Meta-analytic procedures for social research

The purpose of this meta-analysis is to examine overall effect as well as the impact of selected instructional design principles in the context of virtual reality technology-based instruction (i.e. games, simulation, virtual worlds) in K-12 or higher education settings. A total of 13 studies (N?=?3081) in the category of games, 29 studies (N?=?2553) in the category of games, and 27 studies (N?=?2798) in the category of virtual worlds were meta-analyzed. The key inclusion criteria were that the study came from K-12 or higher education settings, used experimental or quasi-experimental research designs, and used a learning outcome measure to evaluate the effects of the virtual reality-based instruction.Results suggest games (FEM?=?0.77; REM?=?0.51), simulations (FEM?=?0.38; REM?=?0.41), and virtual worlds (FEM?=?0.36; REM?=?0.41) were effective in improving learning outcome gains. The homogeneity analysis of the effect sizes was statistically significant, indicating that the studies were different from each other. Therefore, we conducted moderator analysis using 13 variables used to code the studies. Key findings included that: games show higher learning gains than simulations and virtual worlds. For simulation studies, elaborate explanation type feedback is more suitable for declarative tasks whereas knowledge of correct response is more appropriate for procedural tasks. Students performance is enhanced when they conduct the game play individually than in a group. In addition, we found an inverse relationship between number of treatment sessions learning gains for games.With regards to the virtual world, we found that if students were repeatedly measured it deteriorates their learning outcome gains. We discuss results to highlight the importance of considering instructional design principles when designing virtual reality-based instruction. A comprehensive review of virtual reality-based instruction research.Analysis of the moderation effects of design features in a virtual environment.Using an advance statistical technique of meta-analysis to study the effects.Virtual reality environment is effective for teaching in K-12 and higher education.Results can be used by instructional designers to design the virtual environments.

Effectiveness of virtual reality-based instruction on students' learning outcomes in K-12 and higher education

The world needs young people who are skillful in and enthusiastic about science and who view science as their future career field. Ensuring that we will have such young people requires initiatives that engage students in interesting and motivating science experiences. Today, students can investigate scientific phenomena using the tools, data collection techniques, models, and theories of science in physical laboratories that support interactions with the material world or in virtual laboratories that take advantage of simulations. Here, we review a selection of the literature to contrast the value of physical and virtual investigations and to offer recommendations for combining the two to strengthen science learning.

https://science.sciencemag.org/content/sci/340/6130/305.full.pdf

Physical and Virtual Laboratories in Science and Engineering Education

It represents a universally applicable attitude and skill set everyone, not just computer scientists, would be eager to learn and use.

/pdf/computational-thinking-ji-suan-lun-de-si-kao-3qvv34ha3s.pdf

Computational Thinking 計算論的思考

This review presents the first attempt to synthesize recent (post-2005) empirical studies that focus on directly comparing learning outcome achievement using traditional lab (TL; hands-on) and non-traditional lab (NTL; virtual and remote) participants as experimental groups. Findings suggest that most studies reviewed (n?=?50, 89%) demonstrate student learning outcome achievement is equal or higher in NTL versus TL across all learning outcome categories (knowledge and understanding, inquiry skills, practical skills, perception, analytical skills, and social and scientific communication), though the majority of studies (n?=?53, 95%) focused on outcomes related to content knowledge, with most studies (n?=?40, 71%) employing quizzes and tests as the assessment instrument. Scientific inquiry skills was the least assessed learning objective (n?=?4, 7%), and lab reports/written assignments (n?=?5, 9%) and practical exams (n?=?5, 9%) were the least common assessment instrument. The results of this review raise several important concerns and questions to be addressed by future research. Data supports equal or greater outcome achievement in virtual/remote labs vs. hands-on.A categorization tool (KIPPAS) is presented for meaningful outcome comparisons.The Knowledge and understanding (K) outcome of the KIPPAS tool is most frequently assessed.Quizzes/exams are the most frequently used tools for evaluating outcome achievement.

Learning outcome achievement in non-traditional (virtual and remote) versus traditional (hands-on) laboratories

The aim of this experimental study was to compare learning outcomes of students using a simulation alone (simulation environment) with outcomes of those using a simulation in parallel with real circuits (combination environment) in the domain of electricity, and to explore how learning outcomes in these environments are mediated by implicit (only procedural guidance) and explicit (more structure and guidance for the discovery process) instruction. Matched-quartets were created based on the pre-test results of 50 elementary school students and divided randomly into a simulation implicit (SI), simulation explicit (SE), combination implicit (CI) and combination explicit (CE) conditions. The results demonstrated that the instructional support had an expected effect on students' understanding of electric circuits when they used the simulation alone; pure procedural guidance (SI) was insufficient to promote conceptual understanding, but when the students were given more guidance for the discovery process (SE) they were able to gain significant amount of subject knowledge. A surprising finding was that when the students used the simulation and the real circuits in parallel, the explicit instruction (CE) did not seem to elicit much additional gain for their understanding of electric circuits compared to the implicit instruction (CI). Instead, the explicit instruction slowed down the inquiry process substantially in the combination environment (CE). Although the explicit instruction was able to improve students' conceptual understanding of electrical circuits considerably in the simulation environment, their understanding did not reach the level of the students in the combination environment. These results suggest that when teaching students about electricity, the students can gain better understanding when they have an opportunity to use the simulation and the real circuits in parallel than if they have only a computer simulation available, even when the use of the simulation is supported with the explicit instruction. © 2010 Wiley Periodicals, Inc. J Res Sci Teach 48: 71–93, 2011

A comparison of students' conceptual understanding of electric circuits in simulation only and simulation-laboratory contexts

Computer simulations and laboratory activities have been traditionally treated as substitute or competing methods in science teaching. The aim of this experimental study was to investigate if it would be more beneficial to combine simulation and laboratory activities than to use them separately in teaching the concepts of simple electricity. Based on their pre-test performances, 66 elementary school students were placed into three different learning environments: computer simulation, laboratory exercise and a simulation-laboratory combination. The results showed that the simulation-laboratory combination environment led to statistically greater learning gains than the use of either simulation or laboratory activities alone, and it also promoted students' conceptual understanding most efficiently. There were no statistical differences between simulation and laboratory environments. The results highlight the benefits of using simulation along with hands-on laboratory activities to promote students' understanding of electricity. A simulation can help students to first understand the theoretical principles of electricity; however, in order to promote conceptual change, it is necessary to challenge further students' intuitive conceptions by demonstrating through testing that the laws and principles that are discovered through a simulation also apply in reality.

Fostering Elementary School Students' Understanding of Simple Electricity by Combining Simulation and Laboratory Activities

Learning objects (LOs), generally understood as digital learning resources shared and accessed through the Internet and reused in multiple learning contexts, have aroused enthusiasm in the field of...

Effectiveness of learning objects in various instructional settings

Learning objects (LOs), generally understood as digital learning resources shared through the Internet and reused in multiple learning contexts, have aroused worldwide enthusiasm in the field of educational technology during the last years. Although LOs and LO systems offer tremendous possibilities to improve educational practices, there are many theoretical problems and practical shortcomings which are usually neglected. In this article we introduce the promises of cost‐effectiveness, reusability, modifiability and adaptability associated with LOs. Then we critically look at the problems underlying the LO approach, and provide our own alternative interpretation of LOs as useful elements of meaningful learning environments. Because of their flexible nature, LOs and LO systems can be used to support a variety of learning theories and instructional strategies—both sophisticated and reductionist ones (Parrish, 2004). LOs per se are not necessarily pedagogically functional or non‐functional, but their pedagog...

Tomi Jaakkola

Papers

A comparison of students' conceptual understanding of electric circuits in simulation only and simulation-laboratory contexts

Fostering Elementary School Students' Understanding of Simple Electricity by Combining Simulation and Laboratory Activities

Effectiveness of learning objects in various instructional settings

Promises and Pitfalls of Learning Objects

The Development of Situational Interest during a Digital Mathematics Game.