SUMMARY Review date: 1969 to 2003, 34 years. Background and context: Simulations are now in widespread use in medical education and medical personnel evaluation. Outcomes research on the use and effectiveness of simulation technology in medical education is scattered, inconsistent and varies widely in methodological rigor and substantive focus. Objectives: Review and synthesize existing evidence in educational science that addresses the question, ‘What are the features and uses of high-fidelity medical simulations that lead to most effective learning?’. Search strategy: The search covered five literature databases (ERIC, MEDLINE, PsycINFO, Web of Science and Timelit) and employed 91 single search terms and concepts and their Boolean combinations. Hand searching, Internet searches and attention to the ‘grey literature’ were also used. The aim was to perform the most thorough literature search possible of peer-reviewed publications and reports in the unpublished literature that have been judged for academic quality. Inclusion and exclusion criteria: Four screening criteria were used to reduce the initial pool of 670 journal articles to a focused set of 109 studies: (a) elimination of review articles in favor of empirical studies; (b) use of a simulator as an educational assessment or intervention with learner outcomes measured quantitatively; (c) comparative research, either experimental or quasi-experimental; and (d) research that involves simulation as an educational intervention. Data extraction: Data were extracted systematically from the 109 eligible journal articles by independent coders. Each coder used a standardized data extraction protocol. Data synthesis: Qualitative data synthesis and tabular presentation of research methods and outcomes were used. Heterogeneity of research designs, educational interventions, outcome measures and timeframe precluded data synthesis using meta-analysis. Headline results: Coding accuracy for features of the journal articles is high. The extant quality of the published research is generally weak. The weight of the best available evidence suggests that high-fidelity medical simulations facilitate learning under the right conditions. These include the following:

/pdf/features-and-uses-of-high-fidelity-medical-simulations-that-51wb8k5opy.pdf

Features and uses of high-fidelity medical simulations that lead to effective learning: a BEME systematic review

OBJECTIVE: The purpose of this study was to analyze the factors that influence local recurrence after radiofrequency coagulation of liver tumors. SUMMARY BACKGROUND DATA: Local recurrence rate varies widely between 2% and 60%. Apart from tumor size as an important risk factor for local recurrence, little is known about the impact of other factors. METHODS: An exhaustive literature search was carried out for the period from January 1, 1990 to January 1, 2004. Only series with a minimal follow-up of 6 months and/or mean follow-up of 12 months were included. Univariate and multivariate meta-analyses were carried out. RESULTS: Ninety-five independent series were included, allowing the analysis of the local recurrence rate of 5224 treated liver tumors. In a univariate analysis, tumor-dependent factors with significantly less local recurrences were: smaller size, neuroendocrine metastases, nonsubcapsular location, and location away from large vessels. Physician-dependent favorable factors were: surgical (open or laparoscopic) approach, vascular occlusion, general anesthesia, a 1-cm intentional margin, and a greater physician experience. In a multivariate analysis, significantly less local recurrences were observed for small size (P < 0.001) and a surgical (versus percutaneous) approach (P < 0.001). CONCLUSIONS: Radiofrequency coagulation by laparoscopy or laparotomy results in superior local control, independent of tumor size. The percutaneous route should mainly be reserved for patients who cannot tolerate a laparoscopy or laparotomy. The short-term benefits of less invasiveness for the percutaneous route do not outweigh the longer-term higher risk of local recurrence.

/pdf/local-recurrence-after-hepatic-radiofrequency-coagulation-45go5sqeox.pdf

Local recurrence after hepatic radiofrequency coagulation: multivariate meta-analysis and review of contributing factors.

Background: Although technology-enhanced simulation is increasingly used in health professions education, features of effective simulation-based instructional design remain uncertain. Aims: Evaluate the effectiveness of instructional design features through a systematic review of studies comparing different simulation-based interventions. Methods: We systematically searched MEDLINE, EMBASE, CINAHL, ERIC, PsycINFO, Scopus, key journals, and previous review bibliographies through May 2011. We included original research studies that compared one simulation intervention with another and involved health professions learners. Working in duplicate, we evaluated study quality and abstracted information on learners, outcomes, and instructional design features. We pooled results using random effects meta-analysis. Results: From a pool of 10 903 articles we identified 289 eligible studies enrolling 18 971 trainees, including 208 randomized trials. Inconsistency was usually large (I 2 4 50%). For skills outcomes, pooled effect sizes ( positive numbers favoring the instructional design feature) were 0.68 for range of difficulty (20 studies; p5 0.001), 0.68 for repetitive practice (7 studies; p ¼ 0.06), 0.66 for distributed practice (6 studies; p ¼ 0.03), 0.65 for interactivity (89 studies; p5 0.001), 0.62 for multiple learning strategies (70 studies; p5 0.001), 0.52 for individualized learning (59 studies; p5 0.001), 0.45 for mastery learning (3 studies; p ¼ 0.57), 0.44 for feedback (80 studies; p5 0.001), 0.34 for longer time (23 studies; p ¼ 0.005), 0.20 for clinical variation (16 studies; p ¼ 0.24), and � 0.22 for group training (8 studies; p ¼ 0.09). Conclusions: These results confirm quantitatively the effectiveness of several instructional design features in simulation-based education.

https://www.tandfonline.com/doi/pdf/10.3109/0142159X.2012.714886

Comparative effectiveness of instructional design features in simulation-based education: Systematic review and meta-analysis

Objective:
To evaluate the effectiveness of surgical simulation compared with other methods of surgical training.

Surgical simulation: a systematic review.

BACKGROUND: Surgeons are increasingly being scrutinized for their performance and there is growing interest in objective assessment of technical skills. The purpose of this study was to review all evidence for these methods, in order to provide a guideline for use in clinical practice. METHODS: A systematic search was performed using PubMed and Web of Science for studies addressing the validity and reliability of methods for objective skills assessment within surgery and gynaecology only. The studies were assessed according to the Oxford Centre for Evidence-based Medicine levels of evidence. RESULTS: In total 104 studies were included, of which 20 (19.2 per cent) had a level of evidence 1b or 2b. In 28 studies (26.9 per cent), the assessment method was used in the operating room. Virtual reality simulators and Objective Structured Assessment of Technical Skills (OSATS) have been studied most. Although OSATS is seen as the standard for skills assessment, only seven studies, with a low level of evidence, addressed its use in the operating room. CONCLUSION: Based on currently available evidence, most methods of skills assessment are valid for feedback or measuring progress of training, but few can be used for examination or credentialing. The purpose of the assessment determines the choice of method.

Objective assessment of technical surgical skills

Training on a video trainer or computer-based minimally invasive surgery trainer leads to improved benchtop laparoscopic skill. Recently, improved operative performance from practice on a video trainer was reported. The purpose of this study was three fold: (a) to compare psychomotor skill improvement after training on a virtual reality (VR) system with that after training on a video-trainer, (VT) (b) to evaluate whether skills learned on the one training system are transferable to the other, and (c) to evaluate whether VR or VT training improves operative performance. For the study, 50 junior surgery residents completed baseline skill testing on both the VR and VT systems. These subjects then were randomized to either a VR or VT structured training group. After practice, the subjects were tested again on their VR and VT skills. To assess the effect of practice on operative performance, all second-year residents (n = 19) were evaluated on their operative performance during a laparoscopic cholecystectomy before and after skill training. Data are expressed as percentage of improvement in mean score/time. Analysis was performed by Student's paired t-test. The VR training group showed improvement of 54% on the VR posttest, as compared with 55% improvement by the VT group. The VR training group improved more on the VT posttest tasks (36%) than the VT training group improved on the VR posttest tasks (17%) (p <0.05). Operative performance improved only in the VR training group (p <0.05). Psychomotor skillsimprove after training on both VR and VT, and skills may be transferable. Furthermore, training on a minimally invasive surgery trainer, virtual reality system may improve operative performance during laparoscopic cholecystectomy.

Comparison of video trainer and virtual reality training systems on acquisition of laparoscopic skills.

Background and Purpose: Global assessment by direct observation has been validated for evaluating operative performance of surgery residents after formal skills training but is time-consuming. The purpose of this study was to compare global assessment performed from edited videotape with scores from direct observation. Materials and Methods: Junior surgery residents (N = 22) were randomized to 2 weeks of formal videotrainer skills training or a control group. Laparoscopic cholecystectomy was performed at the beginning and end of the rotation, and global assessment scores were compared for the training and control groups. Laparoscopic videotapes were edited: initial (2 minutes), cystic duct/artery (6 minutes), and fossa dissection (2 minutes). Two independent raters performed both direct observation and videotape assessments, and scores were compared for each rater and for interrater reliability using a Spearman correlation. Results: Correlation coefficients for videotape versus direct observation for five...

Measuring operative performance after laparoscopic skills training: edited videotape versus direct observation.

Background
The purpose of this study was to determine the effect of hepatic inflow occlusion (the Pringle maneuver) on laparoscopic radiofrequency (RF) ablation.

The effect of hepatic inflow occlusion on laparoscopic radiofrequency ablation using simulated tumors.

Background: Surgeons are now being assisted by robotic systems in a wide range of laparoscopic procedures. Some reports have suggested that robot-assisted camera control (RACC) may be superior to a human driver in terms of quality of view and directional precision, as well as long-term cost savings. Therefore, we setout to investigate the impact of RACC of surgeon motion efficiency. Methods: Twenty pigs were randomized to undergo a standardized laparoscopic Nissen fundoplication with either a human or RACC system, the AESOP 2000. All procedures were performed by the same surgical fellow. Time was recorded for dissection and suture phases. Inertial motion sensors were used to monitor both the surgeon's hands and the camera. Digitized data were analyzed to produce summary measures related to overall motion. Results: The operative times were slightly longer with RACC (mean 80.2 ± 20.6 vs 73.1 ± 15.4 min, not significant). With regard to operative times and surgeon motion measures, the only statistically significant differences were for setup and breakdown times, which contributed <15% to the total time for the procedure. Conclusion: In terms of impact on surgeon motion efficiency and operative time under normal surgical conditions, RACC is essentially the same as an expert human driver. However, careful planning and structuring of the surgical suite may yield some small gains in operative time.

S. T. Tesfay

Papers

Comparison of video trainer and virtual reality training systems on acquisition of laparoscopic skills.

Measuring operative performance after laparoscopic skills training: edited videotape versus direct observation.

The effect of hepatic inflow occlusion on laparoscopic radiofrequency ablation using simulated tumors.

Surgeon workload and motion efficiency with robot and human laparoscopic camera control.

Developing A Proficiency-Based Training Program For Robotic Surgery