Objectives This article reviews and critically evaluates historical and contemporary research on simulation-based medical education (SBME). It also presents and discusses 12 features and best practices of SBME that teachers should know in order to use medical simulation technology to maximum educational benefit.

Methods  This qualitative synthesis of SBME research and scholarship was carried out in two stages. Firstly, we summarised the results of three SBME research reviews covering the years 1969–2003. Secondly, we performed a selective, critical review of SBME research and scholarship published during 2003–2009.

Results  The historical and contemporary research synthesis is reported to inform the medical education community about 12 features and best practices of SBME: (i) feedback; (ii) deliberate practice; (iii) curriculum integration; (iv) outcome measurement; (v) simulation fidelity; (vi) skill acquisition and maintenance; (vii) mastery learning; (viii) transfer to practice; (ix) team training; (x) high-stakes testing; (xi) instructor training, and (xii) educational and professional context. Each of these is discussed in the light of available evidence. The scientific quality of contemporary SBME research is much improved compared with the historical record.

Conclusions  Development of and research into SBME have grown and matured over the past 40 years on substantive and methodological grounds. We believe the impact and educational utility of SBME are likely to increase in the future. More thematic programmes of research are needed. Simulation-based medical education is a complex service intervention that needs to be planned and practised with attention to organisational contexts.

Medical Education 2010: 44: 50–63

A critical review of simulation-based medical education research: 2003-2009

Purpose This article presents a comparison of the effectiveness of traditional clinical education toward skill acquisition goals versus simulation-based medical education (SBME) with deliberate practice (DP). Method This is a quantitative meta-analysis that spans 20 years, 1990 to 2010. A search strategy involving three literature databases, 12 search terms, and four inclusion criteria was used. Four authors independently retrieved and reviewed articles. Main outcome measures were extracted to calculate effect sizes.

/pdf/does-simulation-based-medical-education-with-deliberate-2omk1xvscu.pdf

Does Simulation-Based Medical Education With Deliberate Practice Yield Better Results Than Traditional Clinical Education? A Meta-Analytic Comparative Review of the Evidence

Competency-based medical education (CBME), by definition, necessitates a robust and multifaceted assessment system. Assessment and the judgments or evaluations that arise from it are important at the level of the trainee, the program, and the public. When designing an assessment system for CBME, medical education leaders must attend to the context of the multiple settings where clinical training occurs. CBME further requires assessment processes that are more continuous and frequent, criterion-based, developmental, work-based where possible, use assessment methods and tools that meet minimum requirements for quality, use both quantitative and qualitative measures and methods, and involve the wisdom of group process in making judgments about trainee progress. Like all changes in medical education, CBME is a work in progress. Given the importance of assessment and evaluation for CBME, the medical education community will need more collaborative research to address several major challenges in assessment, including ‘‘best practices’’ in the context of systems and institutional culture and how to best to train faculty to be better evaluators. Finally, we must remember that expertise, not competence, is the ultimate goal. CBME does not end with graduation from a training program, but should represent a career that includes ongoing assessment.

/pdf/the-role-of-assessment-in-competency-based-medical-education-19yuz29elk.pdf

The role of assessment in competency-based medical education

Objective:To determine the effect of a simulation-based mastery learning model on central venous catheter insertion skill and the prevalence of procedure-related complications in a medical intensive care unit over a 1-yr period.Design:Observational cohort study of an educational intervention.Setting

Simulation-based mastery learning reduces complications during central venous catheter insertion in a medical intensive care unit.

Background Simulation-based education improves procedural competence in central venous catheter (CVC) insertion. The effect of simulation-based education in CVC insertion on the incidence of catheter-related bloodstream infection (CRBSI) is unknown. The aim of this study was to determine if simulation-based training in CVC insertion reduces CRBSI. Methods This was an observational education cohort study set in an adult intensive care unit (ICU) in an urban teaching hospital. Ninety-two internal medicine and emergency medicine residents completed a simulation-based mastery learning program in CVC insertion skills. Rates of CRBSI from CVCs inserted by residents in the ICU before and after the simulation-based educational intervention were compared over a 32-month period. Results There were fewer CRBSIs after the simulator-trained residents entered the intervention ICU (0.50 infections per 1000 catheter-days) compared with both the same unit prior to the intervention (3.20 per 1000 catheter-days) ( P  = .001) and with another ICU in the same hospital throughout the study period (5.03 per 1000 catheter-days) ( P  = .001). Conclusions An educational intervention in CVC insertion significantly improved patient outcomes. Simulation-based education is a valuable adjunct in residency education.

https://jamanetwork.com/journals/jamainternalmedicine/articlepdf/1108514/ioi90050_1420_1423.pdf

Use of Simulation-Based Education to Reduce Catheter-Related Bloodstream Infections

BACKGROUND:

Central venous catheter (CVC) insertions are performed frequently by internal medicine residents. Complications, including arterial puncture and pneumothorax, decrease when operators use fewer needle passes to insert the CVC. In this study, we evaluated the effect of simulation-based mastery learning on CVC insertion skill.



DESIGN:

This was a cohort study of internal jugular (IJ) and subclavian (SC) CVC insertions by 41 internal medicine residents rotating through the medical intensive care unit (MICU) over a five-month period. Thirteen traditionally-trained residents were surveyed about the number of needle passes, complications, and procedural self-confidence on CVCs inserted in the MICU. Concurrently, 28 residents completed simulation-based training in IJ and SC CVC insertions. Simulator-trained residents were expected to perform CVC insertions to mastery standards on a central line simulator. Simulator-trained residents then rotated through the MICU and were surveyed regarding CVC placement. The impact of simulation training was assessed by comparing group survey results.



RESULTS:

No resident met the minimum passing score (MPS) (79.1%) for CVC insertion at baseline: mean (M) (IJ) = 48.4%, standard deviation (SD) = 23.1, M(SC) = 45.2%, SD = 26.3. All residents met or exceeded the MPS at testing after simulation training: M(IJ) = 94.8%, SD = 10.0, M(SC) = 91.1%, SD = 17.8 (p < 0.001). In the MICU, simulator-trained residents required fewer needle passes to insert a CVC than traditionally-trained residents: M = 1.79, SD = 1.0 versus M = 2.78, SD = 1.77 (p = 0.04). Simulator-trained residents displayed more self-confidence about their procedural skills: (M = 81, SD = 11 versus M = 68, SD = 20, p = 0.02).



CONCLUSIONS:

Simulation-based mastery learning increased residents' skills in simulated CVC insertion, decreased the number of needle passes when performing actual procedures, and increased resident self-confidence. Journal of Hospital Medicine 2009;4:397–403. © 2009 Society of Hospital Medicine.

/pdf/use-of-simulation-based-mastery-learning-to-improve-the-1nhbqkqf99.pdf

Jayshankar S. Balachandran

Papers

Use of simulation-based mastery learning to improve the quality of central venous catheter placement in a medical intensive care unit.