Transfer of learning and patient outcome in simulated crisis resource management: a systematic review
Open accessThe DOI matches its Crossref record; 38 of the 38 references it cites were found in a registry or an index.
Abstract
PURPOSE: Simulation-based learning is increasingly used by healthcare professionals as a safe method to learn and practice non-technical skills, such as communication and leadership, required for effective crisis resource management (CRM). This systematic review was conducted to gain a better understanding of the impact of simulation-based CRM teaching on transfer of learning to the workplace and subsequent changes in patient outcomes. SOURCE: Studies on CRM, crisis management, crew resource management, teamwork, and simulation published up to September 2012 were searched in MEDLINE(®), EMBASE™, CINAHL, Cochrane Central Register of Controlled Trials, and ERIC. All studies that used simulation-based CRM teaching with outcomes measured at Kirkpatrick Level 3 (transfer of learning to the workplace) or 4 (patient outcome) were included. Studies measuring only learners' reactions or simple learning (Kirkpatrick Level 1 or 2, respectively) were excluded. Two authors independently reviewed all identified titles and abstracts for eligibility. PRINCIPAL FINDINGS: Nine articles were identified as meeting the inclusion criteria. Four studies measured transfer of simulation-based CRM learning into the clinical setting (Kirkpatrick Level 3). In three of these studies, simulation-enhanced CRM training was found significantly more effective than no intervention or didactic teaching. Five studies measured patient outcomes (Kirkpatrick Level 4). Only one of these studies found that simulation-based CRM training made a clearly significant impact on patient mortality. CONCLUSIONS: Based on a small number of studies, this systematic review found that CRM skills learned at the simulation centre are transferred to clinical settings, and the acquired CRM skills may translate to improved patient outcomes, including a decrease in mortality.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: the PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & for the PRISMA Group (2009) · BMJ · doi:10.1136/bmj.b2535 · Cited by 83,823
Preferred reporting items for systematic reviews and meta-analyses: the PRISMA Statement.
(2009) · PubMed Central · Cited by 44,859
Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & the PRISMA Group* (2009) · Annals of Internal Medicine · doi:10.7326/0003-4819-151-4-200908180-00135 · Cited by 37,554
(2014) · Medical Entomology and Zoology · Cited by 17,633
Evaluating Training Programs : The Four Levels
Kirkpatrick, D. L. (2009) · Cited by 4,720
Barry Issenberg, S., Mcgaghie, W. C., Petrusa, E. R., Lee Gordon, D., & Scalese, R. J. (2005) · Medical Teacher · doi:10.1080/01421590500046924 · Cited by 3,966 · cited 1×
“Outcomes were assessed using a modified Kirkpatrick model of outcomes at four levels.(13,16) Papers were included if they measured identifiable CRM skills at Levels 3 and 4, i.”
MethodDavis, D. A., Mazmanian, P. E., Fordis, M., Van Harrison, R., Thorpe, K. E., & Perrier, L. (2006) · JAMA · doi:10.1001/jama.296.9.1094 · Cited by 2,375 · cited 1×
“The decision to include objectively measured change of behaviour at the workplace and to exclude selfassessment (Kirkpatrick Levels 1 and 2 – reaction and knowledge and skills learning, respectively) may have limited our analysis; however, self-assessment is largely recognized as inaccurate for healthcare professional…”
BackgroundSelf-citationCook, D. A., Hatala, R., Brydges, R., Zendejas, B., Szostek, J. H., Wang, A. T., Erwin, P. J., & Hamstra, S. J. (2011) · JAMA · doi:10.1001/jama.2011.1234 · Cited by 2,170
Evaluating Training Programs: The Four Levels
McFarlane, D. A. (2006) · The Journal of Applied Management and Entrepreneurship · Cited by 1,607
A best evidence systematic review of interprofessional education: BEME Guide no. 9
Hammick, M., Freeth, D., Koppel, I., Reeves, S., & Barr, H. (2007) · Medical Teacher · doi:10.1080/01421590701682576 · Cited by 1,163
Self-citationAssociation Between Implementation of a Medical Team Training Program and Surgical Mortality
Neily, J., Mills, P. D., Young-Xu, Y., Carney, B. T., West, P., Berger, D. H., Mazzia, L. M., Paull, D. E., & Bagian, J. P. (2010) · JAMA · doi:10.1001/jama.2010.1506 · Cited by 1,040
Simulation-Based Training in Anesthesia Crisis Resource Management (ACRM): A Decade of Experience
Gaba, D. M., Howard, S. K., Fish, K. J., Smith, B. E., & Sowb, Y. A. (2001) · Simulation & Gaming · doi:10.1177/104687810103200206 · Cited by 733
Virtual reality training for surgical trainees in laparoscopic surgery
Nagendran, M., Gurusamy, K. S., Aggarwal, R., Loizidou, M., & Davidson, B. R. (2013) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd006575.pub3 · Cited by 593
Kirkpatrick’s levels and education ‘evidence’
Yardley, S., & Dornan, T. (2012) · Medical Education · doi:10.1111/j.1365-2923.2011.04076.x · Cited by 477
Shapiro, M. J. (2004) · Quality and Safety in Health Care · doi:10.1136/qhc.13.6.417 · Cited by 465
Teamwork Training Improves the Clinical Care of Trauma Patients
Capella, J., Smith, S., Philp, A., Putnam, T., Gilbert, C., Fry, W., Harvey, E., Wright, A., Henderson, K., Baker, D., et al. (2010) · Journal of Surgical Education · doi:10.1016/j.jsurg.2010.06.006 · Cited by 453
Value of Debriefing during Simulated Crisis Management: Oral versusVideo-assisted Oral Feedback
Savoldelli, G. L., Naik, V. N., Park, J., Joo, H. S., Chow, R., & Hamstra, S. J. (2006) · Anesthesiology · doi:10.1097/00000542-200608000-00010 · Cited by 430
Roizen, M. F. (2012) · Yearbook of Anesthesiology and Pain Management · doi:10.1016/j.yane.2012.02.026 · Cited by 428
Measuring Self-assessment: Current State of the Art
Ward, M., Gruppen, L., & Regehr, G. (2002) · Advances in Health Sciences Education · doi:10.1023/a:1014585522084 · Cited by 406
Andreatta, P., Saxton, E., Thompson, M., & Annich, G. (2011) · Pediatric Critical Care Medicine · doi:10.1097/pcc.0b013e3181e89270 · Cited by 385
Team Training in the Skies: Does Crew Resource Management (CRM) Training Work?
Salas, E., Burke, C. S., Bowers, C. A., & Wilson, K. A. (2001) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872001775870386 · Cited by 371
In Situ, Multidisciplinary, Simulation-Based Teamwork Training Improves Early Trauma Care
Steinemann, S., Berg, B., Skinner, A., DiTulio, A., Anzelon, K., Terada, K., Oliver, C., Ho, H. C., & Speck, C. (2011) · Journal of Surgical Education · doi:10.1016/j.jsurg.2011.05.009 · Cited by 339
How Can I Know What I Don't Know? Poor Self Assessment in a Well-Defined Domain
Eva, K. W., Cunnington, J. P. W., Reiter, H. I., Keane, D. R., & Norman, G. R. (2004) · Advances in Health Sciences Education · doi:10.1023/b:ahse.0000038209.65714.d4 · Cited by 300
Non‐technical skills training to enhance patient safety: a systematic review
Gordon, M., Darbyshire, D., & Baker, P. (2012) · Medical Education · doi:10.1111/j.1365-2923.2012.04343.x · Cited by 293
DeVita, M. A. (2005) · Quality and Safety in Health Care · doi:10.1136/qshc.2004.011148 · Cited by 274
Bruppacher, H. R., Alam, S. K., LeBlanc, V. R., Latter, D., Naik, V. N., Savoldelli, G. L., Mazer, C. D., Kurrek, M. M., & Joo, H. S. (2010) · Anesthesiology · doi:10.1097/aln.0b013e3181d3e31c · Cited by 241
Riley, W., Davis, S., Miller, K., Hansen, H., Sainfort, F., & Sweet, R. (2011) · The Joint Commission Journal on Quality and Patient Safety · doi:10.1016/s1553-7250(11)37046-8 · Cited by 226
Looking in the mirror: Self-debriefing versus instructor debriefing for simulated crises*
Boet, S., Bould, M. D., Bruppacher, H. R., Desjardins, F., Chandra, D. B., & Naik, V. N. (2011) · Critical Care Medicine · doi:10.1097/ccm.0b013e31820eb8be · Cited by 209
Self-citationImproving Teamwork and Communication in Trauma Care Through In Situ Simulations
Miller, D., Crandall, C., Washington, C., & McLaughlin, S. (2012) · Academic Emergency Medicine · doi:10.1111/j.1553-2712.2012.01354.x · Cited by 200
Boet, S., Bould, M. D., Sharma, B., Revees, S., Naik, V. N., Triby, E., & Grantcharov, T. (2013) · Annals of Surgery · doi:10.1097/sla.0b013e31829659e4 · Cited by 180
Self-citationReview article: Medical education research: an overview of methods
Boet, S., Sharda, S., Goldman, J., & Reeves, S. (2012) · Canadian Journal of Anesthesia/Journal canadien d anesthésie · doi:10.1007/s12630-011-9635-y · Cited by 153
Self-citationTrauma Training in Simulation: Translating Skills From SIM Time to Real Time
Knudson, M. M., Khaw, L., Bullard, M., Dicker, R. A., Cohen, M. J. M., Staudenmayer, K., Sadjadi, J., Howard, S. K., Gaba, D. M., & Krummel, T. M. (2008) · The Journal of Trauma: Injury, Infection, and Critical Care · doi:10.1097/ta.0b013e31816275b0 · Cited by 151
Haycock, A., Koch, A. D., Familiari, P., van Delft, F., Dekker, E., Petruzziello, L., Haringsma, J., & Thomas‐Gibson, S. (2009) · Gastrointestinal Endoscopy · doi:10.1016/j.gie.2009.07.017 · Cited by 134
Outcomes from a labor and delivery team training program with simulation component
PHIPPS, M. G., Lindquist, D. G., McConaughey, E., O'Brien, J. A., Raker, C., & Paglia, M. J. (2011) · American Journal of Obstetrics and Gynecology · doi:10.1016/j.ajog.2011.06.046 · Cited by 116
Doumouras, A. G., Keshet, I., Nathens, A. B., Ahmed, N. A., & Hicks, C. M. (2012) · Journal of surgical education · doi:10.1016/j.jsurg.2011.11.004 · Cited by 79
Virtual reality training for surgical trainees in laparoscopic surgery
Gurusamy, K. S., Aggarwal, R. K., Palanivelu, L. M., & Davidson, B. R. (2007) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd006575 · Cited by 65
Learning fibreoptic intubation with a virtual computer program transfers to ‘hands on’ improvement
Boet, S., Bould, M. D., Schaeffer, R., Fischhof, S., Stojeba, N., Naik, V. N., & Diemunsch, P. A. (2009) · European Journal of Anaesthesiology · doi:10.1097/eja.0b013e3283312725 · Cited by 61
Self-citationBorges, B. C. R., Boet, S., Siu, L. W., et al. (2010) · Canadian Journal of Anesthesia/Journal canadien d anesthésie · doi:10.1007/s12630-010-9322-4 · Cited by 57
Self-citation
Cited by
European Resuscitation Council Guidelines for Resuscitation 2015
Perkins, G. D., Handley, A. J., Koster, R. W., Castrén, M., Smyth, M. A., Olasveengen, T., Monsieurs, K. G., Raffay, V., Gräsner, J.-T., Wenzel, V., et al. (2015) · Resuscitation · doi:10.1016/j.resuscitation.2015.07.015 · Cited by 1,287
Buljac-Samardzic, M., Doekhie, K. D., & van Wijngaarden, J. D. H. (2020) · Human Resources for Health · doi:10.1186/s12960-019-0411-3 · Cited by 515
European Resuscitation Council Guidelines for Resuscitation 2015
Greif, R., Lockey, A. S., Conaghan, P., Lippert, A., De Vries, W., Monsieurs, K. G., Ballance, J. H. W., Barelli, A., Biarent, D., Bossaert, L., et al. (2015) · Resuscitation · doi:10.1016/j.resuscitation.2015.07.032 · Cited by 424
Simulation in Medical Education
So, H. Y., Chen, P. P., Wong, G. K. C., & Chan, T. T. N. (2019) · Journal of the Royal College of Physicians of Edinburgh · doi:10.4997/jrcpe.2019.112 · Cited by 360
Fransen, A. F., van de Ven, J., Banga, F. R., Mol, B. W. J., & Oei, S. G. (2020) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd011545.pub2 · Cited by 89
“Boet 2014 included five studies reporting on patient outcome, but only one study could demonstrate a significant impact on patient outcome.”
BackgroundInfluential
Metadata
- Authors
- Boet, S., Bould, M. D., Fung, L., Qosa, H., Perrier, L., Tavares, W., Reeves, S., & Tricco, A. C.
- Venue
- Canadian Journal of Anesthesia/Journal canadien d'anesthésie
- Published
- 2014-03-25
- Volume
- 61
- Issue
- 6
- Pages
- 571-582
- ISSN
- 0832-610X (ISSN-L)
- 1496-8975
- OpenAlex
- W1688858116
- Cited by
- 291
- References
- 38
- FWCI
- 3.08
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.