Comparative Effectiveness of Technology-Enhanced Simulation Versus Other Instructional Methods: A Systematic Review and Meta-Analysis
The DOI matches its Crossref record; 32 of the 32 references it cites were found in a registry or an index.
Abstract
To determine the comparative effectiveness of technology-enhanced simulation, we summarized the results of studies comparing technology-enhanced simulation training with nonsimulation instruction for health professions learners. We systematically searched databases including MEDLINE, Embase, and Scopus through May 2011 for relevant articles. Working in duplicate, we abstracted information on instructional design, outcomes, and study quality. From 10,903 candidate articles, we identified 92 eligible studies. In random-effects meta-analysis, pooled effect sizes (positive numbers favoring simulation) were as follows: satisfaction outcomes, 0.59 (95% confidence interval, 0.36-0.81; n = 20 studies); knowledge, 0.30 (0.16-0.43; n = 42); time measure of skills, 0.33 (0.00-0.66; n = 14); process measure of skills, 0.38 (0.24-0.52; n = 51); product measure of skills, 0.66 (0.30-1.02; n = 11); time measure of behavior, 0.56 (-0.07 to 1.18; n = 7); process measure of behavior, 0.77 (-0.13 to 1.66; n = 11); and patient effects, 0.36 (-0.06 to 0.78; n = 9). For 5 studies reporting comparative costs, simulation was more expensive and more effective. In summary, in comparison with other instruction, technology-enhanced simulation is associated with small to moderate positive effects.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Measuring inconsistency in meta-analyses
Higgins, J. P. T., Thompson, S. G., Deeks, J. J., & Altman, D. G. (2003) · BMJ · doi:10.1136/bmj.327.7414.557 · Cited by 63,139
Bias in meta-analysis detected by a simple, graphical test
Egger, M., Smith, G. D., Schneider, M., & Minder, C. (1997) · BMJ · doi:10.1136/bmj.315.7109.629 · Cited by 56,722
Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & the PRISMA Group* (2009) · Annals of Internal Medicine · doi:10.7326/0003-4819-151-4-200908180-00135 · Cited by 37,554
Barry Issenberg, S., Mcgaghie, W. C., Petrusa, E. R., Lee Gordon, D., & Scalese, R. J. (2005) · Medical Teacher · doi:10.1080/01421590500046924 · Cited by 3,966 · cited 2×
“Beyond descriptive analysis (2) 89 (97)”
Cognitive Load Theory and Complex Learning: Recent Developments and Future Directions
van Merriënboer, J. J. G., & Sweller, J. (2005) · Educational Psychology Review · doi:10.1007/s10648-005-3951-0 · Cited by 2,206
Cook, D. A., Hatala, R., Brydges, R., Zendejas, B., Szostek, J. H., Wang, A. T., Erwin, P. J., & Hamstra, S. J. (2011) · JAMA · doi:10.1001/jama.2011.1234 · Cited by 2,170
Self-citationMcGaghie, W. C., Issenberg, S. B., Cohen, E. R., Barsuk, J. H., & Wayne, D. B. (2011) · Academic Medicine · doi:10.1097/acm.0b013e318217e119 · Cited by 1,866
The case of the misleading funnel plot
Lau, J., Ioannidis, J. P. A., Terrin, N., Schmid, C. H., & Olkin, I. (2006) · BMJ · doi:10.1136/bmj.333.7568.597 · Cited by 1,766
A critical review of simulation‐based medical education research: 2003–2009
McGaghie, W. C., Issenberg, S. B., Petrusa, E. R., & Scalese, R. J. (2010) · Medical Education · doi:10.1111/j.1365-2923.2009.03547.x · Cited by 1,733
Internet-Based Learning in the Health Professions: A Meta-analysis
Cook, D. A., Levinson, A. J., Garside, S., Dupras, D. M., Erwin, P. J., & Montori, V. M. (2008) · JAMA · doi:10.1001/jama.300.10.1181 · Cited by 1,498
Self-citationSimulation-Based Medical Education: An Ethical Imperative
Ziv, A., Wolpe, P. R., Small, S. D., & Glick, S. (2003) · Academic Medicine · doi:10.1097/00001888-200308000-00006 · Cited by 1,008
Association Between Funding and Quality of Published Medical Education Research
Reed, D. A., Cook, D. A., Beckman, T. J., Levine, R. B., Kern, D. E., & Wright, S. M. (2007) · JAMA · doi:10.1001/jama.298.9.1002 · Cited by 958
Self-citationAdjusting for publication bias in the presence of heterogeneity
Terrin, N., Schmid, C. H., Lau, J., & Olkin, I. (2003) · Statistics in Medicine · doi:10.1002/sim.1461 · Cited by 809
Virtual patients: a critical literature review and proposed next steps
Cook, D. A., & Triola, M. M. (2009) · Medical Education · doi:10.1111/j.1365-2923.2008.03286.x · Cited by 624
Self-citationA Systematic Review of Skills Transfer After Surgical Simulation Training
Sturm, L. P., Windsor, J. A., Cosman, P. H., Cregan, P., Hewett, P. J., & Maddern, G. J. (2008) · Annals of Surgery · doi:10.1097/sla.0b013e318176bf24 · Cited by 621
Computerized Virtual Patients in Health Professions Education: A Systematic Review and Meta-Analysis
Cook, D. A., Erwin, P. J., & Triola, M. M. (2010) · Academic Medicine · doi:10.1097/acm.0b013e3181edfe13 · Cited by 570
Self-citationSurgical Simulation: A Systematic Review
Sutherland, L. M., Middleton, P. F., Anthony, A., Hamdorf, J., Cregan, P., Scott, D., & Maddern, G. J. (2006) · Annals of Surgery · doi:10.1097/01.sla.0000200839.93965.26 · Cited by 536
Cook, D. A., Bordage, G., & Schmidt, H. G. (2008) · Medical Education · doi:10.1111/j.1365-2923.2007.02974.x · Cited by 472
Self-citationGurusamy, K., Aggarwal, R., Palanivelu, L., & Davidson, B. R. (2008) · British Journal of Surgery · doi:10.1002/bjs.6344 · Cited by 420
The Research We Still Are Not Doing: An Agenda for the Study of Computer-Based Learning
Cook, D. A. (2005) · Academic Medicine · doi:10.1097/00001888-200506000-00005 · Cited by 289
Self-citationReed, D. A., Beckman, T. J., Wright, S. M., Levine, R. B., Kern, D. E., & Cook, D. A. (2008) · Journal of General Internal Medicine · doi:10.1007/s11606-008-0664-3 · Cited by 282
Self-citationReflections on experimental research in medical education
Cook, D. A., & Beckman, T. J. (2010) · Advances in Health Sciences Education · doi:10.1007/s10459-008-9117-3 · Cited by 185
Self-citationTime and learning efficiency in Internet-based learning: a systematic review and meta-analysis
Cook, D. A., Levinson, A. J., & Garside, S. (2010) · Advances in Health Sciences Education · doi:10.1007/s10459-010-9231-x · Cited by 183
Self-citationPublication Bias: A Brief Review for Clinicians
Montori, V. M., Smieja, M., & Guyatt, G. H. (2000) · Mayo Clinic Proceedings · doi:10.4065/75.12.1284 · Cited by 171
Simulation in clinical learning
Bradley, P., & Postlethwaite, K. (2003) · Medical Education · doi:10.1046/j.1365-2923.37.s1.1.x · Cited by 169 · cited 1×
“Patient/health care outcomes (3) 9 (10)”
The research we should be doing
Friedman, C. P. (1994) · Academic Medicine · doi:10.1097/00001888-199406000-00005 · Cited by 125
Relative effectiveness of high‐ versus low‐fidelity simulation in learning heart sounds
de Giovanni, D., Roberts, T. E., & Norman, G. R. (2009) · Medical Education · doi:10.1111/j.1365-2923.2009.03398.x · Cited by 116
Evaluating the efficacy of simulators and multimedia for refreshing ACLS skills in India
Delasobera, B. E., Goodwin, T. L., Strehlow, M. C., Gilbert, G. H., D’Souza, P. A., Alok, A., Raje, P., & Mahadevan, S. V. (2009) · Resuscitation · doi:10.1016/j.resuscitation.2009.10.013 · Cited by 68
The Pharmacology of Simulation: A Conceptual Framework to Inform Progress in Simulation Research
Weinger, M. B. (2010) · Simulation in Healthcare The Journal of the Society for Simulation in Healthcare · doi:10.1097/sih.0b013e3181c91d4a · Cited by 49
Petscavage, J. M., Wang, C. L., Schopp, J. G., Paladin, A. M., Richardson, M. L., & Bush, W. H. (2010) · Academic Radiology · doi:10.1016/j.acra.2010.08.014 · Cited by 48
One Drop at a Time: Research to Advance the Science of Simulation
Cook, D. A. (2010) · Simulation in Healthcare The Journal of the Society for Simulation in Healthcare · doi:10.1097/sih.0b013e3181c82aaa · Cited by 47
Self-citationLimpaphayom, K. K., Ajello, C. A., Reinprayoon, D., Lumbiganon, P., & Gaffikin, L. (1997) · British journal of family planning · Cited by 14
Cited by
Cook, D. A., & Reed, D. A. (2015) · Academic Medicine · doi:10.1097/acm.0000000000000786 · Cited by 781
Self-citationCook, D. A., Hamstra, S. J., Brydges, R., Zendejas, B., Szostek, J. H., Wang, A. T., Erwin, P. J., & Hatala, R. (2013) · Medical Teacher · doi:10.3109/0142159x.2012.714886 · Cited by 709
Self-citationCost: The missing outcome in simulation-based medical education research: A systematic review
Zendejas, B., Wang, A. T., Brydges, R., Hamstra, S. J., & Cook, D. A. (2013) · Surgery · doi:10.1016/j.surg.2012.06.025 · Cited by 396
Self-citationState of the Evidence on Simulation-Based Training for Laparoscopic Surgery: A Systematic Review
Zendejas, B., Brydges, R., Hamstra, S. J., & Cook, D. A. (2013) · Annals of Surgery · doi:10.1097/sla.0b013e318288c40b · Cited by 388
Self-citationPatient Outcomes in Simulation-Based Medical Education: A Systematic Review
Zendejas, B., Brydges, R., Wang, A. T., & Cook, D. A. (2013) · Journal of General Internal Medicine · doi:10.1007/s11606-012-2264-5 · Cited by 384
Self-citation
Metadata
- Authors
- Cook, D. A., Brydges, R., Hamstra, S. J., Zendejas, B., Szostek, J. H., Wang, A. T., Erwin, P. J., & Hatala, R.
- Venue
- Simulation in Healthcare: The Journal of the Society for Simulation in Healthcare
- Published
- 2012-10
- Volume
- 7
- Issue
- 5
- Pages
- 308-320
- ISSN
- 1559-2332 (ISSN-L)
- OpenAlex
- W2315348417
- Cited by
- 344
- References
- 32
- FWCI
- 12.83
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.