Virtual Patient Simulations in Health Professions Education: Systematic Review and Meta-Analysis by the Digital Health Education Collaboration
Open accessPublished version of a preprint
The DOI matches its Crossref record; 105 of the 105 references it cites were found in a registry or an index.
Abstract
Background: Virtual patients are interactive digital simulations of clinical scenarios for the purpose of health professions education. There is no current collated evidence on the effectiveness of this form of education. Objective: The goal of this study was to evaluate the effectiveness of virtual patients compared with traditional education, blended with traditional education, compared with other types of digital education, and design variants of virtual patients in health professions education. The outcomes of interest were knowledge, skills, attitudes, and satisfaction. Methods: We performed a systematic review on the effectiveness of virtual patient simulations in pre- and postregistration health professions education following Cochrane methodology. We searched 7 databases from the year 1990 up to September 2018. No language restrictions were applied. We included randomized controlled trials and cluster randomized trials. We independently selected studies, extracted data, and assessed risk of bias and then compared the information in pairs. We contacted study authors for additional information if necessary. All pooled analyses were based on random-effects models. Results: A total of 51 trials involving 4696 participants met our inclusion criteria. Furthermore, 25 studies compared virtual patients with traditional education, 11 studies investigated virtual patients as blended learning, 5 studies compared virtual patients with different forms of digital education, and 10 studies compared different design variants. The pooled analysis of studies comparing the effect of virtual patients to traditional education showed similar results for knowledge (standardized mean difference [SMD]=0.11, 95% CI −0.17 to 0.39, I2=74%, n=927) and favored virtual patients for skills (SMD=0.90, 95% CI 0.49 to 1.32, I2=88%, n=897). Studies measuring attitudes and satisfaction predominantly used surveys with item-by-item comparison. Trials comparing virtual patients with different forms of digital education and design variants were not numerous enough to give clear recommendations. Several methodological limitations in the included studies and heterogeneity contributed to a generally low quality of evidence. Conclusions: Low to modest and mixed evidence suggests that when compared with traditional education, virtual patients can more effectively improve skills, and at least as effectively improve knowledge. The skills that improved were clinical reasoning, procedural skills, and a mix of procedural and team skills. We found evidence of effectiveness in both high-income and low- and middle-income countries, demonstrating the global applicability of virtual patients. Further research should explore the utility of different design variants of virtual patients.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures








Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“as well as enhance diagnostic reasoning [15]”
From Enhancing Psychiatry Training Using an Agentic AI Simulated Consultation Tool: Prospective Cohort Study (2026) · cites this paper as [15]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“This finding aligns with previous studies demonstrating that virtual patients and simulation-based education enhance learners’ ability to organize clinical information and reduce omission errors during data gathering [13].”
From Utilizing generative artificial intelligence to create simulated patient for history taking in gynecology (2026) · cites this paper as [13]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“virtual patients (VPs) can more effectively improve skills and can be at least as effective in enhancing knowledge [21]”
The cited source says what the claim attributes to it.
In the citing paper
“These simulations can replicate various medical scenarios and present students with challenges they may face in real-life situations [13,14].”
From Artificial Intelligence Revolutionizing the Field of Medical Education (2023) · cites this paper as [13]
In the citing paper
“When interacting with virtual patients, medical students can practice their communication and clinical reasoning skills, creating an immersive and interactive virtual environment that mimics real-world scenarios [13,14].”
From Artificial Intelligence Revolutionizing the Field of Medical Education (2023) · cites this paper as [13]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
1 retracted
Virtual patient simulations for health professional education
Kononowicz, A. A., Woodham, L. A., Georg, C., Edelbring, S., Stathakarou, N., Davies, D., Masiello, I., Saxena, N., Car, L. T., Car, J., et al. (2016) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd012194 · Cited by 23
Self-citationRetracted(1983) · Cited by 33,192
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000100 · Cited by 28,164
Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series
(2008) · doi:10.1002/9780470712184 · Cited by 25,048
Wan, X., Wang, W., Liu, J., & Tong, T. (2014) · BMC Medical Research Methodology · doi:10.1186/1471-2288-14-135 · Cited by 11,735
A revision of bloom's taxonomy: an overview
Krathwohl, D. R. (2002) · Theory Into Practice · doi:10.1207/s15430421tip4104_2 · Cited by 8,132
Kirschner, P. A., Sweller, J., & Clark, R. E. (2006) · Educational Psychologist · doi:10.1207/s15326985ep4102_1 · Cited by 7,776 · cited 1×
“freedom cannot be an excuse for neglecting guidance in relation to learning objectives [107,108].”
Frenk, J., Chen, L., Bhutta, Z. A., Cohen, J., Crisp, N., Evans, T., Fineberg, H., Garcia, P., Ke, Y., Kelley, P., et al. (2010) · The Lancet · doi:10.1016/s0140-6736(10)61854-5 · Cited by 5,960
Kraiger, K., Ford, J. K., & Salas, E. (1993) · Journal of Applied Psychology · doi:10.1037/0021-9010.78.2.311 · Cited by 1,831 · cited 1×
“Meta-knowledge (eg, knowledge about the clinical reasoning process itself) was classified as knowledge outcomes following the framework by Kraiger [101].”
Moltu, C., Stefansen, J., Svisdahl, M., & Veseth, M. (2012) · Disability and Rehabilitation · doi:10.3109/09638288.2012.656792 · Cited by 1,247
Research works printed but not linked: 4
- Kurihara, Y, 2004, Stud Health Technol Inform, 107, 894
- Kumta, SM, 2003, J Educ Multimed Hypermedia, 12, 267
- Kinney, P, 1997, J Allied Health, 26, 57
- Weverling, GJ, 1996, Ned Tijdschr Geneeskd, 140, 440
Cited by
Items 701–720 of 720
Alcaíno, Á. A. H. (2026) · Frontiers in Education · doi:10.3389/feduc.2026.1928902
Zhang, W., Liu, Y., Zhu, Y., Lu, X., Wu, L., Yue, M., Hong, X., Xia, O., & Shi, C. (2026) · JMIR Medical Education · doi:10.2196/109752
Fors, U., Nyiringango, G., & Forsberg, E. (2026) · Frontiers in Medicine · doi:10.3389/fmed.2026.1927431
Bustos-Gardea, R., Montes, S. L., González, A. A., Loera, R., & Flores, A. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-44191-1_33
Chamberland, M., Lanthier, L., Setrakian, J., Boulais, I., Labossière, M. N., Cloutier, A., Bergeron, L., & Dubé, T. V. (2026) · Pédagogie médicale · doi:10.1051/pmed/2026025
Online lernen im Medizinstudium – besser als der Hörsaal?
Friederichs, H. (2026) · doi:10.59350/kc2tr-nx884
Temirova, O. (2026) · Ijtimoiy-gumanitar sohada ilmiy-innovatsion tadqiqotlar · doi:10.67227/bgswv985
Ucuzoglu, M. E. (2025) · Marmara University Open Access System
Moreno, C. A. O., Carvajal, A. P., Valdés, L. M. O., & Pereira, W. F. (2026) · Editora Científica Digital eBooks · doi:10.37885/260622141
Moles, M. L., Jarreta, M. B. M., & Azorín, M. I. I. (2026) · Zaguan (Universidad de Zaragoza)
Öztürk, S. Z., & Tontuş, H. Ö. (2026) · Research Square · doi:10.21203/rs.3.rs-10007339/v1
Sadd, R., Reilly, C., Lyford, S., & Wakem, T. A. (2026) · Scope Contemporary Research Topics (Learning and Teaching) · doi:10.34074/scop.4017005
VR-Based Training for Psychiatry Scholars: A Conceptual Architecture for Interviewing and Diagnosis
Totaro, N. G., Vadacca, R., Catalano, C., Catalano, A. A., & Curci, A. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-33506-7_4
Sharofitdinovna, N. P. (2026) · Qo‘qon DPI Ilmiy xabarlar jurnali · doi:10.70728/c.series.ped.v08.i06.108
Müller, F. O., Acuña, M., & Aguilera, M. J. (2026) · SOCIAL REVIEW International Social Sciences Review / Revista Internacional de Ciencias Sociales · doi:10.62701/revsocial.v14.5598
Ganiev, K., & o‘g‘li, A. Z. Z. (2026) · Qo‘qon DPI Ilmiy xabarlar jurnali · doi:10.70728/c.series.ped.v08.i09.056
Supporting information 1 of Online educational interventions in pediatric intensive care medicine
Daniel, D., & Wolbrink, T. A. (2023) · doi:10.3389/fped.2023.1127754.s001
Rovati, L., Gary, P. J., Cubro, E., Dong, Y., Kilickaya, O., Schulte, P. J., Zhong, X., Wörster, M., Kelm, D. J., Gajic, O., et al. (2024) · doi:10.3389/fmed.2023.1336897.s001
Koriťáková, E., Jivram, T., Gîlcă-Blanariu, G.-E., Churová, V., Poulton, E., Ciureanu, A. I., Louis, C., Ștefănescu, G., & Schwarz, D. (2023) · doi:10.3389/feduc.2023.1301269.s006
Metadata
- Authors
- Kononowicz, A. A., Woodham, L. A., Edelbring, S., Stathakarou, N., Davies, D., Saxena, N., Tudor Car, L., Carlstedt-Duke, J., Car, J., & Zary, N.
- Affiliations
- Jagiellonian University (PL)
- St George's, University of London (GB)
- Linköping University (SE)
- Karolinska Institutet (SE)
- University of Warwick (GB)
- National Healthcare Group (SG)
- Nanyang Technological University (SG)
- Corresponding author
- Car, Josip
- ORCID
- Venue
- Journal of Medical Internet Research
- Publisher
- JMIR Publications Inc.
- Published
- 2019-07-02
- Volume
- 21
- Issue
- 7
- Pages
- e14676
- ISSN
- 1438-8871 (ISSN-L)
- PMC
- PMC6632099
- OpenAlex
- W2954595068
- Cited by
- 600
- References
- 105
- Citations by year
- 2026: 143 · 2025: 99 · 2024: 115 · 2023: 70 · 2022: 85 · 2021: 56 · 2020: 27 · 2019: 5
- FWCI
- 5.09
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- Journal of Medical Internet Research (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- St George's Online Research Archive (St George's University of London) (acceptedVersion)
- Warwick Research Archive Portal (University of Warwick) (acceptedVersion)
- Jagiellonian University Repository (Jagiellonian University) (submittedVersion, cc-by-nc-nd)
- KTH Publication Database DiVA (KTH Royal Institute of Technology) (submittedVersion, other-oa)
- DR-NTU (Nanyang Technological University) (submittedVersion, cc-by)
- Funders
- Nanyang Technological University
- Linköpings Universitet
- Karolinska Institutet
- National Healthcare Group
- Topics
- Social Sciences › Education › Simulation-Based Education in Healthcare
- Social Sciences › Education › Innovations in Medical Education
- Health Sciences › Medicine › Surgery › Surgical Simulation and Training
- Keywords
- virtual patients, virtual patient simulation, health professions education, blended learning, digital health education, clinical skills, clinical reasoning, procedural skills, teamwork skills, knowledge acquisition, simulation-based education, low- and middle-income countries, high-income countries, team-based simulation, high-fidelity simulation, low-fidelity simulation
- MeSH terms
- Computer-Assisted Instruction, Computer Simulation, Health Education, Health Occupations, Humans, Patient Simulation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.