CoChat

Virtual Patient Simulations in Health Professions Education: Systematic Review and Meta-Analysis by the Digital Health Education Collaboration

Open access
Kononowicz, Andrzej A, Woodham, Luke A, Edelbring, Samuel, Stathakarou, Natalia, Davies, David, Saxena, Nakul, Tudor Car, Lorainne, Carlstedt-Duke, Jan, Car, Josip, Zary, Nabil · 2019 · Journal of Medical Internet Research

Published version of a preprint

The DOI matches its Crossref record; 105 of the 105 references it cites were found in a registry or an index.

Abstract

Background: Virtual patients are interactive digital simulations of clinical scenarios for the purpose of health professions education. There is no current collated evidence on the effectiveness of this form of education. Objective: The goal of this study was to evaluate the effectiveness of virtual patients compared with traditional education, blended with traditional education, compared with other types of digital education, and design variants of virtual patients in health professions education. The outcomes of interest were knowledge, skills, attitudes, and satisfaction. Methods: We performed a systematic review on the effectiveness of virtual patient simulations in pre- and postregistration health professions education following Cochrane methodology. We searched 7 databases from the year 1990 up to September 2018. No language restrictions were applied. We included randomized controlled trials and cluster randomized trials. We independently selected studies, extracted data, and assessed risk of bias and then compared the information in pairs. We contacted study authors for additional information if necessary. All pooled analyses were based on random-effects models. Results: A total of 51 trials involving 4696 participants met our inclusion criteria. Furthermore, 25 studies compared virtual patients with traditional education, 11 studies investigated virtual patients as blended learning, 5 studies compared virtual patients with different forms of digital education, and 10 studies compared different design variants. The pooled analysis of studies comparing the effect of virtual patients to traditional education showed similar results for knowledge (standardized mean difference [SMD]=0.11, 95% CI −0.17 to 0.39, I2=74%, n=927) and favored virtual patients for skills (SMD=0.90, 95% CI 0.49 to 1.32, I2=88%, n=897). Studies measuring attitudes and satisfaction predominantly used surveys with item-by-item comparison. Trials comparing virtual patients with different forms of digital education and design variants were not numerous enough to give clear recommendations. Several methodological limitations in the included studies and heterogeneity contributed to a generally low quality of evidence. Conclusions: Low to modest and mixed evidence suggests that when compared with traditional education, virtual patients can more effectively improve skills, and at least as effectively improve knowledge. The skills that improved were clinical reasoning, procedural skills, and a mix of procedural and team skills. We found evidence of effectiveness in both high-income and low- and middle-income countries, demonstrating the global applicability of virtual patients. Further research should explore the utility of different design variants of virtual patients.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.2196/14676

Cites

105 of 105 references verified0 citation errors · 0 not checkable

Statistics

Figures

Figure 1 Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) study flow diagram.
Figure 1 Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) study flow diagram.CC BY · PubMed Central
Figure 2 Forest plot of virtual patient to traditional education comparison for knowledge outcomes. df: degrees of freedom; IV: interval variable; random: random effects model.
Figure 2 Forest plot of virtual patient to traditional education comparison for knowledge outcomes. df: degrees of freedom; IV: interval variable; random: random effects model.CC BY · PubMed Central
Figure 3 Forest plot of virtual patient blended learning to traditional education comparison for knowledge outcomes. df: degrees of freedom; IV: interval variable; random: random effects model; VP: virtual patients.
Figure 3 Forest plot of virtual patient blended learning to traditional education comparison for knowledge outcomes. df: degrees of freedom; IV: interval variable; random: random effects model; VP: virtual patients.CC BY · PubMed Central
Figure 4 Forest plot of virtual patient to traditional education comparison for skills outcomes. df: degrees of freedom; IV: interval variable; random: random effects model; VP: virtual patients.
Figure 4 Forest plot of virtual patient to traditional education comparison for skills outcomes. df: degrees of freedom; IV: interval variable; random: random effects model; VP: virtual patients.CC BY · PubMed Central
Figure 5 Forest plot of virtual patient blended learning to traditional education comparison for skills outcomes. df: degrees of freedom; IV: interval variable; random: random effects model; VP: virtual patients.
Figure 5 Forest plot of virtual patient blended learning to traditional education comparison for skills outcomes. df: degrees of freedom; IV: interval variable; random: random effects model; VP: virtual patients.CC BY · PubMed Central
Figure 6 Albatross plot for studies comparing virtual patient with traditional education for knowledge outcomes. SMD: standardized mean difference.
Figure 6 Albatross plot for studies comparing virtual patient with traditional education for knowledge outcomes. SMD: standardized mean difference.CC BY · PubMed Central
Figure 7 Albatross plot for studies comparing virtual patient with traditional education for skills outcome. SMD: standardized mean difference.
Figure 7 Albatross plot for studies comparing virtual patient with traditional education for skills outcome. SMD: standardized mean difference.CC BY · PubMed Central
Figure 8 Risk of bias summary (+ low risk of bias; - high risk of bias, ? unclear risk of bias).
Figure 8 Risk of bias summary (+ low risk of bias; - high risk of bias, ? unclear risk of bias).CC BY · PubMed Central

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

1 retracted

Show all 105 references

Research works printed but not linked: 4

  1. Kurihara, Y, 2004, Stud Health Technol Inform, 107, 894
  2. Kumta, SM, 2003, J Educ Multimed Hypermedia, 12, 267
  3. Kinney, P, 1997, J Allied Health, 26, 57
  4. Weverling, GJ, 1996, Ned Tijdschr Geneeskd, 140, 440

Cited by

Metadata

Authors
Kononowicz, A. A., Woodham, L. A., Edelbring, S., Stathakarou, N., Davies, D., Saxena, N., Tudor Car, L., Carlstedt-Duke, J., Car, J., & Zary, N.
Affiliations
  • Jagiellonian University (PL)
  • St George's, University of London (GB)
  • Linköping University (SE)
  • Karolinska Institutet (SE)
  • University of Warwick (GB)
  • National Healthcare Group (SG)
  • Nanyang Technological University (SG)
Corresponding author
Car, Josip
Venue
Journal of Medical Internet Research
Published
2019-07-02
Volume
21
Issue
7
Pages
e14676
ISSN
1438-8871 (ISSN-L)
OpenAlex
W2954595068
Cited by
600
References
105
Citations by year
2026: 143 · 2025: 99 · 2024: 115 · 2023: 70 · 2022: 85 · 2021: 56 · 2020: 27 · 2019: 5
FWCI
5.09
Type
journal article
Language
en
Open access
Licence
cc-by
Locations
  • Journal of Medical Internet Research (publishedVersion, cc-by)
  • Europe PMC (PubMed Central) (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • St George's Online Research Archive (St George's University of London) (acceptedVersion)
  • Warwick Research Archive Portal (University of Warwick) (acceptedVersion)
  • Jagiellonian University Repository (Jagiellonian University) (submittedVersion, cc-by-nc-nd)
  • KTH Publication Database DiVA (KTH Royal Institute of Technology) (submittedVersion, other-oa)
  • DR-NTU (Nanyang Technological University) (submittedVersion, cc-by)
Funders
  • Nanyang Technological University
  • Linköpings Universitet
  • Karolinska Institutet
  • National Healthcare Group
Topics
  • Social Sciences › Education › Simulation-Based Education in Healthcare
  • Social Sciences › Education › Innovations in Medical Education
  • Health Sciences › Medicine › Surgery › Surgical Simulation and Training
Keywords
virtual patients, virtual patient simulation, health professions education, blended learning, digital health education, clinical skills, clinical reasoning, procedural skills, teamwork skills, knowledge acquisition, simulation-based education, low- and middle-income countries, high-income countries, team-based simulation, high-fidelity simulation, low-fidelity simulation
MeSH terms
Computer-Assisted Instruction, Computer Simulation, Health Education, Health Occupations, Humans, Patient Simulation

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.