Cited by 75Virtual Reality Applications and ImpactsSimulation-Based Education in HealthcareSurgical Simulation and Training

The effects of immersive virtual reality applications on enhancing the learning outcomes of undergraduate health care students: Systematic review with meta-synthesis

Open access
Liu, Justina Yat Wa, Yin, Yue-Heng, Kor, Patrick Pui Kin, Cheung, Daphne Sze Ki, Zhao, Ivy Yan, Wang, Shanshan, Su, Jing Jing, Christensen, Martin +2 more·2023·Journal of Medical Internet Research

Published version of a preprint

Abstract

Background: Immersive virtual reality (IVR) applications are gaining popularity in health care education. They provide an uninterrupted, scaled environment capable of simulating the full magnitude of sensory stimuli present in busy health care settings and increase students’ competence and confidence by providing them with accessible and repeatable learning opportunities in a fail-safe environment. Objective: This systematic review aimed to evaluate the effects of IVR teaching on the learning outcomes and experiences of undergraduate health care students compared with other teaching methods. Methods: MEDLINE, Embase, PubMed, and Scopus were searched (last search on May 2022) for randomized controlled trials (RCTs) or quasi-experimental studies published in English between January 2000 and March 2022. The inclusion criteria were studies involving undergraduate students majoring in health care, IVR teaching, and evaluations of students’ learning outcomes and experiences. The methodological validity of the studies was examined using the Joanna Briggs Institute standard critical appraisal instruments for RCTs or quasi-experimental studies. The findings were synthesized without a meta-analysis using vote counting as the synthesis metric. A binomial test with P<.05 was used to test for statistical significance using SPSS (version 28; IBM Corp). The overall quality of evidence was evaluated using the Grading of Recommendations Assessment, Development, and Evaluation tool. Results: A total of 17 articles from 16 studies totaling 1787 participants conducted between 2007 and 2021 were included. The undergraduate students in the studies majored in medicine, nursing, rehabilitation, pharmacy, biomedicine, radiography, audiology, or stomatology. The IVR teaching domains included procedural training (13/16, 81%), anatomical knowledge (2/16, 12%), and orientation to the operating room setting (1/16, 6%). The quality of the 75% (12/16) of RCT studies was poor, with unclear descriptions of randomization, allocation concealment, and outcome assessor blinding procedures. The overall risk of bias was relatively low in the 25% (4/16) of quasi-experimental studies. A vote count showed that 60% (9/15; 95% CI 16.3%-67.7%; P=.61) of the studies identified similar learning outcomes between IVR teaching and other teaching approaches regardless of teaching domains. The vote count showed that 62% (8/13) of the studies favored using IVR as a teaching medium. The results of the binomial test (95% CI 34.9%-90%; P=.59) did not show a statistically significant difference. Low-level evidence was identified based on the Grading of Recommendations Assessment, Development, and Evaluation tool. Conclusions: This review found that undergraduate students had positive learning outcomes and experiences after engaging with IVR teaching, although the effects may be similar to those of other forms of virtual reality or conventional teaching methods. Given the identification of risk of bias and low level of the overall evidence, more studies with a larger sample size and robust study design are required to evaluate the effects of IVR teaching. Trial Registration: International prospective register of systematic reviews (PROSPERO) CRD42022313706; https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=313706

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.2196/39989

Cites

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • When Liu et al. (2023) summarised findings across studies using vote counting, the binomial test did not indicate a statistically significant difference, and the authors accepted the null hypothesis.

    “However, when Liu et al. (2023) summarised findings across studies using vote counting, the binomial test did not indicate a statistically significant difference, and the authors accepted the null hypothesis.”

    From Intelligent Immersion: AI and VR Tools for Next-Generation Higher Education (2026) · cites this paper as Liu et al., 2023

  • Liu et al. (2023) report that 62% (8/13) of procedural-skill studies showed similar improvement between immersive VR and other teaching methods, while 38% (5/13) reported significantly better performance in the immersive VR group (95% CI 13.9% to 68.4%; p = 0.58).

    “Using vote counting, Liu et al. (2023) report that 62% (8/13) of procedural-skill studies showed similar improvement between immersive VR and other teaching methods, while 38% (5/13) reported significantly better performance in the immersive VR group (95% CI 13.9% to 68.4%; p = 0.58).”

    From Intelligent Immersion: AI and VR Tools for Next-Generation Higher Education (2026) · cites this paper as Liu et al., 2023

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

The citation lists haven’t been fetched yet

References 60 · Cited by 75

Research works printed but not linked: 2

  1. [23]McKenzie J Brennan S Chapter 12 Synthesizing and presenting findings using other methods Cochrane Handbook for Systematic Reviews of Interventions, Second Edition 2019 Hoboken, New Jersey Wiley
  2. [24]Schunemann HH Higgins J Vist G Glasziou P Skoetz N Akl E Guyatt G Chapter 14 Completing ‘Summary of findings’ tables and grading the certainty of the evidence Cochrane Handbook for Systematic Reviews of Interventions, Second Edition 2019 Hoboken, New Jersey Wiley

Authors
Liu, J. Y. W., Yin, Y.-H., Kor, P. P. K., Cheung, D. S. K., Zhao, I. Y., Wang, S., Su, J. J., Christensen, M., Tyrovolas, S., & Leung, A. Y. M.
Affiliations
Hong Kong Polytechnic University (HK)
Corresponding author
Liu, Justina Yat Wa
Venue
Journal of Medical Internet Research
Published
2023-03-06
Volume
25
Pages
e39989
ISSN
1438-8871 (ISSN-L)
OpenAlex
W4323294703
Cited by
75
References
60
Citations by year
2026: 30 · 2025: 23 · 2024: 16 · 2023: 6
FWCI
2.60
Type
journal article
Language
en
Open access
Licence
cc-by
Locations
  • Journal of Medical Internet Research (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • Figshare (publishedVersion)
  • PolyU Institutional Research Archive (Hong Kong Polytechnic University) (publishedVersion, cc-by)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
Funders
Hong Kong Polytechnic University
Topics
  • Physical Sciences › Computer Science › Human-Computer Interaction › Virtual Reality Applications and Impacts
  • Health Sciences › Medicine › Physiology › Simulation-Based Education in Healthcare
  • Health Sciences › Medicine › Surgery › Surgical Simulation and Training
Keywords
immersive virtual reality, health professions education, learning outcomes, procedural training, simulation-based training, nursing education, medical education, teaching methods comparison, student learning experience, quality of evidence, risk of bias, quality of evidence grading, GRADE, meta-synthesis, anatomical knowledge, pharmacy education, rehabilitation education, radiography education, audiology education
MeSH terms
Health Education, Humans, Learning, Pharmacies, Students

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review