The DOI matches its Crossref record; 66 of the 66 references it cites were found in a registry or an index.
Augmented, Mixed, and Virtual Reality-Based Head-Mounted Devices for Medical Education: Systematic Review
Open accessAbstract
Background: Augmented reality (AR), mixed reality (MR), and virtual reality (VR), realized as head-mounted devices (HMDs), may open up new ways of teaching medical content for low-resource settings. The advantages are that HMDs enable repeated practice without adverse effects on the patient in various medical disciplines; may introduce new ways to learn complex medical content; and may alleviate financial, ethical, and supervisory constraints on the use of traditional medical learning materials, like cadavers and other skills lab equipment. Objective: We examine the effectiveness of AR, MR, and VR HMDs for medical education, whereby we aim to incorporate a global health perspective comprising low- and middle-income countries (LMICs). Methods: We conducted a systematic review according to PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analysis) and Cochrane guidelines. Seven medical databases (PubMed, Cochrane Library, Web of Science, Science Direct, PsycINFO, Education Resources Information Centre, and Google Scholar) were searched for peer-reviewed publications from January 1, 2014, to May 31, 2019. An extensive search was carried out to examine relevant literature guided by three concepts of extended reality (XR), which comprises the concepts of AR, MR, and VR, and the concepts of medicine and education. It included health professionals who took part in an HMD intervention that was compared to another teaching or learning method and evaluated with regard to its effectiveness. Quality and risk of bias were assessed with the Medical Education Research Study Quality Instrument, the Newcastle-Ottawa Scale-Education, and A Cochrane Risk of Bias Assessment Tool for Non-Randomized Studies of Interventions. We extracted relevant data and aggregated the data according to the main outcomes of this review (knowledge, skills, and XR HMD). Results: A total of 27 studies comprising 956 study participants were included. The participants included all types of health care professionals, especially medical students (n=573, 59.9%) and residents (n=289, 30.2%). AR and VR implemented with HMDs were most often used for training in the fields of surgery (n=13, 48%) and anatomy (n=4, 15%). A range of study designs were used, and quantitative methods were clearly dominant (n=21, 78%). Training with AR- and VR-based HMDs was perceived as salient, motivating, and engaging. In the majority of studies (n=17, 63%), HMD-based interventions were found to be effective. A small number of included studies (n=4, 15%) indicated that HMDs were effective for certain aspects of medical skills and knowledge learning and training, while other studies suggested that HMDs were only viable as an additional teaching tool (n=4, 15%). Only 2 (7%) studies found no effectiveness in the use of HMDs. Conclusions: The majority of included studies suggested that XR-based HMDs have beneficial effects for medical education, whereby only a minority of studies were from LMICs. Nevertheless, as most studies showed at least noninferior results when compared to conventional teaching and training, the results of this review suggest applicability and potential effectiveness in LMICs. Overall, users demonstrated greater enthusiasm and enjoyment in learning with XR-based HMDs. It has to be noted that many HMD-based interventions were small-scale and conducted as short-term pilots. To generate relevant evidence in the future, it is key to rigorously evaluate XR-based HMDs with AR and VR implementations, particularly in LMICs, to better understand the strengths and shortcomings of HMDs for medical education.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: the PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & for the PRISMA Group (2009) · BMJ · doi:10.1136/bmj.b2535 · Cited by 83,823
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & The PRISMA Group (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000097 · Cited by 64,042
Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series
(2008) · doi:10.1002/9780470712184 · Cited by 25,048
Wang, G., Ma, R., Qiao, G., Wada, K., Aizawa, Y., & Satoh, T. (2015) · Integrative Medicine International · doi:10.1159/000368408 · Cited by 18,657
Cochrane Handbook for Systematic Reviews of Interventions
(2019) · doi:10.1002/9781119536604 · Cited by 14,828
Cumpston, M., Li, T., Page, M. J., Chandler, J., Welch, V. A., Higgins, J. P., & Thomas, J. (2019) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.ed000142 · Cited by 7,218
Frenk, J., Chen, L., Bhutta, Z. A., Cohen, J., Crisp, N., Evans, T., Fineberg, H., Garcia, P., Ke, Y., Kelley, P., et al. (2010) · The Lancet · doi:10.1016/s0140-6736(10)61854-5 · Cited by 5,960
Synthesis without meta-analysis (SWiM) in systematic reviews: reporting guideline
Campbell, M., McKenzie, J. E., Sowden, A., Katikireddi, S. V., Brennan, S. E., Ellis, S., Hartmann-Boyce, J., Ryan, R., Shepperd, S., Thomas, J., et al. (2020) · BMJ · doi:10.1136/bmj.l6890 · Cited by 4,628 · cited 1×
“Data synthesis is reported according to the SWiM (Synthesis Without Meta-analysis) reporting guideline [29].”
MethodMethley, A. M., Campbell, S., Chew-Graham, C., McNally, R., & Cheraghi-Sohi, S. (2014) · BMC Health Services Research · doi:10.1186/s12913-014-0579-0 · Cited by 2,706
The role of google scholar in evidence reviews and its applicability to grey literature searching
Haddaway, N. R., Collins, A. M., Coughlin, D., & Kirk, S. (2015) · PLOS ONE · doi:10.1371/journal.pone.0138237 · Cited by 2,387
Investigating and dealing with publication and other biases in meta-analysis
Sterne, J. A. C., Egger, M., & Smith, G. D. (2001) · BMJ · doi:10.1136/bmj.323.7304.101 · Cited by 2,225 · cited 4×
“Quality and risk of bias was assessed with the Medical Education Research Study Quality Instrument (MERSQI), the Newcastle-Ottawa Scale-Education (NOS-E), and “A Cochrane Risk of Bias Assessment Tool for Non-Randomized Studies” (ACROBAT-NRSI) [26-28].”
MethodInfluentialA review of the use of virtual reality head-mounted displays in education and training
Jensen, L., & Konradsen, F. (2018) · Education and Information Technologies · doi:10.1007/s10639-017-9676-0 · Cited by 1,638
Cipresso, P., Giglioli, I. A. C., Raya, M. A., & Riva, G. (2018) · Frontiers in Psychology · doi:10.3389/fpsyg.2018.02086 · Cited by 1,131
The effectiveness of virtual and augmented reality in health sciences and medical anatomy
Moro, C., Štromberga, Z., Raikos, A., & Stirling, A. (2017) · Anatomical Sciences Education · doi:10.1002/ase.1696 · Cited by 1,040
Evaluating Digital Health Interventions
Murray, E., Hekler, E. B., Andersson, G., Collins, L. M., Doherty, A., Hollis, C., Rivera, D. E., West, R., & Wyatt, J. C. (2016) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2016.06.008 · Cited by 847
Cook, D. A., & Reed, D. A. (2015) · Academic Medicine · doi:10.1097/acm.0000000000000786 · Cited by 781
Systematic review on the effectiveness of augmented reality applications in medical training
Barsom, E. Z., Graafland, M., & Schijven, M. P. (2016) · Surgical Endoscopy · doi:10.1007/s00464-016-4800-6 · Cited by 666
Munafo, J., Diedrick, M., & Stoffregen, T. A. (2017) · Experimental Brain Research · doi:10.1007/s00221-016-4846-7 · Cited by 566
Inequities in the Global Health Workforce: The Greatest Impediment to Health in Sub-Saharan Africa
Anyangwe, S. C. E., & Mtonga, C. (2007) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph2007040002 · Cited by 449
The global state of cataract blindness
Lee, C. M., & Afshari, N. A. (2017) · Current Opinion in Ophthalmology · doi:10.1097/icu.0000000000000340 · Cited by 423
Immersive virtual reality as a teaching tool for neuroanatomy
Stepan, K., Zeiger, J., Hanchuk, S., Del Signore, A., Shrivastava, R., Govindaraj, S., & Iloreta, A. (2017) · International Forum of Allergy & Rhinology · doi:10.1002/alr.21986 · Cited by 402
Birckhead, B., Khalil, C., Liu, X., Conovitz, S., Rizzo, A., Danovitch, I., Bullock, K., & Spiegel, B. (2019) · JMIR Mental Health · doi:10.2196/11973 · Cited by 372
Augmented reality in medical education?
Kamphuis, C., Barsom, E., Schijven, M., & Christoph, N. (2014) · Perspectives on Medical Education · doi:10.1007/s40037-013-0107-7 · Cited by 325
Using virtual reality in medical education to teach empathy
Dyer, E., Swartzlander, B. J., & Gugliucci, M. R. (2018) · Journal of the Medical Library Association · doi:10.5195/jmla.2018.518 · Cited by 322
Moro, C., Birt, J., Stromberga, Z., Phelps, C., Clark, J., Glasziou, P., & Scott, A. M. (2021) · Anatomical Sciences Education · doi:10.1002/ase.2049 · Cited by 299
Using Game-Based Virtual Reality with Haptics for Skill Acquisition
Butt, A. L., Kardong-Edgren, S., & Ellertson, A. (2018) · Clinical Simulation in Nursing · doi:10.1016/j.ecns.2017.09.010 · Cited by 282
Effectiveness of Immersive Virtual Reality in Surgical Training—A Randomized Control Trial
Pulijala, Y., Ma, M., Pears, M., Peebles, D., & Ayoub, A. (2018) · Journal of Oral and Maxillofacial Surgery · doi:10.1016/j.joms.2017.10.002 · Cited by 264
Loorbach, N., Peters, O., Karreman, J., & Steehouder, M. (2015) · British Journal of Educational Technology · doi:10.1111/bjet.12138 · Cited by 230
Moro, C., Phelps, C., Redmond, P., & Stromberga, Z. (2021) · British Journal of Educational Technology · doi:10.1111/bjet.13049 · Cited by 220
Albino, J. E. N., Young, S. K., Neumann, L. M., Kramer, G. A., Andrieu, S. C., Henson, L., Horn, B., & Hendricson, W. D. (2008) · Journal of Dental Education · doi:10.1002/j.0022-0337.2008.72.12.tb04620.x · Cited by 212
Ekstrand, C., Jamal, A., Nguyen, R., Kudryk, A., Mann, J., & Mendez, I. (2018) · CMAJ Open · doi:10.9778/cmajo.20170110 · Cited by 189
Asi, Y. M., & Williams, C. (2018) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2017.11.003 · Cited by 187
Huber, T., Paschold, M., Hansen, C., Wunderling, T., Lang, H., & Kneist, W. (2017) · Surgical Endoscopy · doi:10.1007/s00464-017-5500-6 · Cited by 180
Moro, C., Štromberga, Z., & Stirling, A. (2017) · Australasian Journal of Educational Technology · doi:10.14742/ajet.3840 · Cited by 180
Including non‐randomized studies on intervention effects
Reeves, B. C., Deeks, J. J., Higgins, J. P. T., Shea, B., Tugwell, P., Wells, G. A., & on behalf of the Cochrane Non‐Randomized Studies of Interventions Methods Group (2019) · Wiley eBooks · doi:10.1002/9781119536604.ch24 · Cited by 175
360° virtual reality video for the acquisition of knot tying skills: A randomised controlled trial
Yoganathan, S., Finch, D. A., Parkin, E., & Pollard, J. (2018) · International Journal of Surgery · doi:10.1016/j.ijsu.2018.04.002 · Cited by 167
The Applications of Virtual Reality Technology in Medical Groups Teaching.
Samadbeik, M., Yaaghobi, D., Bastani, P., Abhari, S., Rezaee, R., & Garavand, A. (2018) · Europe PMC (PubMed Central) · Cited by 166
Hooper, J. M., Tsiridis, E. E., Feng, J. E., Schwarzkopf, R. M., Waren, D. P., Long, W. J., Poultsides, L. A., Macaulay, W. B., Papagiannakis, G., Kenanidis, E. I., et al. (2019) · The Journal of Arthroplasty · doi:10.1016/j.arth.2019.04.002 · Cited by 153
Harrington, C. M., Kavanagh, D. O., Ballester, G. W., Ballester, A. W., Dicker, P., Traynor, O. J., Hill, A. D. K., & Tierney, S. (2017) · Journal of surgical education · doi:10.1016/j.jsurg.2017.10.010 · Cited by 144
Training the health workforce: scaling up, saving lives
Crisp, N., Gawanas, B., & Sharp, I. (2008) · The Lancet · doi:10.1016/s0140-6736(08)60309-8 · Cited by 138
A Discussion of Virtual Reality As a New Tool for Training Healthcare Professionals
Fertleman, C. R., Aubugeau-Williams, P., Sher, C., Lim, A.-N., Lumley, S., Delacroix, S., & Pan, X. (2018) · Frontiers in Public Health · doi:10.3389/fpubh.2018.00044 · Cited by 132
E-Learning for Medical Education in Sub-Saharan Africa and Low-Resource Settings: Viewpoint
Barteit, S., Jahn, A., Banda, S. S., Bärnighausen, T., Bowa, A. C., Chileshe, G., Guzek, D., Jorge, M. M., Lüders, S., Malunga, G., et al. (2018) · Journal of Medical Internet Research · doi:10.2196/12449 · Cited by 120
Self-citationFirst-Person Point-of-View–Augmented Reality for Central Line Insertion Training
Rochlen, L. R., Levine, R. L., & Tait, A. R. (2016) · Simulation in Healthcare The Journal of the Society for Simulation in Healthcare · doi:10.1097/sih.0000000000000185 · Cited by 118
Virtual and Augmented Reality in Medical Education
Pantelidis, P., Chorti, A. G., Papagiouvanni, I., Paparoidamis, G., Drosos, C., Panagiotakopoulos, T., Lales, G., & Sideris, M. (2018) · InTech eBooks · doi:10.5772/intechopen.71963 · Cited by 110
Kisekka, V., & Giboney, J. S. (2018) · Journal of Medical Internet Research · doi:10.2196/jmir.9014 · Cited by 102
Immersive Virtual Reality in Health Care: Systematic Review of Technology and Disease States
Snoswell, A. J., & Snoswell, C. L. (2019) · JMIR Biomedical Engineering · doi:10.2196/15025 · Cited by 99
Lin, Y., Yau, H., Wang, I., Zheng, C., & Chung, K. (2013) · Clinical Implant Dentistry and Related Research · doi:10.1111/cid.12119 · Cited by 97
Assessing the effectiveness of health interventions for cost-effectiveness analysis
Mandelblatt, J. S., Fryback, D. G., Weinstein, M. C., Russell, L. B., & Gold, M. R. (1997) · Journal of General Internal Medicine · doi:10.1046/j.1525-1497.1997.07107.x · Cited by 96
Parham, G. P., Bing, E. G., Cuevas, A., Fisher, B., Skinner, J., Mwanahamuntu, M., & Sullivan, R. J. (2019) · ecancermedicalscience · doi:10.3332/ecancer.2019.910 · Cited by 90
Zanaboni, P., Ngangue, P., Mbemba, G. I. C., Schopf, T. R., Bergmo, T. S., & Gagnon, M.-P. (2018) · Journal of Medical Internet Research · doi:10.2196/10202 · Cited by 79
Comparative study of a simulated incident with multiple victims and immersive virtual reality
Price, M. F., Escribano, D., Fernández-Pacheco, A. N., Alonso, N. P., Cerón, J. M. C., Ruíz, R. M., García-Collado, Á. J., Ríos, M. P., & Rodríguez, L. J. (2018) · Nurse Education Today · doi:10.1016/j.nedt.2018.09.006 · Cited by 77
Farahani, N., Post, R. P., Duboy, J., Ahmed, I., Kolowitz, B. J., Krinchai, T., Monaco, S. E., Fine, J. L., Hartman, D. J., & Pantanowitz, L. (2016) · Journal of Pathology Informatics · doi:10.4103/2153-3539.181766 · Cited by 76
Huang, C. Y., Thomas, J. B., Alismail, A., Cohen, A., Almutairi, W., Daher, N. S., Terry, M. H., & Tan, L. D. (2018) · Advances in Medical Education and Practice · doi:10.2147/amep.s160704 · Cited by 70
Ultrasound-Guided Central Venous Access Using Google Glass
Wu, T. S., Dameff, C. J., & Tully, J. L. (2014) · Journal of Emergency Medicine · doi:10.1016/j.jemermed.2014.07.045 · Cited by 66
Górski, F., Buń, P., Wichniarek, R., Zawadzki, P., & Hamrol, A. (2016) · Eurasia Journal of Mathematics Science and Technology Education · doi:10.12973/eurasia.2017.00623a · Cited by 66
Barré, J., Michelet, D., Truchot, J., Jolivet, E., Recanzone, T., Stiti, S., Tesnière, A., & Pourcher, G. (2019) · Obesity Surgery · doi:10.1007/s11695-018-03680-9 · Cited by 66
Bairamian, D., Liu, S., & Eftekhar, B. (2019) · Neurosurgery · doi:10.1093/neuros/nyz003 · Cited by 53
Using Low-Cost Virtual Reality Simulation to Build Surgical Capacity for Cervical Cancer Treatment
Bing, E. G., Parham, G. P., Cuevas, A., et al. (2019) · Journal of Global Oncology · doi:10.1200/jgo.18.00263 · Cited by 47
Using a Novel Student-centered Teaching Method to Improve Pharmacy Student Learning
Meng, X., Yang, L., Sun, H., Du, X., Yang, B., & Guo, H.-W. (2017) · American Journal of Pharmaceutical Education · doi:10.5688/ajpe6505 · Cited by 46
eLearning or technology enhanced learning in medical education—Hope, not hype
Goh, P. S. (2016) · Medical Teacher · doi:10.3109/0142159x.2016.1147538 · Cited by 40
Stereopsis, Visuospatial Ability, and Virtual Reality in Anatomy Learning
Luursema, J., Vorstenbosch, M. A. T. M., & Kooloos, J. G. M. (2017) · Anatomy Research International · doi:10.1155/2017/1493135 · Cited by 39
Carter, J., Bababekov, Y. J., & Majmudar, M. D. (2018) · npj Digital Medicine · doi:10.1038/s41746-018-0034-4 · Cited by 28
Using and Combining Learning Theories in Medical Education
Kamel-ElSayed, S. A., & Loftus, S. (2018) · Medical Science Educator · doi:10.1007/s40670-017-0519-9 · Cited by 22
von Gunten, C. F., Mullan, P. B., Nelesen, R. A., Garman, K., McNeal, H., Savoia, M. C., Muchmore, E. A., Ikeda, T., Amundson, S. A., McKennett, M., et al. (2016) · American Journal of Hospice and Palliative Medicine® · doi:10.1177/1049909116655767 · Cited by 21
[A virtual patient to improve doctor-patient communication : reality or fiction ?]
Bragard, I., Guillaume, M., Ghuysen, A., Servotte, J., Ortiz, I., & Pétré, B. (2018) · PubMed · Cited by 8
da Silva, R. L., Stone, E., & Lobaton, E. J. (2019) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc.2019.8857221 · Cited by 3
Cited by
Mystakidis, S. (2022) · Encyclopedia · doi:10.3390/encyclopedia2010031 · Cited by 1,977
Use of Extended Reality in Medical Education: An Integrative Review
Curran, V. R., Xu, X., Aydin, M. Y., & Meruvia-Pastor, O. (2022) · Medical Science Educator · doi:10.1007/s40670-022-01698-4 · Cited by 107
Dy, M., Olazo, K., Lisker, S., Brown, E., Saha, A., Weinberg, J., & Sarkar, U. (2023) · Journal of Medical Internet Research · doi:10.2196/40044 · Cited by 17
Metadata
- Authors
- Barteit, S., Lanfermann, L., Bärnighausen, T., Neuhann, F., & Beiersmann, C.
- Venue
- JMIR Serious Games
- Publisher
- JMIR Publications Inc.
- Published
- 2021-07-08
- Volume
- 9
- Issue
- 3
- Pages
- e29080
- ISSN
- 2291-9279 (ISSN-L)
- OpenAlex
- W3163359570
- Cited by
- 547
- References
- 66
- FWCI
- 11.01
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.