Learning Outcomes of Immersive Technologies in Health Care Student Education: Systematic Review of the Literature
Open accessPublished version of a preprint
The DOI matches its Crossref record; 71 of the 71 references it cites were found in a registry or an index.
Abstract
Background: There is a lack of evidence in the literature regarding the learning outcomes of immersive technologies as educational tools for teaching university-level health care students. Objective: The aim of this review is to assess the learning outcomes of immersive technologies compared with traditional learning modalities with regard to knowledge and the participants’ learning experience in medical, midwifery, and nursing preclinical university education. Methods: A systematic review was conducted according to the Cochrane Collaboration guidelines. Randomized controlled trials comparing traditional learning methods with virtual, augmented, or mixed reality for the education of medicine, nursing, or midwifery students were evaluated. The identified studies were screened by 2 authors independently. Disagreements were discussed with a third reviewer. The quality of evidence was assessed using the Medical Education Research Study Quality Instrument (MERSQI). The review protocol was registered with PROSPERO (International Prospective Register of Systematic Reviews) in April 2020. Results: Of 15,627 studies, 29 (0.19%) randomized controlled trials (N=2722 students) were included and evaluated using the MERSQI tool. Knowledge gain was found to be equal when immersive technologies were compared with traditional learning modalities; however, the learning experience increased with immersive technologies. The mean MERSQI score was 12.64 (SD 1.6), the median was 12.50, and the mode was 13.50. Immersive technology was predominantly used to teach clinical skills (15/29, 52%), and virtual reality (22/29, 76%) was the most commonly used form of immersive technology. Knowledge was the primary outcome in 97% (28/29) of studies. Approximately 66% (19/29) of studies used validated instruments and scales to assess secondary learning outcomes, including satisfaction, self-efficacy, engagement, and perceptions of the learning experience. Of the 29 studies, 19 (66%) included medical students (1706/2722, 62.67%), 8 (28%) included nursing students (727/2722, 26.71%), and 2 (7%) included both medical and nursing students (289/2722, 10.62%). There were no studies involving midwifery students. The studies were based on the following disciplines: anatomy, basic clinical skills and history-taking skills, neurology, respiratory medicine, acute medicine, dermatology, communication skills, internal medicine, and emergency medicine. Conclusions: Virtual, augmented, and mixed reality play an important role in the education of preclinical medical and nursing university students. When compared with traditional educational modalities, the learning gain is equal with immersive technologies. Learning outcomes such as student satisfaction, self-efficacy, and engagement all increase with the use of immersive technology, suggesting that it is an optimal tool for education.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Second, immersive technology (ie, devices that provide a sense of realism and immersion in the computer-generated world through sensory stimuli) such as VR promotes students’ interest with enhanced satisfaction, self-efficacy, and engagement [59].”
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: the PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & for the PRISMA Group (2009) · BMJ · doi:10.1136/bmj.b2535 · Cited by 83,823
Preferred reporting items for systematic reviews and meta-analyses: the PRISMA Statement.
(2009) · PubMed Central · Cited by 44,859
Cochrane Handbook for Systematic Reviews of Interventions
(2019) · doi:10.1002/9781119536604 · Cited by 14,828
Cumpston, M., Li, T., Page, M. J., Chandler, J., Welch, V. A., Higgins, J. P., & Thomas, J. (2019) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.ed000142 · Cited by 7,218
The effectiveness of virtual and augmented reality in health sciences and medical anatomy
Moro, C., Štromberga, Z., Raikos, A., & Stirling, A. (2017) · Anatomical Sciences Education · doi:10.1002/ase.1696 · Cited by 1,040
Association Between Funding and Quality of Published Medical Education Research
Reed, D. A., Cook, D. A., Beckman, T. J., Levine, R. B., Kern, D. E., & Wright, S. M. (2007) · JAMA · doi:10.1001/jama.298.9.1002 · Cited by 958 · cited 2×
“The authors used appropriate statistical analysis in all studies according to the MERSQI [59].”
Cook, D. A., & Reed, D. A. (2015) · Academic Medicine · doi:10.1097/acm.0000000000000786 · Cited by 781 · cited 1×
“We used the Medical Education Research Study Quality Instrument (MERSQI) to evaluate the study design of the RCTs [30].”
Systematic review of serious games for medical education and surgical skills training
Graafland, M., Schraagen, J. M., & Schijven, M. P. (2012) · British Journal of Surgery · doi:10.1002/bjs.8819 · Cited by 676 · cited 1×
“In addition, it facilitates practice without the risk of human harm and also helps build professional skills and teamwork [18,19].”
AMEE Guide 32: e-Learning in medical education Part 1: Learning, teaching and assessment
Ellaway, R., & Masters, K. (2008) · Medical Teacher · doi:10.1080/01421590802108331 · Cited by 652 · cited 1×
“The Association for Medical Education in Europe has previously published guidance on e-learning in medical education: “Designs for effective medical e-learning, therefore, need to mirror the dynamics and details of real-world practice as well as affording effective learning opportunities” [6].”
Learning and teaching in the clinical environment
Spencer, J. (2003) · BMJ · doi:10.1136/bmj.326.7389.591 · Cited by 602 · cited 1×
“This can be difficult to balance on a day-to-day basis because of the fast-paced nature of medicine, time constraints for clinical teaching in busy wards, and competition between students [67].”
Clinical virtual simulation in nursing education: randomized controlled trial
Padilha, J. M., Machado, P. P., Ribeiro, A., Ramos, J., & Costa, P. (2019) · Journal of Medical Internet Research · doi:10.2196/11529 · Cited by 550 · cited 5×
“In addition, VR, AR, and MR provide an enhanced learning experience based on the secondary outcomes of the studies included in this review [12,26,33,36,38,40,45].”
InfluentialEffectiveness of virtual reality in nursing education: meta-analysis
Chen, F.-Q., Leng, Y.-F., Ge, J.-F., Wang, D.-W., Li, C., Chen, B., & Sun, Z.-L. (2020) · Journal of Medical Internet Research · doi:10.2196/18290 · Cited by 535 · cited 1×
“In addition, they create an environment for repeated practice in a safe space without harm to patients [65,66].”
Implementing the Four Levels: A Practical Guide for Effective Evaluation of Training Programs
Kirkpatrick, D. L., & Kirkpatrick, J. D. (2007) · Cited by 507
Nicholson, D. T., Chalk, C., Funnell, W. R. J., & Daniel, S. J. (2006) · Medical Education · doi:10.1111/j.1365-2929.2006.02611.x · Cited by 473 · cited 1×
“The favored use of VR may be due in part to the widespread availability of cost-effective 3D software and web-based material for the development of anatomy tools [14,60].”
AMEE Guide No. 25: The assessment of learning outcomes for the competent and reflective physician
Shumway, J. M., & Harden, R. M. (2003) · Medical Teacher · doi:10.1080/0142159032000151907 · Cited by 461 · cited 1×
“According to the Association for Medical Education in Europe, “assessment tools selected should be valid, reliable, practical and have an appropriate impact on student learning” [69].”
Zhao, J., Xu, X., Jiang, H., & Ding, Y. (2020) · BMC Medical Education · doi:10.1186/s12909-020-1994-z · Cited by 445 · cited 1×
“Anatomy was the most common topic taught with immersive technologies, which may be because of the ability of immersive technologies to enhance the understanding of complex body processes that cannot be visualized [24].”
Immersive virtual reality as a teaching tool for neuroanatomy
Stepan, K., Zeiger, J., Hanchuk, S., Del Signore, A., Shrivastava, R., Govindaraj, S., & Iloreta, A. (2017) · International Forum of Allergy & Rhinology · doi:10.1002/alr.21986 · Cited by 402 · cited 3×
“A full list of the validated scales used in the RCTs in this review is provided in Multimedia Appendix 2 [26,33,34,36-38,41 ,42 ,45-49”
Developing serious games for cultural heritage: a state-of-the-art review
Anderson, E. F., McLoughlin, L., Liarokapis, F., Peters, C., Petridis, P., & de Freitas, S. (2010) · Virtual Reality · doi:10.1007/s10055-010-0177-3 · Cited by 357 · cited 1×
“He described The Ultimate Display , a VR system that could simulate reality [8], and his paper described core concepts that are the foundation of VR use today.”
A Model for Understanding How Virtual Reality Aids Complex Conceptual Learning
Salzman, M. C., Dede, C., Loftin, R. B., & Chen, J. (1999) · Presence: Teleoperators and Virtual Environments · doi:10.1162/105474699566242 · Cited by 330 · cited 2×
“Immersive technologies are thought to provide pedagogy based on the constructivist theory and experiential learning, creating an environment that aids visual learners and enables students to learn by doing, develop creativity, and increase understanding of invisible concepts [5].”
Maresky, H. S., Oikonomou, A., Ali, I., Ditkofsky, N., Pakkal, M., & Ballyk, B. (2019) · Clinical Anatomy · doi:10.1002/ca.23292 · Cited by 297 · cited 2×
“To date, there has been a multitude of publications detailing the development and implementation of immersive tools, in addition to demonstrating the benefits of VR, AR and MR technology in medical, nursing and midwifery education [12-17].”
Intravenous catheter training system: Computer-based education versus traditional learning methods
Engum, S. A., Jeffries, P., & Fisher, L. (2003) · The American Journal of Surgery · doi:10.1016/s0002-9610(03)00109-0 · Cited by 248
Massive Open Online Courses on Health and Medicine: Review
Liyanagunawardena, T. R., & Williams, S. A. (2014) · Journal of Medical Internet Research · doi:10.2196/jmir.3439 · Cited by 241
Akl, E. A., Pretorius, R. W., Sackett, K., Erdley, W. S., Bhoopathi, P. S., Alfarah, Z., & Schünemann, H. J. (2010) · Medical Teacher · doi:10.3109/01421590903473969 · Cited by 238 · cited 1×
“Similarly, another review looked at serious games used in medical education and found that the evidence was moderate to support the use of immersive technology, stating that it should not replace traditional learning tools [21-25].”
Augmented reality in medical education: a systematic review
Tang, K. S., Cheng, D. L., Mi, E., & Greenberg, P. B. (2019) · Canadian Medical Education Journal · doi:10.36834/cmej.61705 · Cited by 222
Moro, C., Phelps, C., Redmond, P., & Stromberga, Z. (2021) · British Journal of Educational Technology · doi:10.1111/bjet.13049 · Cited by 220 · cited 1×
“A full list of the validated scales used in the RCTs in this review is provided in Multimedia Appendix 2 [26,33,34,36-38,41 ,42 ,45-49”
Hansen, M. M. (2008) · Journal of Medical Internet Research · doi:10.2196/jmir.1051 · Cited by 215
Educational Technologies in Problem-Based Learning in Health Sciences Education: A Systematic Review
Jin, J., & Bridges, S. M. (2014) · Journal of Medical Internet Research · doi:10.2196/jmir.3240 · Cited by 197 · cited 1×
“Educational technology is changing the way in which we learn today, and its purpose is to ultimately improve education [1,2].”
Liaw, S. Y., Ooi, S. W., Rusli, K. D. B., Lau, T. C., Tam, W. W. S., & Chua, W. L. (2020) · Journal of Medical Internet Research · doi:10.2196/17279 · Cited by 191 · cited 2×
“…Apple Inc)–based app mArble Der-ma (m-ARBLE-dermatology) Germany Noll et al [48] No difference between groups in communication performance scores [49] Interprofessional skill training 120 3D virtual hospital devel-oped—CREATIVE Singapore Liaw et al [49] Better performance scores in VR flash card…”
Digital Education in Health Professions: The Need for Overarching Evidence Synthesis
Car, J., Carlstedt-Duke, J., Tudor Car, L., Posadzki, P., Whiting, P., Zary, N., Atun, R., Majeed, A., Campbell, J., & Digital Health Education Collaboration (2019) · Journal of Medical Internet Research · doi:10.2196/12913 · Cited by 166 · cited 1×
“As outlined by the Digital Health Education Collaboration, there is a need for a strong evidence base to guide the development of immersive educational tools so that the learning goals and outcomes are in line with national and international standards [20].”
Peterson, D. C., & Mlynarczyk, G. S. A. (2016) · Anatomical Sciences Education · doi:10.1002/ase.1612 · Cited by 159 · cited 1×
“Educational technology is changing the way in which we learn today, and its purpose is to ultimately improve education [1,2].”
Stereoscopic neuroanatomy lectures using a three-dimensional virtual reality environment
Kockro, R. A., Amaxopoulou, C., Killeen, T., Wagner, W., Reisch, R., Schwandt, E., Gutenberg, A., Giese, A., Stofft, E., & Stadie, A. T. (2015) · Annals of Anatomy - Anatomischer Anzeiger · doi:10.1016/j.aanat.2015.05.006 · Cited by 158 · cited 2×
“…Neuroanatomy 169 Virtual 3DM developed from MRI and CT scans and Dex-troBeam system (Bracco Advanced Medical Technologies) Switzerland Kockro et al [52] 3D group had higher scores, and participants had a preference for 3D training [53] Liver anatomy 410 Computer-based TM n developed using the…”
Liaw, S. Y., Chan, S. W.-C., Chen, F.-G., Hooi, S. C., & Siau, C. (2014) · Journal of Medical Internet Research · doi:10.2196/jmir.3322 · Cited by 147 · cited 3×
“…VP was rated positively Clinical deterioration 57 VP simulation—eRAPIDS, developed at the National University of Singapore Singapore Liaw et al [38] No statistically significant differences be-tween the learning formats Cultural attitudes 51 Second Life (Linden Lab) virtual simulation…”
Blanié, A., Amorim, M., & Benhamou, D. (2020) · BMC Medical Education · doi:10.1186/s12909-020-1939-6 · Cited by 146 · cited 1×
“…use of SG d Basic clinical skills 146 VP cases—LabForSIMS (simulation center) and a software designer (Interaction Healthcare) France Blanie et al [37] No difference in knowledge acquisition; VP was rated positively Clinical deterioration 57 VP simulation—eRAPIDS, developed at the National…”
Bogomolova, K., van der Ham, I. J. M., Dankbaar, M. E. W., van den Broek, W. W., Hovius, S. E. R., van der Hage, J. A., & Hierck, B. P. (2020) · Anatomical Sciences Education · doi:10.1002/ase.1941 · Cited by 141 · cited 2×
“…help from hired programmers for Unity using Oculus Quest software (Oculus) Norway Berg et al [54] No significant differences in knowledge scores [55] Anatomy teaching 60 DynamicAnatomy AR application developed at the Department of Anatomy and Embry-ology at the Leiden University Medical Centre…”
Remtulla, R. (2020) · JMIR Medical Education · doi:10.2196/20190 · Cited by 127 · cited 1×
“In addition, over the past year, the experience of the global COVID-19 pandemic has vastly reduced access to bedside teaching for nursing, midwifery, and medical students [68].”
Liesefeld, H., Fu, X.-L., & Zimmer, H. (2015) · Journal of Experimental Psychology. Learning, Memory and Cognition · doi:10.1037/xlm0000081 · Cited by 112 · cited 1×
“Students may also mentally rotate complex structures inaccurately, leaving the mind to fill the gaps in any missing structures [64].”
Virtual and Augmented Reality in Medical Education
Pantelidis, P., Chorti, A. G., Papagiouvanni, I., Paparoidamis, G., Drosos, C., Panagiotakopoulos, T., Lales, G., & Sideris, M. (2018) · InTech eBooks · doi:10.5772/intechopen.71963 · Cited by 110 · cited 1×
“Therefore, it uses machines that allow a physical view of the surrounding environment to be visible but enhanced with virtual images [10].”
Lombardi, S. A., Hicks, R. E., Thompson, K. V., & Marbach‐Ad, G. (2014) · AJP Advances in Physiology Education · doi:10.1152/advan.00154.2012 · Cited by 107
Issleib, M., Kromer, A., Pinnschmidt, H. O., Süss-Havemann, C., & Kubitz, J. C. (2021) · Scandinavian Journal of Trauma Resuscitation and Emergency Medicine · doi:10.1186/s13049-021-00836-y · Cited by 96
Evaluation of neuroanatomical training using a 3D visual reality model.
Brewer‐Deluce, D., Wilson, T. D., Eagleson, R. A., & de Ribaupierre, S. (2012) · PubMed · Cited by 90
Encyclopedia of Computer Graphics and Games
Manuri, F., Pace, F. D., & Sanna, A. (2015) · Springer eBooks · doi:10.1007/978-3-319-08234-9 · Cited by 87
Role of immersive technologies in healthcare education during the COVID-19 epidemic
Pears, M., Yiasemidou, M., Ismail, M. A., Veneziano, D., & Biyani, C. S. (2020) · Scottish Medical Journal · doi:10.1177/0036933020956317 · Cited by 84 · cited 2×
“Therefore, the availability and development of VPs and immersive learning environments can play a key role in the future as an adjunct to developing clinical skills for students at all levels and at any time [61].”
InfluentialBerg, H., & Steinsbekk, A. (2020) · BMC Medical Education · doi:10.1186/s12909-020-02030-7 · Cited by 83 · cited 3×
“A full list of the validated scales used in the RCTs in this review is provided in Multimedia Appendix 2 [26,33,34,36-38,41 ,42 ,45-49”
Aksoy, E. (2019) · JMIR Serious Games · doi:10.2196/13442 · Cited by 81 · cited 1×
“In addition, it facilitates practice without the risk of human harm and also helps build professional skills and teamwork [18,19].”
Schoeb, D. S., Schwarz, J., Hein, S., Schlager, D., Pohlmann, P. F., Frankenschmidt, A., Gratzke, C., & Miernik, A. J. (2020) · BMC Medical Education · doi:10.1186/s12909-020-02450-5 · Cited by 78 · cited 2×
“…better learning outcomes [47] Catheter training 164 Instructions for catheterization displayed on Microsoft HoloLens Germany Schoeb et al [47] No difference in outcomes between groups [48] Dermatological teaching 44 AR l mobile app, iPhone operating system (iOS, Apple Inc)–based app…”
Menzel, N., Willson, L. H., & Doolen, J. (2014) · International Journal of Nursing Education Scholarship · doi:10.1515/ijnes-2013-0076 · Cited by 77 · cited 1×
“…the learning formats Cultural attitudes 51 Second Life (Linden Lab) virtual simulation environment (WALD e Island) United States Menzel et al [39] No difference in knowledge acquisition; HG f group rated higher for overall effective-Anatomy teaching 29 Campbell’s 3DM of the inner…”
Noll, C., von Jan, U., Raap, U., & Albrecht, U. (2017) · JMIR mhealth and uhealth · doi:10.2196/mhealth.7943 · Cited by 76 · cited 2×
“…teaching 44 AR l mobile app, iPhone operating system (iOS, Apple Inc)–based app mArble Der-ma (m-ARBLE-dermatology) Germany Noll et al [48] No difference between groups in communication performance scores [49] Interprofessional skill training 120 3D virtual hospital…”
Learning clinical reasoning: how virtual patient case format and prior knowledge interact
Kiesewetter, J., Sailer, M., Jung, V. M., Schönberger, R., Bauer, E., Zottmann, J., Hege, I., Zimmermann, H., Fischer, F., & Fischer, M. R. (2020) · BMC Medical Education · doi:10.1186/s12909-020-1987-y · Cited by 74 · cited 2×
“…in dizziness using the HoloLens Physiology and brain anatomy [45] Case formats with a VP did not affect knowledge gain or diagnostic accuracy [46] VP to teach clinical skills 142 VR learning environment CASUS Germany Kiesewetter et al [46] MR group had significantly better learning outcomes…”
Hu, K.-C., Salcedo, D., Kang, Y., Lin, C., Hsu, C.-W., Cheng, C., Suk, F., & Huang, W. (2020) · PLoS ONE · doi:10.1371/journal.pone.0242731 · Cited by 68
Evaluating the effectiveness of learning ear anatomy using holographic models
Gnanasegaram, J. J., Leung, R., & Beyea, J. A. (2020) · Journal of Otolaryngology - Head and Neck Surgery · doi:10.1186/s40463-020-00458-x · Cited by 67 · cited 2×
“In addition, VR, AR, and MR provide an enhanced learning experience based on the secondary outcomes of the studies included in this review [12,26,33,36,38,40,45].”
Marsh, K., Giffin, B. F., & Lowrie, D. J. (2008) · Anatomical Sciences Education · doi:10.1002/ase.56 · Cited by 64 · cited 1×
“Subjects such as anatomy and embryology require students to translate 2D images into 3D concepts, which can be a cognitive challenge for those who have difficulty visualizing this transformation of images [62,63].”
Persky, S., & McBride, C. M. (2009) · Health Communication · doi:10.1080/10410230903263982 · Cited by 57 · cited 1×
“In addition, they create an environment for repeated practice in a safe space without harm to patients [65,66].”
Acquisition of Fire Safety Knowledge and Skills With Virtual Reality Simulation
Rossler, K. L., Sankaranarayanan, G., & Duvall, A. (2018) · Nurse Educator · doi:10.1097/nne.0000000000000551 · Cited by 56 · cited 1×
“A full list of the validated scales used in the RCTs in this review is provided in Multimedia Appendix 2 [26,33,34,36-38,41 ,42 ,45-49”
Du, Y., Fan, S.-C., & Yang, L.-C. (2020) · BMC Medical Education · doi:10.1186/s12909-020-02155-9 · Cited by 56 · cited 1×
“Approximately 66% (19/29) of studies used validated scales to assess the learning experience, namely, the Intrinsic Motivation Inventory [57], General Self-Efficacy Scale, Learner Satisfaction with Simulation Scale [36], and Diagnostic Thinking Inventory [51].”
Virtual Worlds in Nursing Education: A Synthesis of the Literature
Gagne, J. C. D., Oh, J., Kang, J., Vorderstrasse, A. A., & Johnson, C. (2013) · Journal of Nursing Education · doi:10.3928/01484834-20130610-03 · Cited by 53
Forgione, A., & Guraya, S. Y. (2017) · Journal of Research in Medical Sciences · doi:10.4103/jrms.jrms_809_16 · Cited by 49 · cited 1×
“Similarly, another review looked at serious games used in medical education and found that the evidence was moderate to support the use of immersive technology, stating that it should not replace traditional learning tools [21-25].”
Successful learning of surgical liver anatomy in a computer-based teaching module
Nickel, F., Hendrie, J. D., Bruckner, T. M., Kowalewski, K., Kenngott, H. G., Müller-Stich, B. P., & Fischer, L. (2016) · International Journal of Computer Assisted Radiology and Surgery · doi:10.1007/s11548-016-1354-y · Cited by 48 · cited 2×
“…(Bracco Advanced Medical Technologies) Switzerland Kockro et al [52] 3D group had higher scores, and participants had a preference for 3D training [53] Liver anatomy 410 Computer-based TM n developed using the open-source Medical Imaging Interaction Toolkit software developed by the German Cancer…”
Berg, H., & Steinsbekk, A. (2021) · Advances in Health Sciences Education · doi:10.1007/s10459-020-10019-6 · Cited by 44 · cited 2×
“…Group self-practice of the ABCDE approach in multiplayer, immersive, interactive VR application was noninferior to practice with physical equipment [54] VP to teach clinical skills 289 ABCDE resuscitation application developed with help from hired programmers for Unity using Oculus Quest software…”
3D learning objects for augmented/virtual reality educational ecosystems
Mangina, E. (2017) · International Conference on Virtual Systems and Multimedia (VSMM) · doi:10.1109/vsmm.2017.8346266 · Cited by 42 · cited 1×
“Educational technology includes instructional software such as virtual reality (VR), augmented reality (AR), and mixed reality (MR), known collectively as immersive technology [3].”
Self-citationO’Rourke, S. R., Branford, K. R., Brooks, T. L., Ives, L. T., Nagendran, A., & Compton, S. N. (2020) · Teaching and Learning in Medicine · doi:10.1080/10401334.2019.1652180 · Cited by 37 · cited 2×
“…The Netherlands Bogomolva et al [55] No significant between-group differences on the POMS o 2 or salivary cortisol concentration following the SP p interaction; students had similar emotional and behavioral responses when delivering bad news to SP or vSP q [56] Clinical skill—break-ing bad news”
Liaw, S. Y., Tan, K. K., Wu, L. T., Tan, S. C., Choo, H., Yap, J. Y. G., Lim, S. M., Wong, L., & Ignacio, J. (2019) · Journal of Medical Internet Research · doi:10.2196/12537 · Cited by 36 · cited 2×
“…levels of self-efficacy and attitudes toward interprofessional team care VP to teach MDT h rounds 198 VR g (no details) Singapore Liaw et al [41] No difference in knowledge test scores; significant increase in dizziness using the HoloLens Physiology and brain anatomy [45] Case formats with…”
A Randomised Control Trial and Comparative Analysis of Multi-Dimensional Learning Tools in Anatomy
Wang, C., Daniel, B. K., Asıl, M., Khwaounjoo, P., & Çakmak, Y. Ö. (2020) · Scientific Reports · doi:10.1038/s41598-020-62855-6 · Cited by 34 · cited 3×
“Knowledge [33].”
Hampton, B. S., & Sung, V. W. (2010) · American Journal of Obstetrics and Gynecology · doi:10.1016/j.ajog.2009.08.038 · Cited by 30 · cited 1×
“The favored use of VR may be due in part to the widespread availability of cost-effective 3D software and web-based material for the development of anatomy tools [14,60].”
Paim, C. P. P., & Goldmeier, S. (2017) · JMIR Serious Games · doi:10.2196/games.6048 · Cited by 30 · cited 1×
“To date, there has been a multitude of publications detailing the development and implementation of immersive tools, in addition to demonstrating the benefits of VR, AR and MR technology in medical, nursing and midwifery education [12-17].”
Problem‐based learning in internal medicine: virtual patients or paper‐based problems?
Sobočan, M., Turk, N., Dinevski, D., Hojs, R., & Balon, B. P. (2016) · Internal Medicine Journal · doi:10.1111/imj.13304 · Cited by 23 · cited 2×
“Approximately 66% (19/29) of studies used validated scales to assess the learning experience, namely, the Intrinsic Motivation Inventory [57], General Self-Efficacy Scale, Learner Satisfaction with Simulation Scale [36], and Diagnostic Thinking Inventory [51].”
Medical and Surgical Education - Past, Present and Future
Tsoulfas, G. (2018) · InTech eBooks · doi:10.5772/intechopen.68660 · Cited by 22
Mixed Reality Supporting Modern Medical Education
Nicola, S., & Stoicu-Tivadar, L. (2018) · Studies in health technology and informatics · doi:10.3233/978-1-61499-921-8-242 · Cited by 22 · cited 1×
“Finally, MR is the merging of real and virtual worlds to produce new environments and visualizations where physical and digital objects coexist and interact in real time [11].”
Immersive Technologies for Medical Education
Kapralos, B., Uribe-Quevedo, Á., & Dubrowski, A. (2017) · Springer eBooks · doi:10.1007/978-3-319-08234-9_130-1 · Cited by 10 · cited 1×
“Immersive technologies are defined as devices that provide sensory stimuli to provide a sense of realism and immersion in the interactions with the computer-generated world [7].”
Ienghong, K., Kotruchin, P., Tangpaisarn, T., & Apiratwarakul, K. (2021) · Open Access Macedonian Journal of Medical Sciences · doi:10.3889/oamjms.2021.5566 · Cited by 9 · cited 2×
“…skill training 120 3D virtual hospital devel-oped—CREATIVE Singapore Liaw et al [49] Better performance scores in VR flash card group [50] Emergency ultrasound skills 46 3D USS m images played on the downloaded phone app and AR Thailand Ienghong et al [50] No difference in exam…”
Seifert, L. B., Manap, A., Sterz, J., Gerlach, F. M., & Sader, R. A. (2020) · The Electronic Journal of e-Learning · doi:10.34190/ejel.20.18.1.004 · Cited by 8
Virtual Reality Learning Environment in Embryology Education
Alfalah, S. F. M., Falah, J., Muhaidat, N., Hudaib, A. A., Koshebye, D., & AlHourani, S. (2019) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.5281/zenodo.3593205 · Cited by 4
Research works printed but not linked: 3
- HusseinMNätterdalCThe benefits of virtual reality in education- a comparision studyGöteborgs Universitet20152020-12-15GothenburgUniversity of Gothenburghttp://hdl.handle.net/2077/39977
- Nicola, S, 2018, Stud Health Technol Inform, 255, 242
- Brewer, DN, 2012, Stud Health Technol Inform, 173, 85
Cited by
Reviewing the current state of virtual reality integration in medical education - a scoping review
Mergen, M., Graf, N., & Meyerheim, M. (2024) · BMC Medical Education · doi:10.1186/s12909-024-05777-5 · Cited by 177
“…unexpected) & low frequency scenarios 7 [11, 34, 44, 48, 89, 92, 99] Realistic immersive environments, higher authenticity 7 [34, 37, 44, 45, 72, 84, 111] High degree of spatial understanding and visualisation 4 [19, 44, 86, 106] Versatile multi-user scenarios 1 [40] CLINICAL TRANSFER…”
BackgroundInfluentialGarcía‐Robles, P., Cortés‐Pérez, I., Nieto-Escámez, F. A., García‐López, H., Obrero‐Gaitán, E., & Osuna‐Pérez, M. C. (2024) · Anatomical Sciences Education · doi:10.1002/ase.2397 · Cited by 188
“1,2,27,28 and with Zhao et al.'s meta-analysis.”
Implementation of Virtual Reality in Health Professions Education: Scoping Review
Lie, S. S., Helle, N., Sletteland, N. V., Vikman, M. D., & Bonsaksen, T. (2023) · JMIR Medical Education · doi:10.2196/41589 · Cited by 172
“Immersive technologies can provide learning gains similar to those provided by traditional educational modalities [10].”
BackgroundPark, S., Shin, H. J., Kwak, H., & Lee, H. J. (2024) · Journal of Medical Internet Research · doi:10.2196/57566 · Cited by 111
“Immersive technology is widely recognized to improve learning in nursing education [1,2].”
InfluentialCao, Y., Ng, G. W., & Ye, S.-S. (2023) · Sustainability · doi:10.3390/su15031964 · Cited by 79
Metadata
- Authors
- Ryan, G. V., Callaghan, S., Rafferty, A., Higgins, M. F., Mangina, E., & McAuliffe, F.
- Affiliations
- University College Dublin (IE)
- Corresponding author
- McAuliffe, Fionnuala
- ORCID
- Venue
- Journal of Medical Internet Research
- Publisher
- JMIR Publications Inc.
- Published
- 2022-02-01
- Volume
- 24
- Issue
- 2
- Pages
- e30082
- ISSN
- 1438-8871 (ISSN-L)
- PMC
- PMC8848248
- OpenAlex
- W3210050581
- Cited by
- 242
- References
- 71
- Citations by year
- 2026: 60 · 2025: 79 · 2024: 63 · 2023: 30 · 2022: 9
- FWCI
- 3.43
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- Journal of Medical Internet Research (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- Topics
- Social Sciences › Education › Simulation-Based Education in Healthcare
- Physical Sciences › Computer Science › Human-Computer Interaction › Virtual Reality Applications and Impacts
- Social Sciences › Education › Innovations in Medical Education
- Keywords
- immersive technologies, virtual reality, augmented reality, mixed reality, healthcare education, medical students, nursing students, midwifery students, preclinical education, clinical skills training, knowledge improvement, learning experience, self-efficacy, student engagement, anatomy education, history-taking skills, simulation-based training, conventional instruction comparison, quality of evidence
- MeSH terms
- Delivery of Health Care, Humans, Learning, Students, Nursing, Technology
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
