Effectiveness of Immersive Virtual Reality in Surgical Training—A Randomized Control Trial
Open accessAbstract
Purpose Surgical training methods are evolving with the technological advancements, including the application of virtual reality (VR) and augmented reality. However, 28 to 40% of novice residents are not confident in performing a major surgical procedure. VR surgery, an immersive VR (iVR) experience, was developed using Oculus Rift and Leap Motion devices (Leap Motion, Inc, San Francisco, CA) to address this challenge. Our iVR is a multisensory, holistic surgical training application that demonstrates a maxillofacial surgical technique, the Le Fort I osteotomy. The main objective of the present study was to evaluate the effect of using VR surgery on the self-confidence and knowledge of surgical residents.Materials and methods A multisite, single-blind, parallel, randomized controlled trial (RCT) was performed. The participants were novice surgical residents with limited experience in performing the Le Fort I osteotomy. The primary outcome measures were the self-assessment scores of trainee confidence using a Likert scale and an objective assessment of the cognitive skills. Ninety-five residents from 7 dental schools were included in the RCT. The participants were randomly divided into a study group of 51 residents and a control group of 44. Participants in the study group used the VR surgery application on an Oculus Rift with Leap Motion device. The control group participants used similar content in a standard PowerPoint presentation on a laptop. Repeated measures multivariate analysis of variance was applied to the data to assess the overall effect of the intervention on the confidence of the residents.Results The study group participants showed significantly greater perceived self-confidence levels compared with those in the control group (P = .034; α = 0.05). Novices in the first year of their training showed the greatest improvement in their confidence compared with those in their second and third year.Conclusions iVR experiences improve the knowledge and self-confidence of the surgical residents.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Muñoz et al., Dey et al., and Škola et al. utilised real-time bio-signals and created a layer of adaptiveness in IVR training.
“Muñoz et al. [50], Dey et al. [83] and Škola et al. [55] grasp this offering, utilised real-time bio-signals and created a layer of adaptiveness in the IVR training.”
From A systematic review of immersive virtual reality for industrial skills training (2021) · cites this paper as [83]
The VR Surgery section describes an immersive surgical-training application using an Oculus Rift and Leap Motion controller, but does not address real-time bio-signals or adaptive training. Searches for those terms and for Muñoz, Dey, and Škola found no passage in our copy that verifies the attributed claim. Page numbers were not available in the indexed passages. (LLM, conf=0.77)
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Statistical power analyses using G∗Power 3.1: tests for correlation and regression analyses
Faul, F., Erdfelder, E., Buchner, A., & Lang, A.-G. (2009) · Behavior Research Methods · doi:10.3758/brm.41.4.1149 · Cited by 37,615 · see citing works
At the Heart of It All: The Concept of Presence
Lombard, M., & Ditton, T. B. (2006) · Journal of Computer-Mediated Communication · doi:10.1111/j.1083-6101.1997.tb00072.x · Cited by 3,754 · see citing works
Self-Efficacy Beliefs of Adolescents
Pajares, F., & Urdan, T. (2006) · Emerald Group Publishing Limited eBooks · doi:10.1108/978-1-60752-750-3 · Cited by 3,544 · see citing works
Toward an Emotion Nuanced Sensemaking Perspective of Organizational Consultation
Lundberg, C. C. (2000) · Emerald Group Publishing Limited eBooks · doi:10.1108/978-1-60752-837-120251015 · Cited by 3,340 · see citing works
Flawed Self-Assessment: Implications for Health, Education, and the Workplace
Dunning, D., Heath, C., & Suls, J. M. (2004) · Psychological Science in the Public Interest · doi:10.1111/j.1529-1006.2004.00018.x · Cited by 1,865 · see citing works
Why People Fail to Recognize Their Own Incompetence
Dunning, D., Johnson, K., Ehrlinger, J., & Kruger, J. (2003) · Current Directions in Psychological Science · doi:10.1111/1467-8721.01235 · Cited by 1,224 · see citing works
Research Methods and Statistics in Psychology
Coolican, H., & Coolican, H. (2014) · Psychology Press eBooks · doi:10.4324/9780203769836 · Cited by 1,174 · see citing works
Research Methods and Statistics in Psychology
Coolican, H., & Coolican, H. (2013) · Routledge eBooks · doi:10.4324/9780203769669 · Cited by 838 · see citing works
Khor, W. S., Baker, B., Amin, K., Chan, A. D. C., Patel, K. M., & Wong, J. K. F. (2016) · Annals of Translational Medicine · doi:10.21037/atm.2016.12.23 · Cited by 398 · see citing works
Utilizing virtual and augmented reality for educational and clinical enhancements in neurosurgery
Pelargos, P. E., Nagasawa, D. T., Lagman, C., Tenn, S. E., Demos, J. V., Lee, S. J., Bui, T. T., Barnette, N. E., Bhatt, N. S., Ung, N. M., et al. (2016) · Journal of Clinical Neuroscience · doi:10.1016/j.jocn.2016.09.002 · Cited by 300 · see citing works
Beyond “see one, do one, teach one”: toward a different training paradigm
Rodriguez-Paz, J. M., Kennedy, M., Eduardo Salas, A., Wu, A. W., Sexton, J. B., Hunt, E. A., & Pronovost, P. J. (2009) · Postgraduate Medical Journal · doi:10.1136/qshc.2007.023903 · Cited by 279 · see citing works
Our Trainees’ Confidence: Results From a National Survey of 4136 US General Surgery Residents
Bucholz, E. M. (2011) · Archives of Surgery · doi:10.1001/archsurg.2011.178 · Cited by 244 · see citing works
The need for virtual reality simulators in dental education: A review
Roy, E., Bakr, M. M., & George, R. (2017) · The Saudi Dental Journal · doi:10.1016/j.sdentj.2017.02.001 · Cited by 219 · see citing works
Cervone, D. (2000) · Behavior Modification · doi:10.1177/0145445500241002 · Cited by 168 · see citing works
Confidence Crisis Among General Surgery Residents
Elfenbein, D. M. (2016) · JAMA Surgery · doi:10.1001/jamasurg.2016.2792 · Cited by 155 · see citing works
Validating a Self-Confidence Scale for Surgical Trainees
Geoffrion, R., Lee, T., & Singer, J. (2013) · Journal of Obstetrics and Gynaecology Canada · doi:10.1016/s1701-2163(15)30964-6 · Cited by 75 · see citing works
Teaching surgery takes time: the impact of surgical education on time in the operating room
Vinden, C., Malthaner, R. A., McGee, J., et al. (2016) · Canadian Journal of Surgery · doi:10.1503/cjs.017515 · Cited by 71 · see citing works
Meta-analysis of operative experiences of general surgery trainees during training
Elsey, E. J., Griffiths, G. O., Humes, D. J., et al. (2016) · British journal of surgery · doi:10.1002/bjs.10396 · Cited by 56 · see citing works
Focused Surgical Skills Training for Senior Medical Students and Interns
Klingensmith, M. E., & Brunt, L. M. (2010) · Surgical Clinics of North America · doi:10.1016/j.suc.2010.02.004 · Cited by 47 · see citing works
The Elite Athlete, the Master Surgeon
Verrier, E. D. (2016) · Journal of the American College of Surgeons · doi:10.1016/j.jamcollsurg.2016.11.004 · Cited by 36 · see citing works
The development of physician confidence during surgical and medical internship
Binenbaum, G., Musick, D. W., & Ross, H. M. (2006) · The American Journal of Surgery · doi:10.1016/j.amjsurg.2006.07.009 · Cited by 32 · see citing works
Junior doctors making mistakes
Pj, B., Dodd, M., & Wrate, R. W. (1998) · The Lancet · doi:10.1016/s0140-6736(05)78931-5 · Cited by 32 · see citing works
Surgical Training: Is Dabbling Enough?
Hupp, J. R. (2011) · Journal of Oral and Maxillofacial Surgery · doi:10.1016/j.joms.2011.04.004 · Cited by 7 · see citing works
We’ll need more than 48 hours to change EWTD rules
Leahy, P. (2016) · Bulletin of The Royal College of Surgeons of England · doi:10.1308/rcsbull.2017.41 · Cited by 2 · see citing works
Flagged first, then by citations
Research works printed but not linked: 1
- Mitchell L: Safer Surgery. Routledge, 2009
Cited by
Sorted by citations
A review of the evidence for training effectiveness with virtual reality technology
Abich, J., Parker, J., Murphy, J. S., & Eudy, M. (2021) · Virtual Reality · doi:10.1007/s10055-020-00498-8 · Cited by 253 · see citing works
Zhang, M., Ding, H., & Zhang, Y. (2022) · doi:10.20944/preprints202202.0056.v1 · Cited by 211 · see citing works
A systematic review of immersive virtual reality for industrial skills training
Radhakrishnan, U., Koumaditis, K., & Chinello, F. (2021) · Behaviour & Information Technology · doi:10.1080/0144929x.2021.1954693 · Cited by 176 · see citing works
“User perception includes factors like perceived usefulness, self-efficacy, engagement and enjoyment which has been indicated to increase IVR effectiveness for example in: (Lackey et al. 2016; Allcoat and von Mühlenen 2018; Butt, Kardong-Edgren, and Ellertson 2018; Pulijala et al. 2018; Meyer, Omdahl, and Makransky 201…”
BackgroundMethodLiu, J. Y. W., Yin, Y.-H., Kor, P. P. K., Cheung, D. S. K., Zhao, I. Y., Wang, S., Su, J. J., Christensen, M., Tyrovolas, S., & Leung, A. Y. M. (2023) · Journal of Medical Internet Research · doi:10.2196/39989 · Cited by 75 · see citing works
Găină, M.-A., Szalontay, A. S., Ștefănescu, G., Bălan, G. G., Ghiciuc, C. M., Boloș, A., Găină, A.-M., & Ștefănescu, C. (2022) · Journal of Clinical Medicine · doi:10.3390/jcm11061670 · Cited by 44 · see citing works
- Authors
- Pulijala, Y., Ma, M., Pears, M., Peebles, D., & Ayoub, A.
- Affiliations
- University of Huddersfield (GB)
- University of Staffordshire (GB)
- University of Glasgow (GB)
- Corresponding author
- Pulijala, Yeshwanth
- Venue
- Journal of Oral and Maxillofacial Surgery
- Publisher
- Elsevier BV
- Published
- 2018-05
- Volume
- 76
- Issue
- 5
- Pages
- 1065-1072
- ISSN
- 0278-2391 (ISSN-L)
- OpenAlex
- W2764130726
- Cited by
- 264
- References
- 24
- Citations by year
- 2026: 18 · 2025: 28 · 2024: 45 · 2023: 40 · 2022: 38 · 2021: 47 · 2020: 22 · 2019: 20 · 2018: 6
- FWCI
- 13.72
- Type
- journal article
- Language
- en
- Open access
- green
- eprints.hud.ac.uk
- Locations
- Journal of Oral and Maxillofacial Surgery (publishedVersion)
- PubMed (publishedVersion)
- University of Huddersfield Repository (University of Huddersfield) (acceptedVersion)
- Staffordshire Online Repository (Staffordshire University) (acceptedVersion)
- ENLIGHTEN (Jurnal Bimbingan dan Konseling Islam) (acceptedVersion, cc-by-sa)
- Huddersfield Research Portal (University of Huddersfield) (submittedVersion, cc-by-nc-nd)
- Topics
- Health Sciences › Medicine › Surgery › Surgical Simulation and Training
- Physical Sciences › Computer Science › Human-Computer Interaction › Virtual Reality Applications and Impacts
- Physical Sciences › Engineering › Biomedical Engineering › Anatomy and Medical Technology
- Keywords
- immersive virtual reality, surgical training, Le Fort I osteotomy, maxillofacial surgery, surgical residents, self-confidence, surgical knowledge, Oculus Rift, Leap Motion, dental education, simulation-based training
- MeSH terms
- Simulation Training, Virtual Reality, Adult, Clinical Competence, Female, United Kingdom, Humans, Internship and Residency, Male, Self Concept, Surgery, Oral, Single-Blind Method, Osteotomy, Le Fort
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review