Analysing usability and presence of a virtual reality operating room (VOR) simulator during laparoscopic surgery training
Open accessThe DOI matches its Crossref record; 45 of the 45 references it cites were found in a registry or an index.
Abstract
Immersive Virtual Reality (VR) laparoscopy simulation is emerging to enhance the attractiveness and realism of surgical procedural training. This study analyses the usability and presence of a Virtual Operating Room (VOR) setup via user evaluation and sets out the key elements for an immersive environment during a laparoscopic procedural training.In the VOR setup, a VR headset displayed a 360-degree computer-generated Operating Room (OR) around a VR laparoscopic simulator during laparoscopy procedures. Thirty-seven surgeons and surgical trainees performed the complete cholecystectomy task in the VOR. Questionnaires (i.e., Localized Postural Discomfort scale, Questionnaire for Intuitive Use, NASA-Task Load Index, and Presence Questionnaire) followed by a semi-structured interview were used to collect the data.The participants could intuitively adapt to the VOR and were satisfied when performing their tasks (M=3.90, IQR=0.70). The participants, particularly surgical trainees, were highly engaged to accomplish the task. Despite the higher mental workload on four subscales (p <; 0.05), the surgical trainees had a lower effort of learning (4 vs 3.33, p <; 0.05) compared to surgeons. The participants experienced very slight discomfort in seven body segments (0.59-1.16). In addition, they expected improvements for team interaction and personalized experience within the setup.The VOR showed potential to become a useful tool in providing immersive training during laparoscopy procedure simulation based on the usability and presence noted in the study. Future developments of user interfaces, VOR environment, team interaction and personalization should result in improvements of the system.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“with Murcia-Lopez and Steed finding the participants in the IVR training condition to spend more time making physically plausible interactions even though there was no haptic feedback.”
From A systematic review of immersive virtual reality for industrial skills training (2021) · cites this paper as [53]
In the citing paper
“These publications measured the change in knowledge retained after one week [66, 94] and two weeks [10, 53, 58, 67, 68, 81, 106], while one publication also measured perceived levels of enjoyment [66].”
From A systematic review of immersive virtual reality for industrial skills training (2021) · cites this paper as [53]
In the citing paper
“Murcia-Lopez and Steed [53] and Schwarz et al. [99] reported IVR and physical training conditions to be equally effective”
From A systematic review of immersive virtual reality for industrial skills training (2021) · cites this paper as [53]
Citations
Cites
Measuring Presence in Virtual Environments: A Presence Questionnaire
Witmer, B. G., & Singer, M. J. (1998) · Presence: Teleoperators and Virtual Environments · doi:10.1162/105474698565686 · Cited by 6,371
NASA-Task Load Index (NASA-TLX); 20 Years Later
Hart, S. G. (2006) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/154193120605000909 · Cited by 4,297 · cited 2×
“The Raw Task Load Index (RTLX) and subscales were calculated into a score between 0 and 100 (0=low, 100=high) [11].”
MethodThe Factor Structure of the Presence Questionnaire
Witmer, B. G., Jerome, C. J., & Singer, M. J. (2005) · Presence: Teleoperators and Virtual Environments · doi:10.1162/105474605323384654 · Cited by 770 · cited 1×
“previously validated [44, 45].”
Scott, D. J., Bergen, P. C., Rege, R. V., Laycock, R., Tesfay, S. T., Valentine, J. R., Euhus, D. M., Jeyarajah, R. D., Thompson, W. M., & Jones, D. B. (2000) · Journal of the American College of Surgeons · doi:10.1016/s1072-7515(00)00339-2 · Cited by 734 · cited 1×
“They must acquire proficiency on non-intuitive motor skills and hand-eye coordination, as well as deal with the ever-changing instruments throughout the procedure [26, 37].”
BackgroundSystematic review of skills transfer after surgical simulation-based training
Dawe, S. R., Pena, G. N., Windsor, J. A., Broeders, J. A. J. L., Cregan, P. C., Hewett, P. J., & Maddern, G. J. (2014) · British journal of surgery · doi:10.1002/bjs.9482 · Cited by 485 · cited 1×
“Virtual Reality laparoscopy (VRL) simulation, replicating haptic feedback during procedure-specific tasks, has been proven to accelerate the acquisition of skills of laparoscopic trainees [6].”
BackgroundA Survey of Usability Evaluation in Virtual Environments: Classification and Comparison of Methods
Bowman, D. A., Gabbard, J. L., & Hix, D. (2002) · Presence: Teleoperators and Virtual Environments · doi:10.1162/105474602760204309 · Cited by 375
Innovations in surgery simulation: a review of past, current and future techniques
Badash, I., Burtt, K., Solorzano, C. A., & Carey, J. N. (2016) · Annals of Translational Medicine · doi:10.21037/atm.2016.12.24 · Cited by 345 · cited 1×
“To create such a surrounding, the required amount of spatial, financial, personal and technological resources is demanding and can hardly fit into daily clinical routines [1, 17].”
BackgroundPerforming laparoscopic surgery is significantly more stressful for the surgeon than open surgery
Berguer, R., Smith, W. D., & Chung, Y. H. (2001) · Surgical Endoscopy · doi:10.1007/s004640080030 · Cited by 321 · cited 1×
“Additionally, mental workload and ergonomic assessments should be incorporated in the evaluation of new laparoscopic training tools, as laparoscopic surgery involves a higher level of mental and physical stress than the open surgery [2, 5, 38].”
BackgroundA Brief History of Endoscopy, Laparoscopy, and Laparoscopic Surgery
SPANER, S. J., & WARNOCK, G. L. (1997) · Journal of Laparoendoscopic & Advanced Surgical Techniques · doi:10.1089/lap.1997.7.369 · Cited by 276 · cited 1×
“cholecystectomy (gallbladder removal surgery) [39].”
Crew resource management: improving team work in high reliability industries
Flin, R., O’Connor, P., & Mearns, K. (2002) · Team Performance Management: An International Journal · doi:10.1108/13527590210433366 · Cited by 223 · cited 1×
“communication and teamwork) owing to distraction simulation [8].”
Background
Research works printed but not linked: 3
- 2000, 1SO/FDIS 11226 Ergonomics-Evaluation of static working postures
- osterlundand, 2012, Virtualreality: Avatarsinhumanspace- flight training, Acta Astronautica, 71, 139
- mestre, 2006, Immersion et presence, Le traité de la réalité virtuelle Paris Ecole des Mines de Paris, 309
Cited by
Souchet, A. D., Lourdeaux, D., Pagani, A., & Rebenitsch, L. (2023) · Virtual Reality · doi:10.1007/s10055-022-00672-0 · Cited by 225
A systematic review of immersive virtual reality for industrial skills training
Radhakrishnan, U., Koumaditis, K., & Chinello, F. (2021) · Behaviour & Information Technology · doi:10.1080/0144929x.2021.1954693 · Cited by 200
Use of Extended Reality in Medical Education: An Integrative Review
Curran, V. R., Xu, X., Aydin, M. Y., & Meruvia-Pastor, O. (2022) · Medical Science Educator · doi:10.1007/s40670-022-01698-4 · Cited by 107
“, (2020), asemerging technologies, studies comparing the ‘user’ experiences of different XR technologies arerelatively limited, but a very important contributor in the adoption of such technologies in medicaleducation [84].”
BackgroundImmersive procedural training in virtual reality: A systematic literature review
Jongbloed, J., Chaker, R., & Lavoué, É. (2024) · Computers & Education · doi:10.1016/j.compedu.2024.105124 · Cited by 129
“Other medical applications illustrated healthcare procedures in an interactive way and got user feedback on their perceptions of enhanced readiness, mental load, and motivation through a number of questionnaires (Ganni et al., 2020; Tang et al., 2021).”
Milani, A. S., Cecil-Xavier, A., Gupta, A., Cecil, J., & Kennison, S. M. (2022) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2022.2116530 · Cited by 99
“Li (2020) studied the level of presence in a VR-based operating room developed for laparoscopy training.”
Background
Metadata
- Authors
- Li, M., Ganni, S., Ponten, J., Albayrak, A., Rutkowski, A.-F., & Jakimowicz, J.
- Affiliations
- Xi'an Jiaotong University (CN)
- Delft University of Technology (NL)
- Catharina Ziekenhuis (NL)
- Tilburg University (NL)
- Venue
- 2020 IEEE Conference on Virtual Reality and 3D User Interfaces (VR)
- Publisher
- IEEE
- Published
- 2020-03
- Pages
- 566-572
- ISSN
- 1087-8270 (ISSN-L)
- OpenAlex
- W4250495579
- Cited by
- 32
- References
- 43
- Citations by year
- 2026: 3 · 2025: 4 · 2024: 5 · 2023: 4 · 2022: 8 · 2021: 8
- FWCI
- 31.14
- Type
- conference paper
- Language
- en
- Open access
- green
- resolver.tudelft.nl
- Locations
- IEEE Conference on Virtual Reality and 3D User Interfaces (VR) (publishedVersion)
- Research Repository (Delft University of Technology) (submittedVersion)
- Tilburg University Research Portal (submittedVersion)
- Data Archiving and Networked Services (DANS) (submittedVersion)
- Research portal (Tilburg University) (submittedVersion)
- Data Archiving and Networked Services (DANS) (submittedVersion, other-oa)
- Funders
- Technische Universiteit Delft
- Topics
- Health Sciences › Medicine › Surgery › Surgical Simulation and Training
- Physical Sciences › Computer Science › Human-Computer Interaction › Virtual Reality Applications and Impacts
- Physical Sciences › Engineering › Control and Systems Engineering › Simulation and Modeling Applications
- Keywords
- virtual surgery, laparoscopic surgery training, presence, usability, cholecystectomy, mental workload, postural discomfort, surgical residents, immersive simulation, team interaction, individualized training
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Analysing usability and presence of a virtual reality operating room (VOR) simulator during laparoscopic surgery training. https://app.cochat.ai/papers/10.1109/vr46266.2020.1581301697128
- The paper
- Li, M., Ganni, S., Ponten, J., Albayrak, A., Rutkowski, A.-F., & Jakimowicz, J. (2020). Analysing usability and presence of a virtual reality operating room (VOR) simulator during laparoscopic surgery training. 2020 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). https://doi.org/10.1109/vr46266.2020.1581301697128
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.