Investigating Human Performance in a Virtual Reality Haptic Simulator as Influenced by Fidelity and System Latency
Abstract
The objective of this study was to demonstrate the utility of an established model of human motor behavior for assessing the fidelity of a virtual reality (VR) and haptic-based simulation for fine motor task performance. This study was also to serve as a basis for formulating general performance-based simulator-design guidelines toward balancing perceived realism with simulator limitations, such as latency resulting from graphic and haptic renderings. A low-fidelity surgical simulator was developed as an example VR for study, and user performance was tested in a simplified tissue-cutting task using a virtual scalpel. The observed aspect of the simulation included a discrete-movement task under different system-lag conditions and settings of task difficulty. Results revealed user performance in the VR to conform with Fitts' law of motor behavior and for performance to degrade with increasing task difficulty and system time lag. In general, the findings of this work support predictions on human performance under various simulator-design conditions using an established model of motor-control behavior and formulation of human-performance-based simulator-design principles.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the dialoging mode of HIC, delays and reliability of haptic data communication are paramount for safe communication, with a latency requirement of 0-50 ms.
“In the dialoging mode, where the interaction is highly dynamic (e.g., therapist-patient interaction, where the therapist remotely operates a local robotic avatar to assist the local patient to perform rehabilitation exercises), delays and reliability of haptic data communication are paramount for safe communication (a latency requirement of 0-50 ms).”
From The IEEE 1918.1 “Tactile Internet” Standards Working Group and its Standards (2019) · cites this paper as [26]
For the observing mode of HIC, the latency requirement can be further extended to 0-200 ms.
“For the observing mode, where interaction is static or quasi-static (e.g., teletraining system, where a trainee will be observing the performance of a remote trainer), the latency requirement can be further extended to 0-200 ms.”
From The IEEE 1918.1 “Tactile Internet” Standards Working Group and its Standards (2019) · cites this paper as [26]
Cites
The information capacity of the human motor system in controlling the amplitude of movement.
Fitts, P. M. (1954) · Journal of Experimental Psychology · doi:10.1037/h0055392 · Cited by 6,466 · see citing works
The information capacity of the human motor system in controlling the amplitude of movement.
Fitts, P. M. (1992) · Journal of Experimental Psychology General · doi:10.1037//0096-3445.121.3.262 · Cited by 6,291 · see citing works
Virtual Reality Simulation for the Operating Room
Gallagher, A. G., Ritter, E. M., Champion, H. R., Higgins, G. A., Fried, M. P., Moses, G. R., Smith, C. D., & Satava, R. M. (2005) · Annals of Surgery · doi:10.1097/01.sla.0000151982.85062.80 · Cited by 1,054 · see citing works
Physically Based Deformable Models in Computer Graphics
Nealen, A., Müller, M., Keiser, R., Boxerman, E., & Carlson, M. (2006) · Computer Graphics Forum · doi:10.1111/j.1467-8659.2006.01000.x · Cited by 764 · see citing works
A Survey of Surgical Simulation: Applications, Technology, and Education
Liu, A., Tendick, F., Cleary, K., & KAUFMANN, C. R. (2003) · PRESENCE Virtual and Augmented Reality · doi:10.1162/105474603322955905 · Cited by 279 · see citing works
Reaching for objects in VR displays
Ware, C., & Balakrishnan, R. (1994) · ACM Transactions on Computer-Human Interaction · doi:10.1145/198425.198426 · Cited by 231 · see citing works
Modeling the effects of delayed haptic and visual feedback in a collaborative virtual environment
Jay, C., Glencross, M., & Hubbold, R. J. (2007) · ACM Transactions on Computer-Human Interaction · doi:10.1145/1275511.1275514 · Cited by 164 · see citing works
Interactive simulation of surgical cuts
Bielser, D., & Gross, M. H. (2002) · doi:10.1109/pccga.2000.883933 · Cited by 152 · see citing works
Banerjee, P. P., Luciano, C., Lemole, G. M., et al. (2007) · Journal of neurosurgery · doi:10.3171/jns-07/09/0515 · Cited by 117 · see citing works
A new approach for the real-time simulation of tissue deformations in surgery simulation
Monserrat, C., Meier, U., Alcañíz, M., et al. (2001) · Computer Methods and Programs in Biomedicine · doi:10.1016/s0169-2607(00)00093-6 · Cited by 98 · see citing works
Michalski, R., Grobelny, J., & Karwowski, W. (2006) · International Journal of Industrial Ergonomics · doi:10.1016/j.ergon.2006.06.013 · Cited by 69 · see citing works
Kaber, D. B., Riley, J. M., Zhou, R., & Draper, J. (2000) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/154193120004400505 · Cited by 63 · see citing works
Self-citationImpedance Modulation and Feedback Corrections in Tracking Targets of Variable Size and Frequency
Selen, L. P. J., van Dieën, J. H., & Beek, P. J. (2006) · Journal of Neurophysiology · doi:10.1152/jn.00552.2006 · Cited by 61 · see citing works
Investigations into Performance of Minimally Invasive Telesurgery with Feedback Time Delays
Ottensmeyer, M. P., Hu, J., Thompson, J. M., et al. (2000) · PRESENCE Virtual and Augmented Reality · doi:10.1162/105474600566871 · Cited by 34 · see citing works
Control gain adaptation in virtual reality mediated human-telerobot interaction
Sheik-Nainar, M. A., KABER, D. B., & Chow, M. (2005) · Human Factors and Ergonomics in Manufacturing & Service Industries · doi:10.1002/hfm.20025 · Cited by 31 · see citing works
Self-citationA Study on the Perception of Haptics in Surgical Simulation
Batteau, L. M., Liu, A., Maintz, J. B. A., et al. (2004) · Lecture notes in computer science · doi:10.1007/978-3-540-25968-8_21 · Cited by 24 · see citing works
Passive Haptic Data-Compression Methods With Perceptual Coding for Bilateral Presence Systems
Kuschel, M., Kremer, P., & BUSS, M. J. (2009) · IEEE Transactions on Systems Man and Cybernetics - Part A Systems and Humans · doi:10.1109/tsmca.2009.2027219 · Cited by 23 · see citing works
Scott‐Conner, C. E. H. (2006) · Springer eBooks · doi:10.1007/0-387-30485-1 · Cited by 14 · see citing works
Electromyogram-Based Cursor Control System for Users with Motor Disabilities
Chin, C., Barreto, A. B., & Alonso, M. (2006) · Lecture notes in computer science · doi:10.1007/11788713_132 · Cited by 12 · see citing works
Towards physics-based interactive simulation of electrocautery procedures using PhysX
Lu, Z., Sankaranarayanan, G., Deo, D., et al. (2010) · IEEE Haptics Symposium · doi:10.1109/haptic.2010.5444609 · Cited by 11 · see citing works
Lin, S., Lee, Y., & Narayan, R. J. (2007) · Virtual and Physical Prototyping · doi:10.1080/17452750701487941 · Cited by 10 · see citing works
Self-citationBuilding and Testing Optimized Keyboards for Specific Text Entry
Francis, G., & Oxtoby, C. (2006) · Human Factors The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872006777724390 · Cited by 8 · see citing works
Modeling of deformable objects in haptic rendering system for virtual reality
Wang, H., Wang, Y., & Esen, H. (2009) · International Conference on Mechatronics and Automation · doi:10.1109/icma.2009.5246443 · Cited by 6 · see citing works
Operator matching during visually aided teleoperation
Thompson, R. L., McAree, P. R., Daniel, R. W., et al. (2004) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2004.10.003 · Cited by 3 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
The IEEE 1918.1 “Tactile Internet” Standards Working Group and its Standards
Holland, O., Steinbach, E., Prasad, R. V., Liu, Q., Dawy, Z., Aijaz, A., Pappas, N., Chandra, K., Rao, V. S., Oteafy, S., et al. (2019) · Proceedings of the IEEE · doi:10.1109/jproc.2018.2885541 · Cited by 200 · see citing works
“[21], [22] show that latency should be less than 25 ms for accurately completing haptic operations.”
Background
- Authors
- Kaber, D. B., Li, Y., Clamann, M., & Lee, Y.-S.
- Affiliations
- North Carolina State University (US)
- Venue
- IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans
- Published
- 2012-11
- Volume
- 42
- Issue
- 6
- Pages
- 1562-1566
- ISSN
- 1083-4427 (ISSN-L)
- 1558-2426
- OpenAlex
- W2034918745
- Cited by
- 37
- References
- 24
- Citations by year
- 2025: 2 · 2024: 5 · 2022: 1 · 2021: 2 · 2020: 2 · 2019: 5 · 2018: 1 · 2017: 5 · 2016: 3 · 2015: 2 · 2014: 7 · 2013: 2
- FWCI
- 5.38
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- IEEE Transactions on Systems Man and Cybernetics - Part A Systems and Humans (publishedVersion)
- Topics
- Physical Sciences › Engineering › Mechanical Engineering › Teleoperation and Haptic Systems
- Physical Sciences › Computer Science › Human-Computer Interaction › Virtual Reality Applications and Impacts
- Health Sciences › Medicine › Surgery › Surgical Simulation and Training
- Keywords
- virtual reality, haptic simulation, simulation fidelity, system latency, Fitts' law, surgical simulation, tissue cutting, discrete movements, task difficulty, motor control models
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review