Effect of immersive visualization technologies on cognitive load, motivation, usability, and embodiment
Open accessThe DOI matches its Crossref record; 26 of the 26 references it cites were found in a registry or an index.
Abstract
Virtual reality (VR) is a promising tool to promote motor (re)learning in healthy users and brain-injured patients. However, in current VR-based motor training, movements of the users performed in a three-dimensional space are usually visualized on computer screens, televisions, or projection systems, which lack depth cues (2D screen), and thus, display information using only monocular depth cues. The reduced depth cues and the visuospatial transformation from the movements performed in a three-dimensional space to their two-dimensional indirect visualization on the 2D screen may add cognitive load, reducing VR usability, especially in users suffering from cognitive impairments. These 2D screens might further reduce the learning outcomes if they limit users’ motivation and embodiment, factors previously associated with better motor performance. The goal of this study was to evaluate the potential benefits of more immersive technologies using head-mounted displays (HMDs). As a first step towards potential clinical implementation, we ran an experiment with 20 healthy participants who simultaneously performed a 3D motor reaching and a cognitive counting task using: (1) (immersive) VR (IVR) HMD, (2) augmented reality (AR) HMD, and (3) computer screen (2D screen). In a previous analysis, we reported improved movement quality when movements were visualized with IVR than with a 2D screen. Here, we present results from the analysis of questionnaires to evaluate whether the visualization technology impacted users’ cognitive load, motivation, technology usability, and embodiment. Reports on cognitive load did not differ across visualization technologies. However, IVR was more motivating and usable than AR and the 2D screen. Both IVR and AR rea ched higher embodiment level than the 2D screen. Our results support our previous finding that IVR HMDs seem to be more suitable than the common 2D screens employed in VR-based therapy when training 3D movements. For AR, it is still unknown whether the absence of benefit over the 2D screen is due to the visualization technology per se or to technical limitations specific to the device.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
1 retracted
Retracted: Implementations of Virtual Reality for Anxiety-Related Disorders: Systematic Review
Oing, T., & Prescott, J. (2018) · JMIR Serious Games · doi:10.2196/10965 · Cited by 157 · cited 1×
“Twenty healthy participants (15 female, 5 male) without known motor or cognitive disorders, aged from 19 to 42 years old (23.65 ± 4.43) with a preference to use the right hand (Edinburgh handedness questionnaire mean score: 91 ± 19.71; Oldfield 1971) participated in the study.”
MethodInfluentialRetractedHarris, P. A., Taylor, R., Thielke, R., Payne, J., Gonzalez, N., & Conde, J. G. (2009) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2008.08.010 · Cited by 51,384
Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research
(1988) · Advances in Psychology · doi:10.1016/s0166-4115(08)62386-9 · Cited by 15,003
SUS: A 'Quick and Dirty' Usability Scale
(1996) · Usability Evaluation In Industry · doi:10.1201/9781498710411-35 · Cited by 8,989
Rubber hands ‘feel’ touch that eyes see
Botvinick, M., & Cohen, J. (1998) · Nature · doi:10.1038/35784 · Cited by 4,410 · cited 2×
“Embodiment results from the integration of multimodal sensory information (i.e., somatosensory and visual) in the brain (Botvinick and Cohen 1998; Ehrsson et al. 2004).”
BackgroundNASA-Task Load Index (NASA-TLX); 20 Years Later
Hart, S. G. (2006) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/154193120605000909 · Cited by 4,297 · cited 4×
“Table 5 Questions from the “Raw Task Load Index” (RTLX; Hart 2006).”
BackgroundMethodInfluentialThe adaptive brain: aging and neurocognitive scaffolding
Park, D. C., & Reuter-Lorenz, P. (2009) · Annual Review of Psychology · doi:10.1146/annurev.psych.59.103006.093656 · Cited by 2,790 · cited 1×
“Furthermore, cognitive changes, sensory and motor limitations, and slower speed of processing in the very old population (Cabeza 2001; Park and Reuter-Lorenz 2009) are some characteristics associated with participants’ age that might influence their cognitive load.”
BackgroundPaas, F. G. W. C. (1992) · Journal of Educational Psychology · doi:10.1037/0022-0663.84.4.429 · Cited by 2,150 · cited 1×
“Authors reported a lower cognitive load—measured with a dual-task and a self-reporting questionnaire (Paas scale; Paas 1992)—and better motor performance (i.e., faster response time) with the spatial AR compared to the 2D screen.”
MethodAugmented visual, auditory, haptic, and multimodal feedback in motor learning: A review
Sigrist, R., Rauter, G., Riener, R., & Wolf, P. (2013) · Psychonomic Bulletin & Review · doi:10.3758/s13423-012-0333-8 · Cited by 1,416 · cited 1×
“Although VR-based interventions have shown promising results on movement training (Marchal-Crespo et al. 2013; Sigrist et al. 2013), balance and gait training (Kes-hner and Lamontagne 2021), and upper-limb function recovery after stroke (Domínguez-Téllez et al. 2020; Mek-bib et al. 2020),…”
BackgroundWulf, G., & Lewthwaite, R. (2016) · Psychonomic Bulletin & Review · doi:10.3758/s13423-015-0999-9 · Cited by 1,238
Multisensory brain mechanisms of bodily self-consciousness.
Blanke, O. (2012) · Nature Reviews Neuroscience · doi:10.1038/nrn3292 · Cited by 1,147
First person experience of body transfer in virtual reality
Slater, M., Spanlang, B., Sanchez-Vives, M. V., & Blanke, O. (2010) · PLoS ONE · doi:10.1371/journal.pone.0010564 · Cited by 1,090
Putting yourself in the skin of a black avatar reduces implicit racial bias
Peck, T. C., Seinfeld, S., Aglioti, S. M., & Slater, M. (2013) · Consciousness and Cognition · doi:10.1016/j.concog.2013.04.016 · Cited by 967 · cited 4×
“, movements are performed with the avatar instead of having a static avatar—have shown to induce strong embodiment, even if the virtual limb’s appearance is very different from the (own) human body (Banakou et al. 2016; Normand et al. 2011; Peck et al. 2013).”
BackgroundInfluentialWhat is embodiment? A psychometric approach
Longo, M. R., Schüür, F., Kammers, M. P. M., Tsakiris, M., & Haggard, P. (2008) · Cognition · doi:10.1016/j.cognition.2007.12.004 · Cited by 956
Virtual reality for stroke rehabilitation
Laver, K. E., Lange, B., George, S., Deutsch, J. E., Saposnik, G., & Crotty, M. (2017) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd008349.pub4 · Cited by 800
Ehrsson, H. H., Holmes, N. P., & Passingham, R. E. (2005) · The Journal of Neuroscience · doi:10.1523/jneurosci.0800-05.2005 · Cited by 784 · cited 1×
“Importantly, neuroimaging studies have shown that brain areas linked with embodiment overlap with those involved in motor control (Ehrsson et al. 2005; Wise 1985; Zeller et al. 2016).”
BackgroundVisual Capture of Touch: Out-of-the-Body Experiences With Rubber Gloves.
Pavani, F., Spence, C., & Driver, J. (2000) · Psychological Science · doi:10.1111/1467-9280.00270 · Cited by 608
Towards a digital body: the virtual arm illusion
Slater, M. (2008) · Frontiers in Human Neuroscience · doi:10.3389/neuro.09.006.2008 · Cited by 570 · cited 1×
“Numerous studies have shown that body ownership can be experimentally induced over virtual limbs in healthy subjects (Kilteni et al. 2012a; Slater et al. 2008) and stroke patients (Borrego et al. 2019).”
BackgroundExtending body space in immersive virtual reality: a very long arm illusion
Kilteni, K., Normand, J.-M., Sanchez-Vives, M. V., & Slater, M. (2012) · PLoS ONE · doi:10.1371/journal.pone.0040867 · Cited by 499 · cited 8×
“For example, studies have successfully induced body ownership over elongated arms (Kilteni et al. 2012b), heavier bodies (Normand et al. 2011), and mismatched skin-colored arms (Banakou et al. 2016; Peck et al. 2013).”
BackgroundMethodInfluentialMultisensory stimulation can induce an illusion of larger belly size in immersive virtual reality.
Normand, J.-M., Giannopoulos, E., Spanlang, B., & Slater, M. (2011) · PLoS ONE · doi:10.1371/journal.pone.0016128 · Cited by 282 · cited 2×
“…adding visuomotor synchronies—i.e., movements are performed with the avatar instead of having a static avatar—have shown to induce strong embodiment, even if the virtual limb’s appearance is very different from the (own) human body (Banakou et al. 2016; Normand et al. 2011; Peck et al. 2013).”
BackgroundBoeldt, D., McMahon, E., McFaul, M., & Greenleaf, W. (2019) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2019.00773 · Cited by 242 · cited 1×
“…of pain (Pourmand et al. 2018; Theingi et al. 2021), and the treatment of mental disorders in a safe and controllable setting—e.g., eating disorders (Matamala-Gomez et al. 2021), anxiety disorders such as phobias (Boeldt et al. 2019), and post-traumatic stress disorders (Oing and Prescott 2018).”
BackgroundHaptic Guidance Can Enhance Motor Learning of a Steering Task
Crespo, L. M., & Reinkensmeyer, D. J. (2008) · Journal of Motor Behavior · doi:10.3200/jmbr.40.6.545-557 · Cited by 166 · cited 1×
“…3D movements are visualized in virtual environments that offer the possibility to simulate different real or imaginary activities of daily living that can be adapted to the patients’ needs, while providing a motivating (Lee et al. 2003) and safe environment (Marchal-Crespo and Reinkensmeyer 2008).”
BackgroundThe effect of similarities in skin texture and hand shape on perceived ownership of a fake limb
Haans, A., IJsselsteijn, W. A., & de Kort, Y. A. W. (2008) · Body Image · doi:10.1016/j.bodyim.2008.04.003 · Cited by 152
Gerber, S. M., Jeitziner, M.-M., Wyss, P., Chesham, A., Urwyler, P., Müri, R. M., Jakob, S. M., & Nef, T. (2017) · Scientific Reports · doi:10.1038/s41598-017-13153-1 · Cited by 151
Self-citationLee, S. H., Jung, H., Yun, S. J., Oh, B., & Seo, H. G. (2020) · PM&R · doi:10.1002/pmrj.12206 · Cited by 93 · cited 2×
“…et al. 2015), and was positively evaluated (Elor et al. 2018), and reached high-acceptance among people of different ages and neurological conditions without inducing serious side effects—i.e., motion-sickness (Christou et al. 2018; Kourte-sis et al. 2019; Lee et al. 2020; Weber et al. 2019).”
BackgroundGerber, S. M., Jeitziner, M.-M., Knobel, S. E. J., Mosimann, U. P., Müri, R. M., Jakob, S. M., & Nef, T. (2019) · Frontiers in Medicine · doi:10.3389/fmed.2019.00287 · Cited by 59 · cited 1×
“HMDs have also been successfully employed to reduce patients’ cognitive decline (Gerber et al. 2019; Sokolov et al. 2020).”
MethodSelf-citation
Metadata
- Authors
- Wenk, N., Penalver-Andres, J., Buetler, K. A., Nef, T., Müri, R. M., & Marchal-Crespo, L.
- Venue
- Virtual Reality
- Published
- 2021-08-16
- Volume
- 27
- Issue
- 1
- Pages
- 307-331
- ISSN
- 1359-4338 (ISSN-L)
- 1434-9957
- OpenAlex
- W3193803884
- Cited by
- 167
- References
- 26
- FWCI
- 9.49
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.