CoChat

Embodiment Is Related to Better Performance on a Brain–Computer Interface in Immersive Virtual Reality: A Pilot Study

Open access
Juliano, Julia M., Spicer, Ryan P., Vourvopoulos, Athanasios, Lefebvre, Stephanie, Jann, Kay, Ard, Tyler, Santarnecchi, Emiliano, Krum, David M., Liew, Sook-Lei · 2020 · Sensors
Cited by 87

The DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.

Abstract

Electroencephalography (EEG)-based brain–computer interfaces (BCIs) for motor rehabilitation aim to “close the loop” between attempted motor commands and sensory feedback by providing supplemental information when individuals successfully achieve specific brain patterns. Existing EEG-based BCIs use various displays to provide feedback, ranging from displays considered more immersive (e.g., head-mounted display virtual reality (HMD-VR)) to displays considered less immersive (e.g., computer screens). However, it is not clear whether more immersive displays improve neurofeedback performance and whether there are individual performance differences in HMD-VR versus screen-based neurofeedback. In this pilot study, we compared neurofeedback performance in HMD-VR versus a computer screen in 12 healthy individuals and examined whether individual differences on two measures (i.e., presence, embodiment) were related to neurofeedback performance in either environment. We found that, while participants’ performance on the BCI was similar between display conditions, the participants’ reported levels of embodiment were significantly different. Specifically, participants experienced higher levels of embodiment in HMD-VR compared to a computer screen. We further found that reported levels of embodiment positively correlated with neurofeedback performance only in HMD-VR. Overall, these preliminary results suggest that embodiment may relate to better performance on EEG-based BCIs and that HMD-VR may increase embodiment compared to computer screens.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.3390/s20041204

Cites

11 of 11 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 11 references

Research works printed but not linked: 38

  1. Broetz, 2013, Brain-machine interface in chronic stroke rehabilitation: A controlled study, Ann. Neurol., 74, 100, 10.1002/ana.23879 · DOI · Paper page
  2. Caspar, 2015, The relationship between human agency and embodiment, Conscious. Cogn., 33, 226, 10.1016/j.concog.2015.01.007 · DOI · Paper page
  3. Dechent, 2004, Is the human primary motor cortex involved in motor imagery?, Cogn. Brian Res., 19, 138, 10.1016/j.cogbrainres.2003.11.012 · DOI · Paper page
  4. Naito, 2002, Internally simulated movement sensations during motor imagery activate cortical motor areas and the cerebellum, J. Neurosci., 22, 3683, 10.1523/JNEUROSCI.22-09-03683.2002 · DOI · Paper page
  5. Jackson, 2003, Functional cerebral reorganization following motor sequence learning through mental practice with motor imagery, Neuroimage, 20, 1171, 10.1016/S1053-8119(03)00369-0 · DOI · Paper page
  6. Guerra, 2018, The effects of mental practice based on motor imagery for mobility recovery after subacute stroke: Protocol for a randomized controlled trial, Complement. Ther. Clin. Pract., 33, 36, 10.1016/j.ctcp.2018.08.002 · DOI
  7. Carrasco, 2016, Effectiveness of motor imagery or mental practice in functional recovery after stroke: A systematic review, Neurol. English Ed., 31, 43
  8. Ang, 2014, Brain-computer interface-based robotic end effector system for wrist and hand rehabilitation: Results of a three-armed randomized controlled trial for chronic stroke, Front. Neuroeng., 7, 30, 10.3389/fneng.2014.00030 · DOI · Paper page
  9. Pichiorri, 2015, Brain-computer interface boosts motor imagery practice during stroke recovery, Ann. Neurol., 77, 851, 10.1002/ana.24390 · DOI · Paper page
  10. Cincotti, F., Pichiorri, F., Aricò, P., Aloise, F., Leotta, F., De Vico Fallani, F., Millán, J.d.R., Molinari, M., and Mattia, D. (September, January 28). EEG-based Brain-Computer Interface to support post-stroke motor rehabilitation of the upper limb. Proceedings of the 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society, San Diego, CA, USA. · DOI
  11. Frolov, 2017, Post-stroke rehabilitation training with a motor-imagery-based Brain-Computer Interface (BCI)-controlled hand exoskeleton: A randomized controlled multicenter trial, Front. Neurosci., 11, 400, 10.3389/fnins.2017.00400 · DOI · Paper page
  12. Tung, S.W., Guan, C., Ang, K.K., Phua, K.S., Wang, C., Zhao, L., Teo, W.P., and Chew, E. (2013, January 3–7). Motor imagery BCI for upper limb stroke rehabilitation: An evaluation of the EEG recordings using coherence analysis. Proceedings of the 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), Osaka, Japan.
  13. McMahon, M., and Schukat, M. (2018, January 15–17). A low-cost, open-source, BCI-VR game control development environment prototype for game based neurorehabilitation. Proceedings of the IEEE Games, Entertainment, Media Conference (GEM), Galway, Ireland. · DOI
  14. Vourvopoulos, 2016, Motor priming in virtual reality can augment motor-imagery training efficacy in restorative brain-computer interaction: A within-subject analysis, J. Neuroeng. Rehabil., 13, 69, 10.1186/s12984-016-0173-2 · DOI
  15. Kilteni, 2012, The Sense of Embodiment in Virtual Reality, Presence Teleoperators Virtual Environ., 21, 373, 10.1162/PRES_a_00124 · DOI · Paper page
  16. Banakou, 2016, Virtual embodiment of white people in a black virtual body leads to a sustained reduction in their implicit racial bias, Front. Hum. Neurosci., 10, 601, 10.3389/fnhum.2016.00601 · DOI · Paper page
  17. Vecchiato, 2015, Electroencephalographic correlates of sensorimotor integration and embodiment during the appreciation of virtual architectural environments, Front. Psychol., 6, 1944, 10.3389/fpsyg.2015.01944 · DOI
  18. Pavone, 2016, Embodying others in immersive virtual reality: Electro-cortical signatures of monitoring the errors in the actions of an avatar seen from a first-person perspective, J. Neurosci., 36, 268, 10.1523/JNEUROSCI.0494-15.2016 · DOI · Paper page
  19. Slater, 2018, Immersion and the illusion of presence in virtual reality, Br. J. Psychol., 109, 431, 10.1111/bjop.12305 · DOI · Paper page
  20. Bailey, 2016, When does virtual embodiment change our minds?, Presence, 25, 222, 10.1162/PRES_a_00263 · DOI · Paper page
  21. Spicer, R., Anglin, J.M., Krum, D.M., and Liew, S.-L. (2017, January 18–22). REINVENT: A low-cost, virtual reality brain-computer interface for severe stroke upper limb motor recovery. Proceedings of the IEEE Virtual Reality, Los Angeles, CA, USA. · DOI
  22. Klem, 1999, The ten-twenty electrode system of the International Federation, Electroencephalogr. Clin. Neurophysiol., 52, 3
  23. Lee, 2017, A study on immersion and VR sickness in walking interaction for immersive virtual reality applications, Symmetry, 9, 78, 10.3390/sym9050078 · DOI
  24. Delorme, 2004, EEGLAB: An open source toolbox for analysis of single-trial EEG dynamics including independent component analysis, J. Neurosci. Methods, 134, 9, 10.1016/j.jneumeth.2003.10.009 · DOI · Paper page
  25. Welch, 1967, The use of fast Fourier transform for the estimation of power spectra: A method based on time averaging over short, modified periodograms, IEEE Trans. Audio Electroacoust., 15, 70, 10.1109/TAU.1967.1161901 · DOI · Paper page
  26. Neuper, 2006, ERD/ERS patterns reflecting sensorimotor activation and deactivation, Prog. Brain Res., 159, 211, 10.1016/S0079-6123(06)59014-4 · DOI · Paper page
  27. Pfurtscheller, 2000, Spatiotemporal ERD/ERS patterns during voluntary movement and motor imagery, Suppl. Clin. Neurophysiol., 53, 196, 10.1016/S1567-424X(09)70157-6 · DOI
  28. Pfurtscheller, 1997, Motor imagery activates primary sensorimotor area in humans, Neurosci. Lett., 239, 65, 10.1016/S0304-3940(97)00889-6 · DOI · Paper page
  29. Vourvopoulos, 2019, Effects of a brain-computer interface with virtual reality (VR) neurofeedback: A pilot study in chronic stroke patients, Front. Hum. Neurosci., 13, 210, 10.3389/fnhum.2019.00210 · DOI · Paper page
  30. Vourvopoulos, 2019, Efficacy and brain imaging correlates of an immersive motor imagery BCI-driven VR system for upper limb motor rehabilitation: A clinical case report, Front. Hum. Neurosci., 13, 244, 10.3389/fnhum.2019.00244 · DOI · Paper page
  31. Blanco-Mora, D.A., Almeida, Y., Vieira, C., and Badia, S.B.i. (2019, January 6–9). A study on EEG power and connectivity in a virtual reality bimanual rehabilitation training system. Proceedings of the 2019 IEEE International Conference on Systems, Man and Cybernetics (SMC), Bari, Italy. · DOI
  32. Johnson, 2018, Combined rTMS and virtual reality brain–computer interface training for motor recovery after stroke, J. Neural Eng., 15, 016009, 10.1088/1741-2552/aa8ce3 · DOI
  33. Luu, 2016, Gait adaptation to visual kinematic perturbations using a real-time closed-loop brain-computer interface to a virtual reality avatar, J. Neural Eng., 13, 036006, 10.1088/1741-2560/13/3/036006 · DOI
  34. Porcino, T.M., Clua, E., Trevisan, D., Vasconcelos, C.N., and Valente, L. (2017, January 2–4). Minimizing cyber sickness in head mounted display systems: Design guidelines and applications. Proceedings of the 2017 IEEE 5th International Conference on Serious Games and Applications for Health (SeGAH), Perth, WA, Australia. · DOI
  35. Alimardani, M., Nishio, S., and Ishiguro, H. (2016). The importance of visual feedback design in BCIs; from embodiment to motor imagery learning. PLoS ONE, 11. · DOI
  36. Ono, T., Shindo, K., Kawashima, K., Ota, N., Ito, M., Ota, T., Mukaino, M., Fujiwara, T., Kimura, A., and Liu, M. (2014). Brain-computer interface with somatosensory feedback improves functional recovery from severe hemiplegia due to chronic stroke. Front. Neuroeng., 7. · DOI · Paper page
  37. Uktveris, T., and Jusas, V. (2018). Development of a modular board for eeg signal acquisition. Sensors, 18. · DOI
  38. Peck, 2018, Avatar embodiment. Towards a standardized questionnaire, Front. Robot. AI, 5, 74, 10.3389/frobt.2018.00074 · DOI · Paper page

Cited by

Metadata

Authors
Juliano, J. M., Spicer, R. P., Vourvopoulos, A., Lefebvre, S., Jann, K., Ard, T., Santarnecchi, E., Krum, D. M., & Liew, S.-L.
Venue
Sensors
Publisher
MDPI AG
Published
2020-02-22
Volume
20
Issue
4
Pages
1204
ISSN
1424-8220 (ISSN-L)
OpenAlex
W3007529783
Cited by
87
References
11
FWCI
5.76
Type
journal article
Language
en
Open access
gold
Funders
  • American Heart Association (16IRG26960017)
  • National Institutes of Health (K01HD091283)

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.