Estimating Cognitive Workload in an Interactive Virtual Reality Environment Using EEG
Open accessThe DOI matches its Crossref record; 13 of the 13 references it cites were found in a registry or an index.
Abstract
With the recent surge of affordable, high-performance virtual reality (VR) headsets, there is unlimited potential for applications ranging from education, to training, to entertainment, to fitness and beyond. As these interfaces continue to evolve, passive user-state monitoring can play a key role in expanding the immersive VR experience, and tracking activity for user well-being. By recording physiological signals such as the electroencephalogram (EEG) during use of a VR device, the user's interactions in the virtual environment could be adapted in real-time based on the user's cognitive state. Current VR headsets provide a logical, convenient, and unobtrusive framework for mounting EEG sensors. The present study evaluates the feasibility of passively monitoring cognitive workload via EEG while performing a classical n-back task in an interactive VR environment. Data were collected from 15 participants and the spatio-spectral EEG features were analyzed with respect to task performance. The results indicate that scalp measurements of electrical activity can effectively discriminate three workload levels, even after suppression of a co-varying high-frequency activity.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
N-back working memory paradigm: a meta-analysis of normative functional neuroimaging studies.
Owen, A. M., McMillan, K. M., Laird, A. R., & Bullmore, E. (2005) · Human Brain Mapping · doi:10.1002/hbm.20131 · Cited by 3,560
Age differences in short-term retention of rapidly changing information.
Kirchner, W. K. (1958) · Journal of Experimental Psychology · doi:10.1037/h0043688 · Cited by 1,798 · cited 1×
“In order to verify that EEG measures of cognitive workload can be reliably attained using an interactive VR environment, we adapted the well-established n -back task (Kirchner, 1958) for modulating cognitive workload into an immersive virtual environment using a HTC VIVE VR headset 1 .”
MethodSAUSENG, P., KLIMESCH, W., SCHABUS, M., & DOPPELMAYR, M. (2005) · International Journal of Psychophysiology · doi:10.1016/j.ijpsycho.2005.03.018 · Cited by 814
High-Frequency Brain Activity and Muscle Artifacts in MEG/EEG: A Review and Recommendations
Muthukumaraswamy, S. D. (2013) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2013.00138 · Cited by 697
Optical brain monitoring for operator training and mental workload assessment
Ayaz, H., Shewokis, P. A., Bunce, S., Izzetoglu, K., Willems, B., & Onaral, B. (2012) · NeuroImage · doi:10.1016/j.neuroimage.2011.06.023 · Cited by 650 · cited 1×
“…et al., 2007; Brouwer et al., 2012; Gerjets et al., 2014; Hogervorst et al., 2014; Mühl et al., 2014; Ewing et al., 2016; Schultze-Kraft et al., 2016; Grissmann et al., 2017a,b; Scharinger et al., 2017; Pergher et al., 2018) and fNIRS (Ayaz et al., 2012; Herff et al., 2013a; Unni et al., 2017).”
Estimating workload using EEG spectral power and ERPs in the n-back task
Brouwer, A.-M., Hogervorst, M. A., van Erp, J. B. F., Heffelaar, T., Zimmerman, P. H., & Oostenveld, R. (2012) · Journal of Neural Engineering · doi:10.1088/1741-2560/9/4/045008 · Cited by 407 · cited 8×
“Specifically, electrode positions F3, Fz, F4, C3, C4, P3, Pz, P4 were used (see Figure 3 ), based on neural activations from prior EEG and fMRI studies (Owen et al., 2005; Brouwer et al., 2012).”
BackgroundMethodResultInfluentialHogervorst, M. A., Brouwer, A.-M., & van Erp, J. B. F. (2014) · Frontiers in Neuroscience · doi:10.3389/fnins.2014.00322 · Cited by 292 · cited 1×
“Other studies have further investigated changes in brain activity with respect to changes in cognitive workload during task performance using EEG (Berka et al., 2007; Brouwer et al., 2012; Gerjets et al., 2014; Hogervorst et al., 2014; Mühl et al., 2014; Ewing et al., 2016; Schultze-Kraft et al., 2016; Grissmann et al…”
Cognitive tasks augment gamma EEG power
Fitzgibbon, S. P., Pope, K. J., Mackenzie, L., Clark, C. R., & Willoughby, J. O. (2004) · Clinical Neurophysiology · doi:10.1016/j.clinph.2004.03.009 · Cited by 228
Kam, J. W. Y., Griffin, S., Shen, A., Patel, S., Hinrichs, H., Heinze, H.-J., Deouell, L. Y., & Knight, R. T. (2019) · NeuroImage · doi:10.1016/j.neuroimage.2018.09.012 · Cited by 188
FORCe: Fully online and automated artifact removal for brain-computer interfacing
Daly, I., Scherer, R., Billinger, M., & Muller-Putz, G. (2015) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2014.2346621 · Cited by 174 · cited 1×
“, 2019) and motion artifact suppression (Gwin et al., 2010; Daly et al., 2015; Kline et al., 2015; Snyder et al., 2015; Arad et al., 2018) further increase the practicality of integrating EEG into VR headsets.”
Background
Cited by
Xi, N., Chen, J., Gama, F., Riar, M., & Hamari, J. (2022) · Information Systems Frontiers · doi:10.1007/s10796-022-10244-x · Cited by 423
Progress in Brain Computer Interface: Challenges and Opportunities
Saha, S., Mamun, K. A., Ahmed, K., Mostafa, R., Naik, G. R., Darvishi, S., Khandoker, A. H., & Baumert, M. (2021) · Frontiers in Systems Neuroscience · doi:10.3389/fnsys.2021.578875 · Cited by 365
Virtual reality and collaborative learning: a systematic literature review
van der Meer, N., van der Werf, V., Brinkman, W.-P., & Specht, M. (2023) · Frontiers in Virtual Reality · doi:10.3389/frvir.2023.1159905 · Cited by 147
“…as research arguing that physical signals such as electroencephalogram (EEG) can conveniently and unobtrusively be tracked during use of HMD VR (Tremmel et al., 2019), future research on VRCL could prove fruitful in terms of training collaborative skills and competences via use of…”
BackgroundIntroducing Mental Workload Assessment for the Design of Virtual Reality Training Scenarios
Luong, T., Argelaguet, F., Martin, N., & Lecuyer, A. (2020) · 2020 IEEE Conference on Virtual Reality and 3D User Interfaces (VR) · doi:10.1109/vr46266.2020.00089 · Cited by 37
Luo, S., Ren, P., Wu, J., Wu, X., & Zhang, X. (2024) · PLOS ONE · doi:10.1371/journal.pone.0305733 · Cited by 10
“A precise band-pass filter encompassing the range of 0.5–50 Hz is applied, refining the data for further analysis [28].”
MethodInfluential
Metadata
- Authors
- Tremmel, C., Herff, C., Sato, T., Rechowicz, K., Yamani, Y., & Krusienski, D. J.
- Venue
- Frontiers in Human Neuroscience
- Publisher
- Frontiers Media SA
- Published
- 2019-11-14
- Volume
- 13
- Pages
- 401-401
- ISSN
- 1662-5161 (ISSN-L)
- OpenAlex
- W2986017006
- Cited by
- 144
- References
- 13
- FWCI
- 6.90
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.