Using neurophysiological signals that reflect cognitive or affective state: six recommendations to avoid common pitfalls
Open accessThe DOI matches its Crossref record; 16 of the 16 references it cites were found in a registry or an index.
Abstract
Estimating cognitive or affective state from neurophysiological signals and designing applications that make use of this information requires expertise in many disciplines such as neurophysiology, machine learning, experimental psychology, and human factors. This makes it difficult to perform research that is strong in all its aspects as well as to judge a study or application on its merits. On the occasion of the special topic "Using neurophysiological signals that reflect cognitive or affective state" we here summarize often occurring pitfalls and recommendations on how to avoid them, both for authors (researchers) and readers. They relate to defining the state of interest, the neurophysiological processes that are expected to be involved in the state of interest, confounding factors, inadvertently "cheating" with classification analyses, insight on what underlies successful state estimation, and finally, the added value of neurophysiological measures in the context of an application. We hope that this paper will support the community in producing high quality studies and well-validated, useful applications.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Brain–computer interfaces for communication and control
Wolpaw, J. R., Birbaumer, N., McFarland, D. J., Pfurtscheller, G., & Vaughan, T. M. (2002) · Clinical Neurophysiology · doi:10.1016/s1388-2457(02)00057-3 · Cited by 7,927
Picard, R. W. (1997) · MIT Press · doi:10.7551/mitpress/1140.001.0001 · Cited by 7,382
EEG alpha and theta oscillations reflect cognitive and memory performance: a review and analysis
Klimesch, W. (1999) · Brain Research Reviews · doi:10.1016/s0165-0173(98)00056-3 · Cited by 6,889
Dickerson, S. S., & Kemeny, M. E. (2004) · Psychological Bulletin · doi:10.1037/0033-2909.130.3.355 · Cited by 5,881
A few useful things to know about machine learning
Domingos, P. (2012) · Communications of the ACM · doi:10.1145/2347736.2347755 · Cited by 3,326 · cited 1×
“Lotte et al. (2007), van Gerven et al. (2009), Domingos (2012), and Lemm et al. (2011) provide easily readable reviews on classification.”
BackgroundAlpha-band oscillations, attention, and controlled access to stored information
Klimesch, W. (2012) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2012.10.007 · Cited by 3,310
Farwell, L. A., & Donchin, E. (1988) · Electroencephalography and Clinical Neurophysiology · doi:10.1016/0013-4694(88)90149-6 · Cited by 3,228 · cited 10×
“See for example Huang et al. (2007) who combined ERP and button press responses for detecting targets within series of rapidly presented images, and Lin et al. (2014) who combined characteristics of music with listeners’ EEG to estimate emotion.”
BackgroundInfluentialAutonomic nervous system activity in emotion: a review
Kreibig, S. D. (2010) · Biological Psychology · doi:10.1016/j.biopsycho.2010.03.010 · Cited by 3,188 · cited 2×
“In a similar vein, sadness can be associated with autonomous signals associated with overt activity or withdrawn behavior resulting in a need to distinguish between “crying and non-crying sadness” (Kreibig, 2010).”
BackgroundA review of classification algorithms for EEG-based brain–computer interfaces
Lotte, F., Congedo, M., Lécuyer, A., Lamarche, F., & Arnaldi, B. (2007) · Journal of Neural Engineering · doi:10.1088/1741-2560/4/2/r01 · Cited by 2,665
Fundamentals of physiological computing
Fairclough, S. H. (2009) · Interacting with Computers · doi:10.1016/j.intcom.2008.10.011 · Cited by 608
Whitham, E. M., Pope, K. J., Fitzgibbon, S. P., Lewis, T., Clark, C. R., Loveless, S., Broberg, M., Wallace, A., DeLosAngeles, D., Lillie, P., et al. (2007) · Clinical Neurophysiology · doi:10.1016/j.clinph.2007.04.027 · Cited by 524 · cited 1×
“…to be reflected by power changes in the alpha and theta band (Klimesch, 1999; Fink et al., 2005; Brouwer et al., 2012), differ-ences in workload reflected by power changes in high EEG frequencies at frontal electrodes are likely caused by a difference in muscle activation (Whitham et al., 2007).”
BackgroundBlinks and saccades as indicators of fatigue in sleepiness warnings: looking tired?
Schleicher, R., Galley, N., Briest, S., & Galley, L. (2008) · Ergonomics · doi:10.1080/00140130701817062 · Cited by 476 · cited 1×
“Fatigue and behavioral lapses have been shown to relate to EEG signals (Wang et al., 2014) and variables related to eye blinks (Schleicher et al., 2008).”
BackgroundEstimating workload using EEG spectral power and ERPs in the n-back task
Brouwer, A.-M., Hogervorst, M. A., van Erp, J. B. F., Heffelaar, T., Zimmerman, P. H., & Oostenveld, R. (2012) · Journal of Neural Engineering · doi:10.1088/1741-2560/9/4/045008 · Cited by 407 · cited 2×
“…while one would expect differences in work-load to be reflected by power changes in the alpha and theta band (Klimesch, 1999; Fink et al., 2005; Brouwer et al., 2012), differ-ences in workload reflected by power changes in high EEG frequencies at frontal electrodes are likely caused by a…”
BackgroundSelf-citationHogervorst, M. A., Brouwer, A.-M., & van Erp, J. B. F. (2014) · Frontiers in Neuroscience · doi:10.3389/fnins.2014.00322 · Cited by 292 · cited 4×
“Offline classification analyses based on different (combinations of) features are arguably the most straightforward approach for finding out exactly which features contribute most (Hogervorst et al., 2014).”
BackgroundMethodInfluentialSelf-citationPerceiving blocks of emotional pictures and sounds: effects on physiological variables.
Brouwer, A.-M., van Wouwe, N., Mühl, C., van Erp, J., & Toet, A. (2013) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2013.00295 · Cited by 85 · cited 3×
“Examples of this include using measures of workload to evaluate different systems (e.g., interface designs) or using measures of stress to evaluate interventions taken to reduce mental stress (Brouwer et al., 2013b).”
BackgroundSelf-citationCapturing user engagement via psychophysiology: measures and mechanisms for biocybernetic adaptation
Fairclough, S. H., Gilleade, K., Ewing, K. C., & Roberts, J. (2013) · International Journal of Autonomous and Adaptive Communications Systems · doi:10.1504/ijaacs.2013.050694 · Cited by 60 · cited 2×
“It could be necessary to narrow down a specific concept (e.g., is the type of stress under investigation acute or chronic—Dicker-son and Kemeny, 2004) or to refer to states that may underlie an overarching concept as is for example done for “engagement” in Fairclough et al. (2013).”
Background
Cited by
Emotions Recognition Using EEG Signals: A Survey
Alarcao, S. M., & Fonseca, M. J. (2019) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2017.2714671 · Cited by 1,201
EEG-Based BCI Emotion Recognition: A Survey
Torres, E. P., Torres, E. A., Hernández-Álvarez, M., & Yoo, S. G. (2020) · Sensors · doi:10.3390/s20185083 · Cited by 291
Aricò, P., Borghini, G., Di Flumeri, G., Colosimo, A., Pozzi, S., & Babiloni, F. (2016) · Progress in Brain Research · doi:10.1016/bs.pbr.2016.04.021 · Cited by 145
Heading for new shores! Overcoming pitfalls in BCI design
Chavarriaga, R., Fried-Oken, M., Kleih, S., Lotte, F., & Scherer, R. (2017) · Brain-Computer Interfaces · doi:10.1080/2326263x.2016.1263916 · Cited by 97
“, [111, 120-122]) some aspects inherent to BCI systems may require specific new guidelines to be drawn (e.”
Stuldreher, I. V., Thammasan, N., van Erp, J. B. F., & Brouwer, A.-M. (2020) · Journal of Neural Engineering · doi:10.1088/1741-2552/aba87d · Cited by 58
Self-citation
Metadata
- Authors
- Brouwer, A.-M., Zander, T. O., van Erp, J. B. F., Korteling, J. E., & Bronkhorst, A. W.
- Venue
- Frontiers in Neuroscience
- Publisher
- Frontiers Media SA
- Published
- 2015-04-30
- Volume
- 9
- Pages
- 136-136
- ISSN
- 1662-453X (ISSN-L)
- OpenAlex
- W2027068798
- Cited by
- 143
- References
- 16
- FWCI
- 21.68
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.