Automatic Cognitive Load Detection from Face, Physiology, Task Performance and Fusion During Affective Interference
The DOI matches its Crossref record; 52 of the 53 references it cites were found in a registry or an index.
Abstract
Cognitive load (CL) is experienced during critical tasks and also while engaged emotional states are induced either by the task itself or by extraneous experiences. Emotions irrelevant to the working memory representation may interfere with the processing of relevant tasks and can influence task performance and behavior, making the accurate detection of CL from nonverbal information challenging. This paper investigates automatic CL detection from facial features, physiology and task performance under affective interference. Data were collected from participants (n=20) solving mental arithmetic tasks with emotional stimuli in the background, and a combined classifier was used for detecting CL levels. Results indicate that the face modality for CL detection was more accurate under affective interference, whereas physiology and task performance were more accurate without the affective interference. Multimodal fusion improved detection accuracies, but it was less accurate under affective interferences. More specifically, the accuracy decreased with an increasing intensity of emotional arousal.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Increased cognitive workload can lead to higher and lower respiration rate variability [99].”
From A Survey on Measuring Cognitive Workload in Human-Computer Interaction (2023) · cites this paper as [99]
Citations
Cites
Rapid object detection using a boosted cascade of simple features
Viola, P., & Jones, M. (2005) · Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001 · doi:10.1109/cvpr.2001.990517 · Cited by 18,300
The WEKA data mining software: an update
Hall, M., Frank, E., Holmes, G., Pfahringer, B., Reutemann, P., & Witten, I. H. (2009) · ACM SIGKDD Explorations Newsletter · doi:10.1145/1656274.1656278 · Cited by 17,750 · cited 4×
“The classifiers were implemented using MATLABArsenal7, a wrapper for the classifiers in Weka (Hall et al., 2009).”
MethodInfluentialRussell, J. A. (1980) · Journal of Personality and Social Psychology · doi:10.1037/h0077714 · Cited by 16,334
The relation of strength of stimulus to rapidity of habit formation
Yerkes, R. M., & Dodson, J. D. (1908) · Journal of Comparative Neurology and Psychology · doi:10.1002/cne.920180503 · Cited by 6,911
The magical number 4 in short-term memory: A reconsideration of mental storage capacity
Cowan, N. (2001) · Behavioral and Brain Sciences · doi:10.1017/s0140525x01003922 · Cited by 6,779
The Psychology of Human-Computer Interaction
Card, S. K., Moran, T. P., & Newell, A. (2018) · CRC Press eBooks · doi:10.1201/9780203736166 · Cited by 4,103
(1998) · Cited by 3,476
Combining Pattern Classifiers: Methods and Algorithms
Bagui, S. C. (2005) · Technometrics · doi:10.1198/tech.2005.s320 · Cited by 3,202
International Affective Picture System (IAPS) : Technical Manual and Affective Ratings
Lang, P. J. (1995) · Medical Entomology and Zoology · Cited by 2,870
Cognitive Load Measurement as a Means to Advance Cognitive Load Theory
Paas, F., Tuovinen, J. E., Tabbers, H., & Van Gerven, P. W. M. (2003) · Educational Psychologist · doi:10.1207/s15326985ep3801_8 · Cited by 2,527
Research works printed but not linked: 5
- 2007, Aviation, Space, and Environmental Medicine, 78, 231
- 2012, ACM TRANS INTERACT INTELL SYST, 2, 221
- 2011, NEW PERSPECTIVES ON AFFECT AND LEARNING TECHNOLOGIES, 3, 203
- 2010, Psychophysiology, 48, 323
- 1986, HANDBOOK PERCEPT HUM PERFORM, 2, 42
Cited by
A Survey on Measuring Cognitive Workload in Human-Computer Interaction
Kosch, T., Karolus, J., Zagermann, J., Reiterer, H., Schmidt, A., & Woźniak, P. W. (2023) · ACM Computing Surveys · doi:10.1145/3582272 · Cited by 304
“…21, 27, 44–47, 76, 87, 99, 165, 184, 193, 228, 236, 258] Eye Blinks [4, 5, 27, 43–47, 76, 87, 99, 175, 182, 184, 236, 268] Fixations [1, 10, 54, 68, 99, 140, 153, 184, 219, 228] Smooth Pursuits and Ocular Movements [133] Cardiovascular Heart Rate [4, 10, 25, 27, 40, 41, 49, 50, 76, 78, 82, 85, 87,…”
InfluentialMultimodal Fusion for Objective Assessment of Cognitive Workload: A Review
Debie, E., Fernandez Rojas, R., Fidock, J., Barlow, M., Kasmarik, K., Anavatti, S., Garratt, M., & Abbass, H. A. (2021) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2019.2939399 · Cited by 184
“The same authors in a subsequent study [85] investigated the impact of affective interference that emerge due to the nature of the task or personal feelings (i.e., emotional arousal, frustration, and confusion) on the performance of single models (based on single modality) and hybrid fusion model…”
BackgroundCognitive Load Measurement in a Virtual Reality-Based Driving System for Autism Intervention
Zhang, L., Wade, J., Bian, D., Fan, J., Swanson, A., Weitlauf, A., Warren, Z., & Sarkar, N. (2017) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2016.2582490 · Cited by 141
“Different kernel functions of support vector machine (SVM), including linear kernel [31] and Gaussian kernel [32], were used in cognitive load measurement.”
BackgroundMethodInfluentialBarua, A., Ahmed, M. U., & Begum, S. (2023) · IEEE Access · doi:10.1109/access.2023.3243854 · Cited by 152
“[98], [100], [104], [116], [125], [127], [185], [203], [237], [319], [357], [386], [402], Image & Numerical [62], [75], [119], [126], [69], [306], [323], [345], [396], [401], Audio & Text & Sensor [375], Audio & Text [178], [276], [369], [382], [383], Text & Signal [109], Text & Numerical [297], [341], Sensor & Signal…”
Inside Out: Detecting Learners’ Confusion to Improve Interactive Digital Learning Environments
Arguel, A., Lockyer, L., Lipp, O. V., Lodge, J. M., & Kennedy, G. E. (2016) · Journal of Educational Computing Research · doi:10.1177/0735633116674732 · Cited by 118
“For this reason, a multimodal approach consisting of the integration of several indicators may be preferred to detect confusion (Hussain, Calvo, & Chen, 2014; Hussain, Monkaresi, & Calvo, 2012).”
Metadata
- Authors
- Hussain, M. S., Calvo, R. A., & Chen, F.
- Affiliations
- The University of Sydney (AU)
- Data61 (AU)
- Corresponding author
- Hussain, M. S.
- Venue
- Interacting with Computers
- Publisher
- Oxford University Press (OUP)
- Published
- 2013-06-06
- Volume
- 26
- Issue
- 3
- Pages
- 256-268
- ISSN
- 0953-5438 (ISSN-L)
- 1873-7951
- OpenAlex
- W2059430380
- Cited by
- 34
- References
- 53
- Citations by year
- 2026: 4 · 2025: 3 · 2024: 5 · 2023: 4 · 2022: 1 · 2021: 2 · 2020: 3 · 2019: 5 · 2018: 3 · 2016: 2 · 2015: 1 · 2014: 1
- FWCI
- 1.80
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Interacting with Computers (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Emotion and Mood Recognition
- Social Sciences › Human Factors and Ergonomics › Human-Automation Interaction and Safety
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Visual and Cognitive Learning Processes
- Keywords
- cognitive load detection, emotional interference, emotional arousal, facial expressions, physiological signals, task performance, multimodal fusion, mental arithmetic, emotion and cognition
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Automatic Cognitive Load Detection from Face, Physiology, Task Performance and Fusion During Affective Interference. https://app.cochat.ai/papers/10.1093/iwc/iwt032
- The paper
- Hussain, M. S., Calvo, R. A., & Chen, F. (2014). Automatic Cognitive Load Detection from Face, Physiology, Task Performance and Fusion During Affective Interference. Interacting with Computers. https://doi.org/10.1093/iwc/iwt032
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.