Psycho-physiological measures for assessing cognitive load
The DOI matches its Crossref record; 58 of the 59 references it cites were found in a registry or an index.
Abstract
With a focus on presenting information at the right time, the ubicomp community can benefit greatly from learning the most salient human measures of cognitive load. Cognitive load can be used as a metric to determine when or whether to interrupt a user. In this paper, we collected data from multiple sensors and compared their ability to assess cognitive load. Our focus is on visual perception and cognitive speed-focused tasks that leverage cognitive abilities common in ubicomp applications. We found that across all participants, the electrocardiogram median absolute deviation and median heat flux measurements were the most accurate at distinguishing between low and high levels of cognitive load, providing a classification accuracy of over 80% when used together. Our contribution is a real-time, objective, and generalizable method for assessing cognitive load in cognitive tasks commonly found in ubicomp systems and situations of divided attention.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Various studies have shown that biometric data such as heart rate (HR), heart rate variability (HRV), electro-dermal activity (EDA), eye tracking, skin temperature or electroencephalography (EEG) can be used to assess mental effort and cognitive load [85,66,28,13], task difficulty [79,22], emotions [48,27,62], or stress [29,70,84].”
From Sensing Interruptibility in the Office: A Field Study on the Use of Biometric and Computer Interaction Sensors (2018) · cites this paper as [28]
In the citing paper
“This overlaps with the sensors we chose, especially the biometric ones, as they have the potential to measure a variety of internal states such as stress, mood or mental load [29,27,62,28].”
From Sensing Interruptibility in the Office: A Field Study on the Use of Biometric and Computer Interaction Sensors (2018) · cites this paper as [28]
In the citing paper
“Previous research has already linked both, computer interaction and biometric sensors to mental load and interruptibility [28,45,80,37,63,20].”
From Sensing Interruptibility in the Office: A Field Study on the Use of Biometric and Computer Interaction Sensors (2018) · cites this paper as [28]
In the citing paper
“Here, temperature-related measures such as heat flux (heat transfer rate) are more robust [87,217], most likely due to the less noise-prone method to measure them.”
From A Survey on Measuring Cognitive Workload in Human-Computer Interaction (2023) · cites this paper as [87]
In the citing paper
“While some work showed feasible accuracy [182,202], other work argues that other modalities are superior [87,201].”
From A Survey on Measuring Cognitive Workload in Human-Computer Interaction (2023) · cites this paper as [87]
Citations
Cites
Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research
(1988) · Advances in Psychology · doi:10.1016/s0166-4115(08)62386-9 · Cited by 15,003
A feature-integration theory of attention.
Treisman, A. M., & Gelade, G. (1980) · Cognitive Psychology · doi:10.1016/0010-0285(80)90005-5 · Cited by 12,366
The processing-speed theory of adult age differences in cognition
Salthouse, T. A. (1996) · Psychological Review · doi:10.1037/0033-295x.103.3.403 · Cited by 5,902
(2001) · doi:10.1017/cbo9780511546396 · Cited by 4,482
Human Cognitive Abilities: A Survey of Factor-Analytic Studies
Carroll, J. B. (1993) · doi:10.1017/cbo9780511571312 · Cited by 4,121 · cited 5×
“In this study, we focus on ‘visual perception’ and ‘cognitive speed’ among the human cognitive abilities addressed in [4, 27].”
BackgroundInfluentialHuman cognitive abilities a survey of factor-analytic studies
Carroll, J. B. (2004) · Cited by 3,400
Cognitive Load Measurement as a Means to Advance Cognitive Load Theory
Paas, F., Tuovinen, J. E., Tabbers, H., & Van Gerven, P. W. M. (2003) · Educational Psychologist · doi:10.1207/s15326985ep3801_8 · Cited by 2,527
Experimental Design in Psychological Research
(2002) · Foundations of Cognitive Psychology · doi:10.7551/mitpress/3080.003.0011 · Cited by 2,465
Detecting Stress During Real-World Driving Tasks Using Physiological Sensors
Healey, J. A., & Picard, R. W. (2005) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2005.848368 · Cited by 2,207
McGrew, K. S. (2009) · Intelligence · doi:10.1016/j.intell.2008.08.004 · Cited by 1,354
Research works printed but not linked: 5
- 10.1037/1076-898X.6.4.259 · doi:10.1037/1076-898x.6.4.259 · Paper page
- }} Ekstrom , R.B. , French , J.W. , Harman , H.H. and Dermen , D . ( 1976 ) Manual for KIT of factor-referenced cognitive tests. Educational Testing Service , Princeton, NJ, USA . }}Ekstrom, R.B., French, J.W., Harman, H.H. and Dermen, D. (1976) Manual for KIT of factor-referenced cognitive tests. Educational Testing Service, Princeton, NJ, USA.
- }} Hancock , P.A. and Chignell , M.H . ( 1986 ) Toward a Theory of Mental Work Load: Stress and Adaptability in Human-Machine Systems . In Proc. IEEE SMC 1986, 378--383. }}Hancock, P.A. and Chignell, M.H. (1986) Toward a Theory of Mental Work Load: Stress and Adaptability in Human-Machine Systems. In Proc. IEEE SMC 1986, 378--383.
- }} Mital , A. and Govindaraju , M. ( 1999 ) Is it possible to have a single measure for all work? . International Journal of Industrial Engineering Theory , 6 , 190 -- 195 . }}Mital, A. and Govindaraju, M. (1999) Is it possible to have a single measure for all work?. International Journal of Industrial Engineering Theory, 6, 190--195.
- }} Wickens , C.D. ( 1991 ) Processing resources and attention . In Multiple Task Performance. D.L. Damos (Ed.), Taylor and Francis , Ltd ., Bristol, UK, 3--34. }}Wickens, C.D. (1991) Processing resources and attention. In Multiple Task Performance. D.L. Damos (Ed.), Taylor and Francis, Ltd., Bristol, UK, 3--34.
Cited by
Outlook on human-centric manufacturing towards Industry 5.0
Lu, Y., Zheng, H., Chand, S., Xia, W., Liu, Z., Xu, X., Wang, L., Qin, Z., & Bao, J. (2022) · Journal of Manufacturing Systems · doi:10.1016/j.jmsy.2022.02.001 · Cited by 671
A Survey on Measuring Cognitive Workload in Human-Computer Interaction
Kosch, T., Karolus, J., Zagermann, J., Reiterer, H., Schmidt, A., & Woźniak, P. W. (2023) · ACM Computing Surveys · doi:10.1145/3582272 · Cited by 304
“Knowing the pupil diameter for a given light intensity allows us to calculate the effect due to cognitive workload.”
Using near infrared spectroscopy and heart rate variability to detect mental overload
Durantin, G., Gagnon, J.-F., Tremblay, S., & Dehais, F. (2014) · Behavioural Brain Research · doi:10.1016/j.bbr.2013.10.042 · Cited by 259
“The shift from low to high mental workload may be revealed by changes in activity of the autonomous nervous system (ANS) and can be associated with higher pupil size [24] or heart rate [25].”
BackgroundUsing psycho-physiological measures to assess task difficulty in software development
Fritz, T., Begel, A., Müller, S. C., Yigit-Elliott, S., & Züger, M. (2014) · Proceedings of the 36th International Conference on Software Engineering · doi:10.1145/2568225.2568266 · Cited by 262
“Measure Previously found effect Eyetracking Pupil size Cognitive load [28, 40] Memory load [7]; Mental workload [36] Saccades Mental workload while air traffic control tasks [15]; Evaluation of user interfaces [24] Fixations Cognitive load while solving arithmetical tasks [35]; Performance during a code review [73, 65…”
BackgroundContext-Aware Online Adaptation of Mixed Reality Interfaces
Lindlbauer, D., Feit, A. M., & Hilliges, O. (2019) · Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology · doi:10.1145/3332165.3347945 · Cited by 254
“There are three general ways to measure cognitive load: subjective measures such as the NASA TLX [22], performance metrics such as response time, or physiological measures, such as electromyography, skin conductance and respiration (cf. [23, 21]).”
Method
Metadata
- Authors
- Haapalainen, E., Kim, S., Forlizzi, J. F., & Dey, A. K.
- Affiliations
- University of Oulu (FI)
- Carnegie Mellon University (US)
- Venue
- Proceedings of the 12th ACM international conference on Ubiquitous computing
- Publisher
- ACM
- Published
- 2010-09-26
- Pages
- 301-310
- OpenAlex
- W2065073464
- Cited by
- 382
- References
- 59
- Citations by year
- 2026: 8 · 2025: 31 · 2024: 30 · 2023: 16 · 2022: 21 · 2021: 24 · 2020: 48 · 2019: 28 · 2018: 20 · 2017: 29 · 2016: 22 · 2015: 35 · 2014: 24 · 2013: 26 · 2012: 16
- FWCI
- 27.41
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp) (publishedVersion)
- Funders
- National Science Foundation
- Emil Aaltosen Säätiö
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Emotion and Mood Recognition
- Social Sciences › Human Factors and Ergonomics › Human-Automation Interaction and Safety
- Life Sciences › Neuroscience › Cognitive Neuroscience › EEG and Brain-Computer Interfaces
- Keywords
- cognitive load assessment, ubiquitous computing, electrocardiogram, physiological sensors, divided attention, real-time monitoring, user interruption, sensor fusion
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Psycho-physiological measures for assessing cognitive load. https://app.cochat.ai/papers/10.1145/1864349.1864395
- The paper
- Haapalainen, E., Kim, S., Forlizzi, J. F., & Dey, A. K. (2010). Psycho-physiological measures for assessing cognitive load. Proceedings of the 12th ACM international conference on Ubiquitous computing. https://doi.org/10.1145/1864349.1864395
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.