The DOI matches its Crossref record; 58 of the 59 references it cites were found in a registry or an index.
Psycho-physiological measures for assessing cognitive load
Abstract
With a focus on presenting information at the right time, the ubicomp community can benefit greatly from learning the most salient human measures of cognitive load. Cognitive load can be used as a metric to determine when or whether to interrupt a user. In this paper, we collected data from multiple sensors and compared their ability to assess cognitive load. Our focus is on visual perception and cognitive speed-focused tasks that leverage cognitive abilities common in ubicomp applications. We found that across all participants, the electrocardiogram median absolute deviation and median heat flux measurements were the most accurate at distinguishing between low and high levels of cognitive load, providing a classification accuracy of over 80% when used together. Our contribution is a real-time, objective, and generalizable method for assessing cognitive load in cognitive tasks commonly found in ubicomp systems and situations of divided attention.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Various studies have shown that biometric data such as heart rate (HR), heart rate variability (HRV), electro-dermal activity (EDA), eye tracking, skin temperature or electroencephalography (EEG) can be used to assess mental effort and cognitive load [85,66,28,13], task difficulty [79,22], emotions [48,27,62], or stress [29,70,84].”
From Sensing Interruptibility in the Office: A Field Study on the Use of Biometric and Computer Interaction Sensors (2018) · cites this paper as [28]
In the citing paper
“This overlaps with the sensors we chose, especially the biometric ones, as they have the potential to measure a variety of internal states such as stress, mood or mental load [29,27,62,28].”
From Sensing Interruptibility in the Office: A Field Study on the Use of Biometric and Computer Interaction Sensors (2018) · cites this paper as [28]
In the citing paper
“Previous research has already linked both, computer interaction and biometric sensors to mental load and interruptibility [28,45,80,37,63,20].”
From Sensing Interruptibility in the Office: A Field Study on the Use of Biometric and Computer Interaction Sensors (2018) · cites this paper as [28]
In the citing paper
“Here, temperature-related measures such as heat flux (heat transfer rate) are more robust [87,217], most likely due to the less noise-prone method to measure them.”
From A Survey on Measuring Cognitive Workload in Human-Computer Interaction (2023) · cites this paper as [87]
In the citing paper
“While some work showed feasible accuracy [182,202], other work argues that other modalities are superior [87,201].”
From A Survey on Measuring Cognitive Workload in Human-Computer Interaction (2023) · cites this paper as [87]
Citations
Cites
Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research
(1988) · Advances in Psychology · doi:10.1016/s0166-4115(08)62386-9 · Cited by 15,003
A feature-integration theory of attention.
Treisman, A. M., & Gelade, G. (1980) · Cognitive Psychology · doi:10.1016/0010-0285(80)90005-5 · Cited by 12,366
The processing-speed theory of adult age differences in cognition
Salthouse, T. A. (1996) · Psychological Review · doi:10.1037/0033-295x.103.3.403 · Cited by 5,902
(2001) · doi:10.1017/cbo9780511546396 · Cited by 4,482
Human Cognitive Abilities: A Survey of Factor-Analytic Studies
Carroll, J. B. (1993) · doi:10.1017/cbo9780511571312 · Cited by 4,121 · cited 5×
“In this study, we focus on ‘visual perception’ and ‘cognitive speed’ among the human cognitive abilities addressed in [4, 27].”
BackgroundInfluentialHuman cognitive abilities a survey of factor-analytic studies
Carroll, J. B. (2004) · Cited by 3,400
Cognitive Load Measurement as a Means to Advance Cognitive Load Theory
Paas, F., Tuovinen, J. E., Tabbers, H., & Van Gerven, P. W. M. (2003) · Educational Psychologist · doi:10.1207/s15326985ep3801_8 · Cited by 2,527
Experimental Design in Psychological Research
(2002) · Foundations of Cognitive Psychology · doi:10.7551/mitpress/3080.003.0011 · Cited by 2,465
Detecting Stress During Real-World Driving Tasks Using Physiological Sensors
Healey, J. A., & Picard, R. W. (2005) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2005.848368 · Cited by 2,207
McGrew, K. S. (2009) · Intelligence · doi:10.1016/j.intell.2008.08.004 · Cited by 1,354
Aging and measures of processing speed
Salthouse, T. A. (2000) · Biological Psychology · doi:10.1016/s0301-0511(00)00052-1 · Cited by 1,114
Instructional control of cognitive load in the training of complex cognitive tasks
Paas, F. G. W. C., & Van Merriënboer, J. J. G. (1994) · Educational Psychology Review · doi:10.1007/bf02213420 · Cited by 968 · cited 1×
“Cognitive load Cognitive load is defined as a multidimensional construct representing the load that a particular task imposes on the performer [32, 33 ].”
BackgroundHancock, P. A., & Meshkati, N. (1988) · Cited by 954
Paas, F. G. W. C., & Van Merriënboer, J. J. G. (1993) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/001872089303500412 · Cited by 921
MANUAL FOR KIT OF REFERENCE TESTS FOR COGNITIVE FACTORS (REVISED 1963)
French, J. W., Ekstrom, R. B., & Price, L. A. (1963) · doi:10.21236/ad0410915 · Cited by 897
Wayfinding Behavior: Cognitive Mapping and Other Spatial Processes
Golledge, R. G. (2010) · Cited by 885
Speier, C., Valacich, J. S., & Vessey, I. (1999) · Decision Sciences · doi:10.1111/j.1540-5915.1999.tb01613.x · Cited by 701
Modeling Driver Behavior in a Cognitive Architecture
Salvucci, D. D. (2006) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872006777724417 · Cited by 551
Golledge, R. (1998) · doi:10.56021/9780801859939 · Cited by 542
An Analysis of Mental Workload in Pilots During Flight Using Multiple Psychophysiological Measures
Wilson, G. F. (2002) · The International Journal of Aviation Psychology · doi:10.1207/s15327108ijap1201_2 · Cited by 488
Galvanic skin response (GSR) as an index of cognitive load
Shi, Y., Ruiz, N., Taib, R., Choi, E., & Chen, F. (2007) · CHI '07 Extended Abstracts on Human Factors in Computing Systems · doi:10.1145/1240866.1241057 · Cited by 423 · cited 3×
“The BodyMedia SenseWear Pro3 armband (http://www.bodymedia.com) was used to collect a number of psycho-physiological responses that previous work showed to be valuable for measuring cognitive load, including electrocardiograms (ECG), and galvanic skin response (GSR) [21, 23, 43 ].”
BackgroundMethodInfluentialRyu, K., & Myung, R. (2005) · International Journal of Industrial Ergonomics · doi:10.1016/j.ergon.2005.04.005 · Cited by 399
Computers, Communications, and the Public Interest.
Smith, D. H., & Greenberger, M. (1974) · Contemporary Sociology · doi:10.2307/2062571 · Cited by 371
Emotion recognition from physiological signals using wireless sensors for presence technologies
Nasoz, F., Alvarez, K., Lisetti, C. L., & Finkelstein, N. (2004) · Cognition, Technology & Work · doi:10.1007/s10111-003-0143-x · Cited by 367
Advances in the Psychology of Human Intelligence
(2014) · Psychology Press eBooks · doi:10.4324/9781315807768 · Cited by 367
Wickens, C. D., & McCarley, J. S. (2019) · CRC Press eBooks · doi:10.1201/9780429059261 · Cited by 339
Measurement and analysis methods of heart rate and respiration for use in applied environments
Mulder, L. J. M. (1992) · Biological Psychology · doi:10.1016/0301-0511(92)90016-n · Cited by 316
Spatial abilities as traits, processes, and knowledge.
Lohman, D. F. (1988) · Cited by 296
Predicting human interruptibility with sensors: a Wizard of Oz feasibility study
Hudson, S., Fogarty, J., Atkeson, C., Avrahami, D., Forlizzi, J., Kiesler, S., Lee, J., & Yang, J. (2003) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/642611.642657 · Cited by 295
Self-citation(2001) · Cited by 269
Wickens, C., & McCarley, J. (2007) · CRC Press eBooks · doi:10.1201/9781420063363 · Cited by 269
Learning and reasoning about interruption
Horvitz, E., & Apacible, J. (2003) · Proceedings of the 5th international conference on Multimodal interfaces · doi:10.1145/958432.958440 · Cited by 267 · cited 1×
“While research advances have been made in sensing context to determine when an individual is interruptible, or on monitoring the interaction between human and interrupter to understand the cost of interruption [ 19 , 20, 26], much more needs to be understood about how cognitive load factors into contexts of multitaski…”
BackgroundAckerman, P. L., & Cianciolo, A. T. (2000) · Journal of Experimental Psychology: Applied · doi:10.1037//1076-898x.6.4.259 · Cited by 253
What Do Adult Age Differences in the Digit Symbol Substitution Test Reflect?
Salthouse, T. A. (1992) · Journal of Gerontology · doi:10.1093/geronj/47.3.p121 · Cited by 244
The description of aptitude and achievement tests in terms of rotated factors.
French, J. W. (1951) · University of Chicago Press eBooks · Cited by 232
An International Directory of Spatial Tests
Eliot, J. F. (1984) · Cited by 224
Towards an index of opportunity: understanding changes in mental workload during task execution
Iqbal, S. T., Adamczyk, P. D., Zheng, X. S., & Bailey, B. P. (2005) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1054972.1055016 · Cited by 196 · cited 3×
“Earlier work has shown the value of tracking eye movements and changes in pupil size as measures of cognitive load [3, 21, 22 , 52].”
BackgroundMethodInfluentialPredicting the effects of in-car interface use on driver performance: an integrated model approach
SALVUCCI, D. D. (2001) · International Journal of Human-Computer Studies · doi:10.1006/ijhc.2001.0472 · Cited by 195
INSPECTION TIME AND MEASURED INTELLIGENCE
NETTELBECK, T., & LALLY, M. (1976) · British Journal of Psychology · doi:10.1111/j.2044-8295.1976.tb01493.x · Cited by 172
(1999) · International Conference on Human-Computer Interaction · Cited by 168
The precis of Project Ernestine or an overview of a validation of GOMS
Gray, W. D., John, B. E., & Atwood, M. E. (1992) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/142750.142821 · Cited by 152
Assessing Cognitive Load with Physiological Sensors
Ikehara, C. S., & Crosby, M. E. (2005) · Proceedings of the 38th Annual Hawaii International Conference on System Sciences · doi:10.1109/hicss.2005.103 · Cited by 150
Cognitive factors: Their identification and replication.
Ekstrom, R. B., French, J. W., & Harman, H. H. (1979) · Cited by 124
Mental Work-load as a Function of Demand, Capacity, Strategy and Skill
Welford, A. T. (1978) · Ergonomics · doi:10.1080/00140137808931710 · Cited by 113
Human cognitive abilities. A survey of factoranalytic studies
Elshout, J. J. (1995) · Acta Psychologica · doi:10.1016/0001-6918(95)90085-3 · Cited by 112
Speech-based cognitive load monitoring system
Yin, B., Chen, F., Ruiz, N., & Eliathamby Ambikairajah, A. (2008) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2008.4518041 · Cited by 88
Ritter, F. E., & Young, R. M. (2001) · International Journal of Human-Computer Studies · doi:10.1006/ijhc.2001.0471 · Cited by 83
Interruption as a test of the user-computer interface
Kreifeldt, J. G., & McCarthy, M. E. (1981) · NASA Technical Reports Server (NASA) · Cited by 78
Fredericks, T. K., Choi, S. D., Hart, J., Butt, S. E., & Mital, A. (2005) · International Journal of Industrial Ergonomics · doi:10.1016/j.ergon.2005.06.002 · Cited by 78 · cited 3×
“Finally, HR and HRV were shown to have value in assessing cognitive load [ 10 , 29, 52], so we used a Polar RS800CX HR monitor (http://www.polar.fi/en) to collect interbeat interval (IBI) information with an accuracy of 1 ms. The device is comprised of a wireless transmitter attached to an elastic strap worn around th…”
BackgroundMethodInfluentialTechnology-mediated interruption management
Grandhi, S. A., & Jones, Q. (2010) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2009.12.005 · Cited by 74 · cited 1×
“Additionally, how information is designed and presented can help or hinder our ability to resume a task that has been interrupted, and to provide more information about the context of interruption [ 14 , 24, 35].”
BackgroundA gestalt completion test : a study of a cross section of intellect
Street, R. F. (1931) · Medical Entomology and Zoology · Cited by 43
The dictionary for human factors/Ergonomics
Wilson, J. R. (1994) · Applied Ergonomics · doi:10.1016/0003-6870(94)90063-9 · Cited by 32
THE DICTIONARY FOR HUMAN FACTORS/ERGONOMICS
Stramler (1993) · Cited by 30
Inspection time and intelligence
Petrill, S. A., & Deary, I. J. (2001) · Intelligence · doi:10.1016/s0160-2896(01)00079-4 · Cited by 23
Field, G. E. (1987) · ACM SIGCHI Bulletin · doi:10.1145/36111.1045594 · Cited by 23
Steps Towards Including Behavior Moderators in Human Performance Models in Synthetic Environments
Ritter, F. E., & Avraamides, M. N. (2000) · Cited by 22
The dictionary for human factors/ergonomics
Stramler, J. J. (1992) · Medical Entomology and Zoology · Cited by 11
(2000)
Research works printed but not linked: 5
- 10.1037/1076-898X.6.4.259 · doi:10.1037/1076-898x.6.4.259 · Paper page
- }} Ekstrom , R.B. , French , J.W. , Harman , H.H. and Dermen , D . ( 1976 ) Manual for KIT of factor-referenced cognitive tests. Educational Testing Service , Princeton, NJ, USA . }}Ekstrom, R.B., French, J.W., Harman, H.H. and Dermen, D. (1976) Manual for KIT of factor-referenced cognitive tests. Educational Testing Service, Princeton, NJ, USA.
- }} Hancock , P.A. and Chignell , M.H . ( 1986 ) Toward a Theory of Mental Work Load: Stress and Adaptability in Human-Machine Systems . In Proc. IEEE SMC 1986, 378--383. }}Hancock, P.A. and Chignell, M.H. (1986) Toward a Theory of Mental Work Load: Stress and Adaptability in Human-Machine Systems. In Proc. IEEE SMC 1986, 378--383.
- }} Mital , A. and Govindaraju , M. ( 1999 ) Is it possible to have a single measure for all work? . International Journal of Industrial Engineering Theory , 6 , 190 -- 195 . }}Mital, A. and Govindaraju, M. (1999) Is it possible to have a single measure for all work?. International Journal of Industrial Engineering Theory, 6, 190--195.
- }} Wickens , C.D. ( 1991 ) Processing resources and attention . In Multiple Task Performance. D.L. Damos (Ed.), Taylor and Francis , Ltd ., Bristol, UK, 3--34. }}Wickens, C.D. (1991) Processing resources and attention. In Multiple Task Performance. D.L. Damos (Ed.), Taylor and Francis, Ltd., Bristol, UK, 3--34.
Cited by
Outlook on human-centric manufacturing towards Industry 5.0
Lu, Y., Zheng, H., Chand, S., Xia, W., Liu, Z., Xu, X., Wang, L., Qin, Z., & Bao, J. (2022) · Journal of Manufacturing Systems · doi:10.1016/j.jmsy.2022.02.001 · Cited by 671
A Survey on Measuring Cognitive Workload in Human-Computer Interaction
Kosch, T., Karolus, J., Zagermann, J., Reiterer, H., Schmidt, A., & Woźniak, P. W. (2023) · ACM Computing Surveys · doi:10.1145/3582272 · Cited by 304
“Knowing the pupil diameter for a given light intensity allows us to calculate the effect due to cognitive workload.”
Using near infrared spectroscopy and heart rate variability to detect mental overload
Durantin, G., Gagnon, J.-F., Tremblay, S., & Dehais, F. (2014) · Behavioural Brain Research · doi:10.1016/j.bbr.2013.10.042 · Cited by 259
“The shift from low to high mental workload may be revealed by changes in activity of the autonomous nervous system (ANS) and can be associated with higher pupil size [24] or heart rate [25].”
BackgroundUsing psycho-physiological measures to assess task difficulty in software development
Fritz, T., Begel, A., Müller, S. C., Yigit-Elliott, S., & Züger, M. (2014) · Proceedings of the 36th International Conference on Software Engineering · doi:10.1145/2568225.2568266 · Cited by 262
“Measure Previously found effect Eyetracking Pupil size Cognitive load [28, 40] Memory load [7]; Mental workload [36] Saccades Mental workload while air traffic control tasks [15]; Evaluation of user interfaces [24] Fixations Cognitive load while solving arithmetical tasks [35]; Performance during a code review [73, 65…”
BackgroundContext-Aware Online Adaptation of Mixed Reality Interfaces
Lindlbauer, D., Feit, A. M., & Hilliges, O. (2019) · Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology · doi:10.1145/3332165.3347945 · Cited by 254
“There are three general ways to measure cognitive load: subjective measures such as the NASA TLX [22], performance metrics such as response time, or physiological measures, such as electromyography, skin conductance and respiration (cf. [23, 21]).”
Method
Metadata
- Authors
- Haapalainen, E., Kim, S., Forlizzi, J. F., & Dey, A. K.
- Affiliations
- University of Oulu (FI)
- Carnegie Mellon University (US)
- Venue
- Proceedings of the 12th ACM international conference on Ubiquitous computing
- Publisher
- ACM
- Published
- 2010-09-26
- Pages
- 301-310
- OpenAlex
- W2065073464
- Cited by
- 382
- References
- 59
- Citations by year
- 2026: 8 · 2025: 31 · 2024: 30 · 2023: 16 · 2022: 21 · 2021: 24 · 2020: 48 · 2019: 28 · 2018: 20 · 2017: 29 · 2016: 22 · 2015: 35 · 2014: 24 · 2013: 26 · 2012: 16
- FWCI
- 27.41
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp) (publishedVersion)
- Funders
- National Science Foundation
- Emil Aaltosen Säätiö
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Emotion and Mood Recognition
- Social Sciences › Human Factors and Ergonomics › Human-Automation Interaction and Safety
- Life Sciences › Neuroscience › Cognitive Neuroscience › EEG and Brain-Computer Interfaces
- Keywords
- cognitive load assessment, ubiquitous computing, electrocardiogram, physiological sensors, divided attention, real-time monitoring, user interruption, sensor fusion
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.