Task Load Estimation and Mediation Using Psycho-physiological Measures
The DOI matches its Crossref record; 35 of the 36 references it cites were found in a registry or an index.
Abstract
Human performance falls off predictably with excessive task difficulty. This paper reports on a search for a task load estimation metric. Of the five physiological signals analyzed from a multitasking study, only pupil dilation measures correlated well with real-time task load. The paper introduces a novel task load estimation model based on pupil dilation measures. We demonstrate its effectiveness in a multitasking driving scenario. Autonomous mediation of notifications using this model significantly improved user task performance compared to no mediation. The model showed promise even when used outside in a car. Results were achieved using low-cost cameras and open-source measurement tools lending to its potential to be used broadly.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
The magical number seven, plus or minus two: Some limits on our capacity for processing information.
Miller, G. A. (1994) · Psychological Review · doi:10.1037/0033-295x.101.2.343 · Cited by 17,161
Egeth, H., & Kahneman, D. (1975) · The American Journal of Psychology · doi:10.2307/1421603 · Cited by 6,972
Working memory: Looking back and looking forward
Baddeley, A. (2003) · Nature Reviews Neuroscience · doi:10.1038/nrn1201 · Cited by 5,200 · cited 1×
“Theories have been proposed to model how multiple tasks might compete for the same information processing resources [2, 35].”
BackgroundWorking memory span tasks: A methodological review and user’s guide
Conway, A. R. A., Kane, M. J., Bunting, M. F., Hambrick, D. Z., Wilhelm, O., & Engle, R. W. (2005) · Psychonomic Bulletin & Review · doi:10.3758/bf03196772 · Cited by 2,882 · cited 2×
“The notification task was based on cognitive tests frequently used to measure working memory capacity [6].”
MethodMultiple resources and performance prediction
Wickens, C. D. (2002) · Theoretical Issues in Ergonomics Science · doi:10.1080/14639220210123806 · Cited by 2,621 · cited 1×
“Successful dual-task scenarios depend on the availability and requirements of cognitive resources for the secondary task given resource consumption by the primary task [34].”
BackgroundCognitive Load Measurement as a Means to Advance Cognitive Load Theory
Paas, F., Tuovinen, J. E., Tabbers, H., & Van Gerven, P. W. M. (2003) · Educational Psychologist · doi:10.1207/s15326985ep3801_8 · Cited by 2,527
Working Memory Capacity as Executive Attention
Engle, R. W. (2002) · Current Directions in Psychological Science · doi:10.1111/1467-8721.00160 · Cited by 2,507
Multiple Resources and Mental Workload
Wickens, C. D. (2008) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872008x288394 · Cited by 2,164 · cited 1×
“Theories have been proposed to model how multiple tasks might compete for the same information processing resources [2, 35].”
BackgroundAn Efficient Algorithm for Spectral Analysis of Heart Rate Variability
Berger, R. D., Akselrod, S., Gordon, D., & Cohen, R. J. (1986) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.1986.325789 · Cited by 807
Using Electroencephalography to Measure Cognitive Load
Antonenko, P., Paas, F., Grabner, R., & van Gog, T. (2010) · Educational Psychology Review · doi:10.1007/s10648-010-9130-y · Cited by 742
Research works printed but not linked: 2
- Angela Mahr , Michael Feld , Mohammad Mehdi Moniri , and Rafael Math . 2012 . The ConTRe (Continuous Tracking and Reaction) task: A flexible approach for assessing driver cognitive workload with high sensitivity . Adjunct Proceedings of the 4th AutomotiveUI. (2012), 88--91. Angela Mahr, Michael Feld, Mohammad Mehdi Moniri, and Rafael Math. 2012. The ConTRe (Continuous Tracking and Reaction) task: A flexible approach for assessing driver cognitive workload with high sensitivity. Adjunct Proceedings of the 4th AutomotiveUI. (2012), 88--91.
- Sandra P Marshall . 2007 . Identifying cognitive state from eye metrics. Aviation, space, and environmental medicine 78 , Supplement 1 (2007), B165 -- B175 . Sandra P Marshall. 2007. Identifying cognitive state from eye metrics. Aviation, space, and environmental medicine 78, Supplement 1 (2007), B165--B175.
Cited by
A Survey on Measuring Cognitive Workload in Human-Computer Interaction
Kosch, T., Karolus, J., Zagermann, J., Reiterer, H., Schmidt, A., & Woźniak, P. W. (2023) · ACM Computing Surveys · doi:10.1145/3582272 · Cited by 304
“While some work showed feasible accuracy [182, 202], other work argues that other modalities are superior [87, 201].”
InfluentialDatasets for Cognitive Load Inference Using Wearable Sensors and Psychological Traits
Gjoreski, M., Kolenik, T., Knez, T., Luštrek, M., Gams, M., Gjoreski, H., & Pejović, V. (2020) · Applied Sciences · doi:10.3390/app10113843 · Cited by 122
“Instead, physiological techniques for cognitive load measurement rely on signals, stemming from heart beat activity [27], breathing [28], heat flux [29], brain activity [30], and eye movement [31,32].”
BackgroundA Survey of Attention Management Systems in Ubiquitous Computing Environments
Anderson, C., Hübener, I., Seipp, A.-K., Ohly, S., David, K., & Pejović, V. (2018) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3214261 · Cited by 88
“Respiration [94, 99] duration of inhalation/exhalation, mean, median, stdev”
BackgroundInfluentialKim, A., Choi, W., Park, J., Kim, K., & Lee, U. (2018) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3287053 · Cited by 37
“Unlike existing distraction studies [54], interruptibility studies [37, 57] did not systematically examined how interrupting tasks affect driving performance by quantifying the change in deriving performance.”
BackgroundMethodResultInfluentialInterruptibility for In-vehicle Multitasking: Influence of Voice Task Demands and Adaptive Behaviors
Kim, A., Park, J.-M., & Lee, U. (2020) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3381009 · Cited by 30
“However, prior studies did not consider the secondary-task demand (e.g., the workload of the proactive voice services) [7, 60, 68].”
BackgroundPupil size as an indicator of visual-motor workload and expertise in microsurgical training tasks
Bednarik, R., Bartczak, P., Vrzáková, H., Koskinen, J., Elomaa, A.-P., Huotarinen, A., Pérez, D. G. D. G., & zu Fraunberg, M. V. U. (2018) · ACM Symposium on Eye Tracking Research and Applications (ETRA) · doi:10.1145/3204493.3204577 · Cited by 38
My Watch Says I'm Busy: Inferring Cognitive Load with Low-Cost Wearables
Gjoreski, M., Luštrek, M., & Pejović, V. (2018) · ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp) · doi:10.1145/3267305.3274113 · Cited by 25
“Physiological signals, such as heart rate variability, skin conductance, pupil dilation, and others have been shown to correlate with cognitive load [8, 9].”
BackgroundChiossi, F., Ou, C., & Mayer, S. (2023) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3544549.3585624 · Cited by 23
Flow State Feedback Through Sports Wearables: A Case Study on Tennis
Havlucu, H., Eskenazi, T., Akgün, B., Onbaşlı, M. C., Coşkun, A., & Özcan, O. (2018) · Designing Interactive Systems Conference · doi:10.1145/3196709.3196807 · Cited by 18
Gremlin: scheduling interactions in vehicular computing
Lee, K., Flinn, J., & Noble, B. D. (2017) · ACM/IEEE Symposium on Edge Computing (SEC) · doi:10.1145/3132211.3134450 · Cited by 16
Chiossi, F., Ou, C., & Mayer, S. (2024) · International Conference on Advanced Visual Interfaces (AVI) · doi:10.1145/3656650.3656657 · Cited by 19
Wireless Ranging for Contactless Cognitive Load Inference in Ubiquitous Computing
Pejović, V., Matkovič, T., & Ciglarič, M. (2021) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2021.1913860 · Cited by 12
“Physiological techniques for cognitive load measurement rely on signals, stemming from heart beat activity (Myrtek et al., 1994), breathing (Wientjes et al., 1998), heat flux (Haapalainen et al., 2010), brain activity (Sirevaag et al., 1993) and eye movement (Rajan et al., 2016; Wilson, 1993).”
MethodToward Cognitive Load Inference for Attention Management in Ubiquitous Systems
Pejović, V., Gjoreski, M., Anderson, C., David, K., & Luštrek, M. (2020) · IEEE Pervasive Computing · doi:10.1109/mprv.2020.2968909 · Cited by 10
“situ knowledge of cognitive load has led to advances in physiological signal-based cognitive load inference using commodity devices.(11);(12) In the following sections, we showcase our efforts in this direction: “Commodity Wearables for Cognitive Load Inference” section presents a smart wristband-based cognitive load…”
BackgroundEffects of verbal tasks on driving simulator performance
Rann, J. C., & Almor, A. (2022) · Cognitive Research Principles and Implications · doi:10.1186/s41235-022-00357-x · Cited by 11
“There is indeed considerable research showing the utility of this task for studying driving performance (Demberg, 2013; Häuser et al., 2019; Rajan et al., 2016; Reichel et al., 2014; Vogels et al., 2018).”
BackgroundGao, H., Gao, Y., & Kasneci, E. (2025) · International Conference on Multimedia Retrieval · doi:10.1145/3731715.3733275 · Cited by 8
“Within each category, we extracted various statistical characteristics from the data, including mean (Mean), standard deviation (SD), minimum (Min), and maximum (Max) [14, 43].”
Discrete N-Dimensional Entropy of Behavior: DNDEB
Young, M., Javaremi, M. N., & Argall, B. (2019) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros40897.2019.8968600 · Cited by 3
“The need for non-intrusive and online measures of workload has led to a large body of work looking at using varying psychophysiological sensors (including, but not limited to, heart rate variability, electrodermal activity, eye movements, and skin temperature) [8].”
BackgroundEvaluating Attention Management Systems for Dynamic Monitoring Tasks
Gasse, A., Lingler, A., Lorenz, M., Oulasvirta, A., Wintersberger, P., & Ebel, P. (2025) · Annual Symposium on Human-Computer Interaction for Work (CHIWORK) · doi:10.1145/3707640.3731920 · Cited by 4
“Finally, we evaluate workload using pupil diameter as a proxy, following related work [6, 25, 35].”
Reflexive Memory Authenticator: A Proposal for Effortless Renewable Biometrics
Blanchard, E., Kachanovich, S., Selker, T., & Waligorski, F. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-39749-4_7 · Cited by 2
“Because of this, most experiments control the luminance levels and try to keep them constant across all stimuli [19, 38].”
BackgroundSelf-citationAn examination of sustained attention during complex multitasking scenarios
Rann, J. C., & Almor, A. (2025) · Cognitive Research Principles and Implications · doi:10.1186/s41235-025-00674-x · Cited by 2
Improving Usability of Mobile Applications Through Speculation and Distraction Minimization
Lee, K. (2017) · Deep Blue (University of Michigan)
Evaluating Attention Management Systems for Dynamic Monitoring TasksPreprint
Gasse, A., Lingler, A., Lorenz, M., Oulasvirta, A., Wintersberger, P., & Ebel, P. (2025) · OSF Preprints (OSF Preprints) · doi:10.31219/osf.io/jq8ua_v1
Evaluating Attention Management Systems for Dynamic Monitoring TasksPreprint
Gasse, A., Lingler, A., Lorenz, M., Oulasvirta, A., Wintersberger, P., & Ebel, P. (2025) · OSF Preprints (OSF Preprints) · doi:10.31219/osf.io/jq8ua_v2
Evaluating Attention Management Systems for Dynamic Monitoring TasksPreprint
Gasse, A., Lingler, A., Lorenz, M., Oulasvirta, A., Wintersberger, P., & Ebel, P. (2025) · OSF Preprints (OSF Preprints) · doi:10.31219/osf.io/jq8ua_v3
Metadata
- Authors
- Rajan, R., Selker, T., & Lane, I.
- Affiliations
- Carnegie Mellon University (US)
- University of California, Berkeley (US)
- ORCID
- Selker, Ted
- Venue
- Proceedings of the 21st International Conference on Intelligent User Interfaces
- Publisher
- ACM
- Published
- 2016-03-07
- Pages
- 48-59
- OpenAlex
- W2293326312
- Cited by
- 23
- References
- 36
- Citations by year
- 2025: 6 · 2024: 1 · 2023: 2 · 2022: 1 · 2021: 1 · 2020: 4 · 2019: 1 · 2018: 5 · 2017: 2
- FWCI
- 4.50
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- ACM International Conference on Intelligent User Interfaces (IUI) (publishedVersion)
- Topics
- Social Sciences › Human Factors and Ergonomics › Human-Automation Interaction and Safety
- Social Sciences › Decision Sciences › Information Systems and Management › Personal Information Management and User Behavior
- Physical Sciences › Computer Science › Human-Computer Interaction › Gaze Tracking and Assistive Technology
- Keywords
- pupil dilation, physiological signals, multitasking, driving, human performance, low-cost cameras
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.