Task Load Estimation and Mediation Using Psycho-physiological Measures
The DOI matches its Crossref record; 35 of the 36 references it cites were found in a registry or an index.
Abstract
Human performance falls off predictably with excessive task difficulty. This paper reports on a search for a task load estimation metric. Of the five physiological signals analyzed from a multitasking study, only pupil dilation measures correlated well with real-time task load. The paper introduces a novel task load estimation model based on pupil dilation measures. We demonstrate its effectiveness in a multitasking driving scenario. Autonomous mediation of notifications using this model significantly improved user task performance compared to no mediation. The model showed promise even when used outside in a car. Results were achieved using low-cost cameras and open-source measurement tools lending to its potential to be used broadly.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
The magical number seven, plus or minus two: Some limits on our capacity for processing information.
Miller, G. A. (1994) · Psychological Review · doi:10.1037/0033-295x.101.2.343 · Cited by 17,161
Egeth, H., & Kahneman, D. (1975) · The American Journal of Psychology · doi:10.2307/1421603 · Cited by 6,972
Working memory: Looking back and looking forward
Baddeley, A. (2003) · Nature Reviews Neuroscience · doi:10.1038/nrn1201 · Cited by 5,200 · cited 1×
“Theories have been proposed to model how multiple tasks might compete for the same information processing resources [2, 35].”
BackgroundWorking memory span tasks: A methodological review and user’s guide
Conway, A. R. A., Kane, M. J., Bunting, M. F., Hambrick, D. Z., Wilhelm, O., & Engle, R. W. (2005) · Psychonomic Bulletin & Review · doi:10.3758/bf03196772 · Cited by 2,882 · cited 2×
“The notification task was based on cognitive tests frequently used to measure working memory capacity [6].”
MethodMultiple resources and performance prediction
Wickens, C. D. (2002) · Theoretical Issues in Ergonomics Science · doi:10.1080/14639220210123806 · Cited by 2,621 · cited 1×
“Successful dual-task scenarios depend on the availability and requirements of cognitive resources for the secondary task given resource consumption by the primary task [34].”
BackgroundCognitive Load Measurement as a Means to Advance Cognitive Load Theory
Paas, F., Tuovinen, J. E., Tabbers, H., & Van Gerven, P. W. M. (2003) · Educational Psychologist · doi:10.1207/s15326985ep3801_8 · Cited by 2,527
Working Memory Capacity as Executive Attention
Engle, R. W. (2002) · Current Directions in Psychological Science · doi:10.1111/1467-8721.00160 · Cited by 2,507
Multiple Resources and Mental Workload
Wickens, C. D. (2008) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872008x288394 · Cited by 2,164 · cited 1×
“Theories have been proposed to model how multiple tasks might compete for the same information processing resources [2, 35].”
BackgroundAn Efficient Algorithm for Spectral Analysis of Heart Rate Variability
Berger, R. D., Akselrod, S., Gordon, D., & Cohen, R. J. (1986) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.1986.325789 · Cited by 807
Using Electroencephalography to Measure Cognitive Load
Antonenko, P., Paas, F., Grabner, R., & van Gog, T. (2010) · Educational Psychology Review · doi:10.1007/s10648-010-9130-y · Cited by 742
An Analysis of Mental Workload in Pilots During Flight Using Multiple Psychophysiological Measures
Wilson, G. F. (2002) · The International Journal of Aviation Psychology · doi:10.1207/s15327108ijap1201_2 · Cited by 488
Galvanic skin response (GSR) as an index of cognitive load
Shi, Y., Ruiz, N., Taib, R., Choi, E., & Chen, F. (2007) · CHI '07 Extended Abstracts on Human Factors in Computing Systems · doi:10.1145/1240866.1241057 · Cited by 423
Emotional sweating across the body: Comparing 16 different skin conductance measurement locations
van Dooren, M., de Vries, J. J. G. (.-J., & Janssen, J. H. (2012) · Physiology & Behavior · doi:10.1016/j.physbeh.2012.01.020 · Cited by 411
Ryu, K., & Myung, R. (2005) · International Journal of Industrial Ergonomics · doi:10.1016/j.ergon.2005.04.005 · Cited by 399
Psycho-physiological measures for assessing cognitive load
Haapalainen, E., Kim, S., Forlizzi, J. F., & Dey, A. K. (2010) · Proceedings of the 12th ACM international conference on Ubiquitous computing · doi:10.1145/1864349.1864395 · Cited by 382 · cited 1×
“An increase in cortical activity causes a brief, small autonomic nervous response, which is reflected in signals such as heart rate (HR) and heart rate variability (HRV) [11, 27,36], electroencephalogram (EEG) [30, 36], electrocardiogram (ECG) [30], electrodermal activity (EDA) [14, 31], respiration [27], and heat flu…”
BackgroundMcFarlane, D. C. (2002) · Human–Computer Interaction · doi:10.1207/s15327051hci1701_2 · Cited by 378 · cited 1×
“McFarlane’s seminal work proposed four methods for coordinating interruptions, including immediate, negotiated, mediated and scheduled [25].”
BackgroundPassenger and cell phone conversations in simulated driving.
Drews, F. A., Pasupathi, M., & Strayer, D. L. (2008) · Journal of Experimental Psychology: Applied · doi:10.1037/a0013119 · Cited by 336
Measurement and analysis methods of heart rate and respiration for use in applied environments
Mulder, L. J. M. (1992) · Biological Psychology · doi:10.1016/0301-0511(92)90016-n · Cited by 316
Models of attention in computing and communication: from principles to applications
Horvitz, E., Kadie, C., Paek, T., & Hovel, D. (2003) · Communications of the ACM · doi:10.1145/636772.636798 · Cited by 313
A Primer on Multivariate Analysis of Variance (MANOVA) for Behavioral Scientists
Warne, R. T. (2020) · doi:10.7275/sm63-7h70 · Cited by 236
Online Affect Detection and Robot Behavior Adaptation for Intervention of Children With Autism
Liu, C., Conn, K., Sarkar, N., & Stone, W. (2008) · IEEE Transactions on Robotics · doi:10.1109/tro.2008.2001362 · Cited by 209
Towards an index of opportunity: understanding changes in mental workload during task execution
Iqbal, S. T., Adamczyk, P. D., Zheng, X. S., & Bailey, B. P. (2005) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1054972.1055016 · Cited by 196 · cited 2×
“Lastly, prior work has typically focused on cognitive load arising in single-task scenarios like document editing [15], and traffic control management [31].”
BackgroundOr, C. K. L., & Duffy, V. G. (2007) · Occupational Ergonomics · doi:10.3233/oer-2007-7202 · Cited by 154
Assessing Cognitive Load with Physiological Sensors
Ikehara, C. S., & Crosby, M. E. (2005) · Proceedings of the 38th Annual Hawaii International Conference on System Sciences · doi:10.1109/hicss.2005.103 · Cited by 150
Iqbal, S. T., & Bailey, B. P. (2010) · ACM Transactions on Computer-Human Interaction · doi:10.1145/1879831.1879833 · Cited by 131
The effects of speech production and speech comprehension on simulated driving performance
Kubose, T. T., Bock, K., Dell, G. S., Garnsey, S. M., Kramer, A. F., & Mayhugh, J. (2006) · Applied Cognitive Psychology · doi:10.1002/acp.1164 · Cited by 123
(2013) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-40477-1 · Cited by 94
Fredericks, T. K., Choi, S. D., Hart, J., Butt, S. E., & Mital, A. (2005) · International Journal of Industrial Ergonomics · doi:10.1016/j.ergon.2005.06.002 · Cited by 78
The Effect of Stress on Cognitive Load Measurement
Conway, D., Dick, I., Li, Z., Wang, Y., & Chen, F. (2013) · Lecture notes in computer science · doi:10.1007/978-3-642-40498-6_58 · Cited by 68
Kim, S., Chun, J., & Dey, A. K. (2015) · Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems · doi:10.1145/2702123.2702409 · Cited by 55
Han, K. T., & Guo, F. (2020) · ScholarWorks@UMassAmherst (University of Massachusetts Amherst) · doi:10.7275/p7x7-jb36 · Cited by 39
A Multimodal In-Car Dialogue System That Tracks The Driver's Attention
Kousidis, S., Kennington, C., Baumann, T., Buschmeier, H., Kopp, S., & Schlangen, D. (2014) · International Conference on Multimodal Interaction · doi:10.1145/2663204.2663244 · Cited by 29
Language and cognitive load in a dual task environment
Engonopoulos, N., Sayeed, A., & Demberg, V. (2013) · eScholarship (California Digital Library) · Cited by 16
The HRI-CMU Corpus of Situated In-Car Interactions
Cohen, D., Chandrashekaran, A., Lane, I. R., & Raux, A. (2016) · Signals and communication technology · doi:10.1007/978-3-319-21834-2_8 · Cited by 9
Self-citation(2000)
Research works printed but not linked: 2
- Angela Mahr , Michael Feld , Mohammad Mehdi Moniri , and Rafael Math . 2012 . The ConTRe (Continuous Tracking and Reaction) task: A flexible approach for assessing driver cognitive workload with high sensitivity . Adjunct Proceedings of the 4th AutomotiveUI. (2012), 88--91. Angela Mahr, Michael Feld, Mohammad Mehdi Moniri, and Rafael Math. 2012. The ConTRe (Continuous Tracking and Reaction) task: A flexible approach for assessing driver cognitive workload with high sensitivity. Adjunct Proceedings of the 4th AutomotiveUI. (2012), 88--91.
- Sandra P Marshall . 2007 . Identifying cognitive state from eye metrics. Aviation, space, and environmental medicine 78 , Supplement 1 (2007), B165 -- B175 . Sandra P Marshall. 2007. Identifying cognitive state from eye metrics. Aviation, space, and environmental medicine 78, Supplement 1 (2007), B165--B175.
Cited by
A Survey on Measuring Cognitive Workload in Human-Computer Interaction
Kosch, T., Karolus, J., Zagermann, J., Reiterer, H., Schmidt, A., & Woźniak, P. W. (2023) · ACM Computing Surveys · doi:10.1145/3582272 · Cited by 304
“While some work showed feasible accuracy [182, 202], other work argues that other modalities are superior [87, 201].”
InfluentialDatasets for Cognitive Load Inference Using Wearable Sensors and Psychological Traits
Gjoreski, M., Kolenik, T., Knez, T., Luštrek, M., Gams, M., Gjoreski, H., & Pejović, V. (2020) · Applied Sciences · doi:10.3390/app10113843 · Cited by 120
“Instead, physiological techniques for cognitive load measurement rely on signals, stemming from heart beat activity [27], breathing [28], heat flux [29], brain activity [30], and eye movement [31,32].”
BackgroundA Survey of Attention Management Systems in Ubiquitous Computing Environments
Anderson, C., Hübener, I., Seipp, A.-K., Ohly, S., David, K., & Pejović, V. (2018) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3214261 · Cited by 87
“Respiration [94, 99] duration of inhalation/exhalation, mean, median, stdev”
BackgroundInfluentialKim, A., Choi, W., Park, J., Kim, K., & Lee, U. (2018) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3287053 · Cited by 37
“Unlike existing distraction studies [54], interruptibility studies [37, 57] did not systematically examined how interrupting tasks affect driving performance by quantifying the change in deriving performance.”
BackgroundMethodResultInfluentialInterruptibility for In-vehicle Multitasking: Influence of Voice Task Demands and Adaptive Behaviors
Kim, A., Park, J.-M., & Lee, U. (2020) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3381009 · Cited by 30
“However, prior studies did not consider the secondary-task demand (e.g., the workload of the proactive voice services) [7, 60, 68].”
Background
Metadata
- Authors
- Rajan, R., Selker, T., & Lane, I.
- Affiliations
- Carnegie Mellon University (US)
- University of California, Berkeley (US)
- ORCID
- Selker, Ted
- Venue
- Proceedings of the 21st International Conference on Intelligent User Interfaces
- Publisher
- ACM
- Published
- 2016-03-07
- Pages
- 48-59
- OpenAlex
- W2293326312
- Cited by
- 23
- References
- 36
- Citations by year
- 2025: 6 · 2024: 1 · 2023: 2 · 2022: 1 · 2021: 1 · 2020: 4 · 2019: 1 · 2018: 5 · 2017: 2
- FWCI
- 4.50
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- ACM International Conference on Intelligent User Interfaces (IUI) (publishedVersion)
- Topics
- Social Sciences › Human Factors and Ergonomics › Human-Automation Interaction and Safety
- Social Sciences › Decision Sciences › Information Systems and Management › Personal Information Management and User Behavior
- Physical Sciences › Computer Science › Human-Computer Interaction › Gaze Tracking and Assistive Technology
- Keywords
- pupil dilation, physiological signals, multitasking, driving, human performance, low-cost cameras
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.