Look into my Eyes: Using Pupil Dilation to Estimate Mental Workload for Task Complexity Adaptation
The DOI matches its Crossref record; 15 of the 15 references it cites were found in a registry or an index.
Abstract
Cognition-aware systems acquire physiological data to derive implications about physical and mental states. Pupil dilation has recently attracted attention in the HCI community as an indicator for mental workload. The impact of mental workload on pupillary behavior has been extensively examined. However, systems making use of these measurements to alleviate mental workload have been scarcely evaluated. Our work investigates the expediency of task complexity adaption based on pupillary data in real-time. By conducting math tasks with different complexities, we calibrate a complexity adjustment system. In a pilot study (N=6), we evaluate the feasibility of changing task complexity using two different complexities. Our findings show less perceived mental workload during task complexity adaptation compared to presenting high task complexities only. We show the potential of pupil dilation as a valid metric for assessing mental workload as a modality for cognition-aware user interfaces.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research
(1988) · Advances in Psychology · doi:10.1016/s0166-4115(08)62386-9 · Cited by 15,003 · cited 4×
“This is supported by averaged pupil diameter mea-Figure surements and subjective feedback provided through NASA-TLX questionnaires.”
MethodInfluentialNASA-Task Load Index (NASA-TLX); 20 Years Later
Hart, S. G. (2006) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/154193120605000909 · Cited by 4,297 · cited 1×
“To specify the complexity of experimental conditions, questionnaires such as the NASA-TLX [7, 8] or the Driver Activity Load Index [13], are used to derive cognitive implications which depend on subjective perceptions of participants.”
MethodA tutorial on human activity recognition using body-worn inertial sensors
Bulling, A., Blanke, U., & Schiele, B. (2014) · ACM Computing Surveys · doi:10.1145/2499621 · Cited by 1,668 · cited 1×
“Sensing emotional states has attracted attention as a modality for context-aware computing and has been researched thoroughly in the domain of affective computing [4, 15].”
BackgroundPupil Diameter and Load on Memory
Kahneman, D., & Beatty, J. (1966) · Science · doi:10.1126/science.154.3756.1583 · Cited by 1,617 · cited 1×
“Demanding the short-term memory frequently over a timespan causes cognitive effort [1, 2, 9, 10, 11], a mental process which extends the pupil diameter (see Figure 2).”
BackgroundThe relationships among working memory, math anxiety, and performance
Ashcraft, M. H., & Kirk, E. P. (2001) · Journal of Experimental Psychology: General · doi:10.1037/0096-3445.130.2.224 · Cited by 1,445 · cited 2×
“Demanding the short-term memory frequently over a timespan causes cognitive effort [1, 2, 9, 10, 11], a mental process which extends the pupil diameter (see Figure 2).”
BackgroundPupil Size in Relation to Mental Activity during Simple Problem-Solving
Hess, E. H., & Polt, J. M. (1964) · Science · doi:10.1126/science.143.3611.1190 · Cited by 1,169 · cited 2×
“Demanding the short-term memory frequently over a timespan causes cognitive effort [1, 2, 9, 10, 11], a mental process which extends the pupil diameter (see Figure 2).”
BackgroundWorking memory, math performance, and math anxiety
Ashcraft, M. H., & Krause, J. A. (2007) · Psychonomic Bulletin & Review · doi:10.3758/bf03194059 · Cited by 802 · cited 2×
“Demanding the short-term memory frequently over a timespan causes cognitive effort [1, 2, 9, 10, 11], a mental process which extends the pupil diameter (see Figure 2).”
BackgroundTao, J., & Tan, T. (2005) · Lecture Notes in Computer Science · doi:10.1007/11573548_125 · Cited by 494 · cited 1×
“Sensing emotional states has attracted attention as a modality for context-aware computing and has been researched thoroughly in the domain of affective computing [4, 15].”
BackgroundA method to assess the driver mental workload: The driving activity load index (DALI)
Pauzié, A. (2008) · IET Intelligent Transport Systems · doi:10.1049/iet-its:20080023 · Cited by 246 · cited 1×
“To specify the complexity of experimental conditions, questionnaires such as the NASA-TLX [7, 8] or the Driver Activity Load Index [13], are used to derive cognitive implications which depend on subjective perceptions of participants.”
MethodA Model Relating Pupil Diameter to Mental Workload and Lighting Conditions
Pfleging, B., Fekety, D. K., Schmidt, A., & Kun, A. L. (2016) · Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858117 · Cited by 179 · cited 1×
“Since pupillary measurements are error prone to lighting conditions, Pfleging et al. [14] proposed a model for classifying cognitive workload of pupil dilation under different lighting conditions.”
BackgroundSelf-citation
Research works printed but not linked: 1
- Simone Benedetto, Marco Pedrotti, Luca Minin, Thierry Baccino, Alessandra Re, and Roberto Montanari. 2011. Driver workload and eye blink duration. Transportation research part F: traffic psychology and behaviour 14, 3 (2011), 199--208.
Cited by
A Survey on Measuring Cognitive Workload in Human-Computer Interaction
Kosch, T., Karolus, J., Zagermann, J., Reiterer, H., Schmidt, A., & Woźniak, P. W. (2023) · ACM Computing Surveys · doi:10.1145/3582272 · Cited by 304
Self-citationSurvey and Synthesis of State of the Art in Driver Monitoring
Halin, A., Verly, J., & Droogenbroeck, M. V. (2021) · Sensors · doi:10.3390/s21165558 · Cited by 107
“The pupil diameter is considered to be an indicator of mental workload (61; 105; 173).”
Integrating Eye-Tracking to Augmented Reality System for Surgical Training
Lu, S., Sanchez, Y. P., Jiang, X., & Zheng, B. (2020) · Journal of Medical Systems · doi:10.1007/s10916-020-01656-w · Cited by 62
“Eye-tracking technology provides useful pupillary and eye motion data, revealing cognitive information including humanmental workload [15] and attention shift [25].”
BackgroundVirtual Reality Adaptation Using Electrodermal Activity to Support the User Experience
Chiossi, F., Welsch, R., Villa, S., Chuang, L. L., & Mayer, S. (2022) · Big Data and Cognitive Computing · doi:10.3390/bdcc6020055 · Cited by 58
“For instance, when we perform cognitively demanding tasks, the physiological arousal is heightened, manifesting in increased physiological activity such as skin conductance level (SCL) [12], heart rate [13], or pupil dilation [14].”
BackgroundStress generation and non-intrusive measurement in virtual environments using eye tracking
Hirt, C., Eckard, M., & Kunz, A. M. (2020) · Journal of Ambient Intelligence and Humanized Computing · doi:10.1007/s12652-020-01845-y · Cited by 52
Metadata
- Authors
- Kosch, T., Hassib, M., Buschek, D., & Schmidt, A.
- Affiliations
- Ludwig-Maximilians-Universität München (DE)
- Venue
- Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems
- Publisher
- ACM
- Published
- 2018-04-20
- Pages
- 1-6
- OpenAlex
- W2798664662
- Cited by
- 43
- References
- 15
- Citations by year
- 2026: 1 · 2025: 4 · 2024: 4 · 2023: 4 · 2022: 6 · 2021: 7 · 2020: 11 · 2019: 5 · 2018: 1
- FWCI
- 10.74
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) (publishedVersion)
- Funders
- German Federal Ministry of Education and Research (16SV7599K)
- Topics
- Social Sciences › Human Factors and Ergonomics › Human-Automation Interaction and Safety
- Physical Sciences › Computer Science › Human-Computer Interaction › Gaze Tracking and Assistive Technology
- Physical Sciences › Computer Science › Artificial Intelligence › Emotion and Mood Recognition
- Keywords
- pupil dilation, mental workload, real-time adaptation, physiological signals, user interface design
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Look into my Eyes: Using Pupil Dilation to Estimate Mental Workload for Task Complexity Adaptation. https://app.cochat.ai/papers/10.1145/3170427.3188643
- The paper
- Kosch, T., Hassib, M., Buschek, D., & Schmidt, A. (2018). Look into my Eyes: Using Pupil Dilation to Estimate Mental Workload for Task Complexity Adaptation. Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems. https://doi.org/10.1145/3170427.3188643
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.