The Index of Pupillary Activity: Measuring Cognitive Load vis-à-vis Task Difficulty with Pupil Oscillation
The DOI matches its Crossref record; 70 of the 72 references it cites were found in a registry or an index.
Abstract
A novel eye-tracked measure of the frequency of pupil diameter oscillation is proposed for capturing what is thought to be an indicator of cognitive load. The proposed metric, termed the Index of Pupillary Activity, is shown to discriminate task difficulty vis-a-vis cognitive load (if the implied causality can be assumed) in an experiment where participants performed easy and difficult mental arithmetic tasks while fixating a central target (a requirement for replication of prior work). The paper's contribution is twofold: full documentation is provided for the calculation of the proposed measurement which can be considered as an alternative to the existing proprietary Index of Cognitive Activity (ICA). Thus, it is possible for researchers to replicate the experiment and build their own software which implements this measurement. Second, several aspects of the ICA are approached in a more data-sensitive way with the goal of improving the measurement's performance.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The Index of Cognitive Activity (ICA) [164] and the Index of Pupillary Activity (IPA) [62,63] follow a similar principle to separate light-invoked and cognitive workload-related changes in the pupil diameter.”
From A Survey on Measuring Cognitive Workload in Human-Computer Interaction (2023) · cites this paper as [63]
In the citing paper
“However, previous research has shown that various eye movements can also indicate increased cognitive demand [63,131,133] or derive the user proficiency during interaction [151].”
From A Survey on Measuring Cognitive Workload in Human-Computer Interaction (2023) · cites this paper as [63]
Citations
Cites
R: A Language and Environment for Statistical Computing
R Core Team (2025) · doi:10.32614/r.manuals · Cited by 352,181
Cognitive Load During Problem Solving: Effects on Learning
Sweller, J. (1988) · Cognitive Science · doi:10.1016/0364-0213(88)90023-7 · Cited by 11,048 · cited 10×
“Of the three predominant cognitive load measurement methods in CLT studies, namely self-reporting, the dual-task paradigm, and physiological measures [71], eye tracking, of the latter type, offers the greatest potential for delivering a non-invasive estimate of cognitive load (for an excellent recent review of psychop…”
BackgroundMethodInfluentialMeasuring emotion: The self-assessment manikin and the semantic differential
Bradley, M. M., & Lang, P. J. (1994) · Journal of Behavior Therapy and Experimental Psychiatry · doi:10.1016/0005-7916(94)90063-9 · Cited by 9,538 · cited 7×
“The Self-Assessment Manikin (SAM) [8] was used to evaluate participants’ arousal and emotional valence after each task.”
MethodInfluentialEgeth, H., & Kahneman, D. (1975) · The American Journal of Psychology · doi:10.2307/1421603 · Cited by 6,972
A theory of reading: From eye fixations to comprehension.
Just, M. A., & Carpenter, P. A. (1980) · Psychological Review · doi:10.1037/0033-295x.87.4.329 · Cited by 5,220
PsychoPy—Psychophysics software in Python
Peirce, J. W. (2007) · Journal of Neuroscience Methods · doi:10.1016/j.jneumeth.2006.11.017 · Cited by 4,603
(2001) · doi:10.1017/cbo9780511546396 · Cited by 4,482
NASA-Task Load Index (NASA-TLX); 20 Years Later
Hart, S. G. (2006) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/154193120605000909 · Cited by 4,297 · cited 1×
“We used the Raw NASA Task Load Index [21] (NASA-TLX) as a dependent measure of selfreported cognitive load.”
MethodSingularity detection and processing with wavelets
Mallat, S., & Hwang, W. L. (1992) · IEEE Transactions on Information Theory · doi:10.1109/18.119727 · Cited by 3,863
Cognitive Load Measurement as a Means to Advance Cognitive Load Theory
Paas, F., Tuovinen, J. E., Tabbers, H., & Van Gerven, P. W. M. (2003) · Educational Psychologist · doi:10.1207/s15326985ep3801_8 · Cited by 2,527
Working Memory Capacity as Executive Attention
Engle, R. W. (2002) · Current Directions in Psychological Science · doi:10.1111/1467-8721.00160 · Cited by 2,507
Task-evoked pupillary responses, processing load, and the structure of processing resources.
Beatty, J. (1982) · Psychological Bulletin · doi:10.1037/0033-2909.91.2.276 · Cited by 1,959 · cited 5×
“Numerous examples of eye-tracked baseline-related pupil diameter measurements exist, focusing either on inter- [25, 35, 38, 34], or intra-trial baseline differences [5, 54, 36, 10, 29].”
BackgroundMethodInfluentialGraps, A. (1995) · IEEE Computational Science and Engineering · doi:10.1109/99.388960 · Cited by 1,765
Eye fixations and cognitive processes
Just, M. A., & Carpenter, P. A. (1976) · Cognitive Psychology · doi:10.1016/0010-0285(76)90015-3 · Cited by 1,730
Pupil Diameter and Load on Memory
Kahneman, D., & Beatty, J. (1966) · Science · doi:10.1126/science.154.3756.1583 · Cited by 1,617
Eye Tracking in Human-Computer Interaction and Usability Research
Jacob, R. J. K., & Karn, K. S. (2003) · The Mind's Eye · doi:10.1016/b978-044451020-4/50031-1 · Cited by 1,567
Microsaccades uncover the orientation of covert attention
Engbert, R., & Kliegl, R. (2003) · Vision Research · doi:10.1016/s0042-6989(03)00084-1 · Cited by 1,390
Schmider, E., Ziegler, M., Danay, E., Beyer, L., & Bühner, M. (2010) · Methodology · doi:10.1027/1614-2241/a000016 · Cited by 1,290
Pupil Size in Relation to Mental Activity during Simple Problem-Solving
Hess, E. H., & Polt, J. M. (1964) · Science · doi:10.1126/science.143.3611.1190 · Cited by 1,169
Executive Attention, Working Memory Capacity, and a Two-Factor Theory of Cognitive Control
Engle, R. W., & Kane, M. J. (2003) · Psychology of Learning and Motivation · doi:10.1016/s0079-7421(03)44005-x · Cited by 1,104 · cited 1×
“, reading comprehension, complex learning, and reasoning [15, 16].”
BackgroundNasa-task load index (NASA-TLX); 20 years later: (577632012-009)
Hart, S. G. (2006) · PsycEXTRA Dataset · doi:10.1037/e577632012-009 · Cited by 838
Lix, L. M., Keselman, J. C., & Keselman, H. J. (1996) · Review of Educational Research · doi:10.3102/00346543066004579 · Cited by 474
Pupillary responses index cognitive resource limitations
GRANHOLM, E., ASARNOW, R. F., SARKIN, A. J., & DYKES, K. L. (1996) · Psychophysiology · doi:10.1111/j.1469-8986.1996.tb01071.x · Cited by 462
Pupillary Responses During Information Processing Vary with Scholastic Aptitude Test Scores
Ahern, S., & Beatty, J. (1979) · Science · doi:10.1126/science.472746 · Cited by 391
Pupillometry as a measure of cognitive effort in younger and older adults
Piquado, T., Isaacowitz, D., & Wingfield, A. (2010) · Psychophysiology · doi:10.1111/j.1469-8986.2009.00947.x · Cited by 390
Psycho-physiological measures for assessing cognitive load
Haapalainen, E., Kim, S., Forlizzi, J. F., & Dey, A. K. (2010) · Proceedings of the 12th ACM international conference on Ubiquitous computing · doi:10.1145/1864349.1864395 · Cited by 382 · cited 2×
“INTRODUCTION Systems that can detect and respond to their users’ cognitive load have the potential to improve both users’ experiences and outcomes in many domains: students and teachers, drivers, pilots, and surgeons may all benefit from systems that can detect when their jobs are too hard or easy and dynamically adap…”
BackgroundImproving digit span assessment of short-term verbal memory
Woods, D. L., Kishiyama, M. M., Yund, E. W., Herron, T. J., Edwards, B., Poliva, O., Hink, R. F., & Reed, B. (2011) · Journal of Clinical and Experimental Neuropsychology · doi:10.1080/13803395.2010.493149 · Cited by 380
Hyönä, J., Tommola, J., & Alaja, A.-M. (1995) · The Quarterly Journal of Experimental Psychology Section A · doi:10.1080/14640749508401407 · Cited by 371
Lix, L. M., Keselman, J. C., & Keselman, H. J. (1996) · Review of Educational Research · doi:10.2307/1170654 · Cited by 367
Integrating cognitive load theory and concepts of human–computer interaction
Hollender, N., Hofmann, C., Deneke, M., & Schmitz, B. (2010) · Computers in Human Behavior · doi:10.1016/j.chb.2010.05.031 · Cited by 328
Bailey, B. P., & Iqbal, S. T. (2008) · ACM Transactions on Computer-Human Interaction · doi:10.1145/1314683.1314689 · Cited by 325 · cited 2×
“INTRODUCTION Systems that can detect and respond to their users’ cognitive load have the potential to improve both users’ experiences and outcomes in many domains: students and teachers, drivers, pilots, and surgeons may all benefit from systems that can detect when their jobs are too hard or easy and dynamically adap…”
BackgroundHuman-centered design meets cognitive load theory: designing interfaces that help people think
Oviatt, S. (2006) · Proceedings of the 14th ACM international conference on Multimedia · doi:10.1145/1180639.1180831 · Cited by 315
The Index of Cognitive Activity: measuring cognitive workload
Marshall, S. P. (2003) · Proceedings of the IEEE 7th Conference on Human Factors and Power Plants · doi:10.1109/hfpp.2002.1042860 · Cited by 266 · cited 6×
“We provide an alternative metric based on relative moment-tomoment pupil size, inspired by Marshall’s [44] proprietary (closed-source) Index of Cognitive Activity.”
BackgroundMethodInfluentialKlingner, J., Tversky, B., & Hanrahan, P. (2011) · Psychophysiology · doi:10.1111/j.1469-8986.2010.01069.x · Cited by 255 · cited 1×
“Numerous examples of eye-tracked baseline-related pupil diameter measurements exist, focusing either on inter- [25, 35, 38, 34], or intra-trial baseline differences [5, 54, 36, 10, 29].”
BackgroundMapping and correcting the influence of gaze position on pupil size measurements
Hayes, T. R., & Petrov, A. A. (2016) · Behavior Research Methods · doi:10.3758/s13428-015-0588-x · Cited by 229
van der Geest, J. N., & Frens, M. A. (2002) · Journal of Neuroscience Methods · doi:10.1016/s0165-0270(01)00527-1 · Cited by 225
Measuring the task-evoked pupillary response with a remote eye tracker
Klingner, J., Kumar, R., & Hanrahan, P. (2008) · Proceedings of the 2008 symposium on Eye tracking research & applications - ETRA '08 · doi:10.1145/1344471.1344489 · Cited by 222
Pupillary changes in two memory tasks
Beatty, J., & Kahneman, D. (1966) · Psychonomic Science · doi:10.3758/bf03328444 · Cited by 216
Identifying cognitive state from eye metrics.
Marshall, S. P. (2007) · PubMed · Cited by 211
What does germane load mean? An empirical contribution to the cognitive load theory
Debue, N., & van de Leemput, C. (2014) · Frontiers in Psychology · doi:10.3389/fpsyg.2014.01099 · Cited by 209
Using task-induced pupil diameter and blink rate to infer cognitive load.
Chen, S., & Epps, J. (2014) · Human–Computer Interaction · doi:10.1080/07370024.2014.892428 · Cited by 200 · cited 7×
“Minimizing cognitive load is suggested as an integral part of humancentered design [10].”
BackgroundInfluentialA Model Relating Pupil Diameter to Mental Workload and Lighting Conditions
Pfleging, B., Fekety, D. K., Schmidt, A., & Kun, A. L. (2016) · Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858117 · Cited by 179 · cited 2×
“[53] and Palinko and Kun [50] provide notable examples related to HCI, including automotive and online learning domains.”
BackgroundTwo Visual Systems and Their Eye Movements: Evidence from Static and Dynamic Scene Perception
Helmert, J. R., Joos, M., Pannasch, S., & Velichkovsky, B. M. (2005) · eScholarship (California Digital Library) · Cited by 172
Task difficulty in mental arithmetic affects microsaccadic rates and magnitudes
Siegenthaler, E., Costela, F. M., McCamy, M. B., Di Stasi, L. L., Otero‐Millan, J., Sonderegger, A., Groner, R., Macknik, S., & Martinez‐Conde, S. (2014) · European Journal of Neuroscience · doi:10.1111/ejn.12395 · Cited by 166
Discerning Ambient/Focal Attention with Coefficient K
Krejtz, K., Duchowski, A. T., Krejtz, I., Szarkowska, A., & Kopacz, A. (2016) · ACM Transactions on Applied Perception · doi:10.1145/2896452 · Cited by 155
Self-citationPupil Unrest: An Example of Noise in a Biological Servomechanism
STARK, L. W., Campbell, F. W., & Atwood, J. G. (1958) · Nature · doi:10.1038/182857a0 · Cited by 138
Yuksel, B. F., Oleson, K. B., Harrison, L., Peck, E. M., Afergan, D., Chang, R., & Jacob, R. J. (2016) · Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858388 · Cited by 137
Cowley, B., Filetti, M., Lukander, K., Torniainen, J., Henelius, A., Ahonen, L., Barral, O., Kosunen, I., Valtonen, T., Huotilainen, M., et al. (2016) · Foundations and Trends® in Human–Computer Interaction · doi:10.1561/1100000065 · Cited by 110
Measuring the impact of subtitles on cognitive load: eye tracking and dynamic audiovisual texts
Kruger, J.-L., Hefer, E., & Matthew, G. (2013) · Proceedings of the 2013 Conference on Eye Tracking South Africa · doi:10.1145/2509315.2509331 · Cited by 106
Measuring Cognitive Load for Map Tasks Through Pupil Diameter
Kiefer, P., Giannopoulos, I., Duchowski, A. T., & Raubal, M. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-45738-3_21 · Cited by 83
Self-citationPupil shape as viewed along the horizontal visual field
Mathur, A., Gehrmann, J., & Atchison, D. A. (2013) · Journal of Vision · doi:10.1167/13.6.3 · Cited by 76
A study of artificial eyes for the measurement of precision in eye-trackers
Wang, D., Mulvey, F., Pelz, J. B., & Holmqvist, K. (2016) · Behavior Research Methods · doi:10.3758/s13428-016-0755-8 · Cited by 68
Palinko, O., & Kun, A. L. (2012) · Proceedings of the Symposium on Eye Tracking Research and Applications · doi:10.1145/2168556.2168650 · Cited by 59
Lyu, Y., Luo, X., Zhou, J., Yu, C., Miao, C., Wang, T., Shi, Y., & Kameyama, K.-I. (2015) · Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems · doi:10.1145/2702123.2702399 · Cited by 59
Chen, S., & Epps, J. (2014) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2014.2306916 · Cited by 57
Pupil responses to continuous aiming movements.
Jiang, X., Zheng, B., Bednarik, R., & Atkins, M. S. (2015) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2015.05.006 · Cited by 41
Measuring cognitive workload across different eye tracking hardware platforms
Bartels, M., & Marshall, S. P. (2012) · Proceedings of the Symposium on Eye Tracking Research and Applications · doi:10.1145/2168556.2168582 · Cited by 37
Pupil responses during discrete goal-directed movements
Jiang, X., Atkins, M. S., Tien, G., Bednarik, R., & Zheng, B. (2014) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/2556288.2557086 · Cited by 35
THE EFFECT OF TASK COMPLEXITY AND SEQUENCE ON RULE LEARNING AND PROBLEM SOLVING
SWELLER, J. (1976) · British Journal of Psychology · doi:10.1111/j.2044-8295.1976.tb01546.x · Cited by 34
Decoupling light reflex from pupillary dilation to measure emotional arousal in videos
Raiturkar, P., Kleinsmith, A., Keil, A., Banerjee, A., & Jain, E. (2016) · ACM Symposium on Applied Perception · doi:10.1145/2931002.2931009 · Cited by 28
Detecting expert’s eye using a multiple-kernel Relevance Vector Machine
Boccignone, G., Ferraro, M., Crespi, S. A., Robino, C., & de’Sperati, C. (2014) · Journal of Eye Movement Research · doi:10.16910/jemr.7.2.3 · Cited by 27
Pupillometrie als Methode zur Erfassung mentaler Beanspruchungen im automotiven Kontext
Schwalm, M. (2009) · PsyDok Dokumentenserver für die Psychologie (Leibniz-Zentrum für Psychologische Information und Dokumentation) · doi:10.22028/d291-23297 · Cited by 18
Image De-noising with a New Threshold Value Using Wavelets
Ismail, B., & Khan, A. (2021) · Journal of Data Science · doi:10.6339/jds.201204_10(2).0006 · Cited by 17
Effect of memory load on eye movement control: A study using the reading span test
Azuma, M., Minamoto, T., Yaoi, K., Osaka, M., & Osaka, N. (2014) · Journal of Eye Movement Research · doi:10.16910/jemr.7.5.3 · Cited by 14
Image De-noising with a New Threshold Value Using Wavelets
Ismail, B., & Khan, A. (2021) · Journal of Data Science · doi:10.6339/jds.2012.10(2).749 · Cited by 11
Understanding and Measuring Cognitive Workload: A Coordinated Multidisciplinary Approach
Boehm‐Davis, D. A., Gray, W. D., Adelman, L., Marshall, S. P., & Pozos, R. S. (2003) · doi:10.21236/ada417743 · Cited by 7
Designing Cognition-Adaptive Human–Computer Interface for Mission-Critical Systems
Shi, Y., Choi, E. H. C., Taib, R., & Chen, F. (2009) · Springer eBooks · doi:10.1007/b137171_12 · Cited by 7
Study of pupil diameter and eye movements to enhance flight safety
Peysakhovich, V. (2016) · doi:10.13140/rg.2.2.34241.35680 · Cited by 7
Gaze-contingent visual communication
Duchowski, A. T. (1998) · Cited by 5
Self-citation(2000)
Research works printed but not linked: 6
- Paul M. Fitts, Richard E. Jones, and John L. Milton. 1950. Eye Movements of Aircraft Pilots During Instrument-Landing Approaches. Aeronautical Engineering Review 9, 2 (1950), 24--29.
- LimeSurvey Project Team / Carsten Schmitz. 2015. LimeSurvey: An Open Source survey tool. LimeSurvey Project, Hamburg, Germany. http://www.limesurvey.org
- Sandra P. Marshall. 2000. Method and Apparatus for Eye Tracking Monitoring Pupil Dilation to Evaluate Cognitive Activity. US Patent No. 6,090,051. (18 July 2000).
- Jum C. Nunnally and Ira H. Bernstein. 1994. Psychometric Theory (3rd ed.). McGraw-Hill Inc., New York, NY.
- Gergely Rakoczi, Andrew Duchowski, and Margit Pohl. 2014. Designing Online Tests for a Virtual Learning Environment: Evaluation of Visual Behaviour at Different Task Types. In Proceedings of the International Conference on Human Behavior in Design (HBiD). The Design Society, Ascona, Switzerland.
- SR Research Ltd. 2008. EyeLink User Manual. SR Research Ltd., 5516 Main St., Osgoode, ON, Canada K0A 2W0. Version 1.4.0.
Cited by
Review of Eye Tracking Metrics Involved in Emotional and Cognitive Processes
Skaramagkas, V., Giannakakis, G., Ktistakis, E., Manousos, D., Karatzanis, I., Tachos, N., Tripoliti, E., Marias, K., Fotiadis, D. I., & Tsiknakis, M. (2023) · IEEE Reviews in Biomedical Engineering · doi:10.1109/rbme.2021.3066072 · Cited by 419
Eye tracking cognitive load using pupil diameter and microsaccades with fixed gaze
Krejtz, K., Duchowski, A. T., Niedzielska, A., Biele, C., & Krejtz, I. (2018) · PLOS ONE · doi:10.1371/journal.pone.0203629 · Cited by 349
Self-citationA Review of Psychophysiological Measures to Assess Cognitive States in Real-World Driving
Lohani, M., Payne, B. R., & Strayer, D. L. (2019) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2019.00057 · Cited by 348
A Survey on Measuring Cognitive Workload in Human-Computer Interaction
Kosch, T., Karolus, J., Zagermann, J., Reiterer, H., Schmidt, A., & Woźniak, P. W. (2023) · ACM Computing Surveys · doi:10.1145/3582272 · Cited by 304
“Pupil Diameter [4, 5, 9–11, 18–22, 27, 28, 39, 44–47, 55, 58, 62, 63, 72, 87, 92, 94, 99, 103, 107, 108, 112, 142, 143, 153, 154, 157, 165, 175, 187–189, 195, 199–201, 207, 215, 227, 236, 239, 248, 249, 255, 257, 266] Saccades [10, 21, 27, 44–47, 76, 87, 99, 165, 184, 193, 228, 236, 258] Eye Blinks…”
Context-Aware Online Adaptation of Mixed Reality Interfaces
Lindlbauer, D., Feit, A. M., & Hilliges, O. (2019) · Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology · doi:10.1145/3332165.3347945 · Cited by 254
“At run time, the system takes the users’ current cognitive load, estimated via the Index of Pupillary Activity [10], their task, and their environment into account.”
BackgroundMethodInfluential
Metadata
- Authors
- Duchowski, A. T., Krejtz, K., Krejtz, I., Biele, C., Niedzielska, A., Kiefer, P., Raubal, M., & Giannopoulos, I.
- Affiliations
- Clemson University (US)
- Uniwersytet SWPS (PL)
- Interactive Technologies Laboratory, Warsaw, Poland
- ETH Zurich (CH)
- TU Wien (AT)
- ORCID
- Venue
- Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems
- Publisher
- ACM
- Published
- 2018-04-21
- Pages
- 1-13
- OpenAlex
- W2786051348
- Cited by
- 228
- References
- 72
- Citations by year
- 2026: 24 · 2025: 42 · 2024: 37 · 2023: 20 · 2022: 23 · 2021: 36 · 2020: 25 · 2019: 16 · 2018: 5
- FWCI
- 16.52
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- CHI Conference on Human Factors in Computing Systems (publishedVersion)
- Funders
- Swiss National Science Foundation (200021_162886)
- National Science Foundation (IIS-1748380)
- Topics
- Physical Sciences › Computer Science › Human-Computer Interaction › Gaze Tracking and Assistive Technology
- Social Sciences › Human Factors and Ergonomics › Human-Automation Interaction and Safety
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Visual and Cognitive Learning Processes
- Keywords
- cognitive load, eye tracking, mental arithmetic, task difficulty
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.