A Model Relating Pupil Diameter to Mental Workload and Lighting Conditions
Open accessThe DOI matches its Crossref record; 49 of the 49 references it cites were found in a registry or an index.
Abstract
In this paper, we present a proof-of-concept approach to estimating mental workload by measuring the user's pupil diameter under various controlled lighting conditions. Knowing the user's mental workload is desirable for many application scenarios, ranging from driving a car, to adaptive workplace setups. Typically, physiological sensors allow inferring mental workload, but these sensors might be rather uncomfortable to wear. Measuring pupil diameter through remote eye-tracking instead is an unobtrusive method. However, a practical eye-tracking-based system must also account for pupil changes due to variable lighting conditions. Based on the results of a study with tasks of varying mental demand and six different lighting conditions, we built a simple model that is able to infer the workload independently of the lighting condition in 75% of the tested conditions.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“While fNIRS is famous for brain sensing in HCI research due to its easy setup [177], latencies exist between stimulus onset and the exact measure.”
From A Survey on Measuring Cognitive Workload in Human-Computer Interaction (2023) · cites this paper as [177]
Citations
Cites
Paced Auditory Serial-Addition Task: A Measure of Recovery from Concussion
Gronwall, D. M. A. (1977) · Perceptual and Motor Skills · doi:10.2466/pms.1977.44.2.367 · Cited by 2,395 · cited 1×
“Tasks used to induce mental workload, such as the N-back test, delayed digit recall test, or the PASAT [12, 17, 27] can be presented as either a visual stimulus or as an auditory stimulus.”
MethodDetecting Stress During Real-World Driving Tasks Using Physiological Sensors
Healey, J. A., & Picard, R. W. (2005) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2005.848368 · Cited by 2,207 · cited 1×
“Other Physiological Measures of Mental Workload Physiological measures such as functional near-infrared spectroscopy (fNIRS) [11, 44], electroencephalography EEG [5, 10, 33, 42], heart rate [31, 40] and heart rate variability [31, 41], and skin conductance [13, 43], have also been used to track mental workload while e…”
MethodTask-evoked pupillary responses, processing load, and the structure of processing resources.
Beatty, J. (1982) · Psychological Bulletin · doi:10.1037/0033-2909.91.2.276 · Cited by 1,959 · cited 3×
“A dated but thorough review of the literature surrounding task-evoked pupillary responses outlined the relationship between changes in pupil size and mental workload [3].”
BackgroundMethodAge differences in short-term retention of rapidly changing information.
Kirchner, W. K. (1958) · Journal of Experimental Psychology · doi:10.1037/h0043688 · Cited by 1,798 · cited 1×
“Tasks used to induce mental workload, such as the N-back test, delayed digit recall test, or the PASAT [12, 17, 27] can be presented as either a visual stimulus or as an auditory stimulus.”
MethodPupil Diameter and Load on Memory
Kahneman, D., & Beatty, J. (1966) · Science · doi:10.1126/science.154.3756.1583 · Cited by 1,617 · cited 1×
“A number of early studies supported this relationship between pupillary changes and workload, and in a way established the foundation for this approach to psychophysiology [15, 16].”
ResultAn introduction to modern missing data analyses
Baraldi, A. N., & Enders, C. K. (2010) · Journal of School Psychology · doi:10.1016/j.jsp.2009.10.001 · Cited by 1,452 · cited 1×
“Finally, we used a single imputation method [2] to fill in the remaining 3 averages: in our method the missing average is set equal to an average calculated for the same participant, and same lighting conditions, but a different task difficulty.”
MethodA breadth-first survey of eye-tracking applications
Duchowski, A. T. (2002) · Behavior Research Methods, Instruments, & Computers · doi:10.3758/bf03195475 · Cited by 1,061 · cited 1×
“Presentation Modalities of Workload Tasks In many studies where eye-tracking data were used as indices of mental workload, the task used to induce workload was often a visually-based stimulus [7].”
MethodFrontal midline EEG dynamics during working memory
Onton, J., Delorme, A., & Makeig, S. (2005) · NeuroImage · doi:10.1016/j.neuroimage.2005.04.014 · Cited by 850 · cited 6×
“Frontal midline EEG dynamics during working memory.”
MethodInfluentialNeurophysiological measures of cognitive workload during human-computer interaction
Gevins, A., & Smith, M. E. (2003) · Theoretical Issues in Ergonomics Science · doi:10.1080/14639220210159717 · Cited by 414
Estimating workload using EEG spectral power and ERPs in the n-back task
Brouwer, A.-M., Hogervorst, M. A., van Erp, J. B. F., Heffelaar, T., Zimmerman, P. H., & Oostenveld, R. (2012) · Journal of Neural Engineering · doi:10.1088/1741-2560/9/4/045008 · Cited by 407 · cited 6×
“Frontal midline EEG dynamics during working memory.”
MethodInfluential
Research works printed but not linked: 6
- 10.1037/0033--2909.91.2.276 · doi:10.1037/0033--2909.91.2.276
- 10.1088/1741--2560/9/4/045008 · doi:10.1088/1741--2560/9/4/045008
- 10.1016/0167--8760(89)90017--2 · doi:10.1016/0167--8760(89)90017--2
- 10.1111/j.1469--8986.2010.01069.x · doi:10.1111/j.1469--8986.2010.01069.x
- 10.1016/0301-0511(95)05168--6 · doi:10.1016/0301-0511(95)05168--6
- 10.1016/s1369--8478(02)00012--8 · doi:10.1016/s1369--8478(02)00012--8
Cited by
A Review of Psychophysiological Measures to Assess Cognitive States in Real-World Driving
Lohani, M., Payne, B. R., & Strayer, D. L. (2019) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2019.00057 · Cited by 348
“to infer cognitive workload after accounting for some variations in lighting conditions (Pfleging et al., 2016; Reilly et al., 2018).”
BackgroundA Survey on Measuring Cognitive Workload in Human-Computer Interaction
Kosch, T., Karolus, J., Zagermann, J., Reiterer, H., Schmidt, A., & Woźniak, P. W. (2023) · ACM Computing Surveys · doi:10.1145/3582272 · Cited by 304
“Thus, different methods and models (e.g., [195]) were developed to ensure a valid measurement of cognitive workload using pupil dilation: Here, the total pupil dilation is seen as the sum of dilation due to light intensity and cognitive workload.”
Self-citationContext-Aware Online Adaptation of Mixed Reality Interfaces
Lindlbauer, D., Feit, A. M., & Hilliges, O. (2019) · Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology · doi:10.1145/3332165.3347945 · Cited by 254
“Since pupil dilation is confounded with ambient light (cf. [41]), several metrics exist that do not measure absolute size but change in size, such as the proprietary Index of Cognitive Activity et al. [31, 5], and the Index of Pupillary Activity (IPA) by Duchowski et al. [10], which we use in our…”
MethodDuchowski, A. T., Krejtz, K., Krejtz, I., Biele, C., Niedzielska, A., Kiefer, P., Raubal, M., & Giannopoulos, I. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3173856 · Cited by 228
“[53] and Palinko and Kun [50] provide notable examples related to HCI, including automotive and online learning domains.”
BackgroundMeasuring Cognitive Load using Eye Tracking Technology in Visual Computing
Zagermann, J., Pfeil, U., & Reiterer, H. (2016) · Proceedings of the Sixth Workshop on Beyond Time and Errors on Novel Evaluation Methods for Visualization · doi:10.1145/2993901.2993908 · Cited by 224
Cognitive Load Estimation in the Wild
Fridman, L., Reimer, B., Mehler, B., & Freeman, W. T. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3174226 · Cited by 161
“Numerous research groups have employed this form of the n-back task as a structured method for imposing defined levels of cognitive load including ISO associated standards research [2, 16] and in work carried out for the National Highway and Transportation Safety Administration [17].”
MethodCognitive Heat: Exploring the Usage of Thermal Imaging to Unobtrusively Estimate Cognitive Load
Abdelrahman, Y., Velloso, E., Dingler, T., Schmidt, A., & Vetere, F. (2017) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3130898 · Cited by 154
“Different approaches have been introduced to infer cognitive states ranging from using facial expressions [65], eye movements [18] and pupil size [6, 46], skin conductance [20, 32, 56], brain signals [8, 57, 58], Electrodermal activity (EDA) [17, 41, 42], heart and respiration rate [32].”
BackgroundSelf-citationDriver Distraction Using Visual-Based Sensors and Algorithms
Fernández, A., Usamentiaga, R., Candás, J. L. C., & Casado, R. (2016) · Sensors · doi:10.3390/s16111805 · Cited by 159
“Moreover, additional works highlighted the difficulty in estimating cognitive load using pupil diameter during a dialogue task [157] or in different lighting conditions [158].”
BackgroundYamada, Y., & Kobayashi, M. (2018) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2018.06.005 · Cited by 135
Reilly, J. J., Kelly, A. E., Kim, S. H., Jett, S., & Zuckerman, B. M. (2018) · Behavior Research Methods · doi:10.3758/s13428-018-1134-4 · Cited by 122
Improving Driver Emotions with Affective Strategies
Braun, M., Schubert, J., Pfleging, B., & Alt, F. (2019) · Multimodal Technologies and Interaction · doi:10.3390/mti3010021 · Cited by 117
“At the same time, unobtrusive contactless technologies like audio-visual sensors 70 or eye-tracking might have lower initial hurdles regarding acceptance in cars: a video stream of the driver can 71 be used to extract facial action coding units, which in combination with voice features can inform an emotion 72 detecti…”
MethodSelf-citationPupilRec: Leveraging Pupil Morphology for Recommending on Smartphones
Shen, X., Jiang, H., Liu, D., Yang, K., Deng, F., Lui, J. C. S., Liu, J., Dustdar, S., & Luo, J. (2022) · IEEE Internet of Things Journal · doi:10.1109/jiot.2022.3181607 · Cited by 105
“Pfleging et al. [19] explored the correlation between users’ mental workload and their pupillary responses, requiring users to complete tasks of various difficulty levels.”
BackgroundSurvey and Synthesis of State of the Art in Driver Monitoring
Halin, A., Verly, J., & Droogenbroeck, M. V. (2021) · Sensors · doi:10.3390/s21165558 · Cited by 107
The Low/High Index of Pupillary Activity
Duchowski, A. T., Krejtz, K., Gehrer, N. A., Bafna, T., & Bækgaard, P. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376394 · Cited by 94
The impact of luminance on tonic and phasic pupillary responses to sustained cognitive load
Peysakhovich, V., Vachon, F., & Dehais, F. (2016) · International Journal of Psychophysiology · doi:10.1016/j.ijpsycho.2016.12.003 · Cited by 94
“Most recently, Pfleging et al. (2016) also studied pupillary response, manipulating illuminance and luminance during a cognitive task.”
Studying Eye Movements as a Basis for Measuring Cognitive Load
Zagermann, J., Pfeil, U., & Reiterer, H. (2018) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3170427.3188628 · Cited by 98
“To address these limitations, eye tracking is suggested to measure users’ cognitive processes while interacting with a system in an objective and unobtrusive way [6].”
BackgroundInfluentialThe past, present, and future of gaze-enabled handheld mobile devices: survey and lessons learned
Khamis, M., Alt, F., & Bulling, A. (2018) · International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI) · doi:10.1145/3229434.3229452 · Cited by 97
“Cognitive load can be estimated through the pupil’s diameter [91], blink rate [29], or smooth pursuit eye movements [65].”
BackgroundMa, J., Gu, J., Jia, H., Yao, Z., & Chang, R. (2018) · Frontiers in Psychology · doi:10.3389/fpsyg.2018.00459 · Cited by 94
“Literature has proved that EEG and pupil diameter can be used as a physiological index for monitoring the level of drivers’ vigilance (Makeig and Jung, 1995; Jap et al., 2009; Zhao et al., 2012; Heeman et al., 2013; Pfleging et al., 2016).”
BackgroundZhou, C., Yuan, F., Huang, T., Zhang, Y., & Kaner, J. (2022) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph19159251 · Cited by 91
Your Eyes Tell: Leveraging Smooth Pursuit for Assessing Cognitive Workload
Kosch, T., Hassib, M., Woźniak, P. W., Buschek, D., & Alt, F. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3174010 · Cited by 79
“In particular, previous work showed that under controlled conditions, pupil dilation provides an estimate of cognitive load [43, 45].”
BackgroundMethodAlrefaie, M. T., Summerskill, S., & Jackon, T. W. (2019) · Accident Analysis & Prevention · doi:10.1016/j.aap.2019.06.011 · Cited by 82
Xue, T., Ali, A. E., Zhang, T., Ding, G., & Cesar, P. S. (2021) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2021.3124080 · Cited by 92
“(3) Similar to [60], [61], we found PD values are positively correlated with arousal levels,”
BackgroundEHTask: Recognizing User Tasks From Eye and Head Movements in Immersive Virtual Reality
Hu, Z., Bulling, A., Li, S., & Wang, G. (2021) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2021.3138902 · Cited by 73
Eye-Tracking for Performance Evaluation and Workload Estimation in Space Telerobotic Training
Guo, Y., Freer, D., Deligianni, F., & Yang, G. (2021) · IEEE Transactions on Human-Machine Systems · doi:10.1109/thms.2021.3107519 · Cited by 85
The fundamentals of eye tracking part 2: From research question to operationalization
Hooge, I. T. C., Nuthmann, A., Nyström, M., Niehorster, D. C., Holleman, G. A., Andersson, R., & Hessels, R. S. (2025) · Behavior Research Methods · doi:10.3758/s13428-024-02590-2 · Cited by 78
“…operationalization in the assessment of various cognitive states (Strauch et al., 2022; Papesh & Goldinger, 2024), includ-123 ing workload (Pfleging et al., 2016; Hess, 1965), attention (Mathôt et al., 2013; Binda et al., 2013) mental fatigue (Bafna & Hansen, 2021), and arousal (Bradshaw,…”
Background luminance effects on pupil size associated with emotion and saccade preparation
Cherng, Y., Baird, T., Chen, J., & Wang, C. (2020) · Scientific Reports · doi:10.1038/s41598-020-72954-z · Cited by 67
Cross-subject workload classification using pupil-related measures
Appel, T., Scharinger, C., Gerjets, P., & Kasneci, E. (2018) · Proceedings of the 2018 ACM Symposium on Eye Tracking Research & Applications · doi:10.1145/3204493.3204531 · Cited by 53
“The pupil diameter change that occurs with increasing workload is more pronounced if the illumination is low, but the standard deviation also increases [Pfleging et al. 2016].”
BackgroundPrediction of intrinsic and extraneous cognitive load with oculometric and biometric indicators
Ekin, M., Krejtz, K., Duarte, C., Duchowski, A. T., & Krejtz, I. (2025) · Scientific Reports · doi:10.1038/s41598-025-89336-y · Cited by 64
Zhang, T., Ali, A. E., Wang, C., Hanjalić, A., & Cesar, P. S. (2020) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376808 · Cited by 65
“However, PD is also quite sensitive to light conditions [77].”
BackgroundDarejeh, A., Marcus, N., Mohammadi, G., & Sweller, J. (2026) · Human Factors The Journal of the Human Factors and Ergonomics Society · doi:10.1177/00187208261427867 · Cited by 58
Cho, Y. (2021) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445577 · Cited by 59
“To control other factors that affect blinking patterns, we fixated a central target (to minimize visual stimulus and perceptual load [13,40]) with a fixed time duration for each question (to control time pressure which is another cognitive load factor [28]), while we also controlled ambient lighting conditions [56].”
BackgroundPinheiro, H. M., & da Costa, R. M. (2021) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2021.103757 · Cited by 51
Moment-to-Moment Detection of Internal Thought during Video Viewing from Eye Vergence Behavior
Huang, M. X., Li, J., Ngai, G., Leong, H. V., & Bulling, A. (2019) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3343031.3350573 · Cited by 52
Shahini, F., Park, J., Welch, K., & Zahabi, M. (2022) · Ergonomics · doi:10.1080/00140139.2022.2069868 · Cited by 48
“However, this might have changed the amount of reflected light and therefore could have affected the PCPS data as observed in previous studies (Beatty 1982; Pfleging et al. 2016).”
ResultHuang, J., Zhang, Q., Zhang, T., Wang, T., & Tao, D. (2024) · Sensors · doi:10.3390/s24031041 · Cited by 50
Rahman, H., Ahmed, M. U., Barua, S., & Begum, S. (2019) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2019.101634 · Cited by 46
Can EEG Be Adopted as a Neuroscience Reference for Assessing Software Programmers’ Cognitive Load?
Medeiros, J., Couceiro, R., Duarte, G., Duraes, J. A., Castelhano, J., Duarte, I. C., Castelo-Branco, M. S., Madeira, H., Carvalho, P., & Teixeira, C. (2021) · Sensors · doi:10.3390/s21072338 · Cited by 51
“This includes biomarkers related to physiologic manifestations driven by the ANS such as heart rate variability (HRV), through wrist-located photoplethysmography (PPG) [91,92], typically done with bracelets or smartwatches, and task-evoked pupillary response [15,93] that is available in most desktop eye tracking syste…”
BackgroundEye-tracking for human-centered mixed reality: promises and challenges
Gardony, A. L., Lindeman, R. W., & Brunyé, T. T. (2020) · Optical Architectures for Displays and Sensing in Augmented, Virtual, and Mixed Reality (AR, VR, MR) · doi:10.1117/12.2542699 · Cited by 55
“…have been linked to cognitive load, lapses of attention, and task adaptation 77,79,207,212–218 but pupil diameter is constantly influenced by ambient and focal lighting conditions 219,220 , off-axis distortion 221 , and gaze focal depth 222 , all of which shift frequently during MR experiences.”
BackgroundLook into my Eyes: Using Pupil Dilation to Estimate Mental Workload for Task Complexity Adaptation
Kosch, T., Hassib, M., Buschek, D., & Schmidt, A. (2018) · Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3170427.3188643 · Cited by 43
“Since pupillary measurements are error prone to lighting conditions, Pfleging et al. [14] proposed a model for classifying cognitive workload of pupil dilation under different lighting conditions.”
BackgroundSelf-citationA Conceptual framework for Adaptive User Interfaces for older adults
Machado, E., Singh, D., Cruciani, F., Chen, L., Hanke, S., Salvago, F., Kropf, J., & Holzinger, A. (2018) · IEEE International Conference on Pervasive Computing and Communications Workshops (PerCom Workshops) · doi:10.1109/percomw.2018.8480407 · Cited by 41
“to wear or be in touch with any measurement equipment [30].”
BackgroundPupil diameter differentiates expertise in dental radiography visual search
Castner, N., Appel, T., Eder, T., Richter, J., Scheiter, K., Keutel, C., Huettig, F., Duchowski, A. T., & Kasneci, E. (2020) · PLoS ONE · doi:10.1371/journal.pone.0223941 · Cited by 41
“A model was developed that measures pupil 188 dilation during workload that accounts for light changes, where task-related changes are 189 still measurable giving varying lighting conditions [62].”
MethodXue, T., Ali, A. E., Zhang, T., Ding, G., & Cesar, P. S. (2021) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445487 · Cited by 41
“However, previous works [79, 116] reported that ambient light will also greatly affect the PD values.”
BackgroundChan, S., Sapkota, S., Mathews, R., Zhang, H., & Nanayakkara, S. C. (2020) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3432190 · Cited by 43
“We used the n-back task for HCL, a previously established task to induce cognitive load [30, 36, 71].”
MethodImaging Time Series of Eye Tracking Data to Classify Attentional States
Vortmann, L.-M., Knychalla, J., Annerer‐Walcher, S., Benedek, M., & Putze, F. (2021) · Frontiers in Neuroscience · doi:10.3389/fnins.2021.664490 · Cited by 37
“Nonetheless, the connection between mental states and the pupil diameter is also assessed in the studies by Franklin et al. (2013), Pfleging et al. (2016), Unsworth and Robison (2016), and Toker and Conati (2017).”
MethodUsing Microsaccades to Estimate Task Difficulty During Visual Search of Layered Surfaces
Duchowski, A. T., Krejtz, K., Żurawska, J., & House, D. H. (2019) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2019.2901881 · Cited by 40
“Consequently, eye trackers are increasingly being used tomeasure cognitive load due to its recording of pupil diameter as amatter of course [23], [24], [25], [26], [27].”
Quality Evaluation of Modern Code Reviews Through Intelligent Biometric Program Comprehension
Hijazi, H., Duraes, J. A., Couceiro, R., Castelhano, J., Barbosa, R., Medeiros, J., Castelo-Branco, M. S., Carvalho, P., & Madeira, H. (2022) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2022.3158543 · Cited by 38
“Although plenty of papers show that HRV and Pupillography can be used to measure cognitive load (e.g., [18], [19], [20]) we want to ensure further that they can be applied to intellectually complex and abstract tasks such as code reviews.”
BackgroundMethodInfluentialEye-Tracking in Physical Human–Robot Interaction: Mental Workload and Performance Prediction
Upasani, S., Srinivasan, D., Zhu, Q., Du, J., & Leonessa, A. (2023) · Human Factors The Journal of the Human Factors and Ergonomics Society · doi:10.1177/00187208231204704 · Cited by 38
Qin, L., Dong, L., Xu, W., Zhang, L.-D., & León, A. S. (2018) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph15040656 · Cited by 35
“However, the changes in lighting are the main influencing factor [92].”
BackgroundGazeGraph: graph-based few-shot cognitive context sensing from human visual behavior
Lan, G., Heit, B., Scargill, T., & Gorlatova, M. A. (2020) · ACM Conference on Embedded Networked Sensor Systems (SenSys) · doi:10.1145/3384419.3430774 · Cited by 45
Robust cognitive load detection from wrist-band sensors
Borisov, V., Kasneci, E., & Kasneci, G. (2021) · Computers in Human Behavior Reports · doi:10.1016/j.chbr.2021.100116 · Cited by 47
Investigating Methods for Cognitive Workload Estimation for Assistive Robots
Aygun, A., Nguyen, T. D., Haga, Z., Aeron, S., & Scheutz, M. J. (2022) · Sensors · doi:10.3390/s22186834 · Cited by 40
“examined the correlation between pupil diameter and cognitive effort by adjusting the lighting conditions [33].”
BackgroundLee, B. C., Chung, K., & Kim, S.-H. (2018) · Applied Sciences · doi:10.3390/app8101780 · Cited by 36
“However, physiological measures depend on many factors, including other aspects of the user’s cognitive state, the user’s physical activity, and environmental variables such as temperature and lighting [64].”
BackgroundKerautret, L., Dabic, S., & Navarro, J. (2023) · Transportation Research Part F Traffic Psychology and Behaviour · doi:10.1016/j.trf.2023.01.016 · Cited by 33
Padilla, L., Castro, S. C., Quinan, P. S., Ruginski, I. T., & Creem-Regehr, S. H. (2019) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2019.2934286 · Cited by 38
“[9], which accounted for 70% of luminance differences when tested in six luminance conditions.”
BackgroundInfluentialZhang, L., & Cui, H. (2022) · Frontiers in Neuroscience · doi:10.3389/fnins.2022.1011475 · Cited by 38
“The environment’s brightness variations produce changes in the pupil size (Pfleging et al., 2016; Zagermann et al., 2016).”
BackgroundArousal-based pupil modulation is dictated by luminance
Pan, J., Klímová, M., McGuire, J. T., & Ling, S. (2022) · Scientific Reports · doi:10.1038/s41598-022-05280-1 · Cited by 32
Introduction to Multimodal Learning Analytics
Giannakos, M. N., Spikol, D., Mitri, D. D., Sharma, K., Ochôa, X., & Hammad, R. (2022) · Springer eBooks · doi:10.1007/978-3-031-08076-0_1 · Cited by 38
Kim, T.-G., Lim, S.-H., Yoon, S., & Yeom, D. J. (2022) · Building and Environment · doi:10.1016/j.buildenv.2022.109673 · Cited by 28
Cognitive Workload Assessment via Eye Gaze and EEG in an Interactive Multi-Modal Driving Task
Aygun, A., Lyu, B., Nguyen, T. D., Haga, Z., Aeron, S., & Scheutz, M. J. (2022) · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION · doi:10.1145/3536221.3556610 · Cited by 33
“There have been numerous studies that use pupil diameter as an indicator of cognitive workload levels [6, 9, 15, 39, 41, 42].”
BackgroundPupil diameter as a biomarker of effort in goal-directed gait
Saeedpour-Parizi, M. R., Hassan, S. E., & Shea, J. B. (2020) · Experimental Brain Research · doi:10.1007/s00221-020-05915-7 · Cited by 27
Ayaz, H., & Dehais, F. (2021) · Wiley eBooks · doi:10.1002/9781119636113.ch31 · Cited by 27
User Experience of Driver State Visualizations: A Look at Demographics and Personalities
Braun, M., Chadowitz, R., & Alt, F. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-29390-1_9 · Cited by 27
“In automotive research, this has been happening for some time in the form of fatigue detection from steering and video data [13, 33] or the deduction of cognitive load from pupil diameters [37].”
The effects of emotional arousal on pupil size depend on luminance
Pan, J., Sun, X., Park, E., Kaufmann, M., Klímová, M., McGuire, J. T., & Ling, S. (2024) · Scientific Reports · doi:10.1038/s41598-024-70895-5 · Cited by 26
“In a similar vein, Pfleging et al. 16 assessed pupillary responses during a cognitive load recall task under three light conditions, using 1, 2, or 3 lamps, as well as three stimulus brightness conditions, low, medium, and high brightness, where the exact luminance measurements were not reported.”
Expert gaze as a usability indicator of medical AI decision support systems: a preliminary study
Castner, N., Arsiwala-Scheppach, L. T., Mertens, S., Krois, J., Thaqi, E., Kasneci, E., Wahl, S., & Schwendicke, F. (2024) · npj Digital Medicine · doi:10.1038/s41746-024-01192-8 · Cited by 25
Affective Assistants: A Matter of States and Traits
Braun, M., & Alt, F. (2019) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3290607.3313051 · Cited by 22
“An assistant may estimate free cognitive resources, e.g. by monitoring limb and pupil movements, and so find the least distracting moment and modality [12, 14, 15].”
BackgroundMethodMeasurement and verification of cognitive load in multimedia presentation using an eye tracker
Cong, R., Tago, K., & Jin, Q. (2022) · Multimedia Tools and Applications · doi:10.1007/s11042-022-13294-0 · Cited by 21
“In terms of devices and collected data, an eye tracker [11, 17] or gaze tracker [19] was used in this study to obtain the gaze and pupil size, or the pupil diameter or its variation.”
BackgroundMethodCognitive Load Estimation Based on Pupillometry in Virtual Reality with Uncontrolled Scene Lighting
Eckert, M., Habets, E. A. P., & Rummukainen, O. (2021) · International Conference on Quality of Multimedia Experience (QoMEX) · doi:10.1109/qomex51781.2021.9465417 · Cited by 22
iReview: an Intelligent Code Review Evaluation Tool using Biofeedback
Hijazi, H., la Cruz, J. F. D., Castelhano, J., Couceiro, R., Castelo-Branco, M. S., Carvalho, P., & Madeira, H. (2021) · Proceedings/Proceedings - International Symposium on Software Reliability Engineering · doi:10.1109/issre52982.2021.00056 · Cited by 22
Classification of Officers’ Driving Situations Based on Eye-Tracking and Driver Performance Measures
Zahabi, M., Wang, Y., & Shahrampour, S. (2021) · IEEE Transactions on Human-Machine Systems · doi:10.1109/thms.2021.3090787 · Cited by 18
“In addition, collecting eye-tracking measures such as blink rate and PCPS in realistic settings might be challenging due to the changes in the lighting condition and during night shifts [38].”
BackgroundA Review of Pupillometry for Human-computer Interaction Studies
Köles, M. (2017) · Periodica Polytechnica Electrical Engineering and Computer Science · doi:10.3311/ppee.10736 · Cited by 20
Immersion Measurement in Watching Videos Using Eye-tracking Data
Choi, Y., Kim, J., & Hong, J.-H. (2022) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2022.3209311 · Cited by 21
“…and visual searches, and eye movement has been actively studied in many visual tasks as a mirror of personality [25], [26], [27], emotion [28], [29], [30], [31], [32], [33], [34], [35], interest and curiosity [36], [37], [38], attention [39], [40], [41], and cognitive load [12], [42], [43], [44].”
BackgroundA Cognitive Load Assessment Method Considering Individual Differences in Eye Movement Data
Chen, J., Zhang, Q., Cheng, L., Gao, X., & Ding, L. (2019) · International Conference on Control and Automation · doi:10.1109/icca.2019.8899595 · Cited by 19
Demonstrator for extracting cognitive load from pupil dilation for attention management services
Gollan, B., Haslgrübler, M., & Ferscha, A. (2016) · ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp) · doi:10.1145/2968219.2968550 · Cited by 16
Uncovering and Addressing Blink-Related Challenges in Using Eye Tracking for Interactive Systems
Grootjen, J. W., Weingärtner, H., & Mayer, S. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642086 · Cited by 15
Age-Related Differences in Fixation Pattern on a Companion Robot
Oh, Y. H., & Ju, D. Y. (2020) · Sensors · doi:10.3390/s20133807 · Cited by 16
“In order to clearly differentiate the bear from the white wall of the laboratory in the participant’s view [55], we placed dark gray Kent paper on the small wall behind the bear (Figure 2).”
BackgroundEvaluating mental workload: A taxonomic approach to evaluation tools based on ISO 10075
Bartolomei, M., Gervasi, R., Acconito, C., Angioletti, L., Cannizzaro, D., Balconi, M., Mastrogiacomo, L., & Franceschini, F. (2025) · Applied Ergonomics · doi:10.1016/j.apergo.2025.104659 · Cited by 15
Medeiros, J., Simões, M. A., Castelhano, J., Abreu, R., Couceiro, R., Henriques, J. M. O., Castelo-Branco, M. S., Madeira, H., Teixeira, C., & Carvalho, P. (2024) · PLoS ONE · doi:10.1371/journal.pone.0299108 · Cited by 14
Grootjen, J. W., Thalhammer, P., & Kosch, T. (2024) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3676531 · Cited by 14
“In this context, one major drawback is its sensitivity to various external factors, such as changes in lighting conditions [57] or the user’s emotional states [2], which can independently influence pupil size.”
InfluentialVortmann, L.-M., & Putze, F. (2021) · Sensors · doi:10.3390/s21248205 · Cited by 15
Identifying Explanation Needs: Towards a Catalog of User-based Indicators
Deters, H., Reinhardt, L., Droste, J., Obaidi, M., & Schneider, K. A. (2025) · IEEE International Requirements Engineering Conference (RE) · doi:10.1109/re63999.2025.00014 · Cited by 15
“There are already several established methods for recording mental load, such as the pupil width [39] or other biometric values [28], [40].”
A gaze interactive assembly instruction with pupillometric recording
Hansen, J. P., Mardanbegi, D., Biermann, F., & Bækgaard, P. (2018) · Behavior Research Methods · doi:10.3758/s13428-018-1074-z · Cited by 17
“The residual variance can then be taken as a representation of the luminance compensated pupil size, building on the premise that the pupil size can be modelled as the addition of two components, one caused by luminance and the other by other (subjective) factors, as demonstrated by Pfleging, Fekety, Schmidt, and Kun (…”
BackgroundStrauch, C., Barthelmäs, M., Altgassen, E., & Huckauf, A. (2020) · ACM Symposium on Eye Tracking Research and Applications (ETRA) · doi:10.1145/3379157.3388934 · Cited by 14
“Here, brightness was kept constant to preclude confounds in pupil data, however, applicability of pupillometric measurements is not restricted to strictly brightness controlled settings, as long as changes in brightness are sensed [Pfleging et al. 2016].”
BackgroundCognitive and visual processing of 3D enhanced disaster risk communication video
Kopacz, A., Banerski, G., & Biele, C. (2022) · International Journal of Disaster Risk Reduction · doi:10.1016/j.ijdrr.2022.102971 · Cited by 14
Khafaga, A. A. A. E. M. A., Moreira, L. C., & Horan, B. (2023) · International Conference on Automation and Computing (ICAC) · doi:10.1109/icac57885.2023.10275290 · Cited by 14
“Pupil dilation (PD), another indicator of ANS, has been one of the oldest and most established methods for measuring cognitive load according to the literature [51]–[53].”
MethodDetecting Intention Through Motor-Imagery-Triggered Pupil Dilations
Rozado, D., Lochner, M., Engelke, U., & Duenser, A. (2017) · Human-Computer Interaction · doi:10.1080/07370024.2017.1293540 · Cited by 14
“Addressing these issues will require different solutions, but preliminary attempts to address them are already under way (Pfleging et al., 2016).”
BackgroundWeidner, F., & Broll, W. (2020) · Personal and Ubiquitous Computing · doi:10.1007/s00779-020-01438-8 · Cited by 18
“Especially the latter can be a problem and researchers need to control for it [55].”
BackgroundCognitive workload classification of law enforcement officers using physiological responses
Wozniak, D., & Zahabi, M. (2024) · Applied Ergonomics · doi:10.1016/j.apergo.2024.104305 · Cited by 12
VisRecall++: Analysing and Predicting Visualisation Recallability from Gaze Behaviour
Wang, Y., Jiang, Y., Hu, Z., Ruhdorfer, C., Bâce, M., & Bulling, A. (2024) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3655613 · Cited by 14
“Numerous studies in eye tracking research and cognitive science have revealed that human eye movements can provide insights into human cognitive behaviour [10, 11], and this has inspired a growing number of researches in gaze-based cognitive state estimation [29, 50, 63].”
BackgroundPupillary Light Reflex Correction for Robust Pupillometry in Virtual Reality
Eckert, M., Robotham, T., Habets, E. A. P., & Rummukainen, O. (2022) · Proceedings of the ACM on Computer Graphics and Interactive Techniques · doi:10.1145/3530798 · Cited by 11
“…as a baseline and subtracted from the pupil dilation during tasks inducing cognitive load [Hirt et al. 2020], or the average pupil dilation during one fixed lighting condition can be subtracted from the measured pupil size to make it comparable to other lighting conditions [Pfleging et al. 2016].”
BackgroundResultCognitive Load and Oculometrics in the Educational Scenarios: A Systematic Review and Meta-Analysis
Ekin, M., Krejtz, K., & Krejtz, I. (2025) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3725832 · Cited by 11
“For example, Pfleging et al. (2016) [72] conducted a study measuring cognitive load under controlled lighting conditions for designing a predictive pupil diameter model.”
Wong, H. K., Epps, J., & Chen, S. (2018) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2018.2876348 · Cited by 12
“Such analysis has not been found in the literature (the closest being [30] for perceptual load and [43], [44] for affective measurement) since previous studies induced different illumination conditions before the tasks began and kept the luminance conditions constant during the tasks [45]–[48].”
ResultA comprehensive decoding of cognitive load
Zhu, X., Korivand, S., Hamill, K., Jalili, N., & Gong, J. (2022) · Smart Health · doi:10.1016/j.smhl.2022.100336 · Cited by 10
Examining Factors Influencing Cognitive Load of Computer Programmers
Issever, D., Çatalbaş, M. C., & Duran, F. (2023) · Brain Sciences · doi:10.3390/brainsci13081132 · Cited by 12
“conducted a fully controlled experiment with an intuitive classifier under different illumination conditions, during which a dataset and preliminary model were developed to estimate the mental load level based on eye movement [4].”
MethodPupilSense: A Novel Application for Webcam-Based Pupil Diameter Estimation
Shah, V., Watanabe, K., Moser, B. B., & Dengel, A. R. (2025) · ACM Symposium on Eye Tracking Research and Applications (ETRA) · doi:10.1145/3715669.3723125 · Cited by 11
“Previous studies show that the analysis of pupil diameter serves as an indicator of stress [45], attention [37, 55], or cognitive work loads [26,32,46].”
Eyes on URLs: Relating Visual Behavior to Safety Decisions
Ramkumar, N., Kothari, V. H., Mills, C., Koppel, R., Blythe, J., Smith, S. W., & Kun, A. L. (2020) · ACM Symposium on Eye Tracking Research and Applications (ETRA) · doi:10.1145/3379155.3391328 · Cited by 11
“When users face challenging tasks, their pupils dilate on the order of 0.1 to 0.5 mm [Beatty 1982; Pfleging et al. 2016].”
BackgroundMethodInfluentialSelf-citationWang, S., Li, Z., Zeng, C. L., & Hu, J. S. (2023) · Transportation Research Part C Emerging Technologies · doi:10.1016/j.trc.2023.104212 · Cited by 11
Gaze-based Metrics of Cognitive Load in a Conjunctive Visual Memory Task
Bacchin, D., Gehrer, N. A., Krejtz, K., Duchowski, A. T., & Gamberini, L. (2023) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3544549.3585650 · Cited by 11
Catronas, D., Sousa, J., Batista, A. R., Torres, N. L., Mesquita, A., Folia, V., & Silva, S. (2023) · Scientific Reports · doi:10.1038/s41598-023-40081-0 · Cited by 10
“…that deficits in the complementary, parvocellular pathway have also been hypothesized both as causes of duration perception deficits 18 , and as important deficits in dyslexia 11,19 , but these views are compatible as far as the relevance of visual processing skills in time perception is concerned.”
BackgroundAn eye gaze model for seismic interpretation support
de Santana, V. F., Ferreira, J. J., de Paula, R. A., & Cerqueira, R. (2018) · ACM Symposium on Eye Tracking Research and Applications (ETRA) · doi:10.1145/3204493.3204554 · Cited by 8
“And, it seems sensitive to information processing demands [Backs and Walrath 1992; Pfleging et al. 2016].”
BackgroundMethodGruden, T., Tomažič, S., & Jakus, G. (2024) · Sensors · doi:10.3390/s24103193 · Cited by 7
“It should be noted that pupil diameter stabilizing at a lower value than at TO could reflect lower cognitive load after TO or adaptation to changes in light conditions [75,104].”
Background
Metadata
- Authors
- Pfleging, B., Fekety, D. K., Schmidt, A., & Kun, A. L.
- Affiliations
- University of Stuttgart (DE)
- Clemson University (US)
- University of New Hampshire (US)
- Venue
- Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems
- Publisher
- ACM
- Published
- 2016-05-07
- Pages
- 5776-5788
- OpenAlex
- W2346312659
- Cited by
- 179
- References
- 49
- Citations by year
- 2026: 11 · 2025: 22 · 2024: 20 · 2023: 18 · 2022: 20 · 2021: 24 · 2020: 20 · 2019: 11 · 2018: 21 · 2017: 6 · 2016: 6
- FWCI
- 10.01
- Type
- conference paper
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- CHI Conference on Human Factors in Computing Systems (publishedVersion)
- Funders
- Deutsche Forschungsgemeinschaft (EXC 310/2 and SFB/Transregio 161, project C02)
- National Science Foundation (IIA-1358096)
- Topics
- Physical Sciences › Computer Science › Human-Computer Interaction › Gaze Tracking and Assistive Technology
- Social Sciences › Human Factors and Ergonomics › Human-Automation Interaction and Safety
- Physical Sciences › Computer Science › Artificial Intelligence › Emotion and Mood Recognition
- Keywords
- mental workload estimation, pupil size, remote eye tracking, lighting conditions, workload modeling, driving
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.