The Index of Cognitive Activity: measuring cognitive workload
The DOI matches its Crossref record; 3 of the 4 references it cites were found in a registry or an index.
Abstract
The Index of Cognitive Activity is an innovative technique that provides an objective psychophysiological measurement of cognitive workload. As users operate in increasingly complex environments, it is essential that the designers of these environments understand the cognitive demands placed on the users. The Index of Cognitive Activity (ICA) provides an important estimate of the levels of cognitive effort of the user. The ICA is based on changes in pupil dilation that occur as a user interacts with a visual display. The Index is described, and several applications are presented.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Pupil size, for example, increases when humans are exposed to increased cognitive demand [57,58].”
From Detection-Response Task—Uses and Limitations (2018) · cites this paper as [57]
Citations
Cites
Pupillary responses index cognitive resource limitations
GRANHOLM, E., ASARNOW, R. F., SARKIN, A. J., & DYKES, K. L. (1996) · Psychophysiology · doi:10.1111/j.1469-8986.1996.tb01071.x · Cited by 462
Pupillary Responses During Information Processing Vary with Scholastic Aptitude Test Scores
Ahern, S., & Beatty, J. (1979) · Science · doi:10.1126/science.472746 · Cited by 391
The intensity dimension of thought: Pupillometric indices of sentence processing.
Just, M. A., & Carpenter, P. A. (1993) · Canadian Journal of Experimental Psychology / Revue canadienne de psychologie expérimentale · doi:10.1037/h0078820 · Cited by 362
Research works printed but not linked: 3
- marshall, 2002, The Index of Cognitive Activity Estimating Cognitive Effort from Pupil Dilation Unpublished manuscript
- marshall, 0, Combining EEG and Pupil Dilation to Measure Cognitive Workload: A Case Study, Paper submitted to the 36th Annual Hawaii International Conference on Systems Sciences
- kahneman, 1973, Attention and Effort, 17
Cited by
Estimating cognitive load using remote eye tracking in a driving simulator
Palinko, O., Kun, A. L., Shyrokov, A., & Heeman, P. (2010) · Proceedings of the 2010 Symposium on Eye-Tracking Research & Applications - ETRA '10 · doi:10.1145/1743666.1743701 · Cited by 371
“While head-mounted eye trackers are useful for precise eye measures, they are impractical in consumer driving environments and can also affect the results of the experiments [Marshall 2002]. Thus researchers have turned to remote eye tracking in cars to infer the cognitive load of the driver. Recarte and Nunes [2000]…”
BackgroundMethodInfluentialA Review of Psychophysiological Measures to Assess Cognitive States in Real-World Driving
Lohani, M., Payne, B. R., & Strayer, D. L. (2019) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2019.00057 · Cited by 348
Winn, M. B., Wendt, D., Koelewijn, T., & Kuchinsky, S. E. (2018) · Trends in Hearing · doi:10.1177/2331216518800869 · Cited by 339
“Contrary to this suggestion, Marshall (2002) described a framework for virtually real-time assessment of cognitive activity using pupil dilation.”
MethodBailey, B. P., & Iqbal, S. T. (2008) · ACM Transactions on Computer-Human Interaction · doi:10.1145/1314683.1314689 · Cited by 325
“Under conditions of controlled illumination, research shows that pupil dilation is a valid and reliable indicator of mental workload [Beatty 1982; Hess and Polt 1964; Hoecks and Levelt 1993; Juris and Velden 1977; Kahneman 1967; Marshall 2002; Nakayama and Takahashi 2002; Takahashi et al. 2000].”
BackgroundMethodEye Movement and Pupil Measures: A Review
Mahanama, B., Jayawardana, Y., Rengarajan, S., Jayawardena, G., Chukoskie, L., Snider, J., & Jayarathna, S. (2022) · Frontiers in Computer Science · doi:10.3389/fcomp.2021.733531 · Cited by 307
“During the experiments, the authors determined that the LHIPA was able to identify between dif fi cult tasks and easy or baseline tasks throughout the study, while IPA could do so during only one experiment.”
BackgroundMethodInfluentialA Survey on Measuring Cognitive Workload in Human-Computer Interaction
Kosch, T., Karolus, J., Zagermann, J., Reiterer, H., Schmidt, A., & Woźniak, P. W. (2023) · ACM Computing Surveys · doi:10.1145/3582272 · Cited by 304
“In addition to the established questionnaires, previous research has incorporated various custom questionnaires to subjectively measure cognitive workload – tailored to their specific use cases or tasks.”
The Psychometrics of Mental Workload: Multiple Measures Are Sensitive but Divergent
Matthews, G., Reinerman-Jones, L. E., Barber, D. J., & Abich, J. (2015) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720814539505 · Cited by 265
“The pupil’s reflexive response to light is filtered out, and only the isolated response to cognitive stimuli is processed (Marshall, 2002).”
BackgroundMethodKlingner, J., Tversky, B., & Hanrahan, P. (2011) · Psychophysiology · doi:10.1111/j.1469-8986.2010.01069.x · Cited by 255
“Recently, Marshall (2002) used a mental arithmetic task to validate a wavelet-based method of analyzing pupil measure-”
MethodContext-Aware Online Adaptation of Mixed Reality Interfaces
Lindlbauer, D., Feit, A. M., & Hilliges, O. (2019) · Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology · doi:10.1145/3332165.3347945 · Cited by 254
“…pupil dilation is confounded with ambient light (cf. [41]), several metrics exist that do not measure absolute size but change in size, such as the proprietary Index of Cognitive Activity et al. [31, 5], and the Index of Pupillary Activity (IPA) by Duchowski et al. [10], which we use in our work.”
MethodDuchowski, A. T., Krejtz, K., Krejtz, I., Biele, C., Niedzielska, A., Kiefer, P., Raubal, M., & Giannopoulos, I. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3173856 · Cited by 228
“We provide an alternative metric based on relative moment-tomoment pupil size, inspired by Marshall’s [44] proprietary (closed-source) Index of Cognitive Activity.”
BackgroundMethodInfluentialMeasuring the task-evoked pupillary response with a remote eye tracker
Klingner, J., Kumar, R., & Hanrahan, P. (2008) · Proceedings of the 2008 symposium on Eye tracking research & applications - ETRA '08 · doi:10.1145/1344471.1344489 · Cited by 222
“Marshall reported that some of her experimental subjects were bothered by wearing a head-mounted eye tracker, and that this may have distorted some of her results [Marshall 2002].”
BackgroundResultWhat does germane load mean? An empirical contribution to the cognitive load theory
Debue, N., & van de Leemput, C. (2014) · Frontiers in Psychology · doi:10.3389/fpsyg.2014.01099 · Cited by 209
“Although these differences are not statistically significant, results ( Table 3 ) indicated that the Index of Cognitive Activity was the highest in TO and the lowest in TP (for both all AOIs and paragraphs only) whereas mean pupil diameter showed an inverted pattern.”
BackgroundMethodInfluentialAutomatic Stress Classification With Pupil Diameter Analysis
Pedrotti, M., Mirzaei, M. A., Tedesco, A., Chardonnet, J.-R., Mérienne, F., Benedetto, S., & Baccino, T. (2014) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2013.848320 · Cited by 190
“Marshall (2000, 2002) first proposed the use of wavelet analysis for analyzing PD time series, and associated the occurrence of high-frequency variations (faster than 20 ms, i.e., > 50Hz) to instances of cognitive load.”
BackgroundA Model Relating Pupil Diameter to Mental Workload and Lighting Conditions
Pfleging, B., Fekety, D. K., Schmidt, A., & Kun, A. L. (2016) · Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858117 · Cited by 179
Pupil dilation during visual target detection
Privitera, C. M., Renninger, L. W., Carney, T., Klein, S., & Aguilar, M. (2010) · Journal of Vision · doi:10.1167/10.10.3 · Cited by 171
“This cognitive event (or task shift) is correlated with a series of abrupt pupil size enlargements over a period of time (Marshall, 2002; Marshall, Pleydell-Pearce, & Dickson, 2003).”
BackgroundA review of eye-tracking applications as tools for training
Rosch, J. L., & Vogel-Walcutt, J. J. (2013) · Cognition, Technology & Work · doi:10.1007/s10111-012-0234-7 · Cited by 167
“Keywords Eye tracking Cognitive load Instruction Adaptive e-learning”
BackgroundUnderstanding cognitive and affective mechanisms in social psychology through eye-tracking
Rahal, R.-M., & Fiedler, S. (2019) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2019.103842 · Cited by 159
An information-theoretic perspective on the costs of cognition
Zénon, A., Solopchuk, O., & Pezzulo, G. (2019) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2018.09.013 · Cited by 139
“Ar-ithmetic tasks, chess games or creative writing, which are well known for being cognitively demanding (Hess and Polt, 1964; Kellogg, 1987; Marshall, 2002; Westbrook and Braver, 2015) all assign a small prior probability mass for each possible decision and hence, lead to large divergence with the…”
BackgroundPublication guidelines and recommendations for pupillary measurement in psychophysiological studies
Steinhauer, S. R., Bradley, M. M., Siegle, G. J., Roecklein, K. A., & Dix, A. (2022) · Psychophysiology · doi:10.1111/psyp.14035 · Cited by 137
Beyond Good and Evil: What Motivations Underlie Children’s Prosocial Behavior?
Martin, A., & Olson, K. R. (2015) · Perspectives on Psychological Science · doi:10.1177/1745691615568998 · Cited by 163
“In particular, pupil dilation, a reflection of activity in the sympathetic nervous system, like all psychophysiological measures, can be an indicator of many possible underlying psychological states—for example, emotional arousal (Bradley, Miccoli, Escrig, & Lang, 2008; Partala & Surakka, 2003), stimulation ( Janisse,…”
BackgroundMeißner, M., & Oll, J. (2019) · Organizational Research Methods · doi:10.1177/1094428117744882 · Cited by 131
Building pipelines for educational data using AI and multimodal analytics: A “grey‐box” approach
Sharma, K., Papamitsiou, Z., & Giannakos, M. (2019) · British Journal of Educational Technology · doi:10.1111/bjet.12854 · Cited by 130
“Marshall (2002) attempted to quantify small discontinuities in pupil size that are related to cognitive activity.”
BackgroundResultInfluentialAvionics Human-Machine Interfaces and Interactions for Manned and Unmanned Aircraft
Lim, Y., Gardi, A., Sabatini, R., Ramasamy, S., Kistan, T., Ezer, N., Vince, J. P., & Bolia, R. S. (2018) · Progress in Aerospace Sciences · doi:10.1016/j.paerosci.2018.05.002 · Cited by 145
Pupillometry in Infancy Research
Hepach, R., & Westermann, G. (2016) · Journal of Cognition and Development · doi:10.1080/15248372.2015.1135801 · Cited by 106
“Similarly, changes in pupil dilation have been studied as a kind of cognitive index to measure mental workload (Marshall, 2002).”
BackgroundDevos, H., Gustafson, K. M., Ahmadnezhad, P., Liao, K., Mahnken, J. D., Brooks, W. M., & Burns, J. M. (2020) · Brain Sciences · doi:10.3390/brainsci10120994 · Cited by 132
“Therefore, we transformed the raw pupil data to Index of Cognitive Activity (ICA) scores [24,51].”
BackgroundMethodInfluentialPeysakhovich, V., Causse, M., Scannella, S., & Dehais, F. (2015) · International Journal of Psychophysiology · doi:10.1016/j.ijpsycho.2015.04.019 · Cited by 113
The Low/High Index of Pupillary Activity
Duchowski, A. T., Krejtz, K., Gehrer, N. A., Bafna, T., & Bækgaard, P. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376394 · Cited by 94
“Because the IPA is based on measurement of pupillary oscillation, it was thought immune to effects of lighting (and sampling rate, e.g., as indicated by Bartels and Marshall’s [6] Index of Cognitive Activity, or ICA).”
MethodInfluentialMultimodal Intelligent Eye-Gaze Tracking System
Biswas, P., & Langdon, P. (2015) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2014.1001301 · Cited by 81
“…users’ pupil diameters using the eye-gaze trackers, as pupils tend to dilate for higher cognitive load (Beatty & Lucero-Wagoner, 2000; Klingner, 2010), which is already exploited in human–computer interaction research (Iqbal, Zheng, & Bailey, 2004; Marshall, 2002; U.S. Patent No. 6,090,051, 2000).”
BackgroundMethodEye-Hand Behavior in Human-Robot Shared Manipulation
Aronson, R. M., Santini, T., Kübler, T., Kasneci, E., Srinivasa, S. S., & Admoni, H. (2018) · ACM/IEEE International Conference on Human-Robot Interaction (HRI) · doi:10.1145/3171221.3171287 · Cited by 118
“One available metric is pupil size, which several studies [8, 12, 49] demonstrate is correlated with a person’s cognitive effort.”
BackgroundDetection-Response Task—Uses and Limitations
Stojmenova, K., & Sodnik, J. (2018) · Sensors · doi:10.3390/s18020594 · Cited by 77
“Pupil size, for example, increases when humans are exposed to increased cognitive demand [57,58].”
BackgroundDiscovery of everyday human activities from long-term visual behaviour using topic models
Steil, J., & Bulling, A. (2015) · ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp) · doi:10.1145/2750858.2807520 · Cited by 76
“The analysis of the high-frequent fluctuations in pupil diameter has emerged as a robust and well-tested measure of cognitive activity, such as high cognitive load [27, 29].”
BackgroundEye-Tracking for Performance Evaluation and Workload Estimation in Space Telerobotic Training
Guo, Y., Freer, D., Deligianni, F., & Yang, G. (2021) · IEEE Transactions on Human-Machine Systems · doi:10.1109/thms.2021.3107519 · Cited by 85
Estimation of cognitive load based on the pupil size dilation
Gavas, R. D., Chatterjee, D., & Sinha, A. (2017) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/smc.2017.8122826 · Cited by 87
Pervasive Attentive User Interfaces
Bulling, A. (2016) · Computer · doi:10.1109/mc.2016.32 · Cited by 64
Real-time Prediction of User Performance based on Pupillary Assessment via Eye-Tracking
Buettner, R., Sauer, S., Maier, C., Eckhardt, A., & Law, G. G. S. O. M. A. (2018) · AIS Transactions on Human-Computer Interaction · doi:10.17705/1thci.00103 · Cited by 65
“Based on this patented work, she introduced the socalled index of cognitive activity (ICA) to measure cognitive effort (Marshall, 2002).”
BackgroundMethodAn introduction to eye tracking in human factors healthcare research and medical device testing
Pauszek, J. R. (2022) · Human Factors in Healthcare · doi:10.1016/j.hfh.2022.100031 · Cited by 74
Kinney, L., & O’Hare, D. (2019) · Human Factors The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720819854830 · Cited by 61
“…2005; Rivera et al., 2014), with an increase in autonomic arousal (Bradley, Miccoli, Escrig, & Lang, 2008), and with increasing cognitive workload (Bradley et al., 2008; Einhäuser, Stout, Koch, & Carter, 2008; Hyönä, Tommola, & Alaja, 1995; Kahneman, 1973; Marinescu et al., 2018; Marshall, 2002).”
BackgroundThe fundamentals of eye tracking part 2: From research question to operationalization
Hooge, I. T. C., Nuthmann, A., Nyström, M., Niehorster, D. C., Holleman, G. A., Andersson, R., & Hessels, R. S. (2025) · Behavior Research Methods · doi:10.3758/s13428-024-02590-2 · Cited by 76
“It is claimed that the index of cognitive activity (ICA) successfully separates the light reflex from the pupil dilation due to cognitive effort (Marshall, 2002).”
White, M. M., Zhang, W., Winslow, A. T., Zahabi, M., Zhang, F., Huang, H., & KABER, D. B. (2017) · IEEE Transactions on Human-Machine Systems · doi:10.1109/thms.2017.2759762 · Cited by 58
“less susceptible to environmental factors [35].”
BackgroundMethodInfluentialComparison of gaze behaviour of trainee and experienced surgeons during laparoscopic gastric bypass
Erridge, S., Ashraf, H., Purkayastha, S., Darzi, A. W., & Sodergren, M. H. (2017) · British journal of surgery · doi:10.1002/bjs.10672 · Cited by 53
Cognitive load estimation using ocular parameters in automotive
Prabhakar, G., Mukhopadhyay, A., Murthy, L. R. D., Madan, M., Deshmukh, S., & Biswas, P. (2020) · Transportation Engineering · doi:10.1016/j.treng.2020.100008 · Cited by 51
A Human-Centered Dynamic Scheduling Architecture for Collaborative Application
Pupa, A., van Dijk, W., & Secchi, C. (2021) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2021.3068888 · Cited by 51
Pedrotti, M., Lei, S., Dzaack, J., & Rötting, M. (2011) · Behavior Research Methods · doi:10.3758/s13428-010-0055-7 · Cited by 55
“…a patented method (Marshall, 2000) has been introduced, the index of cognitive activity (ICA), which has two major advantages: First, it allows separating the pupil light reflex from the dilation reflex; second, it allows precisely locating of cognitive load in the time dimension (Marshall, 2002).”
MethodMarshall, S. P., Pleydell-Pearce, C. W., & Dickson, B. T. (2003) · 36th Annual Hawaii International Conference on System Sciences, 2003. Proceedings of the · doi:10.1109/hicss.2003.1174298 · Cited by 46
“The Index of Cognitive Activity is a measurement based on the pupil dilation signal [2-3].”
BackgroundSelf-citationCognitive Human-Machine Interfaces and Interactions for Unmanned Aircraft
Lim, Y., Ramasamy, S., Gardi, A., Kistan, T., & Sabatini, R. (2017) · Journal of Intelligent & Robotic Systems · doi:10.1007/s10846-017-0648-9 · Cited by 46
The Index of Cognitive Activity as a Measure of Cognitive Processing Load in Dual Task Settings
Vogels, J., Demberg, V., & Kray, J. (2018) · Frontiers in Psychology · doi:10.3389/fpsyg.2018.02276 · Cited by 55
“…shown to increase with higher task difficulty in digit span tasks, visual search tasks, simulated driving and language processing Frontiers in Psychology | www.frontiersin.org 2 November 2018 | Volume 9 | Article 2276 tasks (Marshall, 2002, 2007; Schwalm et al., 2008; Demberg and Sayeed, 2016).”
BackgroundMethodDetecting drivers’ cognitive load from saccadic intrusion
Biswas, P., & Prabhakar, G. (2018) · Transportation Research Part F Traffic Psychology and Behaviour · doi:10.1016/j.trf.2018.01.017 · Cited by 47
Coyne, J. T., & Sibley, C. M. (2016) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/1541931213601009 · Cited by 44
“Since then, more recent work has focused on different analysis techniques to isolate and identify pupillary signals attributable to mental workload (e.g., Peysakhovich, Causse, Scannella, & Dehais, 2015; Marshall, 2002; Fong, Sibley, Coyne, & Baldwin, 2011).”
BackgroundAging and Eye Tracking: in the Quest for Objective Biomarkers
Marandi, R. Z., & Gazerani, P. (2019) · Future Neurology · doi:10.2217/fnl-2019-0012 · Cited by 53
Cognitive load estimation in VR flight simulator
Hebbar, A., Vinod, S., Shah, A. K., Pashilkar, A. A., & Biswas, P. (2023) · Journal of Eye Movement Research · doi:10.16910/jemr.15.3.11 · Cited by 50
“Literature review reveals that pupil diameter (PD) increases with increase in exerted mental effort (Petkar, et al., 2009; Marshall, 2002).”
BackgroundEye-tracking for human-centered mixed reality: promises and challenges
Gardony, A. L., Lindeman, R. W., & Brunyé, T. T. (2020) · Optical Architectures for Displays and Sensing in Augmented, Virtual, and Mixed Reality (AR, VR, MR) · doi:10.1117/12.2542699 · Cited by 55
Cross-Task and Cross-Participant Classification of Cognitive Load in an Emergency Simulation Game
Appel, T., Gerjets, P. H., Hoffmann, S., Moeller, K., Ninaus, M., Scharinger, C., Sevcenko, N., Wortha, F., & Kasneci, E. (2021) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2021.3098237 · Cited by 52
“Moreover, we employed the Index of Cognitive Activity (ICA) as proposed by Marshall [44], [45].”
MethodRiggs, E. M., Lieder, C. C., & Balliet, R. N. (2009) · Journal of Geoscience Education · doi:10.5408/1.3559525 · Cited by 41
Andrzejewska, M., & Stolińska, A. (2016) · Journal of Eye Movement Research · doi:10.16910/jemr.9.3.3 · Cited by 53
“An interesting index of the cognitive overload based on calculating slight transitory pupil dilations is Index of Cognitive Activity (ICA), developed by Marshall (2002; 2007).”
BackgroundApplying Real Time Physiological Measures of Cognitive Load to Improve Training
Coyne, J. T., Baldwin, C. L., Cole, A., Sibley, C. M., & Roberts, D. M. (2009) · Lecture notes in computer science · doi:10.1007/978-3-642-02812-0_55 · Cited by 50
“ICA is calculated as the frequency of a detection of an abrupt discontinuity in the pupil signal [21].”
MethodPupillary Response Based Cognitive Workload Measurement under Luminance Changes
Xu, J., Wang, Y., Chen, F., & Choi, E. (2011) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-23771-3_14 · Cited by 41
Naik, R., Kogkas, A., Ashrafian, H., Mylonas, G. P., & Darzi, A. W. (2022) · Journal of Surgical Research · doi:10.1016/j.jss.2022.07.010 · Cited by 48
Measuring cognitive workload across different eye tracking hardware platforms
Bartels, M., & Marshall, S. P. (2012) · Proceedings of the Symposium on Eye Tracking Research and Applications · doi:10.1145/2168556.2168582 · Cited by 37
“The Index of Cognitive Activity uses the signal processing techniques of wavelet analysis to detect small but reliable increases in pupil size while minimizing the impact of changes in light [Marshall 2002].”
MethodSelf-citationFixation-aligned pupillary response averaging
Klingner, J. (2010) · ACM Symposium on Eye Tracking Research and Applications (ETRA) · doi:10.1145/1743666.1743732 · Cited by 46
“Several research groups in cognitive science and HCI have shown that eye trackers can provide insight into internal mental processes in another way: through cognitive pupillometry (e.g. Pomplun and Sunkara [2003]).”
BackgroundMethodCognitive Engineering to Improve Patient Safety and Outcomes in Cardiothoracic Surgery
Zenati, M. A., Kennedy-Metz, L. R., & DIAS, R. D. (2019) · Seminars in Thoracic and Cardiovascular Surgery · doi:10.1053/j.semtcvs.2019.10.011 · Cited by 41
“This approach has been useful in military simulations associated with screen-based tasks under the augmented cognition program funded by the US Department of Defense through DARPA.25 Research done with eye-tracking technology in the healthcare setting is being conducted for intraoperative use in surgery, aiming to red…”
MethodA scoping review of research instruments for measuring student engagement: In need for convergence
Buntins, K., Kerres, M., & Heinemann, A. (2021) · International Journal of Educational Research Open · doi:10.1016/j.ijedro.2021.100099 · Cited by 35
Using Microsaccades to Estimate Task Difficulty During Visual Search of Layered Surfaces
Duchowski, A. T., Krejtz, K., Żurawska, J., & House, D. H. (2019) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2019.2901881 · Cited by 37
“(LF/HF) ratio [16], and the Index of Cognitive Activity [33], [34], [35] (measuring pupil oscillation, known as pupil unrest [36]), it is not clear which is superior.”
BackgroundKun, A. L., Palinko, O., Medenica, Ž., & Heeman, P. A. (2013) · Interspeech (USB) · doi:10.21437/interspeech.2013-595 · Cited by 39
“…their vehicles even while using the SDS. Pupil diameter has been used to assess cognitive load for a variety of tasks, such as mental arithmetic [5], auditory and visual vigilance [6], the effects of listening to, and identifying [7, 8], as well as generating [9] spoken information, and…”
MethodToward a Cognitive Theory of Multimedia Assessment (CTMMA)
Kirschner, P. A., Park, B., Malone, S., & Jarodzka, H. (2016) · Springer eBooks · doi:10.1007/978-3-319-17727-4_53-1 · Cited by 40
Simulation Training in Neuroangiography—Validation and Effectiveness
Kreiser, K., Ströber, L., Gehling, K. G., Schneider, F., Kohlbecher, S., Schulz, C. M., Zimmer, C., & Kirschke, J. S. (2020) · Clinical Neuroradiology · doi:10.1007/s00062-020-00902-5 · Cited by 29
“Observations of gaze direction, blink frequency, pupil size and dwell time are recognized means of examining attention and cognitive stress [29].”
BackgroundRational over-specification in visually-situated comprehension and production
Tourtouri, E. N., Delogu, F., Sikos, L., & Crocker, M. W. (2019) · Journal of Cultural Cognitive Science · doi:10.1007/s41809-019-00032-6 · Cited by 27
Measuring linguistically-induced cognitive load during driving using the ConTRe task
Demberg, V., Sayeed, A., Mahr, A., & Müller, C. (2013) · Proceedings of the 5th International Conference on Automotive User Interfaces and Interactive Vehicular Applications · doi:10.1145/2516540.2516546 · Cited by 28
“The ICA(2) has been suggested as a robust and fast measure of cognitive load which has previously been evaluated on a small range of tasks including digit span tasks, language comprehension tasks and a simulated driving task [17, 4].”
BackgroundAnalyzing Students' Mathematical Thinking in Technology-supported Environments
Karadağ, Z. (2010) · TSpace (University of Toronto) · Cited by 44
Pupillary response based cognitive workload index under luminance and emotional changes
Xu, J., Wang, Y., Chen, F., Choi, H. J., Li, G., Chen, S., & Hussain, S. (2011) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/1979742.1979819 · Cited by 28
“With the advance of modern sensing technologies, more and more physiological measures have been developed for the assessment of cognitive workload.”
Cognitive workload estimation due to vague visual stimuli using saccadic eye movements
Bodala, I. P., Yu, K., Mir, H., Thakor, N. V., & Al-Nashash, H. A. (2014) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc.2014.6944252 · Cited by 31
Pupillary transient responses to within-task cognitive load variation
Wong, H. K., & Epps, J. (2016) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2016.08.017 · Cited by 32
Classifying Cognitive Workload Using Eye Activity and EEG Features in Arithmetic Tasks
Chmielewska, M., Plechawska–Wójcik, M., Wawrzyk, M., & Wesołowska, K. (2017) · Communications in computer and information science · doi:10.1007/978-3-319-67642-5_8 · Cited by 31
Classifying Workload with Eye Movements in a Complex Task
Halverson, T., Estepp, J. R., Christensen, J., & Monnin, J. W. (2012) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/1071181312561012 · Cited by 29
“The preponderance of citations (e.g. Iqbal, et al., 2005; Marshall, 2002; Wierwille & Connor, 1983) would suggest that pupil size is most effective.”
BackgroundMethodDo You Feel Like a Hero Yet? Externalized Morality in Video Games
Heron, M. J., & Belford, P. H. (2014) · Open Access Institutional Repository at Robert Gordon University (Robert Gordon University) · Cited by 26
Zhou, T., Xia, P., Zhu, Q., & Du, J. (2022) · Safety Science · doi:10.1016/j.ssci.2023.106100 · Cited by 27
MOCAS: A Multimodal Dataset for Objective Cognitive Workload Assessment on Simultaneous Tasks
Jo, W., Wang, R., Cha, G.-E., Su, S., Senthilkumaran, R. K., Foti, D., & Min, B. (2024) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2024.3414330 · Cited by 39
“Previous research [4], [5], [6], [7], [8] has repeatedly shown that awareness and perception of human CWL can improve the performance of a human-machine interaction system as such awareness allows identifying and alleviating task errors that result from situations of task over-load or under-load.”
Eye’ll Help You Out! How the Gaze Cue Reduces the Cognitive Load Required for Reference Processing
Sekicki, M., & Staudte, M. (2018) · Cognitive Science · doi:10.1111/cogs.12682 · Cited by 29
“Sinceits appearance, the ICA has been tested in a variety of different cognitive tasks (e.g., Marshall, 2002, 2007; Schwalm, Keinath, & Zimmer, 2008).”
Multimodal behavioral and physiological signals as indicators of cognitive load
Zhou, J., Yu, K., Chen, F., Wang, Y., & Arshad, S. Z. (2018) · The Handbook of Multimodal-Multisensor Interfaces: Foundations, User Modeling, and Common Modality Combinations - Volume 2 · doi:10.1145/3107990.3108002 · Cited by 25
Decoupling light reflex from pupillary dilation to measure emotional arousal in videos
Raiturkar, P., Kleinsmith, A., Keil, A., Banerjee, A., & Jain, E. (2016) · ACM Symposium on Applied Perception · doi:10.1145/2931002.2931009 · Cited by 28
“Previous research has shown that increased cognitive effort is correlated with a constriction of the pupil [Marshall 2002; Bailey and Iqbal 2008].”
BackgroundAdaptive aiding with an individualized workload model based on psychophysiological measures
Teo, G. W. L., Matthews, G., Reinerman-Jones, L., & Barber, D. J. (2019) · Human-Intelligent Systems Integration · doi:10.1007/s42454-019-00005-8 · Cited by 27
“We examined a total of 26 psychophysiological measures, 1 including many listed in Table 1, i.e., EEG, ECG, CBFV, rSO 2 , eye fixation duration, Index of Cognitive Activity (ICA) (Marshall 2002), and pupil diameter measures as potential workload markers.”
MethodToker, D., Lallé, S., & Conati, C. (2017) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/3025171.3025187 · Cited by 29
“While including other more complex features such as Index of Cognitive Activity [42] and maximum pupil power [9] may lead to even better prediction results, we investigate only basic standard pupil features given that our main goal is to determine the general usefulness of including pupil features…”
BackgroundExperimental characterisation of eye-tracking sensors for adaptive human-machine systems
Lim, Y., Gardi, A., Pongsakornsathien, N., Sabatini, R., Ezer, N., & Kistan, T. (2019) · Measurement · doi:10.1016/j.measurement.2019.03.032 · Cited by 24
A cognitive model fleshes out Kahneman’s fast and slow systems
Faghihi, U., Estey, C., McCall, R. J., & Franklin, S. (2014) · Biologically Inspired Cognitive Architectures · doi:10.1016/j.bica.2014.11.014 · Cited by 29
“Kahneman and others (Bijleveld, Custers, & Aarts, 2009; Marshall, 2002; Peavler, 1974) postulate that the pupils of the eyes are sensitive indicators and good measures of mental effort.”
BackgroundAssessing surgeons' skill level in laparoscopic cholecystectomy using eye metrics
Gunawardena, N., Matscheko, M., Anzengruber, B., Ferscha, A., Schobesberger, M., Shamiyeh, A., Klugsberger, B., & Solleder, P. (2019) · ACM Symposium on Eye Tracking Research and Applications (ETRA) · doi:10.1145/3314111.3319832 · Cited by 24
“It is a waveletbased algorithm inspired by Marshall’s Index of Cognitive Activity [Marshall 2002].”
MethodEnhancing the effectiveness of human-robot teaming with a closed-loop system
Teo, G. W. L., Reinerman-Jones, L., Matthews, G., Szalma, J. L., Jentsch, F. G., & Hancock, P. A. (2017) · Applied Ergonomics · doi:10.1016/j.apergo.2017.07.007 · Cited by 29
Eye Tracking-Based Stress Classification of Athletes in Virtual Reality
Stoeve, M., Wirth, M., Farlock, R., Antunovic, A., Müller, V., & Eskofier, B. M. (2022) · Proceedings of the ACM on Computer Graphics and Interactive Techniques · doi:10.1145/3530796 · Cited by 32
“Building on the Index of Cognitive Activity (ICA) [Marshall 2002] and the Index of Pupillary Activity (IPA) [Duchowski et al. 2018], the Low/High Index of Pupillary Activity (LHIPA) has been developed by Duchowski et al. as a baseline-related measure of cognitive load [Duchowski et al. 2020].”
MethodPUPILLOMETRY AS A TOOL TO STUDY EXPERTISE IN MEDICINE
Szulewski, A., Kelton, D., & Howes, D. W. (2017) · Frontline Learning Research · doi:10.14786/flr.v5i3.256 · Cited by 23
“To address some of these issues, new techniques (like the index of cognitive activity) have been designed to separate out the light reflex from pupil changes secondary to cognitive workload by measuring abrupt discontinuities in the pupil size signal (Marshall, 2002).”
MethodModeling and inferring human trust in automation based on real- time eye tracking data
Lu, Y., & Sarter, N. B. (2020) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/1071181320641078 · Cited by 23
“Various eye tracking metrics/features have been widely used as indicators of cognitive processes such as decision making (Vachon & Tremblay, 2014), workload (Marshall, 2002) and situation awareness (Moore & Gugerty, 2010).”
MethodKsiążek, P., Zekveld, A. A., Wendt, D., Fiedler, L., Lunner, T., & Kramer, S. E. (2021) · Trends in Hearing · doi:10.1177/23312165211009351 · Cited by 23
“Besides, several ICA studies (Boehm-Davis & Marshall, 2003; Marshall, 2002) indicated that it is possible to separate dilation reflexes from light reflexes in the slightly preprocessed pupil data.”
MethodTask based interpretation of operator state information for adaptive support
Grootjen, M., Neerincx, M. A., & van Weert, J. C. M. (2006) · TNO Repository · Cited by 22
Aljehane, S., Sharif, B., & Maletic, J. I. (2023) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3591135 · Cited by 30
“Many early studies have shown the effects of cognitive workload effect on pupil size [31, 32, 47].”
BackgroundEvans-Harvey, K., Erridge, S., Karamchandani, U., Abdalla, S., Beatty, J. W., Darzi, A. W., Purkayastha, S., & Sodergren, M. H. (2020) · International Journal of Surgery · doi:10.1016/j.ijsu.2020.08.006 · Cited by 22
Analysis of maritime team workload and communication dynamics in standard and emergency scenarios
Lochner, M., Duenser, A., Lützhöft, M., Brooks, B., & Rozado, D. (2018) · Journal of Shipping and Trade · doi:10.1186/s41072-018-0028-z · Cited by 24
“This simulator suite includes a maximum of (Marshall, 2002) separate operational rooms, seven of which (excluding the main bridge and main control room) can be setup in various arrangements, such as tugs, secondary ships etc. (Fig.”
A cognitive decomposition to empirically study human performance in control room environments
Knisely, B. M., Joyner, J. S., Rutkowski, A. M., Wong, M., Barksdale, S., Hotham, H., Kharod, K. C., & Vaughn-Cooke, M. (2020) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2020.102438 · Cited by 20
Haghighat, P., Nguyen, T. Q., Valizadeh, M., Arvan, M., Parde, N., Kim, M., & Jeong, H. (2023) · Applied Ergonomics · doi:10.1016/j.apergo.2023.103969 · Cited by 25
Feeling committed to a robot: why, what, when and how?
Powell, H., & Michael, J. (2019) · Philosophical Transactions of the Royal Society B Biological Sciences · doi:10.1098/rstb.2018.0039 · Cited by 20
“This presents a complication because one of the principal ways in which cognitive load is measured is through pupillometry [74, 75, 76, 77], which is a difficult variable to measure in conditions that are not very tightly controlled.”
BackgroundPsychophysiological Metrics for Workload are Demand-Sensitive but Multifactorial
Reinerman-Jones, L., Matthews, G., Barber, D. J., & Abich, J. (2014) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/1541931214581204 · Cited by 18
Biswas, P., Dutt, V., & Langdon, P. (2015) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2015.1084112 · Cited by 19
“…that an increase in cognitive load results in a sudden hike in pupil dilation, which can be measured by a set of metrics calculated through Wavelet transform of the pupil signal considering driving simulator (Marshall, 2000, 2002), aviation (Marshall, 2007), or map reading (Klingner, 2010) tasks.”
Pupillometry: the Index of Cognitive Activity in a dual-task study
Demberg, V. (2013) · eScholarship (California Digital Library) · Cited by 22
Buettner, R., Scheuermann, I. F., Koot, C., Rössle, M., & Timm, I. J. (2017) · Lecture notes in information systems and organisation · doi:10.1007/978-3-319-67431-5_22 · Cited by 18
Metadata
- Authors
- Marshall, S. P.
- Affiliations
- San Diego State University (US)
- Corresponding author
- Marshall, S.P.
- ORCID
- Marshall, S.P.
- Venue
- Proceedings of the IEEE 7th Conference on Human Factors and Power Plants
- Publisher
- IEEE
- Published
- 2003-06-25
- Pages
- 7-5-7-9
- OpenAlex
- W1960419492
- Cited by
- 266
- References
- 4
- Citations by year
- 2026: 3 · 2025: 13 · 2024: 10 · 2023: 12 · 2022: 16 · 2021: 23 · 2020: 20 · 2019: 23 · 2018: 23 · 2017: 18 · 2016: 25 · 2015: 13 · 2014: 16 · 2013: 13 · 2012: 8
- FWCI
- 2.90
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- Conference on Human Factors and Power Plants (publishedVersion)
- Topics
- Social Sciences › Human Factors and Ergonomics › Human-Automation Interaction and Safety
- Physical Sciences › Computer Science › Human-Computer Interaction › Gaze Tracking and Assistive Technology
- Physical Sciences › Computer Science › Artificial Intelligence › Emotion and Mood Recognition
- Keywords
- mental workload, pupil dilation, psychophysiological measurement, cognitive effort, visual presentation, user interface design, human-computer interaction
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.