The DOI matches its Crossref record; 10 of the 10 references it cites were found in a registry or an index.
A comparison of four methods for cognitive load measurement
Open accessAbstract
Recognizing users' cognitive load during tasks is among the most important considerations for adaptive automation and interface evaluation. This paper compares four methods of measuring user cognitive load, that is, subjective rating of task difficulty, task completion time, performance accuracy and eye activity based physiological measurement. In order to be practically useful, the measurement should be sensitive to task difficulty variation and accurately predict user cognitive load. In this study, we examined the sensitivity and accuracy of these measures for five levels of cognitive load. ANOVA tests and Gaussian mixture model classification results show that subjective rating of task difficulty is the most effective measure, meanwhile eye activity based measure is as sensitive and accurate as using task completion time to classify two or more cognitive load levels, but has the relative advantage of being a real time measure and not requiring a specific action.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Here, various studies report on task completion time (e.g., [45,61]) and reaction time (e.g., [48,82]) or the number of errors (e.g., [13,61]) and task accuracy (e.g., [45,153]) -all highly related to changes in cognitive workload.”
From A Survey on Measuring Cognitive Workload in Human-Computer Interaction (2023) · cites this paper as [45]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Cognitive Load Theory and Instructional Design: Recent Developments
Paas, F., Renkl, A., & Sweller, J. (2003) · Educational Psychologist · doi:10.1207/s15326985ep3801_1 · Cited by 3,041
Cognitive Load Measurement as a Means to Advance Cognitive Load Theory
Paas, F., Tuovinen, J. E., Tabbers, H., & Van Gerven, P. W. M. (2003) · Educational Psychologist · doi:10.1207/s15326985ep3801_8 · Cited by 2,527
Computer interface evaluation using eye movements: methods and constructs
Goldberg, J. H., & Kotval, X. P. (1999) · International Journal of Industrial Ergonomics · doi:10.1016/s0169-8141(98)00068-7 · Cited by 1,053
Direct Measurement of Cognitive Load in Multimedia Learning
Brunken, R., Plass, J. L., & Leutner, D. (2003) · Educational Psychologist · doi:10.1207/s15326985ep3801_7 · Cited by 896 · cited 1×
“Physiological, behavioral measures and task performance are objectiveindirect techniques while brain activity measures and dual-task performance are objective-direct techniques [1].”
BackgroundPsycho-physiological measures for assessing cognitive load
Haapalainen, E., Kim, S., Forlizzi, J. F., & Dey, A. K. (2010) · Proceedings of the 12th ACM international conference on Ubiquitous computing · doi:10.1145/1864349.1864395 · Cited by 382 · cited 1×
“[5] used a Naïve Bayes classifier to discriminate two task difficulty levels and the pupil diameter measures achieved an average accuracy of 54% in visual perception and cognitive speed-focused tasks.”
MethodKlingner, J., Tversky, B., & Hanrahan, P. (2011) · Psychophysiology · doi:10.1111/j.1469-8986.2010.01069.x · Cited by 255 · cited 1×
“, [7] reported that remote eye tracker was precise enough to capture the dynamic pupil diameter changes during multiplication tasks with visual and auditory presentation, and indicated visual presentation inducing lower cognitive load.”
Backgroundadaptive aiding for human/computer control
Rouse, W. B. (1988) · Human Factors The Journal of the Human Factors and Ergonomics Society · doi:10.1177/001872088803000405 · Cited by 252
Eye movements and blinks: their relationship to higher cognitive processes
Fogarty, C., & Stern, J. A. (1989) · International Journal of Psychophysiology · doi:10.1016/0167-8760(89)90017-2 · Cited by 201
Eye activity as a measure of human mental effort in HCI
Chen, S., Epps, J., Ruiz, N., & Chen, F. (2011) · Proceedings of the 16th international conference on Intelligent user interfaces · doi:10.1145/1943403.1943454 · Cited by 174
Self-citationBlink Activity and Task Difficulty
Tanaka, Y., & Yamaoka, K. (1993) · Perceptual and Motor Skills · doi:10.2466/pms.1993.77.1.55 · Cited by 68
Research works printed but not linked: 2
- Hart , S. G. and Staveland , L. E . Development of NASA-TLX: results of empirical and theoretical research . In Hancock, P. A., Meshkati, N. (Eds), Human Mental Workload. Amsterdam , North-Holland ( 1988 ),139--183. Hart, S. G. and Staveland, L. E. Development of NASA-TLX: results of empirical and theoretical research. In Hancock, P. A., Meshkati, N. (Eds), Human Mental Workload. Amsterdam, North-Holland (1988),139--183.
- Wilson , G. F. and Eggemeier , F. T . Psychophysiological assessment of workload in multi-task environments . In: Damos, D. L. (Eds), Multiple-task Performance. London : Taylor & Francis Ltd ( 1991 ), 329--360. Wilson, G. F. and Eggemeier, F. T. Psychophysiological assessment of workload in multi-task environments. In: Damos, D. L. (Eds), Multiple-task Performance. London: Taylor & Francis Ltd (1991), 329--360.
Cited by
A Survey on Measuring Cognitive Workload in Human-Computer Interaction
Kosch, T., Karolus, J., Zagermann, J., Reiterer, H., Schmidt, A., & Woźniak, P. W. (2023) · ACM Computing Surveys · doi:10.1145/3582272 · Cited by 304
“Research showed various links between respiratory activities and an increased cognitive workload: Here, respiration belts or thermistor-based flow sensors underneath the participant’s nose were used to measure the respiration rate, its variance, and depth [106].”
Using task-induced pupil diameter and blink rate to infer cognitive load.
Chen, S., & Epps, J. (2014) · Human–Computer Interaction · doi:10.1080/07370024.2014.892428 · Cited by 200
“They were also studied for task analysis to improve human computer interaction (Iqbal et al., 2005; Haapalainen et al., 2010; Chen, Epps & Chen, 2013a) and for constructing effective and user-personalized training (Chen et al. 2011a; Sibley, Coyne & Baldwin, 2011).”
InfluentialSelf-citationSafari, M., Shalbaf, R., Bagherzadeh, S., & Shalbaf, A. (2024) · Scientific Reports · doi:10.1038/s41598-024-59652-w · Cited by 94
Diagnosing user perception and acceptance using eye tracking in web-based end-user development
Tzafilkou, K., & Protogeros, N. (2017) · Computers in Human Behavior · doi:10.1016/j.chb.2017.02.035 · Cited by 73
ADABase: A Multimodal Dataset for Cognitive Load Estimation
Oppelt, M. P., Foltyn, A., Deuschel, J., Lang, N. R., Holzer, N., Eskofier, B. M., & Yang, S. H. (2022) · Sensors · doi:10.3390/s23010340 · Cited by 64
Metadata
- Authors
- Chen, S., Epps, J., & Chen, F.
- Affiliations
- UNSW Sydney (AU)
- Data61 (AU)
- Venue
- Proceedings of the 23rd Australian Computer-Human Interaction Conference
- Publisher
- ACM
- Published
- 2011-11-28
- Pages
- 76-79
- OpenAlex
- W2010318514
- Cited by
- 63
- References
- 10
- Citations by year
- 2026: 6 · 2025: 9 · 2024: 6 · 2023: 8 · 2022: 7 · 2021: 4 · 2020: 3 · 2019: 4 · 2018: 1 · 2017: 3 · 2016: 1 · 2015: 3 · 2014: 3 · 2013: 3 · 2012: 1
- FWCI
- 4.79
- Type
- conference paper
- Language
- en
- Open access
- green
- hdl.handle.net
- Licence
- Locations
- Australian Conference on Computer-Human Interaction (OzCHI) (publishedVersion)
- UNSWorks (University of New South Wales, Sydney, Australia) (submittedVersion, cc-by-nc-nd)
- Funders
- Australian Government
- Australian Research Council
- Topics
- Social Sciences › Human Factors and Ergonomics › Human-Automation Interaction and Safety
- Physical Sciences › Computer Science › Human-Computer Interaction › Gaze Tracking and Assistive Technology
- Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
- Keywords
- cognitive load assessment, task completion time, performance accuracy, physiological measures, adaptive automation, human-computer interaction evaluation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: A comparison of four methods for cognitive load measurement. https://app.cochat.ai/papers/10.1145/2071536.2071547
- The paper
- Chen, S., Epps, J., & Chen, F. (2011). A comparison of four methods for cognitive load measurement. Proceedings of the 23rd Australian Computer-Human Interaction Conference. https://doi.org/10.1145/2071536.2071547
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.