The Validity of Physiological Measures to Identify Differences in Intrinsic Cognitive Load
Open accessThe DOI matches its Crossref record; 31 of the 31 references it cites were found in a registry or an index.
Abstract
A sample of 33 experiments was extracted from the Web-of-Science database over a 5-year period (2016–2020) that used physiological measures to measure intrinsic cognitive load. Only studies that required participants to solve tasks of varying complexities using a within-subjects design were included. The sample identified a number of different physiological measures obtained by recording signals from four main body categories (heart and lungs, eyes, skin, and brain), as well as subjective measures. The overall validity of the measures was assessed by examining construct validity and sensitivity. It was found that the vast majority of physiological measures had some level of validity, but varied considerably in sensitivity to detect subtle changes in intrinsic cognitive load. Validity was also influenced by the type of task. Eye-measures were found to be the most sensitive followed by the heart and lungs, skin, and brain. However, subjective measures had the highest levels of validity. It is concluded that a combination of physiological and subjective measures is most effective in detecting changes in intrinsic cognitive load.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing
Benjamini, Y., & Hochberg, Y. (1995) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1995.tb02031.x · Cited by 109,482
Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research
(1988) · Advances in Psychology · doi:10.1016/s0166-4115(08)62386-9 · Cited by 15,003
Sweller, J., Ayres, P., & Kalyuga, S. (2011) · doi:10.1007/978-1-4419-8126-4 · Cited by 5,531
Self-citationThayer, J. F., Åhs, F., Fredrikson, M., Sollers, J. J., & Wager, T. D. (2012) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2011.11.009 · Cited by 3,224 · cited 1×
“The HRV measure is generally accepted as a measure of cognitive load (e.g., Finsen et al., 2001; De Rivecourt et al., 2008; Thayer et al., 2012).”
Multiple resources and performance prediction
Wickens, C. D. (2002) · Theoretical Issues in Ergonomics Science · doi:10.1080/14639220210123806 · Cited by 2,621 · cited 1×
“Similar to the cardiovascular measures, respiratory measures are also influenced by and reflective for metabolic, psychological, and behavioral processes (Wientjes et al., 1998).”
BackgroundCognitive Load Measurement as a Means to Advance Cognitive Load Theory
Paas, F., Tuovinen, J. E., Tabbers, H., & Van Gerven, P. W. M. (2003) · Educational Psychologist · doi:10.1207/s15326985ep3801_8 · Cited by 2,527
Self-citationCognitive Architecture and Instructional Design: 20 Years Later
Sweller, J., van Merriënboer, J. J. G., & Paas, F. (2019) · Educational Psychology Review · doi:10.1007/s10648-019-09465-5 · Cited by 2,337 · cited 8×
“According to CLT intrinsic cognitive load is generated by the element interactivity (elements that need to be processed simultaneously) of the task (Sweller et al., 2011); whereas in instructional settings, cognitive load can also be generated by learners dealing with the instructional designs (extraneous cognitive lo…”
BackgroundInfluentialSelf-citationPaas, F. G. W. C. (1992) · Journal of Educational Psychology · doi:10.1037/0022-0663.84.4.429 · Cited by 2,150 · cited 2×
“Further, some studies (N = 8) also used single-item measures of effort, difficulty, and demand, that were not part of the NASA-TLX survey, and more consistent with the scale devised by Paas (1992).”
BackgroundSelf-citationValidating the interpretations and uses of test scores
Kane, M. T. (2013) · Journal of Educational Measurement · doi:10.1111/jedm.12000 · Cited by 2,110
Pupil Diameter and Load on Memory
Kahneman, D., & Beatty, J. (1966) · Science · doi:10.1126/science.154.3756.1583 · Cited by 1,617
Publication recommendations for electrodermal measurements
Society for Psychophysiological Research Ad Hoc Committee on Electrodermal Measures (2012) · Psychophysiology · doi:10.1111/j.1469-8986.2012.01384.x · Cited by 1,288
Paas, F. G. W. C., & Van Merriënboer, J. J. G. (1994) · Journal of Educational Psychology · doi:10.1037/0022-0663.86.1.122 · Cited by 1,198
Self-citationPupil Size in Relation to Mental Activity during Simple Problem-Solving
Hess, E. H., & Polt, J. M. (1964) · Science · doi:10.1126/science.143.3611.1190 · Cited by 1,169
Development of an instrument for measuring different types of cognitive load
Leppink, J., Paas, F., Van der Vleuten, C. P. M., Van Gog, T., & Van Merriënboer, J. J. G. (2013) · Behavior Research Methods · doi:10.3758/s13428-013-0334-1 · Cited by 1,066
Self-citationDiscriminating Stress From Cognitive Load Using a Wearable EDA Device
Setz, C., Arnrich, B., Schumm, J., La Marca, R., Troster, G., & Ehlert, U. (2010) · IEEE Transactions on Information Technology in Biomedicine · doi:10.1109/titb.2009.2036164 · Cited by 742
Innovations in Electrodermal Activity Data Collection and Signal Processing: A Systematic Review
Posada-Quintero, H. F., & Chon, K. H. (2020) · Sensors · doi:10.3390/s20020479 · Cited by 525
Instructional Efficiency: Revisiting the Original Construct in Educational Research
van Gog, T., & Paas, F. (2008) · Educational Psychologist · doi:10.1080/00461520701756248 · Cited by 473
Self-citationUsing subjective measures to detect variations of intrinsic cognitive load within problems
Ayres, P. (2006) · Learning and Instruction · doi:10.1016/j.learninstruc.2006.09.001 · Cited by 381 · cited 1×
“Under these conditions we assume total cognitive load to be equivalent to intrinsic cognitive load as no instruction or learning, or other interacting factors are directly involved (see Ayres, 2006).”
BackgroundSelf-citationCognitive Load Theory for the Design of Medical Simulations
Fraser, K. L., Ayres, P., & Sweller, J. (2015) · Simulation in Healthcare: The Journal of the Society for Simulation in Healthcare · doi:10.1097/sih.0000000000000097 · Cited by 306
Self-citationThe effects of specific respiratory rates on heart rate and heart rate variability
Song, H.-S., & Lehrer, P. M. (2003) · Applied Psychophysiology and Biofeedback · doi:10.1023/a:1022312815649 · Cited by 292
Threats to the validity of eye-movement research in psychology
Orquin, J. L., & Holmqvist, K. (2018) · Behavior Research Methods · doi:10.3758/s13428-017-0998-z · Cited by 280
Katahira, K., Yamazaki, Y., Yamaoka, C., Ozaki, H., Nakagawa, S., & Nagata, N. (2018) · Frontiers in Psychology · doi:10.3389/fpsyg.2018.00300 · Cited by 222
Using galvanic skin response for cognitive load measurement in arithmetic and reading tasks
Nourbakhsh, N., Wang, Y., Chen, F., & Calvo, R. A. (2012) · Proceedings of the 24th Australian Computer-Human Interaction Conference · doi:10.1145/2414536.2414602 · Cited by 219
From Theory to Practice: The Application of Cognitive Load Theory to the Practice of Medicine
Szulewski, A., Howes, D., van Merriënboer, J. J. G., & Sweller, J. (2021) · Academic Medicine · doi:10.1097/acm.0000000000003524 · Cited by 171
The influence of leads on cognitive load and learning in a hypertext environment
Antonenko, P. D., & Niederhauser, D. S. (2010) · Computers in Human Behavior · doi:10.1016/j.chb.2009.10.014 · Cited by 154
Contemporary cognitive load theory research: The good, the bad and the ugly
Kirschner, P. A., Ayres, P., & Chandler, P. (2011) · Computers in Human Behavior · doi:10.1016/j.chb.2010.06.025 · Cited by 144
Self-citationSigh rate and respiratory variability during mental load and sustained attention.
Vlemincx, E., Taelman, J., De Peuter, S., Van Diest, I., & Van Den Bergh, O. (2011) · Psychophysiology · doi:10.1111/j.1469-8986.2010.01043.x · Cited by 142 · cited 1×
“Brain measures were reported in 13 experiments (see Mazur et al., 2016; Tan et al., 2016; Wang et al., 2016; Hosseini et al., 2017; Reinerman-Jones et al., 2017; Wu et al., 2017; Katahira et al., 2018; He et al., 2019; Abd Rahman et al., 2020; Gupta et al., 2020; MakiMarttunen et al., 2020;…”
MethodW. M. Van Gerven, F. G. W. C. P. (2000) · Educational Gerontology · doi:10.1080/03601270050133874 · Cited by 81
Mazur, L. M., Mosaly, P. R., Moore, C., Comitz, E., Yu, F., Falchook, A. D., Eblan, M. J., Hoyle, L. M., Tracton, G., Chera, B. S., et al. (2016) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocw016 · Cited by 45
Pattyn, N., Migeotte, P.-F., Neyt, X., den Nest, A. V., & Cluydts, R. (2010) · Physiology & Behavior · doi:10.1016/j.physbeh.2010.04.037 · Cited by 32
Respiratory control when measuring respiratory sinus arrhythmia during a talking task.
Tininenko, J. R., Measelle, J. R., Ablow, J. C., & High, R. (2012) · Biological Psychology · doi:10.1016/j.biopsycho.2011.12.022 · Cited by 26
Cited by
A Survey on Measuring Cognitive Workload in Human-Computer Interaction
Kosch, T., Karolus, J., Zagermann, J., Reiterer, H., Schmidt, A., & Woźniak, P. W. (2023) · ACM Computing Surveys · doi:10.1145/3582272 · Cited by 304
“A careful evaluation of the actual measurement is inevitable, as external stressors, e.g., the social-evaluative threat of performing well in a study, may impact biomarkers [49].”
The synergy of embodied cognition and cognitive load theory for optimized learning
Zou, L., Zhang, Z., Mavilidi, M., Chen, Y., Herold, F., Ouwehand, K., & Paas, F. (2025) · Nature Human Behaviour · doi:10.1038/s41562-025-02152-2 · Cited by 131
Self-citationTrypke, M., Stebner, F., & Wirth, J. (2024) · Education Sciences · doi:10.3390/educsci14080872 · Cited by 11
Cognitive load theory: researching and planning teaching to maximise learning
Szulewski, A., van Gog, T., Paas, F., & Sweller, J. (2022) · Researching Medical Education · doi:10.1002/9781119839446.ch27 · Cited by 3
Self-citation
Metadata
- Authors
- Ayres, P., Lee, J. Y., Paas, F., & van Merriënboer, J. J. G.
- Venue
- Frontiers in Psychology
- Publisher
- Frontiers Media SA
- Published
- 2021-09-10
- Volume
- 12
- Pages
- 702538-702538
- ISSN
- 1664-1078 (ISSN-L)
- OpenAlex
- W3199395343
- Cited by
- 222
- References
- 31
- FWCI
- 24.38
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.