The DOI matches its Crossref record; 13 of the 13 references it cites were found in a registry or an index.
Cognitive Load Measurement as a Means to Advance Cognitive Load Theory
Abstract
In this article, we discuss cognitive load measurement techniques with regard to their contribu-tion to cognitive load theory (CLT). CLT is concerned with the design of instructional methods that efficiently use people’s limited cognitive processing capacity to apply acquired knowledge and skills to new situations (i.e., transfer). CLT is based on a cognitive architecture that consists of a limited working memory with partly independent processing units for visual and auditory information, which interacts with an unlimited long-term memory. These structures and func-tions of human cognitive architecture have been used to design a variety of novel efficient in-structional methods. The associated research has shown that measures of cognitive load can re-veal important information for CLT that is not necessarily reflected by traditional performance-based measures. Particularly, the combination of performance and cognitive load measures has been identified to constitute a reliable estimate of the mental efficiency of instruc-tional methods. The discussion of previously used cognitive load measurement techniques and their role in the advancement of CLT is followed by a discussion of aspects of CLT that may benefit by measurement of cognitive load. Within the cognitive load framework, we also discuss some promising new techniques.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“One of the most frequently used methods for measuring cognitive load is self-reporting, as becomes clear from the overview by Paas et al. (2003b).”
From Cognitive load theory, educational research, and instructional design: some food for thought (2010) · cites this paper as Paas et al. 2003b
In the citing paper
“The more often cognitive load is measured the more accurate the view of the actual cognitive load is, certainly if it is assumed that cognitive load may vary during the learning process (Paas et al. 2003b).”
From Cognitive load theory, educational research, and instructional design: some food for thought (2010) · cites this paper as Paas et al. 2003b
In the citing paper
“The claims by Paas et al. (2003b) are based on work by Paas et al. (1994) who presented an analysis of the reliability and sensitivity of the subjective rating method. Their data, again, come from two other studies, namely Paas (1992) and Paas and van Merrie ¨nboer (1994b).”
From Cognitive load theory, educational research, and instructional design: some food for thought (2010) · cites this paper as Paas et al. 2003b
In the citing paper
“In their overview of cognitive load measures, Paas et al. (2003b) claim that measures of cognitive load are related to differences in instructional formats in the majority of studies. This conclusion seems not to be completely valid. Not all of the studies they mention have shown such results.”
From Cognitive load theory, educational research, and instructional design: some food for thought (2010) · cites this paper as Paas et al. 2003b
In the citing paper
“Paas et al. (2003b, p. 66), however, claim that the uni-dimensional scale is reliable, sensitive to small differences in cognitive load, and valid (and non-intrusive).”
From Cognitive load theory, educational research, and instructional design: some food for thought (2010) · cites this paper as Paas et al. 2003b
In the citing paper
“With regard to the assessment factors, mental load is imposed by the task or environmental demands. This task-centered dimension, considered independent of subject characteristics, is constant for a given task in a given environment”
From Cognitive load theory, educational research, and instructional design: some food for thought (2010) · cites this paper as Paas et al. 2003b
In the citing paper
“Three different groups of techniques are used to measure cognitive load: self-ratings through questionnaires, physiological measures (e.g., heart rate variability, fMRI), and secondary tasks (for an overview see, Paas et al. 2003b).”
From Cognitive load theory, educational research, and instructional design: some food for thought (2010) · cites this paper as Paas et al. 2003b
In the citing paper
“For example, in their overview Paas et al. (2003b, p. 69) state that in the original study by Paas (1992) it was found that worked-out examples and completion problems were superior in terms of extraneous load, but extraneous load during learning was not measured in this study; beyond that, no differences between conditions were found on invested mental effort during the learning process.”
From Cognitive load theory, educational research, and instructional design: some food for thought (2010) · cites this paper as Paas et al. 2003b
In the citing paper
“Paas et al. (2003b) state that both instantaneous load and overall load are important for cognitive load theory, but since the theory only refers to addition of types of load and to overload; only instantaneous load should be considered for these purposes.”
From Cognitive load theory, educational research, and instructional design: some food for thought (2010) · cites this paper as Paas et al. 2003b
In the citing paper
“Pupillary reactions are also used and are regarded as sensitive for cognitive load variations (Paas et al. 2003b; van Gog et al. 2009), but have only been used in a limited number of studies (e.g., Schultheis and Jameson 2004). There are, however, indications that the sensitivity of this measure to workload changes diminishes with age of the participants (van Gerven et al. 2004).”
From Cognitive load theory, educational research, and instructional design: some food for thought (2010) · cites this paper as Paas et al. 2003b
In the citing paper
“These considerations show that the time aspect is not well considered when measuring cognitive load.”
From Cognitive load theory, educational research, and instructional design: some food for thought (2010) · cites this paper as Paas et al. (2003b)
In the citing paper
“According to Paas et al. (2003b) physiological measures are suited for capturing instantaneous load because they can monitor the load constantly, and overall load is often measured with questionnaire based measures. However, physiological measures are very rarely used in cognitive load research, whereas questionnaire measures of overall load prevail.”
From Cognitive load theory, educational research, and instructional design: some food for thought (2010) · cites this paper as Paas et al. 2003b
In the citing paper
“Paas et al. (2003b), citing Xie and Salvendy (2000), distinguish between different types of load in relation to time: instantaneous load, peak load, accumulated load, average load, and overall load.”
From Cognitive load theory, educational research, and instructional design: some food for thought (2010) · cites this paper as Paas et al. 2003b
In the citing paper
“Paas et al. (2003) and van Gog and Paas (2008) have noted that the subjective rating scale is used in many different ways than originally suggested by Paas and van Merriënboer (1994a, 1994b).”
From Cognitive Architecture and Instructional Design: 20 Years Later (2019) · cites this paper as Paas et al. (2003) and van Gog and Paas (2008)
In the citing paper
“Among other differences, researchers have used different verbal labels (i.e. ' task difficulty ' instead of ' invested mental effort ' ), used fewer categories (e.g. 5 or 7 instead of 9) and used only one measurement after all learning or test tasks, instead of an average of multiple measurements after each learning and test task.”
From Cognitive Architecture and Instructional Design: 20 Years Later (2019) · cites this paper as Paas et al. (2003) and van Gog and Paas (2008)
In the citing paper
“However, secondary task techniques have been criticised for their intrusiveness (i.e. imposing an extra cognitive load that may interfere with the primary task; Paas et al. 2003) and inability to differentiate between different types of cognitive load.”
From Cognitive Architecture and Instructional Design: 20 Years Later (2019) · cites this paper as Paas et al. 2003
In the citing paper
“Mental effort has been defined by Paas et al., as “the cognitive capacity that is actually allocated to accommodate the demands imposed by the task; thus, it can be considered to reflect the actual cognitive load” (Paas, Tuovinen et al., 2003, p. 64; see also Paas & Van Merriënboer, 1994b).”
From Effects of pairs of problems and examples on task performance and different types of cognitive load (2014) · cites this paper as Paas, Tuovinen et al., 2003
In the citing paper
“Subjective rating scales like Paas' (1992) nine-point unidimensional mental effort rating scale have been used intensively for measuring the overall cognitive load experienced by learners (for reviews : Paas, Tuovinen, Tabbers, & Van Gerven, 2003;Van Gog & Paas, 2008).”
From Effects of pairs of problems and examples on task performance and different types of cognitive load (2014) · cites this paper as Paas, Tuovinen, Tabbers, & Van Gerven, 2003
In the citing paper
“The science of cognitive load quantification has been traditionally separated into physiologic measurements and psychometric measurements of this construct (Paas et al. 2003).”
From Measuring physician cognitive load: validity evidence for a physiologic and a psychometric tool (2017) · cites this paper as Paas et al. 2003
In the citing paper
“It has been shown that measures of cognitive load can reveal important information about CLT beyond traditional performance metrics (Paas et al. 2003).”
From Measuring physician cognitive load: validity evidence for a physiologic and a psychometric tool (2017) · cites this paper as Paas et al. 2003
In the citing paper
“This scale has been widely used in the literature and has been shown to be a reliable and valid measure of overall cognitive load (Ayres 2006;Paas et al. 2003).”
From Measuring physician cognitive load: validity evidence for a physiologic and a psychometric tool (2017) · cites this paper as Paas et al. 2003
In the citing paper
“and therefore the addition of Twitter to the intervention did not increase the burden on working memory [36].”
From Tweets, Apps, and Pods: Results of the 6-Month Mobile Pounds Off Digitally (Mobile POD) Randomized Weight-Loss Intervention Among Adults (2011) · cites this paper as [36]
Citations
Cites
Cognitive Load During Problem Solving: Effects on Learning
Sweller, J. (1988) · Cognitive Science · doi:10.1016/0364-0213(88)90023-7 · Cited by 11,048
Cognitive Architecture and Instructional Design
Sweller, J., van Merrienboer, J. J. G., & Paas, F. G. W. C. (1998) · Educational Psychology Review · doi:10.1023/a:1022193728205 · Cited by 6,023
Self-citationPaas, F. G. W. C. (1992) · Journal of Educational Psychology · doi:10.1037/0022-0663.84.4.429 · Cited by 2,150
Self-citationKalyuga, S., Ayres, P., Chandler, P., & Sweller, J. (2003) · Educational Psychologist · doi:10.1207/s15326985ep3801_4 · Cited by 1,927
Paas, F. G. W. C., & Van Merriënboer, J. J. G. (1994) · Journal of Educational Psychology · doi:10.1037/0022-0663.86.1.122 · Cited by 1,198 · cited 1×
“The first attempt was made by Sweller (1988) in his study on cognitive load during problem solving.”
BackgroundSelf-citationInstructional control of cognitive load in the training of complex cognitive tasks
Paas, F. G. W. C., & Van Merriënboer, J. J. G. (1994) · Educational Psychology Review · doi:10.1007/bf02213420 · Cited by 968
Self-citationMayer, R. E., & Chandler, P. (2001) · Journal of Educational Psychology · doi:10.1037/0022-0663.93.2.390 · Cited by 762
Assimilating complex information
Pollock, E., Chandler, P., & Sweller, J. (2002) · Learning and Instruction · doi:10.1016/s0959-4752(01)00016-0 · Cited by 692 · cited 4×
“Furthermore, differential effects on memory load have been found in studies on expertise (Kalyuga, Chandler, & Sweller, 1998, 2000, 2001; Pollock et al., 2002; Tuovinen & Sweller, 1999) and on age differences (Van Gerven, Paas, van Merriënboer, Hendriks, et al.”
BackgroundMethodInfluentialWhen problem solving is superior to studying worked examples.
Kalyuga, S., Chandler, P., Tuovinen, J., & Sweller, J. (2001) · Journal of Educational Psychology · doi:10.1037/0022-0663.93.3.579 · Cited by 548 · cited 1×
“Moreover, worked-out examples and completion problems have shown to be superior to conventional problems, not only in terms of test performance but also in terms of extraneous load (Paas, 1992; Paas & van Merriënboer, 1994b; Sweller, 1988; Van Gerven, Paas, van Merriënboer, Hendriks, & Schmidt, 2002; van Merriënboer,…”
BackgroundSelf-citationSignaling as a cognitive guide in multimedia learning.
Mautone, P. D., & Mayer, R. E. (2001) · Journal of Educational Psychology · doi:10.1037/0022-0663.93.2.377 · Cited by 444
Cited by
Sorted by citations
Items 101–120 of 120
Think before you talk: an empirical study of relationship between speech pauses and cognitive load
Khawaja, M. A., Ruiz, N., & Chen, F. (2008) · Proceedings of the 20th Australasian Conference on Computer-Human Interaction: Designing for Habitus and Habitat · doi:10.1145/1517744.1517814 · Cited by 30
Using language complexity to measure cognitive load for adaptive interaction design
Khawaja, M. A., Chen, F., & Marcus, N. (2010) · Proceedings of the 15th international conference on Intelligent user interfaces · doi:10.1145/1719970.1720024 · Cited by 32
Mendel, J., & Pak, R. (2009) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/154193120905302206 · Cited by 30
Fischer, K., Sullivan, A. M., Cohen, A. P., King, R. W., Cockrill, B. A., & Besche, H. C. (2023) · BMC Medical Education · doi:10.1186/s12909-023-04325-x · Cited by 28
Kesedzic, I., Sarlija, M., Bozek, J., Popovic, S., & Cosic, K. (2021) · IEEE Sensors Journal · doi:10.1109/jsen.2020.3038032 · Cited by 29
Cosic, K., Popovic, S., Sarlija, M., Mijic, I., Kokot, M., Kesedzic, I., Strangman, G., Ivkovic, V., & Zhang, Q. (2019) · IEEE Access · doi:10.1109/access.2019.2957357 · Cited by 29
Potential speech features for cognitive load measurement
Khawaja, M. A., Ruiz, N., & Chen, F. (2007) · Proceedings of the 19th Australasian conference on Computer-Human Interaction: Entertaining User Interfaces · doi:10.1145/1324892.1324902 · Cited by 26
Effects of Neuro-Cognitive Load on Learning Transfer Using a Virtual Reality-Based Driving System
Abdurrahman, U. A., Yeh, S.-C., Wong, Y., & Wei, L. (2021) · Big Data and Cognitive Computing · doi:10.3390/bdcc5040054 · Cited by 24
Turner-McGrievy, G. M., Yang, C.-H., Monroe, C., Pellegrini, C., & West, D. S. (2021) · Journal of Technology in Behavioral Science · doi:10.1007/s41347-021-00203-9 · Cited by 22
Task Load Estimation and Mediation Using Psycho-physiological Measures
Rajan, R., Selker, T., & Lane, I. (2016) · Proceedings of the 21st International Conference on Intelligent User Interfaces · doi:10.1145/2856767.2856769 · Cited by 23
The Effects of Worked-Out Example and Metacognitive Scaffolding on Problem-Solving Programming
Shin, Y., Jung, J., Zumbach, J., & Yi, E. (2023) · Journal of Educational Computing Research · doi:10.1177/07356331231174454 · Cited by 18
Managing Element Interactivity in Equation Solving
Ngu, B. H., Phan, H. P., Yeung, A. S., & Chung, S. F. (2018) · Educational Psychology Review · doi:10.1007/s10648-016-9397-8 · Cited by 16
Problem-solving support and instructional sequence: impact on cognitive load and student performance
Costley, J., Gorbunova, A., Courtney, M., Chen, O., & Lange, C. (2024) · European Journal of Psychology of Education · doi:10.1007/s10212-023-00757-7 · Cited by 13
Freeform pen-input as evidence of cognitive load and expertise
Ruiz, N., Taib, R., & Chen, F. (2011) · Proceedings of the 13th international conference on multimodal interfaces · doi:10.1145/2070481.2070511 · Cited by 11
Trypke, M., Stebner, F., & Wirth, J. (2024) · Education Sciences · doi:10.3390/educsci14080872 · Cited by 11
Cognitive skills learning: pen input patterns in computer-based athlete training
Ruiz, N., Feng, Q. Q., Taib, R., Handke, T., & Chen, F. (2010) · International Conference on Multimodal Interfaces and the Workshop on Machine Learning for Multimodal Interaction · doi:10.1145/1891903.1891955 · Cited by 10
Do speech features for detecting cognitive load depend on specific languages?
Chen, R., Xie, T., Xie, Y., Lin, T., & Tang, N. (2016) · Proceedings of the 18th ACM International Conference on Multimodal Interaction · doi:10.1145/2993148.2993149 · Cited by 8
Cognitive Load Theory: Implications for Nursing Education and Research
Chen, R., Dore, K., Grierson, L. E. M., Hatala, R., & Norman, G. (2014) · Canadian Journal of Nursing Research · doi:10.1177/084456211404600204 · Cited by 8
Han, L., Lv, Q., Xiao, M., Ma, Z., Jou, M., & Huang, C.-C. (2025) · Interactive Learning Environments · doi:10.1080/10494820.2024.2353188 · Cited by 5
Qian, W., Yang, F., Cao, Y., Yi, L., Gu, R., & Wang, Z. (2026) · Frontiers in Psychology · doi:10.3389/fpsyg.2026.1921504 · Cited by 4
Metadata
- Authors
- Paas, F., Tuovinen, J. E., Tabbers, H., & Van Gerven, P. W. M.
- Affiliations
- Open University of the Netherlands (NL)
- Charles Sturt University (AU)
- Venue
- Educational Psychologist
- Publisher
- Informa UK Limited
- Published
- 2003-01-01
- Volume
- 38
- Issue
- 1
- Pages
- 63-71
- ISSN
- 0046-1520 (ISSN-L)
- 1532-6985
- OpenAlex
- W1980877068
- Semantic Scholar
- 698e3ec5e9b7bf7217a250366cf00bfff8a49a99
- Cited by
- 2,527
- References
- 13
- Citations by year
- 2026: 149 · 2025: 142 · 2024: 155 · 2023: 135 · 2022: 174 · 2021: 164 · 2020: 156 · 2019: 143 · 2018: 138 · 2017: 135 · 2016: 114 · 2015: 133 · 2014: 120 · 2013: 110 · 2012: 96
- FWCI
- 47.17
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Educational Psychologist (publishedVersion)
- Research portal (Tilburg University) (publishedVersion)
- EUR Research Repository (Erasmus University Rotterdam) (publishedVersion)
- Data Archiving and Networked Services (DANS) (submittedVersion)
- EUR Research Repository (Erasmus University Rotterdam) (submittedVersion)
- Research Publications (Maastricht University) (submittedVersion)
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Visual and Cognitive Learning Processes
- Social Sciences › Psychology › Developmental and Educational Psychology › Innovative Teaching and Learning Methods
- Social Sciences › Psychology › Developmental and Educational Psychology › Educational and Psychological Assessments
- Keywords
- cognitive load assessment, cognitive load theory, working memory, long-term memory, transfer of learning, instructional design, performance-based measures, cognitive architecture
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review