The DOI matches its Crossref record; 44 of the 45 references it cites were found in a registry or an index.
Development of an instrument for measuring different types of cognitive load
Open accessAbstract
According to cognitive load theory, instructions can impose three types of cognitive load on the learner: intrinsic load, extraneous load, and germane load. Proper measurement of the different types of cognitive load can help us understand why the effectiveness and efficiency of learning environments may differ as a function of instructional formats and learner characteristics. In this article, we present a ten-item instrument for the measurement of the three types of cognitive load. Principal component analysis on data from a lecture in statistics for PhD students (n = 56) in psychology and health sciences revealed a three-component solution, consistent with the types of load that the different items were intended to measure. This solution was confirmed by a confirmatory factor analysis of data from three lectures in statistics for different cohorts of bachelor students in the social and health sciences (ns = 171, 136, and 148), and received further support from a randomized experiment with university freshmen in the health sciences (n = 58).
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Thus, if the sum of these factors exceeds the student's available resources, cognitive overload occurs, hindering the processing of new information (Leppink et al., 2013).”
From Systematic Review of the Effectiveness of Neurodidactic Spaced Learning Strategies in Long-Term Memory (2026) · cites this paper as Leppink et al., 2013
Experimental — accuracy not yet measuredIn the citing paper
“Even if they had to adopt the items to fit the different domains, they found the three factors to be robust.”
From Development and Validation of Two Instruments Measuring Intrinsic, Extraneous, and Germane Cognitive Load (2017) · cites this paper as Leppink et al., 2013
In the citing paper
“However, no separate experiments were performed to verify whether the questionnaire could explicitly differentiate between types of cognitive load, which would be an important criterion for assessing validity.”
From Development and Validation of a Theory-Based Questionnaire to Measure Different Types of Cognitive Load (2023) · cites this paper as Leppink et al. (2013)
In the citing paper
“However, because of problems with the GCL scale (lack of correlation with learning performance), one GCL-related item was added in a further study to explicitly capture the effort required to cope with cognitive load.”
From Development and Validation of a Theory-Based Questionnaire to Measure Different Types of Cognitive Load (2023) · cites this paper as Leppink et al. (2013)
In the citing paper
“a principal component analysis (PCA) was preferred over an exploratory factor analysis (EFA) as it is less stringent in terms of assumptions (e.g., Leppink et al., 2013).”
From Development and Validation of a Theory-Based Questionnaire to Measure Different Types of Cognitive Load (2023) · cites this paper as Leppink et al., 2013
In the citing paper
“Since the previous PCA resulted in a three-component solution and previous cognitive load questionnaires also relied on a three-factor model (Dönmez et al., 2022;Klepsch et al., 2017;Leppink et al., 2013), the a priori hypothesis explicitly assumed that the observed ratings of the items loaded on three latent variables (factors).”
From Development and Validation of a Theory-Based Questionnaire to Measure Different Types of Cognitive Load (2023) · cites this paper as Leppink et al., 2013
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research
(1988) · Advances in Psychology · doi:10.1016/s0166-4115(08)62386-9 · Cited by 15,003
Cognitive Architecture and Instructional Design
Sweller, J., van Merrienboer, J. J. G., & Paas, F. G. W. C. (1998) · Educational Psychology Review · doi:10.1023/a:1022193728205 · Cited by 6,023
Self-citationCognitive Load Theory and Instructional Design: Recent Developments
Paas, F., Renkl, A., & Sweller, J. (2003) · Educational Psychologist · doi:10.1207/s15326985ep3801_1 · Cited by 3,041
Self-citationEye Tracking: A comprehensive guide to methods and measures
Holmqvist, K., Nyström, M., Andersson, R., Dewhurst, R. J., Jarodzka, H. M., & van de Weijer, J. (2015) · Lund University Publications (Lund University) · Cited by 2,919
Cognitive Load Theory and the Format of Instruction
Chandler, P., & Sweller, J. (1991) · Cognition and Instruction · doi:10.1207/s1532690xci0804_2 · Cited by 2,894
Cognitive Load Measurement as a Means to Advance Cognitive Load Theory
Paas, F., Tuovinen, J. E., Tabbers, H., & Van Gerven, P. W. M. (2003) · Educational Psychologist · doi:10.1207/s15326985ep3801_8 · Cited by 2,527
Self-citationCognitive Load Theory and Complex Learning: Recent Developments and Future Directions
van Merriënboer, J. J. G., & Sweller, J. (2005) · Educational Psychology Review · doi:10.1007/s10648-005-3951-0 · Cited by 2,206
Paas, F. G. W. C. (1992) · Journal of Educational Psychology · doi:10.1037/0022-0663.84.4.429 · Cited by 2,150
Self-citationElement Interactivity and Intrinsic, Extraneous, and Germane Cognitive Load
Sweller, J. (2010) · Educational Psychology Review · doi:10.1007/s10648-010-9128-5 · Cited by 2,020
Kalyuga, S., Ayres, P., Chandler, P., & Sweller, J. (2003) · Educational Psychologist · doi:10.1207/s15326985ep3801_4 · Cited by 1,927
The Use of Worked Examples as a Substitute for Problem Solving in Learning Algebra
Sweller, J., & Cooper, G. A. (1985) · Cognition and Instruction · doi:10.1207/s1532690xci0201_3 · Cited by 1,214
Paas, F. G. W. C., & Van Merriënboer, J. J. G. (1994) · Journal of Educational Psychology · doi:10.1037/0022-0663.86.1.122 · Cited by 1,198
Self-citationSalomon, G. (1984) · Journal of Educational Psychology · doi:10.1037/0022-0663.76.4.647 · Cited by 1,015
Hancock, P. A., & Meshkati, N. (1988) · Cited by 954
Measurement of Cognitive Load in Instructional Research
Paas, F. G. W. C., van Merriënboer, J. J. G., & Adam, J. J. (1994) · Perceptual and Motor Skills · doi:10.2466/pms.1994.79.1.419 · Cited by 731
Self-citationCognitive Load Theory: How Many Types of Load Does It Really Need?
Kalyuga, S. (2011) · Educational Psychology Review · doi:10.1007/s10648-010-9150-7 · Cited by 725
Effects of schema acquisition and rule automation on mathematical problem-solving transfer.
Cooper, G., & Sweller, J. (1987) · Journal of Educational Psychology · doi:10.1037/0022-0663.79.4.347 · Cited by 688
Cognitive load as a factor in the structuring of technical material.
Sweller, J., Chandler, P., Tierney, P., & Cooper, M. (1990) · Journal of Experimental Psychology: General · doi:10.1037/0096-3445.119.2.176 · Cited by 629
DeLeeuw, K. E., & Mayer, R. E. (2008) · Journal of Educational Psychology · doi:10.1037/0022-0663.100.1.223 · Cited by 558
When problem solving is superior to studying worked examples.
Kalyuga, S., Chandler, P., Tuovinen, J., & Sweller, J. (2001) · Journal of Educational Psychology · doi:10.1037/0022-0663.93.3.579 · Cited by 548
Atkinson, R. K., Renkl, A., & Merrill, M. M. (2003) · Journal of Educational Psychology · doi:10.1037/0022-0663.95.4.774 · Cited by 491
Instructional Efficiency: Revisiting the Original Construct in Educational Research
van Gog, T., & Paas, F. (2008) · Educational Psychologist · doi:10.1080/00461520701756248 · Cited by 473
Self-citationEye tracking as a tool to study and enhance multimedia learning
van Gog, T., & Scheiter, K. (2009) · Learning and Instruction · doi:10.1016/j.learninstruc.2009.02.009 · Cited by 449
Cierniak, G., Scheiter, K., & Gerjets, P. (2009) · Computers in Human Behavior · doi:10.1016/j.chb.2008.12.020 · Cited by 412
Using subjective measures to detect variations of intrinsic cognitive load within problems
Ayres, P. (2006) · Learning and Instruction · doi:10.1016/j.learninstruc.2006.09.001 · Cited by 381
Effects of worked examples, example-problem, and problem-example pairs on novices’ learning
van Gog, T., Kester, L., & Paas, F. (2011) · Contemporary Educational Psychology · doi:10.1016/j.cedpsych.2010.10.004 · Cited by 283
Self-citationInstructional aids to support a conceptual understanding of multiple representations.
Berthold, K., & Renkl, A. (2009) · Journal of Educational Psychology · doi:10.1037/a0013247 · Cited by 248
Strategies for Programming Instruction in High School: Program Completion vs. Program Generation
van Merriënboer, J. J. G. (1990) · Journal of Educational Computing Research · doi:10.2190/4nk5-17l7-twqv-1ehl · Cited by 222
Knowledge elaboration: A cognitive load perspective
Kalyuga, S. (2009) · Learning and Instruction · doi:10.1016/j.learninstruc.2009.02.003 · Cited by 213
Eysink, T. H. S., de Jong, T., Berthold, K., Kolloffel, B., Opfermann, M., & Wouters, P. (2009) · American Educational Research Journal · doi:10.3102/0002831209340235 · Cited by 158
Camp, G., PAAS, F. G. W. C., Rikers, R. M. J. P., & van Merriënboer, J. J. G. (2001) · Computers in Human Behavior · doi:10.1016/s0747-5632(01)00028-0 · Cited by 141
Self-citationReisslein, J., Atkinson, R. K., Seeling, P., & Reisslein, M. (2006) · Learning and Instruction · doi:10.1016/j.learninstruc.2006.02.008 · Cited by 138
Cognitive load in hypermedia reading comprehension: Influence of text type and linearity
Zumbach, J., & Mohraz, M. (2007) · Computers in Human Behavior · doi:10.1016/j.chb.2007.02.015 · Cited by 123
Learning how to use a computer-based concept-mapping tool: Self-explaining examples helps
Hilbert, T. S., & Renkl, A. (2009) · Computers in Human Behavior · doi:10.1016/j.chb.2008.12.006 · Cited by 119
Salden, R., PAAS, F. G. W. C., Broers, N. J., & van Merriënboer, J. J. G. (2004) · Instructional Science · doi:10.1023/b:truc.0000021814.03996.ff · Cited by 113
Self-citationRecent innovations in educational technology that facilitate student learning
Robinson, D. H., & Schraw, G. J. (2008) · Cited by 92
Exploring Task- and Student-Related Factors in the Method of Propositional Manipulation (MPM)
Leppink, J., Broers, N. J., Imbos, T., van der Vleuten, C. P. M., & Berger, M. P. F. (2011) · Journal of Statistics Education · doi:10.1080/10691898.2011.11889603 · Cited by 84
Self-citationInstructing in generalized knowledge structures to develop flexible problem solving skills
Kalyuga, S., & Hanham, J. (2010) · Computers in Human Behavior · doi:10.1016/j.chb.2010.05.024 · Cited by 58
Self-explanation in the domain of statistics: an expertise reversal effect
Leppink, J., Broers, N. J., Imbos, T., van der Vleuten, C. P. M., & Berger, M. P. F. (2011) · Higher Education · doi:10.1007/s10734-011-9476-1 · Cited by 45
Self-citationGemeinsame Wissenskonstruktion - Theoretische und methodologische Aspekte
Fischer, F. (2002) · Psychologische Rundschau · doi:10.1026//0033-3042.53.3.119 · Cited by 44
Knipfer, K., Mayr, E., Zahn, C., Schwan, S., & Hesse, F. W. (2009) · Educational Research Review · doi:10.1016/j.edurev.2009.06.002 · Cited by 30
Relations among Dimensions of Statistical Knowledge
Huberty, C. J., Dresden, J., & Bak, B.-G. (1993) · Educational and Psychological Measurement · doi:10.1177/0013164493053002022 · Cited by 27
Prior knowledge moderates instructional effects on conceptual understanding of statistics
Leppink, J., Broers, N. J., Imbos, T., van der Vleuten, C. P. M., & Berger, M. P. F. (2012) · Educational Research and Evaluation · doi:10.1080/13803611.2011.640873 · Cited by 23
Self-citationAssessment of cognitive load in multimedia learning environments: Theory, methods, and applications
Paas, F., Ayres, P., Pachman, M., Robinson, D., & Schraw, G. (2008) · EUR Research Repository (Erasmus University Rotterdam) · Cited by 5
Self-citation
Cited by
Sorted by citations
Cognitive Architecture and Instructional Design: 20 Years Later
Sweller, J., van Merriënboer, J. J. G., & Paas, F. (2019) · Educational Psychology Review · doi:10.1007/s10648-019-09465-5 · Cited by 2,337
Self-citationCognitive Load Theory: Implications for medical education: AMEE Guide No. 86
Young, J. Q., Van Merrienboer, J., Durning, S., & Ten Cate, O. (2014) · Medical Teacher · doi:10.3109/0142159x.2014.889290 · Cited by 935
“…also intrinsic (e.g. rate the complexity of the topic covered in the activity), extraneous (e.g. rate the clarity of the instruction for the activity) and germane (e.g. rate how much the activity enhanced your understanding of the topic) load separately (DeLeeuw & Mayer 2008; Leppink et al. 2013).”
BackgroundKlepsch, M., Schmitz, F., & Seufert, T. (2017) · Frontiers in Psychology · doi:10.3389/fpsyg.2017.01997 · Cited by 601
“We could have used a learning scenario in which learners carry out a learning task and rate their experienced load in this situation afterward, as most other researchers have chosen to do (e.g., Cierniak et al., 2009; Leppink et al., 2013).”
BackgroundMethodEffects of pairs of problems and examples on task performance and different types of cognitive load
Leppink, J., Paas, F., van Gog, T., van der Vleuten, C. P. M., & van Merriënboer, J. J. G. (2014) · Learning and Instruction · doi:10.1016/j.learninstruc.2013.12.001 · Cited by 520
Self-citationLearning with desktop virtual reality: Low spatial ability learners are more positively affected
Lee, E. A. L., & Wong, K. W. (2014) · Computers & Education · doi:10.1016/j.compedu.2014.07.010 · Cited by 484
Metadata
- Authors
- Leppink, J., Paas, F., Van der Vleuten, C. P. M., Van Gog, T., & Van Merriënboer, J. J. G.
- Affiliations
- Maastricht University (NL)
- University of Wollongong (AU)
- Corresponding author
- Leppink, Jimmie
- Venue
- Behavior Research Methods
- Published
- 2013-04-10
- Volume
- 45
- Issue
- 4
- Pages
- 1058-1072
- ISSN
- 1554-351X (ISSN-L)
- 1554-3528
- OpenAlex
- W1993729533
- Cited by
- 1,066
- References
- 45
- Citations by year
- 2026: 168 · 2025: 136 · 2024: 130 · 2023: 105 · 2022: 88 · 2021: 84 · 2020: 72 · 2019: 98 · 2018: 49 · 2017: 41 · 2016: 38 · 2015: 31 · 2014: 20 · 2013: 5
- FWCI
- 42.02
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Licence
- www.springer.com/tdm (tdm)
- Locations
- Behavior Research Methods (publishedVersion)
- PubMed (publishedVersion)
- EUR Research Repository (Erasmus University Rotterdam) (publishedVersion)
- Research Online (University of Wollongong) (submittedVersion)
- EUR Research Repository (Erasmus University Rotterdam) (submittedVersion)
- Research Publications (Maastricht University) (submittedVersion, other-oa)
- Figshare (submittedVersion)
- Radboud Repository (Radboud University) (submittedVersion)
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Visual and Cognitive Learning Processes
- Social Sciences › Psychology › Developmental and Educational Psychology › Innovative Teaching and Learning Methods
- Social Sciences › Education › Evaluation of Teaching Practices
- Keywords
- cognitive load, intrinsic cognitive load, extraneous load, germane load, instructional design, statistics instruction, university students, factor structure
- MeSH terms
- Adult, Analysis of Variance, Cognition, Female, Humans, Learning, Male, Models, Psychological, Surveys and Questionnaires, Reproducibility of Results, Linear Models, Behavioral Research, Young Adult
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
