Development and Validation of a Theory-Based Questionnaire to Measure Different Types of Cognitive Load
Open accessThe DOI matches its Crossref record; 128 of the 128 references it cites were found in a registry or an index; 7 of the 74 sources its claims cite were checked for support.
Abstract
According to cognitive load theory, learning can only be successful when instructional materials and procedures are designed in accordance with human cognitive architecture. In this context, one of the biggest challenges is the accurate measurement of the different cognitive load types as these are associated with various activities during learning. Building on psychometric limitations of currently available questionnaires, a new instrument for measuring the three types of cognitive load—intrinsic, extraneous, and germane cognitive load—is developed and validated relying on a set of five empirical studies. In Study 1, a principal component analysis revealed a three-component model which was subsequently confirmed using a confirmatory factor analysis (Study 2). Finally, across three experiments (Studies 3–5), the questionnaire was shown to be sensitive to changes in cognitive load supporting its predictive validity. The quality of the cognitive load questionnaire was underlined by satisfactory internal consistencies across all studies. In sum, the proposed questionnaire can be used in experimental settings to measure the different types of cognitive load in a valid and reliable manner. The construction and validation process of the questionnaire has also shown that the construct germane cognitive load remains controversial concerning its measurement and theoretical embedding in cognitive load theory.
Overview
CoChat Summary
TL;DR
The paper develops and validates a 15-item, theory-based questionnaire to measure intrinsic, extraneous, and germane cognitive load across five studies. It reports a three-factor structure, satisfactory reliability, and sensitivity to separate experimental manipulations, while noting persistent problems with germane cognitive load and learner differentiation of ICL and ECL.
Key findings
- A PCA in Study 1 yielded a three-component solution explaining 74.3% of total variance; after removing two GCL items, internal consistencies were ω ICL = 0.93, ω ECL = 0.91, ω GCL = 0.88.
- A CFA in Study 2 showed acceptable fit (CFI = 0.92; RMSEA = 0.10; GFI = 0.92; SRMR = 0.07), with all items loading on intended factors (p < 0.001); ICL/ECL loadings ranged 0.73–0.93, while GCL loadings ranged 0.35–0.91.
- Experimental studies supported sensitivity: Study 3 found lower ICL after pre-training, t(52) = 1.91, p = 0.031, d = 0.52; Study 4 found higher ECL for separated format, U = 158.00, Z = 3.57, p < 0.001, d = 1.12; Study 5 found higher GCL for imagination, t(52) = 1.73, p = 0.044, d = 0.47.
- Convergent validity with Klepsch et al. (2017) was moderate: ECL correlation was satisfactory, ICL lower but acceptable, and GCL lowest.
Methods
- Five studies: Study 1 PCA with 69 German university students; Study 2 CFA with 158 German-native Prolific participants; Studies 3–5 were between-subjects experiments with 54 students each, manipulating ICL via pre-training, ECL via split-attention, and GCL via imagination.
- The initial 17-item catalog was reduced to 15 items after PCA; items were rated on a 9-point Likert-type scale, and analyses included PCA, CFA, t-tests, Mann–Whitney U tests, chi-square tests, and McDonald’s omega.
- An English translation was produced with assistance from a professor of English and digital linguistics, but validation was conducted on the German version.
Limitations
- The paper states that only the German version underwent construction and validation, so future studies should test the English version; it also states that GCL remains controversial, showed lower factor loadings and reliability, and that learners have difficulty differentiating ICL from ECL.
- The paper notes that self-rating scales require accurate retrospective self-assessment and that method variance may inflate correlations among the three load types.
- Evident from the text: samples were small (69 in Study 1; 54 per experiment), the Study 2 RMSEA was at the cutoff (0.10), GCL items 11 and 13 were retained despite low loadings (0.41 and 0.35), Study 3 found an unexpected GCL effect and no learning-performance difference, and Study 4’s ECL manipulation also significantly raised ICL.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
6 Valid · 1 Not valid · 60 Not checked · 99 Own results and interpretations
Every source the paper cites for this claim was checked and supports it.
In the paper
“Furthermore, the questionnaire by Klepsch et al. (2017) was developed and validated in the German language.”
§ Development and validation of a theory-based questionnaire to measure different types of cognitive load > Psychometric Limitations of Current CLT Questionnaires
What the sources say
- Supportedcites Klepsch et al. (2017) source
Study 1 Methods and Materials states that the questionnaire items were developed in German and translated into English for the paper. Study 2 presents the German items and reports validity testing of the questionnaire, supporting that it was developed and validated in German. (LLM, conf=0.91)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“In this context, a study by Sonderen et al. (2013) showed that reverse-worded items may lead to inattention when responding to a questionnaire.”
§ Development and validation of a theory-based questionnaire to measure different types of cognitive load > Psychometric Limitations of Current CLT Questionnaires
What the sources say
- Supportedcites Sonderen et al., 2013 source
The Discussion states that adding reverse-worded items appears to increase the risk of inattention and confusion. Its conclusion also says that reversing items can lead to more errors due to inattention or confusion. This supports the citing sentence’s cautious wording. (LLM, conf=0.93)
hedgedstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“Cognitive load types are measured with two (ICL) or three items (ECL, GCL).”
§ Development and validation of a theory-based questionnaire to measure different types of cognitive load > Psychometric Limitations of Current CLT Questionnaires
What the sources say
- Supportedcites Klepsch et al. (2017) source
The Study 2 section on redesigning the germane-load items states that the final questionnaire has two ICL items, three ECL items, and three new GCL items. Study 1 used only two GCL items, but the claim matches the final questionnaire. (LLM, conf=0.94)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The sources with a verdict support this claim; the rest weren’t checked yet, have no full text we could read, or their verdicts aren’t rated yet.
In the paper
“Since the previous PCA resulted in a three-component solution and previous cognitive load questionnaires also relied on a three-factor model (Dönmez et al., 2022;Klepsch et al., 2017;Leppink et al., 2013), the a priori hypothesis explicitly assumed that the observed ratings of the items loaded on three latent variables (factors).”
§ Development and validation of a theory-based questionnaire to measure different types of cognitive load > Study 2: Confirmatory Factor Analysis
What the sources say
- Not checked yetcites Dönmez et al., 2022 source
- Supportedcites Klepsch et al., 2017 source
In Study 2 (Methods and Materials), Klepsch et al. describe a three-factor model for their cognitive-load questionnaire, with separable but related factors. Study 2 (Results) reports that this model had the best fit, supporting three interrelated factors of cognitive load. (LLM, conf=0.93)
- Supportedcites Leppink et al., 2013 source
In “The present set of studies,” Leppink et al. describe questionnaire items intended to measure three factors: intrinsic, extraneous, and germane load. The “Exploratory analysis” reports support for a three-factor structure underlying those items, so this paper is an example of a cognitive load questionnaire using a three-factor model. Page numbers are not provided in the supplied passages. (LLM, conf=0.92)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Every source the paper cites for this claim was checked and supports it.
In the paper
“6. GCL Klepsch -.11 | | -.20* | .44*** | .23** -.13 -”
§ Development and validation of a theory-based questionnaire to measure different types of cognitive load > Conclusion
What the sources say
- Supportedcites Klepsch et al. (2017) source
The citation identifies the GCL items used in the citing study. The source paper’s Study 2 pilot-study section says it developed and tested new germane-load items, and its Study 2 results describe the resulting GCL scale. The correlation of r = .44 is a result reported by the citing study, not a result attributed to Klepsch et al. (LLM, conf=0.91)
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
95 more claims
Create a free account to see all 166 claims and to verify the 67 references still open.
- It may state two separate claims as one. 33
- The quote only partly states this claim. 3
- Probably not a substantial claim. 39
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“These items were selected based on theoretical definitions and subjected to factor analysis in Krieglstein et al.’s original validation study.”
From Rethinking pre-training: cognitive load implications for learners with varying prior knowledge (2025) · cites this paper as Krieglstein et al., 2023
The cited source says what the claim attributes to it.
In the citing paper
“Fourth, while the cognitive load scales used were validated and aligned with current theory (Krieglstein et al., 2023), ongoing debate regarding GCL suggests the need for continued refinement of measurement tools.”
From Rethinking pre-training: cognitive load implications for learners with varying prior knowledge (2025) · cites this paper as Krieglstein et al., 2023
Statistics recomputed
Every reported test result, recomputed from its test statistic and degrees of freedom. A result shows as not adding up only once an independent check has confirmed it.
- Not confirmedt(52) = 1.91reported p = .031 · recomputed p = .062
“t(52) = 1.91, p = .031”
- Not confirmedt(52) = 1.56reported p = .062 · recomputed p = .125
“t(52) = 1.56, p = .062”
- Not confirmedt(52) = 0.4reported p = .345 · recomputed p = .691
“t(52) = 0.40, p = .345”
- Consistentχ²(136) = 746.59reported p < .001 · recomputed p < .001
“χ 2 (136) = 746.59,p < .001”
- Consistentχ²(105) = 726.39reported p < .001 · recomputed p < .001
“χ 2 (105) = 726.39,p < .001”
1 more recomputed test
Create a free account to see every test the Stats check recomputed.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated major: it would touch a result — a value a result rests on, reported and recomputed p-values on opposite sides of the significance level, two passages that conflict with no sign which is right, or a cited work retracted before this paper was published.
In the paper
§ Development and validation of a theory-based questionnaire to measure different types of cognitive load > Results
“The initial model showed an acceptable fit of the data (CFI = 0.92; RMSEA = 0.10; GFI = 0.92; SRMR = 0.07).”
§ Development and validation of a theory-based questionnaire to measure different types of cognitive load > Analysis Plan
“Values greater than 0.95 are usually interpreted as an acceptable fit for the CFI (Bentler, 1990)”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
“Bartlett's test of sphericity (Bartlett's χ 2 (87) = 210.98,p < 0.001) confirmed sample fit for factor analysis.”
§ Development and validation of a theory-based questionnaire to measure different types of cognitive load > Results
Reported 87 · recomputed 105
Citations
Cites
1 retracted
An overview of randomization techniques: An unbiased assessment of outcome in clinical research
Suresh, K. (2011) · Journal of Human Reproductive Sciences · doi:10.4103/0974-1208.82352 · Cited by 1,070 · cited 1×
“By this, comparable groups as a result of randomization should be ensured (Suresh, 2011).”
BackgroundRetractedPodsakoff, P. M., MacKenzie, S. B., Lee, J.-Y., & Podsakoff, N. P. (2003) · Journal of Applied Psychology · doi:10.1037/0021-9010.88.5.879 · Cited by 82,194
Statistical Power Analysis for the Behavioral Sciences (2nd ed.).
Lachenbruch, P. A., & Cohen, J. (1989) · Journal of the American Statistical Association · doi:10.2307/2290095 · Cited by 37,395
Alternative Ways of Assessing Model Fit
Browne, M. W., & Cudeck, R. (1992) · Sociological Methods & Research · doi:10.1177/0049124192021002005 · Cited by 27,200 · cited 1×
“Concerning the RMSEA, the value should not exceed the cut-off 0.10 (Browne and Cudeck, 1992).”
InfluentialComparative fit indexes in structural models.
Bentler, P. M. (1990) · Psychological Bulletin · doi:10.1037/0033-2909.107.2.238 · Cited by 25,266 · cited 4×
“Oriented to Hu 1 3 Educational Psychology Review (2023) 35:9 Page 17 of 37 9 and Bentler (1998), the model fit was checked relying on several indices, namely the comparative fit index (CFI), the root-mean-square error of approximation (RMSEA), the goodness-of-fit index (GFI), and the standardized root mean squared res…”
BackgroundInfluentialInterrater reliability: The kappa statistic
McHugh, M. L. (2012) · Biochemia Medica · doi:10.11613/bm.2012.031 · Cited by 19,877 · cited 1×
“Their agreement was calculated with Cohen’s kappa (κ; McHugh, 2012) – an indicator for interrater reliability.”
MethodThe magical number seven, plus or minus two: Some limits on our capacity for processing information.
Miller, G. A. (1956) · Psychological Review · doi:10.1037/h0043158 · Cited by 17,812
Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research
(1988) · Advances in Psychology · doi:10.1016/s0166-4115(08)62386-9 · Cited by 15,003 · cited 1×
“One of the first attempts to measure cognitive load in research and practice with subjective scales was made by Hart and Staveland (1988), who developed the NASA Task Load Index (TLX) focusing on perceived workload.”
BackgroundAn Index of Factorial Simplicity
Kaiser, H. F. (1974) · Psychometrika · doi:10.1007/bf02291575 · Cited by 14,898
Hu, L.-T., & Bentler, P. M. (1998) · Psychological Methods · doi:10.1037/1082-989x.3.4.424 · Cited by 12,298 · cited 1×
“With respect to the SRMR, the value should be close to 0.08 or below (Hu and Bentler, 1998).”
BackgroundInfluential
Research works printed but not linked: 2
- DeVellis, R. F., & Thorpe, C. T. (2021). Scale development: Theory and applications (5th ed.). Sage Publications, Inc.
- de Groot, A. (1965). Thought and choice in chess (2nd ed.). Mouton Publishers.
Cited by
Faber, T. J. E., Dankbaar, M. E. W., van den Broek, W. W., Bruinink, L. J., Hogeveen, M., & van Merriënboer, J. J. G. (2024) · BMC Medical Education · doi:10.1186/s12909-024-05698-3 · Cited by 132
“Apart from the previously mentioned 10-item scale by Lep-pink et al. [16], the 8-item questionnaire by Klepsch and Seufert [85] and the 15-item scale developed by Kriegl-stein et al. [86] appear promising instruments that distinguish between active and passive mental load.”
MethodIntegrating cognitive load theory with other theories, within and beyond educational psychology
Hanham, J., Castro‐Alonso, J. C., & Chen, O. (2023) · British Journal of Educational Psychology · doi:10.1111/bjep.12612 · Cited by 50
Wang, T., Li, S., Tan, C., Zhang, J., & Lajoie, S. P. (2023) · Computers & Education · doi:10.1016/j.compedu.2023.104924 · Cited by 48
Lyu, C., & Deng, S. (2024) · Learning and Individual Differences · doi:10.1016/j.lindif.2024.102564 · Cited by 52
Leveraging cognitive load theory to support students with mathematics difficulty
Barbieri, C., & Rodrigues, J. (2025) · Educational Psychologist · doi:10.1080/00461520.2025.2486138 · Cited by 40
Metadata
- Authors
- Krieglstein, F., Beege, M., Rey, G. D., Sanchez-Stockhammer, C., & Schneider, S.
- Affiliations
- Chemnitz University of Technology (DE)
- University of Education Freiburg (DE)
- University of Zurich (CH)
- Corresponding author
- Krieglstein, Felix
- Venue
- Educational Psychology Review
- Published
- 2023-01-28
- Volume
- 35
- Issue
- 1
- ISSN
- 1040-726X (ISSN-L)
- 1573-336X
- OpenAlex
- W4318334910
- Semantic Scholar
- 5f997fc5cbbe5312ed6f9baf70ca9577035e653e
- Cited by
- 139
- References
- 128
- Citations by year
- 2026: 54 · 2025: 47 · 2024: 29 · 2023: 9
- FWCI
- 35.86
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- creativecommons.org/licenses/by/4.0 (tdm)
- creativecommons.org/licenses/by/4.0 (vor)
- Locations
- Educational Psychology Review (publishedVersion, cc-by)
- Zurich Open Repository and Archive (University of Zurich) (acceptedVersion, cc-by-nc-nd)
- Qucosa (Saxon State and University Library Dresden) (submittedVersion, cc-by-nc-nd)
- Zurich Open Repository and Archive (University of Zurich) (submittedVersion, cc-by)
- Zurich Open Repository and Archive (University of Zurich)
- Funders
- Technische Universität Chemnitz
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Visual and Cognitive Learning Processes
- Social Sciences › Psychology › Developmental and Educational Psychology › Innovative Teaching and Learning Methods
- Social Sciences › Psychology › Developmental and Educational Psychology › Educational and Psychological Assessments
- Keywords
- cognitive load, intrinsic cognitive load, extraneous cognitive load, germane cognitive load, questionnaire development, psychometric validation, construct validity, measurement sensitivity, learning
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-10-07, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-07 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Development and Validation of a Theory-Based Questionnaire to Measure Different Types of Cognitive Load. https://app.cochat.ai/papers/10.1007/s10648-023-09738-0
- The paper
- Krieglstein, F., Beege, M., Rey, G. D., Sanchez-Stockhammer, C., & Schneider, S. (2023). Development and Validation of a Theory-Based Questionnaire to Measure Different Types of Cognitive Load. Educational Psychology Review. https://doi.org/10.1007/s10648-023-09738-0
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.