CoChat

Development and Validation of a Theory-Based Questionnaire to Measure Different Types of Cognitive Load

Open access
Krieglstein, Felix, Beege, Maik, Rey, Günter Daniel, Sanchez-Stockhammer, Christina, Schneider, Sascha · 2023 · Educational Psychology Review

The DOI matches its Crossref record; 128 of the 128 references it cites were found in a registry or an index; 7 of the 74 sources its claims cite were checked for support.

Abstract

According to cognitive load theory, learning can only be successful when instructional materials and procedures are designed in accordance with human cognitive architecture. In this context, one of the biggest challenges is the accurate measurement of the different cognitive load types as these are associated with various activities during learning. Building on psychometric limitations of currently available questionnaires, a new instrument for measuring the three types of cognitive load—intrinsic, extraneous, and germane cognitive load—is developed and validated relying on a set of five empirical studies. In Study 1, a principal component analysis revealed a three-component model which was subsequently confirmed using a confirmatory factor analysis (Study 2). Finally, across three experiments (Studies 3–5), the questionnaire was shown to be sensitive to changes in cognitive load supporting its predictive validity. The quality of the cognitive load questionnaire was underlined by satisfactory internal consistencies across all studies. In sum, the proposed questionnaire can be used in experimental settings to measure the different types of cognitive load in a valid and reliable manner. The construction and validation process of the questionnaire has also shown that the construct germane cognitive load remains controversial concerning its measurement and theoretical embedding in cognitive load theory.

Overview

CoChat Summary

TL;DR

The paper develops and validates a 15-item, theory-based questionnaire to measure intrinsic, extraneous, and germane cognitive load across five studies. It reports a three-factor structure, satisfactory reliability, and sensitivity to separate experimental manipulations, while noting persistent problems with germane cognitive load and learner differentiation of ICL and ECL.

Key findings

  • A PCA in Study 1 yielded a three-component solution explaining 74.3% of total variance; after removing two GCL items, internal consistencies were ω ICL = 0.93, ω ECL = 0.91, ω GCL = 0.88.
  • A CFA in Study 2 showed acceptable fit (CFI = 0.92; RMSEA = 0.10; GFI = 0.92; SRMR = 0.07), with all items loading on intended factors (p < 0.001); ICL/ECL loadings ranged 0.73–0.93, while GCL loadings ranged 0.35–0.91.
  • Experimental studies supported sensitivity: Study 3 found lower ICL after pre-training, t(52) = 1.91, p = 0.031, d = 0.52; Study 4 found higher ECL for separated format, U = 158.00, Z = 3.57, p < 0.001, d = 1.12; Study 5 found higher GCL for imagination, t(52) = 1.73, p = 0.044, d = 0.47.
  • Convergent validity with Klepsch et al. (2017) was moderate: ECL correlation was satisfactory, ICL lower but acceptable, and GCL lowest.

Methods

  • Five studies: Study 1 PCA with 69 German university students; Study 2 CFA with 158 German-native Prolific participants; Studies 3–5 were between-subjects experiments with 54 students each, manipulating ICL via pre-training, ECL via split-attention, and GCL via imagination.
  • The initial 17-item catalog was reduced to 15 items after PCA; items were rated on a 9-point Likert-type scale, and analyses included PCA, CFA, t-tests, Mann–Whitney U tests, chi-square tests, and McDonald’s omega.
  • An English translation was produced with assistance from a professor of English and digital linguistics, but validation was conducted on the German version.

Limitations

  • The paper states that only the German version underwent construction and validation, so future studies should test the English version; it also states that GCL remains controversial, showed lower factor loadings and reliability, and that learners have difficulty differentiating ICL from ECL.
  • The paper notes that self-rating scales require accurate retrospective self-assessment and that method variance may inflate correlations among the three load types.
  • Evident from the text: samples were small (69 in Study 1; 54 per experiment), the Study 2 RMSEA was at the cutoff (0.10), GCL items 11 and 13 were retained despite low loadings (0.41 and 0.35), Study 3 found an unexpected GCL effect and no learning-performance difference, and Study 4’s ECL manipulation also significantly raised ICL.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1007/s10648-023-09738-0

Cites

128 of 128 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

6 Valid · 1 Not valid · 60 Not checked · 99 Own results and interpretations

95 more claims

Create a free account to see all 166 claims and to verify the 67 references still open.

See all claims — free account
  • It may state two separate claims as one. 33
  • The quote only partly states this claim. 3
  • Probably not a substantial claim. 39

Create a free account to see these claims.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Statistics recomputed

Every reported test result, recomputed from its test statistic and degrees of freedom. A result shows as not adding up only once an independent check has confirmed it.

  • Not confirmedt(52) = 1.91reported p = .031 · recomputed p = .062

    “t(52) = 1.91, p = .031”

  • Not confirmedt(52) = 1.56reported p = .062 · recomputed p = .125

    “t(52) = 1.56, p = .062”

  • Not confirmedt(52) = 0.4reported p = .345 · recomputed p = .691

    “t(52) = 0.40, p = .345”

  • Consistentχ²(136) = 746.59reported p < .001 · recomputed p < .001

    “χ 2 (136) = 746.59,p < .001”

  • Consistentχ²(105) = 726.39reported p < .001 · recomputed p < .001

    “χ 2 (105) = 726.39,p < .001”

5 of 6 · the rest aren’t loaded

1 more recomputed test

Create a free account to see every test the Stats check recomputed.

See all tests — free account

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

2 of 2

Citations

Cites

1 retracted

Show all 128 references

Research works printed but not linked: 2

  1. DeVellis, R. F., & Thorpe, C. T. (2021). Scale development: Theory and applications (5th ed.). Sage Publications, Inc.
  2. de Groot, A. (1965). Thought and choice in chess (2nd ed.). Mouton Publishers.

Cited by

See all 185

Metadata

Authors
Krieglstein, F., Beege, M., Rey, G. D., Sanchez-Stockhammer, C., & Schneider, S.
Affiliations
  • Chemnitz University of Technology (DE)
  • University of Education Freiburg (DE)
  • University of Zurich (CH)
Corresponding author
Krieglstein, Felix
Venue
Educational Psychology Review
Published
2023-01-28
Volume
35
Issue
1
ISSN
  • 1040-726X (ISSN-L)
  • 1573-336X
OpenAlex
W4318334910
Cited by
139
References
128
Citations by year
2026: 54 · 2025: 47 · 2024: 29 · 2023: 9
FWCI
35.86
Type
journal article
Language
en
Open access
Licence
Locations
  • Educational Psychology Review (publishedVersion, cc-by)
  • Zurich Open Repository and Archive (University of Zurich) (acceptedVersion, cc-by-nc-nd)
  • Qucosa (Saxon State and University Library Dresden) (submittedVersion, cc-by-nc-nd)
  • Zurich Open Repository and Archive (University of Zurich) (submittedVersion, cc-by)
  • Zurich Open Repository and Archive (University of Zurich)
Funders
Technische Universität Chemnitz
Topics
  • Social Sciences › Psychology › Experimental and Cognitive Psychology › Visual and Cognitive Learning Processes
  • Social Sciences › Psychology › Developmental and Educational Psychology › Innovative Teaching and Learning Methods
  • Social Sciences › Psychology › Developmental and Educational Psychology › Educational and Psychological Assessments
Keywords
cognitive load, intrinsic cognitive load, extraneous cognitive load, germane cognitive load, questionnaire development, psychometric validation, construct validity, measurement sensitivity, learning

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

A language model drew the claims from the paper on 2026-10-07, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-07 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (gpt-6-sol).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Development and Validation of a Theory-Based Questionnaire to Measure Different Types of Cognitive Load. https://app.cochat.ai/papers/10.1007/s10648-023-09738-0
The paper
Krieglstein, F., Beege, M., Rey, G. D., Sanchez-Stockhammer, C., & Schneider, S. (2023). Development and Validation of a Theory-Based Questionnaire to Measure Different Types of Cognitive Load. Educational Psychology Review. https://doi.org/10.1007/s10648-023-09738-0

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.