Looking at Mental Effort Appraisals through a Metacognitive Lens: Are they Biased?
Open accessThe DOI matches its Crossref record; 102 of the 103 references it cites were found in a registry or an index.
Abstract
A central factor in research guided by the Cognitive Load Theory (CLT) is the mental effort people invest in performing a task. Mental effort is commonly assessed by asking people to report their effort throughout performing, learning, or problem-solving tasks. Although this measurement is considered reliable and valid in CLT research, metacognitive research provides robust evidence that self-appraisals of performance are often biased. In this review, we consider the possibility that mental effort appraisals may also be biased. In particular, we review signs for covariations and mismatches between subjective and objective measures of effort. Our review suggests that subjective and most objective effort measures appear reliable and valid when evaluated in isolation, because they discriminate among tasks of varying complexity. However, not much is known about their mutual correspondence—that is, whether subjective measures covariate with objective measures. Moreover, there is evidence that people utilize heuristic cues when appraising their effort, similar to utilization of heuristic cues underlying metacognitive appraisals of performance. These cues are identified by exposing biases—mismatch in effects of cue variations on appraisals and performance. The review concludes with a research agenda in which we suggest applying the well-established methodologies for studying biases in self-appraisals of performance in metacognitive research to investigating effort appraisals. One promising method could be to determine the covariation of effort appraisals and objective effort measures as an indicator of the resolution of effort appraisals.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Instead, learners derive them dynamically through several sources of information such as their effort beliefs, prior task experience, current level of fatigue, interest in the task, and fluency of processing.”
From Worth the Effort: the Start and Stick to Desirable Difficulties (S2D2) Framework (2023) · cites this paper as Scheiter et al., 2020
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“That is, self-reports of effort through ratings on a Likert-type scale should not be viewed as objective reflections of effort based solely on the difficulty of a task.”
From Worth the Effort: the Start and Stick to Desirable Difficulties (S2D2) Framework (2023) · cites this paper as Scheiter et al., 2020
In the citing paper
“Irrespective of what operationalization is chosen, it is important to note that it is not trivial to evaluate and conceptualize effort (see extensive discussions in Baars et al., 2020;Scheiter et al., 2020).”
From Motivation-Achievement Cycles in Learning: a Literature Review and Research Agenda (2022) · cites this paper as Scheiter et al., 2020
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A social-cognitive approach to motivation and personality.
Dweck, C. S., & Leggett, E. L. (1988) · Psychological Review · doi:10.1037/0033-295x.95.2.256 · Cited by 9,745 · cited 1×
“According to Dweck and Leggett (1988), students differ in their implicit theories of intelligence (or mindsets), in that some perceive ability as malleable (growth mindset), whereas others perceive it as fixed.”
BackgroundShiffrin, R. M., & Schneider, W. (1977) · Psychological Review · doi:10.1037/0033-295x.84.2.127 · Cited by 7,335
Cognitive Architecture and Instructional Design
Sweller, J., van Merrienboer, J. J. G., & Paas, F. G. W. C. (1998) · Educational Psychology Review · doi:10.1023/a:1022193728205 · Cited by 6,023
Sweller, J., Ayres, P., & Kalyuga, S. (2011) · doi:10.1007/978-1-4419-8126-4 · Cited by 5,531
Sweller, J. (2012) · Encyclopedia of the Sciences of Learning · doi:10.1007/978-1-4419-1428-6_446 · Cited by 4,405
Metamemory: A Theoretical Framework and New Findings
Nelson, T. O. (1990) · Psychology of Learning and Motivation · doi:10.1016/s0079-7421(08)60053-5 · Cited by 2,583 · cited 2×
“…the timing of metacognitive judgments, it has been shown that the later they are required (i.e., themore experience a person has acquired with the task), the more accurate they are; nevertheless, even retrospective judgments are prone to biases (Leonesio and Nelson 1990; Siedlecka et al. 2016).”
BackgroundCognitive Load Measurement as a Means to Advance Cognitive Load Theory
Paas, F., Tuovinen, J. E., Tabbers, H., & Van Gerven, P. W. M. (2003) · Educational Psychologist · doi:10.1207/s15326985ep3801_8 · Cited by 2,527
Cognitive Architecture and Instructional Design: 20 Years Later
Sweller, J., van Merriënboer, J. J. G., & Paas, F. (2019) · Educational Psychology Review · doi:10.1007/s10648-019-09465-5 · Cited by 2,337 · cited 3×
“Readers interested in recently introduced alternatives to this assumption are referred to Sweller et al. 2019 3 We refer in this review to the body of Metacognitive research dealing with monitoring and control of regulatory decisions.”
BackgroundPaas, F. G. W. C. (1992) · Journal of Educational Psychology · doi:10.1037/0022-0663.84.4.429 · Cited by 2,150 · cited 9×
“Unfortunately, most studies, including the ones introducing the mental effort item (e.g. Paas 1992; Paas and van Merriënboer 1994b), do not report the exact wording of the question about effort.”
BackgroundMethodInfluentialMetacognition in Educational Theory and Practice
(1998) · Routledge eBooks · doi:10.4324/9781410602350 · Cited by 2,119
Cited by
ChatGPT improves creative problem-solving performance in university students: An experimental study
Urban, M., Děchtěrenko, F., Lukavský, J., Hrabalová, V., Svacha, F., Brom, C., & Urban, K. (2024) · Computers & Education · doi:10.1016/j.compedu.2024.105031 · Cited by 396
Motivation-Achievement Cycles in Learning: a Literature Review and Research Agenda
Vu, T., Magis-Weinberg, L., Jansen, B. R. J., van Atteveldt, N., Janssen, T. W. P., Lee, N. C., van der Maas, H. L. J., Raijmakers, M. E. J., Sachisthal, M. S. M., & Meeter, M. (2022) · Educational Psychology Review · doi:10.1007/s10648-021-09616-7 · Cited by 224
Making an Effort Versus Experiencing Load
Klepsch, M., & Seufert, T. (2021) · Frontiers in Education · doi:10.3389/feduc.2021.645284 · Cited by 79
Worth the Effort: the Start and Stick to Desirable Difficulties (S2D2) Framework
de Bruin, A. B. H., Biwer, F., Hui, L., Onan, E., David, L., & Wiradhany, W. (2023) · Educational Psychology Review · doi:10.1007/s10648-023-09766-w · Cited by 109
Seufert, T. (2020) · Educational Psychology Review · doi:10.1007/s10648-020-09574-6 · Cited by 72
Metadata
- Authors
- Scheiter, K., Ackerman, R., & Hoogerheide, V.
- Affiliations
- Leibniz-Institut für Wissensmedien (DE)
- Technion – Israel Institute of Technology (IL)
- Utrecht University (NL)
- Corresponding author
- Scheiter, Katharina
- Venue
- Educational Psychology Review
- Published
- 2020-08-01
- Volume
- 32
- Issue
- 4
- Pages
- 1003-1027
- ISSN
- 1040-726X (ISSN-L)
- 1573-336X
- OpenAlex
- W3046851904
- Cited by
- 63
- References
- 103
- Citations by year
- 2026: 4 · 2025: 15 · 2024: 10 · 2023: 9 · 2022: 9 · 2021: 13 · 2020: 3
- FWCI
- 8.21
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- creativecommons.org/licenses/by/4.0 (tdm)
- creativecommons.org/licenses/by/4.0 (vor)
- Locations
- Educational Psychology Review (publishedVersion, cc-by)
- Utrecht University Repository (Utrecht University) (submittedVersion, other-oa)
- Funders
- Eberhard Karls Universität Tübingen
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Visual and Cognitive Learning Processes
- Social Sciences › Psychology › Developmental and Educational Psychology › Innovative Teaching and Learning Methods
- Life Sciences › Neuroscience › Cognitive Neuroscience › Memory Processes and Influences
- Keywords
- cognitive load theory, metacognition, heuristic cues, task complexity
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Looking at Mental Effort Appraisals through a Metacognitive Lens: Are they Biased? https://app.cochat.ai/papers/10.1007/s10648-020-09555-9
- The paper
- Scheiter, K., Ackerman, R., & Hoogerheide, V. (2020). Looking at Mental Effort Appraisals through a Metacognitive Lens: Are they Biased? Educational Psychology Review. https://doi.org/10.1007/s10648-020-09555-9
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.