The influence of delaying judgments of learning on metacognitive accuracy: a meta-analytic review
The DOI matches its Crossref record; 82 of the 83 references it cites were found in a registry or an index.
Abstract
Many studies have examined the accuracy of predictions of future memory performance solicited through judgments of learning (JOLs). Among the most robust findings in this literature is that delaying predictions serves to substantially increase the relative accuracy of JOLs compared with soliciting JOLs immediately after study, a finding termed the delayed JOL effect. The meta-analyses reported in the current study examined the predominant theoretical accounts as well as potential moderators of the delayed JOL effect. The first meta-analysis examined the relative accuracy of delayed compared with immediate JOLs across 4,554 participants (112 effect sizes) through gamma correlations between JOLs and memory accuracy. Those data showed that delaying JOLs leads to robust benefits to relative accuracy (g = 0.93). The second meta-analysis examined memory performance for delayed compared with immediate JOLs across 3,807 participants (98 effect sizes). Those data showed that delayed JOLs result in a modest but reliable benefit for memory performance relative to immediate JOLs (g = 0.08). Findings from these meta-analyses are well accommodated by theories suggesting that delayed JOL accuracy reflects access to more diagnostic information from long-term memory rather than being a by-product of a retrieval opportunity. However, these data also suggest that theories proposing that the delayed JOL effect results from a memorial benefit or the match between the cues available for JOLs and those available at test may also provide viable explanatory mechanisms necessary for a comprehensive account.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“many of these “classic” findings in the metacognition rely on measures such as G (Rhodes and Tauber, 2011) that may be confounded by bias and performance effects (although see Jang et al., 2012).”
From How to measure metacognition (2014) · cites this paper as Rhodes and Tauber, 2011
In the citing paper
“For example, the delayed JOL effect was found to be most robust when studying word pairs (Rhodes and Tauber, 2011) but was not found for studying expository text (e.g., Maki 1998) or learning to solve problems (e.g., Baars et al. 2018).”
From The Relation Between Students’ Effort and Monitoring Judgments During Learning: A Meta-analysis (2020) · cites this paper as Rhodes and Tauber, 2011
Citations
Cites
Statistical Methods for Meta-Analysis
Wasserman, S., Hedges, L. V., & Olkin, I. (1988) · Journal of Educational Statistics · doi:10.2307/1164953 · Cited by 10,326
The file drawer problem and tolerance for null results.
Rosenthal, R. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.3.638 · Cited by 9,068
Distribution Theory for Glass's Estimator of Effect Size and Related Estimators
Hedges, L. V. (1981) · Journal of Educational Statistics · doi:10.2307/1164588 · Cited by 5,695 · cited 2×
“The product of J and Cohen’s d thus provides an unbiased estimate of the effect size that is often referred to as Hedges’s g (Hedges, 1981):”
BackgroundMethodThe Handbook of Research Synthesis.
Howel, D., Cooper, H., & Hedges, L. V. (1995) · Biometrics · doi:10.2307/2533295 · Cited by 3,642
Metamemory: A Theoretical Framework and New Findings
Nelson, T. O. (1990) · Psychology of Learning and Motivation · doi:10.1016/s0079-7421(08)60053-5 · Cited by 2,583 · cited 3×
“Theories of metacognition presume that monitoring serves to influence control processes during learning (e.g., Nelson, 1996; Nelson & Narens, 1990).”
BackgroundModels of Working Memory: Mechanisms of Active Maintenance and Executive Control
Miyake, A., & Shah, P. (1999) · Cited by 2,455
Distributed practice in verbal recall tasks: A review and quantitative synthesis.
Cepeda, N. J., Pashler, H., Vul, E., Wixted, J. T., & Rohrer, D. (2006) · Psychological Bulletin · doi:10.1037/0033-2909.132.3.354 · Cited by 1,888
Metacognition: Knowing about Knowing
(1994) · The MIT Press eBooks · doi:10.7551/mitpress/4561.001.0001 · Cited by 1,720
Meta-analysis of experiments with matched groups or repeated measures designs
Dunlap, W. P., Cortina, J. M., Vaslow, J. B., & Burke, M. J. (1996) · Psychological Methods · doi:10.1037/1082-989x.1.2.170 · Cited by 1,693
Monitoring one’s own knowledge during study: A cue-utilization approach to judgments of learning
Koriat, A. (1997) · Journal of Experimental Psychology: General · doi:10.1037/0096-3445.126.4.349 · Cited by 1,363
Cited by
Self-Regulated Learning: Beliefs, Techniques, and Illusions
Bjork, R. A., Dunlosky, J., & Kornell, N. (2013) · Annual Review of Psychology · doi:10.1146/annurev-psych-113011-143823 · Cited by 1,468
Fleming, S. M., & Lau, H. C. (2014) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2014.00443 · Cited by 1,408
Dunlosky, J., & Rawson, K. A. (2012) · Learning and Instruction · doi:10.1016/j.learninstruc.2011.08.003 · Cited by 713
Executive function and metacognition: Towards a unifying framework of cognitive self-regulation
Roebers, C. M. (2017) · Developmental Review · doi:10.1016/j.dr.2017.04.001 · Cited by 592
“Empirical evidence in adults has also suggested only low correspondence of different monitoring indicators (Boduroglu, Tekcan, & Kapucu, 2014; Rhodes & Tauber, 2011).”
BackgroundCollege Students’ Time Management: a Self-Regulated Learning Perspective
Wolters, C. A., & Brady, A. C. (2021) · Educational Psychology Review · doi:10.1007/s10648-020-09519-z · Cited by 317
Metadata
- Authors
- Rhodes, M. G., & Tauber, S. K.
- Affiliations
- Colorado State University (US)
- Kent State University (US)
- ORCID
- Tauber, Sarah K.
- Venue
- Psychological Bulletin
- Published
- 2011
- Volume
- 137
- Issue
- 1
- Pages
- 131-148
- ISSN
- 0033-2909 (ISSN-L)
- 1939-1455
- OpenAlex
- W2061235287
- Cited by
- 230
- References
- 83
- Citations by year
- 2026: 14 · 2025: 13 · 2024: 15 · 2023: 23 · 2022: 11 · 2021: 22 · 2020: 14 · 2019: 14 · 2018: 12 · 2017: 16 · 2016: 12 · 2015: 10 · 2014: 18 · 2013: 9 · 2012: 17
- FWCI
- 8.90
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Psychological Bulletin (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Memory Processes and Influences
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Cognitive Functions and Memory
- Social Sciences › Psychology › Developmental and Educational Psychology › Innovative Teaching and Learning Methods
- Keywords
- judgments of learning, metacognitive accuracy, metacognition, memory prediction, memory performance, long-term memory, retrieval cues, metacognitive confidence
- MeSH terms
- Cognition, Cues, Humans, Judgment, Learning, Memory, Short-Term, Models, Psychological, Time Factors, Memory, Long-Term
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.