The influence of delaying judgments of learning on metacognitive accuracy: a meta-analytic review
The DOI matches its Crossref record; 82 of the 83 references it cites were found in a registry or an index.
Abstract
Many studies have examined the accuracy of predictions of future memory performance solicited through judgments of learning (JOLs). Among the most robust findings in this literature is that delaying predictions serves to substantially increase the relative accuracy of JOLs compared with soliciting JOLs immediately after study, a finding termed the delayed JOL effect. The meta-analyses reported in the current study examined the predominant theoretical accounts as well as potential moderators of the delayed JOL effect. The first meta-analysis examined the relative accuracy of delayed compared with immediate JOLs across 4,554 participants (112 effect sizes) through gamma correlations between JOLs and memory accuracy. Those data showed that delaying JOLs leads to robust benefits to relative accuracy (g = 0.93). The second meta-analysis examined memory performance for delayed compared with immediate JOLs across 3,807 participants (98 effect sizes). Those data showed that delayed JOLs result in a modest but reliable benefit for memory performance relative to immediate JOLs (g = 0.08). Findings from these meta-analyses are well accommodated by theories suggesting that delayed JOL accuracy reflects access to more diagnostic information from long-term memory rather than being a by-product of a retrieval opportunity. However, these data also suggest that theories proposing that the delayed JOL effect results from a memorial benefit or the match between the cues available for JOLs and those available at test may also provide viable explanatory mechanisms necessary for a comprehensive account.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“many of these “classic” findings in the metacognition rely on measures such as G (Rhodes and Tauber, 2011) that may be confounded by bias and performance effects (although see Jang et al., 2012).”
From How to measure metacognition (2014) · cites this paper as Rhodes and Tauber, 2011
In the citing paper
“For example, the delayed JOL effect was found to be most robust when studying word pairs (Rhodes and Tauber, 2011) but was not found for studying expository text (e.g., Maki 1998) or learning to solve problems (e.g., Baars et al. 2018).”
From The Relation Between Students’ Effort and Monitoring Judgments During Learning: A Meta-analysis (2020) · cites this paper as Rhodes and Tauber, 2011
Citations
Cites
Statistical Methods for Meta-Analysis
Wasserman, S., Hedges, L. V., & Olkin, I. (1988) · Journal of Educational Statistics · doi:10.2307/1164953 · Cited by 10,326
The file drawer problem and tolerance for null results.
Rosenthal, R. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.3.638 · Cited by 9,068
Distribution Theory for Glass's Estimator of Effect Size and Related Estimators
Hedges, L. V. (1981) · Journal of Educational Statistics · doi:10.2307/1164588 · Cited by 5,695 · cited 2×
“The product of J and Cohen’s d thus provides an unbiased estimate of the effect size that is often referred to as Hedges’s g (Hedges, 1981):”
BackgroundMethodThe Handbook of Research Synthesis.
Howel, D., Cooper, H., & Hedges, L. V. (1995) · Biometrics · doi:10.2307/2533295 · Cited by 3,642
Metamemory: A Theoretical Framework and New Findings
Nelson, T. O. (1990) · Psychology of Learning and Motivation · doi:10.1016/s0079-7421(08)60053-5 · Cited by 2,583 · cited 3×
“Theories of metacognition presume that monitoring serves to influence control processes during learning (e.g., Nelson, 1996; Nelson & Narens, 1990).”
BackgroundModels of Working Memory: Mechanisms of Active Maintenance and Executive Control
Miyake, A., & Shah, P. (1999) · Cited by 2,455
Distributed practice in verbal recall tasks: A review and quantitative synthesis.
Cepeda, N. J., Pashler, H., Vul, E., Wixted, J. T., & Rohrer, D. (2006) · Psychological Bulletin · doi:10.1037/0033-2909.132.3.354 · Cited by 1,888
Metacognition: Knowing about Knowing
(1994) · The MIT Press eBooks · doi:10.7551/mitpress/4561.001.0001 · Cited by 1,720
Meta-analysis of experiments with matched groups or repeated measures designs
Dunlap, W. P., Cortina, J. M., Vaslow, J. B., & Burke, M. J. (1996) · Psychological Methods · doi:10.1037/1082-989x.1.2.170 · Cited by 1,693
Monitoring one’s own knowledge during study: A cue-utilization approach to judgments of learning
Koriat, A. (1997) · Journal of Experimental Psychology: General · doi:10.1037/0096-3445.126.4.349 · Cited by 1,363
Cited by
Self-Regulated Learning: Beliefs, Techniques, and Illusions
Bjork, R. A., Dunlosky, J., & Kornell, N. (2013) · Annual Review of Psychology · doi:10.1146/annurev-psych-113011-143823 · Cited by 1,468
Fleming, S. M., & Lau, H. C. (2014) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2014.00443 · Cited by 1,408
Dunlosky, J., & Rawson, K. A. (2012) · Learning and Instruction · doi:10.1016/j.learninstruc.2011.08.003 · Cited by 713
Executive function and metacognition: Towards a unifying framework of cognitive self-regulation
Roebers, C. M. (2017) · Developmental Review · doi:10.1016/j.dr.2017.04.001 · Cited by 592
“Empirical evidence in adults has also suggested only low correspondence of different monitoring indicators (Boduroglu, Tekcan, & Kapucu, 2014; Rhodes & Tauber, 2011).”
BackgroundCollege Students’ Time Management: a Self-Regulated Learning Perspective
Wolters, C. A., & Brady, A. C. (2021) · Educational Psychology Review · doi:10.1007/s10648-020-09519-z · Cited by 317
Estimating the Difference Between Published and Unpublished Effect Sizes: A Meta-Review
Polanin, J. R., Tanner-Smith, E. E., & Hennessy, E. A. (2016) · Review of Educational Research · doi:10.3102/0034654315582067 · Cited by 234
Kornell, N., Rhodes, M. G., Castel, A. D., & Tauber, S. K. (2011) · Psychological Science · doi:10.1177/0956797611407929 · Cited by 185
Self-citationMetacognition in Later Adulthood: Spared Monitoring Can Benefit Older Adults' Self-Regulation
Hertzog, C., & Dunlosky, J. (2011) · Current Directions in Psychological Science · doi:10.1177/0963721411409026 · Cited by 169
The diminishing criterion model for metacognitive regulation of time investment.
Ackerman, R. (2014) · Journal of Experimental Psychology: General · doi:10.1037/a0035098 · Cited by 152
When asking the question changes the ultimate answer: Metamemory judgments change memory
Mitchum, A. L., Kelley, C. M., & Fox, M. C. (2016) · Journal of Experimental Psychology: General · doi:10.1037/a0039923 · Cited by 148
Murayama, K., Sakaki, M., Yan, V. X., & Smith, G. M. (2014) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/a0036914 · Cited by 74
A meta-analysis and systematic review of reactivity to judgements of learning
Double, K. S., Birney, D. P., & Walker, S. A. (2018) · Memory · doi:10.1080/09658211.2017.1404111 · Cited by 120
“This methodology may make JoL susceptible to what is commonly referred to as reactivity (Rhodes & Tauber, 2011).”
MethodInfluentialRhodes, M. G. (2019) · Teaching of Psychology · doi:10.1177/0098628319834381 · Cited by 186
Self-citationRoebers, C. M., Krebs, S., & Roderer, T. (2012) · Learning and Individual Differences · doi:10.1016/j.lindif.2012.12.003 · Cited by 125
“Because there is a predominance of studies addressing self-regulated learning processes in the context of learning situations (de Bruin & van Gog, 2012; Rhodes & Tauber, 2011), the current study focuses on test taking behavior.”
BackgroundThe Relation Between Students’ Effort and Monitoring Judgments During Learning: A Meta-analysis
Baars, M., Wijnia, L., de Bruin, A., & Paas, F. (2020) · Educational Psychology Review · doi:10.1007/s10648-020-09569-3 · Cited by 101
“For example, the delayed JOL effect was found to be most robust when studying word pairs (Rhodes and Tauber, 2011) but was not found for studying expository text (e.g., Maki 1998) or learning to solve problems (e.g., Baars et al. 2018).”
BackgroundBaars, M., Vink, S., van Gog, T., de Bruin, A., & Paas, F. (2014) · Learning and Instruction · doi:10.1016/j.learninstruc.2014.04.004 · Cited by 86
A role for metamemory in cognitive offloading
Hu, X., Luo, L., & Fleming, S. M. (2019) · Cognition · doi:10.1016/j.cognition.2019.104012 · Cited by 97
Evaluation of seven hypotheses for metamemory performance in rhesus monkeys.
Basile, B. M., Schroeder, G. R., Brown, E. K., Templer, V. L., & Hampton, R. R. (2014) · Journal of Experimental Psychology General · doi:10.1037/xge0000031 · Cited by 99
Rivers, M. L. (2021) · Educational Psychology Review · doi:10.1007/s10648-020-09578-2 · Cited by 81
Do illustrations help or harm metacomprehension accuracy
Jaeger, A. J., & Wiley, J. (2014) · Learning and Instruction · doi:10.1016/j.learninstruc.2014.08.002 · Cited by 103
“One of the most robust findings from this literature indicates that delaying judgments serves to substantially increase the relative accuracy of JOLs compared to JOLs solicited immediately after study (see Rhodes & Tauber, 2011 for a review).”
BackgroundReactivity to Measures of Metacognition
Double, K. S., & Birney, D. P. (2019) · Frontiers in Psychology · doi:10.3389/fpsyg.2019.02755 · Cited by 118
van Loon, M. H., de Bruin, A. B. H., van Gog, T., & van Merriënboer, J. J. G. (2012) · Learning and Instruction · doi:10.1016/j.learninstruc.2012.08.005 · Cited by 112
“Improvements in the relative accuracy of JOLs have been found when they are provided at a short delay after learning, rather than immediately during learning (Koriat & Shitzer-Reichert, 2002; Nelson & Dunlosky, 1991; Rhodes & Tauber, 2011; Schneider, Visé, Lockl, & Nelson, 2000).”
BackgroundMethodResultMetamemory and memory efficiency: Implications for student learning.
Schwartz, B. L., & Efklides, A. (2012) · Journal of Applied Research in Memory and Cognition · doi:10.1016/j.jarmac.2012.06.002 · Cited by 107
The influence of making judgments of learning on memory performance: Positive, negative, or both?
Janes, J. L., Rivers, M. L., & Dunlosky, J. (2018) · Psychonomic Bulletin & Review · doi:10.3758/s13423-018-1463-4 · Cited by 88
“Can prompting students to judge their learning change the ongoing learning process, ultimately impacting memory? If so, does this act help or harm memory, and what are the practical implications of such reactivity? For instance, should students be told to judge their learning frequently during study because doing so e…”
BackgroundLearning from video modeling examples: does gender matter?
Hoogerheide, V., Loyens, S. M. M., & van Gog, T. (2015) · Instructional Science · doi:10.1007/s11251-015-9360-y · Cited by 105
“…confidence can also be a negative outcome if it leads to overconfidence, which can be detrimental to students’ regulation of their learning process (Dunlosky and Rawson 2012; Rhodes and Tauber 2011; Thiede et al. 2003), we instructed participants to predict their performance on the posttest.”
BackgroundTesting facilitates the regulation of subsequent study time
Soderstrom, N. C., & Bjork, R. A. (2014) · Journal of Memory and Language · doi:10.1016/j.jml.2014.03.003 · Cited by 103
The relationships between monitoring, regulation and performance
Koriat, A. (2012) · Learning and Instruction · doi:10.1016/j.learninstruc.2012.01.002 · Cited by 102
“Much less work still has been concerned with the possible benefits that ensue from monitoringbased regulation (see Koriat & Goldsmith, 1996; Rhodes & Tauber, 2011).”
BackgroundJudgments of learning (JOLs) selectively improve memory depending on the type of test
Myers, S. J., Rhodes, M. G., & Hausman, H. E. (2020) · Memory & Cognition · doi:10.3758/s13421-020-01025-5 · Cited by 76
Self-citationMetamemory monitoring and control following retrieval practice for text
Little, J. L., & McDaniel, M. A. (2014) · Memory & Cognition · doi:10.3758/s13421-014-0453-7 · Cited by 82
“…receive an additional opportunity for spaced practice, whereas the unsuccessful retrievals (which were assigned low JOLs) do not (e.g., the memory hypothesis: Kimball & Metcalfe, 2003; Spellman & Bjork, 1992; but see Rhodes & Tauber, 2011, for a review of delayed JOLs on metacognitive accuracy).”
BackgroundBaars, M., van Gog, T., de Bruin, A. B. H., & PAAS, F. G. W. C. (2014) · Applied Cognitive Psychology · doi:10.1002/acp.3008 · Cited by 66
“In their meta-analysis, Rhodes and Tauber (2011) showed that for adults, the delayed-JOL effect was robust with paired associates, category exemplars, sentences, and single words; whereas the effect was not so convincing for children.”
Metacognition, Learning, and Instruction
McCormick, C. B., Dimmitt, C., & Sullivan, F. R. (2012) · Handbook of Psychology, Second Edition · doi:10.1002/9781118133880.hop207004 · Cited by 54
Improving Students’ Metacomprehension Accuracy
Griffin, T. D., Mielicki, M. K., & Wiley, J. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108235631.025 · Cited by 71
McWilliams, A., Bibby, H., Steinbeis, N., David, A. S., & Fleming, S. M. (2023) · Cognition · doi:10.1016/j.cognition.2023.105389 · Cited by 72
“…improved accuracy in judgments of learning (JOLs) after a delay - as do younger adults - and appropriately update their confidence after studying new material (Connor, Dunlosky, & Hertzog, 1997; McGilliv-ray & Castel, 2011; Rabinowitz, Ackerman, Craik, & Hinchley, 1982; Rhodes & Tauber, 2011).”
BackgroundMultiple bases for young and older adults' judgments of learning in multitrial learning.
Tauber, S. K., & Rhodes, M. G. (2012) · Psychology and Aging · doi:10.1037/a0025246 · Cited by 65
“With few departures, multitrial learning (e.g., delayed JOLs; Meeter & Nelson, 2003; Scheck & Nelson, 2005; see Rhodes & Tauber, 2011, for a review of delayed JOLs) has been characterized by impaired calibration and enhanced resolution.”
Self-citationPreschoolers can make highly accurate judgments of learning.
Lipowski, S. L., Merriman, W. E., & Dunlosky, J. (2013) · Developmental Psychology · doi:10.1037/a0030614 · Cited by 57
Comparing the effects of worked examples and modeling examples on learning
Hoogerheide, V., Loyens, S. M. M., & van Gog, T. (2014) · Computers in Human Behavior · doi:10.1016/j.chb.2014.09.013 · Cited by 71
“…confidence in their own abilities might not necessarily be a positive outcome when they would become overconfident, because overconfidence negatively affects students’ regulation of the learning process (Dunlosky & Rawson, 2012; Rhodes & Tauber, 2011; Thiede, Anderson, & Therriault, 2003).”
BackgroundMonitoring the Mind: The Neurocognitive Correlates of Metamemory
Lam, A. T. A. D., Axmacher, N., Fell, J., Staresina, B. P., Gauggel, S., Wagner, T., Olligs, J., & Weis, S. (2012) · PLoS ONE · doi:10.1371/journal.pone.0030009 · Cited by 65
Blake, A. B., Nazarian, M., & Castel, A. D. (2015) · Quarterly Journal of Experimental Psychology · doi:10.1080/17470218.2014.1002798 · Cited by 66
“This follows work with verbal material showing that " delayed " judgements of learning—those made after retrieving the information in question—are often reliable estimates of later memory (see Rhodes & Tauber, 2011).”
Baars, M., van Gog, T., de Bruin, A. B. H., & PAAS, F. G. W. C. (2016) · Educational Psychology · doi:10.1080/01443410.2016.1150419 · Cited by 68
Baars, M., Visser, S., Gog, T. V., Bruin, A. D., & Paas, F. (2013) · Contemporary Educational Psychology · doi:10.1016/j.cedpsych.2013.09.001 · Cited by 45
Improving metacomprehension accuracy in an undergraduate course context.
Wiley, J., Griffin, T. D., Jaeger, A. J., Jarosz, A. F., Cushen, P. J., & Thiede, K. W. (2016) · Journal of Experimental Psychology: Applied · doi:10.1037/xap0000096 · Cited by 49
“…as assessed with intraindividual correlations between predictions of whether or not each item will be remembered, and whether or not each item is remembered successfully, can reach near perfect levels (i.e., intraindividual correlations above .90; Nelson & Dunlosky, 1991; Rhodes & Tauber, 2011).”
BackgroundMeasuring memory monitoring with judgements of retention (JORs)
Tauber, S. K., & Rhodes, M. G. (2012) · Quarterly Journal of Experimental Psychology · doi:10.1080/17470218.2012.656665 · Cited by 47
Self-citationEffects of Feedback on Self‐Evaluations and Self‐Regulation in Elementary School
van Loon, M. H., & Roebers, C. M. (2017) · Applied Cognitive Psychology · doi:10.1002/acp.3347 · Cited by 62
“…to make judgments; postdictions are typically more accurate than predictions of performance (Hacker, Bol, Horgan, & Rakow, 2000), and delaying judgments until after completing the test leads to higher judgment accuracy than immediately making judgments when studying (Rhodes & Tauber, 2011).”
BackgroundMcGillivray, S., & Castel, A. D. (2017) · Experimental Aging Research · doi:10.1080/0361073x.2017.1298956 · Cited by 57
Self-explaining steps in problem-solving tasks to improve self-regulation in secondary education.
Baars, M., Leopold, C., & PAAS, F. G. W. C. (2018) · Journal of Educational Psychology · doi:10.1037/edu0000223 · Cited by 56
“Studies on monitoring learning word pairs (for a review see, Rhodes & Tauber, 2011) and expository text (for a review see, Thiede, Griffin, Wiley, & Redford, 2009) have found several ways to support and improve monitoring judgments (e.g., judgments of learning, JOLs) and study control (e.g.,…”
BackgroundAccurate monitoring leads to effective control and greater learning of patient education materials.
Rawson, K. A., O'Neil, R. L., & Dunlosky, J. T. (2011) · Journal of Experimental Psychology Applied · doi:10.1037/a0024749 · Cited by 55
Castel, A. D., Rhodes, M. G., & Friedman, M. C. (2012) · Memory & Cognition · doi:10.3758/s13421-012-0249-6 · Cited by 47
“…between predicted and actual memory performance that may reflect inappropriate weighting of the cues available to the rememberer (e.g., Benjamin, Bjork, & Schwartz, 1998; Kelley & Jacoby, 1996b; Koriat & Bjork, 2006; Koriat & Ma’ayan, 2005; Rhodes & Castel, 2008, 2009; Rhodes & Tauber, 2011a).”
Self-citationImproving metacognitive accuracy: How failing to retrieve practice items reduces overconfidence
Miller, T. M., & Geraci, L. D. (2014) · Consciousness and Cognition · doi:10.1016/j.concog.2014.08.008 · Cited by 48
“This theoretical mechanism has been termed the monitoring dual memories hypothesis (Nelson & Dunlosky, 1991; also see Rhodes & Tauber, 2011 for a review).”
Bui, Y. C., Pyc, M. A., & Bailey, H. R. (2017) · Memory · doi:10.1080/09658211.2017.1406523 · Cited by 42
“Indeed, evidence has suggested that even very brief delays can increase JOL accuracy (e.g., Rhodes & Tauber, 2011).”
BackgroundResultInfluentialRivers, M. L., Janes, J. L., & Dunlosky, J. T. (2021) · Memory · doi:10.1080/09658211.2021.1985143 · Cited by 47
Are feeling-of-knowing and judgment-of-learning different? Evidence from older adults
Souchay, C., & Isingrini, M. L. (2012) · Acta Psychologica · doi:10.1016/j.actpsy.2012.01.007 · Cited by 48
Do delayed judgements of learning reduce metamemory illusions? A meta-analysis
Luna, K., Мартин-Луенго, Б., & Albuquerque, P. B. (2018) · Quarterly Journal of Experimental Psychology · doi:10.1080/17470218.2017.1343362 · Cited by 45
The Relationship Between Interoception and Metacognition: A Pilot Study
Meessen, J., Mainz, V., Gauggel, S., Volz-Sidiropoulou, E., Sütterlin, S., & Forkmann, T. (2016) · Journal of Psychophysiology · doi:10.1027/0269-8803/a000157 · Cited by 37
Zhao, W., Li, B., Shanks, D. R., Zhao, W., Zheng, J., Hu, X., Su, N., Fan, T., Yin, Y., Luo, L., et al. (2022) · Child Development · doi:10.1111/cdev.13689 · Cited by 35
Tauber, S. K. (., Dunlosky, J., & Rawson, K. A. (2015) · Experimental Psychology · doi:10.1027/1618-3169/a000296 · Cited by 36
Self-citationMaking judgments of learning enhances memory by inducing item-specific processing
Senkova, O., & Otani, H. (2021) · Memory & Cognition · doi:10.3758/s13421-020-01133-2 · Cited by 41
Towards a common conceptual space for metacognition in perception and memory
Mazancieux, A., Pereira, M., Faivre, N., Mamassian, P., Moulin, C. J. A., & Souchay, C. (2023) · Nature Reviews Psychology · doi:10.1038/s44159-023-00245-1 · Cited by 48
“Furthermore, these judgements arguably rely on a retrieval attempt, as has been shown by delaying the point at which a judgement of learning is made 28 .”
Backgroundvan Loon, M. H., de Bruin, A. B. H., van Gog, T., & van Merriënboer, J. J. G. (2013) · Metacognition and Learning · doi:10.1007/s11409-013-9100-0 · Cited by 37
“The memory retrieval account, which states that JOLs are accurate because they rely on information from long-term memory (Nelson and Dunlosky 1991; Rhodes and Tauber 2011) provides an explanation for more accurate monitoring when judging idiom learning after a delay.”
BackgroundThe Testing Effect as a Function of Explicit Testing Instructions and Judgments of Learning
Jönsson, F. U., Hedner, M., & Olsson, M. J. (2012) · Experimental Psychology (formerly Zeitschrift für Experimentelle Psychologie) · doi:10.1027/1618-3169/a000150 · Cited by 36
Feedback reduces the metacognitive benefit of tests.
Kornell, N., & Rhodes, M. G. (2013) · Journal of Experimental Psychology Applied · doi:10.1037/a0032147 · Cited by 37
“The focus of the current article, however, is on the metacognitive benefit of retrieval: Taking a test allows people to accurately monitor their learning and distinguish what they know from what they do not know (e.g., King, Zechmeister, & Shaughnessy, 1980; cf. Rhodes & Tauber, 2011a).”
InfluentialSelf-citationHaerazi, H., & Kazemian, M. (2021) · Journal of Language and Literature Studies · doi:10.36312/jolls.v1i1.498 · Cited by 47
Metamemory viewed through the judgment lens
Bröder, A., & Undorf, M. (2019) · Acta Psychologica · doi:10.1016/j.actpsy.2019.04.011 · Cited by 33
Metacognitive Development and Conceptual Change in Children
Smortchkova, J., & Shea, N. J. (2020) · Review of Philosophy and Psychology · doi:10.1007/s13164-020-00477-7 · Cited by 44
Reactivity of Judgments of Learning in a Levels-of-Processing Paradigm
Tekin, E., & Roediger, H. L. (2020) · Zeitschrift für Psychologie · doi:10.1027/2151-2604/a000425 · Cited by 31
“One issue that has not received much attention until recently is the reactive effects of immediate JOLs (see Rhodes & Tauber, 2011; Spellman & Bjork, 1992, for some research on reactivity of delayed JOLs).”
BackgroundHow crucial is the response format for the testing effect?
Jönsson, F. U., Kubik, V., Sundqvist, M. L., Todorov, I., & Jonsson, B. (2013) · Psychological Research · doi:10.1007/s00426-013-0522-8 · Cited by 32
How restudy decisions affect overall comprehension for seventh‐grade students
Thiede, K. W., Redford, J. S., Wiley, J., & Griffin, T. D. (2017) · British Journal of Educational Psychology · doi:10.1111/bjep.12166 · Cited by 31
“Participants made delayed judgements of learning because they have been shown to be more highly related to subsequent test performance than immediate judgements (Rhodes & Tauber, 2011).”
ResultInfluence of cue word perceptual information on metamemory accuracy in judgement of learning
Hu, X., Liu, Z., Li, T., & Luo, L. (2015) · Memory · doi:10.1080/09658211.2015.1009470 · Cited by 34
“Although immediate JOLs are based mainly on heuristics in the study phase (Koriat, 1997), delayed JOLs rely more on long-term memory strength (Rhodes & Tauber, 2011a).”
BackgroundMagnitude and accuracy differences between judgements of remembering and forgetting
Serra, M. J., & England, B. D. (2012) · Quarterly Journal of Experimental Psychology · doi:10.1080/17470218.2012.685081 · Cited by 36
A Bayesian inference model for metamemory.
Hu, X., Zheng, J., Su, N., Fan, T., Yang, C., Yin, Y., Fleming, S. M., & Luo, L. (2021) · Psychological Review · doi:10.1037/rev0000270 · Cited by 28
Fraundorf, S. H., Caddick, Z. A., Nokes‐Malach, T. J., & Rottman, B. M. (2023) · Cognitive Research Principles and Implications · doi:10.1186/s41235-023-00511-z · Cited by 42
“When JOLs are made at a delay after initial learning, they can strongly predict later performance (Nelson & Dunlosky, 1991, EL: 5); meta-analysis indicates a 0.75 correlation between delayed JOLs and later performance (Rhodes & Tauber, 2011, EL: 1).”
BackgroundInfluentialBaars, M., van Gog, T., de Bruin, A. B. H., & PAAS, F. G. W. C. (2018) · Studies In Educational Evaluation · doi:10.1016/j.stueduc.2018.05.010 · Cited by 34
Chang, M., & Brainerd, C. J. (2022) · Metacognition and Learning · doi:10.1007/s11409-021-09287-3 · Cited by 31
“One of the most robust findings in the JOL literature is that delayed JOLs are better predictors of memory performance than immediate JOLs (Rhodes & Tauber, 2011).”
BackgroundResultBertrand, J., Moulin, C. J. A., & Souchay, C. (2016) · Memory · doi:10.1080/09658211.2016.1200625 · Cited by 28
“…based on recollection (e.g., Souchay, Moulin, Clarys, Taconnat, & Isingrini, 2007) and JOLs are based on information retrieved from either short-term memory or long-term memory (e.g., Nelson & Dunlosky, 1991; Rhodes & Tauber, 2011) according to the delay between the learning phase and prediction.”
MethodWhat moderates the accuracy of ease of learning judgments?
Jemstedt, A., Kubik, V., & Jönsson, F. U. (2017) · Metacognition and Learning · doi:10.1007/s11409-017-9172-3 · Cited by 29
“As opposed to the less studied EOL judgments, much research has focused, for example, on judgments of learning (JOL; Nelson & Dunlosky, 1991; Rhodes & Tauber, 2011; Sikström & Jönsson, 2005) or feeling-of-knowing (FOK) judgments (Hart, 1965; Schwartz, Boduroglu, & Tekcan, 2016).”
ResultMeta-analysis of Interventions for Monitoring Accuracy in Problem Solving
Janssen, N., & Lazonder, A. W. (2024) · Educational Psychology Review · doi:10.1007/s10648-024-09936-4 · Cited by 39
“The idea behind this intervention is that the delay indirectly stimulates students to retrieve the information from memory, which consequently results in higher monitoring accuracy (Rhodes & Tauber, 2011).”
InfluentialMetacognitive judgments can potentiate new learning: The role of covert retrieval
Kubik, V., Koslowski, K., Schubert, T., & Aslan, A. (2022) · Metacognition and Learning · doi:10.1007/s11409-022-09307-w · Cited by 27
“Therefore, making cue-only JOLs can enhance learning via retrieval processes similar to those assumed to be involved in the BTE (cf. Rhodes & Tauber, 2011).”
BackgroundMethodInfluentialMaxwell, N. P., & Huff, M. J. (2022) · Memory & Cognition · doi:10.3758/s13421-022-01381-4 · Cited by 24
“Research suggests that JOLs made following a delay can produce memory benefits (e.g., Akdoğan et al., 2016; Spellman & Bjork, 1992; see Rhodes & Tauber, 2011).”
BackgroundMetacognitive sensitivity: The key to calibrating trust and optimal decision making with AI
Lee, D., Pruitt, J., Zhou, T., Du, J., & Odegaard, B. (2025) · PNAS Nexus · doi:10.1093/pnasnexus/pgaf133 · Cited by 44
Metamemory for pictures of naturalistic scenes: Assessment of accuracy and cue utilization
Undorf, M., & Bröder, A. (2021) · Memory & Cognition · doi:10.3758/s13421-021-01170-5 · Cited by 19
Metamemory: An Update of Critical Findings
Schwartz, B. L., & Metcalfe, J. (2017) · Elsevier eBooks · doi:10.1016/b978-0-12-809324-5.21056-0 · Cited by 27
Sundqvist, M. L., Mäntylä, T., & Jönsson, F. U. (2017) · Frontiers in Psychology · doi:10.3389/fpsyg.2017.01018 · Cited by 21
“In other words, delayed JOLs should produce testing effects because they entail covert retrieval (e.g., Sundqvist et al., 2012; Jönsson et al., 2014; Akdoğan et al., 2015; see Rhodes and Tauber, 2011, for a review), although not all studies confirm this.”
BackgroundMetacognitive monitoring during criterion learning: When and why are judgments accurate?
Pyc, M. A., Rawson, K. A., & Aschenbrenner, A. J. (2014) · Memory & Cognition · doi:10.3758/s13421-014-0403-4 · Cited by 21
Fernandes, D. V. D. H., Puntoni, S., van Osselaer, S. M. J., & Cowley, E. (2015) · Journal of Consumer Psychology · doi:10.1016/j.jcps.2015.06.012 · Cited by 22
Identifying causal subsequent memory effects
Halpern, D. J., Tubridy, S., Davachi, L., & Gureckis, T. M. (2023) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2120288120 · Cited by 18
Judgments of learning enhance recall for category-cued but not letter-cued items
Rivers, M. L., Dunlosky, J. T., Janes, J. L., Witherby, A. E., & Tauber, S. K. (2023) · Memory & Cognition · doi:10.3758/s13421-023-01417-3 · Cited by 19
“…et al., 2021; Senkova & Otani, 2021; Shi et al., 2022; Soder-strom et al., 2015; Tauber & Witherby, 2019; Tekin & Roe-diger, 2020; Witherby & Tauber, 2017; Yang et al., 2015; Zhao et al., 2022; for a review of the effects on learning when JOLs are made after a delay, see Rhodes & Tauber, 2011).”
BackgroundSelf-citationComparing retrieval-based practice and peer instruction in physics learning
Zu, T., Munsell, J., & Rebello, N. S. (2019) · Physical Review Physics Education Research · doi:10.1103/physrevphyseducres.15.010105 · Cited by 23
Why Does Excellent Monitoring Accuracy Not Always Produce Gains in Memory Performance?
Dunlosky, J. T., Mueller, M. L., Morehead, K., Tauber, S. K., Thiede, K. W., & Metcalfe, J. (2021) · Zeitschrift für Psychologie · doi:10.1027/2151-2604/a000441 · Cited by 18
“In particular, the JOLs were expected to demonstrate high levels of accuracy for discriminating between items that had (vs. had not) been recalled by the final test trial of the initial-study phase (Rhodes & Tauber, 2011).”
BackgroundMethodInfluentialSelf-citationUnderstanding metacognitive confidence: Insights from judgment-of-learning justifications
Jersakova, R., Allen, R. J., Booth, J. H. H., Souchay, C., & O’Connor, A. R. (2017) · Journal of Memory and Language · doi:10.1016/j.jml.2017.08.002 · Cited by 21
Ackerman, R., Bernstein, D. M., & Kumar, R. (2020) · Memory & Cognition · doi:10.3758/s13421-020-01012-w · Cited by 20
Mobile Learning to Support Self-Regulated Learning: A Theoretical Review
Baars, M., & Viberg, O. (2022) · International Journal of Mobile and Blended Learning · doi:10.4018/ijmbl.315628 · Cited by 27
Do changed learning goals explain why metamemory judgments reactively affect memory?
Li, B., Shanks, D. R., Zhao, W., Hu, X., Luo, L., & Yang, C. (2024) · Journal of Memory and Language · doi:10.1016/j.jml.2024.104506 · Cited by 17
Carpenter, S. K., & Geller, J. (2019) · Quarterly Journal of Experimental Psychology · doi:10.1177/1747021819879416 · Cited by 16
Assessing metacognition in the classroom: Student help-seeking behavior
Chu, Y., Palmer, S., & Persky, A. M. (2018) · Currents in Pharmacy Teaching and Learning · doi:10.1016/j.cptl.2018.08.011 · Cited by 21
Cognitive and metacognitive determinants of eyewitness memory accuracy over time
Shapira, A. A., & Pansky, A. (2019) · Metacognition and Learning · doi:10.1007/s11409-019-09206-7 · Cited by 20
Do Judgments of Learning Impair Recall When Uninformative Cues Are Salient?
Double, K. S. (2023) · Journal of Intelligence · doi:10.3390/jintelligence11100203 · Cited by 17
Meessen, J., Sütterlin, S., Gauggel, S., & Forkmann, T. (2018) · Cognitive Processing · doi:10.1007/s10339-018-0865-6 · Cited by 17
The Effect of Confidence Rating on a Primary Visual Task
Bonder, T., & Gopher, D. (2019) · Frontiers in Psychology · doi:10.3389/fpsyg.2019.02674 · Cited by 16
The effect of delayed judgments of learning on retention
Tekin, E., & Roediger, H. L., III (2021) · Metacognition and Learning · doi:10.1007/s11409-021-09260-0 · Cited by 18
Improving face identification of mask-wearing individuals
Manley, K. D., Chan, J. C. K., & Wells, G. L. (2022) · Cognitive Research Principles and Implications · doi:10.1186/s41235-022-00369-7 · Cited by 18
“…sufficient to produce prospective judgments of high accuracy for relatively simple materials such as paired associates (Nelson & Dunlosky, 1991; Rhodes & Tauber, 2011; Son & Metcalfe, 2005), but it might be inadequate when dealing with the unique challenges associated with eyewitness…”
BackgroundRemind me of the context: Memory and metacognition at restudy
Zawadzka, K., Simkiss, N. J., & Hanczakowski, M. (2018) · Journal of Memory and Language · doi:10.1016/j.jml.2018.03.001 · Cited by 17
Metadata
- Authors
- Rhodes, M. G., & Tauber, S. K.
- Affiliations
- Colorado State University (US)
- Kent State University (US)
- ORCID
- Tauber, Sarah K.
- Venue
- Psychological Bulletin
- Published
- 2011
- Volume
- 137
- Issue
- 1
- Pages
- 131-148
- ISSN
- 0033-2909 (ISSN-L)
- 1939-1455
- OpenAlex
- W2061235287
- Cited by
- 230
- References
- 83
- Citations by year
- 2026: 14 · 2025: 13 · 2024: 15 · 2023: 23 · 2022: 11 · 2021: 22 · 2020: 14 · 2019: 14 · 2018: 12 · 2017: 16 · 2016: 12 · 2015: 10 · 2014: 18 · 2013: 9 · 2012: 17
- FWCI
- 8.90
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Psychological Bulletin (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Memory Processes and Influences
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Cognitive Functions and Memory
- Social Sciences › Psychology › Developmental and Educational Psychology › Innovative Teaching and Learning Methods
- Keywords
- judgments of learning, metacognitive accuracy, metacognition, memory prediction, memory performance, long-term memory, retrieval cues, metacognitive confidence
- MeSH terms
- Cognition, Cues, Humans, Judgment, Learning, Memory, Short-Term, Models, Psychological, Time Factors, Memory, Long-Term
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.