Is Covert Retrieval an Effective Learning Strategy? Is It as Effective as Overt Retrieval? Answers from a Meta-Analytic Review
The DOI matches its Crossref record; 105 of the 107 references it cites were found in a registry or an index.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Bias in meta-analysis detected by a simple, graphical test
Egger, M., Smith, G. D., Schneider, M., & Minder, C. (1997) · BMJ · doi:10.1136/bmj.315.7109.629 · Cited by 56,722
Conducting Meta-Analyses in R with the metafor Package
Viechtbauer, W. (2010) · Journal of Statistical Software · doi:10.18637/jss.v036.i03 · Cited by 20,464 · cited 1×
“All analyses were conducted via the R metafor package (Viechtbauer, 2010), except where noted otherwise.”
Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2009) · doi:10.1002/9780470743386 · Cited by 14,225 · cited 1×
“Otherwise, the formulae provided by Borenstein et al. (2009) were employed to calculate effect sizes.”
Levels of processing: A framework for memory research
Craik, F. I. M., & Lockhart, R. S. (1972) · Journal of Verbal Learning and Verbal Behavior · doi:10.1016/s0022-5371(72)80001-x · Cited by 9,566 · cited 2×
“Instead, answer monitoring likely relies on surface-level recognition rather than deeper-level retrieval (Abel & Roediger, 2018; Baddeley & Hitch, 2017; Craik & Lockhart, 1972).”
Nicol, D. J., & Macfarlane‐Dick, D. (2006) · Studies in Higher Education · doi:10.1080/03075070600572090 · Cited by 5,846
Dunlosky, J., Rawson, K. A., Marsh, E. J., Nathan, M. J., & Willingham, D. T. (2013) · Psychological Science in the Public Interest · doi:10.1177/1529100612453266 · Cited by 3,138
Test-Enhanced Learning: Taking Memory Tests Improves Long-Term Retention
Roediger, H. L., & Karpicke, J. D. (2006) · Psychological Science · doi:10.1111/j.1467-9280.2006.01693.x · Cited by 2,867
Morris, S. B., & DeShon, R. P. (2002) · Psychological Methods · doi:10.1037/1082-989x.7.1.105 · Cited by 2,502
Reprint—Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & and the PRISMA Group (2009) · Physical Therapy · doi:10.1093/ptj/89.9.873 · Cited by 2,486
Distributed practice in verbal recall tasks: A review and quantitative synthesis.
Cepeda, N. J., Pashler, H., Vul, E., Wixted, J. T., & Rohrer, D. (2006) · Psychological Bulletin · doi:10.1037/0033-2909.132.3.354 · Cited by 1,888
The Critical Importance of Retrieval for Learning
Karpicke, J. D., & Roediger, H. L. (2008) · Science · doi:10.1126/science.1152408 · Cited by 1,791 · cited 3×
“…is that overt retrieval is a universally applicable strategy that can more effectively accelerate learning of different types of materials (Abel & Roediger, 2018; Butler, 2010; Carpenter & Pashler, 2007; Kang et al., 2007; Karpicke & Roediger, 2008; Tauber et al., 2018; Yang et al., 2019).”
Three-level meta-analysis of dependent effect sizes
Van den Noortgate, W., López-López, J. A., Marín-Martínez, F., & Sánchez-Meca, J. (2013) · Behavior Research Methods · doi:10.3758/s13428-012-0261-6 · Cited by 1,130 · cited 1×
“This variability may stem from differences in study design, materials, or the specific methods used to implement covert and overt retrieval (Van den Noortgate et al., 2013).”
The effect of testing versus restudy on retention: A meta-analytic review of the testing effect.
Rowland, C. A. (2014) · Psychological Bulletin · doi:10.1037/a0037559 · Cited by 1,066 · cited 12×
“This aligns with previous findings from overt retrieval research (Chan et al., 2024; Kang et al., 2007; Rowland, 2014; Yang et al., 2021), suggesting that corrective feedback plays a similarly important role in determining the effectiveness of overt and covert retrieval.”
InfluentialEstimation of effect size from a series of independent experiments.
Hedges, L. V. (1982) · Psychological Bulletin · doi:10.1037//0033-2909.92.2.490 · Cited by 1,062
Retrieval Practice Produces More Learning than Elaborative Studying with Concept Mapping
Karpicke, J. D., & Blunt, J. R. (2011) · Science · doi:10.1126/science.1199327 · Cited by 1,019 · cited 1×
“In this sense, overt retrieval may serve as a potent mechanism for reinforcing learning because it combines the cognitive demands of retrieval with overt production of the retrieved answers (Karpicke & Blunt, 2011).”
Stanley, T. D., & Doucouliagos, H. (2014) · Research Synthesis Methods · doi:10.1002/jrsm.1095 · Cited by 916
Blaxton, T. A. (1989) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037//0278-7393.15.4.657 · Cited by 757
Averaging correlation coefficients: Should Fisher’s z transformation be used?
Silver, N. C., & Dunlap, W. P. (1987) · Journal of Applied Psychology · doi:10.1037/0021-9010.72.1.146 · Cited by 606 · cited 1×
“First, we converted the r values, extracted from within-subjects studies in which r values could be directly computed, into Fisher’s Z scores (Silver & Dunlap, 1987).”
Nelson, T. O., & Dunlosky, J. (1991) · Psychological Science · doi:10.1111/j.1467-9280.1991.tb00147.x · Cited by 580 · cited 2×
“) and are asked to report the likelihood that they will be able to recall the target (e.g., banana ) on a later test (Dunlosky & Nelson, 1992; Nelson & Dunlosky, 1991).”
Pyc, M. A., & Rawson, K. A. (2009) · Journal of Memory and Language · doi:10.1016/j.jml.2009.01.004 · Cited by 551 · cited 6×
“The act of practicing retrieval forces learners to work harder, leading to deeper processing and reorganization of studied information and in turn consolidating long-term memory (Bjork & Bjork, 1992, 2020; Pyc & Rawson, 2009).”
InfluentialRethinking the Use of Tests: A Meta-Analysis of Practice Testing
Adesope, O. O., Trevisan, D. A., & Sundararajan, N. (2017) · Review of Educational Research · doi:10.3102/0034654316689306 · Cited by 544 · cited 6×
“However, the meta-analysis by Adesope et al. (2017) observed no additional enhancement of corrective feedback.”
InfluentialTest format and corrective feedback modify the effect of testing on long-term retention
Kang, S. H. K., McDermott, K. B., & Roediger, H. L. (2007) · European Journal of Cognitive Psychology · doi:10.1080/09541440601056620 · Cited by 513
Cue strength as a moderator of the testing effect: The benefits of elaborative retrieval.
Carpenter, S. K. (2009) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/a0017021 · Cited by 503
(1992) · Cited by 464
Levels of processing: A retrospective commentary on a framework for memory research.
Lockhart, R. S., & Craik, F. I. M. (1990) · Canadian Journal of Psychology / Revue canadienne de psychologie · doi:10.1037/h0084237 · Cited by 457
When Does Feedback Facilitate Learning of Words?
Pashler, H., Cepeda, N. J., Wixted, J. T., & Rohrer, D. (2005) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/0278-7393.31.1.3 · Cited by 445 · cited 1×
“Corrective feedback offers an additional layer of re-exposure to study materials, which helps strengthen memory pathways (Kang et al., 2007; Pashler et al., 2005).”
Karpicke, J. D., & Roediger, H. L. (2007) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/0278-7393.33.4.704 · Cited by 421 · cited 1×
“Studies that only included a covert retrieval condition and a control condition, an overt condition and a control condition, or a covert and an overt condition were excluded (Carpenter & Pashler, 2007; Haus-man & Kubik, 2023; Kang et al., 2007; Karpicke & Roediger, 2007; Roediger & Karpicke, 2006).”
A General Linear Model for Estimating Effect Size in the Presence of Publication Bias
Vevea, J. L., & Hedges, L. V. (1995) · Psychometrika · doi:10.1007/bf02294384 · Cited by 413
The "testing" phenomenon: Not gone but nearly forgotten.
Glover, J. A. (1989) · Journal of Educational Psychology · doi:10.1037/0022-0663.81.3.392 · Cited by 392 · cited 4×
“These theories suggest that, similar to overt retrieval (Glover, 1989; Pyc & Rawson, 2009; Rowland, 2014; Yang et al., 2021), covert retrieval enhances learning by reinforcing memory through cognitive effort and re-exposure.”
InfluentialTest-enhanced learning in the classroom: Long-term improvements from quizzing.
Roediger, H. L., Agarwal, P. K., McDaniel, M. A., & McDermott, K. B. (2011) · Journal of Experimental Psychology: Applied · doi:10.1037/a0026252 · Cited by 386
The production effect: Delineation of a phenomenon.
MacLeod, C. M., Gopie, N., Hourihan, K. L., Neary, K. R., & Ozubko, J. D. (2010) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/a0018785 · Cited by 383
Why Testing Improves Memory: Mediator Effectiveness Hypothesis
Pyc, M. A., & Rawson, K. A. (2010) · Science · doi:10.1126/science.1191465 · Cited by 371 · cited 1×
“…proposed to account for the standard retrieval practice effect (i.e., the overt retrieval effect), such as the transfer-appropriate processing theory (Blaxton, 1989), the elaborative retrieval account (Carpenter, 2009), and the mediator effectiveness hypothesis (Pyc & Rawson, 2010), among others.”
Examining the testing effect with open‐ and closed‐book tests
Agarwal, P. K., Karpicke, J. D., Kang, S. H. K., Roediger, H. L., & McDermott, K. B. (2008) · Applied Cognitive Psychology · doi:10.1002/acp.1391 · Cited by 342
Testing (quizzing) boosts classroom learning: a systematic and meta-analytic review
Yang, C., Luo, L., Vadillo, M. A., Yu, R., & Shanks, D. R. (2021) · Psychological Bulletin · doi:10.1037/bul0000309 · Cited by 333 · cited 17×
“…2008; Yang et al., 2019), across different test formats, from recognition to free recall and cued recall tests (Agarwal et al., 2008; Fiechter & Benjamin, 2019; Kang et al., 2007; Yang et al., 2019), and across different settings, from laboratory to classroom (for a review, see Yang et al., 2021).”
InfluentialThe effect of type and timing of feedback on learning from multiple-choice tests.
Butler, A. C., Karpicke, J. D., & Roediger, H. L. (2007) · Journal of Experimental Psychology: Applied · doi:10.1037/1076-898x.13.4.273 · Cited by 321 · cited 1×
“…that providing corrective feedback magnifies the effectiveness of covert retrieval, the specific types of corrective feedback (e.g., simple vs. detailed feed-back) and their timing (e.g., immediate vs. delayed feedback) have not been systematically explored (Butler et al., 2007; Ryan et al., 2024).”
Importance of the kind of cue for judgments of learning (JOL) and the delayed-JOL effect
Dunlosky, J., & Nelson, T. O. (1992) · Memory & Cognition · doi:10.3758/bf03210921 · Cited by 308
Huisman, B., Saab, N., van den Broek, P., & van Driel, J. (2019) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2018.1545896 · Cited by 306
Desirable difficulties in theory and practice.
Bjork, R. A., & Bjork, E. L. (2020) · Journal of Applied Research in Memory and Cognition · doi:10.1016/j.jarmac.2020.09.003 · Cited by 301 · cited 8×
“As proposed by Bjork and Bjork (1992, 2020), strategies or learning conditions that require more mental effort from learners may impede short-term learning because they increase cognitive load and slow down the learning process but are ultimately beneficial for long-term learning because they force…”
InfluentialThe effects of tests on learning and forgetting.
Carpenter, S. K., Pashler, H., Wixted, J. T., & Vul, E. (2008) · Memory & Cognition · doi:10.3758/mc.36.2.438 · Cited by 281 · cited 3×
“…showed that covert retrieval enhances learning compared to control strategies such as rereading (Bullshtein, 2015; Carpenter & Pashler, 2007; Carpenter et al., 2008; Carvalho et al., 2023; Kubik et al., 2020; Smith et al., 2013), while others found no enhancement effect of covert retrieval…”
Why tests appear to prevent forgetting: A distribution-based bifurcation model
Kornell, N., Bjork, R. A., & Garcia, M. A. (2011) · Journal of Memory and Language · doi:10.1016/j.jml.2011.04.002 · Cited by 277 · cited 2×
“…overt—is most beneficial when learners are given the time and cognitive space to consoli-date information over extended periods (Bjork & Bjork, 2020; Kornell et al., 2011; Kubik et al., 2020; Putnam & Roediger, 2013; Roediger & Karpicke, 2006; Row-land, 2014; Sundqvist et al., 2017) and are…”
Carpenter, S. K. (2011) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/a0024140 · Cited by 258
Silence Is Not Golden: A Case for Socially Shared Retrieval-Induced Forgetting
Cuc, A., Koppel, J., & Hirst, W. (2007) · Psychological Science · doi:10.1111/j.1467-9280.2007.01967.x · Cited by 248
Testing during study insulates against the buildup of proactive interference.
Szpunar, K. K., McDermott, K. B., & Roediger, H. L. (2008) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/a0013082 · Cited by 247
Retrieval-Based Learning: A Decade of Progress
Karpicke, J. D. (2017) · Learning and Memory: A Comprehensive Reference · doi:10.1016/b978-0-12-809324-5.21055-9 · Cited by 223 · cited 1×
“Interested readers can consult recent reviews (Karpicke, 2017; Rowland, 2014; Yang et al., 2018, 2021).”
Multilevel Meta-analysis: a comparison with traditional meta-analytical procedures
Van Den Noortgate, W., & Onghena, P. (2003) · Educational and Psychological Measurement · doi:10.1177/0013164403251027 · Cited by 218 · cited 1×
“To mitigate this problem, all meta-analyses reported here were performed using multilevel random-effects models, adding a random intercept at the study level (Pastor & Lazowski, 2018; Van Den Noortgate & Onghena, 2003).”
Yan, Z. (2020) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2019.1629390 · Cited by 217 · cited 1×
“Future studies should examine how different forms of monitoring, such as peer feedback (Huisman et al., 2018; Nicol & Macfarlane-Dick, 2006) or guided self-monitoring (Yan, 2019), can increase the cognitive effort required and produce superior learning outcomes.”
How to obtain nnt from cohen’s D: comparison of two methods
Furukawa, T. A., & Leucht, S. (2011) · PLoS ONE · doi:10.1371/journal.pone.0019070 · Cited by 179 · cited 1×
“To help readers interpret the effect size of covert retrieval (i.e., g = 0.23), we can contextualize this benefit with the aid of a number-needed-to-treat (NNT; Furukawa & Leucht, 2011) analysis using the NNT function in the R dmetar package (Harrer et al., 2019).”
InfluentialReducing bias, increasing transparency and calibrating confidence with preregistration
Hardwicke, T. E., & Wagenmakers, E.-J. (2023) · Nature Human Behaviour · doi:10.1038/s41562-022-01497-2 · Cited by 179
What types of learning are enhanced by a cued recall test?
Carpenter, S. K., Pashler, H., & Vul, E. (2006) · Psychonomic Bulletin & Review · doi:10.3758/bf03194004 · Cited by 172
Instability in memory phenomena: A common puzzle and a unifying explanation
McDaniel, M. A., & Bugg, J. M. (2008) · Psychonomic Bulletin & Review · doi:10.3758/pbr.15.2.237 · Cited by 165
How recall facilitates subsequent recall: A reappraisal.
Thompson, C. P., Wenger, S. K., & Bartling, C. A. (1978) · Journal of Experimental Psychology: Human Learning and Memory · doi:10.1037/0278-7393.4.3.210 · Cited by 143 · cited 4×
“Hence, according to the additional exposure theory (Thompson et al., 1978), we predicted that the enhancement effect of covert retrieval should be stronger when corrective feedback is provided (Yang et al., 2021).”
InfluentialRetrieval potentiates new learning: A theoretical and meta-analytic review.
Chan, J. C. K., Meissner, C. A., & Davis, S. D. (2018) · Psychological Bulletin · doi:10.1037/bul0000166 · Cited by 143 · cited 1×
“Several meta-analyses have already been conducted to quantify the effect of overt retrieval (e.g., Adesope et al., 2017; Chan et al., 2018; Rowland, 2014; Yang et al., 2021).”
Robust Bayesian meta-analysis: Addressing publication bias with model-averaging.
Maier, M., Bartoš, F., & Wagenmakers, E.-J. (2023) · Psychological Methods · doi:10.1037/met0000405 · Cited by 143
Testing beyond words: using tests to enhance visuospatial map learning
Carpenter, S. K., & Pashler, H. (2007) · Psychonomic Bulletin & Review · doi:10.3758/bf03194092 · Cited by 133
Pronunciation effects in recognition memory
Hopkins, R. H., & Edwards, R. E. (1972) · Journal of Verbal Learning and Verbal Behavior · doi:10.1016/s0022-5371(72)80036-7 · Cited by 124
Covert retrieval practice benefits retention as much as overt retrieval practice.
Smith, M. A., Roediger, H. L., & Karpicke, J. D. (2013) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/a0033569 · Cited by 124
Enhancing learning and retrieval of new information: a review of the forward testing effect
Yang, C., Potts, R., & Shanks, D. R. (2018) · npj Science of Learning · doi:10.1038/s41539-018-0024-y · Cited by 119 · cited 2×
“This phenomenon is known as the testing effect , retrieval practice effect , or test-enhanced learning (Dunlosky et al., 2013; Ma et al., 2022; Roediger & Karpicke, 2006; Shanks et al., 2023; Szpunar et al., 2008; Yang et al., 2018, 2021).”
Self-citationPastor, D. A., & Lazowski, R. A. (2018) · Multivariate Behavioral Research · doi:10.1080/00273171.2017.1365684 · Cited by 117
Bartoš, F., Maier, M., Quintana, D. S., & Wagenmakers, E.-J. (2022) · Advances in Methods and Practices in Psychological Science · doi:10.1177/25152459221109259 · Cited by 109
Enhancing visuospatial learning: The benefit of retrieval practice
Kang, S. H. K. (2010) · Memory & Cognition · doi:10.3758/mc.38.8.1009 · Cited by 104
Age-related differences in the impact of spacing, lag, and retention interval.
Balota, D. A., Duchek, J. M., & Paullin, R. (1989) · Psychology and Aging · doi:10.1037//0882-7974.4.1.3 · Cited by 92
Does response mode affect amount recalled or the magnitude of the testing effect?
Putnam, A. L., & Roediger, H. L. (2013) · Memory & Cognition · doi:10.3758/s13421-012-0245-x · Cited by 86
Retrieval-based learning: The need for guided retrieval in elementary school children
Karpicke, J. D., Blunt, J. R., Smith, M. A., & Karpicke, S. (2014) · Journal of Applied Research in Memory and Cognition · doi:10.1016/j.jarmac.2014.07.008 · Cited by 86
Congleton, A. R., & Rajaram, S. (2011) · Memory & Cognition · doi:10.3758/s13421-011-0168-y · Cited by 84
Ungraded Pop Quizzes: Test-Enhanced Learning Without All the Anxiety
Khanna, M. M. (2015) · Teaching of Psychology · doi:10.1177/0098628315573144 · Cited by 77
Is the Levels of Processing effect language-limited?
Baddeley, A., & Hitch, G. J. (2016) · Journal of Memory and Language · doi:10.1016/j.jml.2016.05.001 · Cited by 68
Do judgments of learning directly enhance learning of educational materials?
Ariel, R., Karpicke, J. D., Witherby, A. E., & Tauber, S. K. (2021) · Educational Psychology Review · doi:10.1007/s10648-020-09556-8 · Cited by 55 · cited 7×
“Although certain forms of covert retrieval (e.g., answer thinking, making delayed JOLs) can enhance learning, they generally do not compare to the effectiveness of overt retrieval (Ariel et al., 2021; Tauber et al., 2018; Tekin & Roediger, 2021).”
InfluentialDo Practice Tests (Quizzes) Reduce or Provoke Test Anxiety? A Meta-Analytic Review
Yang, C., Li, J., Zhao, W., Luo, L., & Shanks, D. R. (2023) · Educational Psychology Review · doi:10.1007/s10648-023-09801-w · Cited by 54
Self-citationRetrieving and applying knowledge to different examples promotes transfer of learning
Butler, A. C., Black-Maier, A. C., Raley, N. D., & Marsh, E. J. (2017) · Journal of Experimental Psychology Applied · doi:10.1037/xap0000142 · Cited by 51 · cited 1×
“In addition, many other studies have found that the benefits of overt retrieval are not limited to consolidating memory for factual knowledge but also extend to facilitating knowledge transfer in a variety of contexts (Butler, 2010; Butler et al., 2017).”
Testing enhances subsequent learning in older but not in younger elementary school children
Aslan, A., & Bäuml, K. T. (2015) · Developmental Science · doi:10.1111/desc.12340 · Cited by 48
Testing prepares students to learn better: The forward effect of testing in category learning.
Lee, H. S., & Ahn, D. (2018) · Journal of Educational Psychology · doi:10.1037/edu0000211 · Cited by 40
Testing enhances subsequent learning in older but not in younger elementary school children
Aslan, A., & Bäuml, K.-H. (2015) · University of Regensburg Publication Server (University of Regensburg) · doi:10.5283/epub.33113 · Cited by 38
Maddox, G. B., & Balota, D. A. (2015) · Memory & Cognition · doi:10.3758/s13421-014-0499-6 · Cited by 37
Does covert retrieval benefit learning of key-term definitions?
Tauber, S. K., Witherby, A. E., Dunlosky, J., Rawson, K. A., Putnam, A. L., & Roediger, H. L. (2018) · Journal of Applied Research in Memory and Cognition · doi:10.1016/j.jarmac.2016.10.004 · Cited by 37
Tauber, S. K. (., Dunlosky, J., & Rawson, K. A. (2015) · Experimental Psychology · doi:10.1027/1618-3169/a000296 · Cited by 36
The forward effects of testing transfer to different domains of learning.
Yang, C., Chew, S.-J., Sun, B., & Shanks, D. R. (2019) · Journal of Educational Psychology · doi:10.1037/edu0000320 · Cited by 35
Self-citationSchrank, Z. (2016) · Teaching Sociology · doi:10.1177/0092055x15624745 · Cited by 34
How crucial is the response format for the testing effect?
Jönsson, F. U., Kubik, V., Sundqvist, M. L., Todorov, I., & Jonsson, B. (2013) · Psychological Research · doi:10.1007/s00426-013-0522-8 · Cited by 32
The testing effect in a social setting: Does retrieval practice benefit a listener?
Abel, M., & Roediger, H. L., III (2018) · Journal of Experimental Psychology Applied · doi:10.1037/xap0000148 · Cited by 31
Metacognitive judgments can potentiate new learning: The role of covert retrieval
Kubik, V., Koslowski, K., Schubert, T., & Aslan, A. (2022) · Metacognition and Learning · doi:10.1007/s11409-022-09307-w · Cited by 28
Spaced Retrieval Practice: Can Restudying Trump Retrieval?
Higham, P. A., Fastrich, G. M., Potts, R., Murayama, K., Pickering, J. S., & Hadwin, J. A. (2023) · Educational Psychology Review · doi:10.1007/s10648-023-09809-2 · Cited by 28
Retrieval practice and judgements of learning enhance transfer of physiology information
Dobson, J. L., Linderholm, T., & Stroud, L. (2019) · Advances in Health Sciences Education · doi:10.1007/s10459-019-09881-w · Cited by 26
A Short-Term Testing Effect in Cross-Language Recognition
Verkoeijen, P. P. J. L., Bouwmeester, S., & Camp, G. (2012) · Psychological Science · doi:10.1177/0956797611435132 · Cited by 25
Kubik, V., Jönsson, F. U., de Jonge, M., & Arshamian, A. (2020) · Quarterly Journal of Experimental Psychology · doi:10.1177/1747021820945560 · Cited by 24
Writing-to-Learn Assignments in Introductory Psychology
Nevid, J. S., Pastva, A. M., & Mcclelland, N. (2012) · Teaching of Psychology · doi:10.1177/0098628312456622 · Cited by 23
Effect of levels-of-processing on rates of forgetting
Peng, N., Logie, R. H., & Sala, S. D. (2024) · Memory & Cognition · doi:10.3758/s13421-024-01599-4 · Cited by 22
Sundqvist, M. L., Mäntylä, T., & Jönsson, F. U. (2017) · Frontiers in Psychology · doi:10.3389/fpsyg.2017.01018 · Cited by 21
Depth of processing and memory organization
Koriat, A., & Melkman, R. (1987) · Psychological Research · doi:10.1007/bf00308684 · Cited by 20
Fiechter, J. L., & Benjamin, A. S. (2019) · Psychonomic Bulletin & Review · doi:10.3758/s13423-019-01617-6 · Cited by 19
The effect of delayed judgments of learning on retention
Tekin, E., & Roediger, H. L., III (2021) · Metacognition and Learning · doi:10.1007/s11409-021-09260-0 · Cited by 19
Ryan, A., Judd, T. S., Wilson, C., Larsen, D. P., Elliott, S. L., Kulasegaram, K. M., & Swanson, D. B. (2023) · Medical Education · doi:10.1111/medu.15287 · Cited by 19
Is retrieval the key? Metamemory judgment and testing as learning strategies
Akdoğan, E., Izaute, M., Danion, J., Vidailhet, P., & Bacon, É. (2015) · Memory · doi:10.1080/09658211.2015.1112812 · Cited by 18
The production effect in long-list recall: In no particular order?
Lambert, A. M., Bodner, G. E., & Taikh, A. (2016) · Canadian Journal of Experimental Psychology/Revue canadienne de psychologie expérimentale · doi:10.1037/cep0000086 · Cited by 18
Covert and overt retrieval practice in the classroom.
Sumeracki, M. A., & Castillo, J. (2022) · Translational Issues in Psychological Science · doi:10.1037/tps0000332 · Cited by 16
The magnitude of the testing effect is independent of retrieval practice performance.
Chan, J. C. K., Davis, S. D., Yurtsever, A., & Myers, S. J. (2024) · Journal of Experimental Psychology General · doi:10.1037/xge0001593 · Cited by 15
Shanks, D. R., Don, H. J., Boustani, S., & Yang, C. (2023) · Oxford University Press eBooks · doi:10.1093/acrefore/9780190236557.013.908 · Cited by 14
Self-citationZhao, W., Xu, M., Xu, C., Li, B., Hu, X., Yang, C., & Luo, L. (2023) · Journal of Intelligence · doi:10.3390/jintelligence11100190 · Cited by 14
Self-citationIs recitation an effective tool for adult learners?
McDermott, K. B., & Naaz, F. (2014) · Journal of Applied Research in Memory and Cognition · doi:10.1016/j.jarmac.2014.06.006 · Cited by 13
Delayed Metacomprehension Judgments Do Not Directly Improve Learning from Texts
Hausman, H., & Kubik, V. (2023) · Journal of Intelligence · doi:10.3390/jintelligence11070150 · Cited by 10
Learning Methods and Problems of Qur’an Reciters (Malays and Africans)
Yusof, R. J. R., Zainuddin, R., & Yusoff, Z. M. (2011) · Cited by 7
(2010) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037/a0019902.supp · Cited by 6
Supplemental Material for P-Curve: A Key to the File-Drawer
(2013) · Journal of Experimental Psychology General · doi:10.1037/a0033242.supp · Cited by 5
The forward testing effect in spatial route learning
Xiaofeng, M. A., Tiantian, L. I., Ruihong, J. I. A., & Jie, W. E. I. (2022) · Acta Psychologica Sinica · doi:10.3724/sp.j.1041.2022.01433 · Cited by 5
Covert retrieval yields a forward testing effect across levels of successive list similarity
Carvalho, M. B., Cooper, A., & Marmurek, H. H. C. (2023) · Metacognition and Learning · doi:10.1007/s11409-023-09348-9 · Cited by 5
Does Overt memory testing lead to better learning than Covert memory testing?
Soltani, T. (2011) · PsycEXTRA Dataset · doi:10.1037/e530152013-001 · Cited by 1
Overt and Covert Retrieval Effects on Memory for Repeated and Novel Word-Pairs
Carvalho, M. B. (2019) · The Atrium (University of Guelph) · Cited by 1
Research works printed but not linked: 3
- *Bullshtein, Y. (2015). Comparing the effects of covert and overt initial retrieval on memory over time. (Master’s thesis). University of Haifa. Retrieved from https://www.proquest.com/dissertations-theses/comparing-effects-covert-overt-initial-retrieval/docview/2587650121/se-2
- Gates, A. I. (1917). Recitation as a factor in memorizing. Archives of Psychology, 6(40), 104.
- Yang, C., Shanks, D. R., Zhao, W., Fan, T., & Luo, L. (2023b). Frequent quizzing accelerates classroom learning. In C. E. Overson, M. C. Hakala, L. L. Kordonowy, & V. A. Benassi (Eds.), In their own words: What scholars and teachers want you to know about why and how to apply the science of learning in your academic setting (pp. 190–199). Society for the Teaching of Psychology.
Cited by
The Forward Effect of Judgements of Learning on Memory and Transfer in Inductive Learning
Ritter, C., Hausman, H., Gaschler, R., Tiffin‐Richards, S. P., & Kubik, V. (2025) · Educational Psychology Review · doi:10.1007/s10648-025-10094-4 · Cited by 2
“JOLs can trigger covert retrieval attempts (e.g., Dunlosky & Nelson, 1992), and covert retrieval has been shown to produce a backward testing effect com - pared to restudy, although slightly smaller in magnitude than overt retrieval (for a meta-analysis, see Yu et al., 2025).”
InfluentialThe Effect of Prequestions on Learning: A Multilevel Meta-Analysis
King-Shepard, Q. W., Walker, J., Nokes-Malach, T. J., Carpenter, S. K., & Fraundorf, S. H. (2025) · Educational Psychology Review · doi:10.1007/s10648-025-10075-7 · Cited by 2
Metadata
- Authors
- Yu, Y., Zhao, W., Li, A., Shanks, D. R., Hu, X., Luo, L., & Yang, C.
- Affiliations
- Beijing Normal University (CN)
- University College London (GB)
- Corresponding author
- Yang, Chunliang
- Venue
- Educational Psychology Review
- Published
- 2025-05-24
- Volume
- 37
- Issue
- 2
- ISSN
- 1040-726X (ISSN-L)
- 1573-336X
- OpenAlex
- W4410701070
- Cited by
- 2
- References
- 107
- Citations by year
- 2025: 2
- FWCI
- 1.14
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springernature.com/gp/researchers/text-and-data-mining (tdm)
- www.springernature.com/gp/researchers/text-and-data-mining (vor)
- Locations
- Educational Psychology Review (publishedVersion)
- UCL Discovery (University College London) (submittedVersion)
- OSF Preprints (OSF Preprints) (submittedVersion)
- Funders
- National Natural Science Foundation of China (32371116, 32171045, 32200841)
- Fundamental Research Funds for the Central Universities (1233200008, 2243300005)
- Beijing Social Science Foundation (24DTR067)
- United Kingdom Economic and Social Research Council (ES/S014616/1)
- Tang Scholar Foundation (Tang Scholar Foundation)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Memory Processes and Influences
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Visual and Cognitive Learning Processes
- Social Sciences › Psychology › Developmental and Educational Psychology › Innovative Teaching and Learning Methods
- Keywords
- retrieval practice, long-term memory consolidation, desirable difficulties, corrective feedback, control strategy, retention interval, learning strategies
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.