Unsuccessful retrieval attempts enhance subsequent learning.
The DOI matches its Crossref record; 51 of the 51 references it cites were found in a registry or an index.
Abstract
Taking tests enhances learning. But what happens when one cannot answer a test question-does an unsuccessful retrieval attempt impede future learning or enhance it? The authors examined this question using materials that ensured that retrieval attempts would be unsuccessful. In Experiments 1 and 2, participants were asked fictional general-knowledge questions (e.g., "What peace treaty ended the Calumet War?"). In Experiments 3-6, participants were shown a cue word (e.g., whale) and were asked to guess a weak associate (e.g., mammal); the rare trials on which participants guessed the correct response were excluded from the analyses. In the test condition, participants attempted to answer the question before being shown the answer; in the read-only condition, the question and answer were presented together. Unsuccessful retrieval attempts enhanced learning with both types of materials. These results demonstrate that retrieval attempts enhance future learning; they also suggest that taking challenging tests-instead of avoiding errors-may be one key to effective learning.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“a substantial body of research demonstrates that pretesting enhances subsequent learning by activating prior knowledge, revealing knowledge gaps, and sharpening attention to critical information encountered later [2, 9, 11-13].”
From Do Gains from Generative AI-Enabled Adaptive Pretesting Persist? Evidence from a Retention Study (2026) · cites this paper as [9]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Kornell et al. found no advantage of generating over reading when total trial time was equated.”
From The benefit of generating errors during learning (2014) · cites this paper as Kornell et al., 2009
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Kornell et al. found that the test condition led to better final test performance than the read-only condition.”
From The benefit of generating errors during learning (2014) · cites this paper as Kornell et al., 2009
The cited source says what the claim attributes to it.
In the citing paper
“On the other hand, there is also evidence that generating responses can be beneficial even when many errors are produced, as long as corrective feedback is given (e.g., Kornell, Hays & Bjork, 2009).”
From The benefit of generating errors during learning (2014) · cites this paper as Kornell, Hays & Bjork, 2009
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
James, W. (1913) · Henry Holt and Company eBooks · doi:10.1037/11059-000 · Cited by 25,226
Levels of processing: A framework for memory research
Craik, F. I. M., & Lockhart, R. S. (1972) · Journal of Verbal Learning and Verbal Behavior · doi:10.1016/s0022-5371(72)80001-x · Cited by 9,566 · cited 2×
“Various findings across the history of memory research demonstrate that the primary determinant of long-term learning is not processing effort per se but, instead, the type or level of processing (e.g., Craik & Lockhart, 1972; Craik & Tulving, 1975).”
BackgroundDepth of Processing and the Retention of Words in Episodic Memory
Craik, F. I. M., & Tulving, E. (1975) · Journal of Experimental Psychology: General · doi:10.1037/0096-3445.104.3.268 · Cited by 4,121 · cited 2×
“Various findings across the history of memory research demonstrate that the primary determinant of long-term learning is not processing effort per se but, instead, the type or level of processing (e.g., Craik & Lockhart, 1972; Craik & Tulving, 1975).”
BackgroundTest-Enhanced Learning: Taking Memory Tests Improves Long-Term Retention
Roediger, H. L., & Karpicke, J. D. (2006) · Psychological Science · doi:10.1111/j.1467-9280.2006.01693.x · Cited by 2,867
Information Processing and Cognition: The Loyola Symposium
Brown, A. S., & Solso, R. L. (1976) · The American Journal of Psychology · doi:10.2307/1421430 · Cited by 2,382 · cited 2×
“A second conjecture is that retrieval strengthens retrieval routes from the question to the correct answer (e.g., Bjork, 1975, 1988; McDaniel & Masson, 1985).”
BackgroundResultThe power of testing memory: Basic research and implications for educational practice
Roediger, H. L., & Karpicke, J. D. (2006) · Perspectives on Psychological Science · doi:10.1111/j.1745-6916.2006.00012.x · Cited by 2,037
The University of South Florida free association, rhyme, and word fragment norms
Nelson, D. L., McEvoy, C. L., & Schreiber, T. A. (2004) · Behavior Research Methods, Instruments, & Computers · doi:10.3758/bf03195588 · Cited by 1,929
Distributed practice in verbal recall tasks: A review and quantitative synthesis.
Cepeda, N. J., Pashler, H., Vul, E., Wixted, J. T., & Rohrer, D. (2006) · Psychological Bulletin · doi:10.1037/0033-2909.132.3.354 · Cited by 1,888 · cited 1×
“This effect derives from the benefits of spacing—that is, the benefit of spacing repeated learning events apart instead of massing them together (e.g., Cepeda, Pashler, Vul, Wixted, & Rohrer, 2006; Dempster, 1996; Glenberg, 1979)—but also reflects an apparent lack of harm caused by errors.”
BackgroundZechmeister, E., Gruneberg, M. M., Morris, P. E., & Sykes, R. N. (1980) · The American Journal of Psychology · doi:10.2307/1422245 · Cited by 1,520
McClelland, J. L., & Rumelhart, D. E. (1986) · The MIT Press eBooks · Cited by 1,291
Cited by
Self-Regulated Learning: Beliefs, Techniques, and Illusions
Bjork, R. A., Dunlosky, J., & Kornell, N. (2013) · Annual Review of Psychology · doi:10.1146/annurev-psych-113011-143823 · Cited by 1,468
“(For starters, see Grimaldi & Karpicke 2012, Kornell et al. 2009.)”
BackgroundSelf-citation(2011) · Cited by 725
Self-citationLearning Versus Performance: An Integrative Review
Soderstrom, N. C., & Bjork, R. A. (2015) · Perspectives on Psychological Science · doi:10.1177/1745691615569000 · Cited by 651
“…& Fevreiski, 1983) and is now garnering considerable empirical attention once again (Grimaldi & Karpicke, 2012; Hays, Kornell, & Bjork, 2013; Huelser & Metcalfe, 2012; Knight, Ball, Brewer, DeWitt, & Marsh, 2012; Kornell, Hays, & Bjork, 2009; Potts & Shanks, 2014; Yan, Yu, Garcia, & Bjork, 2014).”
BackgroundSelf-citationMetcalfe, J. (2017) · Annual Review of Psychology · doi:10.1146/annurev-psych-010416-044022 · Cited by 483
“Kornell et al. (2009) also eliminated from consideration any instances in which the person did not generate an error in the error-generation condition.”
BackgroundInfluentialRethinking the Use of Tests: A Meta-Analysis of Practice Testing
Adesope, O. O., Trevisan, D. A., & Sundararajan, N. (2017) · Review of Educational Research · doi:10.3102/0034654316689306 · Cited by 544
Repeated testing produces superior transfer of learning relative to repeated studying.
Butler, A. C. (2010) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/a0019902 · Cited by 492
McDaniel, M. A., Agarwal, P. K., Huelser, B. J., McDermott, K. B., & Roediger, H. L. (2011) · Journal of Educational Psychology · doi:10.1037/a0021782 · Cited by 360
“Another possible contributor to the effects could be learning from feedback, which can be potent (e.g., Butler & Roediger, 2008; McDaniel & Fisher, 1991; Pashler et al., 2005), especially when a correct answer is provided for a failed answer (Izawa, 1970; Kornell et al., 2009).”
BackgroundRetrieval-Based Learning: Active Retrieval Promotes Meaningful Learning
Karpicke, J. D. (2012) · Current Directions in Psychological Science · doi:10.1177/0963721412443552 · Cited by 277
Metacognitive control and strategy selection: Deciding to practice retrieval during learning.
Karpicke, J. D. (2009) · Journal of Experimental Psychology: General · doi:10.1037/a0017341 · Cited by 310
The pretesting effect: do unsuccessful retrieval attempts enhance learning?
Richland, L. E., Kornell, N., & Kao, L. S. (2009) · Journal of Experimental Psychology: Applied · doi:10.1037/a0016496 · Cited by 302
Self-citationSituational interest and learning: Thirst for knowledge
Rotgans, J. I., & Schmidt, H. G. (2014) · Learning and Instruction · doi:10.1016/j.learninstruc.2014.01.002 · Cited by 262
Why tests appear to prevent forgetting: A distribution-based bifurcation model
Kornell, N., Bjork, R. A., & Garcia, M. A. (2011) · Journal of Memory and Language · doi:10.1016/j.jml.2011.04.002 · Cited by 277
“Previous research (Kornell et al., 2009) and Experiments 1 and 2”
BackgroundMethodSelf-citationRetrieval-Based Learning: An Episodic Context Account
Karpicke, J. D., Lehman, M. S., & Aue, W. R. (2012) · Current Directions in Psychological Science · Cited by 314
Carpenter, S. K. (2011) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/a0024140 · Cited by 258
Retrieval-Based Learning: A Perspective for Enhancing Meaningful Learning
Karpicke, J. D., & Grimaldi, P. J. (2012) · Educational Psychology Review · doi:10.1007/s10648-012-9202-2 · Cited by 219
“In particular, one idea is that the act of attempting retrieval improves or " potentiates " encoding during a future study episode (see Izawa 1970; Karpicke 2009; Karpicke and Roediger 2007; Kornell et al. 2009).”
Test-potentiated learning: Distinguishing between direct and indirect effects of tests.
Arnold, K. M., & McDermott, K. B. (2013) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/a0029199 · Cited by 215
“Recently, Kornell, Hays, and Bjork (2009) introduced another paradigm that has been used to examine the effect of a retrieval attempt on a subsequent study trial (see also Slamecka & J Exp Psychol Learn Mem Cogn.”
Errorless learning in cognitive rehabilitation: A critical review
Middleton, E. L., & Schwartz, M. F. (2012) · Neuropsychological Rehabilitation · doi:10.1080/09602011.2011.639619 · Cited by 207
“To illustrate, one method used by Kornell et al. (2009) to ensure retrieval practice failure during learning involved fictional questions with no real-world answer (e.g., “Who shot a fig out of a tree with a crossbow in the 11th century?”).”
BackgroundMethodHalamish, V., & Bjork, R. A. (2011) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/a0023219 · Cited by 189
Self-citationCan spatial training improve long-term outcomes for gifted STEM undergraduates?
Miller, D. I., & Halpern, D. F. (2013) · Learning and Individual Differences · doi:10.1016/j.lindif.2012.03.012 · Cited by 185
When and why do retrieval attempts enhance subsequent encoding?
Grimaldi, P. J., & Karpicke, J. D. (2012) · Memory & Cognition · doi:10.3758/s13421-011-0174-0 · Cited by 200
“Experiment 1 used the procedure developed by Kornell et al. (2009, Exps.”
InfluentialRetrieval-Based Learning: Active Retrieval Promotes Meaningful Learning
Karpicke, J. D. (2012) · Current Directions in Psychological Science · Cited by 232
Retrieval during learning facilitates subsequent memory encoding.
Pastötter, B., Schicker, S., Niedernhuber, J., & Bäuml, K.-H. T. (2011) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/a0021801 · Cited by 177
Learners’ choices and beliefs about self-testing
Kornell, N., & Son, L. K. (2009) · Memory · doi:10.1080/09658210902832915 · Cited by 190
“Moreover, early in the study phase unknown items were predominant, and for such items presentations and tests may be similarly valuable—although retrieval attempts seem to enhance learning, relative to presentations, even for unknown items (see Kornell, Hays, & Bjork, in press ; Richland, Kornell, & Kao, 2009 )—becaus…”
BackgroundSelf-citationThe digital expansion of the mind: Implications of internet usage for memory and cognition.
Marsh, E. J., & Rajaram, S. (2019) · Journal of Applied Research in Memory and Cognition · doi:10.1016/j.jarmac.2018.11.001 · Cited by 186
Karpicke, J. D., Lehman, M., & Aue, W. R. (2014) · Psychology of Learning and Motivation · doi:10.1016/b978-0-12-800283-4.00007-1 · Cited by 185
Desirable Difficulties in Vocabulary Learning
BJorK, R. A., & Kroll, J. F. (2015) · The American Journal of Psychology · doi:10.5406/amerjpsyc.128.2.0241 · Cited by 160
“An experimental paradigm introduced by Kornell et al. (2009) has triggered much of this interest.”
BackgroundSelf-citationHabits and beliefs that guide self-regulated learning: Do they vary with mindset?
Yan, V. X., Thai, K.-P., & Bjork, R. A. (2014) · Journal of Applied Research in Memory and Cognition · doi:10.1016/j.jarmac.2014.04.003 · Cited by 160
Self-citationQuizzing in Middle‐School Science: Successful Transfer Performance on Classroom Exams
McDaniel, M. A., Thomas, R. C., Agarwal, P. K., McDermott, K. B., & Roediger, H. L. (2013) · Applied Cognitive Psychology · doi:10.1002/acp.2914 · Cited by 171
Making related errors facilitates learning, but learners do not know it
Huelser, B. J., & Metcalfe, J. (2012) · Memory & Cognition · doi:10.3758/s13421-011-0167-z · Cited by 171
“1 Because we did not know whether our experiment would replicate the findings of Kornell et al. (2009), we assigned the related materials condition to the first 18 participants, a condition that is most similar to their experiment.”
BackgroundMethodResultInfluentialThe benefit of generating errors during learning
Potts, R., & Shanks, D. R. (2014) · Journal of Experimental Psychology: General · doi:10.1037/a0033194 · Cited by 166
“In order to overcome this item-selection problem, Kornell et al. (2009) eliminated the usual study phase in which to-be-learned associations are studied, starting instead with the initial test, and they selected materials (weakly-associated word pairs, e.g., pond -frog) for which the cues would…”
BackgroundMethodResultInfluentialvan Gog, T., & Sweller, J. (2015) · Educational Psychology Review · doi:10.1007/s10648-015-9310-x · Cited by 164
“This result is in line with other studies showing that success of the retrieval attempt is not important, as long as correct answer feedback (e.g., Kornell et al. 2009) or a subsequent study opportunity (e.g., Richland et al. 2009) is provided.”
ResultThe Emotional and Cognitive Impact of Unexpected Simulated Patient Death
Fraser, K. L., Huffman, J., Ma, I. W. Y., Sobczak, M., McIlwrick, J., Wright, B. J., & McLaughlin, K. (2013) · CHEST Journal · doi:10.1378/chest.13-0987 · Cited by 168
Benefits from retrieval practice are greater for students with lower working memory capacity
Agarwal, P. K., Finley, J. R., Rose, N. S., & Roediger, H. L., III (2016) · Memory · doi:10.1080/09658211.2016.1220579 · Cited by 152
“Alternatively, this discrepancy may be due to test-enhanced processing of feedback (e.g., Arnold & McDermott, 2013a, 2013b; Izawa, 1970; Kornell, Hays, & Bjork, 2009).”
Improving self-regulated learning with a retrieval practice intervention.
Ariel, R., & Karpicke, J. D. (2017) · Journal of Experimental Psychology Applied · doi:10.1037/xap0000133 · Cited by 161
How to learn effectively in medical school: test yourself, learn actively, and repeat in intervals.
Augustin, M. (2014) · Europe PMC (PubMed Central) · Cited by 145
Retrieval potentiates new learning: A theoretical and meta-analytic review.
Chan, J. C. K., Meissner, C. A., & Davis, S. D. (2018) · Psychological Bulletin · doi:10.1037/bul0000166 · Cited by 143
The MAPS model of self-regulation: Integrating metacognition, agency, and possible selves
Frazier, L. D., Schwartz, B. L., & Metcalfe, J. (2021) · Metacognition and Learning · doi:10.1007/s11409-020-09255-3 · Cited by 156
Best practices in active and student-centered learning in physiology classes
Goodman, B. E., Barker, M., & Cooke, J. E. (2018) · AJP Advances in Physiology Education · doi:10.1152/advan.00064.2018 · Cited by 140
“A study by Kornell and colleagues (27) found that”
BackgroundWhen generating a prediction boosts learning: The element of surprise
Brod, G., Hasselhorn, M., & Bunge, S. A. (2018) · Learning and Instruction · doi:10.1016/j.learninstruc.2018.01.013 · Cited by 131
Towards a Theory of Learning for Naming Rehabilitation: Retrieval Practice and Spacing Effects
Middleton, E. L., Schwartz, M. F., Rawson, K. A., Traut, H., & Verkuilen, J. (2016) · Journal of Speech, Language, and Hearing Research · doi:10.1044/2016_jslhr-l-15-0303 · Cited by 125
The effect of distributed practice: Neuroscience, cognition, and education
Gerbier, É., & Toppino, T. C. (2015) · Trends in Neuroscience and Education · doi:10.1016/j.tine.2015.01.001 · Cited by 128
Enhancing learning and retrieval of new information: a review of the forward testing effect
Yang, C., Potts, R., & Shanks, D. R. (2018) · npj Science of Learning · doi:10.1038/s41539-018-0024-y · Cited by 119
Rivers, M. L. (2021) · Educational Psychology Review · doi:10.1007/s10648-020-09578-2 · Cited by 81
Long-term effects of testing on the recall of nontested materials
Chan, J. C. K. (2009) · Memory · doi:10.1080/09658210903405737 · Cited by 126
“First, RIFA and the testing effect may share the same underlying mechanism*an active and conscious retrieval process that enhances retention of the retrieved memories, regardless of whether such memories were retrieved because they were directly tested or were retrieved in a collateral fashion (as in RIFA; cf. Kornell…”
BackgroundWhen and why a failed test potentiates the effectiveness of subsequent study.
Hays, M. J., Kornell, N., & Bjork, R. A. (2013) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/a0028468 · Cited by 113
“This finding is consistent with prior work in which adding a failed test before a presentation enhanced learning (Kornell et al., 2009; Richland et al., 2009).”
BackgroundMethodResultInfluentialSelf-citationRawson, K. A., & Dunlosky, J. (2012) · Educational Psychology Review · doi:10.1007/s10648-012-9203-1
Using electronic flashcards to promote learning in medical students: retesting versus restudying
Schmidmaier, R., Ebersbach, R., Schiller, M., Hege, I., Holzer, M., & Fischer, M. R. (2011) · Medical Education · doi:10.1111/j.1365-2923.2011.04043.x · Cited by 122
The role of interest in memory for trivia questions: An investigation with a large-scale database.
Fastrich, G. M., Kerr, T., Castel, A. D., & Murayama, K. (2017) · Motivation Science · doi:10.1037/mot0000087 · Cited by 105
“For example, Kornell, Hays, and Bjork (2009) presented general knowledge questions and their corresponding answers to participants and examined their memory for the answers in a later memory test.”
BackgroundHow Retrieval Attempts Affect Learning
Kornell, N., & Vaughn, K. E. (2016) · The Psychology of learning and motivation/The psychology of learning and motivation · doi:10.1016/bs.plm.2016.03.003 · Cited by 126
“Kornell et al. (2015) developed a paradigm that met these criteria.”
BackgroundMethodResultInfluentialSelf-citationScaffolding feedback to maximize long-term error correction
Finn, B., & Metcalfe, J. (2010) · Memory & Cognition · doi:10.3758/mc.38.7.951 · Cited by 122
“Several recent studies indicate that as long as the participant ultimately receives feedback of the correct answer, unsuccessful attempts at retrieving may not harm memory ( Kornell et al., 2009; Richland, Kornell, & Kao, 2009).”
BackgroundEpistemic curiosity and the region of proximal learning
Metcalfe, J., Schwartz, B. L., & Eich, T. S. (2020) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2020.06.007 · Cited by 114
Retrieval attempts enhance learning, but retrieval success (versus failure) does not matter.
Kornell, N., Klein, P. J., & Rawson, K. A. (2014) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037/a0037850 · Cited by 108
Self-citationA Classroom Study on the Relationship Between Student Achievement and Retrieval-Enhanced Learning
Carpenter, S. K., Lund, T. J. S., Coffman, C. R., Armstrong, P. I., Lamm, M. H., & Reason, R. D. (2015) · Educational Psychology Review · doi:10.1007/s10648-015-9311-9 · Cited by 113
“Some laboratory studies have shown, for example, that students learn better from failed retrieval attempts than from merely reading, as long as the correct answer is provided after the retrieval attempt (e.g., Kornell et al. 2009; Pashler et al. 2005).”
BackgroundPan, S. C., & Sana, F. (2021) · Journal of Experimental Psychology Applied · doi:10.1037/xap0000345 · Cited by 113
“In the pretesting literature, learning is commonly assessed after a retention interval of just a few minutes, but the pretesting effect also manifests at intervals ranging from 24 hr (e.g., Kornell et al., 2009) to one week (e.g., Richland et al., 2009; see also Pan, Lovelett, et al., 2019).”
BackgroundInfluentialProduction benefits learning: The production effect endures and improves memory for text
Ozubko, J. D., Hourihan, K. L., & MacLeod, C. M. (2012) · Memory · doi:10.1080/09658211.2012.699070 · Cited by 72
Testing facilitates the regulation of subsequent study time
Soderstrom, N. C., & Bjork, R. A. (2014) · Journal of Memory and Language · doi:10.1016/j.jml.2014.03.003 · Cited by 102
Self-citationA randomized controlled trial of interleaved mathematics practice
Rohrer, D., Dedrick, R. F., Hartwig, M. K., & Cheung, C.-N. (2020) · Journal of Educational Psychology · doi:10.1037/edu0000367 · Cited by 90
“…this possibility is only speculative, and, more-over, several studies with nonmathematics tasks have found that students’ errors can enhance their learning when errors are followed by corrective feedback (e.g., Huelser & Metcalfe, 2012; Kornell, Hays, & Bjork, 2009; Richland, Kornell, & Kao, 2009).”
Students Can (Mostly) Recognize Effective Learning, So Why Do They Not Do It?
Rea, S. D., Wang, L., Muenks, K. M., & Yan, V. X. (2022) · Journal of Intelligence · doi:10.3390/jintelligence10040127 · Cited by 103
Effectiveness of clickers: Effect of feedback and the timing of questions on learning
Lantz, M. E., & Stawiski, A. (2013) · Computers in Human Behavior · doi:10.1016/j.chb.2013.10.009 · Cited by 107
Kornell, N. (2014) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/a0033699 · Cited by 88
Self-citationPeople's hypercorrection of high-confidence errors: Did they know it all along?
Metcalfe, J., & Finn, B. (2011) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037/a0021962 · Cited by 93
Immersive Anatomy Atlas: Learning Factual Medical Knowledge in a Virtual Reality Environment
Gloy, K., Weyhe, P., Nerenz, E., Kaluschke, M., Uslar, V., Zachmann, G., & Weyhe, D. (2021) · Anatomical Sciences Education · doi:10.1002/ase.2095 · Cited by 87
“One type of learning that is consistently connected with improved learning and memory results is active learning (Hazlett, 2009; Kornell et al., 2009; Markant et al., 2016).”
BackgroundRetrieval-Based Learning: Positive Effects of Retrieval Practice in Elementary School Children
Karpicke, J. D., Blunt, J. R., & Smith, M. A. (2016) · Frontiers in Psychology · doi:10.3389/fpsyg.2016.00350 · Cited by 82
Metamemory monitoring and control following retrieval practice for text
Little, J. L., & McDaniel, M. A. (2014) · Memory & Cognition · doi:10.3758/s13421-014-0453-7 · Cited by 82
Knight, J. B., Ball, B. H., Brewer, G. A., Dewitt, M. R., & Marsh, R. L. (2012) · Journal of Memory and Language · doi:10.1016/j.jml.2011.12.008 · Cited by 82
“All the experiments examining the influence of unsuccessful tests both here and in previous research (Kornell et al., 2009) have had participants try to generate or guess the target member on test trials without them having had previous episodic experience with the given cue–target pairs.”
BackgroundMethodResultInfluentialThe Error in Trial and Error: Exercises on Phrasal Verbs
Strong, B., & Boers, F. (2018) · TESOL Quarterly · doi:10.1002/tesq.478 · Cited by 80
Leight, H., Saunders, C., Calkins, R., & Withers, M. (2012) · CBE—Life Sciences Education · doi:10.1187/cbe.12-04-0048 · Cited by 77
“First, researchers have recently found that initially getting a question wrong helps students better recall information later (Kornell et al., 2009).”
BackgroundE-Learning in Theory, Practice, and Research
Janelli, M. (2018) · Voprosy Obrazovaniya/ Educational Studies Moscow · doi:10.17323/1814-9545-2018-4-81-98 · Cited by 77
Tests enhance retention and transfer of spatial learning
Carpenter, S. K., & Kelly, J. W. (2012) · Psychonomic Bulletin & Review · doi:10.3758/s13423-012-0221-2 · Cited by 84
Multiple-choice pretesting potentiates learning of related information
Little, J. L., & Bjork, E. L. (2016) · Memory & Cognition · doi:10.3758/s13421-016-0621-z · Cited by 75
Multiple-choice testing as a desirable difficulty in the classroom.
Bjork, E. L., Little, J. L., & Storm, B. C. (2014) · Journal of Applied Research in Memory and Cognition · doi:10.1016/j.jarmac.2014.03.002 · Cited by 75
Pretesting reduces mind wandering and enhances learning during online lectures.
Pan, S. C., Schmitt, A. G., Bjork, E. L., & Sana, F. (2020) · Journal of Applied Research in Memory and Cognition · doi:10.1016/j.jarmac.2020.07.004 · Cited by 79
Mera, Y., Rodríguez, G., & Marin-Garcia, E. (2021) · Psychonomic Bulletin & Review · doi:10.3758/s13423-021-02022-8 · Cited by 86
“The most common procedure is cued-recall, in which a cue is presented and participants are asked to remember the associated target (e.g., Huelser & Metcalfe, 2012; Kornell et al., 2009).”
BackgroundMethodInfluentialFlipped Statistics Class Results: Better Performance Than Lecture Over One Year Later
Winquist, J. R., & Carlson, K. A. (2014) · Journal of Statistics Education · doi:10.1080/10691898.2014.11889717 · Cited by 74
“Additionally, because research suggests that testing is more effective when the correct answer is provided to students after they generate answers (Kornell, Hays, and Bjork 2009), we provided answer keys for all in-class questions so students could check their own work immediately after completing…”
BackgroundWeighing Up Exercises on Phrasal Verbs: Retrieval Versus Trial‐and‐Error Practices
Strong, B., & Boers, F. (2019) · Modern Language Journal · doi:10.1111/modl.12579 · Cited by 74
van den Broek, G. S. E., Takashima, A., Segers, E., & Verhoeven, L. (2018) · Language Learning · doi:10.1111/lang.12285 · Cited by 67
Does incorrect guessing impair fact learning?
Kang, S. H. K., Pashler, H., Cepeda, N. J., Rohrer, D., Carpenter, S. K., & Mozer, M. C. (2011) · Journal of Educational Psychology · doi:10.1037/a0021977 · Cited by 67
“More recently, similar positive effects of prequestioning were also reported by Kornell, Hays, and Bjork (2009) and by Richland, Kornell, and Kao (2009).”
BackgroundStenlund, T., Jönsson, F. U., & Jonsson, B. (2016) · Educational Psychology · doi:10.1080/01443410.2016.1143087 · Cited by 75
Lipnevich, A. A., Panadero, E., Gjicali, K., & Fraile, J. (2021) · Educational Assessment Evaluation and Accountability · doi:10.1007/s11092-021-09357-9 · Cited by 78
Computer-based learning of neuroanatomy: A longitudinal study of learning, transfer, and retention.
Chariker, J. H., Naaz, F., & Pani, J. R. (2011) · Journal of Educational Psychology · doi:10.1037/a0021680 · Cited by 66
Improving Learning Efficiency of Factual Knowledge in Medical Education
Yeh, D. D., & Park, Y. S. (2015) · Journal of surgical education · doi:10.1016/j.jsurg.2015.03.012 · Cited by 70
Learning from errors: Students' and instructors' practices, attitudes, and beliefs
Pan, S. C., Sana, F., Samani, J., Cooke, J., & Kim, J. A. (2020) · Memory · doi:10.1080/09658211.2020.1815790 · Cited by 65
“In contrast, recent laboratory and classroom research shows that errorful learning—that is, generating errors and subsequently receiving correct answer feedback—can lead to better memory for correct information than errorless learning (e.g., Bjork et al., 2015; Kornell et al., 2009).”
BackgroundResultInfluentialMnemonic benefits of retrieval practice at short retention intervals
Rowland, C. A., & DeLosh, E. L. (2015) · Memory · doi:10.1080/09658211.2014.889710 · Cited by 64
“Under some circumstances, unsuccessful retrieval can enhance the learning of new material (see Kornell et al., 2009; Richland, Kornell, & Kao, 2009).”
BackgroundModels as feedback: Developing representational competence in chemistry.
Padalkar, S., & Hegarty, M. (2014) · Journal of Educational Psychology · doi:10.1037/a0037516 · Cited by 69
“…have been tested primarily in the context of verbal learning and fact learning (R. A. Bjork, 1999; Dunning et al., 2003; Hirshman & Bjork, 1988; Kornell et al., 2009; Slamecka & Graf, 1978), so one contribution of this research is that it extends research on these basic principles to a complex…”
BackgroundDoes testing with feedback help grade-school children learn key concepts in science?
Lipko, A. R., Dunlosky, J. T., & Rawson, K. A. (2014) · Journal of Applied Research in Memory and Cognition · doi:10.1016/j.jarmac.2014.04.002 · Cited by 73
Distractors in Parsons Problems Decrease Learning Efficiency for Young Novice Programmers
Harms, K. J., Chen, J., & Kelleher, C. L. (2016) · ACM Conference on International Computing Education Research (ICER) · doi:10.1145/2960310.2960314 · Cited by 74
“The act of trying to retrieve information during testing, even if unsuccessful, was found to enhance future learning [29, 49].”
BackgroundWhen is guessing incorrectly better than studying for enhancing memory?
Vaughn, K. E., & Rawson, K. A. (2012) · Psychonomic Bulletin & Review · doi:10.3758/s13423-012-0276-0 · Cited by 62
Schuchard, J., & Middleton, E. L. (2018) · Cognitive Neuropsychology · doi:10.1080/02643294.2018.1461615 · Cited by 66
Pan, S. C., & Carpenter, S. K. (2023) · Educational Psychology Review · doi:10.1007/s10648-023-09814-5 · Cited by 60
“It can be traced to Kornell et al. (2009) and Rich-land et al. (2009), which investigated prequestioning and pretesting for the cases of trivia facts/paired associate words and science texts, respectively, and reported robust learning benefits.”
BackgroundMethodInfluentialLighting the wick in the candle of learning: generating a prediction stimulates curiosity
Brod, G., & Breitwieser, J. (2019) · npj Science of Learning · doi:10.1038/s41539-019-0056-y · Cited by 60
Janelli, M., & Lipnevich, A. A. (2021) · Computers & Education · doi:10.1016/j.compedu.2020.104076 · Cited by 60
Retrieval Dynamics and Retention in Cross‐Situational Statistical Word Learning
Vlach, H. A., & Sandhofer, C. M. (2013) · Cognitive Science · doi:10.1111/cogs.12092 · Cited by 64
“This finding is consistent with studies of long-term memory and retention—struggling to retrieve information during learning often leads to stronger retention and performance (e.g., Kornell et al., 2009; Pyc & Rawson, 2009; Richland et al., 2009; Vlach et al., 2012).”
BackgroundResultFree recall enhances subsequent learning
Arnold, K. M., & McDermott, K. B. (2013) · Psychonomic Bulletin & Review · doi:10.3758/s13423-012-0370-3 · Cited by 67
The negative testing effect and multifactor account.
Peterson, D. J., & Mulligan, N. W. (2013) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037/a0031337 · Cited by 59
Edmunds, C. E. R., Milton, F., & Wills, A. J. (2014) · Quarterly Journal of Experimental Psychology · doi:10.1080/17470218.2014.978875 · Cited by 58
Retrieval-Based Learning in Children
Fazio, L. K., & Marsh, E. J. (2019) · Current Directions in Psychological Science · doi:10.1177/0963721418806673 · Cited by 57
Optimizing the Efficacy of Learning Objectives through Pretests
Sana, F., Forrin, N. D., Sharma, M., Dubljevic, T., Ho, P., Jalil, E., & Kim, J. A. (2020) · CBE—Life Sciences Education · doi:10.1187/cbe.19-11-0257 · Cited by 60
“This learning benefit has been recently shown with materials of various complexities (e.g., paired associates: Kornell et al., 2009; vocabulary: Potts and Shanks, 2014; reading passages: Richland et al., 2009; video lectures: Carpenter and Toftness, 2017).”
BackgroundThe role of mediator strength in learning from retrieval
Carpenter, S. K., & Yeung, K. L. (2016) · Journal of Memory and Language · doi:10.1016/j.jml.2016.06.008 · Cited by 64
“By this logic, mediators as conceptualized by the elaborative retrieval account and elsewhere (e.g., Cyr & Anderson, 2015; Knight et al., 2012; Kornell et al., 2009; Pyc & Rawson, 2010) could be one type of ‘‘contextual element” that is activated or reinstated during retrieval and that can promote…”
BackgroundPan, S. C., Rickard, T. C., & Bjork, R. A. (2021) · Educational Psychology Review · doi:10.1007/s10648-021-09611-y · Cited by 67
Self-citationThe double-edged sword of memory retrieval
Roediger, H. L., III, & Abel, M. (2022) · Nature Reviews Psychology · doi:10.1038/s44159-022-00115-2 · Cited by 64
“Indeed, benefits of initial retrieval attempts can even emerge when successful retrieval is made impossible by use of vague cues 115,116 .”
Background
Metadata
- Authors
- Kornell, N., Hays, M. J., & Bjork, R. A.
- Affiliations
- University of California, Los Angeles (US)
- Venue
- Journal of Experimental Psychology: Learning, Memory, and Cognition
- Published
- 2009
- Volume
- 35
- Issue
- 4
- Pages
- 989-998
- ISSN
- 0278-7393 (ISSN-L)
- 1939-1285
- OpenAlex
- W2100082680
- Cited by
- 484
- References
- 51
- Citations by year
- 2026: 26 · 2025: 37 · 2024: 30 · 2023: 37 · 2022: 22 · 2021: 38 · 2020: 37 · 2019: 41 · 2018: 29 · 2017: 23 · 2016: 19 · 2015: 21 · 2014: 36 · 2013: 22 · 2012: 31
- FWCI
- 10.65
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Journal of Experimental Psychology Learning Memory and Cognition (publishedVersion)
- PubMed (publishedVersion)
- Funders
- McDonnell Foundation (29192G)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Memory Processes and Influences
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Visual and Cognitive Learning Processes
- Life Sciences › Neuroscience › Cognitive Neuroscience › Memory and Neural Mechanisms
- Keywords
- retrieval practice, weak associations, error prevention
- MeSH terms
- Attention, Humans, Neuropsychological Tests, Reaction Time, Mental Recall, Serial Learning, Recognition, Psychology
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.