The Critical Importance of Retrieval for Learning
The DOI matches its Crossref record; 14 of the 14 references it cites were found in a registry or an index.
Abstract
Learning is often considered complete when a student can produce the correct answer to a question. In our research, students in one condition learned foreign language vocabulary words in the standard paradigm of repeated study-test trials. In three other conditions, once a student had correctly produced the vocabulary item, it was repeatedly studied but dropped from further testing, repeatedly tested but dropped from further study, or dropped from both study and test. Repeated studying after learning had no effect on delayed recall, but repeated testing produced a large positive effect. In addition, students' predictions of their performance were uncorrelated with actual performance. The results demonstrate the critical role of retrieval practice in consolidating learning and show that even university students seem unaware of this fact.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Second, repeated encounters can support retrieval processes, helping students recall words they have previously encountered during gameplay (Karpicke and Roediger, 2008; Nation, 2001; Roediger and Karpicke, 2006; Webb, 2007).”
From Incidental vocabulary learning from digital games: the predictive role of game playing time, foreign language motivation, and anxiety (2026) · cites this paper as Karpicke and Roediger, 2008
In the citing paper
“practice retrieval through answering questions significantly improves long-term retention (15,16).”
From Applying learning theories and instructional design models for effective instruction (2016) · cites this paper as [16]
In the citing paper
“practice retrieval through answering questions significantly improves long-term retention (15,16).”
From Applying learning theories and instructional design models for effective instruction (2016) · cites this paper as [15]
In the citing paper
“Whereas the reactivation of memories during wakefulness, as it occurs for example during rehearsal, can strengthen these memories in the long run (623, 1006), the reactivation transfers the representation into an transient unstable state such that memory is in need of reconsolidation (470, 718, 731, 844, 1033).”
From About Sleep's Role in Memory (2013) · cites this paper as [623]
In the citing paper
“Indeed there are data from other areas of cognitive neuroscience that demonstrate that repeating something that you have successfully learned is the best way to remember it (Chiviacowsky and Wulf, 2007; Karpicke and Roediger, 2008; Wulf and Shea, 2002).”
From Rethinking motor learning and savings in adaptation paradigms: model-free memory for successful actions combines with internal models (2011) · cites this paper as Karpicke and Roediger, 2008
6 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Test-Enhanced Learning: Taking Memory Tests Improves Long-Term Retention
Roediger, H. L., & Karpicke, J. D. (2006) · Psychological Science · doi:10.1111/j.1467-9280.2006.01693.x · Cited by 2,867
Self-citationMemory: A Contribution to Experimental Psychology
Ebbinghaus, H. (2013) · Annals of Neurosciences · doi:10.5214/ans.0972.7531.200408 · Cited by 2,827
Information Processing and Cognition: The Loyola Symposium
Brown, A. S., & Solso, R. L. (1976) · The American Journal of Psychology · doi:10.2307/1421430 · Cited by 2,382
The power of testing memory: Basic research and implications for educational practice
Roediger, H. L., & Karpicke, J. D. (2006) · Perspectives on Psychological Science · doi:10.1111/j.1745-6916.2006.00012.x · Cited by 2,037
Self-citationThe Psychology of Human Learning
Newman, E. B., McGeoch, J. A., & Irion, A. L. (1953) · The American Journal of Psychology · doi:10.2307/1418975 · Cited by 792
Repeated retrieval during learning is the key to long-term retention☆
KARPICKE, J., & ROEDIGERIII, H. (2007) · Journal of Memory and Language · doi:10.1016/j.jml.2006.09.004 · Cited by 598
Self-citationThe influence of retrieval on retention
Carrier, M., & Pashler, H. (1992) · Memory & Cognition · doi:10.3758/bf03202713 · Cited by 575
The promise and perils of self-regulated study
Kornell, N., & Bjork, R. A. (2007) · Psychonomic Bulletin & Review · doi:10.3758/bf03194055 · Cited by 527
The effects of presentation and recall of material in free-recall learning
Tulving, E. (1967) · Journal of Verbal Learning and Verbal Behavior · doi:10.1016/s0022-5371(67)80092-6 · Cited by 402
Thiede, K. W., & Dunlosky, J. (1999) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037//0278-7393.25.4.1024 · Cited by 396
Research works printed but not linked: 4
- A. I. Gates, Arch. Psychol.6, 1 (1917).
- W. F. Battig, Psychon. Sci. Monogr.1 (suppl.), 1 (1965).
- J. Dunlosky, K. Rawson, S. McDonald, in Applied Metacognition, T. Perfect, B. Schwartz, Eds. (Cambridge Univ. Press, Cambridge, 2002), pp. 68–92.
- J. D. Karpicke thesis Washington University St. Louis MO (2007).
Cited by
Items 801–900 of 1,789
Chemical Hygiene and Safety Badge for an Upper-Level Laboratory Course
Roberts, A., O’Neil, A., Barlow, R. E., Keeler, C., Nelligan, W. S., & Westmoreland, T. D. (2020) · Journal of Chemical Education · doi:10.1021/acs.jchemed.0c00118 · Cited by 11
Fendos, J. (2021) · Journal of Chemical Education · doi:10.1021/acs.jchemed.0c01235 · Cited by 14
Laverick, T., Evans, S., Freeston, M. H., & Baddeley, A. (2021) · Cortex · doi:10.1016/j.cortex.2021.03.024 · Cited by 13
Zhang, Y., Yurovsky, D., & Yu, C. (2021) · Cognitive Science · doi:10.1111/cogs.13010 · Cited by 17
“Because retrieval itself has been shown to improve learning (e.g., Karpicke & Roediger, 2008), in Experiment 3 we measured learning performance only at the end of the continuous learning session, without inserting intermediate test trials.”
BackgroundMethodEffective methods of clinical education
Liao, N. N., Scherzer, R., & Kim, E. (2021) · Annals of Allergy Asthma & Immunology · doi:10.1016/j.anai.2021.11.021 · Cited by 13
Distracted by Cues for Suppressed Memories
Hertel, P. T., & Hayes, J. A. (2015) · Psychological Science · doi:10.1177/0956797615570711 · Cited by 10
Best Practices in Medical Teaching
Stahl, S. M., & Davis, R. L. (2011) · Cambridge University Press eBooks · doi:10.1017/cbo9780511996412 · Cited by 10
Avvisati, F., & Borgonovi, F. (2020) · Educational Psychology Review · doi:10.1007/s10648-020-09520-6 · Cited by 24
Binding among select episodic elements is altered via active short-term retrieval
Bridge, D. J., & Voss, J. L. (2015) · Learning & Memory · doi:10.1101/lm.038703.115 · Cited by 9
“Furthermore, numerous studies have demonstrated superior memory of paired-associates in a long-term retrieval test versus those that were simply restudied (Landauer and Bjork 1978; Thompson et al. 1978; Carrier and Pashler 1992; Karpicke and Roediger 2008).”
BackgroundMaking Memories: Why Time Matters
Kelley, P., Evans, M. D. R., & Kelley, J. (2018) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2018.00400 · Cited by 10
Tutoring for success: empowering graduate nurses after failure on the NCLEX-RN
Lutter, S. L., Thompson, C. W., & Condon, M. C. (2017) · Journal of Nursing Education · doi:10.3928/01484834-20171120-11 · Cited by 9
Serfaty, J., & Serrano, R. (2023) · Language Learning · doi:10.1111/lang.12585 · Cited by 19
Evidence-Based Expository Intervention: A Tutorial for Speech-Language Pathologists
Ukrainetz, T. A. (2023) · American Journal of Speech-Language Pathology · doi:10.1044/2023_ajslp-23-00036 · Cited by 12
To Effectively Address Complex Healthcare Problems, Continuing Professional Development Must Evolve
Price, D. W. (2023) · Journal of Continuing Education in the Health Professions · doi:10.1097/ceh.0000000000000537 · Cited by 11
“23,24 Successive components of the longitudinal intervention should also be nimble enough to be adjusted as practice conditions change over time.”
BackgroundLovell, K. L. (2009) · Online Learning · doi:10.24059/olj.v13i1.1677 · Cited by 9
“In addition, the use of computer models or laboratory testing online offers not only a chance to assess students but a chance to offer students more practice, which is a critical part of long-term retention [11].”
BackgroundFlett, K. B., Bousvaros, A., Carpenter, J. F., Millrinen, C. E., Martin, P., & Sandora, T. J. (2017) · Journal of the Pediatric Infectious Diseases Society · doi:10.1093/jpids/pix090 · Cited by 9
“Although wider spacing intervals have been associated with improved retention, retrieval practice, in which being tested alters the learning process and significantly improves knowledge retention, remains a key component of spaced education regardless of the spacing interval [22].”
BackgroundStudents' Perceptions and Behavior Related to Second-Chance Testing
Emeka, C., Bretl, T. W., Herman, G. L., West, M., & Zilles, C. B. (2021) · IEEE Frontiers in Education Conference (FIE) · doi:10.1109/fie49875.2021.9637173 · Cited by 9
“Known as the testing effect, testing increases the likehilood of successful retrieval in the future because of the mnenomic effects of repeated recall [1], [3].”
BackgroundKapnoula, E. C., & Samuel, A. G. (2022) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037/xlm0001129 · Cited by 10
Stronger memory representation after memory reinstatement during retrieval in the human hippocampus
Kang, J., Kang, W., & Lee, S. (2022) · NeuroImage · doi:10.1016/j.neuroimage.2022.119493 · Cited by 10
Geraci, L. D., Kurpad, N., Tirso, R., Gray, K. N., & Wang, Y. (2022) · Metacognition and Learning · doi:10.1007/s11409-022-09326-7 · Cited by 19
Moscovitch, M., & Gilboa, A. (2024) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780190917982.013.43 · Cited by 17
Adapting to test structure: Letting testing teach what to learn
Garcia‐Marques, L., Nunes, L., Marques, P., Carneiro, P., & Weinstein, Y. (2014) · Memory · doi:10.1080/09658211.2014.889166 · Cited by 10
Cloning the Professor, an Alternative to Ineffective Teaching in a Large Course
Nelson, J., Robison, D. F., Bell, J. D., & Bradshaw, W. S. (2009) · CBE—Life Sciences Education · doi:10.1187/cbe.09-01-0006 · Cited by 13
Augmenting Fellow Education Through Spaced Multiple-Choice Questions
Barsoumian, A. E., & Yun, H. C. (2017) · Military Medicine · doi:10.1093/milmed/usx020 · Cited by 9
Part-set cueing impairment & facilitation in semantic memory
Kelley, M. R., & Parihar, S. A. (2018) · Memory · doi:10.1080/09658211.2018.1428993 · Cited by 9
Effect of imprecise skill level on workforce rotation in a dynamic market
Kiassat, C., & Safaei, N. (2018) · Computers & Industrial Engineering · doi:10.1016/j.cie.2018.04.019 · Cited by 10
Confidence in accuracy moderates the benefits of retrieval practice
Zhang, M., Chen, X., & Liu, X. L. (2018) · Memory · doi:10.1080/09658211.2018.1529796 · Cited by 10
“For example, the benefit of retrieval practice has been observed in associative learning (Karpicke & Roediger, 2008), comprehension (Butler, 2010), skill learning (Kromann, Jensen, & Ringsted, 2009), andmathematic inductive learning (Kang, McDaniel, & Pashler, 2011), using a wide range of materials…”
BackgroundCumulative assessment: Does it improve students’ knowledge acquisition and retention?
Cecílio‐Fernandes, D., Nagtegaal, M., Noordzij, G., & Tio, R. A. (2018) · Scientia Medica · doi:10.15448/1980-6108.2018.4.31880 · Cited by 11
“when the material is repeated over time, is proved to improve knowledge retention [2, 4-7], research has shown that medical students may forget around 50% of the learned material over time (for a review see Custer [8]).”
BackgroundMethodHow Individual Differences Affect Learning of Translation‐Ambiguous Vocabulary
Degani, T., & Goldberg, M. (2019) · Language Learning · doi:10.1111/lang.12344 · Cited by 19
“Training took place in the first two sessions, and testing took place at the end of each training session to increase learning (e.g., Karpicke & Roediger, 2008) and during Sessions 3 and 4.”
MethodWilliams, A. E., Denaro, K., Dennin, M. B., & Sato, B. K. (2021) · Journal of Applied Research in Higher Education · doi:10.1108/jarhe-10-2019-0272 · Cited by 9
Table Quizzes as an Assessment Tool in the Gross Anatomy Laboratory
Heise, N., Meyer, C. A., Garbe, B. A., Hall, H. A., & Clapp, T. R. (2020) · Journal of Medical Education and Curricular Development · doi:10.1177/2382120520941822 · Cited by 11
An Improved Design for In-Class Review
Maxwell, E. J., McDonnell, L., & Wieman, C. (2015) · The journal of college science teaching · doi:10.2505/4/jcst15_044_05_48 · Cited by 9
Assessment to Optimize Learning Strategies: A Qualitative Study of Student and Faculty Perceptions
Wlodarczyk, S., Muller-Juge, V., Hauer, K. E., Tong, M. S., Ransohoff, A., & Boscardin, C. (2021) · Teaching and Learning in Medicine · doi:10.1080/10401334.2020.1852940 · Cited by 9
“Frequent formative assessment can also motivate students to stay current within a course and results in better performance than single testing.(21) Emphasis on assessment for learning through the use of frequent low stakes assessments also allows students”
BackgroundAssessment from an Educational Development Perspective
Wright, M. C., Goldwasser, M., Jacobson, W., & Dakes, C. (2017) · To improve the academy · doi:10.1002/tia2.20051 · Cited by 9
Implementing a Virtual Flipped Classroom in a Rheumatology Fellowship Program
Wade, S. D., Freed, J. A., Kyttaris, V. C., Saunders, S., & Hausmann, J. S. (2022) · Arthritis Care & Research · doi:10.1002/acr.24791 · Cited by 10
Ewell, S. N., Cotner, S. H., Drake, A. G., Fagbodun, S., Google, A. N., Robinson, L., Soneral, P. A. G., & Ballen, C. J. (2022) · Journal of Microbiology and Biology Education · doi:10.1128/jmbe.00260-21 · Cited by 21
“In this essay, we focus on the application of appropriate study habits because students report significant struggle in this area, particularly in online environments that demand high-SRL skills (12, 13).”
BackgroundDynamic memory searches: Selective output interference for the memory of facts
Aue, W. R., Criss, A. H., & Prince, M. (2015) · Psychonomic Bulletin & Review · doi:10.3758/s13423-015-0840-5 · Cited by 14
“For example, participants tend to remember information better if they complete a free recall test than if they simply study the material again (Karpicke & Roediger, 2008; Roediger & Karpicke, 2006a).”
BackgroundDevelopment, assessment and use of an on‐line plagiarism tutorial
Kellum, K. K., Mark, A. E., & Riley-Huff, D. A. (2011) · Library Hi Tech · doi:10.1108/07378831111189741 · Cited by 14
Within-session spacing improves delayed recall in children
Zigterman, J. R., Simone, P. M., & Bell, M. C. (2014) · Memory · doi:10.1080/09658211.2014.915975 · Cited by 9
“In particular, longterm memory performance is improved if material is actively recalled rather than re-studied, a phenomenon known as the testing effect (Karpicke & Roediger, 2008).”
BackgroundLappi, O. (2012) · Science & Education · doi:10.1007/s11191-012-9459-3 · Cited by 13
The Relative Benefits of Studying and Testing on Long-Term Retention
Roediger, H. L., III, & Nestojko, J. F. (2015) · doi:10.4324/9781315885582-12 · Cited by 9
Self-citationTeaching high school students to manage time: The development of an intervention
Burrus, J. T., Jackson, T., Holtzman, S. L., & Roberts, R. D. (2016) · Improving Schools · doi:10.1177/1365480216650309 · Cited by 17
Practice makes imperfect: Working memory training can harm recognition memory performance
Matzen, L. E., Trumbo, M., Haass, M. J., Hunter, M. A., Silva, A., Stevens-Adams, S. M., Bunting, M. F., & O’Rourke, P. (2016) · Memory & Cognition · doi:10.3758/s13421-016-0629-4 · Cited by 9
“We expected that the testing effect (Karpicke & Roediger, 2008) would make the quizzedwords easiest to remember on the subsequent memory test, whereas the words that were repeated but not quizzed would be more difficult to remember.”
MethodRepeated recall as an intervention to improve memory performance in heart failure patients
Viveiros, J. D., Sethares, K. A., & Shapiro, A. M. (2017) · European Journal of Cardiovascular Nursing · doi:10.1177/1474515117711610 · Cited by 9
Hulme, A. K., Luo, K., & Štrkalj, G. (2019) · Anatomical Sciences Education · doi:10.1002/ase.1879 · Cited by 9
“…of their study program because of more time spent in interpreting, applying, and integrating their knowledge while building clinical diagnostic skills (Feigin et al., 2007; Karpicke and Roediger, 2008; Magid et al., 2009; White and Ousey, 2010; Karpicke, 2012; Dobson and Linderholm, 2015).”
BackgroundSelf-directed learning and retrieval practice: building a bridge through functional contextualism
Parker, D. A., & Roessger, K. M. (2020) · International Journal of Lifelong Education · doi:10.1080/02601370.2020.1743375 · Cited by 13
“Further research has shown that these effects are augmented when retrieval practice is paired with other learning strategies, such as feedback, interleaving, and spacing (Karpicke & Roediger, 2007, 2008; Pereira et al., 2009; Roediger & Butler, 2011).”
BackgroundParadoxes of learning and memory
Roediger, H. L., III, & Butler, A. C. (2011) · Cambridge University Press eBooks · doi:10.1017/cbo9780511978098.010 · Cited by 10
Self-citationKurtz, T., Mogle, J. A., Sliwinski, M. J., & Hofer, S. M. (2013) · Experimental Aging Research · doi:10.1080/0361073x.2013.839024 · Cited by 14
“…Zimprich (2009) took into account the beneficial effect of multiple study and retrieval trials (Grimaldi & Karpicke, 2012; Karpicke & Blunt, 2011; Karpicke & Roediger, 2007, 2008; Pyc & Rawson, 2009) by using a multitrial PA task to investigate individual differences in PA learning of older…”
MethodMagnuson, J. S., & Crinnion, A. M. (2022) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780198845003.013.23 · Cited by 12
Habitual responses are retrieved from memory, not triggered reflexivelyPreprint
Du, Y., & Haith, A. M. (2023) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/gncsf · Cited by 11
Oxford Handbooks in Linguistics
(2022) · Oxford University Press eBooks · doi:10.1093/9780191954481.003.0108 · Cited by 9
Faster attentional focusing in working memory instills better long-term memoryPreprint
Wang, S., & van Ede, F. (2024) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2024.03.25.586271 · Cited by 13
“…and Fukuda, 2019; Voss and Paller, 2009) or retrieval of information from LTM back into WM (Carrier and Pashler, 1992; Chan and McDermott, 2007; Karpicke and Roediger, 2008; Roediger and Karpicke, 2006) can positively affect subsequent LTM. Importantly, the fate of WM content is not only…”
Retrieval practice plus feedback benefits a third language vocabulary learning
Li, J., Zhang, E.-H., Zhang, H., Gou, H., & Cao, H.-W. (2022) · International Journal of Multilingualism · doi:10.1080/14790718.2022.2102172 · Cited by 13
“…e ff ect in foreign vocabulary learning, researchers often asked participants to retrieve familiar native words (First Language, L1) given the L2 (Second Language, L2) equivalents as cues in retrieval practice conditions (Karpicke & Roediger, 2008; Pyc & Rawson, 2011; van den Broek et al., 2013).”
BackgroundResultInfluentialRemembering and forgetting information about the COVID-19 vaccine on Twitter
Bilgin, E., & Wang, Q. (2022) · Memory · doi:10.1080/09658211.2022.2144892 · Cited by 10
“Second, given that rehearsal enhances memory (Karpicke & Roediger, 2008), we expected to find the rehearsal effect, whereby tweeted information would be remembered better than untweeted information for both pro-vaccine and anti-vaccine arguments.”
BackgroundText‐to‐speech and virtual reality agents in primary school classroom environments
Dai, L., Kritskaia, V., van der Velden, E., Vervoort, R., Blankendaal, M., Jung, M. M., Postma, M., & Louwerse, M. M. (2024) · Journal of Computer Assisted Learning · doi:10.1111/jcal.13046 · Cited by 13
Elzerman, G. H. (2025) · 2025 5th International Conference on Artificial Intelligence and Education (ICAIE) · doi:10.1109/icaie64856.2025.11158185 · Cited by 8
“Research in cognitive psychology supports the retrieval practice theory [25], which posits that knowledge not actively recalled and applied tends not to "stick" [8], [25].”
Castiello, S., Miller, R. R., Witnauer, J. E., Alcaide, D. M., Fung, E., Pitliya, R. J., Morrissey, D. K. C., & Murphy, R. A. (2022) · Journal of Experimental Psychology General · doi:10.1037/xge0001166 · Cited by 8
Bencze, D., Szöllősi, Á., Németh, K., & Racsmány, M. (2022) · Biological Psychology · doi:10.1016/j.biopsycho.2022.108341 · Cited by 9
The critical importance of timing of retrieval practice for the fate of nonretrieved memories
Kriechbaum, V. M., & Bäuml, K. T. (2023) · Scientific Reports · doi:10.1038/s41598-023-32916-7 · Cited by 11
“Again, a two-way analysis of variance with the between-participants factors of lag condition and item type revealed no main effect of lag condition (F(2, 162) = 0.”
BackgroundMethodInfluentialReady, Set, Go? Impact of the Pandemic on Student Readiness: Laboratories, Preparedness, and Support
Ramos, J. G., & Towns, M. H. (2023) · Journal of Chemical Education · doi:10.1021/acs.jchemed.3c00014 · Cited by 11
Study Smarter: Applying the Science of Learning to Radiology
Tung, E. L., & Matalon, S. A. (2023) · Journal of the American College of Radiology · doi:10.1016/j.jacr.2023.04.026 · Cited by 8
Strong but Fragmented Memory of a Stressful Episode
Grob, A.-M., Ehlers, D., & Schwabe, L. (2023) · eNeuro · doi:10.1523/eneuro.0178-23.2023 · Cited by 13
“Because both sleep (Diekelmann and Born, 2010) and rehearsal (Karpicke and Roediger, 2008) are known to affect memory performance, we asked participants to report their sleep quality and duration for the night between experimental days, as well as the amount of rehearsal of the experimental stimuli or procedures at th…”
BackgroundThe challenge of learning adaptive mental behavior.
Hitchcock, P. F., & Frank, M. J. (2024) · Journal of Psychopathology and Clinical Science · doi:10.1037/abn0000924 · Cited by 14
Dogs with a vocabulary of object labels retain them for at least 2 years
Dror, S., Miklósi, Á., & Fugazza, C. (2024) · Biology Letters · doi:10.1098/rsbl.2024.0208 · Cited by 8
“In humans, retrieval practice of a previously learned novel word can improve long-term memory [33].”
BackgroundMartín, A. N. (2015) · Cited by 25
Collaborative system for signal processing education
Krudysz, G. A., & McClellan, J. H. (2011) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2011.5946264 · Cited by 7
Intervention strength does not differentially affect memory reconsolidation of strong memories
van Schie, K., van Veen, S. C., Hendriks, Y. R., van den Hout, M., & Engelhard, I. M. (2017) · Neurobiology of Learning and Memory · doi:10.1016/j.nlm.2017.07.011 · Cited by 10
“Then, participants viewed and recalled the same set of pictures two additional times to ensure strong encoding (Karpicke & Roediger, 2008).”
Turn-by-turn route guidance does not impair route learning.
Kelly, J. W., Lim, A., & Carpenter, S. K. (2021) · Journal of Applied Research in Memory and Cognition · doi:10.1016/j.jarmac.2021.06.001 · Cited by 13
Remembering: An Activity of Mind and Brain
Craik, F. I. M. (2021) · doi:10.1093/oso/9780192895226.001.0001 · Cited by 13
Fraundorf, S. H., Caddick, Z. A., Nokes‐Malach, T. J., & Rottman, B. M. (2023) · Cognitive Research Principles and Implications · doi:10.1186/s41235-023-00508-8 · Cited by 10
“Although feedback may be redundant when a learner is highly confident in their response and correct, it is unlikely to negatively affect learning (Hays et al., 2010, EL: 4; Karpicke & Roediger, 2008, EL: 4).”
BackgroundMethodPhelps, E. A., & Schiller, D. (2013) · Elsevier eBooks · doi:10.1016/b978-0-12-386892-3.00009-3 · Cited by 13
Study for now, but judge for later: Delayed judgments of learning promote long‐term retention
Sundqvist, M. L., Todorov, I., Kubik, V., & Jönsson, F. U. (2012) · Scandinavian Journal of Psychology · doi:10.1111/j.1467-9450.2012.00968.x · Cited by 10
Memory in Educational Settings
Marsh, E. J., & Butler, A. C. (2013) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780195376746.013.0020 · Cited by 10
Recall and response time norms for English–Swahili word pairs and facts about Kenya
Bangert, A. S., & Heydarian, N. M. (2016) · Behavior Research Methods · doi:10.3758/s13428-015-0701-1 · Cited by 9
Johnson, C. W., Johnson, R., Steigman, M., Odo, C., Vijayan, S., & Tata, D. V. (2016) · Educational Researcher · doi:10.3102/0013189x16656939 · Cited by 8
“(2) For high prevalence note-taking, reading, language, and study skills academic risks, train students to employ daily spaced-repetitive practice (Karpicke & Roediger, 2007, 2008), using electronic flashcard and dictation informatics technologies to more effectively cognitively process, store, and…”
BackgroundUrcelay, G. P., & Miller, R. R. (2017) · Elsevier eBooks · doi:10.1016/b978-0-12-809324-5.21004-3 · Cited by 8
Nyland, R. L., & Sawarynski, K. E. (2017) · MedEdPORTAL · doi:10.15766/mep_2374-8265.10610 · Cited by 8
Retrieval practice and spacing in an engineering mathematics classroom: Do the effects add up?
Bego, C. R., Lyle, K. B., Ralston, P. A. S., & Hieb, J. (2017) · IEEE Frontiers in Education Conference (FIE) · doi:10.1109/fie.2017.8190463 · Cited by 10
“[4], [5]).”
Scaling Effective Learning Strategies: Retrieval Practice and Long-Term Knowledge Retention in MOOCs
Davis, D., Kizilcec, R. F., Hauff, C., & Houben, G. (2018) · Journal of Learning Analytics · doi:10.18608/jla.2018.53.3 · Cited by 16
“…of different learning strategies has found retrieval practice to be effective in supporting long-term knowledge retention (Adesope et al., 2017; Clark & Mayer, 2016; Roediger & Butler, 2011; Henry et al., 2016; Lindsey et al., 2014; Karpicke & Roediger, 2008; Karpicke & Blunt, 2011; Custers, 2010).”
BackgroundMethodInfluentialMundt, D., Abel, R., & Hänze, M. (2020) · Journal of Cognitive Psychology · doi:10.1080/20445911.2020.1733584 · Cited by 8
“Retrieving information actively through testing enhances the long-term retention of material more than when reviewing or rereading the same material (e.g. Dunlosky, Rawson, Marsh, Nathan, & Willingham, 2013; Dobson & Linderholm, 2015; Karpicke & Roediger, 2008).”
BackgroundJones, J. M., & Korula, R. (2021) · Medical Science Educator · doi:10.1007/s40670-021-01321-y · Cited by 11
“In our study, several students professed to save the Quiz questions for review until right before the exam, despite evidence that recall based study in which formative questions are used throughout the learning process leads to the best performance on assessments [1, 2, 5, 22].”
BackgroundThe Art and Science of Learning, Teaching, and Delivering Feedback in Psychosomatic Medicine
Lokko, H. N., Gatchel, J. R., Becker, M. A., & Stern, T. A. (2015) · Psychosomatics · doi:10.1016/j.psym.2015.09.006 · Cited by 8
Reductions in Retrieval Competition Predict the Benefit of Repeated Testing
Rafidi, N., Hulbert, J. C., Brooks, P. P., & Norman, K. A. (2018) · Scientific Reports · doi:10.1038/s41598-018-29686-y · Cited by 10
“Other studies have found that the beneficial effects of testing on target memory are most evident after long delays of the sort that we used here 1,3 .”
BackgroundMethodResultA Mastery Approach to Flashcard-Based Adaptive Training
Whitmer, D. E., Johnson, C. I., Marraffino, M. D., Pharmer, R. L., & Blalock, L. D. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-50788-6_41 · Cited by 9
“that the effects of training tend to be amplified when long-term retention is measured [4, 27].”
BackgroundDeep learning for sentence clustering in essay grading supportPreprint
Chang, L., Rastas, I., Pyysalo, S., & Ginter, F. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2104.11556 · Cited by 14
“They require students to retrieve information, which has been shown to help with the retention of learned material [17].”
BackgroundMartin, C. B., Hong, B., Newsome, R. N., et al. (2022) · doi:10.31234/osf.io/2fwup · Cited by 8
Morphology and The Mental Lexicon: Three questions about decomposition
Embick, D., Creemers, A., & Davies, A. J. G. (2022) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780198845003.013.17 · Cited by 14
The neural basis of word production
Nozari, N. (2022) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780198845003.013.12 · Cited by 15
Liu, X. L., & Ranganath, C. (2019) · doi:10.31234/osf.io/4nfue · Cited by 8
Leonard, L. B., Deevy, P., Christ, S. L., Karpicke, J. D., Kueser, J. B., & Fischer, K. (2024) · Journal of Speech Language and Hearing Research · doi:10.1044/2024_jslhr-24-00321 · Cited by 7
“The most benefit from retrieval practice occurs when there are multiple retrieval opportunities during learning (Karpicke & Roediger, 2008) and when spacing occurs between retrieval events (Karpicke & Roediger, 2007).”
Self-citationOkur, M., & Aksoy, V. (2025) · Journal of Intelligence · doi:10.3390/jintelligence13020016 · Cited by 17
Linde, P., Fichter, F., Dietlein, M., Sudbrock, F., Afshar, K., Dapper, H., Fokas, E., Hillebrecht, A., Raupach, T., & Laupichler, M. C. (2026) · npj Digital Medicine · doi:10.1038/s41746-025-02313-7 · Cited by 16
The Effectiveness of Spaced Repetition in Medical Education: A Systematic Review and Meta‐Analysis
Maye, J. A., & Hurley, F. (2026) · The Clinical Teacher · doi:10.1111/tct.70353 · Cited by 11
“Many of the studies demonstrating the testing and spacing effects have focused on memorisation tasks [10, 11], which are of only limited relevance to the practice of medicine in a complex clinical setting.”
Do it twice! Test-taking fosters repeated but not initial study of multimedia instruction
Eitel, A., Benito, S. M., & Scheiter, K. (2017) · Learning and Instruction · doi:10.1016/j.learninstruc.2017.04.003 · Cited by 8
“A large body of research revealed that aside from demonstrating what they know, students reorganize, elaborate, and consolidate knowledge through testing (e.g., Endres & Renkl, 2015; Karpicke & Roediger, 2008).”
BackgroundBailey, E. G., Greenall, R. F., Tullis, M. M., & Williams, K. R. (2021) · PLoS ONE · doi:10.1371/journal.pone.0250143 · Cited by 7
Azzam, M. B., & Easteal, R. A. (2021) · Medical Science Educator · doi:10.1007/s40670-021-01298-8 · Cited by 16
Maraver, M. J., Lapa, A., Garcia‐Marques, L., Carneiro, P., & Raposo, A. (2022) · PLoS ONE · doi:10.1371/journal.pone.0272427 · Cited by 14
“This robust finding, known as the “testing effect” or “retrieval practice effect”, shows that when learned information is retrieved by taking memory tests, it is more likely to be correctly recalled in the future than when the information is reread or restudied [4,5].”
BackgroundRelational Consistency Induced Self-Supervised Hashing for Image Retrieval
Jin, L., Li, Z., Pan, Y., & Tang, J. (2023) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2023.3333294 · Cited by 11
Hartman, J. D., & Eichler, J. F. (2024) · Education Sciences · doi:10.3390/educsci14111224 · Cited by 7
Sarwar, F., Allwood, C. M., & Innes-Ker, Å. H. (2010) · Applied Cognitive Psychology · doi:10.1002/acp.1749 · Cited by 8
Metadata
- Authors
- Karpicke, J. D., & Roediger, H. L.
- Affiliations
- Washington University in St. Louis (US)
- Department of Psychological Sciences, Purdue University, West Lafayette, IN 47907, USA.
- Corresponding author
- Karpicke, Jeffrey D.
- ORCID
- Karpicke, Jeffrey D.
- Venue
- Science
- Published
- 2008-02-15
- Volume
- 319
- Issue
- 5865
- Pages
- 966-968
- ISSN
- 0036-8075 (ISSN-L)
- 1095-9203
- OpenAlex
- W2092301601
- Cited by
- 1,791
- References
- 14
- Citations by year
- 2026: 91 · 2025: 100 · 2024: 109 · 2023: 112 · 2022: 151 · 2021: 123 · 2020: 115 · 2019: 103 · 2018: 143 · 2017: 103 · 2016: 98 · 2015: 113 · 2014: 85 · 2013: 101 · 2012: 81
- FWCI
- 28.60
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Science (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Memory Processes and Influences
- Social Sciences › Psychology › Developmental and Educational Psychology › Second Language Acquisition and Learning
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Visual and Cognitive Learning Processes
- Keywords
- retrieval practice, learning consolidation, foreign language vocabulary, retesting, delayed recall, self-assessment, memory retention
- MeSH terms
- Educational Measurement, Humans, Learning, Memory, Practice, Psychological, Mental Recall, Retention, Psychology, Students, Time Factors, Universities
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.