The Critical Importance of Retrieval for Learning
The DOI matches its Crossref record; 14 of the 14 references it cites were found in a registry or an index.
Abstract
Learning is often considered complete when a student can produce the correct answer to a question. In our research, students in one condition learned foreign language vocabulary words in the standard paradigm of repeated study-test trials. In three other conditions, once a student had correctly produced the vocabulary item, it was repeatedly studied but dropped from further testing, repeatedly tested but dropped from further study, or dropped from both study and test. Repeated studying after learning had no effect on delayed recall, but repeated testing produced a large positive effect. In addition, students' predictions of their performance were uncorrelated with actual performance. The results demonstrate the critical role of retrieval practice in consolidating learning and show that even university students seem unaware of this fact.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Second, repeated encounters can support retrieval processes, helping students recall words they have previously encountered during gameplay (Karpicke and Roediger, 2008; Nation, 2001; Roediger and Karpicke, 2006; Webb, 2007).”
From Incidental vocabulary learning from digital games: the predictive role of game playing time, foreign language motivation, and anxiety (2026) · cites this paper as Karpicke and Roediger, 2008
In the citing paper
“practice retrieval through answering questions significantly improves long-term retention (15,16).”
From Applying learning theories and instructional design models for effective instruction (2016) · cites this paper as [16]
In the citing paper
“practice retrieval through answering questions significantly improves long-term retention (15,16).”
From Applying learning theories and instructional design models for effective instruction (2016) · cites this paper as [15]
In the citing paper
“Whereas the reactivation of memories during wakefulness, as it occurs for example during rehearsal, can strengthen these memories in the long run (623, 1006), the reactivation transfers the representation into an transient unstable state such that memory is in need of reconsolidation (470, 718, 731, 844, 1033).”
From About Sleep's Role in Memory (2013) · cites this paper as [623]
In the citing paper
“Indeed there are data from other areas of cognitive neuroscience that demonstrate that repeating something that you have successfully learned is the best way to remember it (Chiviacowsky and Wulf, 2007; Karpicke and Roediger, 2008; Wulf and Shea, 2002).”
From Rethinking motor learning and savings in adaptation paradigms: model-free memory for successful actions combines with internal models (2011) · cites this paper as Karpicke and Roediger, 2008
6 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Test-Enhanced Learning: Taking Memory Tests Improves Long-Term Retention
Roediger, H. L., & Karpicke, J. D. (2006) · Psychological Science · doi:10.1111/j.1467-9280.2006.01693.x · Cited by 2,867
Self-citationMemory: A Contribution to Experimental Psychology
Ebbinghaus, H. (2013) · Annals of Neurosciences · doi:10.5214/ans.0972.7531.200408 · Cited by 2,827
Information Processing and Cognition: The Loyola Symposium
Brown, A. S., & Solso, R. L. (1976) · The American Journal of Psychology · doi:10.2307/1421430 · Cited by 2,382
The power of testing memory: Basic research and implications for educational practice
Roediger, H. L., & Karpicke, J. D. (2006) · Perspectives on Psychological Science · doi:10.1111/j.1745-6916.2006.00012.x · Cited by 2,037
Self-citationThe Psychology of Human Learning
Newman, E. B., McGeoch, J. A., & Irion, A. L. (1953) · The American Journal of Psychology · doi:10.2307/1418975 · Cited by 792
Repeated retrieval during learning is the key to long-term retention☆
KARPICKE, J., & ROEDIGERIII, H. (2007) · Journal of Memory and Language · doi:10.1016/j.jml.2006.09.004 · Cited by 598
Self-citationThe influence of retrieval on retention
Carrier, M., & Pashler, H. (1992) · Memory & Cognition · doi:10.3758/bf03202713 · Cited by 575
The promise and perils of self-regulated study
Kornell, N., & Bjork, R. A. (2007) · Psychonomic Bulletin & Review · doi:10.3758/bf03194055 · Cited by 527
The effects of presentation and recall of material in free-recall learning
Tulving, E. (1967) · Journal of Verbal Learning and Verbal Behavior · doi:10.1016/s0022-5371(67)80092-6 · Cited by 402
Thiede, K. W., & Dunlosky, J. (1999) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037//0278-7393.25.4.1024 · Cited by 396
Research works printed but not linked: 4
- A. I. Gates, Arch. Psychol.6, 1 (1917).
- W. F. Battig, Psychon. Sci. Monogr.1 (suppl.), 1 (1965).
- J. Dunlosky, K. Rawson, S. McDonald, in Applied Metacognition, T. Perfect, B. Schwartz, Eds. (Cambridge Univ. Press, Cambridge, 2002), pp. 68–92.
- J. D. Karpicke thesis Washington University St. Louis MO (2007).
Cited by
Items 501–600 of 1,789
Lillard, A. S., & McHugh, V. (2019) · Journal of Montessori Research · doi:10.17161/jomr.v5i1.9753 · Cited by 26
Memory Engrams in the Neocortex
Brodt, S., & Gais, S. (2020) · The Neuroscientist · doi:10.1177/1073858420941528 · Cited by 36
“Recent work supports the idea that just like spontaneous endogenous reactivation, also stimulated reactivation in the form of repeated learning or repeated retrieval, might provide a benefit particularly for neocortical memory (Antony and others 2017; Karpicke and Roediger 2008).”
BackgroundTwelve tips on guiding preparation for both high-stakes exams and long-term learning
Sein, A. S., Dathatri, S., & Bates, T. A. (2020) · Medical Teacher · doi:10.1080/0142159x.2020.1828570 · Cited by 27
“…test date A key to test preparation is a strong fund of knowledge that learners have practiced accessing and applying to the answering of questions and the solving of problems, such as through retrieval practice exercises (Karpicke and Roediger 2008) and test-enhanced learning (Green et al. 2018).”
BackgroundGuilding, C., Pye, R. E., Butler, S., Atkinson, M., & Field, E. (2021) · Pharmacology Research & Perspectives · doi:10.1002/prp2.833 · Cited by 32
“17 19 Answering questions enables students to check their understanding of course content, and provides formative and corrective feedback which are important factors in promoting learning.”
BackgroundGanzer, C. A., Insel, K. C., & Ritter, L. S. (2012) · Journal of Neuroscience Nursing · doi:10.1097/jnn.0b013e3182666231 · Cited by 31
Improving the impact of didactic resident training with online spaced education
Gyorki, D. E., Shaw, T. J., Nicholson, J., Baker, C., Pitcher, M. E., Skandarajah, A. R., Segelov, E., & Mann, G. B. (2013) · ANZ Journal of Surgery · doi:10.1111/ans.12166 · Cited by 27
Is Forgetting Caused by Inhibition?
Raaijmakers, J. G. W., & Jakab, E. (2013) · Current Directions in Psychological Science · doi:10.1177/0963721412473472 · Cited by 26
“For example, both Perfect et al. (2004) and Verde (2012) pointed out that many experiments have shown sizable RIF effects despite the fact that the items that were used should have been considered weak (e.”
BackgroundThe beneficial effect of testing: an event-related potential study
Bai, C.-H., Bridger, E. K., Zimmer, H. D., & Mecklinger, A. (2015) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2015.00248 · Cited by 25
“The final test (Phase 3) followed 1 day later to increase the likelihood of observing a substantial testing effect (Butler and Roediger, 2007; Karpicke and Roediger, 2008).”
BackgroundMethodResultAssessment of Learning Gains Associated with Independent Exam Analysis in Introductory Biology
Williams, A. E., Aguilar-Roca, N. M., Tsai, M., Wong, M., Beaupré, M. M., & O’Dowd, D. K. (2011) · CBE—Life Sciences Education · doi:10.1187/cbe.11-03-0025 · Cited by 25
“The act of retrieving an answer from memory, as occurs when students are tested on the same or even similar material multiple times, can increase learning independently of other interventions (Karpicke and Roediger, 2008; Karpicke and Blunt, 2011).”
BackgroundHuman Information Processing: An Overview for Human–Computer Interaction
Proctor, R. W., & Vu, K. L. (2012) · Human factors and ergonomics · doi:10.1201/b11963-4 · Cited by 30
Why the Southern Cross Model? How one University’s Curriculum was TransformedPreprint
Roche, T., Wilson, E., & Goode, E. (2022) · SSRN Electronic Journal · doi:10.2139/ssrn.4029237 · Cited by 29
Leonard, L. B., Christ, S. L., Deevy, P., Karpicke, J. D., Weber, C., Haebig, E., Kueser, J. B., Souto, S., & Krok, W. C. (2021) · Journal of Neurodevelopmental Disorders · doi:10.1186/s11689-021-09368-z · Cited by 28
“Retrieval is important because it can provide benefits to learning that go beyond that which occurs with study alone [28].”
Self-citationLiu, X. L., & Ranganath, C. (2021) · Psychonomic Bulletin & Review · doi:10.3758/s13423-021-01953-6 · Cited by 32
“Considerable evidence, however, suggests that episodic memory is more dynamic, such that repeated retrieval of an event (“retrieval practice”) dramatically enhances the ability to retain the practiced information (Karpicke & Roediger, 2008; Roediger & Butler, 2011; Rowland, 2014).”
BackgroundThe effect of worked examples on student learning and error anticipation in algebra
Barbieri, C., Booth, J. L., Begolli, K. N., & McCann, N. (2021) · Instructional Science · doi:10.1007/s11251-021-09545-6 · Cited by 35
The evidence for and against reactivation-induced memory updating in humans and nonhuman animals
Jardine, K. H., Huff, A. E., Wideman, C. E., McGraw, S. D., & Winters, B. D. (2022) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2022.104598 · Cited by 34
Polack, C. W., & Miller, R. R. (2022) · Journal of Experimental Psychology Animal Learning and Cognition · doi:10.1037/xan0000323 · Cited by 42
The “pure-study” learning curve: the learning curve without cumulative testing
Roediger, H. L., & Smith, M. A. (2012) · Memory & Cognition · doi:10.3758/s13421-012-0213-5 · Cited by 24
“Karpicke and Roediger (2007) showed that when retention tests were given a week later, the STTT condition led to greater recall than did the SSST condition, again showing the power of test trials relative to study trials in enhancing long-term retention (see also Karpicke & Roediger, 2008).”
Carpenter, S. K., & Vul, E. (2011) · Memory & Cognition · doi:10.3758/s13421-011-0092-1 · Cited by 29
Chevron, M.-P. (2014) · Perspectives in Science · doi:10.1016/j.pisc.2014.07.001 · Cited by 35
“…time during the learning path to built well-constructed knowledge networks in memory, cognitive activity oscillates permanently between coding, active retrieval and integrating what has to be learned in a new, or existing framework (Terry, 2006; Karpicke and Roediger, 2008; Fischer, 2008).”
BackgroundConserving Time in the Classroom: The Clicker Technique
Anderson, L. S., Healy, A. F., Kole, J. A., & Bourne, L. E. (2011) · Quarterly Journal of Experimental Psychology · doi:10.1080/17470218.2011.593264 · Cited by 25
“Indeed, repeated testing produces greater retention of learned material than does repeated studying (Karpicke & Roediger, 2008 ; Pyc & Rawson, 2010 ) even when students answer incorrectly (Kornell, Hays, & Bjork, 2009 ).”
BackgroundTesting alters brain activity during subsequent restudy: Evidence for test-potentiated encoding
Vestergren, P., & Nyberg, L. H. (2013) · Trends in Neuroscience and Education · doi:10.1016/j.tine.2013.11.001 · Cited by 30
Glass, A. L. (2009) · Educational Psychology · doi:10.1080/01443410903310674 · Cited by 24
“However, Barr, Rovee-Collier, and Campanella (2005) found that if the infant is given the opportunity to again observe or to imitate the event one day later, then the infant will remember the event and imitate the action 10 days later.”
BackgroundfMRI exploration of pedagogical benefits of repeated testing: when more is not always better
Liu, X. L., & Reder, L. M. (2016) · Brain and Behavior · doi:10.1002/brb3.476 · Cited by 23
“Considerable research has demonstrated the benefits of memory retrieval on subsequent memory, highlighting a phenomenon known as the testing effect (Carrier and Pashler 1992; Roediger and Karpicke 2006a,b; McDaniel et al. 2007; Pashler et al. 2007; Karpicke and Roediger 2008; Rowland 2014).”
BackgroundResultPracticing Emotionally Biased Retrieval Affects Mood and Establishes Biased Recall a Week Later
Vrijsen, J. N., Hertel, P. T., & Becker, E. S. (2016) · Cognitive Therapy and Research · doi:10.1007/s10608-016-9789-6 · Cited by 29
“Among the stronger correlations were BDI-II in Session 1 (r = .45, p = .011), the Session-1 brooding subscale of the RRS (r = .42, p = .019), BDI-II in Session 2 (r = .51, p = .004), and the brooding score in Session 2 (r = .44, p = .014).”
BackgroundLongitudinal assessments in continuing specialty certification and lifelong learning
Price, D. W., Swanson, D. B., Irons, M., & Hawkins, R. E. (2018) · Medical Teacher · doi:10.1080/0142159x.2018.1471202 · Cited by 24
Mobile application based on CCI standards to help children learn English as a foreign language
Sadiq, R. B., Çavuş, N., & İbrahim, D. (2019) · Interactive Learning Environments · doi:10.1080/10494820.2019.1579239 · Cited by 27
Building an Inclusive Classroom.
Penner, M. R. (2018) · Europe PMC (PubMed Central) · doi:10.17615/x2wj-8n38 · Cited by 39
Collaborative Memory: A Selective Review of Data and Theory
Rajaram, S., & Maswood, R. (2017) · Elsevier eBooks · doi:10.1016/b978-0-12-809324-5.21050-x · Cited by 34
“Further, a somewhat counterintuitive yet robust finding shows that in the long run repeated recall improves memory more than additional opportunities to simply study it again, a phenomenon known as the testing effect (Karpicke and Roediger, 2007, 2008; Roediger and Karpicke, 2006a, 2006b).”
Audsley, S., Fernando, K., Maxson, B. K., Robinson, B., & Varney, K. (2013) · The Serials Librarian · doi:10.1080/0361526x.2013.781979 · Cited by 35
Development and Validation of a Theoretical Test in Endosonography for Pulmonary Diseases
Savran, M. M., Clementsen, P. F., Annema, J. T., Minddal, V., Larsen, K. R., Park, Y. S., & Konge, L. (2014) · Respiration · doi:10.1159/000362884 · Cited by 22
Psychological engineering: A functional–cognitive perspective on applied psychology.
Houwer, J. D., Hughes, S., & Barnes‐Holmes, D. (2016) · Journal of Applied Research in Memory and Cognition · doi:10.1016/j.jarmac.2016.09.001 · Cited by 25
Deception and Decay: Verbal Lie Detection as a Function of Delay and Encoding Quality
Harvey, A. C., Vrij, A., Leal, S., Hope, L., & Mann, S. A. (2017) · Journal of Applied Research in Memory and Cognition · doi:10.1016/j.jarmac.2017.04.002 · Cited by 32
“…episodic events ‘inoculates’ against memory decay (Gabbert, Hope, & Fisher, 2009; Gabbert, Hope, Fisher, & Jamieson, 2012; Hope, Gabbert, & Fisher, 2011), a process analogous to the testing effect (Roediger, Putnam & Smith, 2011; also see Roediger & Karpicke, 2006; Karpicke & Roediger, 2008).”
An Adaptive Test Analysis Based on Students' Motivation
Yoshioka, S. R. I., & Ishitani, L. (2018) · Informatics in Education · doi:10.15388/infedu.2018.20 · Cited by 23
“Karpicke and Roediger (2008) observed that studying repeatedly after a formal test did not bring any benefit, but performing tests periodically slowed down the inevitable forgetfulness.”
BackgroundReminders activate the prefrontal‐medial temporal cortex and attenuate forgetting of event memory
Sekeres, M. J., Moscovitch, M., Winocur, G., Pishdadian, S., Nichol, D., & Grady, C. L. (2020) · Hippocampus · doi:10.1002/hipo.23260 · Cited by 23
“…consistent with the mnemonic-enhancing testing effect, in which repeated “test” or active retrieval session lead to superior retention of information over time relative to a re-study, or reminder, session (Karpicke & Roediger, 2008; Oedekoven et al., 2017; Roediger & Karpicke, 2006; Rowland, 2014).”
ResultSupporting the self-regulated use of retrieval practice: A higher education classroom experiment
Broeren, M., Heijltjes, A., Verkoeijen, P., Smeets, G., & Arends, L. (2021) · Contemporary Educational Psychology · doi:10.1016/j.cedpsych.2020.101939 · Cited by 19
“They even believe that re-studying is a more beneficial strategy than retrieval practice (e.g., Roediger & Karpicke, 2006a; Karpicke & Roediger, 2008).”
Math anxiety relates positively to metacognitive insight into mathematical decision making
Desender, K., & Sasanguie, D. (2021) · Psychological Research · doi:10.1007/s00426-021-01511-8 · Cited by 33
“…metacognitive monitoring while studying, but one of them might make very good evaluations of her own knowledge because she constantly tests herself (Karpicke & Roediger, 2008), whereas the other might make very bad self-evaluations by relying on reading fluency as an indication of knowledge…”
BackgroundOptimizing the methodology of human sleep and memory research
Németh, D., Gerbier, É., Born, J., Rickard, T. C., Diekelmann, S., Fogel, S. M., Genzel, L., Prehn‐Kristensen, A., Payne, J. D., Dresler, M., et al. (2023) · Nature Reviews Psychology · doi:10.1038/s44159-023-00262-0 · Cited by 29
How do students implement collaborative testing in real-world contexts?
Wissman, K. T., & Rawson, K. A. (2015) · Memory · doi:10.1080/09658211.2014.999792 · Cited by 27
Exercises on collocations: a comparison of trial-and-error and exemplar-guided procedures
Stengers, H., & Boers, F. (2015) · Journal of Spanish Language Teaching · doi:10.1080/23247797.2015.1104030 · Cited by 27
The effect of recall, reproduction, and restudy on word learning: a pre-registered study
Krishnan, S., Watkins, K. E., & Bishop, D. (2017) · BMC Psychology · doi:10.1186/s40359-017-0198-8 · Cited by 28
“Participants typically do not assume that testing leads to more effective learning [6], and therefore they would be unlikely to apply this strategy more broadly.”
BackgroundMethodResultInfluentialHow teachers can help learners build storage and retrieval strength
Desy, J. R., Busche, K. D., Cusano, R., Veale, P., Coderre, S., & McLaughlin, K. (2017) · Medical Teacher · doi:10.1080/0142159x.2017.1408900 · Cited by 31
“We now know this is not the case and there is a growing body of evidence that retrieval practice builds retrieval strength and consequently increases the likelihood of successful retrieval (i.e. “learning”) (Karpicke and Roediger 2008).”
BackgroundRe-examining the effects of word writing on vocabulary learning
Webb, S., & Piasecki, A. E. (2018) · ITL Review of Applied Linguistics · doi:10.1075/itl.00007.web · Cited by 29
“Although it is intuitively logical that greater time on task will lead to greater learning, this is not always the case in vocabulary learning (Karpicke & Roediger, 2008).”
BackgroundWallihan, R. G., Smith, K. G., Hormann, M. D., Donthi, R. R., Boland, K. A., & Mahan, J. D. (2018) · BMC Medical Education · doi:10.1186/s12909-018-1366-0 · Cited by 26
Bekkink, M. O., Donders, R. A. R. T., van Muijen, G. N. P., & Ruiter, D. J. (2011) · Advances in Health Sciences Education · doi:10.1007/s10459-011-9291-6 · Cited by 22
“Karpicke and Roediger elegantly demonstrated the critical importance of retrieval practice in consolidating learning a foreign language by university students using repeated testing (Karpicke and Roediger 2008).”
BackgroundInfluentialNeural enhancement and attenuation induced by repetitive recall
Hashimoto, T., Usui, N., Taira, M., & Kojima, S. (2011) · Neurobiology of Learning and Memory · doi:10.1016/j.nlm.2011.03.008 · Cited by 25
Meyer, A. J., Armson, A. J., Losco, C. D., Losco, B. E., & Walker, B. F. (2014) · Anatomical Sciences Education · doi:10.1002/ase.1464 · Cited by 31
“Retention studies specifically focusing on gross anatomy show retention of 73–83% of anatomy knowledge over an interval of one to six years, indicating modest attrition (DuBois et al., 1969; Blunt and Blizard, 1975; Kennedy et al., 1981).”
BackgroundDistributed Practice: Rarely Realized in Self-Regulated Mathematical Learning
Barzagar Nazari, K., & Ebersbach, M. (2018) · Frontiers in Psychology · doi:10.3389/fpsyg.2018.02170 · Cited by 23
Learning new word meanings from story reading: the benefit of immediate testing
Hulme, R. C., & Rodd, J. M. (2021) · PeerJ · doi:10.7717/peerj.11693 · Cited by 23
A Comparison of Study Behaviors and Metacognitive Evaluation Used by Biology Students
Ewell, S. N., Driessen, E. P., Grogan, W., Johnston, Q., Ferdous, S., Mehari, Y., Peart, A., Seibenhener, M. L., & Ballen, C. J. (2023) · CBE—Life Sciences Education · doi:10.1187/cbe.22-11-0225 · Cited by 30
“(Karpicke and Roediger, 2008; Bjork and Bjork, 2011; Karpicke and Blunt, 2011; Dunlosky et al. , 2013; Brown et al. , 2014; Karpicke, 2017; Biwer et al. , 2021; Walck-Shannon et al. , 2021).”
Dorsolateral Prefrontal Cortex Enables Updating of Established Memories
Kluen, L. M., Dandolo, L., Jocham, G., & Schwabe, L. (2018) · Cerebral Cortex · doi:10.1093/cercor/bhy298 · Cited by 29
Retrieval practice and judgements of learning enhance transfer of physiology information
Dobson, J. L., Linderholm, T., & Stroud, L. (2019) · Advances in Health Sciences Education · doi:10.1007/s10459-019-09881-w · Cited by 24
Expectancy Violation Drives Memory Boost for Stressful Events
Kalbe, F., Bange, S., Lutz, A., & Schwabe, L. (2020) · Psychological Science · doi:10.1177/0956797620958650 · Cited by 28
“Because both sleep (Diekelmann & Born, 2010) and the amount of rehearsal (Karpicke & Roediger, 2008) are known to affect memory formation, we asked participants to complete brief questionnaires on their sleep quality and duration between the 2 experimental days as well as on the amount of rehearsal…”
BackgroundWorking toward a theoretical model for source comprehension in everyday discourse
Braasch, J. L. G., & Kessler, E. D. (2021) · Discourse Processes · doi:10.1080/0163853x.2021.1905393 · Cited by 26
“Above and beyond reexposure, research has consistently demonstrated that retrieval practice can substantially increase LTM retention (Dunlosky et al., 2013; Karpicke & Roediger, 2008; Rowland, 2014).”
BackgroundMehta, A., Brooke, N., Puskar, A., Woodson, M. C. C., Masi, B., Wallon, R. C., & Greeley, D. A. (2023) · Medical Science Educator · doi:10.1007/s40670-023-01839-3 · Cited by 25
Classification aided analysis of oscillatory signatures in controlled retrieval
Ketz, N., O’Reilly, R. C., & Curran, T. (2013) · NeuroImage · doi:10.1016/j.neuroimage.2013.06.077 · Cited by 23
“Successful retrieval of previously-studied material is known to improve long-term retention, a finding referred to as the testing effect (Karpicke and Roediger, 2008).”
Counter-regulation online: Threat biases retrieval of information during Internet search
Greving, H., & Sassenberg, K. (2015) · Computers in Human Behavior · doi:10.1016/j.chb.2015.03.077 · Cited by 25
“…search outcome and (b) retrieval of information from memory is the key determinant of subsequent behavior and decisions (cf. Fox & Duggan, 2013a,b; Fox & Jones, 2009) and plays an important role for the acquisition of knowledge in general (e.g., Karpicke & Blunt, 2011; Karpicke & Roediger, 2008).”
BackgroundTesting enhances both memorization and conceptual learning of categorical materials.
Cho, K. W., & Powers, A. (2019) · Journal of Applied Research in Memory and Cognition · doi:10.1016/j.jarmac.2019.01.003 · Cited by 24
How to activate students’ natural desire to test themselves
Vaughn, K. E., & Kornell, N. (2019) · Cognitive Research: Principles and Implications · doi:10.1186/s41235-019-0187-y · Cited by 13
Proctor, R. W., & Vu, K. L. (2012) · Springer eBooks · doi:10.1007/978-1-4419-1428-6_722 · Cited by 22
Luckey, A. M., McLeod, S. L., Robertson, I. H., To, W. T., & Vanneste, S. (2020) · Neurorehabilitation and neural repair · doi:10.1177/1545968320943573 · Cited by 25
How preference change induced by mere action versus inaction persists over time
Chen, Z., Holland, R. W., Quandt, J., Dijksterhuis, A., & Veling, H. (2021) · Judgment and Decision Making · doi:10.1017/s1930297500008366 · Cited by 21
Using insights from cognitive science for the teaching of clinical skills: AMEE Guide No. 155
Cecílio‐Fernandes, D., Patel, R. M., & Sandars, J. E. (2023) · Medical Teacher · doi:10.1080/0142159x.2023.2168528 · Cited by 26
“The testing effect (Roediger and Karpicke 2006a, 2006b; Karpicke and Roediger 2008) is an effective strategy for acquiring several clinical skills, including basic life support (Li et al. 2011), advanced life support (Kromann et al. 2009), radiograph interpretation (Boutis et al. 2019), and…”
MethodMishall, P. L., Burton, W. B., & Risley, M. S. (2023) · Advances in experimental medicine and biology · doi:10.1007/978-3-031-26462-7_10 · Cited by 31
Walsh, C. R., & Rissman, J. (2023) · Nature Communications · doi:10.1038/s41467-023-42770-w · Cited by 27
Informing Pedagogy Through the Brain-Targeted Teaching Model
Hardiman, M. M. (2012) · Journal of Microbiology and Biology Education · doi:10.1128/jmbe.v13i1.354 · Cited by 32
“Karpicke and Roediger (22), for example, found that intermittent testing of students’ knowledge produced significantly greater retention than did students’ intermittent studying.”
BackgroundTemporal patterns and dynamics of e-learning usage in medical education
Panzarasa, P., Kujawski, B., Hammond, E. J., & Roberts, C. M. (2015) · Educational Technology Research and Development · doi:10.1007/s11423-015-9407-4 · Cited by 29
“Similarly, scholars agree on the educational role of retrieval practice through learners’ involvement in repeated testing (Butler and Roediger 2007; Karpicke and Roediger 2008; Larsen et al. 2009; Roediger and Butler 2011; Roediger and Karpicke 2006).”
The development and validation of the Memory Support Rating Scale.
Lee, J. Y., Worrell, F. C., & Harvey, A. G. (2015) · Psychological Assessment · doi:10.1037/pas0000219 · Cited by 22
“Studies have documented the effectiveness of testing individuals on learned material as a means to promote further learning and memory of the same material (e.g., Karpicke & Roediger, 2008).”
Thompson, A. R., Kelso, R. S., Ward, P. J., Wines, K., & Hanna, J. B. (2016) · Medical Science Educator · doi:10.1007/s40670-016-0306-z · Cited by 23
Beneficial effects of selective item repetition on the recall of other items
Wallner, L., & Bäuml, K. T. (2017) · Journal of Memory and Language · doi:10.1016/j.jml.2017.04.006 · Cited by 26
Teplitski, M., Irani, T. A., Krediet, C. J., Cesare, M. D., & Marvasi, M. (2018) · Journal of Food Science Education · doi:10.1111/1541-4329.12129 · Cited by 28
Guran, C.-N. A., Herweg, N. A., & Bunzeck, N. (2019) · Journal of Neuroscience · doi:10.1523/jneurosci.2791-18.2019 · Cited by 21
“This is in line with longstanding evidence that testing of information leads to better memory compared with repeated study (Abbott, 1909; Spitzer, 1939; Karpicke and Roediger, 2008; Karpicke and Blunt, 2011).”
BackgroundResultGuran, C.-N. A., Lehmann-Grube, J., & Bunzeck, N. (2020) · Frontiers in Psychology · doi:10.3389/fpsyg.2019.02997 · Cited by 28
What is more effective: a daily or a weekly formative test?
Palmen, L. N., Vorstenbosch, M. A. T. M., Tanck, E., & Kooloos, J. G. M. (2015) · Perspectives on Medical Education · doi:10.1007/s40037-015-0178-8 · Cited by 23
“ipation in weekly quizzes was divided in quartiles as well: 0 quizzes completed [0], 1 quiz completed [1], 2 quizzes completed [2], 3 quizzes completed [3].”
BackgroundThe effects of keyword cues and 3R strategy on children's e‐book reading
Liang, T. H. (2014) · Journal of Computer Assisted Learning · doi:10.1111/jcal.12072 · Cited by 22
Brunyé, T. T., Smith, A. M., Horner, C., & Thomas, A. K. (2018) · Brain and Cognition · doi:10.1016/j.bandc.2018.09.008 · Cited by 28
Walck-Shannon, E. M., Cahill, M. J., McDaniel, M. A., & Frey, R. F. (2019) · CBE—Life Sciences Education · doi:10.1187/cbe.18-08-0163 · Cited by 24
Klionsky, D. J. (2008) · CBE—Life Sciences Education · doi:10.1187/cbe.08-02-0009 · Cited by 22
Assessing and Evaluating Teacher Preparation Programs
(2015) · PsycEXTRA Dataset · doi:10.1037/e507462020-001 · Cited by 21
Learning from your mistakes: does it matter if you’re out in left foot, I mean field?
Cyr, A.-A., & Anderson, N. D. (2018) · Memory · doi:10.1080/09658211.2018.1464189 · Cited by 20
Making a lecture stick: The Effect of spaced instruction on knowledge retention in medical education
Timmer, M. C. J., Steendijk, P., Arend, S. M., & Versteeg, M. (2020) · Medical Science Educator · doi:10.1007/s40670-020-00995-0 · Cited by 20
Wiklund‐Hörnqvist, C., Stillesjö, S., Andersson, M., Jonsson, B., & Nyberg, L. (2021) · Brain and Behavior · doi:10.1002/brb3.1909 · Cited by 20
Rodriguez, F., Yu, R., Park, J., Rivas, M. J., Warschauer, M., & Sato, B. K. (2019) · Proceedings of the 9th International Conference on Learning Analytics & Knowledge · doi:10.1145/3303772.3303841 · Cited by 20
“One of the reasons that spaced studying benefits learning is that it allows one to forget information [3, 6].”
BackgroundLincke, A., Jansen, M., Milrad, M., & Berge, E. (2021) · Research and Practice in Technology Enhanced Learning · doi:10.1186/s41039-021-00159-7 · Cited by 20
The Effect of Testing on the Retention of Coherent and Incoherent Text Material
de Jonge, M., Tabbers, H. K., & Rikers, R. M. J. P. (2015) · Educational Psychology Review · doi:10.1007/s10648-015-9300-z · Cited by 26
Gliddon, C. M., & Rosengren, R. J. (2012) · Biochemistry and Molecular Biology Education · doi:10.1002/bmb.20645 · Cited by 21
“Reinforcement of lecture material included questions such as ‘‘napthol is a hydroxylated form of what compound?’’ ‘‘Draw the structure of X and one other member of the class to which these belong?’’ It has been shown that frequent testing of knowledge results in consolidation of memory [31, 32].”
BackgroundWhen Talking Is Better Than Staying Quiet
Lasry, N., Charles, E. S., Whittaker, C., Lautman, M., Sabella, M. S., Henderson, C., & Singh, C. (2009) · AIP conference proceedings · doi:10.1063/1.3266709 · Cited by 25
Abadie, M., Waroquier, L., & Terrier, P. (2016) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037/xlm0000336 · Cited by 26
Design, Deployment and Evaluation of a Flipped Learning First-Year Engineering Course
Pardo, A., & Mirriahi, N. (2017) · Springer eBooks · doi:10.1007/978-981-10-3413-8_11 · Cited by 23
Cinel, C., Mack, C. C., & Ward, G. (2018) · Journal of Experimental Psychology General · doi:10.1037/xge0000441 · Cited by 94
Oscillatory signatures of reward prediction errors in declarative learning
Ergo, K., Loof, E. D., Janssens, C., & Verguts, T. (2018) · NeuroImage · doi:10.1016/j.neuroimage.2018.10.083 · Cited by 23
“For example, our finding that SRPEs boost declarative learning, might offer an alternative explanation to the testing effect: the finding that testing, rather thanmere studying, is more beneficial to memory (Karpicke and Roediger, 2008; Roediger et al., 2011).”
Going deeper: Automatic short-answer grading by combining student and question models
Zhang, Y., Lin, C., & Chi, M. (2020) · User Modeling and User-Adapted Interaction · doi:10.1007/s11257-019-09251-6 · Cited by 24
“Whilesuchquestionscanrepresentcomplexlearninggoalsmore effectivelythanmultiplechoicequestions(AndersonandBiddle1975;Karpickeand Roediger2008),evaluatingfreetextanswersisinherentlychallenging.”
BackgroundRetrieval Practice in Memory- and Language-Impaired Populations: A Systematic Review
de Lima, M. F. R., Cavendish, B. A., de Deus, J. S., & Buratto, L. G. (2020) · Archives of Clinical Neuropsychology · doi:10.1093/arclin/acaa035 · Cited by 23
EFFECTS OF LEARNING DIRECTION IN RETRIEVAL PRACTICE ON EFL VOCABULARY LEARNING
Terai, M., Yamashita, J., & Pasich, K. E. (2021) · Studies in Second Language Acquisition · doi:10.1017/s0272263121000346 · Cited by 29
“In psychology, retrieval in paired-associate learning has gained attention for its central role in retaining a learned word in memory (e.g., Karpicke & Roediger, 2008; for a review, see Roediger & Karpicke, 2006).”
BackgroundDawson, C. (2013) · Research in Science Education · doi:10.1007/s11165-013-9388-4 · Cited by 26
Bellander, M., Eschen, A., Lövdén, M., Martin, M., Bäckman, L., & Brehmer, Y. (2017) · Frontiers in Aging Neuroscience · doi:10.3389/fnagi.2016.00326 · Cited by 22
“Figure 2 displays the associative memory and item memory composite scores in each group pre and post training.”
BackgroundLong, T., Zhao, G., Yang, X., Zhao, R., & Chen, Q. (2019) · Professional Development in Education · doi:10.1080/19415257.2019.1647872 · Cited by 27
“This finding also supports other studies which indicated that retrieval practice could produce more learning than elaborative studying (Karpicke and Roediger 2008).”
ResultCampos-Arteaga, G., Forcato, C., Wainstein, G., Lagos, R., Palacios-García, I., Artigas, C., Morales, R., Pedreira, M. E., & Rodríguez, E. (2020) · Neurobiology of Learning and Memory · doi:10.1016/j.nlm.2020.107279 · Cited by 19
David, L., Biwer, F., Baars, M., Wijnia, L., PAAS, F. G. W. C., & de Bruin, A. B. H. (2024) · Educational Psychology Review · doi:10.1007/s10648-024-09903-z · Cited by 35
“For example, when using retrieval practice compared to re-study, the beneficial effects can become evident only after a few days (Karpicke & Roediger, 2008; Nunes & Karpicke, 2015).”
Chathampally, Y. G., Cooper, B. L., Wood, D., Tudor, G. J., & Gottlieb, M. A. (2020) · Western Journal of Emergency Medicine · doi:10.5811/westjem.2020.7.47583 · Cited by 21
Heterogenous scaling in the inter-event time of on-line bookmarking
Wang, P., Xie, X.-Y., Yeung, C. H., & Wang, B.-H. (2011) · Physica A Statistical Mechanics and its Applications · doi:10.1016/j.physa.2011.02.026 · Cited by 18
Metadata
- Authors
- Karpicke, J. D., & Roediger, H. L.
- Affiliations
- Washington University in St. Louis (US)
- Department of Psychological Sciences, Purdue University, West Lafayette, IN 47907, USA.
- Corresponding author
- Karpicke, Jeffrey D.
- ORCID
- Karpicke, Jeffrey D.
- Venue
- Science
- Published
- 2008-02-15
- Volume
- 319
- Issue
- 5865
- Pages
- 966-968
- ISSN
- 0036-8075 (ISSN-L)
- 1095-9203
- OpenAlex
- W2092301601
- Cited by
- 1,791
- References
- 14
- Citations by year
- 2026: 91 · 2025: 100 · 2024: 109 · 2023: 112 · 2022: 151 · 2021: 123 · 2020: 115 · 2019: 103 · 2018: 143 · 2017: 103 · 2016: 98 · 2015: 113 · 2014: 85 · 2013: 101 · 2012: 81
- FWCI
- 28.60
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Science (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Memory Processes and Influences
- Social Sciences › Psychology › Developmental and Educational Psychology › Second Language Acquisition and Learning
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Visual and Cognitive Learning Processes
- Keywords
- retrieval practice, learning consolidation, foreign language vocabulary, retesting, delayed recall, self-assessment, memory retention
- MeSH terms
- Educational Measurement, Humans, Learning, Memory, Practice, Psychological, Mental Recall, Retention, Psychology, Students, Time Factors, Universities
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.