The Critical Importance of Retrieval for Learning
The DOI matches its Crossref record; 14 of the 14 references it cites were found in a registry or an index.
Abstract
Learning is often considered complete when a student can produce the correct answer to a question. In our research, students in one condition learned foreign language vocabulary words in the standard paradigm of repeated study-test trials. In three other conditions, once a student had correctly produced the vocabulary item, it was repeatedly studied but dropped from further testing, repeatedly tested but dropped from further study, or dropped from both study and test. Repeated studying after learning had no effect on delayed recall, but repeated testing produced a large positive effect. In addition, students' predictions of their performance were uncorrelated with actual performance. The results demonstrate the critical role of retrieval practice in consolidating learning and show that even university students seem unaware of this fact.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Second, repeated encounters can support retrieval processes, helping students recall words they have previously encountered during gameplay (Karpicke and Roediger, 2008; Nation, 2001; Roediger and Karpicke, 2006; Webb, 2007).”
From Incidental vocabulary learning from digital games: the predictive role of game playing time, foreign language motivation, and anxiety (2026) · cites this paper as Karpicke and Roediger, 2008
In the citing paper
“practice retrieval through answering questions significantly improves long-term retention (15,16).”
From Applying learning theories and instructional design models for effective instruction (2016) · cites this paper as [16]
In the citing paper
“practice retrieval through answering questions significantly improves long-term retention (15,16).”
From Applying learning theories and instructional design models for effective instruction (2016) · cites this paper as [15]
In the citing paper
“Whereas the reactivation of memories during wakefulness, as it occurs for example during rehearsal, can strengthen these memories in the long run (623, 1006), the reactivation transfers the representation into an transient unstable state such that memory is in need of reconsolidation (470, 718, 731, 844, 1033).”
From About Sleep's Role in Memory (2013) · cites this paper as [623]
In the citing paper
“Indeed there are data from other areas of cognitive neuroscience that demonstrate that repeating something that you have successfully learned is the best way to remember it (Chiviacowsky and Wulf, 2007; Karpicke and Roediger, 2008; Wulf and Shea, 2002).”
From Rethinking motor learning and savings in adaptation paradigms: model-free memory for successful actions combines with internal models (2011) · cites this paper as Karpicke and Roediger, 2008
6 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Test-Enhanced Learning: Taking Memory Tests Improves Long-Term Retention
Roediger, H. L., & Karpicke, J. D. (2006) · Psychological Science · doi:10.1111/j.1467-9280.2006.01693.x · Cited by 2,867
Self-citationMemory: A Contribution to Experimental Psychology
Ebbinghaus, H. (2013) · Annals of Neurosciences · doi:10.5214/ans.0972.7531.200408 · Cited by 2,827
Information Processing and Cognition: The Loyola Symposium
Brown, A. S., & Solso, R. L. (1976) · The American Journal of Psychology · doi:10.2307/1421430 · Cited by 2,382
The power of testing memory: Basic research and implications for educational practice
Roediger, H. L., & Karpicke, J. D. (2006) · Perspectives on Psychological Science · doi:10.1111/j.1745-6916.2006.00012.x · Cited by 2,037
Self-citationThe Psychology of Human Learning
Newman, E. B., McGeoch, J. A., & Irion, A. L. (1953) · The American Journal of Psychology · doi:10.2307/1418975 · Cited by 792
Repeated retrieval during learning is the key to long-term retention☆
KARPICKE, J., & ROEDIGERIII, H. (2007) · Journal of Memory and Language · doi:10.1016/j.jml.2006.09.004 · Cited by 598
Self-citationThe influence of retrieval on retention
Carrier, M., & Pashler, H. (1992) · Memory & Cognition · doi:10.3758/bf03202713 · Cited by 575
The promise and perils of self-regulated study
Kornell, N., & Bjork, R. A. (2007) · Psychonomic Bulletin & Review · doi:10.3758/bf03194055 · Cited by 527
The effects of presentation and recall of material in free-recall learning
Tulving, E. (1967) · Journal of Verbal Learning and Verbal Behavior · doi:10.1016/s0022-5371(67)80092-6 · Cited by 402
Thiede, K. W., & Dunlosky, J. (1999) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037//0278-7393.25.4.1024 · Cited by 396
Research works printed but not linked: 4
- A. I. Gates, Arch. Psychol.6, 1 (1917).
- W. F. Battig, Psychon. Sci. Monogr.1 (suppl.), 1 (1965).
- J. Dunlosky, K. Rawson, S. McDonald, in Applied Metacognition, T. Perfect, B. Schwartz, Eds. (Cambridge Univ. Press, Cambridge, 2002), pp. 68–92.
- J. D. Karpicke thesis Washington University St. Louis MO (2007).
Cited by
Items 201–300 of 1,789
Storkel, H. L., Voelmle, K., Fierro, V., Flake, K., Fleming, K., & Romine, R. S. (2016) · Language Speech and Hearing Services in Schools · doi:10.1044/2016_lshss-16-0014 · Cited by 95
“For example, Karpicke and Roediger (2008) showed that repeated testing increased final recall by four standard deviations compared to repeated study.”
Golonka, E., Bowles, A. R., Silbert, N. H., Kramasz, D., Blake, C., & Buckwalter, T. (2015) · Modern Language Journal · doi:10.1111/modl.12191 · Cited by 84
From specific examples to general knowledge in language learning
Tamminen, J., Davis, M. H., & Rastle, K. (2015) · Cognitive Psychology · doi:10.1016/j.cogpsych.2015.03.003 · Cited by 58
“It is now well known that long-term memory benefits from retrieval practice during a study session (e.g., Karpicke & Roediger, 2008).”
BackgroundTechniques and devices to restore cognition
Serruya, M. D., & Kahana, M. J. (2008) · Behavioural Brain Research · doi:10.1016/j.bbr.2008.04.007 · Cited by 87
“Simple procedural changes in the ways people are trained to learn can have dramatic effects: testing retrieval, rather than merely studying items, can significantly improve retention [70].”
The Cognitive Science of Learning: Concepts and Strategies for the Educator and Learner
Weidman, J., & Baker, K. H. (2015) · Anesthesia & Analgesia · doi:10.1213/ane.0000000000000890 · Cited by 101
Using Twitter to Reinforce Classroom Concepts
Blessing, S. B., Blessing, J. S., & Fleck, B. K. B. (2012) · Teaching of Psychology · doi:10.1177/0098628312461484 · Cited by 75
Stone, C. B., & Wang, Q. (2019) · Topics in Cognitive Science · doi:10.1111/tops.12369 · Cited by 75
The requirement of BDNF for hippocampal synaptic plasticity is experience‐dependent
Aarse, J., Herlitze, S., & Manahan‐Vaughan, D. (2016) · Hippocampus · doi:10.1002/hipo.22555 · Cited by 74
Neural Correlates of Reactivation and Retrieval-Induced Distortion
Bridge, D. J., & Paller, K. A. (2012) · The Journal of Neuroscience · doi:10.1523/jneurosci.1378-12.2012 · Cited by 71
“subsequent memory have focused on the “testing effect” (Landauer and Bjork, 1978; Thompson et al., 1978; Carrier and Pashler, 1992; Wheeler and Roediger, 1992; Karpicke and Roediger, 2008; Roediger and Butler, 2011), which refers to the finding that recalling an associate in response to a cue during learning enhances…”
BackgroundResultInfluentialKrautter, M., Dittrich, R., Safi, A., Krautter, J., Maatouk, I., Möltner, A., Herzog, W., & Nikendei, C. (2015) · Advances in Medical Education and Practice · doi:10.2147/amep.s81923 · Cited by 96
QG-net: a data-driven question generation model for educational content
Wang, Z., Lan, A. S., Nie, W., Waters, A. E., Grimaldi, P. J., & Baraniuk, R. G. (2018) · Proceedings of the Fifth Annual ACM Conference on Learning at Scale · doi:10.1145/3231644.3231654 · Cited by 70
An Economic Appraisal of MOOC Platforms: Business Models and Impacts on Higher Education
Belleflamme, P., & Jacqmin, J. (2015) · CESifo Economic Studies · doi:10.1093/cesifo/ifv016 · Cited by 94
“MOOC platforms, leading to free-riding and suboptimal investments.(24) The latter argument suggests that it is supranational authorities that should invest in the development of MOOC platforms; yet, these authorities often lack the necessary funding resources and the relevant competencies in this field.”
BackgroundThe many faces of forgetting: Toward a constructive view of forgetting in everyday life.
Fawcett, J. M., & Hulbert, J. C. (2020) · Journal of Applied Research in Memory and Cognition · doi:10.1016/j.jarmac.2019.11.002 · Cited by 96
Eitel, A. (2015) · Learning and Instruction · doi:10.1016/j.learninstruc.2015.10.003 · Cited by 88
“…repeated studying (i.e., testing effect), because retrieval e as it will be required in the final test e is being practiced, and because testing typically leads to more elaboration of recalled information, thus producing stronger memory traces (Karpicke & Roediger, 2008; Roediger & Butler, 2011).”
BackgroundGradual acquisition of visuospatial associative memory representations via the dorsal precuneus
Schott, B. H., Wüstenberg, T., Lücke, E., Pohl, I., Richter, A., Seidenbecher, C. I., Pollmann, S., Kizilirmak, J. M., & Richardson‐Klavehn, A. (2018) · Human Brain Mapping · doi:10.1002/hbm.24467 · Cited by 77
Haebig, E., Leonard, L. B., Deevy, P., Karpicke, J. D., Christ, S. L., Usler, E. R., Kueser, J. B., Souto, S., Krok, W. C., & Weber, C. (2019) · Journal of Speech Language and Hearing Research · doi:10.1044/2018_jslhr-l-18-0071 · Cited by 83
Self-citationPractice induces a qualitative change in the memory representation for visuomotor learning
Huberdeau, D. M., Krakauer, J. W., & Haith, A. M. (2019) · Journal of Neurophysiology · doi:10.1152/jn.00830.2018 · Cited by 82
The effect of retrieval practice in primary school vocabulary learning
Goossens, N. A. M. C., Camp, G., Verkoeijen, P. P. J. L., & Tabbers, H. K. (2014) · Applied Cognitive Psychology · doi:10.1002/acp.2956 · Cited by 53
Strengthening a consolidated memory: The key role of the reconsolidation process
Forcato, C., Fernández, R. S., & Pedreira, M. E. (2014) · Journal of Physiology-Paris · doi:10.1016/j.jphysparis.2014.09.001 · Cited by 87
“The results showed that repeated study after learning had no effect on delayed recall, but that repeated testing enhanced the target memory (Karpicke and Roediger, 2008).”
BackgroundResultSpatial Representations in the Human Brain
Herweg, N. A., & Kahana, M. J. (2018) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2018.00297 · Cited by 81
Kooloos, J. G. M., Bergman, E. M., Scheffers, M. A. G. P., Schepens‐Franke, A. N., & Vorstenbosch, M. A. T. M. (2019) · Anatomical Sciences Education · doi:10.1002/ase.1924 · Cited by 150
“Many more studies examine the testing effect (e.g., Karpicke and Roediger, 2008; Larsen et al., 2008; Karpicke et al., 2014; Binks, 2018; Larsen, 2018), and all substantiate the effect of testing.”
BackgroundTo What Extent Do Study Habits Relate to Performance?
Walck-Shannon, E. M., Rowell, S. F., & Frey, R. F. (2021) · CBE—Life Sciences Education · doi:10.1187/cbe.20-05-0091 · Cited by 128
“As one example, students may feel that they have learned more if they reread a text passage multiple times than if they are quizzed on that same material (Karpicke and Roediger, 2008).”
Test‐enhanced learning of clinical reasoning: a crossover randomised trial
Raupach, T., Andresen, J. C., Meyer, K., Strobel, L., Koziolek, M., Jung, W., Brown, J., & Anders, S. (2016) · Medical Education · doi:10.1111/medu.13069 · Cited by 71
Leonard, L. B., Karpicke, J. D., Deevy, P., Weber, C., Christ, S. L., Haebig, E., Souto, S., Kueser, J. B., & Krok, W. C. (2019) · Journal of Speech Language and Hearing Research · doi:10.1044/2018_jslhr-l-18-0070 · Cited by 86
Self-citationThe costs and benefits of providing feedback during learning
Hays, M. J., Kornell, N., & Bjork, R. A. (2010) · Psychonomic Bulletin & Review · doi:10.3758/pbr.17.6.797 · Cited by 76
van den Broek, G. S. E., Takashima, A., Segers, E., & Verhoeven, L. (2018) · Language Learning · doi:10.1111/lang.12285 · Cited by 67
“For example, Karpicke and Roediger (2008) showed that when learners remembered the meaning of a new L2 word, practicing the retrieval of the word meaning from memory significantly enhanced performance on a translation test 1 week later, compared to a restudy condition in which words were repeatedly…”
BackgroundMethodFournier, K. A., Couret, J., Ramsay, J. B., & Caulkins, J. L. (2017) · Anatomical Sciences Education · doi:10.1002/ase.1677 · Cited by 68
“As a result, the repeated nature of the examination protocol in the current investigation may have resulted in greater improvements due to the benefits of repeated testing (Karpicke and Roediger, 2008; Gilley and Clarkston, 2014; Soderstrom et al., 2016).”
BackgroundMental Workload: Assessment, Prediction and Consequences
Wickens, C. D. (2017) · Communications in computer and information science · doi:10.1007/978-3-319-61061-0_2 · Cited by 95
Divide and correct: using clusters to grade short answers at scale
Brooks, M., Basu, S., Jacobs, C., & Vanderwende, L. (2014) · Proceedings of the first ACM conference on Learning @ scale conference · doi:10.1145/2556325.2566243 · Cited by 65
“Open-ended questions are more valuable for measuring understanding, application, and reasoning [11], and play a critical role in consolidating learning [9].”
BackgroundCommon Object Representations for Visual Production and Recognition
Fan, J. E., Yamins, D. L. K., & Turk‐Browne, N. B. (2018) · Cognitive Science · doi:10.1111/cogs.12676 · Cited by 78
Transformative neural representations support long-term episodic memory
Liu, J., Zhang, H., Yu, T., Ren, L., Ni, D., Yang, Q., Lu, B., Zhang, L., Axmacher, N., & Xue, G. (2021) · Science Advances · doi:10.1126/sciadv.abg9715 · Cited by 75
“Compared to repeated learning, repeated retrieval practice not only strengthens target memory ( 82 ) but also transforms memory representations, resulting in greater reliance on the frontoparietal region than on the visual cortex ( 80 ) and greater effects in the differentiation of competing memory…”
Computer-based learning of neuroanatomy: A longitudinal study of learning, transfer, and retention.
Chariker, J. H., Naaz, F., & Pani, J. R. (2011) · Journal of Educational Psychology · doi:10.1037/a0021680 · Cited by 72
“Additionally, this approach to learning conforms to what appears to be best practices in regard to optimizing long-term retention through repeated testing (e.g., Karpicke & Roediger, 2008).”
Sumowski, J. F., Chiaravalloti, N., & DeLuca, J. (2010) · Neuropsychology · doi:10.1037/a0017533 · Cited by 66
Durable Improvements in Prostate Cancer Screening from Online Spaced Education
Kerfoot, B. P., Lawler, E. V., Sokolovskaya, G., Gagnon, D., & Conlin, P. R. (2010) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2010.07.016 · Cited by 66
Karlsson Wirebring, L., Wiklund-Hornqvist, C., Eriksson, J., Andersson, M., Jonsson, B., & Nyberg, L. (2015) · Journal of Neuroscience · doi:10.1523/jneurosci.3550-14.2015 · Cited by 65
“There is also accumulating evidence that repeated testing can strengthen memory representations (Karpicke and Roediger, 2008; Roediger and Butler, 2011), and have beneficial effects relative to study at shorter (Wiklund-Hörnqvist et al., 2014) and longer retention intervals (Kornell et al., 2011).”
BackgroundPedraza, L. K., Sierra, R. O., Boos, F. Z., Haubrich, J., Quillfeldt, J. A., & Alvares, L. D. O. (2015) · Hippocampus · doi:10.1002/hipo.22527 · Cited by 78
Vorstenbosch, M. A. T. M., Klaassen, T. P. F. M., Kooloos, J. G. M., Bolhuis, S. M., & Laan, R. (2012) · Anatomical Sciences Education · doi:10.1002/ase.1290 · Cited by 64
Furman, O., Mendelsohn, A., & Dudai, Y. (2012) · Learning & Memory · doi:10.1101/lm.025965.112 · Cited by 65
Moscovitch, M., & Gilboa, A. (2021) · doi:10.31234/osf.io/yxbrs · Cited by 63
Huntley, C. D., Young, B., Temple, J., Longworth, M., Smith, C. T., Jha, V., & Fisher, P. (2019) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2019.01.007 · Cited by 99
Nakata, T., & Elgort, I. (2021) · Second Language Research · doi:10.1177/0267658320927764 · Cited by 62
“Conversely, L2 vocabulary research that is concerned with the effect of testing and retrieval (e.g. Barcroft, 2007, 2015a; Karpicke and Roediger, 2008; van den Broek et al., 2018) suggests that contextual vocabulary learning may benefit more from a spaced than massed repetition schedule.”
BackgroundResultKluge, A., & Frank, B. (2014) · Ergonomics · doi:10.1080/00140139.2013.869357 · Cited by 63
“Based on the research by Farr (1987), Bjork and Bjork (2006), Karpicke and Roediger (2008) and Roediger and Karpicke (2006), testing knowledge and skill is proposed as a promising approach for supporting knowledge and skill retention.”
BackgroundHaslam, C., Hodder, K. I., & Yates, P. J. (2011) · Journal of Clinical and Experimental Neuropsychology · doi:10.1080/13803395.2010.533155 · Cited by 63
“Giving a test with feedback has been shown to be more effective than incorporating an additional learning trial ( Pashler, Rohrer, Cepeda, & Carpenter, 2007 ) or simply repeating the information to be learned ( Karpicke & Roediger, 2008 ).”
MethodDecomposing Parietal Memory Reactivation to Predict Consequences of Remembering
Lee, H., Samide, R., Richter, F. R., & Kuhl, B. A. (2018) · Cerebral Cortex · doi:10.1093/cercor/bhy200 · Cited by 65
Improving Learning Efficiency of Factual Knowledge in Medical Education
Yeh, D. D., & Park, Y. S. (2015) · Journal of surgical education · doi:10.1016/j.jsurg.2015.03.012 · Cited by 70
Pop-up Questions Within Educational Videos: Effects on Students’ Learning
Haagsman, M. E., Scager, K., Boonstra, J., & Koster, M. C. (2020) · Journal of Science Education and Technology · doi:10.1007/s10956-020-09847-3 · Cited by 98
Optimizing Second Language Practice in the Classroom: Perspectives from Cognitive Psychology
Suzuki, Y., Nakata, T., & DEKEYSER, R. M. (2019) · Modern Language Journal · doi:10.1111/modl.12582 · Cited by 78
Miyatsu, T., & McDaniel, M. A. (2019) · Memory & Cognition · doi:10.3758/s13421-019-00936-2 · Cited by 64
The easily learned, easily remembered heuristic in children
Koriat, A., Ackerman, R., Lockl, K., & Schneider, W. (2009) · Cognitive Development · doi:10.1016/j.cogdev.2009.01.001 · Cited by 65
“These results suggest that although the commonly used dropout procedure in learning experiments (Karpicke & Roediger, 2008) ensures perfect recall of each item, the learning history of an item is nevertheless a powerful predictor of the likelihood that the item will be recalled in the future.”
BackgroundMethodResultDrawing to learn: How producing graphical representations enhances scientific thinking.
Fan, J. E. (2015) · Translational Issues in Psychological Science · doi:10.1037/tps0000037 · Cited by 72
Scales, C. D., Moin, T., Fink, A., Berry, S. H., Afsarmanesh, N., Mangione, C. M., & Kerfoot, B. P. (2016) · International Journal for Quality in Health Care · doi:10.1093/intqhc/mzw008 · Cited by 63
Cortico-subcortical neuronal circuitry associated with reconsolidation of human procedural memories
Censor, N., Dayan, E., & Cohen, L. G. (2014) · Cortex · doi:10.1016/j.cortex.2013.05.013 · Cited by 60
Stress and long-term memory retrieval: a systematic review
Klier, C., & Buratto, L. G. (2020) · Trends in Psychiatry and Psychotherapy · doi:10.1590/2237-6089-2019-0077 · Cited by 81
Chan, J. C. K., & Langley, M. M. (2010) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037/a0021204 · Cited by 73
Kang, S. H. K., Gollan, T. H., & Pashler, H. (2013) · Psychonomic Bulletin & Review · doi:10.3758/s13423-013-0450-z · Cited by 73
Executive Function, Self-Regulated Learning, and Reading Comprehension: A Training Study
Cirino, P. T., Miciak, J., Gerst, E. H., Barnes, M. A., Vaughn, S. R., Child, A. E., & Huston-Warren, E. (2016) · Journal of Learning Disabilities · doi:10.1177/0022219415618497 · Cited by 79
“…for every lesson text portion; (c) regular quizzing of recently read material, which has been supported as a strong learning technique (e.g., Karpicke & Roediger, 2006; Rawson & Dunlosky, 2013; Roediger, Putnam, & Smith, 2011); and (d) summarization; both active conditions were also (e)…”
BackgroundPlasticity of inhibition in older adults: retest practice and transfer effects.
Wilkinson, A. J., & Yang, L.-X. (2012) · Psychology and Aging · doi:10.1037/a0025926 · Cited by 45
“Third, mass practice does not allow much opportunity for repeated testing, which has been shown to be particularly beneficial for long-term memory (Karpicke & Roediger, 2008).”
Signed reward prediction errors drive declarative learning
Loof, E. D., Ergo, K., Naert, L., Janssens, C., Talsma, D., Filip Van Opstal, A., & Verguts, T. (2018) · PLoS ONE · doi:10.1371/journal.pone.0189212 · Cited by 52
“In a seminal publication, Karpicke and Roediger empirically manipulated the amount of study and test trials allotted to Swahili-English word pairs [38].”
BackgroundA Controlled Study of Clicker‐Assisted Memory Enhancement in College Classrooms
Shapiro, A. M., & Gordon, L. T. (2012) · Applied Cognitive Psychology · doi:10.1002/acp.2843 · Cited by 57
Retrieval-Based Learning in Children
Fazio, L. K., & Marsh, E. J. (2019) · Current Directions in Psychological Science · doi:10.1177/0963721418806673 · Cited by 57
“Critically, retrieval-based learning is useful even when memory fails (as long as feedback is provided; Pashler, Cepeda, Wixted, & Roher, 2005) and does not require metacognitive sophistication (even adults often fail to appreciate its benefits; Karpicke & Roediger, 2008).”
BackgroundThe peripheral effect of direct current stimulation on brain circuits involving memory
Vanneste, S., Mohan, A., Yoo, H. B., Huang, Y., Luckey, A. M., McLeod, S. L., Tabet, M. N., de Souza, R. R., McIntyre, C. K., Chapman, S. B., et al. (2020) · Science Advances · doi:10.1126/sciadv.aax9538 · Cited by 65
“Experiments 5, 6, 8, 9, and 10: Task All participants underwent a word association memory task that was based on the task of Karpicke and Roediger ( 57 ), which consisted of Swahili-English vocabulary learning.”
Neural signatures of test-potentiated learning in parietal cortex
Nelson, S. M., Arnold, K. M., Gilmore, A. W., & McDermott, K. B. (2013) · Journal of Neuroscience · doi:10.1523/jneurosci.0960-13.2013 · Cited by 57
“Although many studies have shown a difference at Final Test for Tested versus Restudied items (Karpicke and Roediger, 2008), the failure to find such a difference here is not surprising given the low accuracy or retrievability during initial testing (Kang et al.”
BackgroundResultInfluentialThe One-Trial Learning Controversy and Its Aftermath: Remembering Rock (1957)
Roediger, H. L., III, & Arnold, K. M. (2012) · The American Journal of Psychology · doi:10.5406/amerjpsyc.125.2.0127 · Cited by 59
“…studies of paired-associate learning, massive numbers of study trials lead to little or no effect on delayed tests, and the argument has been made that it is repeated testing and not repeated studying that is critical in paired-associate learning (Karpicke, 2009; Karpicke & Roediger, 2008).”
BackgroundSelf-citationBridge, D. J., & Voss, J. L. (2014) · The Journal of Neuroscience · doi:10.1523/jneurosci.3819-13.2014 · Cited by 56
““Testing effects” occur when retrieval of information during a memory test increases the likelihood that the same information will endure more than does simply restudying the information (Hogan and Kintsch, 1971; Runquist, 1983; Carrier and Pashler, 1992; Karpicke and Roediger, 2008).”
BackgroundThe neuroscience of active learning and direct instruction
Dubinsky, J. M., & Hamid, A. (2024) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2024.105737 · Cited by 150
“When learning paired associations, repeated recall under testing conditions is superior to simply viewing the pairings during repeated studying (Karpicke and Roediger, 2008) or even to manipulating the material when constructing a concept map (Karpicke and Blunt, 2011).”
BackgroundTesting to enhance retention in human anatomy
Logan, J. M., Thompson, A., & MARSHAK, D. W. (2011) · Anatomical Sciences Education · doi:10.1002/ase.250 · Cited by 65
“…including word lists (Thompson at al., 1978), associated word pairs (Logan and Balota, 2008), foreign vocabulary words (Carrier and Pashler, 1992; Karpicke and Roediger, 2008), prose passages (Glover, 1989; Chan et al., 2006; Roediger and Karpicke, 2006a), and lectures (Butler and Roediger,…”
BackgroundMethodInfluentialKeresztes, A., Kaiser, D., Kovács, G., & Racsmány, M. (2014) · Cerebral Cortex · doi:10.1093/cercor/bht158 · Cited by 56
Ecological Validity of the Testing Effect: The Use of Daily Quizzes in Introductory Psychology
Batsell, W. R., Perry, J. L., Hanley, E., & Hostetter, A. B. (2017) · Teaching of Psychology · doi:10.1177/0098628316677492 · Cited by 56
Kerfoot, B. P., Gagnon, D. R., McMahon, G. T., Orlander, J. D., Kurgansky, K. E., & Conlin, P. R. (2017) · Diabetes Care · doi:10.2337/dc17-0310 · Cited by 56
Martinelli, S. M., Isaak, R. S., Schell, R. M., Mitchell, J., McEvoy, M. D., & Chen, F. (2019) · Anesthesiology · doi:10.1097/aln.0000000000002827 · Cited by 63
“The act of retrieving a memory changes it, making it easier to retrieve again later, and increases long-term retention.(53,54) One example of this is the long-term retention of phone numbers that you regularly recall from memory as opposed to those you look up and enter from a contact list.”
BackgroundStenlund, T., Jönsson, F. U., & Jonsson, B. (2017) · Educational Psychology · doi:10.1080/01443410.2016.1143087 · Cited by 55
Collaborative Testing: Evidence of Learning in a Controlled In-Class Study of Undergraduate Students
Hollis Gilley, B., & Clarkston, B. (2014) · Journal of College Science Teaching · doi:10.2505/4/jcst14_043_03_83 · Cited by 54
Predicting as a learning strategy
Brod, G. (2021) · Psychonomic Bulletin & Review · doi:10.3758/s13423-021-01904-1 · Cited by 52
Wichert, S., Wolf, O. T., & Schwabe, L. (2011) · Behavioral Neuroscience · doi:10.1037/a0025235 · Cited by 54
“Our finding that memory retrieval may have a positive effect on subsequent recall performance is in line with the results of earlier studies (Carrier & Pashler, 1992; Karpicke & Roediger, 2008).”
ResultOvercoming the Negative Consequences of Interference From Recognition Memory Testing
Malmberg, K. J., Criss, A. H., Gangwani, T., & Shiffrin, R. M. (2012) · Psychological Science · doi:10.1177/0956797611430692 · Cited by 52
“Nevertheless, output interference in recognition testing may at first glance be surprising given the reports that testing memory enhances learning (e.g., Karpicke & Roediger, 2008) and given that practice usually enhances human performance (e.g., Anderson, 1982; Shiffrin & Schneider, 1977).”
ResultExploratory research on second language practice distribution: An Aptitude × Treatment interaction
SUZUKI, Y., & DEKEYSER, R. (2017) · Applied Psycholinguistics · doi:10.1017/s0142716416000084 · Cited by 54
Insights From the Science of Learning Can Inform Evidence-Based Implementation of Peer Instruction
Schell, J. A., & Butler, A. C. (2018) · Frontiers in Education · doi:10.3389/feduc.2018.00033 · Cited by 76
“…instruction that employs retrieval practice more effective: 1) Feedback—Retrieval practice is beneficial to learning even without feedback (e.g., Karpicke and Roediger, 2008), but it becomes evenmore effective when feedback is provided (Kang et al., 2007; Butler and Roediger, 2008) 2)…”
BackgroundBeason‐Abmayr, B., Caprette, D. R., & Gopalan, C. (2021) · AJP Advances in Physiology Education · doi:10.1152/advan.00248.2020 · Cited by 56
“Retrieval practice (15) occurs primarily throughmini-exams, which are given every other week and consist of several short answer questions (see below), and Minute Questions (MQ), which are short quizzes given at the beginning of class.”
BackgroundDevelopment of knowledge in basic sciences: a comparison of two medical curricula
Nouns, Z. M., Schauber, S. K., Witt, C. M., Kingreen, H., & Schüttpelz‐Brauns, K. (2012) · Medical Education · doi:10.1111/medu.12047 · Cited by 65
Can testing immunize memories against interference?
Potts, R., & Shanks, D. R. (2012) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/a0028218 · Cited by 53
Production Practice During Language Learning Improves Comprehension
Hopman, E. W. M., & MacDonald, M. C. (2018) · Psychological Science · doi:10.1177/0956797618754486 · Cited by 67
Larsen, D. (2018) · Seminars in Neurology · doi:10.1055/s-0038-1666983 · Cited by 53
Sleep in humans stabilizes pattern separation performance
Hanert, A., Weber, F. D., Pedersen, A., Born, J., & Bartsch, T. (2017) · The Journal of Neuroscience · doi:10.1523/jneurosci.1189-17.2017 · Cited by 52
“…however, aside from promoting extrahippocampal changes, are expected to also change the features of the hippocampal representation per se, possibly resembling the effects of re-encoding (Karpicke and Roediger, 2008; Received April 29, 2017; revised Sept. 20, 2017; accepted Sept. 27, 2017.”
BackgroundYe, Z., Shi, L., Li, A., Chen, C., & Xue, G. (2020) · eLife · doi:10.7554/elife.57023 · Cited by 63
Retrieval practice: A simple strategy for improving memory after traumatic brain injury
SUMOWSKI, J. F., WOOD, H. G., CHIARAVALLOTI, N., WYLIE, G. R., LENGENFELDER, J., & DELUCA, J. (2010) · Journal of the International Neuropsychological Society · doi:10.1017/s1355617710001128 · Cited by 51
“…shortly after it is presented (but before it is forgotten), that information is much more likely to be remembered in the future (e.g., Karpicke & Roediger, 2008 ), Memory impairment is common following traumatic brain injury (TBI), but interventions to improve memory in persons with TBI have…”
BackgroundThe Role of Self-monitoring in Learning Chemistry with Dynamic Visualizations
Chiu, J. L., & Linn, M. C. (2011) · Contemporary trends and issues in science education · doi:10.1007/978-94-007-2132-6_7 · Cited by 65
Taking the sting out of assessment: is there a role for progress testing?
Pugh, D., & Regehr, G. (2016) · Medical Education · doi:10.1111/medu.12985 · Cited by 61
Competence Assessment as Learner Support in Education
van der Vleuten, C. P. M., Sluijsmans, D. M. A., & Brinke, D. J.-T. (2016) · Technical and vocational education and training · doi:10.1007/978-3-319-41713-4_28 · Cited by 67
Dental Student Study Strategies: Are Self‐Testing and Scheduling Related to Academic Performance?
McAndrew, M., Morrow, C. S., Atiyeh, L., & Pierre, G. C. (2016) · Journal of Dental Education · doi:10.1002/j.0022-0337.2016.80.5.tb06114.x · Cited by 33
Using Quizzing to Assist Student Learning in the Classroom: The Good, the Bad, and the Ugly
Nguyen, K., & McDaniel, M. A. (2015) · Teaching of Psychology · doi:10.1177/0098628314562685 · Cited by 51
The Testing Effect for Learning Principles and Procedures from Texts
Dirkx, K. J. H., Kester, L., & Kirschner, P. A. (2014) · The Journal of Educational Research · doi:10.1080/00220671.2013.823370 · Cited by 51
Social Cognition in the Internet Age: Same As It Ever Was?
Sparrow, B., & Chatman, L. (2013) · Psychological Inquiry · doi:10.1080/1047840x.2013.827079 · Cited by 60
“Another interesting line of research would be the effect of interacting with a transactive memory partner such as the Internet on retrieval practice (Karpicke & Roediger, 2008; for a review see Karpicke, 2012; Karpicke & Grimaldi, 2012).”
BackgroundPrefrontal dopamine and the dynamic control of human long-term memory
Wimber, M., Schott, B. H., Wendler, F., Seidenbecher, C. I., Behnisch, G., Macharadze, T., Bäuml, K.-H. T., & Richardson-Klavehn, A. (2011) · Translational Psychiatry · doi:10.1038/tp.2011.15 · Cited by 51
“Typically, practicing recall of target information, while enhancing later memory for that information”
BackgroundThe effects of test-enhanced learning on long-term retention in AAN annual meeting courses
Larsen, D. P., Butler, A. C., Aung, W. Y., Corboy, J. R., Friedman, D. I., & Sperling, M. R. (2015) · Neurology · doi:10.1212/wnl.0000000000001264 · Cited by 57
Oh, S., Choi, H., Oh, E. G., & Lee, J. Y. (2022) · Patient Education and Counseling · doi:10.1016/j.pec.2022.11.001 · Cited by 68
Sleep’s role in the processing of unwanted memories: Sleep and processing of unwanted memories
FISCHER, S., DIEKELMANN, S., & BORN, J. (2011) · Journal of Sleep Research · doi:10.1111/j.1365-2869.2010.00881.x · Cited by 50
“…retrieval of these items had been practised during the think ⁄no-think 2010 European Sleep Research Society, J. Sleep Res., 20, 267–274 phase before the retention interval, which confirms that retrieval testing per se via re-encoding of traces strengthens memories (Karpicke and Roediger, 2008).”
BackgroundEvaluating quality learning in higher education: re-examining the evidence
Lodge, J. M., & Bosanquet, A. (2013) · Quality in Higher Education · doi:10.1080/13538322.2013.849787 · Cited by 64
Woolf, J. (. R. (2020) · Performance Enhancement & Health · doi:10.1016/j.peh.2020.100178 · Cited by 59
Differential neural contributions to native- and foreign-language talker identification.
Perrachione, T. K., Pierrehumbert, J. B., & Wong, P. C. M. (2009) · Journal of Experimental Psychology Human Perception & Performance · doi:10.1037/a0015869 · Cited by 53
Is the benefit of retrieval practice modulated by motivation?
Kang, S. H. K., & Pashler, H. (2014) · Journal of Applied Research in Memory and Cognition · doi:10.1016/j.jarmac.2014.05.006 · Cited by 49
Metadata
- Authors
- Karpicke, J. D., & Roediger, H. L.
- Affiliations
- Washington University in St. Louis (US)
- Department of Psychological Sciences, Purdue University, West Lafayette, IN 47907, USA.
- Corresponding author
- Karpicke, Jeffrey D.
- ORCID
- Karpicke, Jeffrey D.
- Venue
- Science
- Published
- 2008-02-15
- Volume
- 319
- Issue
- 5865
- Pages
- 966-968
- ISSN
- 0036-8075 (ISSN-L)
- 1095-9203
- OpenAlex
- W2092301601
- Cited by
- 1,791
- References
- 14
- Citations by year
- 2026: 91 · 2025: 100 · 2024: 109 · 2023: 112 · 2022: 151 · 2021: 123 · 2020: 115 · 2019: 103 · 2018: 143 · 2017: 103 · 2016: 98 · 2015: 113 · 2014: 85 · 2013: 101 · 2012: 81
- FWCI
- 28.60
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Science (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Memory Processes and Influences
- Social Sciences › Psychology › Developmental and Educational Psychology › Second Language Acquisition and Learning
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Visual and Cognitive Learning Processes
- Keywords
- retrieval practice, learning consolidation, foreign language vocabulary, retesting, delayed recall, self-assessment, memory retention
- MeSH terms
- Educational Measurement, Humans, Learning, Memory, Practice, Psychological, Mental Recall, Retention, Psychology, Students, Time Factors, Universities
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.