The Critical Importance of Retrieval for Learning
The DOI matches its Crossref record; 14 of the 14 references it cites were found in a registry or an index.
Abstract
Learning is often considered complete when a student can produce the correct answer to a question. In our research, students in one condition learned foreign language vocabulary words in the standard paradigm of repeated study-test trials. In three other conditions, once a student had correctly produced the vocabulary item, it was repeatedly studied but dropped from further testing, repeatedly tested but dropped from further study, or dropped from both study and test. Repeated studying after learning had no effect on delayed recall, but repeated testing produced a large positive effect. In addition, students' predictions of their performance were uncorrelated with actual performance. The results demonstrate the critical role of retrieval practice in consolidating learning and show that even university students seem unaware of this fact.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Second, repeated encounters can support retrieval processes, helping students recall words they have previously encountered during gameplay (Karpicke and Roediger, 2008; Nation, 2001; Roediger and Karpicke, 2006; Webb, 2007).”
From Incidental vocabulary learning from digital games: the predictive role of game playing time, foreign language motivation, and anxiety (2026) · cites this paper as Karpicke and Roediger, 2008
In the citing paper
“practice retrieval through answering questions significantly improves long-term retention (15,16).”
From Applying learning theories and instructional design models for effective instruction (2016) · cites this paper as [16]
In the citing paper
“practice retrieval through answering questions significantly improves long-term retention (15,16).”
From Applying learning theories and instructional design models for effective instruction (2016) · cites this paper as [15]
In the citing paper
“Whereas the reactivation of memories during wakefulness, as it occurs for example during rehearsal, can strengthen these memories in the long run (623, 1006), the reactivation transfers the representation into an transient unstable state such that memory is in need of reconsolidation (470, 718, 731, 844, 1033).”
From About Sleep's Role in Memory (2013) · cites this paper as [623]
In the citing paper
“Indeed there are data from other areas of cognitive neuroscience that demonstrate that repeating something that you have successfully learned is the best way to remember it (Chiviacowsky and Wulf, 2007; Karpicke and Roediger, 2008; Wulf and Shea, 2002).”
From Rethinking motor learning and savings in adaptation paradigms: model-free memory for successful actions combines with internal models (2011) · cites this paper as Karpicke and Roediger, 2008
6 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Test-Enhanced Learning: Taking Memory Tests Improves Long-Term Retention
Roediger, H. L., & Karpicke, J. D. (2006) · Psychological Science · doi:10.1111/j.1467-9280.2006.01693.x · Cited by 2,867
Self-citationMemory: A Contribution to Experimental Psychology
Ebbinghaus, H. (2013) · Annals of Neurosciences · doi:10.5214/ans.0972.7531.200408 · Cited by 2,827
Information Processing and Cognition: The Loyola Symposium
Brown, A. S., & Solso, R. L. (1976) · The American Journal of Psychology · doi:10.2307/1421430 · Cited by 2,382
The power of testing memory: Basic research and implications for educational practice
Roediger, H. L., & Karpicke, J. D. (2006) · Perspectives on Psychological Science · doi:10.1111/j.1745-6916.2006.00012.x · Cited by 2,037
Self-citationThe Psychology of Human Learning
Newman, E. B., McGeoch, J. A., & Irion, A. L. (1953) · The American Journal of Psychology · doi:10.2307/1418975 · Cited by 792
Repeated retrieval during learning is the key to long-term retention☆
KARPICKE, J., & ROEDIGERIII, H. (2007) · Journal of Memory and Language · doi:10.1016/j.jml.2006.09.004 · Cited by 598
Self-citationThe influence of retrieval on retention
Carrier, M., & Pashler, H. (1992) · Memory & Cognition · doi:10.3758/bf03202713 · Cited by 575
The promise and perils of self-regulated study
Kornell, N., & Bjork, R. A. (2007) · Psychonomic Bulletin & Review · doi:10.3758/bf03194055 · Cited by 527
The effects of presentation and recall of material in free-recall learning
Tulving, E. (1967) · Journal of Verbal Learning and Verbal Behavior · doi:10.1016/s0022-5371(67)80092-6 · Cited by 402
Thiede, K. W., & Dunlosky, J. (1999) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037//0278-7393.25.4.1024 · Cited by 396
Research works printed but not linked: 4
- A. I. Gates, Arch. Psychol.6, 1 (1917).
- W. F. Battig, Psychon. Sci. Monogr.1 (suppl.), 1 (1965).
- J. Dunlosky, K. Rawson, S. McDonald, in Applied Metacognition, T. Perfect, B. Schwartz, Eds. (Cambridge Univ. Press, Cambridge, 2002), pp. 68–92.
- J. D. Karpicke thesis Washington University St. Louis MO (2007).
Cited by
Items 101–200 of 1,789
“Concreteness fading” promotes transfer of mathematical knowledge
McNeil, N. M., & Fyfe, E. R. (2012) · Learning and Instruction · doi:10.1016/j.learninstruc.2012.05.001 · Cited by 168
Is expanding retrieval a superior method for learning text materials?
Karpicke, J. D., & Roediger, H. L. (2010) · Memory & Cognition · doi:10.3758/mc.38.1.116 · Cited by 137
Self-citationHopkins, R. F., Lyle, K. B., Hieb, J. L., & Ralston, P. A. S. (2016) · Educational Psychology Review · doi:10.1007/s10648-015-9349-8 · Cited by 136
“…of acquisition), additional retrieval increases the likelihood of long-term retention far more than additional restudy does (e.g., Karpicke 2009; Karpicke and Roediger 2008) and lengthening temporal intervals between retrieval opportunities (i.e., spacing) increases their beneficial impact…”
BackgroundA buffer model of memory encoding and temporal correlations in retrieval.
Lehman, M., & Malmberg, K. J. (2013) · Psychological Review · doi:10.1037/a0030851 · Cited by 130
“The accu- mulation of context features plays an important role in free recall (Malmberg & Shiffrin, 2005), and recent findings suggest that retrieval enhances memory more than does additional study (Karpicke & Roediger, 2008).”
BackgroundImpairing existing declarative memory in humans by disrupting reconsolidation
Chan, J. C. K., & LaPaglia, J. A. (2013) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1218472110 · Cited by 133
“When retrieval of a learned response is ascertained through a memory test, the results almost unequivocally show that retrieval actually makes the original memory less, not more, susceptible to interference (17-20).”
BackgroundThe novelty exploration bonus and its attentional modulation☆
Krebs, R. M., Schott, B. H., Schütze, H., & Düzel, E. (2009) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2009.01.015 · Cited by 131
Effectiveness of simplified 15-min refresher BLS training program: A randomized controlled trial
Nishiyama, C., Iwami, T., Murakami, Y., Kitamura, T., Okamoto, Y., Marukawa, S., Sakamoto, T., & Kawamura, T. (2015) · Resuscitation · doi:10.1016/j.resuscitation.2015.02.015 · Cited by 136
When generating a prediction boosts learning: The element of surprise
Brod, G., Hasselhorn, M., & Bunge, S. A. (2018) · Learning and Instruction · doi:10.1016/j.learninstruc.2018.01.013 · Cited by 131
Rethinking inhibition theory: On the problematic status of the inhibition theory for forgetting
Raaijmakers, J. G. W., & Jakab, E. (2012) · Journal of Memory and Language · doi:10.1016/j.jml.2012.10.002 · Cited by 146
“…that restudy and retrieval testing are supposed to be equally effective learning conditions, is remarkable in light of the recent findings by Roediger and his associates (see e.g. Karpicke & Roediger, 2008) concerning the large differences between these two conditions when tested after a delay.”
ResultStudent-directed retrieval practice is a predictor of medical licensing examination performance
Deng, F., Gluckstein, J. A., & Larsen, D. P. (2015) · Perspectives on Medical Education · doi:10.1007/s40037-015-0220-x · Cited by 130
“[2].”
Learning anatomy enhances spatial ability
Vorstenbosch, M. A. T. M., Klaassen, T. P. F. M., Donders, A. R. T., Kooloos, J. G. M., Bolhuis, S. M., & Laan, R. (2013) · Anatomical Sciences Education · doi:10.1002/ase.1346 · Cited by 144
“The reported increase in repeated MRTs without any training strongly suggests that there is a testing effect (Karpicke and Roediger, 2008; Larsen et al., 2008).”
BackgroundJacoby, L. L., Wahlheim, C. N., & Coane, J. H. (2010) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037/a0020636 · Cited by 127
Separate mnemonic effects of retrieval practice and elaborative encoding
Karpicke, J. D., & Smith, M. A. (2012) · Journal of Memory and Language · doi:10.1016/j.jml.2012.02.004 · Cited by 91
“…3, subjects studied and recalled SwahiliEnglish word pairs, and once items were recalled in the initial learning phase the words were dropped, repeatedly studied, or repeatedly retrieved (as in Experiments 1 and 2; see too Karpicke, 2009; Karpicke & Bauernschmidt, 2011; Karpicke & Roediger, 2008).”
BackgroundMethodInfluentialSelf-citationImproving self-regulated learning with a retrieval practice intervention.
Ariel, R., & Karpicke, J. D. (2018) · Journal of Experimental Psychology: Applied · doi:10.1037/xap0000133 · Cited by 124
Self-citationDividing attention in the classroom reduces exam performance
Glass, A. L., & Kang, M. (2019) · Educational Psychology · doi:10.1080/01443410.2018.1489046 · Cited by 125
“The specific effect on only long-term retention has been confirmed by both laboratory (Karpicke & Roediger, 2007, 2008) and classroom studies (Glass, Ingate, & Sinha, 2013).”
BackgroundResultCovert retrieval practice benefits retention as much as overt retrieval practice.
Smith, M. A., Roediger, H. L., & Karpicke, J. D. (2013) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/a0033569 · Cited by 124
Self-citationBeyond “formative”: assessments to enrich student learning
Kulasegaram, K. M., & Rangachari, P. K. (2018) · AJP Advances in Physiology Education · doi:10.1152/advan.00122.2017 · Cited by 190
A review of the benefits and drawbacks of high-stakes final examinations in higher education
French, S., Dickerson, A., & Mulder, R. A. (2024) · Higher Education · doi:10.1007/s10734-023-01148-z · Cited by 126
“Many studies provide empirical evidence that addressing questions in tests and exams can improve memory recall and the retention of information (Butler & Roediger, 2007; Deng et al., 2015; Karpicke & Roediger, 2008; McDaniel et al., 2007; Roediger & Karpicke, 2006).”
Voss, J. L., Warren, D. E., Gonsalves, B. D., Federmeier, K. D., Tranel, D., & Cohen, N. J. (2011) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1100225108 · Cited by 121
Phillips, J. L., Heneka, N., Bhattarai, P., Fraser, C., & Shaw, T. (2019) · Medical Education · doi:10.1111/medu.13895 · Cited by 120
Language Use Contributes to Expressive Language Growth: Evidence From Bilingual Children
Ribot, K. M., Hoff, E., & Burridge, A. B. (2017) · Child Development · doi:10.1111/cdev.12770 · Cited by 142
“Research in learning and memory has found that the process of retrieval benefits learning, although the mechanism underlying that benefit is not clear (Karpicke & Roediger, 2008; Roediger & Butler, 2011).”
BackgroundMetacognition of the testing effect: Guiding learners to predict the benefits of retrieval
Tullis, J. G., Finley, J. R., & Benjamin, A. S. (2013) · Memory & Cognition · doi:10.3758/s13421-012-0274-5 · Cited by 118
“Karpicke and Roediger (2008) thus argued that " students exhibit no awareness of the mnemonic effects of retrieval practice " (p. 968).”
BackgroundMcDaniel, M. A., & Einstein, G. O. (2020) · Perspectives on Psychological Science · doi:10.1177/1745691620920723 · Cited by 103
“Many studies have shown that judgments of learning frequently do not accurately predict learning results (e.g., Karpicke & Roediger, 2008; Kirk-Johnson et al., Corresponding Author: Mark A. McDaniel, Department of Psychological and Brain Sciences, Washington University, 1 Brookings Dr., St. Louis,…”
BackgroundCooper, M. M. (2015) · Journal of Chemical Education · doi:10.1021/acs.jchemed.5b00203 · Cited by 131
Neural correlates of retrieval-based memory enhancement: an fMRI study of the testing effect
Wing, E. A., Marsh, E. J., & Cabeza, R. (2013) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2013.04.004 · Cited by 111
Toppino, T. C., & Gerbier, É. (2013) · The Psychology of learning and motivation/The psychology of learning and motivation · doi:10.1016/b978-0-12-800090-8.00004-4 · Cited by 137
Classes That Click: Fast, Rich Feedback to Enhance Student Learning and Satisfaction
Chen, J. C., Whittinghill, D. C., & Kadlowec, J. A. (2010) · Journal of Engineering Education · doi:10.1002/j.2168-9830.2010.tb01052.x · Cited by 111
“Recent research (Karpicke and Roediger, 2008) has changed this view.”
Larsen, D. P., Butler, A. C., Lawson, A. L., & Roediger, H. L., III (2012) · Advances in Health Sciences Education · doi:10.1007/s10459-012-9379-7 · Cited by 129
Self-citationNawrot, I., & Doucet, A. (2014) · HAL · Cited by 117
Think3d!: Training Spatial Thinking Fundamental to STEM Education
Taylor, H. A., & Hutton, A. (2013) · Cognition and Instruction · doi:10.1080/07370008.2013.828727 · Cited by 130
Learning as a Generative Activity: Eight Learning Strategies that Promote Understanding
Fiorella, L., & Mayer, R. E. (2015) · Cited by 109
Integrating Cognitive Science and Technology Improves Learning in a STEM Classroom
Butler, A. C., Marsh, E. J., Slavinsky, J. P., & Baraniuk, R. G. (2014) · Educational Psychology Review · doi:10.1007/s10648-014-9256-4 · Cited by 122
“Previous studies have achieved large positive effects on learning by completely changing the curriculum and pedagogy (e.g., Deslauriers et al. 2011) or using carefully controlled laboratory conditions and simple materials (e.g., Karpicke and Roediger 2008).”
BackgroundResultLarge Language Models in Medical Education: Comparing ChatGPT- to Human-Generated Exam Questions
Laupichler, M. C., Rother, J. F., Grunwald Kadow, I. C., Ahmadi, S., & Raupach, T. (2024) · Academic Medicine · doi:10.1097/acm.0000000000005626 · Cited by 107
The Necessary Nine: Design Principles for Embodied VR and Active Stem Education
Johnson-Glenberg, M. C. (2019) · Smart Computing and Intelligence · doi:10.1007/978-981-13-8265-9_5 · Cited by 107
Long-term effects of testing on the recall of nontested materials
Chan, J. C. K. (2010) · Memory · doi:10.1080/09658210903405737 · Cited by 105
“This interest stems mainly from the fact that testing has been established as one of the most powerful memory enhancers available (Carpenter et al., 2007; Karpicke & Roediger, 2008; McDaniel et al., 2007b).”
BackgroundInfluentialUsing electronic flashcards to promote learning in medical students: retesting versus restudying
Schmidmaier, R., Ebersbach, R., Schiller, M., Hege, I., Holzer, M., & Fischer, M. R. (2011) · Medical Education · doi:10.1111/j.1365-2923.2011.04043.x · Cited by 104
The role of sleep in motor sequence consolidation: stabilization rather than enhancement
Nettersheim, A., Hallschmid, M., Born, J., & Diekelmann, S. (2015) · The Journal of Neuroscience · doi:10.1523/jneurosci.1236-14.2015 · Cited by 104
“In the declarative memory domain, it is well known that retrieval sessions represent powerful means to strengthen the memory trace, even more so than actual relearning sessions (Roediger and Karpicke, 2006; Karpicke and Roediger, 2008).”
BackgroundTest-enhanced learning in health professions education: A systematic review: BEME Guide No. 48
Green, M. L., Moeller, J. J., & Spak, J. M. (2018) · Medical Teacher · doi:10.1080/0142159x.2018.1430354 · Cited by 112
“Repeated testing promotes better recall than a long single test (Wheeler and Roediger 1992; Karpicke and Roediger 2008).”
BackgroundVasalou, A., Khaled, R., Holmes, W., & Gooch, D. (2017) · Computers & Education · doi:10.1016/j.compedu.2017.06.009 · Cited by 136
“Recognizing the important role of reinforcement in learning (Brooks, 2007; Karpicke & Roediger, 2008; Rose, 2009), the mini games present in Words Matter draw on a drill and practice approach whereby students are called to practise each sub difficulty in order to achieve game progress.”
A neural substrate in the human hippocampus for linking successive events
Paz, R., Gelbard-Sagiv, H., Mukamel, R., Harel, M., Malach, R., & Fried, I. (2010) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0910834107 · Cited by 100
“This interpretation also would fit with the remarkable correlation we found between the neuronal measure and the subsequent individual memory, because it has been shown that memory retrieval improves subsequent memory performance (36).”
ResultMaking long-term memories in minutes: a spaced learning pattern from memory research in education
Kelley, P., & Whatson, T. (2013) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2013.00589 · Cited by 103
“, 1997) where spacing retrieval practice is known to be effective in improving retrieval, and the greater impact of retrieval practice over further learning practice appears to be a key factor in improving retrieval (Karpicke and Roediger, 2008).”
BackgroundDaily Online Testing in Large Classes: Boosting College Performance while Reducing Achievement Gaps
Pennebaker, J. W., Gosling, S. D., & Ferrell, J. D. (2013) · PLoS ONE · doi:10.1371/journal.pone.0079774 · Cited by 101
“In addition to the effects in improving retention and retrieval [18–20], the quizzes simultaneously accomplished several goals likely to promote self-regulated learning [5–6].”
BackgroundBernacki, M. L., Vosicka, L., & Utz, J. C. (2020) · Journal of Educational Psychology · doi:10.1037/edu0000405 · Cited by 82
Hong, W., Bernacki, M. L., & Perera, H. N. (2020) · Journal of Educational Psychology · doi:10.1037/edu0000445 · Cited by 143
A common mechanism for adaptive scaling of reward and novelty
Bunzeck, N., Dayan, P., Dolan, R. J., & Duzel, E. (2010) · Human Brain Mapping · doi:10.1002/hbm.20939 · Cited by 100
“…2005], and behavioral evidence for this suggestion is the so-called ‘‘testing’’ phenomenon: this refers to the observation that the mere retrieval of memories is an efficient mechanism to improve episodic memory [Buckner et al., 2001; Chan and McDermott, 2007; Karpicke and Roediger, 2008].”
BackgroundLexical integration of novel words without sleep.
Lindsay, S., & Gaskell, M. G. (2013) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/a0029243 · Cited by 101
How Retrieval Attempts Affect Learning
Kornell, N., & Vaughn, K. E. (2016) · The Psychology of learning and motivation/The psychology of learning and motivation · doi:10.1016/bs.plm.2016.03.003 · Cited by 126
Memory in Elementary School Children Is Improved by an Unrelated Novel Experience
Ballarini, F., Martínez, M. C., Perez, M. D., Moncada, D., & Viola, H. (2013) · PLoS ONE · doi:10.1371/journal.pone.0066875 · Cited by 117
“executive functions, memory, attention, processing speed) through transference, generalization and retrieval [19,20,21,22,23].”
BackgroundRivers, M. L. (2021) · Educational Psychology Review · doi:10.1007/s10648-020-09578-2 · Cited by 81
Kerfoot, B. P., Kearney, M. C., Connelly, D., & Ritchey, M. L. (2009) · Annals of Surgery · doi:10.1097/sla.0b013e31819f6db8 · Cited by 98
“Rather, testing actually alters the learning process itself to significantly improve knowledge retention.(10,11) Although ISE has been shown to be an effective and wellaccepted form of online education for medical students,(2,6) it is not known whether ISE is similarly effective for graduate medical education (GME) or…”
BackgroundStrengthening concept learning by repeated testing
Wiklund‐Hörnqvist, C., Jonsson, B., & Nyberg, L. (2014) · Scandinavian Journal of Psychology · doi:10.1111/sjop.12093 · Cited by 75
“E-mail: Carola.WiklundHornkvist@psy.umu.se”
BackgroundWhy is test–restudy practice beneficial for memory? An evaluation of the mediator shift hypothesis.
Pyc, M. A., & Rawson, K. A. (2012) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/a0026166 · Cited by 98
“Finally, testing effects have been demonstrated across the lifespan including preschool-aged children (e.g., Fritz, Morris, Nolan, & Singleton, 2007), young adults (e.g., Karpicke & Roediger, 2008), and older adults (e.g., Logan & Balota, 2008).”
MethodXue, G., Dong, Q., Chen, C., Lu, Z.-L., Mumford, J. A., & Poldrack, R. A. (2013) · Cerebral Cortex · doi:10.1093/cercor/bhs143 · Cited by 91
Building creative thinking in the classroom: From research to practice
Gregory, E., Hardiman, M. M., Yarmolinskaya, J., Rinne, L. F., & Limb, C. J. (2013) · International Journal of Educational Research · doi:10.1016/j.ijer.2013.06.003 · Cited by 136
Nakata, T. (2017) · Studies in Second Language Acquisition · doi:10.1017/s0272263116000280 · Cited by 94
“(Note that because the focus of this study is the effects of retrieval frequency, studies that manipulated the frequency of successful retrievals during learning [e.g., Karpicke & Roediger, 2008] will not be discussed in detail.)”
BackgroundInfluentialRetrieval attempts enhance learning, but retrieval success (versus failure) does not matter.
Kornell, N., Klein, P. J., & Rawson, K. A. (2015) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/a0037850 · Cited by 92
The cognitive principles of learning underlying the 5E Model of Instruction
Martín, H. R., & Bybee, R. W. (2022) · International Journal of STEM Education · doi:10.1186/s40594-022-00337-z · Cited by 177
“Experimental reports from the beginning of the twentieth century through to today have proven him right: retrieval enhances retention (Karpicke & Roediger, 2008).”
BackgroundA Classroom Study on the Relationship Between Student Achievement and Retrieval-Enhanced Learning
Carpenter, S. K., Lund, T. J. S., Coffman, C. R., Armstrong, P. I., Lamm, M. H., & Reason, R. D. (2015) · Educational Psychology Review · doi:10.1007/s10648-015-9311-9 · Cited by 113
Learnersourcing Subgoal Labels for How-to Videos
Weir, S., Kim, J., Gajos, K. Z., & Miller, R. C. (2015) · ACM Conference on Computer Supported Cooperative Work (CSCW) · doi:10.1145/2675133.2675219 · Cited by 111
“Existing online learning platforms such as Coursera add frequent micro-quizzes inside videos to help people learn better from video lectures, and research on retrieval practice might provide support for in-video quizzes [12, 13].”
BackgroundVirtual patient simulation: Knowledge gain or knowledge loss?
Botezatu, M., Hult, H., Tessma, M. K., & Fors, U. (2010) · Medical Teacher · doi:10.3109/01421590903514630 · Cited by 89
What if learning analytics were based on learning science?
Marzouk, Z., Rakovic, M., Liaqat, A., Vytasek, J., Samadi, D., Stewart-Alonso, J., Ram, I., Woloshen, S., Winne, P. H., & Nesbit, J. C. (2016) · Australasian Journal of Educational Technology · doi:10.14742/ajet.3058 · Cited by 89
Boers, F., Dang, T. C. T., & Strong, B. (2016) · Language Teaching Research · doi:10.1177/1362168816651464 · Cited by 103
Neural reactivation in parietal cortex enhances memory for episodically linked information
Jonker, T. R., Dimsdale-Zucker, H., Ritchey, M., Clarke, A., & Ranganath, C. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1800006115 · Cited by 80
“For example, recent work (4, 5) has shown that memory retrieval substantially improves long-term retention relative to reexposure to the same information, a phenomenon referred to as the testing effect.”
BackgroundPredicting achievement and providing support before STEM majors begin to fail
Bernacki, M. L., Chavez, M. M., & Uesbeck, P. M. (2020) · Computers & Education · doi:10.1016/j.compedu.2020.103999 · Cited by 88
Kornell, N. (2014) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/a0033699 · Cited by 88
Reber, R., & Greifeneder, R. (2017) · Educational Psychologist · doi:10.1080/00461520.2016.1258173 · Cited by 87
“However, students not only retrieve information during a multiple-choice test but also learn new information, as the so-called testing effect demonstrates (see Karpicke & Roediger, 2008; McDaniel, Roediger, & McDermott, 2007; Roediger & Karpicke, 2006).”
BackgroundNon Pharmacological Cognitive Enhancers – Current Perspectives
Sachdeva, A., Kumar, K., & Anand, K. S. (2015) · JOURNAL OF CLINICAL AND DIAGNOSTIC RESEARCH · doi:10.7860/jcdr/2015/13392.6186 · Cited by 97
“But mnemonics have not proved effective in age-related cognitive decline [66].”
BackgroundInducing amnesia through systemic suppression
Hulbert, J. C., Henson, R. N., & Anderson, M. C. (2016) · Nature Communications · doi:10.1038/ncomms11003 · Cited by 85
Distributed retrieval practice promotes superior recall of anatomy information
Dobson, J. L., Perez, J., & Linderholm, T. (2017) · Anatomical Sciences Education · doi:10.1002/ase.1668 · Cited by 85
“In contrast, reviewing and then testing one’s memory of a set of notes may not lead to good immediate recall, but leads to superior long-term recall and greater protection from forgetting (Roediger and Karpicke, 2006; Karpicke and Roediger, 2008; Karpicke et al., 2014).”
Does response mode affect amount recalled or the magnitude of the testing effect?
Putnam, A. L., & Roediger, H. L. (2013) · Memory & Cognition · doi:10.3758/s13421-012-0245-x · Cited by 86
Different but Equal? How Nonmajors and Majors Approach and Learn Genetics
Knight, J., & Smith, M. K. (2010) · CBE—Life Sciences Education · doi:10.1187/cbe.09-07-0047 · Cited by 88
“Working on these activities and taking the quizzes was intended to give students extra practice applying fundamental concepts to new situations (application, or transfer) and in-class testing opportunities, a technique shown by cognitive psychologists to improve retention (Karpicke and Roediger, 2008).”
BackgroundVoderholzer, U., Piosczyk, H., Holz, J., Landmann, N., Feige, B., Loessl, B., Kopasz, M., Doerr, J. P., Riemann, D., & Nissen, C. (2011) · Sleep Medicine · doi:10.1016/j.sleep.2010.07.017 · Cited by 85
“It is well known that repeated testing has an influence on retrieval performance in declarative memory tasks [52].”
BackgroundNeural correlates of testing effects in vocabulary learning
van den Broek, G. S. E., Takashima, A., Segers, E., Fernández, G., & Verhoeven, L. (2013) · NeuroImage · doi:10.1016/j.neuroimage.2013.03.071 · Cited by 85
“Replicating previous behavioral results, delayed recall was better and faster for tested words than for restudied words (e.g., Karpicke and Roediger, 2008; Roediger and Karpicke, 2006a,b).”
Optimizing Learning in College: Tips From Cognitive Psychology
Putnam, A. L., Sungkhasettee, V. W., & Roediger, H. L. (2016) · Perspectives on Psychological Science · doi:10.1177/1745691616645770 · Cited by 84
Self-citationHead to head: The role of academic competition in undergraduate anatomical education
Van Nuland, S. E., Roach, V. A., Wilson, T. D., & Belliveau, D. J. (2015) · Anatomical Sciences Education · doi:10.1002/ase.1498 · Cited by 84
“…and cognition have shown that repeated testing of a learner’s long-term memory leads to greater retention of information than does repeated reading of the same information (Spitzer, 1939; Glover, 1989; Roediger and Karpicke, 2006a,b; Karpicke and Roediger, 2008; Karpicke and Blunt, 2011).”
BackgroundNakata, T., & Webb, S. (2016) · Studies in Second Language Acquisition · doi:10.1017/s0272263115000236 · Cited by 82
“…assume that learning involves retrieval, whereby learners are asked to recall information about the L2 word from memory because research shows that retrieval increases learning (e.g., Barcroft, 2007 ; Karpicke & Roediger, 2008 ; Pashler, Rohrer, Cepeda, & Carpenter, 2007 ; Rohrer & Pashler, 2007 ).”
BackgroundLi, Y., & Hafner, C. A. (2021) · ReCALL · doi:10.1017/s0958344021000161 · Cited by 144
“The results are consistent with the finding that retrieval of material significantly increases L2 vocabulary learning (Barcroft, 2007; Karpicke & Roediger, 2008).”
ResultIntegration of medical imaging including ultrasound into a new clinical anatomy curriculum
Moscova, M., Bryce, D. A., Sindhusake, D. P., & Young, N. (2014) · Anatomical Sciences Education · doi:10.1002/ase.1481 · Cited by 95
“As repeated retrieval practice has been shown to improve longterm retention of knowledge, creating opportunities for students to self-test their knowledge should be a priority (Karpicke and Roediger, 2008).”
BackgroundWeinstein, Y., McDermott, K. B., & Roediger, H. L. (2010) · Journal of Experimental Psychology: Applied · doi:10.1037/a0020992 · Cited by 83
“Karpicke and Roediger (2008) found that students did not expect any change in retention following retrieval practice, and Agarwal, Karpicke, Kang, Roediger, and McDermott (2008) found that students predicted the same level of performance after testing as after restudy.”
BackgroundSelf-citationFamiliarity and retrieval processes in delayed judgments of learning.
Metcalfe, J., & Finn, B. (2008) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/a0012580 · Cited by 83
“A number of research reports have shown that testing and retrieval have beneficial effects on later memory (e.g., Butler & Roediger, 2007; Karpicke & Roediger, 2008; McDaniel & Fisher, 1991; McDaniel, Kowitz, & Dunay, 1989; McDaniel & Masson, 1985; Roediger & Karpicke, 2006; Pashler, Cepeda, Wixted, & Rohrer, 2005; Pa…”
Retrieval-Based Learning: Positive Effects of Retrieval Practice in Elementary School Children
Karpicke, J. D., Blunt, J. R., & Smith, M. A. (2016) · Frontiers in Psychology · doi:10.3389/fpsyg.2016.00350 · Cited by 82
“…latter assumption, a wealth of research has demonstrated the powerful benefits of retrieval with a variety of materials such as word lists (e.g., Karpicke and Roediger, 2007, 2008; Pyc and Rawson, 2009, 2010) and educationally relevant texts (e.g., Roediger and Karpicke, 2006b; McDaniel et al.,…”
BackgroundSelf-citationAdaptive spaced education improves learning efficiency: A randomized controlled trial
Kerfoot, B. P. (2010) · Journal of Urology · doi:10.1016/j.juro.2009.10.005 · Cited by 81
Tse, C.-S., Balota, D. A., & Roediger, H. L. (2010) · Psychology and Aging · doi:10.1037/a0019933 · Cited by 80
Test‐enhanced learning and its effect on comprehension and diagnostic accuracy
Baghdady, M., Carnahan, H., Lam, E. W. N., & Woods, N. N. (2014) · Medical Education · doi:10.1111/medu.12302 · Cited by 79
Encoding Deficits Impede Word Learning and Memory in Adults With Developmental Language Disorders
McGregor, K. K., Gordon, K. R., Eden, N. M., Arbisi-Kelm, T., & Oleson, J. (2017) · Journal of Speech Language and Hearing Research · doi:10.1044/2017_jslhr-l-17-0031 · Cited by 95
“For example, college students who engaged in repeated testing of Swahili– English word pairs that required them to retrieve the words repeatedly recalled more words a week later than students who engaged in repeated study trials (Karpicke & Roediger, 2008).”
BackgroundSavi, A. O., Marsman, M., van der Maas, H. L. J., & Maris, G. K. J. (2019) · Perspectives on Psychological Science · doi:10.1177/1745691619866447 · Cited by 73
“Very much related to forgetting are the well-established testing and spacing effects (e.g., Karpicke & Roediger, 2008).”
BackgroundUsing Testing as a Learning Tool
Yang, B. W., Razo, J. F., & Persky, A. M. (2019) · American Journal of Pharmaceutical Education · doi:10.5688/ajpe7324 · Cited by 108
“While repeated studying improves recall in the short term (eg, five minutes after studying), testing improves recall over longer intervals (eg, after a week).(19) Other study techniques show a similar pattern, such as spacing studying out over time and interleaving different topics in practice rather than blocking the…”
BackgroundResultTowards Human-Like Educational Question Generation with Large Language Models
Wang, Z., Valdez, J., Mallick, D. B., & Baraniuk, R. G. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-11644-5_13 · Cited by 145
Immediate lexical integration of novel word forms
Kapnoula, E. C., Packard, S., Gupta, P., & McMurray, B. (2014) · Cognition · doi:10.1016/j.cognition.2014.09.007 · Cited by 91
Self-testing promotes superior retention of anatomy and physiology information
Dobson, J. L., & Linderholm, T. (2014) · Advances in Health Sciences Education · doi:10.1007/s10459-014-9514-8 · Cited by 91
Worth the Effort: the Start and Stick to Desirable Difficulties (S2D2) Framework
de Bruin, A. B. H., Biwer, F., Hui, L., Onan, E., David, L., & Wiradhany, W. (2023) · Educational Psychology Review · doi:10.1007/s10648-023-09766-w · Cited by 109
“For example, when using retrieval practice, learning effects are not immediately visible but appear only after a delay (Karpicke & Roediger, 2008; Nunes & Karpicke, 2015).”
MethodEnhancing visuospatial learning: The benefit of retrieval practice
Kang, S. H. K. (2010) · Memory & Cognition · doi:10.3758/mc.38.8.1009 · Cited by 104
The Oxford Handbook of the Mental Lexicon
Papafragou, A., Trueswell, J. C., & Gleitman, L. R. (2022) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780198845003.001.0001 · Cited by 88
Rose, N. S., Myerson, J., Roediger, H. L., III, & Hale, S. (2010) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037/a0018405 · Cited by 104
Self-citationUngraded Pop Quizzes: Test-Enhanced Learning Without All the Anxiety
Khanna, M. M. (2015) · Teaching of Psychology · doi:10.1177/0098628315573144 · Cited by 77
Building knowledge requires bricks, not sand: The critical role of familiar constituents in learning
Reder, L. M., Liu, X. L., Keinath, A., & Popov, V. (2015) · Psychonomic Bulletin & Review · doi:10.3758/s13423-015-0889-1 · Cited by 91
“…& Teschromer, 1993), distributed practice (Glenberg, 1979; Greene, 1989; Ross & Landauer, 1978), encoding variability (Bird, Nicholson, & Ringer, 1978; Postman & Knecht, 1983), and attempting to retrieve the studied information all improve memory performance (e.g., Karpicke & Roediger, 2008).”
BackgroundRetrieval Practice in Classroom Settings: A Review of Applied Research
Moreira, B. F. T., Pinto, T. S. S., Starling, D. S. V., & Jaeger, A. (2019) · Frontiers in Education · doi:10.3389/feduc.2019.00005 · Cited by 76
“A growing body of research, however, has shown that beyond an assessment tool, tests can also be an effective method to increase long-term retention of studied materials (Bjork, 1988; Roediger and Karpicke, 2006a; Karpicke and Roediger, 2008; Karpicke, 2012; Eisenkraemer et al., 2013).”
MethodPutcha, D., Brickhouse, M. J., Wolk, D. A., & Dickerson, B. C. (2019) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2019.03.015 · Cited by 87
Knight, J. B., Ball, B. H., Brewer, G. A., Dewitt, M. R., & Marsh, R. L. (2012) · Journal of Memory and Language · doi:10.1016/j.jml.2011.12.008 · Cited by 82
An Individual's Rate of Forgetting Is Stable Over Time but Differs Across Materials
Sense, F., Behrens, F., Meijer, R. R., & van Rijn, H. (2016) · Topics in Cognitive Science · doi:10.1111/tops.12183 · Cited by 71
Metadata
- Authors
- Karpicke, J. D., & Roediger, H. L.
- Affiliations
- Washington University in St. Louis (US)
- Department of Psychological Sciences, Purdue University, West Lafayette, IN 47907, USA.
- Corresponding author
- Karpicke, Jeffrey D.
- ORCID
- Karpicke, Jeffrey D.
- Venue
- Science
- Published
- 2008-02-15
- Volume
- 319
- Issue
- 5865
- Pages
- 966-968
- ISSN
- 0036-8075 (ISSN-L)
- 1095-9203
- OpenAlex
- W2092301601
- Cited by
- 1,791
- References
- 14
- Citations by year
- 2026: 91 · 2025: 100 · 2024: 109 · 2023: 112 · 2022: 151 · 2021: 123 · 2020: 115 · 2019: 103 · 2018: 143 · 2017: 103 · 2016: 98 · 2015: 113 · 2014: 85 · 2013: 101 · 2012: 81
- FWCI
- 28.60
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Science (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Memory Processes and Influences
- Social Sciences › Psychology › Developmental and Educational Psychology › Second Language Acquisition and Learning
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Visual and Cognitive Learning Processes
- Keywords
- retrieval practice, learning consolidation, foreign language vocabulary, retesting, delayed recall, self-assessment, memory retention
- MeSH terms
- Educational Measurement, Humans, Learning, Memory, Practice, Psychological, Mental Recall, Retention, Psychology, Students, Time Factors, Universities
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.