The Critical Importance of Retrieval for Learning
The DOI matches its Crossref record; 14 of the 14 references it cites were found in a registry or an index.
Abstract
Learning is often considered complete when a student can produce the correct answer to a question. In our research, students in one condition learned foreign language vocabulary words in the standard paradigm of repeated study-test trials. In three other conditions, once a student had correctly produced the vocabulary item, it was repeatedly studied but dropped from further testing, repeatedly tested but dropped from further study, or dropped from both study and test. Repeated studying after learning had no effect on delayed recall, but repeated testing produced a large positive effect. In addition, students' predictions of their performance were uncorrelated with actual performance. The results demonstrate the critical role of retrieval practice in consolidating learning and show that even university students seem unaware of this fact.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Second, repeated encounters can support retrieval processes, helping students recall words they have previously encountered during gameplay (Karpicke and Roediger, 2008; Nation, 2001; Roediger and Karpicke, 2006; Webb, 2007).”
From Incidental vocabulary learning from digital games: the predictive role of game playing time, foreign language motivation, and anxiety (2026) · cites this paper as Karpicke and Roediger, 2008
In the citing paper
“practice retrieval through answering questions significantly improves long-term retention (15,16).”
From Applying learning theories and instructional design models for effective instruction (2016) · cites this paper as [16]
In the citing paper
“practice retrieval through answering questions significantly improves long-term retention (15,16).”
From Applying learning theories and instructional design models for effective instruction (2016) · cites this paper as [15]
In the citing paper
“Whereas the reactivation of memories during wakefulness, as it occurs for example during rehearsal, can strengthen these memories in the long run (623, 1006), the reactivation transfers the representation into an transient unstable state such that memory is in need of reconsolidation (470, 718, 731, 844, 1033).”
From About Sleep's Role in Memory (2013) · cites this paper as [623]
In the citing paper
“Indeed there are data from other areas of cognitive neuroscience that demonstrate that repeating something that you have successfully learned is the best way to remember it (Chiviacowsky and Wulf, 2007; Karpicke and Roediger, 2008; Wulf and Shea, 2002).”
From Rethinking motor learning and savings in adaptation paradigms: model-free memory for successful actions combines with internal models (2011) · cites this paper as Karpicke and Roediger, 2008
6 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Test-Enhanced Learning: Taking Memory Tests Improves Long-Term Retention
Roediger, H. L., & Karpicke, J. D. (2006) · Psychological Science · doi:10.1111/j.1467-9280.2006.01693.x · Cited by 2,867
Self-citationMemory: A Contribution to Experimental Psychology
Ebbinghaus, H. (2013) · Annals of Neurosciences · doi:10.5214/ans.0972.7531.200408 · Cited by 2,827
Information Processing and Cognition: The Loyola Symposium
Brown, A. S., & Solso, R. L. (1976) · The American Journal of Psychology · doi:10.2307/1421430 · Cited by 2,382
The power of testing memory: Basic research and implications for educational practice
Roediger, H. L., & Karpicke, J. D. (2006) · Perspectives on Psychological Science · doi:10.1111/j.1745-6916.2006.00012.x · Cited by 2,037
Self-citationThe Psychology of Human Learning
Newman, E. B., McGeoch, J. A., & Irion, A. L. (1953) · The American Journal of Psychology · doi:10.2307/1418975 · Cited by 792
Repeated retrieval during learning is the key to long-term retention☆
KARPICKE, J., & ROEDIGERIII, H. (2007) · Journal of Memory and Language · doi:10.1016/j.jml.2006.09.004 · Cited by 598
Self-citationThe influence of retrieval on retention
Carrier, M., & Pashler, H. (1992) · Memory & Cognition · doi:10.3758/bf03202713 · Cited by 575
The promise and perils of self-regulated study
Kornell, N., & Bjork, R. A. (2007) · Psychonomic Bulletin & Review · doi:10.3758/bf03194055 · Cited by 527
The effects of presentation and recall of material in free-recall learning
Tulving, E. (1967) · Journal of Verbal Learning and Verbal Behavior · doi:10.1016/s0022-5371(67)80092-6 · Cited by 402
Thiede, K. W., & Dunlosky, J. (1999) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037//0278-7393.25.4.1024 · Cited by 396
Research works printed but not linked: 4
- A. I. Gates, Arch. Psychol.6, 1 (1917).
- W. F. Battig, Psychon. Sci. Monogr.1 (suppl.), 1 (1965).
- J. Dunlosky, K. Rawson, S. McDonald, in Applied Metacognition, T. Perfect, B. Schwartz, Eds. (Cambridge Univ. Press, Cambridge, 2002), pp. 68–92.
- J. D. Karpicke thesis Washington University St. Louis MO (2007).
Cited by
Dunlosky, J., Rawson, K. A., Marsh, E. J., Nathan, M. J., & Willingham, D. T. (2013) · Psychological Science in the Public Interest · doi:10.1177/1529100612453266 · Cited by 3,138
Rasch, B., & Born, J. (2013) · Physiological Reviews · doi:10.1152/physrev.00032.2012 · Cited by 2,783
“Whereas the reactivation of memories during wakefulness, as it occurs for example during rehearsal, can strengthen these memories in the long run (623, 1006), the reactivation transfers the representation into an transient unstable state such that memory is in need of reconsolidation (470, 718, 731, 844, 1033).”
BackgroundThe critical role of retrieval practice in long-term retention
Roediger, H. L., & Butler, A. C. (2011) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2010.09.003 · Cited by 1,796
Self-citationThe effect of testing versus restudy on retention: A meta-analytic review of the testing effect.
Rowland, C. A. (2014) · Psychological Bulletin · doi:10.1037/a0037559 · Cited by 1,066
Retrieval Practice Produces More Learning than Elaborative Studying with Concept Mapping
Karpicke, J. D., & Blunt, J. R. (2011) · Science · doi:10.1126/science.1199327 · Cited by 1,019
Self-citationKizilcec, R. F., Pérez-Sanagustín, M., & Maldonado, J. J. (2017) · Computers & Education · doi:10.1016/j.compedu.2016.10.001 · Cited by 1,003
“The finding that learners with strong SRL skills (except for help seeking) tended to revisit course content, especially assessments, suggests that learners engaged in retrieval practicedrepeatedly testing their knowledge to promote learning (Karpicke & Roediger, 2008).”
BackgroundKarpicke, J. D., Butler, A. C., & Roediger III, H. L. (2009) · Memory · doi:10.1080/09658210802647009 · Cited by 745
“Our recent research has generalised the testing effect to educational materials (Butler & Roediger, 2007; Karpicke & Roediger, 2007, 2008; Roediger & Karpicke, 2006b) and real-world classroom environments (see McDaniel, Roediger, & McDermott, 2007).”
BackgroundMethodInfluentialSelf-citationThe Restless Engram: Consolidations Never End
Dudai, Y. (2012) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-062111-150500 · Cited by 644
Test-enhanced learning in medical education
Larsen, D. P., Butler, A. C., & Roediger III, H. L. (2008) · Medical Education · doi:10.1111/j.1365-2923.2008.03124.x · Cited by 610
Rethinking the Use of Tests: A Meta-Analysis of Practice Testing
Adesope, O. O., Trevisan, D. A., & Sundararajan, N. (2017) · Review of Educational Research · doi:10.3102/0034654316689306 · Cited by 544
“For example, feedback on high-confidence correct answers can be an inefficient use of time and cognitive energy (Hays, Kornell, & Bjork, 2010; Karpicke & Roediger, 2008).”
BackgroundStrelan, P., Osborn, A., & Palmer, E. (2020) · Educational Research Review · doi:10.1016/j.edurev.2020.100314 · Cited by 526
Repeated testing produces superior transfer of learning relative to repeated studying.
Butler, A. C. (2010) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/a0019902 · Cited by 492
Huang, V. S., Haith, A., Mazzoni, P., & Krakauer, J. W. (2011) · Neuron · doi:10.1016/j.neuron.2011.04.012 · Cited by 472
“Indeed there are data from other areas of cognitive neuroscience that demonstrate that repeating something that you have successfully learned is the best way to remember it (Chiviacowsky and Wulf, 2007; Karpicke and Roediger, 2008; Wulf and Shea, 2002).”
A neoHebbian framework for episodic memory; role of dopamine-dependent late LTP
Lisman, J., Grace, A. A., & Duzel, E. (2011) · Trends in Neurosciences · doi:10.1016/j.tins.2011.07.006 · Cited by 465
Ten Benefits of Testing and Their Applications to Educational Practice
Roediger III, H. L., Putnam, A. L., & Smith, M. A. (2011) · Psychology of Learning and Motivation · doi:10.1016/b978-0-12-387691-1.00001-6 · Cited by 447
“Once again, receiving tests greatly slowed down forgetting (see also Karpicke, 2009; Karpicke & Roediger, 2008; Wheeler, Ewers, & Buonanno, 2003).”
BackgroundSelf-citationVisual sensory networks and effective information transfer in animal groups
Strandburg-Peshkin, A., Twomey, C. R., Bode, N. W. F., Kao, A. B., Katz, Y., Ioannou, C. C., Rosenthal, S. B., Torney, C. J., Wu, H. S., Levin, S. A., et al. (2013) · Current Biology · doi:10.1016/j.cub.2013.07.059 · Cited by 428
Interpolated memory tests reduce mind wandering and improve learning of online lectures
Szpunar, K. K., Khan, N. Y., & Schacter, D. L. (2013) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1221764110 · Cited by 415
“Hence, the act of retrieving relevant lecture content was critical for enhancing retention (24).”
BackgroundImmersive VR and Education: Embodied Design Principles That Include Gesture and Hand Controls
Johnson-Glenberg, M. C. (2018) · Frontiers in Robotics and AI · doi:10.3389/frobt.2018.00081 · Cited by 416
“Should short quizzes be embedded to induce a retest effect (Karpicke and Roediger, 2008)?”
BackgroundMotor learning principles for neurorehabilitation
(2013) · Handbook of Clinical Neurology · doi:10.1016/b978-0-444-52901-5.00008-3 · Cited by 401
“The benefit of prolonged performance at asymptote may relate to the observation that repeated testing itself enhances retention, as demonstrated by Karpicke and Roediger (2008) using an explicit learning task.”
BackgroundTest-enhanced learning in the classroom: Long-term improvements from quizzing.
Roediger, H. L., Agarwal, P. K., McDaniel, M. A., & McDermott, K. B. (2011) · Journal of Experimental Psychology: Applied · doi:10.1037/a0026252 · Cited by 386
“Repeated studying often has little effect on delayed tests (Karpicke & Roediger, 2008; Zaromb & Roediger, 2010).”
BackgroundSelf-citationLarsen, D. P., Butler, A. C., & Roediger III, H. L. (2009) · Medical Education · doi:10.1111/j.1365-2923.2009.03518.x · Cited by 383
Oscillations and Episodic Memory: Addressing the Synchronization/Desynchronization Conundrum
Hanslmayr, S., Staresina, B. P., & Bowman, H. (2016) · Trends in Neurosciences · doi:10.1016/j.tins.2015.11.004 · Cited by 367
“Moreover, this assumption is also in line with a plethora of findings showing that reactivation of memories during wakefulness [57] and sleep [58] counteracts this forgetting.”
ResultApplying learning theories and instructional design models for effective instruction
Khalil, M. K., & Elkhider, I. A. (2016) · Advances in Physiology Education · doi:10.1152/advan.00138.2015 · Cited by 372
Why Testing Improves Memory: Mediator Effectiveness Hypothesis
Pyc, M. A., & Rawson, K. A. (2010) · Science · doi:10.1126/science.1191465 · Cited by 371
McDaniel, M. A., Agarwal, P. K., Huelser, B. J., McDermott, K. B., & Roediger, H. L. (2011) · Journal of Educational Psychology · doi:10.1037/a0021782 · Cited by 360
“In laboratory work, repeated retrieval practice (multiple quizzes) increases the learning benefits from quizzing (Karpicke & Roediger, 2007, 2008).”
BackgroundLabile or stable: opposing consequences for memory when reactivated during waking and sleep
Diekelmann, S., Büchel, C., Born, J., & Rasch, B. (2011) · Nature Neuroscience · doi:10.1038/nn.2744 · Cited by 344
“Discussion There is now evidence that reactivation is a key mechanism of memory formation, which is a principally dynamic proces”
BackgroundCorrecting a metacognitive error: Feedback increases retention of low-confidence correct responses.
Butler, A. C., Karpicke, J. D., & Roediger, H. L. (2008) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/0278-7393.34.4.918 · Cited by 326
Self-citationLong-term effectiveness of inoculation against misinformation: Three longitudinal experiments.
Maertens, R., Roozenbeek, J., Basol, M., & van der Linden, S. (2021) · Journal of Experimental Psychology: Applied · doi:10.1037/xap0000315 · Cited by 321
Metacognitive control and strategy selection: Deciding to practice retrieval during learning.
Karpicke, J. D. (2009) · Journal of Experimental Psychology: General · doi:10.1037/a0017341 · Cited by 310
Self-citationRole of parietal regions in episodic memory retrieval: The dual attentional processes hypothesis
Cabeza, R. (2008) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2008.03.019 · Cited by 306
Collaborative Memory: Cognitive Research and Theory
Rajaram, S., & Pereira-Pasarin, L. P. (2010) · Perspectives on Psychological Science · doi:10.1177/1745691610388763 · Cited by 303
“For instance, considerable research on individual memory shows that repeated retrieval (that amounts to rehearsal) is more powerful than repeated study for improving long-term retention (Karpicke & Roediger, 2008; Roediger & Karpicke, 2006).”
BackgroundOn the effectiveness of self-paced learning
Tullis, J. G., & Benjamin, A. S. (2011) · Journal of Memory and Language · doi:10.1016/j.jml.2010.11.002 · Cited by 286
“…1992; Dunlosky & Nelson, 1994; Shaughnessy, 1981), and often do not appropriately reflect the influence of variables that affect performance considerably (Benjamin, 2005; Koriat, Bjork, Sheffer, & Bar, 2004; Karpicke & Roediger, 2008; Zechmeister & Shaughnessy, 1980, Roediger & Karpicke, 2006).”
Why tests appear to prevent forgetting: A distribution-based bifurcation model
Kornell, N., Bjork, R. A., & Garcia, M. A. (2011) · Journal of Memory and Language · doi:10.1016/j.jml.2011.04.002 · Cited by 277
Retrieval-Based Learning: Active Retrieval Promotes Meaningful Learning
Karpicke, J. D. (2012) · Current Directions in Psychological Science · doi:10.1177/0963721412443552 · Cited by 277
“Every time a person retrieves knowledge, that knowledge is changed, because retrieving knowledge improves one’s ability to retrieve it again in the future (Karpicke & Roediger, 2007, 2008; Karpicke & Zaromb, 2010).”
BackgroundSelf-citationRetrieval-Based Learning: An Episodic Context Account
Karpicke, J. D., Lehman, M. S., & Aue, W. R. (2012) · Current Directions in Psychological Science · Cited by 314
Self-citationRecent research on human learning challenges conventional instructional strategies
Rohrer, D., & Pashler, H. (2010) · Educational Researcher · doi:10.3102/0013189x10374770 · Cited by 269
Innovations in Teaching Undergraduate Biology and Why We Need Them
Wood, W. B. (2009) · Annual Review of Cell and Developmental Biology · doi:10.1146/annurev.cellbio.24.110707.175306 · Cited by 267
“Frequent quizzes can also serve as formative assessment, and research has shown that taking tests after studying leads to significantly more learning than studying alone (Karpicke & Roediger 2008, Klionsky 2008).”
BackgroundSpaced retrieval: Absolute spacing enhances learning regardless of relative spacing.
Karpicke, J. D., & Bauernschmidt, A. (2011) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/a0023436 · Cited by 262
Self-citationCarpenter, S. K. (2011) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/a0024140 · Cited by 258
“This replicates a number of studies reporting beneficial effects of testing (see e.g., Bjork, 1988; Carpenter, Pashler, & Vul, 2006; Chan, McDermott, & Roediger, 2006; Cull, 2000; Izawa, 1992; Karpicke & Roediger, 2008; Kuo & Hirshman, 1996; Mcdaniel, Roediger, & McDermott, 2007).”
Reed, D. A., Shanafelt, T. D., Satele, D. W., Power, D. V., Eacker, A., Harper, W., Moutier, C., Durning, S., Massie, F. S., Thomas, M. R., et al. (2011) · Academic Medicine · doi:10.1097/acm.0b013e3182305d81 · Cited by 256
The Flipped Classroom – From Theory to Practice in Health Professional Education
Persky, A. M., & McLaughlin, J. E. (2017) · American Journal of Pharmaceutical Education · doi:10.5688/ajpe816118 · Cited by 251
“An additional benefit to frequent low-stakes assessments of student understanding (ie, retrieval or testing effects) 77 is it allows instructors to keep abreast of what concepts or skills are particularly challenging for students to master.”
BackgroundDüzel, E., Bunzeck, N., Guitart-Masip, M., & Düzel, S. (2010) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2009.08.006 · Cited by 249
Testing during study insulates against the buildup of proactive interference.
Szpunar, K. K., McDermott, K. B., & Roediger, H. L. (2008) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/a0013082 · Cited by 247
Self-citationConnell, G. L., Donovan, D. A., & Chambers, T. G. (2016) · CBE—Life Sciences Education · doi:10.1187/cbe.15-03-0062 · Cited by 233
“Our use of quizzes at the beginning of each module is consistent with evidence that frequent quizzes after learning material improves content understanding and retention (Karpicke and Roediger, 2008; Klionsky, 2008).”
BackgroundNEVER forget: negative emotional valence enhances recapitulation
Bowen, H. J., Kark, S. M., & Kensinger, E. A. (2018) · Psychonomic Bulletin & Review · doi:10.3758/s13423-017-1313-9 · Cited by 227
The Role of Emotion in the Learning and Transfer of Clinical Skills and Knowledge
McConnell, M. M., & Eva, K. W. (2012) · Academic Medicine · doi:10.1097/acm.0b013e3182675af2 · Cited by 222
Retrieval-Based Learning: A Decade of Progress
Karpicke, J. D. (2017) · Learning and Memory: A Comprehensive Reference · doi:10.1016/b978-0-12-809324-5.21055-9 · Cited by 223
“Students studied and recalled a set of vocabulary word pairs across alternating study and test trials and continued until they had recalled each item (following similar procedures by Karpicke, 2009; Karpicke and Roediger, 2008).”
BackgroundMethodInfluentialSelf-citationBoosting vocabulary learning by verbal cueing during sleep
Schreiner, T., & Rasch, B. (2015) · Cerebral Cortex · doi:10.1093/cercor/bhu139 · Cited by 202
Retrieval-Based Learning: A Perspective for Enhancing Meaningful Learning
Karpicke, J. D., & Grimaldi, P. J. (2012) · Educational Psychology Review · doi:10.1007/s10648-012-9202-2 · Cited by 219
“In the Karpicke and Roediger (2008) experiment described earlier, practicing repeated retrieval produced a large effect on long-term retention (see Fig.”
InfluentialSelf-citationTests enhance the transfer of learning
Rohrer, D., Taylor, K., & Sholar, B. (2010) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037/a0017678 · Cited by 217
“Moreover, tests can improve learning by a dramatic degree (e.g., Karpicke & Roediger, 2008 ).”
BackgroundError and Expectation in Language Learning: The Curious Absence of Mouses in Adult Speech
Ramscar, M., Dye, M., & McCauley, S. M. (2013) · Language · doi:10.1353/lan.2013.0068 · Cited by 203
The Role of Memory Reactivation during Wakefulness and Sleep in Determining Which Memories Endure
Oudiette, D., Antony, J. W., Creery, J. D., & Paller, K. A. (2013) · The Journal of Neuroscience · doi:10.1523/jneurosci.5497-12.2013 · Cited by 204
“There is no doubt that cues are effective when they lead people to rehearse learned information (Karpicke and Roediger, 2008).”
BackgroundChan, J. C. K. (2009) · Journal of Memory and Language · doi:10.1016/j.jml.2009.04.004 · Cited by 204
“Retrieval practice is one of the most powerful ways to enhance long-term retention (Karpicke & Roediger, 2008), and the influence of retrieval practice is not confined to only the directly tested items.”
BackgroundThe multiple effects of practice: skill, habit and reduced cognitive load
Haith, A. M., & Krakauer, J. W. (2018) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2018.01.015 · Cited by 206
“Retrieval is, in general, a time-consuming process that itself can be improved through practice [28].”
Errorless learning in cognitive rehabilitation: A critical review
Middleton, E. L., & Schwartz, M. F. (2012) · Neuropsychological Rehabilitation · doi:10.1080/09602011.2011.639619 · Cited by 207
“In a variant of this design (Karpicke & Roediger, 2008 ), final performance after one week for training involving tests (80%) greatly outperformed training involving more study (36%), demonstrating a robust long-term advantage for training involving retrieval practice.”
BackgroundMethodThe testing effect in free recall is associated with enhanced organizational processes
Zaromb, F. M., & Roediger, H. L. (2010) · Memory & Cognition · doi:10.3758/mc.38.8.995 · Cited by 206
“This finding, known as the testing effect, has been demonstrated using a wide range of study materials and types of tests, in both laboratory and classroom settings and in various subject populations (e.g., Butler & Roediger, 2007; Gates, 1917; Kang, McDermott, & Roediger, 2007; McDaniel, Anderson, Derbish, & Morriset…”
BackgroundWhen and why do retrieval attempts enhance subsequent encoding?
Grimaldi, P. J., & Karpicke, J. D. (2012) · Memory & Cognition · doi:10.3758/s13421-011-0174-0 · Cited by 200
Self-citationHuman memory reconsolidation: A guiding framework and critical review of the evidence.
Elsey, J. W. B., Van Ast, V. A., & Kindt, M. (2018) · Psychological Bulletin · doi:10.1037/bul0000152 · Cited by 199
Retrieval-Based Learning: Active Retrieval Promotes Meaningful Learning
Karpicke, J. D. (2012) · Current Directions in Psychological Science · Cited by 232
Self-citationApplying Adult Learning Practices in Medical Education
Reed, S., Shell, R., Kassis, K., Tartaglia, K., Wallihan, R., Smith, K., Hurtubise, L., Martin, B., Ledford, C., Bradbury, S., et al. (2014) · Current Problems in Pediatric and Adolescent Health Care · doi:10.1016/j.cppeds.2014.01.008 · Cited by 194
Towards a Cognitive and Neurobiological Model of Motivated Forgetting
Anderson, M. C., & Huddleston, E. (2012) · Nebraska Symposium on Motivation · doi:10.1007/978-1-4614-1195-6_3 · Cited by 190
“For example, successful retrieval practice improves an item’s later retention, and, moreover, retards the rate of forgetting over longer retention intervals (e.g., Karpicke & Roediger, 2008 ) , particularly when the retrieval is diffi cult.”
BackgroundComparative effects of test‐enhanced learning and self‐explanation on long‐term retention
Larsen, D. P., Butler, A. C., & Roediger III, H. L. (2013) · Medical Education · doi:10.1111/medu.12141 · Cited by 191
Self-citationLearners’ choices and beliefs about self-testing
Kornell, N., & Son, L. K. (2009) · Memory · doi:10.1080/09658210902832915 · Cited by 190
“When an item can already be recalled, additional presentations, at least in some circumstances, appear to confer little or no benefit, whereas additional tests can have large effects (Karpicke & Roediger, 2007 , 2008 ).”
BackgroundBoet, S., Borges, B. C. R., Naik, V. N., Siu, L. W., Riem, N., Chandra, D., Bould, M. D., & Joo, H. S. (2011) · British Journal of Anaesthesia · doi:10.1093/bja/aer160 · Cited by 189
John, R. A., Ko, J., Kulkarni, M. R., Tiwari, N., Chien, N. A., Ing, N. G., Leong, W. L., & Mathews, N. (2017) · Small · doi:10.1002/smll.201701193 · Cited by 187
Karpicke, J. D., Lehman, M., & Aue, W. R. (2014) · Psychology of Learning and Motivation · doi:10.1016/b978-0-12-800283-4.00007-1 · Cited by 185
“There are a variety of ways to implement a criterion procedure (e.g., see Grimaldi & Karpicke, 2014; Karpicke, 2009; Karpicke & Roediger, 2007b, 2008; Pyc & Rawson, 2009).”
MethodSelf-citationNeural Signature of Reconsolidation Impairments by Propranolol in Humans
Schwabe, L., Nader, K., Wolf, O. T., Beaudry, T., & Pruessner, J. C. (2012) · Biological Psychiatry · doi:10.1016/j.biopsych.2011.10.028 · Cited by 182
“Although relearning processes might occur during retrieval also without external cuing (19), such relearning processes might have been more pronounced if the original learning material would have been presented again during reactivation.”
Miller, T. M., & Geraci, L. (2011) · Metacognition and Learning · doi:10.1007/s11409-011-9083-7 · Cited by 180
“Karpicke and Roediger (2008) showed that multiple retrieval opportunities enhanced participants’ long-term retention of Swahili-English word pairs.”
BackgroundNon-pharmacological cognitive enhancement
Dresler, M., Sandberg, A., Ohla, K., Bublitz, C., Trenado, C., Mroczko-Wąsowicz, A., Kühn, S., & Repantis, D. (2013) · Neuropharmacology · doi:10.1016/j.neuropharm.2012.07.002 · Cited by 180
“retention (Karpicke and Roediger, 2008).”
BackgroundTowards a program of assessment for health professionals: from training into practice
Eva, K. W., Bordage, G., Campbell, C., Galbraith, R., Ginsburg, S., Holmboe, E., & Regehr, G. (2016) · Advances in Health Sciences Education · doi:10.1007/s10459-015-9653-6 · Cited by 180
Retrieval during learning facilitates subsequent memory encoding.
Pastötter, B., Schicker, S., Niedernhuber, J., & Bäuml, K.-H. T. (2011) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/a0021801 · Cited by 177
An electroconvulsive therapy procedure impairs reconsolidation of episodic memories in humans
Kroes, M. C. W., Tendolkar, I., van Wingen, G. A., van Waarde, J. A., Strange, B. A., & Fernández, G. (2014) · Nature Neuroscience · doi:10.1038/nn.3609 · Cited by 175
A Neural Chronometry of Memory Recall
Staresina, B. P., & Wimber, M. (2019) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2019.09.011 · Cited by 171
“If ripple-mediated plasticity can be induced via awake cued recall, this might provide a plausible physiological basis for why repeatedly recalling a memory is such a powerful means to make memories last, thereby bridging between low-level physiology and cognitive theories of the ‘testing effect’ [71,120,121].”
Sekeres, M. J., Bonasia, K., St-Laurent, M., Pishdadian, S., Winocur, G., Grady, C., & Moscovitch, M. (2016) · Learning & Memory · doi:10.1101/lm.039057.115 · Cited by 166
The computational nature of memory modification
Gershman, S. J., Monfils, M.-H., Norman, K. A., & Niv, Y. (2017) · eLife · doi:10.7554/elife.23763 · Cited by 172
“Paradoxical enhancement of memory may be related to well-established ‘testing effects’, which show that memory is enhanced by the act of retrieval even in the absence of feedback (e.g., Karpicke and Roediger, 2008 ).”
BackgroundTransfer of Learning Transformed
Larsen‐Freeman, D. (2013) · Language Learning · doi:10.1111/j.1467-9922.2012.00740.x · Cited by 171
“It was a concern for learners’ being unable to perceive the environmental affordances (although I did not call it this) that led me to coin the term “grammaring” (Larsen-Freeman, 1995, 2003). I reasoned that a contributing cause to the inert knowledge problem, when it came to grammar instruction, was the confusion in…”
BackgroundQuizzing in Middle‐School Science: Successful Transfer Performance on Classroom Exams
McDaniel, M. A., Thomas, R. C., Agarwal, P. K., McDermott, K. B., & Roediger, H. L. (2013) · Applied Cognitive Psychology · doi:10.1002/acp.2914 · Cited by 171
“…transfer because testing improves learning and retention of associations relative to additional study of material (e.g., for learning the meaning associated with a new vocabulary item, see Karpicke & Roediger, 2008; for learning to associate pairs of words, see Carpenter, Pashler, & Vul, 2006).”
The benefit of generating errors during learning
Potts, R., & Shanks, D. R. (2014) · Journal of Experimental Psychology: General · doi:10.1037/a0033194 · Cited by 166
How and when do students use flashcards?
Wissman, K. T., Rawson, K. A., & Pyc, M. A. (2012) · Memory · doi:10.1080/09658211.2012.687052 · Cited by 164
“Concerning the amount of practice, increasing the number of times an item is correctly recalled during practice benefits later retention (eg, Karpicke, 2009 ; Karpicke & Roediger, 2008 ; Pyc & Rawson 2009 ; Vaughn & Rawson, 2011 ).”
Backgroundvan Gog, T., & Sweller, J. (2015) · Educational Psychology Review · doi:10.1007/s10648-015-9310-x · Cited by 164
Retrieval mode distinguishes the testing effect from the generation effect
Karpicke, J. D., & Zaromb, F. M. (2010) · Journal of Memory and Language · doi:10.1016/j.jml.2009.11.010 · Cited by 163
“In addition a number of researchers have espoused the benefits of retrieval practice for student learning (Karpicke & Roediger, 2008; McDaniel et al., 2007; Metcalfe & Kornell, 2007; Pashler et al., 2007) but this has not yet garnered wide support in education.”
Self-citationPowergrading: a Clustering Approach to Amplify Human Effort for Short Answer Grading
Basu, S., Jacobs, C., & Vanderwende, L. (2013) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00236 · Cited by 161
“Notably, testing has been shown to play a key role in the learning process as it assists retention (Anderson & Biddle, 1975), and answer construction for open response is shown to play a critical role in consolidating learning (Karpicke and Roediger, 2008).”
BackgroundDesirable Difficulties in Vocabulary Learning
BJorK, R. A., & Kroll, J. F. (2015) · The American Journal of Psychology · doi:10.5406/amerjpsyc.128.2.0241 · Cited by 160
“Karpicke and Roediger (2008) also found a sizeable long- term advantage of testing over restudying Swahili– English pairs, but in an interesting and unusual way.”
BackgroundThe Read-Recite-Review Study Strategy: Effective and Portable
McDaniel, M. A., Howard, D. C., & Einstein, G. O. (2009) · Psychological Science · doi:10.1111/j.1467-9280.2009.02325.x · Cited by 160
Activating learning at scale: A review of innovations in online learning strategies
Davis, D., Chen, G., Hauff, C., & Houben, G.-J. (2018) · Computers & Education · doi:10.1016/j.compedu.2018.05.019 · Cited by 159
Kerfoot, P. B., Fu, Y., Baker, H., Connelly, D., Ritchey, M. L., & Genega, E. M. (2010) · Journal of the American College of Surgeons · doi:10.1016/j.jamcollsurg.2010.04.023 · Cited by 158
Ullman, M., & Lovelett, J. (2018) · Second language Research · doi:10.1177/0267658316675195 · Cited by 102
“…either the spacing and/or testing effect (Carpenter et al., 2008; Carrier and Pashler, 1992; Kang et al., 2014; Karpicke and Bauernschmidt, 2011; Karpicke and Roediger, 2008; Pavlik et al., 2005; Pyc and Rawson, 2007); although, as expected, these studies do indeed find both effects, they are…”
BackgroundRetrieval practice enhances new learning: the forward effect of testing
Pastötter, B., & Bäuml, K.-H. T. (2014) · Frontiers in Psychology · doi:10.3389/fpsyg.2014.00286 · Cited by 69
“Supporting such view, the results from numerous previous studies have shown that retrieval of previously studied information can increase its long-term retention more than repeated study or elaborative encoding of the information do (Karpicke and Roediger, 2008; Karpicke and Blunt, 2011).”
ResultQuizBot: A Dialogue-based Adaptive Learning System for Factual Knowledge
Ruan, S., Jiang, L., Xu, J., Tham, B. J.-K., Qiu, Z., Zhu, Y., Murnane, E. L., Brunskill, E., & Landay, J. A. (2019) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300587 · Cited by 176
“As shown in many previous studies, retrieval practices like testing lead to higher retention than purely studying via even multiple passive means of self-evaluation [8, 34, 47].”
ResultLittle, J. L., Bjork, E. L., Bjork, R. A., & Angello, G. M. (2012) · Psychological Science · doi:10.1177/0956797612443370 · Cited by 194
Nonmonotonic Plasticity: How Memory Retrieval Drives Learning
Ritvo, V. J. H., Turk‐Browne, N. B., & Norman, K. A. (2019) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2019.06.007 · Cited by 162
Assessment of Clinical Skills With Standardized Patients: State of the Art Revisited
Swanson, D. B., & van der Vleuten, C. P. M. (2013) · Teaching and Learning in Medicine · doi:10.1080/10401334.2013.842916 · Cited by 213
A New Concept of Unsupervised Learning: Directed Self-Guided Learning in the Health Professions
Brydges, R., Dubrowski, A., & Regehr, G. (2010) · Academic Medicine · doi:10.1097/acm.0b013e3181ed4c96 · Cited by 144
Auditory feedback blocks memory benefits of cueing during sleep
Schreiner, T., Lehmann, M., & Rasch, B. (2015) · Nature Communications · doi:10.1038/ncomms9729 · Cited by 160
Littenberg‐Tobias, J., & Reich, J. (2020) · The Internet and Higher Education · doi:10.1016/j.iheduc.2020.100759 · Cited by 171
Putting retrieval-induced forgetting in context: An inhibition-free, context-based account.
Jonker, T. R., Seli, P., & MacLeod, C. M. (2013) · Psychological Review · doi:10.1037/a0034246 · Cited by 142
Who will pass? Analyzing learner behaviors in MOOCs
Tseng, S., Tsao, Y.-W., Yu, L.-C., Chan, C., & Lai, K.-H. R. (2016) · Research and Practice in Technology Enhanced Learning · doi:10.1186/s41039-016-0033-5 · Cited by 155
“Findings of two studies (Karpicke and Roediger 2008; Karpicke and Blunt 2011) also showed that online learners who watched videos did have a better learning performance.”
Kirk-Johnson, A., Galla, B. M., & Fraundorf, S. H. (2019) · Cognitive Psychology · doi:10.1016/j.cogpsych.2019.101237 · Cited by 187
Retrieval practice with short-answer, multiple-choice, and hybrid tests
Smith, M. A., & Karpicke, J. D. (2013) · Memory · doi:10.1080/09658211.2013.831454 · Cited by 173
“When students engage in repeated retrieval, their performance increases (e.g., Karpicke & Roediger, 2008).”
BackgroundSelf-citationFive Popular Study Strategies: Their Pitfalls and Optimal Implementations
Miyatsu, T., Nguyen, K., & McDaniel, M. A. (2018) · Perspectives on Psychological Science · doi:10.1177/1745691617710510 · Cited by 164
Metadata
- Authors
- Karpicke, J. D., & Roediger, H. L.
- Affiliations
- Washington University in St. Louis (US)
- Department of Psychological Sciences, Purdue University, West Lafayette, IN 47907, USA.
- Corresponding author
- Karpicke, Jeffrey D.
- ORCID
- Karpicke, Jeffrey D.
- Venue
- Science
- Published
- 2008-02-15
- Volume
- 319
- Issue
- 5865
- Pages
- 966-968
- ISSN
- 0036-8075 (ISSN-L)
- 1095-9203
- OpenAlex
- W2092301601
- Cited by
- 1,791
- References
- 14
- Citations by year
- 2026: 91 · 2025: 100 · 2024: 109 · 2023: 112 · 2022: 151 · 2021: 123 · 2020: 115 · 2019: 103 · 2018: 143 · 2017: 103 · 2016: 98 · 2015: 113 · 2014: 85 · 2013: 101 · 2012: 81
- FWCI
- 28.60
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Science (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Memory Processes and Influences
- Social Sciences › Psychology › Developmental and Educational Psychology › Second Language Acquisition and Learning
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Visual and Cognitive Learning Processes
- Keywords
- retrieval practice, learning consolidation, foreign language vocabulary, retesting, delayed recall, self-assessment, memory retention
- MeSH terms
- Educational Measurement, Humans, Learning, Memory, Practice, Psychological, Mental Recall, Retention, Psychology, Students, Time Factors, Universities
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.