Repeated testing produces superior transfer of learning relative to repeated studying.
Abstract
The present research investigated whether test-enhanced learning can be used to promote transfer. More specifically, 4 experiments examined how repeated testing and repeated studying affected retention and transfer of facts and concepts. Subjects studied prose passages and then either repeatedly restudied or took tests on the material. One week later, they took a final test that had either the same questions (Experiment 1a), new inferential questions within the same knowledge domain (Experiments 1b and 2), or new inferential questions from different knowledge domains (Experiment 3). Repeated testing produced superior retention and transfer on the final test relative to repeated studying. This finding indicates that the mnemonic benefits of test-enhanced learning are not limited to the retention of the specific response tested during initial learning but rather extend to the transfer of knowledge in a variety of contexts.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Repeated retrieval sessions with corrective feedback improve long-term retention.
“Regardless of the spacing, there is evidence to suggest that repeated retrieval sessions with corrective feedback improves long-term retention (Butler, 2010; Karpicke & Roediger, 2007b; Tse et al., 2010); for a review, see (Binks, 2018).”
From Does difficulty moderate learning? A comparative analysis of the desirable difficulties framework and cognitive load theory (2025) · cites this paper as Butler, 2010
Retrieval practice can enhance near transfer.
“The phenomenon of retrieval-induced facilitation has ties to the literature on transfer, which has shown that retrieval practice can enhance near transfer (Butler 2010, Kang et al. 2011, Rohrer et al. 2010).”
From Practicing Retrieval Facilitates Learning (2021) · cites this paper as Butler 2010
Cites
Statistical power analysis for the behavioral sciences
Cohen, J. (1990) · Computers Environment and Urban Systems · doi:10.1016/0198-9715(90)90050-4 · Cited by 65,406 · see citing works
A Coefficient of Agreement for Nominal Scales
Cohen, J. (1960) · Educational and Psychological Measurement · doi:10.1177/001316446002000104 · Cited by 42,398 · see citing works
Statistical Power Analysis for the Behavioral Sciences (2nd ed.).
Lachenbruch, P. A., & Cohen, J. (1989) · Journal of the American Statistical Association · doi:10.2307/2290095 · Cited by 37,385 · see citing works
(1983) · Medical Entomology and Zoology · Cited by 6,051 · see citing works
(1956) · Medical Entomology and Zoology · Cited by 4,596 · see citing works
Journal of Experimental Psychology: Human Learning and Memory
Bourne, L. E. (1977) · Cited by 4,328 · see citing works
“Ethical Principles of Psychologists and Code of Conduct”
Ford, G. G. (2000) · CRC Press eBooks · doi:10.4324/9781482274400-4 · Cited by 4,257 · see citing works
Depth of Processing and the Retention of Words in Episodic Memory
Craik, F. I. M., & Tulving, E. (1975) · Journal of Experimental Psychology: General · doi:10.1037/0096-3445.104.3.268 · Cited by 4,121 · see citing works
Schema induction and analogical transfer
Gick, M. L., & Holyoak, K. J. (1983) · Cognitive Psychology · doi:10.1016/0010-0285(83)90002-6 · Cited by 2,955 · cited 1× · see citing works
“Numerous studies have shown that a greater degree of initial learning generally increases positive transfer (e.g., Bruce, 1933; see Ellis, 1965), as does increasing the number and variability of training problems (e.g., Bassok & Holyoak, 1989; Gick & Holyoak, 1983; see Kimball & Holyoak, 2000).”
BackgroundTest-Enhanced Learning: Taking Memory Tests Improves Long-Term Retention
Roediger, H. L., & Karpicke, J. D. (2006) · Psychological Science · doi:10.1111/j.1467-9280.2006.01693.x · Cited by 2,867 · see citing works
Memory: A Contribution to Experimental Psychology
Ebbinghaus, H. (2013) · Annals of Neurosciences · doi:10.5214/ans.0972.7531.200408 · Cited by 2,827 · see citing works
Gick, M. L., & Holyoak, K. J. (1980) · Cognitive Psychology · doi:10.1016/0010-0285(80)90013-4 · Cited by 2,552 · cited 1× · see citing works
“…of giving subjects a hint was to negate the need for them to recognize that a previously learned concept was relevant (for a similar procedure, see Gick & Holyoak, 1980; Reed, Ernst, & Banerji, 1974), focusing instead on their ability to recall and apply that concept to answer the inferential…”
Levels of processing versus transfer appropriate processing
Morris, C. D., Bransford, J. D., & Franks, J. J. (1977) · Journal of Verbal Learning and Verbal Behavior · doi:10.1016/s0022-5371(77)80016-9 · Cited by 2,296 · see citing works
When and where do we apply what we learn?: A taxonomy for far transfer
Barnett, S. M., & Ceci, S. J. (2002) · Psychological Bulletin · doi:10.1037/0033-2909.128.4.612 · Cited by 2,076 · cited 6× · see citing works
“In the literature on transfer of learning, the degree of similarity between the contexts of initial learning and transfer is an important factor in determining whether or not transfer occurs (e.g., Holyoak & Koh, 1987; see Barnett & Ceci, 2002).”
BackgroundInfluentialThe power of testing memory: Basic research and implications for educational practice
Roediger, H. L., & Karpicke, J. D. (2006) · Perspectives on Psychological Science · doi:10.1111/j.1745-6916.2006.00012.x · Cited by 2,037 · see citing works
The Critical Importance of Retrieval for Learning
Karpicke, J. D., & Roediger, H. L. (2008) · Science · doi:10.1126/science.1152408 · Cited by 1,791 · see citing works
The instructional effect of feedback in test-like events.
Bangert-Drowns, R. L., Kulik, C.-L. C., Kulik, J. A., & Morgan, M. (1991) · Review of Educational Research · doi:10.3102/00346543061002213 · Cited by 1,313 · see citing works
Buchbesprechungen / Book Reviews
Förstl, H. (2006) · Zeitschrift für Psychiatrie Psychologie und Psychotherapie · doi:10.1024/1661-4747.54.1.68a · Cited by 1,307 · see citing works
The influence of improvement in one mental function upon the efficiency of other functions. (I).
Woodworth, R. S., & Thorndike, E. L. (1901) · Psychological Review · doi:10.1037/h0074898 · Cited by 1,223 · see citing works
An Extension of Box's Results on the Use of the $F$ Distribution in Multivariate Analysis
Geisser, S., & Greenhouse, S. W. (1958) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177706545 · Cited by 1,098 · see citing works
Surface and structural similarity in analogical transfer
Holyoak, K. J., & Koh, K. (1987) · Memory & Cognition · doi:10.3758/bf03197035 · Cited by 922 · see citing works
Coding Processes in Human Memory.
Melton, A. W., & Martin, E. (1973) · The American Journal of Psychology · doi:10.2307/1421959 · Cited by 795 · see citing works
All Other Things Being Equal: Acquisition and Transfer of the Control of Variables Strategy
Chen, Z., & Klahr, D. (1999) · Child Development · doi:10.1111/1467-8624.00081 · Cited by 736 · see citing works
Theories in Cognitive Psychology: The Loyola Symposium
Wallace, W. P., Laughlin, P. R., & Solso, R. L. (1975) · The American Journal of Psychology · doi:10.2307/1421683 · Cited by 725 · see citing works
On interpreting the effects of repetition: Solving a problem versus remembering a solution
Jacoby, L. L. (1978) · Journal of Verbal Learning and Verbal Behavior · doi:10.1016/s0022-5371(78)90393-6 · Cited by 667 · see citing works
The effects of statistical training on thinking about everyday problems
Fong, G. T., Krantz, D. H., & Nisbett, R. E. (1986) · Cognitive Psychology · doi:10.1016/0010-0285(86)90001-0 · Cited by 597 · see citing works
The influence of retrieval on retention
Carrier, L. M., & Pashler, H. (1992) · Memory & Cognition · doi:10.3758/bf03202713 · Cited by 580 · see citing works
Testing the testing effect in the classroom
McDaniel, M. A., Anderson, J. L., Derbish, M. H., & Morrisette, N. (2007) · European Journal of Cognitive Psychology · doi:10.1080/09541440701326154 · Cited by 563 · see citing works
Pyc, M. A., & Rawson, K. A. (2009) · Journal of Memory and Language · doi:10.1016/j.jml.2009.01.004 · Cited by 551 · see citing works
Transfer on Trial: Intelligence, Cognition and Instruction
Detterman, D. K., & Sternberg, R. J. (1993) · Cited by 499 · see citing works
Unsuccessful retrieval attempts enhance subsequent learning.
Kornell, N., Hays, M. J., & Bjork, R. A. (2009) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/a0015729 · Cited by 484 · see citing works
(1992) · Cited by 464 · see citing works
Feedback enhances the positive effects and reduces the negative effects of multiple-choice testing
Butler, A. C., & Roediger, H. L. (2008) · Memory & Cognition · doi:10.3758/mc.36.3.604 · Cited by 457 · see citing works
Self-citationComponent-levels theory of the effects of spacing of repetitions on recall and recognition
Glenberg, A. M. (1979) · Memory & Cognition · doi:10.3758/bf03197590 · Cited by 444 · see citing works
Testing improves long-term retention in a simulated classroom setting
Butler, A. C., & Roediger, H. L. (2007) · European Journal of Cognitive Psychology · doi:10.1080/09541440701326097 · Cited by 434 · see citing works
Self-citationThe Cognitive Basis of Knowledge Transfer
Gick, M. L., & Holyoak, K. J. (1987) · Elsevier eBooks · doi:10.1016/b978-0-12-188950-0.50008-4 · Cited by 425 · see citing works
The role of analogy in transfer between similar problem states
Reed, S. K., Ernst, G. W., & Banerji, R. (1974) · Cognitive Psychology · doi:10.1016/0010-0285(74)90020-6 · Cited by 400 · see citing works
Interdomain transfer between isomorphic topics in algebra and physics.
Bassok, M., & Holyoak, K. J. (1989) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037/0278-7393.15.1.153 · Cited by 394 · see citing works
The "testing" phenomenon: Not gone but nearly forgotten.
Glover, J. A. (1989) · Journal of Educational Psychology · doi:10.1037/0022-0663.81.3.392 · Cited by 392 · see citing works
Hintzman, D. L. (1976) · Psychology of Learning and Motivation · doi:10.1016/s0079-7421(08)60464-8 · Cited by 388 · see citing works
Carpenter, S. K., & Delosh, E. L. (2006) · Memory & Cognition · doi:10.3758/bf03193405 · Cited by 386 · see citing works
Larsen, D. P., Butler, A. C., & Roediger III, H. L. (2009) · Medical Education · doi:10.1111/j.1365-2923.2009.03518.x · Cited by 383 · see citing works
Self-citationEllis, H. C. (1965) · Bibliothèque et Archives nationales du Québec (Québec government) · Cited by 373 · see citing works
The case for the prosecution: Transfer as an epiphenomenon.
Detterman, D. K. (1996) · Dialnet (Universidad de la Rioja) · Cited by 369 · see citing works
Theoretical Implications of the Spacing Effect 1
Hintzman, D. L. (2024) · Routledge eBooks · doi:10.4324/9781032722375-5 · Cited by 364 · see citing works
Chan, J. C. K., McDermott, K. B., & Roediger, H. L. (2006) · Journal of Experimental Psychology: General · doi:10.1037/0096-3445.135.4.553 · Cited by 364 · see citing works
Correcting a metacognitive error: Feedback increases retention of low-confidence correct responses.
Butler, A. C., Karpicke, J. D., & Roediger, H. L., III (2008) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037/0278-7393.34.4.918 · Cited by 332 · see citing works
Self-citationGeneralizing test-enhanced learning from the laboratory to the classroom
Mcdaniel, M. A., Roediger, H. L., & Mcdermott, K. B. (2007) · Psychonomic Bulletin & Review · doi:10.3758/bf03194052 · Cited by 326 · see citing works
Interaction between encoding and retrieval operations in cued recall.
Fisher, R. P., & Craik, F. I. M. (1977) · Journal of Experimental Psychology Human Learning & Memory · doi:10.1037/0278-7393.3.6.701 · Cited by 315 · see citing works
Kolers, P. A. (1973) · Memory & Cognition · doi:10.3758/bf03198119 · Cited by 281 · see citing works
Depth of processing, retrieval cues, and uniqueness of encoding as factors in recall
Moscovitch, M., & Craik, F. I. M. (1976) · Journal of Verbal Learning and Verbal Behavior · doi:10.1016/s0022-5371(76)90040-2 · Cited by 277 · see citing works
Hernstein, R. J., Nickerson, R. S., de Sánchez, M. D., & Swets, J. (1986) · American Psychologist · doi:10.1037/0003-066x.41.11.1279 · Cited by 266 · see citing works
Different rates of forgetting following study versus test trials
Wheeler, M., Ewers, M., & Buonanno, J. F. (2003) · Memory · doi:10.1080/09658210244000414 · Cited by 249 · see citing works
Distributing and Managing the Conditions of Encoding and Practice
Dempster, F. N. (1996) · Elsevier eBooks · doi:10.1016/b978-012102570-0/50011-2 · Cited by 249 · see citing works
Statistical theory of distributional phenomena in learning
Estes, W. K. (1955) · Psychological Review · doi:10.1037/h0046888 · Cited by 246 · see citing works
Stimulus meaningfulness and paired-associate transfer: An encoding variability hypothesis.
Martin, E. (1968) · Psychological Review · doi:10.1037/h0026301 · Cited by 230 · see citing works
Altering memory representations through retrieval.
McDaniel, M. A., & Masson, M. E. J. (1985) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037/0278-7393.11.2.371 · Cited by 229 · see citing works
The Exam-A-Day Procedure Improves Performance in Psychology Classes
Leeming, F. C. (2002) · Teaching of Psychology · doi:10.1207/s15328023top2903_06 · Cited by 222 · see citing works
A testing effect with multimedia learning.
Johnson, C. I., & Mayer, R. E. (2009) · Journal of Educational Psychology · doi:10.1037/a0015183 · Cited by 221 · see citing works
Tests enhance the transfer of learning
Rohrer, D., Taylor, K., & Sholar, B. (2010) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037/a0017678 · Cited by 217 · see citing works
Chan, J. C. K. (2009) · Journal of Memory and Language · doi:10.1016/j.jml.2009.04.004 · Cited by 208 · see citing works
Thorndike, E. L., & Woodworth, R. S. (1901) · Psychological Review · doi:10.1037/h0071280 · Cited by 200 · see citing works
The Limited Benefits of Rereading Educational Texts.
Callender, A., & McDaniel, M. (2009) · Contemporary Educational Psychology · doi:10.1016/j.cedpsych.2008.07.001 · Cited by 196 · see citing works
Needham, D. R., & Begg, I. M. (1991) · Memory & Cognition · doi:10.3758/bf03197150 · Cited by 196 · see citing works
Adey, P. S., & Shayer, M. (1993) · Cognition and Instruction · doi:10.1207/s1532690xci1101_1 · Cited by 188 · see citing works
The Read-Recite-Review Study Strategy
McDaniel, M., Howard, D. C., & Einstein, G. (2009) · Psychology Science · doi:10.1111/j.1467-9280.2009.02325.x · Cited by 179 · see citing works
Retrieval difficulty and subsequent recall
Gardiner, F. M., Craik, F. I. M., & Bleasdale, F. A. (1973) · Memory & Cognition · doi:10.3758/bf03198098 · Cited by 176 · see citing works
What types of learning are enhanced by a cued recall test?
Carpenter, S. K., Pashler, H., & Vul, E. (2006) · Psychonomic Bulletin & Review · doi:10.3758/bf03194004 · Cited by 172 · see citing works
The generation effect when generation fails
Slamucka, N. J., & Fevreiski, J. (1983) · Journal of Verbal Learning and Verbal Behavior · doi:10.1016/s0022-5371(83)90112-3 · Cited by 163 · see citing works
The Testing Effect and the Retention Interval: Questions and Answers
Toppino, T. C., & Cohen, M. S. (2009) · Experimental Psychology · doi:10.1027/1618-3169.56.4.252 · Cited by 160 · see citing works
Relativity of Remembering: Why the Laws of Memory Vanished
Roediger, H. L., III (2007) · Annual Review of Psychology · doi:10.1146/annurev.psych.57.102904.190139 · Cited by 155 · see citing works
The Psychology of Human Learning; An Introduction
Kohler, W., & McGeoch, J. A. (1943) · The American Journal of Psychology · doi:10.2307/1417396 · Cited by 152 · see citing works
How recall facilitates subsequent recall: A reappraisal.
Thompson, C. P., Wenger, S. K., & Bartling, C. A. (1978) · Journal of Experimental Psychology: Human Learning and Memory · doi:10.1037/0278-7393.4.3.210 · Cited by 143 · see citing works
Thorndike, E. L., & Woodworth, R. S. (1901) · Psychological Review · doi:10.1037/h0071363 · Cited by 137 · see citing works
Testing beyond words: using tests to enhance visuospatial map learning
Carpenter, S. K., & Pashler, H. (2007) · Psychonomic Bulletin & Review · doi:10.3758/bf03194092 · Cited by 133 · see citing works
Izawa, C. (1970) · Journal of Experimental Psychology · doi:10.1037/h0028541 · Cited by 117 · see citing works
Some effects of remembering on forgetting
Runquist, W. N. (1983) · Memory & Cognition · doi:10.3758/bf03198289 · Cited by 113 · see citing works
Long-term effects of testing on the recall of nontested materials
Chan, J. C. K. (2009) · Memory · doi:10.1080/09658210903405737 · Cited by 105 · see citing works
Kimball, D. R., & Holyoak, K. J. (2000) · doi:10.1093/oso/9780195122657.003.0007 · Cited by 95 · see citing works
Effects on a later recall by delaying initial recall.
Modigliani, V. (1976) · Journal of Experimental Psychology Human Learning & Memory · doi:10.1037/0278-7393.2.5.609 · Cited by 72 · see citing works
Conditions of transfer of training.
Bruce, R. W. (1933) · Journal of Experimental Psychology · doi:10.1037/h0074550 · Cited by 71 · see citing works
Repetitive Reading and Recall of Expository Text
Amlund, J. T., Kardash, C. A. M., & Kulhavy, R. W. (1986) · Reading Research Quarterly · doi:10.2307/747959 · Cited by 68 · see citing works
Using tests as learning opportunities.
Foos, P. W., & Fisher, R. P. (1988) · Journal of Educational Psychology · doi:10.1037/0022-0663.80.2.179 · Cited by 64 · cited 1× · see citing works
“Similarly, both Foos and Fisher (1988) and McKenzie (1972) used a final transfer test that consisted of new inferential questions about information that had not been previously tested.”
MethodEncoding variability and retention
Postman, L. J., & Knecht, K. (1983) · Journal of Verbal Learning and Verbal Behavior · doi:10.1016/s0022-5371(83)90101-9 · Cited by 62 · see citing works
Effects of teaching statistical laws on reasoning about everyday problems.
Kosonen, P., & Winne, P. H. (1995) · Journal of Educational Psychology · doi:10.1037/0022-0663.87.1.33 · Cited by 54 · see citing works
Superiority of variable to repeated practice in transfer on anagram solution
Goode, M. K., Geraci, L. D., & Roediger, H. L., III (2008) · Psychonomic Bulletin & Review · doi:10.3758/pbr.15.3.662 · Cited by 50 · see citing works
Maskarinec, A. S., & Thompson, C. P. (1976) · Memory & Cognition · doi:10.3758/bf03213242 · Cited by 44 · see citing works
Semantic-feature variability and the spacing effect
McFarland, C. E., Rhodes, D. D., & Frey, T. J. (1979) · Journal of Verbal Learning and Verbal Behavior · doi:10.1016/s0022-5371(79)90100-2 · Cited by 29 · see citing works
On a Correction to be Made to the Correlation Ratio η
Pearson, K. (1911) · Biometrika · doi:10.2307/2331454 · Cited by 24 · see citing works
Kanak, N. J., & Neuner, S. D. (1970) · Journal of Experimental Psychology · doi:10.1037/h0029975 · Cited by 19 · see citing works
Some Effects of Frequent Quizzes on Inferential Thinking
McKenzie, G. R. (1972) · American Educational Research Journal · doi:10.2307/1161684 · Cited by 15 · see citing works
Flagged first, then by citations
1 of the 92 references couldn’t be matched to a known paper.
Cited by
Sorted by citations
Dunlosky, J., Rawson, K. A., Marsh, E. J., Nathan, M. J., & Willingham, D. T. (2013) · Psychological Science in the Public Interest · doi:10.1177/1529100612453266 · Cited by 3,138 · see citing works
The critical role of retrieval practice in long-term retention
Roediger, H. L., & Butler, A. C. (2011) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2010.09.003 · Cited by 1,796 · see citing works
Self-citationThe effect of testing versus restudy on retention: A meta-analytic review of the testing effect.
Rowland, C. A. (2014) · Psychological Bulletin · doi:10.1037/a0037559 · Cited by 1,066 · see citing works
The Pen Is Mightier Than the Keyboard: Advantages of Longhand Over Laptop Note Taking
Mueller, P. A., & Oppenheimer, D. M. (2014) · Psychological Science · doi:10.1177/0956797614524581 · Cited by 1,051 · see citing works
“This dependent measure consisted of 40 questions, 10 on each lecture—two questions in each of five categories adapted from Butler (2010): facts, seduc-tive details, concepts, same-domain inferences (inferences), and new-domain inferences (applications).”
BackgroundEight Ways to Promote Generative Learning
Fiorella, L., & Mayer, R. E. (2016) · Educational Psychology Review · doi:10.1007/s10648-015-9348-9 · Cited by 832 · see citing works
“…testing effect with more meaningful learning materials such as prose passages (e.g., Roediger and Karpicke 2006), more meaningful learning outcomes such as transfer (e.g., Butler 2010; Johnson and Mayer 2009), and more diverse student populations such as young children (e.g., Karpicke et al. 2014).”
BackgroundRethinking the Use of Tests: A Meta-Analysis of Practice Testing
Adesope, O. O., Trevisan, D. A., & Sundararajan, N. (2017) · Review of Educational Research · doi:10.3102/0034654316689306 · Cited by 544 · see citing works
“Butler and Roediger (2007) point out that comparing a retrieval practice condition to a noactivity condition is a more realistic replication of a classroom setting. For example, a short quiz before a chapter exam would likely include some (but not all) questions seen on the chapter exam, and would likely not coincide…”
BackgroundResultInfluentialTen Benefits of Testing and Their Applications to Educational Practice
Roediger, H. L., III, Putnam, A. L., & Smith, M. A. (2011) · The Psychology of learning and motivation/The psychology of learning and motivation · doi:10.1016/b978-0-12-387691-1.00001-6 · Cited by 453 · see citing works
“In another survey on study habits, Karpicke, Butler, and Roediger (2009) asked college students to list their most commonly used study habits (rather than asking directly if they used testing, as in the Kornell and Bjork (2007) survey). When the question was framed in this openended manner, only 11% of students listed…”
BackgroundResultInfluentialSpaced Repetition Promotes Efficient and Effective Learning: Policy Implications for Instruction
Kang, S. H. K. (2016) · Policy Insights from the Behavioral and Brain Sciences · doi:10.1177/2372732215624708 · Cited by 408 · see citing works
“…Kang, McDermott, & Roediger, 2007), slowed forgetting (e.g., Carpenter, Pashler, Wixted, & Vul, 2008), transfer of learning to new situations (e.g., Butler, 2010), generalization to new examples (e.g., Kang, McDaniel, & Pashler, 2011), potentiated subsequent learning (e.g., Arnold & McDermott,…”
BackgroundAssessment, feedback and the alchemy of learning
Watling, C., & Ginsburg, S. (2018) · Medical Education · doi:10.1111/medu.13645 · Cited by 434 · see citing works
Test-enhanced learning in the classroom: Long-term improvements from quizzing.
Roediger, H. L., III, Agarwal, P. K., McDaniel, M. A., & McDermott, K. B. (2011) · Journal of Experimental Psychology Applied · doi:10.1037/a0026252 · Cited by 390 · see citing works
“…(with random placement of the target among three lures), other studies have shown that quizzing enhances retention on restated versions of the target questions (McDaniel, Thomas, Agarwal, Roediger, & McDermott, 2011) and on items requiring transfer of knowledge to new situations (Butler, 2010).”
BackgroundMcDaniel, M. A., Agarwal, P. K., Huelser, B. J., McDermott, K. B., & Roediger, H. L. (2011) · Journal of Educational Psychology · doi:10.1037/a0021782 · Cited by 360 · see citing works
“Butler (2010) has reported four experiments showing that material that has been quizzed leads to greater transfer to new questions than material that was reread (see also McDaniel, Howard, & Einstein, 2009).”
BackgroundRoediger, H. L., III, & Pyc, M. A. (2012) · Journal of Applied Research in Memory and Cognition · doi:10.1016/j.jarmac.2012.09.002 · Cited by 310 · see citing works
“A large number of experiments on retrieval practice have been done in the lab (see Rawson & Dunlosky (2011) and Roediger & Butler (2011) for recent reviews) and in educational settings.”
BackgroundKarpicke, J. D. (2012) · Current Directions in Psychological Science · doi:10.1177/0963721412443552 · Cited by 286 · see citing works
“The author would like to thank Stephanie Karpicke for assistance with preparing the manuscript.”
MethodRetrieval-Based Learning: An Episodic Context Account
Karpicke, J. D., Lehman, M. S., & Aue, W. R. (2012) · Current Directions in Psychological Science · Cited by 276 · see citing works
Transfer of test- enhanced learning: meta-analytic review and synthesis
Pan, S. C., & Rickard, T. C. (2018) · Psychological Bulletin · doi:10.1037/bul0000151 · Cited by 286 · see citing works
Teaching the science of learning
Weinstein, Y., Madan, C., & Sumeracki, M. A. (2018) · Cognitive Research · doi:10.1186/s41235-017-0087-y · Cited by 204 · see citing works
“Practicing retrieval has been shown to improve the application of knowledge to new situations (e.g., Butler, 2010; Dirkx, Kester, & Kirschner, 2014); McDaniel et al., 2013; Smith, Blunt, Whiffen, & Karpicke, 2016); but see Tran, Rohrer, and Pashler (2015) and Wooldridge, Bugg, McDaniel, and Liu…”
BackgroundRetrieval-Based Learning: A Decade of Progress
Karpicke, J. D. (2017) · Learning and Memory: A Comprehensive Reference · doi:10.1016/b978-0-12-809324-5.21055-9 · Cited by 223 · see citing works
“(2016) College Introductory psychology Paper Butler et al. (2014) College Engineering Computerized quizzing Carpenter et al. (2016) College Introductory biology Paper Hopkins et al.”
BackgroundMethodInfluentialAgarwal, P. K., Nunes, L. D., & Blunt, J. R. (2021) · Educational Psychology Review · doi:10.1007/s10648-021-09595-9 · Cited by 211 · see citing works
“Because transfer of knowledge following retrieval practice remains a challenge in the classroom and in the literature (Agarwal 2019; Butler 2010; Pan and Rickard 2018), we encourage more research on retrieval practice and transfer specifically in applied settings.”
BackgroundThe testing effect in free recall is associated with enhanced organizational processes
Zaromb, F. M., & Roediger, H. L. (2010) · Memory & Cognition · doi:10.3758/mc.38.8.995 · Cited by 206 · see citing works
McDermott, K. B., Agarwal, P. K., D'Antonio, L., Roediger, H. L., III, & McDaniel, M. A. (2013) · Journal of Experimental Psychology Applied · doi:10.1037/xap0000004 · Cited by 199 · see citing works
Retrieval-Based Learning: Active Retrieval Promotes Meaningful Learning
Karpicke, J. D. (2012) · Current Directions in Psychological Science · Cited by 198 · see citing works
Comparative effects of test‐enhanced learning and self‐explanation on long‐term retention
Larsen, D. P., Butler, A. C., & Roediger, H. L., III (2013) · Medical Education · doi:10.1111/medu.12141 · Cited by 192 · see citing works
Self-citationThe Actor-Oriented Transfer Perspective and Its Contributions to Educational Research and Practice
Lobato, J. (2012) · Educational Psychologist · doi:10.1080/00461520.2012.693353 · Cited by 191 · see citing works
“, Butler, 2010; Butterfield & Nelson, 1991; Chen & Mo, 2004; Gentner et al., 2003; Rittle-Johnson, 2006). In contrast, AOT research assumes that people regularly generalize their learning experiences and finds the lack of transfer from the mainstream cognitive perspective understandable, given the large research base…”
MethodThe science of effective learning with spacing and retrieval practice
Carpenter, S. K., Pan, S. C., & Butler, A. C. (2022) · Nature Reviews Psychology · doi:10.1038/s44159-022-00089-1 · Cited by 184 · see citing works
Self-citationTesting Enhances the Transfer of Learning
Carpenter, S. K. (2012) · Current Directions in Psychological Science · doi:10.1177/0963721412452728 · Cited by 230 · see citing works
“The beneficial effect of tests on knowledge-based inferences was nicely demonstrated in a recent study by Butler (2010). After reading a text passage, participants either restudied it or completed an initial test on it (e.g., question: “Approximately how many bat species are there in the world?”; answer: “More than 1,…”
BackgroundInfluentialExplanation feedback is better than correct answer feedback for promoting transfer of learning.
Butler, A. C., Godbole, N. R., & Marsh, E. J. (2012) · Journal of Educational Psychology · doi:10.1037/a0031026 · Cited by 177 · see citing works
“Six of the passages and the associated questions were adapted from A. C. Butler (2010), and the rest were created to match.”
BackgroundSelf-citationKarpicke, J. D., Lehman, M., & Aue, W. R. (2014) · Psychology of Learning and Motivation · doi:10.1016/b978-0-12-800283-4.00007-1 · Cited by 185 · see citing works
“…has been substantiated to some degree by the finding that performance on a criterial test is best when the final test questions are identical to initial test questions (e.g., Butler, 2010; Johnson & Mayer, 2009; McDaniel & Fisher, 1991; see also Brewer, Marsh, Meeks, Clark-Foos, & Hicks, 2010).”
BackgroundResultQuizzing in Middle‐School Science: Successful Transfer Performance on Classroom Exams
McDaniel, M. A., Thomas, R. C., Agarwal, P. K., McDermott, K. B., & Roediger, H. L. (2013) · Applied Cognitive Psychology · doi:10.1002/acp.2914 · Cited by 171 · see citing works
“For instance, Butler (2010) found that subjects given a cued recall test (with feedback) on concepts (e.g., wing structure for bats and birds) performed better on questions requiring transfer of those concepts to new contexts (e.g., wing structure for military aircraft) than did subjects who…”
InfluentialRetrieval practice & Bloom’s taxonomy: Do students need fact knowledge before higher order learning?
Agarwal, P. K. (2018) · Journal of Educational Psychology · doi:10.1037/edu0000282 · Cited by 178 · see citing works
“Recent research has found that rephrased quiz or test questions do not facilitate transfer to a greater extent than identical questions (Butler, 2010; Pan & Rickard, in press); thus, although rephrased questions would be ideal for examining the flexibility of learning, it is uncertain whether…”
BackgroundReflection as a strategy to foster medical students’ acquisition of diagnostic competence
Mamede, S., van Gog, T., Moura, A. S., de Faria, R. M. D., Peixoto, J. M., Rikers, R. M. J. P., & Schmidt, H. G. (2012) · Medical Education · doi:10.1111/j.1365-2923.2012.04217.x · Cited by 164 · see citing works
van Gog, T., & Sweller, J. (2015) · Educational Psychology Review · doi:10.1007/s10648-015-9310-x · Cited by 164 · see citing works
“…transfer (e.g., recalling a word in a sentence that differed from the word that had to be recalled from that same sentence on an initial test) or contained cues that were also present in the original text (i.e., corresponding words or terms) that would invite the correct answer (e.g., Butler 2010).”
A systemic framework for the progress test: Strengths, constraints and issues: AMEE Guide No. 71
Wrigley, W. J., van der Vleuten, C. P. M., Freeman, A., & Muijtjens, A. M. M. (2012) · Medical Teacher · doi:10.3109/0142159x.2012.704437 · Cited by 159 · see citing works
Relational categories as a bridge between cognitive and educational research.
Goldwater, M. B., & Schalk, L. (2016) · Psychological Bulletin · doi:10.1037/bul0000043 · Cited by 152 · see citing works
“Butler (2010) found that practicing retrieval increases analogical transfer, but he only tested with transfer problems that contained explicit retrieval cues.”
BackgroundMind wandering during lectures II: Relation to academic performance.
Wammes, J. D., Seli, P., Cheyne, J. A., Boucher, P. O., & Smilek, D. (2016) · Scholarship of Teaching and Learning in Psychology · doi:10.1037/stl0000055 · Cited by 152 · see citing works
The Changing Nature of Educational Assessment
Bennett, R. E. (2015) · Review of Research in Education · doi:10.3102/0091732x14554179 · Cited by 163 · see citing works
“Furthermore, taking a test can, itself, help promote knowledge retention and transfer (Butler, 2010; Hinze, Wiley, & Pellegrino, 2013; Roediger & Karpicke, 2006; Rohrer & Pashler, 2010).”
BackgroundThe Testing Effect Is Alive and Well with Complex Materials
Karpicke, J. D., & Aue, W. R. (2015) · Educational Psychology Review · doi:10.1007/s10648-015-9309-3 · Cited by 140 · see citing works
Brame, C. J., & Biel, R. (2015) · CBE—Life Sciences Education · doi:10.1187/cbe.14-11-0208 · Cited by 132 · see citing works
“In a follow-up experiment described in the same report, Butler (2010) examined the effects of testing on students’ ability to transfer knowledge to a different domain, again comparing the effects of testing to restudy.”
BackgroundInfluentialAgarwal, P. K., Bain, P. M., & Chamberlain, R. W. (2012) · Educational Psychology Review · doi:10.1007/s10648-012-9210-2 · Cited by 132 · see citing works
“In general, the set of applied experiments by McDaniel et al. demonstrates the “flexibility” or transfer of retrieval-based learning, even when quiz and final criterial items differ (see also Butler 2010).”
ResultPracticing Retrieval Facilitates Learning
McDermott, K. B. (2021) · Annual review of psychology · doi:10.1146/annurev-psych-010419-051019 · Cited by 113 · see citing works
Benefits from retrieval practice are greater for students with lower working memory capacity
Agarwal, P. K., Finley, J. R., Rose, N. S., & Roediger, H. L., III (2016) · Memory · doi:10.1080/09658211.2016.1220579 · Cited by 127 · see citing works
“The use of retrieval practice as a learning strategy, by teachers and students, has been shown to increase students ’ long-term retention and transfer of knowledge to new situations (Agarwal, Bain, & Chamberlain, 2012; Butler, 2010).”
Larsen, D. P., Butler, A. C., Lawson, A. L., & Roediger, H. L., III (2012) · Advances in Health Sciences Education · doi:10.1007/s10459-012-9379-7 · Cited by 114 · see citing works
“In addition, there is growing evidence to suggest that practicing retrieval can improve people’s understanding of the material, thereby facilitating subsequent application of that information to new contexts (e.g., Butler 2010).”
BackgroundSelf-citationMamede, S., van Gog, T., Moura, A. S., de Faria, R. M. D., Maria, J. P., & Schmidt, H. G. (2013) · Academic Medicine · doi:10.1097/acm.0000000000000076 · Cited by 109 · see citing works
Learning as a Generative Activity: Eight Learning Strategies that Promote Understanding
Fiorella, L., & Mayer, R. E. (2015) · Cited by 109 · see citing works
Enhancing attention and memory during video-recorded lectures.
Schacter, D. L., & Szpunar, K. K. (2015) · Scholarship of Teaching and Learning in Psychology · doi:10.1037/stl0000011 · Cited by 112 · see citing works
Rawson, K. A., & Dunlosky, J. T. (2012) · Educational Psychology Review · doi:10.1007/s10648-012-9203-1 · Cited by 104 · see citing works
“Test-enhanced learning has been shown on many kinds of criterion measures, including those that primarily measure memory for the practiced items and those that primarily measure comprehension or application of the practiced items (e.g., Butler 2010; Johnson and Mayer 2009; McDaniel et al. 2009).”
BackgroundMethodA Test of the Testing Effect: Acquiring Problem‐Solving Skills From Worked Examples
van Gog, T., & Liesbeth Kester, A. (2012) · Cognitive Science · doi:10.1111/cogs.12002 · Cited by 95 · see citing works
“the information provided in the materials (Butler, 2010; Johnson & Mayer, 2009), the focus on recalling knowledge of the solution procedure and then applying that knowledge to execute each step in the procedure constitutes a fundamental difference between learning from worked examples and learning the other kinds of m…”
BackgroundThe cognitive principles of learning underlying the 5E Model of Instruction
Martín, H. R., & Bybee, R. W. (2022) · International Journal of STEM Education · doi:10.1186/s40594-022-00337-z · Cited by 119 · see citing works
“However, the way students learn is equally important in that it determines the potential for transfer to occur (Butler, 2010).”
BackgroundThe hypercorrection effect persists over a week, but high-confidence errors return
Butler, A. C., Fazio, L. K., & Marsh, E. J. (2011) · Psychonomic Bulletin & Review · doi:10.3758/s13423-011-0173-y · Cited by 89 · see citing works
“, Butler, 2010; see Roediger & Butler, 2011). Recent research by Fazio (2011) has suggested that this procedure might be highly effective.”
BackgroundSelf-citationNeurocognitive mechanisms of the “testing effect”: A review
van den Broek, G. S. E., Takashima, A., Wiklund‐Hörnqvist, C., Wirebring, L. K., Segers, E., Verhoeven, L. T. W., & Nyberg, L. H. (2016) · Trends in Neuroscience and Education · doi:10.1016/j.tine.2016.05.001 · Cited by 91 · see citing works
Enhancing learning by retrieval: Enriching free recall with elaborative prompting
Endres, T., Carpenter, S. K., Martin, A., & Renkl, A. (2016) · Learning and Instruction · doi:10.1016/j.learninstruc.2016.11.010 · Cited by 91 · see citing works
“We currently know much less about the power of retrieval to enhance the arguably more important outcomes of understanding and comprehension of complex, educationally-relevant learning contents (for discussions on this topic, see Butler, 2010; Carpenter, 2014; Pellegrino, 2012).”
BackgroundMeta-analyses of flipped classroom studies: A review of methodology
Hew, K. F., Bai, S., Dawson, P., & Lo, C. K. (2021) · Educational Research Review · doi:10.1016/j.edurev.2021.100393 · Cited by 90 · see citing works
A Classroom Study on the Relationship Between Student Achievement and Retrieval-Enhanced Learning
Carpenter, S. K., Lund, T. J. S., Coffman, C. R., Armstrong, P. I., Lamm, M. H., & Reason, R. D. (2015) · Educational Psychology Review · doi:10.1007/s10648-015-9311-9 · Cited by 90 · see citing works
“…and Roediger 2008; Pyc and Rawson 2010; Toppino and Cohen 2009; Vaughn and Rawson 2011; Vaughn et al. 2013), text passages (Agarwal et al. 2008; Butler 2010; Clark and Svinicki 2014; Hinze and Wiley 2011; Kubik et al. 2014; Roediger and Karpicke 2006), and video-recorded lectures (Butler and…”
BackgroundDistributed retrieval practice promotes superior recall of anatomy information
Dobson, J. L., Perez, J., & Linderholm, T. (2016) · Anatomical Sciences Education · doi:10.1002/ase.1668 · Cited by 88 · see citing works
“…retrieval practice has been well-established for simple and complex materials (for a review see Karpicke and Aue, 2015) and in both laboratory (Butler, 2010; Karpicke and Blunt, 2011; Arnold and McDermott, 2013; Meyer and Logan, 2013; Blunt and Karpicke, 2014; Karpicke et al., 2014) and…”
Using Testing as a Learning Tool
Yang, B. W., Razo, J. F., & Persky, A. M. (2019) · American Journal of Pharmaceutical Education · doi:10.5688/ajpe7324 · Cited by 81 · see citing works
“One laboratory study examined whether testing would help people transfer information about bat echolocation to a task about how submarines use sonar, which they were able to do successfully.(38) In the study noted previously that involved testing healthcare students using a pen and paper versus standardized patients,(…”
BackgroundWhat we measure … and what we should measure in medical education
Boulet, J. R., & Durning, S. J. (2018) · Medical Education · doi:10.1111/medu.13652 · Cited by 77 · see citing works
Expectancy of an open-book test decreases performance on a delayed closed-book test
Agarwal, P. K., & Roediger, H. L., III (2011) · Memory · doi:10.1080/09658211.2011.613840 · Cited by 80 · see citing works
“The results confirm the robust effects of initial tests on the transfer of knowledge (see Butler, 2010), as well as initial tests on delayed retention (Agarwal et al., 2008; Kang et al., 2007).”
BackgroundResultTesting the limits of testing effects using completion tests
Hinze, S. R., & Wiley, J. (2011) · Memory · doi:10.1080/09658211.2011.560121 · Cited by 73 · see citing works
“That is, if availability of specific information in memory is a prerequisite for transfer, then any task that enhances the retrievability of this relevant information should lead to superior transfer (see Butler, 2010).”
BackgroundThe testing effect with authentic educational materials: A cautionary note
Wooldridge, C. L., Bugg, J., McDaniel, M., & Liu, Y. (2014) · Journal of Applied Research in Memory and Cognition · doi:10.1016/j.jarmac.2014.07.001 · Cited by 75 · see citing works
To What Extent Do Study Habits Relate to Performance?
Walck-Shannon, E. M., Rowell, S. F., & Frey, R. F. (2021) · CBE—Life Sciences Education · doi:10.1187/cbe.20-05-0091 · Cited by 89 · see citing works
“Our results support the finding that active, effortful strategies can be effective on a variety of cognitive levels (Butler, 2010; Karpicke and Blunt, 2011; Smith and Karpicke, 2014); and this work extends support of the desirable difficulties framework into biology by finding unique value for…”
A dual memory theory of the testing effect
Rickard, T. C., & Pan, S. C. (2017) · Psychonomic Bulletin & Review · doi:10.3758/s13423-017-1298-4 · Cited by 65 · see citing works
Understanding the cognitive processes involved in writing to learn
Arnold, K. M., Umanath, S., Thio, K., Reilly, W. B., McDaniel, M. A., & Marsh, E. J. (2017) · Journal of Experimental Psychology Applied · doi:10.1037/xap0000119 · Cited by 69 · see citing works
“…not hundreds, of studies have shown that retrieving information from memory boosts retention (Roediger & Karpicke, 2006a) and transfer of knowledge (Butler, 2010; Carpenter, 2012), and these effects have been demonstrated in classrooms as well as in the laboratory (Bangert-Drowns, Kulik, Kulik, &…”
BackgroundTests enhance retention and transfer of spatial learning
Carpenter, S. K., & Kelly, J. W. (2012) · Psychonomic Bulletin & Review · doi:10.3758/s13423-012-0221-2 · Cited by 69 · see citing works
“, Butler, 2010; Carpenter, Pashler, & Vul, 2006; Chan, 2010; Chan, McDermott, & Roediger, 2006; McDaniel, Anderson, Derbish, & Morrisette, 2007). In a recent study, Kang, McDaniel, and Pashler (2011) demonstrated that testing can enhance transfer of mathematical function learning. Participants learned the relationship…”
InfluentialCarpenter, S. K., Endres, T., & Hui, L. (2020) · Educational Psychology Review · doi:10.1007/s10648-020-09562-w · Cited by 75 · see citing works
“2008), text passages (Butler 2010; Hinze et al. 2013), and video-based materials (Butler and Roediger III 2007; Endres et al.”
Roelle, J., & Nückles, M. (2019) · Journal of Educational Psychology · doi:10.1037/edu0000345 · Cited by 74 · see citing works
A systematic review of interleaving as a concept learning strategy
Firth, J., Rivers, I., & Boyle, J. (2021) · Review of Education · doi:10.1002/rev3.3266 · Cited by 65 · see citing works
Improving Learning Efficiency of Factual Knowledge in Medical Education
Yeh, D. D., & Park, Y. S. (2015) · Journal of surgical education · doi:10.1016/j.jsurg.2015.03.012 · Cited by 64 · see citing works
Hinze, S. R., & Rapp, D. N. (2014) · Applied Cognitive Psychology · doi:10.1002/acp.3032 · Cited by 62 · see citing works
Multiple-choice testing as a desirable difficulty in the classroom.
Bjork, E. L., Little, J. L., & Storm, B. C. (2014) · Journal of Applied Research in Memory and Cognition · doi:10.1016/j.jarmac.2014.03.002 · Cited by 75 · see citing works
The benefits of testing for learning on later performance
McConnell, M., St‐Onge, C., & Young, M. E. (2014) · Advances in Health Sciences Education · doi:10.1007/s10459-014-9529-1 · Cited by 61 · see citing works
Pop-up Questions Within Educational Videos: Effects on Students’ Learning
Haagsman, M. E., Scager, K., Boonstra, J. C., & Koster, M. (2020) · Journal of Science Education and Technology · doi:10.1007/s10956-020-09847-3 · Cited by 53 · see citing works
“It is surprising that we did not find a direct testing effect for pop-up questions, since such an effect has been reported by several previous studies (Butler 2010; Glover 1989; Karpicke and Roediger 2008; Szpunar et al. 2008).”
ResultJape, D., Zhou, J., & Bullock, S. (2022) · BMC Medical Education · doi:10.1186/s12909-022-03324-8 · Cited by 60 · see citing works
The importance of constructive comprehension processes in learning from tests
Hinze, S. R., Wiley, J., & Pellegrino, J. W. (2013) · Journal of Memory and Language · doi:10.1016/j.jml.2013.03.002 · Cited by 60 · see citing works
“A few experiments on learning from text have demonstrated benefits of retrieval attempts, with feedback and/or restudy, on these sorts of transfer tests (Butler, 2010; Karpicke & Blunt, 2011; McDaniel, Howard, & Einstein, 2009).”
BackgroundInfluentialDoes pre-testing promote better retention than post-testing?
Latimier, A., Riegert, A., Peyre, H., Ly, S. T., Casati, R., & Ramus, F. (2019) · npj Science of Learning · doi:10.1038/s41539-019-0053-1 · Cited by 57 · see citing works
Learners and Luddites in the Twenty-first Century
Martinelli, S. M., Isaak, R. S., Schell, R. M., Mitchell, J., McEvoy, M. D., & Chen, F. (2019) · Anesthesiology · doi:10.1097/aln.0000000000002827 · Cited by 55 · see citing works
Insights From the Science of Learning Can Inform Evidence-Based Implementation of Peer Instruction
Schell, J. A., & Butler, A. C. (2018) · Frontiers in Education · doi:10.3389/feduc.2018.00033 · Cited by 54 · see citing works
“Retrieval practice has been shown to improve long-term retention (e.g., Larsen et al., 2013) and transfer of learning to new contexts (e.g., Butler, 2010; for review see Carpenter, 2012).”
BackgroundSelf-citationExplaining individual student success using continuous assessment types and student characteristics
Day, I. N. Z., van Blankenstein, F. M., Westenberg, P. M., & Admiraal, W. (2018) · Higher Education Research & Development · doi:10.1080/07294360.2018.1466868 · Cited by 60 · see citing works
“According to Butler (2010), the testing effect also extends to final assessments with new information, denoting a transfer of knowledge.”
BackgroundMethodTaking the sting out of assessment: is there a role for progress testing?
Pugh, D., & Regehr, G. (2016) · Medical Education · doi:10.1111/medu.12985 · Cited by 52 · see citing works
The Testing Effect for Learning Principles and Procedures from Texts
Dirkx, K., Liesbeth Kester, A., & Kirschner, P. A. (2014) · The Journal of Educational Research · doi:10.1080/00220671.2013.823370 · Cited by 52 · see citing works
“…facts, definitions, and concepts), has namely shown that frequent testing, more variation in test questions/problems, and more time for schema construction bolsters the testing effect—even without taking too much time away from classroom instruction (e.g., Butler, 2010; Roediger & Karpicke, 2006a).”
BackgroundMethodResultInfluentialThe effects of test-enhanced learning on long-term retention in AAN annual meeting courses
Larsen, D. P., Butler, A. C., Aung, W. Y., Corboy, J. R., Friedman, D. I., & Sperling, M. R. (2015) · Neurology · doi:10.1212/wnl.0000000000001264 · Cited by 52 · see citing works
Self-citationThe role of mediator strength in learning from retrieval
Carpenter, S. K., & Yeung, K. L. (2016) · Journal of Memory and Language · doi:10.1016/j.jml.2016.06.008 · Cited by 50 · see citing works
“…2011; Vaughn, Rawson, & Pyc, 2013; Zaromb & Roediger, 2010), to more complex phrases and text passages (Agarwal, Karpicke, Kang, Roediger, & McDermott, 2008; Butler, 2010; Hinze & Wiley, 2011; Hinze, Wiley, & Pellegrino, 2013; Kubik, Söderlund, Nilsson, & Jönsson, 2014; Roediger & Karpicke, 2006).”
BackgroundWinn, A. S., DelSignore, L. A., Marcus, C. H., Chiel, L. E., Freiman, E., Stafford, D. E. J., & Newman, L. R. (2019) · MedEdPORTAL · doi:10.15766/mep_2374-8265.10850 · Cited by 50 · see citing works
Testing can counteract proactive interference by integrating competing information
Wahlheim, C. N. (2014) · Memory & Cognition · doi:10.3758/s13421-014-0455-5 · Cited by 48 · see citing works
“…(Chan, McDermott, & Roediger, 2006), the classification of novel exemplars of earlier-studied natural categories (Jacoby, Wahlheim, & Coane, 2010), knowledgebased inferences (Butler, 2010), and transfer of rules to novel materials within the same knowledge domain (Kang, McDaniel, & Pashler, 2011).”
Investigating the testing effect: Retrieval as a characteristic of effective study strategies
Bae, C. L. L., Therriault, D. J., & Redifer, J. L. (2018) · Learning and Instruction · doi:10.1016/j.learninstruc.2017.12.008 · Cited by 49 · see citing works
Guided retrieval practice of educational materials using automated scoring.
Grimaldi, P. J., & Karpicke, J. D. (2013) · Journal of Educational Psychology · doi:10.1037/a0033208 · Cited by 47 · see citing works
The double-edged sword of memory retrieval
Roediger, H. L., III, & Abel, M. (2022) · Nature Reviews Psychology · doi:10.1038/s44159-022-00115-2 · Cited by 46 · see citing works
“In addition, retrieval (relative to rereading) sometimes leads to greater transfer when the same information is needed in a novel circumstance 15,16 , although not always 17,18 .”
BackgroundExtending Cognition to External Agents
Nestojko, J. F., Finley, J. R., & Roediger, H. L., III (2013) · Psychological Inquiry · doi:10.1080/1047840x.2013.844056 · Cited by 48 · see citing works
“Butler, A. C. (2010). Repeated testing produces superior transfer of learning relative to repeated studying. Journal of Experimental Psychology: Learning, Memory, and Cognition, 36, 1118–1133. Carpenter, S. K. (2012). Testing enhances the transfer of learning.”
BackgroundMethodInfluentialRetrieval practice and elaborative encoding benefit memory in younger and older adults.
Coane, J. H. (2013) · Journal of Applied Research in Memory and Cognition · doi:10.1016/j.jarmac.2013.04.001 · Cited by 47 · see citing works
Retrieval Practice Benefits Deductive Inference
Eglington, L. G., & Kang, S. H. K. (2016) · Educational Psychology Review · doi:10.1007/s10648-016-9386-y · Cited by 47 · see citing works
“Also, Butler (2010) found that repeated retrieval practice could promote transfer to test questions that were related to, but different from, originally practiced materials (e.g., learning about the aerodynamics of bat wings and answering questions about the design of airplanes on the final test).”
BackgroundResultEbersbach, M., Feierabend, M., & Nazari, K. B. B. (2020) · Applied Cognitive Psychology · doi:10.1002/acp.3639 · Cited by 45 · see citing works
Minimizing interference with early consolidation boosts 7-day retention in amnesic patients.
Alber, J., Sala, S. D., & Dewar, M. (2014) · Neuropsychology · doi:10.1037/neu0000091 · Cited by 40 · see citing works
Morphew, J., da Silva, M. R., Herman, G. L., & West, M. (2019) · Applied Cognitive Psychology · doi:10.1002/acp.3605 · Cited by 43 · see citing works
Dobson, J. L. (2013) · AJP Advances in Physiology Education · doi:10.1152/advan.00174.2012 · Cited by 40 · see citing works
Shrestha, P. (2016) · Journal of English for Academic Purposes · doi:10.1016/j.jeap.2016.10.002 · Cited by 40 · see citing works
“A large number of studies (e.g., Butler, 2010; Butler, Godbole, & Marsh, 2013; Foley & Kaiser, 2013; MacRae & Skinner, 2011; Thompson, Brooks, & Lizárraga, 2003) have been carried out in education and psychology in order to understand the nature of transfer with regard to learning over the last…”
BackgroundTesting prepares students to learn better: The forward effect of testing in category learning.
Lee, H. S., & Ahn, D. (2017) · Journal of Educational Psychology · doi:10.1037/edu0000211 · Cited by 40 · see citing works
“…test (or retrieval practice) of previously studied information, learners generally perform better on a delayed memory task than those who studied the same material twice without a test (e.g., Butler, 2010; McDaniel & Fisher, 1991; Mcdaniel, Roediger, & McDermott, 2007; Roediger & Karpicke, 2006a).”
Price, D. W., Wang, T., O’Neill, T. R., Morgan, Z. J., Chodavarapu, P., Bazemore, A., Peterson, L. E., & Newton, W. P. (2024) · Academic Medicine · doi:10.1097/acm.0000000000005856 · Cited by 43 · see citing works
Retrieval practice: the lack of transfer to deductive inferences
Tran, R., Rohrer, D., & Pashler, H. (2014) · Psychonomic Bulletin & Review · doi:10.3758/s13423-014-0646-x · Cited by 39 · see citing works
“Butler (2010) found better performance on inference test questions for items that had been tested.”
BackgroundMethodResultTest-enhanced learning in third-grade children
Jaeger, A., Eisenkraemer, R. E., & Stein, L. M. (2014) · Educational Psychology · doi:10.1080/01443410.2014.963030 · Cited by 39 · see citing works
“In line with prior studies (e.g. Butler, 2010; Butler & Roediger, 2008; Carpenter et al., 2009; Halamish & Bjork, 2011; Karpicke & Roediger, 2007; Roediger & Karpicke, 2006), and especially with studies recruiting children as participants (Carpenter et al., 2009; McDaniel et al., 2011; Roediger et…”
BackgroundResultTransfer: A Review for Biology and the Life Sciences
Kaminske, A. N., Kuepper-Tetzel, C. E., Nebel, C. L., Sumeracki, M. A., & Ryan, S. P. (2020) · CBE—Life Sciences Education · doi:10.1187/cbe.19-11-0227 · Cited by 45 · see citing works
“To transfer a concept from one context to another, a student must first recognize that the previous knowledge is relevant, then recall that knowledge accurately, and finally apply the previous knowledge to the new context (Barnett and Ceci, 2002; Butler, 2010; Wooldridge et al., 2014; Sumeracki et al., 2019).”
BackgroundOpt Out: An Examination of Issues
Bennett, R. E. (2016) · ETS Research Report Series · doi:10.1002/ets2.12101 · Cited by 39 · see citing works
“Taking a well-designed practice test can, itself, help promote knowledge retention and transfer and do so more effectively than common approaches to studying (Butler, 2010; Hinze, Wiley, & Pellegrino, 2013; Paul, 2015; Roediger & Karpicke, 2006; Rohrer & Pashler, 2010).”
BackgroundTesting enhances learning: A review of the literature
Binks, S. (2018) · Journal of Professional Nursing · doi:10.1016/j.profnurs.2017.08.008 · Cited by 38 · see citing works
- Authors
- Butler, A. C.
- Affiliations
- Washington University in St. Louis (US)
- Corresponding author
- Butler, Andrew C.
- ORCID
- Butler, Andrew C.
- Venue
- Journal of Experimental Psychology: Learning, Memory, and Cognition
- Published
- 2010
- Volume
- 36
- Issue
- 5
- Pages
- 1118-1133
- ISSN
- 0278-7393 (ISSN-L)
- 1939-1285
- OpenAlex
- W2115033623
- Cited by
- 492
- References
- 92
- Citations by year
- 2026: 15 · 2025: 28 · 2024: 41 · 2023: 47 · 2022: 30 · 2021: 31 · 2020: 34 · 2019: 34 · 2018: 48 · 2017: 24 · 2016: 27 · 2015: 41 · 2014: 28 · 2013: 22 · 2012: 24
- FWCI
- 12.61
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Journal of Experimental Psychology Learning Memory and Cognition (publishedVersion)
- PubMed (publishedVersion)
- Funders
- James S. McDonnell Foundation
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Memory Processes and Influences
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Visual and Cognitive Learning Processes
- Life Sciences › Neuroscience › Cognitive Neuroscience › Memory and Neural Mechanisms
- Keywords
- retrieval practice, retesting, transfer of learning, retention, inferential questions, knowledge domains
- MeSH terms
- Adult, Analysis of Variance, Cues, Humans, Learning, Practice, Psychological, Mental Recall, Retention, Psychology
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review