Rethinking the Use of Tests: A Meta-Analysis of Practice Testing
The DOI matches its Crossref record; 179 of the 179 references it cites were found in a registry or an index.
Abstract
The testing effect is a well-known concept referring to gains in learning and retention that can occur when students take a practice test on studied material before taking a final test on the same material. Research demonstrates that students who take practice tests often outperform students in nontesting learning conditions such as restudying, practice, filler activities, or no presentation of the material. However, evidence-based meta-analysis is needed to develop a comprehensive understanding of the conditions under which practice tests enhance or inhibit learning. This meta-analysis fills this gap by examining the effects of practice tests versus nontesting learning conditions. Results reveal that practice tests are more beneficial for learning than restudying and all other comparison conditions. Mean effect sizes were moderated by the features of practice tests, participant and study characteristics, outcome constructs, and methodological features of the studies. Findings may guide the use of practice tests to advance student learning, and inform students, teachers, researchers, and policymakers. This article concludes with the theoretical and practical implications of the meta-analysis.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Retrieval practice is a powerful method for consolidating long-term learning.”
From A grain of truth in the grain size effect: Retrieval practice is more effective when interspersed during learning. (2024) · cites this paper as Adesope, Trevisan, & Sundararajan, 2017
In the citing paper
“Effect sizes range from moderate to large, with estimates between d = 0.55 and d = 0.88 (Phelps, 2012), g = 0.50 (Rowland, 2014), and g = 0.61 to g = 0.70 (Adesope et al., 2017).”
From Testing the testing effect on prolific: when retrieval practice fails to boost learning (2026) · cites this paper as Adesope et al., 2017
Citations
Cites
Tabachnick, B. G., & Fidell, L. S. (1983) · Cited by 80,031
How to Design and Evaluate Research in Education
Fraenkel, J. R., & Wallen, N. E. (1990) · Cited by 14,998
Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2009) · doi:10.1002/9780470743386 · Cited by 14,225
Hattie, J., & Timperley, H. (2007) · Review of Educational Research · doi:10.3102/003465430298487 · Cited by 12,905
Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2021) · doi:10.1002/9781119558378 · Cited by 9,799
The file drawer problem and tolerance for null results.
Rosenthal, R. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.3.638 · Cited by 9,068 · cited 2×
“Studies with statistically significant results are published more often than studies with no significant results, which typically remain unpublished or at best reported in the less accessible grey literature (Lipsey & Wilson, 2001; Rosenthal, 1979).”
BackgroundResultAssessment and Classroom Learning
Black, P., & Wiliam, D. (1998) · Assessment in Education: Principles, Policy & Practice · doi:10.1080/0969595980050102 · Cited by 8,152 · cited 1×
“When test results are used in this formative way, teachers and students are provided with additional resources that can help adapt teaching and learning to improve student achievement (Black & Wiliam, 1998).”
MethodThe American Psychological Association
Langfeld, H. S. (1919) · Science · doi:10.1126/science.49.1254.51 · Cited by 7,475
Distribution Theory for Glass's Estimator of Effect Size and Related Estimators
Hedges, L. V. (1981) · Journal of Educational Statistics · doi:10.2307/1164588 · Cited by 5,695 · cited 1×
“Since differential sample sizes across studies may bias the effect size obtained by Cohen’s d, we used Hedges’s g to adjust all effect sizes to provide unbiased estimates of effect size (Hedges, 1981; Hedges & Olkin, 1985) using Equation (1) below.”
MethodStatistical Methods for Meta-Analysis.
Freeman, P. R., Hedges, L. V., & Olkin, I. (1986) · Biometrics · doi:10.2307/2531069 · Cited by 4,784
The Handbook of Research Synthesis and Meta-Analysis
(2019) · doi:10.7758/9781610448864 · Cited by 4,553
Journal of Experimental Psychology: Human Learning and Memory
Bourne, L. E. (1977) · Cited by 4,328
Fixed-and random-effects models in meta-analysis.
Hedges, L. V., & Vevea, J. L. (1998) · Psychological Methods · doi:10.1037/1082-989x.3.4.486 · Cited by 2,977
Test-Enhanced Learning: Taking Memory Tests Improves Long-Term Retention
Roediger, H. L., & Karpicke, J. D. (2006) · Psychological Science · doi:10.1111/j.1467-9280.2006.01693.x · Cited by 2,867
Publication Bias in Meta‐Analysis: Prevention, Assessment and Adjustments
(2005) · doi:10.1002/0470870168 · Cited by 2,368
Levels of processing versus transfer appropriate processing
Morris, C. D., Bransford, J. D., & Franks, J. J. (1977) · Journal of Verbal Learning and Verbal Behavior · doi:10.1016/s0022-5371(77)80016-9 · Cited by 2,296 · cited 1×
“…that this is because less demanding retrieval practice activities allow participants to focus all of their cognitive energy on a simple task at hand, whereas deeper levels of processing require more cognitive energy and can distract participants from relevant aspects (C. D. Morris et al., 1977).”
BackgroundThe power of testing memory: Basic research and implications for educational practice
Roediger, H. L., & Karpicke, J. D. (2006) · Perspectives on Psychological Science · doi:10.1111/j.1745-6916.2006.00012.x · Cited by 2,037
The Critical Importance of Retrieval for Learning
Karpicke, J. D., & Roediger, H. L. (2008) · Science · doi:10.1126/science.1152408 · Cited by 1,791 · cited 1×
“For example, feedback on high-confidence correct answers can be an inefficient use of time and cognitive energy (Hays, Kornell, & Bjork, 2010; Karpicke & Roediger, 2008).”
BackgroundRaaijmakers, J. G., & Shiffrin, R. M. (1981) · Psychological Review · doi:10.1037/0033-295x.88.2.93 · Cited by 1,696 · cited 1×
“Consistent with theories of associated memory proposed by J. R. Anderson, Reder, and Lebiere (1996) and Raaijmakers and Shiffrin (1981), RIFA occurs when recall of certain information activates related information.”
Remembering can cause forgetting: Retrieval dynamics in long-term memory.
Anderson, M. C., Bjork, R. A., & Bjork, E. L. (1994) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/0278-7393.20.5.1063 · Cited by 1,482
Levels of processing in human memory
Hendrickson, E. (1980) · Personality and Individual Differences · doi:10.1016/0191-8869(80)90014-8 · Cited by 1,250
Contextual interference effects on the acquisition, retention, and transfer of a motor skill.
Shea, J. B., & Morgan, R. L. (1979) · Journal of Experimental Psychology: Human Learning and Memory · doi:10.1037/0278-7393.5.2.179 · Cited by 1,227
A systematic review and meta-analysis of the cognitive correlates of bilingualism
Adesope, O. O., Lavin, T., Thompson, T., & Ungerleider, C. (2010) · Review of Educational Research · doi:10.3102/0034654310368803 · Cited by 1,132
The effect of testing versus restudy on retention: A meta-analytic review of the testing effect.
Rowland, C. A. (2014) · Psychological Bulletin · doi:10.1037/a0037559 · Cited by 1,066 · cited 2×
“More recently, Rowland (2014) authored a meta-analysis to understand the theoretical underpinnings of studies that examined the testing effect.”
BackgroundRetrieval Practice Produces More Learning than Elaborative Studying with Concept Mapping
Karpicke, J. D., & Blunt, J. R. (2011) · Science · doi:10.1126/science.1199327 · Cited by 1,019
Estimation of a Single Effect Size: Parametric and Nonparametric Methods
Hedges, L. V., & Olkin, I. (1985) · Statistical Methods for Meta-Analysis · doi:10.1016/b978-0-08-057065-5.50010-5 · Cited by 983
Espinosa, J. C. (2004) · Cited by 939
Learning With Concept and Knowledge Maps: A Meta-Analysis
Nesbit, J. C., & Adesope, O. O. (2006) · Review of Educational Research · doi:10.3102/00346543076003413 · Cited by 932 · cited 1×
“…is consistent with well-established review protocols, applying the following procedures to the collection and synthesis of research (Adesope, Lavin, Thompson, & Ungerleider, 2010; Adesope & Nesbit, 2012; Cooper, Hedges, & Valentine, 2009; Lipsey & Wilson, 2001; Nesbit & Adesope, 2006).”
MethodSelf-citationHow People Learn: Brain, Mind, Experience, and School: Expanded Edition
(2000) · doi:10.17226/9853 · Cited by 772
Karpicke, J. D., Butler, A. C., & Roediger III, H. L. (2009) · Memory · doi:10.1080/09658210802647009 · Cited by 745
Timing of feedback and verbal learning.
Kulik, J. A., & Kulik, C.-L. C. (1988) · Review of Educational Research · doi:10.3102/00346543058001079 · Cited by 703
Testing the testing effect in the classroom
McDaniel, M. A., Anderson, J. L., Derbish, M. H., & Morrisette, N. (2007) · European Journal of Cognitive Psychology · doi:10.1080/09541440701326154 · Cited by 563
Recency-sensitive retrieval processes in long-term free recall
Bjork, R. A., & Whitten, W. B. (1974) · Cognitive Psychology · doi:10.1016/0010-0285(74)90009-7 · Cited by 556
Pyc, M. A., & Rawson, K. A. (2009) · Journal of Memory and Language · doi:10.1016/j.jml.2009.01.004 · Cited by 551
The handbook of research synthesis and meta-analysis, 2nd ed.
Cooper, H. M., Hedges, L. V., & Valentine, J. C. (2009) · Cited by 541
The promise and perils of self-regulated study
Kornell, N., & Bjork, R. A. (2007) · Psychonomic Bulletin & Review · doi:10.3758/bf03194055 · Cited by 527 · cited 1×
“Rereading, or reexposure to initial learning material without direct instruction on how to study it, is most commonly used, since it replicates what students typically do during self-directed study sessions (Kornell & Bjork, 2007; Kornell & Son, 2009).”
BackgroundTest format and corrective feedback modify the effect of testing on long-term retention
Kang, S. H. K., McDermott, K. B., & Roediger, H. L. (2007) · European Journal of Cognitive Psychology · doi:10.1080/09541440601056620 · Cited by 513
Cue strength as a moderator of the testing effect: The benefits of elaborative retrieval.
Carpenter, S. K. (2009) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/a0017021 · Cited by 503
Repeated testing produces superior transfer of learning relative to repeated studying.
Butler, A. C. (2010) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/a0019902 · Cited by 492 · cited 10×
“Butler and Roediger (2007) point out that comparing a retrieval practice condition to a noactivity condition is a more realistic replication of a classroom setting. For example, a short quiz before a chapter exam would likely include some (but not all) questions seen on the chapter exam, and would likely not coincide…”
BackgroundResultInfluentialUnsuccessful retrieval attempts enhance subsequent learning.
Kornell, N., Hays, M. J., & Bjork, R. A. (2009) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/a0015729 · Cited by 484
Feedback enhances the positive effects and reduces the negative effects of multiple-choice testing
Butler, A. C., & Roediger, H. L. (2008) · Memory & Cognition · doi:10.3758/mc.36.3.604 · Cited by 457 · cited 2×
“Although some researchers have found that students who receive corrective feedback on exams outperform those who do not receive feedback (e.g., Butler & Roediger, 2008; McDaniel & Fisher, 1991), some researchers did not find significant differences between conditions that received or did not…”
BackgroundMethodClickers in college classrooms: Fostering learning with questioning methods in large lecture classes
Mayer, R. E., Stull, A., DeLeeuw, K., Almeroth, K., Bimber, B., Chun, D., Bulger, M., Campbell, J., Knight, A., & Zhang, H. (2009) · Contemporary Educational Psychology · doi:10.1016/j.cedpsych.2008.04.002 · Cited by 454
When Does Feedback Facilitate Learning of Words?
Pashler, H., Cepeda, N. J., Wixted, J. T., & Rohrer, D. (2005) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/0278-7393.31.1.3 · Cited by 445
Testing improves long-term retention in a simulated classroom setting
Butler, A. C., & Roediger, H. L. (2007) · European Journal of Cognitive Psychology · doi:10.1080/09541440701326097 · Cited by 434
Research Synthesis and Meta-Analysis
Cooper, H., Patall, E., & Lindsay, J. (2009) · The SAGE Handbook of Applied Social Research Methods · doi:10.4135/9781483348858.n11 · Cited by 397
The "testing" phenomenon: Not gone but nearly forgotten.
Glover, J. A. (1989) · Journal of Educational Psychology · doi:10.1037/0022-0663.81.3.392 · Cited by 392
Test-enhanced learning in the classroom: Long-term improvements from quizzing.
Roediger, H. L., Agarwal, P. K., McDaniel, M. A., & McDermott, K. B. (2011) · Journal of Experimental Psychology: Applied · doi:10.1037/a0026252 · Cited by 386
Carpenter, S. K., & Delosh, E. L. (2006) · Memory & Cognition · doi:10.3758/bf03193405 · Cited by 386
The Positive and Negative Consequences of Multiple-Choice Testing.
Roediger, H. L., & Marsh, E. J. (2005) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/0278-7393.31.5.1155 · Cited by 383
Larsen, D. P., Butler, A. C., & Roediger III, H. L. (2009) · Medical Education · doi:10.1111/j.1365-2923.2009.03518.x · Cited by 383
Why Testing Improves Memory: Mediator Effectiveness Hypothesis
Pyc, M. A., & Rawson, K. A. (2010) · Science · doi:10.1126/science.1191465 · Cited by 371 · cited 1×
“Although research on testing has been conducted before the turn of the 19th century, Roediger and Karpicke (2006b) observed that the first large-scale study on testing effects was conducted by Gates in 1917.”
BackgroundKing, A. (1992) · American Educational Research Journal · doi:10.2307/1163370 · Cited by 365
Chan, J. C. K., McDermott, K. B., & Roediger, H. L. (2006) · Journal of Experimental Psychology: General · doi:10.1037/0096-3445.135.4.553 · Cited by 364 · cited 2×
“A possible methodological disadvantage concerns the potential that retrieval practice on some items will affect the memorization of other nontested material (Chan, 2009, 2010; Chan et al., 2006; Spitzer & Bäuml, 2009) in processes known as retrieval-induced forgetting (RIFO) and retrieval-induced facilitation (RIFA).”
BackgroundEvidence for publication bias in video game violence effects literature: A meta-analytic review
Ferguson, C. J. (2007) · Aggression and Violent Behavior · doi:10.1016/j.avb.2007.01.001 · Cited by 363
Illusions of Competence in Monitoring One's Knowledge During Study.
Koriat, A., & Bjork, R. A. (2005) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/0278-7393.31.2.187 · Cited by 362
McDaniel, M. A., Agarwal, P. K., Huelser, B. J., McDermott, K. B., & Roediger, H. L. (2011) · Journal of Educational Psychology · doi:10.1037/a0021782 · Cited by 360 · cited 2×
“…been well documented, few studies have attempted to analyze these effects in a real classroom (see Cranney, Ahn, McKinnon, Morris, & Watts, 2009; Glover, 1989; Mayer et al., 2009; McDaniel et al., 2011; McDaniel, Thomas, Agarwal, McDermott, & Roediger, 2013; McDaniel, Wildman, & Anderson, 2012).”
MethodMetacomprehension: A Brief History and How to Improve Its Accuracy
Dunlosky, J., & Lipko, A. R. (2007) · Current Directions in Psychological Science · doi:10.1111/j.1467-8721.2007.00509.x · Cited by 353
Working Memory: Activation Limitations on Retrieval
Anderson, J. R., Reder, L. M., & Lebiere, C. (1996) · Cognitive Psychology · doi:10.1006/cogp.1996.0007 · Cited by 348
Examining the testing effect with open‐ and closed‐book tests
Agarwal, P. K., Karpicke, J. D., Kang, S. H. K., Roediger, H. L., & McDermott, K. B. (2008) · Applied Cognitive Psychology · doi:10.1002/acp.1391 · Cited by 342
Correcting a metacognitive error: Feedback increases retention of low-confidence correct responses.
Butler, A. C., Karpicke, J. D., & Roediger, H. L. (2008) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/0278-7393.34.4.918 · Cited by 326
The effect of type and timing of feedback on learning from multiple-choice tests.
Butler, A. C., Karpicke, J. D., & Roediger, H. L. (2007) · Journal of Experimental Psychology: Applied · doi:10.1037/1076-898x.13.4.273 · Cited by 321 · cited 1×
“Butler, Karpicke, and Roediger (2007) suggested that this may be because students in a classroom will pay more attention to immediate feedback than delayed feedback.”
BackgroundEffects of Frequent Classroom Testing
Bangert-Drowns, R. L., Kulik, J. A., & Kulik, C.-L. C. (1991) · The Journal of Educational Research · doi:10.1080/00220671.1991.10702818 · Cited by 320
The effect of testing on skills learning
Kromann, C. B., Jensen, M. L., & Ringsted, C. (2009) · Medical Education · doi:10.1111/j.1365-2923.2008.03245.x · Cited by 315
Recitation As a Factor in Memorizing
Gates, A. I. (2010) · Medical Entomology and Zoology · Cited by 310
Roediger, H. L., & Pyc, M. A. (2012) · Journal of Applied Research in Memory and Cognition · doi:10.1016/j.jarmac.2012.09.002 · Cited by 308
The Role of Wait Time in Higher Cognitive Level Learning
Tobin, K. (1987) · Review of Educational Research · doi:10.3102/00346543057001069 · Cited by 308 · cited 1×
“For example, Tobin (1987) reviewed considerable evidence demonstrating that teacher wait time—3- to 5-second pause separating utterances during verbal interaction—improves achievement and facilitates higher level learning by providing students with additional time to think.”
BackgroundThe pretesting effect: do unsuccessful retrieval attempts enhance learning?
Richland, L. E., Kornell, N., & Kao, L. S. (2009) · Journal of Experimental Psychology: Applied · doi:10.1037/a0016496 · Cited by 302
The effects of tests on learning and forgetting.
Carpenter, S. K., Pashler, H., Wixted, J. T., & Vul, E. (2008) · Memory & Cognition · doi:10.3758/mc.36.2.438 · Cited by 281
Hunsu, N. J., Adesope, O., & Bayly, D. J. (2016) · Computers & Education · doi:10.1016/j.compedu.2015.11.013 · Cited by 272
Self-citationApplication of the testing and spacing effects to name learning
Carpenter, S. K., & DeLosh, E. L. (2005) · Applied Cognitive Psychology · doi:10.1002/acp.1101 · Cited by 270
Recent research on human learning challenges conventional instructional strategies
Rohrer, D., & Pashler, H. (2010) · Educational Researcher · doi:10.3102/0013189x10374770 · Cited by 269 · cited 2×
“…revitalized interest in this phenomenon, with many studies over the past two decades (e.g., Chan, McDermott, & Roediger, 2006; Glover, 1989; Johnson & Mayer, 2009; McDaniel, Agarwal, Huelser, McDermott, & Roediger, 2011; McDaniel & Fisher, 1991; Roediger & Karpicke, 2006a; Rohrer & Pashler, 2010).”
MethodCarpenter, S. K. (2011) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/a0024140 · Cited by 258
(2010) · Psychology of Learning and Motivation · doi:10.1016/s0079-7421(10)53003-2 · Cited by 255
Using tests to enhance 8th grade students' retention of U.S. history facts
Carpenter, S. K., Pashler, H., & Cepeda, N. J. (2009) · Applied Cognitive Psychology · doi:10.1002/acp.1507 · Cited by 254
Testing during study insulates against the buildup of proactive interference.
Szpunar, K. K., McDermott, K. B., & Roediger, H. L. (2008) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/a0013082 · Cited by 247
Forgetting as a consequence of retrieval: A meta-analytic review of retrieval-induced forgetting.
Murayama, K., Miyatsu, T., Buchli, D., & Storm, B. C. (2014) · Psychological Bulletin · doi:10.1037/a0037505 · Cited by 228
The Exam-A-Day Procedure Improves Performance in Psychology Classes
Leeming, F. C. (2002) · Teaching of Psychology · doi:10.1207/s15328023top2903_06 · Cited by 222 · cited 1×
“Leeming (2002) demonstrated that beside improvements in overall course grades, frequent classroom quizzing increases class attendance.”
BackgroundA testing effect with multimedia learning.
Johnson, C. I., & Mayer, R. E. (2009) · Journal of Educational Psychology · doi:10.1037/a0015183 · Cited by 220
Tests enhance the transfer of learning
Rohrer, D., Taylor, K., & Sholar, B. (2010) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037/a0017678 · Cited by 217
The testing effect in free recall is associated with enhanced organizational processes
Zaromb, F. M., & Roediger, H. L. (2010) · Memory & Cognition · doi:10.3758/mc.38.8.995 · Cited by 206
Chan, J. C. K. (2009) · Journal of Memory and Language · doi:10.1016/j.jml.2009.04.004 · Cited by 204
When and why do retrieval attempts enhance subsequent encoding?
Grimaldi, P. J., & Karpicke, J. D. (2012) · Memory & Cognition · doi:10.3758/s13421-011-0174-0 · Cited by 200
Effects of Opportunities for Word Retrieval During Second Language Vocabulary Learning
Barcroft, J. (2007) · Language Learning · doi:10.1111/j.1467-9922.2007.00398.x · Cited by 191
Comparative effects of test‐enhanced learning and self‐explanation on long‐term retention
Larsen, D. P., Butler, A. C., & Roediger III, H. L. (2013) · Medical Education · doi:10.1111/medu.12141 · Cited by 191
The limited benefits of rereading educational texts
Callender, A. A., & McDaniel, M. A. (2009) · Contemporary Educational Psychology · doi:10.1016/j.cedpsych.2008.07.001 · Cited by 190
Learners’ choices and beliefs about self-testing
Kornell, N., & Son, L. K. (2009) · Memory · doi:10.1080/09658210902832915 · Cited by 190
Halamish, V., & Bjork, R. A. (2011) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/a0023219 · Cited by 189
The Testing Effect Is Alive and Well with Complex Materials
Karpicke, J. D., & Aue, W. R. (2015) · Educational Psychology Review · doi:10.1007/s10648-015-9309-3 · Cited by 181
Retrieving Essential Material at the End of Lectures Improves Performance on Statistics Exams
Lyle, K. B., & Crawford, N. A. (2011) · Teaching of Psychology · doi:10.1177/0098628311401587 · Cited by 180
A Review of Meta-Analyses in Education: Methodological Strengths and Weaknesses
Ahn, S., Ames, A. J., & Myers, N. D. (2012) · Review of Educational Research · doi:10.3102/0034654312458162 · Cited by 179
Retrieval difficulty and subsequent recall
Gardiner, F. M., Craik, F. I. M., & Bleasdale, F. A. (1973) · Memory & Cognition · doi:10.3758/bf03198098 · Cited by 177
McDaniel, M. A., Wildman, K. M., & Anderson, J. L. (2012) · Journal of Applied Research in Memory and Cognition · doi:10.1016/j.jarmac.2011.10.001 · Cited by 177
Retrieval during learning facilitates subsequent memory encoding.
Pastötter, B., Schicker, S., Niedernhuber, J., & Bäuml, K.-H. T. (2011) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/a0021801 · Cited by 177
The testing effect in recognition memory: A dual process account.
Chan, J. C. K., & McDermott, K. B. (2007) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/0278-7393.33.2.431 · Cited by 175
What types of learning are enhanced by a cued recall test?
Carpenter, S. K., Pashler, H., & Vul, E. (2006) · Psychonomic Bulletin & Review · doi:10.3758/bf03194004 · Cited by 172
Quizzing in Middle‐School Science: Successful Transfer Performance on Classroom Exams
McDaniel, M. A., Thomas, R. C., Agarwal, P. K., McDermott, K. B., & Roediger, H. L. (2013) · Applied Cognitive Psychology · doi:10.1002/acp.2914 · Cited by 171
Coburn, C. E., Hill, H. C., & Spillane, J. P. (2016) · Educational Researcher · doi:10.3102/0013189x16651080 · Cited by 165
Retrieval mode distinguishes the testing effect from the generation effect
Karpicke, J. D., & Zaromb, F. M. (2010) · Journal of Memory and Language · doi:10.1016/j.jml.2009.11.010 · Cited by 163
Verbal redundancy in multimedia learning environments: A meta-analysis.
Adesope, O. O., & Nesbit, J. C. (2012) · Journal of Educational Psychology · doi:10.1037/a0026147 · Cited by 161
Self-citationThe Testing Effect and the Retention Interval: Questions and Answers
Toppino, T. C., & Cohen, M. S. (2009) · Experimental Psychology · doi:10.1027/1618-3169.56.4.252 · Cited by 160
The Read-Recite-Review Study Strategy: Effective and Portable
McDaniel, M. A., Howard, D. C., & Einstein, G. O. (2009) · Psychological Science · doi:10.1111/j.1467-9280.2009.02325.x · Cited by 160
Principles of cognitive science in education: The effects of generation, errors, and feedback
Metcalfe, J., & Kornell, N. (2007) · Psychonomic Bulletin & Review · doi:10.3758/bf03194056 · Cited by 144
Testing versus review: Effects on retention.
Nungester, R. J., & Duchastel, P. C. (1982) · Journal of Educational Psychology · doi:10.1037//0022-0663.74.1.18 · Cited by 144
Tests and test feedback as learning sources
McDaniel, M. A., & Fisher, R. P. (1991) · Contemporary Educational Psychology · doi:10.1016/0361-476x(91)90037-l · Cited by 143
Advances in statistical methods for meta‐analysis
Hedges, L. V. (1984) · New Directions for Program Evaluation · doi:10.1002/ev.1376 · Cited by 142
Testing beyond words: using tests to enhance visuospatial map learning
Carpenter, S. K., & Pashler, H. (2007) · Psychonomic Bulletin & Review · doi:10.3758/bf03194092 · Cited by 133
Larsen, D. P., Butler, A. C., Lawson, A. L., & Roediger, H. L., III (2012) · Advances in Health Sciences Education · doi:10.1007/s10459-012-9379-7 · Cited by 129
Jacoby, L. L., Wahlheim, C. N., & Coane, J. H. (2010) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037/a0020636 · Cited by 127 · cited 1×
“, Kang, McDermott, & Roediger, 2007). For instance, Kang et al. (2007) revealed that students who took a short-answer practice test outperformed students who took a multiple-choice practice test on the final test, regardless of whether the final test was short-answer or multiple-choice.”
ResultExpectation of a final cumulative test enhances long-term retention
Szpunar, K. K., McDermott, K. B., & Roediger, H. L., III (2007) · Memory & Cognition · doi:10.3758/bf03193473 · Cited by 126
Covert retrieval practice benefits retention as much as overt retrieval practice.
Smith, M. A., Roediger, H. L., & Karpicke, J. D. (2013) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/a0033569 · Cited by 124
Learning from feedback: Spacing and the delay–retention effect.
Smith, T. A., & Kimball, D. R. (2010) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/a0017407 · Cited by 123
Some General Constraints on Learning and Memory Research
(2014) · Levels of Processing in Human Memory (PLE: Memory) · doi:10.4324/9781315796192-27 · Cited by 122
Delayed versus immediate feedback in children's and adults' vocabulary learning
Metcalfe, J., Kornell, N., & Finn, B. (2009) · Memory & Cognition · doi:10.3758/mc.37.8.1077 · Cited by 115
The memorial consequences of multiple-choice testing
Marsh, E. J., Roediger, H. L., Bjork, R. A., & Bjork, E. L. (2007) · Psychonomic Bulletin & Review · doi:10.3758/bf03194051 · Cited by 113
Long-term effects of testing on the recall of nontested materials
Chan, J. C. K. (2010) · Memory · doi:10.1080/09658210903405737 · Cited by 105
Enhancing visuospatial learning: The benefit of retrieval practice
Kang, S. H. K. (2010) · Memory & Cognition · doi:10.3758/mc.38.8.1009 · Cited by 104
The Usefulness of the "Fail-Safe" Statistic in Meta-Analysis
Carson, K. P., Schriesheim, C. A., & Kinicki, A. J. (1990) · Educational and Psychological Measurement · doi:10.1177/0013164490502001 · Cited by 99
Why is test–restudy practice beneficial for memory? An evaluation of the mediator shift hypothesis.
Pyc, M. A., & Rawson, K. A. (2012) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/a0026166 · Cited by 98
A Test of the Testing Effect: Acquiring Problem‐Solving Skills From Worked Examples
van Gog, T., & Kester, L. (2012) · Cognitive Science · doi:10.1111/cogs.12002 · Cited by 95
McDermott, K. B. (2006) · Memory & Cognition · doi:10.3758/bf03193404 · Cited by 94
The effect of testing on student achievement, 1910–2010
Phelps, R. P. (2012) · International Journal of Testing · doi:10.1080/15305058.2011.602920 · Cited by 93 · cited 7×
“Phelps also found that the effects of practice tests were amplified when feedback was included with tests. In a selective narrative review on the power of testing in improving memory and retention, Roediger and Karpicke (2006b) reviewed some historical and contemporary findings on testing effects. They observed that p…”
BackgroundMethodResultInfluentialSomething in Common: The Common Core Standards and the Next Chapter in American Education
Rothman, R. (2011) · Cited by 92
Separate mnemonic effects of retrieval practice and elaborative encoding
Karpicke, J. D., & Smith, M. A. (2012) · Journal of Memory and Language · doi:10.1016/j.jml.2012.02.004 · Cited by 91
Expanding retrieval practice: An effective aid to preschool children's learning
Fritz, C. O., Morris, P. E., Nolan, D., & Singleton, J. (2007) · Quarterly Journal of Experimental Psychology · doi:10.1080/17470210600823595 · Cited by 87
Does response mode affect amount recalled or the magnitude of the testing effect?
Putnam, A. L., & Roediger, H. L. (2013) · Memory & Cognition · doi:10.3758/s13421-012-0245-x · Cited by 86
Taking the testing effect beyond the college freshman: Benefits for lifelong learning.
Meyer, A. N. D., & Logan, J. M. (2013) · Psychology and Aging · doi:10.1037/a0030890 · Cited by 85
The benefits of embedded question adjuncts for low and high structure builders.
Callender, A. A., & McDaniel, M. A. (2007) · Journal of Educational Psychology · doi:10.1037/0022-0663.99.2.339 · Cited by 85
Congleton, A. R., & Rajaram, S. (2011) · Memory & Cognition · doi:10.3758/s13421-011-0168-y · Cited by 84
Weinstein, Y., McDermott, K. B., & Roediger, H. L. (2010) · Journal of Experimental Psychology: Applied · doi:10.1037/a0020992 · Cited by 83
Cranney, J., Ahn, M., McKinnon, R., Morris, S., & Watts, K. (2009) · European Journal of Cognitive Psychology · doi:10.1080/09541440802413505 · Cited by 80
Tse, C.-S., Balota, D. A., & Roediger, H. L. (2010) · Psychology and Aging · doi:10.1037/a0019933 · Cited by 80
The costs and benefits of providing feedback during learning
Hays, M. J., Kornell, N., & Bjork, R. A. (2010) · Psychonomic Bulletin & Review · doi:10.3758/pbr.17.6.797 · Cited by 76
Testing the limits of testing effects using completion tests
Hinze, S. R., & Wiley, J. (2011) · Memory · doi:10.1080/09658211.2011.560121 · Cited by 73
Kang, S. H. K., Gollan, T. H., & Pashler, H. (2013) · Psychonomic Bulletin & Review · doi:10.3758/s13423-013-0450-z · Cited by 73
The importance of constructive comprehension processes in learning from tests
Hinze, S., Wiley, J., & Pellegrino, J. (2013) · Journal of Memory and Language · doi:10.1016/j.jml.2013.03.002 · Cited by 71
What happens when university students try to answer prequestions that accompany textbook material
Pressley, M., Tanenbaum, R., McDaniel, M. A., & Wood, E. (1990) · Contemporary Educational Psychology · doi:10.1016/0361-476x(90)90003-j · Cited by 71
Recall facilitates subsequent recognition.
Wenger, S. K., Thompson, C. P., & Bartling, C. A. (1980) · Journal of Experimental Psychology Human Learning & Memory · doi:10.1037/0278-7393.6.2.135 · Cited by 69
Sumowski, J. F., Chiaravalloti, N., & DeLuca, J. (2010) · Neuropsychology · doi:10.1037/a0017533 · Cited by 66
Memory Effects for Test-Like-Events during Acquisition of Foreign Language Vocabulary
Royer, J. M. (1973) · Psychological Reports · doi:10.2466/pr0.1973.32.1.195 · Cited by 63
The testing effect: The role of feedback and collaboration in a tertiary classroom setting
Vojdanoska, M., Cranney, J., & Newell, B. R. (2010) · Applied Cognitive Psychology · doi:10.1002/acp.1630 · Cited by 58
The Testing Effect: Illustrating a Fundamental Concept and Changing Study Strategies
Einstein, G. O., Mullet, H. G., & Harrison, T. L. (2012) · Teaching of Psychology · doi:10.1177/0098628312450432 · Cited by 56
The negative testing effect and multifactor account.
Peterson, D. J., & Mulligan, N. W. (2013) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/a0031337 · Cited by 56
Free recall enhances subsequent learning
Arnold, K. M., & McDermott, K. B. (2013) · Psychonomic Bulletin & Review · doi:10.3758/s13423-012-0370-3 · Cited by 55
Memorial consequences of answering SAT II questions.
Marsh, E. J., Agarwal, P. K., & Roediger, H. L. (2009) · Journal of Experimental Psychology: Applied · doi:10.1037/a0014721 · Cited by 55
Strategies for learning proper names: expanding retrieval practice, meaning and imagery
Morris, P. E., Fritz, C. O., Jackson, L., et al. (2005) · Applied Cognitive Psychology · doi:10.1002/acp.1115 · Cited by 54
Learning Adinkra symbols: The effect of testing
Coppens, L. C., Verkoeijen, P. P. J. L., & Rikers, R. M. J. P. (2011) · Journal of Cognitive Psychology · doi:10.1080/20445911.2011.507188 · Cited by 53
Retrieval practice: A simple strategy for improving memory after traumatic brain injury
SUMOWSKI, J. F., WOOD, H. G., CHIARAVALLOTI, N., WYLIE, G. R., LENGENFELDER, J., & DELUCA, J. (2010) · Journal of the International Neuropsychological Society · doi:10.1017/s1355617710001128 · Cited by 51
Vinovskis, M. (2009) · doi:10.5860/choice.47-5165 · Cited by 51
Retention of prose materials as a function of postacquisition testing.
LaPorte, R. E., & Voss, J. F. (1975) · Journal of Educational Psychology · doi:10.1037/h0076933 · Cited by 49
Retrieval practice and elaborative encoding benefit memory in younger and older adults.
Coane, J. H. (2013) · Journal of Applied Research in Memory and Cognition · doi:10.1016/j.jarmac.2013.04.001 · Cited by 46
The role of organizational processes in long-term retention.
Masson, M. E. J., & McDaniel, M. A. (1981) · Journal of Experimental Psychology Human Learning & Memory · doi:10.1037/0278-7393.7.2.100 · Cited by 44
The Use of Flashcards in an Introduction to Psychology Class
Golding, J. M., Wasarhaley, N. E., & Fletcher, B. (2012) · Teaching of Psychology · doi:10.1177/0098628312450436 · Cited by 43
Retrieval-induced forgetting in a category recognition task.
Spitzer, B., & Bäuml, K. T. (2009) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037/a0014363 · Cited by 39
Benefits of accumulating versus diminishing cues in recall
Finley, J. R., Benjamin, A. S., Hays, M. J., Bjork, R. A., & Kornell, N. (2011) · Journal of Memory and Language · doi:10.1016/j.jml.2011.01.006 · Cited by 39
Memorial consequences of testing school-aged children
Marsh, E. J., Fazio, L. K., & Goswick, A. E. (2012) · Memory · doi:10.1080/09658211.2012.708757 · Cited by 38
(2010) · Journal of Educational Administration · doi:10.1108/09578231011015458 · Cited by 37
Retention of prose following testing with different types of tests
Duchastel, P. C. (1981) · Contemporary Educational Psychology · doi:10.1016/0361-476x(81)90002-3 · Cited by 37
The Testing Effect as a Function of Explicit Testing Instructions and Judgments of Learning
Jönsson, F. U., Hedner, M., & Olsson, M. J. (2012) · Experimental Psychology (formerly Zeitschrift für Experimentelle Psychologie) · doi:10.1027/1618-3169/a000150 · Cited by 36
The effect of recall upon recognition.
Hanawalt, N. G., & Tarr, A. G. (1961) · Journal of Experimental Psychology · doi:10.1037/h0041917 · Cited by 33
How crucial is the response format for the testing effect?
Jönsson, F. U., Kubik, V., Sundqvist, M. L., Todorov, I., & Jonsson, B. (2013) · Psychological Research · doi:10.1007/s00426-013-0522-8 · Cited by 32
Pyke, A. A., & LeFevre, J.-A. (2011) · Journal of Educational Psychology · doi:10.1037/a0023291 · Cited by 30
Interteaching and the Testing Effect: A Systematic Replication
Saville, B. K., Pope, D. A., Lovaas, P., & Williams, J. L. (2012) · Teaching of Psychology · doi:10.1177/0098628312456628 · Cited by 30
The improved name game: Better use of expanding retrieval practice
Morris, P. E., & Fritz, C. O. (2002) · Memory · doi:10.1080/09658210143000371 · Cited by 29
Aging, spaced retrieval, and inflexible memory performance
Bishara, A. J., & Jacoby, L. L. (2008) · Psychonomic Bulletin & Review · doi:10.3758/pbr.15.1.52 · Cited by 28
Comparing the Effects of Testing and Restudying on Recollection in Recognition Memory
Verkoeijen, P. P. J. L., Tabbers, H. K., & Verhage, M. L. (2011) · Experimental Psychology · doi:10.1027/1618-3169/a000117 · Cited by 25
A Short-Term Testing Effect in Cross-Language Recognition
Verkoeijen, P. P. J. L., Bouwmeester, S., & Camp, G. (2012) · Psychological Science · doi:10.1177/0956797611435132 · Cited by 25
Deficiencies of Reporting in Meta-Analyses and Some Remedies
Harwell, M., & Maeda, Y. (2008) · The Journal of Experimental Education · doi:10.3200/jexe.76.4.403-430 · Cited by 24
Teachers Say the Most Interesting Things — An Alternative View of Testing
Buck, S., Ritter, G. W., Jensen, N. C., et al. (2010) · Phi Delta Kappan · doi:10.1177/003172171009100613 · Cited by 23
Retrieval experience as a modifier of future encoding: Another test effect.
Bjork, E. L., & Storm, B. C. (2011) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037/a0023549 · Cited by 23
Interteaching and the Testing Effect: A Preliminary Analysis
Lambert, T. L., & Saville, B. K. (2012) · Teaching of Psychology · doi:10.1177/0098628312450435 · Cited by 18
Pu, X., & Tse, C. (2013) · Cognitive Processing · doi:10.1007/s10339-013-0580-2 · Cited by 16
Repeated Testing, Item Selection, and Relearning: The Benefits of Testing Outweigh the Costs
de Jonge, M., & Tabbers, H. K. (2013) · Experimental Psychology (formerly Zeitschrift für Experimentelle Psychologie) · doi:10.1027/1618-3169/a000189 · Cited by 14
Retention of Prose Materials: The Effect of Testing
Duchastel, P. C. (1979) · The Journal of Educational Research · doi:10.1080/00220671.1979.10885176 · Cited by 12
Long-Term Retention of Prose following Testing
Duchastel, P. C., & Nungester, R. J. (1981) · Psychological Reports · doi:10.2466/pr0.1981.49.2.470 · Cited by 7
Bouwmeester, S., & Verkoeijen, P. P. J. L. (2010) · European Journal of Psychology of Education · doi:10.1007/s10212-010-0036-3 · Cited by 6
The “Testing” Effect and Restricted Retrieval Rehearsal
Glover, J. A., Krug, D., Hannon, S., & Shine, A. E. (1990) · The Psychological Record · doi:10.1007/bf03399560 · Cited by 5
Extension of Testing Effects on the Retention of Prose
Duchastel, P. C. (1980) · Psychological Reports · doi:10.2466/pr0.1980.47.3f.1062 · Cited by 3
Effect of Testing on Retention of Prose: A Replication
Duchastel, P. C. (1980) · Psychological Reports · doi:10.2466/pr0.1980.46.1.182 · Cited by 2
(2000) · doi:10.1002/(sici)1099-0720(200005/06)14:3<215::aid-acp640>3.0.co;2-1
Research works printed but not linked: 8
- Bjork R. A., 1992, From learning processes to cognitive processes: Essays in honor of William K. Estes, 2, 35
- 10.1002/(SICI)1099-0720(200005/06)14:3<215::AID-ACP640>3.3.CO;2-T · doi:10.1002/(sici)1099-0720(200005/06)14:3<215::aid-acp640>3.3.co;2-t
- Gates A. I., 1917, Archives of Psychology, 6, 1
- 10.1111/j.1365-2923.2008.03245.x · DOI · Paper page
- Lipsey M. W., 2001, Practical meta-analysis: Applied social research methods series, 49
- *Masson M. E., 1981, Journal of Experimental Psychology: Human Learning and Memory, 7, 100
- 10.1037/a0026166 · DOI · Paper page
- Roediger H. L., 2013, Encyclopedia of the mind, 660
Cited by
Transfer of test- enhanced learning: meta-analytic review and synthesis
Pan, S. C., & Rickard, T. C. (2018) · Psychological Bulletin · doi:10.1037/bul0000151 · Cited by 286
Agarwal, P. K., Nunes, L. D., & Blunt, J. R. (2021) · Educational Psychology Review · doi:10.1007/s10648-021-09595-9 · Cited by 211
Fostering effective learning strategies in higher education—A mixed-methods study.
Biwer, F., Egbrink, M. G. A. O., Aalten, P., & de Bruin, A. B. H. (2020) · Journal of Applied Research in Memory and Cognition · doi:10.1016/j.jarmac.2020.03.004 · Cited by 195
The science of effective learning with spacing and retrieval practice
Carpenter, S. K., Pan, S. C., & Butler, A. C. (2022) · Nature Reviews Psychology · doi:10.1038/s44159-022-00089-1 · Cited by 184
Makransky, G., Wismer, P., & Mayer, R. E. (2019) · Journal of Computer Assisted Learning · doi:10.1111/jcal.12335 · Cited by 175
“The simulations used multiple choice questions with explanatory feedback as a way of priming appropriate metacognitive processing during learning (Makransky et al., 2006; Mayer, 2016) based on literature that has shown the benefits of retrieval practice (e.g., Adescope et al., 2017).”
Method
Metadata
- Authors
- Adesope, O. O., Trevisan, D. A., & Sundararajan, N.
- Affiliations
- Washington State University (US)
- Simon Fraser University (CA)
- Venue
- Review of Educational Research
- Published
- 2017-02-01
- Volume
- 87
- Issue
- 3
- Pages
- 659-701
- ISSN
- 0034-6543 (ISSN-L)
- 1935-1046
- OpenAlex
- W2624412722
- Cited by
- 544
- References
- 163
- Citations by year
- 2026: 61 · 2025: 61 · 2024: 86 · 2023: 76 · 2022: 60 · 2021: 55 · 2020: 55 · 2019: 43 · 2018: 40 · 2017: 6
- FWCI
- 4.39
- Type
- journal article
- Language
- en
- Update notices
- correction (2017-03-15)
- Open access
- closed
- Licence
- journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
- Locations
- Review of Educational Research (publishedVersion)
- Funders
- Washington State University’s College of Education Faculty Funding Award
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Memory Processes and Influences
- Social Sciences › Psychology › Developmental and Educational Psychology › Innovative Teaching and Learning Methods
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Visual and Cognitive Learning Processes
- Keywords
- practice tests, testing effect, restudying, learning and retention, moderators of effect size, student learning
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.