The effect of testing versus restudy on retention: A meta-analytic review of the testing effect.
The DOI matches its Crossref record; 138 of the 139 references it cites were found in a registry or an index.
Abstract
Meta-analysis uses meta-analysis to examine the effects of testing versus restudy on retention and indicates support for the role of effortful processing as a contributor to the testing effect.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Regarding retrieval practice, over a century of research has demonstrated that students who practice retrieving information have better and longer memory retention for that information compared to students who engage with the material more passively (e.g., restudying).”
From The benefits of successive relearning on multiple learning outcomes. (2022) · cites this paper as Rowland, 2014
In the citing paper
“whereas retrieval practice is the phenomenon that actively recalling information from memory enhances memory”
From Does Retrieval Practice Protect Memory Against Stress? A Meta-Analysis (2025) · cites this paper as Rowland, 2014
In the citing paper
“However, meta-analyses on the benefits of retrieval practice (e.g., Rowland, 2014) show consistently positive effects regardless of the different types of materials used.”
From Does Retrieval Practice Protect Memory Against Stress? A Meta-Analysis (2025) · cites this paper as Rowland, 2014
In the citing paper
“consistent with the robust testing effect (Agarwal et al., 2021; Rowland, 2014; Schwieren et al., 2017; Yang et al., 2021).”
From Does Retrieval Practice Protect Memory Against Stress? A Meta-Analysis (2025) · cites this paper as Rowland, 2014
In the citing paper
“Effect sizes range from moderate to large, with estimates between d = 0.55 and d = 0.88 (Phelps, 2012), g = 0.50 (Rowland, 2014), and g = 0.61 to g = 0.70 (Adesope et al., 2017).”
From Testing the testing effect on prolific: when retrieval practice fails to boost learning (2026) · cites this paper as Rowland, 2014
13 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Measuring inconsistency in meta-analyses
Higgins, J. P. T., Thompson, S. G., Deeks, J. J., & Altman, D. G. (2003) · BMJ · doi:10.1136/bmj.327.7414.557 · Cited by 63,139
The file drawer problem and tolerance for null results.
Rosenthal, R. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.3.638 · Cited by 9,068
Distribution Theory for Glass's Estimator of Effect Size and Related Estimators
Hedges, L. V. (1981) · Journal of Educational Statistics · doi:10.2307/1164588 · Cited by 5,695
Creating false memories: Remembering words not presented in lists.
Roediger, H. L., & McDermott, K. B. (1995) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/0278-7393.21.4.803 · Cited by 3,792
Fixed-and random-effects models in meta-analysis.
Hedges, L. V., & Vevea, J. L. (1998) · Psychological Methods · doi:10.1037/1082-989x.3.4.486 · Cited by 2,977
Test-Enhanced Learning: Taking Memory Tests Improves Long-Term Retention
Roediger, H. L., & Karpicke, J. D. (2006) · Psychological Science · doi:10.1111/j.1467-9280.2006.01693.x · Cited by 2,867
Levels of processing versus transfer appropriate processing
Morris, C. D., Bransford, J. D., & Franks, J. J. (1977) · Journal of Verbal Learning and Verbal Behavior · doi:10.1016/s0022-5371(77)80016-9 · Cited by 2,296
The power of testing memory: Basic research and implications for educational practice
Roediger, H. L., & Karpicke, J. D. (2006) · Perspectives on Psychological Science · doi:10.1111/j.1745-6916.2006.00012.x · Cited by 2,037
The critical role of retrieval practice in long-term retention
Roediger, H. L., & Butler, A. C. (2011) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2010.09.003 · Cited by 1,796
The Critical Importance of Retrieval for Learning
Karpicke, J. D., & Roediger, H. L. (2008) · Science · doi:10.1126/science.1152408 · Cited by 1,791
Cited by
Eight Ways to Promote Generative Learning
Fiorella, L., & Mayer, R. E. (2016) · Educational Psychology Review · doi:10.1007/s10648-015-9348-9 · Cited by 832
“…tasks (i.e., materials high in element interactivity; e.g., Leahy et al. 2015; Van Gog and Kester 2012; Van Gog et al. 2015), other studies report positive effects of self-testing with complex learning materials (e.g., Darabi et al. 2007; see Rowland 2014 for a recent meta-analysis).”
BackgroundFlipped Classrooms: a Review of Key Ideas and Recommendations for Practice
DeLozier, S. J., & Rhodes, M. G. (2017) · Educational Psychology Review · doi:10.1007/s10648-015-9356-9 · Cited by 570
“Such retrieval enhances memory for the retrieved information, compared to rereading that material, a finding known as the testing effect (for reviews, see Roediger 2008; Rowland 2014).”
Rethinking the Use of Tests: A Meta-Analysis of Practice Testing
Adesope, O. O., Trevisan, D. A., & Sundararajan, N. (2017) · Review of Educational Research · doi:10.3102/0034654316689306 · Cited by 544
“More recently, Rowland (2014) authored a meta-analysis to understand the theoretical underpinnings of studies that examined the testing effect.”
BackgroundGamification in the classroom: Examining the impact of gamified quizzes on student learning
Sanchez, D. R., Langer, M., & Kaur, R. (2020) · Computers & Education · doi:10.1016/j.compedu.2019.103666 · Cited by 328
The Compoundness and Sequentiality of Digital Inequality
van Deursen, A. J. A. M., Helsper, E. J., Eynon, R., & van Dijk, J. A. G. M. (2017) · International journal of communication · Cited by 536
Transfer of test- enhanced learning: meta-analytic review and synthesis
Pan, S. C., & Rickard, T. C. (2018) · Psychological Bulletin · doi:10.1037/bul0000151 · Cited by 286
De Wilde, V., Brysbaert, M., & Eyckmans, J. (2020) · Bilingualism: Language and Cognition · doi:10.1017/s1366728918001062 · Cited by 282
Retrieval as a fast route to memory consolidation
Antony, J. W., Ferreira, C. S., Norman, K. A., & Wimber, M. (2017) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2017.05.001 · Cited by 242
“No mechanistic framework exists to date integrating these behavioral findings with the growing literature on the neural basis of learning and memory [1].”
BackgroundInfluentialInstructor and student knowledge of study strategies.
Morehead, K., Rhodes, M. G., & DeLozier, S. (2016) · Memory · doi:10.1080/09658211.2014.1001992 · Cited by 230
“Memory is also enhanced when learners engage in retrieval (rather than restudy) of to-be-remembered information, a benefit known as the testing effect (see Rowland, 2014, for a review).”
BackgroundRetrieval-Based Learning: A Decade of Progress
Karpicke, J. D. (2017) · Learning and Memory: A Comprehensive Reference · doi:10.1016/b978-0-12-809324-5.21055-9 · Cited by 223
“Karpicke et al. (2014b) proposed an episodic context account of retrieval-based learning, which has also been developed and expanded upon in other articles (Lehman et al., 2014; Whiffen and Karpicke, 2017; see also Rowland, 2014; Rowland and DeLosh, 2014).”
BackgroundAgarwal, P. K., Nunes, L. D., & Blunt, J. R. (2021) · Educational Psychology Review · doi:10.1007/s10648-021-09595-9 · Cited by 211
“…from both laboratory and applied settings (Adesope et al. 2017; Bangert-Drowns et al. 1991; Brame and Biel 2015; Dunlosky et al. 2013; Eisenkraemer et al. 2013; Green et al. 2018; Karpicke and Grimaldi 2012; McLaughlin and Coderre 2015; Nguyen and McDaniel 2015; Pyc et al. 2014; Rowland 2014).”
BackgroundFostering effective learning strategies in higher education—A mixed-methods study.
Biwer, F., Egbrink, M. G. A. O., Aalten, P., & de Bruin, A. B. H. (2020) · Journal of Applied Research in Memory and Cognition · doi:10.1016/j.jarmac.2020.03.004 · Cited by 195
The science of effective learning with spacing and retrieval practice
Carpenter, S. K., Pan, S. C., & Butler, A. C. (2022) · Nature Reviews Psychology · doi:10.1038/s44159-022-00089-1 · Cited by 184
Lachner, A., Fabian, A., Franke, U., Preiß, J., Jacob, L., Führer, C., Küchler, U., Paravicini, W., Randler, C., & Thomas, P. (2021) · Computers & Education · doi:10.1016/j.compedu.2021.104304 · Cited by 179
A Neural Chronometry of Memory Recall
Staresina, B. P., & Wimber, M. (2019) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2019.09.011 · Cited by 171
“If ripple-mediated plasticity can be induced via awake cued recall, this might provide a plausible physiological basis for why repeatedly recalling a memory is such a powerful means to make memories last, thereby bridging between low-level physiology and cognitive theories of the ‘testing effect’ [71,120,121].”
Sekeres, M. J., Bonasia, K., St-Laurent, M., Pishdadian, S., Winocur, G., Grady, C., & Moscovitch, M. (2016) · Learning & Memory · doi:10.1101/lm.039057.115 · Cited by 166
Retrieval of Emotional Events from Memory
Kensinger, E. A., & Ford, J. H. (2020) · Annual Review of Psychology · doi:10.1146/annurev-psych-010419-051123 · Cited by 168
Rodrigues, L., Pereira, F. D., Toda, A. M., Palomino, P. T., Pessoa, M., Carvalho, L. S. G., Fernandes, D., Oliveira, E. H. T., Cristea, A. I., & Isotani, S. (2022) · International Journal of Educational Technology in Higher Education · doi:10.1186/s41239-021-00314-6 · Cited by 173
“We can see attempts as a measure of relevant learning behavior based on the testing effect: the idea that the more one is tested, the more one learns Rowland (2014); Rodrigues et al. (2021); Sanchez et al. (2020).”
BackgroundMethodvan Gog, T., & Sweller, J. (2015) · Educational Psychology Review · doi:10.1007/s10648-015-9310-x · Cited by 164
“According to a Google Scholar search (December 2014), his work has only been cited in nine other publications.”
Retrieval practice & Bloom’s taxonomy: Do students need fact knowledge before higher order learning?
Agarwal, P. K. (2019) · Journal of Educational Psychology · doi:10.1037/edu0000282 · Cited by 164
“When students engage in retrieval activities that bring knowledge to mind, learning is strengthened by the challenge (for recent meta-analyses, see Adesope, Trevisan, & Sundararajan, 2017; Rowland, 2014).”
BackgroundNonmonotonic Plasticity: How Memory Retrieval Drives Learning
Ritvo, V. J. H., Turk‐Browne, N. B., & Norman, K. A. (2019) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2019.06.007 · Cited by 162
“Crucially, neither of these scenarios explains why retrieval of ‘hollow’ is a strongly positive (reinforcing) learning experience, as has been demonstrated by myriad studies [35].”
Generative Learning: Which Strategies for What Age?
Brod, G. (2021) · Educational Psychology Review · doi:10.1007/s10648-020-09571-9 · Cited by 145
“A meta-analysis (Rowland 2014) that took into account unpublished studies revealed a moderately strong effect size (0.50 SDs) for studies that compared testing with a restudy control condition.”
ResultInfluentialKirk-Johnson, A., Galla, B. M., & Fraundorf, S. H. (2019) · Cognitive Psychology · doi:10.1016/j.cogpsych.2019.101237 · Cited by 190
Retrieval potentiates new learning: A theoretical and meta-analytic review.
Chan, J. C. K., Meissner, C. A., & Davis, S. D. (2018) · Psychological Bulletin · doi:10.1037/bul0000166 · Cited by 143
Multiple-choice testing in education: Are the best practices for assessment also good for learning?
Butler, A. C. (2018) · Journal of Applied Research in Memory and Cognition · doi:10.1016/j.jarmac.2018.07.002 · Cited by 142
Hopkins, R. F., Lyle, K. B., Hieb, J. L., & Ralston, P. A. S. (2016) · Educational Psychology Review · doi:10.1007/s10648-015-9349-8 · Cited by 136
“The retrieval practice effect refers to the robust finding that retrieving information from memory bolsters long-term retention more so than does restudying information (for a recent meta- analysis, see Rowland 2014).”
BackgroundPracticing Retrieval Facilitates Learning
McDermott, K. B. (2021) · Annual review of psychology · doi:10.1146/annurev-psych-010419-051019 · Cited by 113
“Rowland & DeLosh (2015), however, demonstrate that the level of success on the initial retrieval attempt is important in in determining whether an advantage of retrieval practice will appear at short intervals.”
BackgroundEnhancing learning and retrieval of new information: a review of the forward testing effect
Yang, C., Potts, R., & Shanks, D. R. (2018) · npj Science of Learning · doi:10.1038/s41539-018-0024-y · Cited by 119
“The backward testing effect has been repeatedly demonstrated in numerous studies using different educational materials in both laboratories and classrooms (for reviews, see refs.(7,8)).”
BackgroundAging and recognition memory: A meta-analysis.
Fraundorf, S. H., Hourihan, K. L., Peters, R. A., & Benjamin, A. S. (2019) · Psychological Bulletin · doi:10.1037/bul0000185 · Cited by 149
“The general benefits of testing on potentiating subsequent memory have been well-documented (Roediger & Karpicke, 2006; Rowland, 2014) although age differences in the size of this effect have not been clearly established (Meyer & Logan, 2013; Rabinowitz & Craik, 1986).”
BackgroundGeller, J., Toftness, A. R., Armstrong, P. I., Carpenter, S. K., Manz, C. L., Coffman, C. R., & Lamm, M. H. (2018) · Memory · doi:10.1080/09658211.2017.1397175 · Cited by 85
“restudied material has been widely demonstrated (for reviews, see Kornell & Vaughn, 2016; Rowland, 2014).”
BackgroundHoogerheide, V., Renkl, A., Fiorella, L., PAAS, F. G. W. C., & van Gog, T. (2018) · Journal of Educational Psychology · doi:10.1037/edu0000272 · Cited by 121
“It was important to control for the effect of retrieval practice, as retrieval practice is inherent to explaining and is a known strategy for enhancing learning outcomes in itself (Roediger, Putnam, & Smith, 2011; Rowland, 2014).”
MethodMcLaren, B. M., van Gog, T., Ganoe, C. H., Karabinos, M., & Yaron, D. (2015) · Computers in Human Behavior · doi:10.1016/j.chb.2015.08.038 · Cited by 135
“That is, research has shown that after initial study, testing is more effective for long-term learning than restudying, even though on an immediate test there may be no differences or restudy might even be more effective (Roediger & Karpicke, 2006; Rowland, 2014).”
BackgroundSchuchard, J., & Middleton, E. (2018) · Journal of Speech, Language and Hearing Research · doi:10.1044/2018_jslhr-l-17-0352 · Cited by 28
“, reexposure to the information), even though the restudy condition provides more exposures to the correct information (see Delaney et al., 2010; Karpicke et al., 2014; Roediger & Karpicke, 2006; Rowland, 2014).”
BackgroundInfluentialTest-enhanced learning in health professions education: A systematic review: BEME Guide No. 48
Green, M. L., Moeller, J. J., & Spak, J. M. (2018) · Medical Teacher · doi:10.1080/0142159x.2018.1430354 · Cited by 112
Lyle, K. B., Bego, C. R., Hopkins, R. F., Hieb, J. L., & Ralston, P. A. S. (2020) · Educational Psychology Review · doi:10.1007/s10648-019-09489-x · Cited by 103
The Testing Effect in the Psychology Classroom: A Meta-Analytic Perspective
Schwieren, J., Barenberg, J., & Dutke, S. (2017) · Psychology Learning & Teaching · doi:10.1177/1475725717695149 · Cited by 100
“More recently, Rowland (2014) meta-analysed the data of 61 experimental studies examining the effects of testing compared to restudying.”
BackgroundResultInfluentialEdelsbrunner, P. A., Simonsmeier, B. A., & Schneider, M. (2025) · Educational Psychology Review · doi:10.1007/s10648-024-09982-y · Cited by 231
“Another explanation might be (re-)testing effects that affected participants to process and integrate their knowledge (Rowland, 2014; Wilson et al., 2006).”
Individual differences in long-term memory.
Unsworth, N. (2019) · Psychological Bulletin · doi:10.1037/bul0000176 · Cited by 99
Rivers, M. L. (2021) · Educational Psychology Review · doi:10.1007/s10648-020-09578-2 · Cited by 81
“For example, Rowland (2014) reports that performance is greater for tested than restudied material across different materials, but the effect is larger for prose materials than multimedia material.”
BackgroundRetrieval practice protects memory against acute stress
Smith, A. M., Floerke, V. A., & Thomas, A. K. (2016) · Science · doi:10.1126/science.aah5067 · Cited by 97
A Meta-Analytic Review of the Benefit of Spacing out Retrieval Practice Episodes on Retention
Latimier, A., Peyre, H., & Ramus, F. (2021) · Educational Psychology Review · doi:10.1007/s10648-020-09572-8 · Cited by 96
“Rowland (2014) reported that it was stronger when the learning contents were more complex, when the type of retrieval practice was more effortful, and when feedback was given during practice.”
BackgroundMethodResultInfluentialIncidental Vocabulary Learning Through Listening to Teacher Talk
Jin, Z., & Webb, S. (2020) · Modern Language Journal · doi:10.1111/modl.12661 · Cited by 106
Neurocognitive mechanisms of the “testing effect”: A review
van den Broek, G. S. E., Takashima, A., Wiklund‐Hörnqvist, C., Wirebring, L. K., Segers, E., Verhoeven, L. T. W., & Nyberg, L. H. (2016) · Trends in Neuroscience and Education · doi:10.1016/j.tine.2016.05.001 · Cited by 114
“readers are referred to literature overviews in [3,4,49].”
BackgroundHow to Use Game Elements to Enhance Learning: Applications of the Theory of Gamified Learning
Landers, R. N., Armstrong, M. B., & Collmus, A. B. (2017) · Springer eBooks · doi:10.1007/978-3-319-51645-5_21 · Cited by 155
Enhancing learning by retrieval: Enriching free recall with elaborative prompting
Endres, T., Carpenter, S. K., Martin, A., & Renkl, A. (2016) · Learning and Instruction · doi:10.1016/j.learninstruc.2016.11.010 · Cited by 105
“Furthermore, many studies of retrieval practice havemeasured direct retention of relatively simple materials such as word pairs (see Rowland, 2014), so it is unknown whether the use of elaborative strategies consistently enhances retrieval-based learning of more complex materials.”
BackgroundThe cognitive principles of learning underlying the 5E Model of Instruction
Martín, H. R., & Bybee, R. W. (2022) · International Journal of STEM Education · doi:10.1186/s40594-022-00337-z · Cited by 177
“, reactivating the memory trace by reviewing the information) for an equivalent amount of time (Karpicke & Roediger, 2008; Rowland, 2014).”
BackgroundTwelve tips for applying the science of learning to health professions education
Gooding, H. C., Mann, K. V., & Armstrong, E. G. (2016) · Medical Teacher · doi:10.1080/0142159x.2016.1231913 · Cited by 97
Cavanagh, T. M., & Kiersch, C. (2022) · Educational Technology Research and Development · doi:10.1007/s11423-022-10181-1 · Cited by 200
“…controls and restudy conditions (Adesope et al., 2017), that short answer and free recall practice tests are more effective than multiple-choice or recognition tests, that feedback increases the size of the effect, and that delayed feedback is more effective than immediate feedback (Rowland, 2014).”
BackgroundThe effect of prequestions on learning from video presentations.
Carpenter, S. K., & Toftness, A. R. (2017) · Journal of Applied Research in Memory and Cognition · doi:10.1016/j.jarmac.2016.07.014 · Cited by 87
Using Testing as a Learning Tool
Yang, B. W., Razo, J. F., & Persky, A. M. (2019) · American Journal of Pharmaceutical Education · doi:10.5688/ajpe7324 · Cited by 108
“81).(15,16) Some researchers have argued that question formats requiringmore effort to generate the answer on the part of the student are better for learning.”
BackgroundResultInfluentialThe Effects of Cell Phone Use and Emotion‐regulation Style on College Students' Learning
Lee, S., Kim, M. W., McDonough, I. M., Mendoza, J. S., & Kim, M. S. (2017) · Applied Cognitive Psychology · doi:10.1002/acp.3323 · Cited by 105
The Oxford Handbook of the Mental Lexicon
Papafragou, A., Trueswell, J. C., & Gleitman, L. R. (2022) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780198845003.001.0001 · Cited by 88
Learning-by-Teaching Without Audience Presence or Interaction: When and Why Does it Work?
Lachner, A., Hoogerheide, V., van Gog, T., & Renkl, A. (2022) · Educational Psychology Review · doi:10.1007/s10648-021-09643-4 · Cited by 77
“Memory research has repeatedly shown that accessing information from long-term memory can strengthen the activated memory cues with a variety of learning materials, such as wordlists and complex conceptual materials (Carpenter, 2009; Roediger & Karpicke, 2006; Rowland, 2014).”
BackgroundResultInfluentialLachner, A., Jacob, L., & Hoogerheide, V. (2021) · Learning and Instruction · doi:10.1016/j.learninstruc.2020.101438 · Cited by 77
Retrieval Practice in Classroom Settings: A Review of Applied Research
Moreira, B. F. T., Pinto, T. S. S., Starling, D. S. V., & Jaeger, A. (2019) · Frontiers in Education · doi:10.3389/feduc.2019.00005 · Cited by 119
“Two further testing-effect meta-analytic reviews did not approach the testing effect on classroom environments (Rowland, 2014; Pan and Rickard, 2018).”
BackgroundElectrophysiological signatures of memory reactivation in humans
Schreiner, T., & Staudigl, T. (2020) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2019.0293 · Cited by 76
Storkel, H., Voelmle, K. A., Fierro, V., Flake, K., Fleming, K. K., & Romine, R. (2017) · Language, Speech & Hearing Services in Schools · doi:10.1044/2016_lshss-16-0014 · Cited by 62
“Prior research on children and adults with normal language suggests that testing enhances learning over and above gains made simply through study or input (Eisenkraemer, Jaeger, & Stein, 2013; Roediger & Butler, 2011; Rowland, 2014).”
The sleep benefit in episodic memory: An integrative review and a meta-analysis.
Berres, S., & Erdfelder, E. (2021) · Psychological Bulletin · doi:10.1037/bul0000350 · Cited by 74
Timing matters! Explaining between study phases enhances students’ learning.
Lachner, A., Backfisch, I., Hoogerheide, V., van Gog, T., & Renkl, A. (2019) · Journal of Educational Psychology · doi:10.1037/edu0000396 · Cited by 101
The many faces of forgetting: Toward a constructive view of forgetting in everyday life.
Fawcett, J. M., & Hulbert, J. C. (2020) · Journal of Applied Research in Memory and Cognition · doi:10.1016/j.jarmac.2019.11.002 · Cited by 96
“This long-term benefit f retrieval, known as the “testing effect,” has been documented n numerous lab-based studies, as well as in real-life contexts in hich participants learn new vocabulary or textbook materials Rowland, 2014).”
BackgroundSotola, L. K., & Crede, M. (2021) · Educational Psychology Review · doi:10.1007/s10648-020-09563-9 · Cited by 56
“However, on the whole, this explanation for the testing effect has received mixed support (see Rowland 2014, p. 4).”
BackgroundResultA dual memory theory of the testing effect
Rickard, T. C., & Pan, S. C. (2017) · Psychonomic Bulletin & Review · doi:10.3758/s13423-017-1298-4 · Cited by 84
Endres, T., & Renkl, A. (2015) · Frontiers in Psychology · doi:10.3389/fpsyg.2015.01054 · Cited by 71
“This aspect of retrieval is widely discussed and has attracted broad support (Rowland, 2014).”
BackgroundResultInfluentialFries, L., Son, J. Y., Givvin, K. B., & Stigler, J. W. (2020) · Educational Psychology Review · doi:10.1007/s10648-020-09561-x · Cited by 119
“Research on the testing effect, for example, shows that students learn more from trying to answer test questions than they do from being re-presented with the same information (McDaniel et al. 2007; Rowland 2014).”
BackgroundEffects of incorporating retrieval into learning tasks: The complexity of the tasks matters
Roelle, J., & Berthold, K. (2017) · Learning and Instruction · doi:10.1016/j.learninstruc.2017.01.008 · Cited by 81
“…indicates that the act of retrieval from memory (often referred to as retrieval practice) is a powerful way to promote learning (e.g., Blunt & Karpicke, 2014; Karpicke & Grimaldi, 2012; Lechuga, OrtegaTudela, & G omez-Ariza, 2015; Roediger & Butler, 2011; Roediger & Karpicke, 2006; Rowland, 2014).”
BackgroundInfluentialA Meta-Analysis of Ten Learning Techniques
Donoghue, G. M., & Hattie, J. A. C. (2021) · Frontiers in Education · doi:10.3389/feduc.2021.581216 · Cited by 72
“Rowland (2014) completed a meta-analysis on 61 studies investigating the effect of testing vs. restudy on retention.”
BackgroundGenerating an instructional video as homework activity is both effective and enjoyable
Hoogerheide, V., Visee, J. G. J., Lachner, A., & van Gog, T. (2019) · Learning and Instruction · doi:10.1016/j.learninstruc.2019.101226 · Cited by 88
van den Broek, G. S. E., Takashima, A., Segers, E., & Verhoeven, L. (2018) · Language Learning · doi:10.1111/lang.12285 · Cited by 67
Roelle, J., & Nückles, M. (2019) · Journal of Educational Psychology · doi:10.1037/edu0000345 · Cited by 87
Carpenter, S. K., Endres, T., & Hui, L. (2020) · Educational Psychology Review · doi:10.1007/s10648-020-09562-w · Cited by 129
“…were conducted over 100 years ago (e.g., Abott 1909; Gates 1917), and in the last few decades alone, hundreds of additional studies have been added to the ever growing literature on this topic (for recent reviews and meta-analyses, see Adesope et al. 2017; Dunlosky et al. 2013; Rowland 2014).”
Testing enhances both encoding and retrieval for both tested and untested items
Cho, K. W., Neely, J. H., Crocco, S., & Vitrano, D. (2016) · Quarterly Journal of Experimental Psychology · doi:10.1080/17470218.2016.1175485 · Cited by 78
“are successfully retrieved in the review test than for items that are not successfully retrieved (e.g., Kang et al., 2007; Rowland, 2014; Rowland & DeLosh, 2014a).”
BackgroundMethodInfluentialPereira, F. D., Fonseca, S. C., Oliveira, E. H. T., Cristea, A. I., Bellhauser, H., Rodrigues, L., Oliveira, D. B. F., Isotani, S., & Carvalho, L. S. G. (2021) · IEEE Access · doi:10.1109/access.2021.3105956 · Cited by 63
“Indeed, [60] showed that metacognitive strategies may be worth the equivalent of an additional 7x times greater progress than that used in a traditional environment.”
BackgroundExamining the Testing Effect in University Teaching: Retrievability and Question Format Matter
Greving, S., & Richter, T. (2018) · Frontiers in Psychology · doi:10.3389/fpsyg.2018.02412 · Cited by 79
“This finding is in line with previous findings from laboratory experiments (Rowland, 2014) and with the bifurcation model (Halamish and Bjork, 2011; Kornell et al., 2011).”
BackgroundMethodResultInfluentialChan, J. C. K., Manley, K. D., Davis, S. D., & Szpunar, K. K. (2018) · Journal of Memory and Language · doi:10.1016/j.jml.2018.05.007 · Cited by 68
“” The dearth of research on delay is particularly glaring given the copious amount of evidence for the longevity of the testing effect (for reviews, see Adesope, Trevisan, & Sundararajan, 2017; Rowland, 2014).”
BackgroundMnemonic benefits of retrieval practice at short retention intervals
Rowland, C. A., & DeLosh, E. L. (2015) · Memory · doi:10.1080/09658211.2014.889710 · Cited by 64
“For instance, in a meta-analysis, Rowland (2014) showed that a sizeable portion of studies in the testing effect literature do not report initial test performance data (approximately a quarter of testing effects included in the analysis), with substantially more studies not integrating initial test…”
BackgroundSelf-citationSchuchard, J., & Middleton, E. L. (2018) · Cognitive Neuropsychology · doi:10.1080/02643294.2018.1461615 · Cited by 66
“, 2003); retrieval practice research supports the necessity of successful retrieval attempts to induce the full benefits of retrieving information from long-term memory (Jang, Wixted, Pecher, Zeelenberg, & Huber, 2012; Kornell, Bjork, & Garcia, 2011; Rowland, 2014; Rowland & DeLosh, 2015).”
BackgroundInfluentialMiyatsu, T., & McDaniel, M. A. (2019) · Memory & Cognition · doi:10.3758/s13421-019-00936-2 · Cited by 64
“This caution is an important consideration often neglected by researchers and educators in light of the generally robust testing effects reported in the literature (e.g., Dunlosky et al., 2013; Rowland, 2014).”
BackgroundZengilowski, A., Schuetze, B. A., Nash, B. L., & Schallert, D. L. (2021) · Educational Psychologist · doi:10.1080/00461520.2020.1861948 · Cited by 74
“…effect, adjunct question effect, retrieval practice, and test-enhanced learning has shown that, in comparison to material participants reread, tested knowledge is more likely to be recalled on future tests (Karpicke & Blunt, 2011; Roediger & Butler, 2011; Rothkopf & Bisbicos, 1967; Rowland, 2014).”
ResultBiwer, F., de Bruin, A. B. H., & Persky, A. M. (2022) · Advances in Health Sciences Education · doi:10.1007/s10459-022-10149-z · Cited by 113
“by answering test questions) produces better long-term retention compared to repeated rereading of the material (Adesope et al., 2017; Rowland, 2014).”
BackgroundPan, S. C., & Carpenter, S. K. (2023) · Educational Psychology Review · doi:10.1007/s10648-023-09814-5 · Cited by 60
“…is well-established as a potent enhancer of learning for a plethora of materials across a wide array of educationally relevant circumstances (for reviews, see Carpenter, 2012; Carpenter et al., 2022; Dunlosky et al., 2013; Pan & Rickard, 2018; Roediger & Karpicke, 2006; Rowland, 2014, and others).”
BackgroundDietrich, J., Greiner, F., Weber-Liel, D., Berweger, B., Kämpfe, N., & Kracke, B. (2021) · Computers in Human Behavior · doi:10.1016/j.chb.2021.106819 · Cited by 71
Improving Lifelong Learning by Fostering Students’ Learning Strategies at University
Endres, T., Leber, J., Böttger, C., Rovers, S., & Renkl, A. (2020) · Psychology Learning & Teaching · doi:10.1177/1475725720952025 · Cited by 88
van der Velde, M., Sense, F., Spijkers, R., Meeter, M., & van Rijn, H. (2021) · Frontiers in Education · doi:10.3389/feduc.2021.712987 · Cited by 25
“Retrieval practice is a well-established and effective study method in which learners are prompted to actively recall the learning material (Roediger and Butler, 2011; Rowland, 2014).”
MethodEcological Validity of the Testing Effect: The Use of Daily Quizzes in Introductory Psychology
Batsell, W. R., Perry, J. L., Hanley, E., & Hostetter, A. B. (2017) · Teaching of Psychology · doi:10.1177/0098628316677492 · Cited by 56
“A recent meta-analysis of the testing effect by Rowland (2014) suggests that the necessary condition to produce the phenomenon is effortful recall.”
Does pre-testing promote better retention than post-testing?
Latimier, A., Riegert, A., Peyre, H., Ly, S. T., Casati, R., & Ramus, F. (2019) · npj Science of Learning · doi:10.1038/s41539-019-0053-1 · Cited by 83
Martinelli, S. M., Isaak, R. S., Schell, R. M., Mitchell, J., McEvoy, M. D., & Chen, F. (2019) · Anesthesiology · doi:10.1097/aln.0000000000002827 · Cited by 63
Do judgments of learning directly enhance learning of educational materials?
Ariel, R., Karpicke, J. D., Witherby, A. E., & Tauber, S. K. (2021) · Educational Psychology Review · doi:10.1007/s10648-020-09556-8 · Cited by 55
“Given that retrieval practice typically improves learning outcomes more than restudy (for a review, see Rowland 2014), JOLs that afford retrieval practice should increase learning more than JOLs that afford an additional study opportunity.”
BackgroundRoelle, J., & Renkl, A. (2019) · Journal of Educational Psychology · doi:10.1037/edu0000365 · Cited by 63
Insights From the Science of Learning Can Inform Evidence-Based Implementation of Peer Instruction
Schell, J. A., & Butler, A. C. (2018) · Frontiers in Education · doi:10.3389/feduc.2018.00033 · Cited by 76
“…above, retrieval practice is one of the most robust and well-established active-learning strategies in the science of learning (for review see Roediger and Karpicke, 2006; Roediger and Butler, 2011; Carpenter, 2012; Dunlosky et al., 2013; Rowland, 2014), and it pervades the Peer Instruction method.”
BackgroundMethodLarsen, D. (2018) · Seminars in Neurology · doi:10.1055/s-0038-1666983 · Cited by 53
Yeo, D. J. S., & Fazio, L. K. (2018) · Journal of Educational Psychology · doi:10.1037/edu0000268 · Cited by 70
“Both recommendations are strongly supported by previous research (see Adesope, Trevisan, & Sundararajan, 2017; Atkinson, Derry, Renkl, & Wortham, 2000; Renkl, 2014; Rowland, 2014, for reviews and meta-analyses), but it is currently unclear when teachers should rely on each learning strategy.”
BackgroundResultInfluentialSein, A. S., Rashid, H., Meka, J., Amiel, J. M., & Pluta, W. J. (2020) · Medical Teacher · doi:10.1080/0142159x.2020.1789081 · Cited by 64
The Value of Using Tests in Education as Tools for Learning—Not Just for Assessment
Murphy, D. H., Little, J. L., & Bjork, E. L. (2023) · Educational Psychology Review · doi:10.1007/s10648-023-09808-3 · Cited by 104
The role of mediator strength in learning from retrieval
Carpenter, S. K., & Yeung, K. L. (2016) · Journal of Memory and Language · doi:10.1016/j.jml.2016.06.008 · Cited by 64
“The benefits of retrieval have been demonstrated in both laboratory studies (see Rowland, 2014, for a recent meta-analysis), and in classroom-based studies using realistic course materials (Carpenter, Pashler, & Cepeda, 2009; Carpenter et al., 2016; Goossens, Camp, Verkoeijen, Tabbers, & Zwaan,…”
BackgroundMethodResultExtending the testing effect to self-regulated learning
Fernandez, J., & Jamet, É. (2016) · Metacognition and Learning · doi:10.1007/s11409-016-9163-9 · Cited by 61
Investigating the testing effect: Retrieval as a characteristic of effective study strategies
Bae, C. L. L., Therriault, D. J., & Redifer, J. L. (2018) · Learning and Instruction · doi:10.1016/j.learninstruc.2017.12.008 · Cited by 62
Barenberg, J., & Dutke, S. (2018) · Memory · doi:10.1080/09658211.2018.1506481 · Cited by 67
“The calculation of the sample size was geared to the results of previous meta-analyses revealing medium-sized overall effects of testing at the cognitive performance level (e.g., Rowland, 2014; Schwieren et al., 2017).”
BackgroundOpen-Book Versus Closed-Book Tests in University Classes: A Field Experiment
Rummer, R., Schweppe, J., & Schwede, A. (2019) · Frontiers in Psychology · doi:10.3389/fpsyg.2019.00463 · Cited by 58
Retrieval aids the creation of a generalised memory trace and strengthens episode-unique information
Ferreira, C. S., Charest, I., & Wimber, M. (2019) · NeuroImage · doi:10.1016/j.neuroimage.2019.07.009 · Cited by 58
Bosch, E., Seifried, E., & Spinath, B. (2021) · Learning and Individual Differences · doi:10.1016/j.lindif.2021.102056 · Cited by 70
Metadata
- Authors
- Rowland, C. A.
- Affiliations
- Colorado State University (US)
- Corresponding author
- Rowland, Christopher A.
- Venue
- Psychological Bulletin
- Published
- 2014
- Volume
- 140
- Issue
- 6
- Pages
- 1432-1463
- ISSN
- 0033-2909 (ISSN-L)
- 1939-1455
- OpenAlex
- W2050255700
- Cited by
- 1,066
- References
- 139
- Citations by year
- 2026: 71 · 2025: 103 · 2024: 139 · 2023: 113 · 2022: 138 · 2021: 122 · 2020: 105 · 2019: 91 · 2018: 73 · 2017: 52 · 2016: 36 · 2015: 19 · 2014: 3
- FWCI
- 20.46
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Psychological Bulletin (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Memory Processes and Influences
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Visual and Cognitive Learning Processes
- Life Sciences › Neuroscience › Cognitive Neuroscience › Memory and Neural Mechanisms
- Keywords
- testing effect, restudy, retention, effortful processing, recall tests, recognition test, semantic elaboration, memory retrieval, bifurcation model, memory consolidation
- MeSH terms
- Attention, Cues, Educational Measurement, Humans, Learning, Memory, Neuropsychological Tests, Practice, Psychological, Mental Recall, Retention, Psychology, Semantics, Students, Universities
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.