The effect of testing versus restudy on retention: A meta-analytic review of the testing effect.
The DOI matches its Crossref record; 138 of the 139 references it cites were found in a registry or an index.
Abstract
Meta-analysis uses meta-analysis to examine the effects of testing versus restudy on retention and indicates support for the role of effortful processing as a contributor to the testing effect.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Regarding retrieval practice, over a century of research has demonstrated that students who practice retrieving information have better and longer memory retention for that information compared to students who engage with the material more passively (e.g., restudying).”
From The benefits of successive relearning on multiple learning outcomes. (2022) · cites this paper as Rowland, 2014
In the citing paper
“whereas retrieval practice is the phenomenon that actively recalling information from memory enhances memory”
From Does Retrieval Practice Protect Memory Against Stress? A Meta-Analysis (2025) · cites this paper as Rowland, 2014
In the citing paper
“However, meta-analyses on the benefits of retrieval practice (e.g., Rowland, 2014) show consistently positive effects regardless of the different types of materials used.”
From Does Retrieval Practice Protect Memory Against Stress? A Meta-Analysis (2025) · cites this paper as Rowland, 2014
In the citing paper
“consistent with the robust testing effect (Agarwal et al., 2021; Rowland, 2014; Schwieren et al., 2017; Yang et al., 2021).”
From Does Retrieval Practice Protect Memory Against Stress? A Meta-Analysis (2025) · cites this paper as Rowland, 2014
In the citing paper
“Effect sizes range from moderate to large, with estimates between d = 0.55 and d = 0.88 (Phelps, 2012), g = 0.50 (Rowland, 2014), and g = 0.61 to g = 0.70 (Adesope et al., 2017).”
From Testing the testing effect on prolific: when retrieval practice fails to boost learning (2026) · cites this paper as Rowland, 2014
13 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Measuring inconsistency in meta-analyses
Higgins, J. P. T., Thompson, S. G., Deeks, J. J., & Altman, D. G. (2003) · BMJ · doi:10.1136/bmj.327.7414.557 · Cited by 63,139
The file drawer problem and tolerance for null results.
Rosenthal, R. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.3.638 · Cited by 9,068
Distribution Theory for Glass's Estimator of Effect Size and Related Estimators
Hedges, L. V. (1981) · Journal of Educational Statistics · doi:10.2307/1164588 · Cited by 5,695
Creating false memories: Remembering words not presented in lists.
Roediger, H. L., & McDermott, K. B. (1995) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/0278-7393.21.4.803 · Cited by 3,792
Fixed-and random-effects models in meta-analysis.
Hedges, L. V., & Vevea, J. L. (1998) · Psychological Methods · doi:10.1037/1082-989x.3.4.486 · Cited by 2,977
Test-Enhanced Learning: Taking Memory Tests Improves Long-Term Retention
Roediger, H. L., & Karpicke, J. D. (2006) · Psychological Science · doi:10.1111/j.1467-9280.2006.01693.x · Cited by 2,867
Levels of processing versus transfer appropriate processing
Morris, C. D., Bransford, J. D., & Franks, J. J. (1977) · Journal of Verbal Learning and Verbal Behavior · doi:10.1016/s0022-5371(77)80016-9 · Cited by 2,296
The power of testing memory: Basic research and implications for educational practice
Roediger, H. L., & Karpicke, J. D. (2006) · Perspectives on Psychological Science · doi:10.1111/j.1745-6916.2006.00012.x · Cited by 2,037
The critical role of retrieval practice in long-term retention
Roediger, H. L., & Butler, A. C. (2011) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2010.09.003 · Cited by 1,796
The Critical Importance of Retrieval for Learning
Karpicke, J. D., & Roediger, H. L. (2008) · Science · doi:10.1126/science.1152408 · Cited by 1,791
Cited by
Items 201–300 of 1,077
Do Practice Tests (Quizzes) Reduce or Provoke Test Anxiety? A Meta-Analytic Review
Yang, C., Li, J., Zhao, W., Luo, L., & Shanks, D. R. (2023) · Educational Psychology Review · doi:10.1007/s10648-023-09801-w · Cited by 52
The Testing Effect and Its Relation to Working Memory Capacity and Personality Characteristics
Bertilsson, F., Wiklund‐Hörnqvist, C., Stenlund, T., & Jonsson, B. (2017) · Journal of Cognitive Education and Psychology · doi:10.1891/1945-8959.16.3.241 · Cited by 29
“Most studies on the testing effect compares retrieval practice to a control condition consisting of restudy, and despite equal exposure to the material for the two conditions, retrieval practice is consistently found to outperform restudy (see Rowland, 2014, for a review).”
Pereira, F. D., Rodrigues, L., Henklain, M. H. O., Freitas, H., Oliveira, D. F., Cristea, A. I., Carvalho, L., Isotani, S., Benedict, A., Dorodchi, M., et al. (2023) · IEEE Transactions on Learning Technologies · doi:10.1109/tlt.2022.3224121 · Cited by 26
“Moreover, the testing effect theory has shown to be effective in many fields of education [50].”
BackgroundStimulating the intention to change learning strategies: The role of narratives
Hui, L., de Bruin, A. B. H., Donkers, J., & van Merriënboer, J. J. G. (2021) · International Journal of Educational Research · doi:10.1016/j.ijer.2021.101753 · Cited by 25
The testing effect in a social setting: Does retrieval practice benefit a listener?
Abel, M., & Roediger, H. L., III (2017) · Journal of Experimental Psychology Applied · doi:10.1037/xap0000148 · Cited by 31
“…in order to avoid social contagion with incorrect answers (e.g., Meade & Roediger, 2002; Roediger, Meade, & Bergman, 2001) and to increase potential testing effects (e.g., Arnold & McDermott, 2013; Kang, McDermott, & Roediger, 2007; Pashler, Cepeda, Wixted, & Rohrer, 2005; see also Rowland, 2014).”
BackgroundPan, S. C., Cooke, J., Little, J. L., McDaniel, M. A., Foster, E. R., Connor, L. T., & Rickard, T. C. (2019) · CBE—Life Sciences Education · doi:10.1187/cbe.18-12-0248 · Cited by 29
“Both online and clicker quizzes are generally easily implemented, although a possible disadvantage is that they may be less potent than more extensive formats (Rowland, 2014).”
BackgroundTesting together: When do students learn more through collaborative tests?
LoGiudice, A. B., Pachai, A. A., & Kim, J. A. (2015) · Scholarship of Teaching and Learning in Psychology · doi:10.1037/stl0000041 · Cited by 31
Evaluation of Cognitive Skill Degradation in Flight Planning
Volz, K. M., & Dorneich, M. C. (2020) · Journal of Cognitive Engineering and Decision Making · doi:10.1177/1555343420962897 · Cited by 36
“Attempting to recall information has been shown to enhance learning (Kornell & Vaughn, 2016; Rowland, 2014).”
BackgroundLeonard, L. B., Christ, S. L., Deevy, P., Karpicke, J. D., Weber, C., Haebig, E., Kueser, J. B., Souto, S., & Krok, W. C. (2021) · Journal of Neurodevelopmental Disorders · doi:10.1186/s11689-021-09368-z · Cited by 28
“This insight has been the impetus for numerous studies over the years, with a resurgence in this line of research in the last 15 years (see reviews in [5 – 8]).”
Liu, X. L., & Ranganath, C. (2021) · Psychonomic Bulletin & Review · doi:10.3758/s13423-021-01953-6 · Cited by 32
“Considerable evidence, however, suggests that episodic memory is more dynamic, such that repeated retrieval of an event (“retrieval practice”) dramatically enhances the ability to retain the practiced information (Karpicke & Roediger, 2008; Roediger & Butler, 2011; Rowland, 2014).”
BackgroundRoelle, J., Froese, L., Krebs, R., Obergassel, N., & Waldeyer, J. (2022) · Learning and Instruction · doi:10.1016/j.learninstruc.2022.101634 · Cited by 37
fMRI exploration of pedagogical benefits of repeated testing: when more is not always better
Liu, X. L., & Reder, L. M. (2016) · Brain and Behavior · doi:10.1002/brb3.476 · Cited by 23
“Considerable research has demonstrated the benefits of memory retrieval on subsequent memory, highlighting a phenomenon known as the testing effect (Carrier and Pashler 1992; Roediger and Karpicke 2006a,b; McDaniel et al. 2007; Pashler et al. 2007; Karpicke and Roediger 2008; Rowland 2014).”
BackgroundAssessing students' use of optional online lecture reviews
Corral, D., Carpenter, S. K., Perkins, K., & Gentile, D. A. (2020) · Applied Cognitive Psychology · doi:10.1002/acp.3618 · Cited by 28
“For example, the use of online practice quizzes can afford retrieval practice, in which retrieving information from long-term memory improves learning and retention of that information (Brame & Biel, 2015; Dunlosky, Rawson, Marsh, Nathan, & Willingham, 2013; Roediger & Butler, 2011; Rowland, 2014).”
BackgroundThe benefits of successive relearning on multiple learning outcomes.
Higham, P. A., Zengel, B., Bartlett, L. K., & Hadwin, J. A. (2022) · Journal of Educational Psychology · doi:10.1037/edu0000693 · Cited by 23
Constructive retrieval: Benefits for learning, motivation, and metacognitive monitoring
Endres, T., Carpenter, S. K., & Renkl, A. (2024) · Learning and Instruction · doi:10.1016/j.learninstruc.2024.101974 · Cited by 36
Reminders activate the prefrontal‐medial temporal cortex and attenuate forgetting of event memory
Sekeres, M. J., Moscovitch, M., Winocur, G., Pishdadian, S., Nichol, D., & Grady, C. L. (2020) · Hippocampus · doi:10.1002/hipo.23260 · Cited by 23
“…consistent with the mnemonic-enhancing testing effect, in which repeated “test” or active retrieval session lead to superior retention of information over time relative to a re-study, or reminder, session (Karpicke & Roediger, 2008; Oedekoven et al., 2017; Roediger & Karpicke, 2006; Rowland, 2014).”
ResultSupporting the self-regulated use of retrieval practice: A higher education classroom experiment
Broeren, M., Heijltjes, A., Verkoeijen, P., Smeets, G., & Arends, L. (2021) · Contemporary Educational Psychology · doi:10.1016/j.cedpsych.2020.101939 · Cited by 19
“…participants, for various learning tasks and materials with different complexity levels, in different study contexts and on a substantial amount of outcome measures (e.g., McDaniel, Roediger, & Mcdermott, 2007; Roediger & Karpicke, 2006b; Dunlosky et al., 2013; Rowland, 2014; Karpicke & Aue, 2015).”
BackgroundTracing Preservice Teachers’ Understanding of Nature of Science Through Their Drawings and Writing
Barak, M., Yachin, T., & Erduran, S. (2022) · Research in Science Education · doi:10.1007/s11165-022-10069-3 · Cited by 27
“Adding a retention test might have provided more insights as educational studies have shown that conceptions that are overlooked in a post-test can reappear in a retention test (Rowland, 2014).”
MethodNunn, K., Rohter, S. V., & Middleton, E. L. (2023) · Journal of Speech Language and Hearing Research · doi:10.1044/2022_jslhr-22-00251 · Cited by 25
The effect of recall, reproduction, and restudy on word learning: a pre-registered study
Krishnan, S., Watkins, K. E., & Bishop, D. (2017) · BMC Psychology · doi:10.1186/s40359-017-0198-8 · Cited by 28
“In a recent meta-analysis, Rowland [11] demonstrated that the bifurcation and retrieval effort hypotheses best fit experimental data, with elaborative processing suggested as a mechanism that fits with the data, but one which cannot stand alone.”
BackgroundInfluentialSt. Hilaire, K. J., Carpenter, S. K., & Jennings, J. M. (2019) · Memory · doi:10.1080/09658211.2019.1641209 · Cited by 23
“One well-known strategy is retrieval practice, the finding that answering test questions after studying enhances retention to a greater degree than repeated study (e.g. Carpenter, 2012; Dunlosky, Rawson, Marsh, Nathan, & Willingham, 2013; Karpicke, 2017; Rowland, 2014).”
BackgroundZamary, A., & Rawson, K. A. (2016) · Educational Psychology Review · doi:10.1007/s10648-016-9396-9 · Cited by 29
Distributed Practice: Rarely Realized in Self-Regulated Mathematical Learning
Barzagar Nazari, K., & Ebersbach, M. (2018) · Frontiers in Psychology · doi:10.3389/fpsyg.2018.02170 · Cited by 23
“Most of these learning strategies have been studied extensively in the laboratory and are known to result in robust and strong performance improvements as compared to the respective control conditions (Bertsch et al., 2007; Rohrer, 2012; Rowland, 2014; Adesope et al., 2017; Brunmair and Richter, 2018).”
BackgroundLearning new word meanings from story reading: the benefit of immediate testing
Hulme, R. C., & Rodd, J. M. (2021) · PeerJ · doi:10.7717/peerj.11693 · Cited by 23
“The “testing effect” refers to the finding that testing memory following training can enhance long-term retention, as the additional retrieval practice at test affords an opportunity for further learning (for reviews, see Roediger & Butler, 2011; Rowland, 2014).”
BackgroundMethodInfluentialAdaptive retrieval practice with multiple‐choice questions in the university classroom
Greving, S., Lenhard, W., & Richter, T. (2020) · Journal of Computer Assisted Learning · doi:10.1111/jcal.12445 · Cited by 25
“Theoretical accounts on the testing effect often assume more difficult practice procedures to result in more sustainable memory traces (e.g., Roediger & Karpicke, 2006b; Rowland, 2014).”
BackgroundResultInfluentialKubik, V., Jönsson, F. U., de Jonge, M., & Arshamian, A. (2020) · Quarterly Journal of Experimental Psychology · doi:10.1177/1747021820945560 · Cited by 24
It matters how to recall – task differences in retrieval practice
Endres, T., Kranzdorf, L., Schneider, V., & Renkl, A. (2020) · Instructional Science · doi:10.1007/s11251-020-09526-1 · Cited by 33
“Although our hypotheses have not yet been supported by empirical studies or meta-analyses (see also discussion, Rowland 2014), our findings suggest that there are systematic differences between tasks when the appropriate analytic grain size is chosen, that is, when learning contents and outcomes…”
BackgroundInfluentialWorking toward a theoretical model for source comprehension in everyday discourse
Braasch, J. L. G., & Kessler, E. D. (2021) · Discourse Processes · doi:10.1080/0163853x.2021.1905393 · Cited by 23
“Above and beyond reexposure, research has consistently demonstrated that retrieval practice can substantially increase LTM retention (Dunlosky et al., 2013; Karpicke & Roediger, 2008; Rowland, 2014).”
BackgroundOn the Role of Error in Motor Learning
Lee, T. D., Eliasz, K. L., Gonzalez, D. A., Alguire, K., Ding, K., & Dhaliwal, C. (2015) · Journal of Motor Behavior · doi:10.1080/00222895.2015.1046545 · Cited by 28
Janes, J., Dunlosky, J., & Rawson, K. A. (2018) · Journal of Applied Research in Memory and Cognition · doi:10.1016/j.jarmac.2017.11.003 · Cited by 24
Testing enhances both memorization and conceptual learning of categorical materials.
Cho, K. W., & Powers, A. (2019) · Journal of Applied Research in Memory and Cognition · doi:10.1016/j.jarmac.2019.01.003 · Cited by 24
How to activate students’ natural desire to test themselves
Vaughn, K. E., & Kornell, N. (2019) · Cognitive Research: Principles and Implications · doi:10.1186/s41235-019-0187-y · Cited by 13
“People learn more when they retrieve information from memory than when they are told the same information (Roediger & Butler, 2011; Rowland, 2014).”
BackgroundTesting enhances memory for context
Akan, M., Stanley, S. E., & Benjamin, A. S. (2018) · Journal of Memory and Language · doi:10.1016/j.jml.2018.07.003 · Cited by 29
“The effect size can be considered of medium-to-large magnitude (g=0.49, 95% CI [0.36, 0.62]), and is slightly smaller than the effect sizes (g= 0.57–0.61) reported in a metaanalysis of the testing effect (Rowland, 2014).”
BackgroundMethodResultInfluentialA Review of the Application of Distributed Practice Principles to Naming Treatment in Aphasia
Middleton, E. L., Schuchard, J., & Rawson, K. A. (2020) · Topics in Language Disorders · doi:10.1097/tld.0000000000000202 · Cited by 24
“Specifically, countless studies have shown that retrieval practice, or practice retrieving target information (e.g., the English translation of a Swahili word) from long-term memory, confers robust learning relative to restudying that information (for a review, see Rowland, 2014).”
BackgroundOptimizing practice scheduling requires quantitative tracking of individual item performance
Eglington, L. G., & Pavlik, P. I. (2020) · npj Science of Learning · doi:10.1038/s41539-020-00074-4 · Cited by 30
Yan, V. X., & Wang, L. (2021) · Frontiers in Education · doi:10.3389/feduc.2021.643421 · Cited by 21
Greving, S., & Richter, T. (2022) · Journal of Cognitive Psychology · doi:10.1080/20445911.2022.2085281 · Cited by 33
A meta-analysis on the effect of expertise on eye movements during music reading
Perra, J., Latimier, A., Poulin-Charronnat, B., Thierry Baccino, B., & Drai-Zerbib, V. (2022) · Journal of Eye Movement Research · doi:10.16910/jemr.15.4.1 · Cited by 25
Walsh, C. R., & Rissman, J. (2023) · Nature Communications · doi:10.1038/s41467-023-42770-w · Cited by 27
“No feedback was provided, as feedback can provide an additional restudying opportunity that can enhance fi nal test performance for tested items 68 and in fl ate testing effects 28 .”
Does testing with feedback improve adult spelling skills relative to copying and reading?
Pan, S. C., Rubin, B. R., & Rickard, T. C. (2015) · Journal of Experimental Psychology Applied · doi:10.1037/xap0000062 · Cited by 24
McDaniel, M. A., & Little, J. L. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108235631.020 · Cited by 32
Guran, C.-N. A., Herweg, N. A., & Bunzeck, N. (2019) · Journal of Neuroscience · doi:10.1523/jneurosci.2791-18.2019 · Cited by 21
“While this cannot easily be explained by the “fast-route to consolidation” hypothesis, it might be attributable to enhanced difficulty (or effort) associated with retrieval (Bjork, 1999; Rowland, 2014), or a broader searchstrategy and activation of related semantic concepts (Chan et al., 2006).”
BackgroundGuran, C.-N. A., Lehmann-Grube, J., & Bunzeck, N. (2020) · Frontiers in Psychology · doi:10.3389/fpsyg.2019.02997 · Cited by 28
Using tests to reduce mind-wandering during learning review
Peterson, D. J., & Wissman, K. (2020) · Memory · doi:10.1080/09658211.2020.1748657 · Cited by 23
Testing Effect on High-Level Cognitive Skills
Jensen, J. L., McDaniel, M. A., Kummer, T. A., Godoy, P. D. D. M., & Clair, B. S. (2020) · CBE—Life Sciences Education · doi:10.1187/cbe.19-10-0193 · Cited by 29
“Often referred to as the testing effect, test-enhanced learning is a promising principle demonstrated as a strengthening of retention of information that was previously tested or retrieved (for recent reviews, see Roediger et al., 2011; Dunlosky and Thiede, 2013; Rowland, 2014).”
BackgroundWalck-Shannon, E. M., Cahill, M. J., McDaniel, M. A., & Frey, R. F. (2019) · CBE—Life Sciences Education · doi:10.1187/cbe.18-08-0163 · Cited by 24
Wiklund‐Hörnqvist, C., Stillesjö, S., Andersson, M., Jonsson, B., & Nyberg, L. (2021) · Brain and Behavior · doi:10.1002/brb3.1909 · Cited by 20
“…effect is the number of successful repeated retrievals during learning (e.g., Jang et al., 2012; Rawson & Dunlosky, 2011; Roediger & Butler, 2011; Rowland, 2014), we predicted that HC activity would scale with the number of successful retrievals during learning at day one (i.e., the initial…”
BackgroundMethodInfluentialSelective effects of errorful generation on recognition memory: the role of motivation and surprise
Seabrooke, T., Mitchell, C. J., Wills, A. J., Waters, J. L., & Hollins, T. J. (2019) · Memory · doi:10.1080/09658211.2019.1647247 · Cited by 22
“This benefit of testing is known as the testing effect (for reviews, see Kornell & Vaughn, 2016; Roediger & Karpicke, 2006; for recent meta-analyses, see Adesope, Trevisan, & Sundararajan, 2017; Rowland, 2014).”
MethodA database of general knowledge question performance in older adults
Coane, J. H., & Umanath, S. (2021) · Behavior Research Methods · doi:10.3758/s13428-020-01493-2 · Cited by 25
“…paired associates or word lists (e.g., Coane, 2013; Pastötter & Baüml, 2019) or more complex prose passages (e.g., Roediger & Karpicke, 2006; see Rowland, 2014; van Gog & Sweller, 2015, for reviews), there are experimental paradigms and conditions in which meaningful yet easily controlled…”
BackgroundCleaning working memory: The fate of distractors
Dagry, I., Vergauwe, E., & Barrouillet, P. (2016) · Journal of Memory and Language · doi:10.1016/j.jml.2016.08.002 · Cited by 22
Retrieval Practice in Memory- and Language-Impaired Populations: A Systematic Review
de Lima, M. F. R., Cavendish, B. A., de Deus, J. S., & Buratto, L. G. (2020) · Archives of Clinical Neuropsychology · doi:10.1093/arclin/acaa035 · Cited by 23
“Although feedback is not necessary to elicit an RP effect (Rowland, 2014), it is important in RP designs with clinical populations.”
BackgroundInfluentialDoes retrieval potentiate new learning when retrieval stops but new learning continues?
Chan, J. C. K., Manley, K. D., & Ahn, D. (2020) · Journal of Memory and Language · doi:10.1016/j.jml.2020.104150 · Cited by 22
Backfisch, I., Franke, U., Ohla, K., Scholtz, N., & Lachner, A. (2023) · Unterrichtswissenschaft · doi:10.1007/s42010-023-00192-z · Cited by 29
“…to investigate the effectiveness of distinct design features within teacher education courses, such as lesson plans, teacher education courses should be of longer duration which allow to implement the same pre-and posttests measures without the risk of bias form the testing effect (Rowland 2014).”
Long-term inference and memory following retrieval practice
Siler, J., & Benjamin, A. S. (2019) · Memory & Cognition · doi:10.3758/s13421-019-00997-3 · Cited by 26
“Retrieving information enhances memory for that information more than passive restudy (for review, see Rowland, 2014).”
BackgroundMyers, S. J., Davis, S. D., & Chan, J. C. K. (2021) · Cognitive Research Principles and Implications · doi:10.1186/s41235-021-00309-x · Cited by 30
“Indeed, test taking, which requires memory retrieval, is a well-supported method to improve students’ long-term retention of the tested material and to learn new material (for reviews, see Chan, Meissner, & Davis, 2018; Rowland, 2014).”
MethodThe Effects of Different Feedback Types on Learning With Mobile Quiz Apps
Rüth, M., Breuer, J., Zimmermann, D., & Kaspar, K. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2021.665144 · Cited by 30
“…(e.g., from preschool to adult age), learning materials (e.g., word pairs or general knowledge questions), and learning objectives (e.g., recognition or comprehension) according to meta-analyses (Rowland, 2014; Adesope et al., 2017) and reviews (Rawson and Dunlosky, 2012; Dunlosky et al., 2013).”
BackgroundHow do college students use digital flashcards during self-regulated learning?
Zung, I., Imundo, M. N., & Pan, S. C. (2022) · Memory · doi:10.1080/09658211.2022.2058553 · Cited by 43
“The retrieval practice e ff ect is enhanced by correct answer feedback (e.g., Pan, Hutter, et al., 2019; for review see Rowland, 2014), as it can help learners to maintain their own correct response (Butler et al., 2008) or adjust their response if they made errors (Kang et al., 2007).”
BackgroundMethodInfluentialCuevas, J. A., Childers, G. M., & Dawson, B. L. (2023) · Trends in Neuroscience and Education · doi:10.1016/j.tine.2023.100209 · Cited by 30
Education and training assessment and artificial intelligence. a pragmatic guide for educators
Newton, P. M., & Jones, S. (2025) · British Journal of Biomedical Science · doi:10.3389/bjbs.2024.14049 · Cited by 19
Sundqvist, M. L., Mäntylä, T., & Jönsson, F. U. (2017) · Frontiers in Psychology · doi:10.3389/fpsyg.2017.01018 · Cited by 21
Impact of Spacing of Practice on Learning Brand Name and Generic Drugs
Terenyi, J., Anksorus, H. N., & Persky, A. M. (2017) · American Journal of Pharmaceutical Education · doi:10.5688/ajpe6179 · Cited by 20
“Contract 0 93 (27) 31 (48) 1 94 (23) 55 (50) 2 98 (14) c 68 (47) b,c Equal 0 100 (0) 52 (51) 1 96 (20) 46 (50) 2 96 (19) 62 (49) c Expand 0 96 (21) 26 (45) 1 90 (30) 44 (50) 2 96 (20) c 62 (49) b,c Data presented as percentage correct (SD) Different than 0 successes within the condition (p,.”
The mitigating effect of repeated memory reactivations on forgetting
MacLeod, S., Reynolds, M. G., & Lehmann, H. (2018) · npj Science of Learning · doi:10.1038/s41539-018-0025-x · Cited by 23
“involve effortful retrieval of the originally studied information and can be accompanied by new studying of that original information.(34,35) This implies, for instance, that an individual providing a description of the tuxedo they wore at their wedding would benefit the retention of that memory.”
BackgroundResultInfluentialIn search of transfer following cued recall practice: The case of process‐based biology concepts
Pan, S. C., Hutter, S. A., D'Andrea, D., Unwalla, D., & Rickard, T. C. (2018) · Applied Cognitive Psychology · doi:10.1002/acp.3506 · Cited by 21
The long-term consequences of retrieval demands during working memory
Loaiza, V. M., Doherty, C., & Howlett, P. (2020) · Memory & Cognition · doi:10.3758/s13421-020-01079-5 · Cited by 23
“Although DFR was unsurprisingly lower overall for the no-recall versus serial-recall trials, owing to an overall effect of retrieval practice (Rowland, 2014), the McCabe effect was evident in both recall conditions.”
Sepp, S., Wong, M., Hoogerheide, V., & Castro-Alonso, J. C. (2022) · Journal of Computer Assisted Learning · doi:10.1111/jcal.12715 · Cited by 28
“One of the most robust generative strategy is practice testing (cf. retrieval practice or testing effect; for reviews, see Adesope et al., 2017; Fiorella & Mayer, 2016; Rowland, 2014).”
BackgroundKubik, V., Gaschler, R., & Hausman, H. (2021) · Psychology Learning & Teaching · doi:10.1177/1475725720976462 · Cited by 25
“For example, it has been shown that feedback is more efficient when it is delayed (compared to immediate feedback, Butler et al., 2007; Rowland, 2014), and when the outcome of interest is cognitive (e.g., learning performance) compared to motivational (e.g., intrinsic motivation; Wisniewski et al.,…”
BackgroundInfluentialDoolittle, P. E., & Byrnes, M. K. (2023) · Wiley eBooks · doi:10.1002/9781119852865.ch3 · Cited by 23
Levlin, M., Wiklund‐Hörnqvist, C., Sandgren, O., Karlsson, S., & Jonsson, B. (2022) · Language Speech and Hearing Services in Schools · doi:10.1044/2021_lshss-21-00101 · Cited by 31
The impact of feedback mode on learning gain and self-efficacy: A quasi-experimental study
Johannes, C., & Haase, A. (2022) · Active Learning in Higher Education · doi:10.1177/14697874221131970 · Cited by 28
“The results show medium to high effects exceeding typical effects of repeated testing (Rowland, 2014).”
Leonard, L. B., Deevy, P., Horvath, S., Christ, S. L., Karpicke, J. D., & Kueser, J. B. (2023) · Journal of Speech Language and Hearing Research · doi:10.1044/2022_jslhr-22-00509 · Cited by 20
“The last 20 years has been a period of especially strong interest in this topic (see reviews in Fazio & Marsh, 2019; Rowland, 2014).”
BackgroundFormative and Summative Automated Assessment with Multiple-Choice Question Banks
Beerepoot, M. T. P. (2023) · Journal of Chemical Education · doi:10.1021/acs.jchemed.3c00120 · Cited by 39
Emerging and Future Directions in Test-Enhanced Learning Research
Pan, S. C., Dunlosky, J. T., Xu, M. K., & Ouwehand, K. (2024) · Educational Psychology Review · doi:10.1007/s10648-024-09857-2 · Cited by 31
“…materials that are being used have expanded beyond simple verbal materials to a wide range of stimuli (for discussions see Pan & Rickard, 2018; Rowland, 2014; for a listing, see Rawson & Dunlosky, 2011) varying from mathematical functions (e.g., Kang et al., 2011) to medical procedures (e.g.,…”
Generation and Retrieval Practice Effects in the Classroom Using PeerWise
Kelley, M. R., Chapman-Orr, E. K., Calkins, S., & Lemke, R. J. (2019) · Teaching of Psychology · doi:10.1177/0098628319834174 · Cited by 22
Nazari, K. B., & Ebersbach, M. (2019) · Trends in Neuroscience and Education · doi:10.1016/j.tine.2019.100122 · Cited by 18
A multimedia effect for multiple-choice and constructed-response test items.
Lindner, M. A., Schult, J., & Mayer, R. E. (2020) · Journal of Educational Psychology · doi:10.1037/edu0000646 · Cited by 24
College student normative misperceptions of peer study habit use
Anthenien, A. M., Delozier, S., Neighbors, C., & Rhodes, M. G. (2017) · Social Psychology of Education · doi:10.1007/s11218-017-9412-z · Cited by 24
The Forward Testing Effect is Reliable and Independent of Learners’ Working Memory Capacity
Pastötter, B., & Frings, C. (2019) · Journal of Cognition · doi:10.5334/joc.82 · Cited by 25
Rapid acquisition through fast mapping: stable memory over time and role of prior knowledge
Li, C., Hu, Z., & Yang, J. (2020) · Learning & Memory · doi:10.1101/lm.050138.119 · Cited by 21
The Testing Effect and Far Transfer: The Role of Exposure to Key Information
van Eersel, G. G., Verkoeijen, P. P. J. L., Povilenaite, M., & Rikers, R. M. J. P. (2016) · Frontiers in Psychology · doi:10.3389/fpsyg.2016.01977 · Cited by 23
“Although there is agreement in the literature that the testing effect usually arises after a long retention interval (i.e., longer than 1 day), mixed support has been found for short intervals (Rowland, 2014).”
BackgroundPredicting Visuospatial and Verbal Working Memory by Individual Differences in E-Learning Activities
Fellman, D., Lincke, A., Berge, E., & Jonsson, B. (2020) · Frontiers in Education · doi:10.3389/feduc.2020.00022 · Cited by 24
“The quizzes administered on the e-learning platform were of optional nature and primarily applied from the framework of retrieval practice; a strategy shown to have positive effects on the learning outcomes (for reviews, see Kornell et al., 2011; Rowland, 2014).”
MethodExploring the relationship between retrieval practice, self-efficacy, and memory
Frankenstein, A. N., Udeogu, O. J., McCurdy, M. P., Sklenar, A. M., & Leshikar, E. D. (2022) · Memory & Cognition · doi:10.3758/s13421-022-01324-z · Cited by 27
“Further, because prior work demonstrates that retrieval practice can extend to content that is not tested in a practice test but is related to tested materials (see Adesope et al., 2017; Pan & Rickard, 2018; Rowland, 2014), we also predicted to see a retrieval practice effect for new items on the final test (i.”
BackgroundMethodResultInfluentialHalamish, V., & Elias, D. (2022) · Computers & Education · doi:10.1016/j.compedu.2022.104606 · Cited by 25
Wang, L., Muenks, K. M., & Yan, V. X. (2023) · Journal of Educational Psychology · doi:10.1037/edu0000813 · Cited by 22
Hopper, W. J., & Huber, D. E. (2018) · Journal of Memory and Language · doi:10.1016/j.jml.2018.04.005 · Cited by 25
“Despite many empirical investigations and several proposed theoretical accounts, there is no universally accepted explanation for testing effects, or retrieval-based learning more broadly (Rowland, 2014).”
BackgroundBulgarelli, F., & Weiss, D. J. (2021) · Language Learning · doi:10.1111/lang.12464 · Cited by 15
“Previous research suggests that one retrieval attempt is sufficient to stimulate better longterm learning (for meta-analyses, see Adesope, Trevisan, & Sundararajan, 2017; Rowland, 2014).”
BackgroundRoslan, R. E., Ayub, A. F. M., Ghazali, N., & Zulkifli, N. N. (2021) · ANP Journal Of Social Sciences And Humanities · doi:10.53797/anp.jssh.v2i2.10.2021 · Cited by 25
Welhaf, M. S., Phillips, N. E., Smeekens, B. A., Miyake, A., & Kane, M. J. (2022) · Cognitive Research Principles and Implications · doi:10.1186/s41235-022-00372-y · Cited by 25
“More generally, other aspects of our study design may have minimized the size of the interpolated testing effect on memory (i.e., on the lecture posttest), based on moderator results from recent meta-analyses (Adesope et al., 2017; Rowland, 2014).”
BackgroundMethodInfluentialMemory sins in applied settings: What kind of progress?
Schacter, D. L. (2022) · Journal of Applied Research in Memory and Cognition · doi:10.1037/mac0000078 · Cited by 18
“This pattern is robust and has been con fi rmed in a formal meta-analysis (Rowland, 2014).”
Alitto, J., Malecki, C. K., Coyle, S., & Santuzzi, A. M. (2016) · Journal of School Psychology · doi:10.1016/j.jsp.2016.03.002 · Cited by 25
Rios, J. A., Ihlenfeldt, S. D., Dosedel, M., & Riegelman, A. (2019) · Educational Measurement Issues and Practice · doi:10.1111/emip.12282 · Cited by 21
Teaching Approaches to Learn Theoretical Contents in Physical Education: A Study about Contour Lines
Calle, N. J. B., Escudero, A., & Bores‐García, D. (2020) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph17228599 · Cited by 19
Woods, S. P., Babicz, M. A., Matchanova, A., Sullivan, K. L., Avci, G., Hasbun, R., Giordano, T. P., Fazeli, P. L., & Morgan, E. E. (2020) · Archives of Clinical Neuropsychology · doi:10.1093/arclin/acaa130 · Cited by 16
The Impact of Online Quizzes on Student Success
Bognár, L., Fauszt, T., & Váraljai, M. (2021) · International Journal of Emerging Technologies in Learning (iJET) · doi:10.3991/ijet.v16i11.21679 · Cited by 19
“Well-structured and timed assessments can provide insights into student progress, provide dynamic and personalized assessments, measure immediately, reveal student thinking, and have many other benefits [18], [24].”
BackgroundLow-Stakes Quizzes Improve Learning and Reduce Overconfidence in College Students
Kenney, K. L., & Bailey, H. R. (2021) · Journal of the Scholarship of Teaching and Learning · doi:10.14434/josotl.v21i2.28650 · Cited by 32
“Recent meta-analyses evaluating the effect of retrieval practice on memory reported medium to strong effect sizes (Adesope, Trevisan, & Sundararajan, 2017: g = .74; Rowland, 2014: g = .55).”
BackgroundHaverkamp, Y. E., Bråten, I., Latini, N., & Strømsø, H. I. (2024) · Contemporary Educational Psychology · doi:10.1016/j.cedpsych.2024.102271 · Cited by 28
“Compared to a general endorsement of main idea summarization in the literature, the effectiveness of just rereading or restudying the material for learning and performance has been questioned (e.g., Ekuni et al., 2022; Karpicke & Roediger, 2008; Rowland, 2014; Wallace, Elliot, & Rogge, 2022).”
BackgroundMethodKubik, V., Olofsson, J., Nilsson, L., & Jönsson, F. U. (2015) · Journal of Cognitive Psychology · doi:10.1080/20445911.2015.1111378 · Cited by 16
“…practice) reduces the rate of forgetting as compared to restudy of previously learned information, as shown in a variety of learning materials (e.g. English–Swahili word pairs, Pyc & Rawson, 2012; visuospatial information, Carpenter & Pashler, 2007; for a meta-analytic review, see Rowland, 2014).”
BackgroundReduced interference from memory testing: A postretrieval monitoring account.
Pierce, B. H., Gallo, D. A., & McCain, J. L. (2017) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037/xlm0000377 · Cited by 18
Comparing retrieval-based practice and peer instruction in physics learning
Zu, T., Munsell, J., & Rebello, N. S. (2019) · Physical Review Physics Education Research · doi:10.1103/physrevphyseducres.15.010105 · Cited by 23
Optimizing the Spacing of Retrieval Practice to Improve Pharmacy Students’ Learning of Drug Names
Terenyi, J., Anksorus, H. N., & Persky, A. M. (2019) · American Journal of Pharmaceutical Education · doi:10.5688/ajpe7029 · Cited by 17
Wenzel, K., & Reinhard, M. (2019) · Intelligence · doi:10.1016/j.intell.2019.101405 · Cited by 23
Metadata
- Authors
- Rowland, C. A.
- Affiliations
- Colorado State University (US)
- Corresponding author
- Rowland, Christopher A.
- Venue
- Psychological Bulletin
- Published
- 2014
- Volume
- 140
- Issue
- 6
- Pages
- 1432-1463
- ISSN
- 0033-2909 (ISSN-L)
- 1939-1455
- OpenAlex
- W2050255700
- Cited by
- 1,066
- References
- 139
- Citations by year
- 2026: 71 · 2025: 103 · 2024: 139 · 2023: 113 · 2022: 138 · 2021: 122 · 2020: 105 · 2019: 91 · 2018: 73 · 2017: 52 · 2016: 36 · 2015: 19 · 2014: 3
- FWCI
- 20.46
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Psychological Bulletin (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Memory Processes and Influences
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Visual and Cognitive Learning Processes
- Life Sciences › Neuroscience › Cognitive Neuroscience › Memory and Neural Mechanisms
- Keywords
- testing effect, restudy, retention, effortful processing, recall tests, recognition test, semantic elaboration, memory retrieval, bifurcation model, memory consolidation
- MeSH terms
- Attention, Cues, Educational Measurement, Humans, Learning, Memory, Neuropsychological Tests, Practice, Psychological, Mental Recall, Retention, Psychology, Semantics, Students, Universities
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.