The effect of testing versus restudy on retention: A meta-analytic review of the testing effect.
The DOI matches its Crossref record; 138 of the 139 references it cites were found in a registry or an index.
Abstract
Meta-analysis uses meta-analysis to examine the effects of testing versus restudy on retention and indicates support for the role of effortful processing as a contributor to the testing effect.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Regarding retrieval practice, over a century of research has demonstrated that students who practice retrieving information have better and longer memory retention for that information compared to students who engage with the material more passively (e.g., restudying).”
From The benefits of successive relearning on multiple learning outcomes. (2022) · cites this paper as Rowland, 2014
In the citing paper
“whereas retrieval practice is the phenomenon that actively recalling information from memory enhances memory”
From Does Retrieval Practice Protect Memory Against Stress? A Meta-Analysis (2025) · cites this paper as Rowland, 2014
In the citing paper
“However, meta-analyses on the benefits of retrieval practice (e.g., Rowland, 2014) show consistently positive effects regardless of the different types of materials used.”
From Does Retrieval Practice Protect Memory Against Stress? A Meta-Analysis (2025) · cites this paper as Rowland, 2014
In the citing paper
“consistent with the robust testing effect (Agarwal et al., 2021; Rowland, 2014; Schwieren et al., 2017; Yang et al., 2021).”
From Does Retrieval Practice Protect Memory Against Stress? A Meta-Analysis (2025) · cites this paper as Rowland, 2014
In the citing paper
“Effect sizes range from moderate to large, with estimates between d = 0.55 and d = 0.88 (Phelps, 2012), g = 0.50 (Rowland, 2014), and g = 0.61 to g = 0.70 (Adesope et al., 2017).”
From Testing the testing effect on prolific: when retrieval practice fails to boost learning (2026) · cites this paper as Rowland, 2014
13 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Measuring inconsistency in meta-analyses
Higgins, J. P. T., Thompson, S. G., Deeks, J. J., & Altman, D. G. (2003) · BMJ · doi:10.1136/bmj.327.7414.557 · Cited by 63,139
The file drawer problem and tolerance for null results.
Rosenthal, R. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.3.638 · Cited by 9,068
Distribution Theory for Glass's Estimator of Effect Size and Related Estimators
Hedges, L. V. (1981) · Journal of Educational Statistics · doi:10.2307/1164588 · Cited by 5,695
Creating false memories: Remembering words not presented in lists.
Roediger, H. L., & McDermott, K. B. (1995) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/0278-7393.21.4.803 · Cited by 3,792
Fixed-and random-effects models in meta-analysis.
Hedges, L. V., & Vevea, J. L. (1998) · Psychological Methods · doi:10.1037/1082-989x.3.4.486 · Cited by 2,977
Test-Enhanced Learning: Taking Memory Tests Improves Long-Term Retention
Roediger, H. L., & Karpicke, J. D. (2006) · Psychological Science · doi:10.1111/j.1467-9280.2006.01693.x · Cited by 2,867
Levels of processing versus transfer appropriate processing
Morris, C. D., Bransford, J. D., & Franks, J. J. (1977) · Journal of Verbal Learning and Verbal Behavior · doi:10.1016/s0022-5371(77)80016-9 · Cited by 2,296
The power of testing memory: Basic research and implications for educational practice
Roediger, H. L., & Karpicke, J. D. (2006) · Perspectives on Psychological Science · doi:10.1111/j.1745-6916.2006.00012.x · Cited by 2,037
The critical role of retrieval practice in long-term retention
Roediger, H. L., & Butler, A. C. (2011) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2010.09.003 · Cited by 1,796
The Critical Importance of Retrieval for Learning
Karpicke, J. D., & Roediger, H. L. (2008) · Science · doi:10.1126/science.1152408 · Cited by 1,791
Cited by
Items 601–700 of 1,077
Improving Memory Search Through Model-Based Cue Selection
Cornell, C. A., Norman, K. A., Griffiths, T. L., & Zhang, Q. (2024) · Psychological Science · doi:10.1177/09567976231215298 · Cited by 10
“…benefits (i.e., recalling more items), systems that generate effective retrieval cues could confer long-lasting benefits on memory: It is well known that successfully recalling a memory is one of the best ways to ensure its future accessibility (the testing effect; e.g., Rowland, 2014).”
BackgroundLess to produce and less to consume: the advantage of pure question-based learning
Jemstedt, A., Bälter, O., Gavel, A., Glassey, R. J., & Bosk, D. (2024) · Interactive Learning Environments · doi:10.1080/10494820.2024.2362830 · Cited by 6
“Furthermore, because students on a pQBL course need to reason more on the questions when they do not have access to a text or video about the question subject, it could lead to more effective learning (Carpenter, 2009; Rowland, 2014).”
Effects of elaborate feedback during practice tests: Costs and benefits of retrieval prompts.
van den Broek, G. S. E., Segers, E., van Rijn, H., Takashima, A., & Verhoeven, L. T. W. (2019) · Journal of Experimental Psychology Applied · doi:10.1037/xap0000212 · Cited by 7
“Bob cannot recall the translation, so Ann says, “Think of the word vest!” Suddenly Bob remembers: “Oh, right! Vestis is clothing!” The two students in this fictional example practice the retrieval of words from memory—a practice strategy that a plethora of research has shown to enhance long-term retention (Adesope, Tr…”
BackgroundResultInfluentialKubik, V., Nilsson, L., Olofsson, J., & Jönsson, F. U. (2015) · Scandinavian Journal of Psychology · doi:10.1111/sjop.12238 · Cited by 6
Retention of Text Material under Cued and Uncued Recall and Open and Closed Book Conditions
Nevid, J. S., Pyun, Y. S., & Cheney, B. (2016) · International Journal for the Scholarship of Teaching and Learning · doi:10.20429/ijsotl.2016.100210 · Cited by 5
“…Wildman, & Anderson, 2012; Roediger, Agarwal, McDaniel & McDermott, 2011; Roediger & Butler, 2011; Roediger & Karpicke, 2006; Rohrer, Taylor, & Sholar, 2010; for recent reviews of the testing effect see Karpicki & Grimaldi, 2012; Rawson & Dunlosky, 2012; Rohrer & Pashler, 2010; and Rowland, 2014).”
BackgroundMethodResultInfluentialAdaptive Practice Quizzing in a University Lecture: A Pre-Registered Field Experiment
Heitmann, S., Obergassel, N., Fries, S., Grund, A., Berthold, K., & Roelle, J. (2021) · Journal of Applied Research in Memory and Cognition · doi:10.1016/j.jarmac.2021.07.008 · Cited by 8
Dutke, S., Bakker, H., Papageorgi, I., & Taylor, J. (2017) · Psychology Learning & Teaching · doi:10.1177/1475725717701209 · Cited by 5
“Although hundreds of studies have explored the validity, critical conditions, and theoretical explanations of this effect (for a review see, for example, Rowland, 2014), little is known about the application and effectiveness of practice testing in the teaching of psychology.”
BackgroundDoes value-based prioritization at working memory enhance long-term memory?Preprint
Atkinson, A. L., Waterman, A., & Allen, R. J. (2023) · doi:10.31219/osf.io/awtgc · Cited by 5
Skip the reading assignment: Effective and efficient learning with only practice and feedbackPreprint
Carvalho, P. F., Asher, M. W., Sana, F., & Koedinger, K. R. (2024) · OSF Preprints (OSF Preprints) · doi:10.31219/osf.io/9y2tb · Cited by 8
The facilitative effect of the keyword mnemonic on L2 vocabulary retrieval practice
Qu, K., Liu, T., Qiao, Y., & Wang, P. (2024) · Heliyon · doi:10.1016/j.heliyon.2024.e25212 · Cited by 13
Clark, S. A., Rivers, M. L., & Overono, A. L. (2025) · Behavioral Sciences · doi:10.3390/bs15040477 · Cited by 6
Kim, S., Abel, R., Leutner, D., Schmiemann, P., & Roelle, J. (2025) · Learning and Instruction · doi:10.1016/j.learninstruc.2025.102143 · Cited by 7
Minear, M. E., Coane, J. H., Cooney, L. H., Boland, S. C., & Serrano, J. W. (2023) · Frontiers in Psychology · doi:10.3389/fpsyg.2023.1186566 · Cited by 7
“In addition to success on the initial retrieval attempt (Dudukovic et al., 2015), greater difficulty or effort involved in retrieval is theorized to be beneficial with a larger testing effect resulting from more difficult tests, such as free recall, over easier recognition tests (Rowland, 2014).”
BackgroundActive help-seeking and metacognition interact in supporting children’s retention of science facts
Shields, M., Calabro, G., & Selmeczy, D. (2023) · Journal of Experimental Child Psychology · doi:10.1016/j.jecp.2023.105772 · Cited by 6
Nursing students' experiences with test-enhanced learning in teams: A cross-sectional study
Emblemsvåg, M. S. (2024) · Nurse Education Today · doi:10.1016/j.nedt.2024.106188 · Cited by 7
Bertilsson, F., Stenlund, T., Sundström, A. E., & Jonsson, B. (2024) · European Journal of Psychology of Education · doi:10.1007/s10212-024-00845-2 · Cited by 7
“…information from long-term memory, usually through repeated testing, is highly beneficial for learning and retention when compared to other learning strategies (Carpenter et al., 2008; Dunlosky et al., 2013; Karpicke & Blunt, 2011; Rawson et al., 2013; Roediger & Karpicke, 2006; Rowland, 2014).”
Ranganath, C. (2024) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780190917982.013.6 · Cited by 10
Martinez, D. (2024) · Behavior Research Methods · doi:10.3758/s13428-024-02480-7 · Cited by 7
“Elaboration is known to benefit memory (e.g., Bartsch & Oberauer, 2021), as is the repeated retrieval one likely engages in when central details are referenced throughout a narrative (Roediger & Butler, 2011; Rowland, 2014).”
Lasting benefits of a web-based training in understanding informal arguments
Wertgen, A. G., Münchow, H., Richter, T., & Tiffin‐Richards, S. P. (2025) · European Journal of Psychology of Education · doi:10.1007/s10212-024-00930-6 · Cited by 6
“Moreover, prompts and exercises that invite learners to test and apply their newly acquired knowledge have been shown to be beneficial for learning (e.g., Rowland, 2014).”
Testing Effect: A Further Examination of Open-book and Closed-book Test Formats
Senkova, O., Otani, H., Skeel, R. L., & Babcock, R. L. (2018) · Journal of Effective Teaching in Higher Education · doi:10.36021/jethe.v1i1.15 · Cited by 13
Extrinsically Integrated Instructional Quizzes in Learning Games: An Educational Disaster or Not?
Jičínská, L., Sedláčková, P., Kolek, L., Tetourová, T., Volná, K., Lukavský, J., & Brom, C. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2021.678380 · Cited by 7
“This is notable, as unlike in the case of testing effect (Rowland, 2014; Adesope et al., 2017) or clickerbased systems (Chien et al.”
BackgroundInfluentialWang, L., & Yang, J. (2021) · PsyCh Journal · doi:10.1002/pchj.481 · Cited by 5
“Third, our study did not include the condition of restudy, which is typically the condition in studies of testing effect (Kornell & Vaughn, 2016; Roediger & Butler, 2011; Roediger & Karpicke, 2006; Rowland, 2014).”
BackgroundMethodInfluentialWenzel, K., & Reinhard, M. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2021.693585 · Cited by 6
“…task—even concerning a multitude of difficult, complex, and curricular subjects in realistic learning contexts (e.g., McDaniel et al., 2007; Dunlosky et al., 2013; Rowland, 2014; Karpicke and Aue, 2015; Adesope et al., 2017; Batsell et al., 2017; Rummer et al., 2017; Yang et al., 2021).”
BackgroundInfluentialArticuler connaissances en psychologie cognitive et ingénierie pédagogique
Tricot, A. (2021) · Raisons éducatives · doi:10.3917/raised.025.0141 · Cited by 16
Retrieval Practice as a Learning Strategy for Diverse Populations
Ekuni, R., & Jaeger, A. (2022) · Springer eBooks · doi:10.1007/978-3-031-06908-6_15 · Cited by 9
Benefits of Testing and Production for Learning Turkish As a New Language
Rose, M. C., Brooks, P. J., Lodhi, A. K., & Cortez, A. (2023) · Language Learning · doi:10.1111/lang.12602 · Cited by 5
Wang, L., & Yang, J. (2023) · Memory & Cognition · doi:10.3758/s13421-023-01477-5 · Cited by 7
“The forgetting rate (Fr) within 7 days was calculated as (accuracy at 10-min – accuracy at 7-day) / (accuracy at 10-min) to control for the influence of the first test’s accuracy (Roediger & Karpicke, 2006a; Rowland, 2014).”
InfluentialEnhancing peer instruction in physics: Understanding cognitive processes and refining rules
Gjerde, V., & Hagane, S. (2024) · Physical Review Physics Education Research · doi:10.1103/physrevphyseducres.20.010134 · Cited by 9
Test-Based Learning: Inconsistent Effects Between Higher- and Lower-Level Test Questions
Roelle, J., Roelle, D., & Berthold, K. (2018) · The Journal of Experimental Education · doi:10.1080/00220973.2018.1434756 · Cited by 4
“In light of this robust finding in the literature on test-based learning, providing learners with test questions subsequent to an initial study phase is widely regarded as a highly useful instructional technique (e.g., Dunlosky, Rawson, Marsh, Nathan, & Willingham, 2013; Fiorella & Mayer, 2016; Rawson, 2015; Roediger…”
BackgroundMethodResultInfluentialWilson, M. (2018) · Journal of diagnostic medical sonography · doi:10.1177/8756479318799338 · Cited by 5
Brooks, P. J., & Kempe, V. (2020) · First Language · doi:10.1177/0142723720903637 · Cited by 4
“Retrieval operations make information more accessible for future use, as indicated by research on the benefits of testing for long-term retention (Roediger & Karpicke, 2006; Rowland, 2014).”
BackgroundSpacing, Feedback, and Testing Boost Vocabulary Learning in a Web Application
Belardi, A., Pedrett, S., Rothen, N., & Reber, T. P. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2021.757262 · Cited by 10
“When people have to reproduce or answer questions about the studied material, they remember more than when they study it repeatedly (Rowland, 2014).”
Introducing Desirable Difficulty in Engineering Mathematics with Spaced Retrieval Practice
Bego, C. R., Ralston, P. A. S., Lyle, K. B., & Immekus, J. C. (2024) · ASEE Annual Conference & Exposition · doi:10.18260/1-2--37379 · Cited by 4
“Spaced retrieval practice has been found to benefit both short- and long-term memory (see [18]).”
BackgroundDoes the testing effect depend on presentation modality?
Pierce, B. H., & Hawthorne, M. J. (2016) · Journal of Applied Research in Memory and Cognition · doi:10.1016/j.jarmac.2016.01.001 · Cited by 5
Making remembering more memorable
Leppanen, M. L., & Lyle, K. B. (2018) · Memory · doi:10.1080/09658211.2017.1422270 · Cited by 5
“Information that is retrieved from memory is more likely to be retained than information that is restudied (for a recent meta-analytic review, see Rowland, 2014). Moreover, Carpenter, Pashler, and Vul (2006) showed that, after learning A + B word pairs, retrieving B (given A) increased performance on subsequent tests…”
BackgroundWanderer, J. P., Lasko, T. A., Coco, J., et al. (2020) · Journal of Clinical Anesthesia · doi:10.1016/j.jclinane.2020.110114 · Cited by 4
“, improved performance due to repeated assessment [14].”
BackgroundKlopp, E., & Stark, R. (2020) · Publications of the UdS (Saarland University) · doi:10.22028/d291-31793 · Cited by 3
The testing effect for visual materials depends on pre-existing knowledgePreprint
Ferreira, C. S., & Wimber, M. (2021) · doi:10.31234/osf.io/t6jdn · Cited by 4
Language and thought: The lexicon and beyond
Landau, B. (2022) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780198845003.013.5 · Cited by 7
Efficient Communication and The Organization of The Lexicon
Mahowald, K., Dautriche, I., Braginsky, M., & Gibson, T. (2022) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780198845003.013.19 · Cited by 11
Adam, K. C. S., Zhao, C., & Vogel, E. K. (2023) · doi:10.31234/osf.io/2h5pf · Cited by 4
Murray, E., Horner, A. J., & Göbel, S. M. (2025) · Educational Psychology Review · doi:10.1007/s10648-025-10035-1 · Cited by 4
“As most studies did not report the correlation for within-subject effects, r = .5 was used to compute the pooled standard error as used in previous spacing and retrieval meta-analyses (Latimier et al., 2021; Rowland, 2014).”
Aljabri, S. (2024) · Frontiers in Education · doi:10.3389/feduc.2024.1457504 · Cited by 5
Dechamps, T., & Skulmowski, A. (2025) · Trends in Neuroscience and Education · doi:10.1016/j.tine.2025.100256 · Cited by 3
“Furthermore, Rowland [6] summarizes that testing may enhance learning by leading learners to focus on the crucial points of learning contents, citing [16].”
InfluentialKornell, N., & Bjork, R. A. (2025) · Behavioral Sciences · doi:10.3390/bs15070924 · Cited by 5
“In this case, the items that were recalled correctly, which were already above the recall threshold by virtue of being recalled, moved farther above the threshold because of retrieval practice effects (e.g., Rowland, 2014).”
Retrieval Practice—A Tool to Narrow the Achievement Gap in Learning Higher Mathematics
Muzsnay, A., Szabó, C., Zámbó, C., Szabó, G., & Szeibert, J. (2025) · International Journal of Science and Mathematics Education · doi:10.1007/s10763-025-10607-1 · Cited by 11
“This retrieval-based benefit on long-term retention is commonly denoted as the testing effect (Dunlosky et al., 2013; Rowland, 2014).”
A perspective on friction interventions to curb the spread of misinformation
Jahn, L., Rendsvig, R. K., Flammini, A., Menczer, F., & Hendricks, V. F. (2025) · npj Complexity · doi:10.1038/s44260-025-00051-1 · Cited by 21
van den Broek, G. S. E., Scholten, S., van Thuil, B., van Rijn, H., van Gog, T., & van der Velde, M. (2025) · Computers in Human Behavior · doi:10.1016/j.chb.2025.108862 · Cited by 9
Carpenter, S. K., & Sanchez, C. A. (2025) · Cognitive Research Principles and Implications · doi:10.1186/s41235-025-00693-8 · Cited by 8
“Despite the well-known benefits of retrieval practice (for reviews, see Adesope et al., 2017; Carpenter et al., 2022; Pan & Rickard, 2018; Rowland, 2014; Yang et al., 2021), students report using retrieval primarily as a way to check their knowledge rather than a direct learning strategy (Hartwig &…”
Binks, S. (2026) · Journal of Evaluation in Clinical Practice · doi:10.1111/jep.70349 · Cited by 7
Evaluating Pharmacy Faculty’s Awareness of Teaching and Learning Myths and Misconceptions
Medina, M. S., Castleberry, A. N., & Persky, A. M. (2021) · American Journal of Pharmaceutical Education · doi:10.5688/ajpe8751 · Cited by 5
McConnell, M. (2022) · Journal of Continuing Education in the Health Professions · doi:10.1097/ceh.0000000000000434 · Cited by 5
The benefit of retrieval practice on cued recall under stress depends on item difficulty
Klier, C., & Buratto, L. G. (2023) · Neuroscience Letters · doi:10.1016/j.neulet.2023.137066 · Cited by 4
Palomino, P. T., Rodrigues, L., & Toda, A. M. (2023) · Springer eBooks · doi:10.1007/978-3-031-31949-5_2 · Cited by 9
Mayas, J., Prieto, A. F., & Montoro, P. R. (2023) · Applied Cognitive Psychology · doi:10.1002/acp.4138 · Cited by 3
Leonard, L. B., Deevy, P., & Kueser, J. B. (2024) · Autism & Developmental Language Impairments · doi:10.1177/23969415241275940 · Cited by 5
“…practice have been reported in the scienti fi c literature for more than a century beginning with Abbott (1909a, 1909b) with a resurgence in this line of inquiry in the past 25 years (see reviews in Adesope et al., 2017; Fazio & Marsh, 2019; Karpicke, 2017; Latimier et al., 2021; Rowland, 2014).”
BackgroundFar transfer of retrieval-practice benefits: rule-based learning as the underlying mechanism
Opitz, B., & Kubik, V. (2024) · Cognitive Research Principles and Implications · doi:10.1186/s41235-024-00598-y · Cited by 8
“This finding of the so-called testing effect or retrieval-practice effect 1 on memory is robust, with effect sizes of Hedges’ g = 0.50–0.63 (e .g., Roediger & Karpicke, 2006b; for meta-analyses, see Adesope et al., 2017; Rowland, 2014).”
BackgroundInfluentialRishi, P., Nunn, K., & Rohter, S. V. (2024) · Aphasiology · doi:10.1080/02687038.2024.2432022 · Cited by 4
“The role of effort and success during learning has been most frequently discussed within education and psychology research in the context of retrieval-based learning (see Karpicke, 2012; Rowland, 2014 for review).”
Ehrentraut, H., Puskarevic, A., Kunsorg, A., Abulizi, I., Mayr, A. J., Jung, M., Schillings, M., Temme, C., Pütz, A., Coburn, M., et al. (2025) · Journal of Clinical Medicine · doi:10.3390/jcm14093131 · Cited by 3
“This multi-stage process of learning and repetition led to even stronger knowledge retrieval in the final risk recall test [34].”
Rehn, K., Canham, S. L., Osteen, P. J., Jaggers, J. W., Rose, J., & Fowles, R. (2025) · Housing Policy Debate · doi:10.1080/10511482.2025.2500094 · Cited by 3
“Fifth, concerning the potential changes in reliability scores over time, regardless of whether the same or different assessors are involved, it is important to recognize that repeated assessments may introduce a testing effect (Rowland, 2014).”
Permzadian, V., & Cho, K. W. (2025) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2025.2502590 · Cited by 5
“For example, research has clearly established that attempting to retrieve information from memory during testing enhances long-term retention of the assessed material (i.e. the testing effect; see McDermott 2021 and Rowland 2014 for a review).”
Described neural connections enhance classroom learning of neuroanatomy
Hindy, N. C., Bishara, A. J., & Pani, J. R. (2025) · Anatomical Sciences Education · doi:10.1002/ase.70051 · Cited by 5
Supporting comprehension: The advantages of multiple–choice over true—false practice tests
Hildenbrand, L., & Wiley, J. (2025) · Memory & Cognition · doi:10.3758/s13421-025-01726-9 · Cited by 3
“Decades of research on the testing effect have demonstrated that taking a practice test on to-be-learned materials can result in better learning than other nontesting activities such as simple restudy (Adesope et al., 2017; Dunlosky et al., 2013; Roe-diger & Karpicke, 2006; Rowland, 2014).”
Steinbach, M., Fleckenstein, J., Kuklick, L., & Meyer, J. (2025) · Journal of Computer Assisted Learning · doi:10.1111/jcal.70070 · Cited by 5
The Effect of Retrieval Practice on Transitive Inference
Picklesimer, M. E., Buchin, Z. L., & Mulligan, N. W. (2019) · Experimental Psychology (formerly Zeitschrift für Experimentelle Psychologie) · doi:10.1027/1618-3169/a000467 · Cited by 4
Coaching the Coach: Helping Coaches Improve Their Performance
Gillham, A., & Mullem, P. V. (2020) · Springer eBooks · doi:10.1007/978-3-030-63912-9_20 · Cited by 3
Evans, T., & Oates, G. (2021) · International Journal of Mathematical Education in Science and Technology · doi:10.1080/0020739x.2022.2004749 · Cited by 3
“Like the articles by Bruce May and Amy Bennett, considered later in this foreword, Kinnear et al.’s course design draws on a variety of ideas from cognitive science and mathematics education research, for example, with respect to the ‘testing effect’ (Rowland, 2014).”
BackgroundRiera, A. B., & Valls, C. (2021) · Retos · doi:10.47197/retos.v43i0.89131 · Cited by 3
Spaced Retrieval Practice in Two Fundamental Engineering Courses: Calculus and Physics
Patrick, R. J., Bego, C. R., Chastain, R. J., Ralston, P. A. S., Immekus, J. C., & Lyle, K. B. (2022) · IEEE Frontiers in Education Conference (FIE) · doi:10.1109/fie56618.2022.9962526 · Cited by 5
“As a mnemonic technique, retrieval practice is based on the testing effect, which is the finding that long-term retention of information benefits more from retrieving the information from memory than from restudying it [5], [6].”
BackgroundMethodThe acquisition of foreign language vocabulary: Does spacing effect matter?
Al-Khasawneh, F. M. (2023) · The Education and science journal · doi:10.17853/1994-5639-2023-3-174-193 · Cited by 3
Performance feedback enhances test-potentiated encoding
Ludowicy, P., Paz‐Alonso, P. M., Lachmann, T., & Czernochowski, D. (2023) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2023.1100497 · Cited by 6
“This additional review cycle might serve as a block-wise and delayed correct answer feedback (Rowland, 2014).”
BackgroundMethodInfluentialCan visual representations facilitate EFL information processing and learning?
Manoïlov, P. (2023) · Recherche et pratiques pédagogiques en langues de spécialité · doi:10.4000/apliut.10434 · Cited by 5
Newton, P. M. (2024) · Springer international handbooks of education · doi:10.1007/978-3-031-54144-5_93 · Cited by 6
Sheykhmohammadi, N., Atashpendar, A., & Zampuniéris, D. (2024) · International Conference on Computer Supported Education · doi:10.5220/0012682500003693 · Cited by 3
“Firstly, harder questions require a greater retrieval effort by the student, which in turn can improve the resulting testing effect (Greving and Richter, 2018; Rowland, 2014).”
BackgroundSurin, S., & Damrongpanit, S. (2024) · European Journal of Educational Research · doi:10.12973/eu-jer.13.4.1535 · Cited by 8
“Lastly, it examines the outcomes of testing methodologies (Adesope et al., 2017; Rowland, 2014).”
BackgroundAljabri, S. (2024) · World Journal of English Language · doi:10.5430/wjel.v14n5p303 · Cited by 7
Online Anticipatory Cues During Practice Disrupt Intentional and Incidental Sequence Learning
Dahm, S. F., & Krause, D. (2024) · Journal of Motor Behavior · doi:10.1080/00222895.2024.2369183 · Cited by 3
“…effects (Dahm, Hyna, et al., 2023; Dahm & Rieger, 2023; Kraeutner et al., 2016) may result from enhanced Stimulus-Response Coupling (Ariani & Diedrichsen, 2019; Hardwick et al., 2019; Schneider & Shiffrin, 1977) or simply stem from Testing Effects (learning from repeated testing) (Rowland, 2014).”
Judgments of learning reactively affect memory by inducing covert retrieval
Zhang, X., Guo, Y., Jiang, Y., & Yuan, Y. (2024) · The Journal of General Psychology · doi:10.1080/00221309.2024.2409785 · Cited by 3
“The final results indicated that memory performance across all four conditions, including the RESTUDY condition, was similar, contradicting previous findings on retrieval practice (e.g., Roediger & Karpicke, 2006; for a review, see Rowland, 2014).”
Fan, T., Hui, L., Luo, L., & de Bruin, A. B. H. (2024) · Educational Psychology Review · doi:10.1007/s10648-024-09945-3 · Cited by 4
“Moreover, the testing effect has been reliably found not only in the laboratory but also in real classrooms and across educational levels (for recent reviews, see Adesope et al., 2017; Carpenter et al., 2022; Rowland, 2014; Yang et al., 2021).”
InfluentialTordet, C., Fernandez, J., & Jamet, É. (2024) · Journal of Computer Assisted Learning · doi:10.1111/jcal.13083 · Cited by 7
Predictive learning as the basis of the testing effect
Chen, H., Hauspie, C., Ergo, K., Calderon, C. B., & Verguts, T. (2025) · Communications Psychology · doi:10.1038/s44271-025-00200-1 · Cited by 4
“Semantic elaboration theory proposes that testing produces an elaborative network of multiple mediators to the ( ) target which can support subsequent correct recall 4,15,16 .”
InfluentialRenkl, A., & Endres, T. (2025) · School Effectiveness and School Improvement · doi:10.1080/09243453.2025.2482580 · Cited by 3
“In his frequently cited meta-analysis on the testing effect, Rowland (2014) found a positive average effect size of about half a standard deviation.”
van Eersel, G. G., Verkoeijen, P. P. J. L., Bouwmeester, S., Tabbers, H. K., & Rikers, R. M. J. P. (2017) · Journal of Cognitive Psychology · doi:10.1080/20445911.2017.1300156 · Cited by 4
“The testing effect occurs when retrieving information from memory after an initial study phase enhances long-term retention more than restudying does (for reviews, see Delaney, Verkoeijen, & Spirgel, 2010; Karpicke, Lehman, & Aue, 2014; Roediger & Butler, 2011; Rowland, 2014).”
Evidence for reinstating diverse episodic contexts in retrieval-based learning
Schwoebel, J., Buko, D., & Caissey, K. L. (2021) · Journal of Cognitive Psychology · doi:10.1080/20445911.2021.2008946 · Cited by 4
“effects have been observed after free recall than recognition tasks (Rowland, 2014).”
BackgroundInfluentialTesting effects of free recall on organization in whole/part and part/whole transfer
Bacso, S. A., & Marmurek, H. H. C. (2016) · Acta Psychologica · doi:10.1016/j.actpsy.2016.10.001 · Cited by 3
Hotta, C., Tajika, H., & Neumann, E. (2016) · European Journal of Developmental Psychology · doi:10.1080/17405629.2016.1257425 · Cited by 5
“This idea of spatial learning is consistent with the espousal by Rowland (2014) of the importance of effortful processing to the testing effect, resulting from his meta-analysis of the testing effect, drawing mainly on verbal learning studies.”
BackgroundResultRetrieval activates related words more than presentation
Hausman, H., & Rhodes, M. G. (2018) · Memory · doi:10.1080/09658211.2018.1453934 · Cited by 5
“…retrieval failure A wealth of research has demonstrated that retrieving previously studied information enhances memory for that information relative to restudying it, a phenomenon referred to as the testing effect (for reviews see Roediger & Butler, 2011; Roediger & Karpicke, 2006; Rowland, 2014).”
BackgroundInfluentialInvestigating the replicability and generalizability of the negative testing effect.
Wissman, K. T., & Peterson, D. J. (2018) · Journal of Applied Research in Memory and Cognition · doi:10.1016/j.jarmac.2018.05.002 · Cited by 3
Protective effects of testing across misinformation formats in the household scene paradigm
Pereverseff, R. S., Bodner, G. E., & Huff, M. J. (2019) · Quarterly Journal of Experimental Psychology · doi:10.1177/1747021819881948 · Cited by 3
“…memory organisation (Congleton & Rajaram, 2012) and increased generation of implicit “mediator” cues that can be used at retrieval (Carpenter, 2011; Pyc & Rawson, 2010), which in turn can slow forgetting rates (Kornell, Bjork, & Garcia, 2011; for reviews see Rawson & Dunlosky, 2011; Rowland, 2014).”
Effortful retrieval practice effects in lexical access: a role for semantic competition
Patra, A., Traut, H. J., Stabile, M. J., & Middleton, E. L. (2022) · Language Cognition and Neuroscience · doi:10.1080/23273798.2022.2027991 · Cited by 3
“…retrievalbased naming treatment was informed by best practices derived from the retrieval practice (a.k.a. testenhanced learning) literature (for recent reviews, see Kornell & Vaughn, 2016; Rowland, 2014), including a focus on correct retrieval during treatment and consistent provision of feedback.”
MethodThe Sleep Benefit in Episodic Memory: An Integrative Review and a Meta-AnalysisPreprint
Shakoor, S., & Erdfelder, E. (2022) · doi:10.31234/osf.io/r2an6 · Cited by 3
Contributions of pragmatics to word learning and interpretation
Grigoroglou, M., & Papafragou, A. (2022) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780198845003.013.21 · Cited by 6
Infants’ Learning of Speech Sounds and Word-Forms
Swingley, D. (2022) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780198845003.013.6 · Cited by 5
Schwarz, F., & Zehr, J. (2022) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780198845003.013.18 · Cited by 3
Sleep and testing both strengthen and distort story recollectionPreprint
Denis, D., DiPietro, C., Spreng, R. N., Schacter, D. L., Stickgold, R., & Payne, J. D. (2021) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/abt56 · Cited by 2
Oxford Handbook of Memory: Episodic Memory (Ranganath)Preprint
Ranganath, C. (2022) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/nw94y · Cited by 4
Improving Memory Search through Model-Based Cue SelectionPreprint
Cornell, C. (2023) · doi:10.31234/osf.io/atqs7 · Cited by 3
Roelle, J., & Richter, T. (2025) · Learning and Instruction · doi:10.1016/j.learninstruc.2025.102277 · Cited by 9
Yu, Y., Zhao, W., Li, A., Shanks, D. R., Hu, X., Luo, L., & Yang, C. (2025) · Educational Psychology Review · doi:10.1007/s10648-025-10024-4 · Cited by 2
“This aligns with previous findings from overt retrieval research (Chan et al., 2024; Kang et al., 2007; Rowland, 2014; Yang et al., 2021), suggesting that corrective feedback plays a similarly important role in determining the effectiveness of overt and covert retrieval.”
InfluentialShaw, A., McKernan, B., Martey, R. M., Stromer‐Galley, J., Saulnier, E. T., McLaren, E., Rhodes, M. G., Folkestad, J., Taylor, S. M., Kenski, K. M., et al. (2018) · Multimodal Technologies and Interaction · doi:10.3390/mti2030046 · Cited by 2
Metadata
- Authors
- Rowland, C. A.
- Affiliations
- Colorado State University (US)
- Corresponding author
- Rowland, Christopher A.
- Venue
- Psychological Bulletin
- Published
- 2014
- Volume
- 140
- Issue
- 6
- Pages
- 1432-1463
- ISSN
- 0033-2909 (ISSN-L)
- 1939-1455
- OpenAlex
- W2050255700
- Cited by
- 1,066
- References
- 139
- Citations by year
- 2026: 71 · 2025: 103 · 2024: 139 · 2023: 113 · 2022: 138 · 2021: 122 · 2020: 105 · 2019: 91 · 2018: 73 · 2017: 52 · 2016: 36 · 2015: 19 · 2014: 3
- FWCI
- 20.46
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Psychological Bulletin (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Memory Processes and Influences
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Visual and Cognitive Learning Processes
- Life Sciences › Neuroscience › Cognitive Neuroscience › Memory and Neural Mechanisms
- Keywords
- testing effect, restudy, retention, effortful processing, recall tests, recognition test, semantic elaboration, memory retrieval, bifurcation model, memory consolidation
- MeSH terms
- Attention, Cues, Educational Measurement, Humans, Learning, Memory, Neuropsychological Tests, Practice, Psychological, Mental Recall, Retention, Psychology, Semantics, Students, Universities
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.