The effect of testing versus restudy on retention: A meta-analytic review of the testing effect.
The DOI matches its Crossref record; 138 of the 139 references it cites were found in a registry or an index.
Abstract
Meta-analysis uses meta-analysis to examine the effects of testing versus restudy on retention and indicates support for the role of effortful processing as a contributor to the testing effect.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Regarding retrieval practice, over a century of research has demonstrated that students who practice retrieving information have better and longer memory retention for that information compared to students who engage with the material more passively (e.g., restudying).”
From The benefits of successive relearning on multiple learning outcomes. (2022) · cites this paper as Rowland, 2014
In the citing paper
“whereas retrieval practice is the phenomenon that actively recalling information from memory enhances memory”
From Does Retrieval Practice Protect Memory Against Stress? A Meta-Analysis (2025) · cites this paper as Rowland, 2014
In the citing paper
“However, meta-analyses on the benefits of retrieval practice (e.g., Rowland, 2014) show consistently positive effects regardless of the different types of materials used.”
From Does Retrieval Practice Protect Memory Against Stress? A Meta-Analysis (2025) · cites this paper as Rowland, 2014
In the citing paper
“consistent with the robust testing effect (Agarwal et al., 2021; Rowland, 2014; Schwieren et al., 2017; Yang et al., 2021).”
From Does Retrieval Practice Protect Memory Against Stress? A Meta-Analysis (2025) · cites this paper as Rowland, 2014
In the citing paper
“Effect sizes range from moderate to large, with estimates between d = 0.55 and d = 0.88 (Phelps, 2012), g = 0.50 (Rowland, 2014), and g = 0.61 to g = 0.70 (Adesope et al., 2017).”
From Testing the testing effect on prolific: when retrieval practice fails to boost learning (2026) · cites this paper as Rowland, 2014
13 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Measuring inconsistency in meta-analyses
Higgins, J. P. T., Thompson, S. G., Deeks, J. J., & Altman, D. G. (2003) · BMJ · doi:10.1136/bmj.327.7414.557 · Cited by 63,139
The file drawer problem and tolerance for null results.
Rosenthal, R. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.3.638 · Cited by 9,068
Distribution Theory for Glass's Estimator of Effect Size and Related Estimators
Hedges, L. V. (1981) · Journal of Educational Statistics · doi:10.2307/1164588 · Cited by 5,695
Creating false memories: Remembering words not presented in lists.
Roediger, H. L., & McDermott, K. B. (1995) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/0278-7393.21.4.803 · Cited by 3,792
Fixed-and random-effects models in meta-analysis.
Hedges, L. V., & Vevea, J. L. (1998) · Psychological Methods · doi:10.1037/1082-989x.3.4.486 · Cited by 2,977
Test-Enhanced Learning: Taking Memory Tests Improves Long-Term Retention
Roediger, H. L., & Karpicke, J. D. (2006) · Psychological Science · doi:10.1111/j.1467-9280.2006.01693.x · Cited by 2,867
Levels of processing versus transfer appropriate processing
Morris, C. D., Bransford, J. D., & Franks, J. J. (1977) · Journal of Verbal Learning and Verbal Behavior · doi:10.1016/s0022-5371(77)80016-9 · Cited by 2,296
The power of testing memory: Basic research and implications for educational practice
Roediger, H. L., & Karpicke, J. D. (2006) · Perspectives on Psychological Science · doi:10.1111/j.1745-6916.2006.00012.x · Cited by 2,037
The critical role of retrieval practice in long-term retention
Roediger, H. L., & Butler, A. C. (2011) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2010.09.003 · Cited by 1,796
The Critical Importance of Retrieval for Learning
Karpicke, J. D., & Roediger, H. L. (2008) · Science · doi:10.1126/science.1152408 · Cited by 1,791
Cited by
Items 501–600 of 1,077
Guessing can benefit memory for related word pairs even when feedback is delayed
Zawadzka, K., Zaborowska, O., Butowska, E., Piątkowski, K., & Hanczakowski, M. (2023) · Memory & Cognition · doi:10.3758/s13421-022-01385-0 · Cited by 8
“Classroom tests have long been used as means of assessing students’ knowledge, but there is now also a growing realization that, in addition to assessment, testing one’s memory can also be used to gain knowledge (Roediger & Karpicke, 2006; Rowland, 2014).”
MethodLower constraint testing enhances the testing effect for some contextual details but not others
Giannakopoulos, K. L., McCurdy, M. P., Sklenar, A. M., Frankenstein, A. N., Levy, P. U., & Leshikar, E. D. (2024) · Brain and Behavior · doi:10.1002/brb3.3380 · Cited by 7
“We further found that both testing conditions (lower, higher constraint) improved memory on a final test compared to control conditions (restudy, study-only), consistent with decades of past work on the testing effect (Adesope et al., 2017; Rowland, 2014).”
BackgroundResultInfluentialNevid, J. S., Ambrose, M. A., & Pyun, Y. S. (2017) · Teaching of Psychology · doi:10.1177/0098628317727645 · Cited by 8
“Email: nevidj@stjohns.edu Bransford, & Franks, 1977), the retrieval effort hypothesis (e.g., Pyc & Rawson, 2009; Rowland, 2014), and the principle of desirable manipulations of training (Bjork, 1994).”
BackgroundLoaiza, V. M., & Borovanska, B. M. (2017) · Consciousness and Cognition · doi:10.1016/j.concog.2017.11.002 · Cited by 9
“First, participants’ ratings were sensitive overall to the immediate recall condition, indicating that the self-report ratings are reliable insofar as they are susceptible to task characteristics in a predictable manner (i.e., an overall advantage of tested over non-tested items; Rowland, 2014).”
A role for familiarity in supporting the testing effect over time
Shaffer, R. A., & McDermott, K. B. (2019) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2019.107298 · Cited by 10
“…taking a test, or retrieval practice, has been shown to enhance long-term retention of material relative to not retrieving and even to rereading material (Dunlosky et al., 2013; Karpicke and Roediger, 2008; Roediger and Butler, 2011; Roediger and Karpicke, 2006a; Rowland, 2014; Tulving, 1967).”
BackgroundThe Efficacy of a Classroom Game for Teaching APA Style Citation
Clark, D. A., & Murphy, W. (2020) · Teaching of Psychology · doi:10.1177/0098628320977263 · Cited by 11
“We created the “Citation Game” to enhance memory and learning in the classroom by combining an enjoyable game format with utilizing researchbased techniques such as retrieval practice (see Rowland, 2014 for a meta-analysis) and feedback (Hattie & Timperley, 2007).”
MethodAchieving Testing Effects in an Authentic College Classroom
Shobe, E. R. (2021) · Teaching of Psychology · doi:10.1177/00986283211015669 · Cited by 8
“Some have reported no clear advantage for feedback over no feedback (Butler & Roediger, 2007), but others have confirmed the feedback advantage (Agarwal et al., 2008; Cull, 2000; Kang, 2010; Vojdanoska et al., 2010), including two meta-analyses (Rowland, 2014; Schwieren et al., 2017).”
BackgroundImplementing Test Enhanced Learning: Swedish Teacher Students’ Perception of Quizzing
Nyroos, M., Schéle, I., & Wiklund‐Hörnqvist, C. (2016) · International Journal of Higher Education · doi:10.5430/ijhe.v5n4p1 · Cited by 8
“A growing body of empirical evidence shows that repeated testing is highly effective for improving the accuracy of long-term memory – frequent testing is a powerful mnemonic aid for future retention (Roediger & Butler, 2011; Rowland, 2014).”
BackgroundCognitive Development: Applications to Education
Michal, A. L., Fansher, M., Sun, X., Zhang, H., & Shah, P. (2022) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780199841332.013.7 · Cited by 7
Effects of sleep and retrieval practice on verbal paired-associate learning across 12 and 24 hoursPreprint
Mak, M. H., & Gaskell, M. G. (2023) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/phe5j · Cited by 6
Wahlheim, C. N., Smith, S. T., Garlitch, S. M., & Wiley, R. W. (2023) · Learning & Memory · doi:10.1101/lm.053782.123 · Cited by 8
“These results replicate the fi nding thattesting effects depend onretrievalsuccess(forreview, see Rowland 2014) andsuggest that interpolated retrieval enhanced fi nal list 1 recall via retrieval practice per se and by promoting memory interdependence.”
ResultNeural correlates of retrieval practice on the learning and memory retention of L3 French vocabulary
Li, J., Zhang, E.-H., Zhang, H., He, X., Li, D., & Cao, H.-W. (2023) · International Journal of Multilingualism · doi:10.1080/14790718.2023.2166943 · Cited by 6
“In recent years, a large body of evidence (Adesope et al., 2017; Karpicke,2017 ; Rickard & Pan, 2018; Roediger & Butler, 2011; Rowland, 2014; Yang et al., 2021) has demonstrated the reliability and generalizability of the retrieval practice e ff ect, across di ff erent populations (e.g. from children…”
Yin, Y., Fan, T., Zhao, W., Zheng, J., Hu, X., Su, N., Yang, C., & Luo, L. (2024) · Metacognition and Learning · doi:10.1007/s11409-024-09377-y · Cited by 8
“Results from a meta-analysis conducted by Rowland (2014 ) showed no reliable testing effect when retrieval rate during the practice phase was below 50%.”
InfluentialHa, H., & Lee, H. S. (2024) · Educational Psychology Review · doi:10.1007/s10648-024-09899-6 · Cited by 6
“Previous studies found that testing effects were often greater when tests were delayed (e.g., Karpicke & Roediger, 2007; Pyc & Rawson, 2009; for a meta-analysis, see Rowland, 2014) and retrieval attempt interval—the time between studying and retrieving—increased (Pashler et al., 2003).”
Preservice teachers’ evaluation of evidential support in causal arguments about educational topics
Lederer, A., Thomm, E., & Bauer, J. (2024) · Frontiers in Education · doi:10.3389/feduc.2024.1379222 · Cited by 7
Timing of feedback and retrieval practice: a laboratory study with EFL students
Aljabri, S. (2024) · Humanities and Social Sciences Communications · doi:10.1057/s41599-024-03983-6 · Cited by 14
“One of the factors that affect retrieval practice and signi fi cantly in fl uence its effectiveness in learning contexts is feedback (Adesope et al., 2017; Rowland, 2014).”
Eitel, A., Krebs, M.-C., & Schöne, C. (2025) · Educational Psychology Review · doi:10.1007/s10648-025-10045-z · Cited by 12
“2 Instructional techniques mapped to the causal diagram depicting the relations between independent, mediating, and dependent variables of the FoRe-Squares model e.g., Rowland, 2014) and for the speed of recall (van den Broek et al., 2001), indicating increased automation of knowledge retrieval.”
Retrieval Practice in Stepwise Worked Examples Improves Learning
van den Broek, G. S. E., van Wermeskerken, M., & van Gog, T. (2025) · Learning and Instruction · doi:10.1016/j.learninstruc.2025.102196 · Cited by 10
Liu, S., Zheng, Z., Kent, C. D., & Briscoe, J. (2022) · Memory · doi:10.1080/09658211.2021.1990963 · Cited by 7
“The sample size was justified according to the meta-analysis by Rowland (2014) in which the average effect size of the testing effect was .”
BackgroundMethodInfluentialRetrieval‐based learning in special education
Tempel, T., & Sollich, S. (2023) · Journal of Research in Special Educational Needs · doi:10.1111/1471-3802.12594 · Cited by 8
Permzadian, V., & Cho, K. W. (2023) · Teaching in Higher Education · doi:10.1080/13562517.2023.2289128 · Cited by 8
Langbroek, S., Duchatelet, D., Brinke, D. J.-T., & Camp, G. (2024) · Frontiers in Education · doi:10.3389/feduc.2024.1340120 · Cited by 13
Awareness and Implementation of Evidence-Based Learning Strategies Among STEM Faculty
Wissman, K. T., & Leontyev, A. (2024) · The journal of college science teaching · doi:10.1080/0047231x.2024.2363118 · Cited by 7
Ruitenburg, S. K., Ackermans, K., Kirschner, P. A., Jarodzka, H., & Camp, G. (2024) · Learning and Instruction · doi:10.1016/j.learninstruc.2024.102027 · Cited by 13
Do, N., Jin, T., Priest, R., Meredith, L. N., & Landers, R. N. (2024) · Learning and Individual Differences · doi:10.1016/j.lindif.2024.102572 · Cited by 14
Sleep and retrieval practice both strengthen and distort story recollection
Denis, D., DiPietro, C., Spreng, R. N., Schacter, D. L., Stickgold, R., & Payne, J. D. (2024) · SLEEP Advances · doi:10.1093/sleepadvances/zpae083 · Cited by 10
Tempel, T., Kaufmann, K., Kranz, J., & Möller, A. (2018) · Psychological Research · doi:10.1007/s00426-018-1088-2 · Cited by 9
Activating prior knowledge using multiple‐choice question distractors
Schimmelfing, L. C., & Persky, A. M. (2020) · Medical Education · doi:10.1111/medu.14162 · Cited by 6
Rickard, T. C. (2020) · Psychonomic Bulletin & Review · doi:10.3758/s13423-020-01734-7 · Cited by 8
“…differences Testing, or retrieval practice, has been shown to improve retention of memory relative to a nontest control task across a variety of materials and test types (a phenomenon known as test-enhanced learning, or the testing effect; for reviews, see Roediger & Butler, 2011; Rowland, 2014).”
BackgroundTodd, K., Therriault, D. J., & Angerhofer, A. (2020) · Chemistry Education Research and Practice · doi:10.1039/d0rp00185f · Cited by 10
McHugh, D., Feinn, R., McIlvenna, J., & Trevithick, M. (2021) · Education Sciences · doi:10.3390/educsci11030090 · Cited by 8
“This is significant because feedback coupled to retrieval practice dramatically amplifies knowledge retention improvements [4,45,46].”
BackgroundBencze, D., Szöllősi, Á., & Racsmány, M. (2021) · Memory · doi:10.1080/09658211.2021.1924788 · Cited by 9
Prior episodic learning and the efficacy of retrieval practice
Gupta, M. W., Pan, S. C., & Rickard, T. C. (2021) · Memory & Cognition · doi:10.3758/s13421-021-01236-4 · Cited by 8
“The testing effect has been obtained in a variety of contexts (for reviews, see Karpicke et al., 2014; Kornell & Vaughn, 2016; Rickard & Pan, 2018; Roediger & Karpicke, 2006; Rowland, 2014; van den Broek et al., 2016).”
BackgroundScalable Science Education via Online Cooperative Questioning
Hilton, C. B., Goldwater, M. B., Hancock, D., Clemson, M., Huang, A., & Denyer, G. S. (2021) · CBE—Life Sciences Education · doi:10.1187/cbe.19-11-0249 · Cited by 8
“Given the extensive literature concerning the testing effect (Rowland, 2014) and the benefits of generative/constructive forms of engagement (Chi and Wylie, 2014; Fiorella and Mayer, 2016), as discussed in the Introduction , we suspect that the specific design used here would be at least as…”
Repeated quizzing of basic mathematics concepts to improve grades in economics classes
Leggett, J., Morgan, B., & Tang, K. K. (2022) · The Journal of Economic Education · doi:10.1080/00220485.2022.2111386 · Cited by 7
“…also can improve understanding and retention of concepts through so-called retrieval practice effects (Moreira et al. 2019; Pan and Rickard 2018; Rowland 2014) or through pretesting effects in which producing an incorrect answer improves learning from subsequent feedback (Izawa 1970; Kornell…”
BackgroundExamining the effect size and duration of retrieval-induced facilitation
Oliva, M. T., & Storm, B. C. (2022) · Psychological Research · doi:10.1007/s00426-022-01729-0 · Cited by 6
“Although these two consequences are quite robust (Murayama et al., 2014; Roediger et al., 2011; Rowland, 2014; Storm et al., 2015), there are conditions under which a different pattern of results emerges.”
BackgroundWhat is the relationship between collective memory and metacognition?
Lund, A. E., & Russell, C. (2022) · Progress in brain research · doi:10.1016/bs.pbr.2022.07.006 · Cited by 7
Malejka, S., Heck, D., & Erdfelder, E. (2022) · Journal of Memory and Language · doi:10.1016/j.jml.2022.104356 · Cited by 5
Broeren, M., Verkoeijen, P. P. J. L., Heijltjes, A. E. G., Arends, L. R., & Smeets, G. (2023) · Applied Cognitive Psychology · doi:10.1002/acp.4078 · Cited by 10
The testing effect for visual materials depends on preexisting knowledge.
Ferreira, C. S., & Wimber, M. (2023) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037/xlm0001248 · Cited by 13
“The latter fi nding of a delayed retrieval advantage mirrors many studies reported in the literature using verbal materials (Roediger & Karpicke, 2006a; Rowland, 2014).”
BackgroundResultPieniak, M., Rönsch, M., Oleszkiewicz, A., Abele, S., & Hummel, T. R. (2023) · Vocations and Learning · doi:10.1007/s12186-023-09325-y · Cited by 11
“Alternatively, experience in schools with more complex curricula is beneficial for performance in vocational exams as the experience of par - ticipating in exams and tests might improve learning (Rowland, 2014 ).”
BackgroundThe Testing Effect in the Lecture Hall: Does it Transfer to Content Studied but Not Practiced?
Glaser, J., & Richter, T. (2023) · Teaching of Psychology · doi:10.1177/00986283231218943 · Cited by 9
“…testing seems to be more effective than restudying in different age groups, with different types of learning material, and in the laboratory, with an overall medium effect size (Hedge ’ s g = 0.50; Rowland, 2014) and classroom settings ( g = 0.33; Yang et al., 2021; see also Agarwal et al., 2021).”
InfluentialBalancing Play and Formal Training in the Design of Serious Games
Martey, R. M., Stromer‐Galley, J., Shaw, A., McKernan, B., Saulnier, T., McLaren, E., Rhodes, M., Folkestad, J., Taylor, S. M., Kenski, K. M., et al. (2016) · Games and Culture · doi:10.1177/1555412016674809 · Cited by 5
“Testing also encourages players to retrieve previously learned information in more effective ways than rest-udy or summaries, a phenomenon known as the testing effect (see Rowland, 2014, for a review).”
BackgroundRetrieval practice can improve classroom review despite low practice test performance
Leggett, J. M. I., Burt, J. S., & Carroll, A. (2019) · Applied Cognitive Psychology · doi:10.1002/acp.3517 · Cited by 11
The testing effect under divided attention: Educational application.
Buchin, Z. L., & Mulligan, N. W. (2019) · Journal of Experimental Psychology Applied · doi:10.1037/xap0000230 · Cited by 9
Does retrieving a memory insulate it against memory inhibition? A retroactive interference study
Hulbert, J. C., & Anderson, M. C. (2020) · Memory · doi:10.1080/09658211.2019.1710216 · Cited by 8
“On the one hand, behavioural studies have shown that retrieval fosters later retention of the retrieved content and does so more effectively than does simple re-exposure of the same material (Bjork, 1988; Karpicke & Roediger, 2008; Landauer & Bjork, 1978; Rowland, 2014; van den Broek et al., 2016).”
BackgroundCausal learning with delays up to 21 hours
Zhang, Y., & Rottman, B. M. (2023) · Psychonomic Bulletin & Review · doi:10.3758/s13423-023-02342-x · Cited by 9
“We also had participants make predictions during learning; doing so is believed to have a neutral or slightly beneficial impact on learning (Well et al., 1988), perhaps due to increased attention or for reasons similar to retrieval practice (Roediger and Karpicke, 2006; Rowland, 2014).”
May, B. M. (2021) · International Journal of Mathematical Education in Science and Technology · doi:10.1080/0020739x.2021.1961034 · Cited by 10
Pretesting boosts item but not source memory
Seabrooke, T., Mitchell, C. J., & Hollins, T. J. (2021) · Memory · doi:10.1080/09658211.2021.1977328 · Cited by 6
“…of studying, tests improve memory for information that students studied before the test (the backwards testing effect; Roediger & Karpicke, 2006; Rowland, 2014), and for unrelated information that they study after the test (the forwards testing effect; Szpunar et al., 2008; Yang et al., 2018).”
BackgroundBarenberg, J., & Dutke, S. (2021) · Psychology Learning & Teaching · doi:10.1177/14757257211049312 · Cited by 10
“This effect has frequently been replicated and recent reviews and meta-analyses corroborated its reliability (Dunlosky et al., 2013; Moreira et al., 2019; Roediger III & Butler, 2011; Rowland, 2014; Schwieren et al., 2017; Yang et al., 2021).”
BackgroundResultGuran, C.-N. A., Deuker, L., Göttlich, M., Axmacher, N., & Bunzeck, N. (2022) · Cerebral Cortex Communications · doi:10.1093/texcom/tgac009 · Cited by 8
“Whether this effect relates to enhanced effort (Pyc and Rawson 2009; Rowland 2014) or other processes such as fast mapping (Sharon et al. 2011) remains to be investigated.”
BackgroundResultWissman, K. T., & Rawson, K. A. (2017) · Memory & Cognition · doi:10.3758/s13421-017-0752-x · Cited by 8
“2 Although not of interest for current purposes, the similar recall of tested versus not-tested items for learners in the collaborative group is surprising given the robustness effects of retrieval practice (for reviews of testing effects, see Dunlosky, Rawson, Marsh, Nathan, & Willingham, 2013; Rawson & Dunlosky, 201…”
ResultHopper, W. J., & Huber, D. E. (2019) · Memory & Cognition · doi:10.3758/s13421-019-00903-x · Cited by 8
Roediger, H. L., III, & McDermott, K. B. (2018) · PubMed Central · Cited by 8
Using Mobile Devices in Teaching Large University Classes: How Does It Affect Exam Success?
Feraco, T., Casali, N., Tortora, C., Bon, C. D., Accarrino, D., & Meneghetti, C. (2020) · Frontiers in Psychology · doi:10.3389/fpsyg.2020.01363 · Cited by 9
“The positive effect of quizzes may also be supported by feedback given after each answer (as in Rowland, 2014).”
BackgroundInfluentialOptimizing Fact-Learning with a Response-Latency-Based Adaptive SystemPreprint
Sense, F., & van Rijn, H. (2022) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/chpgv · Cited by 10
Jackendoff, R. S. (2022) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780198845003.013.3 · Cited by 11
Friction Interventions to Curb the Spread of Misinformation on Social MediaPreprint
Jahn, L., Rendsvig, R. K., Flammini, A., Menczer, F., & Hendricks, V. F. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2307.11498 · Cited by 6
“Such a field experiment may also contribute to research on testing effects [59, 60, 61], nudges, and priming [13, 43].”
BackgroundMethodThe benefits of elaborative encoding over retrieval practice for associative learning
Jaeger, A., Martins, T. H. P. G., Rodrigues, J. P. P., Muniz, B. F. B., Fonseca, A. L. S. D. S., & Gonçalves, A. D. O. (2024) · Memory & Cognition · doi:10.3758/s13421-024-01671-z · Cited by 12
“Although feedback can be an efficient tool for improving the effectiveness of retrieval practice (Pashler et al., 2005), especially in applied contexts (Moreira et al., 2019; Rowland, 2014), it may represent a confounding factor for basic research focusing on retrieval (Karpicke et al., 2014).”
van Wijk, E. V., de Jonge, M., van Blankenstein, F. M., Janse, R. J., & Langers, A. M. J. (2024) · BMC Medical Education · doi:10.1186/s12909-024-06538-0 · Cited by 8
“One explanation for the lack of a retrieval benefit in our study could relate to the level of initial retrieval success, which is often lower for VSAQs due to their greater difficulty [3, 14, 23, 34].”
Goldstein, H., Rau, L., Humberg, C., Bachhausen, V., Stahlschmidt, L., & Wager, J. (2025) · Headache The Journal of Head and Face Pain · doi:10.1111/head.14923 · Cited by 5
“Headache-specific knowledge was not evaluated at T3 to minimize testing effects 17,18 and participant burden.”
Smahi, K., Labouidya, O., & Khadiri, K. E. (2025) · International Journal of Engineering Pedagogy (iJEP) · doi:10.3991/ijep.v15i5.55055 · Cited by 5
Huang, S., Cao, H.-W., Wang, J., & Liu, S. (2025) · Behavioral Sciences · doi:10.3390/bs15111540 · Cited by 12
“…demonstrated that learning activities involving active retrieval produce better learning outcomes than non-retrieval activities, a phenomenon known as the retrieval practice effect (RPE) (Adesope et al., 2017; Karpicke, 2017; Roediger & Butler, 2011; Roediger & Karpicke, 2006b; Rowland, 2014).”
Zhang, J., Wang, Y. J., Wanta, W., Zheng, Q., & Wang, X. (2021) · Public Health · doi:10.1016/j.puhe.2021.11.011 · Cited by 5
Embedding retrieval practice in undergraduate biochemistry teaching using PeerWise
Higgins, T., Dudley, E., Bodger, O. G., Newton, P. M., & Francis, N. (2023) · Biochemistry and Molecular Biology Education · doi:10.1002/bmb.21799 · Cited by 5
“4,5 Common ways to do this include the writing/answering of questions, a strategy which has been consistently shown to improve student learning and transfer, when compared to the re-reading of notes or other text, 6,7 and the benefits are experienced independently of cognitive ability.”
BackgroundThe effect of retrieval practice on vocabulary learning for DHH children
Reimer, C. K., Grantham, H., & Butler, A. C. (2024) · The Journal of Deaf Studies and Deaf Education · doi:10.1093/deafed/enae005 · Cited by 6
Nebel, S., Beege, M., Schneider, S., & Rey, G. D. (2024) · Learning and Individual Differences · doi:10.1016/j.lindif.2024.102425 · Cited by 5
Schlag, R., Stegmann, K., & Sailer, M. (2024) · The European Educational Researcher · doi:10.31757/euer.722 · Cited by 7
“Nevertheless, numerous studies have shown that participating in tests on previously studied information can be conducive to student learning (Rowland, 2014).”
BackgroundStorm, B. C., & Soares, J. S. (2024) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780190917982.013.82 · Cited by 25
The effects of counterattitudinal seductive details on learning
Wesenberg, L., Schmidt, F., Schwintek, S., Jansen, S., Krieglstein, F., Schneider, S., & Rey, G. D. (2024) · Learning and Individual Differences · doi:10.1016/j.lindif.2024.102567 · Cited by 6
Seban, P., Urban, K., & Sikl, R. (2025) · Instructional Science · doi:10.1007/s11251-024-09686-4 · Cited by 5
“Nevertheless, we were concerned about the potential influence of the testing effect (Dunlosky et al., 2013; Rowland, 2014) on the observed differences between our experimental groups, basically that it potentially can mask the true effect of the reading approaches we sought to investigate.”
Bencze, D., Marián, M., Szöllősi, Á., Simor, P., & Racsmány, M. (2024) · Cortex · doi:10.1016/j.cortex.2024.11.012 · Cited by 6
Morehead, K., Dunlosky, J. T., Rawson, K. A., Bishop, M., & Pyc, M. A. (2017) · Memory · doi:10.1080/09658211.2017.1381266 · Cited by 7
“…people may generate a new (and potentially longer lasting) mediator that can support later recall or (b) accessing the same mediator across spaced trials can increase later accessibility of that mediator (as per the testing effect, e.g., Pyc & Rawson, 2010; Rowland, 2014; Roediger & Putnam, 2011).”
BackgroundSchunn, C. D., Newcombe, N. S., Alfieri, L., Cromley, J. G., Massey, C. M., & Merlino, J. F. (2018) · Applied Cognitive Psychology · doi:10.1002/acp.3398 · Cited by 8
“…previous concepts at delay even when equating for total study time can greatly reduce forgetting (the “spacing” effect; Rohrer & Pashler, 2007), and testing can help students remember content better than simply reviewing it for the same amount of time (the “testing” effect; Rowland, 2014).”
BackgroundYou've got some explaining to do: Effects of explanation prompts on science text comprehension
McCarthy, K. S., & Hinze, S. (2021) · Applied Cognitive Psychology · doi:10.1002/acp.3875 · Cited by 4
Introducing desirable difficulty in STEM barrier courses with spaced retrieval practice
Bego, C. R., Lyle, K. B., Immekus, J. C., & Ralston, P. A. S. (2021) · IEEE Frontiers in Education Conference (FIE) · doi:10.1109/fie49875.2021.9637192 · Cited by 7
Cavendish, B. A., de Lima, M. F. R., Perícoli, L., & Buratto, L. G. (2021) · Brain and Cognition · doi:10.1016/j.bandc.2021.105807 · Cited by 9
The dual-process perspective and the benefits of retrieval practice in younger and older adults
Shaffer, R. A., & McDermott, K. B. (2022) · Memory · doi:10.1080/09658211.2022.2027986 · Cited by 5
“Critically, improvements in later memory performance following initial testing depend upon a certain level of initial test performance (Kornell et al., 2011; Rowland, 2014).”
BackgroundA Comparative Study of Gamified and Conventional Online Quizzes
Kyung-Mi, O. (2022) · International Journal of Emerging Technologies in Learning (iJET) · doi:10.3991/ijet.v17i03.26349 · Cited by 10
“Meanwhile, gamification has emerged as an effective tool for educators to improve the digital native’s learning outcomes [16, 17].”
BackgroundActive Retrieval Improves Procedural Learning in Orthopedic Surgery
Ndoja, S., Dion, C.-A. B., Pirshahid, A. A., Charron, B. P., Durocher, A. M., McCarton, A., & LeBel, M. (2022) · Journal of surgical education · doi:10.1016/j.jsurg.2022.05.001 · Cited by 7
Udvardi-Lakos, N., Endres, T., Glogger‐Frey, I., & Renkl, A. (2023) · Frontiers in Education · doi:10.3389/feduc.2022.1067347 · Cited by 10
“It also includes repeated and spaced retrieval practice opportunities, which support learning (Bjork, 1970; Rowland, 2014; Carpenter et al., 2022).”
BackgroundMethodCovert retrieval yields a forward testing effect across levels of successive list similarity
Carvalho, M. B., Cooper, A., & Marmurek, H. H. C. (2023) · Metacognition and Learning · doi:10.1007/s11409-023-09348-9 · Cited by 5
“During the review phase, testing can be completed in various formats (Cho et al., 2017; Endres & Renkl, 2015; Racsmány et al., 2017; Rickard and Pan, 2017; Rowland, 2014; Sundqvist et al., 2017).”
BackgroundNewton, P. M. (2023) · Springer eBooks · doi:10.1007/978-981-287-079-7_93-1 · Cited by 10
Hsu, C.-W. (2023) · Journal of Graduate Medical Education · doi:10.4300/jgme-d-23-00146.1 · Cited by 5
Mayrhofer, R., Kuhbandner, C., & Frischholz, K. (2023) · Frontiers in Psychology · doi:10.3389/fpsyg.2023.1258359 · Cited by 6
“…the effectiveness of different learning strategies may vary as a function of the length of the retention interval, as suggested, for example, by the finding that the testing effect depends on the retention interval (e.g., Halamish and Bjork, 2011; Kornell et al., 2011; for a review, see Rowland, 2014).”
BackgroundThe role of mediators for the pretesting effect
Bartl, J., Kliegl, O., & Bäuml, K. T. (2024) · Memory · doi:10.1080/09658211.2024.2323930 · Cited by 6
“…between the posttesting-effect and the pretesting-effect tasks is that the number of overt errors that occur during pretesting is typically much higher than during posttesting, typically close to 100% during pretesting and often in the range between 0% and 50% during posttesting (Rowland, 2014).”
BackgroundRetrieval practice effect and individual differences: current status and future directions
de Lima, M. F. R., & Buratto, L. G. (2024) · Journal of Cognitive Psychology · doi:10.1080/20445911.2024.2354963 · Cited by 8
“In summary, the retrieval practice e ff ect has been well established in experimental research (for meta-analytic reviews, see Rowland, 2014; Yang et al., 2021).”
BackgroundMethodResultThe role of variable retrieval in effective learning
Butowska, E., Kliś, P., Zawadzka, K., & Hanczakowski, M. (2024) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2413511121 · Cited by 10
Time-dependent forgetting and retrieval practice effects in detailed visual long-term memory
Mercer, T., & Jones, G. A. (2018) · Quarterly Journal of Experimental Psychology · doi:10.1177/1747021818799697 · Cited by 7
Kalogiannakis, M., & Kanaki, K. (2019) · Advances in educational technologies and instructional design book series · doi:10.4018/978-1-7998-1479-5.ch010 · Cited by 5
Retrieval practice enhances memory for names in survivors of stroke.
Evans, F. A., Wong, D. K., & Stolwyk, R. J. (2020) · Neuropsychology · doi:10.1037/neu0000701 · Cited by 6
Brudzinski, M. R., Hubenthal, M., Fasola, S. L., & Schnorr, E. (2021) · Seismological Research Letters · doi:10.1785/0220200472 · Cited by 5
Cleary, A. M., McNeely-White, K. L., Hausman, H., Dawson, J., Kuhn, S., Osborn, R. M., Huebert, A. M., & Rhodes, M. G. (2021) · Journal of Applied Research in Memory and Cognition · doi:10.1016/j.jarmac.2021.01.001 · Cited by 6
Bentley, D. C., Attardi, S. M., Faul, J., Melo, V., & Palmer, C. (2021) · Journal of medical imaging and radiation sciences · doi:10.1016/j.jmir.2021.08.017 · Cited by 6
Principles for Educational Assessment with Multimedia
Lindner, M. A. (2021) · Cambridge University Press eBooks · doi:10.1017/9781108894333.055 · Cited by 8
PROTOCOL: Testing frequency and student achievement: A systematic review
Thomsen, M. K., Seerup, J. K., Dietrichson, J., Bondebjerg, A., & Viinholt, B. C. A. (2022) · Campbell Systematic Reviews · doi:10.1002/cl2.1212 · Cited by 11
Fostering university students’ learning performance using the one-take video approach
Börger, J., Spilles, M., Krull, J., Hagen, T., & Hennemann, T. (2022) · Active Learning in Higher Education · doi:10.1177/14697874211069524 · Cited by 8
“At the same time, the continuous recall of one’s own knowledge (testing effect) improves learners’ memory capacity (Rowland, 2014).”
BackgroundInfluentialAre open‐book tests still as effective as closed‐book tests even after a delay of 2 weeks?
Wenzel, K., Schweppe, J., & Rummer, R. (2022) · Applied Cognitive Psychology · doi:10.1002/acp.3943 · Cited by 7
“…and in naturalistic applied learning contexts like school or university classes, for varying (curricular) materials, and when using different forms of test questions (e.g., Adesope et al., 2017; Agarwal et al., 2021; Batsell et al., 2017; Dunlosky et al., 2013; Karpicke & Aue, 2015; Rowland, 2014).”
InfluentialBauer, T., Biehler, R., & Lankeit, E. (2022) · International Journal of Research in Undergraduate Mathematics Education · doi:10.1007/s40753-022-00167-y · Cited by 12
“Even though not entirely understood theoretically, the effect has been well established under various experimental conditions (see e.g., the meta-analysis by Rowland, 2014).”
BackgroundWulf, A. J., & Seizov, O. (2022) · European Journal of Law and Economics · doi:10.1007/s10657-022-09755-4 · Cited by 10
Metadata
- Authors
- Rowland, C. A.
- Affiliations
- Colorado State University (US)
- Corresponding author
- Rowland, Christopher A.
- Venue
- Psychological Bulletin
- Published
- 2014
- Volume
- 140
- Issue
- 6
- Pages
- 1432-1463
- ISSN
- 0033-2909 (ISSN-L)
- 1939-1455
- OpenAlex
- W2050255700
- Cited by
- 1,066
- References
- 139
- Citations by year
- 2026: 71 · 2025: 103 · 2024: 139 · 2023: 113 · 2022: 138 · 2021: 122 · 2020: 105 · 2019: 91 · 2018: 73 · 2017: 52 · 2016: 36 · 2015: 19 · 2014: 3
- FWCI
- 20.46
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Psychological Bulletin (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Memory Processes and Influences
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Visual and Cognitive Learning Processes
- Life Sciences › Neuroscience › Cognitive Neuroscience › Memory and Neural Mechanisms
- Keywords
- testing effect, restudy, retention, effortful processing, recall tests, recognition test, semantic elaboration, memory retrieval, bifurcation model, memory consolidation
- MeSH terms
- Attention, Cues, Educational Measurement, Humans, Learning, Memory, Neuropsychological Tests, Practice, Psychological, Mental Recall, Retention, Psychology, Semantics, Students, Universities
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.