The effect of testing versus restudy on retention: A meta-analytic review of the testing effect.
The DOI matches its Crossref record; 138 of the 139 references it cites were found in a registry or an index.
Abstract
Meta-analysis uses meta-analysis to examine the effects of testing versus restudy on retention and indicates support for the role of effortful processing as a contributor to the testing effect.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Regarding retrieval practice, over a century of research has demonstrated that students who practice retrieving information have better and longer memory retention for that information compared to students who engage with the material more passively (e.g., restudying).”
From The benefits of successive relearning on multiple learning outcomes. (2022) · cites this paper as Rowland, 2014
In the citing paper
“whereas retrieval practice is the phenomenon that actively recalling information from memory enhances memory”
From Does Retrieval Practice Protect Memory Against Stress? A Meta-Analysis (2025) · cites this paper as Rowland, 2014
In the citing paper
“However, meta-analyses on the benefits of retrieval practice (e.g., Rowland, 2014) show consistently positive effects regardless of the different types of materials used.”
From Does Retrieval Practice Protect Memory Against Stress? A Meta-Analysis (2025) · cites this paper as Rowland, 2014
In the citing paper
“consistent with the robust testing effect (Agarwal et al., 2021; Rowland, 2014; Schwieren et al., 2017; Yang et al., 2021).”
From Does Retrieval Practice Protect Memory Against Stress? A Meta-Analysis (2025) · cites this paper as Rowland, 2014
In the citing paper
“Effect sizes range from moderate to large, with estimates between d = 0.55 and d = 0.88 (Phelps, 2012), g = 0.50 (Rowland, 2014), and g = 0.61 to g = 0.70 (Adesope et al., 2017).”
From Testing the testing effect on prolific: when retrieval practice fails to boost learning (2026) · cites this paper as Rowland, 2014
13 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Measuring inconsistency in meta-analyses
Higgins, J. P. T., Thompson, S. G., Deeks, J. J., & Altman, D. G. (2003) · BMJ · doi:10.1136/bmj.327.7414.557 · Cited by 63,139
The file drawer problem and tolerance for null results.
Rosenthal, R. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.3.638 · Cited by 9,068
Distribution Theory for Glass's Estimator of Effect Size and Related Estimators
Hedges, L. V. (1981) · Journal of Educational Statistics · doi:10.2307/1164588 · Cited by 5,695
Creating false memories: Remembering words not presented in lists.
Roediger, H. L., & McDermott, K. B. (1995) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/0278-7393.21.4.803 · Cited by 3,792
Fixed-and random-effects models in meta-analysis.
Hedges, L. V., & Vevea, J. L. (1998) · Psychological Methods · doi:10.1037/1082-989x.3.4.486 · Cited by 2,977
Test-Enhanced Learning: Taking Memory Tests Improves Long-Term Retention
Roediger, H. L., & Karpicke, J. D. (2006) · Psychological Science · doi:10.1111/j.1467-9280.2006.01693.x · Cited by 2,867
Levels of processing versus transfer appropriate processing
Morris, C. D., Bransford, J. D., & Franks, J. J. (1977) · Journal of Verbal Learning and Verbal Behavior · doi:10.1016/s0022-5371(77)80016-9 · Cited by 2,296
The power of testing memory: Basic research and implications for educational practice
Roediger, H. L., & Karpicke, J. D. (2006) · Perspectives on Psychological Science · doi:10.1111/j.1745-6916.2006.00012.x · Cited by 2,037
The critical role of retrieval practice in long-term retention
Roediger, H. L., & Butler, A. C. (2011) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2010.09.003 · Cited by 1,796
The Critical Importance of Retrieval for Learning
Karpicke, J. D., & Roediger, H. L. (2008) · Science · doi:10.1126/science.1152408 · Cited by 1,791
Cited by
Items 301–400 of 1,077
Examining the relationship between generation constraint and memory
McCurdy, M. P., Frankenstein, A. N., Sklenar, A. M., Levy, P. U., & Leshikar, E. D. (2021) · Memory & Cognition · doi:10.3758/s13421-020-01119-0 · Cited by 18
A Framework for Applying the Learning Sciences to MOOC Design
Gordon, D. G., & Wiltrout, M. E. (2021) · Frontiers in Education · doi:10.3389/feduc.2020.500481 · Cited by 17
When retrieval practice promotes new learning – The critical role of study material
Kliegl, O., & Bäuml, K. T. (2021) · Journal of Memory and Language · doi:10.1016/j.jml.2021.104253 · Cited by 21
Klopp, E., & Stark, R. (2020) · Frontiers in Education · doi:10.3389/feduc.2020.00126 · Cited by 17
“The testing effect builds on the elaborative retrieval theory (cf., Carpenter, 2009; Halamish and Bjork, 2011; Rowland, 2014), which features two main cognitive processes.”
BackgroundRicci, M., Wong, T. H., Nikpour, A., & Miller, L. A. (2017) · Cortex · doi:10.1016/j.cortex.2017.10.007 · Cited by 20
Fiechter, J. L., & Benjamin, A. S. (2019) · Psychonomic Bulletin & Review · doi:10.3758/s13423-019-01617-6 · Cited by 17
“Over a variety of learning situations and with myriad stimuli, the benefits of retrieval practice have proven to be remarkably robust (see Rowland, 2014, for a review).”
BackgroundMethodInfluentialSchneider, A., Kühl, M., & Kühl, S. J. (2019) · Medical Teacher · doi:10.1080/0142159x.2019.1628195 · Cited by 18
“Our study shows that practice testing can be utilized to promote students learning within a flipped classroom. Students that prepared with films and multiple-choice questions outperformed students that prepared with films and a reader or with films only. Within a flipped classroom it is important for students to come…”
BackgroundInfluentialTiming storytime to maximize children’s ability to retain new vocabulary
Henderson, L. M., van Rijn, E., James, E., Walker, S., Knowland, V. C. P., & Gaskell, M. G. (2021) · Journal of Experimental Child Psychology · doi:10.1016/j.jecp.2021.105207 · Cited by 24
Pyke, W., Lunau, J., & Javadi, A.-H. (2025) · Quarterly Journal of Experimental Psychology · doi:10.1177/17470218241308143 · Cited by 15
“When cued or free recall is employed during the learning phase, many studies have found improved subsequent memory performance on a final test compared to when recognition is used (Butler & Roediger, 2007; Kang et al., 2007; Stenlund et al., 2016); for reviews, see (McDermott, 2021; Rowland, 2014).”
InfluentialLearning from errors: Exploration of the monitoring learning effect
Middleton, E. L., Schwartz, M. F., Dell, G. S., & Brecher, A. R. (2022) · Cognition · doi:10.1016/j.cognition.2022.105057 · Cited by 19
Yan, V. X., Sana, F., & Carvalho, P. F. (2023) · Policy Insights from the Behavioral and Brain Sciences · doi:10.1177/23727322231218906 · Cited by 30
“Similarly, when learners are not able to successfully retrieve the correct response, and when no feedback is provided, further retrieval practice has little, or even, a negative effect (Fiechter & Benjamin, 2018; Rowland, 2014).”
BackgroundMethodInfluentialLin, T. F., & Riccomini, P. J. (2024) · Journal of Special Education Technology · doi:10.1177/01626434241263045 · Cited by 26
“Findings from two meta-analyses have shown a stronger positive effect of using retrieval practice during learning than various other methods, including reading, restudying, fi ller activities, no activity, or a combination thereof (Adesope et al., 2017; Rowland, 2014).”
The two processes underlying the testing effect– Evidence from Event-Related Potentials (ERPs)
Liu, X. L., Tan, D. H., & Reder, L. M. (2018) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2018.02.022 · Cited by 15
“It is likely that this pattern was the result of relatively poor learning during initial study (Phase 1), coupled with a lack of feedback when tested (Kornell et al., 2011; Rowland, 2014).”
Memory and availability-biased metacognitive illusions for flags of varying familiarity
Blake, A. B., & Castel, A. D. (2018) · Memory & Cognition · doi:10.3758/s13421-018-0872-y · Cited by 16
Popov, V., Zhang, Q., Koch, G. E., Calloway, R. C., & Coutanche, M. N. (2019) · Memory & Cognition · doi:10.3758/s13421-019-00950-4 · Cited by 14
“Testing, especially if followed by a restudy opportunity, improves memory (Liu, Liang, Li, & Reder, 2014; Roediger & Karpicke, 2006; Rowland, 2014).”
BackgroundEffects of distributed practice and criterion level on word retrieval in aphasia
Schuchard, J., Rawson, K. A., & Middleton, E. (2020) · Cognition · doi:10.1016/j.cognition.2020.104216 · Cited by 16
“This type of practice was chosen because a wealth of psychological research has demonstrated that the act of retrieving information from longterm memory persistently strengthens its future retrievability (for recent reviews see Kornell & Vaughn, 2016; Rawson & Dunlosky, 2011; Roediger & Butler, 2011; Roediger, Putnam…”
BackgroundMethodHolm, A. K. J., Hausman, H., & Rhodes, M. G. (2020) · Journal of American College Health · doi:10.1080/07448481.2020.1785472 · Cited by 15
“5 times more likely to remember information they practice retrieving rather than rereading while preparing for an exam.(36) However, less than one third of students report that they learn more from retrieval practice than rereading.”
BackgroundChan, J. C. K., O’Donnell, R., & Manley, K. D. (2022) · Journal of Experimental Psychology Applied · doi:10.1037/xap0000394 · Cited by 17
Less Constrained Practice Tests Enhance the Testing Effect for Item Memory but Not Context Memory
Giannakopoulos, K. L., McCurdy, M. P., Sklenar, A. M., Frankenstein, A. N., Levy, P. U., & Leshikar, E. D. (2021) · The American Journal of Psychology · doi:10.5406/amerjpsyc.134.3.0321 · Cited by 15
The roles of encoding strategies and retrieval practice in test-expectancy effects
Cho, K. W., & Neely, J. H. (2016) · Memory · doi:10.1080/09658211.2016.1202983 · Cited by 15
“Our experiments are also generally related to experiments on testing effects (see Rowland, 2014, for a recent review).”
MethodFiechter, J. L., & Benjamin, A. S. (2017) · Psychonomic Bulletin & Review · doi:10.3758/s13423-017-1366-9 · Cited by 24
“A recent meta-analysis offered evidence for such a boundary condition: In studies where performance during retrieval practice was below 50%, and in which learners did not receive item-by-item feedback on their practice performance, the testing effect is absent (Rowland, 2014).”
BackgroundMethodInfluentialLaPaglia, J. A., & Chan, J. C. K. (2019) · PLoS ONE · doi:10.1371/journal.pone.0212592 · Cited by 22
Using Spacing to Promote Lasting Learning in Educational Contexts: Promises and Challenges
Ebersbach, M., Lachner, A., Scheiter, K., & Richter, T. (2022) · Zeitschrift für Entwicklungspsychologie und Pädagogische Psychologie · doi:10.1026/0049-8637/a000259 · Cited by 14
Greving, S., Lenhard, W., & Richter, T. (2022) · Teaching of Psychology · doi:10.1177/00986283211061204 · Cited by 20
Vocabulary Learning During Reading: Benefits of Contextual Inferences Versus Retrieval Opportunities
van den Broek, G. S. E., Wesseling, E., Huijssen, L., Lettink, M., & van Gog, T. (2022) · Cognitive Science · doi:10.1111/cogs.13135 · Cited by 39
“As the benefits of retrieval practice, compared to other study strategies, are a robust phenomenon in the memory literature (e.g., Adesope et al., 2017; Dunlosky et al., 2013; Karpicke, 2017; Roediger & Butler, 2011; Rowland, 2014), the lack of retrieval benefits, compared to”
BackgroundMethodResultInfluentialEffortful Tests and Repeated Metacognitive Judgments Enhance Future Learning
Davis, S. D., & Chan, J. C. K. (2023) · Educational Psychology Review · doi:10.1007/s10648-023-09803-8 · Cited by 13
Vazquez, S. R., Ermeling, B. A., & Ramirez, G. (2020) · Journal for Research in Mathematics Education · doi:10.5951/jresematheduc-2020-0019 · Cited by 23
Examining the episodic context account: does retrieval practice enhance memory for context?
Hong, M. K., Polyn, S. M., & Fazio, L. K. (2019) · Cognitive Research Principles and Implications · doi:10.1186/s41235-019-0202-3 · Cited by 19
“The benefits of retrieval practice on subsequent memory are firmly established (see Rowland, 2014 for a review).”
BackgroundOtgaar, H., de Ruiter, C., Sumampouw, N. E. J., Erens, B., & Muris, P. (2020) · Journal of Police and Criminal Psychology · doi:10.1007/s11896-020-09401-2 · Cited by 15
“An abundance of studies has shown that such retrieval attempts strengthen the memory for those experiences, a memory phenomenon known as the testing effect (Roediger and McDermott 2006; Rowland 2014).”
BackgroundWenzel, K., & Reinhard, M.-A. (2021) · Learning and Motivation · doi:10.1016/j.lmot.2020.101706 · Cited by 13
The Testing Effect in the Lecture Hall: Does it Depend on Learner Prerequisites?
Glaser, J., & Richter, T. (2022) · Psychology Learning & Teaching · doi:10.1177/14757257221136660 · Cited by 19
“Finally, testing seems to be superior to restudying especially when learning outcomes are assessed at longer retention intervals of one week or more compared to shortly after learning (Rowland, 2014).”
BackgroundInfluentialEffect of levels-of-processing on rates of forgetting
Peng, N., Logie, R. H., & Sala, S. D. (2024) · Memory & Cognition · doi:10.3758/s13421-024-01599-4 · Cited by 22
Test-potentiated learning of motor sequences
Tempel, T., & Kubik, V. (2016) · Memory · doi:10.1080/09658211.2016.1171880 · Cited by 14
“Previous research showed that the direct testing effect generalises across various temporal contexts (increasing with longer retention intervals, Rowland, 2014), across knowledge domains (e.g., science, general knowledge; Butler, 2010; McDaniel et al., 2013), and across test formats (Bjork, Little,…”
BackgroundDoes testing increase spontaneous mediation in learning semantically related paired associates?
Cho, K. W., Neely, J. H., Brennan, M. K., Vitrano, D., & Crocco, S. (2017) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037/xlm0000414 · Cited by 18
“Testing effects occur for a wide variety of materials and for different age groups (see Rowland, 2014, for a meta-analytic review).”
BackgroundMethodRemind me of the context: Memory and metacognition at restudy
Zawadzka, K., Simkiss, N. J., & Hanczakowski, M. (2018) · Journal of Memory and Language · doi:10.1016/j.jml.2018.03.001 · Cited by 17
“…effective strategies of learning do exist, such as interleaving study episodes with testing (Rawson & Dunlosky, 2011; Roediger & Karpicke, 2006; Rowland, 2014), research on metacognitive control of study indicates that people prefer repeated study rather than repeated retrieval as the means of…”
BackgroundWhen does practice testing promote transfer on deductive reasoning tasks?
Wissman, K. T., Zamary, A., & Rawson, K. A. (2018) · Journal of Applied Research in Memory and Cognition · doi:10.1016/j.jarmac.2018.03.002 · Cited by 16
Effects of Test Anxiety on Self-Testing and Learning Performance
Liu, S., Zhao, W., Shanks, D. R., Hu, X., Luo, L., & Yang, C. (2024) · Educational Psychology Review · doi:10.1007/s10648-024-09882-1 · Cited by 14
“First, hundreds of studies have confirmed that testing can consolidate long-term retention of studied information, known as the backward testing effect (for reviews, see Karpicke, 2017; Rowland, 2014; Yang et al., 2021).”
The Impact of Gamification on the Time-Limited Writing Performance of English Majors
Zhihao, Z., & Yu, Z. (2022) · Education Research International · doi:10.1155/2022/4650166 · Cited by 26
“It has been widely used in the fields of science [2], mathematics [3], business [4], and education [5, 6].”
MethodZheng, M. S., O'Brien, K., Cuenin, K., Lyon, C., & Bender, D. J. (2022) · Journal of Dental Education · doi:10.1002/jdd.13066 · Cited by 19
Endres, T., & Eitel, A. (2023) · Applied Cognitive Psychology · doi:10.1002/acp.4160 · Cited by 16
Interactive Learning Effects of Preparing to Teach and Teaching: a Meta-Analytic Approach
Kobayashi, K. (2024) · Educational Psychology Review · doi:10.1007/s10648-024-09871-4 · Cited by 17
“Accumulated evidence indicates the superiority of generative or retrieval-based learning over non-generative or repetitive learning (for systematic and meta-analytic reviews, see Adesope et al., 2017; Brod, 2021; Chi & Wylie, 2014; Fiorella & Mayer, 2015; Rowland, 2014).”
Divided attention and the encoding effects of retrieval
Buchin, Z. L., & Mulligan, N. W. (2019) · Quarterly Journal of Experimental Psychology · doi:10.1177/1747021819847141 · Cited by 13
Simulation-based training for flexible cystoscopy – A randomized trial comparing two approaches
Bube, S. H., Dagnæs-Hansen, J. A., Mahmood, O., Rohrsted, M., Bjerrum, F., Salling, L., Hansen, R. B., & Konge, L. (2020) · Heliyon · doi:10.1016/j.heliyon.2019.e03086 · Cited by 14
The impact of using virtual patients in preclinical pharmacology teaching
Nicolaou, P. A., & Saifi, M. E. (2020) · AJP Advances in Physiology Education · doi:10.1152/advan.00009.2020 · Cited by 16
Rummer, R., & Schweppe, J. (2021) · Unterrichtswissenschaft · doi:10.1007/s42010-021-00137-4 · Cited by 18
“Eine aktuelle Metaanalyse zeigt aber auch gegenüber anderen Kontrollbedingungen – wie dem in Laborexperimenten typischerweise eingesetzten wiederholten Lesen – einen substantiellen Testungseffekt im Feld (Yang et al. 2021).”
BackgroundInfluentialDoes testing enhance new learning because it insulates against proactive interference?
Ahn, D., & Chan, J. C. K. (2022) · Memory & Cognition · doi:10.3758/s13421-022-01273-7 · Cited by 14
“However, a large body of research has established that taking tests enhances learning (Chan, Meissner et al., 2018; Karpicke & Roediger, 2008; Rowland, 2014; for exceptions, see Chan et al., 2017; Davis & Chan, 2015; Finn & Roediger, 2013).”
BackgroundThe Retrieval Practice Hypothesis in Research on Learning by Teaching: Current Status and Challenges
Kobayashi, K. (2022) · Frontiers in Psychology · doi:10.3389/fpsyg.2022.842668 · Cited by 22
“…restudying or other learning strategies in criterion test performance, such as retention, inference, and transfer (for meta-analytic reviews, see Rowland, 2014; Adesope et al., 2017; Pan and Rickard, 2018; Yang et al., 2021), though, under certain conditions, retrieval-based learning has been…”
BackgroundRottman, B. M., Caddick, Z. A., Nokes‐Malach, T. J., & Fraundorf, S. H. (2023) · Cognitive Research Principles and Implications · doi:10.1186/s41235-023-00496-9 · Cited by 16
“Testing is further strengthened when followed by feed-back (Rowland, 2014, EL: 1), a phenomenon too often lacking in medical practice itself, and by having tests spaced out over time (Cepeda et al., 2006, EL: 1; Phillips et al., 2019; EL: 2; Pyc & Rawson, 2009, EL: 3).”
BackgroundTesting can enhance episodic memory updating in younger and older adults.
Kemp, P. L., Loaiza, V. M., & Wahlheim, C. N. (2023) · Psychology and Aging · doi:10.1037/pag0000776 · Cited by 15
“Testing has been shown to improve memory for retrieved information more than restudying at high levels of retrieval success (for a meta-analytic review, see Rowland, 2014).”
BackgroundSpaced Retrieval Practice: Can Restudying Trump Retrieval?
Higham, P. A., Fastrich, G. M., Potts, R., Murayama, K., Pickering, J. S., & Hadwin, J. A. (2023) · Educational Psychology Review · doi:10.1007/s10648-023-09809-2 · Cited by 28
“However, most testing effect research with a restudy condition has included a single practice session (see Rowland, 2014 for a review).”
BackgroundResultInfluentialThe role of retrieval practice in memory and analogical problem-solving
Hostetter, A. B., Penix, E. A., Norman, M. Z., Batsell, W. R., & Carr, T. H. (2018) · Quarterly Journal of Experimental Psychology · doi:10.1177/1747021818771928 · Cited by 21
The testing effect and analogical problem-solving
Peterson, D. J., & Wissman, K. T. (2018) · Memory · doi:10.1080/09658211.2018.1491603 · Cited by 20
“The targeted sample size was n = 102, based on an a priori power analysis, with power set at .80 to detect a medium effect of d = 0.50 (as specified from a meta-analysis of the testing effect literature, Rowland, 2014).”
BackgroundMethodInfluentialKliegl, O., Abel, M., & Bäuml, K. T. (2018) · Frontiers in Psychology · doi:10.3389/fpsyg.2018.01446 · Cited by 13
“Our findings also demonstrate that immediate feedback can amplify the magnitude of the testing effect, because the effect was much more pronounced in the presence (Experiment 4) than the absence (Experiment 3) of such feedback, which mimics results with young adults (Rowland, 2014).”
Retrieval practice benefits memory precision
Schuetze, B. A., Eglington, L. G., & Kang, S. H. K. (2019) · Memory · doi:10.1080/09658211.2019.1623260 · Cited by 17
“Indeed, retrieval practice (RP) has been found to promote long-term learning and retention more than restudying or rereading the material (Karpicke & Roediger, 2008; Rowland, 2014).”
BackgroundMethodResultInfluentialSymeonidou, N., & Kuhlmann, B. G. (2021) · Memory · doi:10.1080/09658211.2021.1910310 · Cited by 15
“…it must be noted that the opposite order, that is, first recognition then free recall, might inflate performance in the second test, suggesting that testing primarily fosters retrieval (i.e., accessibility) rather than storage (i.e., availability; see Rowland, 2014 for a detailed discussion).”
BackgroundThe testing effect is moderated by experimental design
Mulligan, N. W., Susser, J. A., & Smith, S. (2016) · Journal of Memory and Language · doi:10.1016/j.jml.2016.03.006 · Cited by 13
Pretesting Enhances Learning in the Classroom
Soderstrom, N. C., & Bjork, E. L. (2023) · Educational Psychology Review · doi:10.1007/s10648-023-09805-6 · Cited by 13
“(2011) assessed pretesting effects in eighth graders, an age group that attends full days of school and is not expected to study on their own as much as, say, high-school or college students. Carpenter et al. (2018) used a sample of college students in their pretesting study, but, as the researchers stated, “.”
BackgroundBego, C. R., Lyle, K. B., Ralston, P. A. S., Immekus, J. C., Chastain, R. J., Haynes, L. D., Hoyt, L. K., Pigg, R. M., Rabin, S. D., Scobee, M. W., et al. (2024) · International Journal of STEM Education · doi:10.1186/s40594-024-00468-5 · Cited by 12
“Effects of retrieval practice on memory have been extensively studied (Rowland, 2014).”
The Use of Retrieval Practice in the Health Professions: A State-of-the-Art Review
Serra, M. J., Kaminske, A. N., Nebel, C. L., & Coppola, K. M. (2025) · Behavioral Sciences · doi:10.3390/bs15070974 · Cited by 38
“Subsequent meta-analyses of the testing effect and retrieval practice found a reliable medium effect size of testing ( g = 0.50; Rowland, 2014), medium effect sizes when looking at the transfer of test-enhanced learning ( d = 0.40; Pan & Rickard, 2018) and a medium effect size in applied classroom…”
InfluentialTse, C., Chan, M. H.-M., Tse, W.-S., & Wong, S. W. H. (2019) · Frontiers in Psychology · doi:10.3389/fpsyg.2019.00969 · Cited by 16
“…across study materials (e.g., general knowledge fact), test types Frontiers in Psychology | www.frontiersin.org 1 May 2019 | Volume 10 | Article 969 (e.g., cued recall), and populations (e.g., older adults) (see, e.g., Rowland, 2014; Kornell and Vaughn, 2016; Putnam et al., 2016, for reviews).”
Backgroundde Lima, M. F. R., Júnior, S. V. P., da Costa, J. F. D., & Buratto, L. G. (2020) · The Spanish Journal of Psychology · doi:10.1017/sjp.2020.33 · Cited by 13
“The first aim was achieved, replicating previous studies (Cull & Zechmeister, 1994; Dunlosky et al., 2013; Rowland, 2014).”
BackgroundMethodResultInfluentialUsing SQL to query the difficulty imposed by spaced retrieval in engineering mathematics
Boyd, J. R., Bego, C. R., Garcia, O. A., Ralston, P. A. S., Immekus, J. C., & Lyle, K. B. (2021) · IEEE Frontiers in Education Conference (FIE) · doi:10.1109/fie49875.2021.9637171 · Cited by 13
Wirebring, L. K., Wiklund‐Hörnqvist, C., Stillesjö, S., Granberg, C., Lithner, J., Andersson, M., Nyberg, L. H., & Jonsson, B. (2022) · Trends in Neuroscience and Education · doi:10.1016/j.tine.2022.100193 · Cited by 22
Ophuis‐Cox, F. H. A., Catrysse, L., & Camp, G. (2023) · Applied Cognitive Psychology · doi:10.1002/acp.4141 · Cited by 24
Knouse, L. E., Rawson, K. A., & Dunlosky, J. T. (2020) · Learning and Instruction · doi:10.1016/j.learninstruc.2020.101330 · Cited by 19
Fellman, D., Lincke, A., & Jonsson, B. (2020) · Frontiers in Psychology · doi:10.3389/fpsyg.2020.02076 · Cited by 18
“The mechanisms underlying retrieval practice remains unclear (see Rowland, 2014 for an overview), but the effectiveness has been studied and confirmed in different experimental settings, educational contexts, across a range of materials and by brain imaging studies (Dunlosky et al., 2013; van den…”
BackgroundThe effect of practice test modality on perceived mental effort and delayed final test performance
Coppens, L. C., de Jonge, M., van Gog, T., & Kester, L. (2020) · Journal of Cognitive Psychology · doi:10.1080/20445911.2020.1822366 · Cited by 13
Integrating effective learning strategies in basic physics lectures: A thematic analysis
Gjerde, V., Holst, B., & Kolstø, S. D. (2021) · Physical Review Physics Education Research · doi:10.1103/physrevphyseducres.17.010124 · Cited by 17
Edmonds, A., Gerbier, É., Palasis, K., & Whyte, S. (2021) · Lexis · doi:10.4000/lexis.5652 · Cited by 14
Specific questions during retrieval practice are better for texts containing seductive details
Eitel, A., Endres, T., & Renkl, A. (2022) · Applied Cognitive Psychology · doi:10.1002/acp.3984 · Cited by 12
Eyewitness accuracy and retrieval effort: Effects of time and repetition
Gustafsson, P. U., Lindholm, T., & Jönsson, F. U. (2022) · PLoS ONE · doi:10.1371/journal.pone.0273455 · Cited by 17
Kang, S. H. K., Eglington, L. G., Schuetze, B. A., Lu, X., Hinterstoisser, T. M., & Huaco, J. (2023) · Journal of Financial Counseling and Planning · doi:10.1891/jfcp-2021-0032 · Cited by 15
Collier, J. R., Pillai, R. M., & Fazio, L. K. (2023) · Cognitive Research Principles and Implications · doi:10.1186/s41235-023-00488-9 · Cited by 19
“A large literature demonstrates that the simple act of retrieving information from memory enhances retention of the material, even when compared with restudying the same material (see Roediger & Butler, 2011; Rowland, 2014 for reviews).”
BackgroundWissman, K. T., & Rawson, K. A. (2017) · Memory · doi:10.1080/09658211.2017.1350717 · Cited by 12
“Over 100 years of research has established that practice testing facilitates learning and retention (for reviews, see Dunlosky, Rawson, Marsh, Nathan, & Willingham, 2013; Rawson & Dunlosky, 2011; Roediger & Butler, 2011; Rowland, 2014).”
Student Learning with Generated and Answered Peer-written Questions
Hudson, S. L., Jarstfer, M. B., & Persky, A. M. (2018) · American Journal of Pharmaceutical Education · doi:10.5688/ajpe6315 · Cited by 11
Otgaar, H., Chan, J. C. K., Calado, B., & Rooy, D. J. L. (2018) · Legal and Criminological Psychology · doi:10.1111/lcrp.12137 · Cited by 16
“However, we caution against over-interpreting this null effect, given that recognition is not always sensitive to the benefits of prior testing (Chan & McDermott, 2007; Rowland, 2014).”
BackgroundA specific benefit of retrieval-based concept mapping to enhance learning from texts
Tudela, J. M. O., Lechuga, M. T., & Gómez‐Ariza, C. J. (2018) · Instructional Science · doi:10.1007/s11251-018-9476-y · Cited by 15
Retrieval practice improves learning in children with diverse visual word recognition skills
Moreira, B. F. T., Pinto, T. S. S., Justi, F. R. D. R., & Jaeger, A. (2019) · Memory · doi:10.1080/09658211.2019.1668017 · Cited by 22
“As in the meta-analysis reported by (Rowland, 2014), individuals who remembered 50% or less of the encoded target-words during retrieval practice (low performers, N = 28), showed a significantly smaller testing-effect (mean increase of 2.1% for tested vs restudied target-words, SD = 23.8”
BackgroundInfluentialImproving Metacognition in the Classroom
Hausman, H., Myers, S. J., & Rhodes, M. G. (2021) · Zeitschrift für Psychologie · doi:10.1027/2151-2604/a000440 · Cited by 15
Maxwell, N. P., Perry, T., & Huff, M. J. (2021) · Metacognition and Learning · doi:10.1007/s11409-021-09284-6 · Cited by 14
“…difficulties, which have been suggested to contribute to other memory benefits (e.g., spacing and retrieval-practice effects; see Maddox, 2016, and Rowland, 2014, for reviews), it is not always clear what constitutes a sufficient level of difficulty to promote memory (e.g., McDaniel & Butler,…”
BackgroundA Case Study of Using Test-Enhanced Learning as a Formative Assessment in High School Mathematics
Szeibert, J., Muzsnay, A., Szabó, C., & Zámbó, C. (2022) · International Journal of Science and Mathematics Education · doi:10.1007/s10763-022-10264-8 · Cited by 17
“The testing effect is the phenomenon that retrieving information from short- or longterm memory can—under many circumstances—strengthen one’s memory of the retrieved information (Donoghue & Hattie, 2021; Roediger & Butler, 2011; Rowland, 2014).”
BackgroundThe testing effect with free recall: Organization, attention, and order effects
Mulligan, N. W., Buchin, Z. L., & Zhang, A. L. (2022) · Journal of Memory and Language · doi:10.1016/j.jml.2022.104333 · Cited by 18
Dassing, R., Allé, M. C., Cerbai, M., Obrecht, A., Meyer, N., Vidailhet, P., Danion, J., Mengin, A. C., & Berna, F. S. (2020) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2020.00397 · Cited by 18
On The Dynamics of Lexical Access In Two or More Languages
Kroll, J. F., Bice, K., Botezatu, M. R., & Zirnstein, M. (2022) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780198845003.013.26 · Cited by 15
Expanded taxonomies of human memory
Finley, J. R. (2025) · Frontiers in Cognition · doi:10.3389/fcogn.2024.1505549 · Cited by 18
“We know that when an individual retrieves a long-term memory, whether episodic or semantic, that memory is strengthened (the retrieval practice effect, or testing effect; Roediger and Butler, 2011; Rowland, 2014).”
Asher, M. W., Hartman, J. D., Blaser, M., Eichler, J. F., & Carvalho, P. F. (2025) · Computers & Education · doi:10.1016/j.compedu.2025.105387 · Cited by 17
Science reading and self-regulated learning: Evidence from eye movements of middle-school readers
Wang, T.-N., Jian, Y., Wu, C., & Li, P. (2021) · The Journal of Educational Research · doi:10.1080/00220671.2021.2012637 · Cited by 13
“…and testing have mostly focused on learning outcomes, for example, the number of items students memorize (in memory research; e.g., for a review: Rowland, 2014) or how much students comprehend the texts (in reading research; e.g., Barnett & Seefeldt, 1989; Callender & McDaniel, 2009; Rawson &…”
BackgroundZhao, W., Xu, M., Xu, C., Li, B., Hu, X., Yang, C., & Luo, L. (2023) · Journal of Intelligence · doi:10.3390/jintelligence11100190 · Cited by 14
“It has been well‑established that retrieval‑enhanced learning is most effective after long delays (e.g., Rowland 2014; Roediger and Karpicke 2006b).”
BackgroundDoes value-based prioritization at working memory enhance long-term memory?
Atkinson, A. L., Waterman, A., & Allen, R. J. (2024) · Memory & Cognition · doi:10.3758/s13421-024-01532-9 · Cited by 23
“This is in line with previous research which has found that testing information enhances later memory (e.g., Kang et al., 2007; Nungester & Duchastel, 1982; Rowland, 2014).”
ResultWaldeyer, J., Endres, T., Roelle, J., Baars, M., & Renkl, A. (2024) · Educational Psychology Review · doi:10.1007/s10648-024-09944-4 · Cited by 16
“However, in view of the relatively high forgetting rates even after short delays (e.g., Karpicke, 2017; Rowland, 2014; see also Roelle et al., 2022, 2023), such high rates of correct retrieval from memory might not reflect learners’ actual level of the to-be-learned content.”
Effects of study intention and generating multiple choice questions on expository text retention
Hoogerheide, V., Staal, J., Schaap, L., & van Gog, T. (2018) · Learning and Instruction · doi:10.1016/j.learninstruc.2017.12.006 · Cited by 13
Rebel, A., Hester, D. L., DiLorenzo, A. N., McEvoy, M. D., & Schell, R. M. (2018) · Anesthesia & Analgesia · doi:10.1213/ane.0000000000003317 · Cited by 11
Chusni, M. M., Saputro, S., Suranto, S., & Rahardjo, S. B. (2020) · Journal of Physics Conference Series · doi:10.1088/1742-6596/1467/1/012015 · Cited by 17
Ein Plädoyer zur Qualitätssicherung schriftlicher Prüfungen im Psychologiestudium
Lindner, M. A., Sparfeldt, J. R., Köller, O., Lukas, J., & Leutner, D. (2021) · Psychologische Rundschau · doi:10.1026/0033-3042/a000524 · Cited by 11
Selective remembering and directed forgetting are influenced by similar stimulus properties
Murphy, D. H., & Castel, A. D. (2022) · Memory · doi:10.1080/09658211.2022.2092152 · Cited by 14
“Some prior work suggests that although remembering and forgetting may follow similar principles, certain variables can impact remembering and forgetting in different manners (cf. Cepeda et al., 2008; Rowland, 2014).”
BackgroundEndres, T., Kubik, V., Koslowski, K., Hahne, F., & Renkl, A. (2023) · Zeitschrift für Entwicklungspsychologie und Pädagogische Psychologie · doi:10.1026/0049-8637/a000280 · Cited by 15
Effects of imagery rescripting and imaginal exposure on voluntary memory
Ganslmeier, M. G., Ehring, T. W., & Wolkenstein, L. (2023) · Behaviour Research and Therapy · doi:10.1016/j.brat.2023.104409 · Cited by 17
“One possible explanation for this differential effects of ImE and ImRs on voluntary memory in this study may be an imbalance of the two interventions with respect to rehearsal and testing effects due to the repetition and re-encoding of the memory (Rowland, 2014).”
BackgroundKubik, V., Jönsson, F. U., Knopf, M., & Mack, W. (2018) · Frontiers in Psychology · doi:10.3389/fpsyg.2018.01632 · Cited by 15
“…direct testing effect, recall speed, enactment, action memory, distribution-based bifurcation model INTRODUCTION Retrieval practice has attained a great deal of attention as a highly effective study technique for long-term learning (Dunlosky et al., 2013; for a meta-analysis, Rowland, 2014).”
BackgroundResultInfluentialGjerde, V., Holst, B., & Kolstø, S. D. (2020) · Physical Review Physics Education Research · doi:10.1103/physrevphyseducres.16.013103 · Cited by 16
Imundo, M. N., Pan, S. C., Bjork, E. L., & Bjork, R. A. (2020) · Quarterly Journal of Experimental Psychology · doi:10.1177/1747021820968483 · Cited by 16
“, 2007), which computed that 104 participants were required to detect an average testing effect (g = 0.50; Rowland, 2014) as a main effect or interaction in a 2 × 2 analysis of variance (ANOVA) with 70% power (which was chosen due to limitations of the available participant pool and laboratory space; we acknowledge, h…”
MethodInfluential
Metadata
- Authors
- Rowland, C. A.
- Affiliations
- Colorado State University (US)
- Corresponding author
- Rowland, Christopher A.
- Venue
- Psychological Bulletin
- Published
- 2014
- Volume
- 140
- Issue
- 6
- Pages
- 1432-1463
- ISSN
- 0033-2909 (ISSN-L)
- 1939-1455
- OpenAlex
- W2050255700
- Cited by
- 1,066
- References
- 139
- Citations by year
- 2026: 71 · 2025: 103 · 2024: 139 · 2023: 113 · 2022: 138 · 2021: 122 · 2020: 105 · 2019: 91 · 2018: 73 · 2017: 52 · 2016: 36 · 2015: 19 · 2014: 3
- FWCI
- 20.46
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Psychological Bulletin (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Memory Processes and Influences
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Visual and Cognitive Learning Processes
- Life Sciences › Neuroscience › Cognitive Neuroscience › Memory and Neural Mechanisms
- Keywords
- testing effect, restudy, retention, effortful processing, recall tests, recognition test, semantic elaboration, memory retrieval, bifurcation model, memory consolidation
- MeSH terms
- Attention, Cues, Educational Measurement, Humans, Learning, Memory, Neuropsychological Tests, Practice, Psychological, Mental Recall, Retention, Psychology, Semantics, Students, Universities
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.