The effect of testing versus restudy on retention: A meta-analytic review of the testing effect.
The DOI matches its Crossref record; 138 of the 139 references it cites were found in a registry or an index.
Abstract
Meta-analysis uses meta-analysis to examine the effects of testing versus restudy on retention and indicates support for the role of effortful processing as a contributor to the testing effect.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Regarding retrieval practice, over a century of research has demonstrated that students who practice retrieving information have better and longer memory retention for that information compared to students who engage with the material more passively (e.g., restudying).”
From The benefits of successive relearning on multiple learning outcomes. (2022) · cites this paper as Rowland, 2014
In the citing paper
“whereas retrieval practice is the phenomenon that actively recalling information from memory enhances memory”
From Does Retrieval Practice Protect Memory Against Stress? A Meta-Analysis (2025) · cites this paper as Rowland, 2014
In the citing paper
“However, meta-analyses on the benefits of retrieval practice (e.g., Rowland, 2014) show consistently positive effects regardless of the different types of materials used.”
From Does Retrieval Practice Protect Memory Against Stress? A Meta-Analysis (2025) · cites this paper as Rowland, 2014
In the citing paper
“consistent with the robust testing effect (Agarwal et al., 2021; Rowland, 2014; Schwieren et al., 2017; Yang et al., 2021).”
From Does Retrieval Practice Protect Memory Against Stress? A Meta-Analysis (2025) · cites this paper as Rowland, 2014
In the citing paper
“Effect sizes range from moderate to large, with estimates between d = 0.55 and d = 0.88 (Phelps, 2012), g = 0.50 (Rowland, 2014), and g = 0.61 to g = 0.70 (Adesope et al., 2017).”
From Testing the testing effect on prolific: when retrieval practice fails to boost learning (2026) · cites this paper as Rowland, 2014
13 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Measuring inconsistency in meta-analyses
Higgins, J. P. T., Thompson, S. G., Deeks, J. J., & Altman, D. G. (2003) · BMJ · doi:10.1136/bmj.327.7414.557 · Cited by 63,139
The file drawer problem and tolerance for null results.
Rosenthal, R. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.3.638 · Cited by 9,068
Distribution Theory for Glass's Estimator of Effect Size and Related Estimators
Hedges, L. V. (1981) · Journal of Educational Statistics · doi:10.2307/1164588 · Cited by 5,695
Creating false memories: Remembering words not presented in lists.
Roediger, H. L., & McDermott, K. B. (1995) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/0278-7393.21.4.803 · Cited by 3,792
Fixed-and random-effects models in meta-analysis.
Hedges, L. V., & Vevea, J. L. (1998) · Psychological Methods · doi:10.1037/1082-989x.3.4.486 · Cited by 2,977
Test-Enhanced Learning: Taking Memory Tests Improves Long-Term Retention
Roediger, H. L., & Karpicke, J. D. (2006) · Psychological Science · doi:10.1111/j.1467-9280.2006.01693.x · Cited by 2,867
Levels of processing versus transfer appropriate processing
Morris, C. D., Bransford, J. D., & Franks, J. J. (1977) · Journal of Verbal Learning and Verbal Behavior · doi:10.1016/s0022-5371(77)80016-9 · Cited by 2,296
The power of testing memory: Basic research and implications for educational practice
Roediger, H. L., & Karpicke, J. D. (2006) · Perspectives on Psychological Science · doi:10.1111/j.1745-6916.2006.00012.x · Cited by 2,037
The critical role of retrieval practice in long-term retention
Roediger, H. L., & Butler, A. C. (2011) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2010.09.003 · Cited by 1,796
The Critical Importance of Retrieval for Learning
Karpicke, J. D., & Roediger, H. L. (2008) · Science · doi:10.1126/science.1152408 · Cited by 1,791
Cited by
Items 101–200 of 1,077
Devine, O., Harborne, A. C., & McManus, I. C. (2015) · BMC Medical Education · doi:10.1186/s12909-015-0428-9 · Cited by 52
Schoch, S. F., Cordi, M. J., & Rasch, B. (2017) · Neurobiology of Learning and Memory · doi:10.1016/j.nlm.2017.10.009 · Cited by 51
“15 This conclusion was also drawn by Creery, Oudiette, Antony, and Paller (2015) demonstrating limited cueing benefits for nearly perfectly remembered items.”
BackgroundPlak, S., van Klaveren, C., & Cornelisz, I. (2022) · British Journal of Educational Technology · doi:10.1111/bjet.13261 · Cited by 68
The double-edged sword of memory retrieval
Roediger, H. L., III, & Abel, M. (2022) · Nature Reviews Psychology · doi:10.1038/s44159-022-00115-2 · Cited by 64
“…practice tests produced the greatest retrieval practice effects ( g = 0.81), cued recall practice tests produced somewhat less of an effect ( g = 0.72), and recognition practice tests produced a smaller (but still highly reliable) effect ( g = 0.36) relative to restudy control conditions 20 .”
BackgroundInfluentialIs disfluency desirable for learning?
Weißgerber, S. C., & Reinhard, M. (2017) · Learning and Instruction · doi:10.1016/j.learninstruc.2017.02.004 · Cited by 62
Learning by exploring: How much guidance is optimal?
Newman, P. M., & DeCaro, M. S. (2019) · Learning and Instruction · doi:10.1016/j.learninstruc.2019.05.005 · Cited by 48
Subjective cognitive load surveys lead to divergent results for interactive learning media
Skulmowski, A., & Rey, G. D. (2020) · Human Behavior and Emerging Technologies · doi:10.1002/hbe2.184 · Cited by 47
“As reviewed by Rowland (2014), some studies have provided evidence for the existence of the testing effect in short-term learning situations (Rowland, 2014, cites Carpenter & DeLosh, 2006, as an example).”
BackgroundBlondé, P., Girardeau, J.-C., Sperduti, M., & Piolino, P. (2021) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2021.11.015 · Cited by 60
Retrieval Practice Benefits Deductive Inference
Eglington, L. G., & Kang, S. H. K. (2016) · Educational Psychology Review · doi:10.1007/s10648-016-9386-y · Cited by 60
“2007) and effect size information frommeta-analyses of the retrieval practice literature (Rowland 2014).”
BackgroundMethodInfluentialIs testing a more effective learning strategy than note-taking?
Rummer, R., Schweppe, J., Gerst, K., & Wagner, S. (2017) · Journal of Experimental Psychology: Applied · doi:10.1037/xap0000134 · Cited by 45
Reflections on the Resurgence of Interest in the Testing Effect
Roediger, H. L., III, & Karpicke, J. D. (2018) · Perspectives on Psychological Science · doi:10.1177/1745691617718873 · Cited by 49
“Rowland (2014) provided a meta-analytic review of the testing-effect literature (see somewhat different meta-analyses by Adesope, Trevisan, & Sundararajan, 2017; Schwieren, Barenberg, & Dutke, 2017).”
MethodSelf-reported use of retrieval practice varies across age and domain
Tullis, J. G., & Maddox, G. B. (2020) · Metacognition and Learning · doi:10.1007/s11409-020-09223-x · Cited by 52
“Benefits of testing over re-study have been found in classroom settings (Leeming 2002; McDaniel et al. 2011; Rowland 2014).”
BackgroundEnders, N., Gaschler, R., & Kubik, V. (2020) · Psychology Learning & Teaching · doi:10.1177/1475725720971205 · Cited by 69
“Based on laboratory studies (Rowland, 2014) and in the context of learning and teaching psychology (Schwieren et al.”
BackgroundMethodInfluentialLingering Cognitive States Shape Fundamental Mnemonic Abilities
Patil, A., & Duncan, K. D. (2017) · Psychological Science · doi:10.1177/0956797617728592 · Cited by 45
“…proved to be extremely powerful, with effect sizes of 0.72 to 0.94—roughly twice the size of the meta-analytical estimates of classic memory-enhancement techniques, such as the testing and generation effects (see meta-analyses in Bertsch, Pesta, Wiscott, & McDaniel, 2007; Rowland, 2014).”
BackgroundInfluentialEbersbach, M., Feierabend, M., & Nazari, K. B. B. (2020) · Applied Cognitive Psychology · doi:10.1002/acp.3639 · Cited by 45
Translation of basic research in cognitive science to HIV-risk: a randomized controlled trial
Stacy, A. W., Nydegger, L. A., & Shono, Y. (2018) · Journal of Behavioral Medicine · doi:10.1007/s10865-018-9999-3 · Cited by 44
“A recent meta-analysis demonstrated robust, strong effects of retrieval practice across one hundred and fifty-nine effect sizes reported since 1975 (Rowland, 2014), and the most recent studies continue to document the increasingly recognized importance and generality of the effect (Abel & Roediger,…”
BackgroundResultSoicher, R. N., Becker‐Blease, K. A., & Bostwick, K. C. P. (2020) · Cognitive Research Principles and Implications · doi:10.1186/s41235-020-00255-0 · Cited by 68
“Within the realm of cognitive science, the Science of Learning encompasses both basic cognitive science and efficacy research, with an emphasis on the application of cognitive theory to educational settings (Daniel and Chew 2013; Rowland 2014; Science of Learning, National Science Foundation n.d.).”
BackgroundDifferentiation of subsequent memory effects between retrieval practice and elaborative study
Liu, Y., Rosburg, T., Gao, C., Weber, C. E., & Guo, C. (2017) · Biological Psychology · doi:10.1016/j.biopsycho.2017.05.010 · Cited by 45
“Our hypotheses were as follows: For Experiment 1, retrieval practice would outperform elaborative study and re-studying in the delayed test, even when restricting retrieval practice to a single test (Roediger & Butler, 2011; Rowland, 2014).”
Pre-service and In-service Teachers’ Metacognitive Knowledge of Learning Strategies
Halamish, V. (2018) · Frontiers in Psychology · doi:10.3389/fpsyg.2018.02152 · Cited by 55
“Testing as a Means of Learning Tests are usually used to assess learning, but research suggests that tests can also be used to enhance learning (Rowland, 2014; Adesope et al., 2017; Pan and Rickard, 2018).”
MethodPhase separation of competing memories along the human hippocampal theta rhythm
Kerrén, C., van Bree, S., Griffiths, B., & Wimber, M. (2022) · eLife · doi:10.7554/elife.80633 · Cited by 43
“Though not tested behaviourally in this study, repeated recall is known to induce enhancement of the retrieved memories ( Karpicke and Roediger, 2008 ; Rowland, 2014 ) and forgetting of non-retrieved, competing memories ( Anderson et al., 1994 ).”
BackgroundThe Status of the Testing Effect for Complex Materials: Still a Winner
Rawson, K. A. (2015) · Educational Psychology Review · doi:10.1007/s10648-015-9308-4 · Cited by 51
“Several hundred experiments from more than 100 years of research have established that taking a test does more than just assess learning—it actually enhances learning (for recent reviews, see Dunlosky et al. 2013; Roediger et al. 2011; Rowland 2015).”
BackgroundThe forward testing effect on self-regulated study time allocation and metamemory monitoring.
Yang, C., Potts, R., & Shanks, D. R. (2017) · Journal of Experimental Psychology: Applied · doi:10.1037/xap0000122 · Cited by 42
“The theoretical analysis of List 5 recall includes two potential factors: first, a forward effect of prior testing; second, because the level of recall on the List 5 interim test was higher in the interim test group, a greater backward testing effect for the List 5 interim test may have occurred (Rowland, 2014).”
BackgroundGordon, K. R. (2019) · Journal of Speech Language and Hearing Research · doi:10.1044/2018_jslhr-l-astm-18-0240 · Cited by 45
“Identifying the most effective and efficient way to teach can be complex as characteristics of the individual (McGregor, Gordon, Eden, Arbisi-Kelm, & Oleson, 2017; Storkel, Komesidou, Fleming, & Romine, 2017), the material to be learned (Storkel, 2018), and the training strategy (Nunes & Karpicke, 2015; Rowland, 2014)…”
BackgroundKuklick, L., & Lindner, M. A. (2021) · Contemporary Educational Psychology · doi:10.1016/j.cedpsych.2021.102001 · Cited by 42
Theobald, M., Bellhäuser, H., & Imhof, M. (2018) · Learning and Individual Differences · doi:10.1016/j.lindif.2018.05.019 · Cited by 48
Retrieval Practice: Beneficial for All Students or Moderated by Individual Differences?
Bertilsson, F., Stenlund, T., Wiklund‐Hörnqvist, C., & Jonsson, B. (2020) · Psychology Learning & Teaching · doi:10.1177/1475725720973494 · Cited by 56
“This retrievalbased benefit on long-term learning is commonly denoted as the testing effect (for reviews, see Dunlosky et al., 2013; Roediger & Karpicke, 2006a, 2006b; Rowland, 2014).”
BackgroundA systematic – Review of academic stress intended to improve the educational journey of learners
Iqra (2024) · Methods in Psychology · doi:10.1016/j.metip.2024.100163 · Cited by 101
Attention and the testing effect.
Mulligan, N. W., & Picklesimer, M. (2016) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/xlm0000227 · Cited by 39
How Effective is Example Generation for Learning Declarative Concepts?
Rawson, K. A., & Dunlosky, J. T. (2016) · Educational Psychology Review · doi:10.1007/s10648-016-9377-z · Cited by 49
Testing prepares students to learn better: The forward effect of testing in category learning.
Lee, H. S., & Ahn, D. (2018) · Journal of Educational Psychology · doi:10.1037/edu0000211 · Cited by 40
“Although cued-recall tests are generally known to be more effective learning events than other forms of testing (e.g., Bjork & Whitten, 1974; Carpenter, Pashler, & Vul, 2006; Glover, 1989; Rowland, 2014), different types of testing could also be effective (or even more effective) than cued-recall tests.”
Renkl, A. (2022) · Zeitschrift für Pädagogische Psychologie · doi:10.1024/1010-0652/a000345 · Cited by 54
How Personalization Affects Motivation in Gamified Review Assessments
Rodrigues, L., Palomino, P. T., Toda, A. M., Klock, A. C. T., Pessoa, M., Pereira, F. D., Oliveira, E., Oliveira, D. F., Cristea, A. I., Gasparini, I., et al. (2023) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-022-00326-x · Cited by 51
“Empirical evidence supports that theory, showing completing tests positively affects learning outcomes in general (Batsell Jr et al., 2017; Rowland, 2014) and in gamified (Rodrigues et al., 2021; Sanchez et al., 2020) settings.”
Goossens, N. A. M. C., Camp, G., Verkoeijen, P. P. J. L., Tabbers, H. K., Bouwmeester, S., & Zwaan, R. A. (2016) · Applied Cognitive Psychology · doi:10.1002/acp.3245 · Cited by 40
Tests and academic cheating: do learning tasks influence cheating by way of negative evaluations?
Wenzel, K., & Reinhard, M. (2020) · Social Psychology of Education · doi:10.1007/s11218-020-09556-0 · Cited by 57
“2017; Dobson and Linderholm 2015; Rowland 2014).”
BackgroundInfluentialLeonard, L. B., & Deevy, P. (2020) · Journal of Speech Language and Hearing Research · doi:10.1044/2020_jslhr-20-00006 · Cited by 52
“As shown by a meta-analysis of 159 studies by Rowland (2014), this finding holds across a wide range of experimental manipulations.”
Testing enhances learning: A review of the literature
Binks, S. (2018) · Journal of Professional Nursing · doi:10.1016/j.profnurs.2017.08.008 · Cited by 38
Maddox, G. B., & Balota, D. A. (2015) · Memory & Cognition · doi:10.3758/s13421-014-0499-6 · Cited by 37
Palmer, S., Chu, Y., & Persky, A. M. (2019) · American Journal of Pharmaceutical Education · doi:10.5688/ajpe7217 · Cited by 48
“These results have been consistently documented in the literature.(12) In most studies on the testing effect, the timeon-task factor is held relatively constant, suggesting that, if given equal time, retrieving information from memory (or taking a test) improves memory consolidation more than rereading does.”
ResultDoes covert retrieval benefit learning of key-term definitions?
Tauber, S. K., Witherby, A. E., Dunlosky, J., Rawson, K. A., Putnam, A. L., & Roediger, H. L. (2018) · Journal of Applied Research in Memory and Cognition · doi:10.1016/j.jarmac.2016.10.004 · Cited by 37
Retrieval-Induced Remembering and Forgetting
Bäuml, K. T., & Kliegl, O. (2017) · Elsevier eBooks · doi:10.1016/b978-0-12-809324-5.21048-1 · Cited by 44
Carpenter, S. K., Rahman, S., Lund, T. J. S., Armstrong, P. I., Lamm, M. H., Reason, R. D., & Coffman, C. R. (2017) · CBE—Life Sciences Education · doi:10.1187/cbe.16-06-0205 · Cited by 41
“…practice questions over to-be-learned information produces significant gains on long-term retention of that information, over and above rereading the information (for recent reviews, see Roediger and Butler, 2011; Carpenter, 2012; Dunlosky et al., 2013; Rowland, 2014; Brame and Biel, 2015).”
BackgroundResultInfluentialWhat learning strategies do academic support centers recommend to undergraduates?
McCabe, J. A. (2018) · Journal of Applied Research in Memory and Cognition · doi:10.1016/j.jarmac.2017.10.002 · Cited by 44
Leonard, L. B., Deevy, P., Karpicke, J. D., Christ, S. L., Weber, C., Kueser, J. B., & Haebig, E. (2019) · Journal of Speech Language and Hearing Research · doi:10.1044/2019_jslhr-l-19-0221 · Cited by 47
“Collectively, this work has demonstrated how learners’ long-term retention of material is bolstered by inserting instances of self-testing during the period of study (see reviews in Karpicke, 2017; Rowland, 2014).”
BackgroundGordon, K. R. (2020) · Language Speech and Hearing Services in Schools · doi:10.1044/2020_lshss-19i-00001 · Cited by 46
Spacing Effects on Learning and Memory ☆
Carpenter, S. K. (2017) · Elsevier eBooks · doi:10.1016/b978-0-12-809324-5.21054-7 · Cited by 58
Investigating and explaining the effects of successive relearning on long-term retention.
Rawson, K. A., Vaughn, K. E., Walsh, M., & Dunlosky, J. (2018) · Journal of Experimental Psychology: Applied · doi:10.1037/xap0000146 · Cited by 36
“…memory for that information, and memory is enhanced to a greater extent when practice trials for a given item are separated by longer versus shorter intervals (for recent reviews, see Cepeda, Pashler, Vul, Wixted, & Rohrer, 2006; Dunlosky, Rawson, Marsh, Nathan, & Willingham, 2013; Rowland, 2014).”
BackgroundSleep reduces the testing effect—But not after corrective feedback and prolonged retention interval.
Abel, M., Haller, V., Köck, H., Pötschke, S., Heib, D., Schabus, M., & Bäuml, K.-H. T. (2019) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/xlm0000576 · Cited by 33
“…have made the retrieval task less difficult and thus may have reduced the size of the testing effects observed in this study, because testing effects have been shown to be larger when retrieval practice is more difficult (e.g., Carpenter & DeLosh, 2006; Kang et al., 2007; see also Rowland, 2014).”
MethodResultThe forward effects of testing transfer to different domains of learning.
Yang, C., Chew, S.-J., Sun, B., & Shanks, D. R. (2019) · Journal of Educational Psychology · doi:10.1037/edu0000320 · Cited by 35
Prequestions do not enhance the benefits of retrieval in a STEM classroom
Geller, J., Carpenter, S. K., Lamm, M. H., Rahman, S., Armstrong, P. I., & Coffman, C. R. (2017) · Cognitive Research: Principles and Implications · doi:10.1186/s41235-017-0078-z · Cited by 35
“…(e.g., Carpenter, 2012; Dunlosky et al., 2013; Karpicke, in press; Kornell & Vaughn, 2016; McDermott et al., 2014; Roediger, Agarwal, et al., 2011; Rowland, 2014), and to a smaller but ever-increasing literature demonstrating these effects in classrooms (Butler et al., 2014; Carpenter, Pashler, &…”
BackgroundResultInfluentialSystematic review of distributed practice and retrieval practice in health professions education
Trumble, E., Lodge, J. M., Mandrusiak, A., & Forbes, R. (2023) · Advances in Health Sciences Education · doi:10.1007/s10459-023-10274-3 · Cited by 76
“Retrieval practice that increases cognitive demand, correlates with improves assessment scores (Adesope et al., 2017; Rowland, 2014) and retrieval practice questions that are identical to assessment questions are reported to be more effective than non-identical retrieval practice questions (Veltre…”
BackgroundExample-based learning: The benefits of prompting organization before providing examples
Roelle, J., Hiller, S., Berthold, K., & Rumann, S. (2016) · Learning and Instruction · doi:10.1016/j.learninstruc.2016.11.012 · Cited by 41
Can generative learning tasks be optimized by incorporation of retrieval practice?
Waldeyer, J., Heitmann, S., Moning, J., & Roelle, J. (2020) · Journal of Applied Research in Memory and Cognition · doi:10.1016/j.jarmac.2020.05.001 · Cited by 46
Leonard, L. B., Deevy, P., Karpicke, J. D., Christ, S. L., & Kueser, J. B. (2020) · Journal of Speech Language and Hearing Research · doi:10.1044/2020_jslhr-20-00105 · Cited by 43
“(average biphone frequency), and neighborhood density based on the Storkel and Hoover (2010) database.”
BackgroundMethodExample-based learning: should learners receive closed-book or open-book self-explanation prompts?
Hiller, S., Rumann, S., Berthold, K., & Roelle, J. (2020) · Instructional Science · doi:10.1007/s11251-020-09523-4 · Cited by 38
“2017; Roediger and Butler 2011; Rowland 2014).”
BackgroundInfluentialPan, S. C., Rickard, T. C., & Bjork, R. A. (2021) · Educational Psychology Review · doi:10.1007/s10648-021-09611-y · Cited by 67
“…Cooke, et al., 2019) and across a wide range of materials (i.e., the testing effect; for reviews, see Pan & Rickard, 2018; Roediger & Karpicke, 2006b; Rowland, 2014), including spelling (e.g., Beseler, 1953; Christine & Hollingsworth, 1966; Cook, 1957; Cohen, 1969; Jones et al., 2016; Louis, 1950;…”
BackgroundRoelle, J., Endres, T., Abel, R., Obergassel, N., Nückles, M., & Renkl, A. (2023) · Educational Psychology Review · doi:10.1007/s10648-023-09810-9 · Cited by 33
“not necessarily on posttests given immediately after the learning phase (for metaanalyses, see Adesope et al., 2017; Rowland, 2014; Yang et al., 2021).”
Hui, L., de Bruin, A. B. H., Donkers, J., & van Merriënboer, J. J. G. (2022) · Applied Cognitive Psychology · doi:10.1002/acp.3933 · Cited by 33
Strategies to Improve Learning and Retention During Training
Roediger, H. L., III, Nestojko, J. F., & Smith, N. S. (2019) · Oxford University Press eBooks · doi:10.1093/oso/9780190455132.003.0014 · Cited by 37
Undesirable Difficulty Effects in the Learning of High-Element Interactivity Materials
Chen, O., Castro-Alonso, J. C., PAAS, F. G. W. C., & Sweller, J. (2018) · Frontiers in Psychology · doi:10.3389/fpsyg.2018.01483 · Cited by 48
“The nature of the learning materials (e.g., the type of stimuli) may constitute a moderator (Rowland, 2014; Adesope et al., 2017; Pan and Rickard, 2018).”
BackgroundMethodInfluentialClos, M., Bunzeck, N., & Sommer, T. (2019) · The Journal of Neuroscience · doi:10.1523/jneurosci.0495-19.2019 · Cited by 32
“This improvement of memory performance by retrieval practice is known as the “testing effect” and has been observed also in the absence of accuracy feedback (Roediger and Butler, 2011; Rowland, 2014).”
BackgroundMethodInfluentialCogliano, M., Bernacki, M. L., & Kardash, C. M. (2020) · Journal of Educational Psychology · doi:10.1037/edu0000624 · Cited by 51
Does Individual Performance Feedback Increase the Use of Retrieval Practice?
Hui, L., de Bruin, A. B. H., Donkers, J., & van Merriënboer, J. J. G. (2021) · Educational Psychology Review · doi:10.1007/s10648-021-09604-x · Cited by 30
“Such enhanced effort, as mentioned above, might also prevent students from actually using the strategy (Karpicke & Roediger III, 2007; Kirk-Johnson et al., 2019; Rowland, 2014).”
MethodOn the placement of practice questions during study.
Weinstein, Y., Nunes, L., & Karpicke, J. D. (2016) · Journal of Experimental Psychology Applied · doi:10.1037/xap0000071 · Cited by 36
Do spacing and self-testing predict learning outcomes?
Rodriguez, F., Kataoka, S., Rivas, M. J., Kadandale, P., Nili, A. N., & Warschauer, M. (2018) · Active Learning in Higher Education · doi:10.1177/1469787418774185 · Cited by 35
“A number of experiments have shown the different ways that self-testing is more beneficial for learning than other strategies (for a review, see Rowland, 2014).”
BackgroundDo students really prefer repeated rereading over testing when studying textbooks? A reexamination
Kuhbandner, C., & Emmerdinger, K. J. (2019) · Memory · doi:10.1080/09658211.2019.1610177 · Cited by 41
“…conmmonly known as the “testing effect” (e.g., Carrier & Pashler, 1992; McDaniel, Anderson, Derbish, & Morrisette, 2007; McDermott, Agarwal, D’Antonio, Roediger, & McDaniel, 2014; Roediger & Karpicke, 2006; for a review, see Roediger & Butler, 2011; for metaanalytic evidence, see Rowland, 2014).”
Biwer, F., de Bruin, A. B. H., Schreurs, S., & Egbrink, M. G. A. O. (2020) · Journal of Applied Research in Memory and Cognition · doi:10.1016/j.jarmac.2020.07.006 · Cited by 44
Jacob, L., Lachner, A., & Scheiter, K. (2022) · Computers & Education · doi:10.1016/j.compedu.2022.104469 · Cited by 35
Carpenter, S. K., Mickes, L., Rahman, S., & Fernandez, C. (2016) · Journal of Experimental Psychology Applied · doi:10.1037/xap0000077 · Cited by 40
“This technique is useful in general for helping students learn (e.g., Butler, Marsh, Slavinsky, & Baraniuk, 2014; Carpenter, 2012; Dunlosky, Rawson, Marsh, Nathan, & Willingham, 2013; Rowland, 2014; Roediger & Butler, 2011), and it may introduce the added benefit of dispelling illusions of knowing that could arise whe…”
MethodLu, O. H. T., Huang, A. Y. Q., Tsai, D. C. L., & Yang, S. J. H. (2021) · DOAJ (DOAJ: Directory of Open Access Journals) · Cited by 30
Testing with feedback yields potent, but piecewise, learning of history and biology facts.
Pan, S. C., Gopal, A., & Rickard, T. C. (2015) · Journal of Educational Psychology · doi:10.1037/edu0000074 · Cited by 38
“This recommendation is backed by extensive work over decades and across numerous content domains (e.g., Bjork, 1975; Carrier & Pashler, 1992; Gates, 1917; Glover, 1989; for reviews, see Roediger & Karpicke, 2006, and Rowland, 2014).”
BackgroundWeissgerber, S. C., Reinhard, M.-A., & Schindler, S. (2018) · Educational Psychology · doi:10.1080/01443410.2017.1387644 · Cited by 30
“These desirably difficult conditions are empirically derived from studies on instruction and training; and extensive experimental research in the laboratory confirmed the effectiveness of these empirically well-established desirable difficulties as well as outlined some boundary conditions thereof (e.g. Bertsch, Pesta…”
BackgroundToppino, T. C., Lavan, M. H., & Iaconelli, R. (2018) · Memory & Cognition · doi:10.3758/s13421-018-0828-2 · Cited by 39
“, by taking a practice test) serves as a potent learning event that facilitates subsequent retention more than simply restudying the information (Karpicke & Roediger, 2008; Roediger & Butler, 2011; Rowland, 2014).”
BackgroundInfluentialMcManus, I. C., Woolf, K., Harrison, D., Tiffin, P. A., Paton, L. W., Cheung, K. Y. F., & Smith, D. T. (2021) · BMJ Open · doi:10.1136/bmjopen-2020-047354 · Cited by 31
Naujoks-Schober, N., Harder, B., & Händel, M. (2022) · Metacognition and Learning · doi:10.1007/s11409-022-09295-x · Cited by 41
“…studies is on the role of feedback, which is discussed as a relevant design element of participation in practice tests in real classroom settings (Greving & Richter, 2018; Hattie & Timperley, 2007) and a major moderator of the testing effect on performance (Rowland, 2014; Schwieren et al., 2017).”
BackgroundResultInfluentialHow to Promote Lasting Learning in Schools: Theoretical Approaches and an Agenda for Research
Richter, T., Berger, R., Ebersbach, M., Eitel, A., Endres, T., Ferri, R. B., Hänze, M., Lachner, A., Leutner, D., Lipowsky, F., et al. (2022) · Zeitschrift für Entwicklungspsychologie und Pädagogische Psychologie · doi:10.1026/0049-8637/a000258 · Cited by 44
Four semesters investigating frequency of testing, the testing effect, and transfer of training.
Foss, D. J., & Pirozzolo, J. W. (2017) · Journal of Educational Psychology · doi:10.1037/edu0000197 · Cited by 30
“While its prominence has sometimes waned, as evidenced by the title of Glover’s (1989) paper: “The ‘Testing’ Phenomenon: Not Gone But Nearly Forgotten,” the evidence for it is substantial and has continued to grow (e.g., Dunlosky, Rawson, Marsh, Nathan, & Willingham, 2013; Kang, McDaniel, & Pashler, 2011; Rawson & Dun…”
BackgroundThe Use of Concrete Examples Enhances the Learning of Abstract Concepts: A Replication Study
Micallef, A., & Newton, P. M. (2022) · Teaching of Psychology · doi:10.1177/00986283211058069 · Cited by 51
“A number of evidence-based strategies have been developed, including some, such as retrieval practice, whose effectiveness has been demonstrated in naturalistic teaching settings (Rowland, 2014).”
BackgroundHuang, X., Bernacki, M. L., Kim, D., & Hong, W. (2022) · Learning and Instruction · doi:10.1016/j.learninstruc.2021.101577 · Cited by 38
Combining Retrieval Practice with Elaborative Encoding: Complementary or Redundant?
McDaniel, M. (2023) · Educational Psychology Review · doi:10.1007/s10648-023-09784-8 · Cited by 28
“The findings from laboratory and classroom studies demonstrate that retrieval practice supports robust learning and retention, as indicated by several recent reviews and metanalyses (Adesope et al., 2017; Agarwal et al., 2021; Pan & Rickard, 2018; Rowland, 2014; Trumbo et al., 2021).”
BackgroundResultMayrhofer, R., Büchner, I. C., & Hevesi, J. (2024) · Frontiers in Psychology · doi:10.3389/fpsyg.2024.1390233 · Cited by 34
“…as a research program because, built on a fundamental assumption, namely the effect of retrieval, further theories are grouped together (e.g., Rowland, 2014; Schwieren et al., 2017) which—and this is the crucial point—would immediately lose their validity if the effect of retrieval as a…”
BackgroundGamification of Adult Learning: Gamifying Employee Training and Development
Landers, R. N., Auer, E. M., Helms, A. B., Marin, S., & Armstrong, M. B. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108649636.012 · Cited by 51
Elaborative strategies contribute to the long-term benefits of time in working memory
Loaiza, V. M., & Lavilla, E. T. (2020) · Journal of Memory and Language · doi:10.1016/j.jml.2020.104205 · Cited by 31
Roelle, J., Schweppe, J., Endres, T., Lachner, A., von Aufschnaiter, C., Renkl, A., Eitel, A., Leutner, D., Rummer, R., Scheiter, K., et al. (2022) · Zeitschrift für Entwicklungspsychologie und Pädagogische Psychologie · doi:10.1026/0049-8637/a000261 · Cited by 48
Abel, M., & Roediger, H. L., III (2016) · Memory & Cognition · doi:10.3758/s13421-016-0641-8 · Cited by 35
“Although in one of these studies Rowland et al. (2014) reported that the magnitude of the testing effect was not affected by whether pure or mixed lists of retrieval-”
BackgroundResultInfluentialRetrieval practice and spacing effects in multi-session treatment of naming impairment in aphasia
Middleton, E. L., Rawson, K. A., & Verkuilen, J. (2019) · Cortex · doi:10.1016/j.cortex.2019.07.003 · Cited by 29
“…& Karpicke, 2006), procedural learning (Kromann, Jensen, & Ringsted, 2009), and language acquisition (e.g., Barcroft, 2007; Vaughn & Rawson, 2011; for recent reviews see Kornell & Vaughn, 2016; Rawson & Dunlosky, 2011; Roediger & Butler, 2011; Roediger, Putnam & Smith, 2011; Rowland, 2014).”
Comparing the merits of word writing and retrieval practice for L2 vocabulary learning
Candry, S., Decloedt, J., & Eyckmans, J. (2020) · System · doi:10.1016/j.system.2020.102206 · Cited by 33
Retrieval Demands Adaptively Change Striatal Old/New Signals and Boost Subsequent Long-Term Memory
Herweg, N. A., Sommer, T., & Bunzeck, N. (2017) · Journal of Neuroscience · doi:10.1523/jneurosci.1315-17.2017 · Cited by 27
“Such a “testing effect” might relate to the inherent difficulty of retrieval tasks (Bjork, 1999; Rowland, 2014) and depend on the hippocampal-VTA loop (Roediger and Butler, 2011).”
BackgroundResultInfluentialWulandari, I. G. A. P. A., Sa’dijah, C., As’ari, A. R., & Rahardjo, S. (2018) · Journal of Physics Conference Series · doi:10.1088/1742-6596/1028/1/012153 · Cited by 48
MULTIDIMENSIONAL ENGAGEMENT IN LEARNING—AN INTEGRATED INSTRUCTIONAL DESIGN APPROACH
Astleitner, H. (2018) · Journal of Instructional Research · doi:10.9743/jir.2018.1 · Cited by 42
The testing effect under divided attention.
Buchin, Z. L., & Mulligan, N. W. (2017) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/xlm0000427 · Cited by 27
Rawson, K. A., & Zamary, A. (2019) · Journal of Memory and Language · doi:10.1016/j.jml.2019.01.002 · Cited by 32
Training non‐intensivist doctors to work with COVID‐19 patients in intensive care units
Engberg, M., Bonde, J., Sigurðsson, S. Þ., Møller, K., Nayahangan, L. J., Berntsen, M., Eschen, C. T., Haase, N., Bache, S., Konge, L., et al. (2021) · Acta Anaesthesiologica Scandinavica · doi:10.1111/aas.13789 · Cited by 28
Heitmann, S., Grund, A., Fries, S., Berthold, K., & Roelle, J. (2021) · Learning and Instruction · doi:10.1016/j.learninstruc.2021.101526 · Cited by 32
Studying on borrowed time: How does testing impair new learning?
Davis, S. D., & Chan, J. C. K. (2015) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037/xlm0000126 · Cited by 32
Dutke, S., & Barenberg, J. (2015) · Psychology Learning & Teaching · doi:10.1177/1475725715605627 · Cited by 31
“All participants were tested with the same set of 15 CTF items. No difference was found in the number of correct answers, but participants knowing the test format before learning discriminated better between correctly and incorrectly answered items on the basis of their confidence ratings (i.e., DIS). Thus, knowing th…”
BackgroundUsing Evidence-Based Learning Strategies to Improve Medical Education
Madan, C. R. (2023) · Medical Science Educator · doi:10.1007/s40670-023-01798-9 · Cited by 34
Testing Is More Desirable When It Is Adaptive and Still Desirable When Compared to Note-Taking
Heitmann, S., Grund, A., Berthold, K., Fries, S., & Roelle, J. (2018) · Frontiers in Psychology · doi:10.3389/fpsyg.2018.02596 · Cited by 23
“Similar to general testing, several studies show that specific testing entails beneficial effects (Adesope et al., 2017; Rowland, 2014).”
InfluentialPromoting individual and group regulation through social connection: strategies for remote learning
MacMahon, S. J., Leggett, J., & Carroll, A. (2020) · Information and Learning Sciences · doi:10.1108/ils-04-2020-0101 · Cited by 33
Rodrigues, L., Pereira, F. D., Toda, A. M., Palomino, P. T., Oliveira, W., Pessoa, M., de Carvalho, L. S. G., de Oliveira, D. B. F., Oliveira, E., Cristea, A. I., et al. (2022) · ACM Transactions on Computing Education · doi:10.1145/3485732 · Cited by 33
“Furthermore, in a meta-analysis comparing restudy (i.e., reading again) to testing, Rowland [84] found the testing effect on recalling tasks (e.g., short answers) is much larger.”
BackgroundResultMetacognitive judgments can potentiate new learning: The role of covert retrieval
Kubik, V., Koslowski, K., Schubert, T., & Aslan, A. (2022) · Metacognition and Learning · doi:10.1007/s11409-022-09307-w · Cited by 27
“…to a wide variety of materials (e.g., visuospatial information, Carpenter & Pashler, 2007; performed actions, Kubik et al., 2018; for an overview, see Karpicke & Aue, 2015; Rowland, 2014) and settings (e.g., in the lab and classroom environments, Adesope et al., 2017; Yang et al., 2021).”
BackgroundMethodInfluential
Metadata
- Authors
- Rowland, C. A.
- Affiliations
- Colorado State University (US)
- Corresponding author
- Rowland, Christopher A.
- Venue
- Psychological Bulletin
- Published
- 2014
- Volume
- 140
- Issue
- 6
- Pages
- 1432-1463
- ISSN
- 0033-2909 (ISSN-L)
- 1939-1455
- OpenAlex
- W2050255700
- Cited by
- 1,066
- References
- 139
- Citations by year
- 2026: 71 · 2025: 103 · 2024: 139 · 2023: 113 · 2022: 138 · 2021: 122 · 2020: 105 · 2019: 91 · 2018: 73 · 2017: 52 · 2016: 36 · 2015: 19 · 2014: 3
- FWCI
- 20.46
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Psychological Bulletin (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Memory Processes and Influences
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Visual and Cognitive Learning Processes
- Life Sciences › Neuroscience › Cognitive Neuroscience › Memory and Neural Mechanisms
- Keywords
- testing effect, restudy, retention, effortful processing, recall tests, recognition test, semantic elaboration, memory retrieval, bifurcation model, memory consolidation
- MeSH terms
- Attention, Cues, Educational Measurement, Humans, Learning, Memory, Neuropsychological Tests, Practice, Psychological, Mental Recall, Retention, Psychology, Semantics, Students, Universities
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.