The effect of testing versus restudy on retention: A meta-analytic review of the testing effect.
The DOI matches its Crossref record; 138 of the 139 references it cites were found in a registry or an index.
Abstract
Meta-analysis uses meta-analysis to examine the effects of testing versus restudy on retention and indicates support for the role of effortful processing as a contributor to the testing effect.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Regarding retrieval practice, over a century of research has demonstrated that students who practice retrieving information have better and longer memory retention for that information compared to students who engage with the material more passively (e.g., restudying).”
From The benefits of successive relearning on multiple learning outcomes. (2022) · cites this paper as Rowland, 2014
In the citing paper
“whereas retrieval practice is the phenomenon that actively recalling information from memory enhances memory”
From Does Retrieval Practice Protect Memory Against Stress? A Meta-Analysis (2025) · cites this paper as Rowland, 2014
In the citing paper
“However, meta-analyses on the benefits of retrieval practice (e.g., Rowland, 2014) show consistently positive effects regardless of the different types of materials used.”
From Does Retrieval Practice Protect Memory Against Stress? A Meta-Analysis (2025) · cites this paper as Rowland, 2014
In the citing paper
“consistent with the robust testing effect (Agarwal et al., 2021; Rowland, 2014; Schwieren et al., 2017; Yang et al., 2021).”
From Does Retrieval Practice Protect Memory Against Stress? A Meta-Analysis (2025) · cites this paper as Rowland, 2014
In the citing paper
“Effect sizes range from moderate to large, with estimates between d = 0.55 and d = 0.88 (Phelps, 2012), g = 0.50 (Rowland, 2014), and g = 0.61 to g = 0.70 (Adesope et al., 2017).”
From Testing the testing effect on prolific: when retrieval practice fails to boost learning (2026) · cites this paper as Rowland, 2014
13 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Measuring inconsistency in meta-analyses
Higgins, J. P. T., Thompson, S. G., Deeks, J. J., & Altman, D. G. (2003) · BMJ · doi:10.1136/bmj.327.7414.557 · Cited by 63,139
The file drawer problem and tolerance for null results.
Rosenthal, R. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.3.638 · Cited by 9,068
Distribution Theory for Glass's Estimator of Effect Size and Related Estimators
Hedges, L. V. (1981) · Journal of Educational Statistics · doi:10.2307/1164588 · Cited by 5,695
Creating false memories: Remembering words not presented in lists.
Roediger, H. L., & McDermott, K. B. (1995) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/0278-7393.21.4.803 · Cited by 3,792
Fixed-and random-effects models in meta-analysis.
Hedges, L. V., & Vevea, J. L. (1998) · Psychological Methods · doi:10.1037/1082-989x.3.4.486 · Cited by 2,977
Test-Enhanced Learning: Taking Memory Tests Improves Long-Term Retention
Roediger, H. L., & Karpicke, J. D. (2006) · Psychological Science · doi:10.1111/j.1467-9280.2006.01693.x · Cited by 2,867
Levels of processing versus transfer appropriate processing
Morris, C. D., Bransford, J. D., & Franks, J. J. (1977) · Journal of Verbal Learning and Verbal Behavior · doi:10.1016/s0022-5371(77)80016-9 · Cited by 2,296
The power of testing memory: Basic research and implications for educational practice
Roediger, H. L., & Karpicke, J. D. (2006) · Perspectives on Psychological Science · doi:10.1111/j.1745-6916.2006.00012.x · Cited by 2,037
The critical role of retrieval practice in long-term retention
Roediger, H. L., & Butler, A. C. (2011) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2010.09.003 · Cited by 1,796
The Critical Importance of Retrieval for Learning
Karpicke, J. D., & Roediger, H. L. (2008) · Science · doi:10.1126/science.1152408 · Cited by 1,791
Cited by
Items 401–500 of 1,077
The Covid-19 shutdown: when studying turns digital, students want more structure
Gjerde, V., Gray, R., Holst, B., & Kolstø, S. D. (2021) · Physics Education · doi:10.1088/1361-6552/ac031e · Cited by 13
“In addition to being highly effective for improving memory of important relationships (Karpicke and Grimaldi 2012, Rowland 2014, Gjerde et al 2020), the literature also suggest that retrieval practice can make subsequent study more effective, i.e.”
Backgroundvan den Broek, G. S. E., van Gog, T., Jansen, E., Pleijsant, M., & Kester, L. (2021) · Journal of Educational Psychology · doi:10.1037/edu0000499 · Cited by 15
Liu, X. L., O’Reilly, R. C., & Ranganath, C. (2021) · The Psychology of learning and motivation/The psychology of learning and motivation · doi:10.1016/bs.plm.2021.07.003 · Cited by 12
What Happened When? Cerebral Processing of Modified Structure and Content in Episodic Cueing
Siestrup, S., Jainta, B., El-Sourani, N., Trempler, I., Wurm, M. F., Wolf, O. T., Cheng, S., & Schubotz, R. I. (2022) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_01862 · Cited by 13
“When feedback is included in retrieval tasks, consolidation has been shown to occur independent of initial retrieval success (Rowland, 2014; Roediger & Butler, 2011).”
BackgroundThe role of emotion arousal in the retrieval practice effect
Jia, X., Gao, C., Cui, L., & Guo, C. (2019) · Experimental Brain Research · doi:10.1007/s00221-019-05658-0 · Cited by 11
“2018; Pan and Rickard 2018; Roediger and Karpicke 2006; Roediger and Butler 2011; Roediger and Karpicke 2018; Rowland 2014).”
BackgroundMethodResultInfluentialTime-dependent consolidation mechanisms of durable memory in spaced learning
Yang, Y., Huang, Z., Yang, Y., Fan, M., & Yin, D. (2025) · Communications Biology · doi:10.1038/s42003-025-07964-6 · Cited by 10
“Third, in order to estimate the memory retention for each object-word pair, we repeatedly tested the same pairs in different tests, which may affect the memory durability 76 and the systems consolidation 77,78 .”
Barenberg, J., Berse, T., Reimann, L., & Dutke, S. (2021) · Applied Cognitive Psychology · doi:10.1002/acp.3796 · Cited by 12
Tracing Undergraduate Science Learners’ Digital Cognitive Strategy Use and Relation to Performance
Mefferd, K., & Bernacki, M. L. (2023) · Journal of Science Education and Technology · doi:10.1007/s10956-022-10018-9 · Cited by 16
“…can increase judgment of knowing because it facilitates knowledge retrieval and transfer and can be thought of as a metacognitive learning strategy (Rowland, 2014; Theobald, 2018), and have positive effects on students’ self-regulated learning strategies (Panadero, 2017) and academic performance…”
Backgroundda Rocha, F. D. F., Lemos, B., de Brito, P. H., Santos, R., Rodrigues, L., Isotani, S., & Dermeval, D. (2023) · Education and Information Technologies · doi:10.1007/s10639-023-11906-2 · Cited by 15
“Additionally, we opted to work with a quiz-based ITS following the testing effect, which provides consistent evidence that assessment tasks, such as completingquizzes,arestronglyandpositivelyrelatedtolearningoutcomes(Rowland, 2014;KarpickeandAue,2015).”
Lawson, A. P., & Mayer, R. E. (2023) · Journal of Educational Computing Research · doi:10.1177/07356331231215752 · Cited by 14
“Prior knowledge as assessed using a scale rather than a test to reduce any impact of the testing effect on learning (e.g., Karpicke & Aue, 2015; McDaniel et al., 2007; Rowland, 2014).”
MethodLeonard, L. B., Christ, S. L., Deevy, P., Karpicke, J. D., & Kueser, J. B. (2024) · Journal of Speech Language and Hearing Research · doi:10.1044/2024_jslhr-23-00528 · Cited by 16
“There is widespread evidence that RSR promotes learning relative to study alone (see meta-analysis by Rowland, 2014).”
Heikkinen, S., Cristea, T., Saqr, M., Malmberg, J., Kleingeld, A., Snijders, C. C. P., Matzat, U., & Tedre, M. (2024) · Smart Learning Environments · doi:10.1186/s40561-024-00327-4 · Cited by 12
“Such a difference could also portray the testing effect (Rowland, 2014), as completing an assignment or quiz would lead to better learning than rereading the materials associated with rote learning.”
BackgroundPilot Study on the Relationship of Test Anxiety to Utilizing Self-Testing in Self-Regulated Learning
Weißgerber, S. C., & Reinhard, M. (2018) · International Journal of Psychological Studies · doi:10.5539/ijps.v10n4p95 · Cited by 12
“…a practical point of view, the phenomenon’s effectivity (meta-analytic average weighted g = .61; Adesope, Trevisan, & Sundararajan, 2017; g = .50; Rowland, 2014) and broad applicability to educational settings makes it a promising candidate to boost learning throughout all educational sectors…”
BackgroundLi, J., Zhang, E.-H., He, X., Zhang, H., Gou, H., Wang, X., Wang, S., & Cao, H.-W. (2022) · Lingua · doi:10.1016/j.lingua.2022.103294 · Cited by 17
Gjerde, V., Paulsen, V. H., Holst, B., & Kolstø, S. D. (2022) · Physical Review Physics Education Research · doi:10.1103/physrevphyseducres.18.010136 · Cited by 24
Social remembering in the digital age: Implications for virtual study, work, and social engagement
Greeley, G. D., Peña, T., & Rajaram, S. (2022) · Memory Mind & Media · doi:10.1017/mem.2022.3 · Cited by 11
“This improvement is larger than what would be expected if the only mechanism at play is hypermnesia – or improvement in individual recall performance across repeated retrieval attempts (Congleton and Rajaram 2012; Payne 1987; Roediger and Butler 2011; Rowland 2014).”
BackgroundRetrieval practice is costly and is beneficial only when working memory capacity is abundant
Zheng, Y., Sun, P., & Liu, X. L. (2023) · npj Science of Learning · doi:10.1038/s41539-023-00159-w · Cited by 15
Gupta, M. W., Pan, S. C., & Rickard, T. C. (2023) · Journal of Memory and Language · doi:10.1016/j.jml.2023.104476 · Cited by 11
Coppens, L. C., Verkoeijen, P. P. J. L., Bouwmeester, S., & Rikers, R. M. J. P. (2016) · BMC Psychology · doi:10.1186/s40359-016-0127-2 · Cited by 16
The replicability of the negative testing effect: differences across participant populations
Mulligan, N. W., Rawson, K. A., Peterson, D. J., & Wissman, K. T. (2018) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037/xlm0000490 · Cited by 10
Neural activations associated with feedback and retrieval success.
Wiklund-Hörnqvist, C., Andersson, M., Jonsson, B., & Nyberg, L. (2017) · npj Science of Learning · doi:10.1038/s41539-017-0013-6 · Cited by 10
Pediatrician Perspectives on Learning and Practice Change in the MOCA-Peds 2017 Pilot
Turner, A. L., Olmsted, M. G., Smith, A. C., Dounoucos, V., Bradford, A., Althouse, L. A., & Leslie, L. K. (2019) · PEDIATRICS · doi:10.1542/peds.2019-2305 · Cited by 12
Jantzi, C., Mengin, A. C., Serfaty, D., Bacon, É., Elowe, J., Séverac, F., Meyer, N., Berna, F. S., & Vidailhet, P. (2019) · BMC Psychiatry · doi:10.1186/s12888-019-2341-y · Cited by 14
Neurophysiological evidence for the retrieval practice effect under emotional context
Jia, X., Gao, C., Cui, L., & Guo, C. (2019) · International Journal of Psychophysiology · doi:10.1016/j.ijpsycho.2019.12.008 · Cited by 10
The feature boost in false memory: the roles of monitoring and critical item identifiability
Coane, J. H., McBride, D. M., & Xu, S. (2020) · Memory · doi:10.1080/09658211.2020.1735445 · Cited by 11
“Similarly, the benefits of retrieval practice on memory are well-established (see Roediger et al., 2010 for a review): Relative to study, retrieving information from memory promotes learning and retention (see Chan, Meissner, & Davis, 2018; Rowland, 2014, for reviews).”
BackgroundTest-enhanced learning for pairs and triplets: When and why does transfer occur?
Rickard, T. C., & Pan, S. C. (2020) · Memory & Cognition · doi:10.3758/s13421-020-01048-y · Cited by 10
Multimedia learning trumps retrieval practice in psychology teaching
Jägerskog, A., Jönsson, F. U., Selander, S., & Jonsson, B. (2019) · Scandinavian Journal of Psychology · doi:10.1111/sjop.12527 · Cited by 12
Memory in the Digital AgePreprint
Storm, B. C., & Soares, J. S. (2022) · doi:10.31234/osf.io/h8q6e · Cited by 10
Ebbels, S. H., Gadd, M., Nicoll, H., Hughes, L., Dawson, N. J., Burke, C., Calder, S. D., & Frizelle, P. (2024) · Language Speech and Hearing Services in Schools · doi:10.1044/2024_lshss-23-00098 · Cited by 13
Adaptation of quizzing in learning psychology concepts
Obergassel, N., Heitmann, S., Grund, A., Fries, S., Berthold, K., & Roelle, J. (2024) · Learning and Instruction · doi:10.1016/j.learninstruc.2024.102028 · Cited by 12
A scoping review of research on individual differences in the testing effect paradigm
Smith-Peirce, R. N., & Butler, A. C. (2024) · Learning and Individual Differences · doi:10.1016/j.lindif.2024.102602 · Cited by 11
Retrospective Focus Prompts Facilitate Learning From Video Tutorials for Technical Apprenticeship
Schriek, S. A., Berthold, K., & Hefter, M. H. (2025) · Applied Cognitive Psychology · doi:10.1002/acp.70049 · Cited by 9
Tulving’s (1989) Doctrine of Concordance Revisited
Schwartz, B. L., & Cleary, A. M. (2025) · Journal of Cognition · doi:10.5334/joc.447 · Cited by 10
Brand, C., Loibl, K., & Rummel, N. (2025) · Instructional Science · doi:10.1007/s11251-025-09727-6 · Cited by 27
“To avoid testing effects (see Rowland, 2014), we varied whether or not students received the intermediate test.”
Schuetze, B. A., & Yan, V. X. (2022) · Cognitive Science · doi:10.1111/cogs.13136 · Cited by 11
Ryan, A., Judd, T. S., Wilson, C., Larsen, D. P., Elliott, S. L., Kulasegaram, K. M., & Swanson, D. B. (2023) · Medical Education · doi:10.1111/medu.15287 · Cited by 19
“45 Conceivably, an augmented effect of feedback to improve TEL in these instances would be consistent with retrieval effort theories, 12 with more difficult tasks and/or a longer feedback delay evoking deeper and prolonged processing — which, in turn, may enhance memory acquisition, retention and…”
BackgroundA visual paired associate learning ( vPAL ) paradigm to study memory consolidation during sleep
Schmidig, F. J., Geva‐Sagiv, M., Falach, R., Yakim, S., Gat, Y., Sharon, O., Fried, I., & Nir, Y. (2024) · Journal of Sleep Research · doi:10.1111/jsr.14151 · Cited by 10
Adam, K. C. S., Zhao, C. K., & Vogel, E. K. (2024) · Memory & Cognition · doi:10.3758/s13421-024-01566-z · Cited by 14
“In contrast, there is ample evidence that retrieval practice and testing robustly improve performance in typical free recall tasks (e.g., Rowland, 2014).”
den Boer, A. W., Verkoeijen, P. P. J. L., & Heijltjes, A. E. G. (2020) · Psychology Learning & Teaching · doi:10.1177/1475725720971946 · Cited by 14
“Hence, cumulative assessment encourages spaced repetition and retrieval practice, both of which are known to be highly effective for enhancing performance (e.g. Adesope et al., 2017; Carpenter, 2012; Delaney et al., 2010; Fiorella & Mayer, 2015, 2016; Kang, 2016; Roediger & Karpicke, 2006; Rowland, 2014).”
BackgroundRawson, K. A., Dunlosky, J., & Janes, J. (2020) · Educational Psychology Review · doi:10.1007/s10648-020-09528-y · Cited by 9
“Thus, successive relearning combines two highly effective learning techniques—practice testing and spaced practice (for recent reviews of these two techniques, see Rowland 2014; Wiseheart et al. 2019).”
Ribeirinha, T., & da Silva, B. D. (2020) · Revista e-Curriculum · doi:10.23925/1809-3876.2020v18i2p568-589 · Cited by 6
True-False Testing on Trial: Guilty as Charged or Falsely Accused?
Brabec, J. A., Pan, S. C., Bjork, E. L., & Bjork, R. A. (2020) · Educational Psychology Review · doi:10.1007/s10648-020-09546-w · Cited by 17
“Such benefits, however, might not be as consistent or powerful as those elicited by other tests (cf. Rowland 2014) and can depend critically on how true-false items are constructed and the conditions of reference with which the effects of true-false tests are compared.”
ResultWhen to conduct a vocabulary quiz, before the review or after the review?
Kasahara, K., & Kanayama, K. (2021) · System · doi:10.1016/j.system.2021.102641 · Cited by 12
Indirekte Effekte von Abrufübungen – Intuitiv und doch häufig unterschätzt
Endres, T., & Renkl, A. (2021) · Unterrichtswissenschaft · doi:10.1007/s42010-021-00140-9 · Cited by 11
On the reliability of retrieval-induced forgetting
Rowland, C. A., Bates, L. E., & DeLosh, E. L. (2014) · Frontiers in Psychology · doi:10.3389/fpsyg.2014.01343 · Cited by 39
Self-citationHuff, M. J., Yates, T. J., & Balota, D. A. (2018) · Memory · doi:10.1080/09658211.2018.1467929 · Cited by 11
“Inclusion of a restudy control task provided greater convergence with retrieval-practice experiments which often compare the effects of restudy to retrieval (see Rawson & Dunlosky, 2011; Rowland, 2014, for reviews).”
Different reactivation procedures enable or prevent episodic memory updating
Scully, I. D., & Hupbach, A. (2019) · Hippocampus · doi:10.1002/hipo.23159 · Cited by 11
Magnuson, J. S., & Crinnion, A. M. (2022) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780198845003.013.23 · Cited by 12
Oxford Handbooks in Linguistics
(2022) · Oxford University Press eBooks · doi:10.1093/9780191954481.003.0108 · Cited by 9
Retrieval practice plus feedback benefits a third language vocabulary learning
Li, J., Zhang, E.-H., Zhang, H., Gou, H., & Cao, H.-W. (2022) · International Journal of Multilingualism · doi:10.1080/14790718.2022.2102172 · Cited by 13
“Moreover, a meta-analytic study showed that providing corrective feedback almost doubled the bene fi cial e ff ects of retrieval practice relative to no feedback (Rowland, 2014).”
BackgroundTwisted memories: Addiction-related engrams are strengthened by desire thinking
Mattioni, L., Ferri, F., Nikčević, A. V., Spada, M. M., & Sestieri, C. (2023) · Addictive Behaviors · doi:10.1016/j.addbeh.2023.107782 · Cited by 8
Malaysia, U. P., Roslan, R., Ayub, A. F. M., Malaysia, U. P., Ghazali, N., Malaysia, U. T. H. O., Zulkifli, N. N., Malaysia, U. P., Latip, S. N. H. M., Malaysia, U. P., et al. (2023) · Journal of Technical Education and Training · doi:10.30880/jtet.2023.15.03.002 · Cited by 11
Ophuis‐Cox, F. H. A., Rozendal, L., Catrysse, L., Brinke, D. J.-T., & Camp, G. (2023) · Journal of Experimental Psychology Applied · doi:10.1037/xap0000507 · Cited by 12
Zhang, I., Guo, X., Son, J. Y., Blank, I., & Stigler, J. W. (2024) · Memory & Cognition · doi:10.3758/s13421-024-01526-7 · Cited by 16
Supriya, K., Bang, C., Ebie, J. D., Pagliarulo, C., Tucker, D. B., Villegas, K., Wright, C. D., & Brownell, S. E. (2024) · CBE—Life Sciences Education · doi:10.1187/cbe.21-11-0320 · Cited by 12
“…this effect is stronger when students receive feedback on their initial test before retesting, and when the initial test is “retrieval-based,” that is, requires students to generate the answer instead of simply recognizing the answer (Rawson and Dunlosky, 2012; Rowland, 2014; Brame and Biel, 2015).”
BackgroundCleary, A. M., McNeely-White, K. L., Neisser, J. U., Drane, D. L., Liégeois‐Chauvel, C., & Pedersen, N. P. (2025) · Memory & Cognition · doi:10.3758/s13421-024-01673-x · Cited by 19
“…from memory leads to better subsequent memory than the same amount of time spent being merely being re-presented with the information (Abbott, 1909; Rowland, 2014); thus, successful memory retrieval would be expected to enhance subsequent memory for the retrieved item (in this case, the first…”
Pan, S. C., Yu, L., Wong, M. J., Selvarajan, G., & Teo, A. Z. J. (2025) · Journal of Memory and Language · doi:10.1016/j.jml.2025.104608 · Cited by 11
Effects of making errors in learning a foreign language
Guzmán-Muñoz, F. J. (2020) · Journal of Cognitive Psychology · doi:10.1080/20445911.2020.1711766 · Cited by 12
“For example, Rowland (2014) shows that recognition tests normally produce”
Backgroundvan Harsel, M., Hoogerheide, V., Verkoeijen, P. P. J. L., & van Gog, T. (2021) · Journal of Computer Assisted Learning · doi:10.1111/jcal.12589 · Cited by 15
Jia, X., Gao, C., Li, B., Shinkareva, S. V., & Guo, C. (2021) · Biological Psychology · doi:10.1016/j.biopsycho.2021.108222 · Cited by 8
Bencze, D., Szöllősi, Á., Németh, K., & Racsmány, M. (2022) · Biological Psychology · doi:10.1016/j.biopsycho.2022.108341 · Cited by 9
“Additionally, recall tests are suggested to be more effective in terms of long-term memory performance, as compared to various types of recognition memory tests (e.g., Glover, 1989; McDaniel, Anderson, Derbish, & Morrisette, 2007; see also the meta-analytic review of Rowland, 2014).”
How do digital textbook platforms promote active learning in undergraduate biology courses?
Metcalf, L. E., Bernacki, M. L., & Bernacki, L. E. (2022) · Journal of Research in Science Teaching · doi:10.1002/tea.21845 · Cited by 13
Pi, Z., Liu, C., Wang, L., Yang, J., & Li, X. (2023) · Language Teaching Research · doi:10.1177/13621688231164724 · Cited by 10
“…from memory may foster learning through a process of consolidation (Waldeyer et al., 2020), as retrieval intensifies potential retrieval cues (Rowland, 2014) and helps learners build up new retrieval cues as a function of spreading activation (Carpenter, 2009; Endres et al., 2017; Rowland, 2014).”
Delayed Metacomprehension Judgments Do Not Directly Improve Learning from Texts
Hausman, H., & Kubik, V. (2023) · Journal of Intelligence · doi:10.3390/jintelligence11070150 · Cited by 10
“The final test also occurred after a 1-week retention interval given that learners reap the benefits of covert retrieval after long delays (for a meta-analysis, see (Rowland 2014)).”
BackgroundInfluentialCharting the Future of Assessments
Kyllonen, P. C., Sevak, A., Ober, T. M., Choi, I., Sparks, J. R., & Fishtein, D. (2024) · ETS Research Report Series · doi:10.1002/ets2.12388 · Cited by 26
Sleep selectively and durably enhances memory for the sequence of real-world experiences
Diamond, N. B., Simpson, S., Baena, D., Murray, B. J., Fogel, S. M., & Levine, B. (2025) · Nature Human Behaviour · doi:10.1038/s41562-025-02117-5 · Cited by 16
“That said, potential testing effects should be considered in interpreting the T5 data 93 .”
Feedback at Test Can Reverse the Retrieval-Effort Effect
Kliegl, O., Bjork, R. A., & Bäuml, K. T. (2019) · Frontiers in Psychology · doi:10.3389/fpsyg.2019.01863 · Cited by 9
“While the testing effect is very robust, and has been observed over a wide variety of study materials and experimental conditions (for a review, see Rowland, 2014), findings from a recent study by Storm et al. (2014) provide a striking demonstration of how the testing effect can be eliminated, or…”
BackgroundTurn-by-turn route guidance does not impair route learning.
Kelly, J. W., Lim, A., & Carpenter, S. K. (2021) · Journal of Applied Research in Memory and Cognition · doi:10.1016/j.jarmac.2021.06.001 · Cited by 13
Furtado, P. G. F., Hirashima, T., Khudhur, N., et al. (2021) · IEICE Transactions on Information and Systems · doi:10.1587/transinf.2021edp7069 · Cited by 8
“Building the map could be similar to a test in the testing effect [17].”
ResultKloser, M. J., Borko, H., Wilsey, M., & Rafanelli, S. (2022) · Science Education · doi:10.1002/sce.21712 · Cited by 15
Solidity Meets Surprise: Cerebral and Behavioral Effects of Learning from Episodic Prediction Errors
Siestrup, S., Jainta, B., Cheng, S., & Schubotz, R. I. (2022) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_01948 · Cited by 9
“The positive effect of spaced practice has been explained by more effortful preretrieval processing (Feng et al., 2019; Dobson, Perez, & Linderholm, 2017) that determines later retrieval success (Rowland, 2014).”
BackgroundResultInfluentialLearning from refutation texts about scientific topics with analogical and causal explanations
Harsch, R. M., & Kendeou, P. (2023) · Contemporary Educational Psychology · doi:10.1016/j.cedpsych.2023.102172 · Cited by 14
Kang, Y., Ha, H., & Lee, H. S. (2023) · Educational Psychology Review · doi:10.1007/s10648-023-09772-y · Cited by 7
“A large number of studies demonstrated the robust effect of testing relative to a restudy control, using a wide range of materials, including verbal and nonverbal (for reviews, see McDermott, 2021; Rowland, 2014).”
BackgroundFraundorf, S. H., Caddick, Z. A., Nokes‐Malach, T. J., & Rottman, B. M. (2023) · Cognitive Research Principles and Implications · doi:10.1186/s41235-023-00508-8 · Cited by 10
“Evidence indicates that the benefits of testing for long-term learning do indeed depend in part on how well learners perform on the test (Rowland, 2014, EL: 1).”
BackgroundResultInfluentialRetrieval practice and spacing in an engineering mathematics classroom: Do the effects add up?
Bego, C. R., Lyle, K. B., Ralston, P. A. S., & Hieb, J. (2017) · IEEE Frontiers in Education Conference (FIE) · doi:10.1109/fie.2017.8190463 · Cited by 10
The Effect of the Wording of Multiple Documents on Learning
Schoor, C., Melzner, N., & Artelt, C. (2019) · Zeitschrift für Pädagogische Psychologie · doi:10.1024/1010-0652/a000246 · Cited by 8
Mundt, D., Abel, R., & Hänze, M. (2020) · Journal of Cognitive Psychology · doi:10.1080/20445911.2020.1733584 · Cited by 8
“The so-called testing effect is a robust phenomenon (e.g. Adesope, Trevisan, & Sundararajan, 2017; Rowland, 2014).”
BackgroundEbersbach, M. (2020) · Trends in Neuroscience and Education · doi:10.1016/j.tine.2020.100130 · Cited by 8
“In contrast, one might also speculate that a pure closed-book condition is too difficult for question generators when their retrieval success is poor (Rowland, 2014).”
Pretesting can be beneficial even when using the internet to answer questions
Storm, B. C., James, K. K., & Stone, S. M. (2021) · Memory · doi:10.1080/09658211.2020.1863990 · Cited by 8
“Most notably, information that is retrieved tends to become better recalled in the future than it would have been otherwise, a phenomenon known as the testing effect (Roediger & Karpicke, 2006; Rowland, 2014).”
BackgroundRummer, R. (2021) · Psychologische Rundschau · doi:10.1026/0033-3042/a000518 · Cited by 8
Nevid, J. S., & Gordon, A. J. (2018) · Teaching of Psychology · doi:10.1177/0098628318796920 · Cited by 8
“Evidence indicates that greater use of, and better performance on, online quizzes is associated with higher exam scores (Bell, Simone, & Whitfield, 2015; Gurung, 2015; Van Camp & Baugh, 2014).”
BackgroundInfluentialReductions in Retrieval Competition Predict the Benefit of Repeated Testing
Rafidi, N., Hulbert, J. C., Brooks, P. P., & Norman, K. A. (2018) · Scientific Reports · doi:10.1038/s41598-018-29686-y · Cited by 10
“Other studies have found that the beneficial effects of testing on target memory are most evident after long delays of the sort that we used here 1,3 .”
BackgroundInfluentialMorphology and The Mental Lexicon: Three questions about decomposition
Embick, D., Creemers, A., & Davies, A. J. G. (2022) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780198845003.013.17 · Cited by 14
The neural basis of word production
Nozari, N. (2022) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780198845003.013.12 · Cited by 15
Liu, X. L., & Ranganath, C. (2019) · doi:10.31234/osf.io/4nfue · Cited by 8
Soicher, R. N., Becker‐Blease, K. A., & Bostwick, K. C. P. (2019) · doi:10.31234/osf.io/f5kds · Cited by 8
Effects of retrieval practice on retention and application of complex educational concepts
Corral, D., & Carpenter, S. K. (2025) · Learning and Instruction · doi:10.1016/j.learninstruc.2025.102219 · Cited by 23
Do it twice! Test-taking fosters repeated but not initial study of multimedia instruction
Eitel, A., Benito, S. M., & Scheiter, K. (2017) · Learning and Instruction · doi:10.1016/j.learninstruc.2017.04.003 · Cited by 8
“Therefore, repeated testing was more beneficial for long-term retention than repeated studying (testing effect; see Rowland, 2014; for a recent meta-analysis).”
BackgroundBailey, E. G., Greenall, R. F., Tullis, M. M., & Williams, K. R. (2021) · PLoS ONE · doi:10.1371/journal.pone.0250143 · Cited by 7
“The retrieval process itself can be responsible for increased learning [14] as different routes of access are created during the testing experience and encoding becomes deeper or more effortful [15, 16].”
BackgroundResultMeneghetti, C., Casali, N., Fabris, M., Palamà, D., Rizzato, R., Zamperlin, C., Zavagnin, M., & Béni, R. D. (2021) · Journal of Evidence-Based Psychotherapies · doi:10.24193/jebp.2021.2.13 · Cited by 9
Maraver, M. J., Lapa, A., Garcia‐Marques, L., Carneiro, P., & Raposo, A. (2022) · PLoS ONE · doi:10.1371/journal.pone.0272427 · Cited by 14
“The testing effect has been typically found for long term learning, being generally weaker on immediate tests [53], highlighting the robustness of the testing effect.”
BackgroundResultAntony, J. W., Liu, X. L., Zheng, Y., Ranganath, C., & O’Reilly, R. C. (2026) · doi:10.21428/8e6ba8ef.d9f5dd19 · Cited by 7
Arslan, B., & Finn, B. (2023) · Journal of Intelligence · doi:10.3390/jintelligence11110204 · Cited by 9
“…used appropriately, assessments support learning (e.g., see Bennett 2011 for a discussion of the benefit of formative assessments for learning, or see Rowland 2014 for the role of the testing effect in supporting learning) and provide stake-holders such as students, teachers, and policy makers with…”
BackgroundImproving student outcomes using automated feedback in a first-year economics class
Huskisson, S., O’Mahony, T., & Lacey, S. (2024) · International Review of Economics Education · doi:10.1016/j.iree.2024.100303 · Cited by 10
Can tests improve learning in real university classrooms?
Lamotte, M., Izaute, M., & Darnon, C. (2021) · Journal of Cognitive Psychology · doi:10.1080/20445911.2021.1956939 · Cited by 8
“the format of the performance test is highly variable from one study to another—an inconsistency also identified in research conducted in laboratory settings (Chan et al., 2018; Rowland, 2014).”
BackgroundAbrufeffekte im Gedächtnis: Ein Überblick zur aktuellen Grundlagenforschung
Tempel, T., & Pastötter, B. (2021) · Psychologische Rundschau · doi:10.1026/0033-3042/a000517 · Cited by 8
Annamalai, N., Kabilan, M. K., Rashid, R. A., Oleskevicience, G. V., & Vaičiūnienė, V. (2021) · The Qualitative Report · doi:10.46743/2160-3715/2021.4986 · Cited by 14
“Gamification is one of these approaches that may present itself as a useful, cost-effective, and efficient approach for researchers and practitioners to improve learning outcomes (Oprescu et al., 2014; Rowland, 2014).”
BackgroundRenkl, A. (2020) · Springer eBooks · doi:10.1007/978-3-662-61403-7_1 · Cited by 12
Objective Tests in Automated Grading of Computer Science Courses: An Overview
Lujak, M., Slavkovik, M., Lebis, A., Vermeulen, M., & Doniec, A. (2022) · Learning and analytics in intelligent systems · doi:10.1007/978-3-031-04662-9_12 · Cited by 8
Affective Memory in Gamified Learning: A Usability Study
Rodrigues, L., Arndt, D., Palomino, P. T., Toda, A. M., Klock, A. C. T., Avila-Santos, A. P., & Isotani, S. (2022) · Anais do ... Simpósio Brasileiro de Informática na Educação/Anais do Simpósio Brasileiro de Informática na Educação · doi:10.5753/sbie.2022.225748 · Cited by 9
“However, such assessment is prominent for learning [Rowland 2014].”
Background
Metadata
- Authors
- Rowland, C. A.
- Affiliations
- Colorado State University (US)
- Corresponding author
- Rowland, Christopher A.
- Venue
- Psychological Bulletin
- Published
- 2014
- Volume
- 140
- Issue
- 6
- Pages
- 1432-1463
- ISSN
- 0033-2909 (ISSN-L)
- 1939-1455
- OpenAlex
- W2050255700
- Cited by
- 1,066
- References
- 139
- Citations by year
- 2026: 71 · 2025: 103 · 2024: 139 · 2023: 113 · 2022: 138 · 2021: 122 · 2020: 105 · 2019: 91 · 2018: 73 · 2017: 52 · 2016: 36 · 2015: 19 · 2014: 3
- FWCI
- 20.46
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Psychological Bulletin (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Memory Processes and Influences
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Visual and Cognitive Learning Processes
- Life Sciences › Neuroscience › Cognitive Neuroscience › Memory and Neural Mechanisms
- Keywords
- testing effect, restudy, retention, effortful processing, recall tests, recognition test, semantic elaboration, memory retrieval, bifurcation model, memory consolidation
- MeSH terms
- Attention, Cues, Educational Measurement, Humans, Learning, Memory, Neuropsychological Tests, Practice, Psychological, Mental Recall, Retention, Psychology, Semantics, Students, Universities
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.