Single-paper meta-analyses of the effects of spaced retrieval practice in nine introductory STEM courses: is the glass half full or half empty?
Open accessThe DOI matches its Crossref record; 72 of the 72 references it cites were found in a registry or an index.
Abstract
Background: Undergraduate STEM instructors want to help students learn and retain knowledge for their future courses and careers. One promising evidence-based technique that is thought to increase long-term memory is spaced retrieval practice, or repeated testing over time. The beneficial effect of spacing has repeatedly been demonstrated in the laboratory as well as in undergraduate mathematics courses, but its generalizability across diverse STEM courses is unknown. We investigated the effect of spaced retrieval practice in nine introductory STEM courses. Retrieval practice opportunities were embedded in bi-weekly quizzes, either massed on a single quiz or spaced over multiple quizzes. Student performance on practice opportunities and a criterial test at the end of each course were examined as a function of massed or spaced practice. We also conducted a single-paper meta-analysis on criterial test scores to assess the generalizability of the effectiveness of spaced retrieval practice across introductory STEM courses. Results: Significant positive effects of spacing on the criterial test were found in only two courses (Calculus I for Engineers and Chemistry for Health Professionals), although small positive effect sizes were observed in two other courses (General Chemistry and Diversity of Life). Meta-analyses revealed a significant spacing effect when all courses were included, but not when calculus was excluded. The generalizability of the spacing effect across STEM courses therefore remains unclear. Conclusions: Although we could not clearly determine the generalizability of the benefits of spacing in STEM courses, our findings indicate that spaced retrieval practice could be a low-cost method of improving student performance in at least some STEM courses. More work is needed to determine when, how, and for whom spaced retrieval practice is most beneficial. The effect of spacing in classroom settings may depend on some design features such as the nature of retrieval practice activities (multiple-choice versus short answer) and/or feedback settings, as well as student actions (e.g., whether they look at feedback or study outside of practice opportunities). The evidence is promising, and further pragmatic research is encouraged.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Dunlosky, J., Rawson, K. A., Marsh, E. J., Nathan, M. J., & Willingham, D. T. (2013) · Psychological Science in the Public Interest · doi:10.1177/1529100612453266 · Cited by 3,138
The power of testing memory: Basic research and implications for educational practice
Roediger, H. L., & Karpicke, J. D. (2006) · Perspectives on Psychological Science · doi:10.1111/j.1745-6916.2006.00012.x · Cited by 2,037
Distributed practice in verbal recall tasks: A review and quantitative synthesis.
Cepeda, N. J., Pashler, H., Vul, E., Wixted, J. T., & Rohrer, D. (2006) · Psychological Bulletin · doi:10.1037/0033-2909.132.3.354 · Cited by 1,888 · cited 2×
“…conditions are compared in laboratory studies with verbal materials, the spaced condition typically leads to superior information retention (Cepeda et al., 2006; Cull, 2000; Karpicke & Roediger, 2007; Landauer & Eldridge, 1967), representing what is called a spacing effect (Dempster, 1989).”
The critical role of retrieval practice in long-term retention
Roediger, H. L., & Butler, A. C. (2011) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2010.09.003 · Cited by 1,796 · cited 1×
“Feed-back has been shown to help students identify and correct their mistakes as well as gain confidence in correct responses (Butler et al., 2008; Pashler et al., 2005), which may be required in a classroom setting but not in laboratory studies (e.g., Roediger & Butler, 2011).”
The Critical Importance of Retrieval for Learning
Karpicke, J. D., & Roediger, H. L. (2008) · Science · doi:10.1126/science.1152408 · Cited by 1,791 · cited 1×
“…information from memory bolsters the long-term retention of that information more than restudying the information (i.e., the testing effect; e.g., Karpicke & Roediger, 2008; Roediger & Karpicke, 2006; for a meta-analysis, see Adesope et al., 2017; for a recent review, see McDermott, 2021).”
Memory and Metamemory Considerations in the Training of Human Beings
Bjork, R. A. (1994) · Metacognition · doi:10.7551/mitpress/4561.003.0011 · Cited by 1,084 · cited 2×
“Indeed, spacing is often characterized as inducing desirable difficulty (Bjork, 1994), meaning that spacing reduces performance during the early stages of learning but, in the process, promotes cognitive mechanisms that benefit long-term retention (Bjork & Bjork, 2011; Bjork, 1999).”
The effect of testing versus restudy on retention: A meta-analytic review of the testing effect.
Rowland, C. A. (2014) · Psychological Bulletin · doi:10.1037/a0037559 · Cited by 1,066 · cited 1×
“Effects of retrieval practice on memory have been extensively studied (Rowland, 2014).”
Wicherts, J. M., Veldkamp, C. L. S., Augusteijn, H. E. M., Bakker, M., van Aert, R. C. M., & van Assen, M. A. L. M. (2016) · Frontiers in Psychology · doi:10.3389/fpsyg.2016.01832 · Cited by 754 · cited 1×
“The authors followed the a priori analysis plan with the intention of ethical research, specifically not running multiple analyses on the same dataset including and excluding different courses (to avoid p -hacking; Wicherts et al., 2016).”
Karpicke, J. D., Butler, A. C., & Roediger III, H. L. (2009) · Memory · doi:10.1080/09658210802647009 · Cited by 745 · cited 1×
“College students often fail to harness the power of retrieval practice, choosing instead to restudy (Karpicke et al., 2009).”
(2011) · Cited by 725
Cited by
Opportunities and Challenges in Harnessing Digital Technology for Effective Teaching and Learning
Chen, Z., & Singh, C. (2025) · Trends in Higher Education · doi:10.3390/higheredu4010006 · Cited by 16
“Many students did not keep up with the course videos and other course materials and crammed a few days before each exam, something that has been shown to be detrimental to long-term retention in some studies [85].”
ChatGPT-Assisted Retrieval Practice and Exam Scores: Does It Work?
Yusof, I. J. (2025) · Journal of Information Technology Education Research · doi:10.28945/5474 · Cited by 20
“Bego et al. (2024) investigated spaced retrieval practice in STEM courses through bi - weekly quizzes, finding substantial benefits for engineering and health science students.”
Retrieval Practice—A Tool to Narrow the Achievement Gap in Learning Higher Mathematics
Muzsnay, A., Szabó, C., Zámbó, C., Szabó, G., & Szeibert, J. (2025) · International Journal of Science and Mathematics Education · doi:10.1007/s10763-025-10607-1 · Cited by 11
“This support is multifaceted: Firstly, retrieval practice enhances long-term memory: actively recalling information reinforces neural pathways and improves future recall, making it easier for students to build and retain foundational knowledge over time (Bego et al., 2024).”
Millán, M. D. C. S., & Arango, J. P. B. (2025) · Discover Education · doi:10.1007/s44217-025-00735-9 · Cited by 9
“…use of different information and communication technologies, it is possible to show a significant increase in calculus and chemistry courses focused on health personnel; identifying the spaced retrieval practice as a low-cost method that allows enhancing student performance in STEM courses [47].”
Mobile microlearning with repeated short video access: Effects on vocational skill retention
Sudira, P., Inderanata, R. N., Widodo, S., Wagiran, W., & Aryani, S. T. (2026) · Jurnal Pendidikan Vokasi · doi:10.21831/jpv.v15i3.95712 · Cited by 4
Metadata
- Authors
- Bego, C. R., Lyle, K. B., Ralston, P. A. S., Immekus, J. C., Chastain, R. J., Haynes, L. D., Hoyt, L. K., Pigg, R. M., Rabin, S. D., Scobee, M. W., & Starr, T. L.
- Affiliations
- University of Louisville (US)
- Corresponding author
- Bego, Campbell R.
- ORCID
- Venue
- International Journal of STEM Education
- Published
- 2024-02-07
- Volume
- 11
- Issue
- 1
- ISSN
- 2196-7822 (ISSN-L)
- OpenAlex
- W4391602638
- Cited by
- 12
- References
- 72
- Citations by year
- 2026: 3 · 2025: 8
- FWCI
- 2.67
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- creativecommons.org/licenses/by/4.0 (tdm)
- creativecommons.org/licenses/by/4.0 (vor)
- Locations
- International Journal of STEM Education (publishedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- Division of Undergraduate Education (1912253)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Memory Processes and Influences
- Social Sciences › Education › Innovative Teaching Methods
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Visual and Cognitive Learning Processes
- Keywords
- spaced retrieval practice, massed practice, introductory STEM courses, long-term memory, undergraduate mathematics, calculus teaching, chemistry education, active learning
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Single-paper meta-analyses of the effects of spaced retrieval practice in nine introductory STEM courses: is the glass half full or half empty? https://app.cochat.ai/papers/10.1186/s40594-024-00468-5
- The paper
- Bego, C. R., Lyle, K. B., Ralston, P. A. S., Immekus, J. C., Chastain, R. J., Haynes, L. D., Hoyt, L. K., Pigg, R. M., Rabin, S. D., Scobee, M. W., & Starr, T. L. (2024). Single-paper meta-analyses of the effects of spaced retrieval practice in nine introductory STEM courses: is the glass half full or half empty? International Journal of STEM Education. https://doi.org/10.1186/s40594-024-00468-5
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.


