A randomized controlled trial of interleaved mathematics practice
Open accessThe DOI matches its Crossref record; 45 of the 46 references it cites were found in a registry or an index.
Abstract
We report the results of a preregistered, cluster randomized controlled trial of a mathematics learning intervention known as interleaved practice. Whereas most mathematics assignments consist of a block of problems devoted to the same skill or concept, an interleaved assignment is arranged so that no 2 consecutive problems require the same strategy. Previous small-scale studies found that practice assignments with a greater proportion of interleaved practice produced higher test scores. In the present study, we assessed the efficacy and feasibility of interleaved practice in a naturalistic setting with a large, diverse sample. Each of 54 7th-grade mathematics classes periodically completed interleaved or blocked assignments over a period of 4 months, and then both groups completed an interleaved review assignment. One month later, students took an unannounced test, and the interleaved group outscored the blocked group, 61% versus 38%, d = 0.83. Teachers were able to implement the intervention without training, and they later expressed support for interleaved practice in an anonymous survey they completed before they knew the results of the study. Although important caveats remain, the results suggest that interleaved mathematics practice is effective and feasible. (PsycINFO Database Record (c) 2019 APA, all rights reserved)
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Cognitive load theory, learning difficulty, and instructional design
Sweller, J. (1994) · Learning and Instruction · doi:10.1016/0959-4752(94)90003-5 · Cited by 3,801 · cited 1×
“In fact, in numerous studies, mathematics practice problems were more effective when the problems were altered in ways that reduce cognitive load, which is akin to working memory load (e.g., Paas & Van Merriënboer, 1994; Sweller, 1994).”
Dunlosky, J., Rawson, K. A., Marsh, E. J., Nathan, M. J., & Willingham, D. T. (2013) · Psychological Science in the Public Interest · doi:10.1177/1529100612453266 · Cited by 3,138
Schmidt, R. A., & Bjork, R. A. (1992) · Psychological Science · doi:10.1111/j.1467-9280.1992.tb00029.x · Cited by 1,582 · cited 1×
“…blocked practice, students know the strategy for each problem before they read the problem, and this resulting fluency, although illusory, might lead students and teachers to falsely believe that blocking enhances efficacy (e.g., Koriat & Bjork, 2005; Kornell & Bjork, 2007; Schmidt & Bjork, 1992).”
The Use of Worked Examples as a Substitute for Problem Solving in Learning Algebra
Sweller, J., & Cooper, G. A. (1985) · Cognition and Instruction · doi:10.1207/s1532690xci0201_3 · Cited by 1,214
Paas, F. G. W. C., & Van Merriënboer, J. J. G. (1994) · Journal of Educational Psychology · doi:10.1037/0022-0663.86.1.122 · Cited by 1,198 · cited 1×
“In fact, in numerous studies, mathematics practice problems were more effective when the problems were altered in ways that reduce cognitive load, which is akin to working memory load (e.g., Paas & Van Merriënboer, 1994; Sweller, 1994).”
Why are some problems hard? Evidence from Tower of Hanoi
Kotovsky, K., Hayes, J. R., & Simon, H. A. (1985) · Cognitive Psychology · doi:10.1016/0010-0285(85)90009-x · Cited by 722
Attention and retrieval from long-term memory
Baddeley, A., Lewis, V., Eldridge, M., & Thomson, N. (1984) · Journal of Experimental Psychology: General · doi:10.1037/0096-3445.113.4.518 · Cited by 540
The promise and perils of self-regulated study
Kornell, N., & Bjork, R. A. (2007) · Psychonomic Bulletin & Review · doi:10.3758/bf03194055 · Cited by 527
Unsuccessful retrieval attempts enhance subsequent learning.
Kornell, N., Hays, M. J., & Bjork, R. A. (2009) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/a0015729 · Cited by 484 · cited 1×
“…this possibility is only speculative, and, more-over, several studies with nonmathematics tasks have found that students’ errors can enhance their learning when errors are followed by corrective feedback (e.g., Huelser & Metcalfe, 2012; Kornell, Hays, & Bjork, 2009; Richland, Kornell, & Kao, 2009).”
Study strategies of college students: Are self-testing and scheduling related to achievement?
Hartwig, M. K., & Dunlosky, J. (2012) · Psychonomic Bulletin & Review · doi:10.3758/s13423-011-0181-y · Cited by 477 · cited 1×
“These kinds of metacognitive beliefs have been surveyed for some learning strategies (e.g., Hartwig & Dunlosky, 2012) but not for interleaved mathematics practice.”
Self-citationTen Benefits of Testing and Their Applications to Educational Practice
Roediger III, H. L., Putnam, A. L., & Smith, M. A. (2011) · Psychology of Learning and Motivation · doi:10.1016/b978-0-12-387691-1.00001-6 · Cited by 447
Illusions of Competence in Monitoring One's Knowledge During Study.
Koriat, A., & Bjork, R. A. (2005) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/0278-7393.31.2.187 · Cited by 362 · cited 1×
“…blocked practice, students know the strategy for each problem before they read the problem, and this resulting fluency, although illusory, might lead students and teachers to falsely believe that blocking enhances efficacy (e.g., Koriat & Bjork, 2005; Kornell & Bjork, 2007; Schmidt & Bjork, 1992).”
The shuffling of mathematics problems improves learning
Rohrer, D., & Taylor, K. (2007) · Instructional Science · doi:10.1007/s11251-007-9015-8 · Cited by 357 · cited 3×
“…in the introduction, the interleaved group in the present study likely received at least some blocked practice from their teachers before they received the experiment worksheets, and this appears to be true for the other math interleaving studies with one exception (Rohrer & Taylor, 2007).”
Self-citationRoediger, H. L., & Pyc, M. A. (2012) · Journal of Applied Research in Memory and Cognition · doi:10.1016/j.jarmac.2012.09.002 · Cited by 308
Metacognitive awareness of learning strategies in undergraduates
McCabe, J. (2011) · Memory & Cognition · doi:10.3758/s13421-010-0035-2 · Cited by 308 · cited 1×
“However, in scenarios involving non-mathematics category learning tasks, previous studies have found that a majority of students mistakenly believed that blocked practice is more effective than interleaved practice (Kornell & Bjork, 2008; McCabe, 2011).”
The pretesting effect: do unsuccessful retrieval attempts enhance learning?
Richland, L. E., Kornell, N., & Kao, L. S. (2009) · Journal of Experimental Psychology: Applied · doi:10.1037/a0016496 · Cited by 302
Effect of overlearning on retention.
Driskell, J. E., Willis, R. P., & Copper, C. (1992) · Journal of Applied Psychology · doi:10.1037//0021-9010.77.5.615 · Cited by 295
Moving From the Lab to the Field: The Role of Fidelity and Achieved Relative Intervention Strength
Hulleman, C. S., & Cordray, D. S. (2009) · Journal of Research on Educational Effectiveness · doi:10.1080/19345740802539325 · Cited by 291 · cited 4×
“These kinds of realistic conditions are important because promising interventions often fizzle in the classroom (e.g., Hulle-man & Cordray, 2009; O’Donnell, 2008).”
InfluentialThe effects of interleaved practice
Taylor, K., & Rohrer, D. (2010) · Applied Cognitive Psychology · doi:10.1002/acp.1598 · Cited by 288 · cited 2×
“Finally, in a study by Taylor and Rohrer (2010), fourth-grade students completed one session of interleaved or blocked practice of prism problems, and the interleaved group scored much higher on a test given one day later.”
Self-citationThe effects of overlearning and distributed practise on the retention of mathematics knowledge
Rohrer, D., & Taylor, K. (2006) · Applied Cognitive Psychology · doi:10.1002/acp.1266 · Cited by 250
Self-citationBooth, J. L., Lange, K. E., Koedinger, K. R., & Newton, K. J. (2013) · Learning and Instruction · doi:10.1016/j.learninstruc.2012.11.002 · Cited by 205
Taking it to the classroom: Number board games as a small group learning activity.
Ramani, G. B., Siegler, R. S., & Hitti, A. (2012) · Journal of Educational Psychology · doi:10.1037/a0028995 · Cited by 194
Making related errors facilitates learning, but learners do not know it
Huelser, B. J., & Metcalfe, J. (2012) · Memory & Cognition · doi:10.3758/s13421-011-0167-z · Cited by 171
Finn, C. A., & Sladeczek, I. E. (2001) · School Psychology Quarterly · doi:10.1521/scpq.16.2.176.18703 · Cited by 162
The effect of overlearning on retention.
Krueger, W. C. F. (1929) · Journal of Experimental Psychology · doi:10.1037/h0072036 · Cited by 144
Hopkins, R. F., Lyle, K. B., Hieb, J. L., & Ralston, P. A. S. (2016) · Educational Psychology Review · doi:10.1007/s10648-015-9349-8 · Cited by 136
THE EFFECTS OF CUMULATIVE PRACTICE ON MATHEMATICS PROBLEM SOLVING
Mayfield, K. H., & Chase, P. N. (2002) · Journal of Applied Behavior Analysis · doi:10.1901/jaba.2002.35-105 · Cited by 132
Integrating Cognitive Science and Technology Improves Learning in a STEM Classroom
Butler, A. C., Marsh, E. J., Slavinsky, J. P., & Baraniuk, R. G. (2014) · Educational Psychology Review · doi:10.1007/s10648-014-9256-4 · Cited by 122
Rohrer, D., Dedrick, R. F., & Burgess, K. (2014) · Psychonomic Bulletin & Review · doi:10.3758/s13423-014-0588-3 · Cited by 122
Self-citationImplications of Cognitive Science Research for Mathematics Education
Siegler, R. S. (2018) · KiltHub Repository · doi:10.1184/r1/6615134 · Cited by 119
A Test of the Testing Effect: Acquiring Problem‐Solving Skills From Worked Examples
van Gog, T., & Kester, L. (2012) · Cognitive Science · doi:10.1111/cogs.12002 · Cited by 95
Arithmetic practice can be modified to promote understanding of mathematical equivalence.
McNeil, N. M., Fyfe, E. R., & Dunwiddie, A. E. (2014) · Journal of Educational Psychology · doi:10.1037/a0037687 · Cited by 88
Delayed benefits of learning elementary algebraic transformations through contrasted comparisons
Ziegler, E., & Stern, E. (2014) · Learning and Instruction · doi:10.1016/j.learninstruc.2014.04.006 · Cited by 83
The effect of distributed practice on students’ conceptual understanding of statistics
Budé, L., Imbos, T., van de Wiel, M. W., & Berger, M. P. (2011) · Higher Education · doi:10.1007/s10734-010-9366-y · Cited by 79
Interleaved presentation benefits science category learning.
Eglington, L. G., & Kang, S. H. K. (2017) · Journal of Applied Research in Memory and Cognition · doi:10.1016/j.jarmac.2017.07.005 · Cited by 72
Study sequence matters for the inductive learning of cognitive concepts.
Sana, F., Yan, V. X., & Kim, J. A. (2016) · Journal of Educational Psychology · doi:10.1037/edu0000119 · Cited by 69
Interleaved practice in multi-dimensional learning tasks: Which dimension should we interleave?
Rau, M. A., Aleven, V., & Rummel, N. (2013) · Learning and Instruction · doi:10.1016/j.learninstruc.2012.07.003 · Cited by 67 · cited 1×
“In a study with fifth-and sixth-grade students learning about fractions, Rau, Aleven, and Rummel (2013) found an interleaving benefit on tests given zero and seven days later (although the control group did not block practice in the usual sense).”
Yeo, D. J., & Fazio, L. K. (2019) · Journal of Educational Psychology · doi:10.1037/edu0000268 · Cited by 51
Retention as a Function of Degree of Overlearning
Postman, L. (1962) · Science · doi:10.1126/science.135.3504.666 · Cited by 44
Pyke, A. A., & LeFevre, J.-A. (2011) · Journal of Educational Psychology · doi:10.1037/a0023291 · Cited by 30
Interleaved Practice Improves Mathematics Learning: (528942014-240)
Rohrer, D., Dedrick, R. F., & Stershic, S. (2014) · PsycEXTRA Dataset · doi:10.1037/e528942014-240 · Cited by 25
Self-citationBlocking Vs. Interleaving: Examining Single-Session Effects Within Middle School Math Homework
Ostrow, K., Heffernan, N., Heffernan, C., & Peterson, Z. (2015) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-19773-9_34 · Cited by 23 · cited 2×
“Furthermore, the only previous study that did not find a positive interleaving effect used a relatively brief test delay of 2–5 days (Ostrow et al., 2015), although some of the other studies found positive interleaving effects after test delays of one day or less (e.g., Taylor & Rohrer, 2010).”
Overlearning and the Retention of Meaningful Prose
Gilbert, T. F. (1957) · The Journal of General Psychology · doi:10.1080/00221309.1957.9920339 · Cited by 19
Degree of learning, interpolated tests, and rate of forgetting
Rose, R. J. (1992) · Memory & Cognition · doi:10.3758/bf03202712 · Cited by 17
Implementation Fidelity: Examples from the Reading for Understanding Initiative
Roberts, G., Lewis, N. S., Fall, A. M., et al. (2016) · doi:10.4324/9781315734262-9 · Cited by 2
Cited by
Fostering Metacognition to Support Student Learning and Performance
Stanton, J. D., Sebesta, A. J., & Dunlosky, J. (2021) · CBE—Life Sciences Education · doi:10.1187/cbe.20-12-0289 · Cited by 284
Agarwal, P. K., Nunes, L. D., & Blunt, J. R. (2021) · Educational Psychology Review · doi:10.1007/s10648-021-09595-9 · Cited by 211
The science of effective learning with spacing and retrieval practice
Carpenter, S. K., Pan, S. C., & Butler, A. C. (2022) · Nature Reviews Psychology · doi:10.1038/s44159-022-00089-1 · Cited by 184
Interleaved practice improves mathematics learning.
Rohrer, D., Dedrick, R. F., & Stershic, S. (2015) · Journal of Educational Psychology · doi:10.1037/edu0000001 · Cited by 164
Self-citationLachner, A., Jacob, L., & Hoogerheide, V. (2021) · Learning and Instruction · doi:10.1016/j.learninstruc.2020.101438 · Cited by 77
Metadata
- Authors
- Rohrer, D., Dedrick, R. F., Hartwig, M. K., & Cheung, C.-N.
- Affiliations
- University of South Florida (US)
- Venue
- Journal of Educational Psychology
- Published
- 2020-01
- Volume
- 112
- Issue
- 1
- Pages
- 40-52
- ISSN
- 0022-0663 (ISSN-L)
- 1939-2176
- OpenAlex
- W2945831516
- Cited by
- 90
- References
- 46
- Citations by year
- 2026: 11 · 2025: 15 · 2024: 11 · 2023: 11 · 2022: 11 · 2021: 15 · 2020: 14
- FWCI
- 13.39
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Locations
- Journal of Educational Psychology (publishedVersion, other-oa)
- Grantee Submission
- Funders
- US Department of Education (R305A160263)
- Topics
- Social Sciences › Education › Mathematics Education and Pedagogy
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Visual and Cognitive Learning Processes
- Social Sciences › Psychology › Developmental and Educational Psychology › Cognitive and developmental aspects of mathematical skills
- Keywords
- interleaving, mathematics learning, blocked practice, mathematics education, seventh grade students, mathematics achievement, teacher implementation, feasibility
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.