The advantage of mixing examples in inductive learning: a comparison of three hypotheses
Open accessThe DOI matches its Crossref record; 24 of the 24 references it cites were found in a registry or an index; none of the 23 sources its claims cite is checked for support yet.
Abstract
Mixing examples of different categories (interleaving) has been shown to promote inductive learning as compared with presenting examples of the same category together (massing). In three studies, we tested whether the advantage of interleaving is exclusively due to the mixing of examples from different categories or to the temporal gap introduced between presentations. In addition, we also tested the role of working memory capacity (WMC). Results showed that the mixing of examples might be the key component that determines improved induction. WMC might also be involved in the interleaving effect: participants with high spans seemed to profit more than participants with low spans from interleaved presentations. Our findings have relevant implications for education. Practice schedules should be individually customised so society as a whole can profit from differences between learners.
Overview
CoChat Summary
TL;DR
Three experiments tested whether the advantage of mixing examples in inductive learning is due to interleaving, temporal spacing, attention attenuation, or working memory capacity. The results consistently favored spaced/interleaved over massed presentation, found little support for temporal gap or attention-attenuation accounts, and showed preliminary evidence linking WMC to the interleaving effect.
Key findings
- Spaced/interleaved presentation consistently outperformed massed presentation: Experiment 1 new-item classification was .62 vs. .39, \(t[23]=4.1, p<.001\), and studied-item accuracy was .63 vs. .44, \(F[1,22]=18.75, p<.001\); Experiment 2 new-item accuracy was .68 vs. .47, \(F[1,80]=47.61, p<.001\); Experiment 3 immediate test accuracy was .56 vs. .38, \(F[1,113]=71.51, p<.001\), and delayed test accuracy was .54 vs. .35, \(F[1,95]=40.25, p<.001\).
- Temporal gap did not clearly drive the effect: in Experiment 2 the long-gap advantage was marginal for new items (.62 vs. .53, \(p=.051\)) and studied items (.64 vs. .56, \(p=.059\)); in Experiment 3, temporal gap was non-significant in the immediate test (\(p=.562\)) and only marginal in the delayed test (\(p=.056\)).
- Attention-attenuation was not supported: tests of studied items showed no effect of order of presentation in Experiment 1 or Experiment 2, and participants often misjudged massing as better (61% in Experiment 1, 52% in Experiment 2, 63% in Experiment 3 thought massing was better or equal, while 74%, 70%, and 60% respectively did better under spaced conditions).
- WMC showed preliminary links to spacing: Experiment 2 found high WMC more accurate than low WMC (.63 vs. .53, \(p=.039\)) and a marginal presentation-style × WMC interaction (\(p=.094\)); Experiment 3 immediate test had a marginal interaction (\(p=.083\)); combined across experiments (\(N=208\)), WMC correlated with spaced-item accuracy (\(r=.141, p=.042\)) but not massed-item accuracy (\(r=.107, p=.123\)).
Methods
- Three experiments with University of Groningen undergraduates: Experiment 1 \(N=23\), Experiment 2 \(N=88\) with 4 excluded, and Experiment 3 \(N=118\) with 3 missing the delayed test and 15 excluded from WMC analyses.
- Materials were 10 paintings by each of 12 relatively unknown artists from Kornell and Bjork (2008); 6 paintings per artist were studied, and new paintings were used for classification tests. WMC was measured with an automated symmetry span task.
- Presentation style (massed vs. spaced/interleaved) was manipulated within subjects; Experiments 2 and 3 added a between-subjects temporal-gap manipulation, and Experiment 3 added a next-day delayed test. Analyses used mixed ANOVAs, median splits for WMC, and combined correlational analysis.
Limitations
- The paper states that Experiment 1 had a small sample, that WMC was split by median and may not capture extreme differences, and that the WMC effects were only marginal or preliminary.
- The paper notes that Experiment 2’s temporal-gap manipulation extended presentation time, adding extra study time as a confound, which Experiment 3 attempted to control.
- Evident from the text: the WMC evidence rests on marginal interactions and a small combined correlation, and the attention-attenuation conclusion is based on failure to replicate order effects rather than direct support for an alternative attention mechanism.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
0 Valid · 0 Not valid · 16 Not checked · 62 Own results and interpretations
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“There was also a marginally significant effect of gap condition ( F [1, 80] = 3.68, p = .059, η p 2 = .044), showing that participants in the long gap condition were more accurate ( M = .64) than those in the short gap condition ( M = .56).”
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“or interaction between presentation style and order of presentation ( F [5, 110] = .64, p = .66, η p 2 = .03).”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“None of the interactions approached significance.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“there was no effect of order of presentation ( F [5, 110] = 1.39, p = .23, η p 2 = .06)”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Painters presented under spaced conditions were identified faster than those under massed conditions ( M = 3970.40 and M = 4429.97, respectively, ( F [1, 80] = 15.55, p < .001, η p 2 = .163).”
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
33 more claims
Create a free account to see all 78 claims and to verify the 23 references still open.
- It may state two separate claims as one. 30
- Probably not a substantial claim. 12
- The quote only partly states this claim. 3
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Interleaving superior, correlation with working memory capacity small and non-significant.”
From A systematic review of interleaving as a concept learning strategy (2021) · cites this paper as Guzman-Munoz (2017)
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“In an apparently contradictory finding, Guzman-Munoz (2017) found a marginal correlation-significant when findings from his three experiments were pooled-which suggested that high-WM learners benefit more from interleaving.”
From A systematic review of interleaving as a concept learning strategy (2021) · cites this paper as Guzman-Munoz (2017)
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Interleaving superior, with a marginal interaction with working memory (slightly greater advantage for high WM individuals).”
From A systematic review of interleaving as a concept learning strategy (2021) · cites this paper as Guzman-Munoz (2017)
The cited source says what the claim attributes to it.
In the citing paper
“concluded that mixing advantage is mainly due to interleaving, not spacing.”
From A systematic review of interleaving as a concept learning strategy (2021) · cites this paper as Guzman-Munoz (2017)
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated major: it would touch a result — a value a result rests on, reported and recomputed p-values on opposite sides of the significance level, two passages that conflict with no sign which is right, or a cited work retracted before this paper was published.
In the paper
§ Working memory capacity and accuracy in the immediate test
“The marginal interaction shows a relatively bigger spacing effect in the case of high WMC individuals (see Figure 8).”
§ Procedure
“| Short gap | Low WMC | .42 (.05) | .59 (.05) | .32 (.05) | .53 (.05) | | | High WMC | .42 (.05) | .60 (.05) | .29 (.05) | .51 (.05) | | Long gap | Low WMC | .51 (.05) | .56 (.05) | .40 (.05) | .58 (.05) | | | High WMC | .67 (.05) | .56 (.05) | .40 (.05) | .57 (.06) |”
Rated major: it would touch a result — a value a result rests on, reported and recomputed p-values on opposite sides of the significance level, two passages that conflict with no sign which is right, or a cited work retracted before this paper was published.
In the paper
§ Classification of studied items
“Painters presented under spaced conditions were identified faster than those under massed conditions ( M = 3970.40 and M = 4429.97, respectively”
§ Classification of new items
“| Short gap | Low WMC | .45 (.06) | 4029 (262) | .59 (.05) | 3311 (252) | | | High WMC | .48 (.05) | 3930 (222) | .72 (.04) | 3857 (213) | | Long gap | Low WMC | .56 (.05) | 4246 (227) | .72 (.04) | 3920 (218) | | Long gap | High WMC | .54 (.06) | 4331 (270) | .76 (.05) | 3756 (259) |”
Rated major: it would touch a result — a value a result rests on, reported and recomputed p-values on opposite sides of the significance level, two passages that conflict with no sign which is right, or a cited work retracted before this paper was published.
In the paper
§ Procedure
“| Long gap | Massed | .44 (.03) | .36 (.03) |”
§ Procedure
“| Long gap | Low WMC | .51 (.05) | .56 (.05) | .40 (.05) | .58 (.05) | | | High WMC | .67 (.05) | .56 (.05) | .40 (.05) | .57 (.06) |”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Classification of studied items
“WMC ( F [1, 86] = .11, p = .739, η p 2 = .001)”
§ Classification of studied items
“gap condition ( F [1, 80] = 1.04, p = .309, η p 2 = .013)”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
“( t [23] = 4.1, p < .001)”
Reported 23 · recomputed 22
1 more finding
Create a free account to see every finding of this check.
Citations
Cites
Dunlosky, J., Rawson, K. A., Marsh, E. J., Nathan, M. J., & Willingham, D. T. (2013) · Psychological Science in the Public Interest · doi:10.1177/1529100612453266 · Cited by 3,138
Working memory span tasks: A methodological review and user’s guide
Conway, A. R. A., Kane, M. J., Bunting, M. F., Hambrick, D. Z., Wilhelm, O., & Engle, R. W. (2005) · Psychonomic Bulletin & Review · doi:10.3758/bf03196772 · Cited by 2,882 · cited 2×
“We conceptualise working memory (WM) following Engle and colleagues (Conway et al., 2005) as a multicomponent system responsible for keeping information active under the interference of ongoing processing activities.”
MethodKane, M. J., Hambrick, D. Z., Tuholski, S. W., Wilhelm, O., Payne, T. W., & Engle, R. W. (2004) · Journal of Experimental Psychology: General · doi:10.1037/0096-3445.133.2.189 · Cited by 1,679 · cited 5×
“Kang and Pashler (2012) used paintings (difficult to discriminate categories) and compared four different conditions: simultaneous presentation of same category examples, simultaneous presentation of different category examples, massed and interleaved. Their results showed no difference between the simultaneous-differ…”
BackgroundMethodResultInfluentialMemory and Metamemory Considerations in the Training of Human Beings
Bjork, R. A. (1994) · Metacognition · doi:10.7551/mitpress/4561.003.0011 · Cited by 1,084 · cited 12×
“The first experiment broadly replicated the basic design of Kornell and Bjork (2008), where presentation style is manipulated within-subjects and induction is tested in an immediate test.”
BackgroundMethodResultInfluentialMetacognition: Knowing about Knowing
Allen, B. (1995) · Information Processing & Management · doi:10.1016/0306-4573(95)80050-4 · Cited by 878
Learning Concepts and Categories: Is Spacing the “Enemy of Induction”?
Kornell, N., & Bjork, R. A. (2008) · Psychological Science · doi:10.1111/j.1467-9280.2008.02127.x · Cited by 602 · cited 11×
“As in Experiments 1 and 2, we used 10 paintings by the 12 authors introduced by Kornell and Bjork (2008).”
BackgroundMethodResultInfluentialThe spacing effect: A case study in the failure to apply the results of psychological research.
Dempster, F. N. (1988) · American Psychologist · doi:10.1037/0003-066x.43.8.627 · Cited by 439 · cited 1×
“From a practical point of view, the results show that applying current research to educational practice is an even more urgent matter than it was previously thought (Bjork, 1994; Dempster, 1988; Rohrer, 2012), as the loss might be greatest with the brightest learners.”
BackgroundThe shuffling of mathematics problems improves learning
Rohrer, D., & Taylor, K. (2007) · Instructional Science · doi:10.1007/s11251-007-9015-8 · Cited by 357 · cited 1×
“Rohrer and Taylor (2007) illustrate the idea of distributed retrieval with a task of learning to solve mathematical problems.”
BackgroundThe mechanisms of working memory capacity: Primary memory, secondary memory, and attention control
Shipstead, Z., Lindsey, D. R. B., Marshall, R. L., & Engle, R. W. (2014) · Journal of Memory and Language · doi:10.1016/j.jml.2014.01.004 · Cited by 330
Optimizing distributed practice
Cepeda, N. J., Coburn, N., Rohrer, D., Wixted, J. T., Mozer, M. C., & Pashler, H. (2009) · Experimental Psychology · doi:10.1027/1618-3169.56.4.236 · Cited by 296 · cited 3×
“In addition, a delayed test was added to check the possibility that the effect of gap would show more strongly after a meaningful delay between study and test phases (Cepeda et al., 2009).”
BackgroundInfluential
Research works printed but not linked: 2
- Cohen J., 1988, Statistical power analysis for the behavioural sciences
- Schneider W., 2002, E-prime reference guide
Cited by
A systematic review of interleaving as a concept learning strategy
Firth, J., Rivers, I., & Boyle, J. (2021) · Review of Education · doi:10.1002/rev3.3266 · Cited by 65
Chen, O., Paas, F., & Sweller, J. (2021) · Educational Psychology Review · doi:10.1007/s10648-021-09613-w · Cited by 62
“…types of cases of psychopathological disorders 1.03 Wang et al. (2020a) Similar: Contrasting and discriminating word pairs or picture pairs / Guzman-Munoz (2017) Similar: Contrasting and discriminating paintings from the same artist or other artists 1.54 Zulkiply (2015) Similar:…”
BackgroundInfluentialEffects of inductive learning and gamification on news veracity discernment.
Modirrousta-Galian, A., Higham, P. A., & Seabrooke, T. (2023) · Journal of Experimental Psychology Applied · doi:10.1037/xap0000458 · Cited by 44
Visual category learning: Navigating the intersection of rules and similarity
Hughes, G. I., & Thomas, A. K. (2021) · Psychonomic Bulletin & Review · doi:10.3758/s13423-020-01838-0 · Cited by 21
Sana, F., & Fenesi, B. (2025) · Behavioral Sciences · doi:10.3390/bs15060765 · Cited by 26
The Robustness of the Interleaving Benefit
Yan, V. X., & Sana, F. (2021) · Journal of Applied Research in Memory and Cognition · doi:10.1016/j.jarmac.2021.05.002 · Cited by 25
The benefit of interleaved presentation in category learning is independent of working memory
Wang, J., Liu, Z., Xing, Q., & Seger, C. A. (2020) · Memory · doi:10.1080/09658211.2019.1705490 · Cited by 14
“Sana et al. (2018) found no relation between WMC and the interleaving effect, whereas Guzman-Munoz (2017) found that those with higher WMC showed a trend towards profiting more from interleaving.”
BackgroundMethodInfluentialMetacognitive changes and sources of confidence judgements in health professions classroom learning
Persky, A. M., & Dinsmore, D. L. (2019) · Currents in Pharmacy Teaching and Learning · doi:10.1016/j.cptl.2019.01.005 · Cited by 12
Pan, S. C., Yu, L., Hong, Y., Wong, M. J., Selvarajan, G., & Kaku, M. E. (2024) · Learning and Individual Differences · doi:10.1016/j.lindif.2024.102603 · Cited by 9
A Systematic Review of Interleaving as a Concept Learning Strategy
Firth, J., Rivers, I., & Boyle, J. (2019) · Social Science Protocols · doi:10.7565/ssp.2019.2650 · Cited by 8
Ge, Y., Li, F., Li, X., & Li, W. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2021.770885 · Cited by 8
“For example, to identify a specific painter’s style, people must be able to identify patterns that differ from those present in paintings by others (Kornell and Bjork, 2008; Kang and Pashler, 2012; Guzman-Munoz, 2016).”
BackgroundConstraints on the use of the memorizing effort heuristic
Laursen, S. J., & Fiacconi, C. M. (2021) · Metacognition and Learning · doi:10.1007/s11409-021-09273-9 · Cited by 7
“Although previous research has demonstrated a benefit in retrieval when interleaving, as compared to massing study (Brunmair & Richter, 2019; Guzman-Munoz, 2017), the results of the current research suggest that this highly endorsed practice could potentially affect the accuracy with which students…”
ResultRetrieval practice and verbal-visuospatial transfer: From memorization to inductive learning
Hughes, G. I., & Thomas, A. K. (2022) · Journal of Memory and Language · doi:10.1016/j.jml.2022.104402 · Cited by 3
“Many of these studies examine the influence of interleaving the study of category exemplars in an alternating fashion (see, Kornell & Bjork, 2008; Guzman-Munoz, 2017; Kang & Pashler, 2012).”
BackgroundEffects of Inductive Learning and Gamification on News Veracity DiscernmentPreprint
Modirrousta-Galian, A., Higham, P. A., & Seabrooke, T. (2022) · doi:10.31234/osf.io/4wfds · Cited by 3
An Inductive Learning Intervention to Improve News Veracity DiscernmentPreprint
Modirrousta-Galian, A., Seabrooke, T., Hanoch, Y., Kelley, N. J., & Higham, P. A. (2024) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/6j7fr · Cited by 3
Spacing effects in learning and memory
Carpenter, S. K., & Pan, S. C. (2024) · Elsevier eBooks · doi:10.1016/b978-0-443-15754-7.00020-1 · Cited by 5
Designing Social Sciences Worksheets Based on Ethnoscience: A natural stone artisans community
Basyari, I. W., Herawan, E., & Hartini, A. (2019) · doi:10.2991/isseh-18.2019.75 · Cited by 1
“Using specific real examples can distribute the knowledge into long-term memory [19].”
BackgroundCasey, D. (2018) · Arrow - TU Dublin (Technological University Dublin) · doi:10.21427/d7q526 · Cited by 1
“The interleaving effect has been shown to be separate from the spacing effect and also stands without any spacing (Guzman-Munoz, 2017).”
BackgroundInfluentialCheng, Y. (2017) · Educational Psychology · doi:10.1080/01443410.2017.1304644 · Cited by 1
“Guzman-Munoz (2017) examines the aspect of how inductive learning can be promoted by a”
BackgroundThe spacing effect in remote information-integration category learning
Cruz, A., & Minda, J. P. (2024) · Memory & Cognition · doi:10.3758/s13421-024-01569-w · Cited by 1
The Spacing Effect in Remote Information-Integration Category LearningPreprint
Cruz, A., & Minda, J. P. (2022) · doi:10.31234/osf.io/8yhfx
Carr-White, N. (2021) · Research Online (Edith Cowan University) · Cited by 1
Metadata
- Authors
- Guzman-Munoz, F. J.
- Venue
- Educational Psychology
- Publisher
- Informa UK Limited
- Published
- 2016-01-11
- Volume
- 37
- Issue
- 4
- Pages
- 421-437
- ISSN
- 0144-3410 (ISSN-L)
- 1469-5820
- OpenAlex
- W2275976124
- Semantic Scholar
- a10dccc8505c204c3d8285615c7aa8e0cfff0411
- Cited by
- 22
- References
- 24
- Citations by year
- 2025: 2 · 2024: 4 · 2023: 1 · 2022: 2 · 2021: 7 · 2020: 1 · 2019: 3 · 2018: 1 · 2017: 1
- FWCI
- 2.37
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Educational Psychology (publishedVersion, cc-by-nc-nd)
- University of Groningen research database (University of Groningen / Centre for Information Technology) (publishedVersion, cc-by-nc-nd)
- Data Archiving and Networked Services (DANS) (submittedVersion, cc-by-nc-nd)
- University of Groningen research database (University of Groningen / Centre for Information Technology) (submittedVersion, cc-by-nc-nd)
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Visual and Cognitive Learning Processes
- Life Sciences › Neuroscience › Cognitive Neuroscience › Memory Processes and Influences
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Categorization, perception, and language
- Keywords
- interleaving, massing, inductive learning, time gap, working memory capacity, individual differences, practice schedules, individualised learning
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-09-29, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-09-29 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.