The advantage of mixing examples in inductive learning: a comparison of three hypotheses
Open accessThe DOI matches its Crossref record; 24 of the 24 references it cites were found in a registry or an index; none of the 23 sources its claims cite is checked for support yet.
Abstract
Mixing examples of different categories (interleaving) has been shown to promote inductive learning as compared with presenting examples of the same category together (massing). In three studies, we tested whether the advantage of interleaving is exclusively due to the mixing of examples from different categories or to the temporal gap introduced between presentations. In addition, we also tested the role of working memory capacity (WMC). Results showed that the mixing of examples might be the key component that determines improved induction. WMC might also be involved in the interleaving effect: participants with high spans seemed to profit more than participants with low spans from interleaved presentations. Our findings have relevant implications for education. Practice schedules should be individually customised so society as a whole can profit from differences between learners.
Overview
CoChat Summary
TL;DR
Three experiments tested whether the advantage of mixing examples in inductive learning is due to interleaving, temporal spacing, attention attenuation, or working memory capacity. The results consistently favored spaced/interleaved over massed presentation, found little support for temporal gap or attention-attenuation accounts, and showed preliminary evidence linking WMC to the interleaving effect.
Key findings
- Spaced/interleaved presentation consistently outperformed massed presentation: Experiment 1 new-item classification was .62 vs. .39, \(t[23]=4.1, p<.001\), and studied-item accuracy was .63 vs. .44, \(F[1,22]=18.75, p<.001\); Experiment 2 new-item accuracy was .68 vs. .47, \(F[1,80]=47.61, p<.001\); Experiment 3 immediate test accuracy was .56 vs. .38, \(F[1,113]=71.51, p<.001\), and delayed test accuracy was .54 vs. .35, \(F[1,95]=40.25, p<.001\).
- Temporal gap did not clearly drive the effect: in Experiment 2 the long-gap advantage was marginal for new items (.62 vs. .53, \(p=.051\)) and studied items (.64 vs. .56, \(p=.059\)); in Experiment 3, temporal gap was non-significant in the immediate test (\(p=.562\)) and only marginal in the delayed test (\(p=.056\)).
- Attention-attenuation was not supported: tests of studied items showed no effect of order of presentation in Experiment 1 or Experiment 2, and participants often misjudged massing as better (61% in Experiment 1, 52% in Experiment 2, 63% in Experiment 3 thought massing was better or equal, while 74%, 70%, and 60% respectively did better under spaced conditions).
- WMC showed preliminary links to spacing: Experiment 2 found high WMC more accurate than low WMC (.63 vs. .53, \(p=.039\)) and a marginal presentation-style × WMC interaction (\(p=.094\)); Experiment 3 immediate test had a marginal interaction (\(p=.083\)); combined across experiments (\(N=208\)), WMC correlated with spaced-item accuracy (\(r=.141, p=.042\)) but not massed-item accuracy (\(r=.107, p=.123\)).
Methods
- Three experiments with University of Groningen undergraduates: Experiment 1 \(N=23\), Experiment 2 \(N=88\) with 4 excluded, and Experiment 3 \(N=118\) with 3 missing the delayed test and 15 excluded from WMC analyses.
- Materials were 10 paintings by each of 12 relatively unknown artists from Kornell and Bjork (2008); 6 paintings per artist were studied, and new paintings were used for classification tests. WMC was measured with an automated symmetry span task.
- Presentation style (massed vs. spaced/interleaved) was manipulated within subjects; Experiments 2 and 3 added a between-subjects temporal-gap manipulation, and Experiment 3 added a next-day delayed test. Analyses used mixed ANOVAs, median splits for WMC, and combined correlational analysis.
Limitations
- The paper states that Experiment 1 had a small sample, that WMC was split by median and may not capture extreme differences, and that the WMC effects were only marginal or preliminary.
- The paper notes that Experiment 2’s temporal-gap manipulation extended presentation time, adding extra study time as a confound, which Experiment 3 attempted to control.
- Evident from the text: the WMC evidence rests on marginal interactions and a small combined correlation, and the attention-attenuation conclusion is based on failure to replicate order effects rather than direct support for an alternative attention mechanism.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
0 Valid · 0 Not valid · 16 Not checked · 62 Own results and interpretations
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“There was also a marginally significant effect of gap condition ( F [1, 80] = 3.68, p = .059, η p 2 = .044), showing that participants in the long gap condition were more accurate ( M = .64) than those in the short gap condition ( M = .56).”
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“or interaction between presentation style and order of presentation ( F [5, 110] = .64, p = .66, η p 2 = .03).”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“None of the interactions approached significance.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“there was no effect of order of presentation ( F [5, 110] = 1.39, p = .23, η p 2 = .06)”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Painters presented under spaced conditions were identified faster than those under massed conditions ( M = 3970.40 and M = 4429.97, respectively, ( F [1, 80] = 15.55, p < .001, η p 2 = .163).”
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
33 more claims
Create a free account to see all 78 claims and to verify the 23 references still open.
- It may state two separate claims as one. 30
- Probably not a substantial claim. 12
- The quote only partly states this claim. 3
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Interleaving superior, correlation with working memory capacity small and non-significant.”
From A systematic review of interleaving as a concept learning strategy (2021) · cites this paper as Guzman-Munoz (2017)
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“In an apparently contradictory finding, Guzman-Munoz (2017) found a marginal correlation-significant when findings from his three experiments were pooled-which suggested that high-WM learners benefit more from interleaving.”
From A systematic review of interleaving as a concept learning strategy (2021) · cites this paper as Guzman-Munoz (2017)
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Interleaving superior, with a marginal interaction with working memory (slightly greater advantage for high WM individuals).”
From A systematic review of interleaving as a concept learning strategy (2021) · cites this paper as Guzman-Munoz (2017)
The cited source says what the claim attributes to it.
In the citing paper
“concluded that mixing advantage is mainly due to interleaving, not spacing.”
From A systematic review of interleaving as a concept learning strategy (2021) · cites this paper as Guzman-Munoz (2017)
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated major: it would touch a result — a value a result rests on, reported and recomputed p-values on opposite sides of the significance level, two passages that conflict with no sign which is right, or a cited work retracted before this paper was published.
In the paper
§ Working memory capacity and accuracy in the immediate test
“The marginal interaction shows a relatively bigger spacing effect in the case of high WMC individuals (see Figure 8).”
§ Procedure
“| Short gap | Low WMC | .42 (.05) | .59 (.05) | .32 (.05) | .53 (.05) | | | High WMC | .42 (.05) | .60 (.05) | .29 (.05) | .51 (.05) | | Long gap | Low WMC | .51 (.05) | .56 (.05) | .40 (.05) | .58 (.05) | | | High WMC | .67 (.05) | .56 (.05) | .40 (.05) | .57 (.06) |”
Rated major: it would touch a result — a value a result rests on, reported and recomputed p-values on opposite sides of the significance level, two passages that conflict with no sign which is right, or a cited work retracted before this paper was published.
In the paper
§ Classification of studied items
“Painters presented under spaced conditions were identified faster than those under massed conditions ( M = 3970.40 and M = 4429.97, respectively”
§ Classification of new items
“| Short gap | Low WMC | .45 (.06) | 4029 (262) | .59 (.05) | 3311 (252) | | | High WMC | .48 (.05) | 3930 (222) | .72 (.04) | 3857 (213) | | Long gap | Low WMC | .56 (.05) | 4246 (227) | .72 (.04) | 3920 (218) | | Long gap | High WMC | .54 (.06) | 4331 (270) | .76 (.05) | 3756 (259) |”
Rated major: it would touch a result — a value a result rests on, reported and recomputed p-values on opposite sides of the significance level, two passages that conflict with no sign which is right, or a cited work retracted before this paper was published.
In the paper
§ Procedure
“| Long gap | Massed | .44 (.03) | .36 (.03) |”
§ Procedure
“| Long gap | Low WMC | .51 (.05) | .56 (.05) | .40 (.05) | .58 (.05) | | | High WMC | .67 (.05) | .56 (.05) | .40 (.05) | .57 (.06) |”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Classification of studied items
“WMC ( F [1, 86] = .11, p = .739, η p 2 = .001)”
§ Classification of studied items
“gap condition ( F [1, 80] = 1.04, p = .309, η p 2 = .013)”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
“( t [23] = 4.1, p < .001)”
Reported 23 · recomputed 22
1 more finding
Create a free account to see every finding of this check.
Citations
Cites
Dunlosky, J., Rawson, K. A., Marsh, E. J., Nathan, M. J., & Willingham, D. T. (2013) · Psychological Science in the Public Interest · doi:10.1177/1529100612453266 · Cited by 3,138
Working memory span tasks: A methodological review and user’s guide
Conway, A. R. A., Kane, M. J., Bunting, M. F., Hambrick, D. Z., Wilhelm, O., & Engle, R. W. (2005) · Psychonomic Bulletin & Review · doi:10.3758/bf03196772 · Cited by 2,882 · cited 2×
“We conceptualise working memory (WM) following Engle and colleagues (Conway et al., 2005) as a multicomponent system responsible for keeping information active under the interference of ongoing processing activities.”
MethodKane, M. J., Hambrick, D. Z., Tuholski, S. W., Wilhelm, O., Payne, T. W., & Engle, R. W. (2004) · Journal of Experimental Psychology: General · doi:10.1037/0096-3445.133.2.189 · Cited by 1,679 · cited 5×
“Kang and Pashler (2012) used paintings (difficult to discriminate categories) and compared four different conditions: simultaneous presentation of same category examples, simultaneous presentation of different category examples, massed and interleaved. Their results showed no difference between the simultaneous-differ…”
BackgroundMethodResultInfluentialMemory and Metamemory Considerations in the Training of Human Beings
Bjork, R. A. (1994) · Metacognition · doi:10.7551/mitpress/4561.003.0011 · Cited by 1,084 · cited 12×
“The first experiment broadly replicated the basic design of Kornell and Bjork (2008), where presentation style is manipulated within-subjects and induction is tested in an immediate test.”
BackgroundMethodResultInfluentialMetacognition: Knowing about Knowing
Allen, B. (1995) · Information Processing & Management · doi:10.1016/0306-4573(95)80050-4 · Cited by 878
Learning Concepts and Categories: Is Spacing the “Enemy of Induction”?
Kornell, N., & Bjork, R. A. (2008) · Psychological Science · doi:10.1111/j.1467-9280.2008.02127.x · Cited by 602 · cited 11×
“As in Experiments 1 and 2, we used 10 paintings by the 12 authors introduced by Kornell and Bjork (2008).”
BackgroundMethodResultInfluentialThe spacing effect: A case study in the failure to apply the results of psychological research.
Dempster, F. N. (1988) · American Psychologist · doi:10.1037/0003-066x.43.8.627 · Cited by 439 · cited 1×
“From a practical point of view, the results show that applying current research to educational practice is an even more urgent matter than it was previously thought (Bjork, 1994; Dempster, 1988; Rohrer, 2012), as the loss might be greatest with the brightest learners.”
BackgroundThe shuffling of mathematics problems improves learning
Rohrer, D., & Taylor, K. (2007) · Instructional Science · doi:10.1007/s11251-007-9015-8 · Cited by 357 · cited 1×
“Rohrer and Taylor (2007) illustrate the idea of distributed retrieval with a task of learning to solve mathematical problems.”
BackgroundThe mechanisms of working memory capacity: Primary memory, secondary memory, and attention control
Shipstead, Z., Lindsey, D. R. B., Marshall, R. L., & Engle, R. W. (2014) · Journal of Memory and Language · doi:10.1016/j.jml.2014.01.004 · Cited by 330
Optimizing distributed practice
Cepeda, N. J., Coburn, N., Rohrer, D., Wixted, J. T., Mozer, M. C., & Pashler, H. (2009) · Experimental Psychology · doi:10.1027/1618-3169.56.4.236 · Cited by 296 · cited 3×
“In addition, a delayed test was added to check the possibility that the effect of gap would show more strongly after a meaningful delay between study and test phases (Cepeda et al., 2009).”
BackgroundInfluentialWhy interleaving enhances inductive learning: The roles of discrimination and retrieval
Birnbaum, M. S., Kornell, N., Bjork, E. L., & Bjork, R. A. (2013) · Memory & Cognition · doi:10.3758/s13421-012-0272-7 · Cited by 278 · cited 7×
“This study-phase retrieval account also received support from the previously described study by Birnbaum et al. (2013).”
BackgroundResultInfluential(2010) · Psychology of Learning and Motivation · doi:10.1016/s0079-7421(10)53003-2 · Cited by 255
Learning Painting Styles: Spacing is Advantageous when it Promotes Discriminative Contrast
Kang, S. H. K., & Pashler, H. (2012) · Applied Cognitive Psychology · doi:10.1002/acp.1801 · Cited by 246 · cited 4×
“The results of Kang and Pashler (2012) have since been replicated by zulkiply and Burt (2013) who also found no effect of temporal gap in an inductive learning task.”
BackgroundResultInfluentialSpacing effects and their implications for theory and practice
Dempster, F. N. (1989) · Educational Psychology Review · doi:10.1007/bf01320097 · Cited by 243
Interleaving Helps Students Distinguish among Similar Concepts
Rohrer, D. (2012) · Educational Psychology Review · doi:10.1007/s10648-012-9201-3 · Cited by 218 · cited 2×
“From a practical point of view, the results show that applying current research to educational practice is an even more urgent matter than it was previously thought (Bjork, 1994; Dempster, 1988; Rohrer, 2012), as the loss might be greatest with the brightest learners.”
BackgroundSpacing as the friend of both memory and induction in young and older adults.
Kornell, N., Castel, A. D., Eich, T. S., & Bjork, R. A. (2010) · Psychology and Aging · doi:10.1037/a0017807 · Cited by 179 · cited 2×
“The attention–attenuation hypothesis was also indirectly tested by Kornell et al. (2010) through the comparison of induction and repetition conditions.”
MethodResultWorking memory capacity and retrieval from long-term memory: the role of controlled search
Unsworth, N., Brewer, G. A., & Spillers, G. J. (2012) · Memory & Cognition · doi:10.3758/s13421-012-0261-x · Cited by 174
Wahlheim, C. N., Dunlosky, J., & Jacoby, L. L. (2011) · Memory & Cognition · doi:10.3758/s13421-010-0063-y · Cited by 172 · cited 7×
“Their results however failed to show this interaction in marked contrast to those of Wahlheim et al. (2011).”
BackgroundMethodResultInfluentialCarvalho, P. F., & Goldstone, R. L. (2014) · Psychonomic Bulletin & Review · doi:10.3758/s13423-014-0676-4 · Cited by 170 · cited 1×
“Carvalho and Goldstone (2014) also reported a similar interaction between category structure and type of presentation where interleaving helped learning of categories with high degree of similarity, whereas blocking (massing) helped learning of categories with low degree of similarity.”
BackgroundThe spacing effect in children’s memory and category induction
Vlach, H. A., Sandhofer, C. M., & Kornell, N. (2008) · Cognition · doi:10.1016/j.cognition.2008.07.013 · Cited by 165 · cited 1×
“However, Birnbaum, Kornell, Bjork, and Bjork (2013) found that introducing a time interval between examples in a massed condition improved performance (see Vlach, Sandhofer, and Kornell (2008) for a similar result with children).”
BackgroundLogan, J. M., Castel, A. D., Haber, S., & Viehman, E. J. (2012) · Metacognition and Learning · doi:10.1007/s11409-012-9090-3 · Cited by 103 · cited 1×
“Rohrer and Taylor (2007) illustrate the idea of distributed retrieval with a task of learning to solve mathematical problems.”
BackgroundZulkiply, N., & Burt, J. S. (2013) · Memory & Cognition · doi:10.3758/s13421-012-0238-9 · Cited by 92 · cited 4×
“The results of Kang and Pashler (2012) have since been replicated by zulkiply and Burt (2013) who also found no effect of temporal gap in an inductive learning task.”
BackgroundResultInfluentialConcept learning with differing sequences of instances.
Kurtz, K. H., & Hovland, C. I. (1956) · Journal of Experimental Psychology · doi:10.1037/h0040295 · Cited by 60 · cited 1×
“The discrimination hypothesis was first proposed by Kurtz and Hovland (1956) who found that massing examples of simple artificial categories (easy to discriminate) promoted performance in an inductive test, as compared to intermixing examples of different categories.”
BackgroundVoluntary attention and the spacing effect.
Hintzman, D. L., Summers, J. J., Eki, N. T., & Moore, M. D. (1975) · Memory & Cognition · doi:10.3758/bf03197533 · Cited by 34
Research works printed but not linked: 2
- Cohen J., 1988, Statistical power analysis for the behavioural sciences
- Schneider W., 2002, E-prime reference guide
Cited by
A systematic review of interleaving as a concept learning strategy
Firth, J., Rivers, I., & Boyle, J. (2021) · Review of Education · doi:10.1002/rev3.3266 · Cited by 65
Chen, O., Paas, F., & Sweller, J. (2021) · Educational Psychology Review · doi:10.1007/s10648-021-09613-w · Cited by 62
“…types of cases of psychopathological disorders 1.03 Wang et al. (2020a) Similar: Contrasting and discriminating word pairs or picture pairs / Guzman-Munoz (2017) Similar: Contrasting and discriminating paintings from the same artist or other artists 1.54 Zulkiply (2015) Similar:…”
BackgroundInfluentialEffects of inductive learning and gamification on news veracity discernment.
Modirrousta-Galian, A., Higham, P. A., & Seabrooke, T. (2023) · Journal of Experimental Psychology Applied · doi:10.1037/xap0000458 · Cited by 44
Visual category learning: Navigating the intersection of rules and similarity
Hughes, G. I., & Thomas, A. K. (2021) · Psychonomic Bulletin & Review · doi:10.3758/s13423-020-01838-0 · Cited by 21
Sana, F., & Fenesi, B. (2025) · Behavioral Sciences · doi:10.3390/bs15060765 · Cited by 27
Metadata
- Authors
- Guzman-Munoz, F. J.
- Venue
- Educational Psychology
- Publisher
- Informa UK Limited
- Published
- 2016-01-11
- Volume
- 37
- Issue
- 4
- Pages
- 421-437
- ISSN
- 0144-3410 (ISSN-L)
- 1469-5820
- OpenAlex
- W2275976124
- Semantic Scholar
- a10dccc8505c204c3d8285615c7aa8e0cfff0411
- Cited by
- 22
- References
- 24
- Citations by year
- 2025: 2 · 2024: 4 · 2023: 1 · 2022: 2 · 2021: 7 · 2020: 1 · 2019: 3 · 2018: 1 · 2017: 1
- FWCI
- 2.37
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Educational Psychology (publishedVersion, cc-by-nc-nd)
- University of Groningen research database (University of Groningen / Centre for Information Technology) (publishedVersion, cc-by-nc-nd)
- Data Archiving and Networked Services (DANS) (submittedVersion, cc-by-nc-nd)
- University of Groningen research database (University of Groningen / Centre for Information Technology) (submittedVersion, cc-by-nc-nd)
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Visual and Cognitive Learning Processes
- Life Sciences › Neuroscience › Cognitive Neuroscience › Memory Processes and Influences
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Categorization, perception, and language
- Keywords
- interleaving, massing, inductive learning, time gap, working memory capacity, individual differences, practice schedules, individualised learning
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-09-29, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-09-29 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.