Is expanding retrieval a superior method for learning text materials?
Open accessAbstract
Expanding retrieval practice refers to the idea that gradually increasing the spacing interval between repeated tests ought to promote optimal long-term retention. Belief in the superiority of this technique is widespread, but empirical support is scarce. In addition, virtually all research on expanding retrieval has examined the learning of word pairs in paired-associate tasks. We report two experiments in which we examined the learning of text materials with expanding and equally spaced retrieval practice schedules. Subjects studied brief texts and recalled them in an initial learning phase. We manipulated the spacing of the repeated recall tests and examined final recall 1 week later. Overall we found that (1) repeated testing enhanced retention more than did taking a single test, (2) testing with feedback (restudying the passages) produced better retention than testing without feedback, but most importantly (3) there were no differences between expanding and equally spaced schedules of retrieval practice. Repeated retrieval enhanced long-term retention, but how the repeated tests were spaced did not matter.
AI snapshot
Written from the paper’s full text.
TL;DR
In two experiments with expository texts, repeated retrieval improved 1-week retention, and feedback after retrieval further boosted retention, but expanding and equally spaced retrieval schedules did not differ. The spacing schedule of repeated tests did not matter under these conditions.
Key findings
- Expanding versus equally spaced retrieval produced no meaningful differences on final recall 1 week later. In Experiment 1, final recall was .66 for immediate-expanding, .65 for immediate-equal, .53 for delayed-expanding, and .57 for delayed-equal; in Experiment 2, no-feedback final recall was .55/.53 (immediate expanding/equal) and .45/.52 (delayed expanding/equal), and feedback final recall was .80/.78 and .84/.83.
- Repeated testing enhanced long-term retention more than a single test. In Experiment 2 no-feedback conditions, single-test final recall was .37 (immediate) and .32 (delayed), while repeated-test conditions ranged from .45 to .55; in feedback conditions, single-test final recall was .34 and .46, while repeated-test conditions ranged from .78 to .84.
- Feedback after retrieval improved retention. In Experiment 2, repeated-test data showed a main effect of feedback [F(1,60) = 59.65], and repeated retrieval with feedback produced a greater than 400% improvement in long-term retention relative to studying the texts once.
- Subjects recalled texts in forward serial order rather than recalling the last ideas first: average recall-output/input-order correlations were r = .89 in Experiment 1 and r = .81 in Experiment 2, and no subject recalled the last passage ideas first.
Methods
- Experiment 1: 80 Washington University undergraduates studied two brief passages (Bamboo and Vanuatu; 162 and 155 words; 20 idea units each) and took three free recall tests. The design crossed first-test position (immediate vs. delayed) with repeated-test spacing (expanding vs. equal): 0-2-4, 0-2-2, 2-2-4, and 2-2-2 schedules; final recall occurred 1 week later.
- Experiment 2: 64 Washington University undergraduates studied four critical passages (Bamboo, Diving, Eugene O’Neill, Vanuatu; 20 idea units each) plus filler passages. Learning condition was within subjects (study only, single test, expanding retrieval, equally spaced retrieval), while first-test position (immediate vs. delayed) and feedback (feedback vs. no feedback) were between subjects; final recall occurred 1 week later.
- Free recall was scored by idea units; 40 tests were double-scored in each experiment, with interrater correlations of r = .98 (Experiment 1) and r = .97 (Experiment 2). Analyses used ANOVAs comparing first-test position, spacing schedule, test number, repeated testing, and feedback.
Limitations
- Stated: the authors note that differences between expanding and equally spaced schedules might emerge with different paradigm features, such as conditions producing rapid intertest forgetting or much longer delays between tests (perhaps days apart), but say these are empirical questions not yet sufficiently examined.
- Stated: in Experiment 2, the authors could “only speculate” about why the immediate and delayed first-test groups did not differ on the initial test in the feedback conditions.
- Evident: both experiments used brief expository texts, undergraduate samples, and within-session spacing intervals of minutes (total lags of 6–8 min), so the null expanding-versus-equal result may not generalize to longer intervals, other materials, or other populations.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
0 of 40 cited sources checked · 0 supported · 0 flagged
- Findingown data
There are no differences between expanding and equally spaced schedules of retrieval practice for learning text materials.
“there were no differences between expanding and equally spaced schedules of retrieval practice”
- Also stated in: § Abstract · plain
“how the repeated tests were spaced did not matter”
Quote in the paperSubstantial claim - Also stated in: § Abstract · plain
- Findingown data
In Experiment 1, groups with an immediate first recall test recalled more idea units during the initial learning phase than groups with a delayed first test.
“In general the two groups with an immediate first test recalled more idea units than did the two groups with a delayed first test.”
- Also stated in: § Initial recall. · hedged
“There was a main effect of initial test position [F(1,76) 20.27, p 2 .21],indicating that delaying the first test produced forgetting.”
Quote in the paperNot a substantial claim - Also stated in: § Initial recall. · hedged
- Findingown data
Testing with feedback (restudying the passages) produces better retention than testing without feedback.
“testing with feedback (restudying the passages) produced better retention than testing without feedback”
Quote in the paperSubstantial claim - Findingown data
In Experiment 1, recall increased modestly across the three initial tests (hypermnesia).
“There was also a main effect of test number [F(2,152) 4.43, p 2 .06], indicating that a modest amount of hypermnesia occurred across the three tests.”
Quote in the paperNot a substantial claim - Findingown data
Repeated retrieval practice enhances long-term retention more than taking a single test.
“Overall we found that (1) repeated testing enhanced retention more than did taking a single test”
Quote in the paperSubstantial claim
- Findingown data
In Experiment 2 no-feedback initial recall, expanding versus equal spacing did not affect recall.
“But there was no main effect of spacing schedule and no interaction (Fs 1).”
Quote in the paperNot a substantial claim - Findingown data
In Experiment 2 no-feedback conditions, the immediate test group recalled more than the delayed test group during the learning phase.
“The immediate test group recalled more than the delayed test group during the learning phase, and the advantage was due to increased recall on the immediate first test.”
Quote in the paperNot a substantial claim - Findingown data
In Experiment 1, the serial recall retrieval strategy did not depend on the text, test number, or spacing condition.
“The serial recall retrieval strategy did not depend on the text or the test number or the spacing condition.”
Quote in the paperNot a substantial claim - Findingown data
In Experiment 2, in the repeated-test conditions, there was a main effect of feedback.
“This analysis showed only a main effect of feedback [F(1,60) 59.65, p 2 .50].”
Quote in the paperNot a substantial claim - Findingown data
In Experiment 2, repeated testing had a main effect on learning-phase recall in the feedback conditions.
“There was a main effect of repeated testing [F(1,30) 264.16, p 2 .90]”
Quote in the paperSubstantial claim - Findingown data
In Experiment 2, the benefit of feedback in the single-test condition appeared only when the first test occurred after a delay.
“The benefit of feedback in the single test condition appeared only when the first test occurred after a delay.”
- Also stated in: § Materials. · plain
“A pairwise analysis showed that there was no effect of feedback for the immediate first test groups (F 1), but there was an effect for the delayed test groups [F(1,30) 6.20, p 2 .17].”
Quote in the paperNot a substantial claim - Also stated in: § Materials. · plain
- Findingown data
In Experiment 2, there were also significant testing effects in the feedback groups.
“There were also significant testing effects in the feedback groups.”
Quote in the paperNot a substantial claim - Findingown data
In the present experiments (Experiments 1 and 2), expanding and equally spaced schedules of repeated retrieval practice did not differ meaningfully in their effect on long-term retention.
“Third-and most important-there were no discernible differences in the effect of expanding and equally spaced retrieval practice on long-term retention.”
- Also stated in: § Discussion · plain
“The critical finding from Experiment 2 was that there was no difference between expanding and equally spaced schedules of retrieval practice.”
- Also stated in: § GENERAL DISCUSSION · plain
“But most importantly, in both experiments there were no meaningful differences between expanding and equally spaced schedules of repeated testing.”
Quote in the paperSubstantial claim - Also stated in: § Discussion · plain
- Findingown data
In Experiment 2, repeated testing had a main effect on learning-phase recall in the no-feedback conditions.
“There was a main effect of repeated testing [F(1,30) 38.25, p 2 .56]”
Quote in the paperSubstantial claim - Findingown data
In Experiment 2, in the single-test conditions, there was a significant interaction between feedback and position of the first test.
“but there was a significant interaction [F(1,60) 4.69, p 2 .07].”
Quote in the paperNot a substantial claim - Findingown data
In Experiment 2, repeated retrieval of the texts with feedback produced a greater than 400% improvement in long-term retention relative to just studying the texts one time.
“Indeed, repeated retrieval of the texts with feedback produced a greater than 400% improvement in long-term retention relative to just studying the texts one time.”
Quote in the paperSubstantial claim - Findingown data
In Experiment 2, repeated retrieval practice enhanced retention relative to practicing retrieval once on a single test, in both feedback and no-feedback conditions.
“Second, repeated testing enhanced learning beyond taking just a single test.This occurred in both the feedback and no-feedback conditions.”
- Also stated in: § GENERAL DISCUSSION · plain
“Second, repeated retrieval practice enhanced retention relative to practicing retrieval once on a single test.”
Quote in the paperSubstantial claim - Also stated in: § GENERAL DISCUSSION · plain
- Findingown data
In Experiment 2, subjects recalled ideas in forward serial order.
“The figure shows that the subjects recalled ideas in forward serial order.”
- Also stated in: § Materials. · plain
“The overall average Pearson correlation between recall output order and input order was r .81.”
- Also stated in: § Materials. · plain
“Subjects did not recall the most recent ideas first but instead recalled the ideas in serial order to the best of their abilities.”
Quote in the paperNot a substantial claim - Also stated in: § Materials. · plain
- Findingown data
In Experiment 2, there was no difference in performance on the initial test between immediate and delayed first test conditions.
“First, there did not appear to be a difference in performances on the initial test in the immediate and delayed conditions.”
- Also stated in: § Discussion · plain
“A 2 (position of the first test) 3 (learning condition) ANOVA confirmed that there was no main effect of initial test on Test 1 recall (F 1), no main effect of condition [F(2,60) 1.25, n.s.], and no interaction (F 1).”
Quote in the paperNot a substantial claim - Also stated in: § Discussion · plain
- Findingown data
In Experiment 2, recall increased across repeated tests with feedback.
“There was a main effect of test number [F(3,93) 154.41, p 2 .83],reflecting the fact that recall increased across repeated tests with feedback.”
Quote in the paperNot a substantial claim - Findingown data
In Experiment 2, there was no main effect of spacing schedule (expanding vs. equal) on learning-phase recall in the no-feedback conditions.
“There was no main effect of spacing schedule (F 1), no main effect of position of the first test (F 1), and no interaction [F(1,30) 2.22, n.s.].”
Quote in the paperSubstantial claim - Findingown data
In Experiment 2, there was no main effect of spacing schedule (expanding vs. equal) on learning-phase recall in the feedback conditions.
“Again there was no main effect of spacing condition (F 1), no main effect of position of the first test [F(1,30) 1.35, n.s.], and no interaction (F 1).”
- Also stated in: § Discussion · plain
“There was no main effect of spacing schedule [F(1,30) 1.65, n.s.] and no interaction [F(3,93) 1.02, n.s.].”
Quote in the paperSubstantial claim - Also stated in: § Discussion · plain
- Findingown data
In Experiment 2, in the single-test conditions, there was no significant overall effect of feedback.
“There was no significant overall effect of feedback [F(1,30) 1.90, n.s.]”
Quote in the paperNot a substantial claim - Findingown data
In Experiment 2, in the feedback groups, a delayed first test produced better long-term retention than an immediate first test.
“In fact, in the feedback conditions we found that a delayed first test produced better retention than an immediate first test.”
- Also stated in: § Final recall. · plain
“and a main effect of position of the first test [F(1,30) 4.63, p 2 .13]”
Quote in the paperSubstantial claim - Also stated in: § Final recall. · plain
- Findingown data
In Experiment 2, rereading the texts after recalling them (feedback) improved learning and long-term retention.
“Third, rereading the texts after recalling them (and thus receiving feedback after the tests) improved learning and long-term retention.”
- Also stated in: § CONCLUSION · boosted
“The positive effects of retrieval practice are especially great when students receive feedback after retrieval attempts (by rereading texts after attempting recall).”
Quote in the paperSubstantial claim - Also stated in: § CONCLUSION · boosted
- Findingown data
In Experiment 1, taking an immediate first test improved long-term retention.
“In Experiment 1 we found that taking an immediate first test improved long-term retention, probably because of their increased retrieval success on that test.”
Quote in the paperSubstantial claim - Findingown data
In Experiment 2 no-feedback conditions, the pattern of immediate first test improving retention was not found.
“However, we did not find this pattern in the no-feedback conditions in Experiment 2.”
Quote in the paperSubstantial claim - Premisecitation
Landauer and Bjork (1978) found that an expanding retrieval condition produced about a 10% advantage over an equally spaced condition on a final recall test 30 min after learning.
“But the important result was that the expanding condition produced about a 10% advantage over the equally spaced condition on the final test.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Landauer and Bjork (1978)
Not checked in the free run.
- Premisecitation
Practicing retrieval enhances long-term retention.
“We know that practicing retrieval enhances long-term retention (e.g., Karpicke & Roediger, 2008;Roediger & Karpicke, 2006a)”
Quote in the paperSubstantial claim0 of 2 sources checked- cites Karpicke & Roediger, 2008
Not checked in the free run.
- cites Roediger & Karpicke, 2006a
Not checked in the free run.
- Premisecitation
Spacing repetitions enhances retention.
“we also know that spacing repetitions enhances retention (e.g., Glenberg, 1976;Greene, 1989Greene, , 2008;;Rohrer & Pashler, 2007).”
Quote in the paperSubstantial claim0 of 3 sources checked- cites Glenberg, 1976
Not checked in the free run.
- cites Greene, 1989
Not checked in the free run.
- cites Rohrer & Pashler, 2007
Not checked in the free run.
- Premisecitation
Increasing the spacing intervals between study periods tends to produce increasing gains in learning, especially when retention is assessed at long intervals.
“It is true that increasing the spacing intervals between study periods tends to produce increasing gains in learning, especially when retention is assessed at long intervals (Glenberg, 1976;Greene, 2008).”
Quote in the paperSubstantial claim0 of 2 sources checked- cites Glenberg, 1976
Not checked in the free run.
- cites Greene, 2008
Not checked in the free run.
- Premisecitation
In the authors' previous paired-associate experiments, 2 days after learning, the equally spaced retrieval condition produced better retention than did expanding retrieval.
“However, 2 days after the learning phase, the equally spaced retrieval condition produced better retention than did expanding retrieval.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Karpicke & Roediger, 2007a
Not checked in the free run.
- Premiseown data
In the authors' previous paired-associate experiments with feedback after each test, equally spaced practice was superior to expanding retrieval at the 2-day interval.
“We also examined performance with feedback after each test and again found that equally spaced practice was superior to expanding retrieval at the 2-day interval.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Karpicke & Roediger, 2007a
Not checked in the free run.
- Premisecitation
Cull, Shaughnessy, and Zechmeister (1996) did not find significant effects of expanding retrieval over equally spaced retrieval in three of five experiments with short retention intervals.
“For instance, Cull, Shaughnessy, and Zechmeister (1996) did not find significant effects of expanding retrieval over equally spaced retrieval in three of five experiments with short retention intervals (see too Carpenter & DeLosh, 2005;Pyc & Rawson, 2007).”
Quote in the paperSubstantial claim0 of 3 sources checked- cites Cull, Shaughnessy, and Zechmeister (1996)
Not checked in the free run.
- cites Carpenter & DeLosh, 2005
Not checked in the free run.
- cites Pyc & Rawson, 2007
Not checked in the free run.
- Premisecitation
The empirical evidence endorsing the superiority of expanding retrieval is mixed.
“But the empirical evidence endorsing the superiority of expanding retrieval is mixed.”
Quote in the paperSubstantial claim0 of 3 sources checked- cites Cull et al., 1996
Not checked in the free run.
- cites Cull, 2000
Not checked in the free run.
- cites Balota et al., 2007
Not checked in the free run.
- Premiseown data
In the authors' previous paired-associate experiments, at a short delay (10 min after learning) they replicated Landauer and Bjork's finding of an advantage of expanding retrieval.
“At a short delay (10 min after learning) we replicated Landauer and Bjork's (1978) finding of an advantage of expanding retrieval.”
Quote in the paperNot a substantial claim0 of 2 sources checked- cites Karpicke & Roediger, 2007a
Not checked in the free run.
- cites Landauer and Bjork's (1978)
Not checked in the free run.
- Interpretationreasoning
When students recall ideas from texts, a test might nominally occur immediately after study, but functionally the first ideas recalled are not the last few ideas residing in immediate memory.
“Therefore when students recall ideas from texts, a test might nominally occur immediately after study, but functionally the first ideas recalled are not the last few ideas residing in immediate memory.”
Quote in the paperSubstantial claim - Interpretationown data
Current research using relatively modest intervals has failed to obtain any consistent advantage of expanding retrieval.
“Although future research may show differences between expanding and equally spaced retrieval schedules with much longer intervals between tests, current research using relatively modest intervals has failed to obtain any consistent advantage of expanding retrieval.”
Quote in the paperSubstantial claim - Premisereasoning
The typical comparison of expanding and equally spaced schedules confounds the position of the first test and the spacing of repeated tests.
“An important issue in any examination of spaced retrieval practice is that the typical comparison of expanding and equally spaced schedules confounds the position of the first test and the spacing of repeated tests.”
- Also stated in: § GENERAL DISCUSSION · plain
“Expanding schedules typically involve an immediate first test, and equally spaced schedules typically involve a delayed first test.”
Quote in the paperSubstantial claim - Also stated in: § GENERAL DISCUSSION · plain
- Premisereasoning
Important differences exist between recalling individual items in paired-associate tasks and recalling expository texts in free recall tasks.
“However, important differences exist between recalling individual items in paired-associate tasks and recalling expository texts in free recall tasks.”
Quote in the paperSubstantial claim - Premisecitation
In previous studies of text recall, subjects did not tend to recall the last few ideas in the text first, but instead typically recalled ideas in forward serial order.
“However, in our previous studies of text recall (Roediger & Karpicke, 2006b) subjects did not adopt this strategy when recalling expository texts.That is, the subjects did not tend to recall the last few ideas in the text first, but instead typically recalled ideas in forward serial order, perhaps striving to maintain the narrative or structural coherence of the text.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Roediger & Karpicke, 2006b
Not checked in the free run.
- Interpretationown data
As long as repeated retrieval attempts are spaced rather than massed, the particular schedule of the repeated tests seems not to matter, at least under the conditions examined in the literature so far.
“As long as repeated retrieval attempts are spaced rather than massed, the particular schedule of the repeated tests seems not to matter-at least under the conditions examined in the literature so far.”
- Also stated in: § CONCLUSION · hedged
“As long as retrieval attempts are spaced and not massed together, the particular way the retrieval attempts are spaced during a learning period does not matter for long-term retention.”
Quote in the paperSubstantial claim - Also stated in: § CONCLUSION · hedged
- Interpretationown data
Current procedures for implementing expanding retrieval do not successfully induce increasingly difficult retrieval across repeated tests.
“but the data imply that current procedures for implementing expanding retrieval do not successfully induce increasingly difficult retrieval across repeated tests.”
Quote in the paperSubstantial claim- The authors state this as an assumption: Recall latency is a viable index of retrieval difficulty.
- Interpretationown data
In the present experiments, retrieval did not clearly grow increasingly difficult across repeated tests regardless of whether the tests were expanding or equally spaced.
“However, at least under our conditions, it is not clear that retrieval actually grows increasingly difficult across repeated tests regardless of whether the tests are expanding or equally spaced.”
Quote in the paperSubstantial claim- The authors state this as an assumption: Recall latency is a viable index of retrieval difficulty.
- Interpretationown data
Retrieval practice is a powerful way to enhance long-term retention of educationally relevant texts.
“Retrieval practice is a powerful way to enhance long-term retention of educationally relevant texts, and repeated retrieval attempts confer benefits beyond recalling a single time.”
Quote in the paperSubstantial claim - Premisenone given
There have been no published studies examining how the particular spacing of retrieval attempts affects text learning.
“There have been a few recent experiments examining text learning with spaced rereading (Rawson & Kintsch, 2005) and with retrieval practice (Chan, McDermott, & Roediger, 2006;Roediger & Karpicke, 2006b) but there have been no published studies examining how the particular spacing of retrieval attempts affects text learning.”
Quote in the paperSubstantial claim0 of 3 sources checked- cites Rawson & Kintsch, 2005
Not checked in the free run.
- cites Chan, McDermott, & Roediger, 2006
Not checked in the free run.
- cites Roediger & Karpicke, 2006b
Not checked in the free run.
- Premisecitation
Retrieval of items in the focus of immediate awareness does not support later retention.
“There is considerable evidence that retrieval of items in the focus of immediate awareness does not support later retention (e.g., Jacoby, 1978).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Jacoby, 1978
Not checked in the free run.
- Premiseown data
In the present experiments, the spacing intervals used were rather long relative to those used in typical spaced retrieval experiments with paired-associate materials.
“Nonetheless, the spacing intervals that we used in the present experiments were rather long relative to those used in typical spaced retrieval experiments with paired-associate materials.”
Quote in the paperNot a substantial claim - Premisecitation
Feedback has potent effects on learning.
“Feedback has potent effects on learning (Butler, Karpicke, & Roediger, 2007, 2008;Pashler, Cepeda, Wixted, & Rohrer, 2005)”
Quote in the paperSubstantial claim0 of 2 sources checked- cites Butler, Karpicke, & Roediger, 2007, 2008
Not checked in the free run.
- cites Pashler, Cepeda, Wixted, & Rohrer, 2005
Not checked in the free run.
- Interpretationown data
The pattern with text materials differs from the typical finding from 50 years of research on free recall of lists that subjects recall the last items in a list first.
“But the pattern with text materials differs from the typical finding-from 50 years of research on free recall of lists-that subjects recall the last items in a list first (see Deese & Kaufman, 1957;Tulving, 1968).”
Quote in the paperSubstantial claim0 of 2 sources checked- cites Deese & Kaufman, 1957
Not checked in the free run.
- cites Tulving, 1968
Not checked in the free run.
- The quote only partly states this claim. 5
- May combine two claims. 12
- Classified as probably not a substantial claim. 12
The quote only partly states this claim.
Findingown dataIn Experiment 1, subjects tended to recall ideas from the texts in serial order rather than recalling the last few ideas first.
“The figure clearly shows that the subjects tended to recall the ideas from the texts in serial order.”
- Also stated in: § EXPERIMENT 2 · boosted
“In fact there was not a single subject who recalled the last ideas in the passages first.”
Quote in the paperNot a substantial claim- Also stated in: § EXPERIMENT 2 · boosted
The quote only partly states this claim.
Findingown dataIn Experiment 1 final recall, expanding versus equal spacing did not affect recall.
“but no effect of spacing schedule and no interaction (Fs 1).”
Quote in the paperNot a substantial claimThe quote only partly states this claim.
Findingown dataIn Experiment 1 final recall 1 week later, subjects who took an immediate initial recall test outperformed those who took a delayed initial test.
“The subjects who took an immediate initial recall test outperformed those who took a delayed initial test, but the particular spacing of repeated tests did not appear to matter.”
- Also stated in: § EXPERIMENT 2 · plain
“There was a main effect of initial test position [F(1,76) 10.07, p 2 .12]but no effect of spacing schedule and no interaction (Fs 1).”
Quote in the paperSubstantial claim- Also stated in: § EXPERIMENT 2 · plain
May combine two claims.
Findingown dataIn Experiment 2 no-feedback initial recall, there was no main effect of learning condition and no interaction.
“A 2 (position of the first test) 3 (learning condition) ANOVA showed that there was a main effect of the position of the first test [F(1,30) 4.69, p 2 .14]but no main effect of learning condition and no interaction (Fs 1).”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Findingown dataIn Experiment 2 feedback conditions, the pattern of results was somewhat different from the no-feedback conditions.
“The pattern of results was somewhat different from the pattern in the no-feedback conditions.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Findingown dataIn Experiment 2 no-feedback initial recall, there was a marginally significant small degree of hypermnesia across tests.
“There was a marginally significant main effect of test number [F(3,93) 2.32, p 2 .07,p .08], reflecting a small degree of hypermnesia across tests.”
Quote in the paperNot a substantial claimThe quote only partly states this claim.
Findingown dataIn Experiment 1, the average correlation between recall output order and input order was r = .89.
“The overall average correlation was r .89.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Findingown dataIn Experiment 2, the recall order results wholly replicated the results of Experiment 1.
“The recall order results wholly replicated the results of Experiment 1.”
Quote in the paperNot a substantial claimThe quote only partly states this claim.
Findingown dataIn Experiment 2, taking a single free recall test produced better long-term retention than did reading the text and not recalling it, even without feedback, in both immediate and delayed first test conditions.
“First, within the no-feedback groups, both the immediate and delayed first test conditions showed significant testing effects.”
- Also stated in: § Final recall. · plain
“Taking a single test produced better long-term retention than did only studying the text-even when the subjects did not reread the text after recalling it (cf.Roediger & Karpicke, 2006b).”
- Also stated in: § GENERAL DISCUSSION · plain
“First, there was a testing effect: Taking a single free recall test produced better long-term retention than did reading the text and not recalling it—even when there was no feedback after the test.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Roediger & Karpicke, 2006b
Not checked in the free run.
- Also stated in: § Final recall. · plain
May combine two claims.
Findingown dataIn the present experiments, recall remained relatively constant or even exhibited a modest degree of hypermnesia across tests.
“but the present data show that recall remained relatively constant or even exhibited a modest degree of hypermnesia (see too Logan & Balota, 2008).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Logan & Balota, 2008
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Study design and conductnone givenIn Experiment 2, the four critical passages were presented in the same order for every subject, but the order of the four learning conditions was counterbalanced to create four orders.
“The four critical passages were presented in the same order for every subject (Bamboo, Diving, Eugene O'Neill, Vanuatu), but the order of the four learning conditions was counterbalanced to create four orders.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductnone givenIn Experiment 1, the order in which subjects studied the two passages was counterbalanced to create two counterbalancing orders within each condition.
“The order in which the subjects studied the two passages was counterbalanced to create two counterbalancing orders within each condition.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Study design and conductown dataIn Experiment 1, 40 recall tests were scored by two raters, and the Pearson correlation between their scores was r = .98; remaining tests were scored by one rater.
“Initially, 40 recall tests were scored by two raters, and the Pearson product-moment correlation between their scores was r .98.Given the high interrater reliability, the remaining recall tests were scored by one rater.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Study design and conductown dataIn Experiment 2, 40 recall tests were scored by two raters, and the Pearson correlation between their scores was r = .97; remaining tests were scored by one rater.
“As in Experiment 1, 40 recall tests from Experiment 2 were scored by two raters.The Pearson product-moment correlation between their scores was r .97.Given the high interrater reliability, the remaining recall tests were scored by one rater.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductcitationIn Experiment 1, preliminary pilot testing showed that 4 min was enough time for subjects to reach asymptote in amount recalled.
“Preliminary pilot testing showed that 4 min was enough time for subjects to reach asymptote in amount recalled (cf.Roediger & Thorpe, 1978).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Roediger & Thorpe, 1978
Not checked in the free run.
May combine two claims.
Interpretationown dataThe authors' paired-associate learning experiments led them to conclude that expanding retrieval was not superior to equally spaced retrieval and, in fact, the opposite may be true for long-term retention.
“In short, our paired-associate learning experiments led us to conclude that expanding retrieval was not superior to equally spaced retrieval and, in fact, the opposite may be true for long-term retention.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Karpicke & Roediger, 2007a
Not checked in the free run.
May combine two claims.
PremisecitationExperiments that used longer delays (e.g., 24 h or more) often found no effect of expanding retrieval, or sometimes an advantage of equally spaced practice.
“In addition, experiments that used longer delays (e.g., 24 h or more) often found no effect of expanding retrieval, or sometimes an advantage of equally spaced practice (e.g., Cull, 2000;Logan & Balota, 2008).”
Quote in the paperSubstantial claim0 of 2 sources checked- cites Cull, 2000
Not checked in the free run.
- cites Logan & Balota, 2008
Not checked in the free run.
Probably not a substantial claim: may not pass S4 (based).
InterpretationreasoningThe critical factor in paired-associate learning experiments was the position of the first retrieval attempt, not the schedule of repeated tests.
“Our theory was that the critical factor in paired-associate learning experiments was the position of the first retrieval attempt, not the schedule of repeated tests.”
Quote in the paperNot a substantial claim- Rests on an assumption: Recall reflects immediate/primary memory when a word pair is recalled immediately after it was studied.
May combine two claims.
PremisecitationSome experiments in which subjects were given feedback after retrieval attempts also found no advantage of expanding retrieval or an advantage of equally spaced practice.
“And finally, some experiments in which subjects were given feedback after retrieval attempts also found no advantage of expanding retrieval or an advantage of equally spaced practice (for a review, see Balota, Duchek, & Logan, 2007).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Balota, Duchek, & Logan, 2007
Not checked in the free run.
Classified as probably not a substantial claim.
PremisecitationIf students practice retrieval on their own, they would likely restudy after attempting recall.
“Of course, examining feedback is practically relevant, because if students practice retrieval on their own, they would likely restudy after attempting recall (Karpicke, Butler, & Roediger, 2009).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Karpicke, Butler, & Roediger, 2009
Not checked in the free run.
May combine two claims.
PremisecitationExpanding and equally spaced retrieval schedules have been examined with paired-associate materials but not with texts, and the results with paired-associate tasks have been equivocal.
“Expanding and equally spaced retrieval schedules have been examined with pairedassociate materials but not with texts-and moreover, the results with paired-associate tasks have been equivocal (see Balota et al., 2007).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Balota et al., 2007
Not checked in the free run.
May combine two claims.
InterpretationcitationThe conclusion that spacing schedule does not matter is not consistent with Landauer and Bjork's (1978) original idea but is supported by the bulk of recent research.
“This conclusion is not consistent with Landauer and Bjork's (1978) original idea but it is supported by the bulk of recent research.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Landauer and Bjork's (1978)
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationOnly a few studies have examined feedback in the form of rereading a text after students attempted recall.
“but we know of only a few studies that examined feedback in the form of rereading a text after students attempted recall (e.g., McDaniel, Howard, & Einstein, 2009).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites McDaniel, Howard, & Einstein, 2009
Not checked in the free run.
May combine two claims.
InterpretationreasoningEven a single, nominally massed test can enhance later retention, as long as recall on the test does not represent retrieval of items residing in immediate memory.
“Even a single, nominally massed test can enhance later retention, as long as recall on the test does not represent retrieval of items residing in immediate memory.”
Quote in the paperSubstantial claimClassified as probably not a substantial claim.
PremisecitationIncreasing the difficulty of retrieval attempts may promote long-term retention.
“Therefore it may be true that increasing the difficulty of retrieval attempts does in fact promote long-term retention (Pyc & Rawson, 2009)”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Pyc & Rawson, 2009
Not checked in the free run.
May combine two claims.
PremisecitationTesting an individual item immediately after it was studied in a paired-associate learning task would prompt subjects to recall the item when it still resided in their immediate awareness, akin to rehearsing an item in massed fashion, a technique known to have minimal effects on later recall.
“Testing an individual item immediately after it was studied in a pairedassociate learning task would prompt subjects to recall the item when it still resided in their immediate awareness, akin to rehearsing an item in massed fashion, a technique known to have minimal effects on later recall (e.g., Craik & Watkins, 1973).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Craik & Watkins, 1973
Not checked in the free run.
The authors state this as an assumption.
Retrieval difficulty produces a positive effect on long-term retention.
“Retrieval difficulty itself is assumed to produce a positive effect on long-term retention (see Gardiner, Craik, & Bleasdale, 1973;Pyc & Rawson, 2009).”
The paper relies on this without support.
Recall reflects immediate/primary memory when a word pair is recalled immediately after it was studied.
“It is clear that recall reflects immediate/ primary memory when a word pair is recalled immediately after it was studied.”
The authors state this as an assumption.
Recall latency is a viable index of retrieval difficulty.
“Assuming that recall latency is a viable index of retrieval difficulty (Benjamin, Bjork, & Schwartz, 1998;Koriat & Ma'ayan, 2005)”
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
For almost all learning paradigms, the training intervals are fixed, although in one type of spaced training paradigm, the intervals between sessions progressively lengthen.
“For almost all learning paradigms, the training intervals are fixed, although in one type of spaced training paradigm, the intervals between sessions progressively lengthen2,84.”
From The right time to learn: Mechanisms and optimization of spaced learning (2016) · cites this paper as [84]
A meta-analysis and a text learning study found no substantial evidence for the superiority of progressively lengthening intervals in promoting long-term memory formation.
“However, a meta-analysis2 and a text learning study84 found no substantial evidence for the superiority of this approach in terms of promoting long-term memory formation.”
From The right time to learn: Mechanisms and optimization of spaced learning (2016) · cites this paper as [84]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Experiment 1 spacing interval is assigned to the wrong experiment
MinorThe text assigns a six-minute lag to Experiment 1, but Experiment 1 used four-minute periods. Two such periods give an eight-minute lag; the six-minute lag corresponds to Experiment 2's three-minute periods.
“In the present experiments a lag of just two periods at a rate of 3 or 4 min/period resulted in total lags of 6 or 8 min (in Experiments 1 and 2, respectively).”
“The learning phase consisted of a series of 4-min periods.”
Inconsistent denominator degrees of freedom in the same ANOVA
MinorThe reported feedback main effect and feedback-by-test-position interaction come from the same two-factor ANOVA on the single-test data, but their denominator degrees of freedom are given as 30 and 60, respectively. For this between-subjects analysis, they should use the same denominator degrees of freedom.
“There was no significant overall effect of feedback [F(1,30) 1.90, n.s.] and no main effect of position of the first test (F 1), but there was a significant interaction [F(1,60) 4.69, p 2 .07].”
“Thus, there were four between-subjects groups, and 16 subjects were assigned to each group.”
Cites
Depth of Processing and the Retention of Words in Episodic Memory
Craik, F. I. M., & Tulving, E. (1975) · Journal of Experimental Psychology: General · doi:10.1037/0096-3445.104.3.268 · Cited by 4,121 · see citing works
Test-Enhanced Learning: Taking Memory Tests Improves Long-Term Retention
Roediger, H. L., & Karpicke, J. D. (2006) · Psychological Science · doi:10.1111/j.1467-9280.2006.01693.x · Cited by 2,867 · see citing works
Self-citationThe power of testing memory: Basic research and implications for educational practice
Roediger, H. L., & Karpicke, J. D. (2006) · Perspectives on Psychological Science · doi:10.1111/j.1745-6916.2006.00012.x · Cited by 2,037 · see citing works
Self-citationThe Critical Importance of Retrieval for Learning
Karpicke, J. D., & Roediger, H. L. (2008) · Science · doi:10.1126/science.1152408 · Cited by 1,791 · see citing works
Self-citationKarpicke, J. D., Butler, A. C., & Roediger III, H. L. (2009) · Memory · doi:10.1080/09658210802647009 · Cited by 745 · see citing works
Self-citationOn interpreting the effects of repetition: Solving a problem versus remembering a solution
Jacoby, L. L. (1978) · Journal of Verbal Learning and Verbal Behavior · doi:10.1016/s0022-5371(78)90393-6 · Cited by 667 · see citing works
Perspectives on Psychological Science
Blase, A. E. K. A. S. L. (2011) · APS observer · Cited by 628 · see citing works
The role of rehearsal in short-term memory
Craik, F. I. M., & Watkins, M. J. (1973) · Journal of Verbal Learning and Verbal Behavior · doi:10.1016/s0022-5371(73)80039-8 · Cited by 609 · see citing works
Repeated retrieval during learning is the key to long-term retention☆
Karpicke, J. D., & ROEDIGERIII, H. (2006) · Journal of Memory and Language · doi:10.1016/j.jml.2006.09.004 · Cited by 599 · see citing works
Self-citationPyc, M. A., & Rawson, K. A. (2009) · Journal of Memory and Language · doi:10.1016/j.jml.2009.01.004 · Cited by 551 · see citing works
The mismeasure of memory: When retrieval fluency is misleading as a metamnemonic index.
Benjamin, A. S., Bjork, R. A., & Schwartz, B. L. (1998) · Journal of Experimental Psychology General · doi:10.1037/0096-3445.127.1.55 · Cited by 529 · see citing works
When Does Feedback Facilitate Learning of Words?
Pashler, H., Cepeda, N. J., Wixted, J. T., & Rohrer, D. (2005) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/0278-7393.31.1.3 · Cited by 445 · see citing works
Karpicke, J. D., & Roediger, H. L. (2007) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/0278-7393.33.4.704 · Cited by 421 · cited 2× · see citing works
“enhanced long-term retention but the schedule of repeated tests did not matter ( Karpicke & Roediger, 2007a ).”
BackgroundSelf-citationSerial effects in recall of unorganized and sequentially organized verbal material.
Deese, J., & Kaufman, R. (1957) · Journal of Experimental Psychology · doi:10.1037/h0040536 · Cited by 399 · see citing works
Chan, J. C. K., McDermott, K. B., & Roediger, H. L. (2006) · Journal of Experimental Psychology: General · doi:10.1037/0096-3445.135.4.553 · Cited by 364 · see citing works
Assessing Our Own Competence: Heuristics and Illusions
Bjork, R. A. (1999) · The MIT Press eBooks · doi:10.7551/mitpress/1480.003.0023 · Cited by 340 · see citing works
Spacing effects in memory: Evidence for a two-process account.
Greene, R. L. (1989) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037/0278-7393.15.3.371 · Cited by 337 · see citing works
Correcting a metacognitive error: Feedback increases retention of low-confidence correct responses.
Butler, A. C., Karpicke, J. D., & Roediger, H. L., III (2008) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037/0278-7393.34.4.918 · Cited by 332 · see citing works
Self-citationThe effect of type and timing of feedback on learning from multiple-choice tests.
Butler, A. C., Karpicke, J. D., & Roediger, H. L. (2007) · Journal of Experimental Psychology: Applied · doi:10.1037/1076-898x.13.4.273 · Cited by 321 · see citing works
Self-citationThe fate of primary memory items in free recall
Craik, F. I. M. (1970) · Journal of Verbal Learning and Verbal Behavior · doi:10.1016/s0022-5371(70)80042-1 · Cited by 308 · see citing works
Spitzer, H. F. (1939) · Journal of Educational Psychology · doi:10.1037/h0063404 · Cited by 306 · see citing works
Monotonic and nonmonotonic lag effects in paired-associate and recognition memory paradigms
Glenberg, A. M. (1976) · Journal of Verbal Learning and Verbal Behavior · doi:10.1016/s0022-5371(76)90002-5 · Cited by 275 · see citing works
Application of the testing and spacing effects to name learning
Carpenter, S. K., & DeLosh, E. L. (2005) · Applied Cognitive Psychology · doi:10.1002/acp.1101 · Cited by 270 · see citing works
Statistical theory of distributional phenomena in learning
Estes, W. K. (1955) · Psychological Review · doi:10.1037/h0046888 · Cited by 246 · see citing works
The effects of encoding fluency and retrieval fluency on judgments of learning
Koriat, A., & Ma’ayan, H. (2005) · Journal of Memory and Language · doi:10.1016/j.jml.2005.01.001 · Cited by 235 · see citing works
Retrieval difficulty and subsequent recall
Gardiner, F. M., Craik, F. I. M., & Bleasdale, F. A. (1973) · Memory & Cognition · doi:10.3758/bf03198098 · Cited by 176 · see citing works
The Read-Recite-Review Study Strategy
McDaniel, M. A., Howard, D. C., & Einstein, G. O. (2009) · Psychological Science · doi:10.1111/j.1467-9280.2009.02325.x · Cited by 164 · see citing works
The role of recall time in producing hypermnesia
Roediger, H. L., III, & Thorpe, L. A. (1978) · Memory & Cognition · doi:10.3758/bf03197459 · Cited by 154 · see citing works
Increasing Retention Without Increasing Study Time
Rohrer, D., & Pashler, H. (2007) · Current Directions in Psychological Science · doi:10.1111/j.1467-8721.2007.00500.x · Cited by 153 · see citing works
Rereading Effects Depend on Time of Test.
Rawson, K. A., & Kintsch, W. (2005) · Journal of Educational Psychology · doi:10.1037/0022-0663.97.1.70 · Cited by 151 · see citing works
Logan, J. M., & Balota, D. A. (2008) · Aging Neuropsychology and Cognition · doi:10.1080/13825580701322171 · Cited by 135 · see citing works
Balota, D. A., Duchek, J. M., Sergent-Marshall, S. D., & Roediger, H. L., III (2006) · Psychology and Aging · doi:10.1037/0882-7974.21.1.19 · Cited by 127 · see citing works
Storm, B. C., Bjork, R. A., & Storm, J. C. (2010) · Memory & Cognition · doi:10.3758/mc.38.2.244 · Cited by 113 · see citing works
Examining the efficiency of schedules of distributed retrieval practice
Pyc, M. A., & Rawson, K. A. (2007) · Memory & Cognition · doi:10.3758/bf03192925 · Cited by 104 · see citing works
Cull, W. L., Shaughnessy, J. J., & Zechmeister, E. B. (1996) · Journal of Experimental Psychology Applied · doi:10.1037/1076-898x.2.4.365 · Cited by 99 · see citing works
Balota, D. A., Duchek, J. M., & Logan, J. M. (2007) · Cited by 88 · see citing works
Spacing effects on implicit memory tests.
Greene, R. L. (1990) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037/0278-7393.16.6.1004 · Cited by 77 · see citing works
Repetition and Spacing Effects
Greene, R. L. (2008) · Elsevier eBooks · doi:10.1016/b978-012370509-9.00168-6 · Cited by 55 · see citing works
The effect of type and timing of feedback on learning from multiple-choice tests
Butler, A. C., Karpicke, J. D., & Roediger, H. L., III (2006) · PsycEXTRA Dataset · doi:10.1037/e527352012-769 · Cited by 27 · see citing works
Self-citationRogers, B. A. (2000) · Cited by 13 · see citing works
Flagged first, then by citations
3 of the 44 references couldn’t be matched to a known paper.
Research works printed but not linked: 2
- Landauer, T. K., & Bjork, R. A. (1978). Optimum rehearsal patterns and name learning. In M. Gruneberg, P. E. Morris, & R. N. Sykes (Eds.), Practical aspects of memory (pp. 625-632). London: Aca- demic Press.
- Tulving, E. (1968). Theoretical issues in free recall. In T. Dixon & D. Horton (Eds.), Verbal behavior and general behavior theory (pp. 2-36). Englewood Cliffs, NJ: Prentice Hall.
Cited by
Sorted by citations
Dunlosky, J., Rawson, K. A., Marsh, E. J., Nathan, M. J., & Willingham, D. T. (2013) · Psychological Science in the Public Interest · doi:10.1177/1529100612453266 · Cited by 3,138 · see citing works
Retrieval Practice Produces More Learning than Elaborative Studying with Concept Mapping
Karpicke, J. D., & Blunt, J. R. (2011) · Science · doi:10.1126/science.1199327 · Cited by 1,019 · see citing works
Self-citationThe right time to learn: Mechanisms and optimization of spaced learning
Smolen, P., Zhang, Y., & Byrne, J. H. (2016) · Nature Reviews Neuroscience · doi:10.1038/nrn.2015.18 · Cited by 326 · see citing works
Karpicke, J. D. (2012) · Current Directions in Psychological Science · doi:10.1177/0963721412443552 · Cited by 286 · see citing works
Self-citationRetrieval-Based Learning: An Episodic Context Account
Karpicke, J. D., Lehman, M. S., & Aue, W. R. (2012) · Current Directions in Psychological Science · Cited by 276 · see citing works
Self-citationSpaced retrieval: Absolute spacing enhances learning regardless of relative spacing.
Karpicke, J. D., & Kaminske, A. N. (2011) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037/a0023436 · Cited by 263 · see citing works
Self-citationRetrieval-Based Learning: A Decade of Progress
Karpicke, J. D. (2017) · Learning and Memory: A Comprehensive Reference · doi:10.1016/b978-0-12-809324-5.21055-9 · Cited by 223 · see citing works
Self-citationRetrieval-Based Learning: A Perspective for Enhancing Meaningful Learning
Karpicke, J. D., & Grimaldi, P. J. (2012) · Educational Psychology Review · doi:10.1007/s10648-012-9202-2 · Cited by 226 · see citing works
Self-citationRetrieval-Based Learning: Active Retrieval Promotes Meaningful Learning
Karpicke, J. D. (2012) · Current Directions in Psychological Science · Cited by 198 · see citing works
Self-citationNon-pharmacological cognitive enhancement
Dresler, M., Sandberg, A., Ohla, K., Bublitz, C., Trenado, C., Mroczko-Wąsowicz, A., Kühn, S., & Repantis, D. (2012) · Neuropharmacology · doi:10.1016/j.neuropharm.2012.07.002 · Cited by 181 · see citing works
Nakata, T. (2015) · Studies in Second Language Acquisition · doi:10.1017/s0272263114000825 · Cited by 179 · see citing works
Learning with retrieval-based concept mapping.
Blunt, J. R., & Karpicke, J. D. (2014) · Journal of Educational Psychology · doi:10.1037/a0035934 · Cited by 171 · see citing works
Self-citationCarew, T. J., & Magsamen, S. H. (2010) · Neuron · doi:10.1016/j.neuron.2010.08.028 · Cited by 156 · see citing works
Learning as a Generative Activity: Eight Learning Strategies that Promote Understanding
Fiorella, L., & Mayer, R. E. (2015) · Cited by 109 · see citing works
Using electronic flashcards to promote learning in medical students: retesting versus restudying
Schmidmaier, R., Ebersbach, R., Schiller, M., Hege, I., Holzer, M., & Fischer, M. R. (2011) · Medical Education · doi:10.1111/j.1365-2923.2011.04043.x · Cited by 104 · see citing works
A Meta-Analytic Review of the Benefit of Spacing out Retrieval Practice Episodes on Retention
Latimier, A., Peyre, H., & Ramus, F. (2021) · Educational Psychology Review · doi:10.1007/s10648-020-09572-8 · Cited by 96 · see citing works
Retrieval practice over the long term: Should spacing be expanding or equal-interval?
Kang, S. H. K., Lindsey, R. V., Mozer, M. C., & Pashler, H. (2014) · Psychonomic Bulletin & Review · doi:10.3758/s13423-014-0636-z · Cited by 90 · see citing works
Retrieval-based learning: The need for guided retrieval in elementary school children
Karpicke, J. D., Blunt, J. R., Smith, M. A., & Karpicke, S. (2014) · Journal of Applied Research in Memory and Cognition · doi:10.1016/j.jarmac.2014.07.008 · Cited by 89 · see citing works
Self-citationRetrieval-Based Learning: Positive Effects of Retrieval Practice in Elementary School Children
Karpicke, J. D., Blunt, J. R., & Smith, M. A. (2016) · Frontiers in Psychology · doi:10.3389/fpsyg.2016.00350 · Cited by 82 · see citing works
Self-citationCarvalho, P. F., & Goldstone, R. L. (2015) · Frontiers in Psychology · doi:10.3389/fpsyg.2015.00505 · Cited by 69 · see citing works
Kuepper-Tetzel, C. E., Kapler, I. V., & Wiseheart, M. (2014) · Memory & Cognition · doi:10.3758/s13421-014-0394-1 · Cited by 62 · see citing works
Improving Learning Efficiency of Factual Knowledge in Medical Education
Yeh, D. D., & Park, Y. S. (2015) · Journal of surgical education · doi:10.1016/j.jsurg.2015.03.012 · Cited by 62 · see citing works
A comparison of adaptive and fixed schedules of practice.
Mettler, E. W., Massey, C. M., & Kellman, P. J. (2016) · Journal of Experimental Psychology General · doi:10.1037/xge0000170 · Cited by 63 · see citing works
Enhanced Learning and Retention of Medical Knowledge Using the Mobile Flash card Application Anki
Lu, M., Farhat, J. H., & Dallaghan, G. L. B. (2021) · Medical Science Educator · doi:10.1007/s40670-021-01386-9 · Cited by 61 · see citing works
Stenlund, T., Jönsson, F. U., & Jonsson, B. (2016) · Educational Psychology · doi:10.1080/01443410.2016.1143087 · Cited by 57 · see citing works
A cognitive assessment of highly superior autobiographical memory
LePort, A. K. R., Stark, S. M., McGaugh, J. L., & Stark, C. E. L. (2016) · Memory · doi:10.1080/09658211.2016.1160126 · Cited by 50 · see citing works
Guided retrieval practice of educational materials using automated scoring.
Grimaldi, P. J., & Karpicke, J. D. (2013) · Journal of Educational Psychology · doi:10.1037/a0033208 · Cited by 47 · see citing works
Self-citationThe double-edged sword of memory retrieval
Roediger, H. L., III, & Abel, M. (2022) · Nature Reviews Psychology · doi:10.1038/s44159-022-00115-2 · Cited by 46 · see citing works
Divided attention: An undesirable difficulty in memory retention
Gaspelin, N., Ruthruff, E. D., & Pashler, H. (2013) · Memory & Cognition · doi:10.3758/s13421-013-0326-5 · Cited by 44 · see citing works
Liu, G., Lo, H.-Y., & Wang, H. (2013) · Computers & Education · doi:10.1016/j.compedu.2013.06.011 · Cited by 44 · see citing works
Spacing Effects on Learning and Memory ☆
Carpenter, S. K. (2017) · Elsevier eBooks · doi:10.1016/b978-0-12-809324-5.21054-7 · Cited by 45 · see citing works
Learning vocabulary: CALL program versus vocabulary notebook
Hirschel, R., & Fritz, E. M. (2013) · System · doi:10.1016/j.system.2013.07.016 · Cited by 41 · see citing works
Systematic review of distributed practice and retrieval practice in health professions education
Trumble, E., Lodge, J. M., Mandrusiak, A., & Forbes, R. (2023) · Advances in Health Sciences Education · doi:10.1007/s10459-023-10274-3 · Cited by 40 · see citing works
Dobson, J. L. (2013) · AJP Advances in Physiology Education · doi:10.1152/advan.00174.2012 · Cited by 40 · see citing works
Benefits of accumulating versus diminishing cues in recall
Finley, J. R., Benjamin, A. S., Hays, M. J., Bjork, R. A., & Kornell, N. (2011) · Journal of Memory and Language · doi:10.1016/j.jml.2011.01.006 · Cited by 39 · see citing works
Effect of uniform versus expanding retrieval practice on the recall of physiology information
Dobson, J. L. (2012) · AJP Advances in Physiology Education · doi:10.1152/advan.00090.2011 · Cited by 38 · see citing works
INTRICACIES OF SPACED RETRIEVAL: A Resolution
Roediger, H. L., III (2011) · Psychology Press eBooks · doi:10.4324/9780203842539-7 · Cited by 37 · see citing works
Maddox, G. B., & Balota, D. A. (2015) · Memory & Cognition · doi:10.3758/s13421-014-0499-6 · Cited by 37 · see citing works
A Systematic Review of the Testing Effect in Learning
Eisenkraemer, R. E., Jaeger, A., & Stein, L. M. (2013) · Paidéia (Ribeirão Preto) · doi:10.1590/1982-43272356201314 · Cited by 37 · see citing works
Comparing and combining retrieval practice and concept mapping
O'Day, G. M., & Karpicke, J. D. (2021) · Journal of Educational Psychology · doi:10.1037/edu0000486 · Cited by 35 · see citing works
Self-citationReinventing Flashcards to Increase Student Learning
Senzaki, S., Hackathorn, J. M., Appleby, D. C., & Gurung, R. A. R. (2017) · Psychology Learning & Teaching · doi:10.1177/1475725717719771 · Cited by 41 · see citing works
Toppino, T. C., Phelan, H.-A., & Gerbier, É. (2018) · Memory & Cognition · doi:10.3758/s13421-018-0815-7 · Cited by 31 · see citing works
Dobson, J. L. (2011) · Advances in Physiology Education · doi:10.1152/advan.00039.2011 · Cited by 32 · see citing works
D’Antoni, A. V., Mtui, E. P., Loukas, M., Tubbs, R. S., Zipp, G. P., & Dunlosky, J. T. (2018) · Clinical Anatomy · doi:10.1002/ca.23298 · Cited by 28 · see citing works
On the transfer of prior tests or study events to subsequent study.
Storm, B. C., Friedman, M. C., Murayama, K., & Bjork, R. A. (2013) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037/a0034252 · Cited by 27 · see citing works
Gurung, R. A. R., & Burns, K. (2019) · Applied Cognitive Psychology · doi:10.1002/acp.3507 · Cited by 42 · see citing works
Pumilia, C. A., Lessans, S., & Harris, D. (2020) · Cureus · doi:10.7759/cureus.10372 · Cited by 24 · see citing works
Chou, I.-C., Liu, K.-L., & Zhao, N. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2021.781610 · Cited by 19 · see citing works
Effective Teaching: Sensory Learning Styles versus General Memory Processes
Arbuthnott, K. D., & Krätzig, G. P. (2015) · Comprehensive Psychology · doi:10.2466/06.it.4.2 · Cited by 22 · see citing works
Impact of Spacing of Practice on Learning Brand Name and Generic Drugs
Terenyi, J., Anksorus, H. N., & Persky, A. M. (2017) · American Journal of Pharmaceutical Education · doi:10.5688/ajpe6179 · Cited by 18 · see citing works
Episodic and Autobiographical Memory
Marsh, E. J., & Roediger, H. L. (2012) · Handbook of Psychology, Second Edition · doi:10.1002/9781118133880.hop204017 · Cited by 18 · see citing works
Collaborative Testing in Medical Education: Student Perceptions and Long-Term Knowledge Retention
Eastwood, J. L., Kleinberg, K. A., & Rodenbaugh, D. W. (2020) · Medical Science Educator · doi:10.1007/s40670-020-00944-x · Cited by 17 · see citing works
Teachers’ Knowledge of Learning Strategies
Granström, M., Härma, E., & Kikas, E. (2022) · Scandinavian Journal of Educational Research · doi:10.1080/00313831.2022.2074536 · Cited by 15 · see citing works
Optimizing the Spacing of Retrieval Practice to Improve Pharmacy Students’ Learning of Drug Names
Terenyi, J., Anksorus, H. N., & Persky, A. M. (2019) · American Journal of Pharmaceutical Education · doi:10.5688/ajpe7029 · Cited by 17 · see citing works
Immekus, J. C. (2019) · Journal of Statistics Education · doi:10.1080/10691898.2019.1629852 · Cited by 16 · see citing works
Diminished testing benefits in young adults with attention-deficit hyperactivity disorder
Dudukovic, N. M., Gottshall, J. L., Cavanaugh, P. A., & Moody, C. T. (2014) · Memory · doi:10.1080/09658211.2014.977921 · Cited by 13 · see citing works
Kornell, N., & Vaughn, K. E. (2018) · Archives of Scientific Psychology · doi:10.1037/arc0000042 · Cited by 15 · see citing works
Greving, C. E., & Richter, T. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2021.685245 · Cited by 12 · see citing works
Stimulating breadth and depth of vocabulary via repeated storybook readings or tests
Damhuis, C. M. P., Segers, E., & Verhoeven, L. T. W. (2014) · School Effectiveness and School Improvement · doi:10.1080/09243453.2014.965181 · Cited by 12 · see citing works
Neural activations associated with feedback and retrieval success.
Wiklund-Hörnqvist, C., Andersson, M., Jonsson, B., & Nyberg, L. (2017) · npj Science of Learning · doi:10.1038/s41539-017-0013-6 · Cited by 10 · see citing works
Tracing Undergraduate Science Learners’ Digital Cognitive Strategy Use and Relation to Performance
Mefferd, K., & Bernacki, M. L. (2023) · Journal of Science Education and Technology · doi:10.1007/s10956-022-10018-9 · Cited by 11 · see citing works
Ameliorating Episodic Memory Deficits in a Young Adult With Developmental (Congenital) Amnesia
Kim, A. S. N., Saberi, F. M., Wiseheart, M., & Rosenbaum, R. S. (2018) · Journal of the International Neuropsychological Society · doi:10.1017/s1355617718000589 · Cited by 10 · see citing works
Simon-Campbell, E., & Phelan, J. C. (2018) · International Journal of Nursing & Clinical Practices · doi:10.15344/2394-4978/2018/290 · Cited by 9 · see citing works
Bruijniks, S. J. E., Sijbrandij, M., & Huibers, M. J. H. (2019) · Journal of Behavior Therapy and Experimental Psychiatry · doi:10.1016/j.jbtep.2019.101485 · Cited by 8 · see citing works
Note-taking format and difficulty impact learning from instructor-provided lecture notes
Bellinger, D. B., & DeCaro, M. S. (2019) · Quarterly Journal of Experimental Psychology · doi:10.1177/1747021819879434 · Cited by 8 · see citing works
Using Day and Night – Scheduling Retrieval Practice and Sleep
Kroneisen, M., & Kuepper-Tetzel, C. E. (2020) · Psychology Learning & Teaching · doi:10.1177/1475725720965363 · Cited by 8 · see citing works
What Does It Take to Deal with Academic Literature?
Münchow, H., Richter, T., & Schmid, S. (2020) · Springer eBooks · doi:10.1007/978-3-658-27886-1_12 · Cited by 8 · see citing works
Reiter, R., Viehdorfer, M., Hescock, K., Clark, T., & Nemanic, S. (2018) · Journal of Veterinary Medical Education · doi:10.3138/jvme.0516-100r · Cited by 8 · see citing works
Antony, J. W., Liu, X. L., Zheng, Y., Ranganath, C., & O’Reilly, R. C. (2026) · doi:10.21428/8e6ba8ef.d9f5dd19 · Cited by 7 · see citing works
Cognitive Enhancement in Humans
Dresler, M., & Repantis, D. (2015) · Elsevier eBooks · doi:10.1016/b978-0-12-417042-1.00011-5 · Cited by 6 · see citing works
The Effect of Type of Feedback in Multiple-Choice Testing on Long-Term Retention
Jang, Y., & Marshall, E. (2018) · The Journal of General Psychology · doi:10.1080/00221309.2018.1437021 · Cited by 6 · see citing works
Learning Better, Learning More: The Benefits of Expanded Retrieval Practice
Yan, V. X., Eglington, L. G., & Garcia, M. A. (2020) · Journal of Applied Research in Memory and Cognition · doi:10.1016/j.jarmac.2020.03.002 · Cited by 7 · see citing works
Filling in the gaps: using testing and restudy to promote associative learning
Bulevich, J. B., Thomas, A. K., & Parsow, C. (2015) · Memory · doi:10.1080/09658211.2015.1098706 · Cited by 7 · see citing works
Use of Puzzles as an Effective Teaching–Learning Method for Dental Undergraduates
Muthu, M., Nirmal, L., & Prasad, M. (2020) · International Journal of Clinical Pediatric Dentistry · doi:10.5005/jp-journals-10005-1834 · Cited by 7 · see citing works
Karataş, N. B., Özemir, O., Lovelett, J. T., Demir, B., Erkol, K., Veríssimo, J., Erçetin, G., & Ullman, M. T. (2021) · Language Teaching Research · doi:10.1177/13621688211053525 · Cited by 14 · see citing works
What Spaced Learning is Effective for Long-Term L2 Vocabulary Retention?
Kanayama, K., & Kasahara, K. (2017) · ARELE: Annual Review of English Language Education in Japan · doi:10.20581/arele.28.0_113 · Cited by 6 · see citing works
Ryan, A., & WILKINSON, T. J. (2021) · Anatomical Sciences Education · doi:10.1002/ase.2075 · Cited by 6 · see citing works
What is the relationship between collective memory and metacognition?
Lund, A. E., & Russell, C. (2022) · Progress in brain research · doi:10.1016/bs.pbr.2022.07.006 · Cited by 6 · see citing works
Effects of individualized word retrieval in kindergarten vocabulary intervention
Damhuis, C. M. P., Segers, E., Scheltinga, F., & Verhoeven, L. (2016) · School Effectiveness and School Improvement · doi:10.1080/09243453.2015.1114500 · Cited by 8 · see citing works
Effects of the initial test interval and feedback timing on L2 vocabulary retention
Guo, L. (2018) · Language Learning Journal · doi:10.1080/09571736.2018.1551416 · Cited by 6 · see citing works
SIMPLIFY ITS: An intelligent tutoring system based on cognitive diagnosis models and spaced learning
Villanueva, N. M., Costas, A. E., Hermida, D. F., & Rodríguez, A. C. (2018) · IEEE Global Engineering Education Conference (EDUCON) · doi:10.1109/educon.2018.8363440 · Cited by 5 · see citing works
Memory rehabilitation for people with epilepsy
Thompson, P. J., Koorenhof, L., & Kapur, N. (2012) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780199580286.003.0025 · Cited by 5 · see citing works
The Impact of Integration of Self-Tests into a Pre-Clerkship Medical Curriculum
Baatar, D., Lacy, N. L., Mulla, Z. D., & Piskurich, J. F. (2016) · Medical Science Educator · doi:10.1007/s40670-016-0351-7 · Cited by 6 · see citing works
The Effect of Equal Versus Expanding Spacing Practice on the Deliberate Learning of L2 Collocations
Sonbul, S., Macis, M., & Gyllstad, H. (2024) · TESOL Quarterly · doi:10.1002/tesq.3364 · Cited by 5 · see citing works
Metsämuuronen, J., & Mattsson, M. T. (2013) · Journal of Educational and Developmental Psychology · doi:10.5539/jedp.v3n2p89 · Cited by 4 · see citing works
Teaching Residents to Teach: Why and How
Feimster, J. W., McDow, A. D., & Mellinger, J. D. (2017) · Springer eBooks · doi:10.1007/978-3-319-64728-9_7 · Cited by 4 · see citing works
The Effects of Expanding and Equally-Spaced Retrieval Practice on Long-Term L2 Vocabulary Retention
Kanayama, K., & Kasahara, K. (2016) · ARELE: Annual Review of English Language Education in Japan · doi:10.20581/arele.27.0_217 · Cited by 4 · see citing works
Recall Efficacy in EFL Learning
Makarchuk, D. W. (2018) · English Teaching · doi:10.15858/engtea.73.2.201806.115 · Cited by 4 · see citing works
Kılıç, A., Hoyer, W. J., & Howard, M. W. (2013) · Experimental Aging Research · doi:10.1080/0361073x.2013.779200 · Cited by 4 · see citing works
Effect of Repeated Testing on the Development of Secondary Language Proficiency
Metsämuuronen, J. (2013) · Journal of Educational and Developmental Psychology · doi:10.5539/jedp.v3n1p10 · Cited by 4 · see citing works
Isabelle Ching, C. H. O. U., Hu, J., Muñoz, É., & García, A. M. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2021.757351 · Cited by 3 · see citing works
Penn, P., & Wells, I. (2018) · Psychology Teaching Review · doi:10.53841/bpsptr.2018.24.2.70 · Cited by 3 · see citing works
McDowell, L., Hohmann, L. A., & Maxson, R. (2023) · American Journal of Pharmaceutical Education · doi:10.1016/j.ajpe.2023.100576 · Cited by 2 · see citing works
Chiu, G. T. ‐., & Hawkins, C. F. (2023) · Journal on English as a Foreign Language · doi:10.23971/jefl.v13i2.6313 · Cited by 2 · see citing works
Mansy, M. M., Antonenko, P., Murfee, W. L., Furtney, S., Davis, C. K., Krishna, S., Pawlyshyn, B., Thurlow, N. A., & Pierantoni, J.-P. (2023) · Biomedical Engineering Education · doi:10.1007/s43683-023-00123-5 · Cited by 2 · see citing works
Spacing effects in learning and memory
Carpenter, S. K., & Pan, S. C. (2024) · Elsevier eBooks · doi:10.1016/b978-0-443-15754-7.00020-1 · Cited by 2 · see citing works
Acquiring an Accurate Mental Model of Human Learning
Pan, S. C., & Bjork, R. A. (2024) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780190917982.013.69 · Cited by 2 · see citing works
Karpicke, J. D. (2025) · Elsevier eBooks · doi:10.1016/b978-0-443-15754-7.00074-2 · Cited by 3 · see citing works
Self-citationPRÁTICA DE LEMBRAR: A QUAIS FATORES OS EDUCADORES DEVEM SE ATENTAR?
Ekuni, R., & Pompéia, S. (2020) · Psicologia Escolar e Educacional · doi:10.1590/2175-35392020220284 · Cited by 5 · see citing works
Xiaofeng, M. A., Zhou, A., Cui, D., & ZHANG, R. (2014) · Advances in Psychological Science · doi:10.3724/sp.j.1042.2014.00279 · Cited by 2 · see citing works
- Authors
- Karpicke, J. D., & Roediger, H. L.
- Affiliations
- Purdue University West Lafayette (US)
- Corresponding author
- Karpicke, J. D.
- ORCID
- Karpicke, J. D.
- Venue
- Memory & Cognition
- Published
- 2009-12-04
- Volume
- 38
- Issue
- 1
- Pages
- 116-124
- ISSN
- 0090-502X (ISSN-L)
- 1532-5946
- OpenAlex
- W2116385289
- Semantic Scholar
- 29cd968699b66b38a019b6f1058038b62ff21fa1
- Cited by
- 137
- References
- 44
- Citations by year
- 2026: 2 · 2025: 1 · 2024: 5 · 2023: 7 · 2022: 4 · 2021: 8 · 2020: 14 · 2019: 6 · 2018: 16 · 2017: 8 · 2016: 9 · 2015: 12 · 2014: 10 · 2013: 12 · 2012: 10
- FWCI
- 3.71
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Licence
- www.springer.com/tdm (tdm)
- Locations
- Memory & Cognition (publishedVersion)
- PubMed (publishedVersion)
- Funders
- Purdue University
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Memory Processes and Influences
- Life Sciences › Neuroscience › Cognitive Neuroscience › Memory and Neural Mechanisms
- Social Sciences › Psychology › Developmental and Educational Psychology › Second Language Acquisition and Learning
- Keywords
- retrieval practice, spacing effect, long-term retention, text recall, retesting, restudy, feedback
- MeSH terms
- Humans, Practice, Psychological, Reading, Mental Recall, Retention, Psychology, Verbal Learning, Recognition, Psychology, Feedback, Psychological
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-10.
Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-10.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review