The benefits of retrieval practice depend on item difficulty and intelligence.
Abstract
The authors examined whether individual differences in fluid intelligence (gF) modulate the testing effect. Participants studied Swahili-English word pairs and repeatedly studied half the pairs or attempted retrieval, with feedback, for the remaining half. Word pairs were easy or difficult to learn. Overall, participants showed a benefit of testing over restudy. However, almost 1/3 of the sample had a negative testing effect and benefitted more from restudy than testing, as well as performing better overall. These individuals self-reported less use of shallower encoding strategies than positive testing effect participants but did not differ in other dimensions. For individuals with a positive testing effect, difficulty had differential effects on participants who scored high or low on a measure of gF, with high gF participants showing larger testing effects for difficult over easy items, whereas low gF participants showed the opposite. Working memory performance was not related to the magnitude of the testing effect; however, vocabulary knowledge revealed a similar pattern as gF, with higher vocabulary associated with a testing effect for difficult but not easy items. This suggests that the benefit of retrieval practice varies with item difficulty and participant abilities. Thus, recommendations to engage in retrieval practice should take into consideration the interactive effects of to-be-learned materials and individual differences in the learners. (PsycINFO Database Record
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In retrieval learning literature, differences in both task and item difficulty can affect final performance on a memory task.
“In retrieval learning literature, there are differences in how both task (the way in which the learning material is presented; (Carpenter & DeLosh, 2006; Kang et al., 2007; Pyc & Rawson, 2009; Stenlund et al., 2016) and item (the learning material itself; de Lima et al., 2020; Minear et al., 2018; Pyke et al., 2023; Vaughn et al., 2013) difficulty can affect final performance on a memory task.”
From Does difficulty moderate learning? A comparative analysis of the desirable difficulties framework and cognitive load theory (2025) · cites this paper as Minear et al., 2018
Cites
Still being checked.
Cited by
Sorted by citations
Agarwal, P. K., Nunes, L. D., & Blunt, J. R. (2021) · Educational Psychology Review · doi:10.1007/s10648-021-09595-9 · Cited by 211 · see citing works
Practicing Retrieval Facilitates Learning
McDermott, K. B. (2021) · Annual review of psychology · doi:10.1146/annurev-psych-010419-051019 · Cited by 113 · see citing works
Individual differences in long-term memory.
Unsworth, N. (2019) · Psychological Bulletin · doi:10.1037/bul0000176 · Cited by 99 · see citing works
Carpenter, S. K., Endres, T., & Hui, L. (2020) · Educational Psychology Review · doi:10.1007/s10648-020-09562-w · Cited by 75 · see citing works
Miyatsu, T., & McDaniel, M. A. (2019) · Memory & Cognition · doi:10.3758/s13421-019-00936-2 · Cited by 62 · see citing works
Retrieval Practice: Beneficial for All Students or Moderated by Individual Differences?
Bertilsson, F., Stenlund, T., Wiklund‐Hörnqvist, C., & Jonsson, B. (2020) · Psychology Learning & Teaching · doi:10.1177/1475725720973494 · Cited by 45 · see citing works
The benefits of testing: Individual differences based on student factors
Robey, A. (2019) · Journal of Memory and Language · doi:10.1016/j.jml.2019.104029 · Cited by 29 · see citing works
Heitmann, S., Grund, A., Fries, S., Berthold, K., & Roelle, J. (2021) · Learning and Instruction · doi:10.1016/j.learninstruc.2021.101526 · Cited by 30 · see citing works
Roelle, J., Froese, L., Krebs, R., Obergassel, N., & Waldeyer, J. (2022) · Learning and Instruction · doi:10.1016/j.learninstruc.2022.101634 · Cited by 28 · see citing works
The effects of prequestions versus postquestions on memory retention in children.
de Lima, N. K., & Jaeger, A. (2020) · Journal of Applied Research in Memory and Cognition · doi:10.1016/j.jarmac.2020.08.005 · Cited by 24 · see citing works
Adaptive retrieval practice with multiple‐choice questions in the university classroom
Greving, S., Lenhard, W., & Richter, T. (2020) · Journal of Computer Assisted Learning · doi:10.1111/jcal.12445 · Cited by 22 · see citing works
Kubik, V., Gaschler, R., & Hausman, H. E. (2021) · Psychology Learning & Teaching · doi:10.1177/1475725720976462 · Cited by 21 · see citing works
The Forward Testing Effect is Reliable and Independent of Learners’ Working Memory Capacity
Pastötter, B., & Frings, C. (2019) · Journal of Cognition · doi:10.5334/joc.82 · Cited by 18 · see citing works
Yan, V. X., Sana, F., & Carvalho, P. F. (2023) · Policy Insights from the Behavioral and Brain Sciences · doi:10.1177/23727322231218906 · Cited by 21 · see citing works
Wenzel, K., & Reinhard, M. (2019) · Intelligence · doi:10.1016/j.intell.2019.101405 · Cited by 20 · see citing works
Pyke, W., Lunau, J., & Javadi, A.-H. (2025) · Quarterly Journal of Experimental Psychology · doi:10.1177/17470218241308143 · Cited by 15 · see citing works
“…material is presented; (Carpenter & DeLosh, 2006; Kang et al., 2007; Pyc & Rawson, 2009; Stenlund et al., 2016) and item (the learning material itself; de Lima et al., 2020; Minear et al., 2018; Pyke et al., 2023; Vaughn et al., 2013) difficulty can affect final performance on a memory task.”
Retrieval practice improves learning in children with diverse visual word recognition skills
Moreira, B. F. T., Pinto, T. S. S., Justi, F. R. D. R., & Jaeger, A. (2019) · Memory · doi:10.1080/09658211.2019.1668017 · Cited by 15 · see citing works
Tse, C., Chan, M. H.-M., Tse, W.-S., & Wong, S. W. H. (2019) · Frontiers in Psychology · doi:10.3389/fpsyg.2019.00969 · Cited by 12 · see citing works
de Lima, M. F. R., Júnior, S. V. P., da Costa, J. F. D., & Buratto, L. G. (2020) · The Spanish Journal of Psychology · doi:10.1017/sjp.2020.33 · Cited by 12 · see citing works
Fellman, D., Lincke, A., & Jonsson, B. (2020) · Frontiers in Psychology · doi:10.3389/fpsyg.2020.02076 · Cited by 12 · see citing works
Gupta, M. W., Pan, S. C., & Rickard, T. C. (2023) · Journal of Memory and Language · doi:10.1016/j.jml.2023.104476 · Cited by 10 · see citing works
A scoping review of research on individual differences in the testing effect paradigm
Smith-Peirce, R. N., & Butler, A. C. (2024) · Learning and Individual Differences · doi:10.1016/j.lindif.2024.102602 · Cited by 10 · see citing works
Learning neuroscience: Investigating influences of notetaking materials and individual differences
Wilson, J. T., Miller-Goldwater, H. E., Porter, B. M., & Bauer, P. (2023) · Learning and Individual Differences · doi:10.1016/j.lindif.2022.102243 · Cited by 8 · see citing works
Pan, S. C., Yu, L., Wong, M. J., Selvarajan, G., & Teo, A. Z. J. (2025) · Journal of Memory and Language · doi:10.1016/j.jml.2025.104608 · Cited by 8 · see citing works
Pan, S. C., Yu, L., Hong, Y., Wong, M. J., Selvarajan, G., & Kaku, M. E. (2024) · Learning and Individual Differences · doi:10.1016/j.lindif.2024.102603 · Cited by 8 · see citing works
Abrufeffekte im Gedächtnis: Ein Überblick zur aktuellen Grundlagenforschung
Tempel, T., & Pastötter, B. (2021) · Psychologische Rundschau · doi:10.1026/0033-3042/a000517 · Cited by 7 · see citing works
Evaluating the Contribution of Emotional Valence to Associative Memory: Retrieval Practice Matters
Nie, A., Jiang, G., & Li, M. (2021) · Advances in Cognitive Psychology · doi:10.5709/acp-0313-2 · Cited by 6 · see citing works
Individual differences in the reactivity effect of judgments of learning: Cognitive factors
Zhao, W., Liu, S., Tian, X., Li, B., Shanks, D. R., Yang, C., & Luo, L. (2024) · Journal of Memory and Language · doi:10.1016/j.jml.2024.104574 · Cited by 6 · see citing works
Mertens, U., & Lindner, M. A. (2025) · Journal of Computer Assisted Learning · doi:10.1111/jcal.13112 · Cited by 7 · see citing works
Rickard, T. C. (2020) · Psychonomic Bulletin & Review · doi:10.3758/s13423-020-01734-7 · Cited by 6 · see citing works
Prior episodic learning and the efficacy of retrieval practice
Gupta, M. W., Pan, S. C., & Rickard, T. C. (2021) · Memory & Cognition · doi:10.3758/s13421-021-01236-4 · Cited by 6 · see citing works
Retrieval practice effect and individual differences: current status and future directions
de Lima, M. F. R., & Buratto, L. G. (2024) · Journal of Cognitive Psychology · doi:10.1080/20445911.2024.2354963 · Cited by 6 · see citing works
Can you tell people’s cognitive ability level from their response patterns in questionnaires?
Schneider, S., Hernandez, R., Junghaenel, D. U., Jin, H., Lee, P.-J., Gao, H., Maupin, D. J., Orriens, B., Meijer, E., & Stone, A. A. (2024) · Behavior Research Methods · doi:10.3758/s13428-024-02388-2 · Cited by 8 · see citing works
Beyond Working Memory Capacity: Attention Control as the Underlying Mechanism of Cognitive Abilities
Lee, Y., & Engle, R. (2026) · Journal of Intelligence · doi:10.3390/jintelligence14020022 · Cited by 8 · see citing works
Minear, M. E., Coane, J. H., Cooney, L. H., Boland, S. C., & Serrano, J. W. (2023) · Frontiers in Psychology · doi:10.3389/fpsyg.2023.1186566 · Cited by 6 · see citing works
Self-citationDifferential Effects of Additional Formative Assessments on Student Learning Behaviors and Outcomes
Borter, N. (2024) · Studia paedagogica · doi:10.5817/sp2023-3-1 · Cited by 6 · see citing works
Bertilsson, F., Stenlund, T., Sundström, A. E., & Jonsson, B. (2024) · European Journal of Psychology of Education · doi:10.1007/s10212-024-00845-2 · Cited by 4 · see citing works
Wenzel, K., & Reinhard, M. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2021.693585 · Cited by 4 · see citing works
Retrieval Practice and Online Learning
Millet, A. L., Turcotte, N., & Yan, S. (2021) · Emerald Group Publishing Limited eBooks · doi:10.1108/s2055-364120210000040007 · Cited by 4 · see citing works
Retrieval practice enhances memory for names in survivors of stroke.
Evans, F. A., Wong, D. K., & Stolwyk, R. J. (2020) · Neuropsychology · doi:10.1037/neu0000701 · Cited by 4 · see citing works
The benefit of retrieval practice on cued recall under stress depends on item difficulty
Klier, C., & Buratto, L. G. (2023) · Neuroscience Letters · doi:10.1016/j.neulet.2023.137066 · Cited by 3 · see citing works
A working memory dependent dual process model of the testing effect
Zheng, Y., Shi, A., & Liu, X. L. (2024) · npj Science of Learning · doi:10.1038/s41539-024-00268-0 · Cited by 4 · see citing works
The reliability of simultaneous versus individual data collection during stuttering assessment
Davidow, J. H., Ye, J., & Edge, R. L. (2023) · International Journal of Language & Communication Disorders · doi:10.1111/1460-6984.12860 · Cited by 3 · see citing works
Fan, T., Hui, L., Luo, L., & de Bruin, A. B. H. (2024) · Educational Psychology Review · doi:10.1007/s10648-024-09945-3 · Cited by 3 · see citing works
The test–retest reliability of the retrieval practice effect
de Lima, M. F. R., & Buratto, L. G. (2022) · Quarterly Journal of Experimental Psychology · doi:10.1177/17470218221141586 · Cited by 2 · see citing works
Lechuga, M. T., Tudela, J. M. O., & Gómez‐Ariza, C. J. (2024) · Frontiers in Education · doi:10.3389/feduc.2024.1287744 · Cited by 5 · see citing works
Karpicke, J. D. (2025) · Elsevier eBooks · doi:10.1016/b978-0-443-15754-7.00074-2 · Cited by 3 · see citing works
Barenberg, J., & Dutke, S. (2021) · Unterrichtswissenschaft · doi:10.1007/s42010-021-00138-3 · Cited by 2 · see citing works
Individual differences in working memory and the benefit of retrieval practice
Fordyce, A., Redick, T. S., Bedwell, J. P., & Karpicke, J. D. (2025) · Journal of Memory and Language · doi:10.1016/j.jml.2025.104664 · Cited by 1 · see citing works
Kaneko, S., Iwaki, N., Sakuraba, H., Ishikawa, K., Kakinuma, M., Yamamoto, S., & Morotomi, T. (2025) · Cogent Psychology · doi:10.1080/23311908.2025.2524938 · Cited by 1 · see citing works
Retrieval-based argument mapping promotes learning transfer
Liu, Q. (2020) · Summit (Simon Fraser University) · Cited by 1 · see citing works
Beyond One-Size-Fits-All: A Working Memory Dependent Dual-Process Model of the Testing EffectPreprint
Zheng, Y., Shi, A., & Liu, X. L. (2024) · doi:10.31234/osf.io/jv9wr · Cited by 1 · see citing works
Джаудатович, Т. Р. (2022) · IntechOpen eBooks · doi:10.5772/intechopen.104225
The forward testing effect is reliable and independent of learners’ working memory capacityPreprint
Pastötter, B., & Frings, C. (2019) · doi:10.31234/osf.io/dw4fy
Semantic relatedness and the efficacy of retrieval practice
Gupta, M. W., Pan, S. C., & Rickard, T. C. (2026) · npj Science of Learning · doi:10.1038/s41539-026-00416-8
The Promoting Effect of Retrieval Practice Effect on Students’ Learning
詹, 静. (2024) · Advances in Social Sciences · doi:10.12677/ass.2024.138708
de Lima, M. F. R., & Buratto, L. G. (2024) · Cognitive Processing · doi:10.1007/s10339-024-01228-7
Ahoomanesh, M., Shahnazari, M., & Ketabi, S. (2024) · Language Learning Journal · doi:10.1080/09571736.2024.2400290
The Benefits of Testing: Individual Differences Based on Student FactorsPreprint
Dougherty, M. R. P., & Robey, A. (2016) · OSF Preprints (OSF Preprints)
Trends in testing effect research: from lab to classroom, but not yet for all learners
Wilschut, T., Sense, F., & van Rijn, H. (2026) · npj Science of Learning · doi:10.1038/s41539-026-00400-2
Klier, C., & Buratto, L. G. (2026) · Frontiers in Cognition · doi:10.3389/fcogn.2026.1838176
Qu, K., Wang, X., Zhou, J., & Zhang, Y. (2026) · Current Psychology · doi:10.1007/s12144-026-09632-2
The influence of working memory capacity and material complexity on the testing effect
Lü, X., Qu, K., Sun, Y., & Yang, Y. (2026) · Frontiers in Psychology · doi:10.3389/fpsyg.2026.1952951
- Authors
- Minear, M., Coane, J. H., Boland, S. C., Cooney, L. H., & Albat, M.
- Affiliations
- University of Wyoming (US)
- Colby College (US)
- Venue
- Journal of Experimental Psychology: Learning, Memory, and Cognition
- Published
- 2018-09
- Volume
- 44
- Issue
- 9
- Pages
- 1474-1486
- ISSN
- 0278-7393 (ISSN-L)
- 1939-1285
- OpenAlex
- W2797665395
- Cited by
- 63
- References
- 0
- Citations by year
- 2026: 5 · 2025: 5 · 2024: 15 · 2023: 5 · 2022: 4 · 2021: 9 · 2020: 10 · 2019: 8 · 2018: 1 · 2016: 1
- FWCI
- 4.17
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Journal of Experimental Psychology Learning Memory and Cognition (publishedVersion)
- PubMed (publishedVersion)
- Funders
- Colby College (01.2222)
- James McDonnell Foundation (220020426)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Memory Processes and Influences
- Social Sciences › Psychology › Developmental and Educational Psychology › Second Language Acquisition and Learning
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Visual and Cognitive Learning Processes
- Keywords
- retrieval practice, testing effect, fluid intelligence, item difficulty, individual differences, restudy, feedback, encoding strategies, working memory, vocabulary knowledge
- MeSH terms
- Female, Humans, Intelligence, Male, Memory, Short-Term, Pattern Recognition, Visual, Practice, Psychological, Problem Solving, Mental Recall, Vocabulary, Feedback, Psychological, Young Adult
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review