There is no convincing evidence that working memory training is effective: A reply to Au et al. (2014) and Karbach and Verhaeghen (2014)
Abstract
The possible cognitive benefits of working memory training programs have been the subject of intense interest and controversy. Recently two meta-analyses have claimed that working memory training can be effective in enhancing cognitive skills in adulthood (Au et al. Behavioural Brain Research 228:(1) 107-115, 2014) and stemming cognitive decline in old age (Karbach & Verhaeghen Psychological Science 25:2027-2037, 2014). The current article critically evaluates these claims. We argue that these meta-analyses produce misleading results because of (1) biases in the studies included, (2) a failure to take account of baseline differences when calculating effect sizes, and (3) a failure to emphasize the difference between studies with treated versus untreated control groups. We present new meta-analyses and conclude that there is no convincing evidence that working memory training produces general cognitive benefits.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Conflicting prior reviews may stem from biased methodological choices and from focusing on restricted subsets of studies.
“Previous reviews seem to show conflicting findings for two main reasons: First, some methodological decisions may have led to biased conclusions (see Melby-Lervåg & Hulme, 2015). Secondly, typically previous reviews have examined subsets of studies restricted to specific types of working memory training, age groups, or participant status.”
From Working Memory Training Does Not Improve Performance on Measures of Intelligence or Other Measures of “Far Transfer” (2016) · cites this paper as Melby-Lervåg & Hulme, 2015
Cites
Is working memory training effective? A meta-analytic review
Melby-Lervåg, M., & Hulme, C. (2013) · Developmental Psychology · doi:10.1037/a0028228 · Cited by 1,782 · see citing works
Self-citationTraining and plasticity of working memory
Klingberg, T. (2010) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2010.05.002 · Cited by 1,585 · see citing works
Improving fluid intelligence with training on working memory: a meta-analysis
Au, J., Sheehan, E., Tsai, N., Duncan, G. J., Buschkuehl, M., & Jaeggi, S. M. (2015) · Psychonomic Bulletin & Review · doi:10.3758/s13423-014-0699-x · Cited by 671 · cited 16× · see citing works
“Our focus in the current paper has been on two recent metaanalyses (Au et al., 2014; Karbach & Verhaeghen 2014) that have examined the effects of working memory training.”
BackgroundMethodResultInfluentialMohr, D. C., Spring, B., Freedland, K. E., Beckner, V., Arean, P., Hollon, S. D., Ockene, J., & Kaplan, R. (2009) · Psychotherapy and Psychosomatics · doi:10.1159/000228248 · Cited by 565 · see citing works
The role of individual differences in cognitive training and transfer
Jaeggi, S. M., Buschkuehl, M., Shah, P., & Jonides, J. (2014) · Memory & Cognition · doi:10.3758/s13421-013-0364-z · Cited by 432 · see citing works
Working memory training in older adults: Evidence of transfer and maintenance effects.
Borella, E., Carretti, B., Riboldi, F., & De Beni, R. (2010) · Psychology and Aging · doi:10.1037/a0020683 · Cited by 328 · see citing works
Working Memory Training May Increase Working Memory Capacity but Not Fluid Intelligence
Harrison, T. L., Shipstead, Z., Hicks, K. L., Hambrick, D. Z., Redick, T. S., & Engle, R. W. (2013) · Psychological Science · doi:10.1177/0956797613492984 · Cited by 305 · see citing works
Failure of Working Memory Training to Enhance Cognition or Intelligence
Thompson, T. W., Waskom, M. L., Garel, K.-L. A., Cardenas-Iniguez, C., Reynolds, G. O., Winter, R., Chang, P., Pollard, K., Lala, N., Alvarez, G. A., et al. (2013) · PLoS ONE · doi:10.1371/journal.pone.0063614 · Cited by 208 · see citing works
Schweizer, S., Hampshire, A., & Dalgleish, T. (2011) · PLoS ONE · doi:10.1371/journal.pone.0024372 · Cited by 198 · see citing works
On the impacts of working memory training on executive functioning
Salminen, T., Strobach, T., & Schubert, T. (2012) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2012.00166 · Cited by 148 · see citing works
Kraemer, H. C., Gardner, C., Brooks, J. O., & Yesavage, J. A. (1998) · Psychological Methods · doi:10.1037/1082-989x.3.1.23 · Cited by 141 · see citing works
Bürki, C. N., Ludwig, C., Chicherio, C., & de Ribaupierre, A. (2014) · Psychological Research · doi:10.1007/s00426-014-0559-3 · Cited by 131 · see citing works
The effects of working memory resource depletion and training on sensorimotor adaptation
Anguera, J. A., Bernard, J. A., Jaeggi, S. M., Buschkuehl, M., Benson, B. L., Jennett, S., Humfleet, J., Reuter-Lorenz, P. A., Jonides, J., & Seidler, R. D. (2012) · Behavioural Brain Research · doi:10.1016/j.bbr.2011.11.040 · Cited by 115 · see citing works
The Search for Meaningful Ways to Express the Effects of Interventions
Cooper, H. (2008) · Child Development Perspectives · doi:10.1111/j.1750-8606.2008.00063.x · Cited by 25 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Melby-Lervåg, M., Redick, T. S., & Hulme, C. (2016) · Perspectives on Psychological Science · doi:10.1177/1745691616635612 · Cited by 910 · see citing works
“Previous reviews seem to show conflicting findings for two main reasons: First, some methodological decisions may have led to biased conclusions (see Melby-Lervåg & Hulme, 2016).”
Self-citationCognitive Reserve and the Prevention of Dementia: the Role of Physical and Cognitive Activities
Cheng, S.-T. (2016) · Current Psychiatry Reports · doi:10.1007/s11920-016-0721-2 · Cited by 385 · see citing works
Working memory training revisited: A multi-level meta-analysis of n-back training studies
Soveri, A., Antfolk, J., Karlsson, L., Salo, B., & Laine, M. (2017) · Psychonomic Bulletin & Review · doi:10.3758/s13423-016-1217-0 · Cited by 350 · see citing works
“The Au et al. (2015) meta-analysis was challenged by Melby-Lervåg and Hulme (2016) who criticized the exclusion of relevant studies, the calculation of effect sizes without taking pretest differences between groups into account, and the interpretation of the results comparing active and passive…”
BackgroundMethodResultInfluentialDoes Far Transfer Exist? Negative Evidence From Chess, Music, and Working Memory Training
Sala, G., & Gobet, F. (2017) · Current Directions in Psychological Science · doi:10.1177/0963721417712760 · Cited by 309 · see citing works
“For more details, see Karbach and Verhaeghen (2014) and Melby-Lervåg and Hulme (2016).”
BackgroundCognitive Training Does Not Enhance General Cognition
Sala, G., & Gobet, F. (2019) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2018.10.004 · Cited by 303 · see citing works
Placebo effects in cognitive training
Foroughi, C. K., Monfort, S. S., Paczynski, M., McKnight, P. E., & Greenwood, P. M. (2016) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1601243113 · Cited by 270 · see citing works
Working memory training in typically developing children: A meta-analysis of the available evidence.
Sala, G., & Gobet, F. (2017) · Developmental Psychology · doi:10.1037/dev0000265 · Cited by 216 · see citing works
Nilsson, J., Lebedev, A. V., Rydström, A., & Lövdén, M. (2017) · Psychological Science · doi:10.1177/0956797617698139 · Cited by 118 · see citing works
Dougherty, M. R., Hamovitz, T., & Tidwell, J. W. (2016) · Psychonomic Bulletin & Review · doi:10.3758/s13423-015-0865-9 · Cited by 106 · see citing works
Heterogeneity in ADHD: Neurocognitive predictors of peer, family, and academic functioning
Kofler, M. J., Sarver, D. E., Spiegel, J. A., Day, T. N., Harmon, S. L., & Wells, E. L. (2017) · Child Neuropsychology · doi:10.1080/09297049.2016.1205010 · Cited by 94 · see citing works
Teixeira-Santos, A. C., Moreira, C. S., Magalhães, R., Magalhães, C., Pereira, D. R., Leite, J., Carvalho, S., & Sampaio, A. (2019) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2019.05.009 · Cited by 87 · see citing works
Test–retest reliability of five frequently used executive tasks in healthy adults
Soveri, A., Lehtonen, M., Karlsson, L. C., Lukasik, K., Antfolk, J., & Laine, M. (2018) · Applied Neuropsychology: Adult · doi:10.1080/23279095.2016.1263795 · Cited by 81 · see citing works
Lawlor-Savage, L., & Goghari, V. M. (2016) · PLOS ONE · doi:10.1371/journal.pone.0151817 · Cited by 74 · see citing works
Sala, G., Aksayli, N. D., Tatlidil, K. S., Gondo, Y., & Gobet, F. (2019) · Intelligence · doi:10.1016/j.intell.2019.101386 · Cited by 63 · see citing works
Pahor, A., Seitz, A. R., & Jaeggi, S. M. (2022) · Nature Human Behaviour · doi:10.1038/s41562-022-01384-w · Cited by 34 · see citing works
Pattern of Near Transfer Effects Following Working Memory Training With a Dual <i>N</i>-Back Task
Soveri, A., Karlsson, E. P. A., Waris, O., Grönholm-Nyman, P., & Laine, M. (2017) · Experimental Psychology · doi:10.1027/1618-3169/a000370 · Cited by 34 · see citing works
Can short-term memory be trained?
Norris, D. G., Hall, J., & Gathercole, S. E. (2019) · Memory & Cognition · doi:10.3758/s13421-019-00901-z · Cited by 31 · see citing works
Teixeira-Santos, A. C., Moreira, C. S., Pereira, D. R., Pinal, D., Fregni, F., Leite, J., Carvalho, S., & Sampaio, A. (2022) · Frontiers in Aging Neuroscience · doi:10.3389/fnagi.2022.827188 · Cited by 27 · see citing works
Zhong, L.-A., Chen, K.-Y., Hsieh, M.-J., & Ho, M.-C. (2025) · Acta Psychologica · doi:10.1016/j.actpsy.2025.105499 · Cited by 1 · see citing works
- Authors
- Melby-Lervåg, M., & Hulme, C.
- Affiliations
- University of Oslo (NO)
- Corresponding author
- Hulme, Charles
- ORCID
- Hulme, Charles
- Venue
- Psychonomic Bulletin & Review
- Published
- 2015-06-17
- Volume
- 23
- Issue
- 1
- Pages
- 324-330
- ISSN
- 1069-9384 (ISSN-L)
- 1531-5320
- OpenAlex
- W1487954803
- Cited by
- 189
- References
- 14
- Citations by year
- 2026: 5 · 2025: 7 · 2024: 10 · 2023: 9 · 2022: 16 · 2021: 9 · 2020: 23 · 2019: 32 · 2018: 22 · 2017: 27 · 2016: 20 · 2015: 7 · 2013: 1
- FWCI
- 34.64
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springer.com/tdm (tdm)
- Locations
- Psychonomic Bulletin & Review (publishedVersion)
- PubMed (publishedVersion)
- Research Bank (Australian Catholic University) (submittedVersion)
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Cognitive Abilities and Testing
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Cognitive Functions and Memory
- Physical Sciences › Mathematics › Statistics and Probability › Cognitive and developmental aspects of mathematical skills
- Keywords
- working memory training, cognitive training, transfer of training, meta-analysis critique, effect size estimation, baseline differences, control groups, cognitive aging, cognitive decline, general intelligence
- MeSH terms
- Aging, Aptitude, Female, Humans, Intelligence, Learning, Male, Memory, Short-Term, Practice, Psychological, Geriatric Assessment, Executive Function
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
