The DOI matches its Crossref record; 43 of the 43 references it cites were found in a registry or an index.
Is working memory training effective?
Abstract
Working memory (WM) is a cognitive system that strongly relates to a person's ability to reason with novel information and direct attention to goal-relevant information. Due to the central role that WM plays in general cognition, it has become the focus of a rapidly growing training literature that seeks to affect broad cognitive change through prolonged training on WM tasks. Recent work has suggested that the effects of WM training extend to general fluid intelligence, attentional control, and reductions in symptoms of ADHD. We present a theoretically motivated perspective of WM and subsequently review the WM training literature in light of several concerns. These include (a) the tendency for researchers to define change to abilities using single tasks, (b) inconsistent use of valid WM tasks, (c) no-contact control groups, and (d) subjective measurement of change. The literature review highlights several findings that warrant further research but ultimately concludes that there is a need to directly demonstrate that WM capacity increases in response to training. Specifically, we argue that transfer of training to WM must be demonstrated using a wider variety of tasks, thus eliminating the possibility that results can be explained by task specific learning. Additionally, we express concern that many of the most promising results (e.g., increased intelligence) cannot be readily attributed to changes in WM capacity. Thus, a critical goal for future research is to uncover the mechanisms that lead to transfer of training.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“While this does control for important test-retest practice effects, it does not control for potential motivational or Hawthorne effects associated with being enrolled in an intervention study (Shipstead, Redick, & Engle, 2012).”
From Improving fluid intelligence with training on working memory: a meta-analysis (2015) · cites this paper as Shipstead, Redick, & Engle, 2012
In the citing paper
“thereby suggesting that the transfer of n-back training may not be restricted to matrix reasoning tests (Shipstead et al., 2012) but, rather, may reflect a more global improvement in Gf.”
From Improving fluid intelligence with training on working memory: a meta-analysis (2015) · cites this paper as Shipstead et al., 2012
In the citing paper
“As noted by Shipstead, Redick, and Engle (2012), even though some less-near-transfer memory tasks (e.g., odd-one-out task) are not part of the training programs, they still share some overlap with some training tasks (e.g., simple-span tasks).”
From Working memory training in typically developing children: A multilevel meta-analysis (2020) · cites this paper as Shipstead, Redick, and Engle, 2012
In the citing paper
“methodological deficiencies in both design and analysis persist in the WM training literature, despite many prior suggestions for remediation (Boot et al., 2013;Shipstead, Redick, & Engle, 2012;Tidwell et al., 2014).”
From Reevaluating the effectiveness of n-back training on transfer through the Bayesian lens: Support for the null (2016) · cites this paper as Shipstead, Redick, & Engle, 2012
In the citing paper
“A set of several measures is necessary to investigate the effects of WM training on latent factors representing cognitive skills rather than single tasks (Noack et al., 2009;Schmiedek, Lövdén, & Lindenberger, 2010;Shipstead et al., 2012).”
From Working memory training does not enhance older adults' cognitive skills: A comprehensive meta-analysis (2019) · cites this paper as Shipstead et al., 2012
In the citing paper
“Specifically, measurement noise and impurity of cognitive tasks may mimic or obscure true underlying changes in cognitive abilities.”
From Adaptive working memory training does not produce transfer effects in cognition and neuroimaging (2022) · cites this paper as [18]
In the citing paper
“Despite these encouraging findings, the literature clearly shows that these transfer effects were not consistent across studies, a fact that has inspired intense recent debates regarding the transferability of training-induced performance gains (e.g., Shipstead et al., 2012; Melby-Lervåg and Hulme, 2013; Redick et al., 2013).”
From Executive control training from middle childhood to adolescence (2014) · cites this paper as Shipstead et al., 2012
In the citing paper
“Evidence for near and especially far transfer of working-memory training to untrained tasks and abilities has been reported less consistently and has been discussed very controversially (e.g., Shipstead et al., 2012; Redick et al., 2013).”
From Executive control training from middle childhood to adolescence (2014) · cites this paper as Shipstead et al., 2012
In the citing paper
“according to Shipstead et al. (2012), many small-scale studies reported effects that were not replicated in larger-scale interventions.”
From Executive control training from middle childhood to adolescence (2014) · cites this paper as Shipstead et al., 2012
In the citing paper
“Moreover, a few methodological flaws were criticized, such as the use of non-adaptive or no-contact control groups, the use of individual tasks instead of batteries in order to measure constructs, or the analysis of reports from parents that were not blind to training conditions (Shipstead et al., 2012).”
From Executive control training from middle childhood to adolescence (2014) · cites this paper as Shipstead et al., 2012
In the citing paper
“As noted in multiple empirical and theoretical reviews of extant neurocognitive training programs, there are a host of conceptual, methodological, and practical issues to consider when developing and evaluating neurocognitive training programs (Chacko et al., 2013a; Shipstead, et al., 2012).”
From Improving Outcomes for Youth with ADHD: A Conceptual Framework for Combined Neurocognitive and Skill-Based Treatment Approaches (2014) · cites this paper as Shipstead, et al., 2012
In the citing paper
“Although these programs show some evidence for short-term effects on targeted working memory outcomes as measured by neurocognitive tests similar to the ones practiced in the games, they have not shown compelling evidence that these effects generalize beyond neurocognitive outcomes to important domains of functioning in the daily lives of children with ADHD (so-called “far-transfer effects”) [27-”
In the citing paper
“The no-contact group is not given monetary (or equivalent) rewards or stimulating personal attention, both of which positively impact performance.”
From Training-induced improvement in working memory tasks results from switching to efficient strategies (2021) · cites this paper as Shipstead, Redick, & Engle, 2012
In the citing paper
“The magnitude of transfer, when such was reported, is usually small, and is difficult to dissociate from a null result, since it is not resilient to correction for multiple comparisons.”
From Training-induced improvement in working memory tasks results from switching to efficient strategies (2021) · cites this paper as Shipstead et al., 2012
In the citing paper
“Although other studies have reported near and far transfer effects, many are called into question due to small sample sizes and problematic control procedures (for thorough discussion see [53–55]).”
From Dual N-back working memory training in healthy adults: A randomized comparison to processing speed training. (2016) · cites this paper as [55]
Citations
Cites
Studies of interference in serial verbal reactions
Stroop, J. R. (1935) · Journal of Experimental Psychology · doi:10.1037/h0054651 · Cited by 18,622
Miyake, A., Friedman, N. P., Emerson, M. J., Witzki, A. H., Howerter, A., & Wager, T. D. (2000) · Cognitive Psychology · doi:10.1006/cogp.1999.0734 · Cited by 15,798
Effects of noise letters upon the identification of a target letter in a nonsearch task
Eriksen, B. A., & Eriksen, C. W. (1974) · Perception & Psychophysics · doi:10.3758/bf03203267 · Cited by 7,230
The magical number 4 in short-term memory: A reconsideration of mental storage capacity
Cowan, N. (2001) · Behavioral and Brain Sciences · doi:10.1017/s0140525x01003922 · Cited by 6,779
Orne, M. T. (1962) · American Psychologist · doi:10.1037/h0043424 · Cited by 4,041
Paced Auditory Serial-Addition Task: A Measure of Recovery from Concussion
Gronwall, D. M. A. (1977) · Perceptual and Motor Skills · doi:10.2466/pms.1977.44.2.367 · Cited by 2,395
When and where do we apply what we learn?: A taxonomy for far transfer
Barnett, S. M., & Ceci, S. J. (2002) · Psychological Bulletin · doi:10.1037/0033-2909.128.4.612 · Cited by 2,076 · cited 1×
“It must, therefore, be demonstrated that the effects of training transfer to untrained tasks (Barnett & Ceci, 2002; Klingberg, 2010).”
BackgroundComputerized training of working memory in children with ADHD – a randomized, controlled trial
Klingberg, T., Fernell, E., Olesen, P. J., Johnson, M., Gustafsson, P., Dahlström, K., Gillberg, C. G., Forssberg, H., & Westerberg, H. (2005) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1097/00004583-200502000-00010 · Cited by 1,949
Age differences in short-term retention of rapidly changing information.
Kirchner, W. K. (1958) · Journal of Experimental Psychology · doi:10.1037/h0043688 · Cited by 1,798
Kane, M. J., & Engle, R. W. (2003) · Journal of Experimental Psychology: General · doi:10.1037/0096-3445.132.1.47 · Cited by 1,725
Self-citationTraining and plasticity of working memory
Klingberg, T. (2010) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2010.05.002 · Cited by 1,585
Mindfulness meditation improves cognition: evidence of brief mental training
Zeidan, F., Johnson, S. K., Diamond, B. J., David, Z., & Goolkasian, P. (2010) · Consciousness and Cognition · doi:10.1016/j.concog.2010.03.014 · Cited by 1,363
Increased prefrontal and parietal activity after training of working memory
Olesen, P. J., Westerberg, H., & Klingberg, T. (2004) · Nature Neuroscience · doi:10.1038/nn1165 · Cited by 1,317
Training of Working Memory in Children With ADHD
Klingberg, T., Forssberg, H., & Westerberg, H. (2002) · Journal of Clinical and Experimental Neuropsychology · doi:10.1076/jcen.24.6.781.8395 · Cited by 1,225
The influence of improvement in one mental function upon the efficiency of other functions. (I).
Woodworth, R. S., & Thorndike, E. L. (1901) · Psychological Review · doi:10.1037/h0074898 · Cited by 1,223
Miyake, A., Friedman, N. P., Rettinger, D. A., Shah, P., & Hegarty, M. (2001) · Journal of Experimental Psychology: General · doi:10.1037/0096-3445.130.4.621 · Cited by 1,139
Neural mechanisms of general fluid intelligence
Gray, J. R., Chabris, C. F., & Braver, T. S. (2003) · Nature Neuroscience · doi:10.1038/nn1014 · Cited by 1,080
Training and transfer effects of executive functions in preschool children
Thorell, L. B., Lindqvist, S., Bergman Nutley, S., Bohlin, G., & Klingberg, T. (2009) · Developmental Science · doi:10.1111/j.1467-7687.2008.00745.x · Cited by 1,041
Prefrontal cortex and basal ganglia control access to working memory
McNab, F., & Klingberg, T. (2008) · Nature Neuroscience · doi:10.1038/nn2024 · Cited by 989
The concurrent validity of the N -back task as a working memory measure
Jaeggi, S. M., Buschkuehl, M., Perrig, W. J., & Meier, B. (2010) · Memory · doi:10.1080/09658211003702171 · Cited by 981
Working Memory and Intelligence: The Same or Different Constructs?
Ackerman, P. L., Beier, M. E., & Boyle, M. O. (2005) · Psychological Bulletin · doi:10.1037/0033-2909.131.1.30 · Cited by 969
Verbal and Visuospatial Short-Term and Working Memory in Children: Are They Separable?
Alloway, T. P., Gathercole, S. E., & Pickering, S. J. (2006) · Child Development · doi:10.1111/j.1467-8624.2006.00968.x · Cited by 938
Working memory, attention control, and the N-back task: a question of construct validity
Kane, M. J., Conway, A. R. A., Miura, T. K., & Colflesh, G. J. H. (2007) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/0278-7393.33.3.615 · Cited by 933
The cocktail party phenomenon revisited: The importance of working memory capacity
Conway, A. R. A., Cowan, N., & Bunting, M. F. (2001) · Psychonomic Bulletin & Review · doi:10.3758/bf03196169 · Cited by 875
Karbach, J., & Kray, J. (2009) · Developmental Science · doi:10.1111/j.1467-7687.2009.00846.x · Cited by 694
Swanson, H. L., & Beebe-Frankenberger, M. (2004) · Journal of Educational Psychology · doi:10.1037/0022-0663.96.3.471 · Cited by 638 · cited 1×
“By kindergarten, WM capacity is predictive of Gf (Engel de Abreu et al., 2010), and individual differences in WM capacity predict children's verbal and mathematical aptitude (Cowan et al., 2005; Gathercole & Pickering, 2000; Swanson & Beebe-Frankenberger, 2004).”
BackgroundKane, M. J., Hambrick, D. Z., & Conway, A. R. A. (2005) · Psychological Bulletin · doi:10.1037/0033-2909.131.1.66 · Cited by 545
Dahlin, E., Nyberg, L., Bäckman, L., & Neely, A. S. (2008) · Psychology and Aging · doi:10.1037/a0014296 · Cited by 457
DIAMOND, A. (2005) · Development and Psychopathology · doi:10.1017/s0954579405050388 · Cited by 428
Getting a Grip on Drinking Behavior: Training Working Memory to Reduce Alcohol Abuse
Houben, K., Wiers, R. W., & Jansen, A. (2011) · Psychological Science · doi:10.1177/0956797611412392 · Cited by 398
Holmes, J., Gathercole, S. E., Place, M., Dunning, D. L., Hilton, K. A., & Elliott, J. G. (2010) · Applied Cognitive Psychology · doi:10.1002/acp.1589 · Cited by 370
Working memory plasticity in old age: practice gain, transfer, and maintenance
Li, S.-C., Schmiedek, F., Huxhold, O., Röcke, C., Smith, J., & Lindenberger, U. (2008) · Psychology and Aging · doi:10.1037/a0014343 · Cited by 369
Bherer, L., Kramer, A. F., Peterson, M. S., Colcombe, S., Erickson, K., & Becic, E. (2005) · Psychology and Aging · doi:10.1037/0882-7974.20.4.695 · Cited by 312
A Controlled Trial of Working Memory Training for Children and Adolescents with ADHD
Beck, S. J., Hanson, C. A., Puffenberger, S. S., Benninger, K. L., & Benninger, W. B. (2010) · Journal of Clinical Child & Adolescent Psychology · doi:10.1080/15374416.2010.517162 · Cited by 311 · cited 10×
“The identification of WM as a central component of cognition has introduced the possibility that focused, theoretically motivated techniques for training broad abilities can be developed. Klingberg (2010) hypothesized that three factors are critical to a successful cognitive training program (see also Jaeggi, Studer-L…”
BackgroundInfluentialStrategy training and working memory task performance
Turley-Ames, K. (2003) · Journal of Memory and Language · doi:10.1016/s0749-596x(03)00095-0 · Cited by 289
Effects of working memory training on reading in children with special needs
Dahlin, K. I. E. (2011) · Reading and Writing · doi:10.1007/s11145-010-9238-y · Cited by 263
Visuo-Spatial Working Memory Span: A Sensitive Measure of Cognitive Deficits in Children With ADHD
Westerberg, H., Hirvikoski, T., Forssberg, H., & Klingberg, T. (2004) · Child Neuropsychology · doi:10.1080/09297040409609806 · Cited by 225 · cited 1×
“By the account of Westerberg et al. (2004), performance on this task should reflect the ability to sustain attention, and improvement would thus signal a decrease in inattentive symptoms.”
BackgroundEffects of skill training on working memory capacity.
Lee, Y.-S., Lu, M.-J., & Ko, H.-P. (2007) · Learning and Instruction · doi:10.1016/j.learninstruc.2007.02.010 · Cited by 191
Broadway, J. M., & Engle, R. W. (2010) · Behavior Research Methods · doi:10.3758/brm.42.2.563 · Cited by 184
Self-citationIndividual differences in working memory capacity and divided attention in dichotic listening
Colflesh, G. J. H., & Conway, A. R. A. (2007) · Psychonomic Bulletin & Review · doi:10.3758/bf03196824 · Cited by 180
Score gains on g-loaded tests: No g
te Nijenhuis, J., van Vianen, A. E. M., & van der Flier, H. (2007) · Intelligence · doi:10.1016/j.intell.2006.07.006 · Cited by 129
van Vugt, M. K., & Jha, A. P. (2011) · Cognitive, Affective, & Behavioral Neuroscience · doi:10.3758/s13415-011-0048-8 · Cited by 108
Gibson, B. S., Gondoli, D. M., Johnson, A. C., Steeger, C. M., Dobrzenski, B. A., & Morrissey, R. A. (2011) · Child Neuropsychology · doi:10.1080/09297049.2010.551186 · Cited by 71
Cited by
Sorted by citations
Diamond, A. (2013) · Annual Review of Psychology · doi:10.1146/annurev-psych-113011-143750 · Cited by 13,268
Sheeran, P., & Webb, T. L. (2016) · Social and Personality Psychology Compass · doi:10.1111/spc3.12265 · Cited by 2,185
Do “brain-training” programs work?
Simons, D. J., Boot, W. R., Charness, N., Gathercole, S. E., Chabris, C. F., Hambrick, D. Z., & Stine-Morrow, E. A. L. (2016) · Psychological Science in the Public Interest · doi:10.1177/1529100616661983 · Cited by 1,183
Beyond Cumulative Risk: A Dimensional Approach to Childhood Adversity
McLaughlin, K. A., & Sheridan, M. A. (2016) · Current Directions in Psychological Science · doi:10.1177/0963721416655883 · Cited by 906
Melby-Lervåg, M., Redick, T. S., & Hulme, C. (2016) · Perspectives on Psychological Science · doi:10.1177/1745691616635612 · Cited by 983
“*Klingberg, T., Forssberg, H., & Westerberg, H. (2002). Training of working memory in children with ADHD.”
Self-citation
Metadata
- Authors
- Shipstead, Z., Redick, T. S., & Engle, R. W.
- Affiliations
- Georgia Institute of Technology (US)
- Venue
- Psychological Bulletin
- Published
- 2012-07
- Volume
- 138
- Issue
- 4
- Pages
- 628-654
- ISSN
- 0033-2909 (ISSN-L)
- 1939-1455
- OpenAlex
- W2160648917
- Cited by
- 1,101
- References
- 43
- Citations by year
- 2026: 30 · 2025: 37 · 2024: 35 · 2023: 41 · 2022: 52 · 2021: 65 · 2020: 118 · 2019: 74 · 2018: 90 · 2017: 110 · 2016: 109 · 2015: 125 · 2014: 110 · 2013: 73 · 2012: 27
- FWCI
- 142.90
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Psychological Bulletin (publishedVersion)
- PubMed (publishedVersion)
- Funders
- Office of Naval Research (N00014-09-1-0129)
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Cognitive Abilities and Testing
- Social Sciences › Psychology › Developmental and Educational Psychology › Cognitive and developmental aspects of mathematical skills
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Cognitive Functions and Memory
- Keywords
- working memory training, transfer of training, fluid intelligence, attentional control, ADHD symptoms, task-specific learning, working memory capacity, cognitive training
- MeSH terms
- Attention, Attention Deficit Disorder with Hyperactivity, Cognition, Data Interpretation, Statistical, Humans, Intelligence, Memory, Short-Term, Neuropsychological Tests, Practice, Psychological, Research Design, Transfer, Psychology, Program Evaluation, Treatment Outcome
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
