Enhancing Cognitive Abilities with Comprehensive Training: A Large, Online, Randomized, Active-Controlled Trial
Open accessThe DOI matches its Crossref record; 50 of the 52 references it cites were found in a registry or an index.
Abstract
BACKGROUND: A variety of studies have demonstrated gains in cognitive ability following cognitive training interventions. However, other studies have not shown such gains, and questions remain regarding the efficacy of specific cognitive training interventions. Cognitive training research often involves programs made up of just one or a few exercises, targeting limited and specific cognitive endpoints. In addition, cognitive training studies typically involve small samples that may be insufficient for reliable measurement of change. Other studies have utilized training periods that were too short to generate reliable gains in cognitive performance. METHODS: The present study evaluated an online cognitive training program comprised of 49 exercises targeting a variety of cognitive capacities. The cognitive training program was compared to an active control condition in which participants completed crossword puzzles. All participants were recruited, trained, and tested online (N = 4,715 fully evaluable participants). Participants in both groups were instructed to complete one approximately 15-minute session at least 5 days per week for 10 weeks. RESULTS: Participants randomly assigned to the treatment group improved significantly more on the primary outcome measure, an aggregate measure of neuropsychological performance, than did the active control group (Cohen's d effect size = 0.255; 95% confidence interval = [0.198, 0.312]). Treatment participants showed greater improvements than controls on speed of processing, short-term memory, working memory, problem solving, and fluid reasoning assessments. Participants in the treatment group also showed greater improvements on self-reported measures of cognitive functioning, particularly on those items related to concentration compared to the control group (Cohen's d = 0.249; 95% confidence interval = [0.191, 0.306]). CONCLUSION: Taken together, these results indicate that a varied training program composed of a number of tasks targeted to different cognitive functions can show transfer to a wide range of untrained measures of cognitive performance. TRIAL REGISTRATION: ClinicalTrials.gov NCT-02367898.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures




Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The control was designed to match AKL-T01 on expectancy, engagement, and time on task in the form of a challenging and engaging digital word game, targeting cognitive domains not targeted by the AKL-T01 intervention and not primarily associated with ADHD.21”
From A novel digital intervention for actively reducing severity of paediatric ADHD (STARS-ADHD): a randomised controlled trial (2020) · cites this paper as [21]
In the citing paper
“However, research on cognitive training methods suggests a much smaller magnitude of improvement [46], and the TOVA test of attentional functioning has traditionally shown little to no placebo response [47]”
From Proof-of-concept study of an at-home, engaging, digital intervention for pediatric ADHD (2018) · cites this paper as [46]
In the citing paper
“Such a large scale study has been done online with young, healthy participants (n = 4,715)53 but not yet with older adults.”
From The use of commercial computerised cognitive games in older adults: a meta-analysis (2020) · cites this paper as [53]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Statistical Power Analysis for the Behavioral Sciences
Muller, K. (1989) · Technometrics · doi:10.1080/00401706.1989.10488618 · Cited by 99,167
Statistical power analysis for the behavioral sciences
(1990) · Computers, Environment and Urban Systems · doi:10.1016/0198-9715(90)90050-4 · Cited by 65,269
Flow: the psychology of optimal experience
(1990) · Choice Reviews Online · doi:10.5860/choice.28-0597 · Cited by 12,637
Flow: The Psychology of Optimal Experience
Buchanan, R., & Csikszentmihalyi, M. (1991) · Design Issues · doi:10.2307/1511458 · Cited by 9,394
The relation of strength of stimulus to rapidity of habit formation
Yerkes, R. M., & Dodson, J. D. (1908) · Journal of Comparative Neurology and Psychology · doi:10.1002/cne.920180503 · Cited by 6,911
The Cognitive Failures Questionnaire (CFQ) and its correlates
Broadbent, D. E., Cooper, P. F., FitzGerald, P., & Parkes, K. R. (1982) · British Journal of Clinical Psychology · doi:10.1111/j.2044-8260.1982.tb01421.x · Cited by 2,912 · cited 1×
“Participants also completed a survey including nine questions related to specific cognitive failures [44] and successes as well as emotional status.”
BackgroundAction video game modifies visual selective attention
Green, C. S., & Bavelier, D. (2003) · Nature · doi:10.1038/nature01647 · Cited by 2,540
INTERHEMISPHERIC DIFFERENCES IN THE LOCALIZATION OF PSYCHOLOGICAL PROCESSES IN MAN
MILNER, B. (1971) · British Medical Bulletin · doi:10.1093/oxfordjournals.bmb.a070866 · Cited by 2,329 · cited 1×
“(1) Forward and (2) Reverse Memory Span assessed visual short-term and working memory, respectively, and are based on the Corsi Blocks tasks [38].”
MethodWechsler Adult Intelligence Scale--Fourth Edition
Wechsler, D. (2012) · PsycTESTS Dataset · doi:10.1037/t15169-000 · Cited by 2,232
Improving fluid intelligence with training on working memory
Jaeggi, S. M., Buschkuehl, M., Jonides, J., & Perrig, W. J. (2008) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0801268105 · Cited by 2,187 · cited 1×
“The findings of this study are consistent with the extant literature on cognitive training that shows that progressively challenging, targeted cognitive training can be an effective tool for improving core cognitive abilities including speed of processing [13], working memory [46], and fluid reasoning [10].”
ResultEffects of Cognitive Training Interventions With Older Adults: A Randomized Controlled Trial
Ball, K., Berch, D. B., Helmers, K. F., Jobe, J. B., Leveck, M. D., Marsiske, M., Morris, J. N., Rebok, G. W., Smith, D. M., Tennstedt, S. L., et al. (2002) · JAMA · doi:10.1001/jama.288.18.2271 · Cited by 2,049
Computerized training of working memory in children with ADHD – a randomized, controlled trial
Klingberg, T., Fernell, E., Olesen, P. J., Johnson, M., Gustafsson, P., Dahlström, K., Gillberg, C. G., Forssberg, H., & Westerberg, H. (2005) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1097/00004583-200502000-00010 · Cited by 1,949
Video game training enhances cognitive control in older adults
Anguera, J. A., Boccanfuso, J., Rintoul, J. L., Al-Hashimi, O., Faraji, F., Janowich, J., Kong, E., Larraburo, Y., Rolle, C., Johnston, E., et al. (2013) · Nature · doi:10.1038/nature12486 · Cited by 1,666 · cited 1×
“Recent evidence suggests that engaging in cognitively challenging activities can positively impact brain function, with studies demonstrating behavioral [1, 2], physiological [3, 4], and real-world functional [5, 6] gains.”
BackgroundTraining and plasticity of working memory
Klingberg, T. (2010) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2010.05.002 · Cited by 1,585 · cited 1×
“The findings of this study are consistent with the extant literature on cognitive training that shows that progressively challenging, targeted cognitive training can be an effective tool for improving core cognitive abilities including speed of processing [13], working memory [46], and fluid reasoning [10].”
ResultThe Raven's Progressive Matrices: Change and Stability over Culture and Time
Raven, J. (2000) · Cognitive Psychology · doi:10.1006/cogp.1999.0735 · Cited by 1,560 · cited 1×
“(4) Progressive Matrices was based on established matrix reasoning assessments [40] and was designed to assess problem solving and fluid reasoning.”
BackgroundStatistical Estimates and Transformed Beta-Variables.
Minton, P. D., & Blom, G. (1960) · The American Mathematical Monthly · doi:10.2307/2308690 · Cited by 1,166
Putting brain training to the test
Owen, A. M., Hampshire, A., Grahn, J. A., Stenton, R., Dajani, S., Burns, A. S., Howard, R. J., & Ballard, C. G. (2010) · Nature · doi:10.1038/nature09042 · Cited by 1,056 · cited 2×
“Several such programs have been used in research, with promising results for improving cognitive functioning following training reported in most cases [2, 4, 10–16]; however, other studies have failed to demonstrate such gains [17, 18].”
BackgroundInfluentialCognitive ability, cognitive aptitudes, job knowledge, and job performance
Hunter, J. E. (1986) · Journal of Vocational Behavior · doi:10.1016/0001-8791(86)90013-8 · Cited by 988 · cited 1×
“Because cognitive abilities are critical for success at work [19], school [20–22], and activities of daily living [23], there is considerable interest in using large-scale approaches to rigorously investigate the efficacy of cognitive intervention strategies.”
BackgroundThe musician's brain as a model of neuroplasticity
Münte, T. F., Altenmüller, E., & Jäncke, L. (2002) · Nature Reviews Neuroscience · doi:10.1038/nrn843 · Cited by 950
Transfer of Learning After Updating Training Mediated by the Striatum
Dahlin, E., Neely, A. S., Larsson, A., Bäckman, L., & Nyberg, L. (2008) · Science · doi:10.1126/science.1155466 · Cited by 892
Smith, G. E., Housen, P., Yaffe, K., Ruff, R., Kennison, R. F., Mahncke, H. W., & Zelinski, E. M. (2009) · Journal of the American Geriatrics Society · doi:10.1111/j.1532-5415.2008.02167.x · Cited by 785 · cited 1×
“Recent evidence suggests that engaging in cognitively challenging activities can positively impact brain function, with studies demonstrating behavioral [1, 2], physiological [3, 4], and real-world functional [5, 6] gains.”
BackgroundAssociations between cognitive, functional, and FDG-PET measures of decline in AD and MCI
Landau, S. M., Harvey, D., Madison, C. M., Koeppe, R. A., Reiman, E. M., Foster, N. L., Weiner, M. W., & Jagust, W. J. (2011) · Neurobiology of Aging · doi:10.1016/j.neurobiolaging.2009.07.002 · Cited by 750 · cited 1×
“Recent evidence suggests that engaging in cognitively challenging activities can positively impact brain function, with studies demonstrating behavioral [1, 2], physiological [3, 4], and real-world functional [5, 6] gains.”
BackgroundA 3 min reasoning test based on grammatical transformation
Baddeley, A. D. (1968) · Psychonomic Science · doi:10.3758/bf03331551 · Cited by 649 · cited 1×
“(3) Grammatical Reasoning was based on Baddeley’s Grammatical Reasoning Test [39], designed to assess cognitive flexibility and reasoning, and required participants to rapidly and accurately evaluate potentially confusing grammatical statements.”
MethodRedick, T. S., Shipstead, Z., Harrison, T. L., Hicks, K. L., Fried, D. E., Hambrick, D. Z., Kane, M. J., & Engle, R. W. (2013) · Journal of Experimental Psychology: General · doi:10.1037/a0029082 · Cited by 617
Schmiedek (2010) · Frontiers in Aging Neuroscience · doi:10.3389/fnagi.2010.00027 · Cited by 605
Brain plasticity through the life span: Learning to learn and action video games
Bavelier, D., Green, C. S., Pouget, A., & Schrater, P. (2012) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-060909-152832 · Cited by 541 · cited 1×
“This variety increased the opportunity for “learning to learn,” which may enhance transfer to untrained tasks [24].”
BackgroundAcquiring “the Knowledge” of London's Layout Drives Structural Brain Changes
Woollett, K., & Maguire, E. A. (2011) · Current Biology · doi:10.1016/j.cub.2011.11.018 · Cited by 509
Relations between preschool attention span-persistence and age 25 educational outcomes
McClelland, M. M., Acock, A. C., Piccinin, A., Rhea, S. A., & Stallings, M. C. (2013) · Early Childhood Research Quarterly · doi:10.1016/j.ecresq.2012.07.008 · Cited by 477
Do Action Video Games Improve Perception and Cognition?
Boot, W. R., Blakely, D. P., & Simons, D. J. (2011) · Frontiers in Psychology · doi:10.3389/fpsyg.2011.00226 · Cited by 472 · cited 1×
“This is important because it has been suggested that belief in the efficacy of a training intervention could affect effort and performance on testing outcomes [47].”
BackgroundWorking-memory training in younger and older adults: training gains, transfer, and maintenance
Brehmer, Y., Westerberg, H., & Bäckman, L. (2012) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2012.00063 · Cited by 460 · cited 1×
“For example, adaptive difficulty may play an important role in driving the transfer of training [51].”
BackgroundCognitive Training for Improving Executive Function in Chemotherapy-Treated Breast Cancer Survivors
Kesler, S., Hadi Hosseini, S. M., Heckler, C., Janelsins, M., Palesh, O., Mustian, K., & Morrow, G. (2013) · Clinical Breast Cancer · doi:10.1016/j.clbc.2013.02.004 · Cited by 300 · cited 1×
“Previous studies using this program have demonstrated improvements in cognition in children with Turner’s Syndrome [25]; pediatric cancer survivors [26]; healthy middle-aged adults [27]; healthy older adults [28]; older adults with mild cognitive impairment [29]; and adult survivors of breast cancer [30].”
MethodFLOYD, R. G., EVANS, J. J., & McGREW, K. S. (2003) · Psychology in the Schools · doi:10.1002/pits.10083 · Cited by 290
Owsley, C., Sloane, M., McGwin Jr., G., & Ball, K. (2002) · Gerontology · doi:10.1159/000058360 · Cited by 287 · cited 1×
“Because cognitive abilities are critical for success at work [19], school [20–22], and activities of daily living [23], there is considerable interest in using large-scale approaches to rigorously investigate the efficacy of cognitive intervention strategies.”
BackgroundCognitive Training Decreases Motor Vehicle Collision Involvement of Older Drivers
Ball, K., Edwards, J. D., Ross, L. A., & McGwin, Jr. (2010) · Journal of the American Geriatrics Society · doi:10.1111/j.1532-5415.2010.03138.x · Cited by 256 · cited 1×
“Recent evidence suggests that engaging in cognitively challenging activities can positively impact brain function, with studies demonstrating behavioral [1, 2], physiological [3, 4], and real-world functional [5, 6] gains.”
BackgroundThe Influence of Perceptual Training on Working Memory in Older Adults
Berry, A. S., Zanto, T. P., Clapp, W. C., Hardy, J. L., Delahunt, P. B., Mahncke, H. W., & Gazzaley, A. (2010) · PLoS ONE · doi:10.1371/journal.pone.0011537 · Cited by 240
Self-citationEvans, J. J., Floyd, R. G., McGrew, K. S., & Leforgee, M. H. (2002) · School Psychology Review · doi:10.1080/02796015.2002.12086154 · Cited by 206
Wolinsky, F. D., Vander Weg, M. W., Howren, M. B., Jones, M. P., & Dotson, M. M. (2013) · PLoS ONE · doi:10.1371/journal.pone.0061624 · Cited by 201
Wolinsky, F. D., Unverzagt, F. W., Smith, D. M., Jones, R., Stoddard, A., & Tennstedt, S. L. (2006) · The Journals of Gerontology: Series A · doi:10.1093/gerona/61.12.1324 · Cited by 200 · cited 1×
“Recent evidence suggests that engaging in cognitively challenging activities can positively impact brain function, with studies demonstrating behavioral [1, 2], physiological [3, 4], and real-world functional [5, 6] gains.”
BackgroundOn methodological standards in training and transfer experiments
Green, C. S., Strobach, T., & Schubert, T. (2014) · Psychological Research · doi:10.1007/s00426-013-0535-3 · Cited by 188 · cited 1×
“As has been noted previously [50], most cognitive training studies that have shown null results have not been powered in such a way that either a positive or a null outcome would be informative, and often include quite short training periods.”
ResultAssociation of Crossword Puzzle Participation with Memory Decline in Persons Who Develop Dementia
Pillai, J. A., Hall, C. B., Dickson, D. W., Buschke, H., Lipton, R. B., & Verghese, J. (2011) · Journal of the International Neuropsychological Society · doi:10.1017/s1355617711001111 · Cited by 165 · cited 1×
“linked regular engagement with crossword puzzles to a delay in the onset of memory decline in older adults [33].”
BackgroundKesler, S. R., Lacayo, N. J., & Jo, B. (2011) · Brain Injury · doi:10.3109/02699052.2010.536194 · Cited by 162
Finn, M., & McDonald, S. (2011) · Brain Impairment · doi:10.1375/brim.12.3.187 · Cited by 135 · cited 1×
“Previous studies using this program have demonstrated improvements in cognition in children with Turner’s Syndrome [25]; pediatric cancer survivors [26]; healthy middle-aged adults [27]; healthy older adults [28]; older adults with mild cognitive impairment [29]; and adult survivors of breast cancer [30].”
MethodMackey, A. P., Whitaker, K. J., & Bunge, S. A. (2012) · Frontiers in Neuroanatomy · doi:10.3389/fnana.2012.00032 · Cited by 126
Mayas, J., Parmentier, F. B. R., Andrés, P., & Ballesteros, S. (2014) · PLoS ONE · doi:10.1371/journal.pone.0092269 · Cited by 85 · cited 1×
“Previous studies using this program have demonstrated improvements in cognition in children with Turner’s Syndrome [25]; pediatric cancer survivors [26]; healthy middle-aged adults [27]; healthy older adults [28]; older adults with mild cognitive impairment [29]; and adult survivors of breast cancer [30].”
Calculation and number processing: Assessment battery; role of demographic factors
Deloche, G., Seron, X., Larroque, C., Magnien, C., Metz-lutz, M. N., Noel, M. N., Riva, I., Schils, J. P., Dordain, M., Ferrand, I., et al. (1994) · Journal of Clinical and Experimental Neuropsychology · doi:10.1080/01688639408402631 · Cited by 70
Kesler, S. R., Sheau, K. E., Koovakkattu, D., & Reiss, A. L. (2011) · Neuropsychological Rehabilitation · doi:10.1080/09602011.2011.578446 · Cited by 59 · cited 1×
“Previous studies using this program have demonstrated improvements in cognition in children with Turner’s Syndrome [25]; pediatric cancer survivors [26]; healthy middle-aged adults [27]; healthy older adults [28]; older adults with mild cognitive impairment [29]; and adult survivors of breast cancer [30].”
MethodRattray, B., & Smee, D. J. (2013) · Journal of science and medicine in sport · doi:10.1016/j.jsams.2012.12.007 · Cited by 30
Can Computerized Brain Training Games be Used to Identify Early Cognitive Impairment in Cirrhosis?
Tartaglione, E. V., Derleth, M., Yu, L., & Ioannou, G. N. (2014) · The American Journal of Gastroenterology · doi:10.1038/ajg.2013.306 · Cited by 13
David, P., & Gelfeld, V. (2015) · doi:10.26419/res.00096.001 · Cited by 10
(1990)
Research works printed but not linked: 1
- Hardy JL, Drescher D, Sarkar K, Kellett G, Scanlon M. Enhancing visual memory and attention with a web-based cognitive training program. MENSA Research Journal. 2011; 42(2): 13– 20.
Cited by
Do “brain-training” programs work?
Simons, D. J., Boot, W. R., Charness, N., Gathercole, S. E., Chabris, C. F., Hambrick, D. Z., & Stine-Morrow, E. A. L. (2016) · Psychological Science in the Public Interest · doi:10.1177/1529100616661983 · Cited by 1,183
Kollins, S. H., DeLoss, D. J., Cañadas, E., Lutz, J., Findling, R. L., Keefe, R. S. E., Epstein, J. N., Cutler, A. J., & Faraone, S. V. (2020) · The Lancet Digital Health · doi:10.1016/s2589-7500(20)30017-0 · Cited by 385
Diamond, A., & Ling, D. S. (2019) · Cognitive and Working Memory Training · doi:10.1093/oso/9780199974467.003.0008 · Cited by 247
Pallavicini, F., Ferrari, A., & Mantovani, F. (2018) · Frontiers in Psychology · doi:10.3389/fpsyg.2018.02127 · Cited by 204
Computerised cognitive training for preventing dementia in people with mild cognitive impairment
Gates, N. J., Vernooij, R. W., Di Nisio, M., Karim, S., March, E., Martínez, G., & Rutjes, A. W. (2019) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd012279.pub2 · Cited by 168
Metadata
- Authors
- Hardy, J. L., Nelson, R. A., Thomason, M. E., Sternberg, D. A., Katovich, K., Farzin, F., & Scanlon, M.
- Affiliations
- Lumos Labs (United States) (US)
- Wheaton College - Massachusetts (US)
- Wayne State University (US)
- Corresponding author
- Sternberg, Daniel A.
- Venue
- PLoS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2015-09-02
- Volume
- 10
- Issue
- 9
- Pages
- e0134467
- ISSN
- 1932-6203 (ISSN-L)
- PMC
- PMC4557999
- OpenAlex
- W1755037248
- Cited by
- 183
- References
- 52
- Citations by year
- 2026: 14 · 2025: 15 · 2024: 17 · 2023: 15 · 2022: 18 · 2021: 21 · 2020: 16 · 2019: 20 · 2018: 17 · 2017: 20 · 2016: 9 · 2015: 1
- FWCI
- 23.67
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- PLoS ONE (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Wheaton College Digital Repository (Wheaton College (MA)) (submittedVersion, cc-by-sa)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Figshare (submittedVersion, cc-by)
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Cognitive Abilities and Testing
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Cognitive Functions and Memory
- Health Sciences › Medicine › Psychiatry and Mental health › Dementia and Cognitive Impairment Research
- Keywords
- cognitive training, transfer of training, neuropsychological performance, processing speed, short-term memory, working memory, fluid reasoning, problem solving, concentration, crossword puzzles, active control
- MeSH terms
- Adolescent, Adult, Aged, Aged, 80 and over, Attention, Cognition, Female, Humans, Male, Memory, Short-Term, Middle Aged, Neuropsychological Tests, Practice, Psychological, Problem Solving, Internet, Young Adult
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.