Placebo effects in cognitive training

Foroughi, Cyrus K.; Monfort, Samuel S.; Paczynski, Martin; McKnight, Patrick E.; Greenwood, P. M.

doi:10.1073/pnas.1601243113

Cited by 270Cognitive Abilities and TestingPain Management and Placebo EffectCognitive Functions and Memory

Placebo effects in cognitive training

Open access

Foroughi, Cyrus K., Monfort, Samuel S., Paczynski, Martin, McKnight, Patrick E., Greenwood, P. M.·2016·Proceedings of the National Academy of Sciences

DOI 10.1073/pnas.1601243113PMC PMC4941515

Open this paper in CoChat — free account

Abstract

Significance: Placebo effects pose problems for some intervention studies, particularly those with no clearly identified mechanism. Cognitive training falls into that category, and yet the role of placebos in cognitive interventions has not yet been critically evaluated. Here, we show clear evidence of placebo effects after a brief cognitive training routine that led to significant fluid intelligence gains. Our goal is to emphasize the importance of ruling out alternative explanations before attributing the effect to interventions. Based on our findings, we recommend that researchers account for placebo effects before claiming treatment effects.

Integrity signals

Registry

Crossref · 10.1073/pnas.1601243113

Cites

42 of 42 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

The no-contact group is not given monetary (or equivalent) rewards or stimulating personal attention, both of which positively impact performance.
“The no-contact group is not given monetary (or equivalent) rewards or stimulating personal attention, both of which positively impact performance.”
From Training-induced improvement in working memory tasks results from switching to efficient strategies (2021) · cites this paper as Foroughi, Monfort, Paczynski, McKnight, & Greenwood, 2016

Estimating the reproducibility of psychological science
Open Science Collaboration (2015) · Science · doi:10.1126/science.aac4716 · Cited by 8,515 · see citing works
Untitled work
(1999) · Cited by 6,308 · see citing works
“The Need for Cognition.”
Cacioppo, J. T., & Petty, R. E. (1982) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.42.1.116 · Cited by 5,359 · see citing works
The validity and utility of selection methods in personnel psychology: Practical and theoretical implications of 85 years of research findings.
Schmidt, F. L., & Hunter, J. E. (1998) · Psychological Bulletin · doi:10.1037//0033-2909.124.2.262 · Cited by 4,180 · see citing works
Untitled work
(1998) · Cited by 4,172 · see citing works
Handbook of Psychotherapy and Behavior Change
Garfield, S. L., Bergin, A. E., & Dryden, W. (1987) · Journal of Cognitive Psychotherapy · doi:10.1891/0889-8391.1.4.264a · Cited by 3,998 · see citing works
Intelligence: Knowns and unknowns.
Neisser, U., Boodoo, G., Bouchard, T. J., Boykin, A. W., Brody, N., Ceci, S. J., Halpern, D. F., Loehlin, J. C., Perloff, R., Sternberg, R. J., et al. (1996) · American Psychologist · doi:10.1037/0003-066x.51.2.77 · Cited by 2,913 · see citing works
Improving fluid intelligence with training on working memory
Jaeggi, S. M., Buschkuehl, M., Jonides, J., & Perrig, W. J. (2008) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0801268105 · Cited by 2,187 · see citing works
Is working memory training effective? A meta-analytic review
Melby-Lervåg, M., & Hulme, C. (2013) · Developmental Psychology · doi:10.1037/a0028228 · Cited by 1,782 · see citing works
Long-term Effects of Cognitive Training on Everyday Functional Outcomes in Older Adults
Willis, S. L., Tennstedt, S. L., Marsiske, M., Ball, K., Elias, J., Koepke, K. M., Morris, J. N., Rebok, G. W., Unverzagt, F. W., Stoddard, A. M., et al. (2006) · JAMA · doi:10.1001/jama.296.23.2805 · Cited by 1,496 · see citing works
Sources of human psychological differences: the Minnesota Study of Twins Reared Apart
Bouchard, T. J., Lykken, D. T., McGue, M., Segal, N. L., & Tellegen, A. (1990) · Science · doi:10.1126/science.2218526 · Cited by 1,373 · see citing works
Is working memory training effective?
Shipstead, Z., Redick, T. S., & Engle, R. W. (2012) · Psychological Bulletin · doi:10.1037/a0027473 · Cited by 1,101 · see citing works
Handbook of Psychotherapy and Behavior Change
Kepecs, J. G. (1980) · American Journal of Psychotherapy · doi:10.1176/appi.psychotherapy.1980.34.1.131 · Cited by 967 · see citing works
Intelligence and socioeconomic success: A meta-analytic review of longitudinal research
Strenze, T. (2006) · Intelligence · doi:10.1016/j.intell.2006.09.004 · Cited by 950 · see citing works
The Importance of Placebo Effects in Pain Treatment and Research
Turner, J. A. (1994) · JAMA · doi:10.1001/jama.1994.03510440069036 · Cited by 877 · see citing works
Short- and long-term benefits of cognitive training
Jaeggi, S. M., Buschkuehl, M., Jonides, J., & Shah, P. (2011) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1103228108 · Cited by 769 · see citing works
Improving fluid intelligence with training on working memory: a meta-analysis
Au, J., Sheehan, E., Tsai, N., Duncan, G. J., Buschkuehl, M., & Jaeggi, S. M. (2015) · Psychonomic Bulletin & Review · doi:10.3758/s13423-014-0699-x · Cited by 671 · cited 7× · see citing works
“(25) only two provided sufficient detail to determine whether participants were recruited overtly [e.”
BackgroundMethodInfluential
The Pervasive Problem With Placebos in Psychology: Why Active Control Groups Are Not Sufficient to Rule Out Placebo Effects
Boot, W. R., Simons, D. J., Stothart, C., & Stutts, C. (2013) · Perspectives on Psychological Science · doi:10.1177/1745691613491271 · Cited by 670 · see citing works
Intelligence Predicts Health and Longevity, but Why?
Gottfredson, L. S., & Deary, I. J. (2004) · Current Directions in Psychological Science · doi:10.1111/j.0963-7214.2004.01301001.x · Cited by 623 · see citing works
No evidence of intelligence improvement after working memory training: A randomized, placebo-controlled study.
Redick, T. S., Shipstead, Z., Harrison, T. L., Hicks, K. L., Fried, D. E., Hambrick, D. Z., Kane, M. J., & Engle, R. W. (2013) · Journal of Experimental Psychology: General · doi:10.1037/a0029082 · Cited by 617 · see citing works
Making Working Memory Work: A Meta-Analysis of Executive-Control and Working Memory Training in Older Adults
Karbach, J., & Verhaeghen, P. (2014) · Psychological Science · doi:10.1177/0956797614548725 · Cited by 589 · see citing works
Scholastic Assessment or g?: The Relationship Between the Scholastic Assessment Test and General Cognitive Ability
Frey, M. C., & Detterman, D. K. (2004) · Psychological Science · doi:10.1111/j.0956-7976.2004.00687.x · Cited by 585 · see citing works
Intelligence: is it the epidemiologists’ elusive “fundamental cause” of social class inequalities in health?
Gottfredson, L. S. (2004) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.86.1.174 · Cited by 580 · see citing works
The relationship between n-back performance and matrix reasoning — implications for training and transfer
Jaeggi, S. M., Studer-Luethi, B., Buschkuehl, M., Su, Y.-F., Jonides, J., & Perrig, W. J. (2010) · Intelligence · doi:10.1016/j.intell.2010.09.001 · Cited by 509 · see citing works
Longitudinal cohort study of childhood IQ and survival up to age 76
Whalley, L. J., & Deary, I. J. (2001) · BMJ · doi:10.1136/bmj.322.7290.819 · Cited by 496 · see citing works
Do Action Video Games Improve Perception and Cognition?
Boot, W. R., Blakely, D. P., & Simons, D. J. (2011) · Frontiers in Psychology · doi:10.3389/fpsyg.2011.00226 · Cited by 472 · see citing works
The role of individual differences in cognitive training and transfer
Jaeggi, S. M., Buschkuehl, M., Shah, P., & Jonides, J. (2014) · Memory & Cognition · doi:10.3758/s13421-013-0364-z · Cited by 432 · see citing works
Motivation and Autonomy in Counseling, Psychotherapy, and Behavior Change: A Look at Theory and Practice 1ψ7
Ryan, R. M., Lynch, M. F., Vansteenkiste, M., & Deci, E. L. (2011) · The Counseling Psychologist · doi:10.1177/0011000009359313 · Cited by 429 · see citing works
Schooling, intelligence, and income.
Ceci, S. J., & Williams, W. M. (1997) · American Psychologist · doi:10.1037/0003-066x.52.10.1051 · Cited by 407 · see citing works
Working Memory Training May Increase Working Memory Capacity but Not Fluid Intelligence
Harrison, T. L., Shipstead, Z., Hicks, K. L., Hambrick, D. Z., Redick, T. S., & Engle, R. W. (2013) · Psychological Science · doi:10.1177/0956797613492984 · Cited by 305 · see citing works
There is no convincing evidence that working memory training is effective: A reply to Au et al. (2014) and Karbach and Verhaeghen (2014)
Melby-Lervåg, M., & Hulme, C. (2016) · Psychonomic Bulletin & Review · doi:10.3758/s13423-015-0862-z · Cited by 189 · see citing works
Psychometric intelligence and achievement: A cross-lagged panel analysis
Watkins, M. W., Lei, P., & Canivez, G. L. (2006) · Intelligence · doi:10.1016/j.intell.2006.04.005 · Cited by 186 · see citing works
Variability and stability in cognitive abilities are largely genetic later in life
Plomin, R. J., Pedersen, N. L., Lichtenstein, P., & McClearn, G. E. (1994) · Behavior Genetics · doi:10.1007/bf01067188 · Cited by 165 · see citing works
Advanced Progressive Matrices
(2012) · SpringerReference · doi:10.1007/springerreference_184521 · Cited by 155 · see citing works
Patient Preferences in Randomised Trials: Threat or Opportunity?
Torgerson, D. J., Klaber-Moffett, J., & Russell, I. T. (1996) · Journal of Health Services Research & Policy · doi:10.1177/135581969600100403 · Cited by 138 · see citing works
Neurocognitive enhancement in older adults: Comparison of three cognitive training tasks to test a hypothesis of training transfer in brain connectivity
Strenziok, M., Parasuraman, R., Clarke, E., Cisler, D., Thompson, J. C., & Greenwood, P. M. (2013) · NeuroImage · doi:10.1016/j.neuroimage.2013.07.069 · Cited by 127 · see citing works
Self-citation
Ultimate validity of psychological tests
O’Toole, B. I., & Stankov, L. (1992) · Personality and Individual Differences · doi:10.1016/0191-8869(92)90241-g · Cited by 107 · see citing works
Reevaluating the effectiveness of n-back training on transfer through the Bayesian lens: Support for the null
Dougherty, M. R., Hamovitz, T., & Tidwell, J. W. (2016) · Psychonomic Bulletin & Review · doi:10.3758/s13423-015-0865-9 · Cited by 106 · see citing works
A Potential Spatial Working Memory Training Task to Improve Both Episodic Memory and Fluid Intelligence
Rudebeck, S. R., Bor, D., Ormond, A., O’Reilly, J. X., & Lee, A. C. H. (2012) · PLoS ONE · doi:10.1371/journal.pone.0050431 · Cited by 95 · see citing works
The mechanisms of far transfer from cognitive training: Review and hypothesis.
Greenwood, P. M., & Parasuraman, R. (2016) · Neuropsychology · doi:10.1037/neu0000235 · Cited by 62 · see citing works
Self-citation
The stability of general intelligence from early adulthood to middle-age
Larsen, L. P. S., Hartmann, P., & Nyborg, H. (2007) · Intelligence · doi:10.1016/j.intell.2007.01.001 · Cited by 59 · see citing works
A Cross-Lagged Panel Analysis of Psychometric Intelligence and Achievement in Reading and Math
Watkins, M. W., & Styck, K. M. (2017) · Journal of Intelligence · doi:10.3390/jintelligence5030031 · Cited by 39 · see citing works

Flagged first, then by citations

Sorted by citations

From many to (n)one: Meditation and the plasticity of the predictive mind
Laukkonen, R. E., & Slagter, H. A. (2021) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2021.06.021 · Cited by 187 · see citing works
Treatment to Enhance Cognition in Bipolar Disorder (TREC-BD): Efficacy of a Randomized Controlled Trial of Cognitive Remediation Versus Active Control
Lewandowski, K. E., Sperry, S. H., Cohen, B. M., Norris, L. A., Fitzmaurice, G. M., Ongur, D., & Keshavan, M. S. (2017) · The Journal of Clinical Psychiatry · doi:10.4088/jcp.17m11476 · Cited by 115 · see citing works
The Social Context of “Do-It-Yourself” Brain Stimulation: Neurohackers, Biohackers, and Lifehackers
Wexler, A. (2017) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2017.00224 · Cited by 101 · see citing works
The Effects of Mindfulness Meditation on Attention, Executive Control and Working Memory in Healthy Adults: A Meta-analysis of Randomized Controlled Trials
Yakobi, O., Smilek, D., & Danckert, J. (2021) · Cognitive Therapy and Research · doi:10.1007/s10608-020-10177-2 · Cited by 85 · see citing works
The Hype Cycle of Working Memory Training
Redick, T. S. (2019) · Current Directions in Psychological Science · doi:10.1177/0963721419848668 · Cited by 69 · see citing works
Advancing the understanding of placebo effects in psychological outcomes of exercise: Lessons learned and future directions
Lindheimer, J. B., Szabo, A., Raglin, J. S., & Beedie, C. (2020) · European Journal of Sport Science · doi:10.1080/17461391.2019.1632937 · Cited by 64 · see citing works
A randomised placebo-controlled study of purified anthocyanins on cognition in individuals at increased risk for dementia
Aarsland, D., Khalifa, K., Bergland, A. K., Soennesyn, H., Oppedal, K., Holteng, L. B. A., Oesterhus, R., Nakling, A., Jarholm, J. A., de Lucia, C., et al. (2023) · The American Journal of Geriatric Psychiatry · doi:10.1016/j.jagp.2022.10.002 · Cited by 36 · see citing works
The effect of monetary compensation on cognitive training outcomes
Katz, B., Jaeggi, S. M., Buschkuehl, M., Shah, P., & Jonides, J. (2018) · Learning and Motivation · doi:10.1016/j.lmot.2017.12.002 · Cited by 31 · see citing works
Training-induced improvement in working memory tasks results from switching to efficient strategies
Malinovitch, T., Jakoby, H., & Ahissar, M. (2021) · Psychonomic Bulletin & Review · doi:10.3758/s13423-020-01824-6 · Cited by 29 · see citing works

P2‐018: The Effect of a Computer‐Based Cognitive Training Program on Cognition
Yang, Y. (2016) · Alzheimer s & Dementia · doi:10.1016/j.jalz.2016.06.1222 · Cited by 1 · see citing works
Cognitive training for people with mild to moderate dementia
Bahar‐Fuchs, A., Martyr, A., Goh, A., Sabatés, J., & Clare, L. (2018) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd013069 · Cited by 104 · see citing works
[P4–026]: BIOLOGICAL FACTORS CONTRIBUTING TO THE RESPONSE TO COGNITIVE TRAINING IN MILD COGNITIVE IMPAIRMENT
Peter, J., & Klöppel, S. (2017) · Alzheimer s & Dementia · doi:10.1016/j.jalz.2017.06.1890
Transcranial direct current stimulation in combination with cognitive training in individuals with mild cognitive impairment: a controlled 3-parallel-arm study
Pallanti, S., Grassi, E., Knotková, H., & Galli, G. (2022) · CNS Spectrums · doi:10.1017/s1092852922000979 · Cited by 13 · see citing works
EFFECT ASSESSMENT OF A COGNITIVE TRAINING PLATFORM IN HEALTHY OLDER ADULTS
Yaneva, A., & Mateva, N. G. (2017) · CBU International Conference Proceedings · doi:10.12955/cbup.v5.1066 · Cited by 3 · see citing works

Authors: Foroughi, C. K., Monfort, S. S., Paczynski, M., McKnight, P. E., & Greenwood, P. M.
Affiliations: George Mason University (US)
ORCID: Foroughi, Cyrus K.
Monfort, Samuel S.
McKnight, Patrick E.
Greenwood, P. M.
Venue: Proceedings of the National Academy of Sciences
Publisher: National Academy of Sciences
Published: 2016-06-20
Volume: 113
Issue: 27
Pages: 7470-7474
ISSN: 0027-8424 (ISSN-L)
1091-6490
DOI: 10.1073/pnas.1601243113
PMC: PMC4941515
OpenAlex: W2470381355
Semantic Scholar: 2416a051ef3e473b5bfea04ec1d5ebe359d915b2
Cited by: 270
References: 42
Citations by year: 2026: 15 · 2025: 13 · 2024: 13 · 2023: 19 · 2022: 24 · 2021: 37 · 2020: 30 · 2019: 52 · 2018: 31 · 2017: 32 · 2016: 4
FWCI: 56.46
Type: journal article
Language: en
Open access: green
www.ncbi.nlm.nih.gov
Licence: www.pnas.org/preview_site/misc/userlicense.xhtml (vor, 183 d)
Locations: Proceedings of the National Academy of Sciences (publishedVersion)
PubMed Central (publishedVersion)
PubMed (publishedVersion)
Funders: DOD | Office of Naval Research (N00014-14-1-0201)
DOD | Air Force Office of Scientific Research (FA9550-10-1-0385)
Topics: Social Sciences › Psychology › Experimental and Cognitive Psychology › Cognitive Abilities and Testing
Life Sciences › Neuroscience › Cognitive Neuroscience › Pain Management and Placebo Effect
Social Sciences › Psychology › Experimental and Cognitive Psychology › Cognitive Functions and Memory
Keywords: placebo effect, cognitive training, fluid intelligence, brain training, self-selection, suggestion, IQ gains, confounding variables
MeSH terms: Cognition, Humans, Intelligence Tests, Teaching, Placebo Effect

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Placebo effects in cognitive training

Abstract

Integrity signals

Claims the paper makes

Claims other papers make about this one

Cites

Cited by

Related

Record

About these checks