The Pervasive Problem With Placebos in Psychology: Why Active Control Groups Are Not Sufficient to Rule Out Placebo Effects
The DOI matches its Crossref record; 48 of the 48 references it cites were found in a registry or an index.
Abstract
To draw causal conclusions about the efficacy of a psychological intervention, researchers must compare the treatment condition with a control group that accounts for improvements caused by factors other than the treatment. Using an active control helps to control for the possibility that improvement by the experimental group resulted from a placebo effect. Although active control groups are superior to "no-contact" controls, only when the active control group has the same expectation of improvement as the experimental group can we attribute differential improvements to the potency of the treatment. Despite the need to match expectations between treatment and control groups, almost no psychological interventions do so. This failure to control for expectations is not a minor omission-it is a fundamental design flaw that potentially undermines any causal inference. We illustrate these principles with a detailed example from the video-game-training literature showing how the use of an active control group does not eliminate expectation differences. The problem permeates other interventions as well, including those targeting mental health, cognition, and educational achievement. Fortunately, measuring expectations and adopting alternative experimental designs makes it possible to control for placebo effects, thereby increasing confidence in the causal efficacy of psychological interventions.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“One potentially critical factor is the type of activity the control group is exposed to (Boot, Simons, Stothart, & Stutts, 2013; Buschkuehl & Jaeggi, 2011; Melby-Lervåg & Hulme, 2013; Shipstead et al., 2012).”
From Working Memory Training Does Not Improve Performance on Measures of Intelligence or Other Measures of “Far Transfer”: Evidence From a Meta-Analytic Review (2016) · cites this paper as Boot, Simons, Stothart, & Stutts, 2013
In the citing paper
“methodological deficiencies in both design and analysis persist in the WM training literature, despite many prior suggestions for remediation (Boot et al., 2013;Shipstead, Redick, & Engle, 2012;Tidwell et al., 2014).”
From Reevaluating the effectiveness of n-back training on transfer through the Bayesian lens: Support for the null (2016) · cites this paper as Boot et al., 2013
In the citing paper
“However, the limited use of active control groups may compromise the rigor of comparisons as these groups better account for placebo effects and participant expectations [65].”
From Effects of Third-Wave Cognitive Behavioral Therapy for Healthcare Professionals’ Burnout: A Systematic Review and Meta-Analysis (2025) · cites this paper as [65]
In the citing paper
“Additionally, unless the design of the study is a double-blind design, the true effectiveness of an intervention cannot be concluded (Boot et al., 2013).”
From Effectiveness of stress management interventions to change cortisol levels: a systematic review and meta-analysis. (2024) · cites this paper as Boot et al., 2013
In the citing paper
“Second, expectations of efficacy have been shown to moderate intervention effects in general, and also for digital interventions.32”
From A novel digital intervention for actively reducing severity of paediatric ADHD (STARS-ADHD): a randomised controlled trial (2020) · cites this paper as [32]
2 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Yaşlı Kadınlarda Üreme Sağlığı
Kokanalı, D., & Engin Üstün, Y. (n.d.) · DergiPark (Istanbul University) · Cited by 170,090
Fitness Effects on the Cognitive Function of Older Adults: A Meta-Analytic Study
Colcombe, S., & Kramer, A. F. (2003) · Psychological Science · doi:10.1111/1467-9280.t01-1-01430 · Cited by 3,782
Action video game modifies visual selective attention
Green, C. S., & Bavelier, D. (2003) · Nature · doi:10.1038/nature01647 · Cited by 2,540
Writing About Emotional Experiences as a Therapeutic Process
Pennebaker, J. W. (1997) · Psychological Science · doi:10.1111/j.1467-9280.1997.tb00403.x · Cited by 2,486
Improving fluid intelligence with training on working memory
Jaeggi, S. M., Buschkuehl, M., Jonides, J., & Perrig, W. J. (2008) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0801268105 · Cited by 2,187
Anderson, C. A., Shibuya, A., Ihori, N., Swing, E. L., Bushman, B. J., Sakamoto, A., Rothstein, H. R., & Saleem, M. (2010) · Psychological Bulletin · doi:10.1037/a0018251 · Cited by 2,048
Placebo-Induced Changes in fMRI in the Anticipation and Experience of Pain
Wager, T. D., Rilling, J. K., Smith, E. E., Sokolik, A., Casey, K. L., Davidson, R. J., Kosslyn, S. M., Rose, R. M., & Cohen, J. D. (2004) · Science · doi:10.1126/science.1093065 · Cited by 1,992
Ageing, fitness and neurocognitive function
Kramer, A. F., Hahn, S., Cohen, N. J., Banich, M. T., McAuley, E., Harrison, C. R., Chason, J., Vakil, E., Bardell, L., Boileau, R. A., et al. (1999) · Nature · doi:10.1038/22682 · Cited by 1,394
Artifact in behavioral research
Rosenthal, R., & Rosnow, R. L. (1969) · Medical Entomology and Zoology · Cited by 1,186
A Comprehensive Review of the Placebo Effect: Recent Advances and Current Thought
Price, D. D., Finniss, D. G., & Benedetti, F. (2008) · Annual Review of Psychology · doi:10.1146/annurev.psych.59.113006.095941 · Cited by 1,146
Research works printed but not linked: 3
- 10.1016/j .actpsy.2012.06.011 · doi:10.1016/j
- 10.1037/0096-1523 .32.6.1465 · doi:10.1037/0096-1523
- 10.1037/0003-066X.33.9.821 · DOI · Paper page
Cited by
Do “brain-training” programs work?
Simons, D. J., Boot, W. R., Charness, N., Gathercole, S. E., Chabris, C. F., Hambrick, D. Z., & Stine-Morrow, E. A. L. (2016) · Psychological Science in the Public Interest · doi:10.1177/1529100616661983 · Cited by 1,183
Self-citationDiamond, A., & Ling, D. S. (2016) · Developmental Cognitive Neuroscience · doi:10.1016/j.dcn.2015.11.005 · Cited by 1,177
Melby-Lervåg, M., Redick, T. S., & Hulme, C. (2016) · Perspectives on Psychological Science · doi:10.1177/1745691616635612 · Cited by 983
The neuroscience of placebo effects: connecting context, learning and health
Wager, T. D., & Atlas, L. Y. (2015) · Nature Reviews Neuroscience · doi:10.1038/nrn3976 · Cited by 844
Meta-analysis of action video game impact on perceptual, attentional, and cognitive skills.
Bediou, B., Adams, D. M., Mayer, R. E., Tipton, E., Green, C. S., & Bavelier, D. (2018) · Psychological Bulletin · doi:10.1037/bul0000130 · Cited by 807
Metadata
- Authors
- Boot, W. R., Simons, D. J., Stothart, C., & Stutts, C.
- Affiliations
- Florida State University (US)
- University of Illinois Urbana-Champaign (US)
- Venue
- Perspectives on Psychological Science
- Publisher
- SAGE Publications
- Published
- 2013-07
- Volume
- 8
- Issue
- 4
- Pages
- 445-454
- ISSN
- 1745-6916 (ISSN-L)
- 1745-6924
- OpenAlex
- W2166930562
- Cited by
- 670
- References
- 48
- Citations by year
- 2026: 59 · 2025: 55 · 2024: 44 · 2023: 45 · 2022: 47 · 2021: 84 · 2020: 49 · 2019: 59 · 2018: 45 · 2017: 50 · 2016: 45 · 2015: 46 · 2014: 34 · 2013: 7
- FWCI
- 24.13
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
- Locations
- Perspectives on Psychological Science (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Pain Management and Placebo Effect
- Social Sciences › Psychology › Clinical Psychology › Psychotherapy Techniques and Applications
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
- Keywords
- placebo effect, active control groups, causal inference, psychological intervention, video game training, intervention efficacy, experimental design flaws
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: The Pervasive Problem With Placebos in Psychology: Why Active Control Groups Are Not Sufficient to Rule Out Placebo Effects. https://app.cochat.ai/papers/10.1177/1745691613491271
- The paper
- Boot, W. R., Simons, D. J., Stothart, C., & Stutts, C. (2013). The Pervasive Problem With Placebos in Psychology: Why Active Control Groups Are Not Sufficient to Rule Out Placebo Effects. Perspectives on Psychological Science. https://doi.org/10.1177/1745691613491271
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.