The Pervasive Problem With Placebos in Psychology: Why Active Control Groups Are Not Sufficient to Rule Out Placebo Effects
The DOI matches its Crossref record; 48 of the 48 references it cites were found in a registry or an index.
Abstract
To draw causal conclusions about the efficacy of a psychological intervention, researchers must compare the treatment condition with a control group that accounts for improvements caused by factors other than the treatment. Using an active control helps to control for the possibility that improvement by the experimental group resulted from a placebo effect. Although active control groups are superior to "no-contact" controls, only when the active control group has the same expectation of improvement as the experimental group can we attribute differential improvements to the potency of the treatment. Despite the need to match expectations between treatment and control groups, almost no psychological interventions do so. This failure to control for expectations is not a minor omission-it is a fundamental design flaw that potentially undermines any causal inference. We illustrate these principles with a detailed example from the video-game-training literature showing how the use of an active control group does not eliminate expectation differences. The problem permeates other interventions as well, including those targeting mental health, cognition, and educational achievement. Fortunately, measuring expectations and adopting alternative experimental designs makes it possible to control for placebo effects, thereby increasing confidence in the causal efficacy of psychological interventions.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“One potentially critical factor is the type of activity the control group is exposed to (Boot, Simons, Stothart, & Stutts, 2013; Buschkuehl & Jaeggi, 2011; Melby-Lervåg & Hulme, 2013; Shipstead et al., 2012).”
From Working Memory Training Does Not Improve Performance on Measures of Intelligence or Other Measures of “Far Transfer”: Evidence From a Meta-Analytic Review (2016) · cites this paper as Boot, Simons, Stothart, & Stutts, 2013
In the citing paper
“methodological deficiencies in both design and analysis persist in the WM training literature, despite many prior suggestions for remediation (Boot et al., 2013;Shipstead, Redick, & Engle, 2012;Tidwell et al., 2014).”
From Reevaluating the effectiveness of n-back training on transfer through the Bayesian lens: Support for the null (2016) · cites this paper as Boot et al., 2013
In the citing paper
“However, the limited use of active control groups may compromise the rigor of comparisons as these groups better account for placebo effects and participant expectations [65].”
From Effects of Third-Wave Cognitive Behavioral Therapy for Healthcare Professionals’ Burnout: A Systematic Review and Meta-Analysis (2025) · cites this paper as [65]
In the citing paper
“Additionally, unless the design of the study is a double-blind design, the true effectiveness of an intervention cannot be concluded (Boot et al., 2013).”
From Effectiveness of stress management interventions to change cortisol levels: a systematic review and meta-analysis. (2024) · cites this paper as Boot et al., 2013
In the citing paper
“Second, expectations of efficacy have been shown to moderate intervention effects in general, and also for digital interventions.32”
From A novel digital intervention for actively reducing severity of paediatric ADHD (STARS-ADHD): a randomised controlled trial (2020) · cites this paper as [32]
2 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Yaşlı Kadınlarda Üreme Sağlığı
Kokanalı, D., & Engin Üstün, Y. (n.d.) · DergiPark (Istanbul University) · Cited by 170,090
Fitness Effects on the Cognitive Function of Older Adults: A Meta-Analytic Study
Colcombe, S., & Kramer, A. F. (2003) · Psychological Science · doi:10.1111/1467-9280.t01-1-01430 · Cited by 3,782
Action video game modifies visual selective attention
Green, C. S., & Bavelier, D. (2003) · Nature · doi:10.1038/nature01647 · Cited by 2,540
Writing About Emotional Experiences as a Therapeutic Process
Pennebaker, J. W. (1997) · Psychological Science · doi:10.1111/j.1467-9280.1997.tb00403.x · Cited by 2,486
Improving fluid intelligence with training on working memory
Jaeggi, S. M., Buschkuehl, M., Jonides, J., & Perrig, W. J. (2008) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0801268105 · Cited by 2,187
Anderson, C. A., Shibuya, A., Ihori, N., Swing, E. L., Bushman, B. J., Sakamoto, A., Rothstein, H. R., & Saleem, M. (2010) · Psychological Bulletin · doi:10.1037/a0018251 · Cited by 2,048
Placebo-Induced Changes in fMRI in the Anticipation and Experience of Pain
Wager, T. D., Rilling, J. K., Smith, E. E., Sokolik, A., Casey, K. L., Davidson, R. J., Kosslyn, S. M., Rose, R. M., & Cohen, J. D. (2004) · Science · doi:10.1126/science.1093065 · Cited by 1,992
Ageing, fitness and neurocognitive function
Kramer, A. F., Hahn, S., Cohen, N. J., Banich, M. T., McAuley, E., Harrison, C. R., Chason, J., Vakil, E., Bardell, L., Boileau, R. A., et al. (1999) · Nature · doi:10.1038/22682 · Cited by 1,394
Artifact in behavioral research
Rosenthal, R., & Rosnow, R. L. (1969) · Medical Entomology and Zoology · Cited by 1,186
A Comprehensive Review of the Placebo Effect: Recent Advances and Current Thought
Price, D. D., Finniss, D. G., & Benedetti, F. (2008) · Annual Review of Psychology · doi:10.1146/annurev.psych.59.113006.095941 · Cited by 1,146
The effects of video game playing on attention, memory, and executive control
Boot, W. R., Kramer, A. F., Simons, D. J., Fabiani, M., & Gratton, G. (2008) · Acta Psychologica · doi:10.1016/j.actpsy.2008.09.005 · Cited by 990
Self-citationAction-Video-Game Experience Alters the Spatial Resolution of Vision
Green, C. S., & Bavelier, D. (2007) · Psychological Science · doi:10.1111/j.1467-9280.2007.01853.x · Cited by 872
Neurobiological Mechanisms of the Placebo Effect
Benedetti, F., Mayberg, H. S., Wager, T. D., Stohler, C. S., & Zubieta, J.-K. (2005) · The Journal of Neuroscience · doi:10.1523/jneurosci.3458-05.2005 · Cited by 777
Effect of action video games on the spatial distribution of visuospatial attention.
Green, C. S., & Bavelier, D. (2006) · Journal of Experimental Psychology: Human Perception and Performance · doi:10.1037/0096-1523.32.6.1465 · Cited by 745
Redick, T. S., Shipstead, Z., Harrison, T. L., Hicks, K. L., Fried, D. E., Hambrick, D. Z., Kane, M. J., & Engle, R. W. (2013) · Journal of Experimental Psychology: General · doi:10.1037/a0029082 · Cited by 617 · cited 1×
“In fact, when other researchers did measure expectations (Redick et al., 2012), those who received memory training believed that they had shown improved intelligence, memory, and ability to complete daily activities after training.”
BackgroundPrice, D. D., Milling, L. S., Kirsch, I., Duff, A., Montgomery, G. H., & Nicholls, S. S. (1999) · Pain · doi:10.1016/s0304-3959(99)00081-0 · Cited by 561
Enumeration versus multiple object tracking: the case of action video game players
Green, C. S., & Bavelier, D. (2006) · Cognition · doi:10.1016/j.cognition.2005.10.004 · Cited by 560 · cited 2×
“…games showed improved performance on a variety of perceptual and cognitive measures that tap visual processing, attention, and task-switching (e.g., Green & Bavelier, 2003, 2006a, 2006b, 2007; Green, Sugarman, Medford, Klobusicky, & Bavelier, 2012; Li, Polat, Makous, & Bavelier, 2009; Li, Polat,…”
BackgroundMahncke, H. W., Connor, B. B., Appelman, J., Ahsanuddin, O. N., Hardy, J. L., Wood, R. A., Joyce, N. M., Boniske, T., Atkins, S. M., & Merzenich, M. M. (2006) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0605194103 · Cited by 502
Do Action Video Games Improve Perception and Cognition?
Boot, W. R., Blakely, D. P., & Simons, D. J. (2011) · Frontiers in Psychology · doi:10.3389/fpsyg.2011.00226 · Cited by 472
Self-citationEnhancing the contrast sensitivity function through action video game training
Li, R., Polat, U., Makous, W., & Bavelier, D. (2009) · Nature Neuroscience · doi:10.1038/nn.2296 · Cited by 468
Effects of video game playing on measures of spatial performance: Gender effects in late adolescence
Okagaki, L., & Frensch, P. A. (1994) · Journal of Applied Developmental Psychology · doi:10.1016/0193-3973(94)90005-1 · Cited by 357
Improving Children's Mental Rotation Accuracy With Computer Game Playing
De Lisi, R., & Wolford, J. L. (2002) · The Journal of Genetic Psychology · doi:10.1080/00221320209598683 · Cited by 329
The Public Health Risks of Media Violence: A Meta-Analytic Review
Ferguson, C. J., & Kilburn, J. (2009) · The Journal of Pediatrics · doi:10.1016/j.jpeds.2008.11.033 · Cited by 327
Domain specificity of spatial expertise: the case of video game players
Sims, V. K., & Mayer, R. E. (2002) · Applied Cognitive Psychology · doi:10.1002/acp.759 · Cited by 284
Video game practice optimizes executive control skills in dual-task and task switching situations
Strobach, T., Frensch, P. A., & Schubert, T. (2012) · Acta Psychologica · doi:10.1016/j.actpsy.2012.02.001 · Cited by 275
Adachi, P. J. C., & Willoughby, T. (2011) · Psychology of Violence · doi:10.1037/a0024908 · Cited by 262
Psychotherapy and the placebo effect.
Rosenthal, D., & Frank, J. D. (1956) · Psychological Bulletin · doi:10.1037/h0044068 · Cited by 256
5 Demand Characteristics and the Concept of Quasi-Controls
Orne, M. T. (2009) · Artifacts in Behavioral Research · doi:10.1093/acprof:oso/9780195385540.003.0005 · Cited by 247
Efficacy of internet therapy for panic disorder
Klein, B., Richards, J. C., & Austin, D. W. (2006) · Journal of Behavior Therapy and Experimental Psychiatry · doi:10.1016/j.jbtep.2005.07.001 · Cited by 236
Conceptual, methodological, and ethical problems of placebo groups in psychotherapy research.
O'Leary, K. D., & Borkovec, T. D. (1978) · American Psychologist · doi:10.1037//0003-066x.33.9.821 · Cited by 229
Individually-tailored, internet-based treatment for anxiety disorders: a randomized controlled trial
Carlbring, P., Maurin, L., Törngren, C., Linna, E., Eriksson, T., Sparthan, E., Strååt, M., Marquez von Hage, C., Bergman-Nordgren, L., & Andersson, G. (2011) · Behaviour Research and Therapy · doi:10.1016/j.brat.2010.10.002 · Cited by 227
Paradigm change in aggression research: The time has come to retire the General Aggression Model
Ferguson, C. J., & Dyck, D. (2012) · Aggression and Violent Behavior · doi:10.1016/j.avb.2012.02.007 · Cited by 226
Disclosing Trauma Through Writing: Testing the Meaning-Making Hypothesis
Park, C. L., & Blumberg, C. J. (2002) · Cognitive Therapy and Research · doi:10.1023/a:1020353109229 · Cited by 212
The effect of action video game experience on task-switching
Shawn Green, C., Sugarman, M. A., Medford, K., Klobusicky, E., & Bavelier, D. (2012) · Computers in Human Behavior · doi:10.1016/j.chb.2011.12.020 · Cited by 201
Mechanisms of Placebo Pain Reduction: An Empirical Investigation
Montgomery, G., & Kirsch, I. (1996) · Psychological Science · doi:10.1111/j.1467-9280.1996.tb00352.x · Cited by 159
Action video game experience reduces the cost of switching tasks
Cain, M. S., Landau, A. N., & Shimamura, A. P. (2012) · Attention, Perception, & Psychophysics · doi:10.3758/s13414-012-0284-1 · Cited by 158
Low Hopes, High Expectations: Expectancy Effects and the Replicability of Behavioral Experiments
Klein, O., Doyen, S., Leys, C., Magalhães de Saldanha da Gama, P. A., Miller, S., Questienne, L., & Cleeremans, A. (2012) · Perspectives on Psychological Science · doi:10.1177/1745691612463704 · Cited by 144
Reducing backward masking through action game training
Li, R., Polat, U., Scalzo, F., & Bavelier, D. (2010) · Journal of Vision · doi:10.1167/10.14.33 · Cited by 133
Bavelier, D., & Davidson, R. J. (2013) · Nature · doi:10.1038/494425a · Cited by 111
Moscucci, M., Byrne, L., Weintraub, M., & Cox, C. (1987) · Clinical Pharmacology and Therapeutics · doi:10.1038/clpt.1987.26 · Cited by 97
Rudebeck, S. R., Bor, D., Ormond, A., O’Reilly, J. X., & Lee, A. C. H. (2012) · PLoS ONE · doi:10.1371/journal.pone.0050431 · Cited by 95
Blind drunk: the effects of alcohol on inattentional blindness
Clifasefi, S. L., Takarangi, M. K. T., & Bergman, J. S. (2006) · Applied Cognitive Psychology · doi:10.1002/acp.1222 · Cited by 81
The case for causal influences of action videogame play upon vision and attention
Kristjánsson, Á. (2013) · Attention, Perception, & Psychophysics · doi:10.3758/s13414-013-0427-z · Cited by 61 · cited 2×
“In many previous training studies, participants who trained for 10 to 50 hr on fast-paced, visually demanding action video games showed improved performance on a variety of perceptual and cognitive measures that tap visual processing, attention, and task-switching (e.g., Green & Bavelier, 2003, 2006a, 2006b, 2007; Gre…”
BackgroundSchubert, T., & Strobach, T. (2012) · Acta Psychologica · doi:10.1016/j.actpsy.2012.06.010 · Cited by 46
Classically conditioned responses following repeated insulin and glucose administration in humans
Stockhorst, U., Steingrüber, H.-J., & Scherbaum, W. A. (2000) · Behavioural Brain Research · doi:10.1016/s0166-4328(99)00192-8 · Cited by 44
Boot, W. R., & Simons, D. J. (2012) · Acta Psychologica · doi:10.1016/j.actpsy.2012.06.011 · Cited by 37
Self-citationA talking control for use in evaluating the effectiveness of cognitive-behavioral therapy
Serfaty, M., Csipke, E., Haworth, D., Murad, S., & King, M. (2011) · Behaviour Research and Therapy · doi:10.1016/j.brat.2011.05.005 · Cited by 30
Effects of Friend vs. Foe Discrimination Training in Action Video Games
Brown, C. R., May, R., Nyman, J., & Palmer, E. M. (2012) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/1071181312561401 · Cited by 3
Research works printed but not linked: 3
- 10.1016/j .actpsy.2012.06.011 · doi:10.1016/j
- 10.1037/0096-1523 .32.6.1465 · doi:10.1037/0096-1523
- 10.1037/0003-066X.33.9.821 · DOI · Paper page
Cited by
Do “brain-training” programs work?
Simons, D. J., Boot, W. R., Charness, N., Gathercole, S. E., Chabris, C. F., Hambrick, D. Z., & Stine-Morrow, E. A. L. (2016) · Psychological Science in the Public Interest · doi:10.1177/1529100616661983 · Cited by 1,183
Self-citationDiamond, A., & Ling, D. S. (2016) · Developmental Cognitive Neuroscience · doi:10.1016/j.dcn.2015.11.005 · Cited by 1,177
Melby-Lervåg, M., Redick, T. S., & Hulme, C. (2016) · Perspectives on Psychological Science · doi:10.1177/1745691616635612 · Cited by 983
The neuroscience of placebo effects: connecting context, learning and health
Wager, T. D., & Atlas, L. Y. (2015) · Nature Reviews Neuroscience · doi:10.1038/nrn3976 · Cited by 844
Meta-analysis of action video game impact on perceptual, attentional, and cognitive skills.
Bediou, B., Adams, D. M., Mayer, R. E., Tipton, E., Green, C. S., & Bavelier, D. (2018) · Psychological Bulletin · doi:10.1037/bul0000130 · Cited by 807
Metadata
- Authors
- Boot, W. R., Simons, D. J., Stothart, C., & Stutts, C.
- Affiliations
- Florida State University (US)
- University of Illinois Urbana-Champaign (US)
- Venue
- Perspectives on Psychological Science
- Publisher
- SAGE Publications
- Published
- 2013-07
- Volume
- 8
- Issue
- 4
- Pages
- 445-454
- ISSN
- 1745-6916 (ISSN-L)
- 1745-6924
- OpenAlex
- W2166930562
- Cited by
- 670
- References
- 48
- Citations by year
- 2026: 59 · 2025: 55 · 2024: 44 · 2023: 45 · 2022: 47 · 2021: 84 · 2020: 49 · 2019: 59 · 2018: 45 · 2017: 50 · 2016: 45 · 2015: 46 · 2014: 34 · 2013: 7
- FWCI
- 24.13
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
- Locations
- Perspectives on Psychological Science (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Pain Management and Placebo Effect
- Social Sciences › Psychology › Clinical Psychology › Psychotherapy Techniques and Applications
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
- Keywords
- placebo effect, active control groups, causal inference, psychological intervention, video game training, intervention efficacy, experimental design flaws
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.