When a Placebo Is Not a Placebo: Problems and Solutions to the Gold Standard in Psychotherapy Research
Open accessThe DOI matches its Crossref record; 15 of the 15 references it cites were found in a registry or an index.
Abstract
Randomized placebo-controlled trials are recognized as the gold-standard of evidence-based medicine but when it comes to psychotherapy research all that glitters is not gold. Translation of this standard from medicine to clinical psychology is fraught with difficulties. While a wealth of robust evidence shows that psychotherapy is effective for a range of mental health conditions the use of placebo controls to assess the effectiveness of specific psychological interventions faces serious conceptual and methodological challenges (Gaab et al., 2018). In this Opinion article we identify two under-appreciated placebo-related problems which substantially risk the validity of clinical trials in psychotherapy. The first is a common misconception about the nature of placebos; the second is the problem of double-blinding. We review current solutions and future prospects for the gold-standard in psychotherapy research.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Great Psychotherapy Debate: The Evidence for What Makes Psychotherapy Work
Wampold, B. E. (2015) · doi:10.4324/9780203582015 · Cited by 1,773
Some implicit common factors in diverse methods of psychotherapy.
Rosenzweig, S. (1936) · American Journal of Orthopsychiatry · doi:10.1111/j.1939-0025.1936.tb05248.x · Cited by 1,042 · cited 2×
“, 2008) – a finding which is consistent with the Dodo Bird conjecture of treatment equivalence from 1936 (Rosenzweig, 1936).”
ResultPlacebos without Deception: A Randomized Controlled Trial in Irritable Bowel Syndrome
Kaptchuk, T. J., Friedlander, E., Kelley, J. M., Sanchez, M. N., Kokkotou, E., Singer, J. P., Kowalczykowski, M., Miller, F. G., Kirsch, I., & Lembo, A. J. (2010) · PLoS ONE · doi:10.1371/journal.pone.0015591 · Cited by 900 · cited 1×
“A second, nuanced and different use of the term comes under the label “openlabel placebos” (OLPs) (Blease, 2018b); here “placebo” refers to specific interventions (usually sugar pills) which are administered alongside other socio-emotional cues in the patient-practitioner encounter usually with the aim of eliciting sa…”
BackgroundAhn, H.-N., & Wampold, B. E. (2001) · Journal of Counseling Psychology · doi:10.1037/0022-0167.48.3.251 · Cited by 571
Furukawa, T. A., Noma, H., Caldwell, D. M., Honyashiki, M., Shinohara, K., Imai, H., Chen, P., Hunot, V., & Churchill, R. (2014) · Acta Psychiatrica Scandinavica · doi:10.1111/acps.12275 · Cited by 521 · cited 2×
“This is also true where patients allocated to waitlist controls often experience worsening of symptoms (Furukawa et al., 2014) while those allocated to the treatment group experience benefits: too often this difference is hastily attributed to the treatment’s specificity.”
BackgroundeHealth for Patient Engagement: A Systematic Review
Barello, S., Triberti, S., Graffigna, G., Libreri, C., Serino, S., Hibbard, J., & Riva, G. (2016) · Frontiers in Psychology · doi:10.3389/fpsyg.2015.02013 · Cited by 411 · cited 1×
“Although eHealth technologies have been discussed as an effective way to foster the active role of patients in their healthcare (Barello et al., 2016) as a preliminary step in testing the potential for e-therapy it would first be necessary to directly compare the effectiveness of standard psychotherapies (delivered by…”
BackgroundThe efficacy of non-directive supportive therapy for adult depression: A meta-analysis
Cuijpers, P., Driessen, E., Hollon, S. D., van Oppen, P., Barth, J., & Andersson, G. (2012) · Clinical Psychology Review · doi:10.1016/j.cpr.2012.01.003 · Cited by 369 · cited 2×
“Indeed, one recent, noteworthy meta-analysis reported that differences between psychotherapy treatments and “placebos” disappear after allegiance was controlled (Cuijpers et al., 2012).”
BackgroundFreedland, K. E., Mohr, D. C., Davidson, K. W., & Schwartz, J. E. (2011) · Psychosomatic Medicine · doi:10.1097/psy.0b013e318218e1fb · Cited by 369
Are the parts as good as the whole? A meta-analysis of component treatment studies.
Bell, E. C., Marcus, D. K., & Goodlad, J. K. (2013) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0033004 · Cited by 192 · cited 1×
“packages are superior to partial treatment packages at the end of psychotherapy (Ahn and Wampold, 2001; Bell et al., 2013).”
BackgroundIs the Dodo bird endangered in the 21st century? A meta-analysis of treatment comparison studies
Marcus, D. K., O'Connell, D., Norris, A. L., & Sawaqdeh, A. (2014) · Clinical Psychology Review · doi:10.1016/j.cpr.2014.08.001 · Cited by 148 · cited 1×
“Second, a way to address the question of how (and not whether) psychotherapy works is through trials that directly compare two or more treatments to each other (Marcus et al., 2014).”
BackgroundMohr, D. C., Ho, J., Hart, T. L., Baron, K. G., Berendsen, M., Beckner, V., Cai, X., Cuijpers, P., Spring, B., Kinsinger, S. W., et al. (2014) · Translational Behavioral Medicine · doi:10.1007/s13142-014-0262-3 · Cited by 139 · cited 2×
“However, it is well known that these passive control conditions lead to an overestimation of the efficacy of a psychotherapy (Mohr et al., 2014) and are inappropriate for the identification of specific treatment components (Gaab et al.”
BackgroundResultDirect comparisons of treatment modalities for youth disorders: a meta-analysis
Miller, S., Wampold, B., & Varhely, K. (2008) · Psychotherapy Research · doi:10.1080/10503300701472131 · Cited by 126 · cited 1×
“Moreover, meta-analyses of comparative studies have not revealed substantial differences between psychotherapies (Spielmans et al., 2007; Benish et al., 2008; Imel et al., 2008; Miller et al., 2008) – a finding which is consistent with the Dodo Bird conjecture of treatment equivalence from 1936 (Rosenzweig, 1936).”
ResultHow to prove that your therapy is effective, even when it is not: a guideline
Cuijpers, P., & Cristea, I. A. (2016) · Epidemiology and Psychiatric Sciences · doi:10.1017/s2045796015000864 · Cited by 122
The use of waitlists as control conditions in anxiety disorders research
Patterson, B., Boyle, M. H., Kivlenieks, M., & Van Ameringen, M. (2016) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2016.08.015 · Cited by 94
Controlling for the placebo effect in psychotherapy: Noble quest or tilting at windmills?
Kirsch, I., Wampold, B., & Kelley, J. M. (2016) · Psychology of Consciousness: Theory, Research, and Practice · doi:10.1037/cns0000065 · Cited by 71 · cited 1×
“Recently, no-treatment and usual care have been proposed as the appropriate control for establishing the efficacy of a psychotherapy (Kirsch et al., 2016).”
Background
Cited by
López-Pinar, C., Martínez-Sanchís, S., Carbonell-Vayá, E., Sánchez-Meca, J., & Fenollar-Cortés, J. (2020) · Journal of Attention Disorders · doi:10.1177/1087054719855685 · Cited by 47
Control interventions in randomised trials among people with mental health disorders
Faltinsen, E., Todorovac, A., Staxen Bruun, L., Hróbjartsson, A., Gluud, C., Kongerslev, M. T., Simonsen, E., & Storebø, O. J. (2022) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.mr000050.pub2 · Cited by 40
The Other Side of the Coin: Nocebo Effects and Psychotherapy
Locher, C., Koechlin, H., Gaab, J., & Gerger, H. (2019) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2019.00555 · Cited by 25
Self-citationOut of Control: How to Design Digital Placebos
Blease, C. (2023) · Current Treatment Options in Psychiatry · doi:10.1007/s40501-023-00290-w · Cited by 15
“If a combination of factors is considered therapeutically relevant, so-called dismantling studies—whereby a standard treatment is compared to another, except one constituent component—offers another route to isolate effect sizes [12].”
BackgroundInfluentialSelf-citationOptimizing Expectations via Mobile Apps: A New Approach for Examining and Enhancing Placebo Effects
Gruszka, P., Burger, C., & Jensen, M. P. (2019) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2019.00365 · Cited by 15
“org blinding is extremely difficult to achieve when delivering placebo interventions (6).”
Background
Metadata
- Authors
- Locher, C., Gaab, J., & Blease, C.
- Venue
- Frontiers in Psychology
- Publisher
- Frontiers Media SA
- Published
- 2018-11-26
- Volume
- 9
- Pages
- 2317-2317
- ISSN
- 1664-1078 (ISSN-L)
- OpenAlex
- W2903225112
- Cited by
- 65
- References
- 15
- FWCI
- 5.81
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.