Addressing risk of bias in trials of cognitive behavioral therapy.
Open accessThe DOI matches its OpenAlex record; 7 of the 7 references it cites were found in a registry or an index.
Abstract
A recent network meta-analysis by Zhu and colleagues reported in the Shanghai Archives of Psychiatry compared two different comparators (psychological placebo and waitlist control) in trials assessing the effectiveness of cognitive behavioral therapy (CBT) for the treatment of generalized anxiety disorder (GAD). CBT was superior to both of these control conditions, but psychological placebo was superior to waitlist. However, we argue that the term 'psychological placebo' is a misnomer because the impossibility of effectively blinding participants to treatment allocation in CBT trials makes it impossible to control for placebo effects. This failure to blind participants and therapists - and the resultant high risk of bias - was the main reason Zhu and colleagues found that the overall quality of the evidence supporting the conclusion that CBT is effective for GAD is poor. This is a general problem in all psychotherapy trials, which suffer from well-documented methodological and conceptual problems that prevent adequate placebo control and undermine casual inference. We discuss these problems and suggest potential solutions. We conclude that, while it may be difficult to remove potential bias in randomized controlled trials of psychotherapy, we can improve on the status quo by integrating basic science within applied trials to adjust for these biases and, thus, improve the strength of the causal inferences.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
GRADE: an emerging consensus on rating quality of evidence and strength of recommendations
Guyatt, G. H., Oxman, A. D., Vist, G. E., Kunz, R., Falck-Ytter, Y., Alonso-Coello, P., & Schünemann, H. J. (2008) · BMJ · doi:10.1136/bmj.39489.470347.ad · Cited by 23,305
Kirsch, I., Deacon, B. J., Huedo-Medina, T. B., Scoboria, A., Moore, T. J., & Johnson, B. T. (2008) · PLoS Medicine · doi:10.1371/journal.pmed.0050045 · Cited by 2,442
Furukawa, T. A., Noma, H., Caldwell, D. M., Honyashiki, M., Shinohara, K., Imai, H., Chen, P., Hunot, V., & Churchill, R. (2014) · Acta Psychiatrica Scandinavica · doi:10.1111/acps.12275 · Cited by 521 · cited 6×
“CBT targets thinking styles, so adopting longer-term follow-up assessments (i.e., after the active treatment is completed) as the primary outcome may increase confidence in the efficacy of CBT. Similarly, research into placebo effects of antidepressants suggests that placebo effects vary with severity, being greatest…”
BackgroundInfluentialThe Study of Fear Extinction: Implications for Anxiety Disorders
Graham, B. M., & Milad, M. R. (2011) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2011.11040557 · Cited by 387 · cited 1×
“, spiders, social situations) extinguishes the fear response and reduces anxiety is now well understood, and basic research continues to inform the optimization of related psychological therapies.([10]) Mechanism studies could be routinely embedded within clinical trials, by incorporating measures of the psychological…”
BackgroundPsychological treatments: A call for mental-health science
Holmes, E. A., Craske, M. G., & Graybiel, A. M. (2014) · Nature · doi:10.1038/511287a · Cited by 214 · cited 1×
“One way to address basic questions of mechanism is to examine each component of CBT in isolation in the laboratory.([9]) For example, the protocol for exposure therapy, a key behavioral technique used in CBT for anxiety disorders, was developed in the 1960s from the basic science of fear-extinction learning.”
MethodPlacebo psychotherapy: Synonym or oxymoron?
Kirsch, I. (2005) · Journal of Clinical Psychology · doi:10.1002/jclp.20126 · Cited by 164
Borkovec, T. D., & Sibrava, N. J. (2005) · Journal of Clinical Psychology · doi:10.1002/jclp.20127 · Cited by 75 · cited 3×
“Finally, and critically, it is impossible to blind participants and therapists, as CBT involves active engagement with its theoretical rationale.([4]) We concur with others who suggest that the concept of a ‘psychological placebo’ is both methodologically and conceptually flawed.”
Background
Cited by
Goodwin, G., Haddad, P., Ferrier, I., Aronson, J., Barnes, T., Cipriani, A., Coghill, D., Fazel, S., Geddes, Jr., Grunze, H., et al. (2016) · Journal of Psychopharmacology · doi:10.1177/0269881116636545 · Cited by 1,309
Iyadurai, L., Blackwell, S. E., Meiser-Stedman, R., Watson, P. C., Bonsall, M. B., Geddes, J. R., Nobre, A. C., & Holmes, E. A. (2018) · Molecular Psychiatry · doi:10.1038/mp.2017.23 · Cited by 266
Phillips, E. A., Gordeev, V. S., & Schreyögg, J. (2019) · Scandinavian Journal of Work, Environment & Health · doi:10.5271/sjweh.3839 · Cited by 148
Placebo effects in psychotherapy: a framework
Enck, P., & Zipfel, S. (2019) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2019.00456 · Cited by 115
Landry, E. C., Sandoval, X. C. R., Simeone, C. N., Tidball, G., Lea, J., & Westerberg, B. D. (2020) · Otology & Neurotology · doi:10.1097/mao.0000000000002472 · Cited by 82
Metadata
- Authors
- Button, K. S., & Munafo, M. R.
- Venue
- PubMed
- Publisher
- National Institutes of Health
- Published
- 2015-06-25
- Volume
- 27
- Issue
- 3
- Pages
- 144-8
- OpenAlex
- W1890433298
- Cited by
- 26
- References
- 7
- FWCI
- 3.10
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Addressing risk of bias in trials of cognitive behavioral therapy. https://app.cochat.ai/papers/10.11919/j.issn.1002-0829.215042
- The paper
- Button, K. S., & Munafo, M. R. (2015). Addressing risk of bias in trials of cognitive behavioral therapy. PubMed. https://doi.org/10.11919/j.issn.1002-0829.215042
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.