Cited by 86Psychotherapy Techniques and ApplicationsMeta-analysis and systematic reviewsAnxiety, Depression, Psychometrics, Treatment, Cognitive Processes

Are all psychotherapies equally effective in the treatment of adult depression? The lack of statistical power of comparative outcome studies

Open access
Cuijpers, Pim·2016·Evidence Based Mental Health

Abstract

More than 100 comparative outcome trials, directly comparing 2 or more psychotherapies for adult depression, have been published. We first examined whether these comparative trials had sufficient statistical power to detect clinically relevant differences between therapies of d=0.24. In order to detect such an effect size, power calculations showed that a trial would need to include 548 patients. We selected 3 recent meta-analyses of psychotherapies for adult depression (cognitive behaviour therapy (CBT), interpersonal psychotherapy and non-directive counselling) and examined the number of patients included in the trials directly comparing other psychotherapies. The largest trial comparing CBT with another therapy included 178 patients, and had enough power to detect a differential effect size of only d=0.42. None of the trials in the 3 meta-analyses had enough power to detect effect sizes smaller than d=0.34, but some came close to the threshold for detecting a clinically relevant effect size of d=0.24. Meta-analyses may be able to solve the problem of the low power of individual trials. However, many of these studies have considerable risk of bias, and if we only focused on trials with low risk of bias, there would no longer be enough studies to detect clinically relevant effects. We conclude that individual trials are heavily underpowered and do not even come close to having sufficient power for detecting clinically relevant effect sizes. Despite this large number of trials, it is still not clear whether there are clinically relevant differences between these therapies.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1136/eb-2016-102341

Cites

21 of 21 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • In major depressive disorder, CBT, interpersonal psychotherapy, and behavioural activation display similar efficacies.

    “In MDD, CBT, interpersonal psychotherapy (IPT) and behavioural activation have been explored in multiple RCTs and in general display similar efficacies.92”

    From Canadian Network for Mood and Anxiety Treatments ( <scp>CANMAT</scp> ) and International Society for Bipolar Disorders ( <scp>ISBD</scp> ) 2018 guidelines for the management of patients with bipolar disorder (2018) · cites this paper as [92]

    The Introduction says CBT, IPT and behavioural activation have been studied in randomised trials for adult depression and that therapies seem about equally effective. The Discussion and Conclusion caution that comparative trials are underpowered and the evidence is insufficient to establish whether one therapy is more effective than another. Thus, the source supports apparent similar efficacy, but not an unqualified conclusion that their efficacies are similar. (LLM, conf=0.87)

    Experimental — accuracy not yet measured
  • The existing data suggest that screening programs generally increase the likelihood of remission and treatment response in general adult populations but only in the presence of subsequent treatment offers.

    “However, the existing data do suggest that screening programs generally increase the likelihood of remission and treatment response in general adult populations but only in the presence of subsequent treatment offers.”

    From Major depressive disorder (2016) · cites this paper as [125]

    The Introduction and Discussion address the statistical power of trials comparing psychotherapies for adult depression, not depression-screening programs. Searches for screening programs, remission or treatment response, and subsequent treatment offers found no passage addressing the claimed effect. (LLM, conf=0.76)

    Experimental — accuracy not yet measured
  • Previous studies suggested that a certain level of cognitive maturity is required for successful engagement in CBT, which children may not yet have acquired.

    “Previous studies33,34 suggested that a certain level of cognitive maturity is required for successful engagement in CBT, which children may not yet have acquired.”

    From Different Types and Acceptability of Psychotherapies for Acute Anxiety Disorders in Children and Adolescents: A Network Meta-analysis (2019) · cites this paper as [34]

    The comparative-outcome-trials section discusses CBT for adult depression and the statistical power of trials, not the cognitive maturity needed to engage in CBT. Searches for cognitive maturity and children's developmental capacity found no passage addressing the claim; page numbers were unavailable in our copy. (LLM, conf=0.75)

    Experimental — accuracy not yet measured

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Cited by

Sorted by citations

Authors
Cuijpers, P.
Affiliations
Amsterdam Public Health (NL)
Corresponding author
Cuijpers, Pim
Venue
Evidence Based Mental Health
Publisher
BMJ
Published
2016-03-16
Volume
19
Issue
2
Pages
39-42
ISSN
  • 1362-0347 (ISSN-L)
  • 1468-960X
OpenAlex
W2297553235
Cited by
86
References
21
Citations by year
2026: 6 · 2025: 3 · 2024: 12 · 2023: 4 · 2022: 2 · 2021: 12 · 2020: 6 · 2019: 9 · 2018: 13 · 2017: 10 · 2016: 8
FWCI
17.85
Type
journal article
Language
en
Open access
Locations
  • Evidence-Based Mental Health (publishedVersion)
  • PubMed Central (publishedVersion)
  • PubMed (publishedVersion)
  • VU Research Portal (publishedVersion, other-oa)
  • HighWire Press Open Archive (submittedVersion)
  • Data Archiving and Networked Services (DANS) (submittedVersion, other-oa)
Topics
  • Social Sciences › Psychology › Clinical Psychology › Psychotherapy Techniques and Applications
  • Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
  • Social Sciences › Psychology › Experimental and Cognitive Psychology › Anxiety, Depression, Psychometrics, Treatment, Cognitive Processes
Keywords
adult depression, psychotherapy, statistical power, cognitive behavioral therapy, interpersonal psychotherapy, non-directive counseling, meta-analysis, risk of bias, effect size, trial size
MeSH terms
Adult, Depressive Disorder, Humans, Psychotherapy, Outcome Assessment, Health Care

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review