The DOI matches its Crossref record; 49 of the 50 references it cites were found in a registry or an index.
The effects of psychotherapy for adult depression are overestimated: a meta-analysis of study quality and effect size
Abstract
Background: No meta-analytical study has examined whether the quality of the studies examining psychotherapy for adult depression is associated with the effect sizes found. This study assesses this association. Method: We used a database of 115 randomized controlled trials in which 178 psychotherapies for adult depression were compared to a control condition. Eight quality criteria were assessed by two independent coders: participants met diagnostic criteria for a depressive disorder, a treatment manual was used, the therapists were trained, treatment integrity was checked, intention-to-treat analyses were used, N ⩾50, randomization was conducted by an independent party, and assessors of outcome were blinded. Results: Only 11 studies (16 comparisons) met the eight quality criteria. The standardized mean effect size found for the high-quality studies ( d =0.22) was significantly smaller than in the other studies ( d =0.74, p <0.001), even after restricting the sample to the subset of other studies that used the kind of care-as-usual or non-specific controls that tended to be used in the high-quality studies. Heterogeneity was zero in the group of high-quality studies. The numbers needed to be treated in the high-quality studies was 8, while it was 2 in the lower-quality studies. Conclusions: We found strong evidence that the effects of psychotherapy for adult depression have been overestimated in meta-analytical studies. Although the effects of psychotherapy are significant, they are much smaller than was assumed until now, even after controlling for the type of control condition used.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The quality of the included studies was considered using in part the criteria derived by Cuijpers et al. (2010) from work by others (Chambless & Hollon, 1998; Higgins & Green, 2006).”
From An update on the efficacy of psychological treatments for obsessive-compulsive disorder in adults (2013) · cites this paper as Cuijpers et al. (2010)
In the citing paper
“We rated each study on eight criteria developed by Cuijpers and colleagues (2010) and found that the mean quality rating for all RCTs included in this review was only 4.6 (SD 2.2) out of a maximum of 8.0.”
From An update on the efficacy of psychological treatments for obsessive-compulsive disorder in adults (2013) · cites this paper as Cuijpers et al., 2010
In the citing paper
“A similar difference has been noted for psychotherapy effectiveness in depression, whereby overall effectiveness was overestimated in earlier meta-analyses because of inclusion of non-experimental designs.57”
From Effectiveness of psychological interventions in prison to reduce recidivism: a systematic review and meta-analysis of randomised controlled trials (2021) · cites this paper as [57]
In the citing paper
“It is well known from controlled trials that poor-quality trials considerably overestimate the effects of therapies (Cuijpers et al. 2010(Cuijpers et al. , 2019b;;Furukawa et al. 2014).”
From The Role of Common Factors in Psychotherapy Outcomes (2019) · cites this paper as Cuijpers et al. 2010
In the citing paper
“In recent meta-analyses, it has been shown that the treatment effects of psychotherapy have been overestimated in lower quality studies [35,36].”
From Positive psychology interventions: a meta-analysis of randomized controlled studies (2013) · cites this paper as [35]
8 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Measuring inconsistency in meta-analyses
Higgins, J. P. T., Thompson, S. G., Deeks, J. J., & Altman, D. G. (2003) · BMJ · doi:10.1136/bmj.327.7414.557 · Cited by 63,139
An inventory for measuring depression
BECK, A. T. (1961) · Archives of General Psychiatry · doi:10.1001/archpsyc.1961.01710120031004 · Cited by 38,032
Hamilton, M. (1960) · Journal of Neurology, Neurosurgery & Psychiatry · doi:10.1136/jnnp.23.1.56 · Cited by 32,817
Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series
(2008) · doi:10.1002/9780470712184 · Cited by 25,048
Statistical Methods for Meta-Analysis
Wasserman, S., Hedges, L. V., & Olkin, I. (1988) · Journal of Educational Statistics · doi:10.2307/1164953 · Cited by 10,326
Evidence-Based Medicine: How to Practice and Teach EBM
Sackett, D. L. (2000) · Cited by 5,950
Statistical Methods for Meta-Analysis.
Freeman, P. R., Hedges, L. V., & Olkin, I. (1986) · Biometrics · doi:10.2307/2531069 · Cited by 4,784
Defining empirically supported therapies.
Chambless, D. L., & Hollon, S. D. (1998) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.66.1.7 · Cited by 3,067 · cited 1×
“These criteria were based on an authoritative review of empirically supported psychotherapies (Chambless & Hollon, 1998), and on the criteria proposed by the Cochrane Collaboration to assess the methodological validity of a study (Higgins & Green, 2006).”
MethodSelf-citationKirsch, I., Deacon, B. J., Huedo-Medina, T. B., Scoboria, A., Moore, T. J., & Johnson, B. T. (2008) · PLoS Medicine · doi:10.1371/journal.pmed.0050045 · Cited by 2,442
Selective publication of antidepressant trials and its influence on apparent efficacy
Turner, E. H., Matthews, A. M., Linardatos, E., Tell, R. A., & Rosenthal, R. (2008) · New England Journal of Medicine · doi:10.1056/nejmsa065779 · Cited by 2,435
Research works printed but not linked: 2
- Higgins JPT , Green S (2006). Cochrane Handbook for Systematic Reviews of Interventions 4.2.6 (updated September 2006). In The Cochrane Library, Issue 4, 2006. John Wiley & Sons, Ltd: Chichester, UK.
- 10.1037/0033-2909.108.1.30 · doi:10.1037/0033-2909.108.1.30 · Paper page
Cited by
Positive psychology interventions: a meta-analysis of randomized controlled studies
Bolier, L., Haverman, M., Westerhof, G. J., Riper, H., Smit, F., & Bohlmeijer, E. (2013) · BMC Public Health · doi:10.1186/1471-2458-13-119 · Cited by 1,996
“Effectiveness research in psychotherapy shows that effect sizes are relatively small in high-quality studies compared with low-quality studies [35] and this might also be true for positive psychology interventions.”
BackgroundResultSelf-citationPostpartum depression: current status and future directions
O'Hara, M. W., & McCabe, J. E. (2013) · Annual Review of Clinical Psychology · doi:10.1146/annurev-clinpsy-050212-185612 · Cited by 1,750
PRACTICE GUIDELINE FOR THE Treatment of Patients With Major Depressive Disorder
Gelenberg, A. J., Freeman, P. B., Markowitz, J. C., Rosenbaum, J. F., Thase, M. E., Trivedi, M. H., & Rhoads, R. S. (2010) · Cited by 1,510
Relative Deprivation: A Theoretical and Meta-Analytic Review
Smith, H. J., Pettigrew, T. F., Pippin, G. M., & Bialosiewicz, S. (2012) · Personality and Social Psychology Review · doi:10.1177/1088868311430825 · Cited by 1,255
Cuijpers, P., Berking, M., Andersson, G., Quigley, L., Kleiboer, A., & Dobson, K. S. (2013) · The Canadian Journal of Psychiatry · doi:10.1177/070674371305800702 · Cited by 1,066
Self-citation
Metadata
- Authors
- Cuijpers, P., van Straten, A., Bohlmeijer, E., Hollon, S. D., & Andersson, G.
- Affiliations
- Amsterdam Public Health (NL)
- Vanderbilt University (US)
- Linköping University (SE)
- Corresponding author
- Cuijpers, P.
- Venue
- Psychological Medicine
- Publisher
- Cambridge University Press (CUP)
- Published
- 2009-06-03
- Volume
- 40
- Issue
- 2
- Pages
- 211-223
- ISSN
- 0033-2917 (ISSN-L)
- 1469-8978
- OpenAlex
- W2396755030
- Cited by
- 533
- References
- 50
- Citations by year
- 2026: 18 · 2025: 26 · 2024: 43 · 2023: 27 · 2022: 36 · 2021: 31 · 2020: 38 · 2019: 38 · 2018: 31 · 2017: 29 · 2016: 31 · 2015: 30 · 2014: 41 · 2013: 35 · 2012: 24
- FWCI
- 3.51
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Psychological Medicine (publishedVersion)
- PubMed (publishedVersion)
- VU Research Portal (publishedVersion)
- University of Twente Research Information (publishedVersion)
- Digital Academic REpository of VU University Amsterdam (Vrije Universiteit Amsterdam) (submittedVersion)
- University of Twente Research Information (submittedVersion)
- Data Archiving and Networked Services (DANS) (submittedVersion)
- Topics
- Social Sciences › Psychology › Clinical Psychology › Psychotherapy Techniques and Applications
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Anxiety, Depression, Psychometrics, Treatment, Cognitive Processes
- Keywords
- psychotherapy, adult depression, study quality, effect size overestimation, randomized controlled trials, implementation fidelity, control conditions, number needed to treat, heterogeneity
- MeSH terms
- Adult, Major Depressive Disorder, Humans, Psychotherapy, Severity of Illness Index, Cohort Effect, Randomized Controlled Trials as Topic
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: The effects of psychotherapy for adult depression are overestimated: a meta-analysis of study quality and effect size. https://app.cochat.ai/papers/10.1017/s0033291709006114
- The paper
- Cuijpers, P., van Straten, A., Bohlmeijer, E., Hollon, S. D., & Andersson, G. (2010). The effects of psychotherapy for adult depression are overestimated: a meta-analysis of study quality and effect size. Psychological Medicine. https://doi.org/10.1017/s0033291709006114
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.