Is psychotherapy effective? A re-analysis of treatments for depression
Open accessThe DOI matches its Crossref record; 21 of the 21 references it cites were found in a registry or an index.
Abstract
Aims: The aim of this study was to reanalyse the data from Cuijpers et al.'s (2018) meta-analysis, to examine Eysenck's claim that psychotherapy is not effective. Cuijpers et al., after correcting for bias, concluded that the effect of psychotherapy for depression was small (standardised mean difference, SMD, between 0.20 and 0.30), providing evidence that psychotherapy is not as effective as generally accepted. Methods: The data for this study were the effect sizes included in Cuijpers et al. (2018). We removed outliers from the data set of effects, corrected for publication bias and segregated psychotherapy from other interventions. In our study, we considered wait-list (WL) controls as the most appropriate estimate of the natural history of depression without intervention. Results: The SMD for all interventions and for psychotherapy compared to WL controls was approximately 0.70, a value consistent with past estimates of the effectiveness of psychotherapy. Psychotherapy was also more effective than care-as-usual (SMD = 0.31) and other control groups (SMD = 0.43). Conclusions: The re-analysis reveals that psychotherapy for adult patients diagnosed with depression is effective.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Outlier and influence diagnostics for meta-analysis
Viechtbauer, W., & Cheung, M. W.-L. (2010) · Research Synthesis Methods · doi:10.1002/jrsm.11 · Cited by 2,949
Kirsch, I., Deacon, B. J., Huedo-Medina, T. B., Scoboria, A., Moore, T. J., & Johnson, B. T. (2008) · PLoS Medicine · doi:10.1371/journal.pmed.0050045 · Cited by 2,442 · cited 1×
“We know that pill placebo with clinical management is often quite effective, often as effective or nearly as effective as antidepressant medication, particularly for depression (Kirsch, 2002, 2009, 2010; Kirsch et al., 2008).”
BackgroundElkin, I. (1989) · Archives of General Psychiatry · doi:10.1001/archpsyc.1989.01810110013002 · Cited by 2,300
Meta-analysis of psychotherapy outcome studies.
Smith, M. L., & Glass, G. V. (1977) · American Psychologist · doi:10.1037/0003-066x.32.9.752 · Cited by 2,154 · cited 2×
“In the late 1970s, Mary Lee Smith and Gene Glass (Smith and Glass, 1977; Smith et al., 1980) conducted a comprehensive meta-analysis of controlled studies of psychotherapy and found that psychotherapy was indeed effective, with a standardised mean difference (SMD) between treated and untreated patients of approximatel…”
BackgroundInfluentialDimidjian, S., Hollon, S. D., Dobson, K. S., Schmaling, K. B., Kohlenberg, R. J., Addis, M. E., Gallop, R., McGlinchey, J. B., Markley, D. K., Gollan, J. K., et al. (2006) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.74.4.658 · Cited by 1,607
A Comprehensive Review of the Placebo Effect: Recent Advances and Current Thought
Price, D. D., Finniss, D. G., & Benedetti, F. (2008) · Annual Review of Psychology · doi:10.1146/annurev.psych.59.113006.095941 · Cited by 1,146 · cited 1×
“It is well established that seeking relief for distress is a vital factor for response to placebo (Price et al., 2008).”
BackgroundPsychological Treatments That Cause Harm
Lilienfeld, S. O. (2007) · Perspectives on Psychological Science · doi:10.1111/j.1745-6916.2007.00029.x · Cited by 959 · cited 1×
“Prevention programs and programs for those not seeking treatment typically are ineffective (Lilienfeld, 2007; Wampold and Imel, 2015).”
BackgroundJansen, J. P., & Naci, H. (2013) · BMC Medicine · doi:10.1186/1741-7015-11-159 · Cited by 656 · cited 1×
“NT) from network meta-analyses in lieu of examining direct comparisons often leads to erroneous conclusions (see e.g. Del Re et al., 2013; Jansen and Naci, 2013; Wampold and Serlin, 2014; Wartolowska et al., 2014; Wampold et al., 2017), especially when, as in Furukawa et al.”
Cristea, I. A., Gentili, C., Cotet, C. D., Palomba, D., Barbui, C., & Cuijpers, P. (2017) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2016.4287 · Cited by 655
Furukawa, T. A., Noma, H., Caldwell, D. M., Honyashiki, M., Shinohara, K., Imai, H., Chen, P., Hunot, V., & Churchill, R. (2014) · Acta Psychiatrica Scandinavica · doi:10.1111/acps.12275 · Cited by 521 · cited 1×
“Recent meta-analyses suggest that waiting lists may be a nocebo, and artificially inflate the effect sizes of therapies (Furukawa et al., 2014) (emphasis added, p.”
BackgroundResearcher allegiance in psychotherapy outcome research: An overview of reviews
Munder, T., Brütsch, O., Leonhart, R., Gerger, H., & Barth, J. (2013) · Clinical Psychology Review · doi:10.1016/j.cpr.2013.02.002 · Cited by 260 · cited 1×
“Allegiance, an important aspect in psychotherapy studies (Munder et al., 2011; Munder et al., 2012; Munder et al., 2013) was ignored even though many of the studies in this data set were conducted by advocates of one of the treatments.”
ResultLosada, A., Márquez-González, M., Romero-Moreno, R., Mausbach, B. T., López, J., Fernández-Fernández, V., & Nogales-González, C. (2015) · Journal of Consulting and Clinical Psychology · doi:10.1037/ccp0000028 · Cited by 255 · cited 1×
“, 2010), or ‘so called’ psychological placebos (e.g. Watt and Cappeliez, 2000; Spinelli and Endicott, 2003; Armento, 2012; Losada et al., 2015).”
BackgroundDowrick, C., Dunn, G., Ayuso-Mateos, J. L., Dalgard, O. S., Page, H., Lehtinen, V., Casey, P., Wilkinson, C., Vazquez-Barquero, J. L., & Wilkinson, G. (2000) · BMJ · doi:10.1136/bmj.321.7274.1450 · Cited by 228
Posternak, M. A., & Miller, I. (2001) · Journal of Affective Disorders · doi:10.1016/s0165-0327(00)00304-9 · Cited by 215
Cochrane’s risk of bias tool in the context of psychotherapy outcome research
Munder, T., & Barth, J. (2018) · Psychotherapy Research · doi:10.1080/10503307.2017.1411628 · Cited by 174
Wampold, B. E., Budge, S. L., Laska, K. M., Del Re, A. C., Baardseth, T. P., Flűckiger, C., Minami, T., Kivlighan, D. M., & Gunn, W. (2011) · Clinical Psychology Review · doi:10.1016/j.cpr.2011.07.012 · Cited by 134 · cited 2×
“CAU is often nearly as effective as first-line psychotherapeutic treatments for several disorders, including borderline personality disorder, anxiety and depression (Wampold et al., 2011; Cristea et al., 2017).”
BackgroundSelf-citationArmijo-Olivo, S., Ospina, M., da Costa, B. R., Egger, M., Saltaji, H., Fuentes, J., Ha, C., & Cummings, G. G. (2014) · PLoS ONE · doi:10.1371/journal.pone.0096920 · Cited by 124
Testing the allegiance bias hypothesis: a meta-analysis
Munder, T., Gerger, H., Trelle, S., & Barth, J. (2011) · Psychotherapy Research · doi:10.1080/10503307.2011.602752 · Cited by 91 · cited 1×
“Allegiance, an important aspect in psychotherapy studies (Munder et al., 2011; Munder et al., 2012; Munder et al., 2013) was ignored even though many of the studies in this data set were conducted by advocates of one of the treatments.”
ResultMeta‐analysis at middle age: a personal history
Glass, G. V. (2015) · Research Synthesis Methods · doi:10.1002/jrsm.1133 · Cited by 88 · cited 1×
“There were articles rebutting Eysenck’s conclusions and rejoinders, creating a contentious interchange (for a summary see Glass and Kliegl, 1983; Wampold, 2013; Glass, 2015; Wampold and Imel, 2015).”
BackgroundMunder, T., Flückiger, C., Gerger, H., Wampold, B. E., & Barth, J. (2012) · Journal of Counseling Psychology · doi:10.1037/a0029571 · Cited by 79
Self-citationWiersma, J. E., Van Schaik, D. J. F., Hoogendorn, A. W., Dekker, J. J., Van, H. L., Schoevers, R. A., Blom, M. B. J., Maas, K., Smit, J. H., McCullough Jr., J. P., et al. (2014) · Psychotherapy and Psychosomatics · doi:10.1159/000360795 · Cited by 79
Cited by
Prevalence of meditation-related adverse effects in a population-based sample in the United States
Goldberg, S. B., Lam, S. U., Britton, W. B., & Davidson, R. J. (2022) · Psychotherapy Research · doi:10.1080/10503307.2021.1933646 · Cited by 115
Schaeuffele, C., Meine, L. E., Schulz, A., Weber, M. C., Moser, A., Paersch, C., Recher, D., Boettcher, J., Renneberg, B., Flückiger, C., et al. (2024) · Nature Human Behaviour · doi:10.1038/s41562-023-01787-3 · Cited by 91
Self-citationMichopoulos, I., Furukawa, T. A., Noma, H., Kishimoto, S., Onishi, A., Ostinelli, E. G., Ciharova, M., Miguel, C., Karyotaki, E., & Cuijpers, P. (2021) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2020.12.012 · Cited by 69
Cristea, I. A. (2019) · Epidemiology and Psychiatric Sciences · doi:10.1017/s2045796018000665 · Cited by 47
Psychotherapy training in Nepal: views of early career psychiatrists
Rai, Y., Karki, U., & Pinto da Costa, M. (2021) · BJPsych International · doi:10.1192/bji.2020.50 · Cited by 34
Metadata
- Authors
- Munder, T., Flückiger, C., Leichsenring, F., Abbass, A. A., Hilsenroth, M. J., Luyten, P., Rabung, S., Steinert, C., & Wampold, B. E.
- Venue
- Epidemiology and Psychiatric Sciences
- Publisher
- Cambridge University Press (CUP)
- Published
- 2018-07-30
- Volume
- 28
- Issue
- 03
- Pages
- 268-274
- ISSN
- 2045-7960 (ISSN-L)
- 2045-7979
- OpenAlex
- W2885074836
- Cited by
- 131
- References
- 21
- FWCI
- 8.85
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.