In pursuit of truth: A critical examination of meta-analyses of cognitive behavior therapy
The DOI matches its Crossref record; 39 of the 39 references it cites were found in a registry or an index.
Abstract
OBJECTIVE: Three recent meta-analyses have made the claim, albeit with some caveats, that cognitive-behavioral treatments (CBT) are superior to other psychotherapies, in general or for specific disorders (e.g., social phobia). METHOD: The purpose of the present article was to examine four issues in meta-analysis that mitigate claims of CBT superiority: (a) effect size, power, and statistical significance, (b) focusing on disorder-specific symptom measures and ignoring other important indicators of psychological functioning, (c) problems inherent in classifying treatments provided in primary studies into classes of treatments, and (d) the inclusion of problematic trials, which biases the results, and the exclusion of trials that fail to find differences among treatments. RESULTS: When these issues are examined, the effects demonstrating the superiority of CBT are small, nonsignificant for the most part, limited to targeted symptoms, or are due to flawed primary studies. CONCLUSION: Meta-analytic evidence for the superiority of CBT in the three meta-analysis are nonexistent or weak.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Falsification and the Methodology of Scientific Research Programmes
Lakatos, I. (1970) · Criticism and the Growth of Knowledge · doi:10.1017/cbo9781139171434.009 · Cited by 4,649 · cited 1×
“…made by Foa et al. However, scientific results are the product of a community of scientists who are bound to have standards that apply across researchers and instances and remain unchanged over the course of an investigation of a phenomenon (Lakatos, 1970; Lakatos & Musgrave, 1970; Larvor, 1998).”
BackgroundThe Handbook of Research Synthesis and Meta-Analysis
(2019) · doi:10.7758/9781610448864 · Cited by 4,553
Defining empirically supported therapies.
Chambless, D. L., & Hollon, S. D. (1998) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.66.1.7 · Cited by 3,067 · cited 1×
“…is that the emphasis in clinical research on psychological treatments for particular disorders, which goes back to the beginning of the empirically supported treatment movement (Chambless & Hollon, 1998; see also Wampold & Imel, 2015), ignores some crucial facts about psychopathology and treatment.”
BackgroundMediators and Mechanisms of Change in Psychotherapy Research
Kazdin, A. E. (2007) · Annual Review of Clinical Psychology · doi:10.1146/annurev.clinpsy.3.022806.091432 · Cited by 2,504
Meta-analysis of psychotherapy outcome studies.
Smith, M. L., & Glass, G. V. (1977) · American Psychologist · doi:10.1037/0003-066x.32.9.752 · Cited by 2,154 · cited 2×
“Nearly 50 years have passed since the publication of Smith and Glass’s (1977; Smith et al. 1980) pioneering meta-analyses showed psychotherapy was effective and all treatments were equally effective when confounds were controlled.”
The Great Psychotherapy Debate: The Evidence for What Makes Psychotherapy Work
Wampold, B. E. (2015) · doi:10.4324/9780203582015 · Cited by 1,773
Self-citationCipriani, A., Furukawa, T. A., Salanti, G., Geddes, J. R., Higgins, J. P., Churchill, R., Watanabe, N., Nakagawa, A., Omori, I. M., McGuire, H., et al. (2009) · The Lancet · doi:10.1016/s0140-6736(09)60046-5 · Cited by 1,654
The efficacy of psychodynamic psychotherapy
Shedler, J. (2010) · American Psychologist · doi:10.1037/a0018378 · Cited by 1,452 · cited 1×
“And to be clear, CBT is not the only treatment that exaggerates its benefits (e.g., claims that PD treatment produces superior outcomes in the long term; cf., Kivlighan et al., 2015 and Shedler, 2010).”
BackgroundNetwork meta‐analysis for indirect treatment comparisons
Lumley, T. (2002) · Statistics in Medicine · doi:10.1002/sim.1201 · Cited by 1,206 · cited 5×
“Marcus et al. used Wampold et al.’s method to conduct the omnibus test of differences among treatments. The statistic W indexes the degree to which treatments differ and as noted in Table II,W was sufficiently large to reject the null hypothesis that all treatments were equally effective for the primary measures, a re…”
MethodInfluentialFrank, J. (1993) · doi:10.56021/9780801840678 · Cited by 1,094
Research works printed but not linked: 58
- 10.1016/j.cpr.2013.01.004 · DOI
- 10.1037/cou0000091 · DOI
- Baldwin S. A., 2013, Bergin and Garfield’s handbook of psychotherapy and behavior change, 258
- Barlow D. H., 2011, Unified protocol for transdiagnostic treatment of emotional disorders: Therapist guide
- 10.1016/j.janxdis.2007.10.002 · DOI
- 10.1037/a0031437 · DOI · Paper page
- 10.1017/CBO9780511521058 · DOI · Paper page
- 10.1177/2167702613497473 · DOI · Paper page
- Dattilio F. M., 2006, Archives of Psychiatry and Psychotherapy, 8, 5
- 10.1371/journal.pone.0063509 · DOI · Paper page
- 10.1016/j.cpr.2009.08.010 · DOI · Paper page
- 10.1192/bjp.165.3.315 · DOI · Paper page
- 10.1037/h0063633 · DOI · Paper page
- Eysenck H. J., 1961, Handbook of abnormal psychology, 10.1097/00000441-196111000-00034 · DOI · Paper page
- Eysenck H. J., 1966, The effects of psychotherapy
- 10.1093/biomet/27.3-4.310 · DOI · Paper page
- Greenberg G., 2013, The book of woe: The DSM and the unmaking of psychiatry
- 10.1037/e602962010-001 · DOI · Paper page
- 10.1037/0033-2909.122.3.221 · doi:10.1037/0033-2909.122.3.221 · Paper page
- Hunt M., 1997, How science takes stock: The story of meta-analysis
- 10.1016/j.drugalcdep.2010.11.010 · DOI · Paper page
- 10.1016/j.cpr.2015.05.003 · DOI
- 10.1590/S1516-44462004000200003 · DOI · Paper page
- 10.1017/CBO9781139171472 · DOI · Paper page
- 10.1017/CBO9781139171434 · DOI · Paper page
- Larvor B., 1998, Lakatos: An introduction
- Leichsenring F., 2015, Lancet Pyschiatry, 2, 448
- Liberman B. L., 1978, Effective ingredients of successful psychotherapy, 35
- 10.1126/science.7973676 · DOI
- 10.1037/0022-006x.46.4.806 · DOI · Paper page
- 10.1007/s11135-006-9057-z · DOI
- 10.1093/acprof:oso/9780199737208.001.0001 · DOI · Paper page
- Norcross J. C., 1992, Handbook of psychotherapy integration, 3
- 10.1037/pst0000014 · DOI
- 10.1037/0022-006X.76.3.478 · DOI · Paper page
- 10.1001/jama.282.8.786 · DOI · Paper page
- 10.1037/0022-0167.35.2.203 · DOI
- 10.1001/archpsyc.60.5.481 · DOI · Paper page
- 10.1037/0003-066x.40.1.73 · doi:10.1037/0003-066x.40.1.73 · Paper page
- Serlin R. C., 1993, A handbook for data analysis in the behavioral sciences: Methodological issues, 199
- 10.1002/pam.10129 · DOI · Paper page
- 10.1037/0022-006X.59.6.883 · doi:10.1037/0022-006x.59.6.883 · Paper page
- 10.1176/appi.ajp.158.12.1993 · DOI · Paper page
- Smith M. L., 1980, The benefits of psychotherapy
- 10.1016/j.cpr.2010.05.003 · DOI · Paper page
- 10.1111/cpsp.12080 · DOI
- 10.1111/cpsp.12109 · doi:10.1111/cpsp.12109
- 10.1371/journal.pone.0035219 · DOI · Paper page
- 10.1016/j.cpr.2013.08.001 · DOI
- 10.1037/a0030570 · DOI
- 10.1016/j.cpr.2010.06.005 · DOI · Paper page
- Wampold B. E., 2009, The Behavior Therapist, 32, 144
- 10.1037/0033-2909.122.3.226 · doi:10.1037/0033-2909.122.3.226 · Paper page
- 10.1037/1082-989X.5.4.425 · doi:10.1037/1082-989x.5.4.425 · Paper page
- 10.1007/s11135-012-9800-6 · DOI
- 10.1037/0022-006X.71.4.773 · DOI · Paper page
- 10.1037/0033-2909.130.4.631 · DOI · Paper page
- 10.1002/wps.20240 · DOI
Cited by
Steinert, C., Munder, T., Rabung, S., Hoyer, J., & Leichsenring, F. (2017) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2017.17010057 · Cited by 244
Meta-analysis: 13-year follow-up of psychotherapy effects on youth depression
Eckshtain, D., Kuppens, S., Ugueto, A., Ng, M. Y., Vaughn-Coaxum, R., Corteselli, K., & Weisz, J. R. (2020) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1016/j.jaac.2019.04.002 · Cited by 224
A common factors perspective on mindfulness-based interventions
Goldberg, S. B. (2022) · Nature Reviews Psychology · doi:10.1038/s44159-022-00090-8 · Cited by 75
Self-citationSchuster, R., Schreyer, M. L., Kaiser, T., Berger, T., Klein, J. P., Moritz, S., Laireiter, A.-R., & Trutschnig, W. (2020) · Internet Interventions · doi:10.1016/j.invent.2020.100313 · Cited by 21
Choice of Psychotherapy Approach
Marouf, F. (2020) · Psychotherapy in Later Life · doi:10.1017/9781108693905.005
Metadata
- Authors
- Wampold, B. E., Flückiger, C., Del Re, A. C., Yulish, N. E., Frost, N. D., Pace, B. T., Goldberg, S. B., Miller, S. D., Baardseth, T. P., Laska, K. M., & Hilsenroth, M. J.
- Venue
- Psychotherapy Research
- Publisher
- Informa UK Limited
- Published
- 2016-11-24
- Volume
- 27
- Issue
- 1
- Pages
- 14-32
- ISSN
- 1050-3307 (ISSN-L)
- 1468-4381
- OpenAlex
- W2553910288
- Cited by
- 131
- References
- 39
- FWCI
- 22.91
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: In pursuit of truth: A critical examination of meta-analyses of cognitive behavior therapy. https://app.cochat.ai/papers/10.1080/10503307.2016.1249433
- The paper
- Wampold, B. E., Flückiger, C., Del Re, A. C., Yulish, N. E., Frost, N. D., Pace, B. T., Goldberg, S. B., Miller, S. D., Baardseth, T. P., Laska, K. M., & Hilsenroth, M. J. (2017). In pursuit of truth: A critical examination of meta-analyses of cognitive behavior therapy. Psychotherapy Research. https://doi.org/10.1080/10503307.2016.1249433
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.