CoChat

A Metascientific Review of the Evidential Value of Acceptance and Commitment Therapy for Depression

Williams, Alexander J., Botanov, Yevgeny, Giovanetti, Annaleis K., Perko, Victoria L., Sutherland, Carrie L., Youngren, Westley, Sakaluk, John K. · 2023 · Behavior Therapy
Cited by 23

The DOI matches its Crossref record; 32 of the 32 references it cites were found in a registry or an index.

Abstract

In the past three-and-a-half decades, nearly 500 randomized controlled trials (RCTs) have examined Acceptance and Commitment Therapy (ACT) for a range of health problems, including depression. However, emerging concerns regarding the replicability of scientific findings across psychology and mental health treatment outcome research highlight a need to re-examine the strength of evidence for treatment efficacy. Therefore, we conducted a metascientific review of the evidential value of ACT in treating depression. Whereas reporting accuracy was generally high across all trials, we found important differences in evidential value metrics corresponding to the types of control conditions used. RCTs of ACT compared to weaker controls (e.g., no treatment, waitlist) were well-powered, with sample sizes appropriate for detecting plausible effect sizes. They typically yielded stronger Bayesian evidence for (and larger posterior estimates of) ACT efficacy, though there was some evidence of significance inflation among these effects. RCTs of ACT against stronger controls (e.g., other psychotherapies), meanwhile, were poorly powered, designed to detect implausibly large effect sizes, and yielded ambiguous-if not contradicting-Bayesian evidence and estimates of efficacy. Although our review supports a view of ACT as efficacious for treating depression compared to weaker controls, future RCTs must provide more transparent reporting with larger groups of participants to properly assess the difference between ACT and competitor treatments such as behavioral activation and other forms of cognitive behavioral therapy. Clinicians and health organizations should reassess the use of ACT for depression if costs and resources are higher than for other efficacious treatments. Clinical trials contributing effects to our synthesis can be found at https://osf.io/qky35.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1016/j.beth.2022.06.004

Cites

32 of 32 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 32 references

Research works printed but not linked: 19

  1. A-Tjak, 2015, A meta-analysis of the efficacy of acceptance and commitment therapy for clinically relevant mental and physical health problems, Psychotherapy and Psychosomatics, 84, 30, 10.1159/000365764 · DOI · Paper page
  2. Chambless, 1998, Defining empirically supported therapies, Journal of Consulting and Clinical Psychology, 66, 7, 10.1037/0022-006X.66.1.7 · DOI · Paper page
  3. Jiménez, 2012, Acceptance and commitment therapy versus traditional cognitive behavioral therapy: A systematic review and meta-analysis of current empirical evidence, International Journal of Psychology and Psychological Therapy, 12, 333
  4. Meichenbaum, 2018, How to spot hype in the field of psychotherapy: A 19-item checklist, Professional Psychology: Research and Practice, 49, 22, 10.1037/pro0000172 · DOI
  5. Miller, 1969, Psychology as a means of promoting human welfare, American Psychologist, 24, 1063, 10.1037/h0028988 · DOI · Paper page
  6. Mullarkey, 2021, Embracing scientific humility and complexity: Learning “what works for whom” in youth psychotherapy research, Journal of Clinical Child and Adolescent Psychology, 10.1080/15374416.2021.1929252 · DOI
  7. Paul, 1967, Outcome research in psychotherapy, Journal of Consulting Psychology, 31, 109, 10.1037/h0024436 · DOI · Paper page
  8. Pittelkow, 2021, Replication target selection in clinical psychology: A Bayesian and qualitative re-evaluation, Clinical Psychology: Science and Practice
  9. Reardon, 2019, An N-pact factor for clinical psychological research, Journal of Abnormal Psychology, 128, 493, 10.1037/abn0000435 · DOI
  10. Rouder, 2011, A Bayes factor meta-analysis of Bem's ESP claim, Psychonomic Bulletin and Review, 18, 682, 10.3758/s13423-011-0088-7 · DOI · Paper page
  11. Ruiz, 2012, Acceptance and commitment therapy versus traditional cognitive behavioral therapy: A systematic review and meta-analysis of current empirical evidence, International Journal of Psychology and Psychological Therapy, 12, 333
  12. Sakaluk, 2019, Evaluating the evidential value of empirically supported psychological treatments (ESTs): A meta-scientific review, Journal of Abnormal Psychology, 128, 500, 10.1037/abn0000421 · DOI · Paper page
  13. Sakaluk, 2021, Prioritization, evaluation, and promotion of replicability for clinical psychology research: A commentary on Pittelkow et al. (2021), Clinical Psychology: Science and Practice, 28, 222
  14. Schönbrodt, 2017, Sequential hypothesis testing with Bayes factors: Efficiently testing mean differences, Psychological Methods, 22, 322, 10.1037/met0000061 · DOI · Paper page
  15. Silberzahn, 2018, “Many analysts, one data set: Making transparent how variations in analytic choices affect results”: Corrigendum, Advances in Methods and Practices in Psychological Science, 1, 337, 10.1177/2515245917747646 · DOI · Paper page
  16. Tackett, 2019, Psychology's replication crisis and clinical psychological science, Annual Review of Clinical Psychology, 15, 579, 10.1146/annurev-clinpsy-050718-095710 · DOI · Paper page
  17. Uhlmann, 2019, Scientific Utopia III: Crowdsourcing Science, Perspectives on Psychological Science, 14, 711, 10.1177/1745691619850561 · DOI · Paper page
  18. Williams, 2021, Potentially harmful therapies: A meta-scientific review of evidential value, Clinical Psychology: Science and Practice, 28, 5
  19. Wortzel, 2020, Trends in mental health clinical research: Characterizing the ClinicalTrials.gov registry from 2007–2018, PLOS ONE, 15, e0233996, 10.1371/journal.pone.0233996 · DOI

Cited by

Metadata

Authors
Williams, A. J., Botanov, Y., Giovanetti, A. K., Perko, V. L., Sutherland, C. L., Youngren, W., & Sakaluk, J. K.
Venue
Behavior Therapy
Publisher
Elsevier BV
Published
2023-11
Volume
54
Issue
6
Pages
989-1005
ISSN
0005-7894 (ISSN-L)
OpenAlex
W4283524190
Cited by
23
References
32
FWCI
3.86
Type
journal article
Language
en
Open access
closed
Licence
  • www.elsevier.com/tdm/userlicense/1.0/ (tdm)
  • www.elsevier.com/legal/tdmrep-license (tdm)

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.