A Metascientific Review of the Evidential Value of Acceptance and Commitment Therapy for Depression
The DOI matches its Crossref record; 32 of the 32 references it cites were found in a registry or an index.
Abstract
In the past three-and-a-half decades, nearly 500 randomized controlled trials (RCTs) have examined Acceptance and Commitment Therapy (ACT) for a range of health problems, including depression. However, emerging concerns regarding the replicability of scientific findings across psychology and mental health treatment outcome research highlight a need to re-examine the strength of evidence for treatment efficacy. Therefore, we conducted a metascientific review of the evidential value of ACT in treating depression. Whereas reporting accuracy was generally high across all trials, we found important differences in evidential value metrics corresponding to the types of control conditions used. RCTs of ACT compared to weaker controls (e.g., no treatment, waitlist) were well-powered, with sample sizes appropriate for detecting plausible effect sizes. They typically yielded stronger Bayesian evidence for (and larger posterior estimates of) ACT efficacy, though there was some evidence of significance inflation among these effects. RCTs of ACT against stronger controls (e.g., other psychotherapies), meanwhile, were poorly powered, designed to detect implausibly large effect sizes, and yielded ambiguous-if not contradicting-Bayesian evidence and estimates of efficacy. Although our review supports a view of ACT as efficacious for treating depression compared to weaker controls, future RCTs must provide more transparent reporting with larger groups of participants to properly assess the difference between ACT and competitor treatments such as behavioral activation and other forms of cognitive behavioral therapy. Clinicians and health organizations should reassess the use of ACT for depression if costs and resources are higher than for other efficacious treatments. Clinical trials contributing effects to our synthesis can be found at https://osf.io/qky35.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Estimating the reproducibility of psychological science
Open Science Collaboration (2015) · Science · doi:10.1126/science.aac4716 · Cited by 8,515
Simmons, J. P., Nelson, L. D., & Simonsohn, U. (2011) · Psychological Science · doi:10.1177/0956797611417632 · Cited by 6,567
Equivalence Tests: A Practical Primer for t Tests, Correlations, and Meta-Analyses
Lakens, D. (2017) · Social Psychological and Personality Science · doi:10.1177/1948550617697177 · Cited by 3,001
The statistical power of abnormal-social psychological research: A review.
Cohen, J. (1962) · The Journal of Abnormal and Social Psychology · doi:10.1037/h0045186 · Cited by 1,824
Appelbaum, M., Cooper, H., Kline, R. B., Mayo-Wilson, E., Nezu, A. M., & Rao, S. M. (2018) · American Psychologist · doi:10.1037/amp0000191 · Cited by 1,449
Global Burden of Disease and the Impact of Mental and Addictive Disorders
Rehm, J., & Shield, K. D. (2019) · Current Psychiatry Reports · doi:10.1007/s11920-019-0997-0 · Cited by 1,388
Hayes, S. C., Levin, M. E., Plumb-Vilardaga, J., Villatte, J. L., & Pistorello, J. (2013) · Behavior Therapy · doi:10.1016/j.beth.2009.08.002 · Cited by 1,120
Spijkerman, M. P. J., Pots, W. T. M., & Bohlmeijer, E. T. (2016) · Clinical Psychology Review · doi:10.1016/j.cpr.2016.03.009 · Cited by 975
Measurement Schmeasurement: Questionable Measurement Practices and How to Avoid Them
Flake, J. K., & Fried, E. I. (2020) · Advances in Methods and Practices in Psychological Science · doi:10.1177/2515245920952393 · Cited by 969
Efficacy of the third wave of behavioral therapies: A systematic review and meta- analysis
Öst, L.-G. (2008) · Behaviour Research and Therapy · doi:10.1016/j.brat.2007.12.005 · Cited by 727
Yarkoni, T. (2022) · Behavioral and Brain Sciences · doi:10.1017/s0140525x20001685 · Cited by 701
The 52 symptoms of major depression: lack of content overlap among seven common depression scales
Fried, E. I. (2017) · Journal of Affective Disorders · doi:10.1016/j.jad.2016.10.019 · Cited by 649
The empirical status of acceptance and commitment therapy: A review of meta-analyses
Gloster, A. T., Walder, N., Levin, M. E., Twohig, M. P., & Karekla, M. (2020) · Journal of Contextual Behavioral Science · doi:10.1016/j.jcbs.2020.09.009 · Cited by 622
Acceptance and commitment therapy: A meta-analytic review
Powers, M. B., Zum Vörde Sive Vörding, M. B., & Emmelkamp, P. M. G. (2009) · Psychotherapy and Psychosomatics · doi:10.1159/000190790 · Cited by 619
Nelson, L. D., Simmons, J., & Simonsohn, U. (2018) · Annual Review of Psychology · doi:10.1146/annurev-psych-122216-011836 · Cited by 548
The prevalence of statistical reporting errors in psychology (1985–2013)
Nuijten, M. B., Hartgerink, C. H. J., van Assen, M. A. L. M., Epskamp, S., & Wicherts, J. M. (2016) · Behavior Research Methods · doi:10.3758/s13428-015-0664-2 · Cited by 510
The efficacy of Acceptance and Commitment Therapy: An updated systematic review and meta-analysis
Öst, L.-G. (2014) · Behaviour Research and Therapy · doi:10.1016/j.brat.2014.07.018 · Cited by 476
The ironic effect of significant results on the credibility of multiple-study articles.
Schimmack, U. (2012) · Psychological Methods · doi:10.1037/a0029487 · Cited by 455
Maj, M., Stein, D. J., Parker, G., Zimmerman, M., Fava, G. A., De Hert, M., Demyttenaere, K., McIntyre, R. S., Widiger, T., & Wittchen, H. (2020) · World Psychiatry · doi:10.1002/wps.20771 · Cited by 435
Dindo, L., Van Liew, J. R., & Arch, J. J. (2017) · Neurotherapeutics · doi:10.1007/s13311-017-0521-3 · Cited by 371
The (mis)reporting of statistical results in psychology journals
Bakker, M., & Wicherts, J. M. (2011) · Behavior Research Methods · doi:10.3758/s13428-011-0089-5 · Cited by 356
Acceptance and Commitment Therapy (ACT) to reduce depression: a systematic review and meta-analysis
Bai, Z., Luo, S., Zhang, L., Wu, S., & Chi, I. (2020) · Journal of Affective Disorders · doi:10.1016/j.jad.2019.09.040 · Cited by 321
Tackett, J. L., Lilienfeld, S. O., Patrick, C. J., Johnson, S. L., Krueger, R. F., Miller, J. D., Oltmanns, T. F., & Shrout, P. E. (2017) · Perspectives on Psychological Science · doi:10.1177/1745691617690042 · Cited by 251
Cuijpers, P., Turner, E. H., Koole, S. L., van Dijke, A., & Smit, F. (2014) · Depression and Anxiety · doi:10.1002/da.22249 · Cited by 242
Cuijpers, P. (2017) · Canadian Psychology / Psychologie canadienne · doi:10.1037/cap0000096 · Cited by 231
Getting What You Ask For: On the Selectivity of Depression Rating Scales
Demyttenaere, K., & De Fruyt, J. (2003) · Psychotherapy and Psychosomatics · doi:10.1159/000068690 · Cited by 206
Brown, M., Glendenning, A., Hoon, A. E., & John, A. (2016) · Journal of Medical Internet Research · doi:10.2196/jmir.6200 · Cited by 198
Carlbring, P., Hägglund, M., Luthström, A., Dahlin, M., Kadowaki, Å., Vernmark, K., & Andersson, G. (2013) · Journal of Affective Disorders · doi:10.1016/j.jad.2012.12.020 · Cited by 177
Hacker, T., Stone, P., & MacBeth, A. (2016) · Journal of Affective Disorders · doi:10.1016/j.jad.2015.10.053 · Cited by 130
Acceptance and Commitment Therapy
Twohig, M. P. (2012) · Cognitive and Behavioral Practice · doi:10.1016/j.cbpra.2012.04.003 · Cited by 115
French, K., Golijani-Moghaddam, N., & Schröder, T. (2017) · Journal of Contextual Behavioral Science · doi:10.1016/j.jcbs.2017.08.002 · Cited by 100
Clarke, S., Kingston, J., James, K., Bolderston, H., & Remington, B. (2014) · Journal of Contextual Behavioral Science · doi:10.1016/j.jcbs.2014.04.005 · Cited by 79
Research works printed but not linked: 19
- A-Tjak, 2015, A meta-analysis of the efficacy of acceptance and commitment therapy for clinically relevant mental and physical health problems, Psychotherapy and Psychosomatics, 84, 30, 10.1159/000365764 · DOI · Paper page
- Chambless, 1998, Defining empirically supported therapies, Journal of Consulting and Clinical Psychology, 66, 7, 10.1037/0022-006X.66.1.7 · DOI · Paper page
- Jiménez, 2012, Acceptance and commitment therapy versus traditional cognitive behavioral therapy: A systematic review and meta-analysis of current empirical evidence, International Journal of Psychology and Psychological Therapy, 12, 333
- Meichenbaum, 2018, How to spot hype in the field of psychotherapy: A 19-item checklist, Professional Psychology: Research and Practice, 49, 22, 10.1037/pro0000172 · DOI
- Miller, 1969, Psychology as a means of promoting human welfare, American Psychologist, 24, 1063, 10.1037/h0028988 · DOI · Paper page
- Mullarkey, 2021, Embracing scientific humility and complexity: Learning “what works for whom” in youth psychotherapy research, Journal of Clinical Child and Adolescent Psychology, 10.1080/15374416.2021.1929252 · DOI
- Paul, 1967, Outcome research in psychotherapy, Journal of Consulting Psychology, 31, 109, 10.1037/h0024436 · DOI · Paper page
- Pittelkow, 2021, Replication target selection in clinical psychology: A Bayesian and qualitative re-evaluation, Clinical Psychology: Science and Practice
- Reardon, 2019, An N-pact factor for clinical psychological research, Journal of Abnormal Psychology, 128, 493, 10.1037/abn0000435 · DOI
- Rouder, 2011, A Bayes factor meta-analysis of Bem's ESP claim, Psychonomic Bulletin and Review, 18, 682, 10.3758/s13423-011-0088-7 · DOI · Paper page
- Ruiz, 2012, Acceptance and commitment therapy versus traditional cognitive behavioral therapy: A systematic review and meta-analysis of current empirical evidence, International Journal of Psychology and Psychological Therapy, 12, 333
- Sakaluk, 2019, Evaluating the evidential value of empirically supported psychological treatments (ESTs): A meta-scientific review, Journal of Abnormal Psychology, 128, 500, 10.1037/abn0000421 · DOI · Paper page
- Sakaluk, 2021, Prioritization, evaluation, and promotion of replicability for clinical psychology research: A commentary on Pittelkow et al. (2021), Clinical Psychology: Science and Practice, 28, 222
- Schönbrodt, 2017, Sequential hypothesis testing with Bayes factors: Efficiently testing mean differences, Psychological Methods, 22, 322, 10.1037/met0000061 · DOI · Paper page
- Silberzahn, 2018, “Many analysts, one data set: Making transparent how variations in analytic choices affect results”: Corrigendum, Advances in Methods and Practices in Psychological Science, 1, 337, 10.1177/2515245917747646 · DOI · Paper page
- Tackett, 2019, Psychology's replication crisis and clinical psychological science, Annual Review of Clinical Psychology, 15, 579, 10.1146/annurev-clinpsy-050718-095710 · DOI · Paper page
- Uhlmann, 2019, Scientific Utopia III: Crowdsourcing Science, Perspectives on Psychological Science, 14, 711, 10.1177/1745691619850561 · DOI · Paper page
- Williams, 2021, Potentially harmful therapies: A meta-scientific review of evidential value, Clinical Psychology: Science and Practice, 28, 5
- Wortzel, 2020, Trends in mental health clinical research: Characterizing the ClinicalTrials.gov registry from 2007–2018, PLOS ONE, 15, e0233996, 10.1371/journal.pone.0233996 · DOI
Cited by
An Overview of Research on Acceptance and Commitment Therapy
Levin, M. E., Krafft, J., & Twohig, M. P. (2024) · Psychiatric Clinics of North America · doi:10.1016/j.psc.2024.02.007 · Cited by 49
Hayes, S. C., Hofmann, S. G., & Ciarrochi, J. (2023) · Behavior Therapy · doi:10.1016/j.beth.2023.07.011 · Cited by 37
Apolinário-Hagen, J., Drüge, M., Guthardt, L., & Haller, E. (2024) · Advances in Experimental Medicine and Biology · doi:10.1007/978-981-97-4402-2_12 · Cited by 6
Tayyebi, G., Alwan, N. H., Hamed, A. F., Shallal, A. A., Abdulrazzaq, T., & Khayayi, R. (2024) · Iranian Journal of Psychiatry · doi:10.18502/ijps.v19i3.15809 · Cited by 7
“…adolescents grappling with depression, can bolster resilience by learning to embrace difficult emotions rather than shunning them and by avoiding identifying exclusively with a 'depressed self-concept,' recognizing that their essence is not solely defined by their challenging emotions (14).”
BackgroundBrowning, M. E., Lloyd-Richardson, E. E., Satterfield, S. L., & Trisal, A. V. (2023) · Behavioural and Cognitive Psychotherapy · doi:10.1017/s1352465823000188 · Cited by 4
Metadata
- Authors
- Williams, A. J., Botanov, Y., Giovanetti, A. K., Perko, V. L., Sutherland, C. L., Youngren, W., & Sakaluk, J. K.
- Venue
- Behavior Therapy
- Publisher
- Elsevier BV
- Published
- 2023-11
- Volume
- 54
- Issue
- 6
- Pages
- 989-1005
- ISSN
- 0005-7894 (ISSN-L)
- OpenAlex
- W4283524190
- Cited by
- 23
- References
- 32
- FWCI
- 3.86
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.elsevier.com/tdm/userlicense/1.0/ (tdm)
- www.elsevier.com/legal/tdmrep-license (tdm)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.