The DOI matches its Crossref record; 50 of the 51 references it cites were found in a registry or an index; 10 of the 39 sources its claims cite were checked for support.
A systematic review and meta-analysis of self-guided online acceptance and commitment therapy as a transdiagnostic self-help intervention
Open accessAbstract
Online Acceptance and Commitment Therapy (ACT) interventions use websites and smartphone apps to deliver ACT exercises and skills. The present meta-analysis provides a comprehensive review of online ACT self-help interventions, characterizing the programs that have been studied (e.g. platform, length, content) and analyzing their efficacy. A transdiagnostic approach was taken, including studies that addressed a range of targeted problems and populations. Multi-level meta-analyses were used to nest multiple measures of a single construct within their respective studies. A total of 53 randomized controlled trials were included (n = 10,730). Online ACT produced significantly greater outcomes than waitlist controls at post-treatment for anxiety, depression, quality of life, psychological flexibility, and all assessed outcomes (i.e. omnibus effect), which were generally maintained at follow-up. However, only psychological flexibility and all assessed outcomes at post-treatment were found to be significantly greater for online ACT when compared to active controls, with no significant follow-up effects. Overall, these results further clarify that ACT can be effectively delivered in an online format to target a wide range of mental health concerns, although it is less clear if and when online ACT is more efficacious than other online interventions. © 2023 The Author(s). Published by Informa UK Limited, trading as Taylor & Francis Group.
Overview
CoChat Summary
TL;DR
This systematic review and multi-level meta-analysis of 53 RCTs (n = 10,730) found self-guided online ACT produced small significant improvements over waitlist controls at post-treatment across anxiety, depression, quality of life, psychological flexibility, and omnibus outcomes, generally maintained at follow-up. Against active controls, only psychological flexibility and omnibus outcomes were significant at post-treatment, with no significant follow-up effects.
Key findings
- Waitlist comparisons at post-treatment: anxiety g = 0.30 (95% CI [0.17, 0.43]), depression g = 0.44 (95% CI [0.32, 0.57]), quality of life g = 0.20 (95% CI [0.09, 0.30]), psychological flexibility g = 0.29 (95% CI [0.21, 0.38]), and omnibus g = 0.31 (95% CI [0.24, 0.39]). Follow-up effects were generally maintained: anxiety g = 0.32, depression g = 0.49, omnibus g = 0.30; quality of life follow-up was non-significant (g = 0.11, 95% CI [-0.14, 0.36]).
- Active control comparisons at post-treatment: omnibus g = 0.18 (95% CI [0.09, 0.28]) and psychological flexibility g = 0.16 (95% CI [0.02, 0.31]) were significant; anxiety (g = 0.21), depression (g = 0.15), and quality of life (g = 0.17) were not. No significant follow-up effects were found (omnibus g = 0.10; psychological flexibility g = 0.05).
- Adherence and satisfaction: average participants completing all modules was 57.63% (n = 23; SD = 18.45%; range 27.5%–94.7%); average modules completed was 74% (n = 13; SD = 11%; range 53.33%–94.5%); satisfaction averaged 7.27/10 (n = 14; between-study SD = 0.59); System Usability Score averaged 79.19/100 (n = 8; between-study SD = 5.46).
- Intervention features: 38 used a website, 10 used an app, and 5 used a combination; average duration was 9.27 weeks (SD = 9.05; median = 8), ranging from 2 weeks to 1 year; 42 were modular with an average of 6.38 modules (SD = 2.22; range 2–12); 49 included all three ACT pillars; 38 of 53 involved non-automated human support. Publication bias: Egger’s test showed significant asymmetry for waitlist omnibus (p = .017) and active-control omnibus (p = .003), and for waitlist anxiety (p = .012), depression (p = .005), quality of life (p < .001), and psychological flexibility (p = .005).
Methods
- Systematic review and multi-level meta-analysis; searched PsycINFO and Google Scholar in July 2022 plus prior reviews and the ACTing with Technology SIG list; included 53 RCTs (n = 10,730) of phone- or website-delivered self-guided ACT, requiring at least two of the three ACT pillars, peer-reviewed publication, English language, and pre/post outcomes.
- Data were extracted by three researchers with 84% agreement; intent-to-treat data were used; Hedges’ g random-effects models compared online ACT with waitlist and active controls separately; subgroup analyses covered anxiety, depression, quality of life, psychological flexibility, and an omnibus effect; 3-level and 4-level meta-analyses were run with the metafor package; publication bias was assessed with Egger’s tests and contour-enhanced funnel plots.
Limitations
- Stated: heterogeneity in delivery platform, human support, and treatment length; missing outcome data (21 post-treatment effects across 5 studies; 27 follow-up effects across 4 studies); missing adherence data (25 studies) and satisfaction data (11 studies); outcomes did not always map onto primary targets, potentially diluting effect sizes; RCT-only inclusion may inflate adherence and limit external validity; varying follow-up timepoints; significant publication bias risk; most studies from Europe and North America; exclusion of non-English studies.
- Evident from the text: the review was not formally registered.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
8 Valid · 1 Not valid · 23 Not checked · 90 Own results and interpretations
Every source the paper cites for this claim was checked and supports it.
In the paper
“Given the high heterogeneity regarding how adherence, attrition, and engagement are reported in research on online interventions, comparison with other online programs based in other orientations is somewhat difficult (Beintner et al., 2019).”
What the sources say
- Supportedcites Beintner et al., 2019 source
The Introduction says that adherence is not consistently reported and that its operationalization varies across trials, limiting comparability. It also documents differing uses of terms including engagement and attrition. The Abstract’s Conclusions likewise state that varied reporting and usage metrics limit comparisons between studies; neither passage specifies therapeutic orientation, but the claim applies this general limitation to comparisons across orientations. Page numbers are not provided in our copy. (LLM, conf=0.91)
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Participants typically completed a total of 74% ( n = 13; SD = 11%; median = 72.86%) of all modules, with a range of 53.33% to 94.5%.”
plainn = 13- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The pooled effect size for the studies comparing online ACT to waitlist control groups for depression measures during the post-treatment assessment ( k = 27 effects across 24 studies) was a small, significant effect of g = 0.44 (95% CI [0.32, 0.57]), with substantial between-studies heterogeneity ( I 2 = 53.4%) and no within-studies heterogeneity ( I 2 = 0%; see Figure 2(b)).”
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The studies that captured follow-up data on depression ( k = 7 effects across seven studies) had a small, significant pooled effect size of g = 0.49 (95% CI [0.30, 0.68]), with negligible between-studies heterogeneity ( I 2 = 3.8%) and within-studies heterogeneity ( I 2 = 3.8%) when comparing online ACT to waitlist control conditions.”
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“However, no significant effect was found when comparing experiment and waitlist control conditions at follow-up ( k = 6 effects across three studies; g = 0.11; 95% CI [-0.14, 0.36]), with no between or within-studies heterogeneity being present ( I 2 = 0%).”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
53 more claims
Create a free account to see all 122 claims and every source verdict.
- Probably not a substantial claim. 32
- It may state two separate claims as one. 51
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“the concept of the transdiagnostic approach (97, 100–109) reflects the observation that improvements in one dimension of psychological experiences are associated with improvements in further dimensions of psychological experiences.”
From Sleep disturbances and psychological well-being among military medical doctors of the Swiss Armed Forces: study protocol, rationale and development of a cross-sectional and longitudinal interventional study (2024) · cites this paper as [102]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The average attrition rate reported was 42.4 %, and the mean satisfaction rating out of 10 was 7.3.”
From An open trial of the feasibility of brief internet-delivered acceptance and commitment therapy (iACT) for chronic anxiety and depression (2023) · cites this paper as Klimczak et al., 2023
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“In contrast, no significant differences were found when iACT was compared to active control groups such as treatment-as-usual, placebo intervention, or online CBT.”
From An open trial of the feasibility of brief internet-delivered acceptance and commitment therapy (iACT) for chronic anxiety and depression (2023) · cites this paper as Klimczak et al., 2023
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Furthermore, a systematic review and meta-analysis conducted by Klimczak et al also found that ACT could be effectively delivered as a self-guided online intervention.34”
The cited source says what the claim attributes to it.
In the citing paper
“The interventions had an average of 6.4 modules and took an average of 9.3 weeks to deliver.”
From An open trial of the feasibility of brief internet-delivered acceptance and commitment therapy (iACT) for chronic anxiety and depression (2023) · cites this paper as Klimczak et al., 2023
3 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated major: it would touch a result — a value a result rests on, reported and recomputed p-values on opposite sides of the significance level, two passages that conflict with no sign which is right, or a cited work retracted before this paper was published.
In the paper
§ Psychological flexibility
“Among the studies that investigated psychological flexibility at follow-up when comparing experiment and active control conditions ( k = 26 effects across seven studies), a small pooled effect size of g = 0.37 (95% CI [0.24, 0.49]) was found”
§ Anxiety
“| Follow-up ( k = 25) | 0.05 | [-0.15, 0.24] | .632 | .053 | 54.3% | 0% | [-0.43, 0.52] |”
Citations
Cites
R: A Language and Environment for Statistical Computing
R Core Team (2025) · doi:10.32614/r.manuals · Cited by 352,181
Quantifying heterogeneity in a meta‐analysis
Higgins, J. P. T., & Thompson, S. G. (2002) · Statistics in Medicine · doi:10.1002/sim.1186 · Cited by 36,763 · cited 1×
“…a full table of results, including effect size ( g ), 95% confidence intervals, effect size p-values, Cochran’s Q p-values (Cochran, 1954), Higgins and Thompson’s I 2 for both between-study and within-study (J. P. T. Higgins & Thompson, 2002), and 95% prediction intervals (IntHout et al., 2016).”
BackgroundConducting Meta-Analyses in R with the metafor Package
Viechtbauer, W. (2010) · Journal of Statistical Software · doi:10.18637/jss.v036.i03 · Cited by 20,464 · cited 1×
“…for multiple measures of a single construct being nested within a single study (3-level meta-analyses), and multiple constructs being nested within a single study in the case of the omnibus effect (4-level meta-analysis) using the rma. mv() function from the metafor package (Viechtbauer, 2010).”
MethodCochrane Handbook for Systematic Reviews of Interventions
(2019) · doi:10.1002/9781119536604 · Cited by 14,828
An Empirical Evaluation of the System Usability Scale
Bangor, A., Kortum, P. T., & Miller, J. T. (2008) · International Journal of Human–Computer Interaction · doi:10.1080/10447310802205776 · Cited by 5,181
Some Methods for Strengthening the Common χ 2 Tests
Cochran, W. G. (1954) · Biometrics · doi:10.2307/3001616 · Cited by 3,718 · cited 2×
“See Table 1 for a full table of results, including effect size ( g ), 95% confidence intervals, effect size p-values, Cochran’s Q p-values (Cochran, 1954), Higgins and Thompson’s I 2 for both between-study and within-study (J. P. T. Higgins & Thompson, 2002), and 95% prediction intervals (IntHout…”
BackgroundCzeisler, M. É., Lane, R. I., Petrosky, E., Wiley, J. F., Christensen, A., Njai, R., Weaver, M. D., Robbins, R., Facer-Childs, E. R., Barger, L. K., et al. (2020) · MMWR. Morbidity and Mortality Weekly Report · doi:10.15585/mmwr.mm6932a1 · Cited by 2,686
Plea for routinely presenting prediction intervals in meta-analysis.
IntHout, J., Ioannidis, J. P. A., Rovers, M. M., & Goeman, J. J. (2016) · BMJ Open · doi:10.1136/bmjopen-2015-010247 · Cited by 2,264 · cited 2×
“…a full table of results, including effect size ( g ), 95% confidence intervals, effect size p-values, Cochran’s Q p-values (Cochran, 1954), Higgins and Thompson’s I 2 for both between-study and within-study (J. P. T. Higgins & Thompson, 2002), and 95% prediction intervals (IntHout et al., 2016).”
BackgroundAcceptance and commitment therapy.
Hayes, S. C., & Lillis, J. (2012) · American Psychological Association eBooks · doi:10.1037/17335-000 · Cited by 1,543
Borghouts, J., Eikey, E., Mark, G., De Leon, C., Schueller, S. M., Schneider, M., Stadnick, N., Zheng, K., Mukamel, D., & Sorkin, D. H. (2021) · Journal of Medical Internet Research · doi:10.2196/24387 · Cited by 1,069 · cited 2×
“However, these ACT adherence rates appear to be generally similar to those found with other online CBTs (Borghouts et al., 2021; Linardon & FullerTyszkiewicz, 2020).”
Result
Research works printed but not linked: 1
- Melcher J., 2020, Journal of American College Health, 70, 1
Cited by
An Overview of Research on Acceptance and Commitment Therapy
Levin, M. E., Krafft, J., & Twohig, M. P. (2024) · Psychiatric Clinics of North America · doi:10.1016/j.psc.2024.02.007 · Cited by 49
Self-citationPredictors of adherence to a publicly available self-guided digital mental health intervention
Woolley, M. G., Klimczak, K. S., Davis, C. H., & Levin, M. E. (2024) · Cognitive Behaviour Therapy · doi:10.1080/16506073.2024.2341807 · Cited by 27
“…such as cognitive behavioral therapy and acceptance and commitment therapy (ACT), have shown that program completion rates often fall below 50%, and the majority of trial participants typically do not reach full completion of these programs (Klimczak et al., 2023; Lipschitz et al., 2022).”
Self-citationRegli, J., Bahmani, D. S., Rigotti, V., Stanga, Z. G., Ülgür, I. I., Fichter, C., Lang, U. E., Brühl, A. B., & Brand, S. (2024) · Journal of Clinical Medicine · doi:10.3390/jcm13154372 · Cited by 21
Atefi, G. L., van Knippenberg, R. J. M., Bartels, S. L., Losada-Baltar, A., Márquez-González, M., Verhey, F. R. J., & de Vugt, M. E. (2024) · JMIR Aging · doi:10.2196/53489 · Cited by 15
“…revealed a high adherence rate of 83% (24/29) at the postintervention measurements, which exceeded the average adherence rate of 57% found in self-guided ACT interventions [48], 73% found in self-help interventions [24], and 69% found in internet-based treatments for the general population [49].”
BackgroundResultKäll, A., Biliūnaitė, I., & Andersson, G. (2024) · Digital Health · doi:10.1177/20552076241287643 · Cited by 22
Metadata
- Authors
- Klimczak, K. S., San Miguel, G. G., Mukasa, M. N., Twohig, M. P., & Levin, M. E.
- Affiliations
- Utah State University (US)
- Department of Psychology, Utah State University, 2810 Old Main Hill, Logan, UT 84322, USA
- Corresponding author
- Klimczak, Korena S.
- ORCID
- Venue
- Cognitive Behaviour Therapy
- Publisher
- Informa UK Limited
- Published
- 2023-02-27
- Volume
- 52
- Issue
- 3
- Pages
- 269-294
- ISSN
- 1650-6073 (ISSN-L)
- 1651-2316
- OpenAlex
- W4322495356
- Cited by
- 88
- References
- 49
- Citations by year
- 2026: 33 · 2025: 24 · 2024: 23 · 2023: 8
- FWCI
- 4.46
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Cognitive Behaviour Therapy (publishedVersion, cc-by-nc-nd)
- PubMed (publishedVersion)
- Digital Commons - USU (Utah State University) (submittedVersion, cc-by-nc-nd)
- Topics
- Social Sciences › Psychology › Clinical Psychology › Mindfulness and Compassion Interventions
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Anxiety, Depression, Psychometrics, Treatment, Cognitive Processes
- Keywords
- acceptance and commitment therapy, online self-help intervention, transdiagnostic treatment, psychological flexibility, anxiety, depression, quality of life, mobile application, waitlist control, follow-up outcomes, digital mental health
- MeSH terms
- Anxiety, Anxiety Disorders, Humans, Mental Health, Quality of Life, Acceptance and Commitment Therapy
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-11, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-11 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: A systematic review and meta-analysis of self-guided online acceptance and commitment therapy as a transdiagnostic self-help intervention. https://app.cochat.ai/papers/10.1080/16506073.2023.2178498
- The paper
- Klimczak, K. S., San Miguel, G. G., Mukasa, M. N., Twohig, M. P., & Levin, M. E. (2023). A systematic review and meta-analysis of self-guided online acceptance and commitment therapy as a transdiagnostic self-help intervention. Cognitive Behaviour Therapy. https://doi.org/10.1080/16506073.2023.2178498
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.