CoChat

Internet-Delivered Cognitive Behavioral Therapy for Anxiety Disorders in Open Community Versus Clinical Service Recruitment: Meta-Analysis

Open access
Romijn, Geke, Batelaan, Neeltje, Kok, Robin, Koning, Jeroen, van Balkom, Anton, Titov, Nickolai, Riper, Heleen · 2019 · Journal of Medical Internet Research

The DOI matches its Crossref record; 110 of the 113 references it cites were found in a registry or an index; 9 of the 34 sources its claims cite were checked for support.

Abstract

BACKGROUND: Ample studies have shown the effectiveness of internet-delivered cognitive behavioral therapy (iCBT) for anxiety disorders. These studies recruited their participants mainly from the community and, to a lesser extent, from within routine care services. Little is known about whether different recruitment strategies lead to different treatment effects. OBJECTIVE: This meta-analysis compared clinical results obtained in trials with recruitment from the community versus results obtained in trials with clinical service recruitment and explored factors that may mediate differences in treatment outcome. METHODS: We included randomized controlled trials in which the clinical effects of iCBT for anxiety disorders were compared with a control condition (waitlist controls or face-to-face cognitive behavioral therapy). We classified trials as open recruitment trials (recruitment from the community) or clinical service recruitment trials (recruitment through outpatient clinics). Pooled effect sizes based on measures examining anxiety symptoms, depressive symptoms, and quality of life were computed for each type of trial. Subgroup analyses examined whether clinical results from open recruitment trials differed from those obtained in clinical service recruitment trials. Additional analyses explored which demographic, clinical, and treatment-related factors contributed to differences in effect sizes of open recruitment versus clinical service recruitment trials. RESULTS: We included 42 studies with 53 comparisons (43 open recruitment comparisons and 10 clinical recruitment comparisons). Analyses of anxiety measures revealed, first, that iCBT open recruitment studies with waitlist control comparators showed a significantly higher effect size for decrease in anxiety symptoms than did those with clinical recruitment (Q=10.09; P=.001). This association between recruitment method and effect size was no longer significant in a multivariate metaregression with treatment adherence and exclusion of patients with depressive symptoms entered as additional predictors of effect size. Second, effect size for decrease in anxiety symptoms did not differ significantly between clinical recruitment and open recruitment studies with face-to-face cognitive behavioral therapy comparators. The effects of open recruitment trials and clinical recruitment trials did not differ significantly for the secondary outcomes, compared with face-to-face cognitive behavioral therapy and waitlist controls. CONCLUSIONS: iCBT was effective in samples recruited in clinical practice, but effect sizes were smaller than those found in trials with an open recruitment method for studies with waitlist control comparators. Hence, for patients with anxiety disorders in routine care, the impact of iCBT may not be as positive as for study participants recruited from the community. The difference between open recruitment trials and clinical service recruitment trials might be partly explained by patients' greater therapy adherence in open recruitment trials and the stricter exclusion of patients with severe depressive symptoms in these studies. Since most trials in this meta-analysis applied an open recruitment method, more studies with routine care populations are needed to further validate these findings.

Overview

CoChat Summary

TL;DR

This meta-analysis of 42 RCTs (53 comparisons, 3714 participants) found internet-delivered CBT (iCBT) for anxiety disorders was effective versus waitlist control, but effect sizes were smaller in clinical service recruitment (CSR) trials than open recruitment (OR) trials for waitlist comparisons. The recruitment-method difference was no longer significant in multivariate metaregression with treatment adherence and exclusion of severely depressed patients entered as predictors.

Key findings

  • Overall iCBT versus waitlist control reduced anxiety symptoms with g=0.72 (95% CI 0.60-0.83; P<.001; I²=53%; NNT=3). iCBT versus face-to-face CBT showed a nonsignificant difference, g=0.12 (95% CI –0.02 to 0.26; P=.11; NNT=15).
  • For waitlist-controlled studies, OR trials had a large effect on anxiety (g=0.79; P<.001) while CSR trials had a small effect (g=0.28; P=.003); the between-group difference was significant (Q=10.09; P=.001). For face-to-face CBT comparisons, OR (g=0.19; P=.09) and CSR (g=0.06; P=.51) did not differ significantly (Q=0.82; P=.37).
  • Secondary outcomes showed no significant OR versus CSR differences for depression or quality of life. iCBT versus waitlist control effects were g=0.61 for depressive symptoms and g=0.44 for quality of life.
  • In separate analyses, exclusion of severely depressed patients (Q=8.06; P=.005), treatment dose (slope=0.10; P=.003), and treatment adherence (slope=0.01; P<.001) were associated with effect size for waitlist comparators. In multivariate metaregression, recruitment type (slope=0.30; P=.14), treatment adherence (slope=0.01; P=.23), and exclusion of severely depressed patients (slope=0.13; P=.27) were no longer significant.

Methods

  • PRISMA-guided systematic review and meta-analysis; searched PubMed, PsycINFO, and EMBASE through December 2017 for RCTs of guided, unguided, or blended iCBT for adults with a primary anxiety disorder diagnosis by structured interview, compared with waitlist control or face-to-face CBT; excluded OCD and PTSD.
  • Included 42 trials with 53 comparisons (43 OR, 10 CSR) and 3714 participants; outcomes were anxiety symptoms, depressive symptoms, and quality of life.
  • Used random-effects Hedges g, subgroup/mixed-effects analyses, metaregression, Cochrane risk-of-bias assessment, and Egger/trim-and-fill publication-bias checks. OR trials recruited self-referred community participants; CSR trials recruited patients already seeking treatment in outpatient clinical practices.

Limitations

  • Stated by the authors: few trials had face-to-face CBT comparators, so null findings may be underpowered; clinical representativeness involves criteria beyond recruitment type; 3 trials used mixed recruitment, which may have reduced the OR-CSR difference; subgroup and metaregression results were observational and require direct comparisons.
  • Evident in the text: all included studies were rated high risk of bias for blinding of participants and personnel, and selective outcome reporting was low risk in only 4/33 OR trials and 2/9 CSR trials.
  • Evident in the text: heterogeneity was moderate for the primary waitlist-controlled anxiety analysis (I²=53%), which the authors note complicates interpretation of the pooled effect size.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.2196/11706

Cites

110 of 110 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Figures

Figure 1 Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) flowchart of the selection and inclusion process. RCT: randomized controlled trial.
Figure 1 Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) flowchart of the selection and inclusion process. RCT: randomized controlled trial.CC BY · PubMed Central
Figure 2 Forest plot of effects on anxiety symptoms of open recruitment trials and clinical service recruitment trials comparing internet-delivered cognitive behavioral therapy (iCBT) with waitlist control (WLC). GAD: generalized anxiety disorder; iCBGT: clinician-guided group iCBT; PD: panic disorder; SAD: social anxiety disorder.
Figure 2 Forest plot of effects on anxiety symptoms of open recruitment trials and clinical service recruitment trials comparing internet-delivered cognitive behavioral therapy (iCBT) with waitlist control (WLC). GAD: generalized anxiety disorder; iCBGT: clinician-guided group iCBT; PD: panic disorder; SAD: social anxiety disorder.CC BY · PubMed Central
Figure 3 Forest plot of effects on anxiety symptoms of open recruitment trials and clinical service recruitment trials comparing internet-delivered cognitive behavioral therapy (iCBT) with face-to-face cognitive behavioral therapy (CBT). PD: panic disorder; SAD: social anxiety disorder.
Figure 3 Forest plot of effects on anxiety symptoms of open recruitment trials and clinical service recruitment trials comparing internet-delivered cognitive behavioral therapy (iCBT) with face-to-face cognitive behavioral therapy (CBT). PD: panic disorder; SAD: social anxiety disorder.CC BY · PubMed Central

Verification

Claims the paper makes

5 Valid · 0 Not valid · 11 Not checked · 57 Own results and interpretations

43 more claims

Create a free account to see all 73 claims and to verify the 25 references still open.

See all claims — free account
  • It may state two separate claims as one. 16
  • Probably not a substantial claim. 13

Create a free account to see these claims.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

3 more claims about this paper

Create a free account to see every claim other papers make about this one.

See all claims — free account

Citations

Cites

Research works printed but not linked: 8

  1. Riper, H, 2013, Preventie & eMental-health. Onderzoek dat leidt, technologie die verleidt, preventie die bereikt en beklijft. Kennissynthese 2013 in opdracht van ZonMw
  2. Beck, AT, 1979, Cognitive Therapy of Depression
  3. Gallego, M, 2011, Int J Clin Heal Psychol, 11, 459
  4. Bruinsma, A, 2016, Tijdschr Psychiatr, 58, 361
  5. Cohen, J, 1988, Statistical Power Analysis for the Behavioral Sciences. 2nd edition
  6. Orsini, N, 2006, Heterogi: Stata Module to Quantify Heterogeneity in a Meta-Analysis
  7. Allison, Pd, 1999, Logistic Regression Using SAS: Theory And Application. 1st edition
  8. Weisz, J, 1995, J Consult Clin Psychol, 63, 688, 10.1037/0022-006x.63.5.688 · DOI · Paper page

Cited by

See all 52

Metadata

Authors
Romijn, G., Batelaan, N., Kok, R., Koning, J., van Balkom, A., Titov, N., & Riper, H.
Affiliations
  • Amsterdam Public Health (NL)
  • University of Southern Denmark (DK)
  • Pro Persona (NL)
  • Macquarie University (AU)
Corresponding author
Romijn, Geke
Venue
Journal of Medical Internet Research
Published
2019-04-17
Volume
21
Issue
4
Pages
e11706
ISSN
1438-8871 (ISSN-L)
OpenAlex
W2938191752
Cited by
52
References
113
Citations by year
2026: 1 · 2025: 7 · 2024: 4 · 2023: 4 · 2022: 8 · 2021: 12 · 2020: 13 · 2019: 3
FWCI
1.27
Type
journal article
Language
en
Open access
Licence
cc-by
Locations
  • Journal of Medical Internet Research (publishedVersion, cc-by)
  • Europe PMC (PubMed Central) (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • VU Research Portal (publishedVersion, other-oa)
  • University of Southern Denmark Research Portal (University of Southern Denmark) (publishedVersion, cc-by)
  • Pure Amsterdam UMC (submittedVersion, cc-by)
  • Data Archiving and Networked Services (DANS) (submittedVersion, other-oa)
Topics
  • Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
  • Social Sciences › Psychology › Experimental and Cognitive Psychology › Anxiety, Depression, Psychometrics, Treatment, Cognitive Processes
  • Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Telemedicine and Telehealth Implementation
Keywords
internet-based cognitive behavioral therapy, anxiety disorders, recruitment strategies, community-based recruitment, waitlist control, medication adherence, depressive symptoms, quality of life, usual care, effect size heterogeneity, moderators of treatment outcome, digital mental health interventions, primary care settings, generalizability of trial results
MeSH terms
Adult, Anxiety Disorders, Female, Humans, Male, Middle Aged, Quality of Life, Cognitive Behavioral Therapy, Treatment Outcome, Internet

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-10-05, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-05 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (qwen3.8-omni-flash).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.