Internet-Delivered Cognitive Behavioral Therapy for Anxiety Disorders in Open Community Versus Clinical Service Recruitment: Meta-Analysis
Open accessThe DOI matches its Crossref record; 110 of the 113 references it cites were found in a registry or an index; 9 of the 34 sources its claims cite were checked for support.
Abstract
BACKGROUND: Ample studies have shown the effectiveness of internet-delivered cognitive behavioral therapy (iCBT) for anxiety disorders. These studies recruited their participants mainly from the community and, to a lesser extent, from within routine care services. Little is known about whether different recruitment strategies lead to different treatment effects. OBJECTIVE: This meta-analysis compared clinical results obtained in trials with recruitment from the community versus results obtained in trials with clinical service recruitment and explored factors that may mediate differences in treatment outcome. METHODS: We included randomized controlled trials in which the clinical effects of iCBT for anxiety disorders were compared with a control condition (waitlist controls or face-to-face cognitive behavioral therapy). We classified trials as open recruitment trials (recruitment from the community) or clinical service recruitment trials (recruitment through outpatient clinics). Pooled effect sizes based on measures examining anxiety symptoms, depressive symptoms, and quality of life were computed for each type of trial. Subgroup analyses examined whether clinical results from open recruitment trials differed from those obtained in clinical service recruitment trials. Additional analyses explored which demographic, clinical, and treatment-related factors contributed to differences in effect sizes of open recruitment versus clinical service recruitment trials. RESULTS: We included 42 studies with 53 comparisons (43 open recruitment comparisons and 10 clinical recruitment comparisons). Analyses of anxiety measures revealed, first, that iCBT open recruitment studies with waitlist control comparators showed a significantly higher effect size for decrease in anxiety symptoms than did those with clinical recruitment (Q=10.09; P=.001). This association between recruitment method and effect size was no longer significant in a multivariate metaregression with treatment adherence and exclusion of patients with depressive symptoms entered as additional predictors of effect size. Second, effect size for decrease in anxiety symptoms did not differ significantly between clinical recruitment and open recruitment studies with face-to-face cognitive behavioral therapy comparators. The effects of open recruitment trials and clinical recruitment trials did not differ significantly for the secondary outcomes, compared with face-to-face cognitive behavioral therapy and waitlist controls. CONCLUSIONS: iCBT was effective in samples recruited in clinical practice, but effect sizes were smaller than those found in trials with an open recruitment method for studies with waitlist control comparators. Hence, for patients with anxiety disorders in routine care, the impact of iCBT may not be as positive as for study participants recruited from the community. The difference between open recruitment trials and clinical service recruitment trials might be partly explained by patients' greater therapy adherence in open recruitment trials and the stricter exclusion of patients with severe depressive symptoms in these studies. Since most trials in this meta-analysis applied an open recruitment method, more studies with routine care populations are needed to further validate these findings.
Overview
CoChat Summary
TL;DR
This meta-analysis of 42 RCTs (53 comparisons, 3714 participants) found internet-delivered CBT (iCBT) for anxiety disorders was effective versus waitlist control, but effect sizes were smaller in clinical service recruitment (CSR) trials than open recruitment (OR) trials for waitlist comparisons. The recruitment-method difference was no longer significant in multivariate metaregression with treatment adherence and exclusion of severely depressed patients entered as predictors.
Key findings
- Overall iCBT versus waitlist control reduced anxiety symptoms with g=0.72 (95% CI 0.60-0.83; P<.001; I²=53%; NNT=3). iCBT versus face-to-face CBT showed a nonsignificant difference, g=0.12 (95% CI –0.02 to 0.26; P=.11; NNT=15).
- For waitlist-controlled studies, OR trials had a large effect on anxiety (g=0.79; P<.001) while CSR trials had a small effect (g=0.28; P=.003); the between-group difference was significant (Q=10.09; P=.001). For face-to-face CBT comparisons, OR (g=0.19; P=.09) and CSR (g=0.06; P=.51) did not differ significantly (Q=0.82; P=.37).
- Secondary outcomes showed no significant OR versus CSR differences for depression or quality of life. iCBT versus waitlist control effects were g=0.61 for depressive symptoms and g=0.44 for quality of life.
- In separate analyses, exclusion of severely depressed patients (Q=8.06; P=.005), treatment dose (slope=0.10; P=.003), and treatment adherence (slope=0.01; P<.001) were associated with effect size for waitlist comparators. In multivariate metaregression, recruitment type (slope=0.30; P=.14), treatment adherence (slope=0.01; P=.23), and exclusion of severely depressed patients (slope=0.13; P=.27) were no longer significant.
Methods
- PRISMA-guided systematic review and meta-analysis; searched PubMed, PsycINFO, and EMBASE through December 2017 for RCTs of guided, unguided, or blended iCBT for adults with a primary anxiety disorder diagnosis by structured interview, compared with waitlist control or face-to-face CBT; excluded OCD and PTSD.
- Included 42 trials with 53 comparisons (43 OR, 10 CSR) and 3714 participants; outcomes were anxiety symptoms, depressive symptoms, and quality of life.
- Used random-effects Hedges g, subgroup/mixed-effects analyses, metaregression, Cochrane risk-of-bias assessment, and Egger/trim-and-fill publication-bias checks. OR trials recruited self-referred community participants; CSR trials recruited patients already seeking treatment in outpatient clinical practices.
Limitations
- Stated by the authors: few trials had face-to-face CBT comparators, so null findings may be underpowered; clinical representativeness involves criteria beyond recruitment type; 3 trials used mixed recruitment, which may have reduced the OR-CSR difference; subgroup and metaregression results were observational and require direct comparisons.
- Evident in the text: all included studies were rated high risk of bias for blinding of participants and personnel, and selective outcome reporting was low risk in only 4/33 OR trials and 2/9 CSR trials.
- Evident in the text: heterogeneity was moderate for the primary waitlist-controlled anxiety analysis (I²=53%), which the authors note complicates interpretation of the pooled effect size.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures



Verification
Claims the paper makes
5 Valid · 0 Not valid · 11 Not checked · 57 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Often these studies apply strict inclusion and exclusion criteria; for example, they may exclude patients taking psychoactive medication, patients with comorbid disorders, or severely depressed patients [8,9].”
§ Internet-Delivered Cognitive Behavioral Therapy for Anxiety Disorders in Open Community Versus Clinical Service Recruitment: Meta-Analysis > Introduction > Background
What the sources say
- Not checked yetcites [8] Westen, D, 2001, J Consult Clin Psychol source
- Partly supportedcites [9] sourceExperimental — accuracy not yet measured
Stewart & Chambless (2009) support only part of the attributed content: the Introduction (Abstract section, p. 1) states that in research settings 'patients with comorbid disorders are often excluded to achieve homogeneous diagnostic samples' (a characterisation it credits to Westen & Morrison, 2001), and the Method (Studies) section treats 'allowance of medication' and 'clinically representative patients (i.e., no exclusion criteria aside from psychosis, suicidality, organic brain disease, or substance abuse)' as markers separating effectiveness from efficacy studies — which implies, but does not state, that medication-taking patients are excluded. Nothing in our copy says that severely depressed patients are excluded; the paper speaks only of practice patients being 'purported to be more severe'. Also, the selection argument in this source concerns randomized efficacy/RCT samples, not open-recruitment trials as the citing sentence frames it. (LLM, conf=0.72)
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Only a minority of the patient samples in trials with an OR method correspond to patient populations in a regular clinical setting in terms of sociodemographic characteristics, motivation for treatment, level of suffering, and clinical characteristics such as severity of anxiety, comorbidity, or medical history [11-13].”
§ Internet-Delivered Cognitive Behavioral Therapy for Anxiety Disorders in Open Community Versus Clinical Service Recruitment: Meta-Analysis > Introduction > Background
What the sources say
- Partly supportedcites [11] Persons, JB, 1998, J Consult Clin Psychol sourceExperimental — accuracy not yet measured
Silberschatz's section 'Results of RCTs Are Useless to Clinicians' (and his Rebuttal) states the core of the claim: RCTs lack external/ecological validity, 'RCTs do not focus on the types of patients seen in practice', research subjects 'differ markedly from psychotherapy patients', and because single-diagnosis, homogeneous samples are required, 'the type of patient most likely to be screened out of the RCT is the patient seen by the typical practicing therapist' — i.e., comorbidity/multiple problems and general level of functioning are covered. However, our copy nowhere gives the quantified 'only a minority' figure, and it does not address the other enumerated dimensions the claim attributes to this source: sociodemographic characteristics, motivation for treatment, level of suffering, severity of anxiety, or medical history (the closest is Seligman's five properties of practice, which concern treatment duration, self-correction, therapist choice, multiple problems, and general functioning — not patient demographics or morbidity). Persons' rebuttal likewise concedes only that RCT samples are homogeneous and thus 'not easily generalized'. (LLM, conf=0.72)
- Not checked yetcites [12] source
- Partly supportedcites [13] sourceExperimental — accuracy not yet measured
The only passage addressing the claim's point is the Abstract Background, which hedges: people seeking Internet treatment 'may not resemble the general population or have less severe disorders than patients attending outpatient clinics', so 'the response to treatment in Internet based trials might not generalize'. That is a concern about generalization, not a finding that 'only a minority' of trial samples fail to match regular clinical settings; the paper studies no trials at all, comparing one Internet clinic (n=774), one specialist outpatient clinic (n=454) and a national survey (n=627) on demographics and symptom severity only (Abstract Methodology; Measurements). Nothing in our copy supports the claim's specific elements of motivation for treatment, comorbidity, or medical history, and the paper's own results run the other way for severity and demographics (Abstract Principal Findings/Conclusions; Discussion Conclusions: Internet sample as severe as the outpatient clinic, demographics more consistent with the national sample, 'benefits of Internet treatment could apply to the wider population'). (LLM, conf=0.65)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“A meta-analysis [14] found a strong and positive relationship (r=.70) between the number of exclusion criteria and the rate of clinically improved participants for studies on iCBT for anxiety disorders.”
§ Internet-Delivered Cognitive Behavioral Therapy for Anxiety Disorders in Open Community Versus Clinical Service Recruitment: Meta-Analysis > Introduction > Background
What the sources say
- Supportedcites [14] source
The Abstract (Results section of the abstract) states 'a large relationship between number of exclusion criteria and proportion clinically changed in the treatment group for anxiety studies (r = 0.70)', and the Results (Correlation Analyses) describe 'the strong, positive correlation found between the number of exclusion criteria and the proportion clinically changed... for anxiety studies'; the Discussion ('Exclusion and Outcome') repeats that the number of exclusion criteria 'was strongly and positively correlated with the proportion of cCBT participants experiencing clinically significant change for anxiety studies.' Magnitude, direction, both variables and the anxiety-studies subset all match. Two minor caveats the citing sentence drops: the source labels the intervention cCBT (computerized CBT, a superset of iCBT, its anxiety subset being largely internet-delivered trials) and flags the correlation as preliminary given only 23 anxiety studies, but neither changes what is attributed to it. (LLM, conf=0.85)
boostedstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“The difference in overall effect size for the decrease in anxiety symptoms between iCBT and face-to-face CBT at posttest was nonsignificant (g=0.12, 95% CI –0.02 to 0.26; P=.11; I²=0%, 95% CI 0-75; NNT=15).”
- Also stated in: § Background · hedged
“Studies also suggest that it is as effective as face-to-face cognitive behavioral therapy (CBT) in improving symptoms of anxiety [1-5], although these studies are limited in number.”
§ Internet-Delivered Cognitive Behavioral Therapy for Anxiety Disorders in Open Community Versus Clinical Service Recruitment: Meta-Analysis > Results > Overall Effect
What the sources say
- Partly supportedcites [1] sourceExperimental — accuracy not yet measured
Our copy supports the qualitative core: comparison 3.2 (Reduction in disorder-specific anxiety symptom severity) reports a non-significant SMD of 0.06 (95% CI -0.25 to 0.37) for therapist-supported ICBT versus face-to-face CBT at post-treatment (seven studies, 228 vs 222 participants), and 3.3 (general anxiety) reports SMD 0.06 (95% CI -0.42 to 0.55); the Discussion ('Summary of main results') likewise states no significant differences versus face-to-face group and individual CBT. However, none of the specific statistics attributed to this source — g = 0.12, 95% CI -0.02 to 0.26, P = .11, I² = 0%, NNT = 15 — appear anywhere in our copy (searched for these values, NNT/number needed to treat, and the face-to-face comparisons); the review instead reports substantial heterogeneity (I² = 60% and 78%) at post-treatment, not I² = 0%. So the direction of the finding is supported while the effect size, CI, p-value, heterogeneity and NNT are not this review's numbers. (LLM, conf=0.78)
- Not checked yetcites [2] source
- Not checked yetcites [3] source
- Not checked yetcites [4] source
- Not checked yetcites [5] source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § Background · hedged
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Baseline Beck Anxiety Inventory score, mean (SD) | Baseline Beck Anxiety Inventory score, mean (SD) | 25.4 (11.8) | 29.0 (11.1) | t1208=–6.2 | <.001”
§ Internet-Delivered Cognitive Behavioral Therapy for Anxiety Disorders in Open Community Versus Clinical Service Recruitment: Meta-Analysis > Results > Description of Included Studies
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
43 more claims
Create a free account to see all 73 claims and to verify the 25 references still open.
- It may state two separate claims as one. 16
- Probably not a substantial claim. 13
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“In addition, participants in our study appear to be a clinically representative sample, in view of the large proportion of patients with comorbid disorders, lower education levels and severe anxiety symptoms at baseline, in comparison with self-referred samples recruited from the community [12].”
From Acceptability, effectiveness and cost-effectiveness of blended cognitive-behavioural therapy (bCBT) versus face-to-face CBT (ftfCBT) for anxiety disorders in specialised mental health care: A 15-week randomised controlled trial with 1-year follow-up (2021) · cites this paper as [12]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“There is strong evidence supporting internet-delivered cognitive behaviour therapy (iCBT) and consequently growing demand for iCBT in Canada.”
The cited source says what the claim attributes to it.
In the citing paper
“while a small effect size (g = 0.28) was found in the same comparison in routine care populations.”
The cited source says what the claim attributes to it.
In the citing paper
“in a recent meta-analysis [12], a large effect size (g = 0.79) was found for anxiety symptom reduction by iCBT as compared with waitlisted controls in samples recruited from the community”
The cited source says what the claim attributes to it.
In the citing paper
“iCBT has been found effective for several anxiety disorders [10–13], and there are indications for its cost-effectiveness [14].”
3 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: the PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & for the PRISMA Group (2009) · BMJ · doi:10.1136/bmj.b2535 · Cited by 83,823
Measuring inconsistency in meta-analyses
Higgins, J. P. T., Thompson, S. G., Deeks, J. J., & Altman, D. G. (2003) · BMJ · doi:10.1136/bmj.327.7414.557 · Cited by 63,139
Bias in meta-analysis detected by a simple, graphical test
Egger, M., Smith, G. D., Schneider, M., & Minder, C. (1997) · BMJ · doi:10.1136/bmj.315.7109.629 · Cited by 56,722
The CES-D Scale: A Self-Report Depression Scale for Research in the General Population
Radloff, L. S. (1977) · Applied Psychological Measurement · doi:10.1177/014662167700100306 · Cited by 53,267
The PHQ-9: Validity of a brief depression severity measure
Kroenke, K., Spitzer, R. L., & Williams, J. B. W. (2001) · Journal of General Internal Medicine · doi:10.1046/j.1525-1497.2001.016009606.x · Cited by 44,910
An inventory for measuring depression
BECK, A. T. (1961) · Archives of General Psychiatry · doi:10.1001/archpsyc.1961.01710120031004 · Cited by 38,032
Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & the PRISMA Group* (2009) · Annals of Internal Medicine · doi:10.7326/0003-4819-151-4-200908180-00135 · Cited by 37,554
A Brief Measure for Assessing Generalized Anxiety Disorder: The GAD-7
Spitzer, R. L., Kroenke, K., Williams, J. B. W., & Löwe, B. (2006) · Archives of Internal Medicine · doi:10.1001/archinte.166.10.1092 · Cited by 31,765
Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series
(2008) · doi:10.1002/9780470712184 · Cited by 25,048
(1970) · Cited by 24,983
WARE, J. E., KOSINSKI, M., & KELLER, S. D. (1996) · Medical Care · doi:10.1097/00005650-199603000-00003 · Cited by 17,392 · cited 1×
“Since anxiety disorders are frequently accompanied by symptoms of depression and a reduced quality of life [86], secondary outcome measures were effects on depression severity and on quality of life (see Multimedia Appendix 2 for the order of rating scales [36,87-94]).”
BackgroundEuroQol: a new facility for the measurement of health-related quality of life
(1990) · Health Policy · doi:10.1016/0168-8510(90)90421-9 · Cited by 15,736
An inventory for measuring clinical anxiety: Psychometric properties.
Beck, A. T., Epstein, N., Brown, G., & Steer, R. A. (1988) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.56.6.893 · Cited by 14,407
Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2009) · doi:10.1002/9780470743386 · Cited by 14,225
Depression and quality of life in older persons: A review
Sivertsen, H., Bjørkløf, G. H., Engedal, K., Selbæk, G., & Helvik, A.-S. (2015) · Dementia and Geriatric Cognitive Disorders · doi:10.1159/000437299 · Cited by 14,152
Duval, S., & Tweedie, R. (2000) · Biometrics · doi:10.1111/j.0006-341x.2000.00455.x · Cited by 14,099 · cited 1×
“We tested publication bias by inspecting the funnel plot and Egger test [102] on our primary outcome measure and by the Duval and Tweedie trim-and-fill procedure [103].”
MethodDevelopment of the World Health Organization WHOQOL-BREF Quality of Life Assessment
THE WHOQOL GROUP (1998) · Psychological Medicine · doi:10.1017/s0033291798006667 · Cited by 7,933
Scoville, W. B. (1949) · Journal of neurosurgery · doi:10.3171/jns.1949.6.1.0065 · Cited by 7,380
(1995) · Cited by 6,909
Development and validation of the Penn State Worry Questionnaire
Meyer, T. J., Miller, M. L., Metzger, R. L., & Borkovec, T. D. (1990) · Behaviour Research and Therapy · doi:10.1016/0005-7967(90)90135-6 · Cited by 5,099 · cited 1×
“When a general measure of anxiety was not available, we used a measure for specific anxiety symptoms (see Multimedia Appendix 2 [39-49] for the order of rating scales and Multimedia Appendix 3 [7,27-31,50-85] for the outcome measures we used for all studies).”
MethodCognitive Therapy in Depression
Kovacs, M. (1980) · Journal of the American Academy of Psychoanalysis · doi:10.1521/jaap.1.1980.8.1.127 · Cited by 3,402
Mattick, R. P., & Clarke, J. C. (1998) · Behaviour Research and Therapy · doi:10.1016/s0005-7967(97)10031-6 · Cited by 3,367
Liebowitz, M. R. (2015) · Modern Trends in Pharmacopsychiatry · doi:10.1159/000414022 · Cited by 2,266
A brief version of the Fear of Negative Evaluation Scale
Leary, M. R. (1983) · Personality and Social Psychology Bulletin · doi:10.1177/0146167283093007 · Cited by 2,178 · cited 1×
“When a general measure of anxiety was not available, we used a measure for specific anxiety symptoms (see Multimedia Appendix 2 [39-49] for the order of rating scales and Multimedia Appendix 3 [7,27-31,50-85] for the outcome measures we used for all studies).”
MethodBasics of meta‐analysis: I 2 is not an absolute measure of heterogeneity
Borenstein, M., Higgins, J. P. T., Hedges, L. V., & Rothstein, H. R. (2017) · Research Synthesis Methods · doi:10.1002/jrsm.1230 · Cited by 1,848 · cited 1×
“This makes interpreting the pooled effect size difficult, as it is hard to distinguish the observed effect size from the true population effect size [99].”
BackgroundChambless, D. L., Caputo, G. C., Bright, P., & Gallagher, R. (1984) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.52.6.1090 · Cited by 1,247
Frisch, M. B., Cornell, J., Villanueva, M., & Retzlaff, P. J. (1992) · Psychological Assessment · doi:10.1037/1040-3590.4.1.92 · Cited by 1,075 · cited 1×
“Since anxiety disorders are frequently accompanied by symptoms of depression and a reduced quality of life [86], secondary outcome measures were effects on depression severity and on quality of life (see Multimedia Appendix 2 for the order of rating scales [36,87-94]).”
BackgroundMulticenter Collaborative Panic Disorder Severity Scale
Shear, M. K., Brown, T. A., Barlow, D. H., Money, R., Sholomskas, D. E., Woods, S. W., Gorman, J. M., & Papp, L. A. (1997) · American Journal of Psychiatry · doi:10.1176/ajp.154.11.1571 · Cited by 1,001 · cited 1×
“When a general measure of anxiety was not available, we used a measure for specific anxiety symptoms (see Multimedia Appendix 2 [39-49] for the order of rating scales and Multimedia Appendix 3 [7,27-31,50-85] for the outcome measures we used for all studies).”
MethodPsychometric properties of the Liebowitz Social Anxiety Scale
HEIMBERG, R. G., HORNER, K. J., JUSTER, H. R., SAFREN, S. A., BROWN, E. J., SCHNEIER, F. R., & LIEBOWITZ, M. R. (1999) · Psychological Medicine · doi:10.1017/s0033291798007879 · Cited by 968 · cited 1×
“When a general measure of anxiety was not available, we used a measure for specific anxiety symptoms (see Multimedia Appendix 2 [39-49] for the order of rating scales and Multimedia Appendix 3 [7,27-31,50-85] for the outcome measures we used for all studies).”
MethodSize of Treatment Effects and Their Importance to Clinical Research and Practice
Kraemer, H. C., & Kupfer, D. J. (2006) · Biological Psychiatry · doi:10.1016/j.biopsych.2005.09.014 · Cited by 850
Svanborg, P., & Åsberg, M. (1994) · Acta Psychiatrica Scandinavica · doi:10.1111/j.1600-0447.1994.tb01480.x · Cited by 693 · cited 1×
“Since anxiety disorders are frequently accompanied by symptoms of depression and a reduced quality of life [86], secondary outcome measures were effects on depression severity and on quality of life (see Multimedia Appendix 2 for the order of rating scales [36,87-94]).”
BackgroundWesten, D., & Morrison, K. (2001) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.69.6.875 · Cited by 635 · cited 1×
“Often these studies apply strict inclusion and exclusion criteria; for example, they may exclude patients taking psychoactive medication, patients with comorbid disorders, or severely depressed patients [8,9].”
BackgroundBridging the gap between laboratory and clinic in child and adolescent psychotherapy.
Weisz, J. R., Donenberg, G. R., Han, S. S., & Weiss, B. (1995) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.63.5.688 · Cited by 607
Weslen, D., & Morrison, K. (2002) · PsycEXTRA Dataset · doi:10.1037/e323162004-001 · Cited by 509
Stewart, R. E., & Chambless, D. L. (2009) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0016032 · Cited by 483 · cited 3×
“The difference in results we found between OR and CSR trials for studies with WLC comparators is in line with a previous meta-analysis on effectiveness of face-to-face CBT for anxiety disorders by Stewart and Chambless [9].”
BackgroundResultComputer‐Aided Psychotherapy for Anxiety Disorders: A Meta‐Analytic Review
Cuijpers, P., Marks, I. M., van Straten, A., Cavanagh, K., Gega, L., & Andersson, G. (2009) · Cognitive Behaviour Therapy · doi:10.1080/16506070802694776 · Cited by 429 · cited 3×
“Furthermore, we checked reference lists of retrieved articles and of earlier reviews on iCBT for anxiety disorders [1-4].”
BackgroundMethodResultTherapist-supported Internet cognitive behavioural therapy for anxiety disorders in adults
Olthuis, J. V., Watt, M. C., Bailey, K., Hayden, J. A., & Stewart, S. H. (2016) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd011565.pub2 · Cited by 390 · cited 3×
“Furthermore, we checked reference lists of retrieved articles and of earlier reviews on iCBT for anxiety disorders [1-4].”
BackgroundMethodResultAndersson, G., Carlbring, P., Holmström, A., Sparthan, E., Furmark, T., Nilsson-Ihrfelt, E., Buhrman, M., & Ekselius, L. (2006) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.74.4.677 · Cited by 382
Treatment of panic disorder: live therapy vs. self-help via the Internet
Carlbring, P., Nilsson-Ihrfelt, E., Waara, J., Kollenstam, C., Buhrman, M., Kaldo, V., Söderberg, M., Ekselius, L., & Andersson, G. (2005) · Behaviour Research and Therapy · doi:10.1016/j.brat.2004.10.002 · Cited by 372 · cited 1×
“When a general measure of anxiety was not available, we used a measure for specific anxiety symptoms (see Multimedia Appendix 2 [39-49] for the order of rating scales and Multimedia Appendix 3 [7,27-31,50-85] for the outcome measures we used for all studies).”
MethodSocial phobia in the general population: prevalence and sociodemographic profile
Furmark, T., Tillfors, M., Everz, P.-O., Marteinsdottir, I., Gefvert, O., & Fredrikson, M. (1999) · Social Psychiatry and Psychiatric Epidemiology · doi:10.1007/s001270050163 · Cited by 358
Bandelow, B. (1995) · International Clinical Psychopharmacology · doi:10.1097/00004850-199506000-00003 · Cited by 314
Carlbring, P., Gunnarsdóttir, M., Hedensjö, L., Andersson, G., Ekselius, L., & Furmark, T. (2007) · British Journal of Psychiatry · doi:10.1192/bjp.bp.105.020107 · Cited by 293
Is internet-based CBT for panic disorder and agoraphobia as effective as face-to-face CBT?
Kiropoulos, L. A., Klein, B., Austin, D. W., Gilson, K., Pier, C., Mitchell, J., & Ciechomski, L. (2008) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2008.01.008 · Cited by 290 · cited 1×
“When a general measure of anxiety was not available, we used a measure for specific anxiety symptoms (see Multimedia Appendix 2 [39-49] for the order of rating scales and Multimedia Appendix 3 [7,27-31,50-85] for the outcome measures we used for all studies).”
MethodClinician-Assisted Internet-Based Treatment is Effective for Panic: A Randomized Controlled Trial
Wims, E., Titov, N., Andrews, G., & Choi, I. (2010) · Australian & New Zealand Journal of Psychiatry · doi:10.3109/00048671003614171 · Cited by 290 · cited 1×
“When a general measure of anxiety was not available, we used a measure for specific anxiety symptoms (see Multimedia Appendix 2 [39-49] for the order of rating scales and Multimedia Appendix 3 [7,27-31,50-85] for the outcome measures we used for all studies).”
MethodSelf-citationStatistical Methods in Meta-Analysis
Petitti, D. B. (1999) · Meta-Analysis, Decision Analysis, and Cost-Effectiveness Analysis · doi:10.1093/acprof:oso/9780195133646.003.07 · Cited by 287
Hedman, E., Andersson, G., Ljótsson, B., Andersson, E., Rück, C., Mörtberg, E., & Lindefors, N. (2011) · PLoS ONE · doi:10.1371/journal.pone.0018001 · Cited by 285
Transdiagnostic internet treatment for anxiety and depression: a randomised controlled trial
Titov, N., Dear, B. F., Schwencke, G., Andrews, G., Johnston, L., Craske, M. G., & McEvoy, P. (2011) · Behaviour Research and Therapy · doi:10.1016/j.brat.2011.03.007 · Cited by 285 · cited 2×
“When a general measure of anxiety was not available, we used a measure for specific anxiety symptoms (see Multimedia Appendix 2 [39-49] for the order of rating scales and Multimedia Appendix 3 [7,27-31,50-85] for the outcome measures we used for all studies).”
MethodSelf-citationRobinson, E., Titov, N., Andrews, G., McIntyre, K., Schwencke, G., & Solley, K. (2010) · PLoS ONE · doi:10.1371/journal.pone.0010942 · Cited by 277
Self-citationCarlbring, P., Bohman, S., Brunt, S., Buhrman, M., Westling, B. E., Ekselius, L., & Andersson, G. (2006) · American Journal of Psychiatry · doi:10.1176/ajp.2006.163.12.2119 · Cited by 262 · cited 1×
“When a general measure of anxiety was not available, we used a measure for specific anxiety symptoms (see Multimedia Appendix 2 [39-49] for the order of rating scales and Multimedia Appendix 3 [7,27-31,50-85] for the outcome measures we used for all studies).”
MethodTreatment of panic disorder via the internet: A randomized trial of a self-help program
Carlbring, P., Westling, B. E., Ljungstrand, P., Ekselius, L., & Andersson, G. (2001) · Behavior Therapy · doi:10.1016/s0005-7894(01)80019-8 · Cited by 262 · cited 1×
“When a general measure of anxiety was not available, we used a measure for specific anxiety symptoms (see Multimedia Appendix 2 [39-49] for the order of rating scales and Multimedia Appendix 3 [7,27-31,50-85] for the outcome measures we used for all studies).”
MethodGuided and unguided self-help for social anxiety disorder: randomised controlled trial
Furmark, T., Carlbring, P., Hedman, E., Sonnenstein, A., Clevberger, P., Bohman, B., Eriksson, A., Hållén, A., Frykman, M., Holmström, A., et al. (2009) · British Journal of Psychiatry · doi:10.1192/bjp.bp.108.060996 · Cited by 256 · cited 1×
“When a general measure of anxiety was not available, we used a measure for specific anxiety symptoms (see Multimedia Appendix 2 [39-49] for the order of rating scales and Multimedia Appendix 3 [7,27-31,50-85] for the outcome measures we used for all studies).”
MethodCitrome, L., & Ketter, T. A. (2013) · International Journal of Clinical Practice · doi:10.1111/ijcp.12142 · Cited by 250
Efficacy of internet therapy for panic disorder
Klein, B., Richards, J. C., & Austin, D. W. (2006) · Journal of Behavior Therapy and Experimental Psychiatry · doi:10.1016/j.jbtep.2005.07.001 · Cited by 236 · cited 1×
“When a general measure of anxiety was not available, we used a measure for specific anxiety symptoms (see Multimedia Appendix 2 [39-49] for the order of rating scales and Multimedia Appendix 3 [7,27-31,50-85] for the outcome measures we used for all studies).”
MethodReger, M. A., & Gahm, G. A. (2009) · Journal of Clinical Psychology · doi:10.1002/jclp.20536 · Cited by 234 · cited 3×
“Furthermore, we checked reference lists of retrieved articles and of earlier reviews on iCBT for anxiety disorders [1-4].”
BackgroundMethodResultAre results of randomized controlled trials useful to psychotherapists?
Persons, J. B., & Silberschatz, G. (1998) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.66.1.126 · Cited by 233 · cited 2×
“Only a minority of the patient samples in trials with an OR method correspond to patient populations in a regular clinical setting in terms of sociodemographic characteristics, motivation for treatment, level of suffering, and clinical characteristics such as severity of anxiety, comorbidity, or medical history [11-13…”
MethodDear, B. F., Staples, L. G., Terides, M. D., Karin, E., Zou, J., Johnston, L., Gandy, M., Fogliati, V. J., Wootton, B. M., McEvoy, P. M., et al. (2015) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2015.09.003 · Cited by 230
Self-citationIndividually-tailored, internet-based treatment for anxiety disorders: a randomized controlled trial
Carlbring, P., Maurin, L., Törngren, C., Linna, E., Eriksson, T., Sparthan, E., Strååt, M., Marquez von Hage, C., Bergman-Nordgren, L., & Andersson, G. (2011) · Behaviour Research and Therapy · doi:10.1016/j.brat.2010.10.002 · Cited by 227
MARKS, I. M., KENWRIGHT, M., McDONOUGH, M., WHITTAKER, M., & MATAIX-COLS, D. (2004) · Psychological Medicine · doi:10.1017/s003329170300878x · Cited by 226 · cited 3×
“8% [31] and n=70, 77% [53]) and therefore we classified these studies as OR trials.”
BackgroundMethodTitov, N., Dear, B. F., Staples, L. G., Terides, M. D., Karin, E., Sheehan, J., Johnston, L., Gandy, M., Fogliati, V. J., Wootton, B. M., et al. (2015) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2015.08.002 · Cited by 223
Self-citationTitov, N., Andrews, G., Choi, I., Schwencke, G., & Mahoney, A. (2008) · Australian & New Zealand Journal of Psychiatry · doi:10.1080/00048670802512107 · Cited by 221 · cited 1×
“When a general measure of anxiety was not available, we used a measure for specific anxiety symptoms (see Multimedia Appendix 2 [39-49] for the order of rating scales and Multimedia Appendix 3 [7,27-31,50-85] for the outcome measures we used for all studies).”
MethodSelf-citationBergström, J., Andersson, G., Ljótsson, B., Rück, C., Andréewitch, S., Karlsson, A., Carlbring, P., Andersson, E., & Lindefors, N. (2010) · BMC Psychiatry · doi:10.1186/1471-244x-10-54 · Cited by 202 · cited 5×
“When a general measure of anxiety was not available, we used a measure for specific anxiety symptoms (see Multimedia Appendix 2 [39-49] for the order of rating scales and Multimedia Appendix 3 [7,27-31,50-85] for the outcome measures we used for all studies).”
BackgroundMethodInfluentialInternet-based treatment for social phobia: A randomized controlled trial
Berger, T., Hohl, E., & Caspar, F. (2009) · Journal of Clinical Psychology · doi:10.1002/jclp.20603 · Cited by 198 · cited 1×
“When a general measure of anxiety was not available, we used a measure for specific anxiety symptoms (see Multimedia Appendix 2 [39-49] for the order of rating scales and Multimedia Appendix 3 [7,27-31,50-85] for the outcome measures we used for all studies).”
MethodTransdiagnostic Internet treatment for anxiety disorders: A randomized controlled trial
Titov, N., Andrews, G., Johnston, L., Robinson, E., & Spence, J. (2010) · Behaviour Research and Therapy · doi:10.1016/j.brat.2010.05.014 · Cited by 196
Self-citationEvidence that therapy works in clincally representative conditions.
Shadish, W. R., Matt, G. E., Navarro, A. M., Siegle, G., Crits-Christoph, P., Hazelrigg, M. D., Jorm, A. F., Lyons, L. C., Nietzel, M. T., Robinson, L., et al. (1997) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.65.3.355 · Cited by 186
Andersson, G., Paxling, B., Roch-Norlund, P., Östman, G., Norgren, A., Almlöv, J., Georén, L., Breitholtz, E., Dahlin, M., Cuijpers, P., et al. (2012) · Psychotherapy and Psychosomatics · doi:10.1159/000339371 · Cited by 183
Titov, N., Dear, B. F., Staples, L. G., Bennett-Levy, J., Klein, B., Rapee, R. M., Andersson, G., Purtell, C., Bezuidenhout, G., & Nielssen, O. B. (2017) · Australian & New Zealand Journal of Psychiatry · doi:10.1177/0004867416671598 · Cited by 183 · cited 1×
“On the other hand, uncontrolled effectiveness studies show large clinical effects [15-20], thereby suggesting that iCBT for anxiety disorders may be as effective in routine care settings as demonstrated in efficacy trials.”
BackgroundSelf-citationAnxiety sensitivity: multiple dimensions and hierarchic structure
Taylor, S., & Cox, B. J. (1998) · Behaviour Research and Therapy · doi:10.1016/s0005-7967(97)00071-5 · Cited by 181
Shyness 1: Distance Treatment of Social Phobia Over the Internet
Titov, N., Andrews, G., Schwencke, G., Drobny, J., & Einstein, D. (2008) · Australian & New Zealand Journal of Psychiatry · doi:10.1080/00048670802119762 · Cited by 180
Self-citationThe Effectiveness of Online Cognitive Behavioral Treatment in Routine Clinical Practice
Ruwaard, J., Lange, A., Schrieken, B., Dolan, C. V., & Emmelkamp, P. (2012) · PLoS ONE · doi:10.1371/journal.pone.0040089 · Cited by 173
An internet-based self-help treatment for fear of public speaking: a controlled trial.
Botella, C., Gallego, M. J., Garcia-Palacios, A., Guillen, V., Baños, R. M., Quero, S., & Alcañiz, M. (2010) · Cyberpsychology, Behavior, and Social Networking · doi:10.1089/cyber.2009.0224 · Cited by 169 · cited 1×
“When a general measure of anxiety was not available, we used a measure for specific anxiety symptoms (see Multimedia Appendix 2 [39-49] for the order of rating scales and Multimedia Appendix 3 [7,27-31,50-85] for the outcome measures we used for all studies).”
MethodA BRIEF INTERNET-BASED TREATMENT FOR PANIC DISORDER
Klein, B., & Richards, J. C. (2001) · Behavioural and Cognitive Psychotherapy · doi:10.1017/s1352465801001138 · Cited by 168 · cited 1×
“We did not include 1 study because means and standard deviations for anxiety measures were not reported [107] and we received no response from the addressed researchers to our email questions regarding these issues.”
BackgroundAndersson, G., Carlbring, P., Furmark, T., & on behalf of the S. O. F. I. E. Research Group (2012) · PLoS ONE · doi:10.1371/journal.pone.0037411 · Cited by 166
Effectiveness of Guided Internet-Based Cognitive Behavior Therapy in Regular Clinical Settings
Andersson, G., & Hedman, E. (2013) · Verhaltenstherapie · doi:10.1159/000354779 · Cited by 165 · cited 2×
“Our findings are partly in keeping with Andersson and Hedman’s review on the effectiveness of iCBT for anxiety [21].”
BackgroundResultBerger, T., Boettcher, J., & Caspar, F. (2014) · Psychotherapy · doi:10.1037/a0032527 · Cited by 158
Andrews, G., Davies, M., & Titov, N. (2011) · Australian & New Zealand Journal of Psychiatry · doi:10.3109/00048674.2010.538840 · Cited by 152
Self-citationJohnston, L., Titov, N., Andrews, G., Spence, J., & Dear, B. F. (2011) · PLoS ONE · doi:10.1371/journal.pone.0028079 · Cited by 150
Self-citationPaxling, B., Almlöv, J., Dahlin, M., Carlbring, P., Breitholtz, E., Eriksson, T., & Andersson, G. (2011) · Cognitive Behaviour Therapy · doi:10.1080/16506073.2011.576699 · Cited by 147 · cited 1×
“When a general measure of anxiety was not available, we used a measure for specific anxiety symptoms (see Multimedia Appendix 2 [39-49] for the order of rating scales and Multimedia Appendix 3 [7,27-31,50-85] for the outcome measures we used for all studies).”
MethodTitov, N., Andrews, G., Robinson, E., Schwencke, G., Johnston, L., Solley, K., & Choi, I. (2009) · Australian & New Zealand Journal of Psychiatry · doi:10.1080/00048670903179269 · Cited by 147 · cited 1×
“When a general measure of anxiety was not available, we used a measure for specific anxiety symptoms (see Multimedia Appendix 2 [39-49] for the order of rating scales and Multimedia Appendix 3 [7,27-31,50-85] for the outcome measures we used for all studies).”
MethodSelf-citationNordgren, L. B., Hedman, E., Etienne, J., Bodin, J., Kadowaki, Å., Eriksson, S., Lindkvist, E., Andersson, G., & Carlbring, P. (2014) · Behaviour Research and Therapy · doi:10.1016/j.brat.2014.05.007 · Cited by 145 · cited 2×
“When a general measure of anxiety was not available, we used a measure for specific anxiety symptoms (see Multimedia Appendix 2 [39-49] for the order of rating scales and Multimedia Appendix 3 [7,27-31,50-85] for the outcome measures we used for all studies).”
BackgroundMethodStirman, S. W., DeRubeis, R. J., Crits-Christoph, P., & Brody, P. E. (2003) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.71.6.963 · Cited by 143
Shyness 2: Treating Social Phobia Online: Replication and Extension
Titov, N., Andrews, G., & Schwencke, G. (2008) · Australian & New Zealand Journal of Psychiatry · doi:10.1080/00048670802119820 · Cited by 133 · cited 1×
“When a general measure of anxiety was not available, we used a measure for specific anxiety symptoms (see Multimedia Appendix 2 [39-49] for the order of rating scales and Multimedia Appendix 3 [7,27-31,50-85] for the outcome measures we used for all studies).”
MethodSelf-citationLong-term effects of internet-supported cognitive behaviour therapy
Andersson, G., Rozental, A., Shafran, R., & Carlbring, P. (2018) · Expert Review of Neurotherapeutics · doi:10.1080/14737175.2018.1400381 · Cited by 117 · cited 1×
“Studies also suggest that it is as effective as face-to-face cognitive behavioral therapy (CBT) in improving symptoms of anxiety [1-5], although these studies are limited in number.”
BackgroundAndersson, G., Waara, J., Jonsson, U., Malmaeus, F., Carlbring, P., & Öst, L. (2009) · Cognitive Behaviour Therapy · doi:10.1080/16506070902931326 · Cited by 101 · cited 2×
“When a general measure of anxiety was not available, we used a measure for specific anxiety symptoms (see Multimedia Appendix 2 [39-49] for the order of rating scales and Multimedia Appendix 3 [7,27-31,50-85] for the outcome measures we used for all studies).”
MethodQuality of life and anxiety and depressive disorder comorbidity
Norberg, M. M., Diefenbach, G. J., & Tolin, D. F. (2008) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2008.03.005 · Cited by 98
Mahoney, A., Mackenzie, A., Williams, A. D., Smith, J. S., & Andrews, G. (2014) · Behaviour Research and Therapy · doi:10.1016/j.brat.2014.09.012 · Cited by 98
Berger, T., Urech, A., Krieger, T., Stolz, T., Schulz, A., Vincent, A., Moser, C. T., Moritz, S., & Meyer, B. (2017) · Psychological Medicine · doi:10.1017/s0033291716002270 · Cited by 98 · cited 4×
“8% [31] and n=70, 77% [53]) and therefore we classified these studies as OR trials.”
BackgroundMethodInfluentialTitov, N., Andrews, G., Kemp, A., & Robinson, E. (2010) · PLoS ONE · doi:10.1371/journal.pone.0010885 · Cited by 97
Self-citationInternet-based treatment for panic disorder
Richards, J., Klein, B., & Carlbring, P. (2003) · Cognitive Behaviour Therapy · doi:10.1080/16506070302318 · Cited by 82
Richards, J. C., Klein, B., & Austin, D. W. (2006) · Clinical Psychologist · doi:10.1080/13284200500378795 · Cited by 81
Hedman, E., El Alaoui, S., Lindefors, N., Andersson, E., Rück, C., Ghaderi, A., Kaldo, V., Lekander, M., Andersson, G., & Ljótsson, B. (2014) · Behaviour Research and Therapy · doi:10.1016/j.brat.2014.05.010 · Cited by 79
The Fear Questionnaire: Some Data on Validity, Reliability and Layout
Van Zuuren, F. J. (1988) · British Journal of Psychiatry · doi:10.1192/bjp.153.5.659 · Cited by 79
The 2 “Es” of Research: Efficacy and Effectiveness Trials
Streiner, D. L. (2002) · The Canadian Journal of Psychiatry · doi:10.1177/070674370204700607 · Cited by 79
Adelman, C. B., Panza, K. E., Bartley, C. A., Bontempo, A., & Bloch, M. H. (2014) · The Journal of Clinical Psychiatry · doi:10.4088/jcp.13r08894 · Cited by 75
Engel, C. C., Litz, B., Magruder, K. M., Harper, E., Gore, K., Stein, N., Yeager, D., Liu, X., & Coe, T. R. (2015) · General Hospital Psychiatry · doi:10.1016/j.genhosppsych.2015.04.007 · Cited by 74
Nordgreen, T., Haug, T., Öst, L.-G., Andersson, G., Carlbring, P., Kvale, G., Tangen, T., Heiervang, E., & Havik, O. E. (2016) · Behavior Therapy · doi:10.1016/j.beth.2015.10.004 · Cited by 64 · cited 2×
“When a general measure of anxiety was not available, we used a measure for specific anxiety symptoms (see Multimedia Appendix 2 [39-49] for the order of rating scales and Multimedia Appendix 3 [7,27-31,50-85] for the outcome measures we used for all studies).”
MethodSchulz, A., Stolz, T., Vincent, A., Krieger, T., Andersson, G., & Berger, T. (2016) · Behaviour Research and Therapy · doi:10.1016/j.brat.2016.07.001 · Cited by 63
Andersson, G., Waara, J., Jonsson, U., Malmaeus, F., Carlbring, P., & Öst, L.-G. (2013) · Cognitive Behaviour Therapy · doi:10.1080/16506073.2013.844202 · Cited by 59 · cited 2×
“When a general measure of anxiety was not available, we used a measure for specific anxiety symptoms (see Multimedia Appendix 2 [39-49] for the order of rating scales and Multimedia Appendix 3 [7,27-31,50-85] for the outcome measures we used for all studies).”
MethodWilliams, A. D., O'Moore, K., Mason, E., & Andrews, G. (2014) · Internet Interventions · doi:10.1016/j.invent.2014.11.001 · Cited by 53 · cited 1×
“On the other hand, uncontrolled effectiveness studies show large clinical effects [15-20], thereby suggesting that iCBT for anxiety disorders may be as effective in routine care settings as demonstrated in efficacy trials.”
BackgroundOromendia, P., Orrego, J., Bonillo, A., & Molinuevo, B. (2016) · Cognitive Behaviour Therapy · doi:10.1080/16506073.2016.1163615 · Cited by 52 · cited 2×
“When a general measure of anxiety was not available, we used a measure for specific anxiety symptoms (see Multimedia Appendix 2 [39-49] for the order of rating scales and Multimedia Appendix 3 [7,27-31,50-85] for the outcome measures we used for all studies).”
MethodEffectiveness of computerised cognitive behaviour therapy for anxiety disorders in secondary care
Bell, C. J., Colhoun, H. C., Carter, F. A., & Frampton, C. M. (2012) · Australian & New Zealand Journal of Psychiatry · doi:10.1177/0004867412437345 · Cited by 50 · cited 1×
“When a general measure of anxiety was not available, we used a measure for specific anxiety symptoms (see Multimedia Appendix 2 [39-49] for the order of rating scales and Multimedia Appendix 3 [7,27-31,50-85] for the outcome measures we used for all studies).”
MethodKok, R. N., van Straten, A., Beekman, A. T. F., & Cuijpers, P. (2014) · Journal of Medical Internet Research · doi:10.2196/jmir.3429 · Cited by 49 · cited 2×
“Because RK was an author of one of the included studies [50], this study was independently assessed by a third reviewer (NB).”
Self-citationMathiasen, K., Riper, H., Andersen, T. E., & Roessler, K. K. (2018) · Journal of Medical Internet Research · doi:10.2196/10927 · Cited by 45 · cited 1×
“On the other hand, uncontrolled effectiveness studies show large clinical effects [15-20], thereby suggesting that iCBT for anxiety disorders may be as effective in routine care settings as demonstrated in efficacy trials.”
BackgroundSelf-citationHadjistavropoulos, H. D., Pugh, N. E., Hesser, H., & Andersson, G. (2016) · Behavior Therapy · doi:10.1016/j.beth.2015.10.006 · Cited by 42 · cited 1×
“On the other hand, uncontrolled effectiveness studies show large clinical effects [15-20], thereby suggesting that iCBT for anxiety disorders may be as effective in routine care settings as demonstrated in efficacy trials.”
BackgroundDear, B. F., Zou, J. B., Ali, S., Lorian, C. N., Johnston, L., Terides, M. D., Staples, L. G., Gandy, M., Fogliati, V. J., Klein, B., et al. (2015) · Internet Interventions · doi:10.1016/j.invent.2014.11.002 · Cited by 36
Self-citationHeading, K., Kirkby, K. C., Martin, F. H., Daniels, B. A., Gilroy, L. J., & Menzies, R. G. (2001) · Behaviour Change · doi:10.1375/bech.18.2.103 · Cited by 35
Mathiasen, K., Riper, H., Ehlers, L. H., Valentin, J. B., & Rosenberg, N. K. (2016) · Internet Interventions · doi:10.1016/j.invent.2016.03.001 · Cited by 29
Self-citationChristensen, H. M., Mackinnon, A. J., Batterham, P. J., O’Dea, B., Guastella, A. J., Griffiths, K. M., Eagleson, C., Hehir, K. K., Kenardy, J. A., Bennett, K., et al. (2014) · Internet Interventions · doi:10.1016/j.invent.2014.08.002 · Cited by 26
Christensen, H., Guastella, A. J., Mackinnon, A. J., Griffiths, K. M., Eagleson, C., Batterham, P. J., Kalia, K., Kenardy, J., Bennett, K., & Hickie, I. B. (2010) · Trials · doi:10.1186/1745-6215-11-48 · Cited by 24
Are Trials of Computerized Therapy Generalizable? A Multidimensional Meta-analysis
Wilks, C. R., Zieve, G. G., & Lessing, H. K. (2016) · Telemedicine and e-Health · doi:10.1089/tmj.2015.0129 · Cited by 18
Bruinsma, A., Kampman, M., Exterkate, C. C., & Hendriks, G. (2016) · PubMed · Cited by 13
Research works printed but not linked: 8
- Riper, H, 2013, Preventie & eMental-health. Onderzoek dat leidt, technologie die verleidt, preventie die bereikt en beklijft. Kennissynthese 2013 in opdracht van ZonMw
- Beck, AT, 1979, Cognitive Therapy of Depression
- Gallego, M, 2011, Int J Clin Heal Psychol, 11, 459
- Bruinsma, A, 2016, Tijdschr Psychiatr, 58, 361
- Cohen, J, 1988, Statistical Power Analysis for the Behavioral Sciences. 2nd edition
- Orsini, N, 2006, Heterogi: Stata Module to Quantify Heterogeneity in a Meta-Analysis
- Allison, Pd, 1999, Logistic Regression Using SAS: Theory And Application. 1st edition
- Weisz, J, 1995, J Consult Clin Psychol, 63, 688, 10.1037/0022-006x.63.5.688 · DOI · Paper page
Cited by
Etzelmueller, A., Vis, C., Karyotaki, E., Baumeister, H., Titov, N., Berking, M., Cuijpers, P., Riper, H., & Ebert, D. D. (2020) · Journal of Medical Internet Research · doi:10.2196/18100 · Cited by 356
“They also found that effects were smaller in samples recruited in clinical practice than in samples recruited with an open recruitment method compared with waitlist-control groups [13], which raises the question of the effects of iCBT when implemented in routine practice.”
BackgroundResultInfluentialSelf-citationMilgrom, J., Danaher, B. G., Seeley, J. R., Holt, C. J., Holt, C., Ericksen, J., Tyler, M. S., Gau, J. M., & Gemmill, A. W. (2021) · Journal of Medical Internet Research · doi:10.2196/17185 · Cited by 96
Evaluation of the Use of Digital Mental Health Platforms and Interventions: Scoping Review
Balcombe, L., & De Leo, D. (2022) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph20010362 · Cited by 76
Domhardt, M., Letsch, J., Kybelka, J., Koenigbauer, J., Doebler, P., & Baumeister, H. (2020) · Journal of Affective Disorders · doi:10.1016/j.jad.2020.06.059 · Cited by 75
Hadjistavropoulos, H. D., Peynenburg, V., Thiessen, D. L., Nugent, M., Karin, E., Staples, L., Dear, B. F., & Titov, N. (2022) · The Canadian Journal of Psychiatry · doi:10.1177/07067437211006873 · Cited by 52
Self-citation
Metadata
- Authors
- Romijn, G., Batelaan, N., Kok, R., Koning, J., van Balkom, A., Titov, N., & Riper, H.
- Affiliations
- Amsterdam Public Health (NL)
- University of Southern Denmark (DK)
- Pro Persona (NL)
- Macquarie University (AU)
- Corresponding author
- Romijn, Geke
- ORCID
- Venue
- Journal of Medical Internet Research
- Publisher
- JMIR Publications Inc.
- Published
- 2019-04-17
- Volume
- 21
- Issue
- 4
- Pages
- e11706
- ISSN
- 1438-8871 (ISSN-L)
- PMC
- PMC6492068
- OpenAlex
- W2938191752
- Cited by
- 52
- References
- 113
- Citations by year
- 2026: 1 · 2025: 7 · 2024: 4 · 2023: 4 · 2022: 8 · 2021: 12 · 2020: 13 · 2019: 3
- FWCI
- 1.27
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- Journal of Medical Internet Research (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- VU Research Portal (publishedVersion, other-oa)
- University of Southern Denmark Research Portal (University of Southern Denmark) (publishedVersion, cc-by)
- Pure Amsterdam UMC (submittedVersion, cc-by)
- Data Archiving and Networked Services (DANS) (submittedVersion, other-oa)
- Topics
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Anxiety, Depression, Psychometrics, Treatment, Cognitive Processes
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Telemedicine and Telehealth Implementation
- Keywords
- internet-based cognitive behavioral therapy, anxiety disorders, recruitment strategies, community-based recruitment, waitlist control, medication adherence, depressive symptoms, quality of life, usual care, effect size heterogeneity, moderators of treatment outcome, digital mental health interventions, primary care settings, generalizability of trial results
- MeSH terms
- Adult, Anxiety Disorders, Female, Humans, Male, Middle Aged, Quality of Life, Cognitive Behavioral Therapy, Treatment Outcome, Internet
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-05, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-05 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (qwen3.8-omni-flash).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.