Effects of Internet-Based Cognitive Behavioral Therapy in Routine Care for Adults in Treatment for Depression and Anxiety: Systematic Review and Meta-Analysis
Open accessPublished version of a preprint
The DOI matches its Crossref record; 176 of the 176 references it cites were found in a registry or an index; 13 of the 49 sources its claims cite were checked for support.
Abstract
Background: Although there is evidence for the efficacy of internet-based cognitive behavioral therapy (iCBT), the generalizability of results to routine care is limited. Objective: This study systematically reviews effectiveness studies of guided iCBT interventions for the treatment of depression or anxiety. Methods: The acceptability (uptake, participants’ characteristics, adherence, and satisfaction), effectiveness, and negative effects (deterioration) of nonrandomized pre-post designs conducted under routine care conditions were synthesized using systematic review and meta-analytic approaches. Results: A total of 19 studies including 30 groups were included in the analysis. Despite high heterogeneity, individual effect sizes of investigated studies indicate clinically relevant changes, with effect sizes ranging from Hedges’ g=0.42-1.88, with a pooled effect of 1.78 for depression and 0.94 for anxiety studies. Uptake, participants’ characteristics, adherence, and satisfaction indicate a moderate to high acceptability of the interventions. The average deterioration across studies was 2.9%. Conclusions: This study provides evidence supporting the acceptability and effectiveness of guided iCBT for the treatment of depression and anxiety in routine care. Given the high heterogeneity between interventions and contexts, health care providers should select interventions that have been proven in randomized controlled clinical trials. The successful application of iCBT may be an effective way of increasing health care in multiple contexts.
Overview
CoChat Summary
TL;DR
This systematic review and meta-analysis of nonrandomized routine-care studies found that guided iCBT for depression and anxiety produced large pre-post symptom reductions, with pooled Hedges’ g=1.18 for depression and g=0.94 for anxiety, alongside moderate-to-high acceptability and low average deterioration. However, heterogeneity was high and the authors caution that pre-post within-group effects may overestimate treatment effects.
Key findings
- Pooled pre-post effects were large: depression g=1.18 (95% CI 1.06-1.29; k=13 studies) and anxiety g=0.94 (95% CI 0.83-1.06; k=20 studies). Individual study effects ranged from 0.66 to 1.88 for depression and 0.42 to 1.38 for anxiety.
- Acceptability indicators were moderate to high: mean age 38.3 years, 65.4% female, average sessions completed 61.2% (95% CI 54.9%-67.5%), and 61.3% completed all treatment components (95% CI 55.3%-66.9%). Of studies reporting satisfaction, five reported high and four very high satisfaction.
- Average deterioration was 2.9% (k=14, 95% CI 1.9%-4.3%; depression 2.5%, anxiety 3.1%). No study reported other negative effects, and no studies reported predictors of deterioration.
- Subgroup analyses found significant differences for professional training of coaches, supervision of coaches, and treatment duration for both depression and anxiety studies, and for recruitment pathways in depression studies only.
Methods
- Systematic review and meta-analysis reported per PRISMA and registered at PROSPERO (CRD42018095704). Searches covered PubMed, PsychINFO, and the Cochrane Library, plus expert contact and reference tracking.
- Included nonrandomized pre-post effectiveness studies of guided or blended iCBT for adults with depressive and/or anxiety symptoms under routine care conditions; excluded feasibility/pilot trials and individually randomized trials. The abstract reports 19 studies including 30 groups, while the Results section reports 17 studies (n=12,096 participants) and 30 groups.
- Random-effects meta-analysis used Hedges’ g for pre-post symptom change, I² for heterogeneity, subgroup analyses, meta-regression, and publication-bias checks (funnel plot, Egger test, trim-and-fill). Acceptability outcomes were pooled as proportions.
Limitations
- The paper states heterogeneity was high and significant, so firm conclusions about the average effect of iCBT in routine care cannot be drawn; within-group pre-post effect sizes are not optimal estimators and may overestimate treatment effects, including possible spontaneous recovery.
- Risk of bias was substantial: 67.0% of studies had high risk on researcher allegiance, 63.0% did not exclude patients receiving other psychotherapeutic treatments, none adjusted for confounders, and none had a published study protocol.
- Less than half of studies reported deterioration rates, no study reported predictors of deterioration or other negative effects, and satisfaction data could not be pooled because reporting was inconsistent.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures




Verification
Claims the paper makes
9 Valid · 0 Not valid · 16 Not checked · 139 Own results and interpretations
The sources with a verdict support this claim; the rest weren’t checked yet, have no full text we could read, or their verdicts aren’t rated yet.
In the paper
“Systematic reviews on studies were also able to show comparable effects to face-to-face treatments in adults [16,17].”
§ Effects of Internet-Based Cognitive Behavioral Therapy in Routine Care for Adults in Treatment for Depression and Anxiety: Systematic Review and Meta-Analysis > Introduction
What the sources say
- Supportedcites [16] source
The Abstract (p. 3) and All studies (p. 11) report the pooled post-treatment effect of Hedges g = .05 (95% CI, -.09 to .20) across 20 trials with 1418 participants, indicating equivalent overall effects for guided ICBT and face-to-face CBT. The Design and selection of studies section (p. 5) confirms inclusion was restricted to adult patient samples, matching the claim's population. The Discussion (p. 16) restates that the two formats are equally effective across the included disorders, so the paraphrase 'comparable effects to face-to-face treatments in adults' is faithful to this systematic review/meta-analysis. (LLM, conf=0.92)
- Not checked yetcites [17] source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Furthermore, research on patients’ preferences has shown that many do neither make use of psychotherapeutic treatments nor do they receive psychopharmacological treatment [7].”
§ Effects of Internet-Based Cognitive Behavioral Therapy in Routine Care for Adults in Treatment for Depression and Anxiety: Systematic Review and Meta-Analysis > Introduction
What the sources say
- Partly supportedcites [7] sourceExperimental — accuracy not yet measured
The Discussion reports that most German respondents with mental disorders did not report using any service for mental health reasons, supporting the broad point that many did not receive treatment. But the Methods say this paper focuses on service contacts rather than treatment or medication use, so it does not establish that they received no psychopharmacological treatment. It also does not present the finding as research on patients’ preferences. (LLM, conf=0.86)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“Using the internet to provide psychotherapeutic interventions may increase the coverage of usual care services [8,9] by providing highly accessible and scalable interventions reaching people who cannot be reached otherwise.”
§ Effects of Internet-Based Cognitive Behavioral Therapy in Routine Care for Adults in Treatment for Depression and Anxiety: Systematic Review and Meta-Analysis > Introduction
What the sources say
- Supportedcites [8] source
The “What's new?” section (p. 3) says Internet-guided self-help may attract people who would not otherwise seek traditional care and offers scalability and immediate accessibility. It also says this approach could help reduce the gap between treatment need and availability for people with depression and diabetes, supporting the claim as a qualified possibility. (LLM, conf=0.92)
- Supportedcites [9] source
The Introduction says internet- and mobile-based interventions can overcome limits in the availability of traditional psychotherapy and reach people for whom traditional options are unavailable. Areas of Application says stand-alone interventions increase the reach of effective psychological care by removing time and location barriers. The supplied passages do not give page numbers. (LLM, conf=0.92)
hedgedstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The sources with a verdict support this claim; the rest weren’t checked yet, have no full text we could read, or their verdicts aren’t rated yet.
In the paper
“RCTs provide a highly structured environment, which is considered to possibly have an adherence-fostering effect [21,22].”
§ Effects of Internet-Based Cognitive Behavioral Therapy in Routine Care for Adults in Treatment for Depression and Anxiety: Systematic Review and Meta-Analysis > Introduction
What the sources say
- Supportedcites [21] source
The letter by Ebert and Baumeister (section 'Internet-Based Self-help Interventions for Depression in Routine Care', p. 1 of our copy) states that the evidence 'is based on randomized clinical trials, which bring a per se rather high structuring of participants and high research attention,' and links this structuring/commitment-securing to being 'an adherence-promoting element.' The claim's hedge ('considered to possibly') matches the source's own conditional framing ('it can be assumed'). (LLM, conf=0.88)
- Not checked yetcites [22] source
hedgedstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Seventeen studies (n=12,096 participants) reporting on the outcomes of the treatment for depression and anxiety were included.”
§ Effects of Internet-Based Cognitive Behavioral Therapy in Routine Care for Adults in Treatment for Depression and Anxiety: Systematic Review and Meta-Analysis > Results > Study Characteristics
plainn = 12,096- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
86 more claims
Create a free account to see all 164 claims and to verify the 36 references still open.
- It may state two separate claims as one. 45
- Probably not a substantial claim. 41
- The quote only partly states this claim. 7
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Online and internet‐based supports may also be beneficial, and are typically accessible at any time and can allow for a greater degree of anonymity and privacy (Andrews 2018; Etzelmueller 2020).”
From Support for parents and families after stillbirth and neonatal death (2024) · cites this paper as Etzelmueller 2020
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Meta-analytic evidence of IMIs in routine care shows promising effects in the treatment of mental disorders in adults (69).”
From Mental health services for German university students: acceptance of intervention targets and preference for delivery modes (2024) · cites this paper as [69]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“IMIs are similarly effective as face-to-face counseling in the treatment of mental disorders (69) and mental health promotion (64) and prevention (66); they are low-threshold, can reach students (with mental disorders, no intention of seeking help, and no treatment experience) who would otherwise not receive care, and have the potential to be cost-effective (68).”
From Mental health services for German university students: acceptance of intervention targets and preference for delivery modes (2024) · cites this paper as [69]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“By comparison iCBT requires far more clinician time, based on the pooled mean clinician guidance time reported in a large metanalysis of iCBT for depression and anxiety of 148.5 min (SD 147.0) (Etzelmueller et al., 2020).”
From An open trial of the feasibility of brief internet-delivered acceptance and commitment therapy (iACT) for chronic anxiety and depression (2023) · cites this paper as Etzelmueller et al., 2020
The cited source says what the claim attributes to it.
In the citing paper
“The completion rate of 70 % was higher than the average completion rates reported in metanalyses for iACT (57.7 %, (Klimczak et al., 2023)) and iCBT (61.3 %, (Etzelmueller et al., 2020))”
From An open trial of the feasibility of brief internet-delivered acceptance and commitment therapy (iACT) for chronic anxiety and depression (2023) · cites this paper as Etzelmueller et al., 2020
4 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated major: it would touch a result — a value a result rests on, reported and recomputed p-values on opposite sides of the significance level, two passages that conflict with no sign which is right, or a cited work retracted before this paper was published.
In the paper
§ Effects of Internet-Based Cognitive Behavioral Therapy in Routine Care for Adults in Treatment for Depression and Anxiety: Systematic Review and Meta-Analysis > Results > iCBT Service Acceptability
“The average proportion of included people based on the number of people screened was 70.2%”
§ Effects of Internet-Based Cognitive Behavioral Therapy in Routine Care for Adults in Treatment for Depression and Anxiety: Systematic Review and Meta-Analysis > Discussion
“on average, 70.2% of people screened were not offered inclusion”
Rated major: it would touch a result — a value a result rests on, reported and recomputed p-values on opposite sides of the significance level, two passages that conflict with no sign which is right, or a cited work retracted before this paper was published.
In the paper
§ Effects of Internet-Based Cognitive Behavioral Therapy in Routine Care for Adults in Treatment for Depression and Anxiety: Systematic Review and Meta-Analysis > Results > Subgroup Analysis for iCBT for the Treatment of Depression, Anxiety, or Mixed Depression and/or Anxiety
“Significant differences between subgroups were found for professional training of coaches, supervision of coaches, and treatment duration for both depression and anxiety studies”
§ Effects of Internet-Based Cognitive Behavioral Therapy in Routine Care for Adults in Treatment for Depression and Anxiety: Systematic Review and Meta-Analysis > Results > Subgroup Analysis for iCBT for the Treatment of Depression, Anxiety, or Mixed Depression and/or Anxiety
“| | Yes | 14 | 0.9811 | 0.83-1.13 | 90 | <.001 | 86-94 | 86-94 | 2.812 | .09 |”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Effects of Internet-Based Cognitive Behavioral Therapy in Routine Care for Adults in Treatment for Depression and Anxiety: Systematic Review and Meta-Analysis > Results > Effects of iCBT on Symptom Change
“| | Without mixed treatments | 1.282 | 1.26-1.44 | <.001 | 89 (84-92) |”
§ Effects of Internet-Based Cognitive Behavioral Therapy in Routine Care for Adults in Treatment for Depression and Anxiety: Systematic Review and Meta-Analysis > Results > Effects of iCBT on Symptom Change
“Removing the mixed anxiety and depression studies did not result in a relevant change in effect size (g=1.28; 95% CI 1.13-1.44;”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Effects of Internet-Based Cognitive Behavioral Therapy in Routine Care for Adults in Treatment for Depression and Anxiety: Systematic Review and Meta-Analysis > Results > Effects of iCBT on Symptom Change
“| | Without mixed treatments | 0.95 | 0.81-1.10 | <.001 | 83 (74-89) |”
§ Effects of Internet-Based Cognitive Behavioral Therapy in Routine Care for Adults in Treatment for Depression and Anxiety: Systematic Review and Meta-Analysis > Results > Effects of iCBT on Symptom Change
“Excluding the mixed anxiety and depression studies did not result in a significantly different effect size (g=0.99; 95% CI 0.86-1.12;”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Effects of Internet-Based Cognitive Behavioral Therapy in Routine Care for Adults in Treatment for Depression and Anxiety: Systematic Review and Meta-Analysis > Results > Study Characteristics
“all depression studies allowed patients with severe depression severity to be included.”
§ Effects of Internet-Based Cognitive Behavioral Therapy in Routine Care for Adults in Treatment for Depression and Anxiety: Systematic Review and Meta-Analysis > Discussion
“Most evaluated iCBT services for depression (69.2%) excluded severe cases and individuals with suicidal ideation (k=9/13) at baseline.”
9 more findings
Create a free account to see every finding of this check.
Citations
Cites
Statistical Power Analysis for the Behavioral Sciences
Muller, K. (1989) · Technometrics · doi:10.1080/00401706.1989.10488618 · Cited by 99,167
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: the PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & for the PRISMA Group (2009) · BMJ · doi:10.1136/bmj.b2535 · Cited by 83,823
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & The PRISMA Group (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000097 · Cited by 64,042 · cited 1×
“We report this meta-analysis in accordance with the Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines (Multimedia Appendix 1) [26].”
The PHQ-9: Validity of a brief depression severity measure
Kroenke, K., Spitzer, R. L., & Williams, J. B. W. (2001) · Journal of General Internal Medicine · doi:10.1046/j.1525-1497.2001.016009606.x · Cited by 44,910
An inventory for measuring depression
BECK, A. T. (1961) · Archives of General Psychiatry · doi:10.1001/archpsyc.1961.01710120031004 · Cited by 38,032 · cited 1×
“Information is depicted in Multimedia Appendix 5 [64-101] and Multimedia Appendix 6 [102-120] on the iCBT service–related characteristics.”
BackgroundHamilton, M. (1960) · Journal of Neurology, Neurosurgery & Psychiatry · doi:10.1136/jnnp.23.1.56 · Cited by 32,817 · cited 1×
“Information is depicted in Multimedia Appendix 5 [64-101] and Multimedia Appendix 6 [102-120] on the iCBT service–related characteristics.”
BackgroundA Brief Measure for Assessing Generalized Anxiety Disorder: The GAD-7
Spitzer, R. L., Kroenke, K., Williams, J. B. W., & Löwe, B. (2006) · Archives of Internal Medicine · doi:10.1001/archinte.166.10.1092 · Cited by 31,765
Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series
(2008) · doi:10.1002/9780470712184 · Cited by 25,048
ROBINS-I: a tool for assessing risk of bias in non-randomised studies of interventions
Sterne, J. A., Hernán, M. A., Reeves, B. C., Savović, J., Berkman, N. D., Viswanathan, M., Henry, D., Altman, D. G., Ansari, M. T., Boutron, I., et al. (2016) · BMJ · doi:10.1136/bmj.i4919 · Cited by 20,329 · cited 2×
“Thus, in this study, we selected and adapted criteria from two quality assessment tools [33,34] and adapted them to this study’s purposes to evaluate the risk of bias of the included studies.”
BackgroundMethodWang, G., Ma, R., Qiao, G., Wada, K., Aizawa, Y., & Satoh, T. (2015) · Integrative Medicine International · doi:10.1159/000368408 · Cited by 18,657
An inventory for measuring clinical anxiety: Psychometric properties.
Beck, A. T., Epstein, N., Brown, G., & Steer, R. A. (1988) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.56.6.893 · Cited by 14,407 · cited 1×
“Information is depicted in Multimedia Appendix 5 [64-101] and Multimedia Appendix 6 [102-120] on the iCBT service–related characteristics.”
BackgroundDuval, S., & Tweedie, R. (2000) · Biometrics · doi:10.1111/j.0006-341x.2000.00455.x · Cited by 14,099 · cited 1×
“In addition, we used Duval and Tweedie’s trim and fill procedure [46] to adjust the effect size for missing studies.”
MethodStatistical Methods for Meta-Analysis
Wasserman, S., Hedges, L. V., & Olkin, I. (1988) · Journal of Educational Statistics · doi:10.2307/1164953 · Cited by 10,326
Proctor, E., Silmere, H., Raghavan, R., Hovmand, P., Aarons, G., Bunger, A., Griffey, R., & Hensley, M. (2011) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-010-0319-7 · Cited by 8,721 · cited 1×
“Proctor et al [176] suggested a list of outcomes for implementation-related research, and Hermes et al [177] recently made suggestions on how to build upon these ideas to establish a measurement system for the implementation of behavioral intervention technologies.”
BackgroundKessler, R. C., Berglund, P., Demler, O., Jin, R., Koretz, D., Merikangas, K. R., Rush, A. J., Walters, E. E., & Wang, P. S. (2003) · JAMA · doi:10.1001/jama.289.23.3095 · Cited by 7,988
Impact of Event Scale: A Measure of Subjective Stress
Horowitz, M., Wilner, N., & Alvarez, W. (1979) · Psychosomatic Medicine · doi:10.1097/00006842-197905000-00004 · Cited by 7,813 · cited 1×
“Information is depicted in Multimedia Appendix 5 [64-101] and Multimedia Appendix 6 [102-120] on the iCBT service–related characteristics.”
BackgroundThe Yale-Brown Obsessive Compulsive Scale: I. Development, Use, and Reliability
Goodman, W. K. (1989) · Archives of General Psychiatry · doi:10.1001/archpsyc.1989.01810110048007 · Cited by 7,712
Sterne, J. A. C., Sutton, A. J., Ioannidis, J. P. A., Terrin, N., Jones, D. R., Lau, J., Carpenter, J., Rucker, G., Harbord, R. M., Schmid, C. H., et al. (2011) · BMJ · doi:10.1136/bmj.d4002 · Cited by 7,709 · cited 1×
“Publication bias was examined by inspecting the funnel plot [44] and conducting the Egger test of the intercept with a one-tailed significance level of α=.”
MethodScoville, W. B. (1949) · Journal of neurosurgery · doi:10.3171/jns.1949.6.1.0065 · Cited by 7,380
Whiteford, H. A., Degenhardt, L., Rehm, J., Baxter, A. J., Ferrari, A. J., Erskine, H. E., Charlson, F. J., Norman, R. E., Flaxman, A. D., Johns, N., et al. (2013) · The Lancet · doi:10.1016/s0140-6736(13)61611-6 · Cited by 6,006
The PHQ-9: A New Depression Diagnostic and Severity Measure
Kroenke, K., & Spitzer, R. L. (2002) · Psychiatric Annals · doi:10.3928/0048-5713-20020901-06 · Cited by 5,898 · cited 1×
“Information is depicted in Multimedia Appendix 5 [64-101] and Multimedia Appendix 6 [102-120] on the iCBT service–related characteristics.”
BackgroundHow to perform a meta-analysis with R: a practical tutorial
Balduzzi, S., Rücker, G., & Schwarzer, G. (2019) · Evidence Based Mental Health · doi:10.1136/ebmental-2019-300117 · Cited by 5,827 · cited 1×
“2), and pooled proportions were calculated with R [39] package meta [40].”
MethodThe size and burden of mental disorders and other disorders of the brain in Europe 2010
Wittchen, H. U., Jacobi, F., Rehm, J., Gustavsson, A., Svensson, M., Jönsson, B., Olesen, J., Allgulander, C., Alonso, J., Faravelli, C., et al. (2011) · European Neuropsychopharmacology · doi:10.1016/j.euroneuro.2011.07.018 · Cited by 3,754
Assessing Risk of Bias in Included Studies
Higgins, J. P., & Altman, D. G. (2008) · Cochrane Handbook for Systematic Reviews of Interventions · doi:10.1002/9780470712184.ch8 · Cited by 3,396
Mattick, R. P., & Clarke, J. C. (1998) · Behaviour Research and Therapy · doi:10.1016/s0005-7967(97)10031-6 · Cited by 3,367
The Epidemiology of Depression Across Cultures
Kessler, R. C., & Bromet, E. J. (2013) · Annual Review of Public Health · doi:10.1146/annurev-publhealth-031912-114409 · Cited by 2,657 · cited 1×
“Depressive and anxiety disorders are common mental health problems associated with significant suffering, impairment, and reduction in the quality of life [1,2].”
BackgroundExternal validity of randomised controlled trials: “To whom do the results of this trial apply?”
Rothwell, P. M. (2005) · The Lancet · doi:10.1016/s0140-6736(04)17670-8 · Cited by 2,544 · cited 3×
“There is evidence that iCBT recruiting via open recruitment strategies, such as through web-based channels, might only reach a specific population that is different from those seeking help in a clinical setting [19].”
BackgroundPsychometric properties of the credibility/expectancy questionnaire
Devilly, G. J., & Borkovec, T. D. (2000) · Journal of Behavior Therapy and Experimental Psychiatry · doi:10.1016/s0005-7916(00)00012-4 · Cited by 2,295 · cited 2×
“Multimedia Appendix 7 [81,121-123] comprises the results of the negative effects.”
BackgroundBasics of meta‐analysis: I 2 is not an absolute measure of heterogeneity
Borenstein, M., Higgins, J. P. T., Hedges, L. V., & Rothstein, H. R. (2017) · Research Synthesis Methods · doi:10.1002/jrsm.1230 · Cited by 1,848
Brief standard self-rating for phobic patients
Marks, I. M., & Mathews, A. M. (1979) · Behaviour Research and Therapy · doi:10.1016/0005-7967(79)90041-x · Cited by 1,801 · cited 1×
“Information is depicted in Multimedia Appendix 5 [64-101] and Multimedia Appendix 6 [102-120] on the iCBT service–related characteristics.”
BackgroundCredibility of analogue therapy rationales
Borkovec, T. D., & Nau, S. D. (1972) · Journal of Behavior Therapy and Experimental Psychiatry · doi:10.1016/0005-7916(72)90045-6 · Cited by 1,553 · cited 2×
“Multimedia Appendix 7 [81,121-123] comprises the results of the negative effects.”
BackgroundSeedat, S., Scott, K. M., Angermeyer, M. C., Berglund, P., Bromet, E. J., Brugha, T. S., Demyttenaere, K., de Girolamo, G., Haro, J. M., Jin, R., et al. (2009) · Archives of General Psychiatry · doi:10.1001/archgenpsychiatry.2009.36 · Cited by 1,518 · cited 1×
“As similar distributions between female and male users are reported in face-to-face mental health service utilization [126], this effect might be explained by gender differences in help-seeking behavior than being related to iCBT service–related factors [127] as well as by gender differences in the prevalence of depre…”
BackgroundWhat is a pilot or feasibility study? A review of current practice and editorial policy
Arain, M., Campbell, M. J., Cooper, C. L., & Lancaster, G. A. (2010) · BMC Medical Research Methodology · doi:10.1186/1471-2288-10-67 · Cited by 1,483 · cited 2×
“For the definition of feasibility and pilot trials, we followed the NIHR Evaluation, Trials and Studies Coordinating Centre definition of pilot and feasibility trials [30], as recommended by Arain et al [31].”
BackgroundMethodComputer-based psychological treatments for depression: A systematic review and meta-analysis
Richards, D., & Richardson, T. (2012) · Clinical Psychology Review · doi:10.1016/j.cpr.2012.02.004 · Cited by 1,442 · cited 1×
“7% for anxiety studies) than reported elsewhere [130,131].”
Viechtbauer, W. (2007) · Psychometrika · doi:10.1007/s11336-006-1450-y · Cited by 1,250
Chambless, D. L., Caputo, G. C., Bright, P., & Gallagher, R. (1984) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.52.6.1090 · Cited by 1,247 · cited 1×
“Information is depicted in Multimedia Appendix 5 [64-101] and Multimedia Appendix 6 [102-120] on the iCBT service–related characteristics.”
BackgroundCarlbring, P., Andersson, G., Cuijpers, P., Riper, H., & Hedman-Lagerlöf, E. (2018) · Cognitive Behaviour Therapy · doi:10.1080/16506073.2017.1401115 · Cited by 1,232 · cited 1×
“Systematic reviews on studies were also able to show comparable effects to face-to-face treatments in adults [16,17].”
BackgroundSelf-citationThompson, A. E., Anisimowicz, Y., Miedema, B., Hogg, W., Wodchis, W. P., & Aubrey-Bassler, K. (2016) · BMC Family Practice · doi:10.1186/s12875-016-0440-0 · Cited by 1,148
The role of masculinity in men's help-seeking for depression: A systematic review
Seidler, Z. E., Dawes, A. J., Rice, S. M., Oliffe, J. L., & Dhillon, H. M. (2016) · Clinical Psychology Review · doi:10.1016/j.cpr.2016.09.002 · Cited by 1,093 · cited 1×
“As similar distributions between female and male users are reported in face-to-face mental health service utilization [126], this effect might be explained by gender differences in help-seeking behavior than being related to iCBT service–related factors [127] as well as by gender differences in the prevalence of depre…”
BackgroundAndrews, G., Basu, A., Cuijpers, P., Craske, M. G., McEvoy, P., English, C. L., & Newby, J. M. (2018) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2018.01.001 · Cited by 922 · cited 6×
“Furthermore, we conducted reference tracking on the identified studies and previous meta-analyses in the field [5,14,15,27].”
BackgroundMethodInfluentialSelf-citationKuehner, C. (2003) · Acta Psychiatrica Scandinavica · doi:10.1034/j.1600-0447.2003.00204.x · Cited by 839 · cited 1×
“As similar distributions between female and male users are reported in face-to-face mental health service utilization [126], this effect might be explained by gender differences in help-seeking behavior than being related to iCBT service–related factors [127] as well as by gender differences in the prevalence of depre…”
BackgroundRegression Methods to Detect Publication and Other Bias in Meta‐Analysis
Sterne, J. A. C., & Egger, M. (2005) · Publication Bias in Meta‐Analysis · doi:10.1002/0470870168.ch6 · Cited by 826
The Mobility Inventory for Agoraphobia
Chambless, D. L., Caputo, G. C., Jasin, S. E., Gracely, E. J., & Williams, C. (1985) · Behaviour Research and Therapy · doi:10.1016/0005-7967(85)90140-8 · Cited by 775 · cited 1×
“Information is depicted in Multimedia Appendix 5 [64-101] and Multimedia Appendix 6 [102-120] on the iCBT service–related characteristics.”
BackgroundAssessment of patient satisfaction: Development and refinement of a Service Evaluation Questionnaire
Nguyen, T. D., Attkisson, C. C., & Stegner, B. L. (1983) · Evaluation and Program Planning · doi:10.1016/0149-7189(83)90010-1 · Cited by 736 · cited 2×
“Multimedia Appendix 7 [81,121-123] comprises the results of the negative effects.”
BackgroundA Primer on Effectiveness and Efficacy Trials
Singal, A. G., Higgins, P. D. R., & Waljee, A. K. (2014) · Clinical and Translational Gastroenterology · doi:10.1038/ctg.2013.13 · Cited by 698 · cited 3×
“The efficacy derived from RCTs of internet-based interventions might be overestimated for what can be expected when implementing in routine care, limiting the knowledge base for routine clinical practice [20].”
BackgroundSvanborg, P., & Åsberg, M. (1994) · Acta Psychiatrica Scandinavica · doi:10.1111/j.1600-0447.1994.tb01480.x · Cited by 693 · cited 1×
“Information is depicted in Multimedia Appendix 5 [64-101] and Multimedia Appendix 6 [102-120] on the iCBT service–related characteristics.”
BackgroundThe Liebowitz social anxiety scale as a self-report instrument: a preliminary psychometric analysis
Baker, S. L., Heinrichs, N., Kim, H.-J., & Hofmann, S. G. (2002) · Behaviour Research and Therapy · doi:10.1016/s0005-7967(01)00060-2 · Cited by 640 · cited 1×
“Information is depicted in Multimedia Appendix 5 [64-101] and Multimedia Appendix 6 [102-120] on the iCBT service–related characteristics.”
BackgroundThe diagnostic accuracy of the PTSD Checklist: A critical review
McDonald, S. D., & Calhoun, P. S. (2010) · Clinical Psychology Review · doi:10.1016/j.cpr.2010.06.012 · Cited by 546 · cited 1×
“Information is depicted in Multimedia Appendix 5 [64-101] and Multimedia Appendix 6 [102-120] on the iCBT service–related characteristics.”
BackgroundCuijpers, P., Noma, H., Karyotaki, E., Cipriani, A., & Furukawa, T. A. (2019) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2019.0268 · Cited by 539
Self-citationErbe, D., Eichert, H.-C., Riper, H., & Ebert, D. D. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.6588 · Cited by 532 · cited 2×
“Furthermore, the interventions were considered as guided when the guidance was related to the therapeutic content [29] and as blended when the internet-based intervention was combined with face-to-face elements in one integrated standardized treatment protocol [27].”
BackgroundMethodSelf-citationInternet-based self-help for depression: randomised controlled trial
Andersson, G., Bergström, J., Holländare, F., Carlbring, P., Kaldo, V., & Ekselius, L. (2005) · British Journal of Psychiatry · doi:10.1192/bjp.187.5.456 · Cited by 529 · cited 1×
“Information is depicted in Multimedia Appendix 5 [64-101] and Multimedia Appendix 6 [102-120] on the iCBT service–related characteristics.”
BackgroundLange, A., Rietdijk, D., Hudcovicova, M., van de Ven, J.-P., Schrieken, B., & Emmelkamp, P. M. G. (2003) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.71.5.901 · Cited by 495
Implementing routine outcome monitoring in clinical practice: Benefits, challenges, and solutions
Boswell, J. F., Kraus, D. R., Miller, S. D., & Lambert, M. J. (2015) · Psychotherapy Research · doi:10.1080/10503307.2013.817696 · Cited by 494 · cited 1×
“of the effects of routine outcome monitoring in routinely applied iCBT [169], as this monitoring could help evaluate participants’ progress throughout the course of treatment, using standardized outcome measures to elicit clients as part of a measurement-based care delivery approach in routine mental and behavioral he…”
MethodStewart, R. E., & Chambless, D. L. (2009) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0016032 · Cited by 483
Sheehan, K. H., & Sheehan, D. V. (2008) · International Clinical Psychopharmacology · doi:10.1097/yic.0b013e3282f2b4d6 · Cited by 467 · cited 1×
“Information is depicted in Multimedia Appendix 5 [64-101] and Multimedia Appendix 6 [102-120] on the iCBT service–related characteristics.”
BackgroundEbert, D. D., Van Daele, T., Nordgreen, T., Karekla, M., Compare, A., Zarbo, C., Brugnera, A., Øverland, S., Trebbi, G., Jensen, K. L., et al. (2018) · European Psychologist · doi:10.1027/1016-9040/a000318 · Cited by 437 · cited 1×
“Using the internet to provide psychotherapeutic interventions may increase the coverage of usual care services [8,9] by providing highly accessible and scalable interventions reaching people who cannot be reached otherwise.”
BackgroundSelf-citationPre-post effect sizes should be avoided in meta-analyses
Cuijpers, P., Weitz, E., Cristea, I. A., & Twisk, J. (2017) · Epidemiology and Psychiatric Sciences · doi:10.1017/s2045796016000809 · Cited by 432 · cited 2×
“99 to examine the robustness of our findings [42].”
BackgroundSelf-citationvan Ballegooijen, W., Cuijpers, P., van Straten, A., Karyotaki, E., Andersson, G., Smit, J. H., & Riper, H. (2014) · PLoS ONE · doi:10.1371/journal.pone.0100674 · Cited by 409
Self-citationReliability of the self-report version of the panic disorder severity scale
Houck, P. R., Spiegel, D. A., Shear, M. K., & Rucci, P. (2002) · Depression and Anxiety · doi:10.1002/da.10049 · Cited by 406
Knaevelsrud, C., & Maercker, A. (2007) · BMC Psychiatry · doi:10.1186/1471-244x-7-13 · Cited by 398
Therapist-supported Internet cognitive behavioural therapy for anxiety disorders in adults
Olthuis, J. V., Watt, M. C., Bailey, K., Hayden, J. A., & Stewart, S. H. (2016) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd011565.pub2 · Cited by 390 · cited 2×
“5 [124]) but comparable with reports on the mean age of participants within guided iCBT interventions for the treatment of anxiety [125].”
ResultWells, K. B. (1999) · American Journal of Psychiatry · doi:10.1176/ajp.156.1.5 · Cited by 390 · cited 1×
“Although randomized controlled trials (RCTs) are considered the gold standard in exploring the efficacy of mental health interventions, the idealized and controlled nature of these trials limits the generalizability of findings to routine care populations [18].”
BackgroundPROUDFOOT, J., GOLDBERG, D., MANN, A., EVERITT, B., MARKS, I., & GRAY, J. A. (2003) · Psychological Medicine · doi:10.1017/s0033291702007225 · Cited by 389 · cited 1×
“Information is depicted in Multimedia Appendix 5 [64-101] and Multimedia Appendix 6 [102-120] on the iCBT service–related characteristics.”
BackgroundAndersson, G., Carlbring, P., Holmström, A., Sparthan, E., Furmark, T., Nilsson-Ihrfelt, E., Buhrman, M., & Ekselius, L. (2006) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.74.4.677 · Cited by 382 · cited 1×
“Information is depicted in Multimedia Appendix 5 [64-101] and Multimedia Appendix 6 [102-120] on the iCBT service–related characteristics.”
BackgroundTitov, N., Dear, B. F., Johnston, L., Lorian, C., Zou, J., Wootton, B., Spence, J., McEvoy, P. M., & Rapee, R. M. (2013) · PLoS ONE · doi:10.1371/journal.pone.0062873 · Cited by 364
Self-citationICBT in routine care: A descriptive analysis of successful clinics in five countries
Titov, N., Dear, B., Nielssen, O., Staples, L., Hadjistavropoulos, H., Nugent, M., Adlam, K., Nordgreen, T., Bruvik, K. H., Hovland, A., et al. (2018) · Internet Interventions · doi:10.1016/j.invent.2018.07.006 · Cited by 353
Self-citationJosephine, K., Josefine, L., Philipp, D., David, E., & Harald, B. (2017) · Journal of Affective Disorders · doi:10.1016/j.jad.2017.07.021 · Cited by 341 · cited 4×
“Königbauer et al [12] found medium to large pre-post within-group effects ranging between −0.64 and −2.24 for interventions treating clinical depression [12].”
BackgroundInfluentialSelf-citationPsychological treatment of depression: Results of a series of meta-analyses
Cuijpers, P., Andersson, G., Donker, T., & van Straten, A. (2011) · Nordic Journal of Psychiatry · doi:10.3109/08039488.2011.596570 · Cited by 335 · cited 1×
“Given that, for example, the chronicity of depression is associated with worse treatment outcomes [172], the difference in effect might be explained by reaching a population with lower chronicity.”
BackgroundSelf-citationAndersson, G., Carlbring, P., Titov, N., & Lindefors, N. (2019) · The Canadian Journal of Psychiatry · doi:10.1177/0706743719839381 · Cited by 324 · cited 2×
“Furthermore, we conducted reference tracking on the identified studies and previous meta-analyses in the field [5,14,15,27].”
BackgroundMethodSelf-citationGreist, J. H., Marks, I. M., Baer, L., Kobak, K. A., Wenzel, K. W., Hirsch, M. J., Mantle, J. M., & Clary, C. M. (2002) · The Journal of Clinical Psychiatry · doi:10.4088/jcp.v63n0209 · Cited by 321 · cited 1×
“Information is depicted in Multimedia Appendix 5 [64-101] and Multimedia Appendix 6 [102-120] on the iCBT service–related characteristics.”
BackgroundKaryotaki, E., Ebert, D. D., Donkin, L., Riper, H., Twisk, J., Burger, S., Rozental, A., Lange, A., Williams, A. D., Zarski, A. C., et al. (2018) · Clinical Psychology Review · doi:10.1016/j.cpr.2018.06.007 · Cited by 303 · cited 4×
“This is in line with meta-analytic findings from RCTs on guided digital interventions for depression [124] and with studies directly comparing the effectiveness of iCBT services when treatment allocation was based on an automatic web-based assessment versus clinician assessment [173].”
BackgroundResultInfluentialSelf-citationCarlbring, P., Gunnarsdóttir, M., Hedensjö, L., Andersson, G., Ekselius, L., & Furmark, T. (2007) · British Journal of Psychiatry · doi:10.1192/bjp.bp.105.020107 · Cited by 293
Clinician-Assisted Internet-Based Treatment is Effective for Panic: A Randomized Controlled Trial
Wims, E., Titov, N., Andrews, G., & Choi, I. (2010) · Australian & New Zealand Journal of Psychiatry · doi:10.3109/00048671003614171 · Cited by 290 · cited 1×
“40 (please see Multimedia Appendix 8 for references) [133-162] compared with 0.”
BackgroundSelf-citationHedman, E., Andersson, G., Ljótsson, B., Andersson, E., Rück, C., Mörtberg, E., & Lindefors, N. (2011) · PLoS ONE · doi:10.1371/journal.pone.0018001 · Cited by 285 · cited 1×
“40 (please see Multimedia Appendix 8 for references) [133-162] compared with 0.”
BackgroundTransdiagnostic internet treatment for anxiety and depression: a randomised controlled trial
Titov, N., Dear, B. F., Schwencke, G., Andrews, G., Johnston, L., Craske, M. G., & McEvoy, P. (2011) · Behaviour Research and Therapy · doi:10.1016/j.brat.2011.03.007 · Cited by 285 · cited 1×
“40 (please see Multimedia Appendix 8 for references) [133-162] compared with 0.”
BackgroundSelf-citationMack, S., Jacobi, F., Gerschler, A., Strehle, J., Höfler, M., Busch, M. A., Maske, U. E., Hapke, U., Seiffert, I., Gaebel, W., et al. (2014) · International Journal of Methods in Psychiatric Research · doi:10.1002/mpr.1438 · Cited by 284 · cited 2×
“Furthermore, research on patients’ preferences has shown that many do neither make use of psychotherapeutic treatments nor do they receive psychopharmacological treatment [7].”
BackgroundRobinson, E., Titov, N., Andrews, G., McIntyre, K., Schwencke, G., & Solley, K. (2010) · PLoS ONE · doi:10.1371/journal.pone.0010942 · Cited by 277 · cited 1×
“40 (please see Multimedia Appendix 8 for references) [133-162] compared with 0.”
BackgroundSelf-citationThe effects of fifteen evidence-supported therapies for adult depression: A meta-analytic review
Cuijpers, P., Karyotaki, E., de Wit, L., & Ebert, D. D. (2020) · Psychotherapy Research · doi:10.1080/10503307.2019.1649732 · Cited by 276 · cited 2×
“Furthermore, we conducted reference tracking on the identified studies and previous meta-analyses in the field [5,14,15,27].”
BackgroundMethodSelf-citationBerger, T., Caspar, F., Richardson, R., Kneubühler, B., Sutter, D., & Andersson, G. (2011) · Behaviour Research and Therapy · doi:10.1016/j.brat.2010.12.007 · Cited by 265 · cited 1×
“40 (please see Multimedia Appendix 8 for references) [133-162] compared with 0.”
BackgroundTreatment of panic disorder via the internet: A randomized trial of a self-help program
Carlbring, P., Westling, B. E., Ljungstrand, P., Ekselius, L., & Andersson, G. (2001) · Behavior Therapy · doi:10.1016/s0005-7894(01)80019-8 · Cited by 262 · cited 1×
“Information is depicted in Multimedia Appendix 5 [64-101] and Multimedia Appendix 6 [102-120] on the iCBT service–related characteristics.”
BackgroundCarlbring, P., Bohman, S., Brunt, S., Buhrman, M., Westling, B. E., Ekselius, L., & Andersson, G. (2006) · American Journal of Psychiatry · doi:10.1176/ajp.2006.163.12.2119 · Cited by 262 · cited 1×
“40 (please see Multimedia Appendix 8 for references) [133-162] compared with 0.”
BackgroundResearcher allegiance in psychotherapy outcome research: An overview of reviews
Munder, T., Brütsch, O., Leonhart, R., Gerger, H., & Barth, J. (2013) · Clinical Psychology Review · doi:10.1016/j.cpr.2013.02.002 · Cited by 260 · cited 1×
“Although the validity of other indicators has been questioned, the involvement of a researcher in developing the treatment under investigation can be considered a valid indicator of potential researcher allegiance [36].”
BackgroundGuided and unguided self-help for social anxiety disorder: randomised controlled trial
Furmark, T., Carlbring, P., Hedman, E., Sonnenstein, A., Clevberger, P., Bohman, B., Eriksson, A., Hållén, A., Frykman, M., Holmström, A., et al. (2009) · British Journal of Psychiatry · doi:10.1192/bjp.bp.108.060996 · Cited by 256 · cited 1×
“40 (please see Multimedia Appendix 8 for references) [133-162] compared with 0.”
BackgroundEbert, D. D., Cuijpers, P., Muñoz, R. F., & Baumeister, H. (2017) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2017.00116 · Cited by 244
Self-citationKendrick, T., El-Gohary, M., Stuart, B., Gilbody, S., Churchill, R., Aiken, L., Bhattacharya, A., Gimson, A., Brütt, A. L., de Jong, K., et al. (2016) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd011119.pub2 · Cited by 237 · cited 1×
“of the effects of routine outcome monitoring in routinely applied iCBT [169], as this monitoring could help evaluate participants’ progress throughout the course of treatment, using standardized outcome measures to elicit clients as part of a measurement-based care delivery approach in routine mental and behavioral he…”
MethodEfficacy of internet therapy for panic disorder
Klein, B., Richards, J. C., & Austin, D. W. (2006) · Journal of Behavior Therapy and Experimental Psychiatry · doi:10.1016/j.jbtep.2005.07.001 · Cited by 236 · cited 1×
“Information is depicted in Multimedia Appendix 5 [64-101] and Multimedia Appendix 6 [102-120] on the iCBT service–related characteristics.”
BackgroundBuntrock, C., Ebert, D. D., Lehr, D., Smit, F., Riper, H., Berking, M., & Cuijpers, P. (2016) · JAMA · doi:10.1001/jama.2016.4326 · Cited by 232
Self-citationDear, B. F., Staples, L. G., Terides, M. D., Karin, E., Zou, J., Johnston, L., Gandy, M., Fogliati, V. J., Wootton, B. M., McEvoy, P. M., et al. (2015) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2015.09.003 · Cited by 230 · cited 1×
“Information is depicted in Multimedia Appendix 5 [64-101] and Multimedia Appendix 6 [102-120] on the iCBT service–related characteristics.”
BackgroundSelf-citationIndividually-tailored, internet-based treatment for anxiety disorders: a randomized controlled trial
Carlbring, P., Maurin, L., Törngren, C., Linna, E., Eriksson, T., Sparthan, E., Strååt, M., Marquez von Hage, C., Bergman-Nordgren, L., & Andersson, G. (2011) · Behaviour Research and Therapy · doi:10.1016/j.brat.2010.10.002 · Cited by 227 · cited 1×
“40 (please see Multimedia Appendix 8 for references) [133-162] compared with 0.”
BackgroundVernmark, K., Lenndin, J., Bjärehed, J., Carlsson, M., Karlsson, J., Öberg, J., Carlbring, P., Eriksson, T., & Andersson, G. (2010) · Behaviour Research and Therapy · doi:10.1016/j.brat.2010.01.005 · Cited by 226 · cited 1×
“Information is depicted in Multimedia Appendix 5 [64-101] and Multimedia Appendix 6 [102-120] on the iCBT service–related characteristics.”
BackgroundMARKS, I. M., KENWRIGHT, M., McDONOUGH, M., WHITTAKER, M., & MATAIX-COLS, D. (2004) · Psychological Medicine · doi:10.1017/s003329170300878x · Cited by 226 · cited 1×
“Information is depicted in Multimedia Appendix 5 [64-101] and Multimedia Appendix 6 [102-120] on the iCBT service–related characteristics.”
BackgroundHedman, E., Ljótsson, B., Kaldo, V., Hesser, H., El Alaoui, S., Kraepelien, M., Andersson, E., Rück, C., Svanborg, C., Andersson, G., et al. (2014) · Journal of Affective Disorders · doi:10.1016/j.jad.2013.10.023 · Cited by 224 · cited 3×
“Removing these studies [47-49], and the depression group in the study by Ruwaard et al [50], from the analysis did not result in meaningful changes in effect sizes (g=1.”
BackgroundNieuwenhuijsen, K., de Boer, A. G. E. M., Verbeek, J. H. A. M., Blonk, R. W. B., & van Dijk, F. J. H. (2003) · Occupational and Environmental Medicine · doi:10.1136/oem.60.suppl_1.i77 · Cited by 223
Titov, N., Dear, B. F., Staples, L. G., Terides, M. D., Karin, E., Sheehan, J., Johnston, L., Gandy, M., Fogliati, V. J., Wootton, B. M., et al. (2015) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2015.08.002 · Cited by 223 · cited 3×
“Multimedia Appendix 7 [81,121-123] comprises the results of the negative effects.”
BackgroundSelf-citationTitov, N., Andrews, G., Choi, I., Schwencke, G., & Mahoney, A. (2008) · Australian & New Zealand Journal of Psychiatry · doi:10.1080/00048670802512107 · Cited by 221 · cited 1×
“40 (please see Multimedia Appendix 8 for references) [133-162] compared with 0.”
BackgroundSelf-citationSander, L., Rausch, L., & Baumeister, H. (2016) · JMIR Mental Health · doi:10.2196/mental.6061 · Cited by 218
Self-citationDonohue, J. M., & Pincus, H. A. (2007) · PharmacoEconomics · doi:10.2165/00019053-200725010-00003 · Cited by 214
Hans, E., & Hiller, W. (2013) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0031080 · Cited by 211 · cited 1×
“We defined routine care studies as effectiveness studies, which were conducted as nonrandomized clinical trials in settings equal to or representative of routine practice [28].”
MethodBergström, J., Andersson, G., Ljótsson, B., Rück, C., Andréewitch, S., Karlsson, A., Carlbring, P., Andersson, E., & Lindefors, N. (2010) · BMC Psychiatry · doi:10.1186/1471-244x-10-54 · Cited by 202 · cited 1×
“40 (please see Multimedia Appendix 8 for references) [133-162] compared with 0.”
BackgroundInternet-based treatment for social phobia: A randomized controlled trial
Berger, T., Hohl, E., & Caspar, F. (2009) · Journal of Clinical Psychology · doi:10.1002/jclp.20603 · Cited by 198 · cited 1×
“40 (please see Multimedia Appendix 8 for references) [133-162] compared with 0.”
BackgroundTransdiagnostic Internet treatment for anxiety disorders: A randomized controlled trial
Titov, N., Andrews, G., Johnston, L., Robinson, E., & Spence, J. (2010) · Behaviour Research and Therapy · doi:10.1016/j.brat.2010.05.014 · Cited by 196 · cited 1×
“40 (please see Multimedia Appendix 8 for references) [133-162] compared with 0.”
BackgroundSelf-citationPragmatic evaluation of computer-aided self-help for anxiety and depression
Marks, I. M., Mataix-Cols, D., Kenwright, M., Cameron, R., Hirsch, S., & Gega, L. (2003) · British Journal of Psychiatry · doi:10.1192/bjp.183.1.57 · Cited by 185
Ruwaard, J., Schrieken, B., Schrijver, M., Broeksteeg, J., Dekker, J., Vermeulen, H., & Lange, A. (2009) · Cognitive Behaviour Therapy · doi:10.1080/16506070802408086 · Cited by 183 · cited 1×
“Information is depicted in Multimedia Appendix 5 [64-101] and Multimedia Appendix 6 [102-120] on the iCBT service–related characteristics.”
BackgroundTitov, N., Dear, B. F., Staples, L. G., Bennett-Levy, J., Klein, B., Rapee, R. M., Andersson, G., Purtell, C., Bezuidenhout, G., & Nielssen, O. B. (2017) · Australian & New Zealand Journal of Psychiatry · doi:10.1177/0004867416671598 · Cited by 183 · cited 5×
“Removing studies [51,52] as well as PTSD and panic disorder studies by Ruwaard et al [50] and PTSD study by Titov et al [53] from the analysis did not influence the result significantly (g=0.”
BackgroundInfluentialSelf-citationAnxiety sensitivity: multiple dimensions and hierarchic structure
Taylor, S., & Cox, B. J. (1998) · Behaviour Research and Therapy · doi:10.1016/s0005-7967(97)00071-5 · Cited by 181 · cited 1×
“Information is depicted in Multimedia Appendix 5 [64-101] and Multimedia Appendix 6 [102-120] on the iCBT service–related characteristics.”
BackgroundShyness 1: Distance Treatment of Social Phobia Over the Internet
Titov, N., Andrews, G., Schwencke, G., Drobny, J., & Einstein, D. (2008) · Australian & New Zealand Journal of Psychiatry · doi:10.1080/00048670802119762 · Cited by 180 · cited 1×
“Information is depicted in Multimedia Appendix 5 [64-101] and Multimedia Appendix 6 [102-120] on the iCBT service–related characteristics.”
BackgroundSelf-citationNobis, S., Lehr, D., Ebert, D. D., Baumeister, H., Snoek, F., Riper, H., & Berking, M. (2015) · Diabetes Care · doi:10.2337/dc14-1728 · Cited by 175 · cited 1×
“Information is depicted in Multimedia Appendix 5 [64-101] and Multimedia Appendix 6 [102-120] on the iCBT service–related characteristics.”
BackgroundSelf-citationThe Effectiveness of Online Cognitive Behavioral Treatment in Routine Clinical Practice
Ruwaard, J., Lange, A., Schrieken, B., Dolan, C. V., & Emmelkamp, P. (2012) · PLoS ONE · doi:10.1371/journal.pone.0040089 · Cited by 173
Allegiance in psychotherapy outcome research: Separating association from bias.
Leykin, Y., & DeRubeis, R. J. (2009) · Clinical Psychology: Science and Practice · doi:10.1111/j.1468-2850.2009.01143.x · Cited by 170 · cited 1×
“For the present risk of bias assessment, we discussed the aforementioned assessment tools among all coauthors of this manuscript and derived the analysis criteria described in Multimedia Appendix 3 [35].”
MethodEffectiveness of Guided Internet-Based Cognitive Behavior Therapy in Regular Clinical Settings
Andersson, G., & Hedman, E. (2013) · Verhaltenstherapie · doi:10.1159/000354779 · Cited by 165 · cited 3×
“Andersson and Hedman [25] reported on the effectiveness of iCBT within four controlled trials and eight open studies for a multitude of mental health problems, indicating that it might be possible to replicate the findings of controlled efficacy trials on guided iCBT in clinical practice.”
BackgroundInfluentialBerger, T., Boettcher, J., & Caspar, F. (2014) · Psychotherapy · doi:10.1037/a0032527 · Cited by 158
Ebert, D. D., Donkin, L., Andersson, G., Andrews, G., Berger, T., Carlbring, P., Rozenthal, A., Choi, I., Laferton, J. A. C., Johansson, R., et al. (2016) · Psychological Medicine · doi:10.1017/s0033291716001562 · Cited by 154 · cited 2×
“Their investigation is of specific importance within naturalistic study designs and under routine care conditions [164,165,167].”
BackgroundSelf-citationJohnston, L., Titov, N., Andrews, G., Spence, J., & Dear, B. F. (2011) · PLoS ONE · doi:10.1371/journal.pone.0028079 · Cited by 150
Self-citationTherapist-supported Internet cognitive behavioural therapy for anxiety disorders in adults
Olthuis, J. V., Watt, M. C., Bailey, K., Hayden, J. A., & Stewart, S. H. (2015) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd011565 · Cited by 150
Hermes, E. D., Lyon, A. R., Schueller, S. M., & Glass, J. E. (2019) · Journal of Medical Internet Research · doi:10.2196/11752 · Cited by 149 · cited 1×
“Proctor et al [176] suggested a list of outcomes for implementation-related research, and Hermes et al [177] recently made suggestions on how to build upon these ideas to establish a measurement system for the implementation of behavioral intervention technologies.”
BackgroundPaxling, B., Almlöv, J., Dahlin, M., Carlbring, P., Breitholtz, E., Eriksson, T., & Andersson, G. (2011) · Cognitive Behaviour Therapy · doi:10.1080/16506073.2011.576699 · Cited by 147 · cited 1×
“40 (please see Multimedia Appendix 8 for references) [133-162] compared with 0.”
BackgroundNordgren, L. B., Hedman, E., Etienne, J., Bodin, J., Kadowaki, Å., Eriksson, S., Lindkvist, E., Andersson, G., & Carlbring, P. (2014) · Behaviour Research and Therapy · doi:10.1016/j.brat.2014.05.007 · Cited by 145
Hedman, E., Ljótsson, B., Rück, C., Bergström, J., Andersson, G., Kaldo, V., Jansson, L., Andersson, E., Andersson, E., Blom, K., et al. (2013) · Acta Psychiatrica Scandinavica · doi:10.1111/acps.12079 · Cited by 144 · cited 1×
“The full references of the included studies are listed in Multimedia Appendix 4 (Etzelmueller et al, unpublished data, 2020) [47-63].”
BackgroundSpence, J., Titov, N., Dear, B. F., Johnston, L., Solley, K., Lorian, C., Wootton, B., Zou, J., & Schwenke, G. (2011) · Depression and Anxiety · doi:10.1002/da.20835 · Cited by 143 · cited 1×
“40 (please see Multimedia Appendix 8 for references) [133-162] compared with 0.”
BackgroundSelf-citationRozental, A., Magnusson, K., Boettcher, J., Andersson, G., & Carlbring, P. (2017) · Journal of Consulting and Clinical Psychology · doi:10.1037/ccp0000158 · Cited by 137 · cited 2×
“Their investigation is of specific importance within naturalistic study designs and under routine care conditions [164,165,167].”
BackgroundShyness 2: Treating Social Phobia Online: Replication and Extension
Titov, N., Andrews, G., & Schwencke, G. (2008) · Australian & New Zealand Journal of Psychiatry · doi:10.1080/00048670802119820 · Cited by 133 · cited 1×
“Information is depicted in Multimedia Appendix 5 [64-101] and Multimedia Appendix 6 [102-120] on the iCBT service–related characteristics.”
BackgroundSelf-citationRemote treatment of obsessive-compulsive disorder: A randomized controlled trial
Wootton, B. M., Dear, B. F., Johnston, L., Terides, M. D., & Titov, N. (2013) · Journal of Obsessive-Compulsive and Related Disorders · doi:10.1016/j.jocrd.2013.07.002 · Cited by 125 · cited 1×
“40 (please see Multimedia Appendix 8 for references) [133-162] compared with 0.”
BackgroundSelf-citationRozental, A., Castonguay, L., Dimidjian, S., Lambert, M., Shafran, R., Andersson, G., & Carlbring, P. (2018) · BJPsych Open · doi:10.1192/bjo.2018.42 · Cited by 124
Ebert, D. D., Lehr, D., Heber, E., Riper, H., Cuijpers, P., & Berking, M. (2016) · Scandinavian Journal of Work, Environment & Health · doi:10.5271/sjweh.3573 · Cited by 120 · cited 1×
“Information is depicted in Multimedia Appendix 5 [64-101] and Multimedia Appendix 6 [102-120] on the iCBT service–related characteristics.”
BackgroundSelf-citationInternet-Guided Self-Help with or without Exposure Therapy for Phobic and Panic Disorders
Schneider, A. J., Mataix-Cols, D., Marks, I. M., & Bachofen, M. (2005) · Psychotherapy and Psychosomatics · doi:10.1159/000084000 · Cited by 118 · cited 1×
“Information is depicted in Multimedia Appendix 5 [64-101] and Multimedia Appendix 6 [102-120] on the iCBT service–related characteristics.”
BackgroundZarski, A.-C., Lehr, D., Berking, M., Riper, H., Cuijpers, P., & Ebert, D. D. (2016) · Journal of Medical Internet Research · doi:10.2196/jmir.4493 · Cited by 114 · cited 1×
“Furthermore, the interventions were considered as guided when the guidance was related to the therapeutic content [29] and as blended when the internet-based intervention was combined with face-to-face elements in one integrated standardized treatment protocol [27].”
BackgroundSelf-citationJones, S. L., Hadjistavropoulos, H. D., & Soucy, J. N. (2016) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2015.10.006 · Cited by 110 · cited 1×
“40 (please see Multimedia Appendix 8 for references) [133-162] compared with 0.”
BackgroundRichards, D., Timulak, L., O'Brien, E., Hayes, C., Vigano, N., Sharry, J., & Doherty, G. (2015) · Behaviour Research and Therapy · doi:10.1016/j.brat.2015.10.005 · Cited by 109
Negative effects of psychotherapies for adult depression: A meta-analysis of deterioration rates
Cuijpers, P., Reijnders, M., Karyotaki, E., de Wit, L., & Ebert, D. D. (2018) · Journal of Affective Disorders · doi:10.1016/j.jad.2018.05.050 · Cited by 105 · cited 1×
“8% [165]), and also comparable with deterioration rates in face-to-face psychotherapy for depression [166].”
BackgroundSelf-citationHadjistavropoulos, H. D., Nugent, M. M., Alberts, N. M., Staples, L., Dear, B. F., & Titov, N. (2016) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2016.05.006 · Cited by 103 · cited 1×
“The full references of the included studies are listed in Multimedia Appendix 4 (Etzelmueller et al, unpublished data, 2020) [47-63].”
BackgroundSelf-citationAndersson, G., Waara, J., Jonsson, U., Malmaeus, F., Carlbring, P., & Öst, L. (2009) · Cognitive Behaviour Therapy · doi:10.1080/16506070902931326 · Cited by 101 · cited 1×
“40 (please see Multimedia Appendix 8 for references) [133-162] compared with 0.”
BackgroundIvarsson, D., Blom, M., Hesser, H., Carlbring, P., Enderby, P., Nordberg, R., & Andersson, G. (2014) · Internet Interventions · doi:10.1016/j.invent.2014.03.002 · Cited by 101 · cited 1×
“40 (please see Multimedia Appendix 8 for references) [133-162] compared with 0.”
BackgroundEbert, D. D., Nobis, S., Lehr, D., Baumeister, H., Riper, H., Auerbach, R. P., Snoek, F., Cuijpers, P., & Berking, M. (2017) · Diabetic Medicine · doi:10.1111/dme.13173 · Cited by 101 · cited 1×
“Using the internet to provide psychotherapeutic interventions may increase the coverage of usual care services [8,9] by providing highly accessible and scalable interventions reaching people who cannot be reached otherwise.”
BackgroundSelf-citationEl Alaoui, S., Hedman, E., Kaldo, V., Hesser, H., Kraepelien, M., Andersson, E., Rück, C., Andersson, G., Ljótsson, B., & Lindefors, N. (2015) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0039198 · Cited by 99
Ruwaard, J., Broeksteeg, J., Schrieken, B., Emmelkamp, P. M. G., & Lange, A. (2010) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2010.01.010 · Cited by 97 · cited 1×
“Information is depicted in Multimedia Appendix 5 [64-101] and Multimedia Appendix 6 [102-120] on the iCBT service–related characteristics.”
BackgroundTitov, N., Fogliati, V. J., Staples, L. G., Gandy, M., Johnston, L., Wootton, B., Nielssen, O., & Dear, B. F. (2016) · BJPsych Open · doi:10.1192/bjpo.bp.115.002139 · Cited by 93
Self-citationLittlewood, E., Duarte, A., Hewitt, C., Knowles, S., Palmer, S., Walker, S., Andersen, P., Araya, R., Barkham, M., Bower, P., et al. (2015) · Health Technology Assessment · doi:10.3310/hta191010 · Cited by 90 · cited 1×
“Information is depicted in Multimedia Appendix 5 [64-101] and Multimedia Appendix 6 [102-120] on the iCBT service–related characteristics.”
BackgroundSpence, J., Titov, N., Johnston, L., Jones, M. P., Dear, B. F., & Solley, K. (2014) · Journal of Affective Disorders · doi:10.1016/j.jad.2014.03.009 · Cited by 89 · cited 1×
“Information is depicted in Multimedia Appendix 5 [64-101] and Multimedia Appendix 6 [102-120] on the iCBT service–related characteristics.”
BackgroundSelf-citationShandley, K., Austin, D. W., Klein, B., Pier, C., Schattner, P., Pierce, D., & Wade, V. (2008) · Journal of Medical Internet Research · doi:10.2196/jmir.1033 · Cited by 84 · cited 3×
“Removing studies [51,52] as well as PTSD and panic disorder studies by Ruwaard et al [50] and PTSD study by Titov et al [53] from the analysis did not influence the result significantly (g=0.”
BackgroundTulbure, B. T., Szentagotai, A., David, O., Ștefan, S., Månsson, K. N. T., David, D., & Andersson, G. (2015) · PLOS ONE · doi:10.1371/journal.pone.0123997 · Cited by 81
Richards, J. C., Klein, B., & Austin, D. W. (2006) · Clinical Psychologist · doi:10.1080/13284200500378795 · Cited by 81 · cited 1×
“Information is depicted in Multimedia Appendix 5 [64-101] and Multimedia Appendix 6 [102-120] on the iCBT service–related characteristics.”
BackgroundHedman, E., El Alaoui, S., Lindefors, N., Andersson, E., Rück, C., Ghaderi, A., Kaldo, V., Lekander, M., Andersson, G., & Ljótsson, B. (2014) · Behaviour Research and Therapy · doi:10.1016/j.brat.2014.05.010 · Cited by 79 · cited 1×
“40 (please see Multimedia Appendix 8 for references) [133-162] compared with 0.”
BackgroundHadjistavropoulos, H. D., Pugh, N. E., Nugent, M., Hesser, H., Andersson, G., Ivanov, M., Butz, C. G., Marchildon, G. P., Asmundson, G. J. G., Klein, B., et al. (2014) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2014.09.018 · Cited by 78 · cited 1×
“The full references of the included studies are listed in Multimedia Appendix 4 (Etzelmueller et al, unpublished data, 2020) [47-63].”
BackgroundBuntrock, C., Berking, M., Smit, F., Lehr, D., Nobis, S., Riper, H., Cuijpers, P., & Ebert, D. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.6587 · Cited by 78 · cited 1×
“Information is depicted in Multimedia Appendix 5 [64-101] and Multimedia Appendix 6 [102-120] on the iCBT service–related characteristics.”
Self-citationThe Challenges of Improving Treatments for Depression
Cuijpers, P. (2018) · JAMA · doi:10.1001/jama.2018.17824 · Cited by 78 · cited 1×
“This result also supports the hypothesis that findings on pre-post changes in symptom severity might have been influenced by spontaneous or unexplained recovery, which is a common factor in depression [174].”
ResultSelf-citationThe merits of implementing routine outcome monitoring in clinical practice.
Lambert, M. J., & Harmon, K. L. (2018) · Clinical Psychology: Science and Practice · doi:10.1111/cpsp.12268 · Cited by 74 · cited 1×
“of the effects of routine outcome monitoring in routinely applied iCBT [169], as this monitoring could help evaluate participants’ progress throughout the course of treatment, using standardized outcome measures to elicit clients as part of a measurement-based care delivery approach in routine mental and behavioral he…”
MethodSilfvernagel, K., Carlbring, P., Kabo, J., Edström, S., Eriksson, J., Månson, L., & Andersson, G. (2012) · Journal of Medical Internet Research · doi:10.2196/jmir.1853 · Cited by 69 · cited 1×
“40 (please see Multimedia Appendix 8 for references) [133-162] compared with 0.”
BackgroundNordgreen, T., Haug, T., Öst, L.-G., Andersson, G., Carlbring, P., Kvale, G., Tangen, T., Heiervang, E., & Havik, O. E. (2016) · Behavior Therapy · doi:10.1016/j.beth.2015.10.004 · Cited by 64 · cited 1×
“Information is depicted in Multimedia Appendix 5 [64-101] and Multimedia Appendix 6 [102-120] on the iCBT service–related characteristics.”
Backgroundvan der Lem, R., van der Wee, N. J. A., van Veen, T., & Zitman, F. G. (2012) · Psychotherapy and Psychosomatics · doi:10.1159/000330890 · Cited by 63
Andersson, G., Waara, J., Jonsson, U., Malmaeus, F., Carlbring, P., & Öst, L.-G. (2013) · Cognitive Behaviour Therapy · doi:10.1080/16506073.2013.844202 · Cited by 59 · cited 1×
“40 (please see Multimedia Appendix 8 for references) [133-162] compared with 0.”
BackgroundMewton, L. R., & Andrews, G. (2014) · Journal of Affective Disorders · doi:10.1016/j.jad.2014.08.038 · Cited by 57 · cited 1×
“However, a large-scale study showed that iCBT services can also result in positive effects on suicidality, reducing the prevalence of suicidal ideation from 50% at baseline to 27% after treatment [168].”
BackgroundAn internet-based guided self-help intervention for panic symptoms: randomized controlled trial
van Ballegooijen, W., Riper, H., Klein, B., Ebert, D. D., Kramer, J., Meulenbeek, P., & Cuijpers, P. (2013) · Journal of Medical Internet Research · doi:10.2196/jmir.2362 · Cited by 56
Self-citationNordgreen, T., Gjestad, R., Andersson, G., Carlbring, P., & Havik, O. E. (2018) · Internet Interventions · doi:10.1016/j.invent.2018.05.003 · Cited by 56
The Value of Phase 4 Clinical Testing
Vlahakes, G. J. (2006) · New England Journal of Medicine · doi:10.1056/nejme058272 · Cited by 54 · cited 1×
“Hence, after establishing the efficacy of an intervention and its subsequent implementation, the so-called phase IV clinical trials should follow investigating benefits when implemented as well as potential negative effects implemented [23,24].”
BackgroundOromendia, P., Orrego, J., Bonillo, A., & Molinuevo, B. (2016) · Cognitive Behaviour Therapy · doi:10.1080/16506073.2016.1163615 · Cited by 52 · cited 1×
“40 (please see Multimedia Appendix 8 for references) [133-162] compared with 0.”
BackgroundRomijn, G., Batelaan, N., Kok, R., Koning, J., van Balkom, A., Titov, N., & Riper, H. (2019) · Journal of Medical Internet Research · doi:10.2196/11706 · Cited by 52 · cited 5×
“They also found that effects were smaller in samples recruited in clinical practice than in samples recruited with an open recruitment method compared with waitlist-control groups [13], which raises the question of the effects of iCBT when implemented in routine practice.”
BackgroundResultInfluentialSelf-citationNordgreen, T., Gjestad, R., Andersson, G., Carlbring, P., & Havik, O. E. (2017) · Cognitive Behaviour Therapy · doi:10.1080/16506073.2017.1348389 · Cited by 51 · cited 1×
“The full references of the included studies are listed in Multimedia Appendix 4 (Etzelmueller et al, unpublished data, 2020) [47-63].”
BackgroundKok, R. N., van Straten, A., Beekman, A. T. F., & Cuijpers, P. (2014) · Journal of Medical Internet Research · doi:10.2196/jmir.3429 · Cited by 49 · cited 1×
“40 (please see Multimedia Appendix 8 for references) [133-162] compared with 0.”
Self-citationAydos, L., Titov, N., & Andrews, G. (2009) · Australasian Psychiatry · doi:10.1080/10398560903284943 · Cited by 49 · cited 1×
“The full references of the included studies are listed in Multimedia Appendix 4 (Etzelmueller et al, unpublished data, 2020) [47-63].”
BackgroundSelf-citationMathiasen, K., Riper, H., Andersen, T. E., & Roessler, K. K. (2018) · Journal of Medical Internet Research · doi:10.2196/10927 · Cited by 45 · cited 1×
“The full references of the included studies are listed in Multimedia Appendix 4 (Etzelmueller et al, unpublished data, 2020) [47-63].”
BackgroundSelf-citationAllen, A. R., Newby, J. M., Mackenzie, A., Smith, J., Boulton, M., Loughnan, S. A., & Andrews, G. (2016) · BJPsych Open · doi:10.1192/bjpo.bp.115.001826 · Cited by 43
Nobis, S., Ebert, D. D., Lehr, D., Smit, F., Buntrock, C., Berking, M., Baumeister, H., Snoek, F., Funk, B., & Riper, H. (2018) · The British Journal of Psychiatry · doi:10.1192/bjp.2018.10 · Cited by 43 · cited 1×
“Information is depicted in Multimedia Appendix 5 [64-101] and Multimedia Appendix 6 [102-120] on the iCBT service–related characteristics.”
BackgroundSelf-citationGuided self-help via internet for panic disorder: Dissemination across countries
Nordgreen, T., Standal, B., Mannes, H. L., Haug, T. T., Sivertsen, B., Carlbring, P., Andersson, G., Heiervang, E. R., & Havik, O. E. (2010) · Computers in Human Behavior · doi:10.1016/j.chb.2009.12.011 · Cited by 35 · cited 1×
“Information is depicted in Multimedia Appendix 5 [64-101] and Multimedia Appendix 6 [102-120] on the iCBT service–related characteristics.”
BackgroundMathiasen, K., Riper, H., Ehlers, L. H., Valentin, J. B., & Rosenberg, N. K. (2016) · Internet Interventions · doi:10.1016/j.invent.2016.03.001 · Cited by 29
Self-citationInternet-Based Self-help Interventions for Depression in Routine Care
Ebert, D. D., & Baumeister, H. (2017) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2017.1394 · Cited by 29 · cited 2×
“This is important as we strive to report routine care results free from biases possibly being introduced within efficacy studies such as stricter application of protocolized procedures, eligibility criteria, and randomization [19-22].”
BackgroundSelf-citationThe use of automated assessments in internet-based CBT: The computer will be with you shortly
Mason, E. C., & Andrews, G. (2014) · Internet Interventions · doi:10.1016/j.invent.2014.10.003 · Cited by 23 · cited 1×
“This is in line with meta-analytic findings from RCTs on guided digital interventions for depression [124] and with studies directly comparing the effectiveness of iCBT services when treatment allocation was based on an automatic web-based assessment versus clinician assessment [173].”
ResultMcClay, C.-A., Collins, K., Matthews, L., Haig, C. E., McConnachie, A., Morrison, J., Lynch, P., Waters, L., Day, I., McAnee, G., et al. (2015) · BMC Psychiatry · doi:10.1186/s12888-015-0384-2 · Cited by 21
Schlicker, S., Weisel, K. K., Buntrock, C., Berking, M., Nobis, S., Lehr, D., Baumeister, H., Snoek, F. J., Riper, H. M., & Ebert, D. D. (2019) · Journal of Diabetes Research · doi:10.1155/2019/2634094 · Cited by 20 · cited 1×
“Information is depicted in Multimedia Appendix 5 [64-101] and Multimedia Appendix 6 [102-120] on the iCBT service–related characteristics.”
BackgroundSelf-citationInternet- und Mobilebasierte Interventionen in der Psychotherapie
Lin, J., & Baumeister, H. (2015) · Public Health Forum · doi:10.1515/pubhef-2015-0063 · Cited by 19
Self-citationYu, J. S., Szigethy, E., Wallace, M., Solano, F., & Oser, M. (2018) · Telemedicine and e-Health · doi:10.1089/tmj.2017.0280 · Cited by 15 · cited 3×
“Removing studies [51,52] as well as PTSD and panic disorder studies by Ruwaard et al [50] and PTSD study by Titov et al [53] from the analysis did not influence the result significantly (g=0.”
BackgroundMorrison, C. P., Walker, G., Ruggeri, K., & Hughes, J. H. (2014) · The Cognitive Behaviour Therapist · doi:10.1017/s1754470x14000221 · Cited by 11 · cited 2×
“dExcluding one study [54], as this is the only study using clinical judgment without specifying the use of an interview or questionnaire.”
BackgroundMethodKlein, J. P., Knaevelsrud, C., Bohus, M., Ebert, D. D., Gerlinger, G., Günther, K., Jacobi, C., Löbner, M., Riedel-Heller, S. G., Sander, J., et al. (2019) · Fortschritte der Neurologie · Psychiatrie · doi:10.1055/a-0849-9902 · Cited by 11
Self-citation@Home eTherapy Service for People with Common Mental Health Problems: an Evaluation
Gellatly, J., Chisnall, L., Seccombe, N., Ragan, K., Lidbetter, N., & Cavanagh, K. (2018) · Behavioural and Cognitive Psychotherapy · doi:10.1017/s1352465817000297 · Cited by 10
Hill, T. (2016) · ecancermedicalscience · doi:10.3332/ecancer.2012.276 · Cited by 10
Buntrock, C., Ebert, D. D., Lehr, D., Smit, F., Riper, H. M., Berking, M., & Cuijpers, P. J. (2016) · Obstetrical & Gynecological Survey · doi:10.1097/01.ogx.0000490201.67580.e4 · Cited by 2 · cited 1×
“Information is depicted in Multimedia Appendix 5 [64-101] and Multimedia Appendix 6 [102-120] on the iCBT service–related characteristics.”
BackgroundSelf-citation(2009) · ecancermedicalscience · doi:10.3332/ecancer.2008.ltr160 · Cited by 1
Research works printed but not linked: 10
- Higgins, JP, 2006, Cochrane Handbook for Systematic Reviews of Interventions
- 2019, R: A Language and Environment for Statistical Computing
- Balk, EM, 2012, Methods Res Reports, 12, EHC141
- Sterne, J, 2006, Publication Bias in Meta-Analysis: Prevention, Assessment and Adjustments
- 10.1017/s1352465817000297 · DOI · Paper page
- 10.1186/1471-244x-10-54 · DOI · Paper page
- 10.1176/ajp.2006.163.12.2119 · DOI · Paper page
- 10.1192/bjp.bp.108.060996 · DOI · Paper page
- 10.1080/00048670802512107 · DOI · Paper page
- 10.1016/j.jocrd.2013.07.002 · DOI · Paper page
Cited by
The Lancet Psychiatry Commission on youth mental health
McGorry, P. D., Mei, C., Dalal, N., Alvarez-Jimenez, M., Blakemore, S.-J., Browne, V., Dooley, B., Hickie, I. B., Jones, P. B., McDaid, D., et al. (2024) · The Lancet Psychiatry · doi:10.1016/s2215-0366(24)00163-9 · Cited by 663
An overview of and recommendations for more accessible digital mental health services
Lattie, E. G., Stiles-Shields, C., & Graham, A. K. (2022) · Nature Reviews Psychology · doi:10.1038/s44159-021-00003-1 · Cited by 446
Aknin, L. B., De Neve, J.-E., Dunn, E. W., Fancourt, D. E., Goldberg, E., Helliwell, J. F., Jones, S. P., Karam, E., Layard, R., Lyubomirsky, S., et al. (2022) · Perspectives on Psychological Science · doi:10.1177/17456916211029964 · Cited by 418
“eCBT has been shown to be effective in treating depression, anxiety, and loneliness and should therefore be widely available (Etzelmueller et al., 2020; Masi et al., 2011; Phillips et al., 2019).”
BackgroundAknin, L. B., Neve, J. E. D., Dunn, E. W., Fancourt, D. E., Goldberg, E., Helliwell, J. F., Jones, S., Karam, E. G., Layard, R., Lyubomirsky, S., et al. (2021) · doi:10.31234/osf.io/zw93g · Cited by 131
A systematic review of digital and face-to-face cognitive behavioral therapy for depression
Kambeitz-Ilankovic, L., Rzayeva, U., Völkel, L., Wenzel, J., Weiske, J., Jessen, F., Reininghaus, U., Uhlhaas, P. J., Alvarez-Jimenez, M., & Kambeitz, J. (2022) · npj Digital Medicine · doi:10.1038/s41746-022-00677-8 · Cited by 103
“We used four previously established classification criteria to quantify the risk of bias each study (high, low or unclear risk of bias): (1) random sequence generation, (2) allocation concealment, (3) selective outcome reporting (4) incomplete outcome data (5) blinding of participants and study personnel (6) blinding…”
Method
Metadata
- Authors
- Etzelmueller, A., Vis, C., Karyotaki, E., Baumeister, H., Titov, N., Berking, M., Cuijpers, P., Riper, H., & Ebert, D. D.
- Affiliations
- Friedrich-Alexander-Universität Erlangen-Nürnberg (DE)
- Amsterdam Public Health (NL)
- Harvard University (US)
- Universität Ulm (DE)
- Macquarie University (AU)
- Corresponding author
- Etzelmueller, Anne
- ORCID
- Venue
- Journal of Medical Internet Research
- Publisher
- JMIR Publications Inc.
- Published
- 2020-08-31
- Volume
- 22
- Issue
- 8
- Pages
- e18100
- ISSN
- 1438-8871 (ISSN-L)
- PMC
- PMC7490682
- OpenAlex
- W3082630059
- Semantic Scholar
- 23fccf2e8835c63de7334b9c76877ce5bae34768
- Cited by
- 356
- References
- 176
- Citations by year
- 2026: 40 · 2025: 63 · 2024: 79 · 2023: 60 · 2022: 72 · 2021: 37 · 2020: 5
- FWCI
- 6.83
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- Journal of Medical Internet Research (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Pure Amsterdam UMC (publishedVersion, cc-by)
- Amsterdam UMC (VU Amsterdam) - Institutional Repository (publishedVersion, other-oa)
- VU Research Portal (publishedVersion, other-oa)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Data Archiving and Networked Services (DANS) (submittedVersion, other-oa)
- Topics
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Anxiety, Depression, Psychometrics, Treatment, Cognitive Processes
- Health Sciences › Medicine › Psychiatry and Mental health › Mental Health Treatment and Access
- Keywords
- internet-based cognitive behavioral therapy, depression, anxiety, usual care, acceptability, medication adherence, participant satisfaction, treatment uptake, treatment deterioration, digital mental health interventions
- MeSH terms
- Internet-Based Intervention, Adult, Anxiety Disorders, Depression, Female, Humans, Male, Cognitive Behavioral Therapy, Young Adult
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-05, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-05 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (qwen3.8-omni-flash and gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.