Effectiveness of a Web-Based Guided Self-help Intervention for Outpatients With a Depressive Disorder: Short-term Results From a Randomized Controlled Trial
Open accessThe DOI matches its Crossref record; 25 of the 25 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Research has convincingly demonstrated that symptoms of depression can be reduced through guided Internet-based interventions. However, most of those studies recruited people form the general population. There is insufficient evidence for the effectiveness when delivered in routine clinical practice in outpatient clinics. OBJECTIVE: The objective of this randomized controlled trial was to study patients with a depressive disorder (as defined by the Diagnostic and Statistical Manual of Disorders, fourth edition), as assessed by trained interviewers with the Composite International Diagnostic Interview, who registered for treatment at an outpatient mental health clinic. We aimed to examine the effectiveness of guided Internet-based self-help before starting face-to-face treatment. METHODS: We recruited 269 outpatients, aged between 18 and 79 years, from outpatient clinics and randomly allocated them to Internet-based problem solving therapy (n=136), with weekly student support, or to a control condition, who remained on the waitlist with a self-help booklet (control group; n=133). Participants in both conditions were allowed to take up face-to-face treatment at the outpatient clinics afterward. We measured the primary outcome, depressive symptoms, by Center for Epidemiological Studies Depression scale (CES-D). Secondary outcome measures were the Hospital Anxiety and Depression Scale Anxiety subscale (HADS-A), Insomnia Severity Index questionnaire (ISI), and EuroQol visual analog scale (EQ-5D VAS). All outcomes were assessed by telephone at posttest (8 weeks after baseline). RESULTS: Posttest measures were completed by 184 (68.4%) participants. We found a moderate to large within-group effect size for both the intervention (d=0.75) and the control (d=0.69) group. However, the between-group effect size was very small (d=0.07), and regression analysis on posttreatment CES-D scores revealed no significant differences between the groups (b=1.134, 95% CI -2.495 to 4.763). The per-protocol analysis (≥4 sessions completed) results were also not significant (b=1.154, 95% CI -1.978 to 7.637). Between-group differences were small and not significant for all secondary outcomes. Adherence to the intervention was low. Only 36% (49/136) received an adequate dosage of the intervention (≥4 of 5 sessions). The overall treatment satisfaction was moderate. CONCLUSIONS: Internet-based problem solving therapy is not more effective in reducing symptoms of depression than receiving an unguided self-help book during the waitlist period at outpatient mental health clinics. The effect sizes are much smaller than those found in earlier research in the general population, and the low rates of adherence indicate that the acceptability of the intervention at this stage of treatment for depressed outpatients is low. However, taking into account that there is much evidence for the efficacy of Internet-based treatments, it is too early to draw firm conclusions about the effectiveness of these treatments in outpatient clinics as a whole. TRIAL REGISTRATION: Netherlands Trial Register NTR2824; http://www.trialregister.nl/trialreg/admin/rctview.asp?TC=2824 (Archived by WebCite at http://www.webcitation/ 6g3WEuiqH).
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
CONSORT 2010 statement: updated guidelines for reporting parallel group randomized trials
Schulz, K. F., Altman, D. G., Moher, D., & for the CONSORT Group* (2010) · Annals of Internal Medicine · doi:10.7326/0003-4819-152-11-201006010-00232 · Cited by 3,824
SPINHOVEN, P., ORMEL, J., SLOEKERS, P. P. A., KEMPEN, G. I. J. M., SPECKENS, A. E. M., & HEMERT, A. M. V. (1997) · Psychological Medicine · doi:10.1017/s0033291796004382 · Cited by 2,158 · cited 1×
“The HADS has been shown to be reliable in Dutch populations [24].”
Internet-Based and Other Computerized Psychological Treatments for Adult Depression: A Meta-Analysis
Andersson, G., & Cuijpers, P. (2009) · Cognitive Behaviour Therapy · doi:10.1080/16506070903318960 · Cited by 1,368 · cited 1×
“When we designed this trial, the literature showed small effect sizes for unguided self-help (ranging from d= 0.06 to d= 0.28 [7-9]) and larger effect sizes for guided Internet interventions (ranging from d= 0.61 to d= 0.78 [7,8]) compared with waitlist controls.”
InfluentialSelf-citationAndrews, G., Cuijpers, P., Craske, M. G., McEvoy, P., & Titov, N. (2010) · PLoS ONE · doi:10.1371/journal.pone.0013196 · Cited by 1,311
Self-citationAndersson, G., Cuijpers, P., Carlbring, P., Riper, H., & Hedman, E. (2014) · World Psychiatry · doi:10.1002/wps.20151 · Cited by 1,077 · cited 1×
“Previous controlled studies have demonstrated that guided self-help is clinically effective in diverse populations [7-9] and that it has effects comparable with those of face-to-face treatments [10,11].”
Self-citationCuijpers, P., Donker, T., van Straten, A., Li, J., & Andersson, G. (2010) · Psychological Medicine · doi:10.1017/s0033291710000772 · Cited by 832
Self-citationHedman, E., Ljótsson, B., & Lindefors, N. (2012) · Expert Review of Pharmacoeconomics & Outcomes Research · doi:10.1586/erp.12.67 · Cited by 672 · cited 1×
“Although the efficacy of guided Internet-based treatment for depression has been firmly established [32], there is insufficient evidence of its effectiveness when delivered in routine outpatient mental health services.”
Depressive disorders in Europe: prevalence figures from the ODIN study
Ayuso-Mateos, J. L., Vázquez-Barquero, J. L., Dowrick, C., Lehtinen, V., Dalgard, O. S., Casey, P., Wilkinson, C., Lasa, L., Page, H., Dunn, G., et al. (2001) · British Journal of Psychiatry · doi:10.1192/bjp.179.4.308 · Cited by 564 · cited 1×
“Depressive disorders are highly prevalent [1].”
van Ballegooijen, W., Cuijpers, P., van Straten, A., Karyotaki, E., Andersson, G., Smit, J. H., & Riper, H. (2014) · PLoS ONE · doi:10.1371/journal.pone.0100674 · Cited by 409 · cited 1×
“The low adherence to this intervention is a cause for concern because it is far lower than generally found in Internet-based interventions for depression [12,34-36].”
Self-citationBerger, T., Hämmerli, K., Gubser, N., Andersson, G., & Caspar, F. (2011) · Cognitive Behaviour Therapy · doi:10.1080/16506073.2011.616531 · Cited by 383
Bower, P., Kontopantelis, E., Sutton, A., Kendrick, T., Richards, D. A., Gilbody, S., Knowles, S., Cuijpers, P., Andersson, G., Christensen, H., et al. (2013) · BMJ · doi:10.1136/bmj.f540 · Cited by 341
Self-citationvan Straten, A., Cuijpers, P., & Smits, N. (2008) · Journal of Medical Internet Research · doi:10.2196/jmir.954 · Cited by 297 · cited 8×
“Most previous trials examined the effects of Internet treatment in community samples [13,14], general practitioners’ offices [15], or specialized Internet clinics [12].”
InfluentialSelf-citationClinician-Assisted Internet-Based Treatment is Effective for Panic: A Randomized Controlled Trial
Wims, E., Titov, N., Andrews, G., & Choi, I. (2010) · Australian & New Zealand Journal of Psychiatry · doi:10.3109/00048671003614171 · Cited by 290 · cited 1×
“The low adherence to this intervention is a cause for concern because it is far lower than generally found in Internet-based interventions for depression [12,34-36].”
Internet-Based Treatment for Adults with Depressive Symptoms: Randomized Controlled Trial
Warmerdam, L., van Straten, A., Twisk, J., Riper, H., & Cuijpers, P. (2008) · Journal of Medical Internet Research · doi:10.2196/jmir.1094 · Cited by 255
Self-citationSelf-guided psychological treatment for depressive symptoms: a meta-analysis
Cuijpers, P., Donker, T., Johansson, R., Mohr, D. C., van Straten, A., & Andersson, G. (2011) · PLoS ONE · doi:10.1371/journal.pone.0021274 · Cited by 250 · cited 4×
“Previous research showed that self-guided interventions resulted in only small effect sizes on levels of depression [7-9].”
InfluentialSelf-citationBastien, C. H., Morin, C. M., Ouellet, M.-C., Blais, F. C., & Bouchard, S. (2004) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.72.4.653 · Cited by 243
Clinician-Assisted Internet-Based Treatment is Effective for Depression: Randomized Controlled Trial
Perini, S., Titov, N., & Andrews, G. (2009) · Australian & New Zealand Journal of Psychiatry · doi:10.1080/00048670902873722 · Cited by 231 · cited 1×
“The low adherence to this intervention is a cause for concern because it is far lower than generally found in Internet-based interventions for depression [12,34-36].”
Hedman, E., Ljótsson, B., Kaldo, V., Hesser, H., El Alaoui, S., Kraepelien, M., Andersson, E., Rück, C., Svanborg, C., Andersson, G., et al. (2014) · Journal of Affective Disorders · doi:10.1016/j.jad.2013.10.023 · Cited by 224 · cited 4×
“The results of our study also compare poorly with those of other studies of Internet-based cognitive behavioral therapy (iCBT) in routine care [12,15,34].”
InfluentialThe Effectiveness of Online Cognitive Behavioral Treatment in Routine Clinical Practice
Ruwaard, J., Lange, A., Schrieken, B., Dolan, C. V., & Emmelkamp, P. (2012) · PLoS ONE · doi:10.1371/journal.pone.0040089 · Cited by 173 · cited 2×
“The results of our study also compare poorly with those of other studies of Internet-based cognitive behavioral therapy (iCBT) in routine care [12,15,34].”
Høifødt, R. S., Lillevoll, K. R., Griffiths, K. M., Wilsgaard, T., Eisemann, M., Waterloo, K., & Kolstrup, N. (2013) · Journal of Medical Internet Research · doi:10.2196/jmir.2714 · Cited by 154 · cited 3×
“The results of our study also compare poorly with those of other studies of Internet-based cognitive behavioral therapy (iCBT) in routine care [12,15,34].”
Farrer, L., Christensen, H., Griffiths, K. M., & Mackinnon, A. (2011) · PLoS ONE · doi:10.1371/journal.pone.0028099 · Cited by 140 · cited 1×
“However, more recent studies that have directly compared guided with newer self-guided Internet-based interventions found no difference in clinical outcomes for depression and anxiety [37,38].”
Short report: How often do UK primary care trials face recruitment delays?
Bower, P., Wilson, S., & Mathers, N. (2007) · Family Practice · doi:10.1093/fampra/cmm051 · Cited by 135
A cross-national validation of the client satisfaction questionnaire: the Dutch experience
De Brey, H. (1983) · Evaluation and Program Planning · doi:10.1016/0149-7189(83)90018-6 · Cited by 109
Bowman, D., Scogin, F., & Lyrene, B. (1995) · Psychotherapy Research · doi:10.1080/10503309512331331256 · Cited by 83 · cited 1×
“As the intervention had already proven to be effective in community samples in different studies [13,14,20,21], we presented the intervention to the patients as a way to make a head start in their treatment during the waiting time.”
Kenter, R. M., van Straten, A., Hobbel, S., Smit, F., Bosmans, J., Beekman, A., & Cuijpers, P. (2013) · Trials · doi:10.1186/1745-6215-14-412 · Cited by 13 · cited 2×
“The intervention has been described in more detail in several other studies [13,14,17].”
Self-citation
Cited by
Erbe, D., Eichert, H.-C., Riper, H., & Ebert, D. D. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.6588 · Cited by 532
“One study failed to show a superiority of the iCBT waiting-list group compared with a control condition with participants who remained on the wait-list with a self-help booklet [83].”
Digital interventions for the treatment of depression: a meta-analytic review
Moshe, I., Terhorst, Y., Philippi, P., Domhardt, M., Cuijpers, P., Cristea, I., Pulkki-Råback, L., Baumeister, H., & Sander, L. B. (2021) · Psychological Bulletin · doi:10.1037/bul0000334 · Cited by 390
Self-citationJosephine, K., Josefine, L., Philipp, D., David, E., & Harald, B. (2017) · Journal of Affective Disorders · doi:10.1016/j.jad.2017.07.021 · Cited by 341
Karyotaki, E., Ebert, D. D., Donkin, L., Riper, H., Twisk, J., Burger, S., Rozental, A., Lange, A., Williams, A. D., Zarski, A. C., et al. (2018) · Clinical Psychology Review · doi:10.1016/j.cpr.2018.06.007 · Cited by 303
Self-citationLuedtke, A., Sadikova, E., & Kessler, R. C. (2019) · Clinical Psychological Science · doi:10.1177/2167702618815466 · Cited by 143
Metadata
- Authors
- Kenter, R. M. F., Cuijpers, P., Beekman, A., & van Straten, A.
- Venue
- Journal of Medical Internet Research
- Publisher
- JMIR Publications Inc.
- Published
- 2016-03-31
- Volume
- 18
- Issue
- 3
- Pages
- e80
- ISSN
- 1438-8871 (ISSN-L)
- OpenAlex
- W2321524765
- Cited by
- 65
- References
- 25
- FWCI
- 11.85
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.