Use of a Fully Automated Internet-Based Cognitive Behavior Therapy Intervention in a Community Population of Adults With Depression Symptoms: Randomized Controlled Trial
Open accessThe DOI matches its Crossref record; 39 of the 39 references it cites were found in a registry or an index.
Abstract
Background: Although internet-based cognitive behavior therapy (iCBT) interventions can reduce depression symptoms, large differences in their effectiveness exist. Objective: The aim of this study was to evaluate the effectiveness of an iCBT intervention called Thrive, which was designed to enhance engagement when delivered as a fully automated, stand-alone intervention to a rural community population of adults with depression symptoms. Methods: Using no diagnostic or treatment exclusions, 343 adults with depression symptoms were recruited from communities using an open-access website and randomized 1:1 to the Thrive intervention group or the control group. Using self-reports, participants were evaluated at baseline and 4 and 8 weeks for the primary outcome of depression symptom severity and secondary outcome measures of anxiety symptoms, work and social adjustment, psychological resilience, and suicidal ideation. Results: Over the 8-week follow-up period, the intervention group (n=181) had significantly lower depression symptom severity than the control group (n=162; P<.001), with a moderate treatment effect size (d=0.63). Moderate to near-moderate effect sizes favoring the intervention group were observed for anxiety symptoms (P<.001; d=0.47), work/social functioning (P<.001; d=0.39), and resilience (P<.001; d=0.55). Although not significant, the intervention group was 45% less likely than the control group to experience increased suicidal ideation (odds ratio 0.55). Conclusions: These findings suggest that the Thrive intervention was effective in reducing depression and anxiety symptom severity and improving functioning and resilience among a mostly rural community population of US adults. The effect sizes associated with Thrive were generally larger than those of other iCBT interventions delivered as a fully automated, stand-alone intervention. Trial Registration: ClinicalTrials.gov NCT03244878; https://clinicaltrials.gov/ct2/show/NCT03244878
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The PHQ-9: Validity of a brief depression severity measure
Kroenke, K., Spitzer, R. L., & Williams, J. B. W. (2001) · Journal of General Internal Medicine · doi:10.1046/j.1525-1497.2001.016009606.x · Cited by 44,910
Small sample inference for fixed effects from restricted maximum likelihood
Kenward, M. G., & Roger, J. H. (1997) · Biometrics · doi:10.2307/2533558 · Cited by 4,552
Löwe, B., Decker, O., Müller, S., Brähler, E., Schellberg, D., Herzog, W., & Herzberg, P. Y. (2008) · Medical Care · doi:10.1097/mlr.0b013e318160d093 · Cited by 4,527 · cited 1×
“Anxiety symptom severity was measured with the Generalized Anxiety Disorder Scale (GAD-7, score range: 0-21), with higher scores indicating worse symptoms [44].”
The Work and Social Adjustment Scale: a simple measure of impairment in functioning
Mundt, J. C., Marks, I. M., Shear, M. K., & Greist, J. M. (2002) · British Journal of Psychiatry · doi:10.1192/bjp.180.5.461 · Cited by 2,515
Self-citationRisks of all-cause and suicide mortality in mental disorders: a meta-review
Chesney, E., Goodwin, G. M., & Fazel, S. (2014) · World Psychiatry · doi:10.1002/wps.20128 · Cited by 2,115 · cited 1×
“Depression is the leading cause of disability globally [1] and is associated with impaired function [2], higher morbidity and mortality [3,4], greater health care use [5], and higher risk of suicide [6].”
Epidemiology of Adult DSM-5 Major Depressive Disorder and Its Specifiers in the United States
Hasin, D. S., Sarvet, A. L., Meyers, J. L., Saha, T. D., Ruan, W. J., Stohl, M., & Grant, B. F. (2018) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2017.4602 · Cited by 1,737 · cited 3×
“Depression is the leading cause of disability globally [1] and is associated with impaired function [2], higher morbidity and mortality [3,4], greater health care use [5], and higher risk of suicide [6].”
InfluentialLöwe, B., Kroenke, K., Herzog, W., & Gräfe, K. (2004) · Journal of Affective Disorders · doi:10.1016/s0165-0327(03)00198-8 · Cited by 1,558 · cited 1×
“The PHQ-9 (depression symptoms), Generalized Anxiety Disorders Scale-7 (anxiety symptoms), and WSAS-5 (functioning) correlate well with clinician-administered instruments [37,67,68] and are sensitive to interventional effects [45,69,70].”
Modeling the Drop-Out Mechanism in Repeated-Measures Studies
Little, R. J. A. (1995) · Journal of the American Statistical Association · doi:10.1080/01621459.1995.10476615 · Cited by 1,522
Internet-Based and Other Computerized Psychological Treatments for Adult Depression: A Meta-Analysis
Andersson, G., & Cuijpers, P. (2009) · Cognitive Behaviour Therapy · doi:10.1080/16506070903318960 · Cited by 1,368
Behavioral activation treatments of depression: a meta-analysis.
Cuijpers, P., van Straten, A., & Warmerdam, L. (2007) · Clinical Psychology Review · doi:10.1016/j.cpr.2006.11.001 · Cited by 1,144
Andersson, G., Cuijpers, P., Carlbring, P., Riper, H., & Hedman, E. (2014) · World Psychiatry · doi:10.1002/wps.20151 · Cited by 1,077
Delivering interventions for depression by using the internet: randomised controlled trial
Christensen, H. (2004) · BMJ · doi:10.1136/bmj.37945.566632.ee · Cited by 928 · cited 1×
“…compared to the control for two studies [24,62] and small-to-large significant effects sizes for four studies: (1) d =0.22 and d =0.34 for support upon request and weekly support, respectively [26]; (2) d =0.4 (pre-post within-subjects effect size) [63]; (3) d =0.39 [64]; and (4) d =1.14 [61].”
InfluentialAndrews, G., Basu, A., Cuijpers, P., Craske, M. G., McEvoy, P., English, C. L., & Newby, J. M. (2018) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2018.01.001 · Cited by 922 · cited 1×
“Several studies of traditional face-to-face CBT and internet-based CBT (iCBT), herein defined as a class of online software apps that emulate in-person psychotherapy, have shown similar effectiveness for treating depression symptoms [16-18].”
Cuijpers, P., Vogelzangs, N., Twisk, J., Kleiboer, A., Li, J., & Penninx, B. W. (2014) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2013.13030325 · Cited by 677
Vittengl, J. R., Clark, L. A., Dunn, T. W., & Jarrett, R. B. (2007) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.75.3.475 · Cited by 551
Gilbody, S., Littlewood, E., Hewitt, C., Brierley, G., Tharmanathan, P., Araya, R., Barkham, M., Bower, P., Cooper, C., Gask, L., et al. (2015) · BMJ · doi:10.1136/bmj.h5627 · Cited by 409 · cited 5×
“%) unweighted mean completion rate [24-30,52,55,58-64] for short-term (6-16 weeks) follow-up assessments of all studies in Karyotaki et al [21].”
InfluentialBerger, T., Hämmerli, K., Gubser, N., Andersson, G., & Caspar, F. (2011) · Cognitive Behaviour Therapy · doi:10.1080/16506073.2011.616531 · Cited by 383
Cuijpers, P., Li, J., Hofmann, S. G., & Andersson, G. (2010) · Clinical Psychology Review · doi:10.1016/j.cpr.2010.06.001 · Cited by 383 · cited 1×
“Of note, self-assessments may underestimate the effect of iCBT relative to similar studies using clinician-administered assessments [71].”
The Use and Effectiveness of Mobile Apps for Depression: Results From a Fully Remote Clinical Trial
Arean, P. A., Hallgren, K. A., Jordan, J. T., Gazzaley, A., Atkins, D. C., Heagerty, P. J., & Anguera, J. A. (2016) · Journal of Medical Internet Research · doi:10.2196/jmir.6482 · Cited by 376
Clarke, G., Eubanks, D., Reid, E., Kelleher, C., O'Connor, E., DeBar, L. L., Lynch, F., Nunley, S., & Gullion, C. (2005) · Journal of Medical Internet Research · doi:10.2196/jmir.7.2.e16 · Cited by 372 · cited 3×
“RCTs of fully automated, stand-alone iCBT interventions reported in Karyotaki et al and Lorenzo-Luaces et al [21,22,25,27,28].”
InfluentialMeyer, B., Berger, T., Caspar, F., Beevers, C. G., Andersson, G., & Weiss, M. (2009) · Journal of Medical Internet Research · doi:10.2196/jmir.1151 · Cited by 363 · cited 3×
“Of the seven studies described in Karyotaki et al [21] and Lorenzo-Luaces et al [22], only one that delivered a fully automated, stand-alone iCBT intervention like the Thrive intervention had similarly broad eligibility criteria [29].”
InfluentialSPEK, V., NYKLÍČEK, I., SMITS, N., CUIJPERS, P., RIPER, H., KEYZER, J., & POP, V. (2007) · Psychological Medicine · doi:10.1017/s0033291707000542 · Cited by 307 · cited 2×
“Six studies that included individualized email or SMS check-in reminders or telephone diagnostic interviews produced nonsignificant [57] or small-to-medium effect sizes for depression symptoms ( d =0.34 [30]; d =0.36 [58]; d =0.55 [59]; d =0.57 [60]; and d =0.66 [61]).”
InfluentialValidity of the Generalized Anxiety Disorder‐7 Scale in an Acute Psychiatric Sample
Kertz, S., Bigda‐Peyton, J., & Bjorgvinsson, T. (2013) · Clinical Psychology & Psychotherapy · doi:10.1002/cpp.1802 · Cited by 271 · cited 1×
“The PHQ-9 (depression symptoms), Generalized Anxiety Disorders Scale-7 (anxiety symptoms), and WSAS-5 (functioning) correlate well with clinician-administered instruments [37,67,68] and are sensitive to interventional effects [45,69,70].”
Strategies to improve retention in randomised trials: a Cochrane systematic review and meta-analysis
Brueton, V. C., Tierney, J. F., Stenning, S., Meredith, S., Harding, S., Nazareth, I., & Rait, G. (2014) · BMJ Open · doi:10.1136/bmjopen-2013-003821 · Cited by 253
Internet-Based Cognitive-Behavioral Therapy for Depression: Current Progress and Future Directions
Webb, C. A., Rosso, I. M., & Rauch, S. L. (2017) · Harvard Review of Psychiatry · doi:10.1097/hrp.0000000000000139 · Cited by 217 · cited 3×
“However, many barriers to receiving CBT exist, including geographic location, cost of insurance and care, long waitlists, and stigma for seeking treatment for mental illness [10].”
de Graaf, L. E., Gerhards, S. A. H., Arntz, A., Riper, H., Metsemakers, J. F. M., Evers, S. M. A. A., Severens, J. L., Widdershoven, G., & Huibers, M. J. H. (2009) · British Journal of Psychiatry · doi:10.1192/bjp.bp.108.054429 · Cited by 190
Meyer, B., Bierbrodt, J., Schröder, J., Berger, T., Beevers, C. G., Weiss, M., Jacob, G., Späth, C., Andersson, G., Lutz, W., et al. (2015) · Internet Interventions · doi:10.1016/j.invent.2014.12.003 · Cited by 188 · cited 2×
“Six studies that included individualized email or SMS check-in reminders or telephone diagnostic interviews produced nonsignificant [57] or small-to-medium effect sizes for depression symptoms ( d =0.34 [30]; d =0.36 [58]; d =0.55 [59]; d =0.57 [60]; and d =0.66 [61]).”
InfluentialClarke, G., Kelleher, C., Hornbrook, M., DeBar, L., Dickerson, J., & Gullion, C. (2009) · Cognitive Behaviour Therapy · doi:10.1080/16506070802675353 · Cited by 154 · cited 3×
“RCTs of fully automated, stand-alone iCBT interventions reported in Karyotaki et al and Lorenzo-Luaces et al [21,22,25,27,28].”
InfluentialBerger, T., Krieger, T., Sude, K., Meyer, B., & Maercker, A. (2018) · Journal of Affective Disorders · doi:10.1016/j.jad.2017.11.021 · Cited by 153 · cited 2×
“In the seven studies reporting anxiety symptom outcomes, four identified nonsignificant differences with the control [53,56,60,62] and three found small-to-nearly moderate effect sizes ( d =0.22 [54], d =0.25 [26], and d =0.43 [30]).”
InfluentialFarrer, L., Christensen, H., Griffiths, K. M., & Mackinnon, A. (2011) · PLoS ONE · doi:10.1371/journal.pone.0028099 · Cited by 140 · cited 3×
“…effect sizes of d =0.08 [52], d =0.38 [53], d =0.8 [54], and g =0.76 for depression symptoms [55], although the latter study excluded “outliers” from the primary analysis and stated their inclusion resulted in “nonsignificant findings” and reduced the effect size by an undisclosed amount [55].”
InfluentialA randomized controlled trial of internet-based therapy in depression
Moritz, S., Schilling, L., Hauschildt, M., Schröder, J., & Treszl, A. (2012) · Behaviour Research and Therapy · doi:10.1016/j.brat.2012.04.006 · Cited by 140
Phillips, R., Schneider, J., Molosankwe, I., Leese, M., Foroushani, P. S., Grime, P., McCrone, P., Morriss, R., & Thornicroft, G. (2014) · Psychological Medicine · doi:10.1017/s0033291713001323 · Cited by 110 · cited 3×
“…that assessed life/work functioning (using the same measure reported here [WSAS]) found a nonsignificant difference as compared to the control [62], a significant improvement for iCBT+treatment as usual but not in iCBT compared to the control (effect sizes not provided) [52], and an effect…”
InfluentialVallury, K. D., Jones, M., & Oosterbroek, C. (2015) · Journal of Medical Internet Research · doi:10.2196/jmir.4145 · Cited by 105 · cited 2×
“Additionally, a recent meta-analysis showed comparable effectiveness of iCBT interventions for reducing depression and anxiety symptoms among urban and rural populations outside the United States [19].”
Montero-Marín, J., Araya, R., Pérez-Yus, M. C., Mayoral, F., Gili, M., Botella, C., Baños, R., Castro, A., Romero-Sanchiz, P., López-Del-Hoyo, Y., et al. (2016) · Journal of Medical Internet Research · doi:10.2196/jmir.5695 · Cited by 75 · cited 4×
“To date, six of the seven studies of fully automated, stand-alone versions of iCBT have demonstrated small-to-medium clinical effects [26-31] and one found no significant effects [25].”
InfluentialMira, A., Bretón-López, J., García-Palacios, A., Quero, S., Baños, R. M., & Botella, C. (2017) · Neuropsychiatric Disease and Treatment · doi:10.2147/ndt.s130994 · Cited by 71 · cited 4×
“%) unweighted mean completion rate [24-30,52,55,58-64] for short-term (6-16 weeks) follow-up assessments of all studies in Karyotaki et al [21].”
InfluentialZimmerman, M., Walsh, E., Friedman, M., Boerescu, D. A., & Attiullah, N. (2018) · Journal of Affective Disorders · doi:10.1016/j.jad.2017.08.024 · Cited by 63 · cited 1×
“The PHQ-9 (depression symptoms), Generalized Anxiety Disorders Scale-7 (anxiety symptoms), and WSAS-5 (functioning) correlate well with clinician-administered instruments [37,67,68] and are sensitive to interventional effects [45,69,70].”
Psychotherapy for self-stigma among rural clients.
Larson, J. E., & Corrigan, P. W. (2010) · Journal of clinical psychology · doi:10.1002/jclp.20679 · Cited by 60 · cited 1×
“Thrive can be performed in the privacy of one’s home, which might offset mental health-related stigma, a frequent barrier to seeking mental health services experienced by rural US residents [51].”
Lorenzo-Luaces, L., Johns, E., & Keefe, J. R. (2018) · Journal of Medical Internet Research · doi:10.2196/10113 · Cited by 36
Schure, M. B., Howard, M., Bailey, S. J., Bryan, B., & Greist, J. (2018) · Journal of Rural Mental Health · doi:10.1037/rmh0000102 · Cited by 10 · cited 3×
“Thrive is accessible from any location with internet access and can be used on smartphones, tablets, and computers, making it an easily accessible, cost-effective alternative for rural residents who often have to drive long distances for in-person mental health care [41].”
InfluentialSelf-citation
Cited by
Digital interventions for the treatment of depression: a meta-analytic review
Moshe, I., Terhorst, Y., Philippi, P., Domhardt, M., Cuijpers, P., Cristea, I., Pulkki-Råback, L., Baumeister, H., & Sander, L. B. (2021) · Psychological Bulletin · doi:10.1037/bul0000334 · Cited by 390
Li, J., Li, X., Jiang, J., Xu, X., Wu, J., Xu, Y., Lin, X., Hall, J., Xu, H., Xu, J., et al. (2020) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2020.580827 · Cited by 157
“prevention of physical and psychological distress in both the community (24, 25) and inpatients (26, 27).”
BackgroundHornstein, S., Zantvoort, K., Lueken, U., Funk, B., & Hilbert, K. (2023) · Frontiers in Digital Health · doi:10.3389/fdgth.2023.1170002 · Cited by 134
Six, S. G., Byrne, K. A., Tibbett, T. P., & Pericot-Valverde, I. (2021) · JMIR Mental Health · doi:10.2196/32199 · Cited by 95
“The following data were extracted from each article: first author, year of publication, participants’ characteristics (ie, gender and age), population, and study length (Multimedia Appendix 3), as well as app name, app classification (ie, mobile or internet), presence of gamification elements, type of gamification ele…”
MethodResultTerides, M. D., Dear, B. F., Fogliati, V. J., Gandy, M., Karin, E., Jones, M. P., & Titov, N. (2018) · Cognitive Behaviour Therapy · doi:10.1080/16506073.2017.1347195 · Cited by 55
Metadata
- Authors
- Schure, M. B., Lindow, J. C., Greist, J. H., Nakonezny, P. A., Bailey, S. J., Bryan, W. L., & Byerly, M. J.
- Venue
- Journal of Medical Internet Research
- Publisher
- JMIR Publications Inc.
- Published
- 2019-11-18
- Volume
- 21
- Issue
- 11
- Pages
- e14754
- ISSN
- 1438-8871 (ISSN-L)
- OpenAlex
- W2981793541
- Cited by
- 53
- References
- 39
- FWCI
- 6.16
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.