Effectiveness of a Mobile App Intervention for Anxiety and Depression Symptoms in University Students: Randomized Controlled Trial
Open accessThe DOI matches its Crossref record; 32 of the 32 references it cites were found in a registry or an index.
Abstract
Background: Depression and anxiety symptoms are common among university students, but many do not receive treatment. This is often because of lack of availability, reluctance to seek help, and not meeting the diagnostic criteria required to access services. Internet-based interventions, including smartphone apps, can overcome these issues. However, a large number of apps are available, each with little evidence of their effectiveness. Objective: This study aims to evaluate for the first time the effectiveness of a self-guided mobile app, Feel Stress Free, for the treatment of depression and anxiety symptoms in students. Methods: A web-based randomized controlled trial compared a cognitive behavioral therapy (CBT)–based mobile app Feel Stress Free with a wait-list control. University students self-identified as experiencing symptoms of anxiety or depression and were randomized to 6 weeks of intervention (n=84) or control (n=84), unblinded. The app is self-guided and incorporates behavioral relaxation activities, mood tracking and thought challenging, and minigames. Participants completed the Hospital Anxiety and Depression Scale online at baseline and every fortnight. Results: At week 6, the primary end point, there was evidence that the Feel Stress Free app reduced depression symptoms (mean difference −1.56; 95% CI −2.67 to −0.44; P=.006) but only very weak evidence that it reduced anxiety symptoms (mean difference −1.36; 95% CI −2.93 to 0.21; P=.09). At week 4, there was evidence to support the effectiveness of the intervention for anxiety symptoms (mean difference −1.94; 95% CI −3.11 to −0.77; P=.001) and, though weaker, depression symptoms (mean difference −1.08; 95% CI −2.12 to −0.04; P=.04). At week 6, 83% (34/41) of participants indicated that they were using the app weekly or more frequently. Conclusions: The Feel Stress Free app is a promising mobile intervention for treating symptoms of anxiety and depression in students and overcomes many of the barriers to traditional CBT. Further research is needed to establish its effectiveness at and beyond 6 weeks. Trial Registration: ClinicalTrials.gov NCT03032952; https://clinicaltrials.gov/ct2/show/NCT03032952
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Gulliver, A., Griffiths, K. M., & Christensen, H. (2010) · BMC Psychiatry · doi:10.1186/1471-244x-10-113 · Cited by 3,292
Herrmann, C. (1997) · Journal of Psychosomatic Research · doi:10.1016/s0022-3999(96)00216-4 · Cited by 2,885
A systematic review of studies of depression prevalence in university students
Ibrahim, A. K., Kelly, S. J., Adams, C. E., & Glazebrook, C. (2013) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2012.11.015 · Cited by 1,988
Mental health problems and help-seeking behavior among college students
Hunt, J., & Eisenberg, D. (2010) · Journal of Adolescent Health · doi:10.1016/j.jadohealth.2009.08.008 · Cited by 1,949
Andrews, G., Cuijpers, P., Craske, M. G., McEvoy, P., & Titov, N. (2010) · PLoS ONE · doi:10.1371/journal.pone.0013196 · Cited by 1,311
Adherence in Internet Interventions for Anxiety and Depression
Christensen, H., Griffiths, K. M., & Farrer, L. (2009) · Journal of Medical Internet Research · doi:10.2196/jmir.1194 · Cited by 1,133 · cited 2×
“However, this rate is comparable with what is seen at similar time points in other trials of mobile-and web-based CBT where therapist contact is minimal or absent [28,41,42].”
BackgroundResultFirth, J., Torous, J., Nicholas, J., Carney, R., Pratap, A., Rosenbaum, S., & Sarris, J. (2017) · World Psychiatry · doi:10.1002/wps.20472 · Cited by 1,097 · cited 2×
“These are in line with other recent studies that compare CBT apps with wait-list or inactive controls; meta-analyses by Firth et al reported standardized mean difference ESs of 0.45 for anxiety [36] and 0.56 for depression [37].”
BackgroundResultInfluentialLife course outcomes of young people with anxiety disorders in adolescence
WOODWARD, L. J., & FERGUSSON, D. M. (2001) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1097/00004583-200109000-00018 · Cited by 1,051
Mental Health Smartphone Apps: Review and Evidence-Based Recommendations for Future Developments
Bakker, D., Kazantzis, N., Rickwood, D., & Rickard, N. (2016) · JMIR Mental Health · doi:10.2196/mental.4984 · Cited by 886
Lattie, E. G., Adkins, E. C., Winquist, N., Stiles-Shields, C., Wafford, Q. E., & Graham, A. K. (2019) · Journal of Medical Internet Research · doi:10.2196/12869 · Cited by 843 · cited 1×
“More recently, a 2019 systematic review [22] on digital health interventions for improving depression and anxiety among students found that mobile-based interventions such as apps appear to be as promising as computer, web, and virtual reality–based interventions.”
BackgroundFirth, J., Torous, J., Nicholas, J., Carney, R., Rosenbaum, S., & Sarris, J. (2017) · Journal of Affective Disorders · doi:10.1016/j.jad.2017.04.046 · Cited by 675 · cited 2×
“However, if we did overestimate adherence, the fact that low levels of usage produced a benefit would provide support for the effectiveness of the app even without frequent use, in line with findings by Firth et al [36].”
ResultInfluentialThe mental health needs of today’s college students: challenges and recommendations.
Kitzrow, M. A. (2003) · NASPA Journal · doi:10.2202/1949-6605.1310 · Cited by 673 · cited 1×
“Indeed, internet-based self-help is often recommended by university counseling services struggling to cope with high demand [21].”
BackgroundPsychometric comparison of PHQ-9 and HADS for measuring depression severity in primary care
Cameron, I. M., Crawford, J. R., Lawton, K., & Reid, I. C. (2008) · British Journal of General Practice · doi:10.3399/bjgp08x263794 · Cited by 590
Puhan, M. A., Frey, M., Büchi, S., & Schünemann, H. J. (2008) · Health and Quality of Life Outcomes · doi:10.1186/1477-7525-6-46 · Cited by 586
The role of nonspecific factors in cognitive-behavior therapy for depression.
Ilardi, S. S., & Craighead, W. E. (1994) · Clinical Psychology: Science and Practice · doi:10.1111/j.1468-2850.1994.tb00016.x · Cited by 501
Davies, E. B., Morriss, R., & Glazebrook, C. (2014) · Journal of Medical Internet Research · doi:10.2196/jmir.3142 · Cited by 499
A randomized controlled trial of online versus clinic-based CBT for adolescent anxiety.
Spence, S. H., Donovan, C. L., March, S., Gamble, A., Anderson, R. E., Prosser, S., & Kenardy, J. (2011) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0024512 · Cited by 381 · cited 1×
“There is evidence that computerized forms of self-directed CBT (cCBT) can be as effective as traditional CBT in the treatment of depression and anxiety [10,12-14], and cCBT is now recommended in the United Kingdom for treating subclinical to moderate depression [15].”
BackgroundKaltenthaler, E., Brazier, J., De Nigris, E., Tumur, I., Ferriter, M., Beverley, C., Parry, G., Rooney, G., & Sutcliffe, P. (2006) · Health Technology Assessment · doi:10.3310/hta10330 · Cited by 357
Mental health: there’s an app for that
Anthes, E. (2016) · Nature · doi:10.1038/532020a · Cited by 333
Button, K. S., Kounali, D., Thomas, L., Wiles, N. J., Peters, T. J., Welton, N. J., Ades, A. E., & Lewis, G. (2015) · Psychological Medicine · doi:10.1017/s0033291715001270 · Cited by 332
Self-citationCBT for depression: a pilot RCT comparing mobile phone vs. computer
Watts, S., Mackenzie, A., Thomas, C., Griskaitis, A., Mewton, L., Williams, A., & Andrews, G. (2013) · BMC Psychiatry · doi:10.1186/1471-244x-13-49 · Cited by 329 · cited 1×
“Our results are in line with the oft-reported finding that the majority of the improvement associated with a CBT app (and traditional CBT [47]) is seen in the short term [48,49], but a longer follow-up period will be needed to ascertain whether our week 6 results represent a fluctuation typically seen around the 6-wee…”
ResultMusiat, P., Goldstone, P., & Tarrier, N. (2014) · BMC Psychiatry · doi:10.1186/1471-244x-14-109 · Cited by 273
Ly, K. H., Trüschel, A., Jarl, L., Magnusson, S., Windahl, T., Johansson, R., Carlbring, P., & Andersson, G. (2014) · BMJ Open · doi:10.1136/bmjopen-2013-003440 · Cited by 269 · cited 1×
“There is evidence that computerized forms of self-directed CBT (cCBT) can be as effective as traditional CBT in the treatment of depression and anxiety [10,12-14], and cCBT is now recommended in the United Kingdom for treating subclinical to moderate depression [15].”
BackgroundProudfoot, J., Clarke, J., Birch, M.-R., Whitton, A. E., Parker, G., Manicavasagar, V., Harrison, V., Christensen, H., & Hadzi-Pavlovic, D. (2013) · BMC Psychiatry · doi:10.1186/1471-244x-13-312 · Cited by 264 · cited 2×
“However, this rate is comparable with what is seen at similar time points in other trials of mobile-and web-based CBT where therapist contact is minimal or absent [28,41,42].”
ResultClarke, G., Reid, E., Eubanks, D., O'Connor, E., DeBar, L. L., Kelleher, C., Lynch, F., & Nunley, S. (2002) · Journal of Medical Internet Research · doi:10.2196/jmir.4.3.e14 · Cited by 256 · cited 1×
“However, this rate is comparable with what is seen at similar time points in other trials of mobile-and web-based CBT where therapist contact is minimal or absent [28,41,42].”
ResultChristensen, H., Griffiths, K., Groves, C., & Korten, A. (2006) · Australian & New Zealand Journal of Psychiatry · doi:10.1080/j.1440-1614.2006.01743.x · Cited by 201 · cited 1×
“Trying self-directed forms of CBT may also make individuals more likely to seek traditional CBT [50] and can be an alternative for those who are unable to attend therapy.”
BackgroundThe digital placebo effect: mobile mental health meets clinical psychiatry
Torous, J., & Firth, J. (2016) · The Lancet Psychiatry · doi:10.1016/s2215-0366(15)00565-9 · Cited by 200
Beattie, A., Shaw, A., Kaur, S., & Kessler, D. (2009) · Health Expectations · doi:10.1111/j.1369-7625.2008.00531.x · Cited by 170 · cited 1×
“The results of this trial may also not be generalizable beyond university students, but arguably, these are the individuals who are most likely to benefit from the accessibility of this type of treatment [46].”
BackgroundTowards a Framework for Evaluating Mobile Mental Health Apps
Chan, S., Torous, J., Hinton, L., & Yellowlees, P. (2015) · Telemedicine and e-Health · doi:10.1089/tmj.2015.0002 · Cited by 163
Cavanagh, K. (2014) · Behavioural and Cognitive Psychotherapy · doi:10.1017/s1352465813000568 · Cited by 84
Contribution of spontaneous improvement to placebo response in depression: A meta-analytic review
Rutherford, B. R., Mori, S., Sneed, J. R., Pimontel, M. A., & Roose, S. P. (2012) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2012.02.008 · Cited by 79 · cited 1×
“This is common in trials and likely because of spontaneous improvement; fluctuations in symptoms; and regression to the mean, all of which accompany the passage of time [45].”
BackgroundChristoforou, M., Sáez Fonseca, J. A., & Tsakanikos, E. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.7747 · Cited by 48 · cited 1×
“A very similar version of this app (version 1.3) was also tested as a treatment for agoraphobia in 2017 [30].”
MethodInfluentialSelf-citation
Cited by
The Economic Burden of Adults with Major Depressive Disorder in the United States (2010 and 2018)
Greenberg, P. E., Fournier, A.-A., Sisitsky, T., Simes, M., Berman, R., Koenigsberg, S. H., & Kessler, R. C. (2021) · PharmacoEconomics · doi:10.1007/s40273-021-01019-4 · Cited by 838
Are online mental health interventions for youth effective? A systematic review.
Zhou, X., Edirippulige, S., Bai, X., & Bambling, M. (2021) · Journal of Telemedicine and Telecare · doi:10.1177/1357633x211047285 · Cited by 107
Six, S. G., Byrne, K. A., Tibbett, T. P., & Pericot-Valverde, I. (2021) · JMIR Mental Health · doi:10.2196/32199 · Cited by 95
“The following data were extracted from each article: first author, year of publication, participants’ characteristics (ie, gender and age), population, and study length (Multimedia Appendix 3), as well as app name, app classification (ie, mobile or internet), presence of gamification elements, type of gamification ele…”
MethodResultSystematic review and meta-analysis of adverse events in clinical trials of mental health apps
Linardon, J., Fuller-Tyszkiewicz, M., Firth, J., Goldberg, S. B., Anderson, C., McClure, Z., & Torous, J. (2024) · npj Digital Medicine · doi:10.1038/s41746-024-01388-y · Cited by 44
Oliveira, C., Pacheco, M., Borges, J., Meira, L., & Santos, A. (2023) · Internet Interventions · doi:10.1016/j.invent.2023.100609 · Cited by 42
Metadata
- Authors
- McCloud, T., Jones, R., Lewis, G., Bell, V., & Tsakanikos, E.
- Venue
- JMIR mHealth and uHealth
- Publisher
- JMIR Publications Inc.
- Published
- 2020-07-31
- Volume
- 8
- Issue
- 7
- Pages
- e15418
- ISSN
- 2291-5222 (ISSN-L)
- OpenAlex
- W3046610632
- Cited by
- 118
- References
- 32
- FWCI
- 10.59
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.