Counseling With Guided Use of a Mobile Well-Being App for Students Experiencing Anxiety or Depression: Clinical Outcomes of a Feasibility Trial Embedded in a Student Counseling Service
Open accessThe DOI matches its Crossref record; 26 of the 26 references it cites were found in a registry or an index.
Abstract
Background: Anxiety and depression continue to be prominent experiences of students approaching their university counseling service. These services face unique challenges to ensure that they continue to offer quality support with fewer resources to a growing student population. The convenience and availability of mobile phone apps offer innovative solutions to address therapeutic challenges and expand the reach of traditional support. Objective: The primary aim of this study was to establish the feasibility of a trial in which guided use of a mobile phone well-being app was introduced into a student counseling service and offered as an adjunct to face-to-face counseling. Methods: The feasibility trial used a two-arm, parallel nonrandomized design comparing counseling alone (treatment as usual, or TAU) versus counseling supplemented with guided use of a mobile phone well-being app (intervention) for 38 university students experiencing moderate anxiety or depression. Students in both conditions received up to 6 sessions of face-to-face counseling within a 3-month period. Students who approached the counseling service and were accepted for counseling were invited to join the trial. Feasibility factors evaluated include recruitment duration, treatment preference, randomization acceptability, and intervention fidelity. Clinical outcomes and clinical change were assessed with routine clinical outcome measures administered every counseling session and follow-up phases at 3 and 6 months after recruitment. Results: Both groups demonstrated reduced clinical severity by the end of counseling. This was particularly noticeable for depression, social anxiety, and hostility, whereby clients moved from elevated clinical to low clinical or from low clinical to nonclinical by the end of the intervention. By the 6-month follow-up, TAU clients’ (n=18) anxiety had increased whereas intervention clients’ (n=20) anxiety continued to decrease, and this group difference was significant (Generalized Anxiety Disorder–7: t22=3.46, P=.002). This group difference was not replicated for levels of depression: students in both groups continued to decrease their levels of depression by a similar amount at the 6-month follow-up (Physical Health Questionnaire–9: t22=1.30, P=.21). Conclusion: Supplementing face-to-face counseling with guided use of a well-being app is a feasible and acceptable treatment option for university students experiencing moderate anxiety or depression. The feasibility trial was successfully embedded into a university counseling service without denying access to treatment and with minimal disruption to the service. This study provides preliminary evidence for using a well-being app to maintain clinical improvements for anxiety following the completion of counseling. The design of the feasibility trial provides the groundwork for the development of future pilot trials and definitive trials embedded in a student counseling service. Trial registration: ISRCTN registry ISRCTN55102899; http://www.isrctn.com/ISRCTN55102899
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The PHQ-9: Validity of a brief depression severity measure
Kroenke, K., Spitzer, R. L., & Williams, J. B. W. (2001) · Journal of General Internal Medicine · doi:10.1046/j.1525-1497.2001.016009606.x · Cited by 44,910
Landis, J. R., & Koch, G. G. (1977) · Biometrics · doi:10.2307/2529786 · Cited by 4,332 · cited 1×
“Interrater reliability analysis revealed substantial to almost perfect agreement across raters with kappa values in the range of .81 to 1.00 [42].”
InfluentialAuerbach, R. P., Collaborators, W. W.-I., Mortier, P., Bruffaerts, R., Alonso, J., Benjet, C., Cuijpers, P., Demyttenaere, K., Ebert, D. D., Green, J. G., et al. (2018) · Journal of Abnormal Psychology · doi:10.1037/abn0000362 · Cited by 2,522 · cited 1×
“In recent years, the World Mental Health Survey of 13,984 full-time students from 19 colleges across 8 countries found that 35% met the threshold for at least one of the following common lifetime mental disorders (according to the Diagnostic and Statistical Manual of Mental Disorders, 4th Edition, or DSM-IV): major de…”
BackgroundInfluentialThe prevalence and correlates of depression, anxiety, and stress in a sample of college students
Beiter, R., Nash, R., McCrady, M., Rhoades, D., Linscomb, M., Clarahan, M., & Sammut, S. (2015) · Journal of Affective Disorders · doi:10.1016/j.jad.2014.10.054 · Cited by 2,030 · cited 1×
“Identifying the prevalence of mental ill-health in university students has been a longstanding priority of educational institutions, and the growing concern over student mental health is widespread [1-3].”
Mental disorders among college students in the World Health Organization World Mental Health Surveys
Auerbach, R. P., Alonso, J., Axinn, W. G., Cuijpers, P., Ebert, D. D., Green, J. G., Hwang, I., Kessler, R. C., Liu, H., Mortier, P., et al. (2016) · Psychological Medicine · doi:10.1017/s0033291716001665 · Cited by 1,587 · cited 1×
“An earlier study spanning 21 countries found that only 16% of 6452 students with diagnosable mental health disorders received the minimum adequate treatment, and this percentage decreased proportionally according to the income level of the country [10].”
BackgroundMental health problems in college freshmen: Prevalence and academic functioning
Bruffaerts, R., Mortier, P., Kiekens, G., Auerbach, R. P., Cuijpers, P., Demyttenaere, K., Green, J. G., Nock, M. K., & Kessler, R. C. (2018) · Journal of Affective Disorders · doi:10.1016/j.jad.2017.07.044 · Cited by 1,047 · cited 1×
“Identifying the prevalence of mental ill-health in students has been a longstanding priority of educational institutions, and the growing concern over student mental health is widespread [1-3].”
BackgroundTowards a standardised brief outcome measure: Psychometric properties and utility of the CORE–OM
Evans, C., Connell, J., Barkham, M., Margison, F., McGrath, G., Mellor-Clark, J., & Audin, K. (2002) · British Journal of Psychiatry · doi:10.1192/bjp.180.1.51 · Cited by 934 · cited 2×
“The 10-item version has been validated against the CORE-OM, is sensitive to change, and can be used to determine whether a client meets membership of a clinical population (score of ≥ 10).”
Self-citationMental Health Smartphone Apps: Review and Evidence-Based Recommendations for Future Developments
Bakker, D., Kazantzis, N., Rickwood, D., & Rickard, N. (2016) · JMIR Mental Health · doi:10.2196/mental.4984 · Cited by 886 · cited 1×
“The quality of mental health apps was assessed in a recent systematic review, and the top-ranking apps, starting with the highest quality, were (1) HealthyMinds, (2) AnxietyCoach, (3) Moodkit, (4) Pacifica, and (5) Self-help for Anxiety Management (SAM) [38].”
A systematic review: Students with mental health problems—A growing problem
Storrie, K., Ahern, K., & Tuckett, A. (2010) · International Journal of Nursing Practice · doi:10.1111/j.1440-172x.2009.01813.x · Cited by 696 · cited 1×
“…mental ill-health have found that up to 74% of students experience moderate emotional distress by the second semester, and this, in turn, has been linked to negative outcomes including low academic performance, isolation, financial problems, and time away from education leading to depression [4-7].”
Firth, J., Torous, J., Nicholas, J., Carney, R., Rosenbaum, S., & Sarris, J. (2017) · Journal of Affective Disorders · doi:10.1016/j.jad.2017.04.046 · Cited by 675 · cited 1×
“Smartphone apps can be effective for treating anxiety [23] and depression [24], but little is known about the perception, application, or potential benefits of augmenting student counseling services with apps.”
BackgroundChanges in counseling center client problems across 13 years
Benton, S. A., Robertson, J. M., Tseng, W.-C., Newton, F. B., & Benton, S. L. (2003) · Professional Psychology: Research and Practice · doi:10.1037/0735-7028.34.1.66 · Cited by 619
Psychometric comparison of PHQ-9 and HADS for measuring depression severity in primary care
Cameron, I. M., Crawford, J. R., Lawton, K., & Reid, I. C. (2008) · British Journal of General Practice · doi:10.3399/bjgp08x263794 · Cited by 590 · cited 1×
“The PHQ-9 is a reliable measure of depression severity that has been validated against other measures of depression [31-33].”
MethodUsing Emotional and Social Factors to Predict Student Success
Pritchard, M. E., & Wilson, G. S. (. S. (2003) · Journal of College Student Development · doi:10.1353/csd.2003.0008 · Cited by 588 · cited 1×
“Research reports collating global accounts of student mental ill-health have found that up to 74% of students experience moderate emotional distress by the second semester, and this, in turn, has been linked to negative outcomes including low academic performance, isolation, financial problems, and time away from educ…”
BackgroundDavies, E. B., Morriss, R., & Glazebrook, C. (2014) · Journal of Medical Internet Research · doi:10.2196/jmir.3142 · Cited by 499 · cited 1×
“Evidence for these therapeutic technologies is steadily growing, and Web-based interventions for anxiety, depression, and stress can be effective in students [18].”
BackgroundHarrer, M., Adam, S. H., Baumeister, H., Cuijpers, P., Karyotaki, E., Auerbach, R. P., Kessler, R. C., Bruffaerts, R., Berking, M., & Ebert, D. D. (2019) · International Journal of Methods in Psychiatric Research · doi:10.1002/mpr.1759 · Cited by 445 · cited 1×
“…of mental health and well-being internet interventions for university students evaluated 48 RCTs and identified small effects on stress ( g =0.20, 95% CI 0.02-0.38) and depression ( g =0.18, 95% CI 0.08-0.27), with moderate effects on disordered eating ( g =0.52, 95% CI 0.22-0.83) [22].”
InfluentialBarkham, M., Bewick, B., Mullin, T., Gilbody, S., Connell, J., Cahill, J., Mellor-Clark, J., Richards, D., Unsworth, G., & Evans, C. (2013) · Counselling and Psychotherapy Research · doi:10.1080/14733145.2012.729069 · Cited by 413 · cited 1×
“The 10-item Clinical Outcomes in Routine Evaluation Outcome Measure (CORE-10) [34] was administered at the initial clinical assessment (preintervention) and at every counseling session to measure changes in general psychological functioning.”
Self-citationEbert, D. D., Mortier, P., Kaehlke, F., Bruffaerts, R., Baumeister, H., Auerbach, R. P., Alonso, J., Vilagut, G., Martínez, K. U., Lochner, C., et al. (2019) · International Journal of Methods in Psychiatric Research · doi:10.1002/mpr.1782 · Cited by 407 · cited 1×
“The survey also found that 75% of the students would not seek help for an emotional or mental health concern, with the most prominent reasons being that students would rather tackle the problem alone or seek help from friends or they feel too embarrassed to seek professional help [9].”
BackgroundThe Use and Effectiveness of Mobile Apps for Depression: Results From a Fully Remote Clinical Trial
Arean, P. A., Hallgren, K. A., Jordan, J. T., Gazzaley, A., Atkins, D. C., Heagerty, P. J., & Anguera, J. A. (2016) · Journal of Medical Internet Research · doi:10.2196/jmir.6482 · Cited by 376
Towards a consensus around standards for smartphone apps and digital mental health
Torous, J., Andersson, G., Bertagnoli, A., Christensen, H., Cuijpers, P., Firth, J., Haim, A., Hsin, H., Hollis, C., Lewis, S., et al. (2019) · World Psychiatry · doi:10.1002/wps.20592 · Cited by 325 · cited 1×
“However, increased awareness of this evidence gap has sparked the development of new quality frameworks, assessment criteria, XSL • FO RenderX and a shared acceptance to co-create new technologies with clinical expertise and embedded evaluations [48].”
Client preferences affect treatment satisfaction, completion, and clinical outcome: a meta-analysis
Lindhiem, O., Bennett, C. B., Trentacosta, C. J., & McLear, C. (2014) · Clinical Psychology Review · doi:10.1016/j.cpr.2014.06.002 · Cited by 315 · cited 1×
“While client preferences did not impact participation, evidence suggests that discussing and measuring client preference is associated with higher treatment satisfaction, engagement, and clinical outcomes [43].”
BackgroundEbert, D. D., Cuijpers, P., Muñoz, R. F., & Baumeister, H. (2017) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2017.00116 · Cited by 244 · cited 1×
“For example, evidence from RCTs has shown internet and app-based interventions to be particularly effective at reducing depressive symptoms [46].”
BackgroundSander, L., Rausch, L., & Baumeister, H. (2016) · JMIR Mental Health · doi:10.2196/mental.6061 · Cited by 218 · cited 1×
“Web-based interventions appear particularly effective for anxiety and depression, leading to significant reductions in symptom severity with small to medium effect sizes that are maintained long term [19].”
BackgroundTitzler, I., Saruhanjan, K., Berking, M., Riper, H., & Ebert, D. D. (2018) · Internet Interventions · doi:10.1016/j.invent.2018.01.002 · Cited by 176 · cited 1×
“…approaches may help to reduce treatment gaps, there are training opportunities for offering mobile apps in clinical settings, clients can experience apps to be supportive of face-to-face interventions, and blended approaches offer potential to reach more patients than face-to-face alone [25-28].”
Ly, K. H., Topooco, N., Cederlund, H., Wallin, A., Bergström, J., Molander, O., Carlbring, P., & Andersson, G. (2015) · PLOS ONE · doi:10.1371/journal.pone.0126559 · Cited by 171 · cited 1×
“Recent studies exploring the determinants of blended approaches have shown that therapists perceive the possibilities of adding blended work to their routine practice, blended approaches may help to reduce treatment gaps, there are training opportunities for offering mobile apps in clinical settings, clients can exper…”
BackgroundKaryotaki, E., Kemmeren, L., Riper, H., Twisk, J., Hoogendoorn, A., Kleiboer, A., Mira, A., Mackinnon, A., Meyer, B., Botella, C., et al. (2018) · Psychological Medicine · doi:10.1017/s0033291718000648 · Cited by 167 · cited 1×
“These findings are consistent with a meta-analysis of 16 clinical trials comparing internet-based cognitive behavioral therapy (iCBT) versus waitlist control groups, demonstrating less worsening of symptoms for intervention groups [20].”
ResultSteinert, C., Stadter, K., Stark, R., & Leichsenring, F. (2017) · Clinical Psychology & Psychotherapy · doi:10.1002/cpp.2032 · Cited by 83 · cited 1×
“This design choice is particularly relevant for the student counseling context as research suggests that comparing an active treatment against a wait-list control group is not an accurate comparison when testing short-term psychotherapy for depression or social anxiety [44].”
Background
Cited by
Madrid‐Cagigal, A., Kealy, C., Potts, C., Mulvenna, M. D., Byrne, M., Barry, M. M., & Donohoe, G. (2025) · Early Intervention in Psychiatry · doi:10.1111/eip.70017 · Cited by 78
Bennion, M. R., Hardy, G. E., Moore, R. K., Kellett, S., & Millings, A. (2020) · Journal of Medical Internet Research · doi:10.2196/16794 · Cited by 68
Self-citationD'Adamo, L., Paraboschi, L., Claire Grammer, A., Fennig, M., Graham, A. K., Yaeger, L. H., Newman, M. G., Wilfley, D. E., Barr Taylor, C., Eisenberg, D., et al. (2023) · Journal of Behavioral and Cognitive Therapy · doi:10.1016/j.jbct.2023.05.002 · Cited by 37
LaMontagne, L. G., Doty, J. L., Diehl, D. C., Nesbit, T. S., Gage, N. A., Kumbkarni, N., & Leon, S. P. (2024) · Journal of Affective Disorders · doi:10.1016/j.jad.2024.09.014 · Cited by 13
Metadata
- Authors
- Broglia, E., Millings, A., & Barkham, M.
- Venue
- JMIR mHealth and uHealth
- Publisher
- JMIR Publications Inc.
- Published
- 2019-08-15
- Volume
- 7
- Issue
- 8
- Pages
- e14318
- ISSN
- 2291-5222 (ISSN-L)
- OpenAlex
- W2964156246
- Cited by
- 33
- References
- 26
- FWCI
- 4.82
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.