Examining an App-Based Mental Health Self-Care Program, IntelliCare for College Students: Single-Arm Pilot Study
Open accessPublished version of a preprint
The DOI matches its Crossref record; 30 of the 30 references it cites were found in a registry or an index.
Abstract
Background: In recent years, there has been an increase in symptoms of depression, anxiety, and other mental illnesses in college student populations alongside a steady rise in the demand for counseling services. Digital mental health programs, such as those delivered through mobile apps, can add to the array of available services but must be tested for usability and acceptability before implementation. Objective: This study aims to examine how students used IntelliCare for College Students over an 8-week period to examine the preliminary associations between app use and psychosocial targets and to gather user feedback about usability issues that need to be remedied before a larger implementation study. Methods: IntelliCare for College Students is an app-based platform that provides symptom assessments with personalized feedback, information about campus resources, lessons on mental health and wellness topics, and access to the suite of interactive skill–focused IntelliCare apps. A total of 20 students were recruited to participate in an 8-week study. To test for a broad range of potential users, we recruited a mixed sample of students with elevated symptoms of depression or anxiety and students without elevated symptoms. Participants completed psychosocial questionnaires at baseline, week 4, and week 8. Participants also completed user feedback interviews at weeks 4 and 8 in which they provided feedback on their experience using the app and suggestions for changes they would like to be made to the app. Results: Of the 20 students who downloaded the app, 19 completed the study, indicating a high rate of retention. Over the study period, participants completed an average of 5.85 (SD 2.1; range 1-8) symptom assessments. Significant improvements were observed in the Anxiety Literacy Questionnaire scores (Z=−2.006; P=.045) and in the frequency with which participants used both cognitive (Z=−2.091; P=.04) and behavioral (Z=−2.249; P=.03) coping skills. In the feedback interviews, we identified a high degree of usability with minor bugs in the app software, which were quickly fixed. Furthermore, in feedback interviews, we identified that users found the app to be convenient and appreciated the ability to use the program in short bursts of time. Conclusions: The findings indicate that the IntelliCare for College Students program was perceived as largely usable and engaging. Although the program demonstrated usability and preliminary benefits to students, further testing is needed to determine its clinical utility among college students. Trial Registration: ClinicalTrials.gov NCT04035577; https://clinicaltrials.gov/ct2/show/NCT04035577
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source doesn’t support the claim as written.
In the citing paper
“The most common assignment revolved around using the app once daily. This could be one prompt, one session, or one exercise daily, usually taking about ten minutes to complete”
From Analysis of Mobile App-Based Mental Health Solutions for College Students: A Rapid Review (2023) · cites this paper as [16]
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Two studies found no effective results but indications of substantial potential developments in the future [16,24].”
From Analysis of Mobile App-Based Mental Health Solutions for College Students: A Rapid Review (2023) · cites this paper as [16]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Using thematic analysis in psychology
Braun, V., & Clarke, V. (2006) · Qualitative Research in Psychology · doi:10.1191/1478088706qp063oa · Cited by 194,414
A Brief Measure for Assessing Generalized Anxiety Disorder: The GAD-7
Spitzer, R. L., Kroenke, K., Williams, J. B. W., & Löwe, B. (2006) · Archives of Internal Medicine · doi:10.1001/archinte.166.10.1092 · Cited by 31,765
The PHQ-9: A New Depression Diagnostic and Severity Measure
Kroenke, K., & Spitzer, R. L. (2002) · Psychiatric Annals · doi:10.3928/0048-5713-20020901-06 · Cited by 5,898 · cited 6×
“To ensure a range of symptoms of depression and anxiety, we attempted to recruit a balanced sample of participants who had higher symptoms (defined as a baseline PHQ-9 or GAD-7 score ≥10, indicating at least moderate symptoms) and those who had lower symptoms (defined as baseline PHQ-9 and GAD-7 scores both 10) from e…”
MethodInfluentialThe PHQ-8 as a measure of current depression in the general population
Kroenke, K., Strine, T. W., Spitzer, R. L., Williams, J. B. W., Berry, J. T., & Mokdad, A. H. (2009) · Journal of Affective Disorders · doi:10.1016/j.jad.2008.06.026 · Cited by 5,121 · cited 7×
“The PHQ-8 was selected as the symptom check tool because the IntelliCare for College Students app was designed as a self-guided resource that, following this initial study, would be made freely available to all interested students at these universities.”
MethodInfluentialGulliver, A., Griffiths, K. M., & Christensen, H. (2010) · BMC Psychiatry · doi:10.1186/1471-244x-10-113 · Cited by 3,292
Adolescent Onset of the Gender Difference in Lifetime Rates of Major Depression: A Theoretical Model
Cyranowski, J. M., Frank, E., Young, E., & Shear, M. K. (2000) · Archives of General Psychiatry · doi:10.1001/archpsyc.57.1.21 · Cited by 1,276
Help-Seeking and Access to Mental Health Care in a University Student Population
Eisenberg, D., Golberstein, E., & Gollust, S. E. (2007) · Medical Care · doi:10.1097/mlr.0b013e31803bb4c1 · Cited by 1,131 · cited 4×
“The KBSS includes 5 questions designed to measure knowledge of campus mental health services (eg, “What have you heard from other students about the quality of mental health and psychological counseling services on your campus?”).”
MethodInfluentialBeyond the five-user assumption: benefits of increased sample sizes in usability testing
Faulkner, L. (2003) · Behavior Research Methods, Instruments, & Computers · doi:10.3758/bf03195514 · Cited by 1,053 · cited 1×
“previous data, suggesting that 20 users can find 95% of usability problems [14].”
MethodObjective user engagement with mental health apps: systematic search and panel-based usage analysis
Baumel, A., Muench, F., Edan, S., & Kane, J. M. (2019) · Journal of Medical Internet Research · doi:10.2196/14567 · Cited by 965 · cited 3×
“Finally, because participants had committed to an 8-week study period, usage rates may have been higher than would have been in a more naturalistic study design [22].”
BackgroundInfluentialLipson, S. K., Lattie, E. G., & Eisenberg, D. (2019) · Psychiatric Services · doi:10.1176/appi.ps.201800332 · Cited by 947
Self-citation
Cited by
Thieme, A., Hanratty, M., Lyons, M., Palacios, J., Marques, R. F., Morrison, C., & Doherty, G. (2023) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3564752 · Cited by 171
Oliveira, C., Pereira, A., Vagos, P., Nóbrega, C. A., Gonçalves, J., & Afonso, B. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2021.647606 · Cited by 150
Xu, W., Liang, H., Baghaei, N., Ma, X., Yu, K., Meng, X., & Wen, S. (2021) · JMIR Serious Games · doi:10.2196/29330 · Cited by 93
Uptake and effectiveness of a self-guided mobile app platform for college student mental health
Lattie, E. G., Cohen, K. A., Hersch, E., Williams, K. D. A., Kruzan, K. P., MacIver, C., Hermes, J., Maddi, K. L., Kwasny, M., & Mohr, D. C. (2021) · Internet Interventions · doi:10.1016/j.invent.2021.100493 · Cited by 89
Self-citationGlobal youth perspectives on digital health promotion: a scoping review
Ferretti, A., Hubbs, S., & Vayena, E. (2023) · BMC Digital Health · doi:10.1186/s44247-023-00025-0 · Cited by 76
Digital Mental Health Interventions for Young People Aged 16-25 Years: Scoping Review
Potts, C., Kealy, C., McNulty, J. M., Madrid‐Cagigal, A., Wilson, T., Mulvenna, M. D., O’Neill, S. M., Donohoe, G. J., & Barry, M. M. (2025) · Journal of Medical Internet Research · doi:10.2196/72892 · Cited by 74
Wanniarachchi, V. U., Greenhalgh, C., Choi, A., & Warren, J. (2025) · Frontiers in Digital Health · doi:10.3389/fdgth.2025.1500220 · Cited by 46
D'Adamo, L., Paraboschi, L., Claire Grammer, A., Fennig, M., Graham, A. K., Yaeger, L. H., Newman, M. G., Wilfley, D. E., Barr Taylor, C., Eisenberg, D., et al. (2023) · Journal of Behavioral and Cognitive Therapy · doi:10.1016/j.jbct.2023.05.002 · Cited by 37
Personalisation and Recommendation for Mental Health Apps: A Scoping Review
Matthews, P., & Rhodes-Maquaire, C. (2024) · Behaviour and Information Technology · doi:10.1080/0144929x.2024.2356630 · Cited by 35
Mobile applications for mental health self-care: A scoping review
Ahmed, A., Ali, N., Giannicchi, A., Abd-Alrazaq, A. A., Ahmed, M. A., Aziz, S., & Househ, M. S. (2021) · Computer Methods and Programs in Biomedicine Update · doi:10.1016/j.cmpbup.2021.100041 · Cited by 31
Jin, S., Kim, B., & Han, K. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713732 · Cited by 28
Analysis of Mobile App-Based Mental Health Solutions for College Students: A Rapid Review
Choudhury, A., Kuehn, A., Shamszare, H., & Shahsavar, Y. (2023) · Healthcare · doi:10.3390/healthcare11020272 · Cited by 27
“Depression was measured using the following eight different validated scales: (a) Center for Epidemiological Studies Depression Scale (CES-D), (b) Hospital Anxiety Depression Scale (HADS), (c) Patient Health Questionnaire (PHQ), (d) Quick Inventory for Depressive Symptomatology Self Report (QIDS-SR), (e) Montgomery-As…”
BackgroundMethodInfluentialImproving mental health literacy using web- or app-based interventions: A scoping review
Tian, L., Wong, E. L., Dong, D., Cheung, A. W.-L., Chan, S. K. W., Cao, Y., Mok, P. K. H., Zhou, L.-M., & Xu, R. H. (2024) · Digital Health · doi:10.1177/20552076241243133 · Cited by 23
Nagar, R., Quirk, H. D., & Anderson, P. L. (2023) · Internet Interventions · doi:10.1016/j.invent.2023.100676 · Cited by 21
Defining young people’s mental health self-care: a systematic review and co-development approach
Truscott, A., Hayes, D., Bardsley, T., Choksi, D., & Edbrooke-Childs, J. H. (2023) · European Child & Adolescent Psychiatry · doi:10.1007/s00787-023-02320-7 · Cited by 19
Yee, L. M., Leziak, K., Jackson, J., Niznik, C. M., Saber, R., Yeh, C., & Simon, M. A. (2022) · Diabetes Spectrum · doi:10.2337/ds22-0014 · Cited by 16
Wanniarachchi, V. U., Greenhalgh, C., & Warren, J. (2025) · Internet Interventions · doi:10.1016/j.invent.2025.100884 · Cited by 14
Dietvorst, E., de Vries, L. P., van Eijl, S., Mesman, E., Legerstee, J. S., Keijsers, L., Hillegers, M. H. J., & Vreeker, A. (2024) · Digital Health · doi:10.1177/20552076241294105 · Cited by 13
Lambert, J. D., Loades, M. E., Marshall, N., Higson‐Sweeney, N., Chan, S. W. Y., Mahmud, A., Pile, V., Maity, A., Adam, H., Sung, B., et al. (2025) · Journal of Medical Internet Research · doi:10.2196/58164 · Cited by 13
McCallum, M., Ho, A. S., Mitchell, E. S., May, C. N., Behr, H., Ritschel, L. A., Mochrie, K. D., & Michaelides, A. P. (2022) · JMIR Formative Research · doi:10.2196/36794 · Cited by 13
What's In Your Kit? Mental Health Technology Kits for Depression Self-Management
Burgess, E. R., Munson, S. A., Mohr, D. C., & Reddy, M. C. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713585 · Cited by 12
Self-citationGoozée, R., Barrable, A., Ļubenko, J., Παπαδάτου-Παστού, Μ., Haddad, M., McKeown, E., Hirani, S. P., Martin, M., & Tzotzoli, P. (2022) · Journal of Mental Health · doi:10.1080/09638237.2022.2069699 · Cited by 12
Cislo, C., Clingan, C., Gilley, K. N., Rozwadowski, M., Gainsburg, I., Bradley, C. M., Barabas, J., Sandford, E., Olesnavich, M., Tyler, J., et al. (2021) · JMIR Research Protocols · doi:10.2196/29561 · Cited by 11
What medical students want from Mental Health Self-Help Resources: A focus group study
Edwin, J., Cornwall, J., & Plooy, K. D. (2024) · Mental Health & Prevention · doi:10.1016/j.mhp.2024.200353 · Cited by 10
Kim, M., Moon, Y.-K., & Chung, K. (2024) · JMIR mHealth and uHealth · doi:10.2196/50006 · Cited by 6
Ferreira, L. F. D. A., Benevides, A. M. L. N., Rabelo, J. A. F., Medeiros, M. S., Marçal, E., Sanders, L. L. O., & Peixoto, R. A. C. (2022) · Research Society and Development · doi:10.33448/rsd-v11i2.25525 · Cited by 9
Pavlacic, J. M., Hampton, B. N., Young, J. N., Witcraft, S. M., Flores, C. M. N., Vázquez, A. L., & Rheingold, A. A. (2024) · Journal of Technology in Behavioral Science · doi:10.1007/s41347-024-00416-8 · Cited by 8
Integrating Emotional AI into Mobile Apps with Smart Home Systems for Personalized Mental Wellness
Cern, Y. S. (2025) · Journal of Technology in Behavioral Science · doi:10.1007/s41347-025-00508-z · Cited by 8
Brown, S. A., & Chu, S. L. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-92300-6_30 · Cited by 8
Designing for all youth: a scoping review of equity and participation in mental health apps
Figueroa, C. A., Pérez‐Flores, N. J., Guan, K., Zhang, R., Orchard, N. A., Kuebler, W., Williams, G. C., & Stiles‐Shields, C. (2026) · npj Digital Public Health · doi:10.1038/s44482-026-00012-y · Cited by 6
Collin, C., Eyraud, C., Martin, P., Michel, M., Roux, É. L., & Alberti, C. (2025) · BMC Medicine · doi:10.1186/s12916-025-04245-1 · Cited by 5
Maulia, J. T. T. (2023) · Journal of Health Literacy and Qualitative Research · doi:10.61194/jhlqr.v3i2.510 · Cited by 4
Bibliometric Analysis: Student Mental Health
Readi, R., & Mukhlis, I. (2023) · Ethics and Law Journal Business and Notary · doi:10.61292/eljbn.76 · Cited by 4
Dandil, Y., & Kingston, J. L. (2025) · Journal of Technology in Human Services · doi:10.1080/15228835.2025.2491347 · Cited by 4
Quirk, H. D., Nagar, R., & Anderson, P. L. (2023) · Journal of American College Health · doi:10.1080/07448481.2023.2198033 · Cited by 4
Bannigan, G., McGrath, D., Matthews, J. J., & Duignan, C. (2024) · SN Computer Science · doi:10.1007/s42979-024-03014-w · Cited by 3
Louzada, J. D. S., & Pacheco, A. D. S. (2022) · Research Society and Development · doi:10.33448/rsd-v11i5.27977 · Cited by 3
Health service requirements of mHealth app users: evidence from Hangzhou, China
Xu, Z., & Meng, Z. (2024) · Journal of Health Organization and Management · doi:10.1108/jhom-01-2024-0026 · Cited by 3
Analisis Kerangka Intervensi Pakej Pendidikan Kesihatan Mental Belia di Malaysia: Tinjauan Naratif
Daud, N. I. A. M., Sutan, R., & Isa, Z. M. (2025) · Jurnal e-Bangi/e-Bangi · doi:10.17576/ebangi.2025.2201.28 · Cited by 2
Wijaya, H., Setyawati, E., & Mahendra, C. (2021) · INCODING Journal of Informatics and Computer Science Engineering · doi:10.34007/incoding.v2i1.132 · Cited by 2
ale undergraduate students’ perceptions of male student mental health
Wolstenholme, C. (2022) · Sheffield Hallam University · doi:10.7190/shu-thesis-00506 · Cited by 2
Liang, Z., Wang, C., Zhou, Q., Tuersun, Y., Yu, Y., Liu, S., Xie, Y., & Qian, Y. (2025) · BMC Public Health · doi:10.1186/s12889-025-24294-8 · Cited by 1
Choate, S. A. (2022) · ThinkIR: The University of Louisville's Institutional Repository (University of Louisville) · doi:10.18297/etd/3980 · Cited by 1
Bannigan, G., Duignan, C., & McGrath, D. (2023) · Communications in computer and information science · doi:10.1007/978-3-031-29548-5_7
Oliveira, B. A. D., Dent, K., Smith, J. A., Merchant, W. R., & Wright, S. L. (2023) · Child & Youth Services · doi:10.1080/0145935x.2023.2187774
Хайрова, З. Р., Plotnikov, A., Kelareva, I., & Gani, S. V. (2025) · Communications in computer and information science · doi:10.1007/978-3-032-04958-2_21
Khalil, L., Serhier, Z., Berrami, H., & Mouzoun, F. Z. (2023) · Springer Link (Chiba Institute of Technology) · doi:10.1051/e3sconf/202341201026/pdf
Rava, J. A. (2023) · eScholarship (California Digital Library)
Student-Centered Design of a Mental Health Self-Management Tool
Ramos, E. T. (2023) · OakTrust (Texas A&M University Libraries)
Gamified mental health: digital therapeutic alliance and mental well-being
Hirpara, S., & Kachhi, Z. (2025) · Mental Health and Digital Technologies · doi:10.1108/mhdt-08-2025-0052
Ahmadi, N., Sasangohar, F., Jones-wood, S., Moskowitz, J. T., & Phillips, R. (2025) · doi:10.2196/preprints.90531
Masiran, R., Tan, K., Rasol, N. D. M., & Roy, S. (2026) · Research Square · doi:10.21203/rs.3.rs-8631798/v1
A Personalised Well-Being App for Staff Working in Healthcare Settings: A Pilot Feasibility Study
Dandil, Y., McGillivray, H., & Kingston, J. L. (2026) · Journal of Technology in Human Services · doi:10.1080/15228835.2026.2629258
Kim, M., Kim, H., Heo, J.-I., Lee, S., Lahcine, O. F., Lee, S., Kim, H., & Jung, D. (2026) · Journal of Medical Internet Research · doi:10.2196/78930
Taking Mental Health Technology Kits from Concept to Practice: Considering a Community Approach
Burgess, E. R., Chung, C.-F., Burleson, W., Reddy, M. C., & Munson, S. A. (2026) · ACM Interactive Health Conference · doi:10.1145/3786579.3804920
An exploration and evaluation of personalisation in a digital mental health intervention
Rhodes-Maquaire, C. (2025) · UWE Research Repository (UWE Bristol)
Lu, A., & Yeoh, A. (2024) · Journal of Asian Medical Students Association
Haksama, S., & Qolbi, A. (2025) · Journal of Digital Health Innovation and Medical Technology
Makaba, S., & Rumbiak, H. (2025) · Journal of Digital Health Innovation and Medical Technology
Susanto, T., Windarwati, H. D., Ati, N. A. L., Istifada, R., Armaijn, L., Pranata, A. E., Nihayati, H. E., Dwidiyanti, M., Marliana, T., Fahamsyah, E., et al. (2026) · JMIR Human Factors · doi:10.2196/87647
Metadata
- Authors
- Lattie, E., Cohen, K. A., Winquist, N., & Mohr, D. C.
- Affiliations
- Northwestern University (US)
- Corresponding author
- Lattie, Emily
- Venue
- JMIR Mental Health
- Publisher
- JMIR Publications Inc.
- Published
- 2020-10-10
- Volume
- 7
- Issue
- 10
- Pages
- e21075
- ISSN
- 2368-7959 (ISSN-L)
- PMC
- PMC7585772
- OpenAlex
- W3092178332
- Cited by
- 50
- References
- 30
- Citations by year
- 2026: 4 · 2025: 14 · 2024: 8 · 2023: 10 · 2022: 7 · 2021: 7
- FWCI
- 5.42
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- JMIR Mental Health (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- National Institutes of Health (UL1TR001422)
- National Institute of Mental Health (K08MH112878)
- National Center for Advancing Translational Sciences
- Topics
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
- Health Sciences › Medicine › Psychiatry and Mental health › Mental Health Treatment and Access
- Keywords
- mental health apps, university students, depression, anxiety, mental health self-care, app usability, user feedback, coping strategies, symptom assessment, user retention, digital mental health interventions, university counseling services, user engagement, program acceptability
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.