Examining an App-Based Mental Health Self-Care Program, IntelliCare for College Students: Single-Arm Pilot Study
Open accessPublished version of a preprint
The DOI matches its Crossref record; 30 of the 30 references it cites were found in a registry or an index.
Abstract
Background: In recent years, there has been an increase in symptoms of depression, anxiety, and other mental illnesses in college student populations alongside a steady rise in the demand for counseling services. Digital mental health programs, such as those delivered through mobile apps, can add to the array of available services but must be tested for usability and acceptability before implementation. Objective: This study aims to examine how students used IntelliCare for College Students over an 8-week period to examine the preliminary associations between app use and psychosocial targets and to gather user feedback about usability issues that need to be remedied before a larger implementation study. Methods: IntelliCare for College Students is an app-based platform that provides symptom assessments with personalized feedback, information about campus resources, lessons on mental health and wellness topics, and access to the suite of interactive skill–focused IntelliCare apps. A total of 20 students were recruited to participate in an 8-week study. To test for a broad range of potential users, we recruited a mixed sample of students with elevated symptoms of depression or anxiety and students without elevated symptoms. Participants completed psychosocial questionnaires at baseline, week 4, and week 8. Participants also completed user feedback interviews at weeks 4 and 8 in which they provided feedback on their experience using the app and suggestions for changes they would like to be made to the app. Results: Of the 20 students who downloaded the app, 19 completed the study, indicating a high rate of retention. Over the study period, participants completed an average of 5.85 (SD 2.1; range 1-8) symptom assessments. Significant improvements were observed in the Anxiety Literacy Questionnaire scores (Z=−2.006; P=.045) and in the frequency with which participants used both cognitive (Z=−2.091; P=.04) and behavioral (Z=−2.249; P=.03) coping skills. In the feedback interviews, we identified a high degree of usability with minor bugs in the app software, which were quickly fixed. Furthermore, in feedback interviews, we identified that users found the app to be convenient and appreciated the ability to use the program in short bursts of time. Conclusions: The findings indicate that the IntelliCare for College Students program was perceived as largely usable and engaging. Although the program demonstrated usability and preliminary benefits to students, further testing is needed to determine its clinical utility among college students. Trial Registration: ClinicalTrials.gov NCT04035577; https://clinicaltrials.gov/ct2/show/NCT04035577
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source doesn’t support the claim as written.
In the citing paper
“The most common assignment revolved around using the app once daily. This could be one prompt, one session, or one exercise daily, usually taking about ten minutes to complete”
From Analysis of Mobile App-Based Mental Health Solutions for College Students: A Rapid Review (2023) · cites this paper as [16]
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Two studies found no effective results but indications of substantial potential developments in the future [16,24].”
From Analysis of Mobile App-Based Mental Health Solutions for College Students: A Rapid Review (2023) · cites this paper as [16]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Using thematic analysis in psychology
Braun, V., & Clarke, V. (2006) · Qualitative Research in Psychology · doi:10.1191/1478088706qp063oa · Cited by 194,414
A Brief Measure for Assessing Generalized Anxiety Disorder: The GAD-7
Spitzer, R. L., Kroenke, K., Williams, J. B. W., & Löwe, B. (2006) · Archives of Internal Medicine · doi:10.1001/archinte.166.10.1092 · Cited by 31,765
The PHQ-9: A New Depression Diagnostic and Severity Measure
Kroenke, K., & Spitzer, R. L. (2002) · Psychiatric Annals · doi:10.3928/0048-5713-20020901-06 · Cited by 5,898 · cited 6×
“To ensure a range of symptoms of depression and anxiety, we attempted to recruit a balanced sample of participants who had higher symptoms (defined as a baseline PHQ-9 or GAD-7 score ≥10, indicating at least moderate symptoms) and those who had lower symptoms (defined as baseline PHQ-9 and GAD-7 scores both 10) from e…”
MethodInfluentialThe PHQ-8 as a measure of current depression in the general population
Kroenke, K., Strine, T. W., Spitzer, R. L., Williams, J. B. W., Berry, J. T., & Mokdad, A. H. (2009) · Journal of Affective Disorders · doi:10.1016/j.jad.2008.06.026 · Cited by 5,121 · cited 7×
“The PHQ-8 was selected as the symptom check tool because the IntelliCare for College Students app was designed as a self-guided resource that, following this initial study, would be made freely available to all interested students at these universities.”
MethodInfluentialGulliver, A., Griffiths, K. M., & Christensen, H. (2010) · BMC Psychiatry · doi:10.1186/1471-244x-10-113 · Cited by 3,292
Adolescent Onset of the Gender Difference in Lifetime Rates of Major Depression: A Theoretical Model
Cyranowski, J. M., Frank, E., Young, E., & Shear, M. K. (2000) · Archives of General Psychiatry · doi:10.1001/archpsyc.57.1.21 · Cited by 1,276
Help-Seeking and Access to Mental Health Care in a University Student Population
Eisenberg, D., Golberstein, E., & Gollust, S. E. (2007) · Medical Care · doi:10.1097/mlr.0b013e31803bb4c1 · Cited by 1,131 · cited 4×
“The KBSS includes 5 questions designed to measure knowledge of campus mental health services (eg, “What have you heard from other students about the quality of mental health and psychological counseling services on your campus?”).”
MethodInfluentialBeyond the five-user assumption: benefits of increased sample sizes in usability testing
Faulkner, L. (2003) · Behavior Research Methods, Instruments, & Computers · doi:10.3758/bf03195514 · Cited by 1,053 · cited 1×
“previous data, suggesting that 20 users can find 95% of usability problems [14].”
MethodObjective user engagement with mental health apps: systematic search and panel-based usage analysis
Baumel, A., Muench, F., Edan, S., & Kane, J. M. (2019) · Journal of Medical Internet Research · doi:10.2196/14567 · Cited by 965 · cited 3×
“Finally, because participants had committed to an 8-week study period, usage rates may have been higher than would have been in a more naturalistic study design [22].”
BackgroundInfluentialLipson, S. K., Lattie, E. G., & Eisenberg, D. (2019) · Psychiatric Services · doi:10.1176/appi.ps.201800332 · Cited by 947
Self-citation
Cited by
Thieme, A., Hanratty, M., Lyons, M., Palacios, J., Marques, R. F., Morrison, C., & Doherty, G. (2023) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3564752 · Cited by 171
Oliveira, C., Pereira, A., Vagos, P., Nóbrega, C. A., Gonçalves, J., & Afonso, B. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2021.647606 · Cited by 150
Xu, W., Liang, H., Baghaei, N., Ma, X., Yu, K., Meng, X., & Wen, S. (2021) · JMIR Serious Games · doi:10.2196/29330 · Cited by 93
Uptake and effectiveness of a self-guided mobile app platform for college student mental health
Lattie, E. G., Cohen, K. A., Hersch, E., Williams, K. D. A., Kruzan, K. P., MacIver, C., Hermes, J., Maddi, K. L., Kwasny, M., & Mohr, D. C. (2021) · Internet Interventions · doi:10.1016/j.invent.2021.100493 · Cited by 89
Self-citationGlobal youth perspectives on digital health promotion: a scoping review
Ferretti, A., Hubbs, S., & Vayena, E. (2023) · BMC Digital Health · doi:10.1186/s44247-023-00025-0 · Cited by 76
Metadata
- Authors
- Lattie, E., Cohen, K. A., Winquist, N., & Mohr, D. C.
- Affiliations
- Northwestern University (US)
- Corresponding author
- Lattie, Emily
- Venue
- JMIR Mental Health
- Publisher
- JMIR Publications Inc.
- Published
- 2020-10-10
- Volume
- 7
- Issue
- 10
- Pages
- e21075
- ISSN
- 2368-7959 (ISSN-L)
- PMC
- PMC7585772
- OpenAlex
- W3092178332
- Cited by
- 50
- References
- 30
- Citations by year
- 2026: 4 · 2025: 14 · 2024: 8 · 2023: 10 · 2022: 7 · 2021: 7
- FWCI
- 5.42
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- JMIR Mental Health (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- National Institutes of Health (UL1TR001422)
- National Institute of Mental Health (K08MH112878)
- National Center for Advancing Translational Sciences
- Topics
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
- Health Sciences › Medicine › Psychiatry and Mental health › Mental Health Treatment and Access
- Keywords
- mental health apps, university students, depression, anxiety, mental health self-care, app usability, user feedback, coping strategies, symptom assessment, user retention, digital mental health interventions, university counseling services, user engagement, program acceptability
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Examining an App-Based Mental Health Self-Care Program, IntelliCare for College Students: Single-Arm Pilot Study. https://app.cochat.ai/papers/10.2196/21075
- The paper
- Lattie, E., Cohen, K. A., Winquist, N., & Mohr, D. C. (2020). Examining an App-Based Mental Health Self-Care Program, IntelliCare for College Students: Single-Arm Pilot Study. JMIR Mental Health. https://doi.org/10.2196/21075
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.