CoChat

Clinically Meaningful Use of Mental Health Apps and its Effects on Depression: Mixed Methods Study

Open access

Published version of a preprint

The DOI matches its Crossref record; 42 of the 42 references it cites were found in a registry or an index.

Abstract

Background: User engagement is key to the effectiveness of digital mental health interventions. Considerable research has examined the clinical outcomes of overall engagement with mental health apps (eg, frequency and duration of app use). However, few studies have examined how specific app use behaviors can drive change in outcomes. Understanding the clinical outcomes of more nuanced app use could inform the design of mental health apps that are more clinically effective to users. Objective: This study aimed to classify user behaviors in a suite of mental health apps and examine how different types of app use are related to depression and anxiety outcomes. We also compare the clinical outcomes of specific types of app use with those of generic app use (ie, intensity and duration of app use) to understand what aspects of app use may drive symptom improvement. Methods: We conducted a secondary analysis of system use data from an 8-week randomized trial of a suite of 13 mental health apps. We categorized app use behaviors through a mixed methods analysis combining qualitative content analysis and principal component analysis. Regression analyses were used to assess the association between app use and levels of depression and anxiety at the end of treatment. Results: A total of 3 distinct clusters of app use behaviors were identified: learning, goal setting, and self-tracking. Each specific behavior had varied effects on outcomes. Participants who engaged in self-tracking experienced reduced depression symptoms, and those who engaged with learning and goal setting at a moderate level (ie, not too much or not too little) also had an improvement in depression. Notably, the combination of these 3 types of behaviors, what we termed “clinically meaningful use,” accounted for roughly the same amount of variance as explained by the overall intensity of app use (ie, total number of app use sessions). This suggests that our categorization of app use behaviors succeeded in capturing app use associated with better outcomes. However, anxiety outcomes were neither associated with specific behaviors nor generic app use. Conclusions: This study presents the first granular examination of user interactions with mental health apps and their effects on mental health outcomes. It has important implications for the design of mobile health interventions that aim to achieve greater user engagement and improved clinical efficacy.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.2196/15644

Cites

42 of 42 references verified0 citation errors · 0 not checkable

Statistics

Figures

Figure 1 Procedure for categorizing app use activities across 13 IntelliCare apps.
Figure 1 Procedure for categorizing app use activities across 13 IntelliCare apps.CC BY · PubMed Central
Figure 2 Principal component analysis of the types of clinically meaningful activities.
Figure 2 Principal component analysis of the types of clinically meaningful activities.CC BY · PubMed Central

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 42 references

Research works printed but not linked: 1

  1. Lupton, D, 2016, The Quantified Self

Cited by

See all 91

Metadata

Authors
Zhang, R., Nicholas, J., Knapp, A. A., Graham, A. K., Gray, E., Kwasny, M. J., Reddy, M., & Mohr, D. C.
Affiliations
Northwestern University (US)
Corresponding author
Zhang, Renwen
Venue
Journal of Medical Internet Research
Published
2019-12-20
Volume
21
Issue
12
Pages
e15644
ISSN
1438-8871 (ISSN-L)
OpenAlex
W2980344427
Cited by
91
References
42
Citations by year
2026: 7 · 2025: 11 · 2024: 14 · 2023: 11 · 2022: 19 · 2021: 22 · 2020: 7
FWCI
13.50
Type
journal article
Language
en
Open access
Licence
cc-by
Locations
  • Journal of Medical Internet Research (publishedVersion, cc-by)
  • Europe PMC (PubMed Central) (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
Funders
  • National Institutes of Health (UL1TR001422)
  • National Institute of Mental Health (R01MH100482, T32MH115882)
  • National Institute of Diabetes and Digestive and Kidney Diseases (K01DK116925)
  • National Center for Advancing Translational Sciences
Topics
  • Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
  • Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
  • Social Sciences › Psychology › Experimental and Cognitive Psychology › Mental Health Research Topics
Keywords
mental health apps, depression, anxiety, user engagement, self-tracking, goal setting, learning, mobile health intervention, digital mental health, symptom improvement
MeSH terms
Adolescent, Adult, Aged, Depressive Disorder, Humans, Mental Health, Middle Aged, Telemedicine, Young Adult, Meaningful Use, Mobile Applications

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Clinically Meaningful Use of Mental Health Apps and its Effects on Depression: Mixed Methods Study. https://app.cochat.ai/papers/10.2196/15644
The paper
Zhang, R., Nicholas, J., Knapp, A. A., Graham, A. K., Gray, E., Kwasny, M. J., Reddy, M., & Mohr, D. C. (2019). Clinically Meaningful Use of Mental Health Apps and its Effects on Depression: Mixed Methods Study. Journal of Medical Internet Research. https://doi.org/10.2196/15644

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.