Exploring the Use of Multiple Mental Health Apps Within a Platform: Secondary Analysis of the IntelliCare Field Trial
Open accessPublished version of a preprint
The DOI matches its Crossref record; 17 of the 17 references it cites were found in a registry or an index.
Abstract
Background: IntelliCare is a mental health app platform with 14 apps that are elemental, simple and brief to use, and eclectic. Although a variety of apps may improve engagement, leading to better outcomes, they may require navigation aids such as recommender systems that can quickly direct a person to a useful app. Objective: As the first step toward developing navigation and recommender tools, this study explored app-use patterns across the IntelliCare platform and their relationship with depression and anxiety outcomes. Methods: This is a secondary analysis of the IntelliCare Field Trial, which recruited people with depression or anxiety. Participants of the trial received 8 weeks of coaching, primarily by text, and weekly random recommendations for apps. App-use metrics included frequency and lifetime use. Depression and anxiety, measured using the Patient Health Questionnaire-9 and Generalized Anxiety Disorder-7, respectively, were assessed at baseline and end of treatment. Cluster analysis was utilized to determine patterns of app use; ordinal logistic regression models and log-rank tests were used to determine if these use metrics alone, or in combination, predicted improvement or remission in depression or anxiety. Results: The analysis included 96 people who generally followed recommendations to download and try new apps each week. Apps were clustered into 5 groups: Thinking (apps that targeted or relied on thinking), Calming (relaxation and insomnia), Checklists (apps that used checklists), Activity (behavioral activation and activity), and Other. Both overall frequency of use and lifetime use predicted response for depression and anxiety. The Thinking, Calming, and Checklist clusters were associated with improvement in depression and anxiety, and the Activity cluster was associated with improvement in Anxiety only. However, the use of clusters was less strongly associated with improvement than individual app use. Conclusions: Participants in the field trial remained engaged with a suite of apps for the full 8 weeks of the trial. App-use patterns did fall into clusters, suggesting that some knowledge about the use of one app may be useful in selecting another app that the person is more likely to use and may help suggest apps based on baseline symptomology and personal preference.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The PHQ-9: Validity of a brief depression severity measure
Kroenke, K., Spitzer, R. L., & Williams, J. B. W. (2001) · Journal of General Internal Medicine · doi:10.1046/j.1525-1497.2001.016009606.x · Cited by 44,910
Kroenke, K., Spitzer, R. L., Williams, J. B. W., & Löwe, B. (2010) · General Hospital Psychiatry · doi:10.1016/j.genhosppsych.2010.03.006 · Cited by 4,057
Global prevalence of anxiety disorders: a systematic review and meta-regression
Baxter, A. J., Scott, K. M., Vos, T., & Whiteford, H. A. (2013) · Psychological Medicine · doi:10.1017/s003329171200147x · Cited by 1,537
Ferrari, A. J., Somerville, A. J., Baxter, A. J., Norman, R., Patten, S. B., Vos, T., & Whiteford, H. A. (2013) · Psychological Medicine · doi:10.1017/s0033291712001511 · Cited by 1,230 · cited 1×
“Depression and anxiety are common mental health problems [1,2] and are among the leading causes of morbidity and disability worldwide [3].”
BackgroundFirth, J., Torous, J., Nicholas, J., Carney, R., Pratap, A., Rosenbaum, S., & Sarris, J. (2017) · World Psychiatry · doi:10.1002/wps.20472 · Cited by 1,097 · cited 1×
“More recently, mobile apps have been developed and evaluated for the treatment of depression [9,10].”
Mohr, D. C., Cuijpers, P., & Lehman, K. (2011) · Journal of Medical Internet Research · doi:10.2196/jmir.1602 · Cited by 1,097 · cited 1×
“Coaching was guided by the IntelliCare Coaching Manual [22], which is based on aspects of the Efficiency Model of Behavioral Intervention Technologies Support [23] and supportive accountability [24].”
Self-citationChorpita, B. F., & Daleiden, E. L. (2009) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0014565 · Cited by 687 · cited 1×
“There are many potential psychological and behavioral strategies that can be used to target specific concerns associated with mental health problems [12,13].”
Firth, J., Torous, J., Nicholas, J., Carney, R., Rosenbaum, S., & Sarris, J. (2017) · Journal of Affective Disorders · doi:10.1016/j.jad.2017.04.046 · Cited by 675 · cited 1×
“More recently, mobile apps have been developed and evaluated for the treatment of depression [9,10].”
Interaction in 4-second bursts: the fragmented nature of attentional resources in mobile HCI
Oulasvirta, A., Tamminen, S., Roto, V., & Kuorelahti, J. (2005) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1054972.1055101 · Cited by 576 · cited 1×
“People tend to use apps in very short bursts of time, sometimes frequently [15,16].”
BackgroundPerceived barriers to psychological treatments and their relationship to depression
Mohr, D. C., Ho, J., Duffecy, J., Baron, K. G., Lehman, K. A., Jin, L., & Reifler, D. (2010) · Journal of Clinical Psychology · doi:10.1002/jclp.20659 · Cited by 347 · cited 1×
“The vast majority of people experiencing these common mental health problems are unable to access treatment due to a variety of actual or perceived barriers including the lack of availability of services, time constraints, transportation problems, and cost [4,5].”
Self-citation
Research works printed but not linked: 8
- 10.1016/S0140-6736(16)31678-6 · DOI · Paper page
- 10.1016/j.cpr.2012.02.004 · DOI · Paper page
- 10.1007/s12160-013-9486-6 · DOI · Paper page
- England, MJ, 2015, Psychosocial Interventions For Mental And Substance Use Disorders: A Framework For Establishing Evidence-based Standards
- 10.1093/jamia/ocy023 · DOI · Paper page
- 10.1001/archinte.166.10.1092 · DOI · Paper page
- 10.1111/cpsp.12173 · doi:10.1111/cpsp.12173 · Paper page
- Spitzer, RL, 1999, JAMA, 282, 1737, 10.1001/jama.282.18.1737 · DOI · Paper page
Cited by
Graham, A. K., Greene, C. J., Kwasny, M. J., Kaiser, S. M., Lieponis, P., Powell, T., & Mohr, D. C. (2020) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2020.1011 · Cited by 162
Self-citationMohr, D. C., Schueller, S. M., Tomasino, K. N., Kaiser, S. M., Alam, N., Karr, C., Vergara, J. L., Gray, E. L., Kwasny, M. J., & Lattie, E. G. (2019) · Journal of Medical Internet Research · doi:10.2196/13609 · Cited by 116
Self-citationStawarz, K., Preist, C., & Coyle, D. (2019) · JMIR Mental Health · doi:10.2196/12546 · Cited by 107
“Promising initial work in this area has been carried out by Mohr et al [51,63], who developed IntelliCare: an eclectic suite of highly focused elemental apps that together provide a wide range of features, which can be combined and used as needed.”
BackgroundClinically Meaningful Use of Mental Health Apps and its Effects on Depression: Mixed Methods Study
Zhang, R., Nicholas, J., Knapp, A. A., Graham, A. K., Gray, E., Kwasny, M. J., Reddy, M., & Mohr, D. C. (2019) · Journal of Medical Internet Research · doi:10.2196/15644 · Cited by 91
Self-citationChen, A. T., Wu, S., Tomasino, K. N., Lattie, E. G., & Mohr, D. C. (2019) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2019.103187 · Cited by 58
Self-citation
Metadata
- Authors
- Kwasny, M. J., Schueller, S. M., Lattie, E., Gray, E. L., & Mohr, D. C.
- Venue
- JMIR Mental Health
- Publisher
- JMIR Publications Inc.
- Published
- 2019-03-21
- Volume
- 6
- Issue
- 3
- Pages
- e11572
- ISSN
- 2368-7959 (ISSN-L)
- OpenAlex
- W2905913144
- Cited by
- 37
- References
- 17
- FWCI
- 6.75
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.