Augmenting Mental Health in Primary Care: A 1-Year Study of Deploying Smartphone Apps in a Multi-site Primary Care/Behavioral Health Integration Program
Open accessThe DOI matches its Crossref record; 16 of the 16 references it cites were found in a registry or an index.
Abstract
Background: Integrating behavioral health (BH) services into primary care is an evidence-based intervention that can increase access to care, improve patient outcomes, and decrease costs. Digital technology, including smartphone apps, has the potential to augment and extend the reach of these integrated behavioral health services through self-management support impacting lifestyle behaviors. To date, the feasibility and acceptability of using mental health mobile apps within an integrated primary care setting has not yet been explored as part of routine clinical care. Objectives: The objectives of this study were to a) test the feasibility of using mental health applications to augment integrated primary care services; b) solicit feedback from patients and providers to guide implementation, and c) develop a mental health apps toolkit for system-wide dissemination. Methods: Cambridge Health Alliance (CHA) is a safety-net healthcare system that includes two community hospitals and 12 Primary Care (PC) clinics serving nearly 150,000 ethnically and socioeconomically diverse patients around Boston. To select and disseminate mental health apps, a four-phase implementation was undertaken: 1) Evaluation of mental health mobile applications 2) Development of an apps toolkit with stakeholder input, 3) Conducting initial pilot at six primary care locations, and 4) Rolling out the app toolkit across 12 primary care sites and conducting one-year follow-up survey. Results: Among BH providers, 75% responded to the follow-up survey and 83% indicated they use apps as part of their clinical care. Anxiety was the most common condition for which app use was recommended by providers, and 42% expressed interest in further developing their knowledge of mental health apps. Among patients, 65% of participants provided feedback; 66% reported the tools to be helpful, especially for managing stress and anxiety. Conclusions: Our findings indicate mental health apps are applicable and relevant to patients within integrated primary care settings in safety-net health systems. Behavioral health providers perceive the clinical value of using these tools as part of patient care, but require training to increase their comfort-level and confidence applying these tools with patients. To increase provider and patient engagement, mobile apps must be accessible, simple, intuitive and directly relevant to patients’ treatment needs.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Collaborative care for depression and anxiety problems
Archer, J., Bower, P., Gilbody, S., Lovell, K., Richards, D., Gask, L., Dickens, C., & Coventry, P. (2012) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd006525.pub2 · Cited by 1,126
Babor, T. F., McRee, B. G., Kassebaum, P. A., Grimaldi, P. L., Ahmed, K., & Bray, J. (2007) · Substance Abuse · doi:10.1300/j465v28n03_03 · Cited by 1,100
Firth, J., Torous, J., Nicholas, J., Carney, R., Pratap, A., Rosenbaum, S., & Sarris, J. (2017) · World Psychiatry · doi:10.1002/wps.20472 · Cited by 1,097 · cited 1×
“Meta-analysis of randomized clinical studies of smartphone apps for depressive symptoms (9) and anxiety disorders (10) have demonstrated early efficacy data.”
BackgroundSelf-citationMental Health Smartphone Apps: Review and Evidence-Based Recommendations for Future Developments
Bakker, D., Kazantzis, N., Rickwood, D., & Rickard, N. (2016) · JMIR Mental Health · doi:10.2196/mental.4984 · Cited by 886
Development and validation of the user version of the Mobile application rating scale (uMARS)
Stoyanov, S. R., Hides, L., Kavanagh, D. J., & Wilson, H. (2016) · JMIR mhealth and uhealth · doi:10.2196/mhealth.5849 · Cited by 872 · cited 1×
“Drawing on feedback from our Patient Partner Lead, staff member expertise, papers on app evaluation (24), and elements of the user version of the Mobile Apps Rating System (U-MARS) (25), the workgroup next narrowed the list to nine apps and drafted a process for introducing the apps through the Primary Care Behavioral…”
A Smartphone Application to Support Recovery From Alcoholism: A Randomized Clinical Trial
Gustafson, D. H., McTavish, F. M., Chih, M.-Y., Atwood, A. K., Johnson, R. A., Boyle, M. G., Levy, M. S., Driscoll, H., Chisholm, S. M., Dillenburg, L., et al. (2014) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2013.4642 · Cited by 692
Firth, J., Torous, J., Nicholas, J., Carney, R., Rosenbaum, S., & Sarris, J. (2017) · Journal of Affective Disorders · doi:10.1016/j.jad.2017.04.046 · Cited by 675
Self-citationm-Health adoption by healthcare professionals: a systematic review
Gagnon, M.-P., Ngangue, P., Payne-Gagnon, J., & Desmartis, M. (2016) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocv052 · Cited by 622
Torous, J., & Roberts, L. W. (2017) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2017.0262 · Cited by 362
Self-citationMental health: there’s an app for that
Anthes, E. (2016) · Nature · doi:10.1038/532020a · Cited by 333
IntelliCare: An Eclectic, Skills-Based App Suite for the Treatment of Depression and Anxiety
Mohr, D. C., Tomasino, K. N., Lattie, E. G., Palac, H. L., Kwasny, M. J., Weingardt, K., Karr, C. J., Kaiser, S. M., Rossom, R. C., Bardsley, L. R., et al. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.6645 · Cited by 301
Lennon, M. R., Bouamrane, M.-M., Devlin, A. M., O'Connor, S., O'Donnell, C., Chetty, U., Agbakoba, R., Bikker, A., Grieve, E., Finch, T., et al. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.6900 · Cited by 264
Usability of Commercially Available Mobile Applications for Diverse Patients
Sarkar, U., Gourley, G. I., Lyles, C. R., Tieu, L., Clarity, C., Newmark, L., Singh, K., & Bates, D. W. (2016) · Journal of General Internal Medicine · doi:10.1007/s11606-016-3771-6 · Cited by 257 · cited 1×
“On the patient side, there is also concern that many commercially available mental health apps may not be designed for those with more severe symptoms (18).”
BackgroundTorous, J., Chan, S. R., Yee-Marie Tan, S., Behrens, J., Mathew, I., Conrad, E. J., Hinton, L., Yellowlees, P., & Keshavan, M. (2014) · JMIR Mental Health · doi:10.2196/mental.4004 · Cited by 228
Self-citationTowards a Framework for Evaluating Mobile Mental Health Apps
Chan, S., Torous, J., Hinton, L., & Yellowlees, P. (2015) · Telemedicine and e-Health · doi:10.1089/tmj.2015.0002 · Cited by 163
Self-citationTorous, J., Firth, J., Huckvale, K., Larsen, M. E., Cosco, T. D., Carney, R., Chan, S., Pratap, A., Yellowlees, P., Wykes, T., et al. (2018) · Journal of Nervous & Mental Disease · doi:10.1097/nmd.0000000000000864 · Cited by 101
Self-citation
Cited by
The ethics of AI in health care: A mapping review
Morley, J., Machado, C. C. V., Burr, C., Cowls, J., Joshi, I., Taddeo, M., & Floridi, L. (2020) · Social Science & Medicine · doi:10.1016/j.socscimed.2020.113172 · Cited by 1,105
HOFFMAN, L., WISNIEWSKI, H., HAYS, R., HENSON, P., VAIDYAM, A., HENDEL, V., KESHAVAN, M., & TOROUS, J. (2020) · Journal of Psychiatric Practice · doi:10.1097/pra.0000000000000450 · Cited by 97
Self-citationThe Debate on the Ethics of AI in Health Care: a Reconstruction and Critical Review
Morley, J., Machado, C., Burr, C., Cowls, J., Taddeo, M., & Floridi, L. (2019) · SSRN Electronic Journal · doi:10.2139/ssrn.3486518 · Cited by 66
Anmella, G., Sanabra, M., Primé-Tous, M., Segú, X., Cavero, M., Morilla, I., Grande, I., Ruiz, V., Mas, A., Martín-Villalba, I., et al. (2023) · Journal of Medical Internet Research · doi:10.2196/43293 · Cited by 65
Alkhaldi, O., McMillan, B., Maddah, N., & Ainsworth, J. (2023) · JMIR mHealth and uHealth · doi:10.2196/43561 · Cited by 37
Metadata
- Authors
- Hoffman, L., Benedetto, E., Huang, H., Grossman, E., Kaluma, D., Mann, Z., & Torous, J.
- Venue
- Frontiers in Psychiatry
- Publisher
- Frontiers Media SA
- Published
- 2019-02-28
- Volume
- 10
- Pages
- 94-94
- ISSN
- 1664-0640 (ISSN-L)
- OpenAlex
- W2919679984
- Cited by
- 71
- References
- 16
- FWCI
- 10.45
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.