Mental health mobile phone app usage, concerns, and benefits among psychiatric outpatients: comparative survey study
Open accessPublished version of a preprint
Abstract
Background: Despite the popularity of mental health apps, it is unknown if they are actually used by those with mental illness. This study assessed whether differences in clinic setting may influence the use of mental health apps and which factors influence patient perception of apps. Objective: The objective of this study was to gain an understanding of how individuals with mental illness use their mobile phones by exploring their access to mobile phones and their use of mental health apps. Methods: A single time point survey study was conducted over a 2-week period in February 2018 at two nearby outpatient psychiatry clinics: one serving largely mood and anxiety disorder patients with private insurance staffed by both faculty and residents and the other serving largely psychotic disorder patients in a state Department of Mental Health (DMH) setting. A total of 25 patients at the state DMH clinic also consented for a single time point observation of apps currently installed on their personal mobile phone. Results: A total of 113 patients at the private insurance clinic and 73 at the state DMH clinic completed the survey. Those in the private insurance clinic were more likely to download a mental health app compared to the state DMH clinic, but actual rates of reported current app usage were comparable at each clinic, approximately 10%. Verifying current apps on patients’ mobile phones at the state DMH clinic confirmed that approximately 10% had mental health apps installed. Patients at both clinics were most concerned about privacy of mental health apps, although those at the state DMH clinic viewed cost savings as the greatest benefit while those at the private clinic reported time as the greatest benefit. Conclusions: High interest in mental health apps does not automatically translate into high use. Our results of low but similar rates of mental health app use at diverse clinics suggests DMH patients with largely psychotic disorders are as interested and engaged with apps as those in a private insurance clinic treating largely mood and anxiety disorders. Results from our study also highlight the importance of understanding how actual patients are using apps instead of relying on internet-based samples, which often yield higher results due to their likelihood of being selected.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The COINCIDE trial found that collaborative care for people with depression and diabetes or cardiovascular disease improved depression outcomes and increased self-management, with modest effect sizes, in routine practice in areas of high deprivation.
“The intervention improved depression outcomes and increased self-management. Effect sizes were modest, but the intervention was delivered in the context of routine practice in areas of high deprivation. 613”
From Time for united action on depression: a Lancet–World Psychiatric Association Commission (2022) · cites this paper as [613]
Multiple studies show that digital biomarkers including movement intensity, light exposure, and smartphone usage patterns can forecast the diagnostic status of individuals with mood disorders.
“Multiple studies have showcased the promise of digital biomarkers, encompassing factors like movement intensity, light exposure, and smartphone usage patterns, in forecasting the diagnostic status of individuals grappling with mood disorders (19, 22, 38).”
From A narrative review of digital biomarkers in the management of major depressive disorder and treatment-resistant forms (2023) · cites this paper as [22]
Wearable technologies such as smartwatches and novel sensors can generate valuable digital biomarkers of depression in real-world settings.
“Wearable technologies, such as smartwatches and novel sensors, can generate valuable digital biomarkers of depression in real-world settings (22)”
From A narrative review of digital biomarkers in the management of major depressive disorder and treatment-resistant forms (2023) · cites this paper as [22]
Several digital biomarkers have been investigated for MDD characterization and diagnosis, including physical activity patterns, voice features, light exposure measurements, mobile phone GPS, and normal smartphone usage duration and frequency.
“In the recent years, several digital biomarkers have been investigated for MDD characterization and diagnosis such as measure patterns of physical activity (24, 25) features from voice samples (26, 27), light exposure measurements (25), mobile phone global positioning systems (GPS) and normal usage of smartphones such as usage duration and frequency (22).”
From A narrative review of digital biomarkers in the management of major depressive disorder and treatment-resistant forms (2023) · cites this paper as [22]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Firth, J., Torous, J., Nicholas, J., Carney, R., Pratap, A., Rosenbaum, S., & Sarris, J. (2017) · World Psychiatry · doi:10.1002/wps.20472 · Cited by 1,097 · see citing works
Self-citationDigital Phenotyping: Technology for a New Science of Behavior
Insel, T. R. (2017) · JAMA · doi:10.1001/jama.2017.11295 · Cited by 833 · see citing works
Torous, J., Nicholas, J., Larsen, M. E., Firth, J., & Christensen, H. (2018) · Evidence Based Mental Health · doi:10.1136/eb-2018-102891 · Cited by 790 · see citing works
Self-citationFirth, J., Torous, J., Nicholas, J., Carney, R., Rosenbaum, S., & Sarris, J. (2017) · Journal of Affective Disorders · doi:10.1016/j.jad.2017.04.046 · Cited by 675 · see citing works
Self-citationFleming, T., Bavin, L., Lucassen, M., Stasiak, K., Hopkins, S., & Merry, S. (2018) · Journal of Medical Internet Research · doi:10.2196/jmir.9275 · Cited by 670 · see citing works
The WPA-Lancet psychiatry commission on the future of psychiatry
Bhugra, D., Tasman, A., Pathare, S., Priebe, S., Smith, S., Torous, J., Arbuckle, M. R., Langford, A., Alarcón, R. D., Chiu, H. F. K., et al. (2017) · The Lancet Psychiatry · doi:10.1016/s2215-0366(17)30333-4 · Cited by 392 · see citing works
Self-citationTorous, J., & Roberts, L. W. (2017) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2017.0262 · Cited by 362 · see citing works
Self-citationFirth, J., Cotter, J., Torous, J., Bucci, S., Firth, J. A., & Yung, A. R. (2016) · Schizophrenia Bulletin · doi:10.1093/schbul/sbv132 · Cited by 351 · see citing works
Self-citationTorous, J., Friedman, R., & Keshavan, M. (2014) · JMIR mHealth and uHealth · doi:10.2196/mhealth.2994 · Cited by 287 · see citing works
Self-citationTorous, J., Chan, S. R., Yee-Marie Tan, S., Behrens, J., Mathew, I., Conrad, E. J., Hinton, L., Yellowlees, P., & Keshavan, M. (2014) · JMIR Mental Health · doi:10.2196/mental.4004 · Cited by 228 · see citing works
Self-citationMartinez-Martin, N., & Kreitmair, K. (2018) · JMIR Mental Health · doi:10.2196/mental.9423 · Cited by 221 · see citing works
Torous, J. B., Chan, S. R., Gipson, S. Y.-M. T., Kim, J. W., Nguyen, T.-Q., Luo, J., & Wang, P. (2018) · Psychiatric Services · doi:10.1176/appi.ps.201700423 · Cited by 184 · see citing works
Self-citationBen-Zeev, D., Brian, R. M., Jonathan, G., Razzano, L., Pashka, N., Carpenter-Song, E., Drake, R. E., & Scherer, E. A. (2018) · Psychiatric Services · doi:10.1176/appi.ps.201800063 · Cited by 173 · see citing works
Digital Technology Use Among Individuals with Schizophrenia: Results of an Online Survey
Gay, K., Torous, J., Joseph, A., Pandya, A., & Duckworth, K. (2016) · JMIR Mental Health · doi:10.2196/mental.5379 · Cited by 161 · see citing works
Self-citationPrivacy in the Digital World: Medical and Health Data Outside of HIPAA Protections
Glenn, T., & Monteith, S. (2014) · Current Psychiatry Reports · doi:10.1007/s11920-014-0494-4 · Cited by 122 · see citing works
Lal, S., Dell'Elce, J., Tucci, N., Fuhrer, R., Tamblyn, R., & Malla, A. (2015) · JMIR Mental Health · doi:10.2196/mental.4400 · Cited by 108 · see citing works
Torous, J. B., & Nebeker, C. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.6793 · Cited by 74 · see citing works
Self-citationMatteo, D. D., Fine, A., Fotinos, K., Rose, J., & Katzman, M. A. (2018) · JMIR Mental Health · doi:10.2196/mental.9539 · Cited by 68 · see citing works
Clinical technology specialists
Ben-Zeev, D., Drake, R., & Marsch, L. (2015) · BMJ · doi:10.1136/bmj.h945 · Cited by 66 · see citing works
Interest in Use of Technology for Healthcare Among Veterans Receiving Treatment for Mental Health
Miller, C. J., McInnes, D. K., Stolzmann, K. L., & Bauer, M. S. (2016) · Telemedicine Journal and e-Health · doi:10.1089/tmj.2015.0190 · Cited by 52 · see citing works
Bennion, M. R., Hardy, G. E., Moore, R. K., & Millings, A. (2017) · BMJ Open · doi:10.1136/bmjopen-2016-014844 · Cited by 52 · see citing works
It feels different from real life
de Alva, F. E. M., Wadley, G., & Lederman, R. (2015) · Australian Conference on Computer-Human Interaction (OzCHI) · doi:10.1145/2838739.2838806 · Cited by 30 · see citing works
A Survey of Online and Mobile Technology Use at Peer Support Agencies
Aschbrenner, K. A., Naslund, J. A., Grinley, T., Bienvenida, J. C. M., Bartels, S. J., & Brunette, M. (2018) · Psychiatric Quarterly · doi:10.1007/s11126-017-9561-4 · Cited by 26 · see citing works
Smartphones for Smarter Care? Self-Management in Schizophrenia
Sandoval, L. R., Torous, J. B., & Keshavan, M. S. (2017) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2017.16090990 · Cited by 23 · see citing works
Self-citation
Flagged first, then by citations
Cited by
Sorted by citations
Torous, J., Bucci, S., Bell, I. H., Kessing, L. V., Faurholt‐Jepsen, M., Whelan, P., Carvalho, A. F., Keshavan, M., Linardon, J., & Firth, J. (2021) · World Psychiatry · doi:10.1002/wps.20883 · Cited by 1,199 · see citing works
Self-citationTime for united action on depression: a Lancet–World Psychiatric Association Commission
Herrman, H., Patel, V., Kieling, C., Berk, M., Buchweitz, C., Cuijpers, P., Furukawa, T. A., Kessler, R. C., Kohrt, B. A., Maj, M., et al. (2022) · The Lancet · doi:10.1016/s0140-6736(21)02141-3 · Cited by 1,104 · see citing works
An overview of and recommendations for more accessible digital mental health services
Lattie, E. G., Stiles-Shields, C., & Graham, A. K. (2022) · Nature Reviews Psychology · doi:10.1038/s44159-021-00003-1 · Cited by 446 · see citing works
Stein, D. J., Shoptaw, S. J., Vigo, D. V., Lund, C., Cuijpers, P., Bantjes, J., Sartorius, N., & Maj, M. (2022) · World Psychiatry · doi:10.1002/wps.20998 · Cited by 331 · see citing works
Torous, J., Wisniewski, H., Bird, B., Carpenter, E., David, G., Elejalde, E., Fulford, D., Guimond, S., Hays, R., Henson, P., et al. (2019) · Journal of Technology in Behavioral Science · doi:10.1007/s41347-019-00095-w · Cited by 202 · see citing works
Self-citationBauer, M., Glenn, T., Geddes, J., Gitlin, M., Grof, P., Kessing, L. V., Monteith, S., Faurholt-Jepsen, M., Severus, E., & Whybrow, P. C. (2020) · International Journal of Bipolar Disorders · doi:10.1186/s40345-019-0164-x · Cited by 163 · see citing works
Litvin, S., Saunders, R., Maier, M. A., & Lüttke, S. (2020) · PLOS ONE · doi:10.1371/journal.pone.0237220 · Cited by 177 · see citing works
“However, translation from interest to actual use of apps to manage health-related concerns remains a challenge, as patients tend to use apps only rarely in their daily routine [21].”
BackgroundBlease, C., Locher, C., Leon-Carlyle, M., & Doraiswamy, M. (2020) · DIGITAL HEALTH · doi:10.1177/2055207620968355 · Cited by 121 · see citing works
The Digital Psychiatrist: In Search of Evidence-Based Apps for Anxiety and Depression
Marshall, J. M., Dunstan, D. A., & Bartik, W. (2019) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2019.00831 · Cited by 107 · see citing works
Stawarz, K., Preist, C., & Coyle, D. (2019) · JMIR Mental Health · doi:10.2196/12546 · Cited by 107 · see citing works
HOFFMAN, L., WISNIEWSKI, H., HAYS, R., HENSON, P., VAIDYAM, A., HENDEL, V., KESHAVAN, M., & TOROUS, J. (2020) · Journal of Psychiatric Practice · doi:10.1097/pra.0000000000000450 · Cited by 97 · see citing works
Self-citationComputer-Assisted Cognitive-Behavior Therapy and Mobile Apps for Depression and Anxiety
Wright, J. H., Mishkind, M., Eells, T. D., & Chan, S. R. (2019) · Current Psychiatry Reports · doi:10.1007/s11920-019-1031-2 · Cited by 93 · see citing works
Smartphone, Social Media, and Mental Health App Use in an Acute Transdiagnostic Psychiatric Sample
Beard, C., Silverman, A. L., Forgeard, M., Wilmer, M. T., Torous, J., & Björgvinsson, T. (2019) · JMIR mHealth and uHealth · doi:10.2196/13364 · Cited by 58 · see citing works
Self-citationMental Health Apps in Psychiatric Treatment: A Patient Perspective on Real World Technology Usage
Chiauzzi, E., & Newell, A. (2019) · JMIR Mental Health · doi:10.2196/12292 · Cited by 46 · see citing works
Hidalgo-Mazzei, D., Nikolova, V. L., Kitchen, S., & Young, A. H. (2019) · Digital Psychiatry · doi:10.1080/2575517x.2019.1616476 · Cited by 23 · see citing works
Bonnot, O., Adrien, V., Venelle, V., Bonneau, D., Gollier-Briant, F., & Mouchabac, S. (2021) · JMIR Mental Health · doi:10.2196/27803 · Cited by 19 · see citing works
Vignapiano, A., Monaco, F., Pagano, C., Piacente, M., Farina, F., Petrillo, G., Sica, R., Marenna, A., Shin, J. I., Solmi, M., et al. (2023) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2023.1321345 · Cited by 14 · see citing works
- Authors
- Torous, J., Wisniewski, H., Liu, G., & Keshavan, M.
- Affiliations
- Beth Israel Deaconess Medical Center (US)
- Harvard University (US)
- Corresponding author
- Torous, John
- Venue
- JMIR Mental Health
- Publisher
- JMIR Publications Inc.
- Published
- 2018-11-16
- Volume
- 5
- Issue
- 4
- Pages
- e11715
- ISSN
- 2368-7959 (ISSN-L)
- PMC
- PMC6269625
- OpenAlex
- W2896957784
- Cited by
- 201
- References
- 24
- Citations by year
- 2026: 24 · 2025: 24 · 2024: 29 · 2023: 21 · 2022: 24 · 2021: 30 · 2020: 30 · 2019: 17 · 2018: 1 · 2017: 1
- FWCI
- 24.59
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- JMIR Mental Health (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Funders
- National Institute of Mental Health (K23MH116130)
- Topics
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
- Health Sciences › Health Professions › Health Information Management › Health, Technology, Consumer Behavior
- Keywords
- mental health apps, psychiatric outpatients, mood and anxiety disorders, psychosis, state mental health services
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
