Objective User Engagement With Mental Health Apps: Systematic Search and Panel-Based Usage Analysis
Open accessPublished version of a preprint
The DOI matches its Crossref record; 41 of the 41 references it cites were found in a registry or an index.
Abstract
Background: Understanding patterns of real-world usage of mental health apps is key to maximizing their potential to increase public self-management of care. Although developer-led studies have published results on the use of mental health apps in real-world settings, no study yet has systematically examined usage patterns of a large sample of mental health apps relying on independently collected data. Objective: Our aim is to present real-world objective data on user engagement with popular mental health apps. Methods: A systematic engine search was conducted using Google Play to identify Android apps with 10,000 installs or more targeting anxiety, depression, or emotional well-being. Coding of apps included primary incorporated techniques and mental health focus. Behavioral data on real-world usage were obtained from a panel that provides aggregated nonpersonal information on user engagement with mobile apps. Results: In total, 93 apps met the inclusion criteria (installs: median 100,000, IQR 90,000). The median percentage of daily active users (open rate) was 4.0% (IQR 4.7%) with a difference between trackers (median 6.3%, IQR 10.2%) and peer-support apps (median 17.0%) versus breathing exercise apps (median 1.6%, IQR 1.6%; all z≥3.42, all P<.001). Among active users, daily minutes of use were significantly higher for mindfulness/meditation (median 21.47, IQR 15.00) and peer support (median 35.08, n=2) apps than for apps incorporating other techniques (tracker, breathing exercise, psychoeducation: medians range 3.53-8.32; all z≥2.11, all P<.05). The medians of app 15-day and 30-day retention rates were 3.9% (IQR 10.3%) and 3.3% (IQR 6.2%), respectively. On day 30, peer support (median 8.9%, n=2), mindfulness/meditation (median 4.7%, IQR 6.2%), and tracker apps (median 6.1%, IQR 20.4%) had significantly higher retention rates than breathing exercise apps (median 0.0%, IQR 0.0%; all z≥2.18, all P≤.04). The pattern of daily use presented a descriptive peak toward the evening for apps incorporating most techniques (tracker, psychoeducation, and peer support) except mindfulness/meditation, which exhibited two peaks (morning and night). Conclusions: Although the number of app installs and daily active minutes of use may seem high, only a small portion of users actually used the apps for a long period of time. More studies using different datasets are needed to understand this phenomenon and the ways in which users self-manage their condition in real-world settings.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures





Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source doesn’t support the claim as written.
In the citing paper
“Participants’ engagement rates exceeded industry standards”
From A Digital Mental Health Intervention in an Orthopedic Setting for Patients With Symptoms of Depression and/or Anxiety: Feasibility Prospective Cohort Study (2022) · cites this paper as [40]
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“While this study design does not permit definitive causal attribution to the personalization component specifically, the observed patterns are consistent with conceptual frameworks, suggesting that content alignment with users’ cognitive-emotional profiles enhances engagement [8,34].”
From Schema-Informed Digital Mental Health Intervention for Maladaptive Cognitive-Emotional Patterns: Randomized Controlled Trial (2025) · cites this paper as [34]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“When accessed “in the wild,” the vast majority of DMHIs have had low engagement and high attrition (Baumel et al., 2019; Torous et al., 2020; Fleming et al., 2018).”
From A text messaging intervention to support the mental health of young adults: User engagement and feedback from a field trial of an intervention prototype (2023) · cites this paper as Baumel et al., 2019
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“such platforms are frequently characterized by low adherence [14-16]”
From Feasibility and Preliminary Efficacy of Web-Based and Mobile Interventions for Common Mental Health Problems in Working Adults: Multi-Arm Randomized Pilot Trial (2022) · cites this paper as [14]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“This parallels common definitions of engagement used for DMHIs (e.g., any daily app use) (Baumel et al., 2019), and other interactive messaging systems (Psihogios et al., 2019).”
From A text messaging intervention to support the mental health of young adults: User engagement and feedback from a field trial of an intervention prototype (2023) · cites this paper as Baumel et al., 2019
7 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Using thematic analysis in psychology
Braun, V., & Clarke, V. (2006) · Qualitative Research in Psychology · doi:10.1191/1478088706qp063oa · Cited by 194,414 · cited 2×
“components of mental health apps [27,30], drawing on the thematic analysis method suggested by Braun and Clarke [31].”
MethodEysenbach, G. (2005) · Journal of Medical Internet Research · doi:10.2196/jmir.7.1.e11 · Cited by 2,524 · cited 2×
“However, the impact of digital interventions is limited by their ability to engage users in therapeutic activities and to support user adherence to the therapeutic process [9,10].”
BackgroundA behavior model for persuasive design
Fogg, B. (2009) · Proceedings of the 4th International Conference on Persuasive Technology · doi:10.1145/1541948.1541999 · Cited by 2,328 · cited 1×
“Second, user retention patterns might also indicate the low burden associated with app installation (ie, the simplicity of opening the Google Play Store and clicking the app download and installation buttons), which implies that user context, motivation, and ability to engage [44] with these apps were not tested befor…”
BackgroundMobile app rating scale: a new tool for assessing the quality of health mobile apps
Stoyanov, S. R., Hides, L., Kavanagh, D. J., Zelenko, O., Tjondronegoro, D., & Mani, M. (2015) · JMIR mHealth and uHealth · doi:10.2196/mhealth.3422 · Cited by 2,233 · cited 1×
“Although there are some recommender websites [27,29,37] and approaches to help users identify the right apps [38-41], a therapeutic framework that provides guidance to users about how to use the right app at the right time could be useful.”
BackgroundSelf-regulation, ego depletion, and motivation
Baumeister, R. F., & Vohs, K. D. (2007) · Social and Personality Psychology Compass · doi:10.1111/j.1751-9004.2007.00001.x · Cited by 1,402
Adherence in Internet Interventions for Anxiety and Depression
Christensen, H., Griffiths, K. M., & Farrer, L. (2009) · Journal of Medical Internet Research · doi:10.2196/jmir.1194 · Cited by 1,133 · cited 2×
“These findings reflect the lower ranges of real-world retention rates reported in developer-led studies [17-20,22].”
BackgroundUnderstanding and Promoting Effective Engagement With Digital Behavior Change Interventions
Yardley, L., Spring, B. J., Riper, H., Morrison, L. G., Crane, D. H., Curtis, K., Merchant, G. C., Naughton, F., & Blandford, A. (2016) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2016.06.015 · Cited by 1,118 · cited 1×
“These patterns could be explained using the notion of effective engagement described by Yardley and colleagues [36], wherein there is “sufficient engagement with the intervention to achieve intended outcomes.”
BackgroundCollins, L. M., Murphy, S. A., & Strecher, V. (2007) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2007.01.022 · Cited by 1,082
Healthcare via Cell Phones: A Systematic Review
Krishna, S., Boren, S. A., & Balas, E. A. (2009) · Telemedicine and e-Health · doi:10.1089/tmj.2008.0099 · Cited by 882 · cited 1×
“The conversation has shifted from patients and providers to individuals who can now engage in self-care around the clock outside of traditional health care settings (eg, [1-3]).”
Background
Research works printed but not linked: 1
- 2001, The World Health Report 2001. Mental Health: New Understanding, New Hope
Cited by
Torous, J., Bucci, S., Bell, I. H., Kessing, L. V., Faurholt‐Jepsen, M., Whelan, P., Carvalho, A. F., Keshavan, M., Linardon, J., & Firth, J. (2021) · World Psychiatry · doi:10.1002/wps.20883 · Cited by 1,199
Torous, J., Jän Myrick, K., Rauseo-Ricupero, N., & Firth, J. (2020) · JMIR Mental Health · doi:10.2196/18848 · Cited by 946
“Picking from those different apps is challenging as many offer little protection of user data, make exaggerated claims, may be ineffective, and often are quickly abandoned because of usability issues [18,23,24].”
BackgroundTorous, J., Lipschitz, J., Ng, M., & Firth, J. (2020) · Journal of Affective Disorders · doi:10.1016/j.jad.2019.11.167 · Cited by 546
Gadermann, A. C., Thomson, K. C., Richardson, C. G., Gagné, M., McAuliffe, C., Hirani, S., & Jenkins, E. (2021) · BMJ Open · doi:10.1136/bmjopen-2020-042871 · Cited by 479
Digital interventions for the treatment of depression: a meta-analytic review
Moshe, I., Terhorst, Y., Philippi, P., Domhardt, M., Cuijpers, P., Cristea, I., Pulkki-Råback, L., Baumeister, H., & Sander, L. B. (2021) · Psychological Bulletin · doi:10.1037/bul0000334 · Cited by 390
Jakob, R., Harperink, S., Rudolf, A. M., Fleisch, E., Haug, S., Mair, J. L., Salamanca-Sanabria, A., & Kowatsch, T. (2022) · Journal of Medical Internet Research · doi:10.2196/35371 · Cited by 446
“9% of participants using mHealth apps for >15 days [10].”
BackgroundStade, E. C., Stirman, S. W., Ungar, L. H., Boland, C. L., Schwartz, H. A., Yaden, D. B., Sedoc, J., DeRubeis, R. J., Willer, R., & Eichstaedt, J. C. (2024) · npj Mental Health Research · doi:10.1038/s44184-024-00056-z · Cited by 391
“However, these and other existing chatbots frequently struggle to understand and respond to unanticipated user responses 10,13 , which likely contributes to their low engagement and high dropout rates 14,15 .”
BackgroundTorous, J., Linardon, J., Goldberg, S. B., Sun, S., Bell, I., Nicholas, J., Hassan, L., Hua, Y., Milton, A., & Firth, J. (2025) · World Psychiatry · doi:10.1002/wps.21299 · Cited by 323
A randomized trial of online single-session interventions for adolescent depression during COVID-19
Schleider, J. L., Mullarkey, M. C., Fox, K. R., Dobias, M. L., Shroff, A., Hart, E. A., & Roulston, C. A. (2021) · Nature Human Behaviour · doi:10.1038/s41562-021-01235-0 · Cited by 289
“27 Thus, online SSIs offer a unique opportunity for rapid-large scale tests of accessible depression interventions while the pandemic remains underway.”
Prochaska, J. J., Vogel, E. A., Chieng, A., Kendra, M., Baiocchi, M., Pajarito, S., & Robinson, A. (2021) · Journal of Medical Internet Research · doi:10.2196/24850 · Cited by 257
“As recent meta-analytic work suggests, conversational text-based agents may increase engagement and enjoyment in digitized mental health care [12], whereas most general mental health care apps face difficulty sustaining engagement with high dropout [13,14].”
BackgroundGoldberg, S. B., Lam, S. U., Simonsson, O., Torous, J., & Sun, S. (2022) · PLOS Digital Health · doi:10.1371/journal.pdig.0000002 · Cited by 237
“, health apps generally and mental health apps specifically [56, 57]).”
BackgroundBeatty, C., Malik, T., Meheli, S., & Sinha, C. (2022) · Frontiers in Digital Health · doi:10.3389/fdgth.2022.847991 · Cited by 224
“Most notably, this is a problem for minimally guided and unguided smartphone interventions that do not involve any degree of therapist support (9–13).”
BackgroundThe Need for a Mental Health Technology Revolution in the COVID-19 Pandemic
Figueroa, C. A., & Aguilera, A. (2020) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2020.00523 · Cited by 227
“It happened to be the perfect thing”: experiences of generative AI chatbots for mental health
Siddals, S., Torous, J., & Coxon, A. (2024) · npj Mental Health Research · doi:10.1038/s44184-024-00097-4 · Cited by 241
“Moreover,userengagementremainsapersistentchallenge,withmixeduser reviews 11 , and studies indicating that 30 days after installation the proportion of users still active may be as low as 3% 12 .”
Lipschitz, J. M., Pike, C. K., Hogan, T. P., Murphy, S. A., & Burdick, K. E. (2023) · Current Treatment Options in Psychiatry · doi:10.1007/s40501-023-00297-3 · Cited by 225
Philippi, P., Baumeister, H., Apolinário-Hagen, J., Ebert, D. D., Hennemann, S., Kott, L., Lin, J., Messner, E.-M., & Terhorst, Y. (2021) · Internet Interventions · doi:10.1016/j.invent.2021.100459 · Cited by 200
“Therefore, there is a need for future research to address the lack of evidence supporting the relationship between the intention to use an IMI and the actual uptake and adherence (Baumel et al., 2019; Lin et al., 2018).”
BackgroundDigital transformation of mental health services
Bond, R. R., Mulvenna, M. D., Potts, C., O’Neill, S., Ennis, E., & Torous, J. (2023) · npj Mental Health Research · doi:10.1038/s44184-023-00033-y · Cited by 199
“The majority of users of mental health apps simply download and delete an app without using the app for any sustained period of time 26 .”
Engagement and retention in digital mental health interventions: a narrative review
Boucher, E. M., & Raiker, J. S. (2024) · BMC Digital Health · doi:10.1186/s44247-024-00105-9 · Cited by 181
“For example, one study of 93 mental health apps found that the median 15-day retention across apps was 3.9% and the median 30-day retention was 3.3%, suggesting minimal dropoff after this initial two-week period [3].”
MethodInfluentialSpanhel, K., Balci, S., Feldhahn, F., Bengel, J., Baumeister, H., & Sander, L. B. (2021) · npj Digital Medicine · doi:10.1038/s41746-021-00498-1 · Cited by 178
Optimizing Students’ Mental Health and Academic Performance: AI-Enhanced Life Crafting
Dekker, I., De Jong, E. M., Schippers, M. C., De Bruijn-Smolders, M., Alexiou, A., & Giesbers, B. (2020) · Frontiers in Psychology · doi:10.3389/fpsyg.2020.01063 · Cited by 176
“We know, for instance, that (mental) health apps are generally used for a short period of time (about 2 weeks) before being abandoned (Baumel et al., 2019).”
BackgroundInfluentialBergin, A. D., Vallejos, E. P., Davies, E. B., Daley, D., Ford, T., Harold, G., Hetrick, S., Kidner, M., Long, Y., Merry, S., et al. (2020) · npj Digital Medicine · doi:10.1038/s41746-020-00339-7 · Cited by 157
Litvin, S., Saunders, R., Maier, M. A., & Lüttke, S. (2020) · PLOS ONE · doi:10.1371/journal.pone.0237220 · Cited by 177
“Examining objective app usage data, a systematic review by Baumel et al. revealed that only a small portion of individuals actually use apps targeting depression, anxiety, and emotional well-being over a long time period [22].”
MethodGraham, A. K., Greene, C. J., Kwasny, M. J., Kaiser, S. M., Lieponis, P., Powell, T., & Mohr, D. C. (2020) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2020.1011 · Cited by 162
Wu, A., Scult, M. A., Barnes, E. D., Betancourt, J. A., Falk, A., & Gunning, F. M. (2021) · npj Digital Medicine · doi:10.1038/s41746-021-00386-8 · Cited by 161
Providing Human Support for the Use of Digital Mental Health Interventions: Systematic Meta-review
Werntz, A., Amado, S., Jasman, M., Ervin, A., & Rhodes, J. E. (2023) · Journal of Medical Internet Research · doi:10.2196/42864 · Cited by 158
“Overall, the clinical use of DMHIs has been disappointing given the low rates of uptake and engagement [32], with over 50% of the total DMHIs having little to no monthly engagement [33].”
Sun, S., Lin, D., Goldberg, S., Shen, Z., Chen, P., Qiao, S., Brewer, J., Loucks, E., & Operario, D. (2022) · Journal of Counseling Psychology · doi:10.1037/cou0000568 · Cited by 138
“Research suggests low rates of engagement and continued use after downloading (Baumel et al., 2019).”
BackgroundRethinking (Dis)Engagement in Human-Computer Interaction
O'Brien, H. L., Roll, I., Kampen, A., & Davoudi, N. (2022) · Computers in Human Behavior · doi:10.1016/j.chb.2021.107109 · Cited by 139
Actionable health app evaluation: translating expert frameworks into objective metrics
Lagan, S., Aquino, P., Emerson, M. R., Fortuna, K., Walker, R., & Torous, J. (2020) · npj Digital Medicine · doi:10.1038/s41746-020-00312-4 · Cited by 144
Smartphone apps for the treatment of mental health conditions: status and considerations
Huckvale, K., Nicholas, J., Torous, J., & Larsen, M. E. (2020) · Current Opinion in Psychology · doi:10.1016/j.copsyc.2020.04.008 · Cited by 135
Van Daele, T., Karekla, M., Kassianos, A. P., Compare, A., Haddouk, L., Salgado, J., Ebert, D. D., Trebbi, G., Bernaerts, S., Van Assche, E., et al. (2020) · Journal of Psychotherapy Integration · doi:10.1037/int0000218 · Cited by 122
“Self-help applications, for example, show rapid declines in continued use, with only a small percentage of people relying on a smartphone application one month after installation (Baumel et al., 2019).”
BackgroundFitzsimmons-Craft, E. E., Taylor, C. B., Graham, A. K., Sadeh-Sharvit, S., Balantekin, K. N., Eichen, D. M., Monterubio, G. E., Goel, N. J., Flatt, R. E., Karam, A. M., et al. (2020) · JAMA Network Open · doi:10.1001/jamanetworkopen.2020.15633 · Cited by 125
Baumel, A., Fleming, T. M., & Schueller, S. M. (2020) · Journal of Medical Internet Research · doi:10.2196/20631 · Cited by 134
Self-citationHuman-Centered Design Approaches in Digital Mental Health Interventions: Exploratory Mapping Review
Vial, S., Boudhraâ, S., & Dumont, M. (2022) · JMIR Mental Health · doi:10.2196/35591 · Cited by 106
College student engagement with mental health apps: analysis of barriers to sustained use
Melcher, J., Camacho, E., Lagan, S., & Torous, J. (2022) · Journal of American College Health · doi:10.1080/07448481.2020.1825225 · Cited by 106
“found that user retention was just around 4% two weeks after the initial download.(17) Previous studies have attempted to understand students’”
BackgroundFriis-Healy, E. A., Nagy, G. A., & Kollins, S. H. (2021) · JMIR Mental Health · doi:10.2196/25456 · Cited by 106
“Continued growth, however, portends continued saturation of the marketplace with apps that make unwarranted claims, offer minimal protection of user data, or are ineffective [23-25].”
BackgroundSharma, A., Rushton, K., Lin, I. W., Nguyen, T., & Althoff, T. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642761 · Cited by 102
Alvarez-Jimenez, M., Rice, S., D'Alfonso, S., Leicester, S., Bendall, S., Pryor, I., Russon, P., McEnery, C., Santesteban-Echarri, O., Da Costa, G., et al. (2020) · Journal of Medical Internet Research · doi:10.2196/17155 · Cited by 106
“…explained by the lack of human support in most mental health apps; poor adherence, which is considered to be a major pitfall of mental health apps [36], or low use of key app features; and possibly a lack of sustained and structured attention to content and features that may be needed for an…”
BackgroundKaveladze, B. T., Wasil, A. R., Bunyi, J. B., Ramirez, V., & Schueller, S. M. (2022) · JMIR Human Factors · doi:10.2196/30766 · Cited by 104
“Our study echoes previous research suggesting that retention is particularly challenging to understand [9].”
BackgroundResultProchaska, J. J., Vogel, E. A., Chieng, A., Baiocchi, M., Maglalang, D. D., Pajarito, S., Weingardt, K. R., Darcy, A., & Robinson, A. (2021) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2021.108986 · Cited by 113
“While most mental health apps have high drop-off (Baumel et al., 2019; Torous et al., 2018), a meta-analysis found that conversational text-based agents may increase engagement and enjoyment in digitized mental health care (Vaidyam et al.”
BackgroundDigital therapeutics for mental health: Is attrition the Achilles heel?
Nwosu, A., Boardman, S., Husain, M. M., & Doraiswamy, P. M. (2022) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2022.900615 · Cited by 101
Standardising the role of a digital navigator in behavioural health: a systematic review
Perret, S., Alon, N., Carpenter-Song, E. A., Myrick, K. J., Thompson, K., Li, S., Sharma, K., & Torous, J. B. (2023) · The Lancet Digital Health · doi:10.1016/s2589-7500(23)00152-8 · Cited by 106
The digital clinic: Implementing technology and augmenting care for mental health
Rodriguez-Villa, E., Rauseo-Ricupero, N., Camacho, E., Wisniewski, H., Keshavan, M., & Torous, J. (2020) · General Hospital Psychiatry · doi:10.1016/j.genhosppsych.2020.06.009 · Cited by 97
Forbes, A., Keleher, M. R., Venditto, M., & DiBiasi, F. (2023) · Journal of Medical Internet Research · doi:10.2196/43727 · Cited by 94
“Another real-world study of 93 Android mental health apps found that only 3.9% of the users engaged with the apps 15 days later, and only 3.3% of the users sustained engagement on day 30 [44].”
InfluentialByambasuren, O., Beller, E., Hoffmann, T., & Glasziou, P. (2020) · JMIR mhealth and uhealth · doi:10.2196/17447 · Cited by 102
“Recent research suggests that individuals with poor self-reported health and low rates of physical activity were the least likely to report downloading and using these health tools [27]; however, patients adhere better to prescribed apps [2] beyond the typical one week of usage [4,5].”
BackgroundWasil, A. R., Taylor, M. E., Franzen, R. E., Steinberg, J. S., & DeRubeis, R. J. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2021.569785 · Cited by 92
Wasil, A. R., Gillespie, S., Patel, R., Petre, A., Venturo-Conerly, K. E., Shingleton, R. M., Weisz, J. R., & DeRubeis, R. J. (2020) · Journal of Consulting and Clinical Psychology · doi:10.1037/ccp0000604 · Cited by 86
Roberts, A. E., Davenport, T. A., Wong, T., Moon, H.-W., Hickie, I. B., & LaMonica, H. M. (2021) · Internet Interventions · doi:10.1016/j.invent.2021.100379 · Cited by 87
“Similarly, it has been found that the number of app installs and active minutes of use is not associated with long term usage of more popular apps (Baumel et al., 2019).”
BackgroundKramer, J.-N., Künzler, F., Mishra, V., Smith, S. N., Kotz, D., Scholz, U., Fleisch, E., & Kowatsch, T. (2020) · Annals of Behavioral Medicine · doi:10.1093/abm/kaaa002 · Cited by 84
Our Digital Moment: Innovations and Opportunities in Digital Mental Health Care
Gratzer, D., Torous, J., Lam, R. W., Patten, S. B., Kutcher, S., Chan, S., Vigo, D., Pajer, K., & Yatham, L. N. (2021) · The Canadian Journal of Psychiatry · doi:10.1177/0706743720937833 · Cited by 86
“found that 96% of users were not engaging with the app after 2 weeks.(20) And digital mental health care may not meet proper standards for patient privacy, confidentiality, and reliability of service delivery.”
BackgroundA Framework for the Empirical Investigation of Mindfulness Meditative Development
Galante, J., Grabovac, A., Wright, M., Ingram, D. M., Van Dam, N. T., Sanguinetti, J. L., Sparby, T., van Lutterveld, R., & Sacchet, M. D. (2023) · Mindfulness · doi:10.1007/s12671-023-02113-8 · Cited by 84
“Furthermore, it is estimated that less than 5% of individuals continue using mindfulness smartphone applications after 30 days of download (Baumel et al., 2019).”
BackgroundConnolly, S. L., Hogan, T. P., Shimada, S. L., & Miller, C. J. (2020) · Journal of Technology in Behavioral Science · doi:10.1007/s41347-020-00165-4 · Cited by 93
Kubzansky, L. D., Kim, E. S., Boehm, J. K., Davidson, R. J., Huffman, J. C., Loucks, E. B., Lyubomirsky, S., Picard, R. W., Schueller, S. M., Trudel‐Fitzgerald, C., et al. (2023) · Affective Science · doi:10.1007/s42761-022-00167-w · Cited by 124
Regulatory considerations to keep pace with innovation in digital health products
Torous, J., Stern, A. D., & Bourgeois, F. T. (2022) · npj Digital Medicine · doi:10.1038/s41746-022-00668-9 · Cited by 80
Durden, E., Pirner, M. C., Rapoport, S. J., Williams, A., Robinson, A., & Forman-Hoffman, V. L. (2023) · Internet Interventions · doi:10.1016/j.invent.2023.100637 · Cited by 59
Alliance with an unguided smartphone app: validation of the digital working alliance inventory
Goldberg, S. B., Baldwin, S. A., Riordan, K. M., Torous, J., Dahl, C. J., Davidson, R. J., & Hirshberg, M. J. (2022) · Assessment · doi:10.1177/10731911211015310 · Cited by 74
“Moreover, minimally guided and unguided mHealth interventions have notoriously high and rapid rates of disengagement (Baumel et al., 2019; Baumel & Kane, 2018; Eysenbach, 2005; Linardon & Fuller-Tyszkiewicz, 2020; Pratap et al., 2020).”
BackgroundWhat Is the Current and Future Status of Digital Mental Health Interventions?
Baños, R. M., Herrero, R., & Vara, M. D. (2022) · The Spanish Journal of Psychology · doi:10.1017/sjp.2022.2 · Cited by 82
“Second, engagement in DMHIs remains an issue because it varies from one study to another and is usually lower in the real world than in the research context (Baumel et al., 2019).”
BackgroundLeo, A. J., Schuelke, M. J., Hunt, D. M., Metzler, J. P., Miller, J. P., Areán, P. A., Armbrecht, M. A., & Cheng, A. L. (2022) · JMIR Formative Research · doi:10.2196/34889 · Cited by 70
“Engagement in our study was notably higher than digital health industry standards, which measure engagement on the order of days instead of weeks or months [40].”
ResultSzinay, D., Perski, O., Jones, A., Chadborn, T., Brown, J., & Naughton, F. (2021) · JMIR mhealth and uhealth · doi:10.2196/29098 · Cited by 91
“…of engagement were higher for apps that included peer support (median 35.1, IQR not applicable; n=2) and coping strategies such as mindfulness and meditation (median 21.5, IQR 15) compared with apps that incorporated self-monitoring or psychoeducational features (median range 3.53-8.32) [18].”
BackgroundMethodInfluentialA common factors perspective on mindfulness-based interventions
Goldberg, S. B. (2022) · Nature Reviews Psychology · doi:10.1038/s44159-022-00090-8 · Cited by 75
O'Daffer, A., Colt, S. F., Wasil, A. R., & Lau, N. (2022) · JMIR Mental Health · doi:10.2196/40924 · Cited by 72
“Both Headspace and Calm offer a free version of the app, and the premium versions cost US $13 per month and US $15 per month, respectively (or both offer an annual plan for US $70 per year), which are considerably more affordable than traditional mental health interventions [42] (eg, US $60-$250 per session for privat…”
BackgroundMilne-Ives, M., Homer, S. R., Andrade, J., & Meinert, E. (2023) · Frontiers in Psychology · doi:10.3389/fpsyg.2023.1227443 · Cited by 69
“Maintaining engagement is a common challenge for mobile health apps (Birnbaum et al., 2015; Yeager and Benight, 2018; Baumel et al., 2019; Meyerowitz-Katz et al., 2020; Pratap et al., 2020; Torous et al., 2020a) and is a potential reason why evidence of their effectiveness remains mixed (Dounavi and Tsoumani, 2019; Ng…”
Linardon, J. (2023) · Behaviour Research and Therapy · doi:10.1016/j.brat.2023.104421 · Cited by 69
Distinguishing features in the assessment of mHealth apps
Tarricone, R., Petracca, F., Ciani, O., & Cucciniello, M. (2021) · Expert Review of Pharmacoeconomics & Outcomes Research · doi:10.1080/14737167.2021.1891883 · Cited by 62
“as only small portions of users show consistent access to mHealth apps over time [29].”
BackgroundJaworski, B. K., Taylor, K., Ramsey, K. M., Heinz, A., Steinmetz, S., Pagano, I., Moraja, G., & Owen, J. E. (2021) · Journal of Medical Internet Research · doi:10.2196/26559 · Cited by 66
“However, the utility of standalone apps “in the wild” can be limited by poor engagement and high attrition (eg, [26,27].”
BackgroundResultRamos, G., Hernandez-Ramos, R., Taylor, M. E., & Schueller, S. M. (2024) · Behavior Therapy · doi:10.1016/j.beth.2024.04.004 · Cited by 73
Potts, C., Lindström, F., Bond, R., Mulvenna, M., Booth, F., Ennis, E., Parding, K., Kostenius, C., Broderick, T., Boyd, K., et al. (2023) · Journal of Medical Internet Research · doi:10.2196/43051 · Cited by 63
Golden, G., Popescu, C., Israel, S., Perlman, K., Armstrong, C., Fratila, R., Tanguay-Sela, M., & Benrimoh, D. (2024) · Health Policy and Technology · doi:10.1016/j.hlpt.2024.100844 · Cited by 63
Advancing digital health equity: Directions for behavioral and social science research
Jaworski, B. K., Hooper, M. W., Aklin, W. M., Jean‐Francois, B., Elwood, W. N., Belis, D., Riley, W. T., & Hunter, C. M. (2022) · Translational Behavioral Medicine · doi:10.1093/tbm/ibac088 · Cited by 65
Teepe, G. W., Fonseca, A. D., Kleim, B., Jacobson, N. C., Salamanca-Sanabria, A., Car, L. T., Fleisch, E., & Kowatsch, T. (2021) · Journal of Medical Internet Research · doi:10.2196/29412 · Cited by 74
“Although details of user engagement with the apps reviewed in the study by Baumel et al [49] were not available, several apps that were included in our study were also included in this review (eg, Headspace , Calm , Daylio , 7Cups , Happify , Moodpath , and T2 Mood Tracker ).”
InfluentialSmith, A. C., Ahuvia, I. L., Ito, S., & Schleider, J. L. (2023) · International Journal of Eating Disorders · doi:10.1002/eat.23976 · Cited by 70
Zhang, Y., Pratap, A., Folarin, A., Sun, S., Cummins, N., Matcham, F., Vairavan, S., Dineley, J., Ranjan, Y., Rashid, Z., et al. (2023) · npj Digital Medicine · doi:10.1038/s41746-023-00749-3 · Cited by 71
Jardine, J., Nadal, C., Robinson, S., Enrique, Á., Hanratty, M., & Doherty, G. J. (2023) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3635472 · Cited by 73
How Kaiser Permanente Created a Mental Health and Wellness Digital Ecosystem
Mordecai, D., Histon, T., Neuwirth, E., Heisler, W. S., Kraft, A., Bang, Y., Franchino, K., Taillac, C., & Nixon, J. P. (2021) · NEJM Catalyst · doi:10.1056/cat.20.0295 · Cited by 56
Kornfield, R., Meyerhoff, J., Studd, H., Bhattacharjee, A., Williams, J. J., Reddy, M. C., & Mohr, D. C. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3502046 · Cited by 73
“This is refected in low adherence and high abandonment rates for most tools [2, 11, 31], such that users may not receive the needed “dose” of treatment to produce improvements in mental health symptoms [38].”
BackgroundHuman Support in App-Based Cognitive Behavioral Therapies for Emotional Disorders: Scoping Review
Bernstein, E. E., Weingarden, H., Wolfe, E. C., Hall, M. D., Snorrason, I., & Wilhelm, S. (2022) · Journal of Medical Internet Research · doi:10.2196/33307 · Cited by 54
Real-world evidence for a prescription digital therapeutic to treat opioid use disorder
Maricich, Y. A., Xiong, X. R., Gerwien, R. W., Kuo, A., Velez, F. F., Imbert, B., Boyer, K., Luderer, H. F., Braun, S., & Williams, K. R. (2020) · Current Medical Research and Opinion · doi:10.1080/03007995.2020.1846023 · Cited by 61
Agyapong, V. I. O., Shalaby, R., Hrabok, M., Vuong, W., Noble, J. M., Gusnowski, A., Mrklas, K., Li, D., Snaterse, M., Surood, S., et al. (2021) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph18042157 · Cited by 53
Meegahapola, L., Droz, W., Kun, P., GÖTZEN, A. D., Nutakki, C. S., Diwakar, S., Ruíz-Correa, S., Song, D., Xu, H., Bidoglia, M., et al. (2022) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3569483 · Cited by 104
“This two-class inference also allows for detecting negative moods, which is useful in mobile health apps for feedback and interventions [6, 96] because it is such negative moods, along with other aspects like stress that could be harmful to individuals on the long term.”
BackgroundInfluentialBear, H. A., Ayala Nunes, L., DeJesus, J., Liverpool, S., Moltrecht, B., Neelakantan, L., Harriss, E., Watkins, E., & Fazel, M. (2022) · Journal of Medical Internet Research · doi:10.2196/40347 · Cited by 51
“As evidence suggests that engagement is the highest in the first days or weeks of downloading an app, it might be more appropriate for apps to be developed with this anticipated behavior in mind [72].”
BackgroundBell, I., Eisner, E., Allan, S., Cartner, S., Torous, J. B., Bucci, S., & Thomas, N. (2023) · Schizophrenia Bulletin · doi:10.1093/schbul/sbad127 · Cited by 66
“For example, some have argued 59,109 that the density of sampling in EMA studies (ie, percentage completion on a particular day) may be as important as overall percentage completion.”
BackgroundLattie, E., Cohen, K. A., Winquist, N., & Mohr, D. C. (2020) · JMIR Mental Health · doi:10.2196/21075 · Cited by 50
“Finally, because participants had committed to an 8-week study period, usage rates may have been higher than would have been in a more naturalistic study design [22].”
BackgroundInfluentialDigital Overload among College Students: Implications for Mental Health App Use
Smith, A. C., Fowler, L. A., Graham, A. K., Jaworski, B. K., Firebaugh, M., Monterubio, G. E., Vázquez, M. M., DePietro, B., Sadeh‐Sharvit, S., Balantekin, K. N., et al. (2021) · Social Sciences · doi:10.3390/socsci10080279 · Cited by 66
“An analysis of data from 93 mental health apps showed that rates of opening the apps declined by 80% between the first and tenth day, and that the median 15-day retention was 3.9% (Baumel et al. 2019).”
MethodInfluentialUnderstanding users’ perspectives on mobile apps for anxiety management
Balaskas, A., Schueller, S. M., Cox, A. L., & Doherty, G. J. (2022) · Frontiers in Digital Health · doi:10.3389/fdgth.2022.854263 · Cited by 65
“However, apps are not used daily even though the number of app installs may seem high (12).”
BackgroundSinha, C., Cheng, A. L., & Kadaba, M. (2022) · JMIR Formative Research · doi:10.2196/37302 · Cited by 51
“, mindfulness and meditation) [12] is important for the uptake and engagement with digital health interventions.”
BackgroundMair, J. L., Hashim, J., Thai, L., Tai, E. S., Ryan, J. C., Kowatsch, T., Müller‐Riemenschneider, F., & Edney, S. M. (2025) · Translational Behavioral Medicine · doi:10.1093/tbm/ibaf010 · Cited by 57
“Even among those who adopt, for example, health apps, sustaining long-term engagement and adherence remains a critical challenge [5, 6].”
InfluentialConley, C. S., Raposa, E. B., Bartolotta, K., Broner, S. E., Hareli, M., Forbes, N., Christensen, K. M., & Assink, M. (2022) · JMIR Mental Health · doi:10.2196/34254 · Cited by 63
“Finally, mental health technologies generally have low rates of engagement and adherence [35,43,48-50].”
BackgroundTaylor, C. B., Ruzek, J. I., Fitzsimmons-Craft, E. E., Sadeh-Sharvit, S., Topooco, N., Weissman, R. S., Eisenberg, D., Mohr, D., Graham, A., Jacobi, C., et al. (2020) · Journal of Medical Internet Research · doi:10.2196/17493 · Cited by 45
“To improve population-level outcomes, we have recently argued for the need for outcome optimization at the population level—an approach that simultaneously attempts to improve reach, uptake, engagement, and outcomes [1,13,14].”
BackgroundTarricone, R., Petracca, F., Cucciniello, M., & Ciani, O. (2022) · Health Economics · doi:10.1002/hec.4505 · Cited by 54
“Similarly, in the context of mental health, apps showed even poorer user retention, with a median 15-day retention of 3.9% and 30-day retention of 3.3% (Baumel et al., 2019).”
BackgroundInfluentialThe role of gamification in digital mental health
Fleming, T., Poppelaars, M., & Thabrew, H. (2023) · World Psychiatry · doi:10.1002/wps.21041 · Cited by 45
Public Trust in Artificial Intelligence Applications in Mental Health Care: Topic Modeling Analysis
Shan, Y., Ji, M., Xie, W., Lam, K.-Y., & Chow, C.-Y. (2022) · JMIR Human Factors · doi:10.2196/38799 · Cited by 45
“By investigating the most popular MH apps downloaded over 100,000 times, Baumel et al [9] discovered that 96% of users no longer engaged with the apps after 2 weeks.”
BackgroundHybrid care in mental health: a framework for understanding care, research, and future opportunities
Chen, K., Huang, J., & Torous, J. B. (2024) · NPP—Digital Psychiatry and Neuroscience · doi:10.1038/s44277-024-00016-7 · Cited by 45
“However the realization that well over 90% of people stop using a mental health app within a few days [5] has created doubt about the future of this approach.”
Ahuvia, I. L., Sung, J. Y., Dobias, M., Nelson, B. D., Richmond, L. L., London, B. E., & Schleider, J. L. (2022) · Journal of American College Health · doi:10.1080/07448481.2022.2062245 · Cited by 49
“16 Improvements to the accessibility of care do not necessarily mean that said care will be accessed.”
BackgroundShalaby, R., Vuong, W., Hrabok, M., Gusnowski, A., Mrklas, K., Li, D., Snaterse, M., Surood, S., Cao, B., Li, X., et al. (2021) · JMIR mhealth and uhealth · doi:10.2196/24184 · Cited by 45
“Furthermore, Text4Hope has achieved a higher retention rate than those of other mental health apps that target anxiety, depression, or emotional well-being [18,34].”
InfluentialEis, S., Solà-Morales, O., Duarte‐Díaz, A., Vidal‐Alaball, J., Perestelo‐Pérez, L., Robles, N., & Carrión, C. (2022) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph19042186 · Cited by 45
“The described issues give rise to opportunities for collaborations between industry and clinical researchers, with the goal of developing MHapps that are safe and effective, while also sufficiently engaging to ensure compliance and sustain therapeutic effect [69,92,93].”
BackgroundBaumel, A., Torous, J., Edan, S., & Kane, J. M. (2020) · Journal of Affective Disorders · doi:10.1016/j.jad.2020.05.011 · Cited by 41
Self-citationSpottswood, M., Lim, C. T., Davydow, D., & Huang, H. (2022) · Frontiers in Medicine · doi:10.3389/fmed.2022.892205 · Cited by 40
Burchert, S., Kerber, A., Zimmermann, J., & Knaevelsrud, C. (2021) · PLoS ONE · doi:10.1371/journal.pone.0244955 · Cited by 47
“Furthermore, it becomes increasingly evident that mental health apps struggle with user engagement and retention [33].”
BackgroundWasil, A. R., Patel, R., Cho, J. Y., Shingleton, R. M., Weisz, J. R., & DeRubeis, R. J. (2021) · International Journal of Eating Disorders · doi:10.1002/eat.23478 · Cited by 46
Fagernäs, S., Hamilton, W., Espinoza, N., Miloff, A., Carlbring, P., & Lindner, P. (2021) · Internet Interventions · doi:10.1016/j.invent.2021.100370 · Cited by 48
“Again, this risk may be avoidable by offering the user a variety of environments, potentially reducing the risk of few recurring users (Lindner et al., 2019), as also observed with smartphone applications for mental health (Baumel et al., 2019).”
BackgroundRauseo-Ricupero, N., Henson, P., Agate-Mays, M., & Torous, J. B. (2021) · International Review of Psychiatry · doi:10.1080/09540261.2020.1859465 · Cited by 45
Metadata
- Authors
- Baumel, A., Muench, F., Edan, S., & Kane, J. M.
- Affiliations
- University of Haifa (IL)
- Partnership for Drug-Free Kids (US)
- Northwell Health (US)
- Corresponding author
- Baumel, Amit
- Venue
- Journal of Medical Internet Research
- Publisher
- JMIR Publications Inc.
- Published
- 2019-09-25
- Volume
- 21
- Issue
- 9
- Pages
- e14567
- ISSN
- 1438-8871 (ISSN-L)
- PMC
- PMC6785720
- OpenAlex
- W2963232155
- Semantic Scholar
- c418736e20066949b3576cdc92bdb942a3ac4ec5
- Cited by
- 965
- References
- 41
- Citations by year
- 2026: 198 · 2025: 203 · 2024: 140 · 2023: 130 · 2022: 121 · 2021: 110 · 2020: 60 · 2019: 2
- FWCI
- 82.95
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- Journal of Medical Internet Research (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
- Social Sciences › Sociology and Political Science › Impact of Technology on Adolescents
- Keywords
- mental health apps, user engagement, app usage patterns, user retention, anxiety, depression, emotional well-being, mobile health, screen time, Android application, Google Play Store
- MeSH terms
- Self-Management, Anxiety, Mental Disorders, Depression, Humans, Mental Health, Telemedicine, Mobile Applications
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.