Objective User Engagement With Mental Health Apps: Systematic Search and Panel-Based Usage Analysis
Open accessPublished version of a preprint
The DOI matches its Crossref record; 41 of the 41 references it cites were found in a registry or an index.
Abstract
Background: Understanding patterns of real-world usage of mental health apps is key to maximizing their potential to increase public self-management of care. Although developer-led studies have published results on the use of mental health apps in real-world settings, no study yet has systematically examined usage patterns of a large sample of mental health apps relying on independently collected data. Objective: Our aim is to present real-world objective data on user engagement with popular mental health apps. Methods: A systematic engine search was conducted using Google Play to identify Android apps with 10,000 installs or more targeting anxiety, depression, or emotional well-being. Coding of apps included primary incorporated techniques and mental health focus. Behavioral data on real-world usage were obtained from a panel that provides aggregated nonpersonal information on user engagement with mobile apps. Results: In total, 93 apps met the inclusion criteria (installs: median 100,000, IQR 90,000). The median percentage of daily active users (open rate) was 4.0% (IQR 4.7%) with a difference between trackers (median 6.3%, IQR 10.2%) and peer-support apps (median 17.0%) versus breathing exercise apps (median 1.6%, IQR 1.6%; all z≥3.42, all P<.001). Among active users, daily minutes of use were significantly higher for mindfulness/meditation (median 21.47, IQR 15.00) and peer support (median 35.08, n=2) apps than for apps incorporating other techniques (tracker, breathing exercise, psychoeducation: medians range 3.53-8.32; all z≥2.11, all P<.05). The medians of app 15-day and 30-day retention rates were 3.9% (IQR 10.3%) and 3.3% (IQR 6.2%), respectively. On day 30, peer support (median 8.9%, n=2), mindfulness/meditation (median 4.7%, IQR 6.2%), and tracker apps (median 6.1%, IQR 20.4%) had significantly higher retention rates than breathing exercise apps (median 0.0%, IQR 0.0%; all z≥2.18, all P≤.04). The pattern of daily use presented a descriptive peak toward the evening for apps incorporating most techniques (tracker, psychoeducation, and peer support) except mindfulness/meditation, which exhibited two peaks (morning and night). Conclusions: Although the number of app installs and daily active minutes of use may seem high, only a small portion of users actually used the apps for a long period of time. More studies using different datasets are needed to understand this phenomenon and the ways in which users self-manage their condition in real-world settings.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures





Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source doesn’t support the claim as written.
In the citing paper
“Participants’ engagement rates exceeded industry standards”
From A Digital Mental Health Intervention in an Orthopedic Setting for Patients With Symptoms of Depression and/or Anxiety: Feasibility Prospective Cohort Study (2022) · cites this paper as [40]
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“While this study design does not permit definitive causal attribution to the personalization component specifically, the observed patterns are consistent with conceptual frameworks, suggesting that content alignment with users’ cognitive-emotional profiles enhances engagement [8,34].”
From Schema-Informed Digital Mental Health Intervention for Maladaptive Cognitive-Emotional Patterns: Randomized Controlled Trial (2025) · cites this paper as [34]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“When accessed “in the wild,” the vast majority of DMHIs have had low engagement and high attrition (Baumel et al., 2019; Torous et al., 2020; Fleming et al., 2018).”
From A text messaging intervention to support the mental health of young adults: User engagement and feedback from a field trial of an intervention prototype (2023) · cites this paper as Baumel et al., 2019
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“such platforms are frequently characterized by low adherence [14-16]”
From Feasibility and Preliminary Efficacy of Web-Based and Mobile Interventions for Common Mental Health Problems in Working Adults: Multi-Arm Randomized Pilot Trial (2022) · cites this paper as [14]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“This parallels common definitions of engagement used for DMHIs (e.g., any daily app use) (Baumel et al., 2019), and other interactive messaging systems (Psihogios et al., 2019).”
From A text messaging intervention to support the mental health of young adults: User engagement and feedback from a field trial of an intervention prototype (2023) · cites this paper as Baumel et al., 2019
7 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Using thematic analysis in psychology
Braun, V., & Clarke, V. (2006) · Qualitative Research in Psychology · doi:10.1191/1478088706qp063oa · Cited by 194,414 · cited 2×
“components of mental health apps [27,30], drawing on the thematic analysis method suggested by Braun and Clarke [31].”
MethodEysenbach, G. (2005) · Journal of Medical Internet Research · doi:10.2196/jmir.7.1.e11 · Cited by 2,524 · cited 2×
“However, the impact of digital interventions is limited by their ability to engage users in therapeutic activities and to support user adherence to the therapeutic process [9,10].”
BackgroundA behavior model for persuasive design
Fogg, B. (2009) · Proceedings of the 4th International Conference on Persuasive Technology · doi:10.1145/1541948.1541999 · Cited by 2,328 · cited 1×
“Second, user retention patterns might also indicate the low burden associated with app installation (ie, the simplicity of opening the Google Play Store and clicking the app download and installation buttons), which implies that user context, motivation, and ability to engage [44] with these apps were not tested befor…”
BackgroundMobile app rating scale: a new tool for assessing the quality of health mobile apps
Stoyanov, S. R., Hides, L., Kavanagh, D. J., Zelenko, O., Tjondronegoro, D., & Mani, M. (2015) · JMIR mHealth and uHealth · doi:10.2196/mhealth.3422 · Cited by 2,233 · cited 1×
“Although there are some recommender websites [27,29,37] and approaches to help users identify the right apps [38-41], a therapeutic framework that provides guidance to users about how to use the right app at the right time could be useful.”
BackgroundSelf-regulation, ego depletion, and motivation
Baumeister, R. F., & Vohs, K. D. (2007) · Social and Personality Psychology Compass · doi:10.1111/j.1751-9004.2007.00001.x · Cited by 1,402
Adherence in Internet Interventions for Anxiety and Depression
Christensen, H., Griffiths, K. M., & Farrer, L. (2009) · Journal of Medical Internet Research · doi:10.2196/jmir.1194 · Cited by 1,133 · cited 2×
“These findings reflect the lower ranges of real-world retention rates reported in developer-led studies [17-20,22].”
BackgroundUnderstanding and Promoting Effective Engagement With Digital Behavior Change Interventions
Yardley, L., Spring, B. J., Riper, H., Morrison, L. G., Crane, D. H., Curtis, K., Merchant, G. C., Naughton, F., & Blandford, A. (2016) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2016.06.015 · Cited by 1,118 · cited 1×
“These patterns could be explained using the notion of effective engagement described by Yardley and colleagues [36], wherein there is “sufficient engagement with the intervention to achieve intended outcomes.”
BackgroundCollins, L. M., Murphy, S. A., & Strecher, V. (2007) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2007.01.022 · Cited by 1,082
Healthcare via Cell Phones: A Systematic Review
Krishna, S., Boren, S. A., & Balas, E. A. (2009) · Telemedicine and e-Health · doi:10.1089/tmj.2008.0099 · Cited by 882 · cited 1×
“The conversation has shifted from patients and providers to individuals who can now engage in self-care around the clock outside of traditional health care settings (eg, [1-3]).”
Background
Research works printed but not linked: 1
- 2001, The World Health Report 2001. Mental Health: New Understanding, New Hope
Cited by
Items 101–200 of 963
Blasiak, A., Sapanel, Y., Leitman, D., Ng, W. Y., Nicola, R. D., Lee, V. V., Todorov, A., & Ho, D. (2022) · Journal of Medical Internet Research · doi:10.2196/41463 · Cited by 53
“In one of many examples, the usage analysis of 57 mental health apps showed that the percentage of users who opened the app dropped from 69.4% to 3.9% within the first 15 days [39], potentially rendering them ineffective.”
InfluentialThe Digital Navigator: Standardizing Human Technology Support in App-Integrated Clinical Care
Chen, K., Lane, E., Burns, J., Macrynikola, N., Chang, S. M., & Torous, J. B. (2024) · Telemedicine Journal and e-Health · doi:10.1089/tmj.2024.0023 · Cited by 39
“Given the challenges of app engagement across all digital health interventions, especially mental health, 17 the potential for the Digital Navigator to aid in engagement is notable.”
A meta-analysis of persuasive design, engagement, and efficacy in 92 RCTs of mental health apps
Valentine, L., Hinton, J. D. X., Bajaj, K., Boyd, L., O’Sullivan, S., Sorenson, R. P., Bell, I., Vega, M. S., Liu, P., Peters, W., et al. (2025) · npj Digital Medicine · doi:10.1038/s41746-025-01567-5 · Cited by 56
“31 reportedan engagementrate of3.”
Berry, N., Machin, M., Ainsworth, J. D., Berry, K., Edge, D., Haddock, G., Lewis, S. W., Morris, R., & Bucci, S. (2020) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2020.602861 · Cited by 39
“Despite the potential of digital health interventions (DHIs), real-world usage rates are low (19).”
BackgroundWong, H. W., Lo, B., Shi, J., Hollenberg, E., Abi-Jaoudé, A., Johnson, A., Chaim, G., Cleverley, K., Henderson, J. L., LEVINSON, A. J., et al. (2021) · JMIR Mental Health · doi:10.2196/23447 · Cited by 53
“For example, one study found that among 93 mental health apps on the Google Play store, the median 15-day retention rate was 3.9% [13].”
InfluentialMilitello, L. K., Sobolev, M., Okeke, F., Adler, D. A., & Nahum-Shani, I. B. (2021) · JMIR Formative Research · doi:10.2196/30606 · Cited by 42
“However, mindfulness apps often design guided meditations for repeated use [81].”
BackgroundResultInfluentialQin, X., Liu, C., Zhu, W. D., Chen, Y., & Wang, Y. (2022) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph192416824 · Cited by 54
Toward the Science of Engagement With Digital Interventions
Nahum-Shani, I. B., & Yoon, C. (2024) · Current Directions in Psychological Science · doi:10.1177/09637214241254328 · Cited by 45
Marcu, G. M., Ondersma, S. J., Spiller, A. N., Broderick, B. M., Kadri, R., & Buis, L. R. (2021) · Journal of Medical Internet Research · doi:10.2196/34301 · Cited by 51
“The concerns of our interviewees echo the problem of engagement, which is well established in the literature [9,12-14, 21 , 22] and which may be exacerbated when digital”
BackgroundOehler, C., Scholze, K., Driessen, P., Rummel‐Kluge, C., Görges, F., & Hegerl, U. (2021) · Internet Interventions · doi:10.1016/j.invent.2021.100476 · Cited by 36
Peerani, F., Watt, M., Ismond, K. P., Whitlock, R., Ambrosio, L., Hotte, N., Mitchell, N., Bailey, R. J., Kroeker, K., Dieleman, L. A., et al. (2022) · Therapeutic Advances in Gastroenterology · doi:10.1177/17562848221127238 · Cited by 35
Topooco, N., Fowler, L. A., Fitzsimmons‐Craft, E. E., DePietro, B., Vázquez, M. M., Firebaugh, M., Ceglarek, P. J. D., Monterubio, G. E., Newman, M. G., Eisenberg, D., et al. (2022) · Internet Interventions · doi:10.1016/j.invent.2022.100528 · Cited by 69
The conceptualisation and measurement of engagement in digital health
Milne‐Ives, M., Homer, S. R., Andrade, J., & Meinert, E. (2024) · Internet Interventions · doi:10.1016/j.invent.2024.100735 · Cited by 41
“…the increasing demands on healthcare systems, but the impact of digital health interventions is often limited by a critical factor: lack of engagement (Baumel et al., 2019; Birnbaum et al., 2015; Meyerowitz-Katz et al., 2020; Pratap et al., 2020; Torous et al., 2020a; Yeager and Benight, 2018).”
BackgroundVereschagin, M., Wang, A. Y., Richardson, C. G., Xie, H., Munthali, R. J., Hudec, K. L., Leung, C., Wojcik, K. D., Munro, L., Halli, P., et al. (2024) · Journal of Medical Internet Research · doi:10.2196/54287 · Cited by 34
Satre, D. D., Meacham, M. C., Asarnow, L. D., Fisher, W. S., Fortuna, L. R., & Iturralde, E. (2021) · American Journal of Health Promotion · doi:10.1177/08901171211055314 · Cited by 39
“These strategies may boost effectiveness through greater engagement, a persistent problem for mental health apps, which often lose the majority of users within 2 weeks.(73) Through the process of vetting and recommending apps, health systems can increase app credibility and user trust, a hypothesized driver of engagem…”
BackgroundOsborne, E. L., Ainsworth, B., Hooper, N., & Atkinson, M. J. (2023) · Journal of Medical Internet Research · doi:10.2196/44220 · Cited by 37
“…refers to the investment of energy in an activity and includes physical (i.e., actual performance, which researchers often rely on when examining engagement using objective behavioural metrics [10]), affective (i.e., affective reactions), and cognitive (i.e., selective attention) elements [11].”
BackgroundDigitalising mental health care: Practical recommendations from the European Psychiatric Association
Kalman, J. L., Burkhardt, G., Samochowiec, J., Gebhard, C., Dom, G., John, M., Kılıç, Ö., Kurimay, T., Lien, L., Schouler‐Ocak, M., et al. (2023) · European Psychiatry · doi:10.1192/j.eurpsy.2023.2466 · Cited by 49
“Engagement in real-world settings was even poorer: the 15-day retention rate for mental health apps was only 3.9% [35].”
BackgroundInfluentialRodriguez-Villa, E., Mehta, U. M., Naslund, J. A., Tugnawat, D. K., Gupta, S., Thirtalli, J., Bhan, A., Patel, V., Chand, P., Rozatkar, A. R., et al. (2021) · BJPsych Open · doi:10.1192/bjo.2020.142 · Cited by 33
A Mental Health and Well-Being Chatbot: User Event Log Analysis
Booth, F. G., Potts, C., Bond, R., Mulvenna, M. D., Kostenius, C., Dhanapala, I., Vakaloudis, A., Cahill, B., Kuosmanen, L., & Ennis, E. (2023) · JMIR mhealth and uhealth · doi:10.2196/43052 · Cited by 40
“Benchmarking the ChatPal app against a study of 93 mobile apps, 59 of which specialized in mental health [31] shows that ChatPal performed better than average with a drop-off rate in the first 10 days of 77% compared with the average of 80% and a drop off between day 15 and day 30 of 7.1% compared…”
InfluentialRichardson, C. G., Slemon, A., Gadermann, A., McAuliffe, C., Thomson, K., Daly, Z., Salway, T. J., Currie, L. M., David, A., & Jenkins, E. (2020) · Journal of Medical Internet Research · doi:10.2196/24868 · Cited by 34
Baumel, A., & Muench, F. J. (2021) · Journal of Medical Internet Research · doi:10.2196/24905 · Cited by 32
“Despite the fact that digital interventions have significantly expanded their reach, with tens of millions of app downloads, the retention rates across the range of digital interventions remain very poor, with only 4% of behavioral health app users continuing use after 15 days [9].”
BackgroundSelf-citationWebb, C. A., Swords, C. M., Lawrence, H. R., & Hilt, L. M. (2022) · Journal of Consulting and Clinical Psychology · doi:10.1037/ccp0000763 · Cited by 43
Kornfield, R., Stamatis, C. A., Bhattacharjee, A., Pang, B., Nguyen, T., Williams, J. J., Kumar, H., Popowski, S., Beltzer, M., Karr, C. J., et al. (2023) · Internet Interventions · doi:10.1016/j.invent.2023.100667 · Cited by 33
“When accessed “ in the wild, ” the vast majority of DMHIs have had low engagement and high attrition (Baumel et al., 2019; Torous et al., 2020; Fleming et al., 2018).”
BackgroundMethodComtois, K. A., Mata-Greve, F., Johnson, M., Pullmann, M. D., Mosser, B., & Areán, P. A. (2022) · JMIR mhealth and uhealth · doi:10.2196/41689 · Cited by 51
Murray, A. L., Brown, R., Zhu, X., Speyer, L. G., Yang, Y., Xiao, Z., Ribeaud, D., & Eisner, M. (2022) · Journal of Affective Disorders · doi:10.1016/j.jad.2022.11.014 · Cited by 55
Meyerhoff, J., Kornfield, R., Mohr, D. C., & Reddy, M. C. (2022) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3555203 · Cited by 47
“One study that included a systematic search of mental health apps on the Google Play store, in combination with app use data from a panel of mental health app users, found that DMH tools that incorporated peer support had longer use times and greater open rates [9].”
BackgroundFarrall, A., Taylor, J., Ainsworth, B., & Alexander, J. (2023) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581188 · Cited by 42
Kleinau, E., Lamba, T., Jaskiewicz, W., Gorentz, K., Hungerbuehler, I., Rahimi, D., Kokota, D., Maliwichi, L., Jamu, E. S., Zumazuma, A., et al. (2024) · PLoS ONE · doi:10.1371/journal.pone.0303370 · Cited by 54
“824 Engagement with the app was an average of 11 minutes per day, including the completion of 825 assessments, and was within a range of 4 to 22 minutes (median) reported by a study of user 826 engagement with mental health apps [56].”
Lukic, Y. X., Teepe, G. W., Fleisch, E., & Kowatsch, T. (2022) · JMIR Serious Games · doi:10.2196/39186 · Cited by 32
“The positive effects of breathing training have sparked the development of various breathing guidance apps [16].”
BackgroundCurrey, D., & Torous, J. B. (2023) · Journal of Medical Internet Research · doi:10.2196/39258 · Cited by 42
Kulikov, V. N., Crosthwaite, P. C., Hall, S. A., Flannery, J., Strauss, G., Vierra, E., Koepsell, X., Lake, J. I., & Padmanabhan, A. (2023) · Frontiers in Digital Health · doi:10.3389/fdgth.2023.1062471 · Cited by 35
“06 times higher for research studies (88, 89), which is lower than the median daily active use we found.”
BackgroundForman‐Hoffman, V. L., Flom, M., Mariano, T. Y., Chiauzzi, E. J., Williams, A. A. A., Kirvin-Quamme, A., Pajarito, S., Durden, E., & Perski, O. (2023) · Journal of Medical Internet Research · doi:10.2196/47198 · Cited by 44
“F or example, a study using a systematic search of popular mental health apps found a median of 4% of users opening the app on any given day [12].”
Lukic, Y. X., Shih, C.-H. I., Reguera, Á. H., Cotti, A., Fleisch, E., & Kowatsch, T. (2020) · JMIR Serious Games · doi:10.2196/22802 · Cited by 35
“Finally, it has been shown that although breathing training apps yield high numbers of installations, the retention rates and, thus, long-term adherence are very low [24].”
BackgroundFigueroa, C. A., Aguilera, A., Chakraborty, B., Modiri, A., Aggarwal, J., Deliu, N., Sarkar, U., Williams, J. J., & Lyles, C. R. (2021) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocab001 · Cited by 47
“6 However, only a small percentage of users use behavior change apps over a long period of time, 7 and mobile applications have not become part of routine medical care.”
BackgroundMcCall, T., Ali, M. O., Yu, F., Fontelo, P. A., & Khairat, S. (2021) · JMIR Formative Research · doi:10.2196/24393 · Cited by 34
“Past research conducted on the usage patterns of mental health apps showed that despite the high amount of initial installations and daily active minutes spent, only a small percentage of users continued to use the apps for longer than a couple of weeks [44].”
BackgroundAuf, H., Dagman, J., Renström, S., & Chaplin, J. E. (2021) · Proceedings of the Design Society · doi:10.1017/pds.2021.426 · Cited by 47
“Several studies have shown that these apps lose most of their users within the first two weeks after installation (Baumel et al. 2019; Bauer et al. 2020).”
BackgroundSheng, Y., Doyle, J., Bond, R., Jaiswal, R. R., Gavin, S., & Dinsmore, J. G. (2022) · Digital Health · doi:10.1177/20552076221125957 · Cited by 34
“We compared the user retention curve in this study with the user retention curves for other health care apps.(29) Given that the retention curves in other apps take on an ‘L’ shape, this comparison demonstrated that the user retention with ProACT is much better than that of many other health care apps.”
ResultPatients’ adherence to smartphone apps in the management of bipolar disorder: a systematic review
Patoz, M.-C., Hidalgo-Mazzei, D., Pereira, B., Blanc, O., de Chazeron, I., Murru, A., Verdolini, N., Pacchiarotti, I., Vieta, E., Llorca, P.-M., et al. (2021) · International Journal of Bipolar Disorders · doi:10.1186/s40345-021-00224-6 · Cited by 30
Oba, T., Takano, K., Katahira, K., & Kimura, K. (2023) · JMIR mhealth and uhealth · doi:10.2196/49148 · Cited by 34
“Research has shown that the retention rate of commercial health care apps is extremely low [48], and different users have different motivations to maintain the use of an app [49,50], such as adjusting default settings to one’s own needs and abilities, socializing, and competition.”
BackgroundThe impact of mindfulness apps on psychological processes of change: a systematic review
Macrynikola, N., Mir, Z., Gopal, T., Rodriguez, E., Li, S., Cox, M., Yeh, G. Y., & Torous, J. B. (2024) · npj Mental Health Research · doi:10.1038/s44184-023-00048-5 · Cited by 42
“Yet most commercially available mindfulness apps have not been scienti fi cally evaluated 8 , and most mental health apps struggle to keep users engaged 9 .”
Scoping Review: Digital Mental Health Interventions for Children and Adolescents Affected by War
Danese, A., Martsenkovskyi, D., Remberk, B., Khalil, M. Y., Diggins, E., Keiller, E., Masood, S., Awah, I., Barbui, C., Beer, R., et al. (2024) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1016/j.jaac.2024.02.017 · Cited by 67
“Future work will also need to more directly target uptake and continued engagement, which are typically low for digital mental health interventions 18,87,88 and are recognized as a speci fi c challenge in trauma-exposed individuals.”
Álvarez‐Jiménez, M., Nicholas, J., Valentine, L., Liu, P., Mangelsdorf, S. N., Baker, S., Gilbertson, T., O'Loughlin, G., McEnery, C., McGorry, P. D., et al. (2024) · Acta Psychiatrica Scandinavica · doi:10.1111/acps.13751 · Cited by 41
“19 By contrast, 55% of young people who used MOST were still active at 6 weeks, 40% at 12 weeks and 19% at 24 weeks.”
A New Research Model for Artificial Intelligence–Based Well-Being Chatbot Engagement: Survey Study
Yang, Y., Tavares, J., & Oliveira, T. (2024) · JMIR Human Factors · doi:10.2196/59908 · Cited by 50
“An analysis of mental health applications use showed that the average 15-day retention rate was only 3.9% [49].”
InfluentialManole, A., Cârciumaru, R., Brînzaș, R., & Manole, F. (2024) · Information · doi:10.3390/info16010011 · Cited by 44
Is the world ready for ChatGPT therapists?
Graber-Stiehl, I. (2023) · Nature · doi:10.1038/d41586-023-01473-4 · Cited by 32
Cardoso, T. D. A., Kochhar, S., Torous, J. B., & Morton, E. E. (2024) · JMIR Mental Health · doi:10.2196/58631 · Cited by 39
“Poor engagement is endemic to mental health apps in general, extending beyond just those aimed at BD [33], with most users of publicly available apps disengaging within 30 days.”
BackgroundShinn, E. H., Jensen, K., McLaughlin, J., Garden, A. S., Fellman, B. M., Liang, L., & Peterson, S. K. (2019) · Internet Interventions · doi:10.1016/j.invent.2019.100289 · Cited by 32
Integrated Digital Mental Health Care: A Vision for Addressing Population Mental Health Needs
Lim, C. T., Fuchs, C. H., & Torous, J. B. (2024) · International Journal of General Medicine · doi:10.2147/ijgm.s449474 · Cited by 35
“Hybrid care can address the known challenge of low retention in digital health tools, 11,36 given that a digital navigator or clinician can promote engagement, guide the patient to relevant content, and, depending on the tool, use data from the patient’s use in further guiding face-to-face care.”
BackgroundAssessing User Retention of a Mobile App: Survival Analysis
Lin, Y., Chen, S.-Y., Lin, P.-H., Tai, A., Pan, Y., Hsieh, C.-E., & Lin, S. (2020) · JMIR mhealth and uhealth · doi:10.2196/16309 · Cited by 38
“Although the number of app installs and daily active minutes of use may seem high, only a small portion of users actually use apps for a long period of time [8].”
BackgroundMethodInfluentialPorras‐Segovia, A., Díaz-Oliván, I., Barrigón, M. L., Moreno, M., Artés-Rodríguez, A., Pérez-Rodríguez, M. M., & Baca‐García, E. (2022) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2022.02.026 · Cited by 34
Evidence‐informed is not enough: digital therapeutics also need to be evidence‐based
Espie, C. A., Firth, J., & Torous, J. B. (2022) · World Psychiatry · doi:10.1002/wps.20993 · Cited by 28
Digital Interventions to Enhance Readiness for Psychological Therapy: Scoping Review
Jardine, J., Bowman, R., & Doherty, G. J. (2022) · Journal of Medical Internet Research · doi:10.2196/37851 · Cited by 39
“Low use and high dropout rates are persistent problems when it comes to digital solutions [15], although similar problems also affect FTF modalities; between 17% and 25% of clients are estimated to drop out of FTF psychotherapy [8,16,17].”
Understanding Mental Health Apps for Youth: Focus Group Study With Latinx Youth
Agapie, E., Chang, K., Patrachari, S., Neary, M., & Schueller, S. M. (2022) · JMIR Formative Research · doi:10.2196/40726 · Cited by 32
Encouraging help-seeking and engagement in a mental health app: What young people want
Garrido, S., Oliver, E., Chmiel, A., Doran, B., & Boydell, K. (2022) · Frontiers in Digital Health · doi:10.3389/fdgth.2022.1045765 · Cited by 34
“However, other work has suggested that engagement tends to be higher in mental health apps that offer peer support (19) or other forms of social connection (20).”
BackgroundUser engagement in mobile apps for people with schizophrenia: A scoping review
de Almeida, R. S., & Marques, A. J. (2023) · Frontiers in Digital Health · doi:10.3389/fdgth.2022.1023592 · Cited by 35
“clinical trials but also in the real-world (13).”
BackgroundBraun, P., Drüge, M., Hennemann, S., Nitsch, F. J., Staeck, R., & Apolinário-Hagen, J. (2022) · Frontiers in Digital Health · doi:10.3389/fdgth.2022.840869 · Cited by 27
“(9) that future research should focus on the relationship between the intention to use different EMH services and use behavior (92) and investigate whether identified predictors of EMH acceptance could potentially influence actual uptake rates.”
BackgroundSituating Meditation Apps Within the Ecosystem of Meditation Practice: Population-Based Survey Study
Lam, S. U., Xie, Q., & Goldberg, S. B. (2023) · JMIR Mental Health · doi:10.2196/43565 · Cited by 29
“Notably, meditation apps, as with other smartphone-delivered interventions, have notoriously poor user retention, which can limit the interventions’ potential benefits in the long term and may undermine the validity of studies evaluating these interventions [23,24].”
BackgroundPeake, E. E., Miller, I., Flannery, J., Chen, L., Lake, J. I., & Padmanabhan, A. (2024) · Journal of Medical Internet Research · doi:10.2196/48467 · Cited by 38
“This finding supports the idea that engagement and adherence are important drivers of treatment outcomes [82,83].”
Neupane, S., Saha, M., Ali, N., Hnat, T. W., Samiei, S. A., Nandugudi, A., Almeida, D. M., & Kumar, S. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642662 · Cited by 50
“An analysis of mental health apps (with 10,000 or more installs) found that the average retention rate at the 30-day mark was 3.3%[10].”
InfluentialVossen, W., Szymanski, M., & Verbert, K. (2024) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/3640543.3645195 · Cited by 39
“Health apps also often suffer from poor user retention, as the number of daily active users is often only 4% [4].”
BackgroundJung, K., Lee, G., Yuan-hui, H., & Chen, Y. (2025) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3757537 · Cited by 66
“This finding suggests that LLMs could serve as immediate, low-barrier solutions for those with urgent mental health concerns, especially during peak times like evenings, when mental health app usage surges [5].”
Machine learning for ambulatory applications of neuropsychological testing
Chandler, C., Foltz, P. W., Cohen, A. S., Holmlund, T. B., Cheng, J., Bernstein, J., Rosenfeld, E. P., & Elvevåg, B. (2020) · Intelligence-Based Medicine · doi:10.1016/j.ibmed.2020.100006 · Cited by 34
“One study of mental health apps showed that in the fi rst ten days of app usage there is a decline of more than 80% in app open rates and then there is an additional 20% decline between days 15 and 30 [23].”
BackgroundBulaj, G. W., Clark, J. E., Ebrahimi, M., & Bald, E. M. (2021) · Frontiers in Pharmacology · doi:10.3389/fphar.2021.612602 · Cited by 32
“Adverse childhood experiences (ACE) are associated with compromised health outcomes (Bellis et al., 2019), including mental health (Kim et al., 2019) and stress response dysregulation (Jiang et al., 2019).”
BackgroundKnapp, A. A., Cohen, K. A., Nicholas, J., Mohr, D. C., Carlo, A. D., Skerl, J. J., & Lattie, E. G. (2021) · JMIR Mental Health · doi:10.2196/27379 · Cited by 31
“Furthermore, engagement with DMH tools is low, for example, Baumel et al [3] report that just 4% of mental health apps are opened daily.”
MethodUser-Centric Design Methodology for mHealth Apps: The PainApp Paradigm for Chronic Pain
Koumpouros, Y. (2022) · Technologies · doi:10.3390/technologies10010025 · Cited by 35
“[56], the number of app installations and daily active minutes of use are not an indication of success.”
BackgroundWell-being app to support young people during the COVID-19 pandemic: randomised controlled trial
Thabrew, H., Boggiss, A. L., Lim, D. H., Schache, K., Morunga, E., Cao, N., Cavadino, A., & Serlachius, A. S. (2022) · BMJ Open · doi:10.1136/bmjopen-2021-058144 · Cited by 32
Digital Navigator Training to Increase Access to Mental Health Care in Community-Based Organizations
Alon, N., Perret, S., Cohen, A. N., Partiquin, M., LeMelle, S., Boyd, C. E., Aguilera, J., Reat, C., Hough, E., Walsh, J., et al. (2024) · Psychiatric Services · doi:10.1176/appi.ps.20230391 · Cited by 28
Developing and pilot testing ASTHMAXcel, a mobile app for adults with asthma
Hsia, B. C., Mowrey, W. B., Keskin, T., Wu, S., Aita, R., Kwak, L., Ferastraoarou, D., Rosenstreich, D. L., & Jariwala, S. P. (2020) · Journal of Asthma · doi:10.1080/02770903.2020.1728770 · Cited by 29
“One study examining mental health smartphone apps found that those with lowest dropout rates had features enabling peer support (27).”
BackgroundAlessa, T., Hawley, M., Alsulamy, N. A., & de Witte, L. (2020) · JMIR mhealth and uhealth · doi:10.2196/24177 · Cited by 40
Pratt, E. H., Hall, L., Jennings, C., Olsen, M. K., Jan, A., Parish, A., Porter, L. S., & Cox, C. E. (2023) · Annals of the American Thoracic Society · doi:10.1513/annalsats.202301-025oc · Cited by 26
Klapow, M. C., Rosenblatt, A., Lachman, J., & Gardner, F. (2024) · JMIR Pediatrics and Parenting · doi:10.2196/55726 · Cited by 20
“By contrast, Baumel et al [58] reported in a review of 93 mental health mobile apps that the median retention rate after 15 days was 3.9%.”
BackgroundInfluentialAdoption of Digital Therapeutics in Europe
Fassbender, A., Donde, S. S., Silva, M., Friganović, A., Stievano, A., Costa, E. M., Winders, T. A., & van Vugt, J. (2024) · Therapeutics and Clinical Risk Management · doi:10.2147/tcrm.s489873 · Cited by 32
“91–96 As there are currently few DTx approved in practice, there is resistance towards clinical acceptance and organisational change; 97 therefore, the diffusion and usage of DTx are fragmented across Europe.”
Viczko, J., Tarrant, J., & Jackson, R. (2021) · Frontiers in Virtual Reality · doi:10.3389/frvir.2021.618381 · Cited by 30
“However, 30-day retention rates for traditional mindfulness-based apps are quite low (median 4.7%; Baumel, et al., 2019), suggesting that they may be of limited long-term value for most users.”
BackgroundInfluentialShi, J., Lo, B., Wong, H. W., Hollenberg, E., Sanches, M., Abi-Jaoudé, A., Chaim, G., Cleverley, K., Henderson, J. L., Johnson, A., et al. (2021) · Internet Interventions · doi:10.1016/j.invent.2021.100386 · Cited by 31
“For example, participants with different mental health issues may have different expectations and attitudes toward using mental health apps (Baumel et al., 2019).”
BackgroundSimon, L., Reimann, J., Steubl, L., Stach, M., Spiegelhalder, K., Sander, L., Baumeister, H., Meßner, E.-M., & Terhorst, Y. (2022) · Journal of Sleep Research · doi:10.1111/jsr.13642 · Cited by 24
Exploring how informed mental health app selection may impact user engagement and satisfaction
Kopka, M., Camacho, E., Kwon, S., & Torous, J. B. (2023) · PLOS Digital Health · doi:10.1371/journal.pdig.0000219 · Cited by 30
“National data suggests rates of engagement may be less than 10% after two weeks [2] and numerous studies have reported similar decay curves around engagement with diverse health apps [27].”
BackgroundExamining equity in access and utilization of a freely available meditation app
Jiwani, Z., Tatar, R., Dahl, C. J., Wilson-Mendenhall, C. D., Hirshberg, M. J., Davidson, R. J., & Goldberg, S. B. (2023) · npj Mental Health Research · doi:10.1038/s44184-023-00025-y · Cited by 25
“Finally, it should also be noted that similar to other research on other mental health apps 64 , participant attrition was fairly high in the present study, with the average user utilizing the app for approximately four days and engaging in less than four meditation practice sessions.”
BackgroundResultJohnson, E., Corrick, S., Isley, S., Vandermeer, B., Dolgoy, N., Bates, J., Godfrey, E., Soltys, C., Muir, C., Vohra, S., et al. (2024) · PLOS Digital Health · doi:10.1371/journal.pdig.0000435 · Cited by 24
“From other reports, up to 80% of enrolled participants have been found to engage minimally [136, 137], with fewer than 5% being daily users in real world settings [138, 139].”
BackgroundFialho, P. M. M., Wenig, V., Heumann, E., Müller, M., Stock, C., & Pischke, C. R. (2025) · BMC Public Health · doi:10.1186/s12889-025-23669-1 · Cited by 33
“…support, such as coaching or therapist involvement, are associated with higher engagement and better outcomes in digital mental health interventions and better outcomes [71]. iii) Moreover, the review identified weaknesses in research methodology as reflected by the results of the RoB assessment.”
Three questions to consider before developing a mental health app
Wasil, A. R., Weisz, J. R., & DeRubeis, R. J. (2020) · World Psychiatry · doi:10.1002/wps.20757 · Cited by 24
Smartphone app engagement and clinical outcomes in a hybrid clinic
Chang, S., Gray, L., & Torous, J. (2023) · Psychiatry Research · doi:10.1016/j.psychres.2022.115015 · Cited by 21
A Digital Coach to Promote Emotion Regulation Skills
Hopman, K., Richards, D., & Norberg, M. M. (2023) · Multimodal Technologies and Interaction · doi:10.3390/mti7060057 · Cited by 36
“Short intervention timeframes have been recommended in the literature, as studies of digital mental health intervention user behavior highlight that only a small portion of users engage with programs for a long period [51].”
BackgroundCamacho, E., Chang, S. M., Currey, D., & Torous, J. B. (2023) · Health Informatics Journal · doi:10.1177/14604582231215872 · Cited by 24
Engagement in Digital Mental Health Interventions: Can Monetary Incentives Help?
Boucher, E. M., Ward, H. E., Mounts, A. C., & Parks, A. C. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2021.746324 · Cited by 25
“Similarly, a review of real-world usage of mental health apps found that the median percentage of users who opened the app each day was 4%, and the median retention rate was 3.9% for 15 days and 3.3% for 30 days (Baumel et al., 2019).”
BackgroundInfluentialHallenbeck, H. W., Jaworski, B. K., Wielgosz, J., Kuhn, E. R., Ramsey, K. M., Taylor, K. L., Juhasz, K. M., McGee-Vincent, P. A., Mackintosh, M., & Owen, J. E. (2022) · JMIR Mental Health · doi:10.2196/34744 · Cited by 30
“Of note, although most users had steep drop-offs in use of the app over time, as is the case with self-management apps more broadly [18], there was a subset of high-engagement users who reported that they incorporated the app as part of a daily routine and continued to use the app even a year later.”
BackgroundTaylor, K. M., Bradley, J., & Cella, M. (2022) · Psychology and Psychotherapy Theory Research and Practice · doi:10.1111/papt.12395 · Cited by 25
Lin, D. T. S., Nazreen, T., Rutowski, T., Lü, Y., Harati, A., Shriberg, E. E., Chlebek, P., & Aratow, M. (2022) · Frontiers in Psychology · doi:10.3389/fpsyg.2022.811517 · Cited by 29
“Daily use patterns show that usage peaked during evening hours for apps that incorporate tracker, psychoeducation and peer support, whereas usage was high during morning and nighttime for mindfulness/meditation apps (Baumel et al., 2019; Ng et al., 2019).”
BackgroundMoghimi, E., Knyahnytska, Y., Omrani, M., Nikjoo, N., Stephenson, C., Layzell, G., Simpson, A. I. F., & Alavi, N. (2022) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2022.921527 · Cited by 29
McCall, T., Threats, M., Pillai, M., Lakdawala, A., & Bolton, C. S. (2022) · Frontiers in Digital Health · doi:10.3389/fdgth.2022.1028408 · Cited by 27
“The inclusion of preferred content and features, such as group chat rooms for peer support, will help researchers and developers create apps that are both useful and “ sticky ” (23).”
BackgroundStade, E. C., Eichstaedt, J. C., Kim, J. P., & Wiltsey Stirman, S. (2025) · Technology, Mind, and Behavior · doi:10.1037/tmb0000163 · Cited by 23
Reyes, A. T. (2022) · Issues in Mental Health Nursing · doi:10.1080/01612840.2021.1953652 · Cited by 21
“…growth of mental health mobile apps in recent years, most mental health apps have not been empirically tested (Donker et al., 2013; Powell et al., 2014) and have been reported to have very low engagement and adherence rates (Baumel et al., 2019; Lipschitz et al., 2019; Torous et al., 2018).”
BackgroundResultMorton, E. E., Nicholas, J., Lapadat, L., O'Brien, H. L., Barnes, S. J., Poh, C., & Michalak, E. E. (2021) · Journal of Affective Disorders · doi:10.1016/j.jad.2021.08.132 · Cited by 28
O’Sullivan, S., Schmaal, L., D’Alfonso, S., Toenders, Y. J., Valentine, L., McEnery, C., Bendall, S., Nelson, B., Gleeson, J., & Álvarez‐Jiménez, M. (2022) · JMIR Mental Health · doi:10.2196/29211 · Cited by 24
“This is an important observation, as a recent systematic search indicated a 15-day retention rate of 3.9% and a 30-day retention rate of 3.3% for mental health apps [60]; in contrast, 40% (33/82) of the users in our study showed more sustained use over 155 days.”
BackgroundResultInfluentialBaumel, A. (2022) · Journal of Technology in Behavioral Science · doi:10.1007/s41347-022-00245-7 · Cited by 25
“…as the number of program logins, distinct days in which the program was accessed, longevity (number of days between the first and last login), screen time, user retention, and number of modules completed (e.g., Baumel & Kane, 2018; Baumel et al., 2019b; Miller et al., 2019; Rahman et al., 2017).”
BackgroundSelf-citationMcLean, C. P., Davis, C. A., Miller, M. L., Ruzek, J. I., & Neri, E. (2022) · JMIR mhealth and uhealth · doi:10.2196/38951 · Cited by 27
“Most apps show a steep reduction in usage after download, with only 1%-5% of users continuing to use the app after 30 days [26].”
BackgroundPozuelo, J. R., Moffett, B., Davis, M., Stein, A. L., Cohen, H., Craske, M. G., Maritze, M., Makhubela, P., Nabulumba, C., Sikoti, D., et al. (2023) · JMIR Formative Research · doi:10.2196/51423 · Cited by 25
“Many studies are characterized by low adherence and high attrition rates [23,24].”
BackgroundResultInfluentialTorous, J. B., & Vaidyam, A. N. (2020) · Epidemiology and Psychiatric Sciences · doi:10.1017/s2045796020000013 · Cited by 28
“The lack of engagement with individual mental health apps, with recent data suggesting a 4% daily open rate (Baumel et al., 2019), highlights the challenges for even those apps featured highly on the commercial marketplaces.”
BackgroundThe Guardians: Designing a Game for Long-term Engagement with Mental Health Therapy
Ferguson, C., Lewis, R., Wilks, C. R., & Picard, R. W. (2021) · IEEE Conference on Games (CoG) · doi:10.1109/cog52621.2021.9619026 · Cited by 26
“[2], with The Guardians showing an improvement of more than a factor of two over the median.”
BackgroundInfluentialEconomides, M., Bolton, H., Male, R., & Cavanagh, K. (2022) · JMIR Formative Research · doi:10.2196/34032 · Cited by 19
“Moreover, only a fraction of for-profit mental health apps (MHapps) are supported by empirical evidence [13], with added concerns that such platforms are frequently characterized by low adherence [14-16].”
Hiranandani, S., Ipek, S. I., Wilhelm, S., & Greenberg, J. L. (2023) · Journal of Obsessive-Compulsive and Related Disorders · doi:10.1016/j.jocrd.2022.100765 · Cited by 24
Metadata
- Authors
- Baumel, A., Muench, F., Edan, S., & Kane, J. M.
- Affiliations
- University of Haifa (IL)
- Partnership for Drug-Free Kids (US)
- Northwell Health (US)
- Corresponding author
- Baumel, Amit
- Venue
- Journal of Medical Internet Research
- Publisher
- JMIR Publications Inc.
- Published
- 2019-09-25
- Volume
- 21
- Issue
- 9
- Pages
- e14567
- ISSN
- 1438-8871 (ISSN-L)
- PMC
- PMC6785720
- OpenAlex
- W2963232155
- Semantic Scholar
- c418736e20066949b3576cdc92bdb942a3ac4ec5
- Cited by
- 965
- References
- 41
- Citations by year
- 2026: 198 · 2025: 203 · 2024: 140 · 2023: 130 · 2022: 121 · 2021: 110 · 2020: 60 · 2019: 2
- FWCI
- 82.95
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- Journal of Medical Internet Research (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
- Social Sciences › Sociology and Political Science › Impact of Technology on Adolescents
- Keywords
- mental health apps, user engagement, app usage patterns, user retention, anxiety, depression, emotional well-being, mobile health, screen time, Android application, Google Play Store
- MeSH terms
- Self-Management, Anxiety, Mental Disorders, Depression, Humans, Mental Health, Telemedicine, Mobile Applications
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.