Objective User Engagement With Mental Health Apps: Systematic Search and Panel-Based Usage Analysis
Open accessPublished version of a preprint
The DOI matches its Crossref record; 41 of the 41 references it cites were found in a registry or an index.
Abstract
Background: Understanding patterns of real-world usage of mental health apps is key to maximizing their potential to increase public self-management of care. Although developer-led studies have published results on the use of mental health apps in real-world settings, no study yet has systematically examined usage patterns of a large sample of mental health apps relying on independently collected data. Objective: Our aim is to present real-world objective data on user engagement with popular mental health apps. Methods: A systematic engine search was conducted using Google Play to identify Android apps with 10,000 installs or more targeting anxiety, depression, or emotional well-being. Coding of apps included primary incorporated techniques and mental health focus. Behavioral data on real-world usage were obtained from a panel that provides aggregated nonpersonal information on user engagement with mobile apps. Results: In total, 93 apps met the inclusion criteria (installs: median 100,000, IQR 90,000). The median percentage of daily active users (open rate) was 4.0% (IQR 4.7%) with a difference between trackers (median 6.3%, IQR 10.2%) and peer-support apps (median 17.0%) versus breathing exercise apps (median 1.6%, IQR 1.6%; all z≥3.42, all P<.001). Among active users, daily minutes of use were significantly higher for mindfulness/meditation (median 21.47, IQR 15.00) and peer support (median 35.08, n=2) apps than for apps incorporating other techniques (tracker, breathing exercise, psychoeducation: medians range 3.53-8.32; all z≥2.11, all P<.05). The medians of app 15-day and 30-day retention rates were 3.9% (IQR 10.3%) and 3.3% (IQR 6.2%), respectively. On day 30, peer support (median 8.9%, n=2), mindfulness/meditation (median 4.7%, IQR 6.2%), and tracker apps (median 6.1%, IQR 20.4%) had significantly higher retention rates than breathing exercise apps (median 0.0%, IQR 0.0%; all z≥2.18, all P≤.04). The pattern of daily use presented a descriptive peak toward the evening for apps incorporating most techniques (tracker, psychoeducation, and peer support) except mindfulness/meditation, which exhibited two peaks (morning and night). Conclusions: Although the number of app installs and daily active minutes of use may seem high, only a small portion of users actually used the apps for a long period of time. More studies using different datasets are needed to understand this phenomenon and the ways in which users self-manage their condition in real-world settings.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures





Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source doesn’t support the claim as written.
In the citing paper
“Participants’ engagement rates exceeded industry standards”
From A Digital Mental Health Intervention in an Orthopedic Setting for Patients With Symptoms of Depression and/or Anxiety: Feasibility Prospective Cohort Study (2022) · cites this paper as [40]
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“While this study design does not permit definitive causal attribution to the personalization component specifically, the observed patterns are consistent with conceptual frameworks, suggesting that content alignment with users’ cognitive-emotional profiles enhances engagement [8,34].”
From Schema-Informed Digital Mental Health Intervention for Maladaptive Cognitive-Emotional Patterns: Randomized Controlled Trial (2025) · cites this paper as [34]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“When accessed “in the wild,” the vast majority of DMHIs have had low engagement and high attrition (Baumel et al., 2019; Torous et al., 2020; Fleming et al., 2018).”
From A text messaging intervention to support the mental health of young adults: User engagement and feedback from a field trial of an intervention prototype (2023) · cites this paper as Baumel et al., 2019
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“such platforms are frequently characterized by low adherence [14-16]”
From Feasibility and Preliminary Efficacy of Web-Based and Mobile Interventions for Common Mental Health Problems in Working Adults: Multi-Arm Randomized Pilot Trial (2022) · cites this paper as [14]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“This parallels common definitions of engagement used for DMHIs (e.g., any daily app use) (Baumel et al., 2019), and other interactive messaging systems (Psihogios et al., 2019).”
From A text messaging intervention to support the mental health of young adults: User engagement and feedback from a field trial of an intervention prototype (2023) · cites this paper as Baumel et al., 2019
7 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Using thematic analysis in psychology
Braun, V., & Clarke, V. (2006) · Qualitative Research in Psychology · doi:10.1191/1478088706qp063oa · Cited by 194,414 · cited 2×
“components of mental health apps [27,30], drawing on the thematic analysis method suggested by Braun and Clarke [31].”
MethodEysenbach, G. (2005) · Journal of Medical Internet Research · doi:10.2196/jmir.7.1.e11 · Cited by 2,524 · cited 2×
“However, the impact of digital interventions is limited by their ability to engage users in therapeutic activities and to support user adherence to the therapeutic process [9,10].”
BackgroundA behavior model for persuasive design
Fogg, B. (2009) · Proceedings of the 4th International Conference on Persuasive Technology · doi:10.1145/1541948.1541999 · Cited by 2,328 · cited 1×
“Second, user retention patterns might also indicate the low burden associated with app installation (ie, the simplicity of opening the Google Play Store and clicking the app download and installation buttons), which implies that user context, motivation, and ability to engage [44] with these apps were not tested befor…”
BackgroundMobile app rating scale: a new tool for assessing the quality of health mobile apps
Stoyanov, S. R., Hides, L., Kavanagh, D. J., Zelenko, O., Tjondronegoro, D., & Mani, M. (2015) · JMIR mHealth and uHealth · doi:10.2196/mhealth.3422 · Cited by 2,233 · cited 1×
“Although there are some recommender websites [27,29,37] and approaches to help users identify the right apps [38-41], a therapeutic framework that provides guidance to users about how to use the right app at the right time could be useful.”
BackgroundSelf-regulation, ego depletion, and motivation
Baumeister, R. F., & Vohs, K. D. (2007) · Social and Personality Psychology Compass · doi:10.1111/j.1751-9004.2007.00001.x · Cited by 1,402
Adherence in Internet Interventions for Anxiety and Depression
Christensen, H., Griffiths, K. M., & Farrer, L. (2009) · Journal of Medical Internet Research · doi:10.2196/jmir.1194 · Cited by 1,133 · cited 2×
“These findings reflect the lower ranges of real-world retention rates reported in developer-led studies [17-20,22].”
BackgroundUnderstanding and Promoting Effective Engagement With Digital Behavior Change Interventions
Yardley, L., Spring, B. J., Riper, H., Morrison, L. G., Crane, D. H., Curtis, K., Merchant, G. C., Naughton, F., & Blandford, A. (2016) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2016.06.015 · Cited by 1,118 · cited 1×
“These patterns could be explained using the notion of effective engagement described by Yardley and colleagues [36], wherein there is “sufficient engagement with the intervention to achieve intended outcomes.”
BackgroundCollins, L. M., Murphy, S. A., & Strecher, V. (2007) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2007.01.022 · Cited by 1,082
Healthcare via Cell Phones: A Systematic Review
Krishna, S., Boren, S. A., & Balas, E. A. (2009) · Telemedicine and e-Health · doi:10.1089/tmj.2008.0099 · Cited by 882 · cited 1×
“The conversation has shifted from patients and providers to individuals who can now engage in self-care around the clock outside of traditional health care settings (eg, [1-3]).”
Background
Research works printed but not linked: 1
- 2001, The World Health Report 2001. Mental Health: New Understanding, New Hope
Cited by
Items 201–300 of 963
François, J., Audrain‐Pontevia, A., Boudhraâ, S., & Vial, S. (2023) · Journal of Medical Internet Research · doi:10.2196/48182 · Cited by 29
Lee, M., Kang, D., Kim, S., Lim, J., Yoon, J., Kim, Y., Shim, S., Kang, E., Ahn, J. S., Cho, J., et al. (2021) · Supportive Care in Cancer · doi:10.1007/s00520-021-06473-6 · Cited by 25
“However, a real-world study regarding mHealth app usage reported that more than 80% of mHealth app users stopped using the app between days 1 and 10 [55].”
BackgroundHuffman, L. G., Lawrence‐Sidebottom, D., Huberty, J., Roots, M., Roots, K., Parikh, A., Guerra, R., & Weiser, J. (2023) · JMIR Pediatrics and Parenting · doi:10.2196/46154 · Cited by 23
“The majority of DMHIs do not include human interaction, and thus, low patient engagement, high rates of dropout, and negligible improvements in symptoms remain the pressing issues [15,16].”
BackgroundAn exploratory analysis of the effect size of the mobile mental health Application, mindLAMP
Chang, S. M., Alon, N., & Torous, J. B. (2023) · Digital Health · doi:10.1177/20552076231187244 · Cited by 20
Vial, S., Boudhraâ, S., Dumont, M., Tremblay, M., & Riendeau, S. (2023) · JMIR Research Protocols · doi:10.2196/47220 · Cited by 25
“However, there are few examples of successful implementation [2], and 2 systematic reviews reveal that few users are using mental health apps for a long period of time [4,5].”
BackgroundCalvert, E., Cipriani, M., Chen, K., Dhima, A., Burns, J., & Torous, J. B. (2025) · Journal of Affective Disorders · doi:10.1016/j.jad.2025.02.051 · Cited by 22
Kornfield, R., Mohr, D. C., Ranney, R. M., Lattie, E. G., Meyerhoff, J., Williams, J. J., & Reddy, M. C. (2022) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3512946 · Cited by 21
“The DMH community increasingly recognizes the importance of designing tools that can sustain engagement [15,75].”
BackgroundInfluentialIglesias, M., Sinha, C., Vempati, R., Grace, S. E., Roy, M., Chapman, W. C., & Rinaldi, M. L. (2022) · Journal of Occupational and Environmental Medicine · doi:10.1097/jom.0000000000002762 · Cited by 27
May, C. N., Cox‐Martin, M., Ho, A. S., McCallum, M., Chan, C., Blessing, K., Behr, H., Blanco, P., Mitchell, E. S., & Michaelides, A. P. (2023) · Obesity Science & Practice · doi:10.1002/osp4.666 · Cited by 25
Cohen, A., Joshi, D., Bondre, A. P., Chand, P., Chaturvedi, N., Choudhary, S., Dutt, S., Khan, A., Langholm, C., Kumar, M., et al. (2024) · PLOS Digital Health · doi:10.1371/journal.pdig.0000526 · Cited by 20
“[31] suggesting the gamified nature of these tasks may encourage relatively high rates of use.”
BackgroundShkel, J., Green, G., Le, S., Kaveladze, B., Marcotte, V., Rushton, K., Nguyen, T., & Schueller, S. M. (2023) · JMIR Formative Research · doi:10.2196/46062 · Cited by 10
“Although engagement has been noted as a challenge in DMHI research and development [18,19], it is worth noting that mental health interventions overall often experience suboptimal engagement, as many patients drop out before receiving a full course of treatment [20,21].”
BackgroundMcAlister, K. L., Baez, L. M., Huberty, J., & Kerppola, M. (2025) · JMIR Formative Research · doi:10.2196/72469 · Cited by 44
“Importantly, 47% of users were still active after 2 months— this level of usage is much greater than metrics described in other publicly available mental health applications where users drop to only 4% of the initial sample after 2 weeks [39].”
Murphy, J. K., Michalak, E. E., Liu, J., Colquhoun, H., Burton, H., Yang, X., Yang, T., Wang, X., Fei, Y., He, Y., et al. (2021) · BMC Psychiatry · doi:10.1186/s12888-021-03442-5 · Cited by 19
Lukic, Y. X., Klein, S., Brügger, V., Keller, O. C., Fleisch, E., & Kowatsch, T. (2021) · JMIR Serious Games · doi:10.2196/22803 · Cited by 15
“It has been shown that breathing training apps have very low long-term adherence, even though the number of installations is high [18].”
BackgroundGarety, P. A., Ward, T., Emsley, R., Greenwood, K., Freeman, D. H., Fowler, D. G., Kuipers, E., Bebbington, P., Dunn, G., & Hardy, A. (2021) · Efficacy and Mechanism Evaluation · doi:10.3310/eme08110 · Cited by 23
Tandon, P., Purdy, G. M., Ismond, K. P., Cruz, C., Etruw, E., Suderman, K., Hyde, A. M., Stickland, M. K., Spence, J. C., Lien, D. C., et al. (2022) · Contemporary Clinical Trials · doi:10.1016/j.cct.2022.106791 · Cited by 22
Yang, Y. J., & Chung, K. (2022) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-022-05617-9 · Cited by 23
“Among diverse formats in TBI programs, those with mobile devices have been most actively pursued in the recent years (Baumel et al., 2019), possibly thanks to the rapid and widespread use of these devices.”
BackgroundZhang, X., Lewis, S. W., Xu, C., Berry, N., & Bucci, S. (2022) · Internet Interventions · doi:10.1016/j.invent.2022.100576 · Cited by 19
“Low engagement in digital tools has been reported by many digital mental health studies (Torous et al., 2020a; Wu et al., 2021), with a median percentage of daily active users (i.e. opening a mental health app) of only 4.0 % (Baumel et al., 2019).”
InfluentialAn Integrative Engagement Model of Digital Psychotherapy: Exploratory Focus Group Findings
Zech, J. M., Johnson, M., Pullmann, M. D., Hull, T. D., Althoff, T., Munson, S. A., Fridling, N., Litvin, B., Wu, J., & Areán, P. A. (2023) · JMIR Formative Research · doi:10.2196/41428 · Cited by 20
“Less than 30% of self-guided DMH consumers use services for 90 days, and the average engagement is 2 to 4 weeks, with most consumers discontinuing self-guided apps within hours of initial use [24-26].”
Gustafson, D. H., Landucci, G., Vjorn, O., Gicquelais, R. E., Goldberg, S. B., Johnston, D. C., Curtin, J. J., Bailey, G. L., Shah, D. V., Pe‐Romashko, K., et al. (2023) · American Journal of Psychiatry · doi:10.1176/appi.ajp.20230055 · Cited by 20
Eberle, J. W., Daniel, K. E., Baee, S., Silverman, A. L., Lewis, E., Baglione, A. N., Werntz, A. J., French, N. J., Ji, J. L., Hohensee, N., et al. (2024) · Journal of Consulting and Clinical Psychology · doi:10.1037/ccp0000896 · Cited by 25
Powell, A. C., & Torous, J. B. (2020) · JMIR Mental Health · doi:10.2196/18812 · Cited by 22
“A recent study examined real-world data on app use to conclude that only 4% of users actually engage with apps meaningfully after 15 days [16], suggesting that few people receive an adequate “dose” of apps.”
BackgroundThe meditation app revolution.
Creswell, J. D., & Goldberg, S. B. (2025) · American Psychologist · doi:10.1037/amp0001576 · Cited by 18
“Only 4.7% of initial users continue to use digital meditation apps after 30 days, with some estimates suggesting that the average lifetime use of a meditation app is between 1–4 sessions (Baumel et al., 2019; Lam et al., 2023).”
InfluentialDuffecy, J. L., Rehman, A., Gorman, S. N., Huang, Y., & Klumpp, H. (2025) · JMIR mhealth and uhealth · doi:10.2196/58204 · Cited by 26
“A 2019 study examining mental health apps with similar components to Caria (mindfulness, peer support, and tracking) found 30-day retention rates of only 3.3% [63].”
InfluentialPoort, H., Ryan, A. K., MacDougall, K., Malinowski, P. K., MacDonald, A., Markin, Z., Pirl, W. F., Greer, J. A., & Fasciano, K. M. (2021) · Journal of Medical Internet Research · doi:10.2196/25069 · Cited by 18
“portion of users using the apps for a long period [35,36].”
BackgroundJesuthasan, J., Low, M., & Ong, T. (2022) · Frontiers in Digital Health · doi:10.3389/fdgth.2022.846375 · Cited by 23
“To account for low retention rates in digital health interventions (17, 43), engagement metrics were only analyzed for the period of the program during which at least 50% of the participants were still active in the app (i.”
BackgroundComparing Professional and Consumer Ratings of Mental Health Apps: Mixed Methods Study
Hudson, G., Negbenose, E., Neary, M., Jansli, S. M., Schueller, S. M., Wykes, T., & Jilka, S. (2022) · JMIR Formative Research · doi:10.2196/39813 · Cited by 21
Xie, E. B., Freeman, M., Penner‐Goeke, L., Reynolds, K., Lebel, C. A., Giesbrecht, G. F., Rioux, C., MacKinnon, A., Sauer-Zavala, S. E., Roos, L. E., et al. (2023) · Pilot and Feasibility Studies · doi:10.1186/s40814-023-01245-x · Cited by 32
“However, according to systematic review findings, there is often a lack of social support in apps that target individual mental health [45].”
BackgroundWhite, J. S., Salem, M. K., Toussaert, S., Westmaas, J. L., Raiff, B. R., Crane, D., Warrender, E., Lyles, C. R., Abroms, L. C., & Thrul, J. (2023) · JMIR Serious Games · doi:10.2196/46602 · Cited by 25
“Overall, <5% of users actively use a downloaded mHealth app daily, and <5% of users continue to use the app after 10 days [11].”
BackgroundGoetz, G., Jeindl, R., Пантели, Д., Busse, R., & Wild, C. (2023) · Health Policy and Technology · doi:10.1016/j.hlpt.2023.100780 · Cited by 18
Buelens, F., Luyten, P., Claeys, H., Assche, E. V., & Daele, T. V. (2023) · Internet Interventions · doi:10.1016/j.invent.2023.100670 · Cited by 18
“The high levels of early dropout and the steep decline in usage in the self-help modality also reflect earlier findings regarding high dropout and low adherence in non-selected online self-help interventions (Baumel et al., 2019; Linardon and Fuller-Tyszkiewicz, 2019).”
ResultAI-Enabled Mental Health Assessment and Intervention: Bridging Gaps in Access and Quality of Care.
Balasubramanian, S. (2023) · Power System Technology · doi:10.52783/pst.159 · Cited by 24
“[19] Early identification of risk factors allows for timely intervention, preventing the escalation of issues and enabling the development of proactive care plans.”
BackgroundJaso, B. A., Eyllon, M., Sah, P., Pennine, M., Welch, G., Schuler, K. L., Orth, L., O’Dea, H., Rogers, E., Murillo, L., et al. (2024) · Internet Interventions · doi:10.1016/j.invent.2024.100777 · Cited by 19
“A recent meta-analysis showed that post-registration, there is low sustained engagement in DMHIs in the real world, with 3.9 % median retention rates at 15 days post-registration and 3.3 % at 30 days (Baumel et al., 2019).”
BackgroundInfluentialFleming, T. M., Lucassen, M. F. G., Stasiak, K., Sutcliffe, K., & Merry, S. (2021) · Child and Adolescent Mental Health · doi:10.1111/camh.12444 · Cited by 17
García-Estela, A., Cantillo, J., Angarita‐Osorio, N., Mur-Milà, E., Anmella, G., Pérez, V., Vieta, E., Hidalgo‐Mazzei, D., & Colom, F. (2022) · Journal of Medical Internet Research · doi:10.2196/31565 · Cited by 24
“However, there is a general tendency among mental health apps toward low retention and engagement rates [32,47].”
Aschbacher, K., Rivera, L. M., Hornstein, S., Nelson, B. W., Forman‐Hoffman, V. L., & Peiper, N. C. (2023) · Psychosomatic Medicine · doi:10.1097/psy.0000000000001230 · Cited by 20
“Because DMHIs have the potential to improve population-level mental health in a highly scalable and cost-effective fashion, there is an urgent need for studies that determine an optimal dose-response relationship between engagement and outcomes, which potentially underlies the real-world effectiveness of DMHIs (17,18).”
BackgroundYoun, S. J., Jaso, B. A., Eyllon, M., Sah, P., Hoyler, G. H., Barnes, J. B., Jarama, K., Murillo, L., O’Dea, H., Orth, L., et al. (2023) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-023-01292-9 · Cited by 18
“Even if the initial registration hurdle identified above is addressed, the median retention rate of digital therapeutics at 15 days is 3.9% (Baumel et al., 2019), which highlights continued usage problems with this direct to consumer approach.”
InfluentialBaumel, A., Brandes, O., Brendryen, H., Muench, F. J., Kane, J. M., & Saar, C. R. (2023) · Internet Interventions · doi:10.1016/j.invent.2023.100680 · Cited by 21
“One of the main recognizable challenges in the digital health interventions field is that users poorly adhere to digital programs in their unguided format, without added human-support (e.g., (Baumel et al., 2019a; Fleming et al., 2018)).”
BackgroundSelf-citationWilhelm, S., Bernstein, E. E., Bentley, K. H., Snorrason, Í., Hoeppner, S. S., Klare, D. L., Greenberg, J. L., Weingarden, H. M., McCoy, T. H., & Harrison, O. (2024) · JMIR Mental Health · doi:10.2196/53998 · Cited by 18
“The majority of apps, even those that are grounded in empirically supported treatments, have high dropout rates, which limits their effectiveness [14-16].”
BackgroundFitzsimmons‐Craft, E. E., Rackoff, G. N., Shah, J., Strayhorn, J. C., D’Adamo, L., DePietro, B., Howe, C. P., Firebaugh, M., Newman, M. G., Collins, L. M., et al. (2024) · International Journal of Eating Disorders · doi:10.1002/eat.24260 · Cited by 22
Patra, E., Κοκκινοπούλου, Ά., Wilson-Barnes, S., Hart, K. H., Gymnopoulos, L. P., Tsatsou, D., Solachidis, V., Dimitropoulos, K., Rouskas, K., Argiriou, A., et al. (2024) · Life · doi:10.3390/life14101238 · Cited by 23
“In addition, studies examining user engagement found that as few as 3.9% of participants used the mHealth apps for >15 days [8].”
BackgroundInfluentialMacrynikola, N., Chen, K., Lane, E., Nguyen, N. S., Pinto, J., Yen, S., & Torous, J. B. (2024) · JMIR Mental Health · doi:10.2196/65222 · Cited by 22
“Despite demonstrating efficacy in reducing depression and anxiety in randomized controlled trials (RCTs) [11], many stand-alone mental health apps fail to sustain engagement after just 10 days in real-world settings [12].”
Serlachius, A., Schache, K., Boggiss, A., Lim, D., Wallace-Boyd, K., Brenton-Peters, J., Buttenshaw, E., Chadd, S., Cavadino, A., Cao, N., et al. (2020) · JMIR Research Protocols · doi:10.2196/23716 · Cited by 17
“9% of people who downloaded these apps used them for a median of 15 days [47], and another review of 10 self-help interventions for anxiety and depression found that only 0.”
BackgroundSourander, A., Ristkari, T., Kurki, M., Gilbert, S., Hinkka‐Yli‐Salomäki, S., Kinnunen, M., Pulkki-Råbäck, L., & McGrath, P. J. (2021) · Journal of Medical Internet Research · doi:10.2196/27900 · Cited by 23
“In general, high dropout rates in digital interventions have been especially associated with nonguided interventions [43,51-54].”
BackgroundShih, C. W., Pudipeddi, R., Uthayakumar, A., & Washington, P. Y. (2021) · JMIRx Med · doi:10.2196/24972 · Cited by 16
Davies, J. N., Colagiuri, B., Sharpe, L., & Day, M. A. (2023) · Pain · doi:10.1097/j.pain.0000000000002928 · Cited by 17
Mindfulness in education: Critical debates and pragmatic considerations
Lee, W. W. K., McCaw, C. T., & Dam, N. T. V. (2024) · British Educational Research Journal · doi:10.1002/berj.3998 · Cited by 32
Cabreira, V., Wilkinson, T., Frostholm, L., Stone, J., & Carson, A. J. (2024) · npj Digital Medicine · doi:10.1038/s41746-024-01280-9 · Cited by 18
“Asdatashowsthat30-dayretentionrateswithremote interventionsaregenerallylow 35 , perhaps shorter interventions can be applied with a focus on upgrading patient engagement and retention, both of which are key determinants of treatment success.”
BackgroundMontgomery, R. M., Boucher, E. M., Honomichl, R. D., Powell, T. A., Guyton, S. L., Bernecker, S. L., Stoeckl, S. E., & Parks, A. C. (2021) · JMIR Cardio · doi:10.2196/32351 · Cited by 19
“Unfortunately, this is a widespread issue, as the majority of open-access, digital mental health interventions are plagued by low usage and retention rates, with the median app losing 97% of its users within 30 days [110].”
BackgroundLewis, R., Ferguson, C., Wilks, C. R., Jones, N. C., & Picard, R. W. (2022) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3491101.3519840 · Cited by 24
“2%) at 15 days and 30 days after installation, respectively [6].”
BackgroundHoepper, B. B., Siegel, K. R., Carlon, H. A., Kahler, C. W., Park, E. R., Taylor, S. T., Simpson, H. V., & Hoeppner, S. S. (2022) · JMIR Formative Research · doi:10.2196/38234 · Cited by 15
“It has been estimated that less than 5% of apps continue to be used 15 to 30 days after the initial app download [4].”
BackgroundHearn, J. H., Finlay, K. A., & Sheffield, D. (2021) · British Journal of Health Psychology · doi:10.1111/bjhp.12462 · Cited by 15
“However, apps may not provide detailed information and supportive networks that face-to-face courses do (Birtwell et al., 2019), which may contribute to disappointment experienced in those unable to access face-to-face support.”
BackgroundResultInfluentialJeon, H., Yoon, S., Lee, K., Kim, S. H., Kim, E. H., Cho, S., Ko, Y., Yang, S., Dabbish, L., Zimmerman, J., et al. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3714206 · Cited by 36
“As a result, this process may be cognitively demanding for young adults to execute independently, particularly without professional guidance, which may hinder sustained engagement over time [9, 30].”
Rothman, B., Slomkowski, M., Speier, A., Rush, A. J., Trivedi, M. H., Lakhan, S. E., Lawson, E., Fahmy, M., Carpenter, D., Chen, D., et al. (2025) · Journal of Affective Disorders · doi:10.1016/j.jad.2025.119409 · Cited by 18
Bhattacharjee, A., Xu, S. Y., Rao, P., Zeng, Y., Meyerhoff, J., Ahmed, S. I., Mohr, D. C., Liut, M., Mariakakis, A. T., Kornfield, R., et al. (2025) · Designing Interactive Systems Conference · doi:10.1145/3715336.3735810 · Cited by 27
“We also noticed that relatability was often cited as a key factor enhancing the impact of the LLM stories within our study, underscoring the importance of tailoring DMH content to individual contexts [11, 17, 40].”
Eiselt, A.-K., Kirkendall, S., Xiong, E., Langner, D., & Goldfarb, M. B. (2026) · Frontiers in Digital Health · doi:10.3389/fdgth.2025.1713334 · Cited by 21
“Assessments of adherence are extremely inconsistent and show as low as 6% average adherence rates after 30 days (46), with generally lower adherence in real-world use cases compared to research studies (22, 56).”
InfluentialPetracca, F., Tempre, R., Cucciniello, M., Ciani, O., Pompeo, E., Sannino, L., Lovato, V., Castaman, G., Ghirardini, A., & Tarricone, R. (2021) · JMIR Formative Research · doi:10.2196/25071 · Cited by 20
“User engagement and the continuous app use are persisting challenges in mHealth app implementation [17], with poor user retention being observed in the real world [18,19].”
BackgroundAssessing engagement features in an observational study of mental health apps in college students
Melcher, J., Patel, S. K., Scheuer, L., Hays, R., & Torous, J. B. (2022) · Psychiatry Research · doi:10.1016/j.psychres.2022.114470 · Cited by 14
Roesler, A., Butten, K., Calyx, C., Holmes‐Truscott, E., & Taylor, P. J. (2023) · Nutrients · doi:10.3390/nu15153304 · Cited by 17
“Studies in the general population have reported limited to no engagement [15], acceptability [16], or effectiveness [17] with health apps, while some studies in women—including during GDM—have demonstrated that health apps improved treatment uptake, self-awareness, and self-management [18,19].”
BackgroundWilliams, A. J., Freed, M., Theofanopoulou, N., Roquet, C. D., Klasnja, P., Gross, J. J., Schleider, J. L., & Slovák, P. (2023) · JMIR Mental Health · doi:10.2196/46826 · Cited by 23
“This is surprising as prior research shows that engagement with digital interventions tends to drop off markedly over time [18,53,54], and ongoing engagement is a key challenge in traditional therapeutic approaches [55].”
Schafer, M., Lachman, J. M., Gardner, F. E. M., Zinser, P., Calderón, F., Han, Q., Facciolà, C., & Clements, L. (2023) · BMC Public Health · doi:10.1186/s12889-023-16649-w · Cited by 21
“Similarly, numerous studies have also found for digital interventions with optional or unguided components, it is not uncommon for users to exit the intervention before engaging with all of the programme material [76].”
BackgroundYoon, S., Goh, H., Low, X. C., Weng, J. H., & Heaukulani, C. (2024) · BMJ Health & Care Informatics · doi:10.1136/bmjhci-2024-101045 · Cited by 22
Fitzpatrick, S., Crenshaw, A. O., Donkin, V., Collins, A., Xiang, A., Earle, E. A., Goenka, K., Varma, S., Bushe, J., McFadden, T., et al. (2024) · Journal of Medical Internet Research · doi:10.2196/58198 · Cited by 13
“Indeed, the median retention rates for Android self-help DMHI apps after 15 and 30 days is between 3% and 4% [46], suggesting that participants may be less likely to engage in longer interventions, especially in self-paced contexts where progress is not consistently monitored as it is in research…”
Jin, S., Kim, B., & Han, K. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713732 · Cited by 28
“However, our review shows that most apps still highly struggle with low user retention rates once they are released [21, 38, 57, 65, 79, 85, 115, 122, 124, 195].”
Smartphones within Psychological Science
Ellis, D. A. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108671408 · Cited by 15
Catania, J., Beaver, S., Kamath, R. S., Worthington, E., Lu, M., Gandhi, H., Waters, H. C., & Malone, D. C. (2024) · JMIR Mental Health · doi:10.2196/57401 · Cited by 26
“Engagement may be a key consideration for app developers, as app user retention can be low: 1 study showed that >90% of users had abandoned free MH apps within 30 days of installation [41].”
BackgroundDropping the E: The potential for integrating e-mental health in psychotherapy
Daele, T. V., Best, P., Bernaerts, S., Assche, E. V., & Witte, N. A. J. D. (2021) · Current Opinion in Psychology · doi:10.1016/j.copsyc.2021.02.007 · Cited by 15
“Especially high drop-out appears to be a continuing issue [13].”
BackgroundHoefer, M. J. D., Kleunen, L. V., Goodby, C., Blackburn, L. B., Panati, P., & Voida, S. (2021) · Designing Interactive Systems Conference · doi:10.1145/3461778.3461995 · Cited by 21
“Let’s talk about that”’ (Clinician 7).”
BackgroundAntunes, E., Alcaire, R., & Amaral, I. (2022) · Social Sciences · doi:10.3390/socsci12010003 · Cited by 17
Examining young adults daily perspectives on usage of anxiety apps: A user study
Balaskas, A., Schueller, S. M., Cox, A. L., Rashleigh, C., & Doherty, G. J. (2023) · PLOS Digital Health · doi:10.1371/journal.pdig.0000185 · Cited by 21
“Even though the number of app installs may seem high, apps are not often used daily nor for a long period of time [31,32], with evidence suggesting that most mental health apps are rarely used after being downloaded and only opened a few times [33].”
Werntz, A. J., Jasman, M., Simeon, K. M., Gunasekaran, H., Yowell, C. M., & Rhodes, J. E. (2023) · Journal of Technology in Behavioral Science · doi:10.1007/s41347-023-00303-8 · Cited by 17
“Despite this potential, uptake to such resources remains low (Baumel et al., 2019; Stiles-Shields et al., 2017) or inconsistent across platforms (Lattie et al., 2016), limiting the overall impact.”
BackgroundMair, J. L., Castro, Ó., Salamanca-Sanabria, A., Frese, B. F., von Wangenheim, F., Tai, E. S., Kowatsch, T., & Müller‐Riemenschneider, F. (2023) · BMC Public Health · doi:10.1186/s12889-023-15598-8 · Cited by 18
Bravata, D. M., Kim, J., Russell, D. W., Goldman, R., & Pace, E. M. (2023) · JMIR Formative Research · doi:10.2196/48864 · Cited by 21
“This is significantly higher compared to digital community–driven applications, which on average have a 19% retention rate after 90 days, and mental health apps which, on average, have a 3% retention rate after 30 days [54,55].”
BackgroundSchläpfer, S., Schneider, F., Santhanam, P., Eicher, M., Kowatsch, T., Witt, C. M., & Barth, J. (2024) · JMIR Cancer · doi:10.2196/52386 · Cited by 14
“These high use rates contrast with the generally low engagement with mHealth apps reported for individuals with other health conditions [2,10,11,13-15] and suggest that people with cancer might be particularly inclined to improve their health and change certain health behaviors through mHealth apps.”
ResultBilingual children reach early language milestones at the same age as monolingual peers
Muszyńska, K., Krajewski, G., Dynak, A., Garmann, N. G., Romøren, A. S. H., Łuniewska, M., Alcock, K., Katsos, N., Kołak, J., Simonsen, H. G., et al. (2025) · Journal of Child Language · doi:10.1017/s0305000924000655 · Cited by 31
“Some studies have shown 15-day and 30-day retention rates as low as 3 – 4% (Baumel et al., 2019).”
Bowles, N. I., Davies, J. N., Strohmaier, S., Galante, J., & Van Dam, N. T. (2026) · Journal of Contemplative Studies · doi:10.57010/caxs3076 · Cited by 14
Pardes, A. M., Lynch, W., Miclette, M., McGeoch, E., & Daly, B. P. (2021) · Innovations in Digital Health Diagnostics and Biomarkers · doi:10.36401/iddb-21-03 · Cited by 14
“Retention rates vary amongst technologies because there are no standardized measures;([47]) however, preliminary results from mobile health (mHealth) technology developed by Happify found a retention of 20% based on users completing a second PHQ-9 after 8 weeks.”
BackgroundBowles, N. I., & Van Dam, N. T. (2025) · Applied Psychology: Health and Well-Being · doi:10.1111/aphw.70063 · Cited by 14
“The study authors note that these results should be interpreted with caution due to a high risk of bias, and we would add that concerns with attrition in app-based mindfulness programs may undermine their effectiveness (see e.g., Baumel et al., 2019).”
Torous, J. B., Ledley, K. T., Gorban, C., Strudwick, G., Schwarz, J., Choudhary, S., Emerson, M. R., Patriquin, M. A., Dempsey, A. G., Bantjes, J. R., et al. (2025) · JMIR Mental Health · doi:10.2196/84501 · Cited by 22
“These challenges are not new, and landmark research by Bamul et al in 2019 [11] demonstrated that user engagement with mental health apps is negligible after 1 week.”
Newby, J. M., Gupta, S., Hoon, L., Zheng, W. Y., Whitton, A. E., Huckvale, K., Stech, E. P., Mackinnon, A. J., Senadeera, M., Shvetcov, A., et al. (2025) · JAMA Network Open · doi:10.1001/jamanetworkopen.2025.40502 · Cited by 19
A Paradigm Shift in Progress: Generative AI’s Evolving Role in Mental Health Care
Torous, J. B., & Cipriani, A. (2025) · JMIR Mental Health · doi:10.2196/82369 · Cited by 15
“Mental health apps have gained notoriety for low rates of patient engagement, and clinicians’ uptake of these apps has been equally disappointing [4,5].”
Eating disorders early app use mediates treatment effect on clinical improvement
Kim, J. P., Sadeh‐Sharvit, S., Welch, H. A., Neri, E., Tregarthen, J., & Lock, J. (2021) · International Journal of Eating Disorders · doi:10.1002/eat.23652 · Cited by 13
Stanger, S. B., & Lucas, S. J. (2022) · Teaching of Psychology · doi:10.1177/00986283221084005 · Cited by 18
“With more time, students could evaluate which apps held their attention across multiple weeks — a consideration that came up often in both course content on attrition of app use (Baumel et al., 2019) and in student discussions of their app evaluation experiences.”
BackgroundMinen, M. T., George, A., Camacho, E., Yao, L., Sahu, A., Campbell, M. C., Soviero, M., Hossain, Q., Verma, D., & Torous, J. B. (2022) · JMIR mhealth and uhealth · doi:10.2196/36761 · Cited by 13
“Clinical studies do not often feature a valid control condition or simulate the challenges of real-world app engagement, which is frequently low [27].”
BackgroundNaturalistic Evaluation of HeadGear: A Smartphone App to Reduce Depressive Symptoms in Workers.
Deady, M., Collins, D., Glozier, N., Gardiner, E., Arena, A. F. A., Gayed, A., Bryant, R., Calvo, R., & Harvey, S. (2024) · The Behavior Therapist · doi:10.1016/j.beth.2024.01.001 · Cited by 11
Digital health interventions for schizophrenia: Setting standards for mental health
Torous, J. B., Smith, K., Hardy, A., Vinnikova, A., Blease, C., Milligan, L., Hidalgo‐Mazzei, D., Lambe, S., Marzano, L., Uhlhaas, P. J., et al. (2024) · Schizophrenia Research · doi:10.1016/j.schres.2024.04.013 · Cited by 13
Designing personalized mental health interventions for anxiety: CBT therapists’ perspective
Balaskas, A., Schueller, S. M., Doherty, K., Cox, A. L., & Doherty, G. J. (2024) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2024.103319 · Cited by 17
“However, the adoption of these tools remains relatively low, with users frequently expressing dissatisfaction due to the lack of personalization, which is a significant factor leading to disengagement from these applications (Huckvale et al., 2020; Baumel et al., 2019).”
Goldberg, S. B., Kendall, A. D., Hirshberg, M. J., Dahl, C. J., Nahum-Shani, I. B., Davidson, R. J., & Bray, B. C. (2024) · Clinical Psychological Science · doi:10.1177/21677026241266567 · Cited by 16
“Low adherence has been widely observed across app-based interventions, including meditation apps, both in naturalistic settings (Baumel et al., 2019) and RCTs (Linardon & Fuller-Tyszkiewicz, 2020).”
Nordberg, S. S., Jaso, B. A., Sah, P., Schuler, K. L., Eyllon, M., Pennine, M., Hoyler, G. H., Barnes, J. B., Murillo, L., O’Dea, H., et al. (2024) · Journal of Medical Internet Research · doi:10.2196/54528 · Cited by 19
Health Information Technology Resources to Support Measurement-Based Care
Torous, J. B., Powell, A. C., & Rodriguez-Villa, E. (2020) · Child and Adolescent Psychiatric Clinics of North America · doi:10.1016/j.chc.2020.06.011 · Cited by 11
Fortuna, K. L., Wright, A. C., Mois, G., Myers, A. L., Kadakia, A., & Collins-Pisano, C. (2022) · Psychiatric Quarterly · doi:10.1007/s11126-022-09986-3 · Cited by 13
“A recent systematic review examined features of apps and their impact on engagement [20] and found that live (not automatic or artificial) peer support had the highest engagement (17%) compared to other features (i.”
BackgroundSzinay, D., Perski, O., Jones, A., Chadborn, T., Brown, J., & Naughton, F. (2021) · doi:10.32388/ie9k0n · Cited by 14
“Despite the promise of health apps, engagement tends to be poor [16,17].”
BackgroundEditorial: Factors influencing user engagement with digital mental health interventions
Borghouts, J., Pretorius, C., Ayobi, A., Abdullah, S., & Eikey, E. V. (2023) · Frontiers in Digital Health · doi:10.3389/fdgth.2023.1197301 · Cited by 12
Collier, A. F., Hagemann, S., Trinidad, S. B., & Vigil-Hayes, M. (2023) · JMIR Formative Research · doi:10.2196/44926 · Cited by 16
“While Baumel and colleagues’ [13] definitions of engagement were operationalized based on evidence-based strategies, their scale lacked rigorous definitions, especially regarding how interactivity was specifically manifested in behavioral health mHealth apps.”
BackgroundKIOS : A smartphone app for self‐monitoring for patients with bipolar disorder
Pahwa, M., McElroy, S. L., Priesmeyer, H. R., Siegel, G., Siegel, P., Nuss, S., Bowden, C. L., & El‐Mallakh, R. S. (2023) · Bipolar Disorders · doi:10.1111/bdi.13362 · Cited by 15
App-based meditation habits maintain reductions in depression symptoms among autistic adults
Stecher, C. D., Pagni, B. A., Cloonan, S., Vink, S., Hill, E., Ogbeama, D., Delaney, S., & Braden, B. B. (2023) · Autism · doi:10.1177/13623613231200679 · Cited by 14
“Even outside of intervention settings, many existing commercial mobile health apps report a sharp decline in user engagement following initiation, with one study reporting median 15-and 30-day app retention rates of 3.9% and 3.3%, respectively (Baumel et al., 2019; Vaghefi & Tulu, 2019).”
BackgroundInfluentialPredicting early user churn in a public digital weight loss intervention
Jakob, R., Lepper, N., Fleisch, E., & Kowatsch, T. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642321 · Cited by 21
“A majority of the research predicts churn after the initial week of app usage, a period when many users might have already discontinued use with some studies even excluding users who churn within the first few weeks [4, 62].”
BackgroundDoorn, K. A. (2024) · Counselling and Psychotherapy Research · doi:10.1002/capr.12800 · Cited by 16
Schaab, B. L., Cunha, L. F., Silveira, D. C., da Silva, P. C., Ballejos, K. G., Diaz, G. B., Kaiser, V., Calvetti, P. Ü., Cazella, S. C., Barros, H. M. T., et al. (2024) · Frontiers in Psychology · doi:10.3389/fpsyg.2024.1414948 · Cited by 18
White, J. S., Toussaert, S., Raiff, B. R., Salem, M. K., Chiang, A. Y., Crane, D., Warrender, E., Lyles, C. R., Abroms, L. C., Westmaas, J. L., et al. (2024) · Journal of Medical Internet Research · doi:10.2196/57839 · Cited by 15
Metadata
- Authors
- Baumel, A., Muench, F., Edan, S., & Kane, J. M.
- Affiliations
- University of Haifa (IL)
- Partnership for Drug-Free Kids (US)
- Northwell Health (US)
- Corresponding author
- Baumel, Amit
- Venue
- Journal of Medical Internet Research
- Publisher
- JMIR Publications Inc.
- Published
- 2019-09-25
- Volume
- 21
- Issue
- 9
- Pages
- e14567
- ISSN
- 1438-8871 (ISSN-L)
- PMC
- PMC6785720
- OpenAlex
- W2963232155
- Semantic Scholar
- c418736e20066949b3576cdc92bdb942a3ac4ec5
- Cited by
- 965
- References
- 41
- Citations by year
- 2026: 198 · 2025: 203 · 2024: 140 · 2023: 130 · 2022: 121 · 2021: 110 · 2020: 60 · 2019: 2
- FWCI
- 82.95
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- Journal of Medical Internet Research (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
- Social Sciences › Sociology and Political Science › Impact of Technology on Adolescents
- Keywords
- mental health apps, user engagement, app usage patterns, user retention, anxiety, depression, emotional well-being, mobile health, screen time, Android application, Google Play Store
- MeSH terms
- Self-Management, Anxiety, Mental Disorders, Depression, Humans, Mental Health, Telemedicine, Mobile Applications
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.