Objective User Engagement With Mental Health Apps: Systematic Search and Panel-Based Usage Analysis
Open accessPublished version of a preprint
The DOI matches its Crossref record; 41 of the 41 references it cites were found in a registry or an index.
Abstract
Background: Understanding patterns of real-world usage of mental health apps is key to maximizing their potential to increase public self-management of care. Although developer-led studies have published results on the use of mental health apps in real-world settings, no study yet has systematically examined usage patterns of a large sample of mental health apps relying on independently collected data. Objective: Our aim is to present real-world objective data on user engagement with popular mental health apps. Methods: A systematic engine search was conducted using Google Play to identify Android apps with 10,000 installs or more targeting anxiety, depression, or emotional well-being. Coding of apps included primary incorporated techniques and mental health focus. Behavioral data on real-world usage were obtained from a panel that provides aggregated nonpersonal information on user engagement with mobile apps. Results: In total, 93 apps met the inclusion criteria (installs: median 100,000, IQR 90,000). The median percentage of daily active users (open rate) was 4.0% (IQR 4.7%) with a difference between trackers (median 6.3%, IQR 10.2%) and peer-support apps (median 17.0%) versus breathing exercise apps (median 1.6%, IQR 1.6%; all z≥3.42, all P<.001). Among active users, daily minutes of use were significantly higher for mindfulness/meditation (median 21.47, IQR 15.00) and peer support (median 35.08, n=2) apps than for apps incorporating other techniques (tracker, breathing exercise, psychoeducation: medians range 3.53-8.32; all z≥2.11, all P<.05). The medians of app 15-day and 30-day retention rates were 3.9% (IQR 10.3%) and 3.3% (IQR 6.2%), respectively. On day 30, peer support (median 8.9%, n=2), mindfulness/meditation (median 4.7%, IQR 6.2%), and tracker apps (median 6.1%, IQR 20.4%) had significantly higher retention rates than breathing exercise apps (median 0.0%, IQR 0.0%; all z≥2.18, all P≤.04). The pattern of daily use presented a descriptive peak toward the evening for apps incorporating most techniques (tracker, psychoeducation, and peer support) except mindfulness/meditation, which exhibited two peaks (morning and night). Conclusions: Although the number of app installs and daily active minutes of use may seem high, only a small portion of users actually used the apps for a long period of time. More studies using different datasets are needed to understand this phenomenon and the ways in which users self-manage their condition in real-world settings.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures





Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source doesn’t support the claim as written.
In the citing paper
“Participants’ engagement rates exceeded industry standards”
From A Digital Mental Health Intervention in an Orthopedic Setting for Patients With Symptoms of Depression and/or Anxiety: Feasibility Prospective Cohort Study (2022) · cites this paper as [40]
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“While this study design does not permit definitive causal attribution to the personalization component specifically, the observed patterns are consistent with conceptual frameworks, suggesting that content alignment with users’ cognitive-emotional profiles enhances engagement [8,34].”
From Schema-Informed Digital Mental Health Intervention for Maladaptive Cognitive-Emotional Patterns: Randomized Controlled Trial (2025) · cites this paper as [34]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“When accessed “in the wild,” the vast majority of DMHIs have had low engagement and high attrition (Baumel et al., 2019; Torous et al., 2020; Fleming et al., 2018).”
From A text messaging intervention to support the mental health of young adults: User engagement and feedback from a field trial of an intervention prototype (2023) · cites this paper as Baumel et al., 2019
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“such platforms are frequently characterized by low adherence [14-16]”
From Feasibility and Preliminary Efficacy of Web-Based and Mobile Interventions for Common Mental Health Problems in Working Adults: Multi-Arm Randomized Pilot Trial (2022) · cites this paper as [14]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“This parallels common definitions of engagement used for DMHIs (e.g., any daily app use) (Baumel et al., 2019), and other interactive messaging systems (Psihogios et al., 2019).”
From A text messaging intervention to support the mental health of young adults: User engagement and feedback from a field trial of an intervention prototype (2023) · cites this paper as Baumel et al., 2019
7 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Using thematic analysis in psychology
Braun, V., & Clarke, V. (2006) · Qualitative Research in Psychology · doi:10.1191/1478088706qp063oa · Cited by 194,414 · cited 2×
“components of mental health apps [27,30], drawing on the thematic analysis method suggested by Braun and Clarke [31].”
MethodEysenbach, G. (2005) · Journal of Medical Internet Research · doi:10.2196/jmir.7.1.e11 · Cited by 2,524 · cited 2×
“However, the impact of digital interventions is limited by their ability to engage users in therapeutic activities and to support user adherence to the therapeutic process [9,10].”
BackgroundA behavior model for persuasive design
Fogg, B. (2009) · Proceedings of the 4th International Conference on Persuasive Technology · doi:10.1145/1541948.1541999 · Cited by 2,328 · cited 1×
“Second, user retention patterns might also indicate the low burden associated with app installation (ie, the simplicity of opening the Google Play Store and clicking the app download and installation buttons), which implies that user context, motivation, and ability to engage [44] with these apps were not tested befor…”
BackgroundMobile app rating scale: a new tool for assessing the quality of health mobile apps
Stoyanov, S. R., Hides, L., Kavanagh, D. J., Zelenko, O., Tjondronegoro, D., & Mani, M. (2015) · JMIR mHealth and uHealth · doi:10.2196/mhealth.3422 · Cited by 2,233 · cited 1×
“Although there are some recommender websites [27,29,37] and approaches to help users identify the right apps [38-41], a therapeutic framework that provides guidance to users about how to use the right app at the right time could be useful.”
BackgroundSelf-regulation, ego depletion, and motivation
Baumeister, R. F., & Vohs, K. D. (2007) · Social and Personality Psychology Compass · doi:10.1111/j.1751-9004.2007.00001.x · Cited by 1,402
Adherence in Internet Interventions for Anxiety and Depression
Christensen, H., Griffiths, K. M., & Farrer, L. (2009) · Journal of Medical Internet Research · doi:10.2196/jmir.1194 · Cited by 1,133 · cited 2×
“These findings reflect the lower ranges of real-world retention rates reported in developer-led studies [17-20,22].”
BackgroundUnderstanding and Promoting Effective Engagement With Digital Behavior Change Interventions
Yardley, L., Spring, B. J., Riper, H., Morrison, L. G., Crane, D. H., Curtis, K., Merchant, G. C., Naughton, F., & Blandford, A. (2016) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2016.06.015 · Cited by 1,118 · cited 1×
“These patterns could be explained using the notion of effective engagement described by Yardley and colleagues [36], wherein there is “sufficient engagement with the intervention to achieve intended outcomes.”
BackgroundCollins, L. M., Murphy, S. A., & Strecher, V. (2007) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2007.01.022 · Cited by 1,082
Healthcare via Cell Phones: A Systematic Review
Krishna, S., Boren, S. A., & Balas, E. A. (2009) · Telemedicine and e-Health · doi:10.1089/tmj.2008.0099 · Cited by 882 · cited 1×
“The conversation has shifted from patients and providers to individuals who can now engage in self-care around the clock outside of traditional health care settings (eg, [1-3]).”
Background
Research works printed but not linked: 1
- 2001, The World Health Report 2001. Mental Health: New Understanding, New Hope
Cited by
Items 301–400 of 963
Spethmann, S., Hindricks, G., Köhler, K., Störk, S., Angermann, C. E., Böhm, M., Aßmus, B., Winkler, S., Möckel, M., Mittermaier, M., et al. (2024) · Journal of Medical Internet Research · doi:10.2196/63391 · Cited by 21
“However, it is recognized that long-term engagement with digital apps is achieved by only a small number of users; for instance, the 30-day retention rates for patients using mental health apps were only 3.3% [50].”
InfluentialConsumer-Grade Neurofeedback With Mindfulness Meditation: Meta-Analysis
Treves, I. N., Bajwa, Z., Greene, K. D., Bloom, P. A., Kim, N., Wool, E., Goldberg, S. B., Whitfield, S., & Auerbach, R. P. (2025) · Journal of Medical Internet Research · doi:10.2196/68204 · Cited by 18
“One reason may be lack of adherence [64,65].”
Viswanathan, S., Ibrahim, S. B., Shankar, R., Binns, R., Kleek, M. G. V., & Slovák, P. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3714088 · Cited by 26
“Real-world engagement data from 93 health apps indicate that while install rates are high, sustained user engagement remains low, with the median 15-and 30-day retention a mere 3.9% and 3.3% respectively [9].”
InfluentialGuinart, D., Sobolev, M., Patil, B., Walsh, M., & Kane, J. M. (2022) · JMIR Mental Health · doi:10.2196/37184 · Cited by 12
“Engagement remained high during the initial 2 weeks of the study and was stable afterward, improving generally reported mental health app engagement rates [39].”
BackgroundSelf-citationA New Approach to Enhancing Engagement in eHealth Apps
Oakley-Girvan, I. A., & Docherty, J. P. (2022) · Interactive Journal of Medical Research · doi:10.2196/38886 · Cited by 13
“Engagement tends to be highly variable and inconsistent [2-6], leading to problems in retention, data quality, and clinical impact [7,8].”
BackgroundMeyerhoff, J., Nguyen, T., Karr, C. J., Reddy, M. C., Williams, J. J., Bhattacharjee, A., Mohr, D. C., & Kornfield, R. (2022) · Procedia Computer Science · doi:10.1016/j.procs.2022.09.086 · Cited by 12
“Some estimates suggest that over 96% of users stop opening downloaded DMH apps within the first 15 days of installing them [23].”
BackgroundMental health in digital microsystems across three Asian Reddit communities
achuthan, K., Khobragade, S., Kowalski, R. M., & Raman, R. (2026) · Scientific Reports · doi:10.1038/s41598-025-30760-5 · Cited by 13
Kim, H. H., Kim, Y., Michaelides, A. P., & Park, Y. R. (2022) · Journal of Medical Internet Research · doi:10.2196/29380 · Cited by 11
“4% and that for mental health apps is 3%-8% [60-62].”
BackgroundKadirvelu, B., Bel, T. B., Wu, X., Burmester, V., Ananth, S., Branco, B. C. C. C., Serrano, B. G., Gledhill, J. A., Simplicio, M. C. D., Nicholls, D., et al. (2023) · JMIR Formative Research · doi:10.2196/44877 · Cited by 17
“The rates may be influenced by participants' awareness of being part of a research study, potentially leading to increased engagement compared to the naturalistic app user retention rate of 4% over a 15-day period [36,37].”
Persson, D. R., Zhukouskaya, K., Wegener, A.-M. K., Jørgensen, L. K., Bardram, J. E., & Bækgaard, P. (2023) · JMIR Formative Research · doi:10.2196/49738 · Cited by 11
“Many authors note that long-term engagement remains a key challenge in mHealth [14,46] and is reflected in the high attrition rates seen in many mHealth apps [13,14].”
BackgroundSánchez-Ortuño, M. M., Pécune, F., Coelho, J., Micoulaud‐Franchi, J., Salles, N., Auriacombe, M., Serre, F., Levavasseur, Y., de Sevin, É., Sagaspe, P., et al. (2023) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocad163 · Cited by 11
Guest, P. C., Vasilevska, V., Al-Hamadi, A. K., Eder, J., Falkai, P., & Steiner, J. (2023) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2023.1227426 · Cited by 21
Therapeutic Content of Mobile Phone Applications for Substance Use Disorders: An Umbrella Review
Oesterle, T., Hall‐Flavin, D. K., Bormann, N. L., Loukianova, L. L., Fipps, D. C., Breitinger, S. A., Gilliam, W. P., Wu, T. E., da Costa, S. C., Arndt, S. V., et al. (2024) · Mayo Clinic Proceedings Digital Health · doi:10.1016/j.mcpdig.2024.03.004 · Cited by 14
“This suggests that an evidence-based treatment paradigm must be incorporated for meaningful results.”
Gustafson, D. H., Mares, M., Johnston, D. C., Vjorn, O., Curtin, J. J., Landucci, G., Pe‐Romashko, K., Gustafson, D. H., & Shah, D. V. (2024) · JMIR Aging · doi:10.2196/59588 · Cited by 19
“[75].”
Rajeshkumar, L., Mishkind, M. C., Coleman, J. J., Pahwa, M., LaPreze, D., Solenske, S., & Wright, J. H. (2024) · Journal of Psychiatric Practice · doi:10.1097/pra.0000000000000815 · Cited by 15
“104 App creators therefore often incorporate features designed to keep their”
Cross, S. P. M., Mangelsdorf, S. N., Valentine, L., O’Sullivan, S., McEnery, C., Scott, I., Gilbertson, T., Louis, S., Myer, J., Liu, P., et al. (2025) · Internet Interventions · doi:10.1016/j.invent.2025.100849 · Cited by 18
“Approximately 38.7 % of users discontinue interventions prematurely (Etzelmueller et al., 2020), and only 3.3 % of users of popular commercial mental health app (with a median of 100,000 downloads) remain active after 30 days (Baumel et al., 2019).”
InfluentialCOVID-19 Is Straining Mental Health—Could Technology Be the Answer?
Allen, S. E. (2020) · IEEE Pulse · doi:10.1109/mpuls.2020.3008355 · Cited by 12
“9% of users used the apps for more than 15 days [8].”
BackgroundOpen trial of an adaptation of cognitive processing therapy for message-based delivery.
Stirman, S. W., Song, J., Hull, T. D., & Resick, P. A. (2021) · Technology Mind and Behavior · doi:10.1037/tmb0000016 · Cited by 14
“These findings are consistent with reviews that have identified challenges in maintaining engagement in other forms of digital mental health intervention (Baumel et al., 2019; Torous et al., 2018).”
BackgroundResultHoeppner, B. B., Siegel, K. R., Carlon, H. A., Kahler, C. W., Park, E. R., & Hoeppner, S. S. (2021) · JMIR Formative Research · doi:10.2196/29760 · Cited by 10
“Achieving high app use is currently a critical barrier that challenges the utility of publicly available apps, and a recent study on mental health apps found that <4% of app users used the app 15 days after installation in real-world settings [60].”
BackgroundHartley, M., Dorstyn, D., & Due, C. (2022) · Research in Autism · doi:10.1016/j.rasd.2022.101991 · Cited by 16
Teepe, G. W., Kowatsch, T., Hans, F. P., & Benning, L. (2023) · Journal of Medical Internet Research · doi:10.2196/43775 · Cited by 14
“Yet, this is not unexpected, as related work has also reported a significant decline in participation in digital health applications [28,29], and we consider it an adequate reflection of the current real-world pattern of use.”
BackgroundInfluentialVereschagin, M., Wang, A. Y., Leung, C., Richardson, C. G., Hudec, K. L., Doan, Q. H., Virk, P., Halli, P., Wojcik, K. D., Munro, L., et al. (2023) · Journal of Behavioral and Cognitive Therapy · doi:10.1016/j.jbct.2023.02.002 · Cited by 12
Carvalho, L. R., Haas, L. M., Zeni, G. D., Victor, M. M., Techele, S. P., Castanho, J. M., Coimbra, I. M., de Sousa, A. D. F., Ceretta, N., Guirado, A. G., et al. (2023) · European Psychiatry · doi:10.1192/j.eurpsy.2023.2422 · Cited by 17
Kranenburg, L. W., Gillis, J., Mayer, B., & Hoogendijk, W. J. G. (2021) · JMIR Mental Health · doi:10.2196/32123 · Cited by 12
“…contact between the research team and the respondents, one could say that our study results may be similar to what one might expect to find in a real-world user situation, where despite high levels of app download, only a small portion of users actually use the apps for a longer period [33,34].”
Acceptance of smart sensing: a barrier to implementation—results from a randomized controlled trial
Terhorst, Y., Weilbacher, N., Suda, C., Simon, L., Messner, E.-M., Sander, L. B., & Baumeister, H. (2023) · Frontiers in Digital Health · doi:10.3389/fdgth.2023.1075266 · Cited by 10
Sobolev, M., Anand, A., Dziak, J. J., Potter, L. N., Lam, C. Y., Wetter, D. W., & Nahum-Shani, I. B. (2023) · Frontiers in Digital Health · doi:10.3389/fdgth.2023.1144081 · Cited by 10
Schroeder, T., Seaman, K. L., Nguyen, A., Gewald, H., & Georgiou, A. (2023) · Studies in health technology and informatics · doi:10.3233/shti230376 · Cited by 10
Pine, R., Mbinta, J. F., Morenga, L. T., & Fleming, T. M. (2023) · JMIR Serious Games · doi:10.2196/46697 · Cited by 10
“For example, once a health app is downloaded, approximately 4% of users continue to use the app after 15 days [24].”
BackgroundMurray, A. L., Speyer, L. G., Thye, M. D., Stewart, T. M., Obsuth, I., Kane, J., Whyte, K., Devaney, J., Rohde, L. A., Ushakova, A., et al. (2023) · BMJ Open · doi:10.1136/bmjopen-2023-077222 · Cited by 15
Self-citationMeyerhoff, J., Beltzer, M., Popowski, S. A., Karr, C. J., Nguyen, T., Williams, J. J., Krause, C. J., Kumar, H., Bhattacharjee, A., Mohr, D. C., et al. (2023) · Journal of Affective Disorders · doi:10.1016/j.jad.2023.10.119 · Cited by 11
Self-Guided Mental Health Apps Targeting Racial and Ethnic Minority Groups: Scoping Review
Saad, F., Eisenstadt, M., Liverpool, S., Carlsson, C., & Vainieri, I. (2023) · JMIR Mental Health · doi:10.2196/48991 · Cited by 13
“Another major issue with MHAs is the level of user engagement because people rarely use MHAs as a long-term solution [18,19].”
BackgroundFunnell, E. L., Spadaro, B., Martin-Key, N. A., Benáček, J., & Bahn, S. (2024) · JMIR Formative Research · doi:10.2196/48881 · Cited by 13
“However, despite the interest in and promise of mental health apps, prolonged engagement and use remains an issue [24].”
BackgroundOoi, P. B., & Wilkinson, G. G. (2024) · British Journal of Guidance and Counselling · doi:10.1080/03069885.2024.2373180 · Cited by 14
“…lack of underpinning theoretical frameworks, limited evidence of effectiveness, poor rates of long-term client retention, and need for better training of counsellors as identified in a number of studies (e.g. Baumel et al., 2019; Marshall et al., 2020; Phillips et al., 2020; Weisel et al., 2019).”
Assessing Digital Phenotyping for App Recommendations and Sustained Engagement: Cohort Study
Dwyer, B., Flathers, M., Burns, J., Mikkelson, J., Perlmutter, E., Chen, K., Ram, N., & Torous, J. B. (2024) · JMIR Formative Research · doi:10.2196/62725 · Cited by 14
“A landmark 2019 study [5] of 93 mental health–related smartphone apps found that the median 15-day retention rate was 3.9%.”
InfluentialThe Western Australian medical schools mindfulness project: a randomised controlled trial
Moore, S., Mavaddat, N., Auret, K. A., Hassed, C. S., Chambers, R., Sinclair, C., Wilcox, H., & Ngo, H. (2024) · BMC Medical Education · doi:10.1186/s12909-024-06128-0 · Cited by 18
“However, it is important to note that on review of real-world objective data on user engagement with mental health apps, only a small percentage of users continue to use these apps for an extended period of time [6], high-lighting the need to investigate these limitations further.”
BackgroundSchwarz, J., Heinze, M., Scheunemann, K., Schönbeck, J., Schubert, D., Speck, J., Torous, J. B., Uchtmann, L., Wolff, J., & Meier-Diedrich, E. (2024) · Nervenheilkunde · doi:10.1055/a-2409-4731 · Cited by 13
Lo, B., Durocher, K., Charow, R., Kimball, S., Phạm, Q., Sockalingam, S., Wiljer, D., & Strudwick, G. (2025) · Journal of Medical Internet Research · doi:10.2196/67820 · Cited by 11
“As there are a growing number of studies looking at ways to address the ongoing challenges of user engagement [194-196], this work has contributed to a better understanding of the dynamics of, and contributors to, effective user engagement in a clinical environment across individual,…”
Nammas, M. (2025) · Cureus · doi:10.7759/cureus.85563 · Cited by 23
“This is particularly critical in the context of neuropsychiatric disorders, where treatment adherence and trust in therapy significantly impact outcomes [78].”
Schwarz, J., Chen, K., Dashti, H., Heinze, M., Schönbeck, J., Schubert, D., Senst, B., Speck, J., Torous, J. B., Wolff, J., et al. (2025) · JMIR Research Protocols · doi:10.2196/67655 · Cited by 14
“Furthermore, both HCPs and patients frequently perceive digital apps as inadequate for addressing mental health problems [23], and patients often do not adhere to the intended use and stop using the app after initial installation due to a lack of motivation [16,27].”
Spaargaren, K. L., Roke, Y., Begeer, S., van Straten, A., Riper, H. M., Greaves‐Lord, K., & Scheeren, A. M. (2025) · Autism · doi:10.1177/13623613251346885 · Cited by 11
“In real-world usage of mHealth, retention rates are only 4.1% and 6.3% for mindfulness/meditation and tracker apps, respectively (Baumel et al., 2019).”
InfluentialMcCallum, M., Ho, A. S., Mitchell, E. S., May, C. N., Behr, H., Ritschel, L. A., Mochrie, K. D., & Michaelides, A. P. (2022) · JMIR Formative Research · doi:10.2196/36794 · Cited by 13
“In reviews of mental health programs, researchers have voiced concerns about limited published research on commercial programs, and that programs either have limited public engagement or are not based on evidence-based theory [18,25-27,31,32].”
BackgroundDemystifying borderline personality disorder in primary care
Wu, T., Hu, J. J., Davydow, D. S., Huang, H., Spottswood, M., & Huang, H. Y. (2022) · Frontiers in Medicine · doi:10.3389/fmed.2022.1024022 · Cited by 12
“Additionally, recent studies have suggested that while app installation rates may be high, the majority of patients do not continue using apps for long periods of time, (99) calling into question whether there can be sustained improvements.”
BackgroundFeeling Moodie: Insights from a Usability Evaluation to Improve the Design of mHealth Apps
Chan, G., Alslaity, A., Wilson, R., & Orji, R. (2023) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2023.2241613 · Cited by 11
“For example, Baumel et al. (2019) reviewed the literature on user engagement with popular unguided mHealth apps and reported that although the daily active minutes of use seemed high, user retention was poor.”
Miller, M. L., Davis, A. C., & McLean, C. P. (2021) · Journal of Technology in Behavioral Science · doi:10.1007/s41347-020-00188-x · Cited by 10
Kim, H. H., Kim, Y., & Park, Y. R. (2021) · JMIR mhealth and uhealth · doi:10.2196/22183 · Cited by 11
Rafiei, R., Williams, C., Jiang, J., Aungst, T. D., Durrer, M., Tran, D., & Howald, R. (2021) · JMIR mhealth and uhealth · doi:10.2196/25406 · Cited by 15
“This connected DDCP can act as an adherence measure, allowing patients to keep a record of their medication use and share their data with their providers [40,41].”
BackgroundKoumpouros, Y. (2021) · International Conference on PErvasive Technologies Related to Assistive Environments (PETRA) · doi:10.1145/3453892.3461350 · Cited by 10
Smith, I. S., Wellecke, C., Weihs, K. L., Bei, B., & Wiley, J. F. (2021) · Psycho-Oncology · doi:10.1002/pon.5787 · Cited by 10
“mental health tools tends to drop substantially after a couple of weeks.(14,35) Considering that greater treatment adherence in both UP and other internet‐delivered protocols has been linked to lower attrition and favourable symptom outcomes,(36,37) it is important that subsequent research considers methods of monitor…”
BackgroundDitton, E., Knott, B., Hodyl, N., Horton, G., Walker, F. R., & Nilsson, M. (2023) · JMIR Formative Research · doi:10.2196/43263 · Cited by 9
“Maintaining individual participation in psychological health apps is a known problem generally, with real-world user engagement diminishing substantially within 2 to 4 weeks of sign-up [30].”
BackgroundLi, J., Yu, K., Bao, X., Liu, X., & Yao, J. (2021) · Journal of Medical Internet Research · doi:10.2196/29299 · Cited by 9
“The areas investigated include diabetes management [5,6], mental health management [7], pain management [8], and health information dissemination [9].”
Watt, M., Hyde, A. M., Spence, J. C., Wright, G. M., Well, S. V., Johnson, E., Mason, A. L., McLeod, M., & Tandon, P. (2023) · Canadian Liver Journal · doi:10.3138/canlivj-2022-0045 · Cited by 9
Nigam, A. C., & Chanda, R. S. (2024) · Emerald Group Publishing Limited eBooks · doi:10.1108/s1877-63612024000034b010 · Cited by 14
Moretti, F. A., Bortolini, T., Hartle, L., Moll, J., Mattos, P., Furtado, D. R., Fontenelle, L. F., & Fischer, R. D. (2024) · Frontiers in Digital Health · doi:10.3389/fdgth.2024.1383999 · Cited by 11
Designing for mental health in higher education: a collaborative approach to digital interventions
Severes, B., Barreto, M. L., & Esteves, A. (2024) · Behaviour and Information Technology · doi:10.1080/0144929x.2024.2436503 · Cited by 14
Pozuelo, J. R., Nabulumba, C., Sikoti, D., Davis, M., Gumikiriza‐Onoria, J. L., Kinyanda, E., Moffett, B., van Heerden, A. C., O’Mahen, H., Craske, M. G., et al. (2024) · JMIR Serious Games · doi:10.2196/59381 · Cited by 10
Ospina‐Pinillos, L., Shambo-Rodríguez, D. L., Sánchez-Nítola, M. N., Morales, A., Gallego-Sanchez, L. C., Riaño-Fonseca, M. I., Bello-Tocancipá, A. C., Navarro-Mancilla, Á. A., Pavlich‐Mariscal, J. A., Pomares, A., et al. (2025) · JMIR Human Factors · doi:10.2196/66558 · Cited by 17
“Second, even in countries where DHTs are readily available, retention of users and usability are still their main challenges, as it is reported that their use decreases throughout the trials, and most evaluations are limited to short periods [11-13].”
Pine, R., Morenga, L. T., Olson, M., & Fleming, T. M. (2021) · Digital Health · doi:10.1177/20552076211047802 · Cited by 8
Michalak, E. E., Barnes, S. J., Morton, E. E., O'Brien, H. L., Murray, G., Hole, R., & Meyer, D. (2022) · JMIR Research Protocols · doi:10.2196/36213 · Cited by 12
“Although human or peer support has been shown to enhance engagement with digital health interventions [44,45], this comes with a trade-off in terms of feasibility, particularly in terms of scale-up.”
BackgroundBossarte, R. M., Kessler, R. C., Nierenberg, A. A., Chattopadhyay, A., Cuijpers, P. J., Enrique, Á., Foxworth, P. M., Gildea, S. M., Belnap, B. H., Haut, M. W., et al. (2022) · Trials · doi:10.1186/s13063-022-06438-y · Cited by 9
“Strategies to improve adherence to the interventions {11c} i-CBT users often exhibit low levels of engagement, especially in disadvantaged populations [59].”
BackgroundCurrey, D., & Torous, J. B. (2022) · JMIR Research Protocols · doi:10.2196/37954 · Cited by 13
“One leading barrier has been a lack of engagement; many people quickly abandon apps after only a few days [5].”
A look under the hood: analyzing engagement and usage data of a smartphone-based intervention
Siezenga, A. M., Mertens, E. C. A., & van Gelder, J. (2023) · BMC Digital Health · doi:10.1186/s44247-023-00048-7 · Cited by 9
“Nevertheless, the FutureU app showed relatively high retention and exposure rates compared to other smartphone-based interventions (e.g., on average 3.9% of participants open an app intervention on day 15 [25] versus 60.5% of participants opening the FutureU app on day 15).”
MethodInfluentialMobile device use among inpatients on a psychiatric unit: A preliminary study
Aneni, K., & Rosenthal, M. Z. (2021) · Psychiatry Research · doi:10.1016/j.psychres.2021.113720 · Cited by 9
Anton, M. T., Greenberger, H. M., Andreopoulos, E., & Pande, R. L. (2021) · JMIR Formative Research · doi:10.2196/27570 · Cited by 11
“3% 30-day retention rate previously reported for other commercial mental health apps without human support, which is known to be key for improving engagement [46].”
BackgroundMilne‐Ives, M., Homer, S. R., Andrade, J., & Meinert, E. (2021) · JMIR Research Protocols · doi:10.2196/35172 · Cited by 14
“Studies on engagement with mobile health apps and wearable devices often observe poor long-term use [9,12,13] and high rates of attrition [8,14].”
BackgroundAddington, E. L., Cummings, P., Jackson, K., Yang, D., & Moskowitz, J. T. (2022) · Affective Science · doi:10.1007/s42761-022-00135-4 · Cited by 12
“Meta-analysis has shown that greater usage of DMHI, in both self-guided and facilitator/therapistguided formats, predicts better mental health outcomes (Gan et al., 2021).”
BackgroundResultInfluentialSerious Games and Gamification in Clinical Psychology
Fleming, T. M., Sutcliffe, K., Lucassen, M. F. G., Pine, R., & Donkin, L. (2020) · Elsevier eBooks · doi:10.1016/b978-0-12-818697-8.00011-x · Cited by 10
Torous, J. B., & Brady, R. O. (2020) · Bipolar Disorders · doi:10.1111/bdi.12928 · Cited by 9
Kumar, H., Yoo, S., Bernuy, A., Shi, J., Luo, H., Williams, J. J., Kuzminykh, A., Anderson, A., & Kornfield, R. (2024) · doi:10.2139/ssrn.4892998 · Cited by 9
Embaye, J., de Wit, M., & Snoek, F. J. (2024) · JMIR Diabetes · doi:10.2196/52923 · Cited by 8
“In traditional research settings (such as in the feasibility study) there is a higher chance of recruiting people who already are more likely to adhere to e–mental health interventions, than people in the general population who install and try available interventions “in the wild” [12,27].”
BackgroundMurray, A. L., Thye, M. D., Obsuth, I., Cai, S., Lui, M., Orr, C., & Saravanan, A. (2025) · JMIR Mental Health · doi:10.2196/56066 · Cited by 20
“One analysis of mental health app retention, for example, found a median 15-day retention rate of only 3.9% [101].”
InfluentialCharacteristic of mental health app usage: a cross-sectional survey in the general population
Fürtjes, S., Gebel, E., Kische, H., & Beesdo‐Baum, K. (2024) · BMC Public Health · doi:10.1186/s12889-024-20500-1 · Cited by 13
AlNajdi, S. M., Salem, M. A., & Elshaer, I. A. (2025) · Bioengineering · doi:10.3390/bioengineering12101095 · Cited by 12
Kumar, H., Yoo, S., Bernuy, A. Z., Shi, J., Luo, H., Williams, J. J., Kuzminykh, A., Anderson, A., & Kornfield, R. (2025) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3757619 · Cited by 28
“Studies have shown that consistent engagement in such self-directed mindfulness interventions can be challenging, and many participants do not complete the programs [13, 162, 190].”
Wanniarachchi, V. U., Greenhalgh, C., & Warren, J. (2025) · Internet Interventions · doi:10.1016/j.invent.2025.100884 · Cited by 14
“Engagement, which encompasses both the extent and quality of user interaction with the intervention, is essential for ensuring that users benefit from the intervention as intended (Baumel et al., 2019b).”
Prochaska, J. J., Vogel, E. A., Chieng, A., Baiocchi, M., Pajarito, S., Pirner, M., Darcy, A. M., & Robinson, A. H. (2023) · Contemporary Clinical Trials · doi:10.1016/j.cct.2023.107125 · Cited by 12
Huffman, L. G., Lawrence‐Sidebottom, D., Huberty, J., Beatty, C. C., Roots, M., Roots, K., Parikh, A., & Guerra, R. (2023) · JMIR Formative Research · doi:10.2196/49384 · Cited by 8
Lukka, L., Karhulahti, V., Bergman, V.-R., & Palva, J. M. (2024) · Internet Interventions · doi:10.1016/j.invent.2023.100706 · Cited by 14
“One study found that only 4 % of people who have a mental health app installed on their mobile phone open it on any given day, and only 3.3 % continued to use them after 30 days (Baumel et al., 2019).”
BackgroundInfluentialMilne‐Ives, M., Rahman, E., Bradwell, H. L., Baines, R., Boey, T., Potter, A., Lawrence, W. T., van Velthoven, M. H., & Meinert, E. (2024) · PLOS Digital Health · doi:10.1371/journal.pdig.0000481 · Cited by 11
“Mobile apps are a promising tool to support behaviour change because of their ubiquity [17–20], but their impact is commonly limited by low engagement [21–26].”
BackgroundMental health apps within the healthcare system: associations with stigma and mental health literacy
Fürtjes, S., Al-Assad, M., Kische, H., & Beesdo‐Baum, K. (2024) · Archives of Public Health · doi:10.1186/s13690-024-01362-w · Cited by 12
“This low quality might partly explain the high attrition numbers of typically over 90% after 10 days since download [6, 7].”
BackgroundVadhan, N. P., Padovano, H. T., Muench, F. J., Levak, S., & Allen, N. (2024) · Alcoholism Clinical and Experimental Research · doi:10.1111/acer.15414 · Cited by 9
Self-citationRecommender systems use in weight management mHealth interventions: A scoping review
Castro, B. A., Levens, S. M., Sullivan, M., & Shaw, G. (2024) · Obesity Reviews · doi:10.1111/obr.13863 · Cited by 12
User journey method: a case study for improving digital intervention use measurement
Lukka, L., Vesterinen, M., Salonen, A., Bergman, V.-R., Torkki, P. M., Palva, S., & Palva, J. M. (2025) · BMC Health Services Research · doi:10.1186/s12913-025-12641-9 · Cited by 9
A systematic quality rating of available mobile health apps for borderline personality disorder
Steubl, L., Reimann, J., Simon, L., Terhorst, Y., Stach, M., Baumeister, H., Sander, L., & Meßner, E.-M. (2022) · Borderline Personality Disorder and Emotion Dysregulation · doi:10.1186/s40479-022-00186-w · Cited by 12
“, personalization, real-time feedback [35, 36]; and the low adherence to MHAs in real-world treatment [37].”
BackgroundKazi, F. F., & Sandbulte, J. (2023) · Smart Health · doi:10.1016/j.smhl.2023.100385 · Cited by 12
Beyond counting clicks: rethinking engagement in digital mental health
Cipriani, A., Ward, T., Lambe, S., Ostinelli, E. G., Blease, C. R., Gant, T., Gold, S. M., Holmes, E. A., Paccoud, I., Vinnikova, A., et al. (2025) · The British Journal of Psychiatry · doi:10.1192/bjp.2025.10485 · Cited by 8
Persson, D. R., Bardram, J. E., & Bækgaard, P. (2024) · Digital Health · doi:10.1177/20552076241245583 · Cited by 10
“Resulting attrition across conditions reassemble the rate found by Baumel et al. 39 relating to real-world usage suggesting that although EFT may be a potentially bene fi - cial intervention a signi fi cant proportion of users are not interested or motivated on their own to engage with these long…”
BackgroundResultInfluentialKonishi, N., Oba, T., Takano, K., Katahira, K., & Kimura, K. (2024) · JMIR mhealth and uhealth · doi:10.2196/59708 · Cited by 9
“While this retention rate may seem high compared with the reported daily engagement rates for health care apps [30], it is comparable to the 60% active user engagement rate observed in a longitudinal study of a commercial PA app over 6 months [31].”
Zang, G. Y., Spira, A. P., Keqin, R. A. O., 吴, 菁., He, Y., Yi, T. A. N. G., & Leiyu, S. H. I. (2025) · Journal of Medical Internet Research · doi:10.2196/73689 · Cited by 10
“Currently, there is no universally accepted definition of DTx at the international level, however, DTx solutions commonly share key characteristics, including the use of high-quality software, rigorous evidence-based validation, and targeted therapeutic interventions [8,9].”
Baumel, A. (2025) · Frontiers in Digital Health · doi:10.3389/fdgth.2025.1541676 · Cited by 8
Self-citationMcCarren, L., & Kuoppamäki, S. (2025) · JMIR Human Factors · doi:10.2196/67533 · Cited by 10
“This underscores the need for apps to provide reminders or integrate seamlessly with users’ existing schedules to promote adherence and aligns with existing research highlighting that continuity in app use can be a challenge [40].”
Albers, N., Melo, F. S., Neerincx, M. A., Kudina, O., & Brinkman, W. (2025) · npj Digital Medicine · doi:10.1038/s41746-025-01701-3 · Cited by 8
Causal AI Recommendation System for Digital Mental Health: Bayesian Decision-Theoretic Analysis
Varidel, M., An, V., Hickie, I. B., Cripps, S., Marchant, R., Scott, J. L., Crouse, J. J., Poulsen, A., O’Dea, B., McKenna, S., et al. (2025) · Journal of Medical Internet Research · doi:10.2196/71305 · Cited by 12
Borghouts, J. W., Eikey, E. V., Leon, C. D., Schueller, S. M., Schneider, M. L., Stadnick, N. A., Zheng, K., Mukamel, D. B., & Sorkin, D. H. (2025) · JMIR Formative Research · doi:10.2196/73457 · Cited by 9
“While there is no gold standard on how to group frequency of use [30], past research has identified “active” users as individuals who use a mental health app daily [21], weekly or more [31], or monthly or more [32].”
Fleming, T. M., Lucassen, M. F. G., Frampton, C. M., Parag, V., Bullen, C., Merry, S., Shepherd, M., & Stasiak, K. (2025) · Journal of Medical Internet Research · doi:10.2196/66047 · Cited by 7
“Moreover, routinely collected internet traffic data indicates median retention in publicly available mental health app-based programs is less than a quarter of that for the same programs evaluated in trials [18].”
InfluentialElshaer, I. A., AlNajdi, S. M., & Salem, M. A. (2025) · Electronics · doi:10.3390/electronics14204036 · Cited by 15
Linardon, J., Torous, J. B., Messer, M., Liu, C., Bell, I., Nicholas, J. A., & Goldberg, S. B. (2025) · Psychiatry Research · doi:10.1016/j.psychres.2025.116864 · Cited by 11
“Engagement issues are even more pronounced in naturalistic settings, with seminal work indicating that 30-day retention rates for popular mental health apps can be as low as 3 %, and daily active user rates hover around just 4 % (Baumel et al., 2019).”
Conroy, D. E., Yang, C., Lanza, S. T., Smyth, J. M., & Lagoa, C. M. (2020) · JMIR mhealth and uhealth · doi:10.2196/14270 · Cited by 8
“A recent study of mobile apps for mental health indicated that users’ daily rate of opening the apps dropped by 80% in the first 10 days after initially installing and opening the app [10].”
BackgroundIdrees, A. R., Kraft, R., Pryss, R. C., Reichert, M., & Baumeister, H. (2021) · Procedia Computer Science · doi:10.1016/j.procs.2021.07.019 · Cited by 8
“Similar results have been reported for anxiety, depression, or well-being apps [4].”
ResultMessage-based psychotherapy for older adults: A cohort comparison study
Raue, P. J., Fridling, N., Song, J., Hull, T. D., Alexopoulos, G. S., & Areán, P. A. (2022) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2022.951354 · Cited by 9
Zeng, Z., Peng, J., Liu, L., & Gong, W. (2023) · Journal of Medical Internet Research · doi:10.2196/42777 · Cited by 7
“However, unlike platforms on the market where user engagement was one of the most important factors for their sustainability [16,17], the main reason why the platforms identified in our study were no longer available was the termination of the research project.”
Metadata
- Authors
- Baumel, A., Muench, F., Edan, S., & Kane, J. M.
- Affiliations
- University of Haifa (IL)
- Partnership for Drug-Free Kids (US)
- Northwell Health (US)
- Corresponding author
- Baumel, Amit
- Venue
- Journal of Medical Internet Research
- Publisher
- JMIR Publications Inc.
- Published
- 2019-09-25
- Volume
- 21
- Issue
- 9
- Pages
- e14567
- ISSN
- 1438-8871 (ISSN-L)
- PMC
- PMC6785720
- OpenAlex
- W2963232155
- Semantic Scholar
- c418736e20066949b3576cdc92bdb942a3ac4ec5
- Cited by
- 965
- References
- 41
- Citations by year
- 2026: 198 · 2025: 203 · 2024: 140 · 2023: 130 · 2022: 121 · 2021: 110 · 2020: 60 · 2019: 2
- FWCI
- 82.95
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- Journal of Medical Internet Research (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
- Social Sciences › Sociology and Political Science › Impact of Technology on Adolescents
- Keywords
- mental health apps, user engagement, app usage patterns, user retention, anxiety, depression, emotional well-being, mobile health, screen time, Android application, Google Play Store
- MeSH terms
- Self-Management, Anxiety, Mental Disorders, Depression, Humans, Mental Health, Telemedicine, Mobile Applications
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.