Challenges in Participant Engagement and Retention Using Mobile Health Apps: Literature Review
Open accessPublished version of a preprint
The DOI matches its Crossref record; 74 of the 74 references it cites were found in a registry or an index.
Abstract
Background: Mobile health (mHealth) apps are revolutionizing the way clinicians and researchers monitor and manage the health of their participants. However, many studies using mHealth apps are hampered by substantial participant dropout or attrition, which may impact the representativeness of the sample and the effectiveness of the study. Therefore, it is imperative for researchers to understand what makes participants stay with mHealth apps or studies using mHealth apps. Objective: This study aimed to review the current peer-reviewed research literature to identify the notable factors and strategies used in adult participant engagement and retention. Methods: We conducted a systematic search of PubMed, MEDLINE, and PsycINFO databases for mHealth studies that evaluated and assessed issues or strategies to improve the engagement and retention of adults from 2015 to 2020. We followed the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines. Notable themes were identified and narratively compared among different studies. A binomial regression model was generated to examine the factors affecting retention. Results: Of the 389 identified studies, 62 (15.9%) were included in this review. Overall, most studies were partially successful in maintaining participant engagement. Factors related to particular elements of the app (eg, feedback, appropriate reminders, and in-app support from peers or coaches) and research strategies (eg, compensation and niche samples) that promote retention were identified. Factors that obstructed retention were also identified (eg, lack of support features, technical difficulties, and usefulness of the app). The regression model results showed that a participant is more likely to drop out than to be retained. Conclusions: Retaining participants is an omnipresent challenge in mHealth studies. The insights from this review can help inform future studies about the factors and strategies to improve participant retention.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Finally, several recent reviews have explored variables related to user engagement with DMHIs [8,9,18].”
From Digital Mental Health Interventions for Depression: Scoping Review of User Engagement (2022) · cites this paper as [18]
In the citing paper
“For example, study dropout or study attrition has been evaluated as a proxy for treatment dropout, with findings suggesting significant dropout [16-18].”
From Digital Mental Health Interventions for Depression: Scoping Review of User Engagement (2022) · cites this paper as [18]
In the citing paper
“This is evidenced by the low dropout rate of participants who enrolled in the study, which is an indicator of high levels of acceptance [45].”
From Implementation of a web-based resilience enhancement training for nurses: pilot randomized controlled trial (2023) · cites this paper as [45]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: the PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & for the PRISMA Group (2009) · BMJ · doi:10.1136/bmj.b2535 · Cited by 83,823
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & The PRISMA Group (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000097 · Cited by 64,042 · cited 1×
“Our methodology was guided by the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) statement [14].”
Wang, G., Ma, R., Qiao, G., Wada, K., Aizawa, Y., & Satoh, T. (2015) · Integrative Medicine International · doi:10.1159/000368408 · Cited by 18,657
Saturation in qualitative research: exploring its conceptualization and operationalization
Saunders, B., Sim, J., Kingstone, T., Baker, S., Waterfield, J., Bartlam, B., Burroughs, H., & Jinks, C. (2018) · Quality & Quantity · doi:10.1007/s11135-017-0574-8 · Cited by 12,033 · cited 1×
“We reached saturation when we could no longer identify new themes during the analysis, a process Saunders et al [16] considered inductive thematic saturation.”
MethodUsability Evaluation In Industry
(1996) · CRC Press eBooks · doi:10.1201/9781498710411 · Cited by 4,354
Mays, N., Pope, C., & Popay, J. (2005) · Journal of Health Services Research & Policy · doi:10.1258/1355819054308576 · Cited by 1,375
Torous, J., Lipschitz, J., Ng, M., & Firth, J. (2020) · Journal of Affective Disorders · doi:10.1016/j.jad.2019.11.167 · Cited by 546 · cited 1×
“Thus, it is impossible to extrapolate their findings to other mHealth apps that are not in the same subfield [11-13].”
BackgroundHuberty, J., Green, J., Glissmann, C., Larkey, L., Puzia, M., & Lee, C. (2019) · JMIR mHealth and uHealth · doi:10.2196/14273 · Cited by 488 · cited 1×
“Refer to Figure 1 for the study selection flowchart and Multimedia Appendix 1 [4-8,17-73] for characteristics of the studies.”
BackgroundPratap, A., Neto, E. C., Snyder, P., Stepnowsky, C., Elhadad, N., Grant, D., Mohebbi, M. H., Mooney, S., Suver, C., Wilbanks, J., et al. (2020) · npj Digital Medicine · doi:10.1038/s41746-020-0224-8 · Cited by 410 · cited 4×
“In their cross-study evaluation of 100,000 participants, Pratap et al [10] analyzed individual-level study app use data from 8 studies that accumulated nearly 3.”
InfluentialThe Use and Effectiveness of Mobile Apps for Depression: Results From a Fully Remote Clinical Trial
Arean, P. A., Hallgren, K. A., Jordan, J. T., Gazzaley, A., Atkins, D. C., Heagerty, P. J., & Anguera, J. A. (2016) · Journal of Medical Internet Research · doi:10.2196/jmir.6482 · Cited by 376
Cited by
The Metaverse: A New Challenge for the Healthcare System: A Scoping Review
Petrigna, L., & Musumeci, G. (2022) · Journal of Functional Morphology and Kinesiology · doi:10.3390/jfmk7030063 · Cited by 222
“Indeed, through real-time monitoring, the possibility of being part of an online community and being guided by experts around the world increases the possibility of attending fitness programs and adopting a healthy lifestyle [27].”
BackgroundDigital Mental Health Interventions for Depression: Scoping Review of User Engagement
Lipschitz, J. M., Van Boxtel, R., Torous, J., Firth, J., Lebovitz, J. G., Burdick, K. E., & Hogan, T. P. (2022) · Journal of Medical Internet Research · doi:10.2196/39204 · Cited by 105
“Finally, several recent reviews have explored variables related to user engagement with DMHIs [8,9,18].”
Park, D. Y., & Kim, H. (2023) · Sustainability · doi:10.3390/su15010872 · Cited by 150
“…use, there is the need for longitudinal research that assesses a relationship between intentions to use the content and continuous use, as well as factors—such as peer and coach support [112], incentives and reminders [113], and personalized content [114]—that might moderate the relationship.”
BackgroundWang, H., Zhang, J., Luximon, Y., Qin, M., Geng, P., & Tao, D. (2022) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph191710758 · Cited by 98
“Similarly, a recent literature review on users’ engagement and retention of mobile health apps [11] showed that retaining the users of MMPs was really challenging and many barriers (e.”
BackgroundOkolo, C. A., Babawarun, O., Arowoogun, J. O., Adeniyi, A. O., & Chidi, R. (2024) · International Journal of Science and Research Archive · doi:10.30574/ijsra.2024.11.1.0334 · Cited by 113
“Incentives can also be social in nature, such as allowing users to share their achievements with friends and family on social media (Amagai, et. al., 2022, Brower, et. al., 2020, Mahmood, et. al., 2019).”
BackgroundMetaverse: the future of medicine in a virtual world
Sánchez, C. M. C., León, L. A. G., Yanes, R. C. A., & Oloriz, M. A. G. (2022) · Metaverse Basic and Applied Research · doi:10.56294/mr20224 · Cited by 55
Peuters, C., Maenhout, L., Cardon, G., Paepe, A. L. D., DeSmet, A., Lauwerier, E., Leta, K., & Crombez, G. (2024) · BMC Public Health · doi:10.1186/s12889-023-17260-9 · Cited by 66
“0 (PROMIS-PedDepSx) [53], showing good psychometric properties [54].”
BackgroundMair, J. L., Hashim, J., Thai, L., Tai, E. S., Ryan, J. C., Kowatsch, T., Müller‐Riemenschneider, F., & Edney, S. M. (2025) · Translational Behavioral Medicine · doi:10.1093/tbm/ibaf010 · Cited by 56
“Research indicates that while initial uptake may be high, usage often declines sharply, possibly due to loss of motivation, lack of personalization, and poor user experience [7–9].”
Promises and Perils of Consumer Mobile Technologies in Cardiovascular Care
Varma, N., Han, J. K., PASSMAN, R. S., Rosman, L., Ghanbari, H., Noseworthy, P. A., Silva, J. N. A., Deshmukh, A. J., Sanders, P., Hindricks, G., et al. (2024) · Journal of the American College of Cardiology · doi:10.1016/j.jacc.2023.11.024 · Cited by 55
A Comprehensive Picture of Factors Affecting User Willingness to Use Mobile Health Applications
Fan, S., Jain, R. C., & Kankanhalli, M. S. (2024) · ACM Transactions on Computing for Healthcare · doi:10.1145/3626962 · Cited by 40
“Firstly, people’s decisions to use mobile health apps are influenced by various factors that may not be directly related to their health status [6, 70].”
BackgroundHenshall, C., Davey, Z., Srikesavan, C., Hart, L., Butcher, D., & Cipriani, A. (2023) · Journal of Medical Internet Research · doi:10.2196/43771 · Cited by 38
Ho, T. Q. A., Le, L. K.-D., Engel, L., Le, N., Melvin, G., Le, H. N. D., & Mihalopoulos, C. (2025) · European Child & Adolescent Psychiatry · doi:10.1007/s00787-024-02386-x · Cited by 38
“[16].”
Shrestha, R., Altice, F. L., Khati, A., Azwa, I., Gautam, K., Gupta, S., Sullivan, P. S., Ni, Z., Kamarulzaman, A., Phiphatkhunarnon, P., et al. (2023) · JMIR mhealth and uhealth · doi:10.2196/44468 · Cited by 37
“Prior research has documented low user retention and a lack of sustained use after adoption as key challenges to the effectiveness of existing app-based interventions [49].”
BackgroundWhen and Why Adults Abandon Lifestyle Behavior and Mental Health Mobile Apps: Scoping Review
Kidman, P. G., Curtis, R., Watson, A., & Maher, C. A. (2024) · Journal of Medical Internet Research · doi:10.2196/56897 · Cited by 55
“Two 2022 systematic reviews, by Jakob et al [16], and Amagai et al [14] examined the factors influencing health app adherence and engagement.”
InfluentialAydın, A., Gürsoy, A., & Karal, H. (2023) · Discover Oncology · doi:10.1007/s12672-023-00676-5 · Cited by 57
“Mobile apps have been observed to be used in various categories including mental health, rare diseases, disease tracking, women’s health, and infectious diseases [16, 17].”
BackgroundDissemination Strategies for mHealth Apps: Systematic Review
Moungui, H. C., Nana-Djeunga, H. C., Anyiang, C. F., Cano, M., Ruiz-Postigo, J. A., & Carrión, C. (2023) · JMIR mhealth and uhealth · doi:10.2196/50293 · Cited by 42
“All these factors are among those reported by a literature review that identified retention factors related to apps, such as feedback, appropriate reminders, and in-app support from peers or coaches [33].”
BackgroundPerspective: A Conceptual Framework for Adaptive Personalized Nutrition Advice Systems (APNASs)
Renner, B., Buyken, A. E., Gedrich, K., Lorkowski, S., Watzl, B., Linseisen, J., Daniel, H., Conrad, J., Ferrario, P. G., Holzapfel, C., et al. (2023) · Advances in Nutrition · doi:10.1016/j.advnut.2023.06.009 · Cited by 42
“…and goals) and across applications or platforms (e.g., usability, technical issues, and costs) and the environment(e.g.,socialin fl uenceorcontext[97,98];seealsothe affect – integration – motivation and attention – context – translation AIM-ACT model for in-the-moment engagement in digital…”
Kwan, Y. H., Ong, Z. Q., Choo, D. Y. X., Phang, J. K., Yoon, S., & Low, L. L. (2023) · Patient Preference and Adherence · doi:10.2147/ppa.s386456 · Cited by 41
“However, low engagement with the apps may hamper users from reaping the benefits of the mobile apps.(20,21) Having users to participate in the design process may result in a higher level of empowerment and engagement,(22) which would assist mobile health (mHealth) apps in effectively supporting T2DM patients.”
BackgroundSchwarz, A. F., Winkens, L. H. H., de Vet, E., Ossendrijver, D., Bouwsema, K., & Simons, M. (2022) · JMIR mhealth and uhealth · doi:10.2196/40898 · Cited by 39
“Technical difficulties were also negatively influencing engagement in adults [43,89].”
BackgroundResultJoseph, R. P., Todd, M. W., Ainsworth, B. E., Vega‐López, S., Adams, M. A., Hollingshead, K. E., Hooker, S. P., Gaesser, G. A., & Keller, C. S. (2023) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph20021000 · Cited by 36
The impact of mindfulness apps on psychological processes of change: a systematic review
Macrynikola, N., Mir, Z., Gopal, T., Rodriguez, E., Li, S., Cox, M., Yeh, G. Y., & Torous, J. B. (2024) · npj Mental Health Research · doi:10.1038/s44184-023-00048-5 · Cited by 42
“The lack of consensus on engagement metrics is a recognized challenge in the mHealth space 79,80 , as is the dif fi culty sustaining engagement over time 81 .”
Burke, L. E., Sereika, S. M., Bizhanova, Z., Parmanto, B., Kariuki, J. K., Cheng, J. S.-C., Beatrice, B., Cedillo, M., Pulantara, I. W., Wang, Y., et al. (2022) · Journal of Medical Internet Research · doi:10.2196/38243 · Cited by 34
“In SMART, adherence to SM strongly predicted weight loss at all time points [17,29,49].”
The first AI ‐based Chatbot to promote HIV self‐management: A mixed methods usability study
Ma, Y., Achiche, S., Tu, G., Vicente, S., Lessard, D., Engler, K., Lemire, B., Laymouna, M. A., de Pokomandy, A., Cox, J., et al. (2024) · HIV Medicine · doi:10.1111/hiv.13720 · Cited by 35
“Automatic weekly study reminders to participants likely facilitated the high retention rate, as found in other research [82].”
Doumen, M., Cock, D. D., Lierde, C. V., Betrains, A., Pazmiño, S., Bertrand, D., Westhovens, R., & Verschueren, P. (2022) · RMD Open · doi:10.1136/rmdopen-2022-002625 · Cited by 31
Oh, J., Capezzuto, L., Kriara, L., Schjodt‐Eriksen, J., van Beek, J., Bernasconi, C., Montalbán, X., Butzkueven, H., Kappos, L., Giovannoni, G., et al. (2024) · Scientific Reports · doi:10.1038/s41598-023-49299-4 · Cited by 29
“This study identified several drivers and barriers to the deployment and use of such a tool (Panel) and builds on prior smaller studies that have highlighted the feasibility and challenges of using remote, digital tools for MS clinical care 8,19,20 .”
BackgroundJezrawi, R., Balakumar, S., Masud, R., Gabizon, I., Bhagirath, V. C., Varughese, J. K., Brown, M., Trottier, D., Schwalm, J., McGillion, M. H., et al. (2022) · Digital Health · doi:10.1177/20552076221102773 · Cited by 25
“17,19 Factors in fl uencing decisions to continue app use include common user experience elements, such as design interface, navigation fl ow, noti fi cation alerts, goal management, depth of knowledge available, clarity of system rules, personalized actionable recommendations and fi t between system…”
BackgroundTarricone, R., Petracca, F., Svae, L., Cucciniello, M., & Ciani, O. (2024) · eBioMedicine · doi:10.1016/j.ebiom.2024.105091 · Cited by 26
“25 With the continuous reinforcement of strategies to tackle traditional challenges like participant engagement and retention, 26 apps thereby provide unprecedented opportunities for self-management by delivering complex interventions based on behaviour change techniques (BCTs), “ observable,…”
BackgroundSehrawat, O., Noseworthy, P. A., Siontis, K. C., Haddad, T. C., Halamka, J. D., & Liu, H. (2023) · Mayo Clinic Proceedings · doi:10.1016/j.mayocp.2023.02.003 · Cited by 34
Colombo, G., Minta, K., Grübel, J., Tai, W. L. E., Hölscher, C., & Schinazi, V. R. (2024) · Computers in Human Behavior · doi:10.1016/j.chb.2024.108349 · Cited by 25
Yang, S., Cha, M.-J., van Kessel, R., Warrier, G., Thrul, J., Lee, M., Yoon, J., Kang, D., & Cho, J. (2025) · Journal of Medical Internet Research · doi:10.2196/71349 · Cited by 31
“These low retention rates suggest that the actual benefit of mHealth may be limited [20].”
Smart dry powder inhalers and intelligent adherence management
Häußermann, S., Arendsen, L. J., & Pritchard, J. N. (2022) · Advanced Drug Delivery Reviews · doi:10.1016/j.addr.2022.114580 · Cited by 23
Branch, O. H., Rikhy, M., Auster‐Gussman, L. A., Lockwood, K. G., & Graham, S. A. (2022) · JMIR Formative Research · doi:10.2196/38215 · Cited by 26
“Although retention was lower than that in clinical efficacy studies, this is expected for digital health [31], and retention was substantially higher than what is commonly reported for similar programs in the literature [32].”
ResultChiauzzi, E. J., Williams, A. A. A., Mariano, T. Y., Pajarito, S., Robinson, A. H., Kirvin-Quamme, A., & Forman‐Hoffman, V. L. (2024) · BMC Psychiatry · doi:10.1186/s12888-024-05532-6 · Cited by 25
“…high assessment completion and W-MA-02 utilization rates are notable given that attrition remains a perennial problem in mobile health app studies [44], with one recent systematic review of depression DMHI app RCTs suggesting that dropout rates may range from 26 to 48%, even when participant…”
Cho, P. J., Olaye, I. M., Shandhi, M. M. H., Daza, E. J., Foschini, L., & Dunn, J. (2024) · The Lancet Digital Health · doi:10.1016/s2589-7500(24)00219-x · Cited by 28
Guðmundsdóttir, S. L., Ballarini, T., Ámundadóttir, M. L., Mészáros, J., Eysteinsdóttir, J. H., Thorleifsdottir, R. H., Hrafnkelsdóttir, S. K., Helgadóttir, H., Oddsson, S. J., & Silverberg, J. I. (2023) · JMIR Formative Research · doi:10.2196/41227 · Cited by 25
“These results can inform the design of future randomized controlled trials to further validate the efficacy of a targeted DTx program in atopic dermatitis.”
BackgroundInfluentialVial, S., Boudhraâ, S., Dumont, M., Tremblay, M., & Riendeau, S. (2023) · JMIR Research Protocols · doi:10.2196/47220 · Cited by 25
“However, there are few examples of successful implementation [2], and 2 systematic reviews reveal that few users are using mental health apps for a long period of time [4,5].”
BackgroundShaw, G., Jr., Castro, B. A., Gunn, L. H., Norris, K. C., & Thorpe, R. J. (2024) · JMIR mhealth and uhealth · doi:10.2196/46656 · Cited by 29
“However, mobile health (mHealth) apps can play an important adjuvant role in preventing and treating chronic diseases and promoting positive health behavior change among individuals with obesity [8,9], with several factors influencing users’ acceptance of and engagement with mHealth apps [10-12].”
BackgroundKilfoy, A., Chu, C. H., Krisnagopal, A., McAtee, E., Baek, S., Zworth, M., Hwang, K., Park, H., & Jibb, L. (2024) · Journal of Clinical Nursing · doi:10.1111/jocn.17226 · Cited by 41
Javed, A., Kim, D. S., Hershman, S. G., Shcherbina, A., Johnson, A., Tolas, A., O’Sullivan, J. W., McConnell, M. V., Lazzeroni, L. C., King, A. C., et al. (2023) · European Heart Journal - Digital Health · doi:10.1093/ehjdh/ztad047 · Cited by 24
“39 These possibilities will be explored in further extensions of the MyHeart Counts Cardiovascular Health Study.”
Lim, J. Y., Kim, Y., Yeo, S. M., Chae, B. J., Yu, J. H., & Hwang, J. H. (2023) · Health Informatics Journal · doi:10.1177/14604582231156476 · Cited by 23
“In the current study, we presented the retention rate based on opening/logging into the app, as reported in the systematic literature review.(33) Therefore, comparing retention rates may be partially limited.”
MethodKopka, M., Slagman, A. C., Schorr, C., Krampe, H., Altendorf, M. B., Balzer, F., Bolanaki, M., Kuschick, D., Möckel, M., Napierala, H., et al. (2024) · Smart Health · doi:10.1016/j.smhl.2024.100517 · Cited by 23
Reward Design for an Online Reinforcement Learning Algorithm Supporting Oral Self-Care
Trella, A. L., Zhang, K. W., Nahum-Shani, I. B., Shetty, V., Doshi‐Velez, F., & Murphy, S. A. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i13.26866 · Cited by 48
White, J. S., Salem, M. K., Toussaert, S., Westmaas, J. L., Raiff, B. R., Crane, D., Warrender, E., Lyles, C. R., Abroms, L. C., & Thrul, J. (2023) · JMIR Serious Games · doi:10.2196/46602 · Cited by 25
“A perennial challenge for mobile health (mHealth) apps is their low engagement and retention rates [10].”
BackgroundEspinola, C. W., Nguyen, B., Torres, A., Sim, W., Rueda, A., Beavers, L., Campbell, D. M., Jung, H., Lou, W. Y. W., Kapralos, B., et al. (2023) · JMIR Serious Games · doi:10.2196/42813 · Cited by 21
“This finding is supported by recent literature that recommends a combination of different engagement strategies to optimize app use [49,50].”
BackgroundResultEmail-Based Recruitment Into the Health eHeart Study: Cohort Analysis of Invited Eligible Patients
Ng, M. Y., Olgin, J. E., Marcus, G. M., Lyles, C. R., & Pletcher, M. J. (2023) · Journal of Medical Internet Research · doi:10.2196/51238 · Cited by 18
“In addition to being similarly vulnerable to selection biases (eg, altruistic volunteers) and participation attrition as traditional clinical research studies, they must also contend with additional biases and inequities arising from the digital environment [2,3,8].”
Patra, E., Κοκκινοπούλου, Ά., Wilson-Barnes, S., Hart, K. H., Gymnopoulos, L. P., Tsatsou, D., Solachidis, V., Dimitropoulos, K., Rouskas, K., Argiriou, A., et al. (2024) · Life · doi:10.3390/life14101238 · Cited by 23
“Thus, the main advantages of accessibility and reach to diverse samples in terms of race, ethnicity, gender, age, and education level are reduced, and therefore their potential positive impact is minimised [9].”
BackgroundConsumer adoption of digital health services: A systematic literature review and research agenda
Goel, A., Singh, A., Taneja, U., & Jain, S. (2024) · International Journal of Consumer Studies · doi:10.1111/ijcs.13070 · Cited by 22
Modi, A. C., Patel, A. D., Mara, C. A., Schmidt, M., Tenney, J. R., & Stevens, J. H. (2023) · Epilepsy & Behavior · doi:10.1016/j.yebeh.2022.109082 · Cited by 18
Smartphone Apps for Problem Gambling: a Review of Content and Quality
McCurdy, L. Y., Loya, J. M., Hart-Derrick, V. R., Young, G. C., Kiluk, B. D., & Potenza, M. N. (2023) · Current Addiction Reports · doi:10.1007/s40429-023-00479-2 · Cited by 18
Larsen, E., Murton, O. M., Song, X., Joachim, D., Watts, D., Kapczinski, F. P., Venesky, L. G., & Hurowitz, G. (2024) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2024.1342835 · Cited by 18
“Aside from study design factors, a potentially important factor was delivering real-time useful information (MFVB scores) back to users through the study app, a characteristic not shared by many other digital health apps (65, 66).”
BackgroundMethodResultInfluentialAgachi, E., Bijmolt, T. H. A., van Ittersum, K., & Mierau, J. O. (2023) · JMIR mhealth and uhealth · doi:10.2196/43033 · Cited by 21
“Digital behavior change programs often exhibit low participant engagement [11-13].”
A Randomized Clinical Trial of Clinician-Supported PTSD Coach in VA Primary Care Patients
Possemato, K., Johnson, E., Barrie, K. A., Ghaus, S. J., Noronha, D. O., Wade, M. J., Greenbaum, M. A., Rosen, C. S., Cloître, M., Owen, J. E., et al. (2023) · Journal of General Internal Medicine · doi:10.1007/s11606-023-08130-6 · Cited by 15
Evaluating the Effectiveness of Mobile Health in Breast Cancer Care: A Systematic Review
Flaucher, M., Zakreuskaya, A., Nissen, M., Mocker, A., Fasching, P. A., Beckmann, M. W., Eskofier, B. M., & Leutheuser, H. (2023) · The Oncologist · doi:10.1093/oncolo/oyad217 · Cited by 15
Bolt, G. L., Piercy, H., Barnett, A., & Manning, V. (2022) · Addictive Behaviors Reports · doi:10.1016/j.abrep.2022.100471 · Cited by 15
Satibi, S., Ghozali, M. T., & Forthwengel, G. (2023) · Journal of Medicine and Life · doi:10.25122/jml-2023-0153 · Cited by 22
Schläpfer, S., Schneider, F., Santhanam, P., Eicher, M., Kowatsch, T., Witt, C. M., & Barth, J. (2024) · JMIR Cancer · doi:10.2196/52386 · Cited by 14
“In studies using mHealth apps, poor engagement can also confound the outcome and impact the validity of the results as study dropouts may differ from completers [2,9].”
BackgroundResultInfluentialBurke, L. E., Bizhanova, Z., Conroy, M. B., Cheng, J. S.-C., Beatrice, B., Kariuki, J. K., Parmanto, B., & Sereika, S. M. (2025) · Obesity · doi:10.1002/oby.24234 · Cited by 16
“Amagai et al. noted in a review of 69 mHealth studies using apps that there was no agreement on the definition of engagement; however, 95% of the studies measured some form of engagement around opening or using a specific app [23].”
Empowering rheumatology through digital health technologies: contributions and barriers
Benavent, D., Carmona, L., Llorente, J. F. G., Montoro, M., Ramirez, S., Otón, T., Loza, E., & Gómez-Centeno, A. (2024) · Exploration of Musculoskeletal Diseases · doi:10.37349/emd.2024.00038 · Cited by 15
Unsupervised Machine Learning to Identify Positive and Negative Themes in Jordanian mHealth Apps
Alhur, M., Alshamari, S., Oláh, J., & Aldreabi, H. (2022) · International Journal of E-Services and Mobile Applications · doi:10.4018/ijesma.313950 · Cited by 21
Jibb, L., Sivaratnam, S., Hashemi, E., Chu, C. H., Nathan, P. C., Chartrand, J., Alberts, N. M., Masama, T., Pease, H. G., Torres, L. B., et al. (2023) · PLOS Digital Health · doi:10.1371/journal.pdig.0000169 · Cited by 16
Mobile health applications for health-care delivery: trends, opportunities, and challenges
Goel, A., & Taneja, U. (2023) · Journal of Public Health · doi:10.1007/s10389-023-02165-z · Cited by 22
“This also highlighted the relevance of using technology-based remote monitoring with other healthcare facilities (Amagai et al. 2022).”
Pathipati, M. P., Scott, L. L., Griser, A. C., & Staller, K. D. (2024) · Neurogastroenterology & Motility · doi:10.1111/nmo.14811 · Cited by 17
Designing digital health interventions with causal inference and multi-armed bandits: a review
Švihrová, R., Rossi, A. D., Marzorati, D., Tzovara, A., & Faraci, F. D. (2025) · Frontiers in Digital Health · doi:10.3389/fdgth.2025.1435917 · Cited by 16
Moulaei, K., Bahaadinbeigy, K., Mashoof, E., & Dinari, F. (2023) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-023-02308-y · Cited by 19
“Additionally, inviting patients from different races, ethnicities, genders, ages, and education statuses to a meeting of the research team to discuss this application and its advantages can be helpful [65].”
BackgroundSedotto, R. N. M., Edwards, A. E., Dulin, P. L., & King, D. K. (2024) · Healthcare · doi:10.3390/healthcare12010101 · Cited by 12
“Results support the previous literature that providing feedback, notifications, and personalization features are motivators for engaging in behavior change apps, while technical difficulties create barriers to engagement [26].”
ResultDesigning mHealth Apps to Incorporate Evidence-Based Techniques for Prolonging User Engagement
Monachelli, R., Davis, S. W., Barnard, A., Longmire, M. R., Docherty, J. P., & Oakley-Girvan, I. A. (2024) · Interactive Journal of Medical Research · doi:10.2196/51974 · Cited by 16
“Participants are more likely to drop out than be retained despite app elements such as feedback, reminders, in-app support, gamification, and participant compensation [20-23].”
BackgroundWhite, J. S., Toussaert, S., Raiff, B. R., Salem, M. K., Chiang, A. Y., Crane, D., Warrender, E., Lyles, C. R., Abroms, L. C., Westmaas, J. L., et al. (2024) · Journal of Medical Internet Research · doi:10.2196/57839 · Cited by 15
Halabi, R., Selvarajan, R., Lin, Z., Herd, C., Li, S. X., Kabrit, J., Tummalacherla, M., Neto, E. C., & Pratap, A. (2024) · Sensors · doi:10.3390/s24196246 · Cited by 18
“Key factors include differences [21] in hardware and software (e.g., Android vs. iOS) along with variations in device usage by a large population in naturalistic settings [22].”
BackgroundD’Silva, A., Hua, N., Modayil, M. V., Seidel, J. E., & Marshall, D. A. (2024) · Digestive Diseases and Sciences · doi:10.1007/s10620-024-08672-7 · Cited by 14
“While higher attrition could indicate the intervention’s effectiveness and success [79], it could, alternatively, be a reper-cussion of behavioral and sociodemographic factors [75].”
Camera-based mobile applications for movement screening in healthy adults: a systematic review
El-Rajab, I., Klotzbier, T. J., Korbus, H., & Schott, N. (2025) · Frontiers in Sports and Active Living · doi:10.3389/fspor.2025.1531050 · Cited by 12
Adherence to digital pregnancy care – lessons learned from the SMART start feasibility study
Jaeger, K. M., Nissen, M., Leutheuser, H., Danzberger, N., Titzmann, A., Pontones, C. A., Goossens, C., Ziegler, P., Uhrig, S., Haeberle, L., et al. (2025) · npj Digital Medicine · doi:10.1038/s41746-025-01966-8 · Cited by 15
Persson, D. R., Zhukouskaya, K., Wegener, A.-M. K., Jørgensen, L. K., Bardram, J. E., & Bækgaard, P. (2023) · JMIR Formative Research · doi:10.2196/49738 · Cited by 11
“Many authors note that long-term engagement remains a key challenge in mHealth [14,46] and is reflected in the high attrition rates seen in many mHealth apps [13,14].”
BackgroundBjörnsdóttir, S., Ulfsdottir, H., Gudmundsson, E. F., Sveinsdottir, K., Ísberg, A. P., Dobies, B., Magnusdottir, G. E. A., Gunnarsdottir, T., Karlsdottir, T., Björnsdóttir, G., et al. (2023) · JMIR Cardio · doi:10.2196/52576 · Cited by 15
“A strength of this study was the high engagement and completion rate, as these are well known issues of digital health programs [46].”
BackgroundTerceiro, L., Mustafa, M. I., Hägglund, M., & Kharko, A. (2024) · JMIR Research Protocols · doi:10.2196/65099 · Cited by 13
“Studies have examined participant engagement and retention across various settings, for example, mHealth or web-based platforms [21,25], focusing on particular patient groups, for example, older adults with dementia or digital mental health interventions [26-29].”
InfluentialBhidayasiri, R., Phumphid, S., Sringean, J., Anan, C., Laosombut, T., Meesri, J., Wekhinhiran, S., Leabthong, N., Phokaewvarangkul, O., Surangsrirat, D., et al. (2026) · BMC Public Health · doi:10.1186/s12889-026-27654-0 · Cited by 12
“Systematic reviews of mHealth interventions consistently identify participant attrition and engagement loss as key challenges for real-world implementation [93].”
Wu, Y.-C., Shen, S.-F., Chen, L., & Tung, H. (2024) · Journal of Medical Internet Research · doi:10.2196/53450 · Cited by 17
“In our study, the dropout rate in the intervention group was 6% (2/31), consistent with rates reported in prior studies utilizing virtual interventions [71], underscoring its high level of acceptance [72].”
Gamification in mobile applications: techniques, benefits and challenges
Oliveira, M., Abelha, A., Sousa, R., & Peixoto, H. (2024) · Procedia Computer Science · doi:10.1016/j.procs.2024.11.168 · Cited by 10
Sinha, C., Dinesh, D., Heaukulani, C., & Heaukulani, C. (2024) · Frontiers in Digital Health · doi:10.3389/fdgth.2024.1443598 · Cited by 10
“This analysis evidenced high rates of utilization and engagement across the brief intervention (website) and on the longitudinal intervention (app), compared to the average period seen in digital health (36).”
Spaargaren, K. L., Roke, Y., Begeer, S., van Straten, A., Riper, H. M., Greaves‐Lord, K., & Scheeren, A. M. (2025) · Autism · doi:10.1177/13623613251346885 · Cited by 11
“Moreover, it must be noted that high dropout rates are common in mHealth studies, where participants are generally more likely to discontinue than to complete the intervention (Amagai et al., 2022; Ross et al., 2016).”
Hayashi, C., Tanemura, N., Taniguchi, M., Okano, T., Toyoda, H., Mashino, S., & Ogata, S. (2025) · npj Digital Medicine · doi:10.1038/s41746-025-01873-y · Cited by 11
“A recent review article reported that research involving mobile-based apps without gami fi cation (badges, leaderboards, rewards, ava-tars), feedback or noti fi cation, and support from peers or coaches was a potential rationale for poor engagement and areas that could be improved in the future 26 .”
Feeling Moodie: Insights from a Usability Evaluation to Improve the Design of mHealth Apps
Chan, G., Alslaity, A., Wilson, R., & Orji, R. (2023) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2023.2241613 · Cited by 11
“Research also shows that reasons users become disen-gaged and discontinue the use of mHealth apps include the lack of support features and the experience of technical glitches (Amagai et al., 2022).”
Forman‐Hoffman, V. L., Sihvonen, S., Wielgosz, J., Kuhn, E. R., Nelson, B. W., Peiper, N. C., & Gould, C. E. (2024) · Journal of Affective Disorders · doi:10.1016/j.jad.2024.01.057 · Cited by 10
ASTHMAXcel PRO patient satisfaction and usability field testing
Wedel, N., Zinger, N., Singh, A. K., Kaur, S., Njeze, O., Cosar, E., Mowrey, W. B., Green, S., Reznik, M., Feldman, J. M., et al. (2024) · Journal of Asthma · doi:10.1080/02770903.2024.2304615 · Cited by 12
“According to recent studies, approximately 71% of app users are estimated to disengage within 90 days of use and over two-thirds of the general population will stop using an mHealth app after a single use (28,29).”
BackgroundPark, S. Y., Yourell, J., McAlister, K. L., & Huberty, J. (2023) · JMIR Formative Research · doi:10.2196/54284 · Cited by 29
“Costs associated with mobile apps can be a barrier to user retention [34,35].”
BackgroundCarfora, V., & Catellani, P. (2024) · Journal of Environmental Psychology · doi:10.1016/j.jenvp.2024.102255 · Cited by 11
Braver, J., Marwick, T. H., Salim, A., Lekamlage, D. H., Keating, C., Yiallourou, S. R., Oldenburg, B. F., & Carrington, M. J. (2025) · European Heart Journal - Digital Health · doi:10.1093/ehjdh/ztaf043 · Cited by 9
“39,40 Nevertheless, this level of app engagement was modest, particularly for medication reminders (37%).”
Sparks, C., Hsu, A., Neller, S. A., Eaton, J., Thompson, A. D., Wong, B. G., Iacob, E., Terrill, A. L., Caserta, M. S., Stark, L. A., et al. (2024) · Contemporary Clinical Trials · doi:10.1016/j.cct.2024.107518 · Cited by 9
Rahayu, S. R., Zainafree, I., Merzistya, A. N. A., Cahyati, W. H., Farida, E., Wandastuti, A. D., Isbandi, Wahidah, N., Saefurrohim, M. Z., Islam, M. A. N., et al. (2022) · Healthcare Informatics Research · doi:10.4258/hir.2022.28.4.297 · Cited by 20
“This finding is promising because user retention is a challenge in the development and implementation of mHealth [22].”
BackgroundThomassen, E. E. K., Berg, I. J., Kristianslund, E. K., Tveter, A. T., Bakland, G., Gossec, L., Hakim, S., Macfarlane, G. J., de Thurah, A. L., & Østerås, N. (2024) · Rheumatology International · doi:10.1007/s00296-024-05673-7 · Cited by 8
Budin‐Ljøsne, I., Fredheim, N. A. G., Jevne, C. A., Kleven, B. M., Charles, M.-A. A., Felix, J. F., Flaig, R., García, M. P., Havdahl, A., Islam, S., et al. (2024) · BMC Medical Research Methodology · doi:10.1186/s12874-024-02419-8 · Cited by 12
“Securing return on investment may be challenging, as digital platforms are expensive to develop and maintain and require expertise to be designed in line with stringent privacy and confidentiality requirements and in a user-friendly manner [43].”
Finkelstein, E. A., Gardner, D. S.-L., Tham, K. W., Gandhi, M., Cheung, Y. B., Bairavi, J., Lee, C. F., Tan, N. C., Yeoh, E. C. K., Lee, P. C., et al. (2024) · Diabetes Obesity and Metabolism · doi:10.1111/dom.16067 · Cited by 10
Guo, R., Zhang, J., Yang, F., & Wu, Y. X. (2024) · Journal of Medical Internet Research · doi:10.2196/67950 · Cited by 16
“Second, the SMART system creates a supportive feedback environment that transcends time and space limitations [36].”
Rotondi, A. J., Belnap, B. H., Rothenberger, S. D., Feldman, R., Hanusa, B. H., & Rollman, B. L. (2023) · JMIR Mental Health · doi:10.2196/52197 · Cited by 8
“Some patients may have felt that the program was no longer addressing their needs or that they improved sufficiently and discontinued [42].”
Flores, J. S., Dalal, A. K., Sousa, J., Foer, D., Rodriguez, J. A., Plombon, S., Bates, D. W., Arcia, A., & Rudin, R. S. (2024) · Applied Clinical Informatics · doi:10.1055/s-0044-1788978 · Cited by 12
“26,27 Although increased PCP involvement may further improve adoption and use, 58 wedesigned the intervention so that PCP ’ s are not required to change practice in order for patients to bene fi t. Likewise, the minimal volume of call-backs we found can be attributed to changes we made to the…”
Participant Engagement in Microrandomized Trials of mHealth Interventions: Scoping Review
Leong, U., & Chakraborty, B. (2023) · JMIR mhealth and uhealth · doi:10.2196/44685 · Cited by 9
“In fact, it is one of the most common measures of engagement in mHealth interventions [10,44,45].”
Solberg Nes, L., Børøsund, E., Varsi, C., Eide, H., Waxenberg, L. B., Weiss, K. E., Morrison, E. J., Støle, H. S., Kristjansdottir, Ó. B., Bostrøm, K., et al. (2024) · Pain Reports · doi:10.1097/pr9.0000000000001174 · Cited by 7
Who engages in well-being interventions? An analysis of a global digital intervention study
Park, Y., Guevarra, D. A., Simon-Thomas, E. R., & Epel, E. S. (2024) · The Journal of Positive Psychology · doi:10.1080/17439760.2024.2417098 · Cited by 7
“Second, compared to the features of the intervention or its delivery (Amagai et al., 2022; Wu et al., 2021), individual characteristics relevant to engagement have received far less attention.”
Laure, T., Remmerswaal, D., Konigorski, S., Engels, R. C. M. E., & Boffo, M. (2024) · Stress and Health · doi:10.1002/smi.3507 · Cited by 14
Lynch, F. L., Cavese, J. A., Fulton, L., Vuckovic, N. H., & Brent, D. A. (2025) · JMIR Human Factors · doi:10.2196/64867 · Cited by 9
“Difficulty in sustaining engagement with digital tools has been noted in prior studies [36,37].”
Podoly, T. Y., Ezra, H. E., & Doron, G. (2025) · Journal of Affective Disorders · doi:10.1016/j.jad.2025.03.060 · Cited by 8
Metadata
- Authors
- Amagai, S., Pila, S., Kaat, A. J., Nowinski, C. J., & Gershon, R. C.
- Affiliations
- Northwestern University (US)
- Corresponding author
- Amagai, Saki
- Venue
- Journal of Medical Internet Research
- Publisher
- JMIR Publications Inc.
- Published
- 2022-04-26
- Volume
- 24
- Issue
- 4
- Pages
- e35120
- ISSN
- 1438-8871 (ISSN-L)
- PMC
- PMC9092233
- OpenAlex
- W4224941735
- Cited by
- 343
- References
- 74
- Citations by year
- 2026: 83 · 2025: 95 · 2024: 84 · 2023: 65 · 2022: 16
- FWCI
- 12.55
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- Journal of Medical Internet Research (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (acceptedVersion)
- Topics
- Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Health Sciences › Health Professions › Health Information Management › Health, Technology, Consumer Behavior
- Keywords
- mobile health apps, participant retention, participant engagement, participant dropout, attrition, feedback, reminders, peer support, coaching, compensation, technical challenges, retention strategies
- MeSH terms
- Adult, Humans, Telemedicine, Mobile Applications
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
