Challenges in Participant Engagement and Retention Using Mobile Health Apps: Literature Review
Open accessPublished version of a preprint
The DOI matches its Crossref record; 74 of the 74 references it cites were found in a registry or an index.
Abstract
Background: Mobile health (mHealth) apps are revolutionizing the way clinicians and researchers monitor and manage the health of their participants. However, many studies using mHealth apps are hampered by substantial participant dropout or attrition, which may impact the representativeness of the sample and the effectiveness of the study. Therefore, it is imperative for researchers to understand what makes participants stay with mHealth apps or studies using mHealth apps. Objective: This study aimed to review the current peer-reviewed research literature to identify the notable factors and strategies used in adult participant engagement and retention. Methods: We conducted a systematic search of PubMed, MEDLINE, and PsycINFO databases for mHealth studies that evaluated and assessed issues or strategies to improve the engagement and retention of adults from 2015 to 2020. We followed the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines. Notable themes were identified and narratively compared among different studies. A binomial regression model was generated to examine the factors affecting retention. Results: Of the 389 identified studies, 62 (15.9%) were included in this review. Overall, most studies were partially successful in maintaining participant engagement. Factors related to particular elements of the app (eg, feedback, appropriate reminders, and in-app support from peers or coaches) and research strategies (eg, compensation and niche samples) that promote retention were identified. Factors that obstructed retention were also identified (eg, lack of support features, technical difficulties, and usefulness of the app). The regression model results showed that a participant is more likely to drop out than to be retained. Conclusions: Retaining participants is an omnipresent challenge in mHealth studies. The insights from this review can help inform future studies about the factors and strategies to improve participant retention.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Finally, several recent reviews have explored variables related to user engagement with DMHIs [8,9,18].”
From Digital Mental Health Interventions for Depression: Scoping Review of User Engagement (2022) · cites this paper as [18]
In the citing paper
“For example, study dropout or study attrition has been evaluated as a proxy for treatment dropout, with findings suggesting significant dropout [16-18].”
From Digital Mental Health Interventions for Depression: Scoping Review of User Engagement (2022) · cites this paper as [18]
In the citing paper
“This is evidenced by the low dropout rate of participants who enrolled in the study, which is an indicator of high levels of acceptance [45].”
From Implementation of a web-based resilience enhancement training for nurses: pilot randomized controlled trial (2023) · cites this paper as [45]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: the PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & for the PRISMA Group (2009) · BMJ · doi:10.1136/bmj.b2535 · Cited by 83,823
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & The PRISMA Group (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000097 · Cited by 64,042 · cited 1×
“Our methodology was guided by the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) statement [14].”
Wang, G., Ma, R., Qiao, G., Wada, K., Aizawa, Y., & Satoh, T. (2015) · Integrative Medicine International · doi:10.1159/000368408 · Cited by 18,657
Saturation in qualitative research: exploring its conceptualization and operationalization
Saunders, B., Sim, J., Kingstone, T., Baker, S., Waterfield, J., Bartlam, B., Burroughs, H., & Jinks, C. (2018) · Quality & Quantity · doi:10.1007/s11135-017-0574-8 · Cited by 12,033 · cited 1×
“We reached saturation when we could no longer identify new themes during the analysis, a process Saunders et al [16] considered inductive thematic saturation.”
MethodUsability Evaluation In Industry
(1996) · CRC Press eBooks · doi:10.1201/9781498710411 · Cited by 4,354
Mays, N., Pope, C., & Popay, J. (2005) · Journal of Health Services Research & Policy · doi:10.1258/1355819054308576 · Cited by 1,375
Torous, J., Lipschitz, J., Ng, M., & Firth, J. (2020) · Journal of Affective Disorders · doi:10.1016/j.jad.2019.11.167 · Cited by 546 · cited 1×
“Thus, it is impossible to extrapolate their findings to other mHealth apps that are not in the same subfield [11-13].”
BackgroundHuberty, J., Green, J., Glissmann, C., Larkey, L., Puzia, M., & Lee, C. (2019) · JMIR mHealth and uHealth · doi:10.2196/14273 · Cited by 488 · cited 1×
“Refer to Figure 1 for the study selection flowchart and Multimedia Appendix 1 [4-8,17-73] for characteristics of the studies.”
BackgroundPratap, A., Neto, E. C., Snyder, P., Stepnowsky, C., Elhadad, N., Grant, D., Mohebbi, M. H., Mooney, S., Suver, C., Wilbanks, J., et al. (2020) · npj Digital Medicine · doi:10.1038/s41746-020-0224-8 · Cited by 410 · cited 4×
“In their cross-study evaluation of 100,000 participants, Pratap et al [10] analyzed individual-level study app use data from 8 studies that accumulated nearly 3.”
InfluentialThe Use and Effectiveness of Mobile Apps for Depression: Results From a Fully Remote Clinical Trial
Arean, P. A., Hallgren, K. A., Jordan, J. T., Gazzaley, A., Atkins, D. C., Heagerty, P. J., & Anguera, J. A. (2016) · Journal of Medical Internet Research · doi:10.2196/jmir.6482 · Cited by 376
McConnell, M. V., Shcherbina, A., Pavlovic, A., Homburger, J. R., Goldfeder, R. L., Waggot, D., Cho, M. K., Rosenberger, M. E., Haskell, W. L., Myers, J., et al. (2017) · JAMA Cardiology · doi:10.1001/jamacardio.2016.4395 · Cited by 239
The Asthma Mobile Health Study, a large-scale clinical observational study using ResearchKit
Chan, Y.-F. Y., Wang, P., Rogers, L., Tignor, N., Zweig, M., Hershman, S. G., Genes, N., Scott, E. R., Krock, E., Badgeley, M., et al. (2017) · Nature Biotechnology · doi:10.1038/nbt.3826 · Cited by 204 · cited 2×
“Recently, several large-scale studies were able to recruit thousands of participants within a span of a few months using Apple’s ResearchKit framework (eg, [4-7]).”
BackgroundStein, N., & Brooks, K. (2017) · JMIR Diabetes · doi:10.2196/diabetes.8590 · Cited by 191 · cited 1×
“Refer to Figure 1 for the study selection flowchart and Multimedia Appendix 1 [4-8,17-73] for characteristics of the studies.”
BackgroundBidargaddi, N., Almirall, D., Murphy, S., Nahum-Shani, I., Kovalcik, M., Pituch, T., Maaieh, H., & Strecher, V. (2018) · JMIR mHealth and uHealth · doi:10.2196/10123 · Cited by 189 · cited 2×
“Refer to Figure 1 for the study selection flowchart and Multimedia Appendix 1 [4-8,17-73] for characteristics of the studies.”
BackgroundMaximizing Engagement in Mobile Health Studies
Druce, K. L., Dixon, W. G., & McBeth, J. (2019) · Rheumatic Disease Clinics of North America · doi:10.1016/j.rdc.2019.01.004 · Cited by 158 · cited 1×
“Thus, it is impossible to extrapolate their findings to other mHealth apps that are not in the same subfield [11-13].”
BackgroundMoberg, C., Niles, A., & Beermann, D. (2019) · Journal of Medical Internet Research · doi:10.2196/12556 · Cited by 157 · cited 1×
“Refer to Figure 1 for the study selection flowchart and Multimedia Appendix 1 [4-8,17-73] for characteristics of the studies.”
BackgroundBen-Zeev, D., Scherer, E. A., Gottlieb, J. D., Rotondi, A. J., Brunette, M. F., Achtyes, E. D., Mueser, K. T., Gingerich, S., Brenner, C. J., Begale, M., et al. (2016) · JMIR Mental Health · doi:10.2196/mental.6348 · Cited by 137
Dillingham, R., Ingersoll, K., Flickinger, T. E., Waldman, A. L., Grabowski, M., Laurence, C., Wispelwey, E., Reynolds, G., Conaway, M., & Cohn, W. F. (2018) · AIDS Patient Care and STDs · doi:10.1089/apc.2017.0303 · Cited by 132 · cited 1×
“Refer to Figure 1 for the study selection flowchart and Multimedia Appendix 1 [4-8,17-73] for characteristics of the studies.”
BackgroundMichaelides, A., Raby, C., Wood, M., Farr, K., & Toro-Ramos, T. (2016) · BMJ Open Diabetes Research & Care · doi:10.1136/bmjdrc-2016-000264 · Cited by 128 · cited 1×
“Refer to Figure 1 for the study selection flowchart and Multimedia Appendix 1 [4-8,17-73] for characteristics of the studies.”
BackgroundA Mobile Just-in-Time Adaptive Intervention for Smoking Cessation: Pilot Randomized Controlled Trial
Hébert, E. T., Ra, C. K., Alexander, A. C., Helt, A., Moisiuc, R., Kendzor, D. E., Vidrine, D. J., Funk-Lawler, R. K., & Businelle, M. S. (2020) · Journal of Medical Internet Research · doi:10.2196/16907 · Cited by 118 · cited 1×
“Refer to Figure 1 for the study selection flowchart and Multimedia Appendix 1 [4-8,17-73] for characteristics of the studies.”
BackgroundGet with the program: Adherence to a smartphone app for smoking cessation
Zeng, E. Y., Heffner, J. L., Copeland, W. K., Mull, K. E., & Bricker, J. B. (2016) · Addictive Behaviors · doi:10.1016/j.addbeh.2016.07.007 · Cited by 117 · cited 1×
“Refer to Figure 1 for the study selection flowchart and Multimedia Appendix 1 [4-8,17-73] for characteristics of the studies.”
BackgroundClickotine, A Personalized Smartphone App for Smoking Cessation: Initial Evaluation
Iacoviello, B. M., Steinerman, J. R., Klein, D. B., Silver, T. L., Berger, A. G., Luo, S. X., & Schork, N. J. (2017) · JMIR mHealth and uHealth · doi:10.2196/mhealth.7226 · Cited by 115 · cited 1×
“Refer to Figure 1 for the study selection flowchart and Multimedia Appendix 1 [4-8,17-73] for characteristics of the studies.”
BackgroundToro-Ramos, T., Michaelides, A., Anton, M., Karim, Z., Kang-Oh, L., Argyrou, C., Loukaidou, E., Charitou, M. M., Sze, W., & Miller, J. D. (2020) · JMIR mHealth and uHealth · doi:10.2196/17842 · Cited by 107 · cited 1×
“Refer to Figure 1 for the study selection flowchart and Multimedia Appendix 1 [4-8,17-73] for characteristics of the studies.”
BackgroundSpring, B., Pellegrini, C., McFadden, H. G., Pfammatter, A. F., Stump, T. K., Siddique, J., King, A. C., & Hedeker, D. (2018) · Journal of Medical Internet Research · doi:10.2196/10528 · Cited by 102 · cited 1×
“Refer to Figure 1 for the study selection flowchart and Multimedia Appendix 1 [4-8,17-73] for characteristics of the studies.”
BackgroundEverett, E., Kane, B., Yoo, A., Dobs, A., & Mathioudakis, N. (2018) · Journal of Medical Internet Research · doi:10.2196/jmir.9723 · Cited by 101 · cited 1×
“Refer to Figure 1 for the study selection flowchart and Multimedia Appendix 1 [4-8,17-73] for characteristics of the studies.”
BackgroundClinically Meaningful Use of Mental Health Apps and its Effects on Depression: Mixed Methods Study
Zhang, R., Nicholas, J., Knapp, A. A., Graham, A. K., Gray, E., Kwasny, M. J., Reddy, M., & Mohr, D. C. (2019) · Journal of Medical Internet Research · doi:10.2196/15644 · Cited by 91 · cited 1×
“Refer to Figure 1 for the study selection flowchart and Multimedia Appendix 1 [4-8,17-73] for characteristics of the studies.”
BackgroundShcherbina, A., Hershman, S. G., Lazzeroni, L., King, A. C., O'Sullivan, J. W., Hekler, E., Moayedi, Y., Pavlovic, A., Waggott, D., Sharma, A., et al. (2019) · The Lancet Digital Health · doi:10.1016/s2589-7500(19)30129-3 · Cited by 90 · cited 1×
“Refer to Figure 1 for the study selection flowchart and Multimedia Appendix 1 [4-8,17-73] for characteristics of the studies.”
BackgroundThe SMARTER pilot study: Testing feasibility of real-time feedback for dietary self-monitoring
Burke, L. E., Zheng, Y., Ma, Q., Mancino, J., Loar, I., Music, E., Styn, M., Ewing, L., French, B., Sieworek, D., et al. (2017) · Preventive Medicine Reports · doi:10.1016/j.pmedr.2017.03.017 · Cited by 86 · cited 1×
“Refer to Figure 1 for the study selection flowchart and Multimedia Appendix 1 [4-8,17-73] for characteristics of the studies.”
BackgroundMundi, M. S., Lorentz, P. A., Grothe, K. B., Kellogg, T. A., & Collazo–Clavell, M. L. (2015) · Obesity Surgery · doi:10.1007/s11695-015-1617-7 · Cited by 85 · cited 1×
“Refer to Figure 1 for the study selection flowchart and Multimedia Appendix 1 [4-8,17-73] for characteristics of the studies.”
BackgroundBricker, J. B., Copeland, W., Mull, K. E., Zeng, E. Y., Watson, N. L., Akioka, K. J., & Heffner, J. L. (2017) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2016.10.029 · Cited by 84
Dahne, J., Lejuez, C. W., Diaz, V. A., Player, M. S., Kustanowitz, J., Felton, J. W., & Carpenter, M. J. (2019) · Behavior Therapy · doi:10.1016/j.beth.2018.12.003 · Cited by 78 · cited 1×
“Refer to Figure 1 for the study selection flowchart and Multimedia Appendix 1 [4-8,17-73] for characteristics of the studies.”
BackgroundMao, A. Y., Chen, C., Magana, C., Caballero Barajas, K., & Olayiwola, J. N. (2017) · JMIR mHealth and uHealth · doi:10.2196/mhealth.7591 · Cited by 77 · cited 2×
“Refer to Figure 1 for the study selection flowchart and Multimedia Appendix 1 [4-8,17-73] for characteristics of the studies.”
BackgroundForman, E. M., Goldstein, S. P., Zhang, F., Evans, B. C., Manasse, S. M., Butryn, M. L., Juarascio, A. S., Abichandani, P., Martin, G. J., & Foster, G. D. (2019) · Translational Behavioral Medicine · doi:10.1093/tbm/iby016 · Cited by 77 · cited 1×
“Refer to Figure 1 for the study selection flowchart and Multimedia Appendix 1 [4-8,17-73] for characteristics of the studies.”
BackgroundHershman, S. G., Bot, B. M., Shcherbina, A., Doerr, M., Moayedi, Y., Pavlovic, A., Waggott, D., Cho, M. K., Rosenberger, M. E., Haskell, W. L., et al. (2019) · Scientific Data · doi:10.1038/s41597-019-0016-7 · Cited by 75 · cited 1×
“Refer to Figure 1 for the study selection flowchart and Multimedia Appendix 1 [4-8,17-73] for characteristics of the studies.”
BackgroundHealth Apps for Combating COVID-19: Descriptive Review and Taxonomy
Almalki, M., & Giannicchi, A. (2021) · JMIR mHealth and uHealth · doi:10.2196/24322 · Cited by 71 · cited 1×
“In addition, the recent COVID-19 pandemic has led to a rise in the downloads and use of various mHealth apps, highlighting the importance of technology-based remote monitoring and diagnosis for continued advancement in modern health care (eg, [3]).”
BackgroundDu, H., Venkatakrishnan, A., Youngblood, G. M., Ram, A., & Pirolli, P. (2016) · JMIR mHealth and uHealth · doi:10.2196/mhealth.4900 · Cited by 68 · cited 1×
“Refer to Figure 1 for the study selection flowchart and Multimedia Appendix 1 [4-8,17-73] for characteristics of the studies.”
BackgroundTran, C., Dicker, A., Leiby, B., Gressen, E., Williams, N., & Jim, H. (2020) · Journal of Medical Internet Research · doi:10.2196/12689 · Cited by 68 · cited 1×
“Refer to Figure 1 for the study selection flowchart and Multimedia Appendix 1 [4-8,17-73] for characteristics of the studies.”
BackgroundMixed-methods analysis of factors impacting use of a postoperative mHealth app
Scott, A. R., Alore, E. A., Naik, A. D., Berger, D. H., & Suliburk, J. W. (2017) · JMIR mhealth and uhealth · doi:10.2196/mhealth.6728 · Cited by 67
Doerr, M., Maguire Truong, A., Bot, B. M., Wilbanks, J., Suver, C., & Mangravite, L. M. (2017) · JMIR mHealth and uHealth · doi:10.2196/mhealth.6521 · Cited by 67 · cited 2×
“Recently, several large-scale studies were able to recruit thousands of participants within a span of a few months using Apple’s ResearchKit framework (eg, [4-7]).”
BackgroundBush, J., Barlow, D. E., Echols, J., Wilkerson, J., & Bellevin, K. (2017) · Telemedicine Journal and e-Health · doi:10.1089/tmj.2016.0242 · Cited by 67 · cited 1×
“Refer to Figure 1 for the study selection flowchart and Multimedia Appendix 1 [4-8,17-73] for characteristics of the studies.”
BackgroundCharacterizing user engagement with health app data: a data mining approach
Serrano, K. J., Coa, K. I., Yu, M., Wolff-Hughes, D. L., & Atienza, A. A. (2017) · Translational Behavioral Medicine · doi:10.1007/s13142-017-0508-y · Cited by 67 · cited 1×
“Refer to Figure 1 for the study selection flowchart and Multimedia Appendix 1 [4-8,17-73] for characteristics of the studies.”
BackgroundBerman, M. A., Guthrie, N. L., Edwards, K. L., Appelbaum, K. J., Njike, V. Y., Eisenberg, D. M., & Katz, D. L. (2018) · JMIR Diabetes · doi:10.2196/diabetes.9591 · Cited by 67 · cited 1×
“Refer to Figure 1 for the study selection flowchart and Multimedia Appendix 1 [4-8,17-73] for characteristics of the studies.”
BackgroundHuberty, J., Vranceanu, A.-M., Carney, C., Breus, M., Gordon, M., & Puzia, M. E. (2019) · JMIR mHealth and uHealth · doi:10.2196/15648 · Cited by 67 · cited 1×
“Refer to Figure 1 for the study selection flowchart and Multimedia Appendix 1 [4-8,17-73] for characteristics of the studies.”
BackgroundMichaelides, A., Major, J., Pienkosz Jr, E., Wood, M., Kim, Y., & Toro-Ramos, T. (2018) · JMIR mHealth and uHealth · doi:10.2196/mhealth.9161 · Cited by 62 · cited 1×
“Refer to Figure 1 for the study selection flowchart and Multimedia Appendix 1 [4-8,17-73] for characteristics of the studies.”
BackgroundRoss, E. L., Jamison, R. N., Nicholls, L., Perry, B. M., & Nolen, K. D. (2020) · Journal of Medical Internet Research · doi:10.2196/16939 · Cited by 62 · cited 2×
“One study explicitly mentioned the use of the research support team to troubleshoot any technical difficulties for users [35], but most articles did not mention how they handled technology support requests.”
BackgroundGriauzde, D., Kullgren, J. T., Liestenfeltz, B., Ansari, T., Johnson, E. H., Fedewa, A., Saslow, L. R., Richardson, C., & Heisler, M. (2019) · JMIR mHealth and uHealth · doi:10.2196/11267 · Cited by 58 · cited 1×
“Refer to Figure 1 for the study selection flowchart and Multimedia Appendix 1 [4-8,17-73] for characteristics of the studies.”
Sittig, S., Wang, J., Iyengar, S., Myneni, S., & Franklin, A. (2020) · JMIR mHealth and uHealth · doi:10.2196/15927 · Cited by 52 · cited 1×
“Refer to Figure 1 for the study selection flowchart and Multimedia Appendix 1 [4-8,17-73] for characteristics of the studies.”
BackgroundAn mHealth App for Self-Management of Chronic Lower Back Pain (Limbr): Pilot Study
Selter, A., Tsangouri, C., Ali, S. B., Freed, D., Vatchinsky, A., Kizer, J., Sahuguet, A., Vojta, D., Vad, V., Pollak, J., et al. (2018) · JMIR mHealth and uHealth · doi:10.2196/mhealth.8256 · Cited by 51
The asthma mobile health study, smartphone data collected using ResearchKit
Chan, Y.-F. Y., Bot, B. M., Zweig, M., Tignor, N., Ma, W., Suver, C., Cedeno, R., Scott, E. R., Gregory Hershman, S., Schadt, E. E., et al. (2018) · Scientific Data · doi:10.1038/sdata.2018.96 · Cited by 50
Ifejika, N. L., Bhadane, M. Y., Cai, C. C., Noser, E. A., Grotta, J. C., & Savitz, S. I. (2020) · JMIR mhealth and uhealth · doi:10.2196/17816 · Cited by 46 · cited 1×
“Refer to Figure 1 for the study selection flowchart and Multimedia Appendix 1 [4-8,17-73] for characteristics of the studies.”
BackgroundFernández, M. D. P., Bron, G. M., Kache, P. A., Larson, S. R., Maus, A., Gustafson, D. H., Tsao, J. I., Bartholomay, L. C., Paskewitz, S. M., & Diuk‐Wasser, M. A. (2019) · JMIR mhealth and uhealth · doi:10.2196/14769 · Cited by 44 · cited 3×
“According to Fernandez et al [57], “Gamification or the use of game design elements (badges, leaderboards, rewards, and avatars) can help maintain user engagement.””
BackgroundPetersen, C. L., Weeks, W. B., Norin, O., & Weinstein, J. N. (2018) · JMIR mhealth and uhealth · doi:10.2196/11082 · Cited by 43 · cited 1×
“Refer to Figure 1 for the study selection flowchart and Multimedia Appendix 1 [4-8,17-73] for characteristics of the studies.”
BackgroundSmartphone health apps for tobacco cessation: a systematic review
Chu, K.-H., Matheny, S. J., Escobar-Viera, C. G., Wessel, C., Notier, A. E., & Davis, E. M. (2021) · Addictive Behaviors · doi:10.1016/j.addbeh.2020.106616 · Cited by 43 · cited 1×
“Thus, it is impossible to extrapolate their findings to other mHealth apps that are not in the same subfield [11-13].”
BackgroundMarler, J. D., Fujii, C. A., Utley, D. S., Tesfamariam, L. J., Galanko, J. A., & Patrick, H. (2019) · JMIR mHealth and uHealth · doi:10.2196/12609 · Cited by 42 · cited 2×
“For example, mHealth apps created to support smoking cessation for adult smokers were more likely to be successful when participants were already highly motivated to stop smoking (eg, [18,40,72]).”
BackgroundBricker, J. B., Watson, N. L., Heffner, J. L., Sullivan, B., Mull, K., Kwon, D., Westmaas, J. L., & Ostroff, J. (2020) · JMIR Formative Research · doi:10.2196/16652 · Cited by 41
Johnston, D. C., Mathews, W. D., Maus, A., & Gustafson, D. H. (2019) · Substance Abuse Research and Treatment · doi:10.1177/1178221819861377 · Cited by 37 · cited 1×
“Refer to Figure 1 for the study selection flowchart and Multimedia Appendix 1 [4-8,17-73] for characteristics of the studies.”
BackgroundRudin, R. S., Fanta, C. H., Qureshi, N., Duffy, E., Edelen, M. O., Dalal, A. K., & Bates, D. W. (2019) · Applied Clinical Informatics · doi:10.1055/s-0039-1697597 · Cited by 37 · cited 1×
“Refer to Figure 1 for the study selection flowchart and Multimedia Appendix 1 [4-8,17-73] for characteristics of the studies.”
BackgroundDevelopment and evaluation of the See Me Smoke-Free multi-behavioral mHealth app for women smokers
Gordon, J. S., Armin, J., D. Hingle, M., Giacobbi, P., Cunningham, J. K., Johnson, T., Abbate, K., Howe, C. L., & Roe, D. J. (2017) · Translational Behavioral Medicine · doi:10.1007/s13142-017-0463-7 · Cited by 36 · cited 1×
“Refer to Figure 1 for the study selection flowchart and Multimedia Appendix 1 [4-8,17-73] for characteristics of the studies.”
BackgroundBetthauser, L. M., Stearns‐Yoder, K. A., McGarity, S., Smith, V., Place, S. S., & Brenner, L. A. (2020) · Journal of Medical Internet Research · doi:10.2196/15506 · Cited by 36 · cited 1×
“Refer to Figure 1 for the study selection flowchart and Multimedia Appendix 1 [4-8,17-73] for characteristics of the studies.”
BackgroundUsing the Habit App for Weight Loss Problem Solving: Development and Feasibility Study
Pagoto, S., Tulu, B., Agu, E., Waring, M. E., Oleski, J. L., & Jake-Schoffman, D. E. (2018) · JMIR mHealth and uHealth · doi:10.2196/mhealth.9801 · Cited by 33 · cited 1×
“Refer to Figure 1 for the study selection flowchart and Multimedia Appendix 1 [4-8,17-73] for characteristics of the studies.”
BackgroundPurkayastha, S., Addepally, S. A., & Bucher, S. (2019) · JMIR Human Factors · doi:10.2196/14146 · Cited by 33 · cited 1×
“Refer to Figure 1 for the study selection flowchart and Multimedia Appendix 1 [4-8,17-73] for characteristics of the studies.”
BackgroundUse of Mental Health Apps by Patients With Breast Cancer in the United States: Pilot Pre-Post Study
Chow, P. I., Showalter, S. L., Gerber, M., Kennedy, E. M., Brenin, D., Mohr, D. C., Lattie, E. G., Gupta, A., Ocker, G., & Cohn, W. F. (2020) · JMIR Cancer · doi:10.2196/16476 · Cited by 33 · cited 1×
“Refer to Figure 1 for the study selection flowchart and Multimedia Appendix 1 [4-8,17-73] for characteristics of the studies.”
BackgroundHoeppner, B. B., Hoeppner, S. S., Carlon, H. A., Perez, G. K., Helmuth, E., Kahler, C. W., & Kelly, J. F. (2019) · JMIR mhealth and uhealth · doi:10.2196/13436 · Cited by 31 · cited 2×
“For example, mHealth apps created to support smoking cessation for adult smokers were more likely to be successful when participants were already highly motivated to stop smoking (eg, [18,40,72]).”
BackgroundMerriam-Webster's Geographical Dictionary
Schmid, R., Hopkins, D. J., & Merriam-Webster (1998) · Taxon · doi:10.2307/1223820 · Cited by 30
Early weight loss in a standalone mHealth intervention predicting treatment success
Patel, M. L., Hopkins, C. M., & Bennett, G. G. (2019) · Obesity Science & Practice · doi:10.1002/osp4.329 · Cited by 28 · cited 1×
“Refer to Figure 1 for the study selection flowchart and Multimedia Appendix 1 [4-8,17-73] for characteristics of the studies.”
BackgroundEscobar-Viera, C. G., Zhou, Z., Morano, J. P., Lucero, R. J., Lieb, S., McIntosh, S., Clauson, K. A., & Cook, R. L. (2019) · JMIR mhealth and uhealth · doi:10.2196/14557 · Cited by 27 · cited 1×
“Refer to Figure 1 for the study selection flowchart and Multimedia Appendix 1 [4-8,17-73] for characteristics of the studies.”
BackgroundTrading pounds for points: Engagement and weight loss in a mobile health intervention
Hales, S. B., Turner‐McGrievy, G. M., Wilcox, S., Davis, R. E., Fahim, A., Huhns, M. N., & Valafar, H. (2017) · Digital Health · doi:10.1177/2055207617702252 · Cited by 24
Patrick, H., Fujii, C. A., Glaser, D. B., Utley, D. S., & Marler, J. D. (2018) · JMIR mhealth and uhealth · doi:10.2196/11708 · Cited by 21 · cited 1×
“Refer to Figure 1 for the study selection flowchart and Multimedia Appendix 1 [4-8,17-73] for characteristics of the studies.”
BackgroundEfficacy of Osteoporosis Prevention Smartphone App
Ryan, P. A., Brown, R., Csuka, M. E., & Papanek, P. E. (2019) · Nursing Research · doi:10.1097/nnr.0000000000000392 · Cited by 19 · cited 1×
“Refer to Figure 1 for the study selection flowchart and Multimedia Appendix 1 [4-8,17-73] for characteristics of the studies.”
BackgroundBruno, M., Wright, M., Baker, C. L., Emir, B., Carda, E., Clausen, M., Sigler, C., & Patel, A. (2018) · JMIR mhealth and uhealth · doi:10.2196/mhealth.9115 · Cited by 16
Sridharan, V., Shoda, Y., Heffner, J. L., & Bricker, J. B. (2019) · JMIR mhealth and uhealth · doi:10.2196/14602 · Cited by 16 · cited 1×
“Refer to Figure 1 for the study selection flowchart and Multimedia Appendix 1 [4-8,17-73] for characteristics of the studies.”
BackgroundKrzyzanowski, M. C., Kizakevich, P. N., Duren‐Winfield, V., Eckhoff, R., Hampton, J. C., Carr, L. T. B., McCauley, G., Roberson, K. B., Onsomu, E. O., Williams, J. P., et al. (2020) · JMIR mhealth and uhealth · doi:10.2196/15156 · Cited by 16 · cited 1×
“Refer to Figure 1 for the study selection flowchart and Multimedia Appendix 1 [4-8,17-73] for characteristics of the studies.”
BackgroundKelechi, T. J., Prentice, M. A., Mueller, M., Madisetti, M., & Vertegel, A. A. (2020) · JMIR mhealth and uhealth · doi:10.2196/15015 · Cited by 11 · cited 1×
“Refer to Figure 1 for the study selection flowchart and Multimedia Appendix 1 [4-8,17-73] for characteristics of the studies.”
BackgroundShah, S., Kemp, J. M., Kvedar, J. C., & Gracey, L. E. (2020) · International Journal of Women’s Dermatology · doi:10.1016/j.ijwd.2020.08.001 · Cited by 11 · cited 1×
“Refer to Figure 1 for the study selection flowchart and Multimedia Appendix 1 [4-8,17-73] for characteristics of the studies.”
Background
Cited by
The Metaverse: A New Challenge for the Healthcare System: A Scoping Review
Petrigna, L., & Musumeci, G. (2022) · Journal of Functional Morphology and Kinesiology · doi:10.3390/jfmk7030063 · Cited by 222
“Indeed, through real-time monitoring, the possibility of being part of an online community and being guided by experts around the world increases the possibility of attending fitness programs and adopting a healthy lifestyle [27].”
BackgroundDigital Mental Health Interventions for Depression: Scoping Review of User Engagement
Lipschitz, J. M., Van Boxtel, R., Torous, J., Firth, J., Lebovitz, J. G., Burdick, K. E., & Hogan, T. P. (2022) · Journal of Medical Internet Research · doi:10.2196/39204 · Cited by 105
“Finally, several recent reviews have explored variables related to user engagement with DMHIs [8,9,18].”
Park, D. Y., & Kim, H. (2023) · Sustainability · doi:10.3390/su15010872 · Cited by 150
“…use, there is the need for longitudinal research that assesses a relationship between intentions to use the content and continuous use, as well as factors—such as peer and coach support [112], incentives and reminders [113], and personalized content [114]—that might moderate the relationship.”
BackgroundWang, H., Zhang, J., Luximon, Y., Qin, M., Geng, P., & Tao, D. (2022) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph191710758 · Cited by 98
“Similarly, a recent literature review on users’ engagement and retention of mobile health apps [11] showed that retaining the users of MMPs was really challenging and many barriers (e.”
BackgroundOkolo, C. A., Babawarun, O., Arowoogun, J. O., Adeniyi, A. O., & Chidi, R. (2024) · International Journal of Science and Research Archive · doi:10.30574/ijsra.2024.11.1.0334 · Cited by 113
“Incentives can also be social in nature, such as allowing users to share their achievements with friends and family on social media (Amagai, et. al., 2022, Brower, et. al., 2020, Mahmood, et. al., 2019).”
Background
Metadata
- Authors
- Amagai, S., Pila, S., Kaat, A. J., Nowinski, C. J., & Gershon, R. C.
- Affiliations
- Northwestern University (US)
- Corresponding author
- Amagai, Saki
- Venue
- Journal of Medical Internet Research
- Publisher
- JMIR Publications Inc.
- Published
- 2022-04-26
- Volume
- 24
- Issue
- 4
- Pages
- e35120
- ISSN
- 1438-8871 (ISSN-L)
- PMC
- PMC9092233
- OpenAlex
- W4224941735
- Cited by
- 343
- References
- 74
- Citations by year
- 2026: 83 · 2025: 95 · 2024: 84 · 2023: 65 · 2022: 16
- FWCI
- 12.55
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- Journal of Medical Internet Research (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (acceptedVersion)
- Topics
- Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Health Sciences › Health Professions › Health Information Management › Health, Technology, Consumer Behavior
- Keywords
- mobile health apps, participant retention, participant engagement, participant dropout, attrition, feedback, reminders, peer support, coaching, compensation, technical challenges, retention strategies
- MeSH terms
- Adult, Humans, Telemedicine, Mobile Applications
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
