Predicting which type of push notification content motivates users to engage in a self-monitoring app
Open accessAbstract
Despite the unprecedented access to self-monitoring health apps, lack of optimal user engagement remains a significant challenge. Push notification prompts with contextually tailored messages offers a promising strategy to improve engagement. To increase the efficacy of push-notifications on engaging individuals with health apps, greater attention to the modifiable components of push notifications that influence responsiveness is needed. This study examines the effect of message content and frequency of push notifications, along with past app usage on responding to notifications within 24 h, and engaging with self-monitoring in JOOL Health smartphone app. Mixed models were applied on a de-identified data set of 18,000 contextually tailored push notifications sent by JOOL Health App to 1414 participants. The content in sent messages on behavioural topics were mapped into either tailored suggestions or tailored insights. Our findings suggest that push notifications with tailored suggestions were more effective overall in encouraging self-monitoring, but amongst frequent app users, push-notifications containing insights was associated with greater self-monitoring. People who were not using the app as frequently were less likely to respond to a prompt. This study suggests that push-notification content does have an impact on subsequent use of key app features, and app developers should consider what content is likely to work best for who, and under what circumstances. Secondary data-analysis of commercial apps presents a unique opportunity to elucidate and optimize health behaviors.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
External strategies such as automated reminders, therapist-led coaching, and moderated peer-support groups can be effective toward promoting engagement with digital interventions for mental health.
“There is already some promising research being done in this space, with several studies finding that external strategies such as automated reminders (13, 67), therapist-led coaching (68, 69), and moderated peer-support groups (70) can be effective toward promoting engagement with digital interventions for mental health.”
From Effect of Engagement With Digital Interventions on Mental Health Outcomes: A Systematic Review and Meta-Analysis (2021) · cites this paper as [67]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
The Transtheoretical Model of Health Behavior Change.
Prochaska, J. O., & Velicer, W. F. (1997) · American Journal of Health Promotion · doi:10.4278/0890-1171-12.1.38 · Cited by 7,782 · see citing works
Linear Mixed-Effects Models using 'Eigen' and S4
Bates, D. M., Maechler, M., Bolker, B. M., & Walker, S. C. (2015) · Cited by 5,924 · see citing works
Webb, T. L., Joseph, J., Yardley, L., & Michie, S. (2010) · Journal of Medical Internet Research · doi:10.2196/jmir.1376 · Cited by 2,517 · see citing works
lme4: Linear Mixed-Effects Models using 'Eigen' and S4
Bates, D. M., Maechler, M., Bolker, B. M., Walker, S. C., Ly, A., & Jagan, M. (2003) · doi:10.32614/cran.package.lme4 · Cited by 2,389 · see citing works
Effective techniques in healthy eating and physical activity interventions: A meta-regression.
Michie, S., Abraham, C., Whittington, C., McAteer, J., & Gupta, S. (2009) · Health Psychology · doi:10.1037/a0016136 · Cited by 2,229 · see citing works
Perski, O., Blandford, A., West, R., & Michie, S. (2017) · Translational Behavioral Medicine · doi:10.1007/s13142-016-0453-1 · Cited by 1,193 · see citing works
Understanding and Promoting Effective Engagement With Digital Behavior Change Interventions
Yardley, L., Spring, B. J., Riper, H., Morrison, L. G., Crane, D. H., Curtis, K., Merchant, G. C., Naughton, F., & Blandford, A. (2016) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2016.06.015 · Cited by 1,118 · see citing works
One size does not fit all: the case for tailoring print materials
Kreuter, M. W., Strecher, V. J., & Glassman, B. (1999) · Annals of Behavioral Medicine · doi:10.1007/bf02895958 · Cited by 831 · see citing works
Self-citationCan Mobile Phone Apps Influence People’s Health Behavior Change? An Evidence Review
Zhao, J., Freeman, B., & Li, M. (2016) · Journal of Medical Internet Research · doi:10.2196/jmir.5692 · Cited by 618 · see citing works
Olander, E. K., Fletcher, H., Williams, S. L., Atkinson, L., Turner, A., & French, D. (2013) · International Journal of Behavioral Nutrition and Physical Activity · doi:10.1186/1479-5868-10-29 · Cited by 595 · see citing works
Does monitoring goal progress promote goal attainment? A meta-analysis of the experimental evidence.
Harkin, B., Webb, T. L., Chang, B. P. I., Prestwich, A., Conner, M., Kellar, I., Benn, Y., & Sheeran, P. (2016) · Psychological Bulletin · doi:10.1037/bul0000025 · Cited by 564 · see citing works
Apps to promote physical activity among adults: a review and content analysis
Middelweerd, A., Mollee, J. S., van der Wal, C. N., Brug, J., & te Velde, S. J. (2014) · International Journal of Behavioral Nutrition and Physical Activity · doi:10.1186/s12966-014-0097-9 · Cited by 546 · see citing works
Who uses mobile phone health apps and does use matter? A secondary data analytics approach
Carroll, J. K., Moorhead, A., Bond, R., LeBlanc, W. G., Petrella, R. J., & Fiscella, K. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.5604 · Cited by 540 · see citing works
French, D., Olander, E. K., Chisholm, A., & McSharry, J. (2014) · Annals of Behavioral Medicine · doi:10.1007/s12160-014-9593-z · Cited by 531 · see citing works
Fry, J. P., & Neff, R. A. (2009) · Journal of Medical Internet Research · doi:10.2196/jmir.1138 · Cited by 447 · see citing works
Kauer, S. D., Reid, S. C., Crooke, A. H. D., Khor, A., Hearps, S. J. C., Jorm, A. F., Sanci, L., & Patton, G. (2012) · Journal of Medical Internet Research · doi:10.2196/jmir.1858 · Cited by 404 · see citing works
iPhone Apps for Smoking Cessation
Abroms, L. C., Padmanabhan, N., Thaweethai, L., & Phillips, T. (2011) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2010.10.032 · Cited by 365 · see citing works
An in-situ study of mobile phone notifications
Pielot, M., Church, K., & de Oliveira, R. C. (2014) · International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI) · doi:10.1145/2628363.2628364 · Cited by 356 · see citing works
Bardus, M., van Beurden, S. B., Smith, J. R., & Abraham, C. (2016) · International Journal of Behavioral Nutrition and Physical Activity · doi:10.1186/s12966-016-0359-9 · Cited by 350 · see citing works
The Effectiveness of Prompts to Promote Engagement With Digital Interventions: A Systematic Review
Alkhaldi, G., Hamilton, F. L., Lau, R., Webster, R., Michie, S., & Murray, E. (2016) · Journal of Medical Internet Research · doi:10.2196/jmir.4790 · Cited by 273 · see citing works
Hartmann‐Boyce, J., Johns, D. J., Jebb, S. A., Aveyard, P. N., & Behavioural Weight Management Review Group (2014) · Obesity Reviews · doi:10.1111/obr.12165 · Cited by 219 · see citing works
Designing content-driven intelligent notification mechanisms for mobile applications
Mehrotra, A., Musolesi, M., Hendley, R., & Pejović, V. (2015) · ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp) · doi:10.1145/2750858.2807544 · Cited by 186 · see citing works
Morrison, L. G., Hargood, C., Pejovic, V., Geraghty, A. W. A., Lloyd, S., Goodman, N., Michaelides, D. T., Weston, A., Musolesi, M., Weal, M. J., et al. (2017) · PLoS ONE · doi:10.1371/journal.pone.0169162 · Cited by 162 · see citing works
Effects of content and time of delivery on receptivity to mobile interruptions
Fischer, J. E., Yee, N., Bellotti, V. M. E., Good, N., Benford, S., & Greenhalgh, C. (2010) · International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI) · doi:10.1145/1851600.1851620 · Cited by 148 · see citing works
Brouwer, W., Oenema, A., Raat, H., Crutzen, R., de Nooijer, J., de Vries, N. K., & Brug, J. (2010) · Health Education Research · doi:10.1093/her/cyp063 · Cited by 147 · cited 1× · see citing works
“Age, gender and BMI were speci fi ed as covariates as women, people with lower BMI, higher education level and age are more likely to engage with online lifestyle interventions (Brouwer et al., 2010; Schneider et al., 2012).”
BackgroundMuench, F. J., & Baumel, A. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.7463 · Cited by 138 · see citing works
Evaluating the Impact of Physical Activity Apps and Wearables: Interdisciplinary Review
McCallum, C., Rooksby, J., & Gray, C. M. (2018) · JMIR mhealth and uhealth · doi:10.2196/mhealth.9054 · Cited by 126 · see citing works
Bylund, M., Juhlin, O., & Fernaeus, Y. (2011) · doi:10.1145/2037373 · Cited by 116 · see citing works
Hingle, M. D., & Patrick, H. (2016) · Journal of Nutrition Education and Behavior · doi:10.1016/j.jneb.2015.12.009 · Cited by 101 · see citing works
Characterizing Periodic Messaging Interventions Across Health Behaviors and Media: Systematic Review
León, E. D., Fuentes, L. W., & Cohen, J. E. (2014) · Journal of Medical Internet Research · doi:10.2196/jmir.2837 · Cited by 81 · see citing works
Quigley, A. J., Diamond, S. L., Irani, P., & Subramanian, S. (2014) · Human-Computer Interaction with Mobile Devices and Services · Cited by 71 · see citing works
Characterizing user engagement with health app data: a data mining approach
Serrano, K. J., Coa, K. I., Yu, M., Wolff-Hughes, D. L., & Atienza, A. A. (2017) · Translational Behavioral Medicine · doi:10.1007/s13142-017-0508-y · Cited by 67 · see citing works
Schneider, F., van Osch, L., Schulz, D. N., Kremers, S., & de Vries, H. (2012) · Journal of Medical Internet Research · doi:10.2196/jmir.1939 · Cited by 59 · see citing works
Schneider, F., de Vries, H., Candel, M. J. J. M., van de Kar, A., & van Osch, L. (2013) · Journal of Medical Internet Research · doi:10.2196/jmir.2151 · Cited by 58 · see citing works
Carter, M. C., Burley, V. J., & Cade, J. E. (2017) · JMIR mhealth and uhealth · doi:10.2196/mhealth.4520 · Cited by 50 · see citing works
Rahman, Q. A., Janmohamed, T., Pirbaglou, M., Ritvo, P., Heffernan, J. M., Clarke, H. A., & Katz, J. D. (2017) · JMIR mhealth and uhealth · doi:10.2196/mhealth.7871 · Cited by 47 · see citing works
Kim, J. Y., Wineinger, N. E., Taitel, M., Radin, J. M., Akinbosoye, O., Jiang, J., Nikzad, N., Orr, G., Topol, E., & Steinhubl, S. (2016) · Journal of Medical Internet Research · doi:10.2196/jmir.6371 · Cited by 37 · see citing works
Jones, M., Tscheligi, M., Rogers, Y., & Murray‐Smith, R. (2017) · doi:10.1145/3098279 · Cited by 34 · see citing works
Push Notifications in Diet Apps: Influencing Engagement Times and Tasks
Freyne, J., Yin, J., Brindal, E., Hendrie, G. A., Berkovsky, S., & Noakes, M. (2017) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2017.1278896 · Cited by 28 · see citing works
Conversational context helps improve mobile notification management
Schulze, F., & Groh, G. (2016) · International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI) · doi:10.1145/2935334.2935347 · Cited by 21 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Gan, D. Z. Q., McGillivray, L., Han, J., Christensen, H., & Torok, M. (2021) · Frontiers in Digital Health · doi:10.3389/fdgth.2021.764079 · Cited by 305 · see citing works
Goldstein, S. P., Zhang, F., Klasnja, P., Hoover, A., Wing, R. R., & Thomas, J. G. (2021) · JMIR Research Protocols · doi:10.2196/33568 · Cited by 26 · see citing works
- Authors
- Bidargaddi, N., Pituch, T., Maaieh, H., Short, C., & Strecher, V.
- Affiliations
- Flinders University (AU)
- Freemasons Foundation Centre for Men's Health (AU)
- University of Michigan (US)
- Corresponding author
- Bidargaddi, N.
- Venue
- Preventive Medicine Reports
- Publisher
- Elsevier BV
- Published
- 2018-09
- Volume
- 11
- Pages
- 267-273
- ISSN
- 2211-3355 (ISSN-L)
- PMC
- PMC6080195
- OpenAlex
- W2887089341
- Cited by
- 77
- References
- 41
- Citations by year
- 2026: 6 · 2025: 8 · 2024: 9 · 2023: 11 · 2022: 11 · 2021: 18 · 2020: 10 · 2019: 4
- FWCI
- 12.22
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Preventive Medicine Reports (publishedVersion, cc-by-nc-nd)
- Europe PMC (PubMed Central) (publishedVersion, cc-by-nc-nd)
- PubMed Central (publishedVersion, cc-by-nc-nd)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Flinders Academic Commons (Flinders University) (submittedVersion, other-oa)
- Flinders Academic Commons (Flinders University) (submittedVersion, cc-by-nc-nd)
- Minerva Access (University of Melbourne) (submittedVersion, cc-by-nc-nd)
- Topics
- Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
- Physical Sciences › Computer Science › Human-Computer Interaction › Innovative Human-Technology Interaction
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Keywords
- push notifications, self-monitoring, health apps, user engagement, message content, app usage frequency
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
