Understanding Health Behavior Technology Engagement: Pathway to Measuring Digital Behavior Change Interventions
Open accessThe DOI matches its Crossref record; 28 of the 29 references it cites were found in a registry or an index; 3 of the 18 sources its claims cite were checked for support.
Abstract
Researchers and practitioners of digital behavior change interventions (DBCI) use varying and, often, incongruent definitions of the term “engagement,” thus leading to a lack of precision in DBCI measurement and evaluation. The objective of this paper is to propose discrete definitions for various types of user engagement and to explain why precision in the measurement of these engagement types is integral to ensuring the intervention is effective for health behavior modulation. Additionally, this paper presents a framework and practical steps for how engagement can be measured in practice and used to inform DBCI design and evaluation. The key purpose of a DBCI is to influence change in a target health behavior of a user, which may ultimately improve a health outcome. Using available literature and practice-based knowledge of DBCI, the framework conceptualizes two primary categories of engagement that must be measured in DBCI. The categories are health behavior engagement, referred to as “Big E,” and DBCI engagement, referred to as “Little e.” DBCI engagement is further bifurcated into two subclasses: (1) user interactions with features of the intervention designed to encourage frequency of use (ie, simple login, games, and social interactions) and make the user experience appealing, and (2) user interactions with behavior change intervention components (ie, behavior change techniques), which influence determinants of health behavior and subsequently influence health behavior. Achievement of Big E in an intervention delivered via digital means is contingent upon Little e. If users do not interact with DBCI features and enjoy the user experience, exposure to behavior change intervention components will be limited and less likely to influence the behavioral determinants that lead to health behavior engagement (Big E). Big E is also dependent upon the quality and relevance of the behavior change intervention components within the solution. Therefore, the combination of user interactions and behavior change intervention components creates Little e, which is, in turn, designed to improve Big E. The proposed framework includes a model to support measurement of DBCI that describes categories of engagement and details how features of Little e produce Big E. This framework can be applied to DBCI to support various health behaviors and outcomes and can be utilized to identify gaps in intervention efficacy and effectiveness.
Overview
CoChat Summary
## TL;DR
This paper argues that digital behavior change interventions (DBCI) need precise, separate measures of engagement with the digital tool and engagement with the target health behavior. It proposes a framework with “Little e” (DBCI engagement) and “Big E” (health behavior engagement) to improve measurement, analysis, and optimization of DBCI.
## Key findings
- The paper states there is no universally accepted and comprehensive definition of engagement, which contributes to inconsistent DBCI measurement and evaluation.
- It proposes two primary engagement categories: “Big E” for engagement with the targeted health behavior, and “Little e” for engagement with the digital intervention itself; Little e is further split into little eUI and little eBCT.
- The framework is intended to support measurement of the causal pathway exposure to the intervention → determinants → behavior → health outcomes, and to help identify which behavior change techniques (BCTs) are linked to which behaviors and outcomes.
- The paper notes that the “Big E” outcome is contingent upon “Little e”: if users do not interact with DBCI features, exposure to BCTs is less likely to influence determinants and health behavior engagement.
## Methods
- The paper is a framework and conceptual analysis paper, not an empirical intervention trial.
- The authors report that they reviewed several definitions of engagement from the literature and practice-based DBCI knowledge to identify limitations and develop new definitions.
- They then used market research, economic evaluation, subject matter expertise, behavior science literature, and intervention mapping literature to build a hybrid model drawing on a theory of change conceptual model and a traditional logic model.
## Limitations
- The paper states that definitions based only on user interactions are limited because they assume interaction leads to outcomes, and they do not distinguish meaningful online versus offline interactions or identify unique interaction sequences tied to specific BCTs.
- The paper notes that an a priori theory approach is limited because researchers are restricted to the behavior change pathways originally planned, so new or emerging change processes may be missed.
- Evident from the text: the paper is conceptual rather than empirical, so it does not provide outcome data from a tested intervention; this limits direct evidence for the framework’s effectiveness.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures



Verification
Claims the paper makes
2 Valid · 1 Not valid · 13 Not checked · 20 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“First, there is a limited and inconsistent understanding of the engagement’s specific impact, particularly on DBCI effect size, attrition, and sustained health behaviors [4].”
§ Understanding Health Behavior Technology Engagement: Pathway to Measuring Digital Behavior Change Interventions > Introduction > Analysis of Current Definitions of Engagement in Literature
What the sources say
- Partly supportedcites [4] sourceExperimental — accuracy not yet measured
The Discussion (page unavailable) reports inconsistent exposure measures and says this limited the ability to pool studies; the Introduction links repeat visits to sustainable change and notes that visitors often leave interventions early. The paper does not establish that a lack of a universally accepted definition of engagement causes this uncertainty, nor does it assess engagement’s specific impact on DBCI effect size, attrition, and sustained health behaviors. (LLM, conf=0.84)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The absence of a standardized DBCI framework for defining and measuring engagement inhibits the ability to understand the mechanisms of action of an intervention.”
§ Understanding Health Behavior Technology Engagement: Pathway to Measuring Digital Behavior Change Interventions > Introduction > Analysis of Current Definitions of Engagement in Literature
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
In the paper
“This is a significant limitation because data needed to update features of the intervention are absent; thus, future optimization and cost-saving processes informed by evidence will be nearly impossible [13].”
§ Understanding Health Behavior Technology Engagement: Pathway to Measuring Digital Behavior Change Interventions > Introduction > Analysis of Current Definitions of Engagement in Literature
What the sources say
- Not checked yetcites [13] West, R, 2016, A guide to development and evaluation of digital behavior interventions in healthcare
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
In the paper
“It is generally accepted that user engagement with DBCI is a precursor to improved health outcomes.”
§ Understanding Health Behavior Technology Engagement: Pathway to Measuring Digital Behavior Change Interventions > Introduction > Analysis of Current Definitions of Engagement in Literature
What the sources say
- Not checked yetcites [5] source
boostedstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Definitions of engagement based on behavior performance parameters only do not provide details of user interactions with components of a digital intervention.”
§ Understanding Health Behavior Technology Engagement: Pathway to Measuring Digital Behavior Change Interventions > Introduction > Analysis of Current Definitions of Engagement in Literature
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
8 more claims
Create a free account to see all 36 claims and to verify the 15 references still open.
- Probably not a substantial claim. 16
- It may state two separate claims as one. 9
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Nonetheless, ECA use does decline over time, limiting long-term health effects [1,14-17].”
From Use and Effect of Embodied Conversational Agents for Improving Eating Behavior and Decreasing Loneliness Among Community-Dwelling Older Adults: Randomized Controlled Trial (2022) · cites this paper as [17]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Digital interventions have the potential to evoke changes unavailable in traditional methods because of the ability to design personalized treatment models and measure engagement [28-30].”
From A Digital Mental Health Support Program for Depression and Anxiety in Populations With Attention-Deficit/Hyperactivity Disorder: Feasibility and Usability Study (2023) · cites this paper as [28]
Experimental — accuracy not yet measured
Citations
Cites
Ryan, R. M., & Deci, E. L. (2000) · American Psychologist · doi:10.1037//0003-066x.55.1.68 · Cited by 54,599
Kytle, J., & Bandura, A. (1978) · Contemporary Sociology · doi:10.2307/2065952 · Cited by 25,422
Michie, S., Richardson, M., Johnston, M., Abraham, C., Francis, J., Hardeman, W., Eccles, M. P., Cane, J., & Wood, C. E. (2013) · Annals of Behavioral Medicine · doi:10.1007/s12160-013-9486-6 · Cited by 7,629
Ecological momentary assessment
Shiffman, S., Stone, A. A., & Hufford, M. R. (2008) · Annual Review of Clinical Psychology · doi:10.1146/annurev.clinpsy.3.022806.091415 · Cited by 6,454
Moral Identity and Developmental Theory
Lapsley, D. (2015) · Human Development · doi:10.1159/000435926 · Cited by 3,819
The Technology Acceptance Model: Its past and its future in health care
Holden, R. J., & Karsh, B.-T. (2010) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2009.07.002 · Cited by 2,669
Health behavior : theory, research, and practice
Glanz, K., Rimer, B. K., & Viswanath, K. (2015) · Cited by 2,218
Planning Health Promotion Programs: An Intervention Mapping Approach
Hicking-Woodison, L. (2017) · Nursing Standard · doi:10.7748/ns.32.6.33.s38 · Cited by 1,841
What is user engagement? A conceptual framework for defining user engagement with technology
O'Brien, H. L., & Toms, E. G. (2008) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.20801 · Cited by 1,397
Understanding and Promoting Effective Engagement With Digital Behavior Change Interventions
Yardley, L., Spring, B. J., Riper, H., Morrison, L. G., Crane, D. H., Curtis, K., Merchant, G. C., Naughton, F., & Blandford, A. (2016) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2016.06.015 · Cited by 1,118
Research works printed but not linked: 4
- West, R, 2016, A guide to development and evaluation of digital behavior interventions in healthcare
- Jackson, C, 2014, European Health Psychologist, 16, 7
- Bandura, A, 1986, Social foundations of thought and action: A social cognitive theory
- Nunnally, J, 1978, Psychometric Theory
Cited by
Digital Interventions on Healthy Lifestyle Management: Systematic Review
Chatterjee, A., Prinz, A., Gerdes, M., & Martinez, S. (2021) · Journal of Medical Internet Research · doi:10.2196/26931 · Cited by 194
Rethinking (Dis)Engagement in Human-Computer Interaction
O'Brien, H. L., Roll, I., Kampen, A., & Davoudi, N. (2022) · Computers in Human Behavior · doi:10.1016/j.chb.2021.107109 · Cited by 139
Eaton, C. K., Vallejo, N., McDonald, X., Wu, J., Rodríguez, R., Muthusamy, N., Mathioudakis, N. N., & Riekert, K. A. (2024) · Journal of Medical Internet Research · doi:10.2196/50508 · Cited by 139
Mclaughlin, M., Delaney, T., Hall, A., Byaruhanga, J., Mackie, P., Grady, A., Reilly, K., Campbell, E., Sutherland, R., Wiggers, J., et al. (2021) · Journal of Medical Internet Research · doi:10.2196/23180 · Cited by 105
Voorheis, P., Zhao, A., Kuluski, K., Pham, Q., Scott, T., Sztur, P., Khanna, N., Ibrahim, M., & Petch, J. (2022) · JMIR mHealth and uHealth · doi:10.2196/35799 · Cited by 94
Liu, R., Menhas, R., & Saqib, Z. A. (2024) · Frontiers in Psychology · doi:10.3389/fpsyg.2024.1349880 · Cited by 118
Online Well-Being Group Coaching Program for Women Physician Trainees: A Randomized Clinical Trial
Mann, A., Shah, A. N., Thibodeau, P. S., Dyrbye, L. N., Syed, A., Woodward, M. A., Thurmon, K., Jones, C. D., Dunbar, K. S., & Fainstad, T. L. (2023) · JAMA Network Open · doi:10.1001/jamanetworkopen.2023.35541 · Cited by 87
Milne-Ives, M., Homer, S. R., Andrade, J., & Meinert, E. (2023) · Frontiers in Psychology · doi:10.3389/fpsyg.2023.1227443 · Cited by 69
O'Brien, H. L., Morton, E., Kampen, A., Barnes, S. J., & Michalak, E. E. (2020) · BJPsych Open · doi:10.1192/bjo.2020.72 · Cited by 57
The use of AI in mental health services to support decision-making: scoping review
Auf, H., Svedberg, P., Nygren, J., Nair, M., & Lundgren, L. E. (2025) · Journal of Medical Internet Research · doi:10.2196/63548 · Cited by 56
Peng, M. Y., & Yan, X. (2022) · Frontiers in Psychology · doi:10.3389/fpsyg.2022.852394 · Cited by 79
Balaji, D., He, L., Giani, S., Bosse, T., Wiers, R., & de Bruijn, G.-J. (2022) · Sexual Health · doi:10.1071/sh22016 · Cited by 44
Mclaughlin, M., Delaney, T., Hall, A., Byaruhanga, J., Mackie, P., Grady, A., Reilly, K., Campbell, E., Sutherland, R., Wiggers, J., et al. (2021) · Journal of Medical Internet Research · doi:10.2196/29094 · Cited by 45
Blasiak, A., Sapanel, Y., Leitman, D., Ng, W. Y., Nicola, R. D., Lee, V. V., Todorov, A., & Ho, D. (2022) · Journal of Medical Internet Research · doi:10.2196/41463 · Cited by 53
A meta-analysis of persuasive design, engagement, and efficacy in 92 RCTs of mental health apps
Valentine, L., Hinton, J. D. X., Bajaj, K., Boyd, L., O’Sullivan, S., Sorenson, R. P., Bell, I., Vega, M. S., Liu, P., Peters, W., et al. (2025) · npj Digital Medicine · doi:10.1038/s41746-025-01567-5 · Cited by 56
Bucher, A., Blazek, E. S., & Symons, C. T. (2024) · Mayo Clinic Proceedings Digital Health · doi:10.1016/j.mcpdig.2024.05.007 · Cited by 48
Flaherty, S. J., McCarthy, M. B., Collins, A., McCafferty, C., & McAuliffe, F. M. (2021) · European Journal of Marketing · doi:10.1108/ejm-06-2019-0531 · Cited by 41
Schwarz, A. F., Winkens, L. H. H., de Vet, E., Ossendrijver, D., Bouwsema, K., & Simons, M. (2022) · JMIR mhealth and uhealth · doi:10.2196/40898 · Cited by 45
Just-in-time adaptive intervention to promote fluid consumption in patients with kidney stones.
Conroy, D. E., West, A. B., Brunke-Reese, D., Thomaz, E., & Streeper, N. M. (2020) · Health Psychology · doi:10.1037/hea0001032 · Cited by 38
Voorheis, P., Petch, J., Phạm, Q., & Kuluski, K. (2023) · PLOS Digital Health · doi:10.1371/journal.pdig.0000213 · Cited by 46
Giovanelli, A., Rowe, J., Taylor, M., Berna, M. S., Tebb, K., Penilla, C., Pugatch, M., Lester, J. C., & Ozer, E. M. (2023) · Journal of Medical Internet Research · doi:10.2196/40306 · Cited by 41
The conceptualisation and measurement of engagement in digital health
Milne‐Ives, M., Homer, S. R., Andrade, J., & Meinert, E. (2024) · Internet Interventions · doi:10.1016/j.invent.2024.100735 · Cited by 41
Adu, M. D., Malabu, U. H., Malau‐Aduli, A. E. O., Drovandi, A. D., & Malau‐Aduli, B. S. (2020) · JMIR mhealth and uhealth · doi:10.2196/17802 · Cited by 46
Kramer, L. L., van Velsen, L., Clark, J. L., Mulder, B. C., & de Vet, E. (2022) · JMIR Formative Research · doi:10.2196/33974 · Cited by 31
Williams, K. R., Markwardt, S., Kearney, S. M., Karp, J. F., Kraemer, K. L., Park, M. J., Freund, P., Watson, A. R., Schuster, J., & Beckjord, E. B. (2021) · JMIR mhealth and uhealth · doi:10.2196/23498 · Cited by 32
Baumel, A., & Muench, F. J. (2021) · Journal of Medical Internet Research · doi:10.2196/24905 · Cited by 32
Auster‐Gussman, L. A., Lockwood, K. G., Graham, S. A., Pitter, V., & Branch, O. H. (2022) · Frontiers in Digital Health · doi:10.3389/fdgth.2022.886783 · Cited by 34
User engagement in mobile apps for people with schizophrenia: A scoping review
de Almeida, R. S., & Marques, A. J. (2023) · Frontiers in Digital Health · doi:10.3389/fdgth.2022.1023592 · Cited by 35
Associations between Digital Health Intervention Engagement and Dietary Intake: A Systematic Review
Delaney, T. M., McLaughlin, M. J., Hall, A. E., Yoong, S. L., Brown, A., O’Brien, K. M., Dray, J., Barnes, C., Hollis, J., Wyse, R., et al. (2021) · Nutrients · doi:10.3390/nu13093281 · Cited by 27
Arigo, D., Jake‐Schoffman, D. E., & Pagoto, S. (2024) · Journal of Behavioral Medicine · doi:10.1007/s10865-024-00526-x · Cited by 32
Nelson, L. A., Spieker, A. J., Mayberry, L. S., McNaughton, C., & Greevy, R. A. (2021) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocab254 · Cited by 23
Kramer, L. L., Mulder, B. C., van Velsen, L., & de Vet, E. (2021) · JMIR Research Protocols · doi:10.2196/22186 · Cited by 23
Willis, M., Hein, L. B., Hu, Z., Saran, R., Argentina, M., Bragg‐Gresham, J. L., Krein, S. L., Gillespie, B. W., Zheng, K., & Veinot, T. C. (2021) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocab033 · Cited by 24
Mancinelli, E., Bassi, G., Gabrielli, S., & Salcuni, S. (2022) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph19159549 · Cited by 21
Morton, E. E., Nicholas, J., Lapadat, L., O'Brien, H. L., Barnes, S. J., Poh, C., & Michalak, E. E. (2021) · Journal of Affective Disorders · doi:10.1016/j.jad.2021.08.132 · Cited by 28
Jesuthasan, J., Low, M., & Ong, T. (2022) · Frontiers in Digital Health · doi:10.3389/fdgth.2022.846375 · Cited by 23
Nardi, W. R., Roy, A., DUNSIGER, S. I., & Brewer, J. A. (2022) · Journal of Medical Internet Research · doi:10.2196/33696 · Cited by 22
An Integrative Engagement Model of Digital Psychotherapy: Exploratory Focus Group Findings
Zech, J. M., Johnson, M., Pullmann, M. D., Hull, T. D., Althoff, T., Munson, S. A., Fridling, N., Litvin, B., Wu, J., & Areán, P. A. (2023) · JMIR Formative Research · doi:10.2196/41428 · Cited by 20
Weiner, L. S., Crowley, R. N., Sheeber, L., Koegler, F. H., Davis, J. F., Wells, M., Funkhouser, C. J., Auerbach, R. P., & Allen, N. B. (2024) · JMIR Mental Health · doi:10.2196/51366 · Cited by 24
Sporrel, K., Wang, S., Ettema, D., Nibbeling, N., Kröse, B., Deutekom, M. D. L. F., Boer, R. D., & Simons, M. (2022) · JMIR Formative Research · doi:10.2196/35268 · Cited by 20
Lee, S., Jeong, J.-H., Kim, M., Lee, S., Kim, S.-P., & Jung, D. (2025) · JMIR mhealth and uhealth · doi:10.2196/53133 · Cited by 25
Eiselt, A.-K., Kirkendall, S., Xiong, E., Langner, D., & Goldfarb, M. B. (2026) · Frontiers in Digital Health · doi:10.3389/fdgth.2025.1713334 · Cited by 21
Digital Behavioral Activation Interventions During the Perinatal Period: Scoping Review
Mancinelli, E., Dell’Arciprete, G., Pattarozzi, D., Gabrielli, S., & Salcuni, S. (2023) · JMIR Pediatrics and Parenting · doi:10.2196/40937 · Cited by 20
Voorheis, P., Bhuiya, A. R., Kuluski, K., Phạm, Q., & Petch, J. (2023) · Journal of Medical Internet Research · doi:10.2196/45095 · Cited by 26
Saksono, H., & Parker, A. G. (2024) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3674504 · Cited by 19
Hui, C. Y., McKinstry, B., McLean, S., Buchner, M., & Pinnock, H. (2022) · JAMIA Open · doi:10.1093/jamiaopen/ooac110 · Cited by 16
Nudge goes to Silicon Valley: designing for the disengaged and the irrational
Doyuran, E. B. (2023) · Journal of Cultural Economy · doi:10.1080/17530350.2023.2261485 · Cited by 19
Beinema, T. C., den Akker, H. O., Hurmuz, M. Z. M., Jansen-Kosterink, S. M., & Hermens, H. J. (2022) · Internet Interventions · doi:10.1016/j.invent.2022.100502 · Cited by 18
Ross, J., Hawkes, R. E., Miles, L. M., Cotterill, S., Bower, P., & Murray, E. (2023) · Journal of Medical Internet Research · doi:10.2196/47436 · Cited by 14
Lawrence, K. S., Rodriguez, D. V., Feldthouse, D. M., Shelley, D., Yu, J. L., Belli, H. M., González, J., Tasneem, S., Fontaine, J., Groom, L. L., et al. (2021) · JMIR Research Protocols · doi:10.2196/26750 · Cited by 18
Oppezzo, M., Tremmel, J. A., Kapphahn, K., Desai, M., Baiocchi, M., Sanders, M., & Prochaska, J. J. (2021) · Internet Interventions · doi:10.1016/j.invent.2021.100426 · Cited by 14
Ah, D. M. V., Crouch, A., & Storey, S. (2023) · Cancer Medicine · doi:10.1002/cam4.5904 · Cited by 16
Tsirmpas, C., Nikolakopoulou, M., Kaplow, S., Andrikopoulos, D., Fatouros, P., Kontoangelos, K., & Papageorgiou, C. (2023) · JMIR Formative Research · doi:10.2196/48362 · Cited by 11
Abdulrahman, A., & Richards, D. (2021) · Multimodal Technologies and Interaction · doi:10.3390/mti5090056 · Cited by 11
Hooker, S. A., Crain, A. L., Muegge, J., Rossom, R. C., Pronk, N. P., Pasumarthi, D. P., Kunisetty, G., & Masters, K. S. (2024) · JMIR Formative Research · doi:10.2196/55722 · Cited by 13
User Engagement in an Online Digital Health Intervention to Promote Problem Solving
O'Brien, H. L., Chen, A., Kaneshiro, J., & Zaslavsky, O. (2024) · Interacting with Computers · doi:10.1093/iwc/iwae030 · Cited by 13
Gosetto, L., Falquet, G., & Ehrler, F. (2025) · PLOS Digital Health · doi:10.1371/journal.pdig.0000978 · Cited by 13
Magee, M. R., Gholamrezaei, A., McNeilage, A. G., Sim, A., Dwyer, L., Ferreira, M. L., Darnall, B. D., Glare, P. A., & Ashton-James, C. E. (2022) · JMIR Formative Research · doi:10.2196/40507 · Cited by 12
Pritwani, S., Girotra, S., Shrivastava, P., Kumar, A., Swamy, A. M., Batra, S., Sharma, N., John, R., Praveen, D., Gara, S., et al. (2024) · BMC Musculoskeletal Disorders · doi:10.1186/s12891-024-08003-x · Cited by 13
Rad, D., & Rad, G. (2021) · Technium Social Sciences Journal · doi:10.47577/tssj.v21i1.3950 · Cited by 11
Milne‐Ives, M., Homer, S. R., Andrade, J., & Meinert, E. (2021) · JMIR Research Protocols · doi:10.2196/35172 · Cited by 14
Serio, C. D., Gabarda, A., Uyar-Morency, F., Silfee, V., Ludwig, J. M., Szigethy, E., & Butterworth, S. W. (2022) · JMIR Formative Research · doi:10.2196/34552 · Cited by 12
Robinson, S. A., Bamonti, P. M., Richardson, C. R., Kadri, R., & Moy, M. L. (2023) · The Journal of Rural Health · doi:10.1111/jrh.12765 · Cited by 10
Hocking, J., Maeder, A., Powers, D. M. W., Perimal‐Lewis, L., Dodd, B., & Lange, B. S. (2023) · Clinical Rehabilitation · doi:10.1177/02692155231216615 · Cited by 10
Torre, S. A. D. L., Mistiri, M. E., Hekler, E. B., Predrag, K., Marlin, B. M., Pavel, M., Spruijt‐Metz, D., & Rivera, D. E. (2024) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2024.104721 · Cited by 11
Michalak, E. E., Barnes, S. J., Morton, E. E., O'Brien, H. L., Murray, G., Hole, R., & Meyer, D. (2022) · JMIR Research Protocols · doi:10.2196/36213 · Cited by 12
Look who's talking: appearance of embodied conversational agents in eHealth
ter Stal, S. (2021) · doi:10.3990/1.9789036551267 · Cited by 12
Herrijgers, C., Verboon, P., Florence, É., Vandebosch, H., Poels, K., & Platteau, T. (2024) · JMIR Formative Research · doi:10.2196/56606 · Cited by 9
Trivedi, R., Laranjo, L., Marschner, S. L., Thiagalingam, A., Thomas, S. P., Kumar, S., Shaw, T. J., & Chow, C. K. (2025) · JMIR Cardio · doi:10.2196/64326 · Cited by 12
Conroy, D. E., Yang, C., Lanza, S. T., Smyth, J. M., & Lagoa, C. M. (2020) · JMIR mhealth and uhealth · doi:10.2196/14270 · Cited by 8
Sanchez-Flack, J., Buscemi, J., O’Donnell, A. J., Withington, M. H. C., & Fitzgibbon, M. (2021) · Frontiers in Digital Health · doi:10.3389/fdgth.2021.687648 · Cited by 9
Fontil, V., Khoong, E. C., Green, B. B., Ralston, J. D., Zhou, C., Garcia, F., McCulloch, C. E., Sarkar, U., & Lyles, C. R. (2023) · Contemporary Clinical Trials · doi:10.1016/j.cct.2023.107112 · Cited by 7
Participant Engagement in Microrandomized Trials of mHealth Interventions: Scoping Review
Leong, U., & Chakraborty, B. (2023) · JMIR mhealth and uhealth · doi:10.2196/44685 · Cited by 9
Rabbi, M., Philyaw-Kotov, M. L., Li, J., Li, K. T., Rothman, B., Giragosian, L., Reyes, M., Gadway, H., Cunningham, R. M., Bonar, E. E., et al. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.13545 · Cited by 8
Nelson, L. A., Spieker, A. J., LeStourgeon, L. M., Greevy, R. A., Molli, S., Roddy, M. K., & Mayberry, L. S. (2023) · JMIR mhealth and uhealth · doi:10.2196/47632 · Cited by 6
Engagement and Use of a Blended mHealth Intervention for Health Behavior Change
Zimmermann, M., Greenberg, L., & Breland, J. Y. (2023) · International Journal of Behavioral Medicine · doi:10.1007/s12529-023-10182-1 · Cited by 6
Boudreau, F., Dagenais, G. R., de Vries, H., Walthouwer, M. J. L., Côté, J., Turbide, G., Bourlaud, A.-S., & Poirier, P. (2020) · Health Psychology and Behavioral Medicine · doi:10.1080/21642850.2020.1850287 · Cited by 7
Tailoring coaching conversations with virtual health coaches
Beinema, T. C. (2021) · doi:10.3990/1.9789036552608 · Cited by 8
Goevaerts, W. F., Limpt, N. T. V., Kop, W. J., Kemps, H., & Lü, Y. (2025) · JMIR Formative Research · doi:10.2196/76978 · Cited by 6
Balaji, D., de Bruijn, G., Bosse, T., Ischen, C., van der Goot, M. J., & Wiers, R. W. H. J. (2024) · ACM Conference on Conversational User Interfaces (CUI) · doi:10.1145/3640794.3665556 · Cited by 7
Mapping Behavior Change Wheel Techniques to Digital Behavior Change Interventions: Review
Farhat-ul-Ain, F.-U., Popovitš, O., & Tomberg, V. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-05412-9_20 · Cited by 5
Digital Learning Response in the Midst of the Covid-19 Pandemic: The Case of Mauritius
Tandrayen‐Ragoobur, V., Seetanah, B., Fauzel, S. B., & Teeroovengadu, V. (2023) · Africa Development · doi:10.57054/ad.v48i2.5083 · Cited by 6
User-engagement in digital health applications: a scoping reviewPreprint
AKTAS, M., Cambon, L., & Aromatario, O. (2023) · Research Square · doi:10.21203/rs.3.rs-3333695/v1 · Cited by 7
Sandborg, J., Markides, B. R., Simmons, S., Downing, K. L., Nicholson, J. M., Orellana, L., Koorts, H., Carson, V., Salmon, J., & Hesketh, K. D. (2025) · JMIR mhealth and uhealth · doi:10.2196/60478 · Cited by 4
Mapping the Process of Engagement With Digital Health Interventions: A Cross-Case Synthesis
Milne‐Ives, M., Homer, S. R., Andrade, J., & Meinert, E. (2025) · Mayo Clinic Proceedings Innovations Quality & Outcomes · doi:10.1016/j.mayocpiqo.2025.100625 · Cited by 7
Digital Lifestyle Interventions to Support Healthy Gestational Weight Gain: Scoping Review
Otte, R. A., Duracher, L., Demir, O., & Spelt, H. (2025) · Journal of Medical Internet Research · doi:10.2196/71548 · Cited by 5
Kay, M. C., Miller, H., Askew, S., Spaulding, E. M., Chisholm, M., Christy, J., Yang, Q., & Steinberg, D. (2022) · AJPM Focus · doi:10.1016/j.focus.2022.100037 · Cited by 7
Firet, L., Teunissen, T. A. M., Kool, R. B., Akkermans, R. P., Lagro‐Janssen, A. L. M., van der Vaart, C. H., & Assendelft, W. J. (2024) · BMC Family Practice · doi:10.1186/s12875-024-02325-4 · Cited by 6
Wu, J.-C., Brunke-Reese, D., Lagoa, C. M., & Conroy, D. E. (2024) · Digital Health · doi:10.1177/20552076241255656 · Cited by 8
Hocking, J., Oster, C., & Maeder, A. (2020) · JBI Evidence Synthesis · doi:10.11124/jbies-20-00225 · Cited by 4
Mann, A., Fainstad, T. L., Sullivan, I., Ritz, E. M., SooHoo, J. R., Mechaber, H. F., & Shah, A. N. (2025) · PLoS ONE · doi:10.1371/journal.pone.0328546 · Cited by 8
Lagerlund, H., Bezuidenhout, L., Humphries, S., Holmlund, L., Kwak, L., Häger, C. K., & Conradsson, D. M. (2026) · JMIR mhealth and uhealth · doi:10.2196/75662 · Cited by 3
Meinert, E., Milne‐Ives, M., Taylor, E., Inkster, B., Paik, A., Ananthakrishnan, A., Orr, M., Costelloe, C., & Shankar, R. (2026) · International Journal of Social Psychiatry · doi:10.1177/00207640251415507 · Cited by 3
Dollard, J., Jadczak, A. D., Halkett, I., Tucker, G., Thompson, M. Q., Mahadavan, S., Thomas, J., Oxford, L., Muscedere, J., & Visvanathan, R. (2026) · Age and Ageing · doi:10.1093/ageing/afag120 · Cited by 4
Engagement of Users in Digital Health Applications: Scoping Review
AKTAS, M., Cambon, L., & Aromatario, O. (2025) · JMIR mhealth and uhealth · doi:10.2196/66002 · Cited by 3
Fernández-Luque, L., Núñez-Benjumea, F. J., Cervera‐Torres, S., Guerra, J. L. L., Liao, Z. X., Pagán, J. A., & Zambrana, F. R. (2022) · Cognitive informatics in biomedicine and healthcare · doi:10.1007/978-3-031-07696-1_9 · Cited by 3
Worthington, A., Gillies, N. A., Hannaford, R., Roy, R., & Braakhuis, A. J. (2023) · BMC Nutrition · doi:10.1186/s40795-023-00798-7 · Cited by 4
Gamification of an Automated Internet Intervention to Enhance Engagement and Adherence
Curland, R. A., Muñoz, R. F., & Leykin, Y. (2025) · Journal of Technology in Behavioral Science · doi:10.1007/s41347-025-00528-9 · Cited by 3
Areán, P. A., & Allred, R. (2022) · Elsevier eBooks · doi:10.1016/b978-0-323-90045-4.00011-3 · Cited by 3
de Almeida, R. S., Soutelo, A. P., Portugal, P., & Marques, A. J. (2023) · Advances in Rehabilitation · doi:10.5114/areh.2023.133146 · Cited by 2
Metadata
- Authors
- Cole-Lewis, H., Ezeanochie, N., & Turgiss, J.
- Affiliations
- Johnson & Johnson (United States) (US)
- Corresponding author
- Ezeanochie, Nnamdi
- Venue
- JMIR Formative Research
- Publisher
- JMIR Publications Inc.
- Published
- 2019-10-10
- Volume
- 3
- Issue
- 4
- Pages
- e14052
- ISSN
- 2561-326X (ISSN-L)
- PMC
- PMC6813486
- OpenAlex
- W2980146733
- Cited by
- 155
- References
- 29
- Citations by year
- 2026: 20 · 2025: 28 · 2024: 24 · 2023: 27 · 2022: 24 · 2021: 23 · 2020: 9
- FWCI
- 19.09
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- JMIR Formative Research (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Topics
- Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Physical Sciences › Computer Science › Human-Computer Interaction › Innovative Human-Technology Interaction
- Keywords
- digital behaviour change interventions, user engagement, engagement measurement, behaviour change techniques, intervention design, intervention evaluation, user experience, usage frequency, health behavior change
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-11, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-11 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.