CoChat

Understanding Health Behavior Technology Engagement: Pathway to Measuring Digital Behavior Change Interventions

Open access
Cole-Lewis, Heather, Ezeanochie, Nnamdi, Turgiss, Jennifer · 2019 · JMIR Formative Research

The DOI matches its Crossref record; 28 of the 29 references it cites were found in a registry or an index; 3 of the 18 sources its claims cite were checked for support.

Abstract

Researchers and practitioners of digital behavior change interventions (DBCI) use varying and, often, incongruent definitions of the term “engagement,” thus leading to a lack of precision in DBCI measurement and evaluation. The objective of this paper is to propose discrete definitions for various types of user engagement and to explain why precision in the measurement of these engagement types is integral to ensuring the intervention is effective for health behavior modulation. Additionally, this paper presents a framework and practical steps for how engagement can be measured in practice and used to inform DBCI design and evaluation. The key purpose of a DBCI is to influence change in a target health behavior of a user, which may ultimately improve a health outcome. Using available literature and practice-based knowledge of DBCI, the framework conceptualizes two primary categories of engagement that must be measured in DBCI. The categories are health behavior engagement, referred to as “Big E,” and DBCI engagement, referred to as “Little e.” DBCI engagement is further bifurcated into two subclasses: (1) user interactions with features of the intervention designed to encourage frequency of use (ie, simple login, games, and social interactions) and make the user experience appealing, and (2) user interactions with behavior change intervention components (ie, behavior change techniques), which influence determinants of health behavior and subsequently influence health behavior. Achievement of Big E in an intervention delivered via digital means is contingent upon Little e. If users do not interact with DBCI features and enjoy the user experience, exposure to behavior change intervention components will be limited and less likely to influence the behavioral determinants that lead to health behavior engagement (Big E). Big E is also dependent upon the quality and relevance of the behavior change intervention components within the solution. Therefore, the combination of user interactions and behavior change intervention components creates Little e, which is, in turn, designed to improve Big E. The proposed framework includes a model to support measurement of DBCI that describes categories of engagement and details how features of Little e produce Big E. This framework can be applied to DBCI to support various health behaviors and outcomes and can be utilized to identify gaps in intervention efficacy and effectiveness.

Overview

CoChat Summary

## TL;DR

This paper argues that digital behavior change interventions (DBCI) need precise, separate measures of engagement with the digital tool and engagement with the target health behavior. It proposes a framework with “Little e” (DBCI engagement) and “Big E” (health behavior engagement) to improve measurement, analysis, and optimization of DBCI.

## Key findings

  • The paper states there is no universally accepted and comprehensive definition of engagement, which contributes to inconsistent DBCI measurement and evaluation.
  • It proposes two primary engagement categories: “Big E” for engagement with the targeted health behavior, and “Little e” for engagement with the digital intervention itself; Little e is further split into little eUI and little eBCT.
  • The framework is intended to support measurement of the causal pathway exposure to the intervention → determinants → behavior → health outcomes, and to help identify which behavior change techniques (BCTs) are linked to which behaviors and outcomes.
  • The paper notes that the “Big E” outcome is contingent upon “Little e”: if users do not interact with DBCI features, exposure to BCTs is less likely to influence determinants and health behavior engagement.

## Methods

  • The paper is a framework and conceptual analysis paper, not an empirical intervention trial.
  • The authors report that they reviewed several definitions of engagement from the literature and practice-based DBCI knowledge to identify limitations and develop new definitions.
  • They then used market research, economic evaluation, subject matter expertise, behavior science literature, and intervention mapping literature to build a hybrid model drawing on a theory of change conceptual model and a traditional logic model.

## Limitations

  • The paper states that definitions based only on user interactions are limited because they assume interaction leads to outcomes, and they do not distinguish meaningful online versus offline interactions or identify unique interaction sequences tied to specific BCTs.
  • The paper notes that an a priori theory approach is limited because researchers are restricted to the behavior change pathways originally planned, so new or emerging change processes may be missed.
  • Evident from the text: the paper is conceptual rather than empirical, so it does not provide outcome data from a tested intervention; this limits direct evidence for the framework’s effectiveness.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.2196/14052

Cites

28 of 28 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Figures

Figure 1 Diagram illustrating the Johnson and Johnson approach to health engagement. UI: user interaction; Ux: user experience; BCT: behavior change technique.
Figure 1 Diagram illustrating the Johnson and Johnson approach to health engagement. UI: user interaction; Ux: user experience; BCT: behavior change technique.CC BY · PubMed Central
Figure 2 Diagram illustrating relationship engagement measurements. UI: user interaction; BCT: behavior change technique.
Figure 2 Diagram illustrating relationship engagement measurements. UI: user interaction; BCT: behavior change technique.CC BY · PubMed Central
Figure 3 Diagram illustrating unique constellation of user interaction/user interface features that represent behavior change techniques. UI: user interaction; BCT: behavior change technique.
Figure 3 Diagram illustrating unique constellation of user interaction/user interface features that represent behavior change techniques. UI: user interaction; BCT: behavior change technique.CC BY · PubMed Central

Verification

Claims the paper makes

2 Valid · 1 Not valid · 13 Not checked · 20 Own results and interpretations

8 more claims

Create a free account to see all 36 claims and to verify the 15 references still open.

See all claims — free account
  • Probably not a substantial claim. 16
  • It may state two separate claims as one. 9

Create a free account to see these claims.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Show all 28 references

Research works printed but not linked: 4

  1. West, R, 2016, A guide to development and evaluation of digital behavior interventions in healthcare
  2. Jackson, C, 2014, European Health Psychologist, 16, 7
  3. Bandura, A, 1986, Social foundations of thought and action: A social cognitive theory
  4. Nunnally, J, 1978, Psychometric Theory

Cited by

Metadata

Authors
Cole-Lewis, H., Ezeanochie, N., & Turgiss, J.
Affiliations
Johnson & Johnson (United States) (US)
Corresponding author
Ezeanochie, Nnamdi
Venue
JMIR Formative Research
Published
2019-10-10
Volume
3
Issue
4
Pages
e14052
ISSN
2561-326X (ISSN-L)
OpenAlex
W2980146733
Cited by
155
References
29
Citations by year
2026: 20 · 2025: 28 · 2024: 24 · 2023: 27 · 2022: 24 · 2021: 23 · 2020: 9
FWCI
19.09
Type
journal article
Language
en
Open access
Licence
cc-by
Locations
  • JMIR Formative Research (publishedVersion, cc-by)
  • Europe PMC (PubMed Central) (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
Topics
  • Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
  • Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
  • Physical Sciences › Computer Science › Human-Computer Interaction › Innovative Human-Technology Interaction
Keywords
digital behaviour change interventions, user engagement, engagement measurement, behaviour change techniques, intervention design, intervention evaluation, user experience, usage frequency, health behavior change

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-10-11, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-11 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (gpt-6-sol).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.