Which Combinations of Techniques and Modes of Delivery in Internet-Based Interventions Effectively Change Health Behavior? A Meta-Analysis
Open accessThe DOI matches its Crossref record; 26 of the 26 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Many online interventions designed to promote health behaviors combine multiple behavior change techniques (BCTs), adopt different modes of delivery (MoD) (eg, text messages), and range in how usable they are. Research is therefore needed to examine the impact of these features on the effectiveness of online interventions. OBJECTIVE: This study applies Classification and Regression Trees (CART) analysis to meta-analytic data, in order to identify synergistic effects of BCTs, MoDs, and usability factors. METHODS: We analyzed data from Webb et al. This review included effect sizes from 52 online interventions targeting a variety of health behaviors and coded the use of 40 BCTs and 11 MoDs. Our research also developed a taxonomy for coding the usability of interventions. Meta-CART analyses were performed using the BCTs and MoDs as predictors and using treatment success (ie, effect size) as the outcome. RESULTS: Factors related to usability of the interventions influenced their efficacy. Specifically, subgroup analyses indicated that more efficient interventions (interventions that take little time to understand and use) are more likely to be effective than less efficient interventions. Meta-CART identified one synergistic effect: Interventions that included barrier identification/ problem solving and provided rewards for behavior change reported an average effect size that was smaller (ḡ=0.23, 95% CI 0.08-0.44) than interventions that used other combinations of techniques (ḡ=0.43, 95% CI 0.27-0.59). No synergistic effects were found for MoDs or for MoDs combined with BCTs. CONCLUSIONS: Interventions that take little time to understand and use were more effective than those that require more time. Few specific combinations of BCTs that contribute to the effectiveness of online interventions were found. Furthermore, no synergistic effects between BCTs and MoDs were found, even though MoDs had strong effects when analyzed univariately in the original study.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Michie, S., Richardson, M., Johnston, M., Abraham, C., Francis, J., Hardeman, W., Eccles, M. P., Cane, J., & Wood, C. E. (2013) · Annals of Behavioral Medicine · doi:10.1007/s12160-013-9486-6 · Cited by 7,629
Durlak, J. A., & DuPre, E. P. (2008) · American Journal of Community Psychology · doi:10.1007/s10464-008-9165-0 · Cited by 5,304
Webb, T. L., & Sheeran, P. (2006) · Psychological Bulletin · doi:10.1037/0033-2909.132.2.249 · Cited by 3,732
Self-citationA taxonomy of behavior change techniques used in interventions
Abraham, C., & Michie, S. (2008) · Health Psychology · doi:10.1037/0278-6133.27.3.379 · Cited by 2,525 · cited 2×
“First, not all BCTs from the original taxonomy of Abraham and Michie [9] were present in the original analyses by Webb et al [3].”
Webb, T. L., Joseph, J., Yardley, L., & Michie, S. (2010) · Journal of Medical Internet Research · doi:10.2196/jmir.1376 · Cited by 2,517 · cited 10×
“Various meta-analyses have shown that online interventions designed to promote health behavior change can be effective, but that the effectiveness of interventions varies considerably [3-6].”
InfluentialSelf-citationPublication Bias in Meta‐Analysis: Prevention, Assessment and Adjustments
(2005) · doi:10.1002/0470870168 · Cited by 2,368
Effective techniques in healthy eating and physical activity interventions: A meta-regression.
Michie, S., Abraham, C., Whittington, C., McAteer, J., & Gupta, S. (2009) · Health Psychology · doi:10.1037/a0016136 · Cited by 2,229
Using Pedometers to Increase Physical Activity and Improve Health: A Systematic Review
Bravata, D. M., Smith-Spangler, C., Sundaram, V., Gienger, A. L., Lin, N., Lewis, R., Stave, C. D., Olkin, I., & Sirard, J. R. (2007) · JAMA · doi:10.1001/jama.298.19.2296 · Cited by 2,064 · cited 2×
“Another limitation is that this meta-analysis shows the effects on behavior and/or outcomes, but not on the potential mediators (eg, factors such as attitudes, self-efficacy, and skills) that might explain behavior change [46,52].”
Michie, S., Ashford, S., Sniehotta, F. F., Dombrowski, S. U., Bishop, A., & French, D. P. (2011) · Psychology & Health · doi:10.1080/08870446.2010.540664 · Cited by 1,756 · cited 3×
“Evidence suggests that behavior change techniques can be reliably coded [21], but additional research is needed to confirm the extent to which coders can reliably identify modes of delivery and usability.”
The IMAGE Study Group, Greaves, C. J., Sheppard, K. E., Abraham, C., Hardeman, W., Roden, M., Evans, P. H., & Schwarz, P. (2011) · BMC Public Health · doi:10.1186/1471-2458-11-119 · Cited by 1,163
Cited by
Schoeppe, S., Alley, S., Van Lippevelde, W., Bray, N. A., Williams, S. L., Duncan, M. J., & Vandelanotte, C. (2016) · International Journal of Behavioral Nutrition and Physical Activity · doi:10.1186/s12966-016-0454-y · Cited by 949
“[28, 61, 74], better understanding of factors that improve participant engagement and retention is needed.”
BackgroundSchoeppe, S., Alley, S., Rebar, A. L., Hayman, M., Bray, N. A., Van Lippevelde, W., Gnam, J.-P., Bachert, P., Direito, A., & Vandelanotte, C. (2017) · International Journal of Behavioral Nutrition and Physical Activity · doi:10.1186/s12966-017-0538-3 · Cited by 277
Quality of Publicly Available Physical Activity Apps: Review and Content Analysis
Bondaronek, P., Alkhaldi, G., Slee, A., Hamilton, F. L., & Murray, E. (2018) · JMIR mHealth and uHealth · doi:10.2196/mhealth.9069 · Cited by 156
Digital interventions to support adolescents and young adults with cancer: systematic review
McCann, L., McMillan, K. A., & Pugh, G. (2019) · JMIR Cancer · doi:10.2196/12071 · Cited by 98
“Existing reviews of digital interventions targeting health behavior change suggest user involvement in intervention design, mode of delivery (eg, Web-based, mobile based, through an advisor, telephone, or e-mail), synergistic use of behavior change techniques, and usability (ie, how easy is the digital health interven…”
BackgroundHealth Behavior Change for Obesity Management
Teixeira, P. J., & Marques, M. M. (2017) · Obesity Facts · doi:10.1159/000484933 · Cited by 97
Metadata
- Authors
- van Genugten, L., Dusseldorp, E., Webb, T. L., & van Empelen, P.
- Venue
- Journal of Medical Internet Research
- Publisher
- JMIR Publications Inc.
- Published
- 2016-06-07
- Volume
- 18
- Issue
- 6
- Pages
- e155
- ISSN
- 1438-8871 (ISSN-L)
- OpenAlex
- W2411404383
- Cited by
- 91
- References
- 26
- FWCI
- 2.19
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Which Combinations of Techniques and Modes of Delivery in Internet-Based Interventions Effectively Change Health Behavior? A Meta-Analysis. https://app.cochat.ai/papers/10.2196/jmir.4218
- The paper
- van Genugten, L., Dusseldorp, E., Webb, T. L., & van Empelen, P. (2016). Which Combinations of Techniques and Modes of Delivery in Internet-Based Interventions Effectively Change Health Behavior? A Meta-Analysis. Journal of Medical Internet Research. https://doi.org/10.2196/jmir.4218
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.