What makes online substance-use interventions engaging? A systematic review and narrative synthesis
Open accessThe DOI matches its Crossref record; 42 of the 42 references it cites were found in a registry or an index.
Abstract
Background: Online substance-use interventions are effective in producing reductions in harmful-use. However, low user engagement rates with online interventions reduces overall effectiveness of interventions. Identifying optimal strategies with which to engage users with online substance-use interventions may improve usage rates and subsequent effectiveness. Objectives: (1) To identify the most prevalent engagement promoting strategies utilised to increase use of online substance-use interventions. (2) To determine whether the identified engagement promoting strategies increased said use of online substance-use interventions. Review methods: The reviewed followed Cochrane methodology. Databases were searched for online substance-use interventions and engagement promoting strategies limited by study type (randomised controlled trial). Due to heterogeneity between engagement promoting strategies and engagement outcomes, meta-analytic techniques were not possible. Narrative synthesis methods were used. Results: Fifteen studies were included. Five different engagement promoting strategies were identified: (1) tailoring; (2) delivery strategies; (3) incentives; (4) reminders; (5) social support. The most frequently reported engagement promoting strategies was tailoring (47% of studies), followed by reminders and social support (40% of studies) and delivery strategies (33% of studies). The narrative synthesis demonstrated that tailoring, multimedia delivery of content and reminders are potential techniques for promoting engagement. The evidence for social support was inconclusive and negative for incentives. Conclusions: This review was the first to examine engagement promoting strategies in solely online substance-use interventions. Three strategies were identified that may be integral in promoting engagement with online substance-use interventions. However, the small number of eligible extracted studies, inconsistent reporting of engagement outcomes and diversity of engagement features prevent firmer conclusions. More high-quality trials examining engagement are required.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
From game design elements to gamefulness: defining "gamification"
Deterding, S., Dixon, D., Khaled, R., & Nacke, L. (2011) · Proceedings of the 15th International Academic MindTrek Conference: Envisioning Future Media Environments · doi:10.1145/2181037.2181040 · Cited by 8,402
Leamy, M., Bird, V., Boutillier, C. L., Williams, J., & Slade, M. (2011) · British Journal of Psychiatry · doi:10.1192/bjp.bp.110.083733 · Cited by 3,038
A taxonomy of behavior change techniques used in interventions
Abraham, C., & Michie, S. (2008) · Health Psychology · doi:10.1037/0278-6133.27.3.379 · Cited by 2,525 · cited 1×
“This maps onto the concept of usability and aesthetics, which have been demonstrated to be key factors in engagement.(70,71) For example content which is well presented and easy to digest is more likely to be utilised than content which is difficult to navigate or read, which is supported by the findings in this revie…”
ResultThe World’s Technological Capacity to Store, Communicate, and Compute Information
Hilbert, M., & López, P. (2011) · Science · doi:10.1126/science.1200970 · Cited by 1,643 · cited 1×
“A start date of 1990 was chosen as it corresponds to the time period when the internet became available.(31) Participants.”
MethodWhat is user engagement? A conceptual framework for defining user engagement with technology
O'Brien, H. L., & Toms, E. G. (2008) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.20801 · Cited by 1,397
Persuasive System Design Does Matter: a Systematic Review of Adherence to Web-based Interventions
Kelders, S. M., Kok, R. N., Ossebaard, H. C., & Van Gemert-Pijnen, J. E. (2012) · Journal of Medical Internet Research · doi:10.2196/jmir.2104 · Cited by 1,308 · cited 1×
“In the substance-use field, providing voucher or prized-based reinforcement for abstinence from drugs as well as treatment adherence is effective.(68,75) One potential moderator may be the influence of motivation level on engagement; in the present review, Ramo et al.”
BackgroundPerski, O., Blandford, A., West, R., & Michie, S. (2017) · Translational Behavioral Medicine · doi:10.1007/s13142-016-0453-1 · Cited by 1,193
Defining Internet-Supported Therapeutic Interventions
Barak, A., Klein, B., & Proudfoot, J. G. (2009) · Annals of Behavioral Medicine · doi:10.1007/s12160-009-9130-7 · Cited by 731
Design of an mHealth app for the self-management of adolescent type 1 diabetes: a pilot study
Cafazzo, J. A., Casselman, M., Hamming, N., Katzman, D. K., & Palmert, M. R. (2012) · Journal of Medical Internet Research · doi:10.2196/jmir.2058 · Cited by 676 · cited 1×
“This maps onto the concept of usability and aesthetics, which have been demonstrated to be key factors in engagement.(70,71) For example content which is well presented and easy to digest is more likely to be utilised than content which is difficult to navigate or read, which is supported by the findings in this revie…”
ResultA Behavior Change Model for Internet Interventions
Ritterband, L. M., Thorndike, F. P., Cox, D. J., Kovatchev, B. P., & Gonder-Frederick, L. A. (2009) · Annals of Behavioral Medicine · doi:10.1007/s12160-009-9133-4 · Cited by 591 · cited 2×
“Tailoring has been hypothesised to be effective because it adapts the intervention to specific attributes of the user.(19) In the alcohol field tailoring has been demonstrated to improve the intervention by making it more meaningful and relatable to the user,(67) increasing their likelihood of engaging with the interv…”
Background
Cited by
Mclaughlin, M., Delaney, T., Hall, A., Byaruhanga, J., Mackie, P., Grady, A., Reilly, K., Campbell, E., Sutherland, R., Wiggers, J., et al. (2021) · Journal of Medical Internet Research · doi:10.2196/23180 · Cited by 105
“We used the modified versions of published search filters for physical activity and sedentary behavior [28], engagement [20], and DHIs [20,29,30].”
MethodMilward, J., Deluca, P., Drummond, C., & Kimergård, A. (2018) · JMIR mHealth and uHealth · doi:10.2196/11692 · Cited by 38
“The BRANCH app was developed in 3 stages: a systematic review of EPSs for Web-based substance use interventions [7]; scoping focus groups to determine user preferences for content, features, and style [8]; and usability testing on the prototype BRANCH app with a sample of the target population [6].”
BackgroundMethodInfluentialSelf-citationBell, L., Garnett, C., Bao, Y., Cheng, Z., Qian, T., Perski, O., Potts, H. W. W., & Williamson, E. (2023) · JMIR mHealth and uHealth · doi:10.2196/38342 · Cited by 35
Metadata
- Authors
- Milward, J., Drummond, C., Fincham-Campbell, S., & Deluca, P.
- Venue
- DIGITAL HEALTH
- Publisher
- SAGE Publications
- Published
- 2018-01
- Volume
- 4
- Pages
- 2055207617743354-2055207617743354
- ISSN
- 2055-2076 (ISSN-L)
- OpenAlex
- W2790961053
- Cited by
- 56
- References
- 42
- FWCI
- 0.94
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: What makes online substance-use interventions engaging? A systematic review and narrative synthesis. https://app.cochat.ai/papers/10.1177/2055207617743354
- The paper
- Milward, J., Drummond, C., Fincham-Campbell, S., & Deluca, P. (2018). What makes online substance-use interventions engaging? A systematic review and narrative synthesis. DIGITAL HEALTH. https://doi.org/10.1177/2055207617743354
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.