What makes online substance-use interventions engaging? A systematic review and narrative synthesis
Open accessThe DOI matches its Crossref record; 43 of the 43 references it cites were found in a registry or an index.
Abstract
Background: Online substance-use interventions are effective in producing reductions in harmful-use. However, low user engagement rates with online interventions reduces overall effectiveness of interventions. Identifying optimal strategies with which to engage users with online substance-use interventions may improve usage rates and subsequent effectiveness. Objectives: (1) To identify the most prevalent engagement promoting strategies utilised to increase use of online substance-use interventions. (2) To determine whether the identified engagement promoting strategies increased said use of online substance-use interventions. Review methods: The reviewed followed Cochrane methodology. Databases were searched for online substance-use interventions and engagement promoting strategies limited by study type (randomised controlled trial). Due to heterogeneity between engagement promoting strategies and engagement outcomes, meta-analytic techniques were not possible. Narrative synthesis methods were used. Results: Fifteen studies were included. Five different engagement promoting strategies were identified: (1) tailoring; (2) delivery strategies; (3) incentives; (4) reminders; (5) social support. The most frequently reported engagement promoting strategies was tailoring (47% of studies), followed by reminders and social support (40% of studies) and delivery strategies (33% of studies). The narrative synthesis demonstrated that tailoring, multimedia delivery of content and reminders are potential techniques for promoting engagement. The evidence for social support was inconclusive and negative for incentives. Conclusions: This review was the first to examine engagement promoting strategies in solely online substance-use interventions. Three strategies were identified that may be integral in promoting engagement with online substance-use interventions. However, the small number of eligible extracted studies, inconsistent reporting of engagement outcomes and diversity of engagement features prevent firmer conclusions. More high-quality trials examining engagement are required.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
From game design elements to gamefulness: defining "gamification"
Deterding, S., Dixon, D., Khaled, R., & Nacke, L. (2011) · Proceedings of the 15th International Academic MindTrek Conference: Envisioning Future Media Environments · doi:10.1145/2181037.2181040 · Cited by 8,402
Leamy, M., Bird, V., Boutillier, C. L., Williams, J., & Slade, M. (2011) · British Journal of Psychiatry · doi:10.1192/bjp.bp.110.083733 · Cited by 3,038
A taxonomy of behavior change techniques used in interventions
Abraham, C., & Michie, S. (2008) · Health Psychology · doi:10.1037/0278-6133.27.3.379 · Cited by 2,525 · cited 1×
“This maps onto the concept of usability and aesthetics, which have been demonstrated to be key factors in engagement.(70,71) For example content which is well presented and easy to digest is more likely to be utilised than content which is difficult to navigate or read, which is supported by the findings in this revie…”
ResultThe World’s Technological Capacity to Store, Communicate, and Compute Information
Hilbert, M., & López, P. (2011) · Science · doi:10.1126/science.1200970 · Cited by 1,643 · cited 1×
“A start date of 1990 was chosen as it corresponds to the time period when the internet became available.(31) Participants.”
MethodWhat is user engagement? A conceptual framework for defining user engagement with technology
O'Brien, H. L., & Toms, E. G. (2008) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.20801 · Cited by 1,397
Persuasive System Design Does Matter: a Systematic Review of Adherence to Web-based Interventions
Kelders, S. M., Kok, R. N., Ossebaard, H. C., & Van Gemert-Pijnen, J. E. (2012) · Journal of Medical Internet Research · doi:10.2196/jmir.2104 · Cited by 1,308 · cited 1×
“In the substance-use field, providing voucher or prized-based reinforcement for abstinence from drugs as well as treatment adherence is effective.(68,75) One potential moderator may be the influence of motivation level on engagement; in the present review, Ramo et al.”
BackgroundPerski, O., Blandford, A., West, R., & Michie, S. (2017) · Translational Behavioral Medicine · doi:10.1007/s13142-016-0453-1 · Cited by 1,193
Understanding and Promoting Effective Engagement With Digital Behavior Change Interventions
Yardley, L., Spring, B. J., Riper, H., Morrison, L. G., Crane, D. H., Curtis, K., Merchant, G. C., Naughton, F., & Blandford, A. (2016) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2016.06.015 · Cited by 1,118
Defining Internet-Supported Therapeutic Interventions
Barak, A., Klein, B., & Proudfoot, J. G. (2009) · Annals of Behavioral Medicine · doi:10.1007/s12160-009-9130-7 · Cited by 731
Design of an mHealth app for the self-management of adolescent type 1 diabetes: a pilot study
Cafazzo, J. A., Casselman, M., Hamming, N., Katzman, D. K., & Palmert, M. R. (2012) · Journal of Medical Internet Research · doi:10.2196/jmir.2058 · Cited by 676 · cited 1×
“This maps onto the concept of usability and aesthetics, which have been demonstrated to be key factors in engagement.(70,71) For example content which is well presented and easy to digest is more likely to be utilised than content which is difficult to navigate or read, which is supported by the findings in this revie…”
ResultA Behavior Change Model for Internet Interventions
Ritterband, L. M., Thorndike, F. P., Cox, D. J., Kovatchev, B. P., & Gonder-Frederick, L. A. (2009) · Annals of Behavioral Medicine · doi:10.1007/s12160-009-9133-4 · Cited by 591 · cited 2×
“Tailoring has been hypothesised to be effective because it adapts the intervention to specific attributes of the user.(19) In the alcohol field tailoring has been demonstrated to improve the intervention by making it more meaningful and relatable to the user,(67) increasing their likelihood of engaging with the interv…”
BackgroundGamification: What It Is and Why It Matters to Digital Health Behavior Change Developers
Cugelman, B. (2013) · JMIR Serious Games · doi:10.2196/games.3139 · Cited by 531 · cited 1×
“The strategy was based on previously published systematic reviews on online health interventions and engagement with digital interventions(4,10,32) and, in the case where systematic reviews had not been conducted on a specific topic, such as gamification, the search terms were based on the existing literature.(33) The…”
MethodMeta-analysis of internet-delivered interventions to increase physical activity levels
Davies, C. A., Spence, J. C., Vandelanotte, C., Caperchione, C. M., & Mummery, W. (2012) · International Journal of Behavioral Nutrition and Physical Activity · doi:10.1186/1479-5868-9-52 · Cited by 488
Website-Delivered Physical Activity Interventions
Vandelanotte, C., Spathonis, K. M., Eakin, E. G., & Owen, N. (2007) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2007.02.041 · Cited by 475
Brouwer, W., Kroeze, W., Crutzen, R., de Nooijer, J., de Vries, N. K., Brug, J., & Oenema, A. (2011) · Journal of Medical Internet Research · doi:10.2196/jmir.1639 · Cited by 455 · cited 8×
“Brouwer et al.9 also examined exposure to internet-delivered health promotion interventions with qualitative descriptive analyses.”
BackgroundMethodInfluentialOnline Prevention Aimed at Lifestyle Behaviors: A Systematic Review of Reviews
Kohl, L. F., Crutzen, R., & de Vries, N. K. (2013) · Journal of Medical Internet Research · doi:10.2196/jmir.2665 · Cited by 388
Kaner, E. F., Beyer, F. R., Garnett, C., Crane, D., Brown, J., Muirhead, C., Redmore, J., O'Donnell, A., Newham, J. J., de Vocht, F., et al. (2017) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd011479.pub2 · Cited by 308
Allam, A., Kostova, Z., Nakamoto, K., & Schulz, P. J. (2015) · Journal of Medical Internet Research · doi:10.2196/jmir.3510 · Cited by 274
The Effectiveness of Prompts to Promote Engagement With Digital Interventions: A Systematic Review
Alkhaldi, G., Hamilton, F. L., Lau, R., Webster, R., Michie, S., & Murray, E. (2016) · Journal of Medical Internet Research · doi:10.2196/jmir.4790 · Cited by 273 · cited 3×
“In a recent meta-analysis, the use of reminders to improve engagement with digital health interventions showed small but significant results.(23) This supports the findings from the current review.”
BackgroundResultInfluentialStrecher, V., McClure, J., Alexander, G., Chakraborty, B., Nair, V., Konkel, J., Greene, S., Couper, M., Carlier, C., Wiese, C., et al. (2008) · Journal of Medical Internet Research · doi:10.2196/jmir.1002 · Cited by 264 · cited 22×
“Two studies reported peer social support as an EPS.54,46,56 Stoddard et al.,56 in a very high quality study with large sample size (n¼ 1375), examined the effect of a social bulletin board where users could interact with each other within a self-help smoking cessation programme.”
BackgroundMethodResultInfluentialComputer‐delivered interventions for alcohol and tobacco use: a meta‐analysis
Rooke, S., Thorsteinsson, E., Karpin, A., Copeland, J., & Allsop, D. (2010) · Addiction · doi:10.1111/j.1360-0443.2010.02975.x · Cited by 262
Engagement and retention: measuring breadth and depth of participant use of an online intervention
Couper, M. P., Alexander, G. L., Zhang, N., Little, R. J., Maddy, N., Nowak, M. A., McClure, J. B., Calvi, J. J., Rolnick, S. J., Stopponi, M. A., et al. (2010) · Journal of Medical Internet Research · doi:10.2196/jmir.1430 · Cited by 244
Engagement in a Diabetes Self-management Website: Usage Patterns and Generalizability of Program Use
Glasgow, R. E., Christiansen, S. M., Kurz, D., King, D. K., Woolley, T., Faber, A. J., Estabrooks, P. A., Strycker, L., Toobert, D., & Dickman, J. (2011) · Journal of Medical Internet Research · doi:10.2196/jmir.1391 · Cited by 219
Glasgow, R. E., Nelson, C. C., Kearney, K. A., Reid, R., Ritzwoller, D. P., Strecher, V. J., Couper, M. P., Green, B., & Wildenhaus, K. (2007) · Journal of Medical Internet Research · doi:10.2196/jmir.9.2.e11 · Cited by 216
Verheijden, M. W., Jans, M. P., Hildebrandt, V. H., & Hopman-Rock, M. (2007) · Journal of Medical Internet Research · doi:10.2196/jmir.9.1.e1 · Cited by 195
Interactive computer-based interventions for sexual health promotion
Bailey, J. V., Murray, E., Rait, G., Mercer, C. H., Morris, R. W., Peacock, R., Cassell, J., & Nazareth, I. (2010) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd006483.pub2 · Cited by 183
Behavior Change Techniques in Popular Alcohol Reduction Apps
Crane, D., Garnett, C., Brown, J., West, R., & Michie, S. (2015) · Journal of Medical Internet Research · doi:10.2196/jmir.4060 · Cited by 177 · cited 1×
“Techniques such as monitoring, feedback, tailoring, aesthetic design, novelty, credible source and social support have been proposed to influence usage with online interventions.(77,78) This model has been further extended by Short et al.”
MethodCrutzen, R., de Nooijer, J., Brouwer, W., Oenema, A., Brug, J., & de Vries, N. K. (2011) · Health Education & Behavior · doi:10.1177/1090198110372878 · Cited by 158 · cited 4×
“An early systematic review by Crutzen et al.(10) examined strategies that facilitated exposure to internet-delivered health behaviour change interventions for adolescents.”
BackgroundInfluentialBrouwer, W., Oenema, A., Raat, H., Crutzen, R., de Nooijer, J., de Vries, N. K., & Brug, J. (2010) · Health Education Research · doi:10.1093/her/cyp063 · Cited by 147
Defining Participant Exposure Measures in Web-Based Health Behavior Change Programs
Danaher, B. G., Boles, S. M., Akers, L., Gordon, J. S., & Severson, H. H. (2006) · Journal of Medical Internet Research · doi:10.2196/jmir.8.3.e15 · Cited by 145 · cited 1×
“Introduction Online interventions have been developed for a range of substance-use issues including alcohol reduction, tobacco and cannabis smoking cessation.(1) 3 Typically, they are delivered or supported via the internet and Addictions Department, Institute of Psychiatry, Psychology and Neuroscience, King’s College…”
BackgroundInternet and computer based interventions for cannabis use: a meta-analysis
Tait, R. J., Spijkerman, R., & Riper, H. (2013) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2013.05.012 · Cited by 144
Effectiveness of a self-guided web-based cannabis treatment program: randomized controlled trial
Rooke, S., Copeland, J., Norberg, M., Hine, D., & McCambridge, J. (2013) · Journal of Medical Internet Research · doi:10.2196/jmir.2256 · Cited by 141
SCHUBART, J. R., STUCKEY, H. L., GANESHAMOORTHY, A., & SCIAMANNA, C. N. (2011) · CIN: Computers, Informatics, Nursing · doi:10.1097/ncn.0b013e3182065eed · Cited by 135 · cited 5×
“However, none of the three studies included in the Schubart et al.(22) study including SUIs were included in this comparison.”
BackgroundMethodResultInfluentialHutton, H. E., Wilson, L. M., Apelberg, B. J., Avila Tang, E., Odelola, O., Bass, E. B., & Chander, G. (2011) · Nicotine & Tobacco Research · doi:10.1093/ntr/ntq252 · Cited by 132 · cited 1×
“13 Studies suggest a dose response relationship between the level of a user’s engagement and the effectiveness of an online health intervention.(14) 17 Whilst this association may also be due to reverse causality, such as when a user experiences better outcomes they are more likely to engage, it is plausible that enga…”
BackgroundInternational Spanish/English Internet smoking cessation trial yields 20% abstinence rates at 1 year
Muñoz, R. F., Barrera, A. Z., Delucchi, K., Penilla, C., Torres, L. D., & Pérez-Stable, E. J. (2009) · Nicotine & Tobacco Research · doi:10.1093/ntr/ntp090 · Cited by 127
Funk, K. L., Stevens, V. J., Appel, L. J., Bauck, A., Brantley, P. J., Champagne, C. M., Coughlin, J., Dalcin, A. T., Harvey-Berino, J., Hollis, J. F., et al. (2010) · Journal of Medical Internet Research · doi:10.2196/jmir.1504 · Cited by 94
Theoretical Perspectives of Adherence to Web-Based Interventions: a Scoping Review
Ryan, C., Bergin, M., & Wells, J. S. (2018) · International Journal of Behavioral Medicine · doi:10.1007/s12529-017-9678-8 · Cited by 86
Randomized trial of a neighborhood environment-focused physical activity website intervention
Ferney, S. L., Marshall, A. L., Eakin, E. G., & Owen, N. (2009) · Preventive Medicine · doi:10.1016/j.ypmed.2008.10.022 · Cited by 85
McClure, J. B., Shortreed, S. M., Bogart, A., Derry, H., Riggs, K., St John, J., Nair, V., & An, L. (2013) · Journal of Medical Internet Research · doi:10.2196/jmir.2508 · Cited by 83
Crane, D., Garnett, C., Brown, J., West, R., & Michie, S. (2017) · Frontiers in Public Health · doi:10.3389/fpubh.2017.00039 · Cited by 82 · cited 2×
“User engagement research has reported that social or ‘community’ features are highly desired in apps for cutting down alcohol-use.(67) With numerous studies pointing to social support being a useful tool to promote behaviour change,(72-74) further research is warranted.”
BackgroundMethodChewFree.com: Evaluation of a Web-based cessation program for smokeless tobacco users
Severson, H., Gordon, J., Danaher, B., & Akers, L. (2008) · Nicotine & Tobacco Research · doi:10.1080/14622200701824984 · Cited by 81
Schaub, M. P., Wenger, A., Berg, O., Beck, T., Stark, L., Buehler, E., & Haug, S. (2015) · Journal of Medical Internet Research · doi:10.2196/jmir.4860 · Cited by 78 · cited 1×
“…Yes Yes Yes Yes Unclear No 5/7 Munoz et al. 2009 Yes Yes No Yes Yes Unclear No 4/7 Ramo et al. 2015 Unclear Unclear Unclear Yes Yes Unclear No 2/3 Schaub et al. 2015 Yes Yes No Yes Yes Unclear No 4/7 Schulz et al. 2013 Unclear Unclear No Yes Yes Unclear No 2/7 Severson et al. 2008 Unclear Yes…”
Two fully automated web-based interventions for risky alcohol use: randomized controlled trial
Tensil, M.-D., Jonas, B., & Strüber, E. (2013) · Journal of Medical Internet Research · doi:10.2196/jmir.2489 · Cited by 20 · cited 17×
“Two studies reported peer social support as an EPS.54,46,56 Stoddard et al.,56 in a very high quality study with large sample size (n¼ 1375), examined the effect of a social bulletin board where users could interact with each other within a self-help smoking cessation programme.”
BackgroundResultInfluential
Cited by
Mclaughlin, M., Delaney, T., Hall, A., Byaruhanga, J., Mackie, P., Grady, A., Reilly, K., Campbell, E., Sutherland, R., Wiggers, J., et al. (2021) · Journal of Medical Internet Research · doi:10.2196/23180 · Cited by 105
“We used the modified versions of published search filters for physical activity and sedentary behavior [28], engagement [20], and DHIs [20,29,30].”
MethodMilward, J., Deluca, P., Drummond, C., & Kimergård, A. (2018) · JMIR mHealth and uHealth · doi:10.2196/11692 · Cited by 38
“The BRANCH app was developed in 3 stages: a systematic review of EPSs for Web-based substance use interventions [7]; scoping focus groups to determine user preferences for content, features, and style [8]; and usability testing on the prototype BRANCH app with a sample of the target population [6].”
BackgroundMethodInfluentialSelf-citationBell, L., Garnett, C., Bao, Y., Cheng, Z., Qian, T., Perski, O., Potts, H. W. W., & Williamson, E. (2023) · JMIR mHealth and uHealth · doi:10.2196/38342 · Cited by 35
Metadata
- Authors
- Milward, J., Drummond, C., Fincham-Campbell, S., & Deluca, P.
- Venue
- DIGITAL HEALTH
- Publisher
- SAGE Publications
- Published
- 2018-01
- Volume
- 4
- Pages
- 2055207617743354-2055207617743354
- ISSN
- 2055-2076 (ISSN-L)
- OpenAlex
- W2790961053
- Cited by
- 56
- References
- 43
- FWCI
- 0.94
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.