The Effectiveness of Technology-Based Strategies to Promote Engagement With Digital Interventions: A Systematic Review Protocol
Open accessThe DOI matches its Crossref record; 27 of the 27 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Digital interventions provide effective and potentially cost-effective models for improving health outcomes as they deliver health information and services that are widely disseminated, confidential, and can be tailored to needs of the individual user. Digital interventions have been used successfully for health promotion, mental health, and for enabling self-management of long-term conditions. However, their effectiveness is limited by low usage rates, with non-engagement a major challenge. Hence, it is crucial to find effective strategies to increase user engagement with digital interventions. OBJECTIVE: This systematic review will aim to evaluate the effectiveness of technology-based strategies to promote engagement with digital interventions. METHODS: We will follow Cochrane Collaboration guidelines on systematic review methodology. The search strategy will be executed across seven e-databases (including MEDLINE, EMBASE, PsycINFO, CINAHL) using the concepts "digital intervention" and "engagement", limited by study type (randomized controlled trial). Grey literature and reference lists of included studies will be searched. Titles and abstracts will be independently screened by 2 authors. Then the full text of potentially eligible papers will be obtained and double screened. Data from eligible papers will be extracted by 1 author and checked for accuracy by another author. Bias will be assessed using the Cochrane bias assessment tool. Narrative synthesis will report on all included studies, and where appropriate, data will be pooled using meta-analysis. All findings will be reported according to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines. Sources of heterogeneity will be further investigated if required. RESULTS: Our research is in progress. The final draft of the systematic review is being written and will be submitted before the end of 2015. CONCLUSIONS: The review findings will inform researchers and digital intervention providers about optimal use of technology-based strategies to promote engagement with digital interventions. TRIAL REGISTRATION: PROSPERO International Prospective Register of Systematic Reviews: CRD42014010164; http://www.crd.york.ac.uk/PROSPERO/display_record.asp?ID=CRD42014010164#.VTZmmiFViko (Archived by WebCite at http://www.webcitation.org/6XxQC8fT8).
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Eysenbach, G. (2005) · Journal of Medical Internet Research · doi:10.2196/jmir.7.1.e11 · Cited by 2,524 · cited 4×
“• It is important to differentiate between disengagement from a DI (non-usage attrition), and disengagement from an online trial of a DI, that is, loss to follow-up (dropout attrition) [15].”
BackgroundInfluentialWebb, T. L., Joseph, J., Yardley, L., & Michie, S. (2010) · Journal of Medical Internet Research · doi:10.2196/jmir.1376 · Cited by 2,517
Self-citationPersuasive System Design Does Matter: a Systematic Review of Adherence to Web-based Interventions
Kelders, S. M., Kok, R. N., Ossebaard, H. C., & Van Gemert-Pijnen, J. E. (2012) · Journal of Medical Internet Research · doi:10.2196/jmir.2104 · Cited by 1,308
Wantland, D. J., Portillo, C. J., Holzemer, W. L., Slaughter, R., & McGhee, E. M. (2004) · Journal of Medical Internet Research · doi:10.2196/jmir.6.4.e40 · Cited by 966 · cited 1×
“Numerous systematic reviews have confirmed the potential effectiveness of DIs in improving health behaviors and health outcomes [1-5,7-14].”
BackgroundDefining Internet-Supported Therapeutic Interventions
Barak, A., Klein, B., & Proudfoot, J. G. (2009) · Annals of Behavioral Medicine · doi:10.1007/s12160-009-9130-7 · Cited by 731 · cited 1×
“The definition was chosen because it includes offline and online interventions and specifies the purpose of the DI without limiting it by listing specific characteristics [31].”
BackgroundInteractive Health Communication Applications for people with chronic disease
Murray, E., Burns, J., See Tai, S., Lai, R., & Nazareth, I. (2005) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd004274.pub4 · Cited by 722 · cited 2×
“Numerous systematic reviews have confirmed the potential effectiveness of DIs in improving health behaviors and health outcomes [1-5,7-14].”
BackgroundSelf-citationWebsite-Delivered Physical Activity Interventions
Vandelanotte, C., Spathonis, K. M., Eakin, E. G., & Owen, N. (2007) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2007.02.041 · Cited by 475 · cited 1×
“Research suggests that the effectiveness of a DI can be mediated by the user’s level of engagement, and there appears to be a dose-response relationship [13,16-18].”
BackgroundBrouwer, W., Kroeze, W., Crutzen, R., de Nooijer, J., de Vries, N. K., Brug, J., & Oenema, A. (2011) · Journal of Medical Internet Research · doi:10.2196/jmir.1639 · Cited by 455 · cited 4×
“This review found considerable heterogeneity but suggested that regular contacts by email or phone appeared to result in greater number of logins [27].”
BackgroundMethodInfluentialFry, J. P., & Neff, R. A. (2009) · Journal of Medical Internet Research · doi:10.2196/jmir.1138 · Cited by 447 · cited 1×
“A systematic review also found that periodic email and phone prompts used for behavior change were effective compared to control groups either receiving non-technological prompts or no prompts [26].”
BackgroundInternet-based physical activity interventions: a systematic review of the literature.
van den Berg, M. H., Schoones, J. W., & Vliet Vlieland, T. P. (2007) · Journal of Medical Internet Research · doi:10.2196/jmir.9.3.e26 · Cited by 377 · cited 2×
“Numerous systematic reviews have confirmed the potential effectiveness of DIs in improving health behaviors and health outcomes [1-5,7-14].”
BackgroundClarke, G., Eubanks, D., Reid, E., Kelleher, C., O'Connor, E., DeBar, L. L., Lynch, F., Nunley, S., & Gullion, C. (2005) · Journal of Medical Internet Research · doi:10.2196/jmir.7.2.e16 · Cited by 372 · cited 1×
“Human contact (eg, regular phone calls) may considerably add to the cost of delivery of digital interventions and may therefore undermine one of the potential benefits of digital interventions, namely the low marginal cost per additional user [28].”
BackgroundComputer-based diabetes self-management interventions for adults with type 2 diabetes mellitus
Pal, K., Eastwood, S. V., Michie, S., Farmer, A. J., Barnard, M. L., Peacock, R., Wood, B., Inniss, J. D., & Murray, E. (2013) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd008776.pub2 · Cited by 344 · cited 2×
“Numerous systematic reviews have confirmed the potential effectiveness of DIs in improving health behaviors and health outcomes [1-5,7-14].”
BackgroundSelf-citationOnline Alcohol Interventions: A Systematic Review
White, A., Kavanagh, D., Stallman, H., Klein, B., Kay-Lambkin, F., Proudfoot, J., Drennan, J., Connor, J., Baker, A., Hines, E., et al. (2010) · Journal of Medical Internet Research · doi:10.2196/jmir.1479 · Cited by 305 · cited 2×
“Numerous systematic reviews have confirmed the potential effectiveness of DIs in improving health behaviors and health outcomes [1-5,7-14].”
BackgroundOnline support for smoking cessation: a systematic review of the literature
Shahab, L., & McEwen, A. (2009) · Addiction · doi:10.1111/j.1360-0443.2009.02710.x · Cited by 275
Web‐based self‐help for problem drinkers: a pragmatic randomized trial
Riper, H., Kramer, J., Smit, F., Conijn, B., Schippers, G., & Cuijpers, P. (2008) · Addiction · doi:10.1111/j.1360-0443.2007.02063.x · Cited by 267
Strecher, V., McClure, J., Alexander, G., Chakraborty, B., Nair, V., Konkel, J., Greene, S., Couper, M., Carlier, C., Wiese, C., et al. (2008) · Journal of Medical Internet Research · doi:10.2196/jmir.1002 · Cited by 264 · cited 2×
“number, and type of pages viewed and visited [17,32,33].”
BackgroundEngagement and retention: measuring breadth and depth of participant use of an online intervention
Couper, M. P., Alexander, G. L., Zhang, N., Little, R. J., Maddy, N., Nowak, M. A., McClure, J. B., Calvi, J. J., Rolnick, S. J., Stopponi, M. A., et al. (2010) · Journal of Medical Internet Research · doi:10.2196/jmir.1430 · Cited by 244
Can stand‐alone computer‐based interventions reduce alcohol consumption? A systematic review
Khadjesari, Z., Murray, E., Hewitt, C., Hartley, S., & Godfrey, C. (2011) · Addiction · doi:10.1111/j.1360-0443.2010.03214.x · Cited by 208 · cited 3×
“DIs can potentially provide a convenient gateway for patients to access and receive tailored and private health information and services [1,5].”
BackgroundSelf-citationComputerised cognitive-behavioural therapy for depression: systematic review
Kaltenthaler, E., Parry, G., Beverley, C., & Ferriter, M. (2008) · British Journal of Psychiatry · doi:10.1192/bjp.bp.106.025981 · Cited by 206 · cited 2×
“Numerous systematic reviews have confirmed the potential effectiveness of DIs in improving health behaviors and health outcomes [1-5,7-14].”
BackgroundInteractive computer-based interventions for sexual health promotion
Bailey, J. V., Murray, E., Rait, G., Mercer, C. H., Morris, R. W., Peacock, R., Cassell, J., & Nazareth, I. (2010) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd006483.pub2 · Cited by 183 · cited 5×
“DIs have been developed and used for numerous health issues including improving self-management of long-term conditions [2] (eg, diabetes [3] and asthma [4]), health promotion for sexual health [1], reducing excessive alcohol consumption [5-7], smoking cessation [8,9], increasing physical activity [10,11], and mental…”
InfluentialSelf-citationDefining Participant Exposure Measures in Web-Based Health Behavior Change Programs
Danaher, B. G., Boles, S. M., Akers, L., Gordon, J. S., & Severson, H. H. (2006) · Journal of Medical Internet Research · doi:10.2196/jmir.8.3.e15 · Cited by 145 · cited 1×
“number, and type of pages viewed and visited [17,32,33].”
BackgroundHutton, H. E., Wilson, L. M., Apelberg, B. J., Avila Tang, E., Odelola, O., Bass, E. B., & Chander, G. (2011) · Nicotine & Tobacco Research · doi:10.1093/ntr/ntq252 · Cited by 132 · cited 2×
“Numerous systematic reviews have confirmed the potential effectiveness of DIs in improving health behaviors and health outcomes [1-5,7-14].”
BackgroundThe Information Architecture of Behavior Change Websites
Danaher, B. G., McKay, H. G., & Seeley, J. R. (2005) · Journal of Medical Internet Research · doi:10.2196/jmir.7.2.e12 · Cited by 129 · cited 1×
“Although this association could be due to reverse causality, where users who make most change (for other reasons) ascribe this change to the DI and hence engage with it, it is not unreasonable to suggest that non-use or suboptimal use of a DI is likely to limit its effectiveness [15,22].”
BackgroundBrouwer, W., Oenema, A., Crutzen, R., de Nooijer, J., de Vries, N. K., & Brug, J. (2008) · Journal of Medical Internet Research · doi:10.2196/jmir.956 · Cited by 115 · cited 1×
“In addition, engagement has been categorized into three phases: (1) visiting the DI for the first time, (2) prolonging the first visit, and (3) revisiting the DI [34], which depends to some extent on the goal of the DI and whether it has to be used once or repeatedly.”
Funk, K. L., Stevens, V. J., Appel, L. J., Bauck, A., Brantley, P. J., Champagne, C. M., Coughlin, J., Dalcin, A. T., Harvey-Berino, J., Hollis, J. F., et al. (2010) · Journal of Medical Internet Research · doi:10.2196/jmir.1504 · Cited by 94 · cited 1×
“Research suggests that the effectiveness of a DI can be mediated by the user’s level of engagement, and there appears to be a dose-response relationship [13,16-18].”
BackgroundMcClure, J. B., Shortreed, S. M., Bogart, A., Derry, H., Riggs, K., St John, J., Nair, V., & An, L. (2013) · Journal of Medical Internet Research · doi:10.2196/jmir.2508 · Cited by 83
Robroek, S. J., Lindeboom, D. E., & Burdorf, A. (2012) · Journal of Medical Internet Research · doi:10.2196/jmir.1788 · Cited by 79
Cited by
Hollis, C., Falconer, C. J., Martin, J. L., Whittington, C., Stockton, S., Glazebrook, C., & Davies, E. B. (2017) · Journal of Child Psychology and Psychiatry · doi:10.1111/jcpp.12663 · Cited by 846
“The number of DHIs aimed at CYP’s mental health is growing rapidly (particularly mHealth apps) and Table 1 Glossary of common terms and abbreviations used in the field of digital healthcare (Alkhaldi et al., 2015; Andersson, 2016; Barak, Klein, & Proudfoot, 2009; K€ allander et al., 2013; Podina, Mogoase, David, Szent…”
The Effectiveness of Prompts to Promote Engagement With Digital Interventions: A Systematic Review
Alkhaldi, G., Hamilton, F. L., Lau, R., Webster, R., Michie, S., & Murray, E. (2016) · Journal of Medical Internet Research · doi:10.2196/jmir.4790 · Cited by 273
“These measures were determined in advance before screening included studies [34].”
Self-citationPatel, S., Akhtar, A., Malins, S., Wright, N., Rowley, E., Young, E., Sampson, S., & Morriss, R. (2020) · Journal of Medical Internet Research · doi:10.2196/16228 · Cited by 190
The Asthma Mobile Health Study, a large-scale clinical observational study using ResearchKit
Chan, Y.-F. Y., Wang, P., Rogers, L., Tignor, N., Zweig, M., Hershman, S. G., Genes, N., Scott, E. R., Krock, E., Badgeley, M., et al. (2017) · Nature Biotechnology · doi:10.1038/nbt.3826 · Cited by 204
“Studies to date have not found advantages in terms of HCU or cost, and adoption of the technology in healthcare settings remains low 26–29 .”
BackgroundSystematic review and meta-analysis of internet interventions for smoking cessation among adults
Graham, A., Carpenter, K., Cha, S., Cole, S., Jacobs, M., Raskob, M., & Cole-Lewis, H. (2016) · Substance Abuse and Rehabilitation · doi:10.2147/sar.s101660 · Cited by 114
“In addition, we extracted information about strategies used to promote engagement/adherence in accordance with the study by Alkhaldi et al.(35) We included selected items from the CONSORT-EHEALTH checklist relevant to the reporting of eHealth trials(36) (eg, intervention access, level of human involvement, and engagem…”
Metadata
- Authors
- Alkhaldi, G., Hamilton, F. L., Lau, R., Webster, R., Michie, S., & Murray, E.
- Venue
- JMIR Research Protocols
- Publisher
- JMIR Publications Inc.
- Published
- 2015-04-28
- Volume
- 4
- Issue
- 2
- Pages
- e47
- ISSN
- 1929-0748 (ISSN-L)
- OpenAlex
- W1965986382
- Cited by
- 48
- References
- 27
- FWCI
- 1.35
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.