The Effectiveness of Technology-Based Strategies to Promote Engagement With Digital Interventions: A Systematic Review Protocol
Open accessThe DOI matches its Crossref record; 27 of the 27 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Digital interventions provide effective and potentially cost-effective models for improving health outcomes as they deliver health information and services that are widely disseminated, confidential, and can be tailored to needs of the individual user. Digital interventions have been used successfully for health promotion, mental health, and for enabling self-management of long-term conditions. However, their effectiveness is limited by low usage rates, with non-engagement a major challenge. Hence, it is crucial to find effective strategies to increase user engagement with digital interventions. OBJECTIVE: This systematic review will aim to evaluate the effectiveness of technology-based strategies to promote engagement with digital interventions. METHODS: We will follow Cochrane Collaboration guidelines on systematic review methodology. The search strategy will be executed across seven e-databases (including MEDLINE, EMBASE, PsycINFO, CINAHL) using the concepts "digital intervention" and "engagement", limited by study type (randomized controlled trial). Grey literature and reference lists of included studies will be searched. Titles and abstracts will be independently screened by 2 authors. Then the full text of potentially eligible papers will be obtained and double screened. Data from eligible papers will be extracted by 1 author and checked for accuracy by another author. Bias will be assessed using the Cochrane bias assessment tool. Narrative synthesis will report on all included studies, and where appropriate, data will be pooled using meta-analysis. All findings will be reported according to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines. Sources of heterogeneity will be further investigated if required. RESULTS: Our research is in progress. The final draft of the systematic review is being written and will be submitted before the end of 2015. CONCLUSIONS: The review findings will inform researchers and digital intervention providers about optimal use of technology-based strategies to promote engagement with digital interventions. TRIAL REGISTRATION: PROSPERO International Prospective Register of Systematic Reviews: CRD42014010164; http://www.crd.york.ac.uk/PROSPERO/display_record.asp?ID=CRD42014010164#.VTZmmiFViko (Archived by WebCite at http://www.webcitation.org/6XxQC8fT8).
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Eysenbach, G. (2005) · Journal of Medical Internet Research · doi:10.2196/jmir.7.1.e11 · Cited by 2,524 · cited 4×
“• It is important to differentiate between disengagement from a DI (non-usage attrition), and disengagement from an online trial of a DI, that is, loss to follow-up (dropout attrition) [15].”
BackgroundInfluentialWebb, T. L., Joseph, J., Yardley, L., & Michie, S. (2010) · Journal of Medical Internet Research · doi:10.2196/jmir.1376 · Cited by 2,517
Self-citationPersuasive System Design Does Matter: a Systematic Review of Adherence to Web-based Interventions
Kelders, S. M., Kok, R. N., Ossebaard, H. C., & Van Gemert-Pijnen, J. E. (2012) · Journal of Medical Internet Research · doi:10.2196/jmir.2104 · Cited by 1,308
Wantland, D. J., Portillo, C. J., Holzemer, W. L., Slaughter, R., & McGhee, E. M. (2004) · Journal of Medical Internet Research · doi:10.2196/jmir.6.4.e40 · Cited by 966 · cited 1×
“Numerous systematic reviews have confirmed the potential effectiveness of DIs in improving health behaviors and health outcomes [1-5,7-14].”
BackgroundDefining Internet-Supported Therapeutic Interventions
Barak, A., Klein, B., & Proudfoot, J. G. (2009) · Annals of Behavioral Medicine · doi:10.1007/s12160-009-9130-7 · Cited by 731 · cited 1×
“The definition was chosen because it includes offline and online interventions and specifies the purpose of the DI without limiting it by listing specific characteristics [31].”
BackgroundInteractive Health Communication Applications for people with chronic disease
Murray, E., Burns, J., See Tai, S., Lai, R., & Nazareth, I. (2005) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd004274.pub4 · Cited by 722 · cited 2×
“Numerous systematic reviews have confirmed the potential effectiveness of DIs in improving health behaviors and health outcomes [1-5,7-14].”
BackgroundSelf-citationWebsite-Delivered Physical Activity Interventions
Vandelanotte, C., Spathonis, K. M., Eakin, E. G., & Owen, N. (2007) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2007.02.041 · Cited by 475 · cited 1×
“Research suggests that the effectiveness of a DI can be mediated by the user’s level of engagement, and there appears to be a dose-response relationship [13,16-18].”
BackgroundBrouwer, W., Kroeze, W., Crutzen, R., de Nooijer, J., de Vries, N. K., Brug, J., & Oenema, A. (2011) · Journal of Medical Internet Research · doi:10.2196/jmir.1639 · Cited by 455 · cited 4×
“This review found considerable heterogeneity but suggested that regular contacts by email or phone appeared to result in greater number of logins [27].”
BackgroundMethodInfluentialFry, J. P., & Neff, R. A. (2009) · Journal of Medical Internet Research · doi:10.2196/jmir.1138 · Cited by 447 · cited 1×
“A systematic review also found that periodic email and phone prompts used for behavior change were effective compared to control groups either receiving non-technological prompts or no prompts [26].”
BackgroundInternet-based physical activity interventions: a systematic review of the literature.
van den Berg, M. H., Schoones, J. W., & Vliet Vlieland, T. P. (2007) · Journal of Medical Internet Research · doi:10.2196/jmir.9.3.e26 · Cited by 377 · cited 2×
“Numerous systematic reviews have confirmed the potential effectiveness of DIs in improving health behaviors and health outcomes [1-5,7-14].”
Background
Cited by
Hollis, C., Falconer, C. J., Martin, J. L., Whittington, C., Stockton, S., Glazebrook, C., & Davies, E. B. (2017) · Journal of Child Psychology and Psychiatry · doi:10.1111/jcpp.12663 · Cited by 846
“The number of DHIs aimed at CYP’s mental health is growing rapidly (particularly mHealth apps) and Table 1 Glossary of common terms and abbreviations used in the field of digital healthcare (Alkhaldi et al., 2015; Andersson, 2016; Barak, Klein, & Proudfoot, 2009; K€ allander et al., 2013; Podina, Mogoase, David, Szent…”
The Effectiveness of Prompts to Promote Engagement With Digital Interventions: A Systematic Review
Alkhaldi, G., Hamilton, F. L., Lau, R., Webster, R., Michie, S., & Murray, E. (2016) · Journal of Medical Internet Research · doi:10.2196/jmir.4790 · Cited by 273
“These measures were determined in advance before screening included studies [34].”
Self-citationPatel, S., Akhtar, A., Malins, S., Wright, N., Rowley, E., Young, E., Sampson, S., & Morriss, R. (2020) · Journal of Medical Internet Research · doi:10.2196/16228 · Cited by 190
The Asthma Mobile Health Study, a large-scale clinical observational study using ResearchKit
Chan, Y.-F. Y., Wang, P., Rogers, L., Tignor, N., Zweig, M., Hershman, S. G., Genes, N., Scott, E. R., Krock, E., Badgeley, M., et al. (2017) · Nature Biotechnology · doi:10.1038/nbt.3826 · Cited by 204
“Studies to date have not found advantages in terms of HCU or cost, and adoption of the technology in healthcare settings remains low 26–29 .”
BackgroundSystematic review and meta-analysis of internet interventions for smoking cessation among adults
Graham, A., Carpenter, K., Cha, S., Cole, S., Jacobs, M., Raskob, M., & Cole-Lewis, H. (2016) · Substance Abuse and Rehabilitation · doi:10.2147/sar.s101660 · Cited by 114
“In addition, we extracted information about strategies used to promote engagement/adherence in accordance with the study by Alkhaldi et al.(35) We included selected items from the CONSORT-EHEALTH checklist relevant to the reporting of eHealth trials(36) (eg, intervention access, level of human involvement, and engagem…”
Ainsworth, B., Steele, M., Stuart, B., Joseph, J., Miller, S., Morrison, L., Little, P., & Yardley, L. (2017) · Annals of Behavioral Medicine · doi:10.1007/s12160-016-9866-9 · Cited by 41
“Although improving, DBCI non-usage and dropout rates remain high [2], and recent research has investigated how to increase engagement in order to improve intervention outcomes [3, 4].”
BackgroundBremer, V., Chow, P. I., Funk, B., Thorndike, F. P., & Ritterband, L. M. (2020) · doi:10.2196/preprints.17738 · Cited by 29
“However, the reason for such high dropout rates is still unclear [5], whereas longer treatment duration and user engagement appear to be associated with improved treatment outcomes and greater effectiveness of the digital intervention [7-10].”
BackgroundHonary, M., Fisher, N. R., McNaney, R., & Lobban, F. (2018) · JMIR Mental Health · doi:10.2196/11473 · Cited by 28
“Research suggests that effectiveness of Web-based health interventions correlates with users’level of engagement [33-35].”
Metadata
- Authors
- Alkhaldi, G., Hamilton, F. L., Lau, R., Webster, R., Michie, S., & Murray, E.
- Venue
- JMIR Research Protocols
- Publisher
- JMIR Publications Inc.
- Published
- 2015-04-28
- Volume
- 4
- Issue
- 2
- Pages
- e47
- ISSN
- 1929-0748 (ISSN-L)
- OpenAlex
- W1965986382
- Cited by
- 48
- References
- 27
- FWCI
- 1.35
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.