The DOI matches its Crossref record; 31 of the 32 references it cites were found in a registry or an index.
Predicting user adherence to behavioral eHealth interventions in the real world: examining which aspects of intervention design matter most
Abstract
Existing frameworks have identified a range of intervention design features that may facilitate adherence to eHealth interventions; however, empirical data are lacking on whether intervention design features can predict user adherence in the real world-where the public access available tools-and whether some design aspects of behavioral eHealth interventions are more important than others in predicting adherence. This study examined whether intervention design qualities predict user adherence to behavioral eHealth interventions in real-world use and which qualities matter the most. We correlated the online activities of users of 30 web-based behavioral interventions-collected from a proprietary data set of anonymized logs from consenting users of Microsoft Internet Explorer add-on-with interventions' quality ratings obtained by trained raters prior to empirical examination. The quality ratings included: Usability, Visual Design, User Engagement, Content, Therapeutic Persuasiveness (i.e., persuasive design and incorporation of behavior change techniques), and Therapeutic Alliance. We found Therapeutic Persuasiveness (i.e., the incorporation of persuasive design/behavior change principles) to be the most robust predictor of adherence (i.e., duration of use, number of unique sessions; 40 ≤ rs ≤ .58, ps ≤ .005), explaining 42% of the variance in user adherence in our regression model. Results indicated up to six times difference in the percentage of users utilizing the interventions for more than a minimum amount of time and sessions based on Therapeutic Persuasiveness. Findings suggest the importance of persuasive design and behavior change techniques incorporation during the design and evaluation of digital behavioral interventions.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“However, the scope of IMIs seems to be limited by a low uptake and intervention adherence of individuals (Baumel and Yom-Tov, 2018; Baumel et al., 2017).”
From Feasibility of a Software agent providing a brief Intervention for Self-help to Uplift psychological wellbeing (“SISU”). A single-group pretest-posttest trial investigating the potential of SISU to act as therapeutic agent (2021) · cites this paper as Baumel and Yom-Tov, 2018
Citations
Cites
Eysenbach, G. (2005) · Journal of Medical Internet Research · doi:10.2196/jmir.7.1.e11 · Cited by 2,524
Webb, T. L., Joseph, J., Yardley, L., & Michie, S. (2010) · Journal of Medical Internet Research · doi:10.2196/jmir.1376 · Cited by 2,517
What is user engagement? A conceptual framework for defining user engagement with technology
O'Brien, H. L., & Toms, E. G. (2008) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.20801 · Cited by 1,397
Persuasive System Design Does Matter: a Systematic Review of Adherence to Web-based Interventions
Kelders, S. M., Kok, R. N., Ossebaard, H. C., & Van Gemert-Pijnen, J. E. (2012) · Journal of Medical Internet Research · doi:10.2196/jmir.2104 · Cited by 1,308
Adherence in Internet Interventions for Anxiety and Depression
Christensen, H., Griffiths, K. M., & Farrer, L. (2009) · Journal of Medical Internet Research · doi:10.2196/jmir.1194 · Cited by 1,133
Health behavior models in the age of mobile interventions: are our theories up to the task?
Riley, W. T., Rivera, D. E., Atienza, A. A., Nilsen, W., Allison, S. M., & Mermelstein, R. (2011) · Translational Behavioral Medicine · doi:10.1007/s13142-011-0021-7 · Cited by 978
Healthcare via Cell Phones: A Systematic Review
Krishna, S., Boren, S. A., & Balas, E. A. (2009) · Telemedicine and e-Health · doi:10.1089/tmj.2008.0099 · Cited by 882
A Review of eHealth Interventions for Physical Activity and Dietary Behavior Change
Norman, G. J., Zabinski, M. F., Adams, M. A., Rosenberg, D. E., Yaroch, A. L., & Atienza, A. A. (2007) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2007.05.007 · Cited by 605
A Behavior Change Model for Internet Interventions
Ritterband, L. M., Thorndike, F. P., Cox, D. J., Kovatchev, B. P., & Gonder-Frederick, L. A. (2009) · Annals of Behavioral Medicine · doi:10.1007/s12160-009-9133-4 · Cited by 591
van Ballegooijen, W., Cuijpers, P., van Straten, A., Karyotaki, E., Andersson, G., Smit, J. H., & Riper, H. (2014) · PLoS ONE · doi:10.1371/journal.pone.0100674 · Cited by 409
Online Prevention Aimed at Lifestyle Behaviors: A Systematic Review of Reviews
Kohl, L. F., Crutzen, R., & de Vries, N. K. (2013) · Journal of Medical Internet Research · doi:10.2196/jmir.2665 · Cited by 388
Intervention Mapping: Protocol for Applying Health Psychology Theory to Prevention Programmes
Kok, G., Schaalma, H. P., Ruiter, R. A. C., van Empelen, P., & Brug, J. (2004) · Journal of Health Psychology · doi:10.1177/1359105304038379 · Cited by 362
Individual characteristics associated with World Wide Web use
Atkinson, M., & Kydd, C. T. (1997) · ACM SIGMIS Database the DATABASE for Advances in Information Systems · doi:10.1145/264701.264705 · Cited by 357
Emerging mHealth and eHealth interventions for serious mental illness: a review of the literature
Naslund, J. A., Marsch, L. A., McHugo, G. J., & Bartels, S. J. (2015) · Journal of Mental Health · doi:10.3109/09638237.2015.1019054 · Cited by 327
Cugelman, B., Thelwall, M., & Dawes, P. (2011) · Journal of Medical Internet Research · doi:10.2196/jmir.1367 · Cited by 323
Evaluating eHealth Interventions: The Need for Continuous Systemic Evaluation
Catwell, L., & Sheikh, A. (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000126 · Cited by 307
Engagement and retention: measuring breadth and depth of participant use of an online intervention
Couper, M. P., Alexander, G. L., Zhang, N., Little, R. J., Maddy, N., Nowak, M. A., McClure, J. B., Calvi, J. J., Rolnick, S. J., Stopponi, M. A., et al. (2010) · Journal of Medical Internet Research · doi:10.2196/jmir.1430 · Cited by 244
Adherence in Internet-based interventions.
(2008) · PubMed Central · Cited by 215
Baumel, A., Faber, K., Mathur, N., Kane, J. M., & Muench, F. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.7270 · Cited by 206
Self-citationChristensen, H., Griffiths, K., Groves, C., & Korten, A. (2006) · Australian & New Zealand Journal of Psychiatry · doi:10.1080/j.1440-1614.2006.01743.x · Cited by 201
Methodological issues in research on web-based behavioral interventions
Danaher, B. G., & Seeley, J. R. (2009) · Annals of Behavioral Medicine · doi:10.1007/s12160-009-9129-0 · Cited by 193
Lalmas, M., O’Brien, H., & Yom-Tov, E. (2015) · Synthesis Lectures on Information Concepts, Retrieval, and Services · doi:10.1007/978-3-031-02289-0 · Cited by 192
Self-citationMoller, A. C., Merchant, G., Conroy, D. E., West, R., Hekler, E., Kugler, K. C., & Michie, S. (2017) · Journal of Behavioral Medicine · doi:10.1007/s10865-016-9818-7 · Cited by 151
Who Does What on the Web: A Large-Scale Study of Browsing Behavior
Goel, S., Hofman, J. M., & Sirer, M. I. (2021) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v6i1.14266 · Cited by 141
Lalmas, M., O'Brien, H., & Yom‐Tov, E. (2014) · Synthesis lectures on information concepts, retrieval, and services · doi:10.2200/s00605ed1v01y201410icr038 · Cited by 95
Self-citationProvost, M., Koompalum, D., Dong, D., & Martin, B. C. (2005) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2005.07.034 · Cited by 77
Makai, P., Perry, M., Robben, S. H., Schers, H. J., Heinen, M. M., Olde Rikkert, M. G., & Melis, R. F. (2014) · Journal of Medical Internet Research · doi:10.2196/jmir.3057 · Cited by 59
White, R. W., & Horvitz, E. (2013) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2012-001473 · Cited by 57
Mediators of a successful web‐based smokeless tobacco cessation program
Danaher, B. G., Smolkowski, K., Seeley, J. R., & Severson, H. H. (2008) · Addiction · doi:10.1111/j.1360-0443.2008.02295.x · Cited by 45
Making the Case for a Feasible Evaluation Method of Available E-Mental Health Products
Baumel, A. (2016) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-016-0764-z · Cited by 19
Self-citationDigital Libraries Applications: CBIR, Education, Social Networks, eScience/Simulation, and GIS
Fox, E. A., & Leidig, J. P. (2014) · Synthesis lectures on information concepts, retrieval, and services · doi:10.2200/s00565ed1v01y201401icr032 · Cited by 16
Research works printed but not linked: 1
- Aitken, 2013, Patient apps for improved healthcare from novelty to mainstream
Cited by
Sorted by citations
Objective user engagement with mental health apps: systematic search and panel-based usage analysis
Baumel, A., Muench, F., Edan, S., & Kane, J. M. (2019) · Journal of Medical Internet Research · doi:10.2196/14567 · Cited by 965
Self-citationFleming, T., Bavin, L., Lucassen, M., Stasiak, K., Hopkins, S., & Merry, S. (2018) · Journal of Medical Internet Research · doi:10.2196/jmir.9275 · Cited by 670
“The dose or amount of exposure to digital mental health interventions for clinically significant effects has been considered in previous research, with greater adherence generally associated with greater clinical gains [6,7,9].”
BackgroundMethodJakob, R., Harperink, S., Rudolf, A. M., Fleisch, E., Haug, S., Mair, J. L., Salamanca-Sanabria, A., & Kowatsch, T. (2022) · Journal of Medical Internet Research · doi:10.2196/35371 · Cited by 446
Ringeval, F., Schuller, B., Valstar, M., Cummins, N., Cowie, R., Tavabi, L., Schmitt, M., Alisamir, S., Amiriparian, S., Messner, E.-M., et al. (2019) · Proceedings of the 9th International on Audio/Visual Emotion Challenge and Workshop · doi:10.1145/3347320.3357688 · Cited by 409
The Handbook of Behavior Change
Hagger, M. S., Cameron, L. D., Hamilton, K., Hankonen, N. E., & Lintunen, T. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108677318 · Cited by 446
Metadata
- Authors
- Baumel, A., & Yom-Tov, E.
- Affiliations
- Northwell Health (US)
- Microsoft Research, Herzeliya, Israel
- Corresponding author
- Baumel, Amit
- ORCID
- Baumel, Amit
- Venue
- Translational Behavioral Medicine
- Publisher
- Oxford University Press (OUP)
- Published
- 2018-02-17
- Volume
- 8
- Issue
- 5
- Pages
- 793-798
- ISSN
- 1613-9860 (ISSN-L)
- 1869-6716
- OpenAlex
- W2790152727
- Cited by
- 128
- References
- 32
- Citations by year
- 2026: 6 · 2025: 8 · 2024: 14 · 2023: 8 · 2022: 6 · 2021: 14 · 2020: 59 · 2019: 10 · 2018: 3
- FWCI
- 27.15
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- academic.oup.com/journals/pages/open_access/funder_policies/chorus/standard_publication_model (vor)
- Locations
- Translational Behavioral Medicine (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
- Physical Sciences › Computer Science › Human-Computer Interaction › Innovative Human-Technology Interaction
- Keywords
- user adherence, intervention design, persuasive design, behaviour change techniques, therapeutic relationship, usability, user engagement, online intervention, real-world applications
- MeSH terms
- Therapeutic Alliance, Adult, Behavior Therapy, Mental Disorders, Humans, Outcome and Process Assessment, Health Care, Patient Compliance, Persuasive Communication, Telemedicine, Internet
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review