The DOI matches its Crossref record; 32 of the 32 references it cites were found in a registry or an index.
Developing and Evaluating Digital Interventions to Promote Behavior Change in Health and Health Care: Recommendations Resulting From an International Workshop
Open accessAbstract
Devices and programs using digital technology to foster or support behavior change (digital interventions) are increasingly ubiquitous, being adopted for use in patient diagnosis and treatment, self-management of chronic diseases, and in primary prevention. They have been heralded as potentially revolutionizing the ways in which individuals can monitor and improve their health behaviors and health care by improving outcomes, reducing costs, and improving the patient experience. However, we are still mainly in the age of promise rather than delivery. Developing and evaluating these digital interventions presents new challenges and new versions of old challenges that require use of improved and perhaps entirely new methods for research and evaluation. This article discusses these challenges and provides recommendations aimed at accelerating the rate of progress in digital behavior intervention research and practice. Areas addressed include intervention development in a rapidly changing technological landscape, promoting user engagement, advancing the underpinning science and theory, evaluating effectiveness and cost-effectiveness, and addressing issues of regulatory, ethical, and information governance. This article is the result of a two-day international workshop on how to create, evaluate, and implement effective digital interventions in relation to health behaviors. It was held in London in September 2015 and was supported by the United Kingdom's Medical Research Council (MRC), the National Institute for Health Research (NIHR), the Methodology Research Programme (PI Susan Michie), and the Robert Wood Johnson Foundation of the United States (PI Kevin Patrick). Important recommendations to manage the rapid pace of change include considering using emerging techniques from data science, machine learning, and Bayesian approaches and learning from other disciplines including computer science and engineering. With regard to assessing and promoting engagement, a key conclusion was that sustained engagement is not always required and that for each intervention it is useful to establish what constitutes "effective engagement," that is, sufficient engagement to achieve the intended outcomes. The potential of digital interventions for testing and advancing theories of behavior change by generating ecologically valid, real-time objective data was recognized. Evaluations should include all phases of the development cycle, designed for generalizability, and consider new experimental designs to make the best use of rich data streams. Future health economics analyses need to recognize and model the complex and potentially far-reaching costs and benefits of digital interventions. In terms of governance, developers of digital behavior interventions should comply with existing regulatory frameworks, but with consideration for emerging standards around information governance, ethics, and interoperability.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“To date, low uptake and poor engagement are commonly observed with digital interventions, which are often insufficient to sustain behavior change [15,16].”
From Influences on the Uptake of and Engagement With Health and Well-Being Smartphone Apps: Systematic Review (2020) · cites this paper as [16]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Within the realm of digital interventions, using suitable strategies, such as user-centered participatory design, can heighten user engagement, thereby rendering intervention measures more appealing and efficacious [26].”
From Assessing the Effectiveness of Digital Health Behavior Strategies on Type 2 Diabetes Management: Systematic Review and Network Meta-Analysis (2025) · cites this paper as [26]
In the citing paper
“Behavioural theory can guide the design of mHealth interventions aimed at changing health behaviours.60”
From mHealth text and voice communication for monitoring people with chronic diseases in low-resource settings: a realist review (2018) · cites this paper as [60]
In the citing paper
“An important reason for the lack of justifications for the intended use of eHealth technologies might be that there is a lack of knowledge regarding the working mechanisms of technology-based applications [8].”
From Clarifying the Concept of Adherence to eHealth Technology: Systematic Review on When Usage Becomes Adherence (2017) · cites this paper as [8]
In the citing paper
“the results of a recent literature review of theoretical perspectives on adherence showed that adherence is a multidimensional concept, influenced by a range of technological, environmental, and individual factors altogether that cannot be evaluated by technology usage alone [8,84].”
From Clarifying the Concept of Adherence to eHealth Technology: Systematic Review on When Usage Becomes Adherence (2017) · cites this paper as [8]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Eysenbach, G., & CONSORT-EHEALTH Group (2011) · Journal of Medical Internet Research · doi:10.2196/jmir.1923 · Cited by 1,863 · cited 1×
“The advice provided here is specific to DBCIs, but it should also build on the good practice of reporting general mHealth interventions published elsewhere to ensure adequate description of the technical components of the intervention [44,45].”
BackgroundYardley, L., Morrison, L., Bradbury, K., & Muller, I. (2015) · Journal of Medical Internet Research · doi:10.2196/jmir.4055 · Cited by 1,442 · cited 2×
“These qualitative approaches are central to participatory user-centered design, which is the key to developing and evaluating DBCIs in order to ensure that they are engaging and effective [16,17].”
BackgroundSelf-citationA Holistic Framework to Improve the Uptake and Impact of eHealth Technologies
van Gemert-Pijnen, J. E., Nijland, N., van Limburg, M., Ossebaard, H. C., Kelders, S. M., Eysenbach, G., & Seydel, E. R. (2011) · Journal of Medical Internet Research · doi:10.2196/jmir.1672 · Cited by 1,126 · cited 2×
“These qualitative approaches are central to participatory user-centered design, which is the key to developing and evaluating DBCIs in order to ensure that they are engaging and effective [16,17].”
BackgroundUnderstanding and Promoting Effective Engagement With Digital Behavior Change Interventions
Yardley, L., Spring, B. J., Riper, H., Morrison, L. G., Crane, D. H., Curtis, K., Merchant, G. C., Naughton, F., & Blandford, A. (2016) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2016.06.015 · Cited by 1,118 · cited 3×
“The workshop led to a series of publications [3-7].”
BackgroundSelf-citationBuilding Ontologies with Basic Formal Ontology
Arp, R., Smith, B., & Spear, A. D. (2015) · The MIT Press eBooks · doi:10.7551/mitpress/9780262527811.001.0001 · Cited by 1,083 · cited 1×
“Such knowledge-organizing structures are called “ontologies” [22,23].”
The impact of guidance on Internet-based mental health interventions — A systematic review
Baumeister, H., Reichler, L., Munzinger, M., & Lin, J. (2014) · Internet Interventions · doi:10.1016/j.invent.2014.08.003 · Cited by 1,037 · cited 1×
“Adding human support is also known to promote engagement with many interventions [18].”
BackgroundEvaluating Digital Health Interventions
Murray, E., Hekler, E. B., Andersson, G., Collins, L. M., Doherty, A., Hollis, C., Rivera, D. E., West, R., & Wyatt, J. C. (2016) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2016.06.008 · Cited by 847 · cited 4×
“The workshop led to a series of publications [3-7].”
BackgroundInfluentialSelf-citationRamsey, S. D., Willke, R. J., Glick, H., Reed, S. D., Augustovski, F., Jonsson, B., Briggs, A., & Sullivan, S. D. (2015) · Value in Health · doi:10.1016/j.jval.2015.02.001 · Cited by 811 · cited 1×
“However, existing economic approaches (eg, ISPOR guidance [29]) will need to be adapted to take into account the way digital health interventions are delivered, covering the whole life cycle of the intervention.”
BackgroundMichie, S., Wood, C. E., Johnston, M., Abraham, C., Francis, J. J., & Hardeman, W. (2015) · Health Technology Assessment · doi:10.3310/hta19990 · Cited by 680 · cited 1×
“This includes designing DBCIs on a modular basis with a clear understanding of which behavior change techniques [43] constitute that module and how they link to the theoretically postulated mechanisms of action.”
BackgroundSelf-citationAgarwal, S., LeFevre, A. E., Lee, J., L’Engle, K., Mehl, G., Sinha, C., & Labrique, A. (2016) · BMJ · doi:10.1136/bmj.i1174 · Cited by 639
Flagged first, then by citations
Research works printed but not linked: 8
- West, R, 2016, A Guide to the Development and Evaluation of Digital Behaviour Change Intervention
- Michie, S, 2014, ABC of Behaviour Change Theories: An Essential Resource for Researchers, Policy Makers and Practitioners
- Christmas, S, 2015, Thinking about behaviour change: an interdisciplinary dialogue
- 2016, Optimizing the Nation's Investment in Academic Research A New Regulatory Framework for the 21st Century
- 2014, Guidance: Medical device stand-alone software including apps
- 2014, Personalised Health and Care 2020: Using data and technology to transform outcomes for patients and citizens
- 1998, Data Protection Act 1998
- 2016, Regulation (EU) of the European Parliament and of the Council of 27 April 2016 on the protection of natural persons with regard to the processing of personal data and on the free movement of such data (General Data Protection Regulation)
Cited by
Sorted by citations
Items 301–400 of 866
Online interventions for sexual health in cancer
Matthew, A., & Yang, Z. (2019) · Current Opinion in Supportive and Palliative Care · doi:10.1097/spc.0000000000000477 · Cited by 17
“Similarly, the acceptability of digital health interventions is evidenced by their increasing prevalence across many healthcare areas including primary prevention, diagnosis, treatment, and management of disease and treatment sideeffects [24].”
BackgroundThe Role of a Smart Health Ecosystem in Transforming the Management of Chronic Health Conditions
Nourse, R. A., Dingler, T., Kelly, J. T., Kwaśnicka, D., & Maddison, R. (2023) · Journal of Medical Internet Research · doi:10.2196/44265 · Cited by 17
“It is recommended that theories be used to guide intervention development and implementation as this can improve the acceptability and increase the effectiveness of interventions [39].”
Stephenson, A., García-Constantino, M., McDonough, S., MURPHY, M. H., Nugent, C., & Mair, J. L. (2020) · Digital Health · doi:10.1177/2055207620913410 · Cited by 16
“Incorporating UCD principles ensures that interventions are responsive to users’ needs and preferences, and are designed ‘from the ground up’ rather than based on developers’ preconceptions or rigid procurement briefs.(45,47) This study describes the process undertaken to design and develop a digital DBCI to reduce oc…”
BackgroundMethodFord, K. L., Portz, J. D., Zhou, S., Gornail, S., Moore, S. L., Zhang, X., & Bull, S. S. (2021) · Frontiers in Digital Health · doi:10.3389/fdgth.2021.616278 · Cited by 18
“In the last few years, researchers and policy makers endorsed interdisciplinary collaboration and future efforts to advance digital health technologies (11, 88, 89).”
BackgroundHawkes, R. E., Miles, L. M., & French, D. (2022) · Journal of Medical Internet Research · doi:10.2196/34253 · Cited by 17
“Digital interventions may allow higher fidelity as staff do not have to be trained to deliver all the intervention content [7].”
BackgroundMacaulay, L., O’Dolan, C., Avenell, A., Carroll, P., Cotton, S. C., Dombrowski, S. U., Elders, A., Goulão, B., Gray, C. M., Harris, F., et al. (2022) · Trials · doi:10.1186/s13063-022-06504-5 · Cited by 16
“Testing innovative, scalable, digital interventions for reducing obesity is recommended to increase reach to men and promote self-management [11].”
BackgroundNovel behaviour change frameworks for digital health interventions: A critical review
Pelly, M. L., Fatehi, F., Liew, D., & Verdejo‐García, A. (2023) · Journal of Health Psychology · doi:10.1177/13591053231164499 · Cited by 20
Trends in patients’ overall satisfaction with healthcare delivery in Accra, Ghana
Odonkor, S. T., Frimpong, C. A., Duncan, E., & Odonkor, C. J. A. (2019) · African Journal of Primary Health Care & Family Medicine · doi:10.4102/phcfm.v11i1.1884 · Cited by 16
Edridge, C., Wolpert, M., Deighton, J., & Edbrooke-Childs, J. H. (2020) · Journal of Medical Internet Research · doi:10.2196/14223 · Cited by 17
“Due to the complex nature of digital interventions, traditional RCTs may be insufficient to assess efficacy [8].”
BackgroundKelly, P. J., Beck, A. K., Deane, F. P., Larance, B., Baker, A., Hides, L. M., Manning, V., Shakeshaft, A. P., Neale, J., Kelly, J. F., et al. (2021) · Journal of Medical Internet Research · doi:10.2196/25217 · Cited by 16
“The development of SMART Track was grounded in theory [40,57] and user-centered design [57].”
Lisowska, A., Szymon Wilk, A., & Mor Peleg, B. (2022) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2022.104276 · Cited by 15
McGirr, C., Rooney, C., Gallagher, D., Dombrowski, S. U., Anderson, A. S., Cardwell, C. R., Free, C., Hoddinott, P., Holmes, V. A., McIntosh, E., et al. (2020) · Public Health Research · doi:10.3310/phr08040 · Cited by 15
Special issue on digital health interventions in chronic medical conditions: Editorial
Baumeister, H., Ebert, D. D., & Snoek, F. (2022) · Internet Interventions · doi:10.1016/j.invent.2021.100457 · Cited by 13
“The studies target a broad range of chronic medical conditions, including diabetes (Geirhos et al., 2021; Mellergård et al., 2021; Muijs et al., 2021), cancer (Harnas et al., 2021; Nap-van der Vlist et al., 2021; van der Hout et al., 2021), arthritis and pain (Blaney et al., 2021; Geirhos et al.,…”
BackgroundEiselt, A.-K., Kirkendall, S., Xiong, E., Langner, D., & Goldfarb, M. B. (2026) · Frontiers in Digital Health · doi:10.3389/fdgth.2025.1713334 · Cited by 20
Young, C., Mohebbi, M., Staudacher, H. M., Berk, M., Jacka, F. N., & O'Neil, A. E. (2021) · International Review of Psychiatry · doi:10.1080/09540261.2020.1854193 · Cited by 16
“Both eHealth and m-Health interventions can be effective in changing health behaviours (S. Michie et al., 2017).”
BackgroundSoltero, E. G., Lopez, C., Hernandez, E., O’Connor, T. M., & Thompson, D. I. (2022) · JMIR Pediatrics and Parenting · doi:10.2196/39261 · Cited by 16
“Technology-based interventions use digital devices, such as computers, tablets, smartphones, and wearable devices, to deliver personalized and real-time health promotion and disease prevention interventions [10-13].”
BackgroundAgachi, E., Bijmolt, T. H. A., van Ittersum, K., & Mierau, J. O. (2023) · JMIR mhealth and uhealth · doi:10.2196/43033 · Cited by 15
“In general, mHealth apps suffer from low participant engagement and high dropout rates [33,34].”
Mixed Reality-based Exergames for Upper Limb Robotic Rehabilitation
Garcia-Hernandez, N. V., Buccelli, S., Laffranchi, M., & Michieli, L. D. (2023) · ACM/IEEE International Conference on Human-Robot Interaction (HRI) · doi:10.1145/3568294.3580124 · Cited by 15
Jeong, S., & Nam, Y.-G. (2024) · Healthcare · doi:10.3390/healthcare12222261 · Cited by 16
“Several previous studies have examined the impact of digital health technologies on health outcomes [13–20].”
Halminen, O., Chen, A., Tenhunen, H., & Lillrank, P. M. (2020) · Health Services Management Research · doi:10.1177/0951484820971447 · Cited by 15
“As compared with traditional interventions, DHIs are often “rapidly developed and tend to iterate, update, and improve” 14 and “evolving through several stages of maturity during which the evaluation needs of the intervention are also changing rapidly”.”
ResultYoung, C., Mohebbi, M., Staudacher, H. M., KAY‐LAMBKIN, F. J., Berk, M., Jacka, F. N., & O'Neil, A. E. (2021) · JMIR Mental Health · doi:10.2196/24871 · Cited by 14
“In addition, analyzing these types of data against intervention outcomes will enable robust estimates of effective engagement [21].”
A survey of technology literacy and use in cancer survivors from the Alberta Cancer Exercise program
Ester, M., McNeely, M. L., McDonough, M. H., & Culos-Reed, S. N. (2021) · Digital Health · doi:10.1177/20552076211033426 · Cited by 14
“12–16 In addition, challenges concerning study adherence and continued engagement with mHealth may limit the effectiveness of mHealth PA interventions.(17,18) According to the Technology Acceptance Model and the Unified Theory of Technology Use and Acceptance, perceived ease of use (effort expectancy), as influenced b…”
MethodShoneye, C. L., Dhaliwal, S. S., Pollard, C. M., Boushey, C. J., Delp, E. J., Harray, A. J., Howat, P. A., Hutchesson, M., Rollo, M. E., Zhu, F. M., et al. (2019) · Nutrients · doi:10.3390/nu11020435 · Cited by 15
“Digital behavior change interventions (DBCI) combining these approaches are evolving rapidly, introducing new challenges for evaluation including understanding their role in effective engagement with end users [12].”
BackgroundGallagher, R. D., Parker, H. M., Zhang, L., Kirkness, A., Roach, K., Belshaw, J., Glinatsis, H., Gallagher, P., & Neubeck, L. (2019) · Heart Lung and Circulation · doi:10.1016/j.hlc.2019.05.178 · Cited by 15
Consumers' Preferences and Willingness to Pay for Personalised Nutrition
Pérez-Troncoso, D., Epstein, D., & Castañeda-García, J. (2021) · Applied Health Economics and Health Policy · doi:10.1007/s40258-021-00647-3 · Cited by 13
“Information on perceptions of users is crucial at all stages in the product development cycle [24].”
BackgroundKar, P. S., Goward, C., Whitman, M., Davies, M., Willner, T., & Shaw, K. (2020) · Practical Diabetes · doi:10.1002/pdi.2295 · Cited by 14
“35 For this analysis, peer or health coach interactions, reading of learning material, and self-monitoring were used to demonstrate proactive engagement.”
MethodAppiah, R., Fadiji, A. W., Wissing, M. P., & Schutte, L. (2021) · Journal of Community Psychology · doi:10.1002/jcop.22566 · Cited by 16
Wu, D., An, J., Yu, P., Lin, H., Ma, L., Duan, H., & Deng, N. (2021) · Journal of Medical Internet Research · doi:10.2196/25630 · Cited by 14
Cruz-Martínez, R. R., Wentzel, J., Bente, B. E., Sanderman, R., & van Gemert‐Pijnen, J. E. W. C. (2021) · JMIR Cardio · doi:10.2196/31985 · Cited by 14
“In this way, technical investigations could help advance knowledge about what works, for whom, and why in terms of CVD self-management [22].”
BackgroundStockley, R., & Christian, D. L. (2022) · Archives of Physiotherapy · doi:10.1186/s40945-022-00139-0 · Cited by 14
Frennert, S., Erlingsdóttir, G., Muhic, M., Rydenfält, C., Nymberg, V. M., & Ekman, B. (2022) · Scandinavian Journal of Caring Sciences · doi:10.1111/scs.13099 · Cited by 14
Long-term usage of a commercial mHealth app: A “multiple-lives” perspective
Lau, E. Y., Mitchell, M., & Faulkner, G. (2022) · Frontiers in Public Health · doi:10.3389/fpubh.2022.914433 · Cited by 16
Perkes, S. J., Bonevski, B., Hall, K., Mattes, J. E., Chamberlain, C., Bennett, J., Whittaker, R., Palazzi, K. L., Lambkin, D., & Kennedy, M. (2023) · Journal of Medical Internet Research · doi:10.2196/42660 · Cited by 14
“This information is critical to designing interventions that have sustained engagement [23], which many mHealth solutions fall short of [24].”
Mekhael, M., Ho, C., Noujaim, C., Assaf, A. Y. M., Younes, H., Hajjar, A. H. E., Chaudhry, H. A., Lanier, B., Chouman, N., Makan, N., et al. (2023) · Journal of Medical Internet Research · doi:10.2196/43134 · Cited by 14
“These findings are primarily the result of decreased compliance or difficulties in using such tools [8,13-15].”
Carrera, A., Manetti, S., & Lettieri, E. (2024) · BMC Health Services Research · doi:10.1186/s12913-024-10702-z · Cited by 17
“Indeed, the development and assessment of disruptive innovation such as DTx introduces additional hurdles (e.g., regulatory frameworks, ethics considerations, organizational challenges) calling for the design of updated and potentially new methodologies for research and evaluation [47].”
BackgroundLie, S. S., Karlsen, B., Niemiec, C. P., Graue, M., & Oftedal, B. F. (2018) · Patient Preference and Adherence · doi:10.2147/ppa.s154612 · Cited by 15
“40 Nonetheless, we anticipate that the benefits associated with in-person consultation are likely to outweigh the costs.”
Goodrich, D. E., Lowery, J. C., Burns, J., & Richardson, C. R. (2018) · JMIR Diabetes · doi:10.2196/diabetes.9867 · Cited by 14
“Although the telehealth technology highlighted by this mixed-methods program evaluation may seem dated by today’s standards, the barriers to implementation of new generations of eHealth and mHealth technologies largely remain the same [47].”
Design and Development of a Digital Weight Management Intervention (ToDAy): Qualitative Study
Shoneye, C. L., Mullan, B. A., Begley, A. M., Pollard, C. M., Jancey, J. M., & Kerr, D. A. (2020) · JMIR mhealth and uhealth · doi:10.2196/17919 · Cited by 14
“Future studies will assess the relationship between behavior change and intervention features, consistent with guidelines for developing digital health interventions [49].”
BackgroundMethodHind, D., Drabble, S. J., Arden, M. A., Mandefield, L., Waterhouse, S., Maguire, C., Cantrill, H., Robinson, L., Beever, D., Scott, A. J., et al. (2020) · BMJ Open · doi:10.1136/bmjopen-2020-039089 · Cited by 14
Zick, S. M., Kruger, G. H., Harte, S. E., Sen, A., Harris, R. E., & Pearce, C. L. (2021) · Contemporary Clinical Trials · doi:10.1016/j.cct.2021.106477 · Cited by 14
Li, M., Liu, S., Yu, B., Li, N., Lyu, A., Yang, H., He, H., Zhang, N., Ma, J., Sun, M., et al. (2025) · Journal of Medical Internet Research · doi:10.2196/63209 · Cited by 12
“Within the realm of digital interventions, using suitable strategies, such as user-centered participatory design, can heighten user engagement, thereby rendering intervention measures more appealing and efficacious [26].”
Kip, H., Kelders, S. M., & Van Gemert-Pijnen, L. J. E. W. C. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300365 · Cited by 11
“When looking at literature on eHealth development in general, the importance of incorporating stakeholder perspectives and continuous formative evaluations is indeed deemed essential [3, 23–26].”
BackgroundWang, Q., Yang, W., Xu, K., & Lam, L. T.-M. (2025) · Digital Health · doi:10.1177/20552076251353731 · Cited by 14
Irvine, L. A., Morris, J. H., Dombrowski, S. U., Breckenridge, J. P., Farré, A., Özakinci, G., Lebedis, T., & Jones, C. (2023) · Pilot and Feasibility Studies · doi:10.1186/s40814-023-01326-x · Cited by 13
Zhang, H., Yang, Y., Hao, X., Qin, Y., & Li, K. (2023) · Sleep Medicine · doi:10.1016/j.sleep.2023.07.036 · Cited by 15
Mobile health applications for health-care delivery: trends, opportunities, and challenges
Goel, A., & Taneja, U. (2023) · Journal of Public Health · doi:10.1007/s10389-023-02165-z · Cited by 16
Du, J. C., Jin, G., Zhang, H., Operario, D., Shi, H., Wang, S., Wang, J., Sun, Y., & Zhang, Z. (2025) · Current HIV/AIDS Reports · doi:10.1007/s11904-025-00733-4 · Cited by 13
“Digital health interventions show significant promise in enhancing population health and improving healthcare service efficiency and coverage [ 20–22].”
Robertson, M. C., Lyons, E., Liao, Y., Baum, M. L., & Basen‐Engquist, K. (2020) · JMIR mhealth and uhealth · doi:10.2196/18364 · Cited by 15
“One exception is that the participants’ response rate to the text messages requesting a response was low; this corroborates previous literature that has identified participant engagement as a challenge to mHealth interventions [41,42].”
BackgroundResultAsiri, Y., Millard, D. E., & Weal, M. J. (2021) · IEEE Transactions on Learning Technologies · doi:10.1109/tlt.2021.3104817 · Cited by 13
“DBCIs are methods applied when providing the learner with continual support and tailored guidance, with the objective of altering unwelcome behaviors through interactions with weband mobile- based platforms [42], [43].”
MethodChen, J., Houston, T. K., Faro, J. M., Nagawa, C. S., Orvek, E., Blok, A. C., Allison, J. J., Person, S. D., Smith, B., & Sadasivam, R. S. (2021) · BMC Public Health · doi:10.1186/s12889-021-11803-8 · Cited by 13
van Beurden, S. B., Greaves, C. J., Abraham, C., Lawrence, N., & Smith, J. R. (2021) · Digital Health · doi:10.1177/20552076211057667 · Cited by 14
“However, more recently, and specific to lifestyle interventions, the term digital behaviour change interventions (DBCIs) has emerged, which typically refer to the use of websites and smartphones as intervention delivery platforms.(62) The aim of this paper is to describe the systematic development of a self-delivered…”
BackgroundFundoiano-Hershcovitz, ., Bacher, D., Ritholz, M. D., Horwitz, D. L., Manejwala, O., & Goldstein, P. (2022) · Journal of Medical Internet Research · doi:10.2196/32923 · Cited by 14
“On the one hand, mobile apps have been shown to improve diabetes outcomes via education and support for adhering to evidence-based recommendations [29-32].”
BackgroundTorkamaan, H., & Ziegler, J. (2022) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/3490099.3511118 · Cited by 13
“User engagement is one of the prime challenges of digital interventions [35] — that is using digital technology, e.g., mobile devices [8, 32, 33, 37, 52, 55, 58] for behavior change.”
BackgroundPrinciples for Developing Innovative HIV Digital Health Interventions
Burrus, O., Gupta, C., Ortiz, A., Zulkiewicz, B. A., Furberg, R., Uhrig, J. D., Harshbarger, C. L., & Lewis, M. A. (2018) · Medical Care · doi:10.1097/mlr.0000000000000957 · Cited by 13
Mobile Apps for Health Behavior Change: Protocol for a Systematic Review
Milne‐Ives, M., Lam, C., van Velthoven, M. H., & Meinert, E. (2019) · JMIR Research Protocols · doi:10.2196/16931 · Cited by 13
“Recently, there has been much research about the use of digital technologies to enhance specific health behaviors [3,4].”
Dumas, A., Lemieux, S., Lapointe, A., Provencher, V., Robitaille, J., & Desroches, S. (2020) · Trials · doi:10.1186/s13063-020-04628-0 · Cited by 13
Howell, D., Bryant‐Lukosius, D., Avery, J., Santaguida, A., Powis, M., Papadakos, T. J., Addario, V., Lovas, M., Kukreti, V., Haase, K. R., et al. (2023) · JMIR Cancer · doi:10.2196/44914 · Cited by 13
“Many have not been developed using a co-design approach or best practices in usability testing and seldom target the active treatment phase of cancer [35].”
MethodDudley, R. E. J., Dodgson, G., Common, S., Ogundimu, E. O., Liley, J., O'Grady, L., Watson, F., Gibbs, C., Arnott, B., Fernyhough, C., et al. (2024) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2024.04.031 · Cited by 11
Farmer, A. A., Bobrow, K., Leon, N., Williams, N., Phiri, E., Namadingo, H., Cooper, S., Prince, J., Crampin, A. C., Besada, D., et al. (2019) · JMIR Research Protocols · doi:10.2196/12377 · Cited by 12
“We have also used theory-and evidence-informed behavior-change constructs to guide the content and delivery mechanisms of the SMS text message intervention in this setting [19].”
Integrated Analytical Framework for the Development of Artificial Intelligence-Based Medical Devices
Arima, H., & Kano, S. (2021) · Therapeutic Innovation & Regulatory Science · doi:10.1007/s43441-021-00292-x · Cited by 14
“The main requirements were extracted from the requirements for devices and program challenges related to digital technology to facilitate or support the behavioral changes in healthcare professionals, patients, or the general public [14].”
BackgroundMethodCreber, R. M., Turchioe, M. R., BIVIANO, A. B., Caceres, B. A., Garan, H., Goldenthal, I. L., Koleck, T. A., Mitha, S. A., Hickey, K. T., & Henry, S. B. (2021) · European Journal of Cardiovascular Nursing · doi:10.1093/eurjcn/zvab009 · Cited by 13
“Across many health domains, sustained patient engagement with digital health technologies has been low.(14,15) The optimal frequency and duration of engagement with digital health are generally driven by clinical necessity.”
BackgroundWhale, K., Beasant, L., Wright, A. J., Yardley, L., WALLACE, L. M., Moody, L., & Joinson, C. J. (2021) · JMIR Pediatrics and Parenting · doi:10.2196/26212 · Cited by 12
“The development of URApp was informed by the Medical Research Council guidance for developing and evaluating digital interventions [25], which recommends the use of theory to inform intervention design and delivery [26,27].”
MethodSelf-citationCan We Use Commercial Mobile Apps Instead of Research Mobile Apps in Healthcare Research?
Sezgın, E. (2021) · Frontiers in Public Health · doi:10.3389/fpubh.2021.685439 · Cited by 15
“Behavior change techniques (BCT) and digital behavior change interventions (DBCI) have been used to investigate promotion of healthy behavior using RMA (6).”
MethodPimenta, N. M., Félix, I. B., Monteiro, D., Marques, M. M., & Guerreiro, M. P. (2022) · Frontiers in Psychology · doi:10.3389/fpsyg.2022.883354 · Cited by 13
The NIH Science of Behavior Change Program: Looking Toward the Future
Stoeckel, L. E., Hunter, C. M., Onken, L. S., Green, P. A., Nielsen, L., Aklin, W. M., & Simmons, J. M. (2023) · Behavior Therapy · doi:10.1016/j.beth.2023.03.006 · Cited by 12
Precision health research and implementation reviewed through the conNECT framework
Menon, U., Cohn, E. G., Downs, C. A., Gephart, S. M., & Redwine, L. S. (2019) · Nursing Outlook · doi:10.1016/j.outlook.2019.05.010 · Cited by 12
Bente, B. E., Wentzel, J., Groeneveld, R. G., IJzerman, R. V. H., de Buisonjé, D. R., Breeman, L. D., Janssen, V. R., Kraaijenhagen, R. A., Pieterse, M. E., Evers, A. W. M., et al. (2021) · JMIR Cardio · doi:10.2196/33252 · Cited by 13
“This contributes to better uptake and adherence to lifestyle change, and improve health outcomes [5].”
BackgroundHeffner, J. L., Watson, N. L., Serfozo, E., Mull, K. E., MacPherson, L., Gasser, M., & Bricker, J. B. (2019) · JMIR Formative Research · doi:10.2196/13728 · Cited by 10
“The app was created following an iterative user-centered design process [24] including competitive analysis, focus groups, and usability testing of low- and high-fidelity prototypes followed by a single-arm pilot trial.”
MethodShim, Y., Scotney, V. S., & Tay, L. (2021) · The Journal of Positive Psychology · doi:10.1080/17439760.2021.1913642 · Cited by 14
“The software must be sensitive to the process and content of the mEMI (Michie et al., 2017), and the way content is displayed needs to have design sensibilities that enhance user experiences (e.g., Short et al., 2015; Yardley et al., 2016).”
BackgroundMethodHobby, J., Crowley, J., Barnes, K. A., MITCHELL, L. J., Parkinson, J. E., & Ball, L. (2022) · BMJ Open · doi:10.1136/bmjopen-2021-058955 · Cited by 11
“27 Across the review, studies used a variety of theories and models including the stages of change model, 28 motivational interviewing 29 and cognitive behavioural therapy.”
MethodDevelopment of the intelligent knee osteoarthritis lifestyle app: a person-based approach
Stevenson, R. D. M., Chowdhury, E. A., Inza, V. B., Western, M. J., Walsh, N. E., Jones, S. L., & Bilzon, J. (2024) · BMC Musculoskeletal Disorders · doi:10.1186/s12891-024-07313-4 · Cited by 12
“However, it is recognised that to enhance the likelihood of longer-term success, these technologies should be based on empirical behavioural theory [20] and adopt a person-based approach to development to ensure they meet the needs of target users [21, 22].”
BackgroundLalloo, C., Phạm, Q., Cafazzo, J. A., Stephenson, E. A., & Stinson, J. (2020) · Contemporary Clinical Trials Communications · doi:10.1016/j.conctc.2020.100525 · Cited by 9
Zheluk, A., & Maddock, J. (2020) · JMIR Formative Research · doi:10.2196/23366 · Cited by 12
“DHIs include all interventions delivered via digital technologies that facilitate health behavior change [34].”
Holen-Rabbersvik, E., Ullebust, B., Ree, E., Schibevaag, L., Hurup-Thomsen, L., Strømme, T., Aase, K., Aase, I., Ellis, L. A., & Wiig, S. (2020) · Tidsskrift for omsorgsforskning · doi:10.18261/issn.2387-5984-2020-02-07 · Cited by 11
Leveraging Technology to Overcome the “Scalability Problem” in Communication Skills Training Courses
Callahan, M. E., Brant, E. B., Mohan, D., Norman, M. K., Arnold, R. M., & White, D. B. (2021) · ATS Scholar · doi:10.34197/ats-scholar.2020-0164ps · Cited by 14
“Engagement refers to the learner’s willingness to interact with the intervention and investment in learning the skill at hand (13).”
BackgroundDurán, L., Almeida, A. M., Lopes, A. C., & Figueiredo‐Braga, M. (2022) · Healthcare · doi:10.3390/healthcare10010165 · Cited by 11
Yang, W., Zhang, X., Chen, J., Miao, W., Zheng, C., Qian, X., & Geng, G. (2022) · Primary care diabetes · doi:10.1016/j.pcd.2022.05.004 · Cited by 11
McNamara, L., Scott, K. M., Boyd, R. N., Farmer, E. S., Webb, A., Bosanquet, M., Nguyen, K., & Novak, I. (2022) · BMJ Open · doi:10.1136/bmjopen-2022-063558 · Cited by 13
Validation of the VitaBit Sit–Stand Tracker: Detecting Sitting, Standing, and Activity Patterns
Berninger, N. M., ten Hoor, G. A., & Plasqui, G. (2018) · Sensors · doi:10.3390/s18030877 · Cited by 11
“Those factors are often summarized as tailoring and user support and can increase program engagement, and therefore behavioral change [26].”
BackgroundNewman, C. G. J., Ashby, S., McLean, B., & Shankar, R. (2019) · Epilepsy & Behavior · doi:10.1016/j.yebeh.2019.106514 · Cited by 11
Malik, S. H., Moloney, C., Koledova, E. B., Reston, J., & Weinman, J. A. (2020) · Journal of Medical Internet Research · doi:10.2196/18157 · Cited by 11
Rahman, M. A., Rashed, R., Purabi, S. A., Ulfat, N., Chellappan, S., & Islam, A. B. M. A. A. (2021) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3449118 · Cited by 11
“In this realm, a particularly powerful concept is called Just-in-time-adaptive interventions (JITAIs) [68, 74, 100], where the goal is to slowly learn about a subject over time, and interveneminimally, but still optimally, only when needed.”
BackgroundAdvancing Digital Behavior Change Interventions by Exploring a Calendar-Based Suggestion System
Damen, I., van den Heuvel, R., Brankaert, R., & Vos, S. B. (2021) · European Conference on Cognitive Ergonomics · doi:10.1145/3452853.3452866 · Cited by 11
“As mentioned by Michie et al. (2017), ’we are still mainly in the age of promise rather than delivery’.”
BackgroundInfluentialOnline and Offline Behavior Change Techniques to Promote a Healthy Lifestyle: A Qualitative Study
Bossen, D., Bak, M., Braam, K. I., Wentink, M. M., Holla, J., Visser, B., & Dallinga, J. M. (2022) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph19010521 · Cited by 15
“These disappointing findings are often related to poor adherence rates and a lack of clarity which mechanisms and BCT components of eHealth interventions support behavior change [20].”
BackgroundCruz-Martínez, R. R., Noort, P. D., Asbjørnsen, R. A., van Niekerk, J. M., Wentzel, J., Sanderman, R., & van Gemert‐Pijnen, J. E. W. C. (2019) · JMIR Research Protocols · doi:10.2196/13334 · Cited by 11
“[2].”
InfluentialFakolade, A. O., Walters, A. J., Cameron, J., Latimer‐Cheung, A. E., & Pilutti, L. A. (2019) · Patient Education and Counseling · doi:10.1016/j.pec.2019.10.022 · Cited by 11
Self-help interventions for young people with persistent physical symptoms: a systematic review
Holsting, A. F., Rask, M. T., Frostholm, L., Rosendal, M., & Rask, C. U. (2021) · Journal of Psychosomatic Research · doi:10.1016/j.jpsychores.2021.110553 · Cited by 10
Robertson, M. C., Baranowski, T., Thompson, D. I., Basen‐Engquist, K., Swartz, M. C., & Lyons, E. (2021) · JMIR Serious Games · doi:10.2196/29964 · Cited by 12
Democratizing Global Health Care Through Scalable Emergent (Beyond the Mobile) Wireless Technologies
Jones, G. B., Bryant, A., & Wright, J. (2022) · JMIR Biomedical Engineering · doi:10.2196/31079 · Cited by 10
“The promise of digitally enabled health care is being realized at an incredible pace [3].”
BackgroundSobolev, M., Anand, A., Dziak, J. J., Potter, L. N., Lam, C. Y., Wetter, D. W., & Nahum-Shani, I. B. (2023) · Frontiers in Digital Health · doi:10.3389/fdgth.2023.1144081 · Cited by 10
Henshall, C. L., Davey, Z., Jacelon, C. S., & Martin, C. E. (2019) · Health Informatics Journal · doi:10.1177/1460458219882268 · Cited by 10
“28,30,32 In 33–36 The Internet-based Exercise-focused Health App for Lung cancer survivors (iEXHALE), is a mobile web app that is currently being developed and will be designed to provide lung cancer survivors with an algorithm-based, tailor-made, self-management programme that can be used to…”
BackgroundInfluentialBen, S., Xin, J., Chen, S., Jiang, Y., Yuan, Q., Li, S., Christiani, D. C., Zhang, Z., Du, M., & Wang, M. (2021) · Journal of Infection · doi:10.1016/j.jinf.2021.11.003 · Cited by 11
Kitsaras, G., Pretty, I., & Allan, J. (2022) · Pilot and Feasibility Studies · doi:10.1186/s40814-022-01039-7 · Cited by 8
“The same principles highlight the criteria likely to influence the feasibility and success of a behavioural intervention through the APEASE criteria (Affordability, Practicability, Effectiveness, Accessibility, Safety and Equity) and the need for feasibility and proofof-concept studies prior to larger, more robust and…”
BackgroundRodda, S. N., Bagot, K. L., Merkouris, S., Youssef, G. J., Lubman, D. I., Thomas, A. C., & Dowling, N. A. (2022) · JMIR Research Protocols · doi:10.2196/38919 · Cited by 11
“Consistent with recommendations [43,87], Gambling Habit Hacker is based on well-established behavior change frameworks that delineate intentional and volitional phases, targeting the volitional phase.”
MethodO'Connor, C., Leyritana, K., Doyle, A., Birdthistle, I., Lewis, J., Gill, R., & Salvaña, E. (2022) · JMIR Formative Research · doi:10.2196/37163 · Cited by 12
“For mHealth interventions, current guidance suggests that practitioners should also include a minimum set of information about the content, context, and technical features of the intervention, including aspects such as ease of use, content quality, privacy and security, service quality, personalization, and perceived…”
BackgroundAn implementation framework for transformative gamification services
Tanouri, A., Kennedy, A., & Veer, E. (2023) · Behaviour and Information Technology · doi:10.1080/0144929x.2023.2241560 · Cited by 11
“This is important as behaviour change is a long-term process and creation of a new behaviour requires adequate uptake and sustained engagement with gami fi cation services (Co ş kun and Erbu ğ 2016; Kohl, Crutzen, and de Vries 2013; Michie et al. 2017).”
Statistics and Data Science Collaboration Laboratories: Engines for Development
Vance, E. A., & Pruitt, T. R. (2022) · Chapman & Hall/CRC eBooks · doi:10.1201/9781003261148-2 · Cited by 10
Kernebeck, S., Scheibe, M., Sinha, M., Fischer, F., Knapp, A., Timpel, P., Harst, L., Reininghaus, U., & Vollmar, H. C. (2022) · Das Gesundheitswesen · doi:10.1055/a-1915-4371 · Cited by 12
Wood, W. A., Bailey, C., Castrogivanni, B., Mehedint, D., Bryant, A. L., Lavin, K. N., Tan, X. M., Richardson, J., Qian, Y., Tan, K., et al. (2023) · Cancer Medicine · doi:10.1002/cam4.5625 · Cited by 9
Phạm, Q., Shaw, J., Morita, P. P., Seto, E., Stinson, J., & Cafazzo, J. A. (2019) · Journal of Medical Internet Research · doi:10.2196/14849 · Cited by 12
“Transformative advances to the technological components powering these novel interventions have rapidly changed their capacity to improve health outcomes [3].”
Background
Metadata
- Authors
- Michie, S., Yardley, L., West, R., Patrick, K., & Greaves, F.
- Affiliations
- University College London (GB)
- University of Oxford (GB)
- University of California San Diego (US)
- Public Health England (GB)
- Corresponding author
- Michie, Susan
- Venue
- Journal of Medical Internet Research
- Publisher
- JMIR Publications Inc.
- Published
- 2017-06-29
- Volume
- 19
- Issue
- 6
- Pages
- e232
- ISSN
- 1438-8871 (ISSN-L)
- PMC
- PMC5509948
- OpenAlex
- W2724146920
- Cited by
- 865
- References
- 32
- Citations by year
- 2026: 75 · 2025: 94 · 2024: 98 · 2023: 94 · 2022: 122 · 2021: 120 · 2020: 94 · 2019: 98 · 2018: 59 · 2017: 11
- FWCI
- 81.54
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- Journal of Medical Internet Research (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- ePrints Soton (University of Southampton) (acceptedVersion)
- UCL Discovery (University College London) (submittedVersion)
- Explore Bristol Research (submittedVersion, cc-by)
- Bristol Research (University of Bristol) (submittedVersion, cc-by)
- Spiral (Imperial College London) (submittedVersion, other-oa)
- Funders
- Robert Wood Johnson Foundation
- Cancer Research UK (22962)
- National Institute for Health and Care Research
- Medical Research Council (MR/K023195/1)
- Economic and Social Research Council (ES/F029624/1)
- Topics
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
- Social Sciences › Psychology › Applied Psychology › Behavioral Health and Interventions
- Keywords
- digital interventions, behavior change, health behavior, health care, intervention development, user engagement, cost-effectiveness, health economics, regulatory framework, information governance, ethics, interoperability, machine learning, data science, Bayesian approach, chronic disease self-management, primary prevention
- MeSH terms
- Delivery of Health Care, Humans, Health Behavior, Telemedicine, Internet
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
