Implementation Strategies to Enhance the Implementation of eHealth Programs for Patients With Chronic Illnesses: Realist Systematic Review
Open accessAbstract
Background: There is growing evidence of the positive effects of electronic health (eHealth) interventions for patients with chronic illness, but implementation of such interventions into practice is challenging. Implementation strategies that potentially impact implementation outcomes and implementation success have been identified. Which strategies are actually used in the implementation of eHealth interventions for patients with chronic illness and which ones are the most effective is unclear. Objective: This systematic realist review aimed to summarize evidence from empirical studies regarding (1) which implementation strategies are used when implementing eHealth interventions for patients with chronic illnesses living at home, (2) implementation outcomes, and (3) the relationship between implementation strategies, implementation outcomes, and degree of implementation success. Methods: A systematic literature search was performed in the electronic databases MEDLINE, Embase, PsycINFO, Scopus, Allied and Complementary Medicine Database, Cumulative Index to Nursing and Allied Health Literature, and Cochrane Library. Studies were included if they described implementation strategies used to support the integration of eHealth interventions into practice. Implementation strategies were categorized according to 9 categories defined by the Expert Recommendations for Implementing Change project: (1) engage consumers, (2) use evaluative and iterative strategies, (3) change infrastructure, (4) adapt and tailor to the context, (5) develop stakeholder interrelationships, (6) use financial strategies, (7) support clinicians, (8) provide interactive assistance, and (9) train and educate stakeholders. Implementation outcomes were extracted according to the implementation outcome framework by Proctor and colleagues: (1) acceptability, (2) adoption, (3) appropriateness, (4) cost, (5) feasibility, (6) fidelity, (7) penetration, and (8) sustainability. Implementation success was extracted according to the study authors’ own evaluation of implementation success in relation to the used implementation strategies. Results: The implementation strategies management support and engagement, internal and external facilitation, training, and audit and feedback were directly related to implementation success in several studies. No clear relationship was found between the number of implementation strategies used and implementation success. Conclusions: This is the first review examining implementation strategies, implementation outcomes, and implementation success of studies reporting the implementation of eHealth programs for patients with chronic illnesses living at home. The review indicates that internal and external facilitation, audit and feedback, management support, and training of clinicians are of importance for eHealth implementation. The review also points to the lack of eHealth studies that report implementation strategies in a comprehensive way and highlights the need to design robust studies focusing on implementation strategies in the future. Trial Registration: PROSPERO CRD42018085539; https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=85539
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
There is limited evidence of actual implementation of digital pain self-management interventions into clinical care after study completion.
“with subsequent limited evidence of actual implementation into clinical care after study completion [22,28].”
From Short-Term Findings From Testing EPIO, a Digital Self-Management Program for People Living With Chronic Pain: Randomized Controlled Trial (2023) · cites this paper as [28]
The Results (Implementation Outcomes Reported; page unavailable) say only 3 of 12 included studies reported whether eHealth programs were sustained, supporting limited evidence about continued use. The review covers chronic illnesses broadly, however, and does not establish this specifically for digital pain self-management interventions or for implementation into clinical care after study completion. (LLM, conf=0.82)
Experimental — accuracy not yet measuredThe viewpoints of policy makers are seldom recorded in scientific publications despite their important role in the outer context of implementation.
“The viewpoints of policy makers are seldom recorded in scientific publications despite their important role in the outer context of implementation [13-15].”
From Perspectives of Policy Makers and Service Users Concerning the Implementation of eHealth in Sweden: Interview Study (2022) · cites this paper as [15]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Proctor, E., Silmere, H., Raghavan, R., Hovmand, P., Aarons, G., Bunger, A., Griffey, R., & Hensley, M. (2011) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-010-0319-7 · Cited by 8,721 · see citing works
Powell, B. J., Waltz, T. J., Chinman, M. J., Damschroder, L. J., Smith, J. L., Matthieu, M. M., Proctor, E. K., & Kirchner, J. E. (2015) · Implementation Science · doi:10.1186/s13012-015-0209-1 · Cited by 4,963 · see citing works
Making sense of implementation theories, models and frameworks
Nilsen, P. (2015) · Implementation Science · doi:10.1186/s13012-015-0242-0 · Cited by 4,447 · see citing works
Realist review - a new method of systematic review designed for complex policy interventions
Pawson, R., Greenhalgh, T., Harvey, G., & Walshe, K. (2005) · Journal of Health Services Research & Policy · doi:10.1258/1355819054308530 · Cited by 3,190 · see citing works
Greenhalgh, T., Wherton, J., Papoutsi, C., Lynch, J., Hughes, G., A'Court, C., Hinder, S., Fahy, N., Procter, R., & Shaw, S. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.8775 · Cited by 2,887 · cited 2× · see citing works
“Also, several frameworks for technology implementation have pointed to the importance of contextual factors as key elements to address in order to succeed, including the CeHRes (Center for eHealth Research and Disease Management) roadmap [66] and the NASSS framework [28].”
BackgroundImplementation strategies: recommendations for specifying and reporting
Proctor, E. K., Powell, B. J., & McMillen, J. C. (2013) · Implementation Science · doi:10.1186/1748-5908-8-139 · Cited by 2,585 · see citing works
Eysenbach, G. (2001) · Journal of Medical Internet Research · doi:10.2196/jmir.3.2.e20 · Cited by 2,449 · see citing works
Evaluating barriers to adopting telemedicine worldwide: A systematic review
Scott Kruse, C., Karem, P., Shifflett, K., Vegi, L., Ravi, K., & Brooks, M. (2018) · Journal of Telemedicine and Telecare · doi:10.1177/1357633x16674087 · Cited by 1,735 · see citing works
Buntin, M. B., Burke, M. F., Hoaglin, M. C., & Blumenthal, D. (2011) · Health Affairs · doi:10.1377/hlthaff.2011.0178 · Cited by 1,311 · see citing works
A Holistic Framework to Improve the Uptake and Impact of eHealth Technologies
van Gemert-Pijnen, J. E., Nijland, N., van Limburg, M., Ossebaard, H. C., Kelders, S. M., Eysenbach, G., & Seydel, E. R. (2011) · Journal of Medical Internet Research · doi:10.2196/jmir.1672 · Cited by 1,126 · see citing works
Self-citationWaltz, T. J., Powell, B. J., Matthieu, M. M., Damschroder, L. J., Chinman, M. J., Smith, J. L., Proctor, E. K., & Kirchner, J. E. (2015) · Implementation Science · doi:10.1186/s13012-015-0295-0 · Cited by 1,108 · see citing works
A compilation of strategies for implementing clinical innovations in health and mental health
Powell, B. J., McMillen, J. C., Proctor, E. K., Carpenter, C. R., Griffey, R. T., Bunger, A. C., Glass, J. E., & York, J. L. (2012) · Medical Care Research and Review · doi:10.1177/1077558711430690 · Cited by 1,069 · see citing works
Ross, J., Stevenson, F., Lau, R., & Murray, E. (2016) · Implementation Science · doi:10.1186/s13012-016-0510-7 · Cited by 1,011 · see citing works
Enhancing the Impact of Implementation Strategies in Healthcare: A Research Agenda
Powell, B. J., Fernandez, M. E., Williams, N. J., Aarons, G. A., Beidas, R. S., Lewis, C. C., McHugh, S. M., & Weiner, B. J. (2019) · Frontiers in Public Health · doi:10.3389/fpubh.2019.00003 · Cited by 775 · see citing works
Whitehead, L., & Seaton, P. (2016) · Journal of Medical Internet Research · doi:10.2196/jmir.4883 · Cited by 743 · cited 1× · see citing works
“A growing body of evidence indicates positive effects of eHealth services on patient health outcomes [6-9].”
BackgroundRealist synthesis: illustrating the method for implementation research
Rycroft-Malone, J., McCormack, B., Hutchinson, A. M., DeCorby, K., Bucknall, T. K., Kent, B., Schultz, A., Snelgrove-Clarke, E., Stetler, C. B., Titler, M., et al. (2012) · Implementation Science · doi:10.1186/1748-5908-7-33 · Cited by 742 · see citing works
Tailored interventions to address determinants of practice
Baker, R., Camosso-Stefinovic, J., Gillies, C., Shaw, E. J., Cheater, F., Flottorp, S., Robertson, N., Wensing, M., Fiander, M., Eccles, M. P., et al. (2015) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd005470.pub3 · Cited by 711 · see citing works
A Glossary for Dissemination and Implementation Research in Health
Rabin, B. A., Brownson, R. C., Haire-Joshu, D., Kreuter, M. W., & Weaver, N. L. (2008) · Journal of Public Health Management and Practice · doi:10.1097/01.phh.0000311888.06252.bb · Cited by 676 · cited 1× · see citing works
“Process of putting to use or integrating evidence-based interventions within a setting [44].”
BackgroundO’Connor, S., Hanlon, P., O’Donnell, C. A., Garcia, S., Glanville, J., & Mair, F. S. (2016) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-016-0359-3 · Cited by 636 · see citing works
Mair, F. S., May, C., O’Donnell, C., Finch, T., Sullivan, F., & Murray, E. (2012) · Bulletin of the World Health Organization · doi:10.2471/blt.11.099424 · Cited by 553 · see citing works
Leeman, J., Birken, S. A., Powell, B. J., Rohweder, C., & Shea, C. M. (2017) · Implementation Science · doi:10.1186/s13012-017-0657-x · Cited by 544 · see citing works
Hanlon, P., Daines, L., Campbell, C., McKinstry, B., Weller, D., & Pinnock, H. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.6688 · Cited by 499 · cited 1× · see citing works
“For example, telehealth is regarded as a safe option for delivery of self-management support [10], and internet-delivered cognitive behavioral therapy (ICBT) has shown promising results as an alternative to traditional face-to-face interventions among persons with chronic health illnesses [3].”
BackgroundWhy use theories in qualitative research?
Reeves, S., Albert, M., Kuper, A., & Hodges, B. D. (2008) · BMJ · doi:10.1136/bmj.a949 · Cited by 436 · see citing works
Knowledge translation in health: how implementation science could contribute more
Wensing, M., & Grol, R. P. T. M. (2019) · BMC Medicine · doi:10.1186/s12916-019-1322-9 · Cited by 415 · see citing works
Ivers, N. M., Grimshaw, J., Jamtvedt, G., Flottorp, S. A., O’Brien, M. A., French, S. D., Young, J. M., & Odgaard‐Jensen, J. (2014) · Journal of General Internal Medicine · doi:10.1007/s11606-014-2913-y · Cited by 383 · see citing works
Greenhalgh, T., Shaw, S., Wherton, J., Vijayaraghavan, S., Morris, J., Bhattacharya, S., Hanson, P., Campbell-Richards, D., Ramoutar, S., Collard, A., et al. (2018) · Journal of Medical Internet Research · doi:10.2196/jmir.9897 · Cited by 371 · see citing works
Models and Frameworks for Implementing Evidence-Based Practice: Linking Evidence to Action
Rycroft‐Malone, J., & Bucknall, T. K. (2010) · Cited by 360 · see citing works
Elbert, N. J., van Os‐Medendorp, H., van Renselaar, W., Ekeland, A. G., Roijen, L. H., Raat, H., Nijsten, T. E. C., & Pasmans, S. G. M. A. (2014) · Journal of Medical Internet Research · doi:10.2196/jmir.2790 · Cited by 350 · see citing works
Perry, C. K., Damschroder, L. J., Hemler, J. R., Woodson, T. T., Ono, S. S., & Cohen, D. J. (2019) · Implementation Science · doi:10.1186/s13012-019-0876-4 · Cited by 288 · see citing works
Brewster, L., Mountain, G. A., Wessels, B. A., Kelly, C. M., & Hawley, M. (2013) · Journal of Advanced Nursing · doi:10.1111/jan.12196 · Cited by 281 · see citing works
Tomás Pantoja, C., Opiyo, N., Lewin, S. A., Paulsen, E., Ciapponi, A., Wiysonge, C. S., Herrera, C. A., Gabriel Rada, G., Peñaloza, B., Dudley, L., et al. (2017) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd011086.pub2 · Cited by 258 · see citing works
Lau, R., Stevenson, F., Ong, B. N., Dziedzic, K., Treweek, S., Eldridge, S., Everitt, H., Kennedy, A., Qureshi, N., Rogers, A., et al. (2015) · BMJ Open · doi:10.1136/bmjopen-2015-009993 · Cited by 254 · cited 3× · see citing works
“Several of the included studies reported training of health care personnel as a preferred implementation strategy, and this strategy was also found to be widely used by others, even though effects appear inconsistent [62,64].”
BackgroundResultInfluentialGreenhalgh, T., Wherton, J., Papoutsi, C., Lynch, J., Hughes, G., A’Court, C., Hinder, S., Procter, R., & Shaw, S. (2018) · BMC Medicine · doi:10.1186/s12916-018-1050-6 · Cited by 232 · see citing works
Deady, M., Choi, I., Calvo, R. A., Glozier, N., Christensen, H., & Harvey, S. B. (2017) · BMC Psychiatry · doi:10.1186/s12888-017-1473-1 · Cited by 222 · see citing works
Sandström, B., Borglin, G., Nilsson, R., & Willman, A. (2011) · Worldviews on Evidence-Based Nursing · doi:10.1111/j.1741-6787.2011.00216.x · Cited by 207 · see citing works
Varsi, C., Ekstedt, M., Gammon, D., & Ruland, C. M. (2015) · Journal of Medical Internet Research · doi:10.2196/jmir.5091 · Cited by 191 · see citing works
Self-citationKruse, C. S., & Beane, A. (2018) · Journal of Medical Internet Research · doi:10.2196/jmir.8793 · Cited by 188 · see citing works
Morton, K., Dennison, L., May, C., Murray, E., Little, P., McManus, R., & Yardley, L. (2016) · Patient Education and Counseling · doi:10.1016/j.pec.2016.10.019 · Cited by 181 · see citing works
Telemedicine across borders: A systematic review of factors that hinder or support implementation
Saliba, V., Legido-Quigley, H., Hallik, R., Aaviksoo, A., Car, J., & McKee, M. (2012) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2012.08.003 · Cited by 173 · see citing works
Mold, F., de Lusignan, S., Sheikh, A., Majeed, A., Wyatt, J. C., Quinn, T., Cavill, M., Franco, C., Chauhan, U., Blakey, H., et al. (2015) · British Journal of General Practice · doi:10.3399/bjgp15x683941 · Cited by 168 · see citing works
Benefits of mobile apps in pain management: Systematic review
Thurnheer, S. E., Gravestock, I., Pichierri, G., Steurer, J., & Burgstaller, J. M. (2018) · JMIR mHealth and uHealth · doi:10.2196/11231 · Cited by 160 · see citing works
Mehta, S., Peynenburg, V. A., & Hadjistavropoulos, H. D. (2019) · Journal of Behavioral Medicine · doi:10.1007/s10865-018-9984-x · Cited by 153 · see citing works
Turgoose, D., Ashwick, R., & Murphy, D. (2018) · Journal of Telemedicine and Telecare · doi:10.1177/1357633x17730443 · Cited by 148 · see citing works
Hage, E., Roo, J. P., van Offenbeek, M. A., & Boonstra, A. (2013) · BMC Health Services Research · doi:10.1186/1472-6963-13-19 · Cited by 137 · see citing works
Hendy, J., Chrysanthaki, T., Barlow, J., Knapp, M., Rogers, A., Sanders, C., Bower, P., Bowen, R., Fitzpatrick, R., Bardsley, M., et al. (2012) · BMC Health Services Research · doi:10.1186/1472-6963-12-403 · Cited by 130 · see citing works
Eldh, A. C., Almost, J., DeCorby-Watson, K., Gifford, W., Harvey, G., Hasson, H., Kenny, D. J., Moodie, S., Wallin, L., & Yost, J. (2017) · BMC Health Services Research · doi:10.1186/s12913-016-1958-5 · Cited by 109 · see citing works
Harerimana, B., Forchuk, C., & O'Regan, T. (2019) · International Journal of Mental Health Nursing · doi:10.1111/inm.12571 · Cited by 109 · see citing works
Huynh, A. K., Hamilton, A. B., Farmer, M. M., Bean‐Mayberry, B., Stirman, S. W., Moin, T., & Finley, E. P. (2018) · Frontiers in Public Health · doi:10.3389/fpubh.2018.00134 · Cited by 100 · see citing works
Hadjistavropoulos, H. D., Nugent, M. M., Dirkse, D., & Pugh, N. (2017) · BMC Psychiatry · doi:10.1186/s12888-017-1496-7 · Cited by 94 · see citing works
Meta-narrative and realist reviews: guidance, rules, publication standards and quality appraisal
Gough, D. (2013) · BMC Medicine · doi:10.1186/1741-7015-11-22 · Cited by 85 · see citing works
Organizational strategies for promoting patient and provider uptake of personal health records
Wells, S., Rozenblum, R., Park, A., Dunn, M., & Bates, D. W. (2015) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2014-003055 · Cited by 67 · see citing works
Horton, K. (2008) · Journal of Nursing Management · doi:10.1111/j.1365-2834.2008.00845.x · Cited by 64 · see citing works
Shea, C. M., & Belden, C. M. (2015) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-016-0240-4 · Cited by 61 · see citing works
The Implementation of Internet Interventions for Depression: A Scoping Review
Drozd, F., Vaskinn, L., Bergsund, H. B., Haga, S. M., Slinning, K., & Bjørkli, C. A. (2016) · Journal of Medical Internet Research · doi:10.2196/jmir.5670 · Cited by 60 · see citing works
Wilhelmsen, M., Høifødt, R. S., Kolstrup, N., Waterloo, K. K., Eisemann, M. R., Chenhall, R. D., & Risør, M. B. (2014) · Journal of Medical Internet Research · doi:10.2196/jmir.3556 · Cited by 55 · see citing works
Boonstra, A., & Offenbeek, V. M. (2010) · Information Systems Journal · doi:10.1111/j.1365-2575.2010.00358.x · Cited by 50 · see citing works
Pilot testing an app-based stress management intervention for cancer survivors
Børøsund, E., Varsi, C., Clark, M. M., Ehlers, S. L., Andrykowski, M. A., Sleveland, H. R. S., Bergland, A., & Nes, L. S. (2020) · Translational Behavioral Medicine · doi:10.1093/tbm/ibz062 · Cited by 49 · see citing works
Self-citationTaylor, J., Coates, E. J., Wessels, B. A., Mountain, G. A., & Hawley, M. (2015) · BMC Health Services Research · doi:10.1186/s12913-015-1195-3 · Cited by 47 · see citing works
Implementing Video to Home to Increase Access to Evidence-Based Psychotherapy for Rural Veterans
Lindsay, J. A., Hudson, S., Martin, L. A., Hogan, J., Nessim, M., Graves, L., Gabriele, J. M., & White, D. L. (2017) · Journal of Technology in Behavioral Science · doi:10.1007/s41347-017-0032-4 · Cited by 45 · see citing works
Fortney, J. C., Pyne, J. M., Ward‐Jones, S., Bennett, I. M., Diehl, J., Farris, K., Cerimele, J. M., & Curran, G. M. (2018) · Families Systems & Health · doi:10.1037/fsh0000357 · Cited by 25 · see citing works
Becoming an eCoach: Training therapists in online cognitive-behavioral therapy for chronic pain
Terpstra, J. A., van der Vaart, R., Spillekom-van Koulil, S., van Dam, A., Rosmalen, J. G. M., Knoop, H., van Middendorp, H., & Evers, A. W. M. (2018) · Patient Education and Counseling · doi:10.1016/j.pec.2018.03.029 · Cited by 17 · see citing works
Nielsen, B., Slinning, K., Oddli, H. W., & Drozd, F. (2018) · JMIR Research Protocols · doi:10.2196/10312 · Cited by 11 · see citing works
Managers’ Identification with and Adoption of Telehealthcare
Hendy, J., Chrysanthaki, T., & Barlow, J. G. (2014) · Societies · doi:10.3390/soc4030428 · Cited by 2 · see citing works
Deploying telehealth with sheltered housing tenants living with COPD: a qualitative case study
Bailey, C., Cook, G. A., Herman, L., McMillan, C., Rose, J., Marston, R., Binks, E., & Barron, E. (2015) · Housing Care and Support · doi:10.1108/hcs-09-2015-0015 · Cited by 1 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Ledel Solem, I. K., Varsi, C., Eide, H., Kristjansdottir, O. B., Børøsund, E., Schreurs, K. M. G., Waxenberg, L. B., Weiss, K. E., Morrison, E. J., Haaland-Øverby, M., et al. (2020) · Journal of Medical Internet Research · doi:10.2196/15889 · Cited by 80 · see citing works
Self-citationLovero, K. L., Kemp, C. G., Wagenaar, B. H., Giusto, A., Greene, M. C., Powell, B. J., & Proctor, E. K. (2023) · Implementation Science · doi:10.1186/s13012-023-01310-2 · Cited by 52 · see citing works
Varsi, C., Ledel Solem, I. K., Eide, H., Børøsund, E., Kristjansdottir, O. B., Heldal, K., Waxenberg, L. B., Weiss, K. E., Schreurs, K. M. G., Morrison, E. J., et al. (2021) · BMC Health Services Research · doi:10.1186/s12913-021-06278-7 · Cited by 53 · see citing works
Enablers and barriers in upscaling telemonitoring across geographic boundaries: a scoping review
Gijsbers, H., Feenstra, T. M., Eminovic, N., van Dam, D., Nurmohamed, S. A., van de Belt, T., & Schijven, M. P. (2022) · BMJ Open · doi:10.1136/bmjopen-2021-057494 · Cited by 37 · see citing works
Neher, M., Nygårdh, A., Broström, A., Lundgren, J., & Johansson, P. (2022) · Journal of Medical Internet Research · doi:10.2196/28870 · Cited by 21 · see citing works
“The viewpoints of policy makers are seldom recorded in scientific publications despite their important role in the outer context of implementation [13-15].”
Engaging with EPIO, a digital pain self-management program: a qualitative study
Bostrøm, K., Varsi, C., Eide, H., Børøsund, E., Kristjansdottir, Ó. B., Schreurs, K. M. G., Waxenberg, L. B., Weiss, K. E., Morrison, E. J., Nordang, E. F., et al. (2022) · BMC Health Services Research · doi:10.1186/s12913-022-07963-x · Cited by 18 · see citing works
“, patients, health care providers) involvement in the development process [18], issues with attrition/adherence [19, 20], limited evidence of efficacy [12, 16] and limited implementation and actual use post study [21, 22].”
BackgroundBostrøm, K., Børøsund, E., Eide, H., Varsi, C., Kristjansdottir, Ó. B., Schreurs, K. M. G., Waxenberg, L. B., Weiss, K. E., Morrison, E. J., Stavenes Støle, H., et al. (2023) · Journal of Medical Internet Research · doi:10.2196/47284 · Cited by 12 · see citing works
“Finally, rigorous efficacy testing to establish efficacy appears to be scarce in the existing digital pain self-management interventions [17,27], with subsequent limited evidence of actual implementation into clinical care after study completion [22,28].”
Self-citationSolberg Nes, L., Børøsund, E., Varsi, C., Eide, H., Waxenberg, L. B., Weiss, K. E., Morrison, E. J., Støle, H. S., Kristjansdottir, Ó. B., Bostrøm, K., et al. (2024) · Pain Reports · doi:10.1097/pr9.0000000000001174 · Cited by 7 · see citing works
Self-citation
- Authors
- Varsi, C., Solberg Nes, L., Kristjansdottir, O. B., Kelders, S. M., Stenberg, U., Zangi, H. A., Børøsund, E., Weiss, K. E., Stubhaug, A., Asbjørnsen, R. A., Westeng, M., Ødegaard, M., & Eide, H.
- Affiliations
- Oslo University Hospital (NO)
- North-West University (ZA)
- VID Specialized University (NO)
- University of Washington (US)
- University of Oslo (NO)
- Corresponding author
- Varsi, Cecilie
- ORCID
- Venue
- Journal of Medical Internet Research
- Publisher
- JMIR Publications Inc.
- Published
- 2019-09-27
- Volume
- 21
- Issue
- 9
- Pages
- e14255
- ISSN
- 1438-8871 (ISSN-L)
- PMC
- PMC6789428
- OpenAlex
- W2976336448
- Cited by
- 148
- References
- 64
- Citations by year
- 2026: 20 · 2025: 15 · 2024: 22 · 2023: 23 · 2022: 28 · 2021: 29 · 2020: 7 · 2019: 4
- FWCI
- 3.18
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- Journal of Medical Internet Research (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- University of Twente Research Information (publishedVersion, cc-by)
- NORA - Norwegian Open Research Archives (submittedVersion, cc-by)
- NORA - Norwegian Open Research Archives (submittedVersion, other-oa)
- University of Twente Research Information (submittedVersion, cc-by)
- Funders
- Norges Forskningsråd (256574)
- Topics
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Telemedicine and Telehealth Implementation
- Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
- Keywords
- digital health interventions, chronic disease, implementation strategies, implementation outcomes, implementation success, home care, audit and feedback, facilitation, management support, clinician training, stakeholder engagement, Expert Recommendations for Implementing Change, sustainability, fidelity, acceptability, adoption, feasibility, cost, penetration, appropriateness, telemedicine
- MeSH terms
- Chronic Disease, Health Plan Implementation, Humans, Telemedicine
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
