The DOI matches its Crossref record; 251 of the 251 references it cites were found in a registry or an index.
Factors Determining the Success and Failure of eHealth Interventions: Systematic Review of the Literature
Open accessPublished version of a preprint
Abstract
BACKGROUND: eHealth has an enormous potential to improve healthcare cost, effectiveness, and quality of care. However, there seems to be a gap between the foreseen benefits of research and clinical reality. OBJECTIVE: Our objective was to systematically review the factors influencing the outcome of eHealth interventions in terms of success and failure. METHODS: We searched the PubMed database for original peer-reviewed studies on implemented eHealth tools that reported on the factors for the success or failure, or both, of the intervention. We conducted the systematic review by following the patient, intervention, comparison, and outcome framework, with 2 of the authors independently reviewing the abstract and full text of the articles. We collected data using standardized forms that reflected the categorization model used in the qualitative analysis of the outcomes reported in the included articles. RESULTS: Among the 903 identified articles, a total of 221 studies complied with the inclusion criteria. The studies were heterogeneous by country, type of eHealth intervention, method of implementation, and reporting perspectives. The article frequency analysis did not show a significant discrepancy between the number of reports on failure (392/844, 46.5%) and on success (452/844, 53.6%). The qualitative analysis identified 27 categories that represented the factors for success or failure of eHealth interventions. A quantitative analysis of the results revealed the category quality of healthcare (n=55) as the most mentioned as contributing to the success of eHealth interventions, and the category costs (n=42) as the most mentioned as contributing to failure. For the category with the highest unique article frequency, workflow (n=51), we conducted a full-text review. The analysis of the 23 articles that met the inclusion criteria identified 6 barriers related to workflow: workload (n=12), role definition (n=7), undermining of face-to-face communication (n=6), workflow disruption (n=6), alignment with clinical processes (n=2), and staff turnover (n=1). CONCLUSIONS: The reviewed literature suggested that, to increase the likelihood of success of eHealth interventions, future research must ensure a positive impact in the quality of care, with particular attention given to improved diagnosis, clinical management, and patient-centered care. There is a critical need to perform in-depth studies of the workflow(s) that the intervention will support and to perceive the clinical processes involved.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Addressing these issues will likely contribute to development of more user friendly, meaningful interventions for patients and can potentially improve treatment outcomes for patients living with chronic pain [27,39,44,46].”
From A User-Centered Approach to an Evidence-Based Electronic Health Pain Management Intervention for People With Chronic Pain: Design and Development of EPIO (2020) · cites this paper as [46]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Items 201–251 of 251
DeWorsop, D. O., Creatura, G. M., Bluez, G., Thurnauer, H., Forselius-Bielen, K., Ranganathan, M., Deaso, E., Bhat, J. A., & D’Souza, D. C. (2016) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2016.02.045 · Cited by 26 · cited 2×
“DeWorsop et al [129] and Lee and Billings [133] reported on the importance of cost effectiveness to promoting the adoption of eHealth interventions.”
BackgroundHanna, L., May, C. R., & Fairhurst, K. (2011) · Journal of Innovation in Health Informatics · doi:10.14236/jhi.v19i1.789 · Cited by 25 · cited 1×
“Multimedia Appendix 1 [19-239] presents the outcomes.”
Lee, A. C. W., & Billings, M. (2015) · Physical Therapy · doi:10.2522/ptj.20150079 · Cited by 25 · cited 2×
“DeWorsop et al [129] and Lee and Billings [133] reported on the importance of cost effectiveness to promoting the adoption of eHealth interventions.”
BackgroundGreenberg, A., Krämer, S., Welch, V., O'Sullivan, E., & Hall, S. (2006) · Healthcare Quarterly · doi:10.12927/hcq.2006.18468 · Cited by 25 · cited 1×
“Multimedia Appendix 1 [19-239] presents the outcomes.”
Possibilities and Expectations for mHealth in the Pacific Islands: Insights From Key Informants
Umali, E., McCool, J. P., & Whittaker, R. (2016) · JMIR mhealth and uhealth · doi:10.2196/mhealth.4626 · Cited by 25 · cited 1×
“Multimedia Appendix 1 [19-239] presents the outcomes.”
Primary care providers' perceptions of mobile store-and-forward teledermatology
Barbieri, J. S., Nelson, C. A., Bream, K. D. W., & Kovarik, C. (2015) · Dermatology Online Journal · doi:10.5070/d3218028436 · Cited by 24
Anticipating mismatches of HIT investments: Developing a viability-fit model for e-health services
Mettler, T. (2015) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2015.10.002 · Cited by 24 · cited 1×
“Multimedia Appendix 1 [19-239] presents the outcomes.”
eHealth in Saudi Arabia: Current Trends, Challenges and Recommendations
Alsulame, K., Khalifa, M., & Househ, M. S. (2015) · Studies in health technology and informatics · doi:10.3233/978-1-61499-538-8-233 · Cited by 22 · cited 1×
“Multimedia Appendix 1 [19-239] presents the outcomes.”
Quinlivan, J. A., Lyons, S., & Petersen, R. W. (2014) · Telemedicine Journal and e-Health · doi:10.1089/tmj.2013.0342 · Cited by 21 · cited 1×
“Multimedia Appendix 1 [19-239] presents the outcomes.”
Self Management and Telehealth: Lessons Learnt from the Evaluation of a Dorset Telehealth Program
Bond, C., & Worswick, L. (2014) · Patient · doi:10.1007/s40271-014-0091-y · Cited by 21
Three years experience with the implementation of a networked electronic medical record in Haiti.
Lober, W. B., Quiles, C., Wagner, S., Cassagnol, R., Lamothes, R., Alexis, D. R. P., Joseph, P., Sutton, P. L., Puttkammer, N. H., & Kitahata, M. M. (2008) · PubMed Central · Cited by 19
Ruas, S. S. M., & Assunção, A. Á. (2013) · Telemedicine Journal and e-Health · doi:10.1089/tmj.2012.0095 · Cited by 18 · cited 1×
“Multimedia Appendix 1 [19-239] presents the outcomes.”
Informatics and Knowledge Translation
Bullard, M. J., Emond, S. D., Graham, T. A. D., Ho, K., & Holroyd, B. R. (2007) · Academic Emergency Medicine · doi:10.1197/j.aem.2007.06.032 · Cited by 18
Reasons (not) to Spend a Few Billions More on EHRs: How Human Factors Research Can Help
Aimé, X., Declerck, G., & Issues, S. E. F. T. I. Y. S. O. H. F. A. O. (2014) · Yearbook of Medical Informatics · doi:10.15265/iy-2014-0033 · Cited by 18 · cited 2×
“In the literature, the technical perspective during the design phase is identified as a significant contributor to the gap between prospect and reality [94,251].”
BackgroundCaring from a distance: the role of telehealth.
Taylor, J., & Coates, L. (2015) · PubMed · Cited by 18
Mattocks, K. M., Lalime, K., Tate, J. P., Giannotti, T. E., Carr, K., Carrabba, A. S., Blum, T., & Meehan, T. P. (2007) · PubMed · Cited by 17
Mergel, I. A. (2014) · JMIR mhealth and uhealth · doi:10.2196/mhealth.3694 · Cited by 17 · cited 1×
“Multimedia Appendix 1 [19-239] presents the outcomes.”
Nikander, K., Denyer, J., Dodd, M. E., Dyche, T., Webb, A. K., Weller, P. H., & Stableforth, D. E. (2010) · Journal of Aerosol Medicine and Pulmonary Drug Delivery · doi:10.1089/jamp.2009.0770 · Cited by 17 · cited 1×
“Multimedia Appendix 1 [19-239] presents the outcomes.”
Sørensen, T., Dyb, K., Rygh, E., Salvesen, R., & Thomassen, L. (2014) · BMC Health Services Research · doi:10.1186/s12913-014-0643-9 · Cited by 17 · cited 3×
“use of the technology, analyzing the self-reported data and subsequently answering the patient’s questions [87,95], the need for new competences [97], and unresolved attribution of responsibilities [105,106].”
BackgroundMethodBarriers and Opportunities to the Widespread Adoption of Telemedicine: A Bi-Country Evaluation
Vimarlund, V., & LeRouge, C. (2013) · Studies in health technology and informatics · doi:10.3233/978-1-61499-289-9-933 · Cited by 16 · cited 1×
“Multimedia Appendix 1 [19-239] presents the outcomes.”
Ruxwana, N., Herselman, M. E., & Pottas, D. (2014) · Health Information Management Journal · doi:10.1177/183335831404300104 · Cited by 16 · cited 1×
“Multimedia Appendix 1 [19-239] presents the outcomes.”
Early Experiences with Mobile Electronic Health Records Application in a Tertiary Hospital in Korea
Choi, W., Park, M., Hong, E. S., Kim, S., Ahn, R., Hong, J., Song, S., Kim, T., Kim, J., & Yeo, S. (2015) · Healthcare Informatics Research · doi:10.4258/hir.2015.21.4.292 · Cited by 16 · cited 1×
“Multimedia Appendix 1 [19-239] presents the outcomes.”
Levin, D. N. (2012) · Frontiers of Health Services Management · doi:10.1097/01974520-201210000-00006 · Cited by 16 · cited 1×
“Multimedia Appendix 1 [19-239] presents the outcomes.”
Designing an artificial pancreas architecture: the AP@home experience
Lanzola, G., Toffanin, C., Palma, F. D., Favero, S. D., Magni, L., & Bellazzi, R. (2014) · Medical & Biological Engineering & Computing · doi:10.1007/s11517-014-1231-1 · Cited by 15 · cited 1×
“Multimedia Appendix 1 [19-239] presents the outcomes.”
The Grid as a Healthcare Provision Tool
Blanquer, I., & Hernández, V. (2005) · Methods of Information in Medicine · doi:10.1055/s-0038-1633935 · Cited by 14 · cited 1×
“Multimedia Appendix 1 [19-239] presents the outcomes.”
Realizing Telemedicine Advantages at the National Level: Cases from the United Arab Emirates
Al-Qirim, N. A. Y. (2007) · Telemedicine Journal and e-Health · doi:10.1089/tmj.2006.0087 · Cited by 14 · cited 1×
“Multimedia Appendix 1 [19-239] presents the outcomes.”
The uneven diffusion of telemedicine services in Australia
Mitchell, J. G. (1999) · Journal of Telemedicine and Telecare · doi:10.1258/1357633991932504 · Cited by 14 · cited 1×
“Multimedia Appendix 1 [19-239] presents the outcomes.”
Ong, M., Pelayo, S., & Issues, S. E. F. T. I. Y. S. O. H. F. A. O. (2015) · Yearbook of Medical Informatics · doi:10.15265/iy-2015-033 · Cited by 13
Lessons learned from the Hospital Without Walls project
Dadd, M. J., Doyle, B., Wilson, L., & Gunaratnam, M. (2002) · Journal of Telemedicine and Telecare · doi:10.1258/13576330260440709 · Cited by 13 · cited 1×
“Multimedia Appendix 1 [19-239] presents the outcomes.”
Self-acquired patient images: the promises and the pitfalls
Damanpour, S., Srivastava, D., & Nijhawan, R. I. (2016) · Seminars in Cutaneous Medicine and Surgery · doi:10.12788/j.sder.2016.013 · Cited by 13 · cited 1×
“Multimedia Appendix 1 [19-239] presents the outcomes.”
Moxham, C., Chambers, N., Girling, J., Garg, S., Jelfs, E., & Bremner, J. (2012) · Health Services Management Research · doi:10.1258/hsmr.2012.012018 · Cited by 12 · cited 1×
“Multimedia Appendix 1 [19-239] presents the outcomes.”
Inventory of electronic health information exchange in Wisconsin, 2006.
Foldy, S. L. (2007) · PubMed · Cited by 12
Reinventing patient-centered computing for the twenty-first century.
Goldberg, H., Morales, A., Gottlieb, L., Meador, L., & Safran, C. (2001) · PubMed · Cited by 11
Explaining the Adoption of Telemedicine Services: An Analysis of a Paediatric Telemedicine Service
Cook, D. J., Doolittle, G. C., Ferguson, D., Hanks, N., Hood, J. W., Howard, M., Troha, J., Mehling, D., & Zurbuchen, N. (2002) · Journal of Telemedicine and Telecare · doi:10.1177/1357633x020080s248 · Cited by 11 · cited 1×
“Multimedia Appendix 1 [19-239] presents the outcomes.”
Santana, M., de Grood, C., & Eso, K. (2015) · Journal of Multidisciplinary Healthcare · doi:10.2147/jmdh.s72953 · Cited by 11 · cited 1×
“Multimedia Appendix 1 [19-239] presents the outcomes.”
Telehealth as a tool for independent self-management by people living with long term conditions.
Bond, C. (2014) · PubMed · Cited by 10
Understanding the Gap between Desire for and Use of Consumer Health Solutions
Zelmer, J., & Hagens, S. (2014) · A Nudge Too Far? A Nudge at All? On Paying People to Be Healthy · doi:10.12927/hcpap.2014.23871 · Cited by 10 · cited 1×
“Multimedia Appendix 1 [19-239] presents the outcomes.”
Roig-Sena, J., & Saigí-Rubió, F. (2011) · Anales del Sistema Sanitario de Navarra · doi:10.4321/s1137-66272011000200009 · Cited by 9
Tran, B. Q., Buckley, K. M., Bertera, E. M., & Gonzales, P. (2009) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/iembs.2009.5333537 · Cited by 9 · cited 1×
“Multimedia Appendix 1 [19-239] presents the outcomes.”
Evolving Health IT Systems Evaluation: The Convergence of Health Informatics and HTA
Doupi, P. (2016) · Studies in health technology and informatics · doi:10.3233/978-1-61499-635-4-220 · Cited by 9
Fico, G., & Arredondo, M. T. (2015) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc.2015.7318812 · Cited by 8 · cited 1×
“Multimedia Appendix 1 [19-239] presents the outcomes.”
Audit of a sexual health website email link for general practitioners
Biggs, K., Lowe, P., Walsh, J., & Lagios, K. (2009) · International Journal of STD & AIDS · doi:10.1258/ijsa.2009.009192 · Cited by 8 · cited 2×
“In the literature, the technical perspective during the design phase is identified as a significant contributor to the gap between prospect and reality [94,251].”
BackgroundRandell, R., Backhouse, M. R., & Nelson, E. A. (2015) · Informatics for Health and Social Care · doi:10.3109/17538157.2015.1064424 · Cited by 7 · cited 3×
“Less mentioned, but still significant, were statements that eHealth is impersonal and, therefore, undermines face-to-face communication [56,72,86,87,91,106], substantiated by the claim that the foundation of good nursing is physical presence, human touch, and the use of all senses.”
BackgroundDevelopment and implementation of IT require focus on user participation, acceptance and workflow.
Sølling, I. K., Carøe, P., & Mathiesen, K. S. (2014) · PubMed · Cited by 7
Abramson, E. L., Silver, M. D., & Kaushal, R. (2014) · The Joint Commission Journal on Quality and Patient Safety · doi:10.1016/s1553-7250(14)40058-8 · Cited by 7 · cited 1×
“Multimedia Appendix 1 [19-239] presents the outcomes.”
Rossos, P. G., St-Cyr, O., Purdy, B., Toenjes, C., Masino, C., & Chmelnitsky, D. (2015) · Studies in health technology and informatics · doi:10.3233/978-1-61499-505-0-121 · Cited by 5
Barriers to implementation of a Continuity of Care Record (CCR) in HIV/AIDS care.
Schnall, R., Odlum, M. L., Gordon, P. C., & Henry, S. B. (2009) · PubMed · Cited by 3
de Asmundis, C., Ricciardi, D., Namdar, M., Pappaert, G., Rodríguez‐Mañero, M., Wauters, K., Casado-Arroyo, R., Rao, J. J., Bayrak, F., CHIERCHIA, G., et al. (2013) · Radboud Repository (Radboud University) · doi:10.2143/ac.68.4.2988892 · Cited by 3
de Asmundis, C., Ricciardi, D., Namdar, M., Pappaert, G., Rodríguez‐Mañero, M., Wauters, K., Casado-Arroyo, R., Rao, J., Bayrak, F., Chierchia, G., et al. (2013) · Acta cardiologica. Supplementum · doi:10.1080/ac.68.4.2988892 · Cited by 1 · cited 1×
“Multimedia Appendix 1 [19-239] presents the outcomes.”
Meyer, R., & Factors, S. E. F. T. I. Y. S. O. H. (2010) · Yearbook of Medical Informatics · doi:10.1055/s-0038-1638683 · Cited by 1
Adoption Space and the Idea-to-Market Process of Health Technologies
Saranummi, N., Beuscart, R., Norman, B., Maglaveras, N., Strano, C., & Karavidopoulou, Y. (2016) · Studies in health technology and informatics · doi:10.3233/978-1-61499-653-8-9 · Cited by 1 · cited 1×
“Multimedia Appendix 1 [19-239] presents the outcomes.”
Research works printed but not linked: 33
- Ågren, G, 2006, Healthy Ageing -- A Challenge for Europe
- Goldberg, HS, 2001, Stud Health Technol Inform, 84, 1455
- 2011, ISO/IEC/IEEE 42010:2011(E) (Revision of ISO/IEC 42010:2007 and IEEE Std 1471-2000)
- Ehrler, F, 2014, Stud Health Technol Inform, 205, 667
- Sølling, IK, 2014, Stud Health Technol Inform, 201, 219
- Zhang, X, 2014, Stud Health Technol Inform, 204, 176
- El-Mahalli, AA, 2012, Perspect Health Inf Manag, 9, 1
- Schnall, R, 2009, Stud Health Technol Inform, 146, 248
- Saranummi, N, 2016, Stud Health Technol Inform, 224, 9
- Rossos, PG, 2015, Stud Health Technol Inform, 209, 121
- Barrett, M, 2009, Rural Remote Health, 9, 1154
- Foldy, S, 2007, WMJ, 106, 120
- Mattocks, K, 2007, Conn Med, 71, 27
- Ayatollahi, H, 2014, Perspect Health Inf Manag, 11, 1c
- Alkhaldi, B, 2014, Stud Health Technol Inform, 205, 875
- Alsulame, K, 2015, Stud Health Technol Inform, 213, 233
- Owens, DK, 1998, West J Med, 168, 166
- Doupi, P, 2016, Stud Health Technol Inform, 222, 220
- Bond, CS, 2014, Stud Health Technol Inform, 206, 1
- Griebel, L, 2013, Stud Health Technol Inform, 192, 965
- Schwarz, F, 2014, Rural Remote Health, 14, 2871
- Hanna, L, 2011, Inform Prim Care, 19, 17
- Lober, WB, 2008, AMIA Annu Symp Proc, 434
- Taylor, J, 2015, Nurs Times, 111, 18
- Vimarlund, V, 2013, Stud Health Technol Inform, 192, 933
- Meyer, R, 2010, Yearb Med Inform, 21
- Mars, M, 2010, Yearb Med Inform, 87
- Ruxwana, N, 2014, Health Inf Manag, 43, 26
- Anvari, M, 2004, Semin Laparosc Surg, 11, 123
- Dadd, M, 2002, J Telemed Telecare, 8 Suppl 3, S3:11
- Courtney, KL, 2008, Inform Prim Care, 16, 195
- Gardner, RM, 2004, Respir Care, 49, 378
- Bowens, FM, 2010, Perspect Health Inf Manag, 7, 1d
Cited by
Patient Satisfaction With Telemedicine During the COVID-19 Pandemic: Retrospective Cohort Study
Ramaswamy, A., Yu, M., Drangsholt, S., Ng, E., Culligan, P. J., Schlegel, P. N., & Hu, J. C. (2020) · Journal of Medical Internet Research · doi:10.2196/20786 · Cited by 475
“This is problematic because patient satisfaction has been cited as the most important factor in the success of telemedicine initiatives [33].”
BackgroundeHealth for improving quality of life in breast cancer patients: A systematic review
Triberti, S., Savioni, L., Sebri, V., & Pravettoni, G. (2019) · Cancer Treatment Reviews · doi:10.1016/j.ctrv.2019.01.003 · Cited by 184
Dugstad, J., Eide, T., Nilsen, E. R., & Eide, H. (2019) · BMC Health Services Research · doi:10.1186/s12913-019-4191-1 · Cited by 174
“This breach is traditionally considered to be a major barrier to implementation [22, 39].”
BackgroundTossaint-Schoenmakers, R., Versluis, A., Chavannes, N. H., Talboom-Kamp, E. P. W. A., & Kasteleyn, M. J. (2021) · Journal of Medical Internet Research · doi:10.2196/27180 · Cited by 232
“Inflexibility and complexity of the technology comes at the expense of effective daily processes and their quality [53,54].”
BackgroundTelemedicine in Orthopaedic Surgery: Challenges and Opportunities
Makhni, M. C., Riew, G. J., & Sumathipala, M. G. (2020) · Journal of Bone and Joint Surgery · doi:10.2106/jbjs.20.00452 · Cited by 156
Metadata
- Authors
- Granja, C., Janssen, W., & Johansen, M. A.
- Affiliations
- UiT The Arctic University of Norway (NO)
- Corresponding author
- Granja, Conceição
- Venue
- Journal of Medical Internet Research
- Publisher
- JMIR Publications Inc.
- Published
- 2018-05-01
- Volume
- 20
- Issue
- 5
- Pages
- e10235
- ISSN
- 1438-8871 (ISSN-L)
- PMC
- PMC5954232
- OpenAlex
- W2801287189
- Cited by
- 578
- References
- 250
- Citations by year
- 2026: 40 · 2025: 47 · 2024: 68 · 2023: 64 · 2022: 128 · 2021: 91 · 2020: 76 · 2019: 48 · 2018: 15
- FWCI
- 10.47
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- Journal of Medical Internet Research (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- NORA - Norwegian Open Research Archives (submittedVersion, other-oa)
- Topics
- Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Telemedicine and Telehealth Implementation
- Health Sciences › Health Professions › Health Information Management › Electronic Health Records Systems
- Keywords
- digital health interventions, implementation success factors, implementation barriers, workflow disruption, workload, role definition, face-to-face communication, employee turnover, quality of care, implementation costs, clinical process
- MeSH terms
- Humans, Medical Informatics, Telemedicine
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
