CoChat

Factors Determining the Success and Failure of eHealth Interventions: Systematic Review of the Literature

Open access
Granja, Conceição, Janssen, Wouter, Johansen, Monika Alise · 2018 · Journal of Medical Internet Research

Published version of a preprint

The DOI matches its Crossref record; 251 of the 251 references it cites were found in a registry or an index.

Abstract

BACKGROUND: eHealth has an enormous potential to improve healthcare cost, effectiveness, and quality of care. However, there seems to be a gap between the foreseen benefits of research and clinical reality. OBJECTIVE: Our objective was to systematically review the factors influencing the outcome of eHealth interventions in terms of success and failure. METHODS: We searched the PubMed database for original peer-reviewed studies on implemented eHealth tools that reported on the factors for the success or failure, or both, of the intervention. We conducted the systematic review by following the patient, intervention, comparison, and outcome framework, with 2 of the authors independently reviewing the abstract and full text of the articles. We collected data using standardized forms that reflected the categorization model used in the qualitative analysis of the outcomes reported in the included articles. RESULTS: Among the 903 identified articles, a total of 221 studies complied with the inclusion criteria. The studies were heterogeneous by country, type of eHealth intervention, method of implementation, and reporting perspectives. The article frequency analysis did not show a significant discrepancy between the number of reports on failure (392/844, 46.5%) and on success (452/844, 53.6%). The qualitative analysis identified 27 categories that represented the factors for success or failure of eHealth interventions. A quantitative analysis of the results revealed the category quality of healthcare (n=55) as the most mentioned as contributing to the success of eHealth interventions, and the category costs (n=42) as the most mentioned as contributing to failure. For the category with the highest unique article frequency, workflow (n=51), we conducted a full-text review. The analysis of the 23 articles that met the inclusion criteria identified 6 barriers related to workflow: workload (n=12), role definition (n=7), undermining of face-to-face communication (n=6), workflow disruption (n=6), alignment with clinical processes (n=2), and staff turnover (n=1). CONCLUSIONS: The reviewed literature suggested that, to increase the likelihood of success of eHealth interventions, future research must ensure a positive impact in the quality of care, with particular attention given to improved diagnosis, clinical management, and patient-centered care. There is a critical need to perform in-depth studies of the workflow(s) that the intervention will support and to perceive the clinical processes involved.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.2196/10235

Cites

251 of 251 references verified0 citation errors · 0 not checkable

Statistics

Figures

Figure 1 Preferred Reporting Items for Systematic reviews and Meta-Analyses (PRISMA) flowchart of the literature search and article selection.
Figure 1 Preferred Reporting Items for Systematic reviews and Meta-Analyses (PRISMA) flowchart of the literature search and article selection.CC BY · PubMed Central

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 251 references

Research works printed but not linked: 33

  1. Ågren, G, 2006, Healthy Ageing -- A Challenge for Europe
  2. Goldberg, HS, 2001, Stud Health Technol Inform, 84, 1455
  3. 2011, ISO/IEC/IEEE 42010:2011(E) (Revision of ISO/IEC 42010:2007 and IEEE Std 1471-2000)
  4. Ehrler, F, 2014, Stud Health Technol Inform, 205, 667
  5. Sølling, IK, 2014, Stud Health Technol Inform, 201, 219
  6. Zhang, X, 2014, Stud Health Technol Inform, 204, 176
  7. El-Mahalli, AA, 2012, Perspect Health Inf Manag, 9, 1
  8. Schnall, R, 2009, Stud Health Technol Inform, 146, 248
  9. Saranummi, N, 2016, Stud Health Technol Inform, 224, 9
  10. Rossos, PG, 2015, Stud Health Technol Inform, 209, 121
  11. Barrett, M, 2009, Rural Remote Health, 9, 1154
  12. Foldy, S, 2007, WMJ, 106, 120
  13. Mattocks, K, 2007, Conn Med, 71, 27
  14. Ayatollahi, H, 2014, Perspect Health Inf Manag, 11, 1c
  15. Alkhaldi, B, 2014, Stud Health Technol Inform, 205, 875
  16. Alsulame, K, 2015, Stud Health Technol Inform, 213, 233
  17. Owens, DK, 1998, West J Med, 168, 166
  18. Doupi, P, 2016, Stud Health Technol Inform, 222, 220
  19. Bond, CS, 2014, Stud Health Technol Inform, 206, 1
  20. Griebel, L, 2013, Stud Health Technol Inform, 192, 965
  21. Schwarz, F, 2014, Rural Remote Health, 14, 2871
  22. Hanna, L, 2011, Inform Prim Care, 19, 17
  23. Lober, WB, 2008, AMIA Annu Symp Proc, 434
  24. Taylor, J, 2015, Nurs Times, 111, 18
  25. Vimarlund, V, 2013, Stud Health Technol Inform, 192, 933
  26. Meyer, R, 2010, Yearb Med Inform, 21
  27. Mars, M, 2010, Yearb Med Inform, 87
  28. Ruxwana, N, 2014, Health Inf Manag, 43, 26
  29. Anvari, M, 2004, Semin Laparosc Surg, 11, 123
  30. Dadd, M, 2002, J Telemed Telecare, 8 Suppl 3, S3:11
  31. Courtney, KL, 2008, Inform Prim Care, 16, 195
  32. Gardner, RM, 2004, Respir Care, 49, 378
  33. Bowens, FM, 2010, Perspect Health Inf Manag, 7, 1d

Cited by

See all 578

Metadata

Authors
Granja, C., Janssen, W., & Johansen, M. A.
Affiliations
UiT The Arctic University of Norway (NO)
Corresponding author
Granja, Conceição
Venue
Journal of Medical Internet Research
Published
2018-05-01
Volume
20
Issue
5
Pages
e10235
ISSN
1438-8871 (ISSN-L)
OpenAlex
W2801287189
Cited by
578
References
250
Citations by year
2026: 40 · 2025: 47 · 2024: 68 · 2023: 64 · 2022: 128 · 2021: 91 · 2020: 76 · 2019: 48 · 2018: 15
FWCI
10.47
Type
journal article
Language
en
Open access
Licence
cc-by
Locations
  • Journal of Medical Internet Research (publishedVersion, cc-by)
  • Europe PMC (PubMed Central) (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • NORA - Norwegian Open Research Archives (submittedVersion, other-oa)
Topics
  • Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
  • Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Telemedicine and Telehealth Implementation
  • Health Sciences › Health Professions › Health Information Management › Electronic Health Records Systems
Keywords
digital health interventions, implementation success factors, implementation barriers, workflow disruption, workload, role definition, face-to-face communication, employee turnover, quality of care, implementation costs, clinical process
MeSH terms
Humans, Medical Informatics, Telemedicine

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.