Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 165 of the 168 references it cites were found in a registry or an index; 4 of the 32 sources its claims cite were checked for support.

The Impact of eHealth on the Quality and Safety of Health Care: A Systematic Overview

Open access

Abstract

BACKGROUND: There is considerable international interest in exploiting the potential of digital solutions to enhance the quality and safety of health care. Implementations of transformative eHealth technologies are underway globally, often at very considerable cost. In order to assess the impact of eHealth solutions on the quality and safety of health care, and to inform policy decisions on eHealth deployments, we undertook a systematic review of systematic reviews assessing the effectiveness and consequences of various eHealth technologies on the quality and safety of care. METHODS AND FINDINGS: We developed novel search strategies, conceptual maps of health care quality, safety, and eHealth interventions, and then systematically identified, scrutinised, and synthesised the systematic review literature. Major biomedical databases were searched to identify systematic reviews published between 1997 and 2010. Related theoretical, methodological, and technical material was also reviewed. We identified 53 systematic reviews that focused on assessing the impact of eHealth interventions on the quality and/or safety of health care and 55 supplementary systematic reviews providing relevant supportive information. This systematic review literature was found to be generally of substandard quality with regards to methodology, reporting, and utility. We thematically categorised eHealth technologies into three main areas: (1) storing, managing, and transmission of data; (2) clinical decision support; and (3) facilitating care from a distance. We found that despite support from policymakers, there was relatively little empirical evidence to substantiate many of the claims made in relation to these technologies. Whether the success of those relatively few solutions identified to improve quality and safety would continue if these were deployed beyond the contexts in which they were originally developed, has yet to be established. Importantly, best practice guidelines in effective development and deployment strategies are lacking. CONCLUSIONS: There is a large gap between the postulated and empirically demonstrated benefits of eHealth technologies. In addition, there is a lack of robust research on the risks of implementing these technologies and their cost-effectiveness has yet to be demonstrated, despite being frequently promoted by policymakers and "techno-enthusiasts" as if this was a given. In the light of the paucity of evidence in relation to improvements in patient outcomes, as well as the lack of evidence on their cost-effectiveness, it is vital that future eHealth technologies are evaluated against a comprehensive set of measures, ideally throughout all stages of the technology's life cycle. Such evaluation should be characterised by careful attention to socio-technical factors to maximise the likelihood of successful implementation and adoption.

Overview

CoChat Summary

TL;DR

This systematic overview of 108 reviews found that the empirical evidence for most common eHealth technologies’ benefits on quality and safety is weak, inconsistent, or absent. The paper argues that large-scale eHealth investments should not be justified by assumed gains alone, because patient-level and cost-effectiveness benefits were rarely demonstrated.

Key findings

  • The searches retrieved 46,349 references, and the authors included 108 reviews: 53 as the main empirical evidence base and 55 supplementary reviews for context.
  • For EHRs, the paper found only weak evidence for benefits in time efficiency and data quality (legibility, completeness, comprehensiveness), while risks such as time costs, increased costs, and reduced patient-centeredness were mostly anecdotal.
  • For PACS, there were only 3 reviews; evidence for improved organizational efficiency was weak, and overall cost-effectiveness could not be determined because economic findings were often contradictory and of poor quality.
  • For CPOE and ePrescribing, the review reports moderate evidence for some organizational/practitioner benefits, but weak or inconsistent evidence for patient-level outcomes; for ePrescribing, there was no clear evidence of patient outcome benefit outside prescribing, and medication-error reductions were not clearly linked to patient harm reduction.

Methods

  • Systematic overview of systematic reviews focused on clinician-oriented eHealth technologies related to storage/retrieval of data and support for clinical decision making; patient-focused interventions were excluded.
  • Searched PubMed/MEDLINE, EMBASE, and the Cochrane Library for secondary research reports published from 1997 to 2007, with no language restrictions; searches were updated through end of April 2010.
  • Performed dual-reviewer screening and critical appraisal (with arbitration by a third reviewer), then used narrative synthesis because the literature was too diverse for quantitative pooling; evidence was classified using a modified WHO Health Evidence Network approach as strong, moderate, or weak.

Limitations

  • The paper states that poor indexing, reliance on English-language databases, and a novel multimethod approach meant some reviews may have been missed and the synthesis was “less rigorous” than a conventional systematic review because individual primary studies were not appraised.
  • The authors note that they had to adapt the critical appraisal instrument, and that overlap in reviews plus inconsistent terminology required judgment calls about which reviews and primary studies mapped to which interventions.
  • Evident from the text: the overview covers mostly economically developed country settings and clinician-orientated information systems, so the findings may not generalize well to patient-oriented technologies or other contexts.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1371/journal.pmed.1000387

Cites

165 of 165 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Figures

Figure 1 PRISMA flow diagram.
Figure 1 PRISMA flow diagram.CC BY · PubMed Central

Verification

Claims the paper makes

4 Valid · 0 Not valid · 24 Not checked · 67 Own results and interpretations

41 more claims

Create a free account to see all 95 claims and to verify the 28 references still open.

See all claims — free account
  • Probably not a substantial claim. 27
  • It may state two separate claims as one. 28

Create a free account to see these claims.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

5 more claims about this paper

Create a free account to see every claim other papers make about this one.

See all claims — free account

Citations

Cites

Show all 168 references

Research works printed but not linked: 3

  1. C Pagliari, 2004, EH1 E-Health scoping exercise. Review of wider Web-based information sources.
  2. C Pagliari, 2004, EH1 E-Health scoping exercise. Review of the traditional research literature.
  3. PG Shekelle, 2009, Costs and benefits of health technology information: an updated systematic review.

Cited by

See all 1,442

Metadata

Authors
Black, A. D., Car, J., Pagliari, C., Anandan, C., Cresswell, K., Bokun, T., McKinstry, B., Procter, R., Majeed, A., & Sheikh, A.
Affiliations
  • Imperial College London (GB)
  • University of Edinburgh (GB)
  • University of Manchester (GB)
Corresponding author
Sheikh, Aziz
Venue
PLoS Medicine
Published
2011-01-18
Volume
8
Issue
1
Pages
e1000387
ISSN
  • 1549-1277 (ISSN-L)
  • 1549-1676
OpenAlex
W2002144979
Cited by
1,442
References
168
Citations by year
2026: 23 · 2025: 26 · 2024: 44 · 2023: 46 · 2022: 55 · 2021: 81 · 2020: 94 · 2019: 102 · 2018: 109 · 2017: 110 · 2016: 129 · 2015: 109 · 2014: 126 · 2013: 207 · 2012: 111
FWCI
24.19
Type
journal article
Language
en
Open access
Locations
  • PLoS Medicine (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • RePEc: Research Papers in Economics (publishedVersion)
  • Warwick Research Archive Portal (University of Warwick) (acceptedVersion)
  • Research Publications (Maastricht University) (submittedVersion, cc-by)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
  • Figshare (submittedVersion, cc-by)
  • Research Explorer (The University of Manchester) (submittedVersion)
  • Edinburgh Research Explorer (University of Edinburgh) (submittedVersion, cc-by)
  • Spiral (Imperial College London) (submittedVersion, other-oa)
  • Research Publications (Maastricht University) (submittedVersion, other-oa)
Funders
Economic and Social Research Council
Topics
  • Health Sciences › Health Professions › Health Information Management › Electronic Health Records Systems
  • Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Telemedicine and Telehealth Implementation
  • Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Technology and Human Factors in Education and Health
Keywords
e-health, quality of care, patient safety, clinical decision support, telemedicine, health data management, digital health technologies, cost-effectiveness, evidence gaps, health policy
MeSH terms
Cost-Benefit Analysis, Delivery of Health Care, Health Policy, Medical Informatics, Quality of Health Care, Radiology Information Systems, Review Literature as Topic, Efficiency, Organizational, Electronic Prescribing, Electronic Health Records

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-10-11, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-11 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (gpt-6-sol).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: The Impact of eHealth on the Quality and Safety of Health Care: A Systematic Overview. https://app.cochat.ai/papers/10.1371/journal.pmed.1000387
The paper
Black, A. D., Car, J., Pagliari, C., Anandan, C., Cresswell, K., Bokun, T., McKinstry, B., Procter, R., Majeed, A., & Sheikh, A. (2011). The Impact of eHealth on the Quality and Safety of Health Care: A Systematic Overview. PLoS Medicine. https://doi.org/10.1371/journal.pmed.1000387

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.