The DOI matches its Crossref record; 875 of the 877 references it cites were found in a registry or an index.
Costs and benefits of health information technology.
Open accessAbstract
OBJECTIVES: An evidence report was prepared to assess the evidence base regarding benefits and costs of health information technology (HIT) systems, that is, the value of discrete HIT functions and systems in various healthcare settings, particularly those providing pediatric care. DATA SOURCES: PubMed, the Cochrane Controlled Clinical Trials Register, and the Cochrane Database of Reviews of Effectiveness (DARE) were electronically searched for articles published since 1995. Several reports prepared by private industry were also reviewed. REVIEW METHODS: Of 855 studies screened, 256 were included in the final analyses. These included systematic reviews, meta-analyses, studies that tested a hypothesis, and predictive analyses. Each article was reviewed independently by two reviewers; disagreement was resolved by consensus. RESULTS: Of the 256 studies, 156 concerned decision support, 84 assessed the electronic medical record, and 30 were about computerized physician order entry (categories are not mutually exclusive). One hundred twenty four of the studies assessed the effect of the HIT system in the outpatient or ambulatory setting; 82 assessed its use in the hospital or inpatient setting. Ninety-seven studies used a randomized design. There were 11 other controlled clinical trials, 33 studies using a pre-post design, and 20 studies using a time series. Another 17 were case studies with a concurrent control. Of the 211 hypothesis-testing studies, 82 contained at least some cost data. We identified no study or collection of studies, outside of those from a handful of HIT leaders, that would allow a reader to make a determination about the generalizable knowledge of the study's reported benefit. Beside these studies from HIT leaders, no other research assessed HIT systems that had comprehensive functionality and included data on costs, relevant information on organizational context and process change, and data on implementation. A small body of literature supports a role for HIT in improving the quality of pediatric care. Insufficient data were available on the costs or cost-effectiveness of implementing such systems. The ability of Electronic Health Records (EHRs) to improve the quality of care in ambulatory care settings was demonstrated in a small series of studies conducted at four sites (three U.S. medical centers and one in the Netherlands). The studies demonstrated improvements in provider performance when clinical information management and decision support tools were made available within an EHR system, particularly when the EHRs had the capacity to store data with high fidelity, to make those data readily accessible, and to help translate them into context-specific information that can empower providers in their work. Despite the heterogeneity in the analytic methods used, all cost-benefit analyses predicted substantial savings from EHR (and health care information exchange and interoperability) implementation: The quantifiable benefits are projected to outweigh the investment costs. However, the predicted time needed to break even varied from three to as many as 13 years. CONCLUSIONS: HIT has the potential to enable a dramatic transformation in the delivery of health care, making it safer, more effective, and more efficient. Some organizations have already realized major gains through the implementation of multifunctional, interoperable HIT systems built around an EHR. However, widespread implementation of HIT has been limited by a lack of generalizable knowledge about what types of HIT and implementation methods will improve care and manage costs for specific health organizations. The reporting of HIT development and implementation requires fuller descriptions of both the intervention and the organizational/economic environment in which it is implemented.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Conversely, lack of effective leadership to advocate change, set priorities or manage the implementation process; and changes in leadership were presented as barriers [55, 67–69].”
From Achieving change in primary care—causes of the evidence to practice gap: systematic reviews of reviews (2015) · cites this paper as [69]
In the citing paper
“Personal style, defined as the perceived fit between the intervention and the preferred style of clinical practice, such as clinicians’ communication style [78, 79], personality [54] and philosophical opposition to the intervention [69, 76], were presented exclusively as barriers.”
From Achieving change in primary care—causes of the evidence to practice gap: systematic reviews of reviews (2015) · cites this paper as [69]
In the citing paper
“Resistance to change caused by disagreement with the evidence, negative beliefs about the usefulness or added value of the intervention or belief that the intervention was not part of their role were commonly described as a barrier to implementation [3, 14, 35, 41, 67–70, 76, 77, 80].”
From Achieving change in primary care—causes of the evidence to practice gap: systematic reviews of reviews (2015) · cites this paper as [69]
In the citing paper
“A lack of knowledge and a limited understanding of benefits afforded by the systems acted as a barrier to implementation [49, 52, 53].”
From Factors that influence the implementation of e-health: a systematic review of systematic reviews (an update) (2016) · cites this paper as [52]
In the citing paper
“Health professionals’ perceptions that e-health systems disrupt workflows, and the delivery of care, are a barrier to both the implementation and use of these systems [23, 49, 52, 56, 57].”
From Factors that influence the implementation of e-health: a systematic review of systematic reviews (an update) (2016) · cites this paper as [52]
In the citing paper
“whereas negative attitudes and staff resistance acted as barriers [49, 52].”
From Factors that influence the implementation of e-health: a systematic review of systematic reviews (an update) (2016) · cites this paper as [52]
Citations
Cites
1 retracted
Nursing record systems: effects on nursing practice and healthcare outcomes.
Urquhart, C., Currell, R., Grant, M., & Hardiker, N. (2009) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd002099.pub2 · Cited by 246
RetractedInstitute of Medicine (2000) · National Academies Press eBooks · doi:10.17226/9728 · Cited by 14,390
Crossing the Quality Chasm: A New Health System for the 21st Century
Baker, A. (2001) · BMJ · doi:10.1136/bmj.323.7322.1192 · Cited by 10,779
Decision aids for people facing health treatment or screening decisions
Stacey, D., Légaré, F., Lewis, K., Barry, M. J., Bennett, C. L., Eden, K. B., Holmes-Rovner, M., Llewellyn-Thomas, H., Lyddiatt, A., Thomson, R., et al. (2017) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd001431.pub5 · Cited by 6,685
The quality of health care delivered to adults in the United States
McGlynn, E. A., Asch, S. M., Adams, J., Keesey, J., Hicks, J., DeCristofaro, A., & Kerr, E. A. (2003) · New England Journal of Medicine · doi:10.1056/nejmsa022615 · Cited by 5,079
Garg, A. X., Adhikari, N. K. J., McDonald, H., Rosas-Arellano, M. P., Devereaux, P. J., Beyene, J., Sam, J., & Haynes, R. B. (2005) · JAMA · doi:10.1001/jama.293.10.1223 · Cited by 2,936
Organizing Care for Patients with Chronic Illness
Wagner, E. H., Austin, B. T., & Korff, M. V. (1996) · The Milbank Quarterly · doi:10.2307/3350391 · Cited by 2,877
Role of Computerized Physician Order Entry Systems in Facilitating Medication Errors
Koppel, R. (2005) · JAMA · doi:10.1001/jama.293.10.1197 · Cited by 2,126
Bates, D. W. (1998) · JAMA · doi:10.1001/jama.280.15.1311 · Cited by 2,107
Medication Errors and Adverse Drug Events in Pediatric Inpatients
Kaushal, R. (2001) · JAMA · doi:10.1001/jama.285.16.2114 · Cited by 1,917
Cited by
Sorted by citations
The Technology Acceptance Model: Its past and its future in health care
Holden, R. J., & Karsh, B.-T. (2010) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2009.07.002 · Cited by 2,669
“Notably, no study used a broader definition of usefulness, despite the notion that health IT might be useful for not only enhancing performance, but also making performance easier and more satisfying, increasing efficiency and lowering costs, improving quality and safety of care, and more [113–115].”
The Impact of eHealth on the Quality and Safety of Health Care: A Systematic Overview
Black, A. D., Car, J., Pagliari, C., Anandan, C., Cresswell, K., Bokun, T., McKinstry, B., Procter, R., Majeed, A., & Sheikh, A. (2011) · PLoS Medicine · doi:10.1371/journal.pmed.1000387 · Cited by 1,442
“Three related reviews – an update, a fuller report, and its more concise counterpart – were an exception due to the complementary nature of the reports rather than these being duplicative [22,55,56].”
BackgroundRoss, J., Stevenson, F., Lau, R., & Murray, E. (2016) · Implementation Science · doi:10.1186/s13012-016-0510-7 · Cited by 1,011
Electronic health records in ambulatory care—a national survey of physicians
DesRoches, C. M., Campbell, E. G., Rao, S. R., Donelan, K., Ferris, T. G., Jha, A., Kaushal, R., Levy, D. E., Rosenbaum, S., Shields, A. E., et al. (2008) · New England Journal of Medicine · doi:10.1056/nejmsa0802005 · Cited by 1,111
Shanafelt, T. D., Dyrbye, L. N., Sinsky, C., Hasan, O., Satele, D., Sloan, J., & West, C. P. (2016) · Mayo Clinic Proceedings · doi:10.1016/j.mayocp.2016.05.007 · Cited by 1,086
“n July 2016 promise for enhancing coordination of care, reducing errors, and improving quality of care.(10-16) In their current form and implementation, however, they seem to have had a variety of unintended negative consequences that reduce efficiency, increase clerical burden, and increase the risk of burnout for ph…”
Background
Metadata
- Authors
- Shekelle, P. G., Morton, S. C., & Keeler, E. B.
- ORCID
- Shekelle, Paul G
- Published
- 2006-04
- Issue
- 132
- Pages
- 1-71
- PMC
- PMC4781594
- OpenAlex
- W2169921538
- Cited by
- 501
- References
- 877
- Citations by year
- 2026: 3 · 2025: 5 · 2024: 6 · 2023: 8 · 2022: 12 · 2021: 22 · 2020: 22 · 2019: 21 · 2018: 32 · 2017: 35 · 2016: 35 · 2015: 28 · 2014: 33 · 2013: 41 · 2012: 30
- Type
- report
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Health Sciences › Health Professions › Health Information Management › Electronic Health Records Systems
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Technology and Human Factors in Education and Health
- Health Sciences › Health Professions › Health Information Management › Medical Coding and Health Information
- Keywords
- health information technology, electronic health records, clinical decision support, computerized physician order entry, pediatric care, outpatient care, inpatient care, quality of care, cost-effectiveness, implementation costs, process change, organizational context, cost-benefit analysis
- MeSH terms
- Ambulatory Care, Cost-Benefit Analysis, Costs and Cost Analysis, Information Systems, Pediatrics, Quality of Health Care, Technology, Medical Records Systems, Computerized
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review