Health Information Technology: An Updated Systematic Review With a Focus on Meaningful Use
The DOI matches its Crossref record; 38 of the 38 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Incentives offered by the U.S. government have spurred marked increases in use of health information technology (IT). PURPOSE: To update previous reviews and examine recent evidence that relates health IT functionalities prescribed in meaningful use regulations to key aspects of health care. DATA SOURCES: English-language articles in PubMed from January 2010 to August 2013. STUDY SELECTION: 236 studies, including pre-post and time-series designs and clinical trials that related the use of health IT to quality, safety, or efficiency. DATA EXTRACTION: Two independent reviewers extracted data on functionality, study outcomes, and context. DATA SYNTHESIS: Fifty-seven percent of the 236 studies evaluated clinical decision support and computerized provider order entry, whereas other meaningful use functionalities were rarely evaluated. Fifty-six percent of studies reported uniformly positive results, and an additional 21% reported mixed-positive effects. Reporting of context and implementation details was poor, and 61% of studies did not report any contextual details beyond basic information. LIMITATION: Potential for publication bias, and evaluated health IT systems and outcomes were heterogeneous and incompletely described. CONCLUSION: Strong evidence supports the use of clinical decision support and computerized provider order entry. However, insufficient reporting of implementation and context of use makes it impossible to determine why some health IT implementations are successful and others are not. The most important improvement that can be made in health IT evaluations is increased reporting of the effects of implementation and context. PRIMARY FUNDING SOURCE: Office of the National Coordinator.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Studies have shown that digital health technology can improve health literacy, enhance patient participation in health care, enable patients to better manage their own health, and improve health care efficiency, especially in patients with chronic diseases”
From Inequities in Health Care Services Caused by the Adoption of Digital Health Technologies: Scoping Review (2022) · cites this paper as [13]
Citations
Cites
Chaudhry, B., Wang, J., Wu, S., Maglione, M., Mojica, W., Roth, E., Morton, S. C., & Shekelle, P. G. (2006) · Annals of Internal Medicine · doi:10.7326/0003-4819-144-10-200605160-00125 · Cited by 3,159
Self-citationThe “Meaningful Use” Regulation for Electronic Health Records
Blumenthal, D., & Tavenner, M. (2010) · New England Journal of Medicine · doi:10.1056/nejmp1006114 · Cited by 2,059
Buntin, M. B., Burke, M. F., Hoaglin, M. C., & Blumenthal, D. (2011) · Health Affairs · doi:10.1377/hlthaff.2011.0178 · Cited by 1,311
Medicare and Medicaid programs; electronic health record incentive program--stage 2. Final rule.
(2010) · PubMed · Cited by 407
Goldzweig, C. L., Towfigh, A., Maglione, M., & Shekelle, P. G. (2009) · Health Affairs · doi:10.1377/hlthaff.28.2.w282 · Cited by 375
Self-citationRadley, D. C., Wasserman, M. R., Olsho, L. E., Shoemaker, S. J., Spranca, M. D., & Bradshaw, B. (2013) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2012-001241 · Cited by 318
Centers for Medicare & Medicaid Services (CMS)
Services, U. S. C. F. M. M. (2013) · Cited by 318
Roshanov, P. S., Misra, S., Gerstein, H. C., Garg, A. X., Sebaldt, R. J., Mackay, J. A., Weise-Kelly, L., Navarro, T., Wilczynski, N. L., Haynes, R. B., et al. (2011) · Implementation Science · doi:10.1186/1748-5908-6-92 · Cited by 236
STARE-HI—Statement on reporting of evaluation studies in Health Informatics
TALMON, J., AMMENWERTH, E., BRENDER, J., DEKEIZER, N., NYKANEN, P., & RIGBY, M. (2009) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2008.09.002 · Cited by 234
Advancing the Science of Patient Safety
Shekelle, P. G., Pronovost, P. J., Wachter, R. M., Taylor, S. L., Dy, S. M., Foy, R., Hempel, S., McDonald, K. M., Ovretveit, J., Rubenstein, L. V., et al. (2011) · Annals of Internal Medicine · doi:10.7326/0003-4819-154-10-201105170-00011 · Cited by 216
Self-citationRohm, A. J., & Milne, G. R. (2004) · Journal of Business Research · doi:10.1016/s0148-2963(02)00345-4 · Cited by 197
Souza, N. M., Sebaldt, R. J., Mackay, J. A., Prorok, J. C., Weise-Kelly, L., Navarro, T., Wilczynski, N. L., Haynes, R. B., & the CCDSS Systematic Review Team (2011) · Implementation Science · doi:10.1186/1748-5908-6-87 · Cited by 178
Shamliyan, T. A., Duval, S., Du, J., & Kane, R. L. (2008) · Health Services Research · doi:10.1111/j.1475-6773.2007.00751.x · Cited by 165
Electronic Health Record–Based Decision Support to Improve Asthma Care: A Cluster-Randomized Trial
Bell, L. M., Grundmeier, R. W., Localio, R., Zorc, J. J., Fiks, A. G., Zhang, X., Stephens, T. B., Swietlik, M., & Guevara, J. P. (2010) · PEDIATRICS · doi:10.1542/peds.2009-1385 · Cited by 152
Hemens, B. J., Holbrook, A. M., Tonkin, M., Mackay, J. A., Weise-Kelly, L., Navarro, T., Wilczynski, N. L., Haynes, R. B., & the CCDSS Systematic Review Team (2011) · Implementation Science · doi:10.1186/1748-5908-6-89 · Cited by 148
Roshanov, P. S., You, J. J., Dhaliwal, J., Koff, D., Mackay, J. A., Weise-Kelly, L., Navarro, T., Wilczynski, N. L., Haynes, R. B., & the CCDSS Systematic Review Team (2011) · Implementation Science · doi:10.1186/1748-5908-6-88 · Cited by 141
Sahota, N., Lloyd, R., Ramakrishna, A., Mackay, J. A., Prorok, J. C., Weise-Kelly, L., Navarro, T., Wilczynski, N. L., Haynes, R. B., & the CCDSS Systematic Review Team (2011) · Implementation Science · doi:10.1186/1748-5908-6-91 · Cited by 127
Nieuwlaat, R., Connolly, S. J., Mackay, J. A., Weise-Kelly, L., Navarro, T., Wilczynski, N. L., Haynes, R. B., & the CCDSS Systematic Review Team (2011) · Implementation Science · doi:10.1186/1748-5908-6-90 · Cited by 97
Ryan, A. M., Bishop, T. F., Shih, S. C., & Casalino, L. P. (2013) · Health Affairs · doi:10.1377/hlthaff.2012.0742 · Cited by 82
Terrell, K. M., Perkins, A. J., Hui, S. L., Callahan, C. M., Dexter, P. R., & Miller, D. K. (2010) · Annals of Emergency Medicine · doi:10.1016/j.annemergmed.2010.03.025 · Cited by 73
Hyman, D., Laire, M., Redmond, D., & Kaplan, D. W. (2012) · PEDIATRICS · doi:10.1542/peds.2011-2984 · Cited by 61
STARE-HI -Statement on Reporting of Evaluation Studies in Health Informatics
Ammenwerth, E., Brender, J., de Keizer, N. F., Nykänen, P., Rigby, M., & Talmon, J. L. (2009) · Yearbook of Medical Informatics · doi:10.1055/s-0038-1638633 · Cited by 55
Schwann, N. M., Bretz, K. A., Eid, S. M., Burger, T. L., Fry, D., Ackler, F., Evans, P., Romancheck, D., Beck, M., Ardire, A. J., et al. (2011) · Anesthesia & Analgesia · doi:10.1213/ane.0b013e318227b511 · Cited by 54
Electronic Medical Records and the Efficiency of Hospital Emergency Departments
Furukawa, M. F. (2010) · Medical Care Research and Review · doi:10.1177/1077558710372108 · Cited by 51
Galanter, W., Thambi, M., Rosencranz, H., Shah, B., Falck, S., Lin, F., Nutescu, E. A., & Lambert, B. L. (2010) · American Journal of Health-System Pharmacy · doi:10.2146/ajhp090575 · Cited by 50
Improved Physician Work Flow After Integrating Sign-out Notes into the Electronic Medical Record
Bernstein, J. A., Imler, D. L., Sharek, P. J., & Longhurst, C. (2010) · The Joint Commission Journal on Quality and Patient Safety · doi:10.1016/s1553-7250(10)36013-2 · Cited by 49
Impact of computerized physician order entry on ED patient length of stay
Spalding, S. C., Mayer, P. H., Ginde, A. A., Lowenstein, S. R., & Yaron, M. (2010) · The American Journal of Emergency Medicine · doi:10.1016/j.ajem.2009.10.007 · Cited by 38
Fernando, T., Nguyen, D. D., & Baraff, L. J. (2011) · Academic Emergency Medicine · doi:10.1111/j.1553-2712.2011.01249.x · Cited by 37
Computerized Provider Order Entry in Pediatric Oncology: Design, Implementation, and Outcomes
Chen, A. R., & Lehmann, C. U. (2011) · Journal of Oncology Practice · doi:10.1200/jop.2011.000344 · Cited by 36
Point of Care Documentation Impact on the Nurse-Patient Interaction
Duffy, W. J., Kharasch, M. S., & Du, H. (2010) · Nursing Administration Quarterly · doi:10.1097/naq.0b013e3181c95ec4 · Cited by 34
Dalal, S. R., Shekelle, P., Hempel, S., Newberry, S. J., Motala, A., & Shetty, K. D. (2012) · Medical Decision Making · doi:10.1177/0272989x12457243 · Cited by 32
Self-citationElectronic Medical Record Availability and Primary Care Depression Treatment
Harman, J. S., ROST, K. M., Harle, C. A., & Cook, R. L. (2012) · Journal of General Internal Medicine · doi:10.1007/s11606-012-2001-0 · Cited by 27
Wang, H., Lu, C., Wu, M., Huang, M.-H., & Huang, Y. (2012) · International Journal of Clinical Pharmacology and Therapeutics · doi:10.5414/cp201678 · Cited by 23
Electronic medical record customization and the impact upon chart completion rates.
Bennett, K. J., & Steen, C. (2010) · PubMed · Cited by 21
Shekelle, P., Pronovost, P., Wachter, R., Taylor, S., Dy, S. M., Foy, R., Hempel, S., McDonald, K. M., Øvretveit, J., & Rubenstein, L. V. (2010) · White Rose Research Online (University of Leeds, The University of Sheffield, University of York) · Cited by 19
Self-citationGeorgiou, A., Lang, S., Rosenfeld, D., & Westbrook, J. I. (2011) · Archives of Pathology & Laboratory Medicine · doi:10.5858/2010-0286-so.1 · Cited by 18
Effects of laboratory data exchange in the care of patients with HIV
Bell, D. S., Cima, L., Seiden, D. S., Nakazono, T. T., Alcouloumre, M. S., & Cunningham, W. E. (2012) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2012.07.012 · Cited by 13
Computerized Physician Order Entry Reduces Medication Turnaround Time of Labor Induction Agents
Refuerzo, J., Straub, H. L., Murphy, R., Salter, L., Ramin, S., & Blackwell, S. C. (2010) · American Journal of Perinatology · doi:10.1055/s-0030-1268717 · Cited by 3
Research works printed but not linked: 1
- Bennett KJ, 2010, Fam Med, 42, 338
Cited by
HITECH Act Drove Large Gains In Hospital Electronic Health Record Adoption
Adler-Milstein, J., & Jha, A. K. (2017) · Health Affairs · doi:10.1377/hlthaff.2016.1651 · Cited by 396
Yao, R., Zhang, W., Evans, R., Cao, G., Rui, T., & Shen, L. (2022) · Journal of Medical Internet Research · doi:10.2196/34144 · Cited by 451
“Studies have shown that digital health technology can improve health literacy, enhance patient participation in health care, enable patients to better manage their own health, and improve health care efficiency, especially in patients with chronic diseases [13,14].”
BackgroundNuckols, T. K., Smith-Spangler, C., Morton, S. C., Asch, S. M., Patel, V. M., Anderson, L. J., Deichsel, E. L., & Shekelle, P. G. (2014) · Systematic Reviews · doi:10.1186/2046-4053-3-56 · Cited by 340
Self-citationLi, E., Clarke, J., Ashrafian, H., Darzi, A., & Neves, A. L. (2022) · Journal of Medical Internet Research · doi:10.2196/38144 · Cited by 220
Furukawa, M. F., King, J., Patel, V., Hsiao, C.-J., Adler-Milstein, J., & Jha, A. K. (2014) · Health Affairs · doi:10.1377/hlthaff.2014.0445 · Cited by 273
Metadata
- Authors
- Jones, S. S., Rudin, R. S., Perry, T., & Shekelle, P. G.
- Affiliations
- Brigham and Women's Hospital (US)
- Venue
- Annals of Internal Medicine
- Publisher
- American College of Physicians
- Published
- 2014-01-07
- Volume
- 160
- Issue
- 1
- Pages
- 48-54
- ISSN
- 0003-4819 (ISSN-L)
- 1539-3704
- OpenAlex
- W2160676411
- Cited by
- 475
- References
- 38
- Citations by year
- 2026: 14 · 2025: 13 · 2024: 28 · 2023: 17 · 2022: 50 · 2021: 41 · 2020: 43 · 2019: 46 · 2018: 46 · 2017: 47 · 2016: 50 · 2015: 47 · 2014: 30
- FWCI
- 8.81
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.acpjournals.org/journal/aim/text-and-data-mining (tdm)
- Locations
- Annals of Internal Medicine (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Health Sciences › Health Professions › Health Information Management › Electronic Health Records Systems
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Technology and Human Factors in Education and Health
- Health Sciences › Health Professions › Health Information Management › Medical Coding and Health Information
- Keywords
- health information technology, meaningful use, clinical decision support, computerized physician order entry, quality of care, patient safety, health care efficiency, implementation context, reporting quality
- MeSH terms
- Humans, Medical Informatics Applications, United States, Outcome Assessment, Health Care, Efficiency, Organizational, Decision Support Systems, Clinical, Medical Order Entry Systems, Meaningful Use
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.