Review: Electronic Health Records and the Reliability and Validity of Quality Measures: A Review of the Literature
The DOI matches its Crossref record; 46 of the 47 references it cites were found in a registry or an index.
Abstract
Previous reviews of research on electronic health record (EHR) data quality have not focused on the needs of quality measurement. The authors reviewed empirical studies of EHR data quality, published from January 2004, with an emphasis on data attributes relevant to quality measurement. Many of the 35 studies reviewed examined multiple aspects of data quality. Sixty-six percent evaluated data accuracy, 57% data completeness, and 23% data comparability. The diversity in data element, study setting, population, health condition, and EHR system studied within this body of literature made drawing specific conclusions regarding EHR data quality challenging. Future research should focus on the quality of data from specific EHR components and important data attributes for quality measurement such as granularity, timeliness, and comparability. Finally, factors associated with poor or variability in data quality need to be better understood and effective interventions developed.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“In a 2010 review, Chan et al 10 looked at the quality of the same clinical concepts across multiple institutions, and still found a great deal of variability. The completeness of blood pressure recordings, for example, fell anywhere between 0.1% and 51%.”
From Methods and dimensions of electronic health record data quality assessment: enabling reuse for clinical research (2013) · cites this paper as [10]
In the citing paper
“EHRs typically are optimized for efficient patient care and nonclinical administrative requirements, resulting in great variation in clinical documentation practices, even among users of the same systems.38–40”
From A harmonized data quality assessment terminology and framework for the secondary use of electronic health record data (2016) · cites this paper as [39]
In the citing paper
“In particular, representativeness is often not a factor86,87 while it is a crucial property for secondary use of data in clinical studies88 or when reusing medical data as training data for ML applications.”
From The METRIC-framework for assessing data quality for trustworthy AI in medicine: A systematic review (2024) · cites this paper as [86]
In the citing paper
“While these developments have advanced the understanding of data quality in the context of medical applications, frameworks for EHR frequently focus on the data quality of individual patients86,87, neglecting data quality aspects for the overall population.”
From The METRIC-framework for assessing data quality for trustworthy AI in medicine: A systematic review (2024) · cites this paper as [86]
Citations
Cites
The American Journal of Managed Care
(2020) · The American Journal of Managed Care · doi:10.37765/ajmc · Cited by 3,237
Electronic health records in ambulatory care—a national survey of physicians
DesRoches, C. M., Campbell, E. G., Rao, S. R., Donelan, K., Ferris, T. G., Jha, A., Kaushal, R., Levy, D. E., Rosenbaum, S., Shields, A. E., et al. (2008) · New England Journal of Medicine · doi:10.1056/nejmsa0802005 · Cited by 1,111
Informatics in Primary Care: Strategies in Information Management for the Healthcare Provider
(2002) · Health Informatics · doi:10.1007/978-1-4613-0069-4 · Cited by 422
Systematic review of scope and quality of electronic patient record data in primary care
Thiru, K., Hassey, A., & Sullivan, F. (2003) · BMJ · doi:10.1136/bmj.326.7398.1070 · Cited by 342
Agreement between patient-reported symptoms and their documentation in the medical record.
Pakhomov, S., Jacobsen, S. J., Chute, C. G., & Roger, V. L. (2008) · PubMed · Cited by 281
Rewarding Provider Performance: Aligning Incentives in Medicare
English, W. J. (2008) · Annals of Internal Medicine · doi:10.7326/0003-4819-148-8-200804150-00028 · Cited by 220
Tang, P. C., Ralston, M., Arrigotti, M. F., Qureshi, L., & Graham, J. (2007) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m2198 · Cited by 193 · cited 4×
“It has also been suggested that the clinical relevance of the data and their anticipated future use (e.g., for decision support) may affect data quality (Roukema et al., 2006; Tang et al., 2007).”
BackgroundResultInfluentialEgger, M. (2008) · Bulletin of the World Health Organization · doi:10.2471/blt.07.049908 · Cited by 177
Review: Use of Electronic Medical Records for Health Outcomes Research: A Literature Review
Dean, B. B., Lam, J., Natoli, J. L., Butler, Q., Aguilar, D., & Nordyke, R. J. (2009) · Medical Care Research and Review · doi:10.1177/1077558709332440 · Cited by 176
Pringle, M., Ward, P., & Chilvers, C. E. D. (1995) · Europe PMC (PubMed Central) · Cited by 146
Research works printed but not linked: 7
- Faulconer, E.R., 2004, Informatics in Primary Care, 12, 243
- Hicken, V.N., 2004, Studies in Health Technology and Informatics, 107, 1053
- Kaboli, P.J., 2004, American Journal of Managed Care, 10, 872
- Powell, J., 2006, Informatics in Primary Care, 14, 55
- Pringle, M., 1995, British Journal of General Practice, 45, 537
- Ricciardi, T.N., AMIA Annual Symposium Proceedings
- 10.1007/s11606-006-0256-z · doi:10.1007/s11606-006-0256-z
Cited by
The Impact of eHealth on the Quality and Safety of Health Care: A Systematic Overview
Black, A. D., Car, J., Pagliari, C., Anandan, C., Cresswell, K., Bokun, T., McKinstry, B., Procter, R., Majeed, A., & Sheikh, A. (2011) · PLoS Medicine · doi:10.1371/journal.pmed.1000387 · Cited by 1,442
Weiskopf, N. G., & Weng, C. (2013) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2011-000681 · Cited by 1,216
“Hogan and Wagner, 8 in their 1997 literature review, found 22 that the correctness of data ranged between 44% and 100%, and completeness between 1.1% and 100%, depending the clinical concepts being studied.”
BackgroundInfluentialKahn, M. G., Callahan, T. J., Barnard, J., Bauck, A. E., Brown, J., Davidson, B. N., Estiri, H., Goerg, C., Holve, E., Johnson, S. G., et al. (2016) · eGEMs (Generating Evidence & Methods to improve patient outcomes) · doi:10.13063/2327-9214.1244 · Cited by 697
Hersh, W. R., Weiner, M. G., Embi, P. J., Logan, J. R., Payne, P. R. O., Bernstam, E. V., Lehmann, H. P., Hripcsak, G., Hartzog, T. H., Cimino, J. J., et al. (2013) · Medical Care · doi:10.1097/mlr.0b013e31829b1dbd · Cited by 567
The impact of electronic health records on healthcare quality: a systematic review and meta-analysis
Campanella, P., Lovato, E., Marone, C., Fallacara, L., Mancuso, A., Ricciardi, W., & Specchia, M. L. (2016) · The European Journal of Public Health · doi:10.1093/eurpub/ckv122 · Cited by 434
Metadata
- Authors
- Chan, K. S., Fowles, J. B., & Weiner, J. P.
- Affiliations
- Johns Hopkins University (US)
- Park Nicollet Institute, Minneapolis, MN
- Venue
- Medical Care Research and Review
- Publisher
- SAGE Publications
- Published
- 2010-02-11
- Volume
- 67
- Issue
- 5
- Pages
- 503-527
- ISSN
- 1077-5587 (ISSN-L)
- 1552-6801
- OpenAlex
- W2135703887
- Cited by
- 365
- References
- 47
- Citations by year
- 2026: 10 · 2025: 14 · 2024: 19 · 2023: 20 · 2022: 31 · 2021: 36 · 2020: 23 · 2019: 37 · 2018: 28 · 2017: 19 · 2016: 22 · 2015: 26 · 2014: 24 · 2013: 25 · 2012: 18
- FWCI
- 2.44
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
- Locations
- Medical Care Research and Review (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Health Sciences › Health Professions › Health Information Management › Electronic Health Records Systems
- Health Sciences › Health Professions › Health Information Management › Medical Coding and Health Information
- Physical Sciences › Computer Science › Information Systems › Data Quality and Management
- Keywords
- electronic health records, EHR data quality, quality metrics, data accuracy, data completeness, data comparability, data granularity, timeliness, reliability statistics, validity
- MeSH terms
- Humans, Quality Assurance, Health Care, Research Design, United States, Reproducibility of Results, Quality Indicators, Health Care, Electronic Health Records
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Review: Electronic Health Records and the Reliability and Validity of Quality Measures: A Review of the Literature. https://app.cochat.ai/papers/10.1177/1077558709359007
- The paper
- Chan, K. S., Fowles, J. B., & Weiner, J. P. (2010). Review: Electronic Health Records and the Reliability and Validity of Quality Measures: A Review of the Literature. Medical Care Research and Review. https://doi.org/10.1177/1077558709359007
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.