Why Is the Electronic Health Record So Challenging for Research and Clinical Care?
Open accessThe DOI matches its Crossref record; 25 of the 25 references it cites were found in a registry or an index.
Abstract
Background The electronic health record (EHR) has become increasingly ubiquitous. At the same time, health professionals have been turning to this resource for access to data that is needed for the delivery of health care and for clinical research. There is little doubt that the EHR has made both of these functions easier than earlier days when we relied on paper-based clinical records. Coupled with modern database and data warehouse systems, high-speed networks, and the ability to share clinical data with others are large number of challenges that arguably limit the optimal use of the EHR Objectives Our goal was to provide an exhaustive reference for those who use the EHR in clinical and research contexts, but also for health information systems professionals as they design, implement, and maintain EHR systems. Methods This study includes a panel of 24 biomedical informatics researchers, information technology professionals, and clinicians, all of whom have extensive experience in design, implementation, and maintenance of EHR systems, or in using the EHR as clinicians or researchers. All members of the panel are affiliated with Penn Medicine at the University of Pennsylvania and have experience with a variety of different EHR platforms and systems and how they have evolved over time. Results Each of the authors has shared their knowledge and experience in using the EHR in a suite of 20 short essays, each representing a specific challenge and classified according to a functional hierarchy of interlocking facets such as usability and usefulness, data quality, standards, governance, data integration, clinical care, and clinical research. Conclusion We provide here a set of perspectives on the challenges posed by the EHR to clinical and research users.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The UK Biobank resource with deep phenotyping and genomic data
Bycroft, C., Freeman, C., Petkova, D., Band, G., Elliott, L. T., Sharp, K., Motyer, A., Vukcevic, D., Delaneau, O., O’Connell, J., et al. (2018) · Nature · doi:10.1038/s41586-018-0579-z · Cited by 8,876 · cited 1×
“72 It seems that a powerful approach for precision medicine research in the future would include routinely conducting patient-reported surveys to supplement the EHR.”
BackgroundTheoretical and Empirical Analysis of ReliefF and RReliefF
Robnik-Šikonja, M., & Kononenko, I. (2003) · Machine Learning · doi:10.1023/a:1025667309714 · Cited by 3,025 · cited 1×
“95 This is one of many potential sources of bias that can impact ML performance.”
BackgroundGeorge, H., Duke Jon, D., Shah Nigam, H., Reich Christian, G., Vojtech, H., Schuemie Martijn, J., Suchard Marc, A., Woong, P. R., Kei, W. I. C., Rijnbeek Peter, R., et al. (2015) · Studies in Health Technology and Informatics · doi:10.3233/978-1-61499-564-7-574 · Cited by 1,542 · cited 1×
“31 Researchers interested in patient-centered outcomes research may fi nd the PCOR-Net CDM useful in part through research opportunities facilitated by the Patient-Centered Outcomes Research Institute (PCORI).”
MethodPotential Biases in Machine Learning Algorithms Using Electronic Health Record Data
Gianfrancesco, M. A., Tamang, S., Yazdany, J., & Schmajuk, G. (2018) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2018.3763 · Cited by 1,395 · cited 3×
“…access to accurate and complete health care data by clinicians, public health agencies and professionals, biomedical informaticians, and researchers who are engaged in patient care, clinical characterization of COVID-19, and establishing distributed networks for large-scale pandemic surveillance.”
BackgroundMethodInfluentialEnsuring fairness in machine learning to advance health equity.
Rajkomar, A., Hardt, M., Howell, M. D., Corrado, G., & Chin, M. H. (2018) · Annals of Internal Medicine · doi:10.7326/m18-1990 · Cited by 1,341
The PhenX Toolkit: get the most from your measures
Hamilton, C. M., Strader, L. C., Pratt, J. G., Maiese, D., Hendershot, T., Kwok, R. K., Hammond, J. A., Huggins, W., Jackman, D., Pan, H., et al. (2011) · American Journal of Epidemiology · doi:10.1093/aje/kwr193 · Cited by 889
Estimating the success of re-identifications in incomplete datasets using generative models
Rocher, L., Hendrickx, J. M., & de Montjoye, Y.-A. (2019) · Nature Communications · doi:10.1038/s41467-019-10933-3 · Cited by 816 · cited 1×
“63 Because anonymization can decrease information content of the dataset, differential privacy methods are sometimes used in research because they divulge insightful characteristics of cohorts while not disclosing information about any particular individual.”
MethodNext-generation phenotyping of electronic health records
Hripcsak, G., & Albers, D. J. (2013) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2012-001145 · Cited by 795
Linking physicians’ pay to the quality of care--a major experiment in the United Kingdom
Roland, M. (2004) · New England Journal of Medicine · doi:10.1056/nejmhpr041294 · Cited by 689
The National COVID Cohort Collaborative (N3C): Rationale, design, infrastructure, and deployment
Haendel, M. A., Chute, C. G., Bennett, T. D., Eichmann, D. A., Guinney, J., Kibbe, W. A., Payne, P. R. O., Pfaff, E. R., Robinson, P. N., Saltz, J. H., et al. (2021) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocaa196 · Cited by 553 · cited 1×
“This integration can happen in a centralized manner as demonstrated by the National COVID Cohort Collaborative (N3C) consortium 97 or in a federated manner as demonstrated by the Consortium for the Clinical Characteri-zationofCOVID-19byEHR(4CE) 98 ortheOHDSIconsortium.”
Method
Cited by
The Sociodemographic Biases in Machine Learning Algorithms: A Biomedical Informatics Perspective
Franklin, G., Stephens, R., Piracha, M., Tiosano, S., Lehouillier, F., Koppel, R., & Elkin, P. (2024) · Life · doi:10.3390/life14060652 · Cited by 76
“To avoid these practices, health care organizations need to improve the quality, accuracy, and usability of EHRs [34].”
BackgroundSelf-citationConceptualising fairness: three pillars for medical algorithms and health equity
Sikstrom, L., Maslej, M. M., Hui, K., Findlay, Z., Buchman, D. Z., & Hill, S. L. (2022) · BMJ Health & Care Informatics · doi:10.1136/bmjhci-2021-100459 · Cited by 76
Suenghataiphorn, T., Danpanichkul, P., Tribuddharat, N., & Kulthamrongsri, N. (2025) · Journal of Clinical and Experimental Hepatology · doi:10.1016/j.jceh.2025.102627 · Cited by 6
Unlocking electronic health records: a hybrid graph RAG approach to safe clinical AI for patient QA
Thio, S., Lewis, M., Denaxas, S., & Dobson, R. J. B. (2026) · Frontiers in Digital Health · doi:10.3389/fdgth.2026.1780700 · Cited by 6
“These relationships embody not only associations but also causal chains, temporal dependencies, and clinical reasoning pathways fundamental to understanding a patient’s health trajectory (3, 4).”
Metadata
- Authors
- Holmes, J. H., Beinlich, J., Boland, M. R., Bowles, K. H., Chen, Y., Cook, T. S., Demiris, G., Draugelis, M., Fluharty, L., Gabriel, P. E., Grundmeier, R., Hanson, C. W., Herman, D. S., Himes, B. E., Hubbard, R. A., Kahn, C. E., Kim, D., Koppel, R., Long, Q., Mirkovic, N., Morris, J. S., Mowery, D. L., Ritchie, M. D., Urbanowicz, R., & Moore, J. H.
- Venue
- Methods of Information in Medicine
- Publisher
- Georg Thieme Verlag KG
- Published
- 2021-05
- Volume
- 60
- Issue
- 01/02
- Pages
- 032-048
- ISSN
- 0026-1270 (ISSN-L)
- 2511-705X
- OpenAlex
- W3184497436
- Cited by
- 117
- References
- 25
- FWCI
- 10.63
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Why Is the Electronic Health Record So Challenging for Research and Clinical Care? https://app.cochat.ai/papers/10.1055/s-0041-1731784
- The paper
- Holmes, J. H., Beinlich, J., Boland, M. R., Bowles, K. H., Chen, Y., Cook, T. S., Demiris, G., Draugelis, M., Fluharty, L., Gabriel, P. E., Grundmeier, R., Hanson, C. W., Herman, D. S., Himes, B. E., Hubbard, R. A., Kahn, C. E., Kim, D., Koppel, R., Long, Q., . . . Moore, J. H. (2021). Why Is the Electronic Health Record So Challenging for Research and Clinical Care? Methods of Information in Medicine. https://doi.org/10.1055/s-0041-1731784
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.