Next-generation phenotyping of electronic health records
Open accessAbstract
The national adoption of electronic health records (EHR) promises to make an unprecedented amount of data available for clinical research, but the data are complex, inaccurate, and frequently missing, and the record reflects complex processes aside from the patient's physiological state. We believe that the path forward requires studying the EHR as an object of interest in itself, and that new models, learning from data, and collaboration will lead to efficient use of the valuable information currently locked in health records.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
CONCERN EWS's methodological choices, including robust modeling of temporal data patterns and use of nursing assessment and observational data, allowed it to have accurate and robust predictive power and sufficient lead time to alter a patient's clinical trajectory.
“Several methodological choices allowed CONCERN EWS to have accurate and robust predictive power and sufficient lead time to alter a patient’s clinical trajectory as we observed in this trial, including: (1) robust modeling of temporal data patterns40–42 (for example, time of day, day of week and patient hospital day) for health care processes (for example, nurses’ surveillance and medication”
From Real-time surveillance system for patient deterioration: a pragmatic cluster-randomized controlled trial (2025) · cites this paper as [40]
Split into 2 atoms — 1 confirmed, 1 partially supported, 0 disputed, 0 misattributed, 0 unverifiable. Expand the claim to see per-atom verdicts.
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Mining electronic health records: towards better research applications and clinical care
Jensen, P. B., Jensen, L. J., & Brunak, S. (2012) · Nature Reviews Genetics · doi:10.1038/nrg3208 · Cited by 1,680 · see citing works
Weiskopf, N. G., & Weng, C. (2013) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2011-000681 · Cited by 1,216 · cited 1× · see citing works
“CHALLENGES Unfortunately, the EHR carries many challenges.(2)”
Flagged first, then by citations
Research works printed but not linked: 49
- [1]Blumenthal D Tavenner M The “meaningful use” regulation for electronic health records. N Engl J Med 2010; 363: 501– 4 20647183
- [3]Heitjan DF Basu S Distinguishing “missing at random” and “missing completely at random”. Am Statistician 1996; 50: 207– 13
- [4]Hogan WR Wagner MM Accuracy of data in computer-based patient records. J Am Med Inform Assoc 1997; 4: 342– 55 9292840 PMC61252
- [5]Sagreiya H Altman RB The utility of general purpose versus specialty clinical databases for research: warfarin dose estimation from extracted clinical variables. J Biomed Inform 2010; 43: 747– 51 20363365 PMC2928873
- [6]Tao C Parker CG Oniki TA An OWL meta-ontology for representing the clinical element model. AMIA Annu Symp Proc 2011; 1372– 81 22195200 PMC3243162
- [7]Pryor TA Hripcsak G Sharing MLM's: an experiment between Columbia-Presbyterian and LDS Hospital. Proc Annu Symp Comput Appl Med Care 1993: 399– 403 8130503 PMC2248539
- [8]Hripcsak G Kuperman GJ Friedman C Extracting findings from narrative reports: software transferability and sources of physician disagreement. Methods Inf Med 1998; 37: 1– 7 9550840
- [9]Friedman C Hripcsak G Natural language processing and its future in medicine. Acad Med 1999; 74: 890– 5 10495728
- [10]Hripcsak G Zhou L Parsons S Modeling electronic discharge summaries as a simple temporal constraint satisfaction problem. J Am Med Inform Assoc 2005; 12: 55– 63 15492038 PMC543827
- [11]Hripcsak G Knirsch C Zhou L Bias associated with mining electronic health records. J Biomed Discov Collab 2011; 6: 48– 52 21647858 PMC3149555
- [12]Fine MJ Auble TE Yealy DM A prediction rule to identify low-risk patients with community-acquired pneumonia. N Engl J Med 1997; 336: 243– 50 8995086
- [13]Boustani MA Munger S Gulati R Selecting a change and evaluating its impact on the performance of a complex adaptive health care delivery system. Clin Interv Aging 2010; 5: 141– 8 20517483 PMC2877524
- [14]Kurreeman F Liao K Chibnik L Genetic basis of autoantibody positive and negative rheumatoid arthritis risk in a multi-ethnic cohort derived from electronic health records. Am J Hum Genet 2011; 88: 57– 69 21211616 PMC3014362
- [15]Brownstein JS Murphy SN Goldfine AB Rapid identification of myocardial infarction risk associated with diabetes medications using electronic medical records. Diabetes Care 2010; 33: 526– 31 20009093 PMC2827502
- [16]Denny JC Ritchie MD Crawford DC Identification of genomic predictors of atrioventricular conduction: using electronic medical records as a tool for genome science. Circulation 2010; 122: 2016– 21 21041692 PMC2991609
- [17]Chen DP Morgan AA Butte AJ Validating pathophysiological models of aging using clinical electronic medical records. J Biomed Inform 2010; 43: 358– 64 19958842 PMC2878870
- [18]Kullo IJ Fan J Pathak J Leveraging informatics for genetic studies: use of the electronic medical record to enable a genome-wide association study of peripheral arterial disease. J Am Med Inform Assoc 2010; 17: 568– 74 20819866 PMC2995686
- [19]Hripcsak G Austin JHM Alderson PO Use of natural language processing to translate clinical information from a database of 889,921 chest radiographic reports. Radiology 2002; 224: 157– 63 12091676
- [20]Wilcox AB Hripcsak G The role of domain knowledge in automating medical text report classification. J Am Med Inform Assoc 2003; 10: 330– 8 12668687 PMC181983
- [21]McCarty CA Chisholm RL Chute CG; eMERGE Team The eMERGE Network: a consortium of biorepositories linked to electronic medical records data for conducting genomic studies. BMC Med Genomics 2011; 4: 13 21269473 PMC3038887
- [22]Conway M Berg RL Carrell D Analyzing the heterogeneity and complexity of Electronic Health Record oriented phenotyping algorithms. AMIA Annu Symp Proc 2011; 2011: 274– 83 22195079 PMC3243189
- [23]Kho AN Pacheco JA Peissig PL Electronic medical records for genetic research: results of the eMERGE consortium. Sci Transl Med 2011; 3: 79re1 PMC3690272 21508311
- [24]Warner HR Knowledge sectors for logical processing of patient data in the HELP system. Proceedings of the International Conference on Interactive Techniques in Computer-Aided Design; Bologna, Italy New York: IEEE, 1978: 401– 4
- [25]Scott P Worden R Semantic mapping to simplify deployment of HL7 v3 Clinical Document Architecture. J Biomed Inform 2012; 45: 697 702 22465786
- [26]Heymans S McKennirey M Phillips J Semantic validation of the use of SNOMED CT in HL7 clinical documents. J Biomed Semantics 2011; 2: 2 21762489 PMC3152505
- [27]Tao C Parker CG Oniki TA An OWL meta-ontology for representing the clinical element model. AMIA Annu Symp Proc 2011; 2011: 1372– 81 22195200 PMC3243162
- [29]Pearson K On lines and planes of closest fit to systems of points in space. Phil Mag 1901; 2: 559– 72
- [30]Weare BC Navato AR Newell RE Empirical orthogonal analysis of Pacific sea surface temperatures. J Phys Oceanography 1976; 6: 671– 9
- [31]Blei DM Ng AY Jordan MI Latent dirichlet allocation. J Mach Learn Res 2003; 3: 993– 1022
- [32]Perotte A Bartlett N Elhadad N Hierarchically supervised Latent Dirichlet Allocation. Twenty-Fifth Annual Conference onNeural Information Processing Systems; 12–15 December, 2011, Granada, Spain, 2011: 2609– 17
- [33]Tatonetti NP Denny JC Murphy SN Detecting drug interactions from adverse-event reports: interaction between paroxetine and pravastatin increases blood glucose levels. Clin Pharmacol Ther 2011; 90: 133– 42. 10.1038/clpt.2011.83 21613990 PMC3216673 · DOI
- [34]Melton GB Parsons S Morrison FP Inter-patient distance metrics using SNOMED CT defining relationships. J Biomed Inform 2006; 39: 697– 705 16554186
- [35]Hripcsak G Knirsch C Zhou L Using discordance to improve classification in narrative clinical databases: an application to community-acquired pneumonia. Comput Biol Med 2007; 37: 296– 304 16620802
- [36]Altiparmak F Ferhatosmanoglu H Erdal S Information mining over heterogeneous and high-dimensional time-series data in clinical trials databases. IEEE Trans Inf Technol Biomed 2006; 10: 254– 63 16617614
- [37]Nadkarni PM Ohno-Machado L Chapman WW Natural language processing: an introduction. J Am Med Inform Assoc 2011; 18: 544– 51 21846786 PMC3168328
- [38]Shahar Y Tu SW Musen MA Temporal-abstraction mechanisms in management of clinical protocols. Proc Annu Symp Comput Appl Med Care 1991; 629– 33 1807678 PMC2247607
- [39]Kahn MG Fagan LM Tu S Extensions to the time-oriented database model to support temporal reasoning in medical expert systems. Methods Inf Med 1991; 30: 4– 14 2005832
- [40]Sacchi L Larizza C Combi C Data mining with temporal sbstractions: learning rules from time series. Data Mining and Knowledge Discov 2007; 15: 217– 47
- [41]Moskovitch R Shahar Y Medical temporal-knowledge discovery via temporal abstraction. AMIA Annu Symp Proc 2009: 452– 6 20351898 PMC2815492
- [42]Zhou L Hripcsak G Temporal reasoning with medical data – a review with emphasis on medical natural language processing. J Biomed Inform 2007; 40: 183– 202 17317332 PMC7357407
- [43]Komalapriya C Thiel M Ramano MC Reconstruction of a system's dynamics from short trajectories. Phys Rev E 2008; 78: 066217 19256935
- [44]Albers DJ Hripcsak G A statistical dynamics approach to the study of human health data: resolving population scale diurnal variation in laboratory data. Physics Letters A 2010; 374: 1159– 64 20544004 PMC2882798
- [45]Lin JH Haug PJ Exploiting missing clinical data in Bayesian network modeling for predicting medical problems. J Biomed Inform 2008; 41: 1– 14 17625974
- [46]Hripcsak G Albers DJ Perotte A Exploiting time in electronic health record correlations. J Am Med Inform Assoc 2011; 18: i109– i115 22116643 PMC3241180
- [48]van Gerven M Taal B Lucas P Dynamic Bayesian networks as prognostic models for clinical patient management. J Biomed Inform 2008; 41: 515– 29 18337188
- [49]Granger CW Investigating causal relations by econometric models and cross-spectral methods. Econometrica 1969; 37: 424– 38
- [50]Kleinberg S Mishra B The temporal logic of causal structures. In: Proceedings of the 25th Conference on Uncertainty in Artificial Intelligence (UAI). 18-21 June 2009; Montreal, QC, Canada. Corvallis, Oregon: AUAI Press, 2009:303–12
- [51]Tatonetti NP Ye PP Daneshjou R Data-driven prediction of drug effects and interactions. Sci Transl Med 2012; 4: 125ra31 PMC3382018 22422992
- [53]Jensen PB Jensen LJ Brunak S Mining electronic health records: towards better research applications and clinical care. Nat Rev Genet 2012 Published Online First 2 May 2012. doi: 10.1038/nrg3208 22549152 · DOI · Paper page
Cited by
Sorted by citations
Deep learning for healthcare: review, opportunities and challenges
Miotto, R., Wang, F., Wang, S., Jiang, X., & Dudley, J. T. (2018) · Briefings in Bioinformatics · doi:10.1093/bib/bbx044 · Cited by 3,076 · see citing works
Hersh, W. R., Weiner, M. G., Embi, P. J., Logan, J. R., Payne, P. R. O., Bernstam, E. V., Lehmann, H. P., Hripcsak, G., Hartzog, T. H., Cimino, J. J., et al. (2013) · Medical Care · doi:10.1097/mlr.0b013e31829b1dbd · Cited by 567 · see citing works
Self-citationAgniel, D., Kohane, I. S., & Weber, G. M. (2018) · BMJ · doi:10.1136/bmj.k1479 · Cited by 391 · see citing works
Mining Electronic Health Records (EHRs): A Survey
Yadav, P., Steinbach, M., Kumar, V., & Simon, G. (2018) · ACM Computing Surveys · doi:10.1145/3127881 · Cited by 299 · see citing works
Electronic health records-driven phenotyping: challenges, recent advances, and perspectives
Pathak, J., Kho, A. N., & Denny, J. C. (2013) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2013-002428 · Cited by 274 · see citing works
Wei, W.-Q., Teixeira, P. L., Mo, H., Cronin, R. M., Warner, J. L., & Denny, J. C. (2016) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocv130 · Cited by 230 · see citing works
Clinical Data Reuse or Secondary Use: Current Status and Potential Future Progress
Meystre, S. M., Lovis, C., Bürkle, T., Tognola, G., Budrionis, A., & Lehmann, C. U. (2017) · Yearbook of Medical Informatics · doi:10.15265/iy-2017-007 · Cited by 204 · see citing works
Tran, T., Nguyen, T. D., Phung, D., & Venkatesh, S. (2015) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2015.01.012 · Cited by 172 · see citing works
Oakden-Rayner, L., Carneiro, G., Bessen, T., Nascimento, J. C., Bradley, A. P., & Palmer, L. J. (2017) · Scientific Reports · doi:10.1038/s41598-017-01931-w · Cited by 154 · see citing works
<p>The role of medical data in efficient patient care delivery: a review</p>
Adane, K., Gizachew, M., & Kendie, S. (2019) · Risk Management and Healthcare Policy · doi:10.2147/rmhp.s179259 · Cited by 120 · see citing works
Development and evaluation of an ensemble resource linking medications to their indications
Wei, W.-Q., Cronin, R. M., Xu, H., Lasko, T. A., Bastarache, L., & Denny, J. C. (2013) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2012-001431 · Cited by 106 · see citing works
Identifying and mitigating biases in EHR laboratory tests
Pivovarov, R., Albers, D. J., Sepulveda, J. L., & Elhadad, N. (2014) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2014.03.016 · Cited by 91 · see citing works
Self-citationRedundancy-Aware Topic Modeling for Patient Record Notes
Cohen, R., Aviram, I., Elhadad, M., & Elhadad, N. (2014) · PLoS ONE · doi:10.1371/journal.pone.0087555 · Cited by 71 · see citing works
“This research contributes primarily to the emerging field of understanding the characteristics of patient records, their impact on mining techniques, and how to correct for them [27].”
BackgroundRossetti, S. C., Dykes, P. C., Knaplund, C., Cho, S., Withall, J., Lowenthal, G., Albers, D., Lee, R. Y., Jia, H., Bakken, S., et al. (2025) · Nature Medicine · doi:10.1038/s41591-025-03609-7 · Cited by 54 · see citing works
“…sufficient lead time to alter a patient’s clinical trajectory as we observed in this trial, including: (1) robust modeling of temporal data patterns 40–42 (for example, time of day, day of week and patient hospital day) for health care processes (for example, nurses’ surveillance and medication…”
Self-citationDistributed learning from multiple EHR databases: Contextual embedding models for medical events
Li, Z., Roberts, K., Jiang, X., & Long, Q. (2019) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2019.103138 · Cited by 44 · see citing works
Rossetti, S. C., Knaplund, C., Albers, D., Dykes, P. C., Kang, M. J., Korach, T. Z., Zhou, L., Schnock, K., Garcia, J., Schwartz, J., et al. (2021) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocab006 · Cited by 42 · see citing works
Self-citationCroux, C., Nguyen, N.-P.-T., Lee, J., Raynaud, C., Saint-Prix, F., Gonzalez-Pajuelo, M., Meynial-Salles, I., & Soucaille, P. (2016) · Biotechnology for Biofuels · doi:10.1186/s13068-016-0432-2 · Cited by 41 · see citing works
Predicting next-day discharge via electronic health record access logs
Zhang, X., Yan, C., Malin, B. A., Patel, M. B., & Chen, Y. (2021) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocab211 · Cited by 38 · see citing works
Zhou, Y., Shi, J., Stein, R., Liu, X., Baldassano, R. N., Forrest, C. B., Chen, Y., & Huang, J. (2023) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocad066 · Cited by 33 · see citing works
Yin, K., Qian, D., Cheung, W. K., Fung, B. C. M., & Poon, J. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33011246 · Cited by 19 · see citing works
Walters, C. E., Nitin, R., Margulis, K., Boorom, O., Gustavson, D. E., Bush, C. T., Davis, L. K., Below, J. E., Cox, N. J., Camarata, S. M., et al. (2020) · Journal of Speech, Language, and Hearing Research · doi:10.1044/2020_jslhr-19-00397 · Cited by 18 · see citing works
Alderson, P. O., Donlin, M. J., & Morrison, L. A. (2021) · doi:10.1101/2021.05.13.21255493 · Cited by 3 · see citing works
- Authors
- Hripcsak, G., & Albers, D. J.
- Affiliations
- Columbia University (US)
- Corresponding author
- Hripcsak, G.
- Venue
- Journal of the American Medical Informatics Association
- Publisher
- Oxford University Press (OUP)
- Published
- 2013-01-01
- Volume
- 20
- Issue
- 1
- Pages
- 117-121
- ISSN
- 1067-5027 (ISSN-L)
- 1527-974X
- PMC
- PMC3555337
- OpenAlex
- W2121382432
- Cited by
- 795
- References
- 2
- Citations by year
- 2026: 73 · 2025: 48 · 2024: 54 · 2023: 55 · 2022: 53 · 2021: 73 · 2020: 59 · 2019: 78 · 2018: 63 · 2017: 62 · 2016: 55 · 2015: 51 · 2014: 42 · 2013: 26 · 2012: 2
- FWCI
- 38.11
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by-nc
- Locations
- Journal of the American Medical Informatics Association (publishedVersion, cc-by-nc)
- Europe PMC (PubMed Central) (publishedVersion, cc-by-nc)
- PubMed Central (publishedVersion, cc-by-nc)
- PubMed (publishedVersion)
- Funders
- U.S. National Library of Medicine (LM006910, R01LM006910)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning in Healthcare
- Health Sciences › Health Professions › Health Information Management › Electronic Health Records Systems
- Health Sciences › Health Professions › Health Information Management › Medical Coding and Health Information
- Keywords
- electronic health records, phenotyping, clinical research data, data quality, missing data, data model, learning from data, health data utilization
- MeSH terms
- Diffusion of Innovation, Humans, Models, Theoretical, Quality Control, United States, Biomedical Research, Data Mining, Electronic Health Records
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review