Deep EHR: A Survey of Recent Advances in Deep Learning Techniques for Electronic Health Record (EHR) Analysis
Open accessThe DOI matches its Crossref record; 64 of the 64 references it cites were found in a registry or an index.
Abstract
The past decade has seen an explosion in the amount of digital information stored in electronic health records (EHRs). While primarily designed for archiving patient information and performing administrative healthcare tasks like billing, many researchers have found secondary use of these records for various clinical informatics applications. Over the same period, the machine learning community has seen widespread advances in the field of deep learning. In this review, we survey the current research on applying deep learning to clinical tasks based on EHR data, where we find a variety of deep learning techniques and frameworks being applied to several types of clinical applications including information extraction, representation learning, outcome prediction, phenotyping, and deidentification. We identify several limitations of current research involving topics such as model interpretability, data heterogeneity, and lack of universal benchmarks. We conclude by summarizing the state of the field and identifying avenues of future deep EHR research.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Since DL is based on the idea of the data representation, such techniques can automatically generate optimal features, starting from the raw input data, without any human intervention, making it possible to identify the unknown patterns that otherwise would remain hidden or unknown [44].”
From Human Activity Recognition Using Inertial, Physiological and Environmental Sensors: A Comprehensive Survey (2020) · cites this paper as [44]
The cited source says what the claim attributes to it.
In the citing paper
“Gated RNNs have shown advantages in modeling sequential dependencies in long-term time-series [44].”
From Human Activity Recognition Using Inertial, Physiological and Environmental Sensors: A Comprehensive Survey (2020) · cites this paper as [44]
In the citing paper
“The use of AI-based approaches to learn health data has been adopted widely in smart healthcare, such as the use of intelligent imaging to detect disease [63].”
From A comprehensive survey on federated learning techniques for healthcare informatics (2023) · cites this paper as [63]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(2008) · Journal of Machine Learning Research · Cited by 33,051
Efficient Estimation of Word Representations in Vector Space
Mikolov, T., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1301.3781 · Cited by 26,568 · cited 4×
“One such technique is called word embedding , including the skip-gram model popularized by Mikolov et al. in their word2vec implementation [36].”
MethodInfluential(2012) · Cited by 9,062
MIMIC-III, a freely accessible critical care database
Johnson, A. E. W., Pollard, T. J., Shen, L., Lehman, L.-W. H., Feng, M., Ghassemi, M., Moody, B., Szolovits, P., Anthony Celi, L., & Mark, R. G. (2016) · Scientific Data · doi:10.1038/sdata.2016.35 · Cited by 8,141
Extracting and composing robust features with denoising autoencoders
Vincent, P., Larochelle, H., Bengio, Y., & Manzagol, P.-A. (2008) · Proceedings of the 25th international conference on Machine learning - ICML '08 · doi:10.1145/1390156.1390294 · Cited by 7,436
Deep learning in medical image analysis
Shen, D., Wu, G., & Suk, H.-I. (2017) · Annual Review of Biomedical Engineering · doi:10.1146/annurev-bioeng-071516-044442 · Cited by 4,968
A few useful things to know about machine learning
Domingos, P. (2012) · Communications of the ACM · doi:10.1145/2347736.2347755 · Cited by 3,326 · cited 1×
“a “black art” [29] requiring creativity, trial-and-error, and oftentimes luck.”
BackgroundRecurrent Neural Networks for Multivariate Time Series with Missing Values
Che, Z., Purushotham, S., Cho, K., Sontag, D., & Liu, Y. (2018) · Scientific Reports · doi:10.1038/s41598-018-24271-9 · Cited by 2,370
Deep Learning for Health Informatics
Ravì, D., Wong, C., Deligianni, F., Berthelot, M., Andreu-Perez, J., Lo, B., & Yang, G.-Z. (2017) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2016.2636665 · Cited by 2,000
Miotto, R., Li, L., Kidd, B. A., & Dudley, J. T. (2016) · Scientific Reports · doi:10.1038/srep26094 · Cited by 1,710
Mining electronic health records: towards better research applications and clinical care
Jensen, P. B., Jensen, L. J., & Brunak, S. (2012) · Nature Reviews Genetics · doi:10.1038/nrg3208 · Cited by 1,680
Deep learning for computational biology
Angermueller, C., Pärnamaa, T., Parts, L., & Stegle, O. (2016) · Molecular Systems Biology · doi:10.15252/msb.20156651 · Cited by 1,473 · cited 1×
“While other biomedical data such as medical images or genomic information exist and are covered in recent relevant articles [25], [27], [28], in this”
BackgroundUsing recurrent neural network models for early detection of heart failure onset
Choi, E., Schuetz, A., Stewart, W. F., & Sun, J. (2017) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocw112 · Cited by 928 · cited 1×
“[43], [45] [38], [44], [54] [52], [53], [60], [61] [13], [14]”
Savova, G. K., Kipper-Schuler, K. C., Hurdle, J. F., & Meystre, S. M. (2008) · Yearbook of Medical Informatics · doi:10.1055/s-0038-1638592 · Cited by 895 · cited 1×
“In particular, the patient data contained in EHR systems has been used for such tasks as medical concept extraction [7], [8], patient trajectory modeling [9], disease inference [10], [11], clinical decision support systems [12], and more (Table I).”
MethodLearning to Diagnose with LSTM Recurrent Neural Networks
Lipton, Z. C., Kale, D. C., Elkan, C., & Wetzel, R. (2015) · arXiv · doi:10.48550/arxiv.1511.03677 · Cited by 879
Medication-related clinical decision support in computerized provider order entry systems: a review
Kuperman, G. J., Bobb, A., Payne, T. H., Avery, A. J., Gandhi, T. K., Burns, G., Classen, D. C., & Bates, D. W. (2007) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m2170 · Cited by 763 · cited 1×
“In particular, the patient data contained in EHR systems has been used for such tasks as medical concept extraction [7], [8], patient trajectory modeling [9], disease inference [10], [11], clinical decision support systems [12], and more (Table I).”
Method(2016) · PubMed · Cited by 576
Multi-layer Representation Learning for Medical Concepts
Choi, E., Bahadori, M. T., Searles, E., Coffey, C., Thompson, M., Bost, J., Tejedor-Sojo, J., & Sun, J. (2016) · Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2939672.2939823 · Cited by 469 · cited 1×
“DeepPatient Multi-outcome Prediction Miotto [15] Deepr Hospital Re-admission Prediction Nguyen [20] DeepCare EHR Concept Representation Pham [21] Doctor AI Heart Failure Prediction Choi [22] Med2Vec EHR Concept Representation Choi [23] eNRBM Suicide risk stratification Tran [24]”
MethodDeep Learning-Based Feature Representation for AD/MCI Classification
Suk, H.-I., & Shen, D. (2013) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-40763-5_72 · Cited by 439
Risk Prediction with Electronic Health Records: A Deep Learning Approach
Cheng, Y., Wang, F., Zhang, P., & Hu, J. (2016) · Proceedings of the 2016 SIAM International Conference on Data Mining · doi:10.1137/1.9781611974348.49 · Cited by 380
De-identification of patient notes with recurrent neural networks
Dernoncourt, F., Lee, J. Y., Uzuner, O., & Szolovits, P. (2017) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocw156 · Cited by 378
Minimizing Computation in Convolutional Neural Networks
Cong, J., & Xiao, B. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-11179-7_36 · Cited by 372
$\mathtt {Deepr}$: A Convolutional Net for Medical Records
Nguyen, P., Tran, T., Wickramasinghe, N., & Venkatesh, S. (2017) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2016.2633963 · Cited by 352
Uses of Electronic Health Records for Public Health Surveillance to Advance Public Health
Birkhead, G. S., Klompas, M., & Shah, N. R. (2015) · Annual Review of Public Health · doi:10.1146/annurev-publhealth-031914-122747 · Cited by 345 · cited 2×
“encounter, including demographic information, diagnoses, laboratory tests and results, prescriptions, radiological images, clinical notes, and more [1].”
BackgroundAustin, P. C., Tu, J. V., Ho, J. E., Levy, D., & Lee, D. S. (2013) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2012.11.008 · Cited by 338
Secondary Use of EHR: Data Quality Issues and Informatics Opportunities.
(2010) · PubMed Central · Cited by 332
Interpretable Deep Models for ICU Outcome Prediction.
Che, Z., Purushotham, S., Khemani, R. G., & Liu, Y. (2016) · PubMed · Cited by 332
Bidirectional RNN for Medical Event Detection in Electronic Health Records
Jagannatha, A. N., & Yu, H. (2016) · Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.18653/v1/n16-1056 · Cited by 314
Lasko, T. A., Denny, J. C., & Levy, M. A. (2013) · PLoS ONE · doi:10.1371/journal.pone.0066341 · Cited by 313
Jiang, M., Chen, Y., Liu, M., Rosenbloom, S. T., Mani, S., Denny, J. C., & Xu, H. (2011) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2011-000163 · Cited by 291
DeepCare: A Deep Dynamic Memory Model for Predictive Medicine
Pham, T., Tran, T., Phung, D., & Venkatesh, S. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-31750-2_3 · Cited by 269
Learning Low-Dimensional Representations of Medical Concepts.
Choi, Y., Chiu, C. Y.-I., & Sontag, D. A. (2016) · PubMed Central · Cited by 258
Doctor AI: Predicting Clinical Events via Recurrent Neural Networks
Choi, E., Bahadori, M. T., Schuetz, A., Stewart, W. F., & Sun, J. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1511.05942 · Cited by 244
Deep Computational Phenotyping
Che, Z., Kale, D., Li, W., Bahadori, M. T., & Liu, Y. (2015) · Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2783258.2783365 · Cited by 239
Incremental knowledge base construction using DeepDive
Shin, J., Wu, S., Wang, F., De Sa, C., Zhang, C., & Ré, C. (2015) · Proceedings of the VLDB Endowment · doi:10.14778/2809974.2809991 · Cited by 232
Recurrent Neural Networks for Multivariate Time Series with Missing ValuesPreprint
Che, Z., Purushotham, S., Cho, K., et al. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1606.01865 · Cited by 230
Structured prediction models for RNN based sequence labeling in clinical text
Jagannatha, A., & yu, H. (2016) · Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d16-1082 · Cited by 215
Disease inference from health-related questions via sparse deep learning
Nie, L., Wang, M., Zhang, L., Yan, S., Zhang, B., & Chua, T.-S. (2015) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2015.2399298 · Cited by 195
Deep learning for healthcare decision making with EMRs
Liang, Z., Zhang, G., Huang, J. X., & Hu, Q. V. (2014) · 2014 IEEE International Conference on Bioinformatics and Biomedicine (BIBM) · doi:10.1109/bibm.2014.6999219 · Cited by 174
Tran, T., Nguyen, T. D., Phung, D., & Venkatesh, S. (2015) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2015.01.012 · Cited by 172
Semi-supervised learning of the electronic health record for phenotype stratification
Beaulieu-Jones, B. K., & Greene, C. S. (2016) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2016.10.007 · Cited by 171
Esteban, C., Staeck, O., Baier, S., Yang, Y., & Tresp, V. (2016) · 2016 IEEE International Conference on Healthcare Informatics (ICHI) · doi:10.1109/ichi.2016.16 · Cited by 154
Named Entity Recognition in Chinese Clinical Text Using Deep Neural Network
Yonghui, W., Min, J., Jianbo, L., & Hua, X. (2015) · Studies in Health Technology and Informatics · doi:10.3233/978-1-61499-564-7-624 · Cited by 143
Zhao, D., & Weng, C. (2011) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2011.05.004 · Cited by 135
Hsiao, C., & Hing, E. (2012) · PubMed · Cited by 135
Choi, E., Schuetz, A., Stewart, W. F., & Sun, J. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1602.03686 · Cited by 109
Distilling Knowledge from Deep Networks with Applications to Healthcare Domain
Che, Z., Purushotham, S., Khemani, R. G., & Liu, Y. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1512.03542 · Cited by 105
Clinical Relation Extraction with Deep Learning
Lv, X., Guan, Y., Yang, J., & Wu, J. (2016) · International Journal of Hybrid Information Technology · doi:10.14257/ijhit.2016.9.7.22 · Cited by 83
Ebadollahi, S., Sun, J., Gotz, D., Hu, J., Sow, D., & Neti, C. (2010) · PubMed Central · Cited by 75
DeepCare: A Deep Dynamic Memory Model for Predictive Medicine
Pham, T., Tran, T., Phung, D., & Venkatesh, S. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1602.00357 · Cited by 74
Incremental knowledge base construction using DeepDive
De, C., Ratner, A., Ré, C., Shin, J., Wang, F., Wu, S., & Zhang, C. (2016) · The VLDB Journal · doi:10.1007/s00778-016-0437-2 · Cited by 61
Fries, J. (2016) · International Workshop on Semantic Evaluation (SemEval) · doi:10.18653/v1/s16-1198 · Cited by 49
Jacobson, O., & Dalianis, H. (2016) · Workshop on Biomedical Language Processing (BioNLP) · doi:10.18653/v1/w16-2926 · Cited by 47
Temporal Pattern and Association Discovery of Diagnosis Codes Using Deep Learning
Mehrabi, S., Sohn, S., Li, D., Pankratz, J. J., Therneau, T., St. Sauver, J. L., Liu, H., & Palakal, M. (2015) · 2015 International Conference on Healthcare Informatics · doi:10.1109/ichi.2015.58 · Cited by 46
Knake, L. A., Ahuja, M., McDonald, E. L., Ryckman, K. K., Weathers, N., Burstain, T., Dagle, J. M., Murray, J. C., & Nadkarni, P. (2016) · BMC Pediatrics · doi:10.1186/s12887-016-0592-z · Cited by 45
Deep neural network architectures for forecasting analgesic response
Nickerson, P., Tighe, P. J., Shickel, B., & Rashidi, P. (2016) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc.2016.7591352 · Cited by 41
Self-citationMusical Audio Synthesis Using Autoencoding Neural Nets
Sarroff, A. M., & Casey, M. A. (2014) · Goldsmiths (University of London) · doi:10.5281/zenodo.850877 · Cited by 40
Li, H., Li, X., Ramanathan, M. K., & Zhang, A. (2014) · Methods · doi:10.1016/j.ymeth.2014.06.011 · Cited by 39
Deep Learning Architecture for Patient Data De-identification in Clinical Records.
Yadav, S., Ekbal, A., Saha, S., & Bhattacharyya, P. (2016) · Cited by 30
Exploiting Task-Oriented Resources to Learn Word Embeddings for Clinical Abbreviation Expansion
Liu, Y., Ge, T., Mathews, K., Ji, H., & McGuinness, D. (2015) · Proceedings of BioNLP 15 · doi:10.18653/v1/w15-3810 · Cited by 17
Bidirectional Recurrent Neural Networks for Medical Event Detection in Electronic Health RecordsPreprint
Jagannatha, A., & Yu, H. Q. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1606.07953 · Cited by 14
De-identification in natural language processing
Vincze, V., & Farkas, R. (2014) · International Convention on Information and Communication Technology, Electronics and Microelectronics · doi:10.1109/mipro.2014.6859768 · Cited by 13
Multi-layer Representation Learning for Medical ConceptsPreprint
Choi, E., Bahadori, M. T., Searles, E., et al. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1602.05568 · Cited by 10
A Short Review of Ethical Challenges in Clinical Natural Language Processing
Suster, S., Tulkens, S., & Daelemans, W. (2017) · Proceedings of the First ACL Workshop on Ethics in Natural Language Processing · doi:10.18653/v1/w17-1610 · Cited by 6
Research works printed but not linked: 3
- che, 0, Distilling knowledge from deep networks with applications to computational phenotyping, Proc Workshop Data Sci Learn Appl Biomed Health Sci, 1
- 2016, Adoption of Electronic Health Record Systems Among U.S. Non-Federal Acute Care Hospitals: 2008–2015, Oce of the National Coordinator for Health Information Technology
- goodfellow, 2016, Deep Learning
Cited by
A guide to deep learning in healthcare
Esteva, A., Robicquet, A., Ramsundar, B., Kuleshov, V., DePristo, M., Chou, K., Cui, C., Corrado, G., Thrun, S., & Dean, J. (2019) · Nature Medicine · doi:10.1038/s41591-018-0316-z · Cited by 5,312
“The next generation of automatic speech recognition 32 and information extraction models will likely develop clinical voice assistants to accurately transcribe patient visits.”
BackgroundMethodScalable and accurate deep learning with electronic health records
Rajkomar, A., Oren, E., Chen, K., Dai, A. M., Hajaj, N., Hardt, M., Liu, P. J., Liu, X., Marcus, J., Sun, M., et al. (2018) · npj Digital Medicine · doi:10.1038/s41746-018-0029-1 · Cited by 2,648
“Given rapid developments in this field, we point readers to a recent, comprehensive review [88].”
BackgroundAn overview of deep learning in medical imaging focusing on MRI
Lundervold, A. S., & Lundervold, A. (2019) · Zeitschrift für Medizinische Physik · doi:10.1016/j.zemedi.2018.11.002 · Cited by 2,058
Federated Learning for Internet of Things: A Comprehensive Survey
Nguyen, D. C., Ding, M., Pathirana, P. N., Seneviratne, A., Li, J., & Vincent Poor, H. (2021) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2021.3075439 · Cited by 1,503
“, intelligent imaging for disease detection [107].”
The ethics of AI in health care: A mapping review
Morley, J., Machado, C. C. V., Burr, C., Cowls, J., Joshi, I., Taddeo, M., & Floridi, L. (2020) · Social Science & Medicine · doi:10.1016/j.socscimed.2020.113172 · Cited by 1,105
Metadata
- Authors
- Shickel, B., Tighe, P. J., Bihorac, A., & Rashidi, P.
- Affiliations
- University of Florida (US)
- University of Florida Health (US)
- Venue
- IEEE Journal of Biomedical and Health Informatics
- Published
- 2018-09
- Volume
- 22
- Issue
- 5
- Pages
- 1589-1604
- ISSN
- 2168-2194 (ISSN-L)
- 2168-2208
- PMC
- PMC6043423
- OpenAlex
- W2625625371
- Cited by
- 1,688
- References
- 64
- Citations by year
- 2026: 277 · 2025: 276 · 2024: 206 · 2023: 194 · 2022: 153 · 2021: 199 · 2020: 181 · 2019: 150 · 2018: 52
- FWCI
- 15.22
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- IEEE Journal of Biomedical and Health Informatics (publishedVersion)
- PubMed (publishedVersion)
- Europe PMC (PubMed Central) (acceptedVersion)
- PubMed Central (acceptedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- Division of Industrial Innovation and Partnerships (1631871)
- National Institute of General Medical Sciences (1R01GM114290, R01GM-110240)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning in Healthcare
- Health Sciences › Health Professions › Health Information Management › Electronic Health Records Systems
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Keywords
- electronic health records, deep learning, clinical natural language processing, clinical information extraction, representation learning, outcome prediction, phenotyping, de-identification, model interpretability, data heterogeneity, clinical benchmarking
- MeSH terms
- Deep Learning, Humans, Electronic Health Records
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.