Opportunities and challenges in developing risk prediction models with electronic health records data: a systematic review
Open accessThe DOI matches its Crossref record; 141 of the 144 references it cites were found in a registry or an index.
Abstract
Objective: Electronic health records (EHRs) are an increasingly common data source for clinical risk prediction, presenting both unique analytic opportunities and challenges. We sought to evaluate the current state of EHR based risk prediction modeling through a systematic review of clinical prediction studies using EHR data. Methods: We searched PubMed for articles that reported on the use of an EHR to develop a risk prediction model from 2009 to 2014. Articles were extracted by two reviewers, and we abstracted information on study design, use of EHR data, model building, and performance from each publication and supplementary documentation. Results: We identified 107 articles from 15 different countries. Studies were generally very large (median sample size = 26 100) and utilized a diverse array of predictors. Most used validation techniques (n = 94 of 107) and reported model coefficients for reproducibility (n = 83). However, studies did not fully leverage the breadth of EHR data, as they uncommonly used longitudinal information (n = 37) and employed relatively few predictor variables (median = 27 variables). Less than half of the studies were multicenter (n = 50) and only 26 performed validation across sites. Many studies did not fully address biases of EHR data such as missing data or loss to follow-up. Average c-statistics for different outcomes were: mortality (0.84), clinical prediction (0.83), hospitalization (0.71), and service utilization (0.71). Conclusions: EHR data present both opportunities and challenges for clinical risk prediction. There is room for improvement in designing such studies.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“In spite of the richness and potential of available data, scaling the development of predictive models is difficult because, for traditional predictive modeling techniques, each outcome to be predicted requires the creation of a custom dataset with specific variables.7”
From Scalable and accurate deep learning with electronic health records (2018) · cites this paper as [7]
In the citing paper
“Despite the rich data now digitized in EHRs,20 a recent systematic review of the medical literature7 found that predictive models built with EHR data use a median of only 27 variables, rely on traditional generalized linear models, and are built using data at a single center.”
From Scalable and accurate deep learning with electronic health records (2018) · cites this paper as [7]
In the citing paper
“Although external validation is recognized as an area of improvement for clinical risk prediction models [85]”
Citations
Cites
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000100 · Cited by 28,164
Self-citationDermyshi, E., Wang, Y., Yan, C., Hong, W., Qiu, G., Gong, X., & Zhang, T. (2017) · Neonatology · doi:10.1159/000454668 · Cited by 24,451
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2009.06.006 · Cited by 10,578
Self-citationPrediction of coronary heart disease using risk factor categories
Wilson, P. W. F., D’Agostino, R. B., Levy, D., Belanger, A. M., Silbershatz, H., & Kannel, W. B. (1998) · Circulation · doi:10.1161/01.cir.97.18.1837 · Cited by 9,581 · cited 2×
“Traditionally, risk pre- diction algorithms have been developed from large cohort studies such as the Framingham Heart Study.3 These studies were designed to follow people for years or even decades.”
MethodMoons, K. G. M., Altman, D. G., Reitsma, J. B., Ioannidis, J. P. A., Macaskill, P., Steyerberg, E. W., Vickers, A. J., Ransohoff, D. F., & Collins, G. S. (2015) · Annals of Internal Medicine · doi:10.7326/m14-0698 · Cited by 5,147
Self-citationCollins, G. S., Reitsma, J. B., Altman, D. G., & Moons, K. G. M. (2015) · British Journal of Cancer · doi:10.1038/bjc.2014.639 · Cited by 3,293
Joint modelling of longitudinal measurements and event time data
Henderson, R. (2000) · Biostatistics · doi:10.1093/biostatistics/1.4.465 · Cited by 913
The Electronic Medical Records and Genomics (eMERGE) Network: past, present, and future
Gottesman, O., Kuivaniemi, H., Tromp, G., Faucett, W. A., Li, R., Manolio, T. A., Sanderson, S. C., Kannry, J., Zinberg, R., Basford, M. A., et al. (2013) · Genetics in Medicine · doi:10.1038/gim.2013.72 · Cited by 698
Statistical Evaluation of Prognostic versus Diagnostic Models: Beyond the ROC Curve
Cook, N. R. (2008) · Clinical Chemistry · doi:10.1373/clinchem.2007.096529 · Cited by 691
Research works printed but not linked: 1
- Liu, 2010, Length of stay predictions: improvements through the use of automated laboratory and comorbidity variables, Med Care., 48, 739, 10.1097/mlr.0b013e3181e359f3 · DOI · Paper page
Cited by
Items 501–600 of 1,000
Sim, T., Hahn, S., Kim, K.-J., Cho, E.-Y., Jeong, Y., Kim, J.-H., Ha, E.-Y., Kim, I.-C., Park, S.-H., Cho, C.-H., et al. (2025) · Journal of Clinical Medicine · doi:10.3390/jcm14072213 · Cited by 7
Fung, A., Loutet, M. G., Roth, D. E., Wong, E., Gill, P. J., Morris, S. K., & Beyene, J. (2024) · Academic Pediatrics · doi:10.1016/j.acap.2024.03.016 · Cited by 7
Risk Prediction in Cardio-Oncology: Conceptual and Methodological Considerations
Sen, J., Amir, E., Austin, P. C., Marwick, T. H., McIntosh, C., Thavendiranathan, P., & Abdel-Qadir, H. M. (2026) · JACC CardioOncology · doi:10.1016/j.jaccao.2026.01.006 · Cited by 7
Kitchen, C., Chang, H., Weiner, J. P., & Kharrazi, H. H. K. (2022) · Risk Management and Healthcare Policy · doi:10.2147/rmhp.s356080 · Cited by 7
Al-Dailami, A., Kuang, H., & Wang, J. (2022) · IEEE International Conference on Bioinformatics and Biomedicine (BIBM) · doi:10.1109/bibm55620.2022.9994881 · Cited by 7
Deep learning for clinical decision-making and improved healthcare outcome
Kabir, R., Syed, H. Z., Vinnakota, D., Sivasubramanian, M., Hitch, G., Okello, S. A., Sharon-Shivuli-Isigi, Pulikkottil, A. T., Mahmud, I., Dehghani, L., et al. (2023) · Elsevier eBooks · doi:10.1016/b978-0-443-19413-9.00004-7 · Cited by 7
Quality and Performance Measures in Healthcare Systems Using Fog Computing
Patel, R., Acharjya, A., Patel, P., Sivaiah, B., & Sahoo, B. (2023) · Advances in computational intelligence and robotics book series · doi:10.4018/978-1-6684-4466-5.ch006 · Cited by 7
Torsello, A., Aromatario, M., Scopetti, M., Bianco, L., Oliva, S., D’Errico, S., & Napoli, C. (2024) · Healthcare · doi:10.3390/healthcare12030331 · Cited by 7
Dynamic risk prediction of survival in liver cirrhosis: A comparison of landmarking approaches
Paukner, M. J., Ladner, D. P., & Zhao, L. (2024) · PLoS ONE · doi:10.1371/journal.pone.0306328 · Cited by 7
Maternal early warning scores shown to be methodologically weak and at high risk of bias
Chester‐Jones, M., Kirtley, S., Er, F., Jogarah, V., Qiao, Y., Tunn, R., Vides, N., Watkinson, P., Knight, M., Gerry, S., et al. (2025) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2025.111833 · Cited by 9
Detrois, K. E., Hartonen, T., Teder‐Laving, M., Jermy, B. S., Läll, K., Yang, Z., FinnGen, Mägi, R., Ripatti, S., & Ganna, A. (2025) · Nature Genetics · doi:10.1038/s41588-025-02298-9 · Cited by 7
Rassy, E., Delaloge, S., Slaouti, Y., Pudlarz, T., Lekens, B., Boilève, A., Michiels, S., & Karimi, M. (2025) · British Journal of Cancer · doi:10.1038/s41416-025-03172-5 · Cited by 7
Guiding Clinical Decisions Through Predictive Risk Rules
Goldstein, B. A., & Bedoya, A. (2020) · JAMA Network Open · doi:10.1001/jamanetworkopen.2020.13101 · Cited by 7
Self-citationYarborough, B. J. H., & Stumbo, S. P. (2022) · Archives of Suicide Research · doi:10.1080/13811118.2022.2064255 · Cited by 7
A Review on Various Data Prediction Technologies
(2022) · doi:10.46632/daai/2/1/9 · Cited by 7
An imConvNet-based deep learning model for Chinese medical named entity recognition
Zheng, Y., Han, Z., Cai, Y., Duan, X., Sun, J., Yang, W., & Huang, H. (2022) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-022-02049-4 · Cited by 7
Ortíz, A., Portolés, J. M., Pino-Pino, M. D., Barea, J. L., López, M., de Sequera, P., Quiroga, B., Echarri, R., Velasco, M. P., Díaz, R., et al. (2023) · Kidney Diseases · doi:10.1159/000528784 · Cited by 7
Health inequalities in AI machine learning
Chung, R. Y., & Freedman, B. (2024) · Elsevier eBooks · doi:10.1016/b978-0-323-95068-8.00009-1 · Cited by 7
Chu, Y.-C., Kuo, W.-T., Cheng, Y.-R., Lee, C.-Y., Shiau, C., Tarng, D., & Lai, F. (2018) · Scientific Reports · doi:10.1038/s41598-018-31290-z · Cited by 7
Numeracy and Understanding of Quantitative Aspects of Predictive Models: A Pilot Study
Weissman, G. E., Yadav, K. N., Madden, V. L., Courtright, K. R., Hart, J. L., Asch, D. A., Schapira, M. M., & Halpern, S. D. (2018) · Applied Clinical Informatics · doi:10.1055/s-0038-1669457 · Cited by 7
Patient-Specific Explanations for Predictions of Clinical Outcomes
Tajgardoon, M., Samayamuthu, M. J., Calzoni, L., & Visweswaran, S. (2019) · ACI Open · doi:10.1055/s-0039-1697907 · Cited by 7
Primary care risk stratification in COPD using routinely collected data: a secondary data analysis
Johnson, M., Rigge, L., Culliford, D. J., Josephs, L. K., Thomas, M. D., & Wilkinson, T. M. A. (2019) · npj Primary Care Respiratory Medicine · doi:10.1038/s41533-019-0154-6 · Cited by 7
Szymonifka, J. D., Conderino, S. E., Cigolle, C. T., Ha, J., Kabeto, M. U., Yu, J.-H., Dodson, J. A., Thorpe, L. E., Blaum, C. S., & Zhong, J. (2020) · JAMIA Open · doi:10.1093/jamiaopen/ooaa059 · Cited by 7
Bologa, C., Pankratz, V. S., Unruh, M. L., Roumelioti, M., Shah, V. O., Shaffi, S. K., Arzhan, S., Cook, J., & Argyropoulos, C. (2021) · BMC Medical Research Methodology · doi:10.1186/s12874-021-01318-6 · Cited by 7
AEP-DLA: Adverse Event Prediction in Hospitalized Adult Patients Using Deep Learning Algorithms
Wu, C., Wu, M.-J., Chen, L.-C., Lo, Y.-C., Huang, C.-C., Yu, H.-H., Pardeshi, M. S., Lo, W., & Sheu, R. (2021) · IEEE Access · doi:10.1109/access.2021.3070618 · Cited by 7
A new methodological framework for hazard detection models in health information technology systems
Omitaomu, O. A., Klasky, H. B., Olama, M. M., Özmen, Ö., Pullum, L., Thakur, A. M., Kuruganti, T. P., Scott, J. M., Laurio, A., Drews, F. A., et al. (2021) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2021.103937 · Cited by 7
Khaled, N., Turki, A., & Aidalina, M. (2019) · International Journal of Public Health and Clinical Sciences · doi:10.32827/ijphcs.6.5.22 · Cited by 7
Chan, S. L., Lee, J. W., Ong, M. E. H., Siddiqui, F. J., Graves, N., Ho, A. F. W., & Liu, N. (2022) · PLoS ONE · doi:10.1371/journal.pone.0267965 · Cited by 7
Brankovic, A., Rolls, D. A., Boyle, J., Niven, P., & Khanna, S. (2022) · Scientific Reports · doi:10.1038/s41598-022-20907-z · Cited by 7
Dormosh, N., Damoiseaux‐Volman, B. A., van der Velde, N., Medlock, S. K., Romijn, J. A., & Abu–Hanna, A. (2023) · Journal of the American Medical Directors Association · doi:10.1016/j.jamda.2023.03.006 · Cited by 7
Cowling, T. E., Cromwell, D. A., Sharples, L. D., & van der Meulen, J. (2020) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2020.08.001 · Cited by 7
Amland, R. C., & Sutariya, B. B. (2018) · JAMIA Open · doi:10.1093/jamiaopen/ooy013 · Cited by 7
Marafino, B. J., Dudley, R. A., Shah, N. H., & Chen, J. H. (2018) · PubMed Central · Cited by 7
Supervised mixture of experts models for population health
Shou, X., Mavroudeas, G., Magdon‐Ismail, M., Figueroa, J., Kuruzovich, J., & Bennett, K. P. (2020) · Methods · doi:10.1016/j.ymeth.2020.05.016 · Cited by 6
Bias correction models for electronic health records data in the presence of non-random sampling
Kim, J., Anthopolos, R., & Zhong, J. (2024) · Biometrics · doi:10.1093/biomtc/ujae014 · Cited by 6
Applying Artificial Intelligence in Pediatric Clinical Trials: Potential Impacts and Obstacles
Foote, H. P., Cohen‐Wolkowiez, M., Lindsell, C. J., & Hornik, C. P. V. (2024) · The Journal of Pediatric Pharmacology and Therapeutics · doi:10.5863/1551-6776-29.3.336 · Cited by 6
Grim, S., Kotz, A., Kotz, G., Halliwell, C., Thomas, J. F., & Kessler, R. S. (2024) · Scientific Reports · doi:10.1038/s41598-024-80064-3 · Cited by 6
DOME: Directional medical embedding vectors from Electronic Health Records
Wen, J., Xue, H., Rush, E. N., Panickan, V. A., Cai, T. A., Zhou, D., Ho, Y.-L. A., Costa, L., Begoli, E., Hong, C., et al. (2025) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2024.104768 · Cited by 6
Transforming Medical Tourism Through Digital Advancements
Ashraf, J., & Hayat, Y. (2025) · Advances in healthcare information systems and administration book series · doi:10.4018/979-8-3693-7888-5.ch017 · Cited by 6
Svenšek, A., Gosak, L., Lorber, M., Štiglic, G., & Fijačko, N. (2025) · JMIR mhealth and uhealth · doi:10.2196/56466 · Cited by 6
Olier, I., Ortega‐Martorell, S., Margereson, G., Bellfield, R. A. A., Welters, I. D., & Lip, G. Y. H. (2025) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2025.111196 · Cited by 6
Brullas, G., Luaces, C., de la Maza, V. T. S., & Brotons, P. (2025) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2025.106189 · Cited by 6
An interpretable machine learning approach to predicting depression and diabetes
Chike, O. E., Oduniyi, O. S., & Nwaiwu, J. I. (2026) · Healthcare Analytics · doi:10.1016/j.health.2026.100454 · Cited by 6
Appelbaum, L., Kaplan, I. D., Palchuk, M. B., Kundrot, S., Winer-Jones, J. P., & Rinard, M. (2022) · Exon Publications eBooks · doi:10.36255/exon-publications-digital-health-federated-databases · Cited by 6
Gazzotti, R., Zucker, C. F., Gandon, F. L., Lacroix-Hugues, V., & Darmon, D. (2022) · Journal of Biomedical Semantics · doi:10.1186/s13326-022-00261-9 · Cited by 6
Sanz, N. V., García‐Layana, A., Colas, T., Moriche, M., Moreno, M. M., & Ciprandi, G. (2022) · Applied Sciences · doi:10.3390/app122312352 · Cited by 6
Liu, X., Armaignac, D. L., Becker, C., Hiddleson, C. A., DuBouchet, E. M., Rincon, T., Amelung, P. J., French, R., Scurlock, C. S., Atallah, L., et al. (2022) · Critical Care Medicine · doi:10.1097/ccm.0000000000005750 · Cited by 6
Yang, H., Zhang, Y., Heng, F., Li, W., Feng, Y., Tao, J., Wang, L., Zhang, Z., Li, X., & Lu, Y. (2024) · Asian Nursing Research · doi:10.1016/j.anr.2024.04.012 · Cited by 6
Somathilake, G., Ford, E. M., Armes, J., Moschoyiannis, S., Collins, M., Francsics, P., & Lemańska, A. (2024) · Cancer Epidemiology · doi:10.1016/j.canep.2024.102715 · Cited by 6
Kouroupis, M., Korfiatis, N., & Cornford, J. (2019) · Elsevier eBooks · doi:10.1016/b978-0-443-36769-4.00017-8 · Cited by 6
E-Pedigrees: a large-scale automatic family pedigree prediction application
Huang, X., Tatonetti, N. P., LaRow, K., Delgoffe, B. E., Mayer, J. G., Page, D., & Hebbring, S. J. (2021) · Bioinformatics · doi:10.1093/bioinformatics/btab419 · Cited by 6
Describing a complex primary health care population to support future decision support initiatives
Kueper, J. K., Rayner, J., Zwarenstein, M., & Lizotte, D. J. (2022) · International Journal for Population Data Science · doi:10.23889/ijpds.v7i1.1756 · Cited by 6
Orgueira, A. M., Arias, J. Á. D., Martín, R. S., Piñeiro, V. P., López, M. C., Raíndo, A. P., Pérez, L. B., González, M. S., Pérez‐Encinas, M., Rodríguez, M. F. F., et al. (2023) · Frontiers in Oncology · doi:10.3389/fonc.2023.1157646 · Cited by 6
Dosis, A., Helliwell, J. A., Syversen, A., Tiernan, J. P., Zhang, Z., & Jayne, D. G. (2023) · International Journal of Colorectal Disease · doi:10.1007/s00384-023-04455-0 · Cited by 6
Debray, T. P. A., Simoneau, G., Copetti, M., Platt, R. W., Shen, C., Pellegrini, F., & de Moor, C. (2023) · Statistical Methods in Medical Research · doi:10.1177/09622802231172032 · Cited by 6
Ser, S. E., Shear, K., Snigurska, U. A., Prosperi, M., Wu, Y., Magoč, T., Bjarnadóttir, R. I., & Lucero, R. J. (2023) · JMIR Research Protocols · doi:10.2196/48521 · Cited by 6
Dauphinot, V., Laurent, M., Prodel, M., Civet, A., Vainchtock, A., Moutet, C., Krolak‐Salmon, P., & Garnier‐Crussard, A. (2024) · Alzheimer s Research & Therapy · doi:10.1186/s13195-024-01533-5 · Cited by 6
Overcoming barriers to diabetic polyneuropathy management in primary care
Adams, A. S., Callaghan, B. C., & Grant, R. W. (2016) · Healthcare · doi:10.1016/j.hjdsi.2016.10.003 · Cited by 6
Kefiyalew, B., Abay, S. M., Mamo, W., Abate, B. B., Chanyalew, M. A., Ayalew, Y., Necho, A., Mekonnen, Z. A., Teklu, A., Shahabuddin, A., et al. (2021) · Ethiopian Journal of Health Development · Cited by 6
A new expert system with diagnostic accuracy for pediatric upper respiratory conditions
Yazdani, S., Lerner, C. F., Kulkarni, D., Kamzan, A. D., & Henry, R. C. (2022) · Healthcare Analytics · doi:10.1016/j.health.2022.100042 · Cited by 6
Choi, Y. Y., Jeong, H., Lee, J. H., Sung, K., Shin, J., Kim, H. C., Kim, J., & Kang, D. R. (2021) · CardioMetabolic Syndrome Journal · doi:10.51789/cmsj.2021.1.e19 · Cited by 6
Koning, N. R., Büchner, F. L., Leeuwenburgh, N. A., Paijmans, I. J. M., Dijk, D. J. A. V. D.-V., Vermeiren, R. R. J. M., Numans, M. E., & Crone, M. R. (2022) · BMJ Open · doi:10.1136/bmjopen-2021-049151 · Cited by 6
The Role of Pharmacoepidemiology in Industry
Gatto, N. M., Sobel, R. E., Geier, J. L., Mo, J., Bate, A., & Reynolds, R. F. (2019) · Wiley eBooks · doi:10.1002/9781119413431.ch7 · Cited by 6
Innovation on Machine Learning in Healthcare Services–An Introduction
Pattnayak, P., & Jena, O. P. (2021) · Wiley eBooks · doi:10.1002/9781119792611.ch1 · Cited by 6
The science of informatics and predictive analytics
Lenert, L. A. (2019) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocz202 · Cited by 6
Modlin, I. M., Kidd, M. S., Drozdov, I. A., & Bodei, L. (2019) · Neuroendocrinology · doi:10.1159/000504605 · Cited by 6
Early Prediction of Alzheimer’s Disease and Related Dementias Using Electronic Health RecordsPreprint
Yang, X., Li, Q., Wu, Y., Bian, J., Lyu, T., Guo, Y. M., Marra, D. E., Miller, A., Shenkman, E. A., & Maraganore, D. M. (2020) · medRxiv · doi:10.1101/2020.06.13.20130401 · Cited by 6
Developing Implementable Risk Prediction Models with Electronic Health Records Data
Goldstein, B. A., & Pencina, M. J. (2019) · Wiley eBooks · doi:10.1002/9781118445112.stat08204 · Cited by 6
Self-citationMachine Learning–Driven Prediction of Comorbidities and Mortality in Adults With Type 1 Diabetes
Andersen, J. S., Stoltenberg, C. W., Jensen, M. H., Vestergaard, P., Hejlesen, O. K., & Hangaard, S. (2024) · Journal of Diabetes Science and Technology · doi:10.1177/19322968241267779 · Cited by 5
ChatGPT in cardiovascular medicine: revolution, hype, or helper?
Uchmanowicz, I., Jędrzejczyk, M., Vellone, E., Janczak, S. D., Mirkowski, K., Uchmanowicz, B., & Czapla, M. (2025) · Frontiers in Public Health · doi:10.3389/fpubh.2025.1622561 · Cited by 5
Knowledge Graph Augmented Large Language Models for Disease PredictionPreprint
Wang, R., Vinh, T., Xu, R., Zhou, Y., Lu, J., Pasquel, F. J., Ali, M. M., & Yang, C. (2025) · PubMed Central · doi:10.48550/arxiv.2512.01210 · Cited by 5
AI-Driven Predictive Analytics for Clinical Decision Support and Improved Patient Outcomes
Kopparthi, G. S. (2024) · International Journal of Science Research and Technology · doi:10.15662/ijsrat.2024.0704004 · Cited by 5
Kirk, P., Liu, X., Borza, T., Li, B. Y., Sessine, M. S., Zhu, K., Lesse, O., Qin, Y. A., Jacobs, B. L., Urish, K. L., et al. (2020) · Urologic Oncology Seminars and Original Investigations · doi:10.1016/j.urolonc.2019.11.011 · Cited by 5
From Traditional Statistical Methods to Machine and Deep Learning for Prediction Models
Lee, J. H., & Kang, D. R. (2020) · Cardiovascular Prevention and Pharmacotherapy · doi:10.36011/cpp.2020.2.e6 · Cited by 5
Dynamic Fusion Algorithm of Building Surface Data in Heterogeneous Environment
Jing, Z., & Gao, J. (2020) · Mobile Networks and Applications · doi:10.1007/s11036-020-01677-2 · Cited by 5
Zhang, Y., Tayarani, M., Alaref, S. J., Beecy, A., Liu, Y., Sholle, E., RoyChoudhury, A., Axsom, K., Gao, H. O., Pathak, J., et al. (2020) · JAMIA Open · doi:10.1093/jamiaopen/ooaa038 · Cited by 5
Khan, A., Zubair, S., & Khan, S. (2021) · ADCAIJ ADVANCES IN DISTRIBUTED COMPUTING AND ARTIFICIAL INTELLIGENCE JOURNAL · doi:10.14201/adcaij2021102183196 · Cited by 5
Axford, D., Sohel, F. A., Abedi, V., Zhu, Y., Zand, R., Barkoudah, E., Krupica, T., Iheasirim, K., Sharma, U. M., Dugani, S. B., et al. (2023) · European Heart Journal - Digital Health · doi:10.1093/ehjdh/ztad073 · Cited by 5
El‐Hayek, C., Nguyen, T. C. L., Hellard, M. E., Curtis, M., Sacks‐Davis, R., Aung, H. L., Asselin, J., Boyle, D. I., Wilkinson, A. L., Polkinghorne, V., et al. (2024) · npj Digital Medicine · doi:10.1038/s41746-024-01318-y · Cited by 5
Online adaptive method for disease prediction based on big data of clinical laboratory test
Yang, X., Tong, Y., Meng, X., Zhao, S., Xu, Z., Li, Y., Liu, G., & Tan, S. (2016) · IEEE International Conference on Software Engineering and Service Science (ICSESS) · doi:10.1109/icsess.2016.7883208 · Cited by 5
Fishe, J. N., Bian, J., Chen, Z., Hu, H. Z., Min, J. S., Modave, F. P., & Prosperi, M. (2019) · Journal of Asthma · doi:10.1080/02770903.2019.1642352 · Cited by 5
Xu, Z., Arnold, M., Sun, L., Stevens, D., Chung, R., Ip, S., Barrett, J., Kaptoge, S. K., Pennells, L. A. M., Angelantonio, E. D., et al. (2022) · International Journal of Epidemiology · doi:10.1093/ije/dyac140 · Cited by 5
Development and Application of an Intensive Care Medical Data Set for Deep Learning
Zhao, S., Liu, P., Tang, G., Guo, Y., & Li, G. (2020) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata50022.2020.9378231 · Cited by 5
A novel index to assess low energy fracture risks in patients prescribed antiepileptic drugs
Nordqvist, O., Björneld, O., Brudin, L. H., Wanby, P., Nobin, R., & Carlsson, M. (2021) · PLoS ONE · doi:10.1371/journal.pone.0256093 · Cited by 5
Brusq, C., Mieusset, R., & Hamdi, S. M. (2021) · Andrology · doi:10.1111/andr.13106 · Cited by 5
Lannou, E. L., Post, B., Haar, S., Brett, S. J., Kadirvelu, B., & Faisal, A. A. (2021) · medRxiv · doi:10.1101/2021.03.29.21254579 · Cited by 5
Benchmark time series data sets for PyTorch -- the torchtime packagePreprint
Darke, P., Missier, P., & Bacardit, J. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2207.12503 · Cited by 5
Tamraparani, V. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5117105 · Cited by 5
Tallon, E. M., Williams, D. D., Schweisberger, C., Mullaney, C., Lockee, B., Ferro, D., Vandervelden, C. A., Barnes, M. S., Sarteau, A. C., Kahkoska, A. R., et al. (2025) · JMIR Diabetes · doi:10.2196/69142 · Cited by 4
Nandyala, S., Borse, L. B., Gayatri, A. P., & Bonthu, M. G. (2025) · Elsevier eBooks · doi:10.1016/b978-0-443-43823-3.00017-0 · Cited by 4
Germaine, M., Belsti, Y., O'Higgins, A. C., Egan, B., Teede, H. J., Healy, G. F., & Enticott, J. (2026) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2026.111547 · Cited by 4
Vader, D. T., Shu, D., Hubbard, R. A., Boge, C. L. K., Sharova, A. P., Downes, K. J., & Li, Y. (2026) · Epidemiology · doi:10.1097/ede.0000000000001974 · Cited by 4
Panero, J. L. C., de la Poza, G., Hidalgo, L., Sancho-Tello, M. V. A., Torras, X., de Lamadrid, R. S., Maté, C., & Sánchez‐Antolín, G. (2022) · Gastroenterología y Hepatología · doi:10.1016/j.gastrohep.2022.10.012 · Cited by 4
Early detection of heart failure using in-patient longitudinal electronic health records
Drozdov, I. A., Szubert, B., Murphy, C., Brooksbank, K. J. M., & Lowe, D. J. (2024) · PLoS ONE · doi:10.1371/journal.pone.0314145 · Cited by 4
Enhancing risk prediction base on health administrative data using high-dimensional prediction model
Hossain, M. B., Sadatsafavi, M., Wong, H., Cook, V. J., Johnston, J. C., & Karim, M. E. (2025) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2025.111857 · Cited by 4
Walpitage, D. L., Garcia, A., Harper, E. M., Sharma, N. K., & Waitman, L. R. (2019) · PubMed · Cited by 4
Soares, N. S., Singhal, S., Kloosterman, C., & Bailey, T. (2021) · PubMed · Cited by 4
Evaluation of Incident 7-Day Infection and Sepsis Hospitalizations in an Integrated Health System
Liu, V. X., Manickam, R. N., Greene, J. D., Schuler, A., Kipnis, P., Bhimarao, M., Barreda, F., & Escobar, G. J. (2021) · Annals of the American Thoracic Society · doi:10.1513/annalsats.202104-451oc · Cited by 4
Harnessing Electronic Medical Records in Cardiovascular Clinical Practice and Research
Gouda, P., & Ezekowitz, J. A. (2022) · Journal of Cardiovascular Translational Research · doi:10.1007/s12265-022-10313-1 · Cited by 4
Metadata
- Authors
- Goldstein, B. A., Navar, A. M., Pencina, M. J., & Ioannidis, J. P. A.
- Affiliations
- Duke University (US)
- Center for Predictive Medicine, Duke Clinical Research Institute, Duke University, Durham, NC 27710, USA
- Stanford University (US)
- Venue
- Journal of the American Medical Informatics Association
- Publisher
- Oxford University Press (OUP)
- Published
- 2016-05-17
- Volume
- 24
- Issue
- 1
- Pages
- 198-208
- ISSN
- 1067-5027 (ISSN-L)
- 1527-974X
- PMC
- PMC5201180
- OpenAlex
- W2395172628
- Cited by
- 936
- References
- 144
- Citations by year
- 2026: 132 · 2025: 115 · 2024: 97 · 2023: 98 · 2022: 107 · 2021: 122 · 2020: 100 · 2019: 82 · 2018: 59 · 2017: 15 · 2016: 6
- FWCI
- 9.07
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Journal of the American Medical Informatics Association (publishedVersion)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- HighWire Press Open Archive (submittedVersion)
- Funders
- National Institute of Diabetes and Digestive and Kidney Diseases (K25DK097279)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning in Healthcare
- Health Sciences › Health Professions › Health Information Management › Electronic Health Records Systems
- Health Sciences › Health Professions › Health Information Management › Medical Coding and Health Information
- Keywords
- electronic health records, clinical risk prediction, risk prediction model, model validation, multicenter validation, longitudinal data, missing data, loss to follow-up, model reproducibility, concordance index, mortality prediction, hospitalization prediction, service utilization
- MeSH terms
- Humans, Models, Statistical, Risk Assessment, Electronic Health Records
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.