Opportunities and challenges in developing risk prediction models with electronic health records data: a systematic review
Open accessThe DOI matches its Crossref record; 141 of the 144 references it cites were found in a registry or an index.
Abstract
Objective: Electronic health records (EHRs) are an increasingly common data source for clinical risk prediction, presenting both unique analytic opportunities and challenges. We sought to evaluate the current state of EHR based risk prediction modeling through a systematic review of clinical prediction studies using EHR data. Methods: We searched PubMed for articles that reported on the use of an EHR to develop a risk prediction model from 2009 to 2014. Articles were extracted by two reviewers, and we abstracted information on study design, use of EHR data, model building, and performance from each publication and supplementary documentation. Results: We identified 107 articles from 15 different countries. Studies were generally very large (median sample size = 26 100) and utilized a diverse array of predictors. Most used validation techniques (n = 94 of 107) and reported model coefficients for reproducibility (n = 83). However, studies did not fully leverage the breadth of EHR data, as they uncommonly used longitudinal information (n = 37) and employed relatively few predictor variables (median = 27 variables). Less than half of the studies were multicenter (n = 50) and only 26 performed validation across sites. Many studies did not fully address biases of EHR data such as missing data or loss to follow-up. Average c-statistics for different outcomes were: mortality (0.84), clinical prediction (0.83), hospitalization (0.71), and service utilization (0.71). Conclusions: EHR data present both opportunities and challenges for clinical risk prediction. There is room for improvement in designing such studies.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“In spite of the richness and potential of available data, scaling the development of predictive models is difficult because, for traditional predictive modeling techniques, each outcome to be predicted requires the creation of a custom dataset with specific variables.7”
From Scalable and accurate deep learning with electronic health records (2018) · cites this paper as [7]
In the citing paper
“Despite the rich data now digitized in EHRs,20 a recent systematic review of the medical literature7 found that predictive models built with EHR data use a median of only 27 variables, rely on traditional generalized linear models, and are built using data at a single center.”
From Scalable and accurate deep learning with electronic health records (2018) · cites this paper as [7]
In the citing paper
“Although external validation is recognized as an area of improvement for clinical risk prediction models [85]”
Citations
Cites
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000100 · Cited by 28,164
Self-citationDermyshi, E., Wang, Y., Yan, C., Hong, W., Qiu, G., Gong, X., & Zhang, T. (2017) · Neonatology · doi:10.1159/000454668 · Cited by 24,451
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2009.06.006 · Cited by 10,578
Self-citationPrediction of coronary heart disease using risk factor categories
Wilson, P. W. F., D’Agostino, R. B., Levy, D., Belanger, A. M., Silbershatz, H., & Kannel, W. B. (1998) · Circulation · doi:10.1161/01.cir.97.18.1837 · Cited by 9,581 · cited 2×
“Traditionally, risk pre- diction algorithms have been developed from large cohort studies such as the Framingham Heart Study.3 These studies were designed to follow people for years or even decades.”
MethodMoons, K. G. M., Altman, D. G., Reitsma, J. B., Ioannidis, J. P. A., Macaskill, P., Steyerberg, E. W., Vickers, A. J., Ransohoff, D. F., & Collins, G. S. (2015) · Annals of Internal Medicine · doi:10.7326/m14-0698 · Cited by 5,147
Self-citationCollins, G. S., Reitsma, J. B., Altman, D. G., & Moons, K. G. M. (2015) · British Journal of Cancer · doi:10.1038/bjc.2014.639 · Cited by 3,293
Joint modelling of longitudinal measurements and event time data
Henderson, R. (2000) · Biostatistics · doi:10.1093/biostatistics/1.4.465 · Cited by 913
The Electronic Medical Records and Genomics (eMERGE) Network: past, present, and future
Gottesman, O., Kuivaniemi, H., Tromp, G., Faucett, W. A., Li, R., Manolio, T. A., Sanderson, S. C., Kannry, J., Zinberg, R., Basford, M. A., et al. (2013) · Genetics in Medicine · doi:10.1038/gim.2013.72 · Cited by 698
Statistical Evaluation of Prognostic versus Diagnostic Models: Beyond the ROC Curve
Cook, N. R. (2008) · Clinical Chemistry · doi:10.1373/clinchem.2007.096529 · Cited by 691
Research works printed but not linked: 1
- Liu, 2010, Length of stay predictions: improvements through the use of automated laboratory and comorbidity variables, Med Care., 48, 739, 10.1097/mlr.0b013e3181e359f3 · DOI · Paper page
Cited by
Items 101–200 of 1,000
The AI life cycle: a holistic approach to creating ethical AI for health decisions
Ng, M. Y., Kapur, S., Blizinsky, K. D., & Hernandez-Boussard, T. (2022) · Nature Medicine · doi:10.1038/s41591-022-01993-y · Cited by 71
Fialoke, S., Mälarstig, A., Miller, M. R., & Dumitriu, A. (2018) · Europe PMC (PubMed Central) · Cited by 71
Counterfactual Reasoning for Fair Clinical Risk PredictionPreprint
Pfohl, S., Duan, T., Ding, D. Y., & Shah, N. H. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1907.06260 · Cited by 71
Sun, H., Depraetere, K., Meesseman, L., Silva, P. C., Szymanowsky, R., Fliegenschmidt, J., Hulde, N., von Dossow, V., Vanbiervliet, M., Baerdemaeker, J. D., et al. (2022) · Journal of Medical Internet Research · doi:10.2196/34295 · Cited by 70
Li, C., Liu, X., Shen, P., Sun, Y., Zhou, T., Chen, W., Chen, Q., Lin, H., Tang, X., & Gao, P. (2023) · European Heart Journal - Digital Health · doi:10.1093/ehjdh/ztad058 · Cited by 70
Nwaimo, C. S., Adegbola, A. E., & Adegbola, M. D. (2024) · GSC Advanced Research and Reviews · doi:10.30574/gscarr.2024.19.3.0190 · Cited by 70
Wang, X., Zhang, Y., Hao, S., Zheng, L., Liao, J., Ye, C., Xia, M., Wang, O., Liu, M., Weng, C. H., et al. (2019) · Journal of Medical Internet Research · doi:10.2196/13260 · Cited by 62
Big Data Impacting Dynamic Food Safety Risk Management in the Food Chain
Donaghy, J. A., Danyluk, M. D., Ross, T., Krishna, B., & Farber, J. (2021) · Frontiers in Microbiology · doi:10.3389/fmicb.2021.668196 · Cited by 67
Influence of medical domain knowledge on deep learning for Alzheimer's disease prediction
Ljubic, B., Roychoudhury, S., Cao, X. H., Pavlovski, M., Obradovic, S., Nair, R. R., Glass, L. M., & Obradovic, Z. (2020) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2020.105765 · Cited by 66
Goldstein, B. A., Pomann, G., Winkelmayer, W. C., & Pencina, M. J. (2017) · Statistics in Medicine · doi:10.1002/sim.7308 · Cited by 66
Self-citationFadl Federated-autonomous deep learning for distributed electronic health record
Liu, D., Miller, T., Sayeed, R., & Mandl, K. D. (2018) · arXiv · doi:10.48550/arxiv.1811.11400 · Cited by 65
“Healthcare records are stored in different locations and data silos, including but not limited to hospitals, pharmacies, payors, and personal devices[6, 17, 2, 9].”
BackgroundBozkurt, S., Cahan, E. M., Seneviratne, M. G., Sun, R., Lossio-Ventura, J. A., Ioannidis, J. P. A., & Hernandez-Boussard, T. (2020) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocaa164 · Cited by 65
Self-citationAppelbaum, L., Cambronero, J., Stevens, J. P., Horng, S., Pollick, K., Silva, G., Haneuse, S., Piatkowski, G., Benhaga, N., Duey, S., et al. (2020) · European Journal of Cancer · doi:10.1016/j.ejca.2020.10.019 · Cited by 64
Roe, K. D., Jawa, V., Zhang, X., Chute, C. G., Epstein, J. A., Matelsky, J., Shpitser, I., & Taylor, C. O. (2020) · PLoS ONE · doi:10.1371/journal.pone.0231300 · Cited by 63
Paige, E., Barrett, J., Stevens, D., Keogh, R. H., Sweeting, M. J., Nazareth, I., Petersen, I., & Wood, A. (2018) · American Journal of Epidemiology · doi:10.1093/aje/kwy018 · Cited by 63
Predictive Modeling of Hospital Readmission: Challenges and Solutions
Wang, S., & Zhu, X. (2021) · IEEE Transactions on Computational Biology and Bioinformatics · doi:10.1109/tcbb.2021.3089682 · Cited by 62
Stevens, L. M., Linstead, E. J., Hall, J. L., & Kao, D. P. (2021) · Circulation Heart Failure · doi:10.1161/circheartfailure.119.006799 · Cited by 62
Colubri, A., Hartley, M.-A., Siakor, M., Wolfman, V., Felix, A., Sesay, T., Shaffer, J. G., Garry, R. F., Grant, D. S., Levine, A. C., et al. (2019) · EClinicalMedicine · doi:10.1016/j.eclinm.2019.06.003 · Cited by 61
Designing risk prediction models for ambulatory no-shows across different specialties and clinics
Ding, X., Gellad, Z. F., Mather, R. C. “., Barth, P., Poon, E. G., Newman, M. F., & Goldstein, B. A. (2018) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocy002 · Cited by 61
Self-citationPate, A., Emsley, R., Ashcroft, D. M., Brown, B. C., & van Staa, T. P. (2019) · BMC Medicine · doi:10.1186/s12916-019-1368-8 · Cited by 61
Luo, G., He, S., Stone, B. L., Nkoy, F. L., & Johnson, M. D. (2020) · JMIR Medical Informatics · doi:10.2196/16080 · Cited by 61
Machine learning-based prediction models for patients no-show in online outpatient appointments
Fan, G., Deng, Z., Ye, Q., & Wang, B. (2021) · Data Science and Management · doi:10.1016/j.dsm.2021.06.002 · Cited by 61
KASHANI, K. B., Awdishu, L., Bagshaw, S. M., Barreto, E. F., Granado, R. C., Evans, B. J., Forni, L. G., Ghosh, E., Goldstein, S. L., Kane‐Gill, S. L., et al. (2023) · Nature Reviews Nephrology · doi:10.1038/s41581-023-00744-7 · Cited by 61
Towards a symbiotic relationship between big data, artificial intelligence, and hospital pharmacy
Rio‐Bermudez, C. D., Medrano, I. H., Yebes, L., & Poveda, J. L. (2020) · Journal of Pharmaceutical Policy and Practice · doi:10.1186/s40545-020-00276-6 · Cited by 61
The number needed to benefit: estimating the value of predictive analytics in healthcare
Liu, V. X., Bates, D. W., Wiens, J., & Shah, N. H. (2019) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocz088 · Cited by 59
Predictive Analytics for Glaucoma Using Data From the All of Us Research Program
Baxter, S. L., Saseendrakumar, B. R., Paul, P., Kim, J., Bonomi, L., Kuo, T.-T., Loperena, R., Ratsimbazafy, F., Boerwinkle, E., Cicek, M. S., et al. (2021) · American Journal of Ophthalmology · doi:10.1016/j.ajo.2021.01.008 · Cited by 59
Nationwide prediction of type 2 diabetes comorbidities
Dworzynski, P., Aasbrenn, M., Rostgaard, K., Melbye, M., Gerds, T. A., Hjalgrim, H., & Pers, T. H. (2020) · Scientific Reports · doi:10.1038/s41598-020-58601-7 · Cited by 58
Hong, J. C., Niedzwiecki, D., Palta, M., & Tenenbaum, J. D. (2018) · JCO Clinical Cancer Informatics · doi:10.1200/cci.18.00037 · Cited by 58
Predicting Patient Outcomes with Graph Representation LearningPreprint
Rocheteau, E., Tong, C., Veličković, P., Lane, N. D., & Lió, P. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2101.03940 · Cited by 58
Trends and Challenges of Wearable Multimodal Technologies for Stroke Risk Prediction
Chen, Y.-H., & Sawan, M. (2021) · Sensors · doi:10.3390/s21020460 · Cited by 57
Abraham, A., Le, B. L., Kosti, I., Straub, P., Velez-Edwards, D. R., Davis, L. K., Newton, J. M., Muglia, L. J., Rokas, A., Bejan, C. A., et al. (2022) · BMC Medicine · doi:10.1186/s12916-022-02522-x · Cited by 57
Artificial intelligence in clinical decision support and the prediction of adverse events
Oei, S. P., Bakkes, T. H. G. F., Mischi, M., Bouwman, R. A., van Sloun, R. J. G., & Turco, S. (2025) · Frontiers in Digital Health · doi:10.3389/fdgth.2025.1403047 · Cited by 57
Chavez‐Yenter, D., Goodman, M. S., Chen, Y., Chu, X., Bradshaw, R. L., Chambers, R. L., Chan, P. A., Daly, B. M., Flynn, M. C., Gammon, A., et al. (2022) · JAMA Network Open · doi:10.1001/jamanetworkopen.2022.34574 · Cited by 56
Personal and social patterns predict influenza vaccination decision
Shaham, A., Chodick, G., Shalev, V., & Yamin, D. (2020) · BMC Public Health · doi:10.1186/s12889-020-8327-3 · Cited by 56
Ivanics, T., Nelson, W., Patel, M. S., Claasen, M. P. A. W., Lau, L., Gorgen, A., Abreu, P., Goldenberg, A., Erdman, L., & Sapisochin, G. (2022) · Liver Transplantation · doi:10.1002/lt.26332 · Cited by 53
Patterson, B. W., Engstrom, C. J., Sah, V., Smith, M. A., Mendonça, E. A., Pulia, M. S., Repplinger, M. D., Hamedani, A. G., Page, D., & Shah, M. N. (2019) · Medical Care · doi:10.1097/mlr.0000000000001140 · Cited by 53
Hurst, J. H., Liu, Y., Maxson, P. J., Permar, S. R., Boulware, L. E., & Goldstein, B. A. (2020) · Journal of Clinical and Translational Science · doi:10.1017/cts.2020.499 · Cited by 53
Self-citationWeegar, R., & Sundström, K. (2020) · PLoS ONE · doi:10.1371/journal.pone.0237911 · Cited by 53
Knowledge Graph Embeddings for ICU readmission prediction
Carvalho, R. M. S., Oliveira, D., & Pesquita, C. (2023) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-022-02070-7 · Cited by 53
Deasy, J., Liò, P., & Ercole, A. (2020) · Scientific Reports · doi:10.1038/s41598-020-79142-z · Cited by 52
Creating Fair Models of Atherosclerotic Cardiovascular Disease Risk
Pfohl, S., Marafino, B., Coulet, A., Rodriguez, F., Palaniappan, L., & Shah, N. H. (2019) · Proceedings of the 2019 AAAI/ACM Conference on AI, Ethics, and Society · doi:10.1145/3306618.3314278 · Cited by 52
Data-driven longitudinal characterization of neonatal health and morbidity
Francesco, D. D., Reiss, J. D., Roger, J. M., Tang, A., Chang, A. L., Becker, M., Phongpreecha, T., Espinosa, C. A., Morin, S., Berson, E., et al. (2023) · Science Translational Medicine · doi:10.1126/scitranslmed.adc9854 · Cited by 52
FeARH: Federated machine learning with anonymous random hybridization on electronic medical records
Cui, J., Zhu, H., Deng, H., Chen, Z., & Liu, D. (2021) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2021.103735 · Cited by 43
Logothetis, S. B., Green, D., Holland, M., & Moubayed, N. A. (2023) · Scientific Reports · doi:10.1038/s41598-023-40661-0 · Cited by 51
Dorosti, S., Ghoushchi, S. J., Sobhrakhshankhah, E., Ahmadi, M., & Sharifi, A. (2019) · Soft Computing · doi:10.1007/s00500-019-04507-0 · Cited by 50
Review of Machine Learning in Predicting Dermatological Outcomes
Du, A., Emam, S., & Gniadecki, R. (2020) · Frontiers in Medicine · doi:10.3389/fmed.2020.00266 · Cited by 50
Tan, M., Hatef, E., Taghipour, D. J., Vyas, K., Kharrazi, H. H. K., Gottlieb, L. M., & Weiner, J. P. (2020) · JMIR Medical Informatics · doi:10.2196/18084 · Cited by 50
Xu, D., Hu, P. J., Huang, T., Fang, X., & Hsu, C. (2020) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2020.103576 · Cited by 50
Akter, S., Liu, Z., Simões, E. J., & Rao, P. R. (2025) · The Journal of Prevention of Alzheimer s Disease · doi:10.1016/j.tjpad.2025.100169 · Cited by 49
Veracity in big data: How good is good enough
Reimer, A. P., & Madigan, E. A. (2018) · Health Informatics Journal · doi:10.1177/1460458217744369 · Cited by 49
Duan, H., Sun, Z., Dong, W., He, K., & Huang, Z. (2019) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2019.2962079 · Cited by 49
Møller, J. K., Sørensen, M., & Hardahl, C. (2021) · PLoS ONE · doi:10.1371/journal.pone.0248636 · Cited by 49
Talaei-Khoei, A., & Wilson, J. M. (2018) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2018.08.008 · Cited by 48
Personalized hypertension treatment recommendations by a data-driven model
Hu, Y., Huerta, J., Cordella, N., Mishuris, R. G., & Paschalidis, I. C. (2023) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-023-02137-z · Cited by 38
Deep Learning for Epidemiologists: An Introduction to Neural Networks
Serghiou, S., & Rough, K. (2023) · American Journal of Epidemiology · doi:10.1093/aje/kwad107 · Cited by 48
The Stanford Medicine data science ecosystem for clinical and translational research
Callahan, A., Ashley, E. A., Datta, S., Desai, P., Ferris, T., Fries, J., Halaas, M., Langlotz, C. P., Mackey, S., Posada, J., et al. (2023) · JAMIA Open · doi:10.1093/jamiaopen/ooad054 · Cited by 48
Brom, H., Brooks Carthon, J. M., Ikeaba, U., & Chittams, J. (2020) · Journal of Nursing Care Quality · doi:10.1097/ncq.0000000000000412 · Cited by 47
Ludlow, K., Westbrook, J. I., Jorgensen, M. L., Lind, K. E., Baysari, M. T., Gray, L., Day, R. O., Ratcliffe, J., Lord, S. R., Georgiou, A., et al. (2021) · BMJ Open · doi:10.1136/bmjopen-2021-048657 · Cited by 47
van Berkel, N., Bellio, M., Skov, M. B., & BLANDFORD, A. E. (2023) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3571815 · Cited by 47
Artificial Intelligence in Medicine: Text Mining of Health Care Workers’ Opinions
Nitiéma, P. (2023) · Journal of Medical Internet Research · doi:10.2196/41138 · Cited by 47
Symptoms timeline and outcomes in amyotrophic lateral sclerosis using artificial intelligence
Segura, T., Medrano, I. H., Collazo, S., Maté, C., Sguera, C., Rio‐Bermudez, C. D., Casero, H., Salcedo, I., García‐García, J., Alcahut-Rodríguez, C., et al. (2023) · Scientific Reports · doi:10.1038/s41598-023-27863-2 · Cited by 47
Cardiovascular Care Innovation through Data-Driven Discoveries in the Electronic Health Record
Dhingra, L. S., Shen, M., Mangla, A., & Khera, R. (2023) · The American Journal of Cardiology · doi:10.1016/j.amjcard.2023.06.104 · Cited by 47
Evidence-based medicine and big genomic data
Ioannidis, J. P. A., & Khoury, M. J. (2018) · Human Molecular Genetics · doi:10.1093/hmg/ddy065 · Cited by 47
Self-citationInterpreting a recurrent neural network’s predictions of ICU mortality risk
Ho, V. L., Aczon, M., Ledbetter, D., & Wetzel, R. C. (2021) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2021.103672 · Cited by 47
Martín, A. J. M., Souto, J. C., Lecumberri, R., Obispo, B., Sánchez, A., Aparicio, J., Aguayo, C., Gutiérrez, D., Palomo, A. G., Fanjul, V., et al. (2023) · Thrombosis Research · doi:10.1016/j.thromres.2023.06.015 · Cited by 46
Transporting a Prediction Model for Use in a New Target Population
Steingrimsson, J. A., Gatsonis, C. G., Li, B., & Dahabreh, I. J. (2022) · American Journal of Epidemiology · doi:10.1093/aje/kwac128 · Cited by 46
Artificial intelligence in oncology: From bench to clinic
Elkhader, J. A., & Elemento, O. (2021) · Seminars in Cancer Biology · doi:10.1016/j.semcancer.2021.04.013 · Cited by 47
Morley, T. J., Han, L., Castro, V. M., Morra, J. H., Perlis, R. H., Cox, N. J., Bastarache, L. A., & Ruderfer, D. M. (2021) · Nature Medicine · doi:10.1038/s41591-021-01356-z · Cited by 46
Zhan, X., Humbert‐Droz, M., Mukherjee, P., & Gevaert, O. (2021) · Patterns · doi:10.1016/j.patter.2021.100289 · Cited by 46
Explainable AI in Healthcare Application
Sindiramutty, S. R., Tee, W. J., Balakrishnan, S., Kaur, S., Thangaveloo, R., Jazri, H., Khan, N. A., Gharib, A. H., & Manchuri, A. R. (2024) · Advances in computational intelligence and robotics book series · doi:10.4018/978-1-6684-6361-1.ch005 · Cited by 45
Comorbidity-based framework for Alzheimer’s disease classification using graph neural networks
Abuhantash, F., Hantash, M. K. A., & Shehhi, A. A. (2024) · Scientific Reports · doi:10.1038/s41598-024-72321-2 · Cited by 45
Moglia, V., Johnson, O. A., Cook, G., de Kamps, M., & Smith, L. (2025) · BMC Medical Research Methodology · doi:10.1186/s12874-025-02473-w · Cited by 45
Xu, D., Sheng, J. Q., Hu, P. J., Huang, T., & Hsu, C. (2020) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2020.3033323 · Cited by 44
Cowling, T. E., Cromwell, D. A., Bellot, A., Sharples, L. D., & van der Meulen, J. (2021) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2020.12.018 · Cited by 45
Exploring machine learning to predict depressive relapses of bipolar disorder patients
Rotenberg, L. D. S., Borges-Júnior, R. G., Lafer, B., Salvini, R. L., & Dias, R. D. S. (2021) · Journal of Affective Disorders · doi:10.1016/j.jad.2021.08.127 · Cited by 45
Emi-Johnson, O. G., & Nkrumah, K. J. (2025) · Cureus · doi:10.7759/cureus.82437 · Cited by 44
On, J., Park, H., & Yoo, S. (2021) · European Journal of Oncology Nursing · doi:10.1016/j.ejon.2021.102066 · Cited by 44
Hankin, B. L., Young, J. F., Gallop, R., & Garber, J. (2018) · Journal of Abnormal Child Psychology · doi:10.1007/s10802-018-0401-2 · Cited by 43
Cui, H., Shen, Z., Zhang, J., Shao, H., Qin, L., Ho, J. C., & Yang, C. (2024) · PubMed Central · doi:10.48550/arxiv.2403.15464 · Cited by 43
The Evolution of AI: From Classical Machine Learning to Modern Large Language Models
Mundlamuri, R., Gunnam, G. R., Mysari, N. K., & Pujuri, J. (2025) · IEEE Access · doi:10.1109/access.2025.3621344 · Cited by 43
Nugroho, Y. W., & Pramudita, F. A. (2024) · Media Publikasi Promosi Kesehatan Indonesia (MPPKI) · doi:10.56338/mppki.v7i2.4867 · Cited by 42
Meta-learning in Healthcare: A Survey
Rafiei, A., Moore, R., Jahromi, S., Hajati, F., & Kamaleswaran, R. (2024) · SN Computer Science · doi:10.1007/s42979-024-03166-9 · Cited by 42
Nasarudin, N. A., Jasmi, F. A., Sinnott, R., Zaki, N., Alashwal, H., Mohamed, E. A., & Mohamad, M. S. (2024) · Artificial Intelligence Review · doi:10.1007/s10462-024-10876-2 · Cited by 42
Adversarial MACE Prediction After Acute Coronary Syndrome Using Electronic Health Records
Huang, Z., & Dong, W. (2018) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2018.2882518 · Cited by 42
Diabetes Care and Management Using Electronic Medical Records: A Systematic Review
Lessing, S., & Hayman, L. L. (2018) · Journal of Diabetes Science and Technology · doi:10.1177/1932296818815507 · Cited by 42
Understanding the Care Ecologies of Veterans with PTSD
Evans, H. I., Lakshmi, U. K., Watson, H., Ismail, A., Sherrill, A. M., Kumar, N., & Arriaga, R. I. (2020) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376170 · Cited by 42
Mishra, I., & Mohapatra, S. (2023) · International Journal of Information Technology · doi:10.1007/s41870-023-01321-8 · Cited by 42
Schofield, I., Brodbelt, D. C., Kennedy, N., Niessen, S., Church, D. B., Geddes, R. F., & O'Neill, D. G. (2021) · Scientific Reports · doi:10.1038/s41598-021-88440-z · Cited by 41
Beyond the Randomized Clinical Trial: Innovative Data Science to Close the Pediatric Evidence Gap
Goulooze, S. C., Zwep, L. B., Vogt, J. E., Krekels, E. H. J., Hankemeier, T., van den Anker, J. N., & Knibbe, C. A. J. (2020) · Clinical Pharmacology & Therapeutics · doi:10.1002/cpt.1744 · Cited by 40
Prediction of Childhood Obesity from Nationwide Health Records
Rossman, H., Shilo, S., Barbash‐Hazan, S., Artzi, N. S., Hadar, E., Balicer, R. D., Feldman, B., Wiznitzer, A., & Segal, E. (2021) · The Journal of Pediatrics · doi:10.1016/j.jpeds.2021.02.010 · Cited by 40
Tensor learning of pointwise mutual information from EHR data for early prediction of sepsis
Nesaragi, N., Patidar, S., & Aggarwal, V. (2021) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2021.104430 · Cited by 40
Environmental and clinical data utility in pediatric asthma exacerbation risk prediction models
Hurst, J. H., Zhao, C., Hostetler, H. P., Ghorveh, M. G., Lang, J. E., & Goldstein, B. A. (2022) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-022-01847-0 · Cited by 40
Self-citationRamakrishnaiah, Y., Maćešić, N., Webb, G. I., Peleg, A. Y., & Tyagi, S. (2025) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2025.105816 · Cited by 39
Akinbode, A. K., & Taiwo, K. A. (2025) · International Journal of Scientific Research and Modern Technology. · doi:10.38124/ijsrmt.v4i1.569 · Cited by 39
Patient similarity analytics for explainable clinical risk prediction
Fang, H. S. A., Tan, N. C., Tan, W. Y., Oei, R. W., Lee, M. L., & Hsu, W. (2021) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-021-01566-y · Cited by 39
Gomollón, F., Gisbert, J. P., Guerra, I., Plaza, R., Pajares, R., Almazán, L. M., Martín, M. C. L., Antonaya, M. D., Mendoza, M. I. V., Aparicio, J., et al. (2021) · European Journal of Gastroenterology & Hepatology · doi:10.1097/meg.0000000000002317 · Cited by 39
Mugisha, C., & Paik, I. (2022) · IEEE Access · doi:10.1109/access.2022.3148279 · Cited by 39
Pet genomics medicine runs wild
Moses, L., Niemi, S., & Karlsson, E. K. (2018) · Nature · doi:10.1038/d41586-018-05771-0 · Cited by 39
Predicting Patient Outcomes with Graph Representation Learning
Tong, C., Rocheteau, E., Veličković, P., Lane, N., & Liò, P. (2022) · Studies in Computational Intelligence · doi:10.1007/978-3-030-93080-6_20 · Cited by 38
Dashtban, A., Mizani, M. A., Pasea, L., Denaxas, S., Corbett, R., Mamza, J. B., Gao, H., Morris, T., Hemingway, H., & Banerjee, A. (2023) · EBioMedicine · doi:10.1016/j.ebiom.2023.104489 · Cited by 38
Metadata
- Authors
- Goldstein, B. A., Navar, A. M., Pencina, M. J., & Ioannidis, J. P. A.
- Affiliations
- Duke University (US)
- Center for Predictive Medicine, Duke Clinical Research Institute, Duke University, Durham, NC 27710, USA
- Stanford University (US)
- Venue
- Journal of the American Medical Informatics Association
- Publisher
- Oxford University Press (OUP)
- Published
- 2016-05-17
- Volume
- 24
- Issue
- 1
- Pages
- 198-208
- ISSN
- 1067-5027 (ISSN-L)
- 1527-974X
- PMC
- PMC5201180
- OpenAlex
- W2395172628
- Cited by
- 936
- References
- 144
- Citations by year
- 2026: 132 · 2025: 115 · 2024: 97 · 2023: 98 · 2022: 107 · 2021: 122 · 2020: 100 · 2019: 82 · 2018: 59 · 2017: 15 · 2016: 6
- FWCI
- 9.07
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Journal of the American Medical Informatics Association (publishedVersion)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- HighWire Press Open Archive (submittedVersion)
- Funders
- National Institute of Diabetes and Digestive and Kidney Diseases (K25DK097279)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning in Healthcare
- Health Sciences › Health Professions › Health Information Management › Electronic Health Records Systems
- Health Sciences › Health Professions › Health Information Management › Medical Coding and Health Information
- Keywords
- electronic health records, clinical risk prediction, risk prediction model, model validation, multicenter validation, longitudinal data, missing data, loss to follow-up, model reproducibility, concordance index, mortality prediction, hospitalization prediction, service utilization
- MeSH terms
- Humans, Models, Statistical, Risk Assessment, Electronic Health Records
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.