Opportunities and challenges in developing risk prediction models with electronic health records data: a systematic review
Open accessThe DOI matches its Crossref record; 141 of the 144 references it cites were found in a registry or an index.
Abstract
Objective: Electronic health records (EHRs) are an increasingly common data source for clinical risk prediction, presenting both unique analytic opportunities and challenges. We sought to evaluate the current state of EHR based risk prediction modeling through a systematic review of clinical prediction studies using EHR data. Methods: We searched PubMed for articles that reported on the use of an EHR to develop a risk prediction model from 2009 to 2014. Articles were extracted by two reviewers, and we abstracted information on study design, use of EHR data, model building, and performance from each publication and supplementary documentation. Results: We identified 107 articles from 15 different countries. Studies were generally very large (median sample size = 26 100) and utilized a diverse array of predictors. Most used validation techniques (n = 94 of 107) and reported model coefficients for reproducibility (n = 83). However, studies did not fully leverage the breadth of EHR data, as they uncommonly used longitudinal information (n = 37) and employed relatively few predictor variables (median = 27 variables). Less than half of the studies were multicenter (n = 50) and only 26 performed validation across sites. Many studies did not fully address biases of EHR data such as missing data or loss to follow-up. Average c-statistics for different outcomes were: mortality (0.84), clinical prediction (0.83), hospitalization (0.71), and service utilization (0.71). Conclusions: EHR data present both opportunities and challenges for clinical risk prediction. There is room for improvement in designing such studies.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“In spite of the richness and potential of available data, scaling the development of predictive models is difficult because, for traditional predictive modeling techniques, each outcome to be predicted requires the creation of a custom dataset with specific variables.7”
From Scalable and accurate deep learning with electronic health records (2018) · cites this paper as [7]
In the citing paper
“Despite the rich data now digitized in EHRs,20 a recent systematic review of the medical literature7 found that predictive models built with EHR data use a median of only 27 variables, rely on traditional generalized linear models, and are built using data at a single center.”
From Scalable and accurate deep learning with electronic health records (2018) · cites this paper as [7]
In the citing paper
“Although external validation is recognized as an area of improvement for clinical risk prediction models [85]”
Citations
Cites
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000100 · Cited by 28,164
Self-citationDermyshi, E., Wang, Y., Yan, C., Hong, W., Qiu, G., Gong, X., & Zhang, T. (2017) · Neonatology · doi:10.1159/000454668 · Cited by 24,451
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2009.06.006 · Cited by 10,578
Self-citationPrediction of coronary heart disease using risk factor categories
Wilson, P. W. F., D’Agostino, R. B., Levy, D., Belanger, A. M., Silbershatz, H., & Kannel, W. B. (1998) · Circulation · doi:10.1161/01.cir.97.18.1837 · Cited by 9,581 · cited 2×
“Traditionally, risk pre- diction algorithms have been developed from large cohort studies such as the Framingham Heart Study.3 These studies were designed to follow people for years or even decades.”
MethodMoons, K. G. M., Altman, D. G., Reitsma, J. B., Ioannidis, J. P. A., Macaskill, P., Steyerberg, E. W., Vickers, A. J., Ransohoff, D. F., & Collins, G. S. (2015) · Annals of Internal Medicine · doi:10.7326/m14-0698 · Cited by 5,147
Self-citationCollins, G. S., Reitsma, J. B., Altman, D. G., & Moons, K. G. M. (2015) · British Journal of Cancer · doi:10.1038/bjc.2014.639 · Cited by 3,293
Joint modelling of longitudinal measurements and event time data
Henderson, R. (2000) · Biostatistics · doi:10.1093/biostatistics/1.4.465 · Cited by 913
The Electronic Medical Records and Genomics (eMERGE) Network: past, present, and future
Gottesman, O., Kuivaniemi, H., Tromp, G., Faucett, W. A., Li, R., Manolio, T. A., Sanderson, S. C., Kannry, J., Zinberg, R., Basford, M. A., et al. (2013) · Genetics in Medicine · doi:10.1038/gim.2013.72 · Cited by 698
Statistical Evaluation of Prognostic versus Diagnostic Models: Beyond the ROC Curve
Cook, N. R. (2008) · Clinical Chemistry · doi:10.1373/clinchem.2007.096529 · Cited by 691
Research works printed but not linked: 1
- Liu, 2010, Length of stay predictions: improvements through the use of automated laboratory and comorbidity variables, Med Care., 48, 739, 10.1097/mlr.0b013e3181e359f3 · DOI · Paper page
Cited by
Items 401–500 of 1,000
Access to care affects electronic health record reliability and AI-driven disease prediction
Zink, A., Luan, H., & Chen, I. Y. (2026) · Nature Health · doi:10.1038/s44360-026-00054-9 · Cited by 13
External Validation of a Machine Learning Based Delirium Prediction Software in Clinical Routine
Jauk, S., Veeranki, S. P. K., Kramer, D., Högler, S., Mühlecker, D., Eberhartl, E., Schueler, A., Chvosta, C., Straßer, W., Strasser, R., et al. (2022) · Studies in health technology and informatics · doi:10.3233/shti220353 · Cited by 13
Cao, L., Huang, Y.-S. V., Wu, C., Getz, K., Miller, T. P., Ruiz, J., Fisher, B. T., Seif, A. E., Aplenc, R., & Li, Y. (2023) · Pediatric Blood & Cancer · doi:10.1002/pbc.30260 · Cited by 13
Predictive Modeling to Identify Children With Complex Health Needs At Risk for Hospitalization
Ming, D. Y., Zhao, C., Tang, X., Chung, R. J., Rogers, U. A., Stirling, A., Economou-Zavlanos, N., & Goldstein, B. A. (2023) · Hospital Pediatrics · doi:10.1542/hpeds.2022-006861 · Cited by 13
Self-citationTrottet, C., Vogels, T., Keitel, K., Kulinkina, A. V., Tan, R., Cobuccio, L. G., Jaggi, M., & Hartley, M. (2023) · PLOS Digital Health · doi:10.1371/journal.pdig.0000108 · Cited by 13
Khagi, B., Belousova, T., Short, C. M., Taylor, A. A., Nambi, V., Ballantyne, C. M., Bismuth, J. X., Shah, D. J., & Brunner, G. (2023) · Magnetic Resonance Imaging · doi:10.1016/j.mri.2023.11.014 · Cited by 13
Injecting Domain Knowledge in Electronic Medical Records to Improve Hospitalization Prediction
Gazzotti, R., Zucker, C. F., Gandon, F. L., Lacroix-Hugues, V., & Darmon, D. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-21348-0_8 · Cited by 13
Liang, H., Yang, L., Tao, L., Shi, L., Yang, W., Bai, J., Zheng, D., Wang, N., & Ji, J. (2020) · Chinese Journal of Cancer Research · doi:10.21147/j.issn.1000-9604.2020.02.11 · Cited by 13
Tian, Y., Chen, W., Zhou, T., Li, J., Ding, K., & Li, J. (2020) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2020.104173 · Cited by 13
Kim, H. H., Lim, Y., Seo, S. I., Lee, K. J., Kim, J., & Shin, W. G. (2021) · Applied Sciences · doi:10.3390/app11136194 · Cited by 13
Dormosh, N., Heymans, M. W., van der Velde, N., Hugtenburg, J. G., Maarsingh, O. R., Slottje, P., Abu–Hanna, A., & Schut, M. C. (2022) · Journal of the American Medical Directors Association · doi:10.1016/j.jamda.2022.07.002 · Cited by 13
A Framework for Automatic Clustering of EHR Messages Using a Spatial Clustering Approach
Ayaz, M., Pasha, M. F., Le, T. Y., Alahmadi, T. J., Abdullah, N. N. B., & Alhababi, Z. A. (2023) · Healthcare · doi:10.3390/healthcare11030390 · Cited by 13
Kakarmath, S. S., Golas, S. B., Felsted, J. A., Kvedar, J. C., Jethwani, K., & Agboola, S. O. (2018) · JMIR Research Protocols · doi:10.2196/resprot.9466 · Cited by 13
Enhancing Antibiotic Stewardship using a Natural Language Approach for Better Feature RepresentationPreprint
Lee, S. A., Brokowski, T. J., & Chiang, J. N. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2405.20419 · Cited by 13
Rashidian, S., Li, N., Amar, J., Lee, J. H., Pugh, S., Yang, E., Masterson, G., Cha, M., Jia, Y., & Vaid, A. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2506.04032 · Cited by 13
Tarumi, S., Takeuchi, W., Qi, R., Ning, X., Ruppert, L., Ban, H., Robertson, D. H., Schleyer, T., & Kawamoto, K. (2022) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2022.104001 · Cited by 12
How AI Could Help Us in the Epidemiology and Diagnosis of Acute Respiratory Infections?
Epelde, F. (2024) · Pathogens · doi:10.3390/pathogens13110940 · Cited by 12
Searching for Value Sensitive Design in Applied Health AI: A Narrative Review
Long, Y., Novak, L. L., & Walsh, C. G. (2024) · Yearbook of Medical Informatics · doi:10.1055/s-0044-1800723 · Cited by 12
Shi, J., Hubbard, A., Fong, N., & Pirracchio, R. (2025) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-025-03058-9 · Cited by 12
ETHICS of AI Adoption and Deployment in Health Care: Progress, Challenges, and Next Steps
Oleribe, O. O., Taylor-Robinson, A. W., Chimezie, C., & Taylor-Robinson, S. D. (2025) · JMIR AI · doi:10.2196/67626 · Cited by 12
Ruddle, R. A., Adnan, M., & Hall, M. (2022) · BMJ Open · doi:10.1136/bmjopen-2022-064887 · Cited by 12
Clinical assistant decision-making model of tuberculosis based on electronic health records
Wang, M., Lee, C., Wei, Z., Ji, H., Yang, Y., & Yang, C. (2023) · BioData Mining · doi:10.1186/s13040-023-00328-y · Cited by 12
Quality Control, Data Cleaning, Imputation
Liu, D., Oberman, H., Muñoz, J., Hoogland, J., & Debray, T. P. A. (2023) · Springer eBooks · doi:10.1007/978-3-031-36678-9_2 · Cited by 12
Johnson, R., Chang, T., Moineddin, R., Upshaw, T. L., Crampton, N. H., Wallace, E., & Pinto, A. D. (2024) · The Journal of the American Board of Family Medicine · doi:10.3122/jabfm.2023.230381r1 · Cited by 12
Singh, A. K., Sharma, K. K., Bajpai, M. K., & Cabezuelo, A. S. (2024) · Applied Soft Computing · doi:10.1016/j.asoc.2024.112374 · Cited by 12
Quantifying predictive capability of electronic health records for the most harmful breast cancer
Wu, Y., Fan, J., Peissig, P. L., Berg, R., Tafti, A. P., Yin, J., Yuan, M., Page, D., Cox, J., & Burnside, E. S. (2018) · SPIE Medical Imaging: Image Perception, Observer Performance, and Technology Assessment · doi:10.1117/12.2293954 · Cited by 12
Bodagh, N., Archbold, A., Weerackody, R. P., Hawking, M. K. D., Barnes, M. R., Lee, A. M., Janjuha, S., Gutteridge, C., Robson, J. P., & Timmis, A. (2018) · BMJ Open · doi:10.1136/bmjopen-2017-019790 · Cited by 12
Can the NHS be a learning healthcare system in the age of digital technology?
Banerjee, A., Drumright, L. N., & Mitchell, A. R. J. (2018) · BMJ Evidence-Based Medicine · doi:10.1136/bmjebm-2018-110953 · Cited by 12
Gaussian Process-Based Models for Clinical Time Series in Healthcare
Futoma, J. (2018) · Cited by 12
Predicting Hospital Utilization and Inpatient Mortality of Patients Tested for COVID-19Preprint
Davis, C., Gao, M. C., Nichols, M., & Henao, R. (2020) · medRxiv · doi:10.1101/2020.12.04.20244137 · Cited by 12
Paudel, R., Dias, S. L., Wade, C. G., Cronin, C. M., & Hassett, M. J. (2024) · JCO Clinical Cancer Informatics · doi:10.1200/cci-24-00145 · Cited by 11
Medical named entity recognition based on domain knowledge and position encoding
Sun, S., Hu, Q., Xu, F., Hu, F., Wu, Y., & Wang, B. (2025) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-025-03037-0 · Cited by 11
Wu, Y., Zhao, W., Zhang, L., Wang, Y., Wen, Y., & Liu, L. (2025) · Digestive and Liver Disease · doi:10.1016/j.dld.2025.06.007 · Cited by 11
Greenberg, J. K., Otun, A., Ghogawala, Z., Yen, P., Molina, C. A., Limbrick, D. D., Foraker, R. E., Kelly, M. P., & Ray, W. Z. (2021) · Global Spine Journal · doi:10.1177/21925682211008424 · Cited by 11
Sabharwal, P., Hurst, J. H., Tejwani, R., Hobbs, K. T., Routh, J. C., & Goldstein, B. A. (2022) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-022-01827-4 · Cited by 11
Self-citationGuan, J., Leung, E. Y. M., Kwok, K. O., & Chen, F. Y. (2023) · BMC Medical Research Methodology · doi:10.1186/s12874-022-01824-1 · Cited by 11
Zhu, G. H., Yuan, A. L., Yu, D., Zha, A. M., & Wu, H. (2023) · PLOS Digital Health · doi:10.1371/journal.pdig.0000400 · Cited by 11
Dai, L., Yang, X., Li, H., Zhao, X., Lin, L., Jiang, Y., Wang, Y., Li, Z., & Shen, H. (2024) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2024.102772 · Cited by 11
Quesada, J. A., & Orozco‐Beltrán, D. (2024) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2024.105722 · Cited by 11
-, M. M. M., & Dida, M. A. (2019) · International Journal of Advanced Technology and Engineering Exploration · doi:10.19101/ijatee.2019.650057 · Cited by 11
Tarimo, C. S., Bhuyan, S. S., Li, Q., Mahande, M. J., Wu, J., & Fu, X. (2021) · BMJ Open · doi:10.1136/bmjopen-2021-051925 · Cited by 11
A Comparison of Models Predicting One-Year Mortality at Time of Admission
Pierce, R. P., Raithel, S., Brandt, L. C., Clary, K. W., & Craig, K. W. (2021) · Journal of Pain and Symptom Management · doi:10.1016/j.jpainsymman.2021.11.006 · Cited by 11
SeDIE: A Semantic-Driven Engine for Integration of Healthcare Data
Dhayne, H., Kilany, R., Haque, R., & Taher, Y. (2018) · IEEE International Conference on Bioinformatics and Biomedicine (BIBM) · doi:10.1109/bibm.2018.8621243 · Cited by 11
Kryvova, O., & KOZAK, L. (2021) · Cybernetics and computer engineering · doi:10.15407/kvt203.01.077 · Cited by 11
Kennedy, C. J., Mark, D. G., Huang, J., van der Laan, M. J., Hubbard, A., & Reed, M. E. (2021) · medRxiv · doi:10.1101/2021.03.08.21252615 · Cited by 11
ChatPD: An LLM-driven Paper-Dataset Networking System
Xu, A., Ding, R., & Wang, L. (2025) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3711896.3737202 · Cited by 10
Addressing Missingness in Predictive Models That Use Electronic Health Record Data
Lin, S., Groenwold, R. H. H., Mehta, H. B., Kim, J. S., & Segal, J. B. (2025) · Annals of Internal Medicine · doi:10.7326/annals-24-01516 · Cited by 10
Artificial intelligence in preventive and managed healthcare
Shenoy, S., Sanap, G., Paul, D., Desai, N., Tambe, V., Kalyane, D., & Tekade, R. K. (2021) · Elsevier eBooks · doi:10.1016/b978-0-12-814425-1.00003-6 · Cited by 10
Nong, P., & Adler‐Milstein, J. (2021) · JAMIA Open · doi:10.1093/jamiaopen/ooab076 · Cited by 10
Tan, H., Zhou, X., Spratte, B. N., McMahon, S., Nielsen, M. E., Lund, J. L., Harris, A. H. S., Smith, A. B., & Basch, E. (2020) · The Journal of Urology · doi:10.1097/ju.0000000000001355 · Cited by 10
Ensemble learning for poor prognosis predictions: A case study on SARS-CoV-2
Wu, H., Zhang, H., Karwath, A., Ibrahim, Z. M., Shi, T., Zhang, X., Wang, K., Sun, J., Dhaliwal, K., Bean, D. M., et al. (2020) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocaa295 · Cited by 10
Using red blood cell distribution width to predict death after abdominal aortic aneurysm rupture
Li, W., Liao, T., Zhang, Y., & Li, C. (2023) · BMC Cardiovascular Disorders · doi:10.1186/s12872-023-03191-1 · Cited by 10
Tensor Factorization-Based Prediction With an Application to Estimate the Risk of Chronic Diseases
Wang, H., Zhang, Q., Chen, F. Y., Leung, E. Y. M., Wong, E. L., & Yeoh, E. (2021) · IEEE Intelligent Systems · doi:10.1109/mis.2021.3071018 · Cited by 10
Wang, T., Velez, T., Apostolova, E., Tschampel, T., Ngo, T. L., & Hardison, J. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1806.10174 · Cited by 10
Jin, Y., Weberpals, J. G., Wang, S. V., Desai, R. J., Merola, D., & Lin, K. J. (2023) · Clinical Pharmacology & Therapeutics · doi:10.1002/cpt.2901 · Cited by 9
Suh, J., Kwun, J.-S., Ahn, H.-B., Kang, S.-H., Yoo, S., 김석, Song, W., Hyun, J., Oh, J. S., & Baek, G. (2025) · Journal of Medical Internet Research · doi:10.2196/66366 · Cited by 9
de Groot, L. M., Twisk, J. W. R., Kok, A. A. L., & Heymans, M. W. (2025) · Annals of Epidemiology · doi:10.1016/j.annepidem.2025.07.060 · Cited by 9
Abdelhag, M. E. (2026) · The Saudi Journal of Applied Sciences and Technology · doi:10.63908/prv7rm86 · Cited by 9
An End‐to‐End Data‐Adaptive Pancreas Segmentation System with an Image Quality Control Toolbox
Zhu, Y., Hu, P., Li, X., Tian, Y., Bai, X., Liang, T., & Li, J. (2023) · Journal of Healthcare Engineering · doi:10.1155/2023/3617318 · Cited by 9
Irfan, M., Shahrestani, S. A., & Elkhodr, M. (2024) · Health care science · doi:10.1002/hcs2.84 · Cited by 9
Weil, L. I., Zwerwer, L. R., Chu, H., Verhoeff, M., Jeurissen, P., & Munster, B. C. V. (2024) · Health and Technology · doi:10.1007/s12553-024-00824-z · Cited by 9
John, T. L. S., Kanwar, O., Abidi, E., Nekidy, W. S. E., & Piechowski‐Jóźwiak, B. (2024) · PLOS Digital Health · doi:10.1371/journal.pdig.0000589 · Cited by 9
Adaptable graph neural networks design to support generalizability for clinical event prediction
Tariq, A., Kaur, G., Su, L., Gichoya, J. W., Patel, B. N., & Banerjee, I. (2025) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2025.104794 · Cited by 9
Verhoeff, M., de Groot, J. F., Burgers, J. S., & Munster, B. C. V. (2022) · PLoS ONE · doi:10.1371/journal.pone.0260829 · Cited by 9
Canturk, T., Czikk, D., Wai, E. K., Phan, P., Stratton, A. C., Michalowski, W., & Kingwell, S. P. (2022) · North American Spine Society Journal (NASSJ) · doi:10.1016/j.xnsj.2022.100142 · Cited by 9
Kiser, A. C., Eilbeck, K. L., Ferraro, J. P., Skarda, D. E., Samore, M. H., & Bucher, B. T. (2022) · JMIR Medical Informatics · doi:10.2196/39057 · Cited by 9
Regulating Fake News and Hoaxes: A Comparative Analysis of Indonesia and Malaysia
Supanto, S., Saefudin, Y., Ismail, N., Susanti, R., & Adi, L. K. (2023) · Journal of Human Rights Culture and Legal System · doi:10.53955/jhcls.v3i3.113 · Cited by 9
Building artificial intelligence‐based personalized predictive models
Bhandari, M., & Reddiboina, M. (2019) · British Journal of Urology · doi:10.1111/bju.14746 · Cited by 9
Supervised Mixture Models for Population Health
Shou, X., Mavroudeas, G., New, A., Arhin, K., Kuruzovich, J., Magdon‐Ismail, M., & Bennett, K. P. (2019) · IEEE International Conference on Bioinformatics and Biomedicine (BIBM) · doi:10.1109/bibm47256.2019.8983339 · Cited by 9
Bai, E., Song, S. L., Fraser, H., & Ranney, M. L. (2022) · Applied Clinical Informatics · doi:10.1055/s-0041-1740923 · Cited by 9
Named Entity Recognition in Chinese Electronic Medical Records Based on ALBERT-IDCNN-CRF
Tang, G. (2022) · IEEE International Conference on Computer and Communications (ICCC) · doi:10.1109/iccc56324.2022.10066018 · Cited by 9
Forecasting depressive relapse in Bipolar Disorder from clinical data
Borges-Júnior, R. G., Salvini, R. L., Nierenberg, A. A., Sachs, G. S., Lafer, B., & Dias, R. D. S. (2018) · IEEE International Conference on Bioinformatics and Biomedicine (BIBM) · doi:10.1109/bibm.2018.8621255 · Cited by 9
Associative attention networks for temporal relation extraction from electronic health records
Zhao, S., Li, L., Lu, H., Zhou, A., & Qian, S. (2019) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2019.103309 · Cited by 9
Contextual Feature Selection with Conditional Stochastic GatesPreprint
Sristi, R. D., Lindenbaum, O., Lifshitz, S., Lavzin, M., Schiller, J., Mishne, G., & Benisty, H. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2312.14254 · Cited by 9
Ran, W. H., Xi, X., Li, F., Lu, J., Jiang, J. H., Huang, H. F., Zhang, Y., & Li, S. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2506.06340 · Cited by 9
Bergquist, T., Schaffter, T., Yan, Y., Yu, T., Prosser, J., Gao, J., Chen, G., Charzewski, Ł., Nawalany, Z., Brugere, I., et al. (2023) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocad159 · Cited by 8
Li, Y., Mei, Z., Sun, G., Liu, Z., Li, J., Ong, M. E. H., Fan, H., & Cao, C. (2025) · BMC Public Health · doi:10.1186/s12889-025-24724-7 · Cited by 8
The Ethics of Leveraging Routinely Collected Patient Data for AI Development: Mixed Methods Study
Maris, M., Klopotowska, J. E., Cornet, R., van den Hoven, M., Lieverse, J. E., Fernández-Llaneza, D., & Bak, M. (2025) · Journal of Medical Internet Research · doi:10.2196/79863 · Cited by 8
Artificial Intelligence Length-of-Stay Forecasting and Pediatric Surgical Capacity
Berry, J. G., Mathieu, D., Staffa, S. J., Reis, B. Y., Hong, P. J., Asztalos, G., & Ferrari, L. R. (2026) · Archives of Pediatrics and Adolescent Medicine · doi:10.1001/jamapediatrics.2025.5385 · Cited by 8
Li, Z., Gogia, S., Tatem, K. S., Cooke, C., Singer, J., Chokshi, D. A., & Newton-Dame, R. (2022) · Medical Care · doi:10.1097/mlr.0000000000001807 · Cited by 8
Hekman, D. J., Cochran, A. L., Maru, A., Barton, H. J., Shah, M. N., Wiegmann, D. A., Smith, M. A., Liao, F., & Patterson, B. W. (2023) · JMIR Research Protocols · doi:10.2196/48128 · Cited by 8
Diagnostic suspicion bias and machine learning: Breaking the awareness deadlock for sepsis detection
Prasad, V., Aydemir, B., Kehoe, I. E., Kotturesh, C., O’Connell, A., Biebelberg, B., Wang, Y., Lynch, J. C., Pepino, J. A., Filbin, M. R., et al. (2023) · PLOS Digital Health · doi:10.1371/journal.pdig.0000365 · Cited by 8
Deardorff, W. J., Diaz‐Ramirez, L. G., Boscardin, W. J., Smith, A. K., & Lee, S. J. (2023) · Journal of the American Geriatrics Society · doi:10.1111/jgs.18704 · Cited by 8
Grotenhuis, Z., Mosteiro, P. J., & Leeuwenberg, A. (2024) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2024.108014 · Cited by 8
Goldstein, B. A., Mohottige, D., Bessias, S., & Cary, M. P. (2024) · American Journal of Kidney Diseases · doi:10.1053/j.ajkd.2024.04.008 · Cited by 8
Self-citationDrozdov, I. A., Szubert, B., Rowe, I. A. C., Kendall, T. J., & Fallowfield, J. A. (2024) · Annals of Hepatology · doi:10.1016/j.aohep.2024.101528 · Cited by 8
Graf, R., Todd, S., & Baksh, M. F. (2026) · Biometrical Journal · doi:10.1002/bimj.70171 · Cited by 8
Wu, P., Hurst, J. H., French, A., Chrestensen, M., & Goldstein, B. A. (2025) · JMIR Medical Informatics · doi:10.2196/63740 · Cited by 8
Self-citationMartin, G. P., Pate, A., Bladon, S., Sperrin, M., & Riley, R. D. (2025) · BMC Medicine · doi:10.1186/s12916-025-03978-3 · Cited by 8
Reducing Readmission for Sepsis by Improving Risk Prediction Algorithms
Renard, V. J., Farahani, P., Boehm, L. M., LaNoue, M. D., Akingbule, O., Xu, H., Frazier, A. L. B., Edelman, D. E., Østbye, T., & Wahid, L. (2025) · American Journal of Critical Care · doi:10.4037/ajcc2025455 · Cited by 8
Towards Reducing Diagnostic Errors with Interpretable Risk Prediction
McInerney, D. J., Dickinson, W., Flynn, L. C., Young, A. C., Young, G. S., van de Meent, J.-W., & Wallace, B. (2024) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2024.naacl-long.399 · Cited by 8
A Visual Analytics Framework for Analysis of Patient Trajectories
Madhobi, K. F., Kamruzzaman, M., Kalyanaraman, A., Lofgren, E., Moehring, R. W., & Krishnamoorthy, B. (2019) · ACM International Conference on Bioinformatics, Computational Biology, and Health Informatics (ACM-BCB) · doi:10.1145/3307339.3342143 · Cited by 8
Big data y nuevas tecnologías de la información: qué necesita saber el cardiólogo
Baladrón, C., de Diego, J. J. G., & Amat-Santos, I. J. (2020) · Revista Española de Cardiología · doi:10.1016/j.recesp.2020.06.017 · Cited by 8
Zhang, Y., Han, Y., Gao, P., Mo, Y., Hao, S., Huang, J., Ye, F., Li, Z., Zheng, L., Yao, X., et al. (2021) · JMIR Medical Informatics · doi:10.2196/23606 · Cited by 8
Gazzotti, R., Zucker, C. F., Gandon, F. L., Lacroix-Hugues, V., & Darmon, D. (2020) · ACM Symposium on Applied Computing · doi:10.1145/3341105.3373932 · Cited by 8
Frailty and In-Hospital Mortality Risk Using EHR Nursing Data
Lekan, D. A., McCoy, T. P., Jenkins, M., Mohanty, S. D., & Manda, P. (2021) · Biological Research For Nursing · doi:10.1177/10998004211060541 · Cited by 8
Wu, L., Hu, Y. Q., Zhang, X., Yuan, B., Chen, W., Liu, K., & Liu, M. (2022) · Knowledge-Based Systems · doi:10.1016/j.knosys.2022.108655 · Cited by 8
Application of Clinical Concept Embeddings for Heart Failure Prediction in UK EHR dataPreprint
Denaxas, S., Stenetorp, P., Riedel, S., Pikoula, M., Dobson, R., & Hemingway, H. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1811.11005 · Cited by 8
ISTHMUS: Secure, Scalable, Real-time and Robust Machine Learning Platform for HealthcarePreprint
Arora, A., Nethi, A., Kharat, P., Verghese, V., Jenkins, G., Miff, S., Chowdhry, V., & Wang, X. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1909.13343 · Cited by 8
Selig, K. (2020) · mediaTUM (Technical University of Munich) · Cited by 8
Metadata
- Authors
- Goldstein, B. A., Navar, A. M., Pencina, M. J., & Ioannidis, J. P. A.
- Affiliations
- Duke University (US)
- Center for Predictive Medicine, Duke Clinical Research Institute, Duke University, Durham, NC 27710, USA
- Stanford University (US)
- Venue
- Journal of the American Medical Informatics Association
- Publisher
- Oxford University Press (OUP)
- Published
- 2016-05-17
- Volume
- 24
- Issue
- 1
- Pages
- 198-208
- ISSN
- 1067-5027 (ISSN-L)
- 1527-974X
- PMC
- PMC5201180
- OpenAlex
- W2395172628
- Cited by
- 936
- References
- 144
- Citations by year
- 2026: 132 · 2025: 115 · 2024: 97 · 2023: 98 · 2022: 107 · 2021: 122 · 2020: 100 · 2019: 82 · 2018: 59 · 2017: 15 · 2016: 6
- FWCI
- 9.07
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Journal of the American Medical Informatics Association (publishedVersion)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- HighWire Press Open Archive (submittedVersion)
- Funders
- National Institute of Diabetes and Digestive and Kidney Diseases (K25DK097279)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning in Healthcare
- Health Sciences › Health Professions › Health Information Management › Electronic Health Records Systems
- Health Sciences › Health Professions › Health Information Management › Medical Coding and Health Information
- Keywords
- electronic health records, clinical risk prediction, risk prediction model, model validation, multicenter validation, longitudinal data, missing data, loss to follow-up, model reproducibility, concordance index, mortality prediction, hospitalization prediction, service utilization
- MeSH terms
- Humans, Models, Statistical, Risk Assessment, Electronic Health Records
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.