Opportunities and challenges in developing risk prediction models with electronic health records data: a systematic review
Open accessThe DOI matches its Crossref record; 141 of the 144 references it cites were found in a registry or an index.
Abstract
Objective: Electronic health records (EHRs) are an increasingly common data source for clinical risk prediction, presenting both unique analytic opportunities and challenges. We sought to evaluate the current state of EHR based risk prediction modeling through a systematic review of clinical prediction studies using EHR data. Methods: We searched PubMed for articles that reported on the use of an EHR to develop a risk prediction model from 2009 to 2014. Articles were extracted by two reviewers, and we abstracted information on study design, use of EHR data, model building, and performance from each publication and supplementary documentation. Results: We identified 107 articles from 15 different countries. Studies were generally very large (median sample size = 26 100) and utilized a diverse array of predictors. Most used validation techniques (n = 94 of 107) and reported model coefficients for reproducibility (n = 83). However, studies did not fully leverage the breadth of EHR data, as they uncommonly used longitudinal information (n = 37) and employed relatively few predictor variables (median = 27 variables). Less than half of the studies were multicenter (n = 50) and only 26 performed validation across sites. Many studies did not fully address biases of EHR data such as missing data or loss to follow-up. Average c-statistics for different outcomes were: mortality (0.84), clinical prediction (0.83), hospitalization (0.71), and service utilization (0.71). Conclusions: EHR data present both opportunities and challenges for clinical risk prediction. There is room for improvement in designing such studies.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“In spite of the richness and potential of available data, scaling the development of predictive models is difficult because, for traditional predictive modeling techniques, each outcome to be predicted requires the creation of a custom dataset with specific variables.7”
From Scalable and accurate deep learning with electronic health records (2018) · cites this paper as [7]
In the citing paper
“Despite the rich data now digitized in EHRs,20 a recent systematic review of the medical literature7 found that predictive models built with EHR data use a median of only 27 variables, rely on traditional generalized linear models, and are built using data at a single center.”
From Scalable and accurate deep learning with electronic health records (2018) · cites this paper as [7]
In the citing paper
“Although external validation is recognized as an area of improvement for clinical risk prediction models [85]”
Citations
Cites
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000100 · Cited by 28,164
Self-citationDermyshi, E., Wang, Y., Yan, C., Hong, W., Qiu, G., Gong, X., & Zhang, T. (2017) · Neonatology · doi:10.1159/000454668 · Cited by 24,451
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2009.06.006 · Cited by 10,578
Self-citationPrediction of coronary heart disease using risk factor categories
Wilson, P. W. F., D’Agostino, R. B., Levy, D., Belanger, A. M., Silbershatz, H., & Kannel, W. B. (1998) · Circulation · doi:10.1161/01.cir.97.18.1837 · Cited by 9,581 · cited 2×
“Traditionally, risk pre- diction algorithms have been developed from large cohort studies such as the Framingham Heart Study.3 These studies were designed to follow people for years or even decades.”
MethodMoons, K. G. M., Altman, D. G., Reitsma, J. B., Ioannidis, J. P. A., Macaskill, P., Steyerberg, E. W., Vickers, A. J., Ransohoff, D. F., & Collins, G. S. (2015) · Annals of Internal Medicine · doi:10.7326/m14-0698 · Cited by 5,147
Self-citationCollins, G. S., Reitsma, J. B., Altman, D. G., & Moons, K. G. M. (2015) · British Journal of Cancer · doi:10.1038/bjc.2014.639 · Cited by 3,293
Joint modelling of longitudinal measurements and event time data
Henderson, R. (2000) · Biostatistics · doi:10.1093/biostatistics/1.4.465 · Cited by 913
The Electronic Medical Records and Genomics (eMERGE) Network: past, present, and future
Gottesman, O., Kuivaniemi, H., Tromp, G., Faucett, W. A., Li, R., Manolio, T. A., Sanderson, S. C., Kannry, J., Zinberg, R., Basford, M. A., et al. (2013) · Genetics in Medicine · doi:10.1038/gim.2013.72 · Cited by 698
Statistical Evaluation of Prognostic versus Diagnostic Models: Beyond the ROC Curve
Cook, N. R. (2008) · Clinical Chemistry · doi:10.1373/clinchem.2007.096529 · Cited by 691
Research works printed but not linked: 1
- Liu, 2010, Length of stay predictions: improvements through the use of automated laboratory and comorbidity variables, Med Care., 48, 739, 10.1097/mlr.0b013e3181e359f3 · DOI · Paper page
Cited by
Items 601–700 of 1,000
An unsupervised embedding harmonization system for privacy-preserving data mining in healthcare
Li, M., Lin, Y., Chen, H., & Aparasu, R. R. (2023) · IISE Transactions on Healthcare Systems Engineering · doi:10.1080/24725579.2023.2231011 · Cited by 4
Oborotov, G. A., Koshechkin, K. A., & Orlov, Y. L. (2023) · Berichte aus der medizinischen Informatik und Bioinformatik/Journal of integrative bioinformatics · doi:10.1515/jib-2023-0014 · Cited by 4
Windle, N., Alam, A., Patel, H., Street, J. M., Lathwood, M., Farrington, T., & Maruthappu, M. (2024) · Home Health Care Management & Practice · doi:10.1177/10848223241253839 · Cited by 4
Using the Electronic Health Record to Develop a Gastric Cancer Risk Prediction Model
Kim, M. K., Rouphael, C., Wehbe, S., Yoon, J. Y., Wisnivesky, J. P., McMichael, J., Welch, N., Dasarathy, S., & Zabor, E. C. (2024) · Gastro Hep Advances · doi:10.1016/j.gastha.2024.07.001 · Cited by 4
C-LIME: A Consistency-Oriented LIME for Time-Series Health-Risk Predictions
Ito, T., Ochiai, K., & Fukazawa, Y. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-69886-7_5 · Cited by 4
Hien, N. T., Tsai, F., Chang, Y.-H., Burton, W., Phuc, P. T., Nguyen, P., Harnod, D., Lam, C., Lu, T., Chen, C.-I., et al. (2024) · Frontiers in Medicine · doi:10.3389/fmed.2023.1289968 · Cited by 4
Quantifying risk factors in medical reports with a context-aware linear model
Przybyła, P., Brockmeier, A. J., & Ananiadou, S. (2019) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocz004 · Cited by 4
Development of medical records exchange system - a case of OpenMRS and Care2X
Rweikiza, G., & Machuve, D. Z. (2019) · International Journal of Advanced Technology and Engineering Exploration · doi:10.19101/ijatee.2019.650011 · Cited by 4
Adams, K., Howe, J. L., Gaunt, M. J., Ratwani, R. M., & Fong, A. (2019) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/1071181319631410 · Cited by 4
CRcoder: An Interactive Web Application and SAS Macro to Support Personalized Clinical Decisions
McAvay, G., Murphy, T. E., Agogo, G. O., & Allore, H. G. (2019) · The Permanente Journal · doi:10.7812/tpp/19.078 · Cited by 4
Applying Quantitative Approaches in the Use of RWE in Clinical Development and Life-Cycle Management
He, W., Fang, Y., Wang, H., & Chan, I. S. F. (2021) · Statistics in Biopharmaceutical Research · doi:10.1080/19466315.2021.1927827 · Cited by 4
Deriving Weight From Big Data: Comparison of Body Weight Measurement–Cleaning Algorithms
Evans, R. R., Burns, J., Damschroder, L. J., Annis, A., Freitag, M. B., Raffa, S. D., & Wiitala, W. L. (2022) · JMIR Medical Informatics · doi:10.2196/30328 · Cited by 4
Deardorff, W. J., Jing, B., Jeon, S. Y., Boscardin, W. J., Lee, A. K., Fung, K. Z., & Lee, S. J. (2022) · BMC Geriatrics · doi:10.1186/s12877-022-03126-z · Cited by 4
“Think Outside of Box” - Ten Commandments in Providing Optimal Health Informatics Education
Patel, J. S., Dzomba, B. J., & Wu, H. (2022) · IEEE International Conference on Healthcare Informatics (ICHI) · doi:10.1109/ichi54592.2022.00115 · Cited by 4
Tele‐Health Monitoring Using Artificial Intelligence Deep Learning Framework
Verma, S., Malviya, R., Alam, A., & Tripathi, B. D. (2022) · Wiley eBooks · doi:10.1002/9781119857983.ch7 · Cited by 4
Martin, G. P., & Mamas, M. A. (2018) · Cardiovascular Research · doi:10.1093/cvr/cvy290 · Cited by 4
Fournaise, A., Lauridsen, J. T., Bech, M., Wiil, U. K., Rasmussen, J. B., Kidholm, K., Espersen, K., & Andersen‐Ranberg, K. (2021) · BMC Geriatrics · doi:10.1186/s12877-021-02092-2 · Cited by 4
Predicting the future of cardiovascular risk prediction
Banerjee, A. (2017) · Heart · doi:10.1136/heartjnl-2016-311141 · Cited by 4
Perspectives and solutions towards intelligent ambient assisted living systemsPreprint
Sun, H., & Florio, V. D. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2102.13173 · Cited by 4
Pate, A., Emsley, R., Ashcroft, D. M., Brown, B. C., & van Staa, T. P. (2019) · BMC Medicine · doi:10.1186/s12916-019-1404-8 · Cited by 4
Patient Similarity Analytics for Explainable Clinical Risk PredictionPreprint
Fang, H. S. A., Tan, N. C., Tan, W. Y., Oei, R. W., Lee, M. L., & Hsu, W. (2021) · Research Square · doi:10.21203/rs.3.rs-147408/v1 · Cited by 4
Albu, E., Gao, S., Stijnen, P., Rademakers, F. E., Janssens, C., Cossey, V., Debaveye, Y. A., Wynants, L., & CALSTER, B. V. (2024) · Research Square · doi:10.21203/rs.3.rs-4527690/v1 · Cited by 4
CliMB: An AI-enabled Partner for Clinical Predictive ModelingPreprint
Saveliev, E., Schubert, T., Pouplin, T., Kosmoliaptsis, V., & van der Schaar, M. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2410.03736 · Cited by 4
Silva (2023) · doi:10.37689/acta-ape/2023ao00771 · Cited by 3
Robust extraction of pneumonia-associated clinical states from electronic health records
Xu, F., Morales, F. L., & Amaral, L. A. N. (2024) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2417688121 · Cited by 3
Thornton, B., Patel, K. P., Ma, B., & Castro-Núñez, J. (2025) · International Journal of Oral and Maxillofacial Surgery · doi:10.1016/j.ijom.2025.10.005 · Cited by 3
Park, J., Pang, C., Lee, T. Y., Yang, J. Y., Berkowitz, J. S., Wei, A. Z., & Tatonetti, N. P. (2026) · npj Precision Oncology · doi:10.1038/s41698-026-01483-1 · Cited by 3
Ronaghi, S., Choudhary, P., Rehkopf, D. H., & Lin, B. Y. (2025) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc58623.2025.11254798 · Cited by 3
Identifying Patients at High Risk for Colorectal Carcinoma Using the Electronic Health Record
Ahuja, Y., Meng, X., & Shaukat, A. (2025) · Digestive Diseases and Sciences · doi:10.1007/s10620-025-09615-6 · Cited by 3
Chowdhury, M. R. K., Rashid, M., Stub, D. A., Dinh, D., Karim, M. N., & Billah, B. (2025) · Methods and Protocols · doi:10.3390/mps8060148 · Cited by 3
Dinc, R., & Ardıç, N. (2025) · Life · doi:10.3390/life15121916 · Cited by 3
Digital Healing for Diabetic Disabilities: Tools for Monitoring, Mobility, and Self-Management
Adhikary, K., Ganguly, K., Maity, M. D., Mahata, P., & Samson, O. J. (2026) · Springer eBooks · doi:10.1007/978-981-95-8946-3_12 · Cited by 3
Jiang, X.-Z., Guo, L.-J., Zhang, M.-T., Ji, G.-L., Liu, H.-T., Zheng, Y., & Zhou, J. (2026) · Frontiers in Cardiovascular Medicine · doi:10.3389/fcvm.2026.1846105 · Cited by 3
External Validation of the PREVENT Equations in a National Sample of US Adults
Khan, S. S., Sang, Y., Huang, X., Petito, L. C., Hong, C., Pencina, M. J., Ballew, S. H., Grams, M. E., Ndumele, C. E., Lloyd‐Jones, D. M., et al. (2026) · Circulation Population Health and Outcomes · doi:10.1161/circoutcomes.125.012988 · Cited by 3
Self-citationKamulegeya, R., Nabatanzi, R., Semugenze, D., Mugala, F., Takuwa, M., Nasinghe, E., Musinguzi, D., Namiiro, S. M., Katumba, A., Ssengooba, W., et al. (2026) · PLoS ONE · doi:10.1371/journal.pone.0355124 · Cited by 3
Electronic Health Data Quality and Population Health Management Algorithms
Predmore, Z., & Fischer, S. H. (2021) · Population Health Management · doi:10.1089/pop.2021.0170 · Cited by 3
Ton, A. T., & Hah, R. J. (2023) · Seminars in Spine Surgery · doi:10.1016/j.semss.2023.101031 · Cited by 3
Kanning, J. P., van Os, H. J. A., Rakers, M. M., Wermer, M. J. H., Geerlings, M. I., & Ruigrok, Y. M. (2024) · PLoS ONE · doi:10.1371/journal.pone.0303868 · Cited by 3
O’Neill, M., Hurst, M., Pagalan, L., Diemert, L. M., Kornas, K., Fisher, S., Hong, A., Manuel, D. G., & Rosella, L. C. (2024) · BMJ Public Health · doi:10.1136/bmjph-2023-000377 · Cited by 3
Data-Driven Decision Management: Multi-Modal Analytics in a Health Case Study
Agomuo, O. C., Khan, Z., Otuomasirichi, A. I., Uzoma, A. K., & Muzamal, J. H. (2025) · International Conference on Ubiquitous Information Management and Communication (IMCOM) · doi:10.1109/imcom64595.2025.10857526 · Cited by 3
Ip, S., Harrison, H., Usher‐Smith, J. A., Barclay, M., Tyrer, J. P., Dennis, J., Yang, X., Lush, M. J., Renzi, C., Pashayan, N., et al. (2025) · BMJ Oncology · doi:10.1136/bmjonc-2024-000336 · Cited by 3
Yan, C., Grabowska, M. E., Thakkar, R., Dickson, A. L., Embí, P. J., Feng, Q., Denny, J. C., Kerchberger, V. E., Malin, B., & Wei, W. (2025) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocaf055 · Cited by 3
Enhancing Predictive Healthcare Using AI-Driven Early Warning Systems
Arsalan, H. (2025) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v39i28.35326 · Cited by 3
Li, Y., Wang, X., & Liu, X. (2025) · Scientific Reports · doi:10.1038/s41598-025-10906-1 · Cited by 3
Albu, E., Gao, S., Stijnen, P., Rademakers, F. E., Janssens, C., Cossey, V., Debaveye, Y. A., Wynants, L., & CALSTER, B. V. (2025) · Diagnostic and Prognostic Research · doi:10.1186/s41512-025-00194-8 · Cited by 3
Singh, K., Thibodeau, A., Niziol, L. M., Nakai, T. K., Bixler, J. E., Khan, M., & Woodward, M. A. (2021) · Cornea · doi:10.1097/ico.0000000000002877 · Cited by 3
Validating pertussis data measures using electronic medical record data in Ontario, Canada 1986–2016
McBurney, S. H., Kwong, J. C., Brown, K. A., Rudzicz, F., Chen, B., Candido, E., & Crowcroft, N. S. (2023) · Vaccine X · doi:10.1016/j.jvacx.2023.100408 · Cited by 3
Endebu, T., Taye, G., Addissie, A., Deksisa, A., & Deressa, W. A. (2024) · Discover Health Systems · doi:10.1007/s44250-024-00092-8 · Cited by 3
Indhumathi, V., Sankaradass, V., & Manish, V. K. M. (2025) · International Conference on Data Science, Agents & Artificial Intelligence (ICDSAAI) · doi:10.1109/icdsaai65575.2025.11011716 · Cited by 3
Lu, X., Zeng, C., Gong, Z., Jin, R., Zhang, Z., Liu, K., Hu, N., Xiao, J., & Xiong, Y. (2025) · International Journal of Surgery · doi:10.1097/js9.0000000000003427 · Cited by 3
Machine learning models for predicting dosing of oral anticoagulants: a systematic review
Barras, M. A., Hanjani, L. S., Scott, I. A., Abdel‐Hafez, A., & Falconer, N. (2025) · Journal of Pharmacy Practice and Research · doi:10.1002/jppr.70054 · Cited by 3
Developing the Interpretability of Deep Artificial Neural Network on Application Problems
Yang, S.-A., & Yang, M.-H. (2019) · International Conference on Machine Learning and Cybernetics · doi:10.1109/icmlc48188.2019.8949230 · Cited by 3
Wang, Z., Sun, H., Zhao, D., & Jiang, T. (2020) · IEEE Access · doi:10.1109/access.2020.2981119 · Cited by 3
McBurney, S. H., Kwong, J. C., Brown, K. A., Rudzicz, F., Chen, B., Candido, E., & Crowcroft, N. S. (2022) · Annals of Epidemiology · doi:10.1016/j.annepidem.2022.11.002 · Cited by 3
Chang, Y., & Hu, C. (2022) · Medical Education · doi:10.1111/medu.14990 · Cited by 3
Smith, L., Carmichael, J., Cook, G., Shinkins, B., & Neal, R. D. (2023) · Cancers · doi:10.3390/cancers15030975 · Cited by 3
van Os, H. J. A., Kanning, J. P., Ferrari, M. D., Bonten, T. N., Kist, J. M., Vos, H. M. M., Vos, R. C., Putter, H., Groenwold, R. H. H., & Wermer, M. J. H. (2023) · Neurology · doi:10.1212/wnl.0000000000207513 · Cited by 3
Immune-unreactive urinary albumin as a predictor of cardiovascular events: the Hortega Study
Martínez, F., Pichler, G., Ruiz-Hernandez, A., Martín-Escudero, J. C., Chaves, F. J., González-Albert, V., Téllez-Plaza, M., Heerspink, H. J. L., de Zeeuw, D., & Redón, J. (2018) · Nephrology Dialysis Transplantation · doi:10.1093/ndt/gfy087 · Cited by 3
Sepsis surveillance: an examination of parameter sensitivity and alert reliability
Amland, R. C., Burghart, M., & Overhage, J. M. (2019) · JAMIA Open · doi:10.1093/jamiaopen/ooz014 · Cited by 3
Stachel, A. G. (2020) · CUNY Academic Works (City University of New York) · doi:10.5281/zenodo.3839988 · Cited by 3
Finding Rare Disease Patients in EHR Databases via Lightly-Supervised LearningPreprint
Colbaugh, R., & Glass, K. (2020) · medRxiv · doi:10.1101/2020.07.06.20147322 · Cited by 3
Utilizing Electronic Dental Record Data to Track Periodontal Disease Change
Patel, J. S. (2020) · IUScholarWorks (Indiana University) · doi:10.7912/c2/958 · Cited by 3
Faisal, A. A., Lannou, E. L., Post, B., Haar, S., Brett, S. J., & Kadirvelu, B. (2021) · Research Square · doi:10.21203/rs.3.rs-374482/v1 · Cited by 3
Imputation Strategies Under Clinical Presence: Impact on Algorithmic FairnessPreprint
Jeanselme, V., De‐Arteaga, M., Zhang, Z., Barrett, J., & Tom, B. D. M. (2022) · arXiv (Cornell University) · doi:10.17863/cam.92891 · Cited by 3
Trottet, C., Vogels, T., Keitel, K., Kulunkina, A. V., Tan, R., Cobuccio, L. G., Jaggi, M., & Hartley, M. (2022) · medRxiv · doi:10.1101/2022.08.17.22278908 · Cited by 3
Towards coordination and tailoring of hospital care for patients with multimorbidity
Verhoeff, M. (2023) · University of Groningen research database (University of Groningen / Centre for Information Technology) · doi:10.33612/diss.559042304 · Cited by 4
Wang, W. K., Yang, R., Pang, C., Natarajan, K., Liu, N., McDuff, D., Slotwiner, D. J., Wang, F., McDermott, M. B. A., & Xu, X. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2509.22920 · Cited by 3
Temporal graph-based convolutional neural networks for electronic health records
Hancox, Z. (2025) · White Rose eTheses Online (University of Leeds, The University of Sheffield, University of York) · Cited by 3
Precision public health – A critical review of the opportunities and obstacles
Kneale, D., Lorenc, T., O’Mara-Eves, A., Hong, Q., Sutcliffe, K., Sowden, A., & Thomas, J. (2020) · UCL Discovery (University College London) · Cited by 3
Joint Score-Threshold Optimization for Interpretable Risk AssessmentPreprint
Ganjkhanloo, F., Springer, E., Hoyer, E. H., Young, D. L., & Ghobadi, K. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2510.21934 · Cited by 3
Automatic Construction of Clinical Scoring Systems with LLM AgentsPreprint
Estévez, S. R., Chiu, C., & van der Schaar, M. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2601.22324 · Cited by 3
Green artificial intelligence to automate medical diagnosis with low energy consumption
Henao, J. A. G. (2021) · theses.fr (ABES) · doi:10.70675/c9683e60z640az42a7zaf83ze2c47909d110 · Cited by 3
Tan, J., Liu, C., Yang, M. A., Xiong, Y., Huang, S., Qi, Y., Chen, M., Thabane, L., Liu, X., He, L., et al. (2022) · Acta Obstetricia Et Gynecologica Scandinavica · doi:10.1111/aogs.14757 · Cited by 2
Wassell, M., Vitiello, A., Butler-Henderson, K. A., Verspoor, K. M., & Pollard, H. P. (2024) · Journal of Occupational Rehabilitation · doi:10.1007/s10926-024-10196-w · Cited by 2
Khalifa, M., Magrabi, F., & Gallego, B. (2024) · Computer Methods and Programs in Biomedicine Update · doi:10.1016/j.cmpbup.2024.100161 · Cited by 2
Lin, S., Hsu, Y., Kim, J. S., Jackson, J. W., & Segal, J. B. (2024) · Journal of General Internal Medicine · doi:10.1007/s11606-024-09068-z · Cited by 2
Alamery, M. M., Alatawi, H. O. E., Alruwaili, I. D., Alanazi, H. D. S., Alsumairy, S. S. M., Gharawi, A. A. Y., .Aldossary, A. N. A., Alwayni, H. M. Y., Thiyabi, S. S. S. A., & alinazy, A. E. (2024) · Saudi Journal of Medicine and Public Health · doi:10.64483/202412443 · Cited by 2
Alfakhri, A., Almadani, O. A., Asiri, I. M., Alsuhebany, N., Alanazi, A., & Althunian, T. A. (2026) · JCO Clinical Cancer Informatics · doi:10.1200/cci-25-00248 · Cited by 2
Machine Learning in Cardiology: Assessing Model Reliability for Real world Deployment
Divya, K. S., Mohebbanaaz, & Hussain, G. F. (2025) · International Conference on Computing, Communication and Automation · doi:10.1109/iccca66364.2025.11325131 · Cited by 2
Hooker, S. A., Rossom, R. C., Haapala, J. L., Crain, A. L., Miley, K. M., Olson, A. W., Kane, S. M., Christensen, K. S., O’Connor, P. J., Bart, G. B., et al. (2026) · Journal of General Internal Medicine · doi:10.1007/s11606-026-10257-1 · Cited by 2
Saksenberg, D., Lee, R., Vaidya, S., Yuan, A., Jeong, S., Lockwood, N., Li, J. L., & Russo, G. S. (2026) · Journal of Pain Research · doi:10.2147/jpr.s596384 · Cited by 2
Validation of a Risk‐Prediction Model in the Presence of Outcome Misclassification
Zou, R., Williamson, B. D., Shortreed, S. M., & Coley, R. Y. (2026) · Statistics in Medicine · doi:10.1002/sim.70377 · Cited by 2
Laevens, B. P. M., Meeßen, C., Pijpers, F. P., Bruns, T., Chen, Y., Loomba, R., Jakhar, N., Arning, K., Schneider, K. M., & Schneider, C. V. (2026) · JHEP Reports · doi:10.1016/j.jhepr.2026.101846 · Cited by 2
Opportunities and Challenges in Using National EHR Networks for AI in Learning Health Systems
Kukhareva, P., Gouripeddi, R., Peek, N. B., & Kawamoto, K. (2026) · Learning Health Systems · doi:10.1002/lrh2.70090 · Cited by 2
Hybrid Methods for Feature Selection Algorithms in the Field of Medical Records
Syahidin, Y., & Suryani, A. I. (2023) · International Journal of Psycology and Health Science · doi:10.38035/ijphs.v1i3.339 · Cited by 2
Yata, V. K., Jena, S., Indracanti, M., Chitta, S., & Kolliputi, N. (2026) · Frontiers in Digital Health · doi:10.3389/fdgth.2026.1816806 · Cited by 2
Risk-Guided Screening for Atrial Fibrillation Using Electronic Health Records
Nadarajah, R., Wu, J., Wahab, A., Reynolds, C., Haris, M., Joseph, T., Raveendra, K., Hurdus, B., Kazi, K., Bennett, S., et al. (2026) · Circulation · doi:10.1161/circulationaha.126.079391 · Cited by 2
Lee, G.-M., Won, J.-Y., Cho, E. Y., Kim, J., Kim, K. J., Lee, Y. S., Lee, H. J., & Kim, J. (2026) · Journal of Medical Internet Research · doi:10.2196/95665 · Cited by 2
Wang, Y., Xu, Y., Peng, J., Hao, M., Huang, L., Yao, Z., Ruan, H., Leng, J., Yin, W., Yang, Y., et al. (2026) · Journal of the American Heart Association · doi:10.1161/jaha.126.050956 · Cited by 2
Kaleta, M., Niederkrotenthaler, T., Kautzky‐Willer, A., & Klimek, P. (2020) · JMIR Medical Informatics · doi:10.2196/18147 · Cited by 2
Cao, L., Huang, Y.-S. V., Getz, K., Seif, A. E., Ruiz, J., Miller, T. P., Fisher, B. T., Aplenc, R., & Li, Y. (2024) · Pediatric Blood & Cancer · doi:10.1002/pbc.30858 · Cited by 2
Methodological Challenges for Risk Prediction in Perinatal Epidemiology
Grandi, S. M., Hutcheon, J. A., Filion, K. B., & Platt, R. W. (2018) · Current Epidemiology Reports · doi:10.1007/s40471-018-0173-9 · Cited by 2
CATAN: Chart-aware temporal attention network for adverse outcome prediction
Gero, Z., & Ho, J. C. (2021) · IEEE International Conference on Healthcare Informatics (ICHI) · doi:10.1109/ichi52183.2021.00024 · Cited by 2
Sequeira, L., McNair, D., Wiljer, D., Strudwick, G., Luca, V. D., Kailasam, K., Thompson, M., Chou, B., & Strauss, J. (2022) · Studies in health technology and informatics · doi:10.3233/shti220140 · Cited by 2
kingdom of Saudi Arabia, M. O. H.-D. O. H. A. I. J., Alzhrani, H., Alyoubi, B., kingdom of Saudi Arabia, M. O. H.-D. O. H. A. I. J., Assiri, M., kingdom of Saudi Arabia, M. O. H.-D. O. H. A. I. J., Aljuaid, A., kingdom of Saudi Arabia, M. O. H.-D. O. H. A. I. J., Aljohani, S., kingdom of Saudi Arabia, M. O. H.-D. O. H. A. I. J., et al. (2022) · International Journal of Medical Science and Clinical Research Studies · doi:10.47191/ijmscrs/v2-i12-28 · Cited by 2
Hugo, J., Ibing, S., Borchert, F., Sachs, J. P., Cho, J. H., Ungaro, R. C., & Böttinger, E. P. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-34344-5_35 · Cited by 2
Role of Artificial Intelligence in Telemedicine
Patel, P. S. (2023) · International Journal for Research in Applied Science and Engineering Technology · doi:10.22214/ijraset.2023.55211 · Cited by 2
Yan, M., Hong, H., Wilson, J. A., & Goldstein, B. A. (2025) · American Journal of Epidemiology · doi:10.1093/aje/kwaf013 · Cited by 2
Self-citationSyahidin, Y., & Suryani, A. I. (2025) · Dinasti International Journal of Education Management And Social Science · doi:10.38035/dijemss.v6i3.4024 · Cited by 2
Metadata
- Authors
- Goldstein, B. A., Navar, A. M., Pencina, M. J., & Ioannidis, J. P. A.
- Affiliations
- Duke University (US)
- Center for Predictive Medicine, Duke Clinical Research Institute, Duke University, Durham, NC 27710, USA
- Stanford University (US)
- Venue
- Journal of the American Medical Informatics Association
- Publisher
- Oxford University Press (OUP)
- Published
- 2016-05-17
- Volume
- 24
- Issue
- 1
- Pages
- 198-208
- ISSN
- 1067-5027 (ISSN-L)
- 1527-974X
- PMC
- PMC5201180
- OpenAlex
- W2395172628
- Cited by
- 936
- References
- 144
- Citations by year
- 2026: 132 · 2025: 115 · 2024: 97 · 2023: 98 · 2022: 107 · 2021: 122 · 2020: 100 · 2019: 82 · 2018: 59 · 2017: 15 · 2016: 6
- FWCI
- 9.07
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Journal of the American Medical Informatics Association (publishedVersion)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- HighWire Press Open Archive (submittedVersion)
- Funders
- National Institute of Diabetes and Digestive and Kidney Diseases (K25DK097279)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning in Healthcare
- Health Sciences › Health Professions › Health Information Management › Electronic Health Records Systems
- Health Sciences › Health Professions › Health Information Management › Medical Coding and Health Information
- Keywords
- electronic health records, clinical risk prediction, risk prediction model, model validation, multicenter validation, longitudinal data, missing data, loss to follow-up, model reproducibility, concordance index, mortality prediction, hospitalization prediction, service utilization
- MeSH terms
- Humans, Models, Statistical, Risk Assessment, Electronic Health Records
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.