Opportunities and challenges in developing risk prediction models with electronic health records data: a systematic review
Open accessThe DOI matches its Crossref record; 141 of the 144 references it cites were found in a registry or an index.
Abstract
Objective: Electronic health records (EHRs) are an increasingly common data source for clinical risk prediction, presenting both unique analytic opportunities and challenges. We sought to evaluate the current state of EHR based risk prediction modeling through a systematic review of clinical prediction studies using EHR data. Methods: We searched PubMed for articles that reported on the use of an EHR to develop a risk prediction model from 2009 to 2014. Articles were extracted by two reviewers, and we abstracted information on study design, use of EHR data, model building, and performance from each publication and supplementary documentation. Results: We identified 107 articles from 15 different countries. Studies were generally very large (median sample size = 26 100) and utilized a diverse array of predictors. Most used validation techniques (n = 94 of 107) and reported model coefficients for reproducibility (n = 83). However, studies did not fully leverage the breadth of EHR data, as they uncommonly used longitudinal information (n = 37) and employed relatively few predictor variables (median = 27 variables). Less than half of the studies were multicenter (n = 50) and only 26 performed validation across sites. Many studies did not fully address biases of EHR data such as missing data or loss to follow-up. Average c-statistics for different outcomes were: mortality (0.84), clinical prediction (0.83), hospitalization (0.71), and service utilization (0.71). Conclusions: EHR data present both opportunities and challenges for clinical risk prediction. There is room for improvement in designing such studies.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“In spite of the richness and potential of available data, scaling the development of predictive models is difficult because, for traditional predictive modeling techniques, each outcome to be predicted requires the creation of a custom dataset with specific variables.7”
From Scalable and accurate deep learning with electronic health records (2018) · cites this paper as [7]
In the citing paper
“Despite the rich data now digitized in EHRs,20 a recent systematic review of the medical literature7 found that predictive models built with EHR data use a median of only 27 variables, rely on traditional generalized linear models, and are built using data at a single center.”
From Scalable and accurate deep learning with electronic health records (2018) · cites this paper as [7]
In the citing paper
“Although external validation is recognized as an area of improvement for clinical risk prediction models [85]”
Citations
Cites
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000100 · Cited by 28,164
Self-citationDermyshi, E., Wang, Y., Yan, C., Hong, W., Qiu, G., Gong, X., & Zhang, T. (2017) · Neonatology · doi:10.1159/000454668 · Cited by 24,451
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2009.06.006 · Cited by 10,578
Self-citationPrediction of coronary heart disease using risk factor categories
Wilson, P. W. F., D’Agostino, R. B., Levy, D., Belanger, A. M., Silbershatz, H., & Kannel, W. B. (1998) · Circulation · doi:10.1161/01.cir.97.18.1837 · Cited by 9,581 · cited 2×
“Traditionally, risk pre- diction algorithms have been developed from large cohort studies such as the Framingham Heart Study.3 These studies were designed to follow people for years or even decades.”
MethodMoons, K. G. M., Altman, D. G., Reitsma, J. B., Ioannidis, J. P. A., Macaskill, P., Steyerberg, E. W., Vickers, A. J., Ransohoff, D. F., & Collins, G. S. (2015) · Annals of Internal Medicine · doi:10.7326/m14-0698 · Cited by 5,147
Self-citationCollins, G. S., Reitsma, J. B., Altman, D. G., & Moons, K. G. M. (2015) · British Journal of Cancer · doi:10.1038/bjc.2014.639 · Cited by 3,293
Joint modelling of longitudinal measurements and event time data
Henderson, R. (2000) · Biostatistics · doi:10.1093/biostatistics/1.4.465 · Cited by 913
The Electronic Medical Records and Genomics (eMERGE) Network: past, present, and future
Gottesman, O., Kuivaniemi, H., Tromp, G., Faucett, W. A., Li, R., Manolio, T. A., Sanderson, S. C., Kannry, J., Zinberg, R., Basford, M. A., et al. (2013) · Genetics in Medicine · doi:10.1038/gim.2013.72 · Cited by 698
Statistical Evaluation of Prognostic versus Diagnostic Models: Beyond the ROC Curve
Cook, N. R. (2008) · Clinical Chemistry · doi:10.1373/clinchem.2007.096529 · Cited by 691
Research works printed but not linked: 1
- Liu, 2010, Length of stay predictions: improvements through the use of automated laboratory and comorbidity variables, Med Care., 48, 739, 10.1097/mlr.0b013e3181e359f3 · DOI · Paper page
Cited by
Items 801–900 of 1,000
Leung, E. K. H., Guan, J., Kwok, K. O., Hung, C., Ching, C., Chong, K., Yam, C., Sun, T., Tsang, W., Yeoh, E., et al. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2403.15759 · Cited by 1
Real-Time Clinical Decision Support Systems for the Prevention of Deterioration in Acute Care
Blythe, R. D. (2024) · Queensland University of Technology · doi:10.5204/thesis.eprints.251291 · Cited by 1
Turki, H., Pasha, N. A., Altammami, A., & Alzahrani, A. (2025) · Research Square · doi:10.21203/rs.3.rs-7660197/v1 · Cited by 1
Prediction of Survival Outcomes under Clinical Presence Shift: A Joint Neural Network ArchitecturePreprint
Jeanselme, V., Martin, G. P., Sperrin, M., Peek, N. B., Tom, B. D. M., & Barrett, J. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2508.05472 · Cited by 1
Machine Learning for Diabetes and Mortality Risk Prediction From Electronic Health Records
Alhassan, Z. (2021) · Durham e-Theses (Durham University) · Cited by 1
Huang, X. (2023) · Keele Research Repository (Keele University) · Cited by 1
da Silva, D. D. C. S. A. (2023) · LA Referencia (Red Federada de Repositorios Institucionales de Publicaciones Científicas) · Cited by 1
Imputation of Unknown Missingness in Sparse Electronic Health RecordsPreprint
Han, J., Nassar, J., Batra, S. S., Córdova‐Palomera, A., Nori, V. S., & Tillman, R. E. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2602.20442 · Cited by 1
Johnson, R. (2023) · TSpace (University of Toronto) · Cited by 1
Knowledge graphs based extension of patients’ folders to predict hospitalization
Gazzotti, R. (2020) · theses.fr (ABES) · doi:10.70675/1561fa3aza142z439bz889azfc4c786a066e · Cited by 1
MedicalBench: Evaluating Large Language Models Towards Improved Medical Concept ExtractionPreprint
Yang, Z., Lyng, G. D., Batra, S. S., & Tillman, R. E. (2026) · SSRN Electronic Journal · doi:10.64898/2026.04.12.26350704 · Cited by 1
Moriyama, K. (2026) · Research Square · doi:10.21203/rs.3.rs-8571942/v1 · Cited by 1
The Role of Pharmacoepidemiology in Industry
Mo, J., Gatto, N. M., Sobel, R. E., & Reynolds, R. F. (2012) · Wiley eBooks · doi:10.1002/9781119959946.ch7
Genetic Variation and the Electrocardiograph: From Genome-Wide Association Studies to the Patient
Hedley, P. L., Hagen, C. M., & Christiansen, M. (2018) · Circulation Genomic and Precision Medicine · doi:10.1161/circgen.118.002164
Gardner, B. J. (2018) · DigitalCommons@UNMC
Colubri, A., Hartley, M., Siakor, M., Wolfman, V., Sesay, T., Felix, A., Levine, A. C., & Sabeti, P. C. (2018) · SSRN Electronic Journal · doi:10.2139/ssrn.3250927
Driving the Point Home: Novel Approaches to Mitigate Crash Risk for Patients With ADHD
Raman, S. R., Engelhard, M., & Kollins, S. H. (2019) · PEDIATRICS · doi:10.1542/peds.2019-0820
Bhattacharya, M. (2019) · Library, Museums and Press - UDSpace (University of Delaware) · doi:10.58088/80mf-0p88
Aprendizado de máquina para análise de recaída para depressão em pacientes com transtorno bipolar
Júnior, B., & Gomes, R. (2018) · Americanae (AECID Library)
Fermont, J. M. (2019) · Apollo (University of Cambridge) · doi:10.17863/cam.43618
Operations Research Models for Reducing Hospital Readmissions
Liu, X. (2019) · Deep Blue (University of Michigan)
High-Risk Patient Identification: A Review of Current Methodologies
Sivanandam, S. (2019) · American Journal of Biomedical Science & Research · doi:10.34297/ajbsr.2019.06.000999
Synchronization of Machine Learning into Electronic Health Records
Meet, N., Vatsa, E., & Nitin, S. K. (2019) · International Journal of Computer Applications · doi:10.5120/ijca2019919751
Year in Review 2018―医学・医療・医療情報学編
智博, 澤. (2018) · Institutional Repositories DataBase (IRDB) · doi:10.14948/jami.38.279
ANALYSIS OF INFORMATION VALUE CHAINS FOR GOUT SELF-CARE MANAGEMENT
Russell, M. J. (2020) · UKnowledge (University of Kentucky) · doi:10.13023/etd.2020.358
Optimising the cost-effectiveness of risk-based screening for diabetic retinopathy
Sampson, C. (2020) · Nottingham ePrints (University of Nottingham)
Novel visual approaches for attribute analysis, selection, and prediction
Artur, E. (2020) · Digital Library of Theses and Dissertations (Universidade de São Paulo) · doi:10.11606/t.55.2020.tde-31082020-175620
Gupta, A. (2019) · SHAREOK (University of Oklahoma; Oklahoma State University; Central Oklahoma University)
Temporal Cascade and Structural Modelling of EHRs for Granular Readmission PredictionPreprint
Hettige, B., Wang, W., Li, Y.-F., Le, S. T. T., & Buntine, W. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2102.02586
Peacock, S., Cinelli, M., Heldt, F. S., McLachlan, L., Vizcaychipi, M. P., McCarthy, A., Lipunova, N., Fletcher, R. A., Hancock, A., Dürichen, R., et al. (2021) · Lecture notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering · doi:10.1007/978-3-030-70569-5_21
Xue, Y. (2021) · Journal of Biosciences and Medicines · doi:10.4236/jbm.2021.94002
Salomon, F. ‐., Thüring, M., & Salomon, B. (1984) · PubMed
Brown, L., Sullivan, F., Kelsey, T., & Agrawal, U. (2021) · Research Square · doi:10.21203/rs.3.rs-910471/v1
Improving Performance of Machine Learning on Prediction of Breast Cancer Over a Small Sample Dataset
Sangari, N., & Qu, Y. (2021) · Transactions on computational science and computational intelligence · doi:10.1007/978-3-030-71704-9_70
Verspoor, K. M. (2019) · Faculty Opinions – Post-Publication Peer Review of the Biomedical Literature · doi:10.3410/f.733181042.793560978
Usage of biobank data for psychiatric genomics and promotion of precision psychiatry
Davis, L. K., & Dennis, J. K. (2022) · Elsevier eBooks · doi:10.1016/b978-0-12-819602-1.00018-8
Exploration on Document Taxonomy by Ganb Algorithm
Babu, R. S. (2022) · International Journal of Engineering and Advanced Technology · doi:10.35940/ijeat.d3485.0411422
Chae, S., Brown, G. D., Gilbertson‐White, S., Moorhead, S. A., Cherwin, C. H., & Street, W. N. (2020) · doi:10.17077/etd.005716
Application of Information Value Chain in Gout Management
Russell, M. J., & Kim, S. (2022) · Korean Journal of Adult Nursing · doi:10.7475/kjan.2022.34.4.351
Statistical Learning for Large-Scale and Complex-Structured Data
Tang, W. (2022) · Deep Blue (University of Michigan) · doi:10.7302/6349
Digitale Phänotypisierung und künstliche Intelligenz
Harrer, M., Terhorst, Y., Baumeister, H., & Ebert, D. D. (2023) · Springer eBooks · doi:10.1007/978-3-662-65816-1_27
ФУНДАМЕНТАЛЬНАЯ И ПРИКЛАДНАЯ НАУКА: СОСТОЯНИЕ И ТЕНДЕНЦИИ РАЗВИТИЯ
университет, А. Г., Трахов, А. И., Васильева, Е. Г., университет, А. Г., Нальбиевна, Х. Б., университет, А. Г., Волощенко, Л. М., службы», Ф. В. «. А. У. И. Г., Теплова, Я. Е., службы», Ф. В. «. А. У. И. Г., et al. (2023) · ICSP «NEW SCIENCE» eBooks · doi:10.46916/05062023-1-978-5-00215-000-7
Panero, J. L. C., de la Poza, G., Hidalgo, L., Sancho-Tello, M. V. A., Torras, X., de Lamadrid, R. S., Maté, C., & Sánchez‐Antolín, G. (2023) · Gastroenterología y Hepatología (English Edition) · doi:10.1016/j.gastre.2022.10.014
Mohammed, A. (2023) · Computer Applications An International Journal · doi:10.5121/caij.2023.10404
A conceptual framework for the ICU of the future evaluated by the MIMIC-III digital archive
Markopoulos, D., Tsolakidis, A., Triantafyllou, I. S., Giannakopoulos, G. A., & Skourlas, C. (2023) · Global Knowledge, Memory and Communication · doi:10.1108/gkmc-06-2023-0203
Data access, data bias, data equity
Shung, D. L., & Laine, L. (2024) · Elsevier eBooks · doi:10.1016/b978-0-323-95068-8.00002-9
Hu, L. (2024) · RAND Corporation eBooks · doi:10.7249/rgsda3274-1
Representations and inference from time-varying routine care data
Doutreligne, M. (2023) · theses.fr (ABES) · doi:10.70675/164ffb44zdec6z4a84z8362z90adf17f7c15
Additional file 1 of Personalized hypertension treatment recommendations by a data-driven model
Hu, Y., Huerta, J., Cordella, N., Mishuris, R. G., & Paschalidis, I. C. (2023) · Figshare · doi:10.6084/m9.figshare.22610374
Andreu-Mateu, C., Andreu‐Vilarroig, C., Sánchez-Bermejo, N., Santamaría, C., & Tosca, R. (2024) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2024.105470
McInerney, D. J. (2024) · Digital Repository Service (Northeastern University) · doi:10.17760/d20653001
Data Expansion for Named Entity Recognition based on migration learning
Li, Q., Zhang, C., & Zhou, G. (2024) · International Conference on Computer Vision, Image and Deep Learning (CVIDL) · doi:10.1109/cvidl62147.2024.10603909
Brakenhoff, S. M., Theijse, T., van Wijngaarden, P., Trautwein, C., Brozat, J. F., Tacke, F., Honkoop, P., Vanwolleghem, T., Posthouwer, D., Zeuzem, S., et al. (2024) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-024-02608-x
AI-Driven Predictive Modelling for Cardiovascular Disease Risk Assessment
Sr.IT Security Risk Analyst The Auto Club Group (AAA) Tampa, F., & Vegesna, V. (2024) · International Journal of Innovative Research in Advanced Engineering · doi:10.26562/ijirae.2024.v1108.01
AI-Assisted Diagnosis of Rare Genetic Disorders : A Case Study
Sr.IT Security Risk Analyst The Auto Club Group (AAA) Tampa, F., & Vegesna, V. (2024) · International Journal of Innovative Research in Advanced Engineering · doi:10.26562/ijirae.2024.v1107.04
Enfermería en Situaciones Críticas: Guía Avanzada para el Manejo del Paciente Crítico Tomo 1
Monar, R. M. V., Yaguar, N. R. C., Rivera, I. A. F., Zambrano, V. P. D., Macías, R. Y. V., & Munzon, G. S. C. (2024) · doi:10.56470/978-9942-660-96-1
A semiparametric method for risk prediction using integrated electronic health record data
Hasler, J., Ma, Y., Wei, Y., Parikh, R. B., & Chen, J. (2024) · The Annals of Applied Statistics · doi:10.1214/24-aoas1938
Assessing Incremental Value of Added Predictors in Cardiovascular Risk Prediction Models
Gajjar, P., Nayor, M. G., & Duncan, M. S. (2025) · Elsevier eBooks · doi:10.1016/b978-0-443-15734-9.00030-3
Digital Psychiatry for the Treatment of Comorbid Disorders
Orsolini, L., Fiorani, M., Longo, G., & Volpe, U. (2025) · Springer eBooks · doi:10.1007/978-3-031-81802-8_20
Factors Influencing Electronic Medical Record Success in Moroccan Hospital Settings
Rhayha, R., & Ismaili, A. A. (2025) · Advances in Science, Technology & Innovation/Advances in science, technology & innovation · doi:10.1007/978-3-031-74470-9_25
Efforts to overcome student absenteeism
Bayowe, M. (2023) · International Journal of Curriculum Development Teaching and Learning Innovation · doi:10.35335/curriculum.v2i1.148
A scalable cloud-based EHR for managing hospital admissions using embedded AIPreprint
Nalela, P. (2025) · Research Square · doi:10.21203/rs.3.rs-6665256/v1
Salvatore, M., Mondul, A. M., Friese, C. R., Hanauer, D. A., Xu, H., Pearce, C. L., & Mukherjee, B. (2025) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2025.104853
Leveraging Language Models for Enhanced Clinical Decision Support in Electronic Health RecordsPreprint
Ran, W. H., Xi, X., Li, F., Lu, J., Jiang, J. H., Huang, H. F., Zhang, Y., & Li, S. (2025) · doi:10.36227/techrxiv.174913496.60344680/v1
Sim, T. Y., Cho, E. Y., Kim, J., Kim, H. G., & Kim, S. (2025) · Journal of Clinical Medicine · doi:10.3390/jcm14134444
Predictive Analytics in Healthcare: A New Era of Proactive Medicine
Hoque, M. E., & Makgatho, S. (2025) · Business & IT · doi:10.14311/bit.2025.01.04
Development of Predictive models for Personalized medicine based on Electronic health records
Kimi, M., Sinanović, Š., & Stevanović, T. (2025) · Glasnik javnog zdravlja · doi:10.5937/serbjph2502070k
Wang, M., Engelhard, M., Pun, P. H., & Goldstein, B. A. (2025) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2025.3599477
Self-citationMcGilvray, M. M. O., Pawale, A. A., Pyeatte, S. R., Shepherd, H. M., Wilcox, A. B., Heaton, J., & Pasque, M. K. (2025) · medRxiv · doi:10.1101/2025.08.13.25333636
Pharmacovigilance in Clinical Trails
Jada, B. (2025) · International Journal of Zoology Environment and Life Sciences · doi:10.70604/ijzels.v2i2.53
Jeon, C. H., Sung, K., & Cho, J. (2025) · Surgical Infections · doi:10.1177/10962964251376959
Primary Care and Chronic Disease Management
Quinn, C. E. (2025) · Springer eBooks · doi:10.1007/978-3-032-01613-3_5
A Structural Change Detection Method Integrating Causal Inference and Deep Learning
Liu, T., & Liu, H. (2025) · International Journal of Pattern Recognition and Artificial Intelligence · doi:10.1142/s0218001425520263
Silva, J., & Ortiz, J. H. (2025) · Anais do Congresso Brasileiro Interdisciplinar em Ciência e Tecnologia. · doi:10.29327/27640582.1063042
Rostamzadeh, N., Sharma, R., Abdullah, S. S., McArthur, E., Chalabianloo, N., Sontrop, J. M., Weir, M. L., Sedig, K., Garg, A. X., & Muanda, F. T. (2025) · JMIR Research Protocols · doi:10.2196/77224
Khalid, A. R., & Nashwan, A. J. (2025) · World Journal of Psychiatry · doi:10.5498/wjp.v15.i10.110719
Understanding AI and Machine Learning for Public Health
Leung, R. (2025) · Springer eBooks · doi:10.1007/978-3-032-08677-8_2
Real-World Applications of Supervised Learning
Leung, R. (2025) · Springer eBooks · doi:10.1007/978-3-032-08677-8_8
Bhaskar, T., Kirubakaran, S., Aelgani, V., Kumar, V. N., Maneiah, D., & Srinu, V. (2025) · Lecture notes in electrical engineering · doi:10.1007/978-981-95-0269-1_84
Feature Selection and Model Optimization for Survival Prediction in Patients with Angina Pectoris
Bata, R., Ghanem, A. S., & Nagy, A. C. (2025) · Journal of Clinical Medicine · doi:10.3390/jcm14228111
INTELIGÊNCIA ARTIFICIAL E ALGORITMOS DESAFIOS ÉTICOS, GOVERNANÇA E RESPONSABILIDADES
Hupffer, H. M. (2025) · Casa Leiria eBooks · doi:10.29327/5734110
UM MODELO DE ANONIMIZAÇÃO APLICADO A PRONTUÁRIOS ELETRÔNICOS
da Silva, D. P., de Mello, B. H., Bez, M. R., & Rigo, S. J. (2025) · Casa Leiria eBooks · doi:10.29327/5734110.1-12
AI Powered Medical Diagnosis System
Tiwari, A., & Awasthi, S. (2025) · Iconic Research and Engineering Journals · doi:10.64388/irev9i6-1712560
Multimorbidity measurement strategies for predicting hospital visits
Neves, B. D., Moreira, J. M., Gonçalves, S., Cerejo, J., Mota, I., Silva, N. A., Leite, F., & Silva, M. J. (2025) · BMC Health Services Research · doi:10.1186/s12913-025-13817-z
Optimizing Cardiovascular Disease Diagnosis Using Hybrid Predictive Models
Raju, D. S. (2025) · International Journal of Innovative Research in Advanced Engineering · doi:10.26562/ijirae.2025.v1212.11
TRACER: Transfer Learning based Real-time Adaptation for Clinical Evolving RiskPreprint
Yan, M., Tian, Z., Li, S., Liu, N., Goldstein, B. A., Liu, M., & Hong, C. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2512.12795
Self-citationLearning Causally Predictable Outcomes from Psychiatric Longitudinal DataPreprint
Strobl, E. V. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2506.16629
Modifiers of PM2.5 Associated Health Effects in Vulnerable Populations
Narain, M. (2025) · Carolina Digital Repository (University of North Carolina at Chapel Hill) · doi:10.17615/fgka-ee54
Joint Workshop Of The German Research Training Groups In Computer Science, E. M. 3. 1. (2021) · doi:10.25593/opus4-fau-16426
Γιαννάκης, Γ. (2023) · Dione (University of Piraeus) · doi:10.26267/unipi_dione/3683
Deep learning for electronic health records: risk prediction, explainability, and uncertainty
Li, Y. (2022) · Oxford University Research Archive (ORA) (University of Oxford) · doi:10.5287/ora-n6q8j61w5
Chen, Y., Hao, L., Zou, V. Z., Hollander, Z., Ng, R. T., & Isaac, K. V. (2022) · Figshare · doi:10.6084/m9.figshare.19759383
Chen, Y., Hao, L., Zou, V. Z., Hollander, Z., Ng, R. T., & Isaac, K. V. (2022) · Figshare · doi:10.6084/m9.figshare.19759380
Sabharwal, P., Hurst, J. H., Tejwani, R., Hobbs, K. T., Routh, J. C., & Goldstein, B. A. (2022) · Figshare · doi:10.6084/m9.figshare.19451236
Self-citationBrakenhoff, S. M., Theijse, T., van Wijngaarden, P., Trautwein, C., Brozat, J. F., Tacke, F., Honkoop, P., Vanwolleghem, T., Posthouwer, D., Zeuzem, S., et al. (2024) · Figshare · doi:10.6084/m9.figshare.26629029
Hossain, M. B. (2025) · cIRcle (University of British Columbia) · doi:10.14288/1.0448347
Bull, L. M., Lunt, M., Martin, G. P., Hyrich, K. L., & Sergeant, J. C. (2020) · Figshare · doi:10.6084/m9.figshare.12629586
Nguyen, H., Vasconcellos, H. D. D., Keck, K., Reis, J. P., Lewis, C. E., Sidney, S., Lloyd‐Jones, D. M., Schreiner, P. J., Güallar, E., Wu, C. O., et al. (2023) · Figshare · doi:10.6084/m9.figshare.22609988
Metadata
- Authors
- Goldstein, B. A., Navar, A. M., Pencina, M. J., & Ioannidis, J. P. A.
- Affiliations
- Duke University (US)
- Center for Predictive Medicine, Duke Clinical Research Institute, Duke University, Durham, NC 27710, USA
- Stanford University (US)
- Venue
- Journal of the American Medical Informatics Association
- Publisher
- Oxford University Press (OUP)
- Published
- 2016-05-17
- Volume
- 24
- Issue
- 1
- Pages
- 198-208
- ISSN
- 1067-5027 (ISSN-L)
- 1527-974X
- PMC
- PMC5201180
- OpenAlex
- W2395172628
- Cited by
- 936
- References
- 144
- Citations by year
- 2026: 132 · 2025: 115 · 2024: 97 · 2023: 98 · 2022: 107 · 2021: 122 · 2020: 100 · 2019: 82 · 2018: 59 · 2017: 15 · 2016: 6
- FWCI
- 9.07
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Journal of the American Medical Informatics Association (publishedVersion)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- HighWire Press Open Archive (submittedVersion)
- Funders
- National Institute of Diabetes and Digestive and Kidney Diseases (K25DK097279)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning in Healthcare
- Health Sciences › Health Professions › Health Information Management › Electronic Health Records Systems
- Health Sciences › Health Professions › Health Information Management › Medical Coding and Health Information
- Keywords
- electronic health records, clinical risk prediction, risk prediction model, model validation, multicenter validation, longitudinal data, missing data, loss to follow-up, model reproducibility, concordance index, mortality prediction, hospitalization prediction, service utilization
- MeSH terms
- Humans, Models, Statistical, Risk Assessment, Electronic Health Records
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.