Opportunities and challenges in developing risk prediction models with electronic health records data: a systematic review
Open accessThe DOI matches its Crossref record; 141 of the 144 references it cites were found in a registry or an index.
Abstract
Objective: Electronic health records (EHRs) are an increasingly common data source for clinical risk prediction, presenting both unique analytic opportunities and challenges. We sought to evaluate the current state of EHR based risk prediction modeling through a systematic review of clinical prediction studies using EHR data. Methods: We searched PubMed for articles that reported on the use of an EHR to develop a risk prediction model from 2009 to 2014. Articles were extracted by two reviewers, and we abstracted information on study design, use of EHR data, model building, and performance from each publication and supplementary documentation. Results: We identified 107 articles from 15 different countries. Studies were generally very large (median sample size = 26 100) and utilized a diverse array of predictors. Most used validation techniques (n = 94 of 107) and reported model coefficients for reproducibility (n = 83). However, studies did not fully leverage the breadth of EHR data, as they uncommonly used longitudinal information (n = 37) and employed relatively few predictor variables (median = 27 variables). Less than half of the studies were multicenter (n = 50) and only 26 performed validation across sites. Many studies did not fully address biases of EHR data such as missing data or loss to follow-up. Average c-statistics for different outcomes were: mortality (0.84), clinical prediction (0.83), hospitalization (0.71), and service utilization (0.71). Conclusions: EHR data present both opportunities and challenges for clinical risk prediction. There is room for improvement in designing such studies.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“In spite of the richness and potential of available data, scaling the development of predictive models is difficult because, for traditional predictive modeling techniques, each outcome to be predicted requires the creation of a custom dataset with specific variables.7”
From Scalable and accurate deep learning with electronic health records (2018) · cites this paper as [7]
In the citing paper
“Despite the rich data now digitized in EHRs,20 a recent systematic review of the medical literature7 found that predictive models built with EHR data use a median of only 27 variables, rely on traditional generalized linear models, and are built using data at a single center.”
From Scalable and accurate deep learning with electronic health records (2018) · cites this paper as [7]
In the citing paper
“Although external validation is recognized as an area of improvement for clinical risk prediction models [85]”
Citations
Cites
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000100 · Cited by 28,164
Self-citationDermyshi, E., Wang, Y., Yan, C., Hong, W., Qiu, G., Gong, X., & Zhang, T. (2017) · Neonatology · doi:10.1159/000454668 · Cited by 24,451
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2009.06.006 · Cited by 10,578
Self-citationPrediction of coronary heart disease using risk factor categories
Wilson, P. W. F., D’Agostino, R. B., Levy, D., Belanger, A. M., Silbershatz, H., & Kannel, W. B. (1998) · Circulation · doi:10.1161/01.cir.97.18.1837 · Cited by 9,581 · cited 2×
“Traditionally, risk pre- diction algorithms have been developed from large cohort studies such as the Framingham Heart Study.3 These studies were designed to follow people for years or even decades.”
MethodMoons, K. G. M., Altman, D. G., Reitsma, J. B., Ioannidis, J. P. A., Macaskill, P., Steyerberg, E. W., Vickers, A. J., Ransohoff, D. F., & Collins, G. S. (2015) · Annals of Internal Medicine · doi:10.7326/m14-0698 · Cited by 5,147
Self-citationCollins, G. S., Reitsma, J. B., Altman, D. G., & Moons, K. G. M. (2015) · British Journal of Cancer · doi:10.1038/bjc.2014.639 · Cited by 3,293
Joint modelling of longitudinal measurements and event time data
Henderson, R. (2000) · Biostatistics · doi:10.1093/biostatistics/1.4.465 · Cited by 913
The Electronic Medical Records and Genomics (eMERGE) Network: past, present, and future
Gottesman, O., Kuivaniemi, H., Tromp, G., Faucett, W. A., Li, R., Manolio, T. A., Sanderson, S. C., Kannry, J., Zinberg, R., Basford, M. A., et al. (2013) · Genetics in Medicine · doi:10.1038/gim.2013.72 · Cited by 698
Statistical Evaluation of Prognostic versus Diagnostic Models: Beyond the ROC Curve
Cook, N. R. (2008) · Clinical Chemistry · doi:10.1373/clinchem.2007.096529 · Cited by 691
Research works printed but not linked: 1
- Liu, 2010, Length of stay predictions: improvements through the use of automated laboratory and comorbidity variables, Med Care., 48, 739, 10.1097/mlr.0b013e3181e359f3 · DOI · Paper page
Cited by
Items 301–400 of 1,000
Vagliano, I., Dormosh, N., Rios, M., Luik, T. T., Buonocore, T. M., Elbers, P., Dongelmans, D. A., Schut, M. C., & Abu–Hanna, A. (2023) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2023.104504 · Cited by 22
Methods for Generating and Evaluating Synthetic Longitudinal Patient Data: A Systematic Review
Perkonoja, K., Auranen, K. J., & Virta, J. (2025) · Journal of Healthcare Informatics Research · doi:10.1007/s41666-025-00223-7 · Cited by 23
Silva, P. C., Sun, H., Rodríguez-Brazzarola, P., Rezk, M. S. M., Zhang, X., Fliegenschmidt, J., Hulde, N., von Dossow, V., Meesseman, L., Depraetere, K., et al. (2024) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2024.104692 · Cited by 23
Eckert, C., Nieves-Robbins, N. M., Spieker, E. A., Louwers, T., Hazel, D., Marquardt, J., Solveson, K., Zahid, A., Ahmad, M. A., Barnhill, R. P., et al. (2019) · Applied Clinical Informatics · doi:10.1055/s-0039-1688553 · Cited by 22
Canelón, S. P., Burris, H. H., Levine, L. D., & Boland, M. R. (2020) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2020.104339 · Cited by 22
Real-time imputation of missing predictor values in clinical practice
Nijman, S. W. J., Hoogland, J., Groenhof, T. K. J., Brandjes, M., Jacobs, J. J. L., Bots, M. L., Asselbergs, F. W., Moons, K. G. M., & Debray, T. P. A. (2020) · European Heart Journal - Digital Health · doi:10.1093/ehjdh/ztaa016 · Cited by 22
Sarker, A., Al-Garadi, M. A., Yang, Y., Choi, J. D., Quyyumi, A. A., & Martin, G. S. (2021) · JMIR Medical Informatics · doi:10.2196/18471 · Cited by 21
Gon, Y., Kabata, D., Yamamoto, K., Shintani, A., Todo, K., Mochizuki, H., & Sakaguchi, M. (2017) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-017-0554-x · Cited by 22
Nallabasannagari, A. R., Reddiboina, M., Seltzer, R. G. N., Zeffiro, T., Sharma, A. K., & Bhandari, M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2009.01366 · Cited by 22
Hunik, L., Chaabouni, A., van Laarhoven, T., Hartman, T. O., Leijenaar, R. T. H., Cals, J., Uijen, A. A., & Schers, H. (2025) · JMIR Medical Informatics · doi:10.2196/62862 · Cited by 21
Dehbaghi, H. A., & Khoshgard, K. (2025) · International Journal of Emergency Medicine · doi:10.1186/s12245-025-01049-1 · Cited by 21
Sangari, N., & Qu, Y. (2020) · International Conference on Computational Science and Computational Intelligence (CSCI) · doi:10.1109/csci51800.2020.00152 · Cited by 21
A multi-step approach to managing missing data in time and patient variant electronic health records
Cesare, N., & Were, L. P. O. (2022) · BMC Research Notes · doi:10.1186/s13104-022-05911-w · Cited by 21
Qu, C., Luo, W., Zeng, Z., Lin, X., Gong, X., Wang, X., Zhang, Y., & Li, Y. (2022) · Heliyon · doi:10.1016/j.heliyon.2022.e11361 · Cited by 21
Natural Language Processing and Text Mining (Turning Unstructured Data into Structured)
Bagheri, A., Giachanou, A., Mosteiro, P. J., & Verberne, S. (2023) · Springer eBooks · doi:10.1007/978-3-031-36678-9_5 · Cited by 21
Attention-based neural networks for clinical prediction modelling on electronic health records
Fridgeirsson, E. A., Sontag, D. A., & Rijnbeek, P. R. (2023) · BMC Medical Research Methodology · doi:10.1186/s12874-023-02112-2 · Cited by 21
Zou, W., Xiujuan, Y., Chen, Y., Li, X., Huang, J., Zhang, Y., Lin, Y., & Xie, B. (2024) · Scientific Reports · doi:10.1038/s41598-024-64776-0 · Cited by 21
Recommendations for improving national clinical datasets for health equity research
Block, R. G., Puro, J. E., Cottrell, E., Lunn, M. R., Dunne, M., Quiñones, A. R., Chung, B., Pinnock, W., Reid, G. M., & Heintzman, J. D. (2020) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocaa144 · Cited by 21
Lin, Y., Yu, Z. B., & Lee, S. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2504.14657 · Cited by 21
Cabanillas Silva, P., Sun, H., Rezk, M., Roccaro-Waldmeyer, D. M., Fliegenschmidt, J., Hulde, N., von Dossow, V., Meesseman, L., Depraetere, K., Stieg, J., et al. (2024) · Journal of Medical Internet Research · doi:10.2196/51409 · Cited by 20
Vos, G., van Eijk, L., Sarnyai, Z., & Azghadi, M. R. (2025) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2025.108899 · Cited by 20
Kanwar, M. K., Kilic, A., & Mehra, M. R. (2021) · The Journal of Heart and Lung Transplantation · doi:10.1016/j.healun.2021.02.016 · Cited by 20
Evaluation of Electronic Health Record-Based Suicide Risk Prediction Models on Contemporary Data
Walker, R. L., Shortreed, S. M., Ziebell, R. A., Johnson, E., Boggs, J. M., Lynch, F. L., Daida, Y. G., Ahmedani, B. K., Rossom, R. C., Coleman, K. J., et al. (2021) · Applied Clinical Informatics · doi:10.1055/s-0041-1733908 · Cited by 20
Predicting Therapeutic Response to Unfractionated Heparin Therapy: Machine Learning Approach
Abdel‐Hafez, A., Scott, I. A., Falconer, N., Canaris, S., Bonilla, O., Marxen, S., Garderen, A. V., & Barras, M. A. (2022) · Interactive Journal of Medical Research · doi:10.2196/34533 · Cited by 20
Wang, Y., Tian, L., Liu, X., Zhang, H., Tang, Y., Zhang, H., Nie, W., & Wang, L. (2023) · Cancers · doi:10.3390/cancers15245879 · Cited by 20
Cox-nnet v2.0: improved neural-network-based survival prediction extended to large-scale EMR data
Wang, D., Jing, Z., He, K., & Garmire, L. X. (2021) · Bioinformatics · doi:10.1093/bioinformatics/btab046 · Cited by 20
Systematic review of machine learning models for personalised dosing of heparin
Falconer, N., Abdel‐Hafez, A., Scott, I. A., Marxen, S., Canaris, S., & Barras, M. A. (2021) · British Journal of Clinical Pharmacology · doi:10.1111/bcp.14852 · Cited by 20
Anetta, K., Horák, A., Wojakowski, W., Wita, K., & Jadczyk, T. (2022) · Journal of Personalized Medicine · doi:10.3390/jpm12060869 · Cited by 20
High Triglyceride Variability Increases the Risk of First Attack of Acute Pancreatitis
Tung, Y., Hsiao, F., Lin, C., Ho, C.-T., Hsu, T., Chiang, H., & Chu, P. (2022) · The American Journal of Gastroenterology · doi:10.14309/ajg.0000000000002198 · Cited by 20
Time‐to‐event prediction using survival analysis methods for Alzheimer's disease progression
Sharma, R., Anand, H., Badr, Y., & Qiu, R. G. (2021) · Alzheimer's & Dementia: Translational Research & Clinical Interventions · doi:10.1002/trc2.12229 · Cited by 19
Detection Bias in EHR-Based Research on Clinical Exposures and Dementia
Wang, J., Choi, M., Buto, P. T., Kelly, J. D., Joie, R. L., Kornak, J., Zimmerman, S. C., Chen, R., Raphael, E., Schaefer, C. A., et al. (2025) · JAMA Network Open · doi:10.1001/jamanetworkopen.2025.6637 · Cited by 19
Data-Driven Methods for Advancing Precision Oncology
Nedungadi, P., Iyer, A., Gutjahr, G., Bhaskar, J., & Pillai, A. (2018) · Current Pharmacology Reports · doi:10.1007/s40495-018-0127-4 · Cited by 19
Incorporating informatively collected laboratory data from EHR in clinical prediction models
Sun, M., Engelhard, M., Bedoya, A., & Goldstein, B. A. (2024) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-024-02612-1 · Cited by 19
Self-citationOrtiz, A., & Mulsant, B. H. (2024) · Journal of Medical Internet Research · doi:10.2196/59826 · Cited by 19
Vladić, N., Englisch, C., Berger, J. M., Moik, F., Berghoff, A. S., Preusser, M., Pabinger, I., & Ay, C. (2025) · Blood Advances · doi:10.1182/bloodadvances.2025016044 · Cited by 19
Pinaire, J., Chabert, E., Azé, J., Bringay, S., & Landais, P. (2021) · Journal of Healthcare Engineering · doi:10.1155/2021/5531807 · Cited by 19
Salerno, S. N., Hornik, C. P. V., Cohen‐Wolkowiez, M., Smith, P. B., Ku, L., Kelly, M. S., Clark, R. H., & González, D. (2017) · The Pediatric Infectious Disease Journal · doi:10.1097/inf.0000000000001610 · Cited by 19
Fall Detection in EHR using Word Embeddings and Deep Learning
dos Santos, H. D. P., da Silva, A. P., Maciel, M. C. O., Burin, H. M. V., Urbanetto, J. D. S., & Vieira, R. L. R. (2019) · IEEE International Conference on Bioinformatics and Bioengineering (BIBE) · doi:10.1109/bibe.2019.00054 · Cited by 19
Improved Hierarchical Patient Classification with Language Model Pretraining over Clinical NotesPreprint
Kemp, J., Rajkomar, A., & Dai, A. M. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1909.03039 · Cited by 19
Andreotti, F., Heldt, F. S., Abu‐Jamous, B., Li, M., Javer, A., Carr, O., Jovanović, S., Lipunova, N., Irving, B., Khan, R. T., et al. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.08491 · Cited by 19
Khaled, A., Sabir, M., Qureshi, R., Caruso, C. M., Guarrasi, V., Xiang, S., & Zhou, S. K. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2506.12808 · Cited by 19
Oh, M., Kim, H.-S., Jung, Y. M., Lee, H., Lee, S.-B., & Lee, S. M. (2024) · Journal of Medical Internet Research · doi:10.2196/58021 · Cited by 18
Reps, J., Rijnbeek, P. R., Cuthbert, A. R., Ryan, P. B., Pratt, N. L., & Schuemie, M. J. (2021) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-021-01408-x · Cited by 18
Kwon, O., Na, W., Kang, H. J., Jun, T. J., Kweon, J., Park, G., Cho, Y., Hur, C., Chae, J., Kang, D., et al. (2022) · JMIR Medical Informatics · doi:10.2196/26801 · Cited by 18
Venkatesh, K. K., Jelovsek, J. E., Hoffman, M., Beckham, A. J., Bitar, G., Friedman, A. M., Boggess, K., & Stamilio, D. M. (2023) · BJOG An International Journal of Obstetrics & Gynaecology · doi:10.1111/1471-0528.17572 · Cited by 18
Integrated AI Medical Emergency Diagnostics Advising System
Aityan, S. K., Mosaddegh, A., Herrero, R., Inchingolo, F., Nguyen, K. C. D., Balzanelli, M. G., Lazzaro, R., Iacovazzo, N., Cefalo, A., Carriero, L., et al. (2024) · Electronics · doi:10.3390/electronics13224389 · Cited by 18
Tian, Y., Shang, Y., Tong, D., Chi, S., Li, J., Kong, X., Ding, K., & Li, J. (2018) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2018.08.008 · Cited by 18
Xie, F., Liu, N., Wu, S. X., Ang, Y., Low, L. L., Ho, A. F. W., Lam, S. S. W., Matchar, D. B., Ong, M. E. H., & Chakraborty, B. (2019) · BMJ Open · doi:10.1136/bmjopen-2019-031382 · Cited by 18
Goldstein, B. A. (2020) · Clinical Trials · doi:10.1177/1740774520931211 · Cited by 18
Self-citationChroNet: A multi-task learning based approach for prediction of multiple chronic diseases
Feng, R., Cao, Y. L., Liu, X., Chen, T., Chen, J., Chen, D. Z., Gao, H., & Wu, J. F. (2021) · Multimedia Tools and Applications · doi:10.1007/s11042-020-10482-8 · Cited by 18
Chicco, D., & Jurman, G. (2021) · IEEE Access · doi:10.1109/access.2021.3084063 · Cited by 18
Lucas, J. E., Bazemore, T. C., Alo, C., Monahan, P. B., & Voora, D. (2017) · PLOS ONE · doi:10.1371/journal.pone.0187809 · Cited by 17
Hansen, L., Enevoldsen, K. C., Bernstorff, M., Nielbo, K. L., Danielsen, A. A., & Østergaard, S. D. (2021) · Acta Neuropsychiatrica · doi:10.1017/neu.2021.22 · Cited by 17
van Os, H. J. A., Kanning, J. P., Wermer, M. J. H., Chavannes, N. H., Numans, M. E., Ruigrok, Y. M., van Zwet, E. W., Putter, H., Steyerberg, E. W., & Groenwold, R. H. H. (2022) · Frontiers in Epidemiology · doi:10.3389/fepid.2022.871630 · Cited by 17
Predictive analytics for cardiovascular patient readmission and mortality: An explainable approach
Huberts, L. C. E., Li, S., Blake, V., Jorm, L. R., Yu, J. S., Ooi, S., & Gallego, B. (2024) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2024.108321 · Cited by 17
Machine learning-based delirium prediction in surgical in-patients: a prospective validation study
Jauk, S., Kramer, D., Sumerauer, S., Veeranki, S. P. K., Schrempf, M., & Puchwein, P. (2024) · JAMIA Open · doi:10.1093/jamiaopen/ooae091 · Cited by 17
Federated Learning in Big Data with IoT for Intrusion Detection
Govindaram, A., Prasath, J. S., Suganya, A., Jayasakthi, K., Rajkumar, N., & Jose Anand, A. (2025) · International Conference on Mobile Computing and Sustainable Informatics (ICMCSI) · doi:10.1109/icmcsi64620.2025.10883562 · Cited by 17
Deng, B., Xu, C., Li, H., Huang, Y.-H., Hou, M., & Bian, J. (2025) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3711896.3737147 · Cited by 17
Big data and new information technology: what cardiologists need to know
Baladrón, C., de Diego, J. J. G., & Amat-Santos, I. J. (2020) · Revista Española de Cardiología (English Edition) · doi:10.1016/j.rec.2020.06.036 · Cited by 17
Schuler, A., O’suilleabhain, L., Rinetti-Vargas, G., Kipnis, P., Barreda, F. X., Liu, V. X., Sofrygin, O., & Escobar, G. J. (2020) · JAMA Network Open · doi:10.1001/jamanetworkopen.2020.17109 · Cited by 17
A Review of Mortality Risk Prediction Models in Smartphone Applications
Fijačko, N., Creber, R. M., Gosak, L., Kocbek, P., Cilar, L., Creber, P., & Štiglic, G. (2021) · Journal of Medical Systems · doi:10.1007/s10916-021-01776-x · Cited by 17
Galimzhanov, A. M., Matetić, A., Tenekecioğlu, E., & Mamas, M. A. (2023) · International Journal of Cardiology · doi:10.1016/j.ijcard.2023.131339 · Cited by 17
Saleh, S. N., Makam, A. N., Halm, E. A., & Nguyen, O. K. (2020) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-020-01248-1 · Cited by 17
Imputation Strategies Under Clinical Presence: Impact on Algorithmic FairnessPreprint
Jeanselme, V., De‐Arteaga, M., Zhang, Z., Tom, B. D. M., & Barrett, J. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4496874 · Cited by 17
Barton, H. J., Maru, A., Leaf, M. A., Hekman, D. J., Wiegmann, D. A., Shah, M. N., & Patterson, B. W. (2024) · JMIR Human Factors · doi:10.2196/52592 · Cited by 16
On the evaluation of synthetic longitudinal electronic health records
Achterberg, J., Haas, M., & Spruit, M. R. (2024) · BMC Medical Research Methodology · doi:10.1186/s12874-024-02304-4 · Cited by 16
Forood, A. M. K., Osifuwa, A. D., Idoko, J. E., Oni, O., Ajaelu, C. S., & Idoko, F. A. (2024) · GSC Advanced Research and Reviews · doi:10.30574/gscarr.2024.21.1.0380 · Cited by 16
InfEHR: Clinical phenotype resolution through deep geometric learning on electronic health records
Kauffman, J., Holmes, E., Vaid, A., Charney, A. W., Kovatch, P., Lampert, J. M., Sakhuja, A., Žitnik, M., Glicksberg, B. S., Hofer, I. S., et al. (2025) · Nature Communications · doi:10.1038/s41467-025-63366-6 · Cited by 16
Mapping risk of ischemic heart disease using machine learning in a Brazilian state
Bergamini, M., Iora, P. H., Rocha, T. A. H., Tchuisseu, Y. P., Dutra, A. D. C., Scheidt, J. F. H. C., Nihei, O. K., Carvalho, M. D. D. B., Staton, C. A., Vissoci, J. R. N., et al. (2020) · PLoS ONE · doi:10.1371/journal.pone.0243558 · Cited by 16
Advancing care for acute gastrointestinal bleeding using artificial intelligence
Shung, D. L. (2021) · Journal of Gastroenterology and Hepatology · doi:10.1111/jgh.15372 · Cited by 16
Ji, X., Cui, G., Xu, C., Hou, J., Zhang, Y., & Ren, Y. (2022) · Frontiers in Pharmacology · doi:10.3389/fphar.2021.773135 · Cited by 16
Observability and its impact on differential bias for clinical prediction models
Yan, M., Pencina, M. J., Boulware, L. E., & Goldstein, B. A. (2022) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocac019 · Cited by 16
Self-citationBlythe, R. D., Parsons, R., Barnett, A. G., McPhail, S., & White, N. M. (2023) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2023.05.020 · Cited by 16
The added value of text from Dutch general practitioner notes in predictive modeling
Seinen, T. M., Kors, J. A., van Mulligen, E. M., Fridgeirsson, E. A., & Rijnbeek, P. R. (2023) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocad160 · Cited by 16
Can Machine Learning Help Identify Patients at Risk for Recurrent Sexually Transmitted Infections?
Elder, H. R., Gruber, S., Willis, S. J., Cocoros, N. M., Callahan, M., Flagg, E. W., Klompas, M., & Hsu, K. (2020) · Sexually Transmitted Diseases · doi:10.1097/olq.0000000000001264 · Cited by 16
Xiong, H., Zhang, J., Huang, Y., Leach, K., & Barnes, L. E. (2017) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3007195 · Cited by 16
Wang, J., Ahn, S., Dalal, T., Zhang, X., Pan, W., Zhang, Q., Chen, B., Dodge, H. H., Fei, W., & Zhou, J. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2405.16413 · Cited by 16
Artificial intelligence-enabled electrocardiography from scientific research to clinical application
Lin, C.-S., Liu, W.-T., Chen, Y.-H., Lin, S.-H., & Lin, C. (2025) · EMBO Molecular Medicine · doi:10.1038/s44321-025-00351-y · Cited by 15
Sîngeap, M. S., Corneanu, L. E., Prodaniuc, A., Șova, I. A., Coșovanu, E. O., & Petriș, O. R. (2025) · Diagnostics · doi:10.3390/diagnostics15243162 · Cited by 15
Nikravangolsefid, N., Reddy, S., Truong, H. H., Charkviani, M., Ninan, J., Prokop, L. J., Suppadungsuk, S., Singh, W., KASHANI, K. B., & Garces, J. P. D. (2024) · Journal of Critical Care · doi:10.1016/j.jcrc.2024.154889 · Cited by 15
Li, M., Li, X., Pan, K., Geva, A., Yang, D. Y., Sweet, S. M., Bonzel, C.-L., Panickan, V. A., Xiong, X., Mandl, K. D., et al. (2024) · npj Digital Medicine · doi:10.1038/s41746-024-01320-4 · Cited by 15
Dabek, F., Hoover, P. J., Jorgensen-Wagers, K., Wu, T., & Caban, J. J. (2022) · Frontiers in Neurology · doi:10.3389/fneur.2021.769819 · Cited by 15
Zhu, Y., Venugopalan, J., Zhang, Z., Chanani, N. K., Maher, K., & Wang, M. D. (2022) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2022.640926 · Cited by 15
González‐Juanatey, C., Anguita-Sánchez, M. P., Barrios, V., Nuñez-Gil, I. J., Gómez‐Doblas, J. J., García–Moll, X., Gormaz, C. L., Rollán-Gómez, M. J., Peral-Disdier, V., Martínez‐Dolz, L., et al. (2022) · Journal of Clinical Medicine · doi:10.3390/jcm11206004 · Cited by 15
Lexical stability of psychiatric clinical notes from electronic health records over a decade
Hansen, L., Enevoldsen, K., Bernstorff, M., Perfalk, E., Danielsen, A. A., Nielbo, K. L., & Østergaard, S. D. (2023) · Acta Neuropsychiatrica · doi:10.1017/neu.2023.46 · Cited by 15
Jain, S. S., Sarkar, I. N., Stey, P., Anand, R., Biron, D. R., & Chen, E. S. (2018) · Europe PMC (PubMed Central) · Cited by 15
Innovation on Machine Learning in Healthcare Services—An Introduction
Pattnayak, P., & Panda, A. R. (2021) · Studies in computational intelligence · doi:10.1007/978-981-33-4698-7_1 · Cited by 15
Han, E., Kharrazi, H. H. K., & Shi, L. (2023) · JMIR Aging · doi:10.2196/42437 · Cited by 14
Sun, Y., Liu, Y., Zhu, Y., Luo, R., Luo, Y., Wang, S., & Feng, Z. (2024) · Current Medical Research and Opinion · doi:10.1080/03007995.2024.2307346 · Cited by 14
An interpretable predictive deep learning platform for pediatric metabolic diseases
Javidi, H., Mariam, A., Alkhaled, L., Pantalone, K. M., & Rotroff, D. M. (2024) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocae049 · Cited by 14
Individualized survival predictions using state space model with longitudinal and survival data
Cauchi, M., Mills, A. R., Lawrie, A., Kiely, D. G., & Kadirkamanathan, V. (2024) · Journal of The Royal Society Interface · doi:10.1098/rsif.2023.0682 · Cited by 14
A machine learning tool for early identification of celiac disease autoimmunity
Dreyfuss, M., Getz, B., Lebwohl, B., Ramni, O., Underberger, D., Ber, T. I., Steinberg-Koch, S., Jenudi, Y., Gazit, S., Patalon, T., et al. (2024) · Scientific Reports · doi:10.1038/s41598-024-80817-0 · Cited by 14
Clinical Informatics and the Electronic Medical Record
Abid, M., & Schneider, A. (2023) · Surgical Clinics of North America · doi:10.1016/j.suc.2022.11.005 · Cited by 14
Luo, G. (2019) · Global Transitions · doi:10.1016/j.glt.2018.11.001 · Cited by 14
Tan, Q., Ye, M., Ma, A. J., Yip, T. C., Wong, G. L., & Yuen, P. C. (2021) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocaa306 · Cited by 14
Bakker, L. J., Aarts, J. E. C. M., Groot, C. A. U., & Redekop, K. (2021) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-021-01682-9 · Cited by 14
Roy, A., Ara, J., Ghodke, S., & Akter, J. (2025) · Journal of Business and Management Studies · doi:10.32996/jbms.2025.7.2.9 · Cited by 13
AI-delirium guard: Predictive modeling of postoperative delirium in elderly surgical patients
Boppana, S. H., Tyagi, D., Komati, S. S. K., Boppana, S. L., Raj, R., & Mintz, C. D. (2025) · PLoS ONE · doi:10.1371/journal.pone.0322032 · Cited by 13
Ahmed, M. S., Zhinuk, F. A., Acharjee, S., Begum, S. A., Jobiullah, M. I., & Islam, S. (2025) · International Journal of Professional Business Review · doi:10.26668/businessreview/2025.v10i8.5628 · Cited by 13
Naskinova, I., Kolev, M., Karova, D., & Milev, M. (2026) · Electronics · doi:10.3390/electronics15020312 · Cited by 13
Metadata
- Authors
- Goldstein, B. A., Navar, A. M., Pencina, M. J., & Ioannidis, J. P. A.
- Affiliations
- Duke University (US)
- Center for Predictive Medicine, Duke Clinical Research Institute, Duke University, Durham, NC 27710, USA
- Stanford University (US)
- Venue
- Journal of the American Medical Informatics Association
- Publisher
- Oxford University Press (OUP)
- Published
- 2016-05-17
- Volume
- 24
- Issue
- 1
- Pages
- 198-208
- ISSN
- 1067-5027 (ISSN-L)
- 1527-974X
- PMC
- PMC5201180
- OpenAlex
- W2395172628
- Cited by
- 936
- References
- 144
- Citations by year
- 2026: 132 · 2025: 115 · 2024: 97 · 2023: 98 · 2022: 107 · 2021: 122 · 2020: 100 · 2019: 82 · 2018: 59 · 2017: 15 · 2016: 6
- FWCI
- 9.07
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Journal of the American Medical Informatics Association (publishedVersion)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- HighWire Press Open Archive (submittedVersion)
- Funders
- National Institute of Diabetes and Digestive and Kidney Diseases (K25DK097279)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning in Healthcare
- Health Sciences › Health Professions › Health Information Management › Electronic Health Records Systems
- Health Sciences › Health Professions › Health Information Management › Medical Coding and Health Information
- Keywords
- electronic health records, clinical risk prediction, risk prediction model, model validation, multicenter validation, longitudinal data, missing data, loss to follow-up, model reproducibility, concordance index, mortality prediction, hospitalization prediction, service utilization
- MeSH terms
- Humans, Models, Statistical, Risk Assessment, Electronic Health Records
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.