Risk prediction models: I. Development, internal validation, and assessing the incremental value of a new (bio)marker
The DOI matches its Crossref record; 100 of the 100 references it cites were found in a registry or an index.
Abstract
Prediction models are increasingly used to complement clinical reasoning and decision making in modern medicine in general, and in the cardiovascular domain in particular. Developed models first and foremost need to provide accurate and (internally and externally) validated estimates of probabilities of specific health conditions or outcomes in targeted patients. The adoption of such models must guide physician's decision making and an individual's behaviour, and consequently improve individual outcomes and the cost-effectiveness of care. In a series of two articles we review the consecutive steps generally advocated for risk prediction model research. This first article focuses on the different aspects of model development studies, from design to reporting, how to estimate a model's predictive performance and the potential optimism in these estimates using internal validation techniques, and how to quantify the added or incremental value of new predictors or biomarkers (of whatever type) to existing predictors. Each step is illustrated with empirical examples from the cardiovascular field.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“It is therefore essential that key details of how a prediction model was developed and validated be clearly reported to enable synthesis and critical appraisal of all relevant information (14,(33)(34)(35)(36).”
From Transparent Reporting of a multivariable prediction model for Individual Prognosis Or Diagnosis (TRIPOD): The TRIPOD Statement (2015) · cites this paper as [14]
In the citing paper
“The TRIPOD Statement covers studies that report solely development [12,15], both development and external validation, and solely external validation (with or without updating), of a prediction model [14] (Figure 1).”
From Transparent reporting of a multivariable prediction model for individual prognosis or diagnosis (TRIPOD): the TRIPOD Statement (2015) · cites this paper as [15]
In the citing paper
“The TRIPOD Statement covers studies that report solely development,12,15 both development and external validation, and solely external validation (with or without updating), of a prediction model14 (Figure 3).”
From Transparent Reporting of a Multivariable Prediction Model for Individual Prognosis or Diagnosis (TRIPOD): The TRIPOD Statement (2015) · cites this paper as [15]
Citations
Cites
An Introduction to the Bootstrap
Efron, B., & Tibshirani, R. J. (1994) · doi:10.1201/9780429246593 · Cited by 40,500
(1990) · Choice Reviews Online · doi:10.5860/choice.27-3338 · Cited by 35,305
An Introduction to the Bootstrap
Efron, B., & Tibshirani, R. J. (1993) · doi:10.1007/978-1-4899-4541-9 · Cited by 21,230
Multiple Imputation for Nonresponse in Surveys
Rubin, D. B. (1987) · Wiley Series in Probability and Statistics · doi:10.1002/9780470316696 · Cited by 20,701
Hosmer, D. W., & Lemeshow, S. (2000) · doi:10.1002/0471722146 · Cited by 20,302
Statistical Analysis With Missing Data
Lahiff, M., Little, R. J. A., & Rubin, D. B. (1989) · Journal of the American Statistical Association · doi:10.2307/2289883 · Cited by 17,265
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · PLoS Medicine · doi:10.1371/journal.pmed.0020124 · Cited by 10,505
A simulation study of the number of events per variable in logistic regression analysis
Peduzzi, P., Concato, J., Kemper, E., Holford, T. R., & Feinstein, A. R. (1996) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(96)00236-3 · Cited by 9,655
Prediction of coronary heart disease using risk factor categories
Wilson, P. W. F., D’Agostino, R. B., Levy, D., Belanger, A. M., Silbershatz, H., & Kannel, W. B. (1998) · Circulation · doi:10.1161/01.cir.97.18.1837 · Cited by 9,581
Harrell, F. E. (2001) · Springer Series in Statistics · doi:10.1007/978-1-4757-3462-1 · Cited by 9,195
Research works printed but not linked: 2
- Wells, 1997, A simple clinical model to categorize pretest probability in patients with suspected pulmonary embolism, Blood, 90, 424
- Hosmer DW Lemeshow S . Applied Survival Analysis: Regression Modelling of Time to Event Data. New York: Wiley, 1999.
Cited by
Items 401–500 of 1,000
Moslehi, S., Mahjub, H., Farhadian, M., Soltanian, A. R., & Mamani, M. (2022) · BMC Medical Research Methodology · doi:10.1186/s12874-022-01827-y · Cited by 16
SPIN-PM: a consensus framework to evaluate the presence of spin in studies on prediction models
Navarro, C. L. A., Damen, J. A., Ghannad, M., Dhiman, P., van Smeden, M., Reitsma, J. B., Collins, G. S., Riley, R. D., Moons, K. G. M., & Hooft, L. (2024) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2024.111364 · Cited by 16
Self-citationRisk Prediction Models for Perioperative Hypothermia: A Systematic Review
Liu, J., Liu, F., Xu, W., Du, L., Li, Y., Liang, A., Li, B., & Zhang, M. (2025) · Journal of Multidisciplinary Healthcare · doi:10.2147/jmdh.s538891 · Cited by 16
Timmerman, N., Galyfos, G. C., Sigala, F., Thanopoulou, K., de Borst, G. J., Davidovic, L. B., Eckstein, H., Filipović, N., Grugni, R., Kallmayer, M. A., et al. (2020) · European Journal of Clinical Investigation · doi:10.1111/eci.13411 · Cited by 16
Prediction model for an early revision for dislocation after primary total hip arthroplasty
Pakarinen, O., Karsikas, M., Reito, A. R., Lainiala, O. S., Neuvonen, P., & Eskelinen, A. P. (2022) · PLoS ONE · doi:10.1371/journal.pone.0274384 · Cited by 16
Rei, A., Ortigão, R., Canelas‐Pais, M., Afonso, L. P., Pimentel‐Nunes, P., Dinis-Ribeiro, M. J., & Libânio, D. (2023) · Endoscopy · doi:10.1055/a-2089-6849 · Cited by 16
Quirino, I. G., Dias, C. S., Vasconcelos, M. A., Poggiali, I. V., Gouvea, K. C., Pereira, A. K., Paulinelli, G. P., Moura, A. R., Ferreira, R., Colosimo, E. A., et al. (2014) · Pediatric Nephrology · doi:10.1007/s00467-014-2870-z · Cited by 16
Mueller, Y. K., Bastard, M., Nkemenang, P., Comte, É., Ehounou, G., Eyangoh, S. I., Rusch, B., Tabah, E. N., Trellu, L. T., & Étard, J.-F. (2016) · PLoS neglected tropical diseases · doi:10.1371/journal.pntd.0004593 · Cited by 16
Predicting an Unfavorable Course of Dizziness in Older Patients
Stam, H., Maarsingh, O. R., Heymans, M. W., van Weert, H. C. P. M., van der Wouden, J. C., & van der Horst, H. E. (2018) · The Annals of Family Medicine · doi:10.1370/afm.2289 · Cited by 16
Lima, S. I. V. C., Martins, R. R., Saldanha, V., Silbiger, V. N., dos Santos, I. C. C., de Araújo, I. B., & Oliveira, A. G. (2020) · PLoS ONE · doi:10.1371/journal.pone.0243714 · Cited by 16
Using the laboratory to predict thrombosis in dogs: An achievable goal?
Jeffery, U., Staber, J. M. R., & LeVine, D. N. (2016) · The Veterinary Journal · doi:10.1016/j.tvjl.2016.03.027 · Cited by 16
van Vugt, V. A., van der Wouden, J. C., Bosmans, J. E., Smalbrugge, M., van Diest, W., Essery, R., Yardley, L., van der Horst, H. E., & Maarsingh, O. R. (2017) · BMJ Open · doi:10.1136/bmjopen-2016-015479 · Cited by 16
Daza, J. F., Bartoszko, J. M., van Klei, W. A., Ladha, K. S., McCluskey, S. A., & Wijeysundera, D. N. (2022) · Annals of Surgery · doi:10.1097/sla.0000000000005509 · Cited by 15
Nikravangolsefid, N., Reddy, S., Truong, H. H., Charkviani, M., Ninan, J., Prokop, L. J., Suppadungsuk, S., Singh, W., KASHANI, K. B., & Garces, J. P. D. (2024) · Journal of Critical Care · doi:10.1016/j.jcrc.2024.154889 · Cited by 15
Risk Scores and Prediction Models in Chronic Heart Failure: A Comprehensive Review
Toumpourleka, M., Patoulias, D., Katsimardou, A., Doumas, M. N., & Papadopoulos, C. E. (2020) · Current Pharmaceutical Design · doi:10.2174/1381612826666200521141249 · Cited by 15
Charvat, H., Sasazuki, S., Inoue, M., Iwasaki, M., Sawada, N., Shimazu, T., Yamaji, T., & Tsugane, S. (2013) · Preventive Medicine · doi:10.1016/j.ypmed.2013.08.030 · Cited by 15
Liu, X., Chen, Z., Fine, J. P., Liu, L., Wang, A., Guo, J. C., Tao, L., Mahara, G., Yang, K. Y., Zhang, J., et al. (2016) · Scientific Reports · doi:10.1038/srep37248 · Cited by 15
Hozo, I., Tsalatsanis, A., & Djulbegović, B. (2016) · Journal of Evaluation in Clinical Practice · doi:10.1111/jep.12676 · Cited by 15
Sanders, S., Rathbone, J., Bell, K., Glasziou, P., & Doust, J. A. (2017) · Diagnostic and Prognostic Research · doi:10.1186/s41512-017-0013-2 · Cited by 15
Lee, N., Kitashoji, E., Koizumi, N., Lacuesta, T. L., Ribo, M. R., Dimaano, E. M., Saito, N., Suzuki, M., Ariyoshi, K., & Parry, C. M. (2017) · Transactions of the Royal Society of Tropical Medicine and Hygiene · doi:10.1093/trstmh/try015 · Cited by 15
Physician Judgement vs Model-Predicted Prognosis in Patients With Heart Failure
Buchan, T. A., Ross, H. J., McDonald, M. A., Billia, F., Delgado, D., Posada, J. D., Luk, A. C., Guyatt, G. H., & Alba, A. C. (2019) · Canadian Journal of Cardiology · doi:10.1016/j.cjca.2019.07.623 · Cited by 15
Risk models to predict late-onset seizures after stroke: A systematic review
Lekoubou, A., Debroy, K., Kwegyir-Aggrey, A., Bonilha, L., Kengne, A. P., & Chinchilli, V. M. (2021) · Epilepsy & Behavior · doi:10.1016/j.yebeh.2021.108003 · Cited by 15
Self-citationBovine Viral Diarrhoea Virus (BVDV) in Dairy Cattle: A Matched Case-Control Study
Machado, G., Egocheaga, R. M. F., Hein, H. E., de Miranda, I. C. S., Neto, W. S., de Almeida, L. L., Canal, C. W., Stein, M. C., & Corbellini, L. G. (2014) · Transboundary and Emerging Diseases · doi:10.1111/tbed.12219 · Cited by 15
Risk Prediction Models in Perioperative Medicine: Methodological Considerations
Collins, G. S., Ma, J., Gerry, S., Ohuma, E. O., Odondi, L., Trivella, M., de Beyer, J. A., & Vazquez-Montes, M. (2016) · Current anesthesiology reports · doi:10.1007/s40140-016-0171-8 · Cited by 15
Risk prediction model for postoperative pneumonia in esophageal cancer patients: A systematic review
Jiang, Y., Li, Z., Jiang, W., Wei, T., & Chen, B. (2024) · Frontiers in Oncology · doi:10.3389/fonc.2024.1419633 · Cited by 14
Samim, M., Mungroop, T. H., Hilal, M. A., Isfordink, C. J., Molenaar, I. Q., van der Poel, M. J., Armstrong, T., Takhar, A. S., Pearce, N. W., Primrose, J. M., et al. (2018) · HPB · doi:10.1016/j.hpb.2018.02.635 · Cited by 14
A Risk Prediction Model for Operative Mortality after Heart Valve Surgery in a Korean Cohort
Kim, H. J., Kim, J. B., Kim, S., Yun, S., Lee, S., Lim, C., Choi, J. W., Hwang, H. Y., Kim, K. H., Lee, S. H., et al. (2020) · The Korean Journal of Thoracic and Cardiovascular Surgery · doi:10.5090/jcs.20.102 · Cited by 14
Pavlou, M., Costafreda, S. G., Galsworthy, W. J. H., Korres, G., & Bamiou, D. (2023) · Scientific Reports · doi:10.1038/s41598-023-35904-z · Cited by 15
Schmidt, A. F., Groenwold, R. H. H., Amsellem, P. M., Bacon, N. J., Klungel, O. H., Hoes, A. W., de Boer, A., Kow, K. Y., Maritato, K. C., Kirpensteijn, J., et al. (2015) · Preventive Veterinary Medicine · doi:10.1016/j.prevetmed.2015.10.016 · Cited by 14
Prediction of excessive weight gain in insulin treated patients with type 2 diabetes
Cichosz, S. L., Lundby‐Christensen, L., Johansen, M. D., Tarnow, L., Almdal, T., Hejlesen, O. K., & The C.I.M.T. Trial Group (2016) · Journal of Diabetes · doi:10.1111/1753-0407.12418 · Cited by 14
The objective CORE score allows early rule out in acute chest pain patients
Borna, C., Kollberg, K., Larsson, D., Mokhtari, A., & Ekelund, U. E. G. (2018) · Scandinavian Cardiovascular Journal · doi:10.1080/14017431.2018.1546891 · Cited by 14
Cheng, P., Chou, H., Wang, C., Lo, W., & Liao, L. (2013) · European Archives of Oto-Rhino-Laryngology · doi:10.1007/s00405-013-2629-3 · Cited by 14
Hwang, H. S., Yoon, D. H., Suh, C., & Huh, J. (2016) · Annals of Hematology · doi:10.1007/s00277-016-2689-8 · Cited by 14
Clinical predictors of candidemia in medical non-neutropenic, non-ICU patients. The CaMed score
Ruiz‐Ruigómez, M., Dueñas, C., Hernandez, C., García, D. V., Coronado-Álvarez, N. M., Portillo-Tuñón, V., Cardozo, C., Muñoz‐Medina, L., Cabo-Magadán, R., Luna, J. D. D., et al. (2018) · International Journal of Clinical Practice · doi:10.1111/ijcp.13275 · Cited by 14
Primary Spinal Tumor Mortality Score (PSTMS): a novel scoring system for predicting poor survival
Szövérfi, Z., Lazáry, Á., Bozsódi, Á., Klemencsics, I., Éltes, P. E., & Varga, P. P. (2014) · The Spine Journal · doi:10.1016/j.spinee.2014.03.009 · Cited by 14
Validation of death prediction after breast cancer relapses using joint models
Mauguen, A., Rachet, B., Mathoulin‐Pélissier, S., Lawrence, G., Siesling, S., MacGrogan, G. M., Laurent, A., & Rondeau, V. (2015) · BMC Medical Research Methodology · doi:10.1186/s12874-015-0018-x · Cited by 14
Conde‐Agudelo, A., Romero, R. J., & Roberts, J. M. (2014) · Elsevier eBooks · doi:10.1016/b978-0-12-407866-6.00011-0 · Cited by 14
Hantavirus Pulmonary Syndrome Risk in Entre Ríos, Argentina
Vadell, M. V., Carbajo, A. E., Massa, C., Cueto, G. R., & Villafañe, I. E. G. (2019) · EcoHealth · doi:10.1007/s10393-019-01425-3 · Cited by 13
van Maanen, R., Rutten, F. H., Klok, F. A., Huisman, M. V., Blom, J. W., Moons, K. G. M., & Geersing, G. (2019) · BMJ Open · doi:10.1136/bmjopen-2019-031639 · Cited by 13
Self-citationFast Outcome Categorization of the Upper Limb After Stroke
Jordan, H. T., Che, J., Byblow, W. D., & Stinear, C. M. (2021) · Stroke · doi:10.1161/strokeaha.121.035170 · Cited by 13
Development of a clinical prediction model for perinatal deaths in low resource settings
Housseine, N., Rijken, M. J., Weller, K., Nassor, N. H., Kayode, G. A., Dodd, C. N., Debray, T. P. A., Meguid, T., Franx, A., Grobbee, D. E., et al. (2022) · EClinicalMedicine · doi:10.1016/j.eclinm.2022.101288 · Cited by 13
Self-citationSchiborn, C., Paprott, R., Heidemann, C., Kuhn, T. E., Fritsche, A., Kaaks, R., & Schulze, M. B. (2022) · Deutsches Ärzteblatt international · doi:10.3238/arztebl.m2022.0268 · Cited by 13
Wueest, A. S., Berres, M., Béttex, D., Steiner, L. A., Monsch, A. U., & Goettel, N. (2022) · Journal of Cardiothoracic and Vascular Anesthesia · doi:10.1053/j.jvca.2022.11.038 · Cited by 13
Wang, M., Sajobi, T. T., Hogan, D. B., Ganesh, A., Seitz, D. P., Chekouo, T., Forkert, N. D., BORRIE, M. J., Camicioli, R. M., Hsiung, G. R., et al. (2023) · Alzheimer s & Dementia · doi:10.1002/alz.12987 · Cited by 13
Zakai, N. A., Wilkinson, K. S., Sparks, A. D., Packer, R. T., Koh, I., Roetker, N. S., Repp, A. B., Thomas, R., Holmes, C. E., Cushman, M., et al. (2023) · Journal of Thrombosis and Haemostasis · doi:10.1016/j.jtha.2023.10.015 · Cited by 13
Rentroia‐Pacheco, B., Bellomo, D., Lakeman, I. M. M., Wakkee, M., Hollestein, L. M., & Klaveren, D. V. (2024) · BMC Medical Research Methodology · doi:10.1186/s12874-024-02213-6 · Cited by 13
Ban, J.-W., Stevens, R., & Perera, R. (2018) · Diagnostic and Prognostic Research · doi:10.1186/s41512-018-0025-6 · Cited by 13
Ramspek, C. L., Moumni, M. E., Wali, E., Heemskerk, M. B. A., Pol, R. A., Crop, M. J., Jansen, N. E., Hoitsma, A. J., Dekker, F. W., van Diepen, M., et al. (2020) · Kidney International · doi:10.1016/j.kint.2020.11.016 · Cited by 13
Risk Factors for Hepatic Hydrothorax in Cirrhosis Patients with Ascites – A Clinical Cohort Study
Deleuran, T., Watson, H., Vilstrup, H., & Jepsen, P. (2021) · Digestive Diseases and Sciences · doi:10.1007/s10620-021-07134-8 · Cited by 13
Moerschel, K. S., Bacquer, D. D., Backer, G. D., Wood, D., Kotseva, K., Wellmann, J., & Prugger, C. (2022) · European Journal of Preventive Cardiology · doi:10.1093/eurjpc/zwac079 · Cited by 13
How to conduct a high-quality original study on a diagnostic research topic
Yao, X., & Vella, E. T. (2017) · Surgical Oncology · doi:10.1016/j.suronc.2017.06.005 · Cited by 13
Morris, Z. H., Azab, A. N., Harlev, S., & Plakht, Y. (2018) · European Journal of Obstetrics & Gynecology and Reproductive Biology · doi:10.1016/j.ejogrb.2018.04.028 · Cited by 13
Systematic review of prediction models for postacute care destination decision-making
Kennedy, E. E., Bowles, K. H., & Aryal, S. (2021) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocab197 · Cited by 13
Mayige, M. T. (2014) · Cited by 13
Greco, A., & Capodanno, D. (2025) · Journal of Cardiovascular Development and Disease · doi:10.3390/jcdd12090344 · Cited by 12
Statistically Significant Association Does not Imply Improvement in Prediction of Clinical Outcomes
Jiang, S., ROSNER, B. A., & Colditz, G. A. (2025) · Cancer Prevention Research · doi:10.1158/1940-6207.capr-25-0056 · Cited by 12
Applicability of the Existing CVD Risk Assessment Tools to Type II Diabetics in Oman: A Review
Al-Rawahi, A., & Lee, P. J. (2015) · Oman Medical Journal · doi:10.5001/omj.2015.65 · Cited by 12
Alba, A. C., Buchan, T. A., Saha, S., Fan, C. S., Demers, C., Poon, S., Mak, S. S., Al‐Hesayen, A., Toma, M., Zieroth, S. R., et al. (2023) · Circulation Heart Failure · doi:10.1161/circheartfailure.122.010312 · Cited by 12
Improved Mortality Prediction in Dialysis Patients Using Specific Clinical and Laboratory Data
Hemke, A. C., Heemskerk, M. B. A., van Diepen, M., Dekker, F. W., & Hoitsma, A. J. (2015) · American Journal of Nephrology · doi:10.1159/000439181 · Cited by 12
No added value of interferon-γ release to a prediction model for childhood tuberculosis
Togun, T. O., Egere, U., Gomez, M. P., Sillah, A. K., Daramy, M., Tientcheu, L. D., Sutherland, J. S., Hill, P. C., & Kampmann, B. (2015) · European Respiratory Journal · doi:10.1183/13993003.00890-2015 · Cited by 12
Prognosis research and risk of bias
D’Amico, G., Malizia, G., & D’Amico, M. (2016) · Internal and Emergency Medicine · doi:10.1007/s11739-016-1404-z · Cited by 12
Atiksawedparit, P., Rattanasiri, S., Sittichanbuncha, Y., McEvoy, M., Suriyawongpaisal, P., Attia, J. R., & Thakkinstian, A. (2019) · Injury · doi:10.1016/j.injury.2019.05.028 · Cited by 12
Xu, W., Huang, J., Yu, Q., Yu, H., Pu, Y., & Shi, Q. (2021) · Neurological Sciences · doi:10.1007/s10072-021-05219-w · Cited by 12
Chen, S., Wang, C., Gu, Y., Ruan, R., Yu, J., & Wang, S. (2022) · Frontiers in Oncology · doi:10.3389/fonc.2021.774800 · Cited by 12
Feleke, S. F., Anteneh, Z. A., Wassie, G. T., Yalew, A. K., & Dessie, A. M. (2022) · BMJ Open · doi:10.1136/bmjopen-2022-061061 · Cited by 12
Risk Prediction Models: Applications in Cancer Prevention
Colditz, G. A., & Wei, E. K. (2015) · Current Epidemiology Reports · doi:10.1007/s40471-015-0057-1 · Cited by 12
Lee, Y. M., Lang, D. S. P., & Lockwood, C. S. (2012) · JBI Library of Systematic Reviews · doi:10.11124/jbisrir-2012-31 · Cited by 12
Campbell, D. J. (2016) · BMC Research Notes · doi:10.1186/s13104-016-2028-0 · Cited by 12
Hentzien, M., Delpierre, C., Puglièse, P., Allavena, C., Jacomet, C., Valantin, M., Cabie, A., Cuzin, L., Rey, D., Bani‐Sadr, F., et al. (2018) · PLoS ONE · doi:10.1371/journal.pone.0195725 · Cited by 12
Deng, M. C.-H. K. (2018) · Biomarkers in Medicine · doi:10.2217/bmm-2018-0097 · Cited by 12
Wisnieski, L. C., Norby, B., Pierce, S. J., Becker, T. B., Gandy, J. C., & Sordillo, L. M. (2019) · Preventive Veterinary Medicine · doi:10.1016/j.prevetmed.2019.104692 · Cited by 12
Adam, L., Feller, M., Syrogiannouli, L., Giovane, C. D., Donzé, J. D., Baumgartner, C., Segna, D., Floriani, C., Roten, L., Fischer, U., et al. (2021) · Journal of Thrombosis and Haemostasis · doi:10.1111/jth.15251 · Cited by 12
Carluccio, E., Biagioli, P., Alunni, G., Murrone, A., Zingarini, G., Coiro, S., D’Antonio, A., Mengoni, A., Cerasa, M. F., & Ambrosio, G. (2017) · International Journal of Cardiology · doi:10.1016/j.ijcard.2017.05.123 · Cited by 12
Prediction models in gynaecology: Transparent reporting needed for clinical application
Gelderblom, M. E., Stevens, K. Y. R., Houterman, S., Weyers, S., & Schoot, B. C. (2021) · European Journal of Obstetrics & Gynecology and Reproductive Biology · doi:10.1016/j.ejogrb.2021.08.013 · Cited by 11
Humbert‐Vidan, L., Hansen, C. R., Petit, S., Muñoz-Montplet, C., Hueniken, K., Mohamed, A. S. R., Saunders, D. P., Patel, V., Verduijn, G. M., Heemsbergen, W. D., et al. (2026) · International Journal of Radiation Oncology*Biology*Physics · doi:10.1016/j.ijrobp.2025.12.044 · Cited by 11
Yang, C., Wu, X., Liu, J., Wang, H., Jiang, Y., Wei, Z., & Cai, Q. (2023) · Journal of Hepatocellular Carcinoma · doi:10.2147/jhc.s396433 · Cited by 11
Atchley, T. J., Gross, E. G., Alam, Y., Estévez-Ordoñez, D., Saccomano, B. W., George, J. A., Laskay, N. M. B., Schmalz, P. G. R., Riley, K. O., & Fisher, W. S. (2023) · World Neurosurgery · doi:10.1016/j.wneu.2023.12.061 · Cited by 11
Suttie, M., Kable, J. A., Mahnke, A. H., & Bandoli, G. (2024) · Alcoholism Clinical and Experimental Research · doi:10.1111/acer.15271 · Cited by 11
Parkinson, C., Foley, K., Whybra, P., Hills, R. K., Roberts, A., Marshall, C., Staffurth, J., & Spezi, E. (2018) · EJNMMI Research · doi:10.1186/s13550-018-0379-3 · Cited by 11
Prognostic relevance of Doppler echocardiographic re-assessment in HFrEF patients
Ghio, S., Carluccio, E., Scardovi, A. B., Dini, F. L., Rossi, A., Falletta, C., Scelsi, L., Greco, A., & Temporelli, P. L. (2020) · International Journal of Cardiology · doi:10.1016/j.ijcard.2020.11.025 · Cited by 11
Alkosha, H. M., Abuelnasr, T., & Mohammed, M. (2022) · World Neurosurgery · doi:10.1016/j.wneu.2022.02.005 · Cited by 11
O’Shea, R. J., Rookyard, C., Withey, S. J., Cook, G., Tsoka, S., & Goh, V. (2022) · Insights into Imaging · doi:10.1186/s13244-022-01245-0 · Cited by 11
Damoiseaux‐Volman, B. A., van Schoor, N. M., Medlock, S. K., Romijn, J. A., van der Velde, N., & Abu–Hanna, A. (2022) · European Geriatric Medicine · doi:10.1007/s41999-022-00719-0 · Cited by 12
Bavry, A. A., Gong, Y., Handberg, E. M., Cooper‐DeHoff, R. M., & Pepine, C. J. (2014) · The American Journal of Medicine · doi:10.1016/j.amjmed.2014.09.028 · Cited by 11
Taravatmanesh, S., Khalili, D., Khodakarim, S., Asgari, S., Hadaegh, F., Azizi, F., & Sabour, S. (2017) · PubMed Central · Cited by 11
Wisnieski, L. C., Norby, B., Pierce, S. J., Becker, T. B., Gandy, J. C., & Sordillo, L. M. (2019) · Preventive Veterinary Medicine · doi:10.1016/j.prevetmed.2019.104701 · Cited by 11
External Validation of the DynPG for Kidney Transplant Recipients
Lenain, R., Dantan, É., Giral, M., Foucher, Y., Asar, Ö., Naesens, M., Hazzan, M., & Fournier, M. (2020) · Transplantation · doi:10.1097/tp.0000000000003209 · Cited by 11
Baart, A. M., Fontana, S., Tschaggelar, A., Heymans, M. W., & de Kort, W. L. A. M. (2016) · Transfusion Medicine and Hemotherapy · doi:10.1159/000446817 · Cited by 11
Nugawela, M. D., Stephenson, T. J., Shafran, R., Stavola, B. L. D., Ladhani, S. N., Simmons, R., McOwat, K., Rojas, N. K., Cheung, E. Y., Ford, T. J., et al. (2022) · medRxiv · doi:10.1101/2022.04.01.22273117 · Cited by 11
Pestarino, L., Fortner, R. T., Nøst, T. H., Fotopoulos, I., Urbárová, I., Røe, O. D., Langseth, H., & Rounge, T. B. (2025) · Cancer Epidemiology Biomarkers & Prevention · doi:10.1158/1055-9965.epi-25-0787 · Cited by 10
Cardiovascular Risk Prediction in Older Adults
Colantonio, L. D., & Bittner, V. (2025) · Current Atherosclerosis Reports · doi:10.1007/s11883-025-01339-2 · Cited by 10
Liu, Z., Liang, Y., Yu, J., Yu, J., & Liu, J. (2026) · PLoS ONE · doi:10.1371/journal.pone.0342286 · Cited by 10
Liu, X., Tao, L., Wang, M., Li, H., & Xu, W. (2022) · Clinical Breast Cancer · doi:10.1016/j.clbc.2022.10.010 · Cited by 10
Tao, Y., Chen, S., Yu, J., Shen, Q., Ruan, R., & Wang, S. (2022) · Frontiers in Medicine · doi:10.3389/fmed.2022.1038097 · Cited by 10
Dinh, T. S., Meid, A. D., Rudolf, H., Brueckle, M.-S., González‐González, A. I., Bencheva, V., Gogolin, M., Snell, K. I. E., Elders, P. J. M., Thuermann, P. A., et al. (2023) · PLoS ONE · doi:10.1371/journal.pone.0280907 · Cited by 10
He, T., Li, H., & Zhang, Z. (2023) · Journal of Ovarian Research · doi:10.1186/s13048-023-01173-7 · Cited by 10
Guo, X., Xu, H., Zhang, J., Hao, B., & Yang, T. (2023) · Heliyon · doi:10.1016/j.heliyon.2023.e22226 · Cited by 10
Garwe, T., & Choi, J. (2025) · The Journal of Trauma: Injury, Infection, and Critical Care · doi:10.1097/ta.0000000000004584 · Cited by 10
Reveiz, M., Bouhouita-Guermech, S., Blackmore, K. M., Chiquette, J., Demers, É., Dorval, M., Lambert-Côté, L., Nabi, H., Pashayan, N., Soucy, P., et al. (2025) · Frontiers in Genetics · doi:10.3389/fgene.2025.1481863 · Cited by 10
Zondervan, P. J., van Lienden, K. P., van Delden, O. M., de la Rosette, J. J. M. C. H., & Laguna, M. P. (2015) · Journal of Endourology · doi:10.1089/end.2015.0472 · Cited by 10
Metadata
- Authors
- Moons, K. G. M., Kengne, A. P., Woodward, M., Royston, P., Vergouwe, Y., Altman, D. G., & Grobbee, D. E.
- Affiliations
- University Medical Center Utrecht (NL)
- The University of Sydney (AU)
- MRC Clinical Trials Unit at UCL (GB)
- University of Oxford (GB)
- Corresponding author
- Moons, Karel G M
- Venue
- Heart
- Publisher
- BMJ
- Published
- 2012-03-07
- Volume
- 98
- Issue
- 9
- Pages
- 683-690
- ISSN
- 1355-6037 (ISSN-L)
- 1468-201X
- OpenAlex
- W2146404132
- Cited by
- 889
- References
- 100
- Citations by year
- 2026: 42 · 2025: 52 · 2024: 59 · 2023: 59 · 2022: 92 · 2021: 87 · 2020: 75 · 2019: 46 · 2018: 76 · 2017: 53 · 2016: 58 · 2015: 68 · 2014: 56 · 2013: 44 · 2012: 18
- FWCI
- 9.09
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Heart (publishedVersion)
- PubMed (publishedVersion)
- UCL Discovery (University College London) (submittedVersion)
- Funders
- Medical Research Council (MC_EX_G0800814)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Health Sciences › Health Professions › Health Information Management › Artificial Intelligence in Healthcare
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Keywords
- risk prediction model, model development, internal validation, optimism bias, cardiovascular risk prediction, predictive performance, clinical decision-making, cost-effectiveness
- MeSH terms
- Cardiovascular Diseases, Cost-Benefit Analysis, Decision Making, Decision Support Techniques, Humans, Models, Theoretical, Predictive Value of Tests, Risk, Reproducibility of Results, Biomarkers
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.