Risk prediction models: I. Development, internal validation, and assessing the incremental value of a new (bio)marker
The DOI matches its Crossref record; 100 of the 100 references it cites were found in a registry or an index.
Abstract
Prediction models are increasingly used to complement clinical reasoning and decision making in modern medicine in general, and in the cardiovascular domain in particular. Developed models first and foremost need to provide accurate and (internally and externally) validated estimates of probabilities of specific health conditions or outcomes in targeted patients. The adoption of such models must guide physician's decision making and an individual's behaviour, and consequently improve individual outcomes and the cost-effectiveness of care. In a series of two articles we review the consecutive steps generally advocated for risk prediction model research. This first article focuses on the different aspects of model development studies, from design to reporting, how to estimate a model's predictive performance and the potential optimism in these estimates using internal validation techniques, and how to quantify the added or incremental value of new predictors or biomarkers (of whatever type) to existing predictors. Each step is illustrated with empirical examples from the cardiovascular field.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“It is therefore essential that key details of how a prediction model was developed and validated be clearly reported to enable synthesis and critical appraisal of all relevant information (14,(33)(34)(35)(36).”
From Transparent Reporting of a multivariable prediction model for Individual Prognosis Or Diagnosis (TRIPOD): The TRIPOD Statement (2015) · cites this paper as [14]
In the citing paper
“The TRIPOD Statement covers studies that report solely development [12,15], both development and external validation, and solely external validation (with or without updating), of a prediction model [14] (Figure 1).”
From Transparent reporting of a multivariable prediction model for individual prognosis or diagnosis (TRIPOD): the TRIPOD Statement (2015) · cites this paper as [15]
In the citing paper
“The TRIPOD Statement covers studies that report solely development,12,15 both development and external validation, and solely external validation (with or without updating), of a prediction model14 (Figure 3).”
From Transparent Reporting of a Multivariable Prediction Model for Individual Prognosis or Diagnosis (TRIPOD): The TRIPOD Statement (2015) · cites this paper as [15]
Citations
Cites
An Introduction to the Bootstrap
Efron, B., & Tibshirani, R. J. (1994) · doi:10.1201/9780429246593 · Cited by 40,500
(1990) · Choice Reviews Online · doi:10.5860/choice.27-3338 · Cited by 35,305
An Introduction to the Bootstrap
Efron, B., & Tibshirani, R. J. (1993) · doi:10.1007/978-1-4899-4541-9 · Cited by 21,230
Multiple Imputation for Nonresponse in Surveys
Rubin, D. B. (1987) · Wiley Series in Probability and Statistics · doi:10.1002/9780470316696 · Cited by 20,701
Hosmer, D. W., & Lemeshow, S. (2000) · doi:10.1002/0471722146 · Cited by 20,302
Statistical Analysis With Missing Data
Lahiff, M., Little, R. J. A., & Rubin, D. B. (1989) · Journal of the American Statistical Association · doi:10.2307/2289883 · Cited by 17,265
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · PLoS Medicine · doi:10.1371/journal.pmed.0020124 · Cited by 10,505
A simulation study of the number of events per variable in logistic regression analysis
Peduzzi, P., Concato, J., Kemper, E., Holford, T. R., & Feinstein, A. R. (1996) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(96)00236-3 · Cited by 9,655
Prediction of coronary heart disease using risk factor categories
Wilson, P. W. F., D’Agostino, R. B., Levy, D., Belanger, A. M., Silbershatz, H., & Kannel, W. B. (1998) · Circulation · doi:10.1161/01.cir.97.18.1837 · Cited by 9,581
Harrell, F. E. (2001) · Springer Series in Statistics · doi:10.1007/978-1-4757-3462-1 · Cited by 9,195
Research works printed but not linked: 2
- Wells, 1997, A simple clinical model to categorize pretest probability in patients with suspected pulmonary embolism, Blood, 90, 424
- Hosmer DW Lemeshow S . Applied Survival Analysis: Regression Modelling of Time to Event Data. New York: Wiley, 1999.
Cited by
Items 301–400 of 1,000
McFARLANE, J. M., Pennings, J. S., Liu, F., Gilroy, H., Nava, A., Maddoux, J. A., Montalvo‐Liendo, N., & Paulson, R. M. (2015) · Violence Against Women · doi:10.1177/1077801215599843 · Cited by 27
Luo, T., Li, Y., Nie, R., Liang, C., Liu, Z., Xue, Z., Chen, G., Jiang, K., Liu, Z., Lin, H., et al. (2020) · Computational and Structural Biotechnology Journal · doi:10.1016/j.csbj.2020.09.037 · Cited by 27
Wang, Y., Zhang, L., Niu, M., Li, R., Tu, R., Liu, X., Hou, J., Mao, Z., Wang, Z., & Wang, C. (2021) · Frontiers in Public Health · doi:10.3389/fpubh.2021.606711 · Cited by 27
Parise, O., Parise, G., Vaidyanathan, A., Occhipinti, M., Gharaviri, A., Tetta, C., Bidar, E., Maesen, B. A. E., Maessen, J. G., Meir, M. L., et al. (2023) · Journal of Cardiovascular Development and Disease · doi:10.3390/jcdd10020082 · Cited by 27
Validity of the Maximal Heart Rate Prediction Models among Runners and Cyclists
Kasiak, P. S., Wiecha, S., Cieśliński, I., Takken, T., Łach, J., Lewandowski, M., Barylski, M., Mamcarz, A., & Śliż, D. (2023) · Journal of Clinical Medicine · doi:10.3390/jcm12082884 · Cited by 27
Zhong, K., An, X., Kong, Y., & Zhu, C. (2024) · Clinical Neurology and Neurosurgery · doi:10.1016/j.clineuro.2024.108225 · Cited by 27
Masconi, K. L., Matsha, T. E., Erasmus, R. T., & Kengne, A. P. (2015) · PLoS ONE · doi:10.1371/journal.pone.0139210 · Cited by 27
Self-citationRisk predictive modelling for diabetes and cardiovascular disease
Kengne, A. P., Masconi, K. L., Mbanya, V. N., Lekoubou, A., Echouffo-Tcheugui, J. B., & Matsha, T. E. (2013) · Critical Reviews in Clinical Laboratory Sciences · doi:10.3109/10408363.2013.853025 · Cited by 28
Self-citationRaskovalova, T., Deegan, P. B., Yang, R., Pavlova, E., Stirnemann, J., Labarère, J., Zimran, A., Mistry, P. K., & Berger, M. G. (2017) · Systematic Reviews · doi:10.1186/s13643-017-0483-x · Cited by 29
Risk Calculators in Bipolar Disorder: A Systematic Review
Silva Ribeiro, J., Pereira, D., Salagre, E., Coroa, M., Santos Oliveira, P., Santos, V., Madeira, N., Grande, I., & Vieta, E. (2020) · Brain Sciences · doi:10.3390/brainsci10080525 · Cited by 26
“Risk calculators estimate the probability of an individual to develop a particular outcome based on different predictors, such as demographic variables, clinical evaluation, and complementary diagnostic exam results [30].”
BackgroundIn humble defense of unexplainable black box prediction models in healthcare
van Royen, F. S.-A., Weerts, H., de Hond, A., Geersing, G., Rutten, F. H., Moons, K. G. M., & van Smeden, M. (2025) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2025.112013 · Cited by 26
Self-citationDhiman, P., Andersen, S., Vestergaard, P., Masud, T., & Qureshi, N. (2018) · BMJ Open · doi:10.1136/bmjopen-2017-018898 · Cited by 26
Clinical history of cancer‐associated splanchnic vein thrombosis
Valeriani, E., Nisio, M. D., Riva, N., Caiano, L. M., Porreca, E., Bang, S., Beyer‐Westendorf, J., Sartori, M. T., Barillari, G., Santoro, R., et al. (2020) · Journal of Thrombosis and Haemostasis · doi:10.1111/jth.15214 · Cited by 26
Batzlaff, C. M., Karpman, C., Afessa, B., & Benzo, R. P. (2014) · Mayo Clinic Proceedings · doi:10.1016/j.mayocp.2013.12.004 · Cited by 26
Posch, F., Gebhart, J., Rand, J. H., Koder, S., Quehenberger, P., Pengo, V., Ay, C., & Pabinger, I. (2017) · BMC Medicine · doi:10.1186/s12916-017-0807-7 · Cited by 25
“5 s)), diabetes, smoking, and aCL IgM antibodies) was applied to construct a multivariable model for the prediction of thrombotic risk [26].”
MethodJeong, C. W., Lee, S., Jung, J.-W., Lee, B. K., Jeong, S. J., Hong, S. K., Byun, S., & Lee, S. E. (2014) · PLoS ONE · doi:10.1371/journal.pone.0094441 · Cited by 25
Miao, Z., Sealey, M. D., Sathyanarayanan, S., Delen, D., Zhu, L., & Shepherd, S. (2022) · Information Systems · doi:10.1016/j.is.2022.102130 · Cited by 25
Hueting, T. A., van Maaren, M. C., Hendriks, M. P., Koffijberg, H., & Siesling, S. (2022) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2022.10.016 · Cited by 26
Wheeler, A. M., Baker, J. F., Riley, T. R., Yang, Y., Roul, P., Wysham, K. D., Cannon, G. W., Kunkel, G. A., Kerr, G. S., Ascherman, D. P., et al. (2024) · Rheumatology · doi:10.1093/rheumatology/keae001 · Cited by 25
Costa, G. D., Passerini, G., Messina, M., Moiola, L., Rodegher, M., Colombo, B., Locatelli, M., Comı, G., Furlan, R., & Martinelli, V. (2015) · Journal of Neuroimmunology · doi:10.1016/j.jneuroim.2015.10.009 · Cited by 25
On the importance of global cardiovascular risk assessment in people with type 2 diabetes
Echouffo-Tcheugui, J. B., & Kengne, A. P. (2013) · Primary care diabetes · doi:10.1016/j.pcd.2013.03.002 · Cited by 25
Self-citationCollins, G. S., Reitsma, J. B., Altman, D. G., & Moons, K. G. M. (2015) · Diabetic Medicine · doi:10.1111/dme.12654 · Cited by 27
Self-citationWall, E. C., Mukaka, M., Scarborough, M., Ajdukiewicz, K. M. B., Cartwright, K. E., Nyirenda, M., Denis, B., Allain, T. J., Faragher, B. E., Lalloo, D. G., et al. (2016) · Clinical Infectious Diseases · doi:10.1093/cid/ciw779 · Cited by 25
Development and validation of the Adverse Inpatient Medication Event model (AIME)
Falconer, N., Barras, M. A., Abdel‐Hafez, A., Radburn, S., & Cottrell, N. (2020) · British Journal of Clinical Pharmacology · doi:10.1111/bcp.14560 · Cited by 25
Cerebral Small Vessel Disease MRI Features Do Not Improve the Prediction of Stroke Outcome
Coutureau, J., Asselineau, J., Perez, P., Kuchcinski, G., Sagnier, S., Renou, P., Munsch, F., Lopes, R., Hénon, H., Bordet, R., et al. (2020) · Neurology · doi:10.1212/wnl.0000000000011208 · Cited by 25
The Role of Artificial Intelligence in Chronic Liver Diseases and Liver Transplantation
Spann, A., Strauss, A. T., Davis, S. E., & Bhat, M. (2025) · Gastroenterology · doi:10.1053/j.gastro.2025.05.012 · Cited by 24
Fehr, J., Piccininni, M., Kurth, T., Konigorski, S., & Initiative, T. A. D. N. (2023) · BMC Medical Research Methodology · doi:10.1186/s12874-023-02003-6 · Cited by 25
Shen, W., Sakamoto, N., & Yang, L. (2014) · BMC Cancer · doi:10.1186/1471-2407-14-554 · Cited by 24
Meisner, A., Kerr, K. F., Thiessen‐Philbrook, H., Coca, S. G., & Parikh, C. R. (2015) · Kidney International · doi:10.1038/ki.2015.283 · Cited by 24
Lodewijk, L., Kluijfhout, W. P., Kist, J. W., Stegeman, I., Plukker, J. T., van Dijkum, E. J. M. N., Bonjer, H. J., Bouvy, N. D., Schepers, A., de Wilt, J. H. W., et al. (2016) · Langenbeck s Archives of Surgery · doi:10.1007/s00423-016-1393-4 · Cited by 24
A Comprehensive Risk Score to Predict Prolonged Hospital Length of Stay After Heart Transplantation
Crawford, T. C., Magruder, J. T., Grimm, J. C., Suarez‐Pierre, A., Patel, N., Sciortino, C. M., Zehr, K. J., Mandal, K., Tedford, R. J., Russell, S. D., et al. (2017) · The Annals of Thoracic Surgery · doi:10.1016/j.athoracsur.2017.07.012 · Cited by 24
Prediction of individuals at high absolute risk of esophageal squamous cell carcinoma
Wang, Q.-L., Lagergren, J., & Xie, S.-H. (2018) · Gastrointestinal Endoscopy · doi:10.1016/j.gie.2018.10.025 · Cited by 24
Age-Specific Risk Scores Do Not Improve HIV-1 Prediction Among Women in South Africa
Peebles, K., Palanee‐Phillips, T., Balkus, J. E., Beesham, I., Makkan, H., Deese, J., Smit, J. A., Heffron, R. A., MORRISON, C. S., Philip, N. M., et al. (2020) · JAIDS Journal of Acquired Immune Deficiency Syndromes · doi:10.1097/qai.0000000000002436 · Cited by 24
Ställberg, B., Lisspers, K., Larsson, K., Janson, C., Müller, M., Łuczko, M., Bjerregaard, B. K., Bacher, G., Holzhauer, B., Goyal, P., et al. (2021) · International Journal of COPD · doi:10.2147/copd.s293099 · Cited by 24
Harrison, D. A., Ferrando-Vivas, P., Shahin, J., & Rowan, K. (2015) · Health Services and Delivery Research · doi:10.3310/hsdr03410 · Cited by 24
Monahan, A. C., & Feldman, S. S. (2021) · JMIR Medical Informatics · doi:10.2196/30022 · Cited by 23
Can we really predict risk of cancer?
Thrift, A. P., & Whiteman, D. C. (2013) · Cancer Epidemiology · doi:10.1016/j.canep.2013.04.002 · Cited by 24
Dasenbrock, H. H., Smith, T. R., Gormley, W. B., Castlen, J. P., Patel, N. J., Frerichs, K. U., Aziz‐Sultan, M. A., & Du, R. (2019) · Journal of the American Heart Association · doi:10.1161/jaha.119.013412 · Cited by 23
A computational approach to compare regression modelling strategies in prediction research
Pajouheshnia, R., Pestman, W. R., Teerenstra, S., & Groenwold, R. H. H. (2016) · BMC Medical Research Methodology · doi:10.1186/s12874-016-0209-0 · Cited by 23
Häberle, L., Hein, A., Rübner, M., Schneider, M. O., Ekici, A. B., Gaß, P., Hartmann, A., Schulz‐Wendtland, R., Beckmann, M. W., Lo, W., et al. (2017) · Geburtshilfe und Frauenheilkunde · doi:10.1055/s-0043-111602 · Cited by 22
Wu, H.-L., Wu, Y.-M., Chen, J., Chang, K.-Y., Cherng, Y., Lin, S.-P., Tsou, M., & Tai, Y. (2020) · Scientific Reports · doi:10.1038/s41598-020-76644-8 · Cited by 22
Hong, S. I., Kim, K. W., Park, H. J., Ko, Y., Yoo, C., Park, S. Y., Khang, S., Jeong, H., & Lee, J. (2022) · Frontiers in Oncology · doi:10.3389/fonc.2022.878472 · Cited by 22
Varey, A. H. R., Li, I., Sharouni, M. E., Simon, J. M., Dedeilia, A., Ch’ng, S., Saw, R. P. M., Spillane, A. J., Shannon, K. F., Pennington, T. E., et al. (2024) · Journal of Clinical Oncology · doi:10.1200/jco.23.01020 · Cited by 22
Cho, H., Kim, M.-H., Kim, H. J., Park, J. Y., Ryu, D., Lee, H., Lee, J. P., Lim, C.-S., Kim, K. H., Oh, K., et al. (2016) · Peritoneal Dialysis International · doi:10.3747/pdi.2015.00201 · Cited by 22
Dorajoo, S. R., Ng, J. S. L., Goh, J. H. F., Lim, S. C., Yap, C. W., Chan, A., & Lee, J. Y. C. (2017) · Diabetes Research and Clinical Practice · doi:10.1016/j.diabres.2017.02.007 · Cited by 23
Lifestyle index for mortality prediction using multiple ageing cohorts in the USA, UK and Europe
Liao, J., Terrera, G. M., Scholes, S., Hao, Y., & Chen, Y. (2018) · Scientific Reports · doi:10.1038/s41598-018-24778-1 · Cited by 22
Schoenaker, D. A. J. M., Vergouwe, Y., Soedamah‐Muthu, S. S., Callaway, L. K., & Mishra, G. D. (2018) · Diabetes Research and Clinical Practice · doi:10.1016/j.diabres.2018.09.021 · Cited by 22
Self-citationReal-time imputation of missing predictor values in clinical practice
Nijman, S. W. J., Hoogland, J., Groenhof, T. K. J., Brandjes, M., Jacobs, J. J. L., Bots, M. L., Asselbergs, F. W., Moons, K. G. M., & Debray, T. P. A. (2020) · European Heart Journal - Digital Health · doi:10.1093/ehjdh/ztaa016 · Cited by 22
Self-citationLeft ventricular assist device patient selection: do risk scores help?
Ravichandran, A. K., & Cowger, J. A. (2015) · PubMed · doi:10.3978/j.issn.2072-1439.2015.11.02 · Cited by 22
Balitsky, A. K., Kelton, J. G., & Arnold, D. M. (2018) · Blood · doi:10.1182/blood-2018-08-868406 · Cited by 22
PSA enzymatic activity: A new biomarker for assessing prostate cancer aggressiveness
Ahrens, M. J., Bertin, P. A., Vonesh, E. F., Meade, T. J., Catàlona, W. J., & Georganopoulou, D. G. (2013) · The Prostate · doi:10.1002/pros.22714 · Cited by 22
A Pragmatic Preoperative Prediction Score for Nonhome Discharge After Cardiac Operations
Powers, J. S., Rydingsward, J. E., Lander, H. L., Ng, J. A., Xu, X., Kaneko, T., Shekar, P., Muehlschlegel, J. D., & Body, S. C. (2017) · The Annals of Thoracic Surgery · doi:10.1016/j.athoracsur.2017.11.060 · Cited by 21
Urinary Biomarkers of Renal Fibrosis
Zhou, L., Lv, L., & Liu, B. (2019) · Advances in experimental medicine and biology · doi:10.1007/978-981-13-8871-2_30 · Cited by 21
Massy, Z. A., Lambert, O., Metzger, M., Sedki, M., Chaubet, A., Breuil, B., Jaafar, A., Tack, I., Nguyen‐Khoa, T., Alvès, M., et al. (2022) · Kidney International Reports · doi:10.1016/j.ekir.2022.11.023 · Cited by 21
Langenhuijsen, L. F. S., Janse, R. J., Venema, E., Kent, D. M., van Diepen, M., Dekker, F. W., Steyerberg, E. W., & de Jong, Y. (2023) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2023.04.012 · Cited by 22
Validation of the Aldosteronoma Resolution Score Within Current Clinical Practice
Vorselaars, W. M. C. M., van Beek, D., Postma, E. L., Spiering, W., Rinkes, I. H. M. B., Valk, G. D., Vriens, M. R., International CONNsortium Study Group, Zarnegar, R., Fahey, T. J., et al. (2019) · World Journal of Surgery · doi:10.1007/s00268-019-05074-z · Cited by 21
Schuijt, H. J., Bos, J. A. H., Smeeing, D. P. J., Geraghty, O., & van der Velde, D. (2019) · European Journal of Trauma and Emergency Surgery · doi:10.1007/s00068-019-01278-z · Cited by 21
Acuña, J. C. R., & Vila, M. (2021) · American Journal of Distance Education · doi:10.1080/08923647.2021.1954839 · Cited by 21
Claassen-van Dessel, N., van der Wouden, J. C., Twisk, J. W. R., Dekker, J., & van der Horst, H. E. (2018) · Journal of Psychosomatic Research · doi:10.1016/j.jpsychores.2018.02.009 · Cited by 20
King, C., Llewellyn, C. D., Shahmanesh, M., Abraham, C., Bailey, J., Burns, F. M., Clark, L., Copas, A. J., Howarth, A., Hughes, G., et al. (2019) · Health Technology Assessment · doi:10.3310/hta23120 · Cited by 20
Distributed functional connectivity predicts neuropsychological test performance among older adults
Kwak, S., Kim, H., Kim, H., Youm, Y., & Chey, J. (2021) · Human Brain Mapping · doi:10.1002/hbm.25436 · Cited by 20
Youssef, A., van der Hoorn, M., Dongen, M., Visser, J., Bloemenkamp, K. W. M., Lith, J. M. M. V., van Geloven, N., & Lashley, E. E. L. O. (2021) · Human Reproduction · doi:10.1093/humrep/deab264 · Cited by 20
Hayward, K. S., Kuys, S. S., Barker, R. N., & Brauer, S. (2014) · Neurorehabilitation · doi:10.3233/nre-141096 · Cited by 20
Lodde, M., Mian, C., Mayr, R., Comploj, E., Trenti, E., Melotti, R., Campodonico, F., Maffezzini, M., Fritsche, H., & Pycha, A. (2014) · International Journal of Urology · doi:10.1111/iju.12509 · Cited by 20
Hegendörfer, E., Vaes, B., Pottelbergh, G. V., Matheï, C., Verbakel, J. Y. J., & Degryse, J. (2019) · Journal of the American Medical Directors Association · doi:10.1016/j.jamda.2019.08.029 · Cited by 20
Zhang, X., Ning, L., Hu, Y., Zhao, S., Li, Z., Li, L., Dai, Y., Jiang, L., Wang, A., Chu, X., et al. (2020) · Annals of Surgical Oncology · doi:10.1245/s10434-020-08244-9 · Cited by 20
Comprehensive Analysis of Prognostic Alternative Splicing Signatures in Oral Squamous Cell Carcinoma
Cao, R., Zhang, J., Jiang, L., Wang, Y., Ren, X., Cheng, B., & Xia, J. (2020) · Frontiers in Oncology · doi:10.3389/fonc.2020.01740 · Cited by 20
Masconi, K. L., Matsha, T. E., Erasmus, R. T., & Kengne, A. P. (2015) · Diabetology & Metabolic Syndrome · doi:10.1186/s13098-015-0039-y · Cited by 20
Self-citationYonel, Z., Kocher, T., Chapple, I., Dietrich, T., Völzke, H., Nauck, M. A., Collins, G. S., Gray, L. J., & Holtfreter, B. (2022) · Journal of Dental Research · doi:10.1177/00220345221129807 · Cited by 19
Thomas, J., Bansback, N. J., Barber, C. E. H., Wells, G. A., & Hazlewood, G. S. (2022) · Best Practice & Research Clinical Rheumatology · doi:10.1016/j.berh.2022.101812 · Cited by 19
Musto, L., Smith, A. J., Pepper, C., Bujkiewicz, S., & Bown, M. J. (2024) · British journal of surgery · doi:10.1093/bjs/znae239 · Cited by 19
Utsumi, T., Ishitsuka, N., Noro, T., Suzuki, Y., Iijima, S., Sugizaki, Y., Somoto, T., Oka, R., Endo, T., Kamiya, N., et al. (2025) · International Journal of Urology · doi:10.1111/iju.70075 · Cited by 18
Myers, J., Kei, J., Aithal, S., Aithal, V., Driscoll, C., Khan, A., Manuel, A., Joseph, A., & Malicka, A. N. (2018) · Ear and Hearing · doi:10.1097/aud.0000000000000565 · Cited by 19
Preeclampsia Risk Prediction Model for Chinese Pregnant Patients With Systemic Lupus Erythematosus
Jiang, M., Wang, Y., Fu, Q., Lin, S., Wu, J., & Di, W. J. (2020) · Arthritis Care & Research · doi:10.1002/acr.24265 · Cited by 19
Tan, Y., Huo, L., Wang, S., Geng, C., Li, Y., Ma, X., Wang, B., He, Y., Yao, C., & Ouyang, T. (2021) · Cancer Management and Research · doi:10.2147/cmar.s297794 · Cited by 19
Review of Laboratory Methods to Determine HDL and LDL Subclasses and Their Clinical Importance
Chary, A., & Hedayati, M. (2022) · Reviews in Cardiovascular Medicine · doi:10.31083/j.rcm2304147 · Cited by 19
Prognostic impact of systolic blood pressure variability in people with diabetes
Bell, K., Azizi, L., Nilsson, P. M., Hayen, A. D., Irwig, L., Östgren, C. J., & Sundröm, J. (2018) · PLoS ONE · doi:10.1371/journal.pone.0194084 · Cited by 19
Lo, W., Hsu, W., Wang, C., Cheng, P., & Liao, L. (2019) · PLoS ONE · doi:10.1371/journal.pone.0221062 · Cited by 19
Zhang, H., Shao, J., Chen, D., Zou, P., Cui, N., Tang, L., Wang, D., & Ye, Z. (2020) · Diabetes Metabolic Syndrome and Obesity · doi:10.2147/dmso.s283949 · Cited by 19
Maarsingh, O. R., Heymans, M. W., Verhaak, P. F. M., Penninx, B. W. J. H., & Comijs, H. C. (2018) · Journal of Affective Disorders · doi:10.1016/j.jad.2018.04.026 · Cited by 19
Kraler, S. C., Liberale, L., Nopp, S., Englisch, C., Grilz, E., Lapikova-Bryhinska, T., Akhmedov, A. T., Carbone, F., Ramoni, D., Tirandi, A., et al. (2024) · Journal of Thrombosis and Haemostasis · doi:10.1016/j.jtha.2024.07.019 · Cited by 18
Cancelliere, C., Boyle, E., Côté, P., Holm, L. W., Salmi, L., & Cassidy, J. D. (2020) · Accident Analysis & Prevention · doi:10.1016/j.aap.2020.105580 · Cited by 18
Criddle, D., Devine, B., Murray, K., Budgeon, C. A., Sanfilippo, F. M., Gupta, S., Davidson, A., Etherton‐Beer, C., & Clifford, R. M. (2021) · Research in Social and Administrative Pharmacy · doi:10.1016/j.sapharm.2021.08.014 · Cited by 18
A Systematic Review of Polygenic Models for Predicting Drug Outcomes
Siemens, A., Anderson, S. J., Rassekh, S. R., Ross, C. J., & Carleton, B. (2022) · Journal of Personalized Medicine · doi:10.3390/jpm12091394 · Cited by 18
Incorporating published univariable associations in diagnostic and prognostic modeling
A Debray, T. P., Koffijberg, H., Lu, D., Vergouwe, Y., Steyerberg, E. W., & M Moons, K. G. (2012) · BMC Medical Research Methodology · doi:10.1186/1471-2288-12-121 · Cited by 17
Self-citationA Preoperative Multimarker Approach to Evaluate Acute Kidney Injury After Cardiac Surgery
Enger, T. B., Pleym, H., Stenseth, R., Greiff, G., Wahba, A., & Videm, V. (2016) · Journal of Cardiothoracic and Vascular Anesthesia · doi:10.1053/j.jvca.2016.10.005 · Cited by 18
Development of a risk prediction model for Barrett's esophagus in an Australian population
Ireland, C. J., Fielder, A. L., Thompson, S. K., Laws, T. A., Watson, D. I., & Esterman, A. (2017) · Diseases of the Esophagus · doi:10.1093/dote/dox033 · Cited by 18
Gu, L., Chen, M., Khadaroo, P. A., Ma, X., Kong, L., Li, X., Zhu, H., Zhong, X., Pan, J., & Wang, X.-F. (2018) · Journal of Gastrointestinal Surgery · doi:10.1007/s11605-018-3816-8 · Cited by 18
Schuijt, H. J., Smeeing, D. P. J., Würdemann, F. S., Hegeman, J. H., Geraghty, O. C., Houwert, R. M., Weaver, M. J., van der Velde, D., & on behalf of the Dutch Hip Fracture Audit Taskforce study group (2020) · Journal of Orthopaedic Trauma · doi:10.1097/bot.0000000000001851 · Cited by 18
Parikh, N. A., Harpster, K. L., He, L., Illapani, V. S. P., Khalid, F. C., Klebanoff, M. A., O’Shea, T. M., & Altaye, M. (2020) · Scientific Reports · doi:10.1038/s41598-020-72632-0 · Cited by 18
Collins, G. S., & Altman, D. G. (2012) · European Journal of Cardio-Thoracic Surgery · doi:10.1093/ejcts/ezs562 · Cited by 19
Self-citationValidation and Adjustment of the Leipzig-Halifax Acute Aortic Dissection Type A Scorecard
Mejàre-Berggren, H., & Olsson, C. (2017) · The Annals of Thoracic Surgery · doi:10.1016/j.athoracsur.2017.05.010 · Cited by 17
Predictive validity of three home fall hazard assessment tools for older adults in Thailand
Lektip, C., Lapmanee, S., Rattananupong, T., Lohsoonthorn, V., Vorayingyong, A., Woratanarat, T., Sirisuk, K.-O., Suttanon, P., Petsirasan, R., Kitidumrongsuk, P., et al. (2020) · PLoS ONE · doi:10.1371/journal.pone.0244729 · Cited by 17
Predicting a post-thrombolysis intracerebral hemorrhage: a systematic review
Echouffo-Tcheugui, J. B., Woodward, M., & Kengne, A. P. (2013) · Journal of Thrombosis and Haemostasis · doi:10.1111/jth.12186 · Cited by 18
Self-citationBavry, A. A., Kumbhani, D. J., Gong, Y., Handberg, E. M., Cooper‐DeHoff, R. M., & Pepine, C. J. (2013) · Journal of the American Heart Association · doi:10.1161/jaha.113.000205 · Cited by 17
Borisenko, O., Müller‐Ehmsen, J., Lindenfeld, J. M., Rafflenbeul, E., & Hamm, C. W. (2018) · BMC Cardiovascular Disorders · doi:10.1186/s12872-018-0898-x · Cited by 17
Reporting Standards and Critical Appraisal of Prediction Models
Wee, L., van Kuijk, S. M. J., Dankers, F. J. W. M., Traverso, A., Welch, M. L., & Dekker, A. L. A. J. (2018) · Springer eBooks · doi:10.1007/978-3-319-99713-1_10 · Cited by 17
Tailoring treatments using treatment effect modification
Schmidt, A. F., Klungel, O. H., Nielen, M., de Boer, A., Groenwold, R. H. H., & Hoes, A. W. (2016) · Pharmacoepidemiology and Drug Safety · doi:10.1002/pds.3965 · Cited by 17
Clausen, S. H., Hartvigsen, J., Boyle, E., Roos, E. M., Grønne, D. T., Ernst, M. T., Arnbak, B., & Skou, S. T. (2021) · Arthritis Research & Therapy · doi:10.1186/s13075-021-02608-6 · Cited by 16
Williams, R. D., Reps, J., Kors, J. A., Ryan, P. B., Steyerberg, E. W., Verhamme, K. M. C., & Rijnbeek, P. R. (2022) · Drug Safety · doi:10.1007/s40264-022-01161-8 · Cited by 16
Metadata
- Authors
- Moons, K. G. M., Kengne, A. P., Woodward, M., Royston, P., Vergouwe, Y., Altman, D. G., & Grobbee, D. E.
- Affiliations
- University Medical Center Utrecht (NL)
- The University of Sydney (AU)
- MRC Clinical Trials Unit at UCL (GB)
- University of Oxford (GB)
- Corresponding author
- Moons, Karel G M
- Venue
- Heart
- Publisher
- BMJ
- Published
- 2012-03-07
- Volume
- 98
- Issue
- 9
- Pages
- 683-690
- ISSN
- 1355-6037 (ISSN-L)
- 1468-201X
- OpenAlex
- W2146404132
- Cited by
- 889
- References
- 100
- Citations by year
- 2026: 42 · 2025: 52 · 2024: 59 · 2023: 59 · 2022: 92 · 2021: 87 · 2020: 75 · 2019: 46 · 2018: 76 · 2017: 53 · 2016: 58 · 2015: 68 · 2014: 56 · 2013: 44 · 2012: 18
- FWCI
- 9.09
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Heart (publishedVersion)
- PubMed (publishedVersion)
- UCL Discovery (University College London) (submittedVersion)
- Funders
- Medical Research Council (MC_EX_G0800814)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Health Sciences › Health Professions › Health Information Management › Artificial Intelligence in Healthcare
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Keywords
- risk prediction model, model development, internal validation, optimism bias, cardiovascular risk prediction, predictive performance, clinical decision-making, cost-effectiveness
- MeSH terms
- Cardiovascular Diseases, Cost-Benefit Analysis, Decision Making, Decision Support Techniques, Humans, Models, Theoretical, Predictive Value of Tests, Risk, Reproducibility of Results, Biomarkers
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.