Cited by 286Statistical Methods in EpidemiologyArtificial Intelligence in HealthcareMeta-analysis and systematic reviews

The DOI matches its Crossref record; 56 of the 56 references it cites were found in a registry or an index.

There is no such thing as a validated prediction model

Open access

Van Calster, Ben, Steyerberg, Ewout W., Wynants, Laure, van Smeden, Maarten·2023·BMC Medicine

DOI 10.1186/s12916-023-02779-wPMC PMC9951847

Open this paper in CoChat — free account Open PDF

Abstract

BACKGROUND: Clinical prediction models should be validated before implementation in clinical practice. But is favorable performance at internal validation or one external validation sufficient to claim that a prediction model works well in the intended clinical context? MAIN BODY: We argue to the contrary because (1) patient populations vary, (2) measurement procedures vary, and (3) populations and measurements change over time. Hence, we have to expect heterogeneity in model performance between locations and settings, and across time. It follows that prediction models are never truly validated. This does not imply that validation is not important. Rather, the current focus on developing new models should shift to a focus on more extensive, well-conducted, and well-reported validation studies of promising models. CONCLUSION: Principled validation strategies are needed to understand and quantify heterogeneity, monitor performance over time, and update prediction models when appropriate. Such strategies will help to ensure that prediction models stay up-to-date and safe to support clinical decision-making.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

Integrity signals

Registry

Crossref · 10.1186/s12916-023-02779-w

Cites

56 of 56 references verified0 citation errors · 0 not checkable

Statistics

Fig. 1 Distribution of patient age in the 9 largest centers from the ovarian cancer study. Histograms, density estimates, and mean (standard deviation) are given per centerCC BY · PubMed Central

Fig. 2 Distribution of maximum lesion diameter in the 9 largest centers from the ovarian cancer study. Histograms, density estimates, and median (interquartile range) are given per centerCC BY · PubMed Central

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Transparent Reporting of a multivariable prediction model for Individual Prognosis Or Diagnosis (TRIPOD): Explanation and Elaboration
Moons, K. G. M., Altman, D. G., Reitsma, J. B., Ioannidis, J. P. A., Macaskill, P., Steyerberg, E. W., Vickers, A. J., Ransohoff, D. F., & Collins, G. S. (2015) · Annals of Internal Medicine · doi:10.7326/m14-0698 · Cited by 5,147
Self-citation
Internal validation of predictive models
Steyerberg, E. W., Harrell, F. E., Borsboom, G. J. J. M., Eijkemans, M. J. C., Vergouwe, Y., & Habbema, J. D. F. (2001) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(01)00341-9 · Cited by 2,746
Calibration: the Achilles heel of predictive analytics
On behalf of Topic Group ‘Evaluating diagnostic tests and prediction models’ of the STRATOS initiative, Van Calster, B., McLernon, D. J., van Smeden, M., Wynants, L., & Steyerberg, E. W. (2019) · BMC Medicine · doi:10.1186/s12916-019-1466-7 · Cited by 2,650
Derivation of a Simple Clinical Model to Categorize Patients Probability of Pulmonary Embolism: Increasing the Models Utility with the SimpliRED D-dimer
Anderson, D., Rodger, M., Ginsberg, J., Kearon, C., Gent, M., Turpie, A., Bormanis, J., Weitz, J., Chamberlain, M., Bowie, D., et al. (2000) · Thrombosis and Haemostasis · doi:10.1055/s-0037-1613830 · Cited by 1,651
Prognosis and prognostic research: validating a prognostic model
Altman, D. G., Vergouwe, Y., Royston, P., & Moons, K. G. M. (2009) · BMJ · doi:10.1136/bmj.b605 · Cited by 1,436
Prediction models need appropriate internal, internal-external, and external validation
Steyerberg, E. W., & Harrell, F. E. (2016) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2015.04.005 · Cited by 1,304
Assessing the Generalizability of Prognostic Information
Justice, A. C., Covinsky, K. E., & Berlin, J. A. (1999) · Annals of Internal Medicine · doi:10.7326/0003-4819-130-6-199903160-00016 · Cited by 1,160
A calibration hierarchy for risk models was defined: from utopia to empirical data
Van Calster, B., Nieboer, D., Vergouwe, Y., De Cock, B., Pencina, M. J., & Steyerberg, E. W. (2016) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2015.12.005 · Cited by 910
Self-citation
Understanding receiver operating characteristic (ROC) curves
Fan, J., Upadhye, S., & Worster, A. (2006) · Canadian Journal of Emergency Medicine · doi:10.1017/s1481803500013336 · Cited by 843
Sample size considerations for the external validation of a multivariable prognostic model: A resampling study
Collins, G. S., Ogundimu, E. O., & Altman, D. G. (2016) · Statistics in Medicine · doi:10.1002/sim.6787 · Cited by 665

Show all 56 references

Sorted by citations

Items 101–200 of 285

Development and internal validation of a clinical prediction model for serious complications after emergency laparotomy
Kokkinakis, S., Kritsotakis, E. I., Paterakis, K. N., Karali, G., Malikides, V., Kyprianou, A., Papalexandraki, M., Anastasiadis, C. S., Zoras, O., Drakos, N., et al. (2023) · European Journal of Trauma and Emergency Surgery · doi:10.1007/s00068-023-02351-4 · Cited by 4
Diagnostic clinical prediction rules for categorising low back pain: A systematic review
Hill, C., Banerjee, A., Hill, J. C., & Stapleton, C. H. (2023) · Musculoskeletal Care · doi:10.1002/msc.1816 · Cited by 5
Validation of the PediBIRN-7 clinical prediction rule for pediatric abusive head trauma
Hymel, K. P., Carroll, C. L., Frazier, T. N., Weeks, K., Herman, B. E., Marinello, M., Chen, Y., Wang, M., & Boos, S. C. (2024) · Child Abuse & Neglect · doi:10.1016/j.chiabu.2024.106799 · Cited by 4
Identifying individuals at high risk for dementia in primary care: Development and validation of the DemRisk risk prediction model using routinely collected patient data
Reeves, D., Morgan, C., Stamate, D., Ford, E. M., Ashcroft, D. M., Kontopantelis, E., van Marwijk, H., & McMillan, B. (2024) · PLoS ONE · doi:10.1371/journal.pone.0310712 · Cited by 5
Validity of the Johns Hopkins Adjusted Clinical Groups system on the utilisation of healthcare services in Norway: a retrospective cross-sectional study
Hosar, R., Berntsen, G., & Steinsbekk, A. (2024) · BMC Health Services Research · doi:10.1186/s12913-024-11715-4 · Cited by 4
Predicting type 2 diabetes and testosterone effects in high-risk Australian men: development and external validation of a 2-year risk model
Robledo, K. P., Marschner, I. C., Grossmann, M., Handelsman, D. J., Yeap, B. B., Allan, C. A., Foote, C., Inder, W. J., Stuckey, B. G. A., Jesudason, D. R., et al. (2024) · European Journal of Endocrinology · doi:10.1093/ejendo/lvae166 · Cited by 4
Predicting patent challenges for small-molecule drugs: A cross-sectional study
Memedovich, A., Steele, B. J., Orr, T., Chaudhry, S., Tadrous, M., Kesselheim, A. S., Hollis, A., & Beall, R. F. (2025) · PLoS Medicine · doi:10.1371/journal.pmed.1004540 · Cited by 4
Validation of the Clinical Frailty Scale for predicting 90-day mortality in hospitalised older adults screened as at risk of nearing the end of life in Queensland, Australia: a multisite observational study
Blythe, R. D., White, N. M., Brown, C., Hillman, K., & Barnett, A. G. (2025) · BMJ Open · doi:10.1136/bmjopen-2025-108419 · Cited by 3
Predictive accuracy of surgeon gestalt for adverse postoperative outcomes: systematic review
Yang, J. J., Mullan, S. J., Rayhan, T. M., Sandhu, C., Ramaiya, A. N., & Heneghan, C. J. (2025) · British journal of surgery · doi:10.1093/bjs/znaf249 · Cited by 5
Harnessing multi-source data for individualized care in Hodgkin Lymphoma
Parsons, S. K., Rodday, A. M., Upshaw, J. N., Scharman, C. D., Zhu, C., Cao, Y., Tiger, Y. K., Maurer, M. J., & Evens, A. M. (2024) · Blood Reviews · doi:10.1016/j.blre.2024.101170 · Cited by 4
Development and validation of a lifetime prediction model for incident type 2 diabetes in patients with established cardiovascular disease: the CVD2DM model
Helmink, M. A. G., Peters, S. A. E., Westerink, J., Harris, K., Tillmann, T., Woodward, M., van Sloten, T. T., van der Meer, M. G., Teraa, M., Dorresteijn, J. A. N., et al. (2024) · European Journal of Preventive Cardiology · doi:10.1093/eurjpc/zwae096 · Cited by 6
Targeted Development and Validation of Clinical Prediction Models in Secondary Care Settings: Opportunities and Challenges for Electronic Health Record Data
van Maurik, I. S., Doodeman, H. J., Nuijens, B. W., Möhringer, R. P. M., Sudiono, D. R., Jongbloed, W., & van Soelen, E. (2024) · JMIR Medical Informatics · doi:10.2196/57035 · Cited by 3
Towards Effective AI in Healthcare: Identifying Success Factors and the Potential of Human-in-the-Loop
Theilmann, K., Dahlem, N., Steffny, L., Podevin, D., Hartnik, J., & Greff, T. (2025) · IFIP advances in information and communication technology · doi:10.1007/978-3-031-96239-4_13 · Cited by 3
Risk stratification in diabetic kidney disease: a review of prediction models for methodological advances and clinical application
Wang, Y., Wang, J. C., & Chen, H. (2026) · Journal of Translational Medicine · doi:10.1186/s12967-026-07746-6 · Cited by 4
Predicting adverse outcomes in adults with a community-acquired lower respiratory tract infection: a protocol for the development and validation of two prediction models for (i) all-cause hospitalisation and mortality and (ii) cardiovascular outcomes
Rijk, M. H., Platteel, T. N., Geersing, G., Hollander, M., Dalmolen, B. L. G. P., Little, P. S., Rutten, F. H., van Smeden, M., & Venekamp, R. P. (2023) · Diagnostic and Prognostic Research · doi:10.1186/s41512-023-00161-1 · Cited by 3
Dynamic Prediction of Time to Wound Healing at Routine Wound Care Visits
Thomassen, D., Amesz, S. F., Stol, N. P., le Cessie, S., & Steyerberg, E. W. (2024) · Advances in Wound Care · doi:10.1089/wound.2024.0069 · Cited by 3
Tutorial: dos and don’ts in clinical prediction research for venous thromboembolism
Nemeth, B., Smeets, M. J. R., Cannegieter, S. C., & van Smeden, M. (2024) · Research and Practice in Thrombosis and Haemostasis · doi:10.1016/j.rpth.2024.102480 · Cited by 3
Identifying persistent high-cost patients in the hospital for care management: development and validation of prediction models
de Ruijter, U. W., Kaplan, Z. L. R., Eijkenaar, F., Maas, C. C. H. M., van der Heide, A., Bax, W. A., & Lingsma, H. F. (2024) · BMC Health Services Research · doi:10.1186/s12913-024-11936-7 · Cited by 3
Hidden risks of predictive models in healthcare
Alderman, J. E., Riley, R. D., Parekh, D., Summers, C., Liu, X., & Denniston, A. K. (2025) · BMJ Evidence-Based Medicine · doi:10.1136/bmjebm-2025-113730 · Cited by 3
A comparison of modeling approaches for static and dynamic prediction of central-line bloodstream infections using electronic health records (part 1): regression models
Gao, S., Albu, E., Putter, H., Stijnen, P., Rademakers, F. E., Cossey, V., Debaveye, Y. A., Janssens, C., CALSTER, B. V., & Wynants, L. (2025) · Diagnostic and Prognostic Research · doi:10.1186/s41512-025-00199-3 · Cited by 2
Cytokine release syndrome risk model with T-cell engaging therapies
Lafeuille, P., Blumentals, W. A., Brulle-Wohlhueter, C., Chen, W., Sang, C., Manning, S. E., Saltzman, S., Canvin, J., Richards, S. M., Kamperschroer, C., et al. (2025) · Cytotherapy · doi:10.1016/j.jcyt.2025.07.002 · Cited by 3
Prognostic factors associated with length of stay in children with an acute admission to a pediatric ward: a historical cohort study
Timmer, K. S., Voskuijl, W. P., Bijlsma, M. W., & Maaskant, J. M. (2025) · BMC Pediatrics · doi:10.1186/s12887-025-06000-0 · Cited by 2
External validation of GDM risk prediction models using a machine learning reciprocal model-exchange framework
Germaine, M., Belsti, Y., O'Higgins, A. C., Egan, B., Teede, H. J., Healy, G. F., & Enticott, J. (2026) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2026.111547 · Cited by 3
Impact of Internal Validation Protocols on Predictive Maintenance Performance in Biomedical Equipment
Moufid, J., Koulali, R., Moussaid, K., & Abghour, N. (2026) · Technologies · doi:10.3390/technologies14020115 · Cited by 3
Performance of multivariable risk prediction algorithms in predicting COPD exacerbations: a population-based study
Mehareen, J., Lim, L. H. M., Adibi, A., Amegadzie, J. E., Xia, Y., Vera, M. A. D., Law, M. R., Sin, D. D., Bhatt, S. P., Quint, J. K., et al. (2026) · Thorax · doi:10.1136/thorax-2026-224814 · Cited by 2
Why Radiomics Rarely Reaches the Clinic: Reproducibility, Validation, and Evidence Gap—A Critical Narrative Review
Pozzi, J., D’Argenzio, J., Carriero, S., Cè, M., D’Arrigo, D., Lanza, C., Biondetti, P., Angileri, S. A., Pavan, M., Catona, R., et al. (2026) · Diagnostics · doi:10.3390/diagnostics16142266 · Cited by 2
Type 2 diabetes subtypes for precision medicine: methodological challenges and alternative prediction-based approaches
Mori, T., Herder, C., Cardoso, P., Dennis, J., & Kuß, O. (2026) · Diabetologia · doi:10.1007/s00125-026-06802-6 · Cited by 2
The PROgnostic ModEl for chronic lung disease (PRO-MEL): development and temporal validation
Ng, S. H.-X., Chiam, Z. Y., Chai, G. T., Kaur, P., Yip, W. F., Low, Z. J., Chu, J., Tey, L. H., Neo, H. Y., Tan, W. S., et al. (2024) · BMC Pulmonary Medicine · doi:10.1186/s12890-024-03233-0 · Cited by 4
Prognostic models in multiple sclerosis: progress and challenges in clinical integration
Havla, J. B., Reeve, K. A., Ön, B. I., Mansmann, U., & Held, U. (2024) · Neurological Research and Practice · doi:10.1186/s42466-024-00338-z · Cited by 3
Research inefficiencies in external validation studies of the Framingham Wilson coronary heart disease risk rule: A systematic review
Ban, J.-W., Abel, L., Stevens, R., & Perera, R. (2024) · PLoS ONE · doi:10.1371/journal.pone.0310321 · Cited by 2
External validation and calibration of risk equations for prediction of diabetic kidney diseases among patients with type 2 diabetes in Taiwan
Su, H., Nguyen, T. T. D., Lin, W., Ou, H., & Kuo, S. (2024) · Cardiovascular Diabetology · doi:10.1186/s12933-024-02443-4 · Cited by 2
External Validation of the ARISE Prediction Models for Aneurysmal Rebleeding After Aneurysmal Subarachnoid Hemorrhage
Mijderwijk, H.-J., de Winkel, J., Nieboer, D., Abdelaal, A., Germans, M. R., Karadağ, C., Cornelius, J. F., Sorteberg, A. G., Roozenbeek, B., Lingsma, H. F., et al. (2024) · Neurosurgery · doi:10.1227/neu.0000000000003275 · Cited by 2
External Validation of the Walter Index for Posthospitalization Mortality Prediction in Older Adults
Avelino‐Silva, T. J., Lee, S. J., Covinsky, K. E., Walter, L. C., Deardorff, W. J., Boscardin, W. J., Campora, F., Szlejf, C., Suemoto, C. K., & Smith, A. K. (2025) · JAMA Network Open · doi:10.1001/jamanetworkopen.2024.55475 · Cited by 2
Prediction model of the T cell-mediated rejection after liver transplantation in children and adults: A case-controlled study
Ai, C., Song, J., Chi, Y., Xu, G., Yang, J., Lv, T., Jin, S., Wu, H. M., Xiang, B., & Yang, J. (2025) · International Journal of Surgery · doi:10.1097/js9.0000000000002279 · Cited by 2
Development and validation of a nomogram to predict the risk of in-hospital MACE for emergence NSTE-ACS: A retrospective multicenter study based on the Chinese population
Zhou, Q., He, R., Li, H., & Gu, M. (2025) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2025.105884 · Cited by 2
Federated Prediction Models and External Validation for Radiotherapy Outcomes in Oropharyngeal Cancer using F.A.I.R. Clinical and Radiomics DataPreprint
Gouthamchand, V., Gottardelli, B., Kulkarni, G., Sherkhane, U. B., Hogenboom, J., Subramanian, R., Jha, A. K., Mithun, S., Purandare, N. C., Agarwal, J. P., et al. (2025) · medRxiv · doi:10.1101/2025.01.29.25321214 · Cited by 2
Development and internal validation of time-to-event risk prediction models for major medical complications within 30 days after elective colectomy
Ke, J. X. C., Jen, T. T. H., Gao, S., Ngo, L. H., Wu, L., Flexman, A. M., Schwarz, S. K. W., Brown, C. J., & Görges, M. (2024) · PLoS ONE · doi:10.1371/journal.pone.0314526 · Cited by 1
Development and validation of a prediction model for serious infections in rheumatoid arthritis patients treated with tocilizumab in Japan
Nanki, T., Yamaguchi, T., Umetsu, K., Tanabe, R., Maeda, N., Kanazawa, M., Furuno, Y., Matsuda, S., Takemoto, S., Asao, K., et al. (2025) · Clinical Rheumatology · doi:10.1007/s10067-025-07328-9
Diabetes Screening in the Emergency Department: Development of a Predictive Model for Elevated Hemoglobin A1c
Smart, M. H., Lin, J., Layden, B. T., Eisenberg, Y., Pickard, A. S., Sharp, L. K., Danielson, K. K., & Kong, A. (2025) · Journal of Diabetes Research · doi:10.1155/jdr/8830658 · Cited by 1
Clinical prognostic models for sarcomas: a systematic review and critical appraisal of development and validation studies
Heesen, P., Christ, S. M., Ciobanu-Caraus, O., Kahraman, A., Schelling, G., Studer, G., Bode‐Lesniewska, B., & Fuchs, B. (2025) · Diagnostic and Prognostic Research · doi:10.1186/s41512-025-00186-8 · Cited by 1
Predicting prolonged work absence due to musculoskeletal disorders: development, validation, and clinical usefulness of prognostic prediction models
Rysstad, T. L., Grotle, M., Traeger, A. C., Aasdahl, L., Vigdal, Ø. N., Aanesen, F., Øiestad, B. E., Pripp, A. H., Wynne‐Jones, G., Dunn, K. M., et al. (2025) · International Archives of Occupational and Environmental Health · doi:10.1007/s00420-025-02129-8 · Cited by 1
The comparative performance of models predicting patient and graft survival after kidney transplantation: A systematic review
van de Klundert, J. J., Pérez-Galarce, F., Olivares, M., Pengel, L. H. M., & de Weerd, A. (2025) · Transplantation Reviews · doi:10.1016/j.trre.2025.100934 · Cited by 1
Development and Validation of a Novel Risk Calculator to Predict Sub-optimal HIV Outcomes Among Pregnant and Postpartum Women with HIV in Kenya
Owuor, K. O., Turan, J. M., Szychowski, J. M., Onono, M. A., Ongeri, L., Beres, L. K., Helová, A., Ouma, E., Onyando, M., Patel, R. C., et al. (2025) · AIDS and Behavior · doi:10.1007/s10461-025-04814-8 · Cited by 1
External Validation of Dose Patterns and Dosimetric Predictors for Radiation-Induced Esophagitis In Non-Small Cell Lung Cancer
Monti, S., Palma, G., Caroprese, M., & Cella, L. (2025) · International Journal of Radiation Oncology*Biology*Physics · doi:10.1016/j.ijrobp.2025.07.1445 · Cited by 1
External validation of the S-GRAS score for predicting recurrence in patients with adrenocortical carcinoma: implications for adjuvant mitotane therapy
Jimenez-Fonseca, P., Álvarez-Escolá, C., Navarro, I. B., Hernando, J., Fernández, L. G., Cruz, M. Á. M., Iglesias, C., García-Donás, J., César, M. J. P., Paja, M., et al. (2025) · European Journal of Endocrinology · doi:10.1093/ejendo/lvaf171 · Cited by 1
Development of GIS-based Box Model Tool for Air Quality Mapping with Python and ArcGIS Pro in Kirkuk City, Iraq
Jumaah, H. J., Kamran, K. V., Ghanbari, A., & Jeihouni, M. (2025) · International Journal of Engineering and Geosciences · doi:10.26833/ijeg.1710723 · Cited by 1
Predicting nosocomial infections in critically Ill children: a comprehensive systematic review of risk assessment models
Wang, L.-Y., Feng, M., Luo, Y., Wang, C., Wang, H., Li, L., Zhang, Y., Huang, X., Huang, M.-J., & Tian, Y. (2025) · Frontiers in Pediatrics · doi:10.3389/fped.2025.1636580 · Cited by 1
Secondary Prevention of AFAIS: Deploying Traditional Regression, Machine Learning, and Deep Learning Models to Validate and Update CHA2DS2-VASc for 90-Day Recurrence
Simon, J. E., Kraiński, Ł., Karlinski, M. A., & Niewada, M. (2025) · Journal of Clinical Medicine · doi:10.3390/jcm14207327 · Cited by 1
Validation of a prognostic calculator to predict recurrence and mortality in melanoma patients undergoing sentinel lymph node biopsy
Downey, J., & Baliski, C. R. (2025) · Surgical Oncology · doi:10.1016/j.suronc.2025.102311 · Cited by 1
Radiomics and Back Pain
Lin, J., Duddalwar, V. A., & Safaee, M. (2025) · Global Spine Journal · doi:10.1177/21925682251394282 · Cited by 1
Prediction of reoffending in people released from prison in Norway: external validation of the OxRec risk assessment tool
Virtanen, S., Stavseth, M. R., Bukten, A., Tesli, M., Fazel, S., & Chang, Z. (2025) · Psychology Crime and Law · doi:10.1080/1068316x.2025.2581796 · Cited by 1
External generalizability and internal accuracy of predictive models for perinatal mortality: a systematic review and meta-analysis
Falah, Z. E., Marfak, A., Asmaa, M. A., & Thimou, A. (2025) · Clinical Epidemiology and Global Health · doi:10.1016/j.cegh.2025.102227 · Cited by 1
Development and preliminary validation of a PICC-related venous thrombosis risk prediction model for cancer patients: A systematic review and meta-analysis predominantly based on Chinese populations
Zhang, J., Li, C., Zhang, H., Wu, W., Sun, X., & Zhang, W. (2025) · Asia-Pacific Journal of Oncology Nursing · doi:10.1016/j.apjon.2025.100839 · Cited by 1
Predicting the likelihood of hypoadrenocorticism in dogs using signalment and routine laboratory results with an ensemble machine learning predictive model
Martineau, M., Kurtz, M., Lavoué, R., Krafft, É., Benchekroun, G., Drut, A., Kim, M. W., Thierry, S., Robin, E., & Boedec, K. L. (2026) · Journal of Veterinary Internal Medicine · doi:10.1093/jvimsj/aalaf067 · Cited by 1
Clarifying validation terminologies in healthcare
Dy, A., Buetow, S., Bredemeyer, A. J., Saini, M. L., Lucas, F. M., Bennett, S., Blenman, K., Wharton, K. A., Singhal, S., de Baca, M. E., et al. (2026) · npj Digital Medicine · doi:10.1038/s41746-026-02471-2 · Cited by 1
Building and validating machine learning models to predict appendiceal perforation during conservative treatment of fecalith-associated appendicitis: a 20-algorithm multicenter retrospective analysis
Zhu, Y., Jiawei, F. E. N. G., Liu, R., Ren, W., Ma, X., Wang, N., Gong, L., & Kong, F. (2026) · Scientific Reports · doi:10.1038/s41598-026-47372-2 · Cited by 1
From Missing Data to Climate Action: Machine Learning for Carbon Accounting in Wastewater Systems
Sánchez-Balseca, J., Ramírez-Melgarejo, M., & Foguet, A. P. (2026) · Earth Systems and Environment · doi:10.1007/s41748-026-01131-5 · Cited by 1
Emerging Urinary Biomarkers and Innovative Technologies for the Early Detection and Personalized Management of Chronic Kidney Disease
Moldakhmetova, S., Bimurat, B., Berdaly, A., Makhammajanov, Z., Salykov, A., Bukasov, R., & Gaipov, A. (2026) · International Journal of Molecular Sciences · doi:10.3390/ijms27083648 · Cited by 1
Supervised machine learning models for predicting sepsis-associated acute kidney injury in children: a real-world evaluation
Shi, D., Gu, W., Yang, X.-J., Sun, Y.-Q., Yin, J.-W., Miao, H., & Ge, X. (2026) · World Journal of Pediatrics · doi:10.1007/s12519-026-01038-1 · Cited by 1
Modelling the financial impact of sustainable construction: Random Forest-based approach
Wijayawardena, D. S. I., Ranadewa, K. A. T. O., & Illankoon, C. (2026) · International Journal of Construction Management · doi:10.1080/15623599.2026.2666343 · Cited by 1
Diagnostic performance of machine learning-based radiomics models for predicting epidermal growth factor receptor mutation status in lung adenocarcinoma in Chinese patients: A systematic review and meta-analysis
Yang, J., Jiang, J., Peng, J., Li, J., Mi, P., & Chen, G. (2026) · Journal of International Medical Research · doi:10.1177/03000605261460311 · Cited by 1
Applying Machine Learning Models to Predict Occupational Noise-Induced Hearing Loss: A Systematic Review and Meta-analysis
Wang, Z., Fan, Y., Zhang, X., Liu, X., Yu, C. Y., Wu, L., Qiu, W., & Zhang, M. (2026) · Noise and Health · doi:10.4103/nah.nah_11_26 · Cited by 1
Clinical predictive artificial intelligence evaluation: A narrative review of trial designs and practical considerations
Fosset, M., Pensier, J., Jung, B., Siddiqi, A., Mamdani, M. M., & Celi, L. A. (2026) · PLOS Digital Health · doi:10.1371/journal.pdig.0001621 · Cited by 1
Leakage-Resistant Evaluation of Gait Mat and Multisensor Biomechanical Features for Knee Osteoarthritis Screening: A Subject-Level Data Integrity Study
Yang, M.-A., & Ha, K.-S. (2026) · Bioengineering · doi:10.3390/bioengineering13090965 · Cited by 1
Development and Validation of a Prediction Model: Application to Digestive Cancer Research
Kwon, Y., & Han, K. (2023) · Journal of Digestive Cancer Research · doi:10.52927/jdcr.2023.11.3.157 · Cited by 1
External validation and update of the International Medical Prevention Registry on Venous Thromboembolism bleeding risk score for predicting bleeding in acutely ill hospitalized medical patients: a retrospective single-center cohort study in Japan
Arakaki, D., Iwata, M., & Terasawa, T. (2024) · Thrombosis Journal · doi:10.1186/s12959-024-00603-w · Cited by 1
Personalized dynamic super learning: an application in predicting hemodiafiltration convection volumes
Chatton, A., Bally, M., Levesque, R. L., Malenica, I., Platt, R. W., & Schnitzer, M. E. (2024) · Journal of the Royal Statistical Society Series C (Applied Statistics) · doi:10.1093/jrsssc/qlae070 · Cited by 3
powerROC: An Interactive Web Tool for Sample Size Calculation in Assessing Models' Discriminative Abilities
Grolleau, F., Tibshirani, R. J., & Chen, J. H. (2025) · Europe PMC (PubMed Central) · doi:10.48550/arxiv.2501.03155 · Cited by 2
The fundamentals of AI ethics in medical imaging
Amann, J., Bürger, V. K., Livne, M., Bui, C. K. T., & Madai, V. I. (2025) · Elsevier eBooks · doi:10.1016/b978-0-44-323761-4.00010-9 · Cited by 3
Test Driving an Old Car on a New Road—The Need for Context-Specific Adaptations in Predictive Modeling
Butt, A. L., Allan, P. G., Dang, D. D., & Tanaka, K. A. (2025) · Anesthesia & Analgesia · doi:10.1213/ane.0000000000007463 · Cited by 1
Modelos de predicción en trasplantes: Estado del arte y aplicaciones
Cabas, S., Garcia-Lopez, A. E., Gómez-Montero, A., Anichiarico-Castillo, L. A., Sarmiento-Gallego, J. A., & Girón-Luque, F. (2025) · Revista Colombiana de Cirugía · doi:10.30944/20117582.2813 · Cited by 1
External validation of a model to predict recurrence-free and melanoma-specific survival for patients with melanoma after sentinel node biopsy
Stassen, R. C., Maas, C. C. H. M., Leong, S. P. L., Kashani–Sabet, M., White, R. L., Pockaj, B. A., Zager, J. S., Schneebaum, S., Vetto, J. T., Avisar, E., et al. (2025) · British journal of surgery · doi:10.1093/bjs/znaf037 · Cited by 1
Challenges in making an evidence-based prognosis
Rysavy, M. A. (2025) · Seminars in Perinatology · doi:10.1016/j.semperi.2025.152054 · Cited by 1
Validation of a risk-prediction model for pediatric post-discharge mortality after hospital admission for infection in Rwanda: A prospective cohort study
Hooft, A. M., Umuhoza, C., Trawin, J., Mfuranziza, C., Uwiragiye, E., Zhang, C., Nguyen, V., Kornblith, A. E., Kenya‐Mugisha, N., Ansermino, J. M., et al. (2025) · PLOS Global Public Health · doi:10.1371/journal.pgph.0004606 · Cited by 1
Dynamic pressure ulcer risk predictions for hospitalized patients: development and validation of a machine learning model with an expert group of nursesPreprint
Greup, S., Spoon, D., de Vroed, A., Werkhoven, B., Timmerman, E., Ista, E., & van Dijk, M. (2024) · medRxiv · doi:10.1101/2024.12.16.24319086 · Cited by 1
Electronic Health Record-Based Prediction Models to Inform Decisions about HIV Pre-exposure Prophylaxis: A Systematic ReviewPreprint
Agovi, A. M., Thompson, C. T., Meadows, R. J., Lu, Y., & Ojha, R. P. (2025) · medRxiv · doi:10.1101/2025.01.17.25320732 · Cited by 1
How Outcome Prediction Could Aid Clinical Practice
Clift, A. K. (2025) · British Journal of Hospital Medicine · doi:10.12968/hmed.2024.0781 · Cited by 1
Letter to the editor on: “Polytrauma scoring revisited: prognostic validity and usability in daily clinical practice”
Ba, G., & Shi, Q. (2023) · European Journal of Trauma and Emergency Surgery · doi:10.1007/s00068-023-02354-1
Editorial: Less is more for colorectal cancer diagnosis – FIT leads the way
Logan, R. P., & Hamilton, W. T. (2023) · Alimentary Pharmacology & Therapeutics · doi:10.1111/apt.17662
Validated Prediction Models of Nursing Home Utilization: A Scoping Review (Preprint)Preprint
Han, E., & Kim, J. (2023) · doi:10.2196/preprints.53310
Planned but ever published? A retrospective analysis of clinical prediction modelling studies registered on clinicaltrials.gov since 2000Preprint
White, N. M., Parsons, R., Borg, D. N., Collins, P. G. S., & Barnett, A. G. (2023) · doi:10.31219/osf.io/nh9sx
A tool to predict the risk of lower extremity amputation in patients starting dialysis
Akerboom, B., Janse, R. J., Caldinelli, A., Lindholm, B., Rotmans, J. I., Evans, M., & van Diepen, M. (2024) · Nephrology Dialysis Transplantation · doi:10.1093/ndt/gfae050
Reply
Warren, A. S., & Zettervall, S. L. (2024) · Journal of Vascular Surgery · doi:10.1016/j.jvs.2023.12.023
Combining multimorbidity clustering with limited demographic information enables high-precision outcome predictionsPreprint
Ferreira, F. S., Lannou, E. L., Post, B., Haar, S., Kadirvelu, B., Brett, S. J., & Faisal, A. A. (2024) · medRxiv · doi:10.1101/2024.05.28.24308024
A Canado-European external validation of the Kidney Transplant Failure ScorePreprint
Chatton, A., Feugo, K. A., Pilote, É., Cardinal, H., Platt, R. W., & Schnitzer, M. E. (2024) · medRxiv · doi:10.1101/2024.10.31.24316511
The authors reply:
Rockenschaub, P., Madai, V. I., & Frey, D. (2024) · Critical Care Medicine · doi:10.1097/ccm.0000000000006441
Toxicidad del Fipronil. Revisión sistemática de la literatura
Vargas-Mena, E. (2025) · Biosalud · doi:10.17151/biosa.2020.19.1.3
In Response
Siemens, K., Hunt, B. J., & Tibby, S. M. (2025) · Anesthesia & Analgesia · doi:10.1213/ane.0000000000007464
KI in der Wirbelsäulenchirurgie: Die Macht der Vorhersage
Hegewald, A. A. (2025) · Die Wirbelsäule · doi:10.1055/a-2279-4590
Validation of Ultrasonographic Criteria for Diagnosing Сlostridioides difficile Colitis in COVID-19 and Non-COVID-19 Patients With Antibiotic-Associated Diarrhea
Александровна, Р. И., & Пиманов, С. И. (2025) · Innovative medicine of Kuban · doi:10.35401/2541-9897-2025-10-2-40-46
Equivalence of Predictor Variables in Risk Scores
Nandakumar, A., Biju, S., Gutjahr, G., Reshma, G. G., Nair, H. J., Bijukumar, S. C., & Sathyapalan, D. T. (2025) · International Conference on Data Science and Information System (ICDSIS) · doi:10.1109/icdsis65355.2025.11071146
Portability of an artificial intelligence model for self-harm detection across hospital settingsPreprint
Rozova, V. S., Witt, K., Conway, M., Robinson, J., & Verspoor, K. M. (2025) · medRxiv · doi:10.1101/2025.07.10.25331160
Assessing Decadal-Scale Coastal Change Likelihood to Define the Accuracy and Application of Scientific Information
Pendleton, E. A., Lentz, E. E., Henderson, R. E., Heslin, J. L., Bartlett, M. K., & Sterne, T. K. (2025) · Journal of Coastal Research · doi:10.2112/jcoastres-d-24-00072.1
Predictive Performance Precision Analysis in Medicine: Identification of low-confidence predictions at patient and profile levels (MED3pa I)Preprint
Lefebvre, O., Lemyre, F. C., Éthier, J., Chikouche, L. H., Amriou, L., Poenaru, D., & Vallières, M. (2025) · medRxiv · doi:10.1101/2025.08.22.25334254
MyGESig: a population-specific gene signature improves survival prediction in Malaysian breast cancer patientsPreprint
Khairi, M. H. F., Wong, Z. L., Ang, B. H., Phipps-Tan, J., Rudin, P. N. F. A., Rajadurai, P., Hoong, S. M., Taib, N. A. M., Yip, C. H., Ho, W.-K., et al. (2025) · medRxiv · doi:10.1101/2025.08.28.25334111
Algorithm Fairness in Predicting Unmet Preventive Care: Evidence from 16 European Countries using SHAREPreprint
Shen, T. K.-B., Li, V., Chen, N., Hsu, J. S. H., Atun, R. A., Liu, V. T. N., Wang, C. I., Wu, D. B., Yeh, P.-C., & Lee, J. T. (2025) · medRxiv · doi:10.1101/2025.09.09.25335389
Author Response to “Letter to the Editor”: “Critical flaws in the predictive model for bacterial infections in older AoCLD patients”
Zou, J., & Chen, R. (2025) · Hepatology International · doi:10.1007/s12072-025-10942-z
Limitations of surrogate outcomes in evaluating anthropometric predictors of CVD risk
Deckert, A., Neuhann, F., Steffen, H., Becher, H., & Bluemke, M. (2025) · The Lancet Regional Health - Southeast Asia · doi:10.1016/j.lansea.2025.100686
Las publicaciones médicas por dentro
de Antioquia, U., & Jaimes, F. A. (2025) · Editorial Universidad de Antioquia eBooks · doi:10.17533/udea.978-958-501-247-9
Learning Patient Similarity from Genomics for Precision OncologyPreprint
Shady, M., Reardon, B. M., Jiang, S., Pimenta, E. M., O’Meara, T. A., Park, J., Kehl, K. L., Elmarakeby, H., Sunyaev, S. R., & Allen, E. M. V. (2025) · medRxiv · doi:10.64898/2025.12.17.25342480

Authors: Van Calster, B., Steyerberg, E. W., Wynants, L., & van Smeden, M.
Affiliations: KU Leuven (BE)
Maastricht University (NL)
ORCID: Van Calster, Ben
Steyerberg, Ewout W.
Wynants, Laure
van Smeden, Maarten
Venue: BMC Medicine
Publisher: Springer Science and Business Media LLC
Published: 2023-02-24
Volume: 21
Issue: 1
Pages: 70-70
ISSN: 1741-7015 (ISSN-L)
DOI: 10.1186/s12916-023-02779-w
PMC: PMC9951847
OpenAlex: W4321782827
Cited by: 286
References: 56
Citations by year: 2026: 99 · 2025: 91 · 2024: 67 · 2023: 29
FWCI: 58.07
Type: journal article
Language: en
Open access: gold
doi.org
Licence: cc-by
creativecommons.org/licenses/by/4.0 (tdm)
creativecommons.org/licenses/by/4.0 (vor)
Locations: BMC Medicine (publishedVersion, cc-by)
PubMed Central (publishedVersion, cc-by)
PubMed (publishedVersion)
Research Publications (Maastricht University) (publishedVersion, cc-by)
Leiden Repository (Leiden University) (submittedVersion, cc-by)
Lirias (KU Leuven) (submittedVersion, other-oa)
DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
Utrecht University Repository (Utrecht University) (submittedVersion, other-oa)
Funders: Fonds Wetenschappelijk Onderzoek (G097322N)
Topics: Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
Health Sciences › Health Professions › Health Information Management › Artificial Intelligence in Healthcare
Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
Keywords: clinical prediction model, model validation, external validation, internal validation, model updating, clinical decision support

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

There is no such thing as a validated prediction model

Abstract

Overview

Integrity signals

Figures

Verification

Claims the paper makes

Claims other papers make about this one

Self-check

Citations

Cites

Cited by

Related

Metadata

Record

About these checks