Cited by 657Meta-analysis and systematic reviewsStatistical Methods in EpidemiologyClinical practice guidelines implementation

The DOI matches its Crossref record; 49 of the 49 references it cites were found in a registry or an index.

A guide to systematic review and meta-analysis of prediction model performance

Open access

Debray, Thomas P A, Damen, Johanna A A G, Snell, Kym I E, Ensor, Joie, Hooft, Lotty, Reitsma, Johannes B, Riley, Richard D, Moons, Karel G M·2017·BMJ

DOI 10.1136/bmj.i6460

Open this paper in CoChat — free account Open PDF

Abstract

Validation of prediction models is highly recommended and increasingly common in the literature. A systematic review of validation studies is therefore helpful, with meta-analysis needed to summarise the predictive performance of the model being validated across different settings and populations. This article provides guidance for researchers systematically reviewing and meta-analysing the existing evidence on a specific prediction model, discusses good practice when quantitatively summarising the predictive performance of the model across studies, and provides recommendations for interpreting meta-analysis estimates of model performance. We present key steps of the meta-analysis and illustrate each step in an example review, by summarising the discrimination and calibration performance of the EuroSCORE for predicting operative mortality in patients undergoing coronary artery bypass grafting.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

Integrity signals

Registry

Crossref · 10.1136/bmj.i6460

Cites

49 of 49 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Two new Later Stone Age sites from the Final Pleistocene in the Falémé Valley, eastern Senegal
Ndiaye, M., Lespez, L., Tribolo, C., Rassé, M., Hadjas, I., Davidoux, S., Huysecom, É., & Douze, K. (2024) · Monash University Research Portal (Monash University) · doi:10.3929/ethz-b-000667478 · Cited by 24,214
The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate healthcare interventions: explanation and elaboration
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gotzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · BMJ · doi:10.1136/bmj.b2700 · Cited by 17,648
Estimating the mean and variance from the median, range, and the size of a sample
Hozo, S. P., Djulbegovic, B., & Hozo, I. (2005) · BMC Medical Research Methodology · doi:10.1186/1471-2288-5-13 · Cited by 9,062
Transparent Reporting of a multivariable prediction model for Individual Prognosis Or Diagnosis (TRIPOD): Explanation and Elaboration
Moons, K. G. M., Altman, D. G., Reitsma, J. B., Ioannidis, J. P. A., Macaskill, P., Steyerberg, E. W., Vickers, A. J., Ransohoff, D. F., & Collins, G. S. (2015) · Annals of Internal Medicine · doi:10.7326/m14-0698 · Cited by 5,147
Self-citation
Transparent Reporting of a multivariable prediction model for Individual Prognosis Or Diagnosis (TRIPOD): The TRIPOD Statement
Collins, G. S., Reitsma, J. B., Altman, D. G., & Moons, K. G. M. (2015) · Annals of Internal Medicine · doi:10.7326/m14-0697 · Cited by 3,267
Self-citation
Interpretation of random effects meta-analyses
Riley, R. D., Higgins, J. P. T., & Deeks, J. J. (2011) · BMJ · doi:10.1136/bmj.d549 · Cited by 2,884
Self-citation
Chapter 9: Analysing Data and Undertaking Meta-Analyses
Deeks, J. J., Higgins, J. P. T., & Altman, D. G. (2008) · Cited by 2,782
The Hartung-Knapp-Sidik-Jonkman method for random effects meta-analysis is straightforward and considerably outperforms the standard DerSimonian-Laird method
IntHout, J., Ioannidis, J. P., & Borm, G. F. (2014) · BMC Medical Research Methodology · doi:10.1186/1471-2288-14-25 · Cited by 2,419
Preferred Reporting Items for a Systematic Review and Meta-analysis of Individual Participant Data: The PRISMA-IPD Statement
Stewart, L. A., Clarke, M., Rovers, M., Riley, R. D., Simmonds, M., Stewart, G., & Tierney, J. F. (2015) · JAMA · doi:10.1001/jama.2015.3656 · Cited by 2,134
Self-citation
Critical appraisal and data extraction for systematic reviews of prediction modelling studies: the CHARMS checklist
Moons, K. G. M., de Groot, J. A. H., Bouwmeester, W., Vergouwe, Y., Mallett, S., Altman, D. G., Reitsma, J. B., & Collins, G. S. (2014) · PLoS Medicine · doi:10.1371/journal.pmed.1001744 · Cited by 2,018
Self-citation

Flagged first, then by citations

Show all 48 references

Sorted by citations

Items 101–200 of 648

Evaluating the development and validation of empirically-derived prognostic models for pressure ulcer risk assessment: A systematic review
Shi, C., Dumville, J. C., & Cullum, N. A. (2018) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2018.08.005 · Cited by 40
Comparison of Severity of Illness Scores and Artificial Intelligence Models That Are Predictive of Intensive Care Unit Mortality: Meta-analysis and Review of the Literature
Barboi, C., Tzavelis, A., & Muhammad, L. N. (2022) · JMIR Medical Informatics · doi:10.2196/35293 · Cited by 39
Cardiovascular disease risk prediction models in the Chinese population- a systematic review and meta-analysis
Guo, Z., Tang, J., Haiying, H., Yuping, Z., Yu, Q., & Jingfen, J. (2022) · BMC Public Health · doi:10.1186/s12889-022-13995-z · Cited by 38
A systematic review of clinical health conditions predicted by machine learning diagnostic and prognostic models trained or validated using real-world primary health care data
Abdulazeem, H. M., Whitelaw, S., Schauberger, G., & Klug, S. J. (2023) · PLoS ONE · doi:10.1371/journal.pone.0274276 · Cited by 40
Development and Validation of Prognostic Models for Oral Squamous Cell Carcinoma: A Systematic Review and Appraisal of the Literature
Russo, D., Mariani, P., Caponio, V. C. A., Russo, L. L., Fiorillo, L., Zhurakivska, K., Muzio, L. L., Laino, L., & Troiano, G. (2021) · Cancers · doi:10.3390/cancers13225755 · Cited by 37
Machine learning for the prediction of toxicities from head and neck cancer treatment: A systematic review with meta-analysis
Araújo, A. L. D., Moraes, M. C., Pérez‐de‐Oliveira, M. E., da Silva, V. M., Saldivia‐Siracusa, C., Pedroso, C. M., Lopes, M. A., Vargas, P. A., Kochanny, S. E., Pearson, A. T., et al. (2023) · Oral Oncology · doi:10.1016/j.oraloncology.2023.106386 · Cited by 37
Prognostic models for predicting clinical disease progression, worsening and activity in people with multiple sclerosis
Reeve, K. A., Ön, B. I., Havla, J. B., Burns, J., Gosteli, M., Alabsawi, A., Alayash, Z., Götschi, A., Seibold, H., Mansmann, U., et al. (2023) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd013606.pub2 · Cited by 37
Use of Machine Learning and Artificial Intelligence Methods in Geriatric Mental Health Research Involving Electronic Health Record or Administrative Claims Data: A Systematic Review
Chowdhury, M., Cervantes, E. G., Chan, W.-Y., & Seitz, D. P. (2021) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2021.738466 · Cited by 39
Predicting neurological outcome in adult patients with cardiac arrest: systematic review and meta-analysis of prediction model performance
Amacher, S. A., Blatter, R., Briel, M., Appenzeller‐Herzog, C., Bohren, C., Becker, C., Beck, K., Groß, S., Tisljar, K., Sutter, R., et al. (2022) · Critical Care · doi:10.1186/s13054-022-04263-y · Cited by 36
Risk prediction models for cancer therapy related cardiac dysfunction in patients with cancer and cancer survivors: systematic review and meta-analysis
Gomes, C., Geels, J., Debray, T. P. A., Malekzadeh, A., Asselbergs, F. W., & Linschoten, M. (2025) · BMJ · doi:10.1136/bmj-2025-084062 · Cited by 35
Self-citation
Assessing prognosis and prediction of treatment response in early rheumatoid arthritis: systematic reviews
Archer, R. J., Everson-Hock, E., Hamilton, J., Stevens, J., Essat, M., Poku, E. N., Clowes, M., Pandor, A., & Stevenson, M. (2018) · Health Technology Assessment · doi:10.3310/hta22660 · Cited by 35
Performance of prediction models on survival outcomes of colorectal cancer with surgical resection: A systematic review and meta-analysis
He, Y., Ong, A. Y., Li, X., Din, F. V., Brown, E. R., Timofeeva, M. N., Wang, Z., Farrington, S. M., Campbell, H., Dunlop, M. G., et al. (2019) · Surgical Oncology · doi:10.1016/j.suronc.2019.05.014 · Cited by 35
Prognostic models for predicting relapse or recurrence of major depressive disorder in adults
Moriarty, A. S., Meader, N., Snell, K. I. E., Riley, R. D., Paton, L. W., Chew-Graham, C. A., Gilbody, S. M., Churchill, R. C., Phillips, R. S., Ali, S., et al. (2021) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd013491.pub2 · Cited by 35
Self-citation
A Systematic Review and Meta-Analysis of Preoperative Frailty Instruments Derived From Electronic Health Data
Alkadri, J., Hage, D., Nickerson, L. H., Scott, L. R., Shaw, J. F., Aucoin, S. D., & McIsaac, D. I. (2021) · Anesthesia & Analgesia · doi:10.1213/ane.0000000000005595 · Cited by 35
Clinical Prediction Models for Suspected Pediatric Foreign Body Aspiration
Lee, J. W., Philteos, J., Levin, M., Namavarian, A., Propst, E. J., & Wolter, N. E. (2021) · JAMA Otolaryngology–Head & Neck Surgery · doi:10.1001/jamaoto.2021.1548 · Cited by 35
Prognostic models for amyotrophic lateral sclerosis: a systematic review
Xu, L., He, B., Zhang, Y., Chen, L., Fan, D., Zhan, S., & Wang, S. (2021) · Journal of Neurology · doi:10.1007/s00415-021-10508-7 · Cited by 34
Large-scale external validation and comparison of prognostic models: an application to chronic obstructive pulmonary disease
Guerra, B., Haile, S. R., Lamprecht, B., Ramírez, A. S., Martínez‐Camblor, P., Kaiser, B., Alfageme, I., Almagro, P., Casanova, C., Esteban, C., et al. (2018) · BMC Medicine · doi:10.1186/s12916-018-1013-y · Cited by 35
Prognostic models of diabetic microvascular complications: a systematic review and meta-analysis
Saputro, S. A., Pattanaprateep, O., Pattanateepapon, A., Karmacharya, S., & Thakkinstian, A. (2021) · Systematic Reviews · doi:10.1186/s13643-021-01841-z · Cited by 34
Artificial intelligence models for predicting acute kidney injury in the intensive care unit: a systematic review of modeling methods, data utilization, and clinical applicability
Shi, T., Lin, Y., Zhao, H., & Kong, G. (2025) · JAMIA Open · doi:10.1093/jamiaopen/ooaf065 · Cited by 33
Cardiovascular Disease Prognostic Models in Latin America and the Caribbean: A Systematic Review
Carrillo-Larco, R. M., Altez-Fernandez, C., Pacheco-Barrios, N. V., Claudia Bambs, S., Irazola, V. E., Miranda, J. J., Danaei, G., & Perel, P. (2019) · Global Heart · doi:10.1016/j.gheart.2019.03.001 · Cited by 33
Prognostic Models Predicting Mortality in Preterm Infants: Systematic Review and Meta-analysis
van Beek, P. E., Andriessen, P., Onland, W., & Schuit, E. (2021) · PEDIATRICS · doi:10.1542/peds.2020-020461 · Cited by 34
Assessing racial bias in type 2 diabetes risk prediction algorithms
Cronjé, H. T., Katsiferis, A., Elsenburg, L. K., Andersen, T. O., Rod, N. H., Nguyen, T., & Varga, T. V. (2023) · PLOS Global Public Health · doi:10.1371/journal.pgph.0001556 · Cited by 34
Systematic review: risk prediction models for recurrence of hepatocellular carcinoma after liver transplantation
Al‐Ameri, A. A. M., Wei, X., Wen, X., Wei, Q., Guo, H., Zheng, S., & Xu, X. (2020) · Transplant International · doi:10.1111/tri.13585 · Cited by 31
Systematic review and meta-analysis of mortality risk prediction models in adult cardiac surgery
Sinha, S., Dimagli, A., Dixon, L. K., Gaudino, M. F. L., Caputo, M., Vohra, H. A., Angelini, G. D., & Benedetto, U. (2021) · Interactive Cardiovascular and Thoracic Surgery · doi:10.1093/icvts/ivab151 · Cited by 31
Prognostic Models in Severe Traumatic Brain Injury: A Systematic Review and Meta-analysis
Vieira, R. D. C. A., Silveira, J. C. P., Paiva, W. S., de Oliveira, D. V., de Souza, C. P. E., Santos, E. S., & de Sousa, R. M. C. (2022) · Neurocritical Care · doi:10.1007/s12028-022-01547-7 · Cited by 31
Protease activity as a prognostic factor for wound healing in venous leg ulcers
Westby, M. J., Dumville, J. C., Stubbs, N. C., Norman, G., Wong, J. K. F., Cullum, N. A., & Riley, R. D. (2017) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd012841 · Cited by 31
Self-citation
Prognostic Factors Associated With Extubation Failure in Acutely Brain-Injured Patients: A Systematic Review and Meta-Analysis*
Taran, S., Angeloni, N. A., Pinto, R. L., Lee, S. Y., McCREDIE, V. A., Schultz, M. J., Robba, C., Taccone, F. S., & Adhikari, N. K. J. (2022) · Critical Care Medicine · doi:10.1097/ccm.0000000000005769 · Cited by 30
Acute Kidney Injury Prognosis Prediction Using Machine Learning Methods: A Systematic Review
Lin, Y., Shi, T., & Kong, G. (2024) · Kidney Medicine · doi:10.1016/j.xkme.2024.100936 · Cited by 34
Comparison of machine learning methods versus traditional Cox regression for survival prediction in cancer using real-world data: a systematic literature review and meta-analysis
Huang, Y., Bazzazzadehgan, S., Li, J., Arabshomali, A., Li, M., Bhattacharya, K., & Bentley, J. P. (2025) · BMC Medical Research Methodology · doi:10.1186/s12874-025-02694-z · Cited by 31
Epilepsy Among Elderly Medicare Beneficiaries
Moura, L. M. V. R., Smith, J. R., Blacker, D., Vogeli, C., Schwamm, L. H., Cole, A. J., Hernández–Dı́az, S., & Hsu, J. (2019) · Medical Care · doi:10.1097/mlr.0000000000001072 · Cited by 30
A Systematic Review on Predictors of Working Memory Training Responsiveness in Healthy Older Adults: Methodological Challenges and Future Directions
Ophey, A., Roheger, M., Folkerts, A., Skoetz, N., & Kalbe, E. (2020) · Frontiers in Aging Neuroscience · doi:10.3389/fnagi.2020.575804 · Cited by 35
An Assessment of the Predictive Performance of Current Machine Learning–Based Breast Cancer Risk Prediction Models: Systematic Review
Gao, Y., Li, S., Jin, Y., Zhou, L., Sun, S., Xu, X., Li, S., Yang, H., Zhang, Q., & Wang, Y. (2022) · JMIR Public Health and Surveillance · doi:10.2196/35750 · Cited by 30
Multi-domain prognostic models used in middle-aged adults without known cognitive impairment for predicting subsequent dementia
Geethadevi, G. M., Quinn, T. J., George, J., Anstey, K. J., Bell, J. S., Sarwar, M. R., & Cross, A. J. (2023) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd014885.pub2 · Cited by 30
Guidance to best tools and practices for systematic reviews1
Kolaski, K., Logan, L. R., & Ioannidis, J. P. A. (2023) · Journal of Pediatric Rehabilitation Medicine · doi:10.3233/prm-230019 · Cited by 35
Evidence synthesis in prognosis research
Debray, T. P. A., de Jong, V. M. T., Moons, K. G. M., & Riley, R. D. (2019) · Diagnostic and Prognostic Research · doi:10.1186/s41512-019-0059-4 · Cited by 30
Self-citation
Can risk prediction models help us individualise stillbirth prevention? A systematic review and critical appraisal of published risk models
Townsend, R., Manji, A., Allotey, J., Heazell, A. E. P., Jorgensen, L., Magee, L. A., Mol, B. W., Snell, K. I. E., Riley, R. D., Sandall, J., et al. (2020) · BJOG An International Journal of Obstetrics & Gynaecology · doi:10.1111/1471-0528.16487 · Cited by 29
Self-citation
Prognostic models for predicting the risk of foot ulcer or amputation in people with type 2 diabetes: a systematic review and external validation study
Beulens, J. W. J., Yauw, J. S., Elders, P. J. M., Feenstra, T., Herings, R. M. C., Slieker, R. C., Moons, K. G. M., Nijpels, G., & van der Heijden, A. A. W. A. (2021) · Diabetologia · doi:10.1007/s00125-021-05448-w · Cited by 30
Self-citation
Machine learning approaches for risk prediction after percutaneous coronary intervention: a systematic review and meta-analysis
Zaka, A., Mutahar, D., Gorcilov, J., Gupta, A. K., Kovoor, J. G., Stretton, B., Mridha, N., Sivagangabalan, G., Thiagalingam, A., Chow, C. K., et al. (2024) · European Heart Journal - Digital Health · doi:10.1093/ehjdh/ztae074 · Cited by 28
Prediction of incident atrial fibrillation in community-based electronic health records: a systematic review with meta-analysis
Nadarajah, R., Alsaeed, E. S., Hurdus, B., Aktaa, S., Hogg, D., Bates, M. G. D., Cowan, C., Wu, J., & Gale, C. P. (2021) · Heart · doi:10.1136/heartjnl-2021-320036 · Cited by 28
GRADE concept paper 2: Concepts for judging certainty on the calibration of prognostic models in a body of validation studies
Foroutan, F., Guyatt, G. H., Trivella, M., Kreuzberger, N., Skoetz, N., Riley, R. D., Roshanov, P. S., Alba, A. C., Sekercioglu, N., Canelo‐Aybar, C., et al. (2021) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2021.11.024 · Cited by 29
Self-citation
Interim PET-results for prognosis in adults with Hodgkin lymphoma: a systematic review and meta-analysis of prognostic factor studies
Aldin, A., Umlauff, L., Estcourt, L. J., Collins, P. G. S., Moons, K. G. M., Engert, A., Kobe, C., von Tresckow, B., Haque, M., Foroutan, F., et al. (2019) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd012643.pub2 · Cited by 28
Self-citation
Reporting on the Value of Artificial Intelligence in Predicting the Optimal Embryo for Transfer: A Systematic Review including Data Synthesis
Sfakianoudis, K., Maziotis, E., Grigoriadis, S., Pantou, A., Kokkini, G., Trypidi, A., Giannelou, P., Zikopoulos, A., Angeli, I., Vaxevanoglou, T., et al. (2022) · Biomedicines · doi:10.3390/biomedicines10030697 · Cited by 29
Structured data vs. unstructured data in machine learning prediction models for suicidal behaviors: A systematic review and meta-analysis
Hopkins, D., Rickwood, D., Hallford, D. J., & Watsford, C. R. (2022) · Frontiers in Digital Health · doi:10.3389/fdgth.2022.945006 · Cited by 29
Prediction models for breast cancer-related lymphedema: a systematic review and critical appraisal
Qiu, L., Yang, T., Jin, Y., & Die, Y. M. (2022) · Systematic Reviews · doi:10.1186/s13643-022-02084-2 · Cited by 27
Prediction Models for Heart Failure in the Community: A Systematic Review and Meta-Analysis
Nadarajah, R., Younsi, T., Romer, E., Raveendra, K., Nakao, Y. M., Nakao, K., Shuweihdi, F., Hogg, D., Arbel, R., Zahger, D., et al. (2023) · European Journal of Heart Failure · doi:10.1002/ejhf.2970 · Cited by 30
The performance of FIT-based and other risk prediction models for colorectal neoplasia in symptomatic patients: a systematic review
Hampton, J. S., Kenny, R. P. W., Rees, C. J., Hamilton, W. T., Eastaugh, C., Richmond, C., & Sharp, L. (2023) · EClinicalMedicine · doi:10.1016/j.eclinm.2023.102204 · Cited by 27
Risk prediction models for falls in hospitalized older patients: a systematic review and meta-analysis
Mao, A., Su, J., Ren, M., Chen, S., & Zhang, H. (2025) · BMC Geriatrics · doi:10.1186/s12877-025-05688-0 · Cited by 29
A proof-of-concept application of a novel scoring approach for personalized medicine in multiple sclerosis
Pellegrini, F., Copetti, M., Bovis, F., Cheng, D., Hyde, R., de Moor, C., Kieseier, B. C., & Sormani, M. P. (2019) · Multiple Sclerosis Journal · doi:10.1177/1352458519849513 · Cited by 27
Risk scores for type 2 diabetes mellitus in Latin America: a systematic review of population‐based studies
Carrillo-Larco, R. M., Aparcana-Granda, D. J., Mejia, J. R., Barengo, N. C., & Bernabé‐Ortiz, A. (2019) · Diabetic Medicine · doi:10.1111/dme.14114 · Cited by 28
Risk scores for occult cancer in patients with unprovoked venous thromboembolism: Results from an individual patient data meta‐analysis
Mulder, F. I., Carrier, M., van Doormaal, F. F., Robin, P., Otten, H.-M. M. B., Salaün, P., Buller, H. R., Gal, G. L., & van Es, N. (2020) · Journal of Thrombosis and Haemostasis · doi:10.1111/jth.15001 · Cited by 27
External validation of prognostic models predicting pre-eclampsia: individual participant data meta-analysis
for the IPPIC Collaborative Network, Snell, K. I. E., Allotey, J., Smuk, M., Hooper, R., Chan, C., Ahmed, A., Chappell, L. C., von Dadelszen, P., Green, M., et al. (2020) · BMC Medicine · doi:10.1186/s12916-020-01766-9 · Cited by 28
Self-citation
Guidance to best tools and practices for systematic reviews
Kolaski, K., Logan, L. R., & Ioannidis, J. P. A. (2023) · British Journal of Pharmacology · doi:10.1111/bph.16100 · Cited by 29
Predictive models for cardiovascular and kidney outcomes in patients with type 2 diabetes: systematic review and meta-analyses
Buchan, T. A., Malik, A., Chan, C., Chambers, J., Suk, Y., Zhu, J. W., Ge, F. Z., Le, H., Vargas, L. A., Hao, Q., et al. (2021) · Heart · doi:10.1136/heartjnl-2021-319243 · Cited by 27
Prognostic models for mortality after cardiac surgery in patients with infective endocarditis: a systematic review and aggregation of prediction models
Fernandez-Felix, B. M., Barca, L. V., García‐Esquinas, E., Correa-Pérez, A., Fernández‐Hidalgo, N., Muriel, A., López‐Alcalde, J., Díaz, N. Á., Pijoán, J. I., Ribera, A., et al. (2021) · Clinical Microbiology and Infection · doi:10.1016/j.cmi.2021.05.051 · Cited by 27
Association of Preoperative Hyponatremia With Surgical Outcomes: A Systematic Review and Meta-analysis of 32 Observational Studies
Teo, C. B., Gan, M. Y., Tay, R. Y. K., Loh, W. J., & Loh, N. H. W. (2022) · The Journal of Clinical Endocrinology & Metabolism · doi:10.1210/clinem/dgac685 · Cited by 25
Prognostic models for predicting the severity and mortality in people with acute pancreatitis
Gurusamy, K. S., Debray, T. P. A., & Rompianesi, G. (2018) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd013026 · Cited by 26
Self-citation
Identifying older adults with frailty approaching end-of-life: A systematic review
Hall, A., Boulton, E., Kunonga, P., Spiers, G., Beyer, F. R., Bower, P., Craig, D., Todd, C. J., & Hanratty, B. (2021) · Palliative Medicine · doi:10.1177/02692163211045917 · Cited by 29
Diagnostic and prognostic prediction models in ventilator-associated pneumonia: Systematic review and meta-analysis of prediction modelling studies
Frondelius, T., Atkova, I., Miettunen, J., Rello, J., & Jansson, M. M. (2021) · Journal of Critical Care · doi:10.1016/j.jcrc.2021.10.001 · Cited by 27
A Systematic Review and Meta-Analysis of Prognostic Nomograms After UTUC Surgery
Pallauf, M., König, F., D’Andrea, D., Laukhtina, E., Mostafaei, H., Motlagh, R. S., Quhal, F., Aydh, A., Yanagisawa, T., Kawada, T., et al. (2022) · Frontiers in Oncology · doi:10.3389/fonc.2022.907975 · Cited by 25
Application of mathematical models to validate emerging processing technologies in food
Alvarenga, V. O., Brito, L. M., & Lacerda, I. C. A. (2022) · Current Opinion in Food Science · doi:10.1016/j.cofs.2022.100928 · Cited by 25
Development and validation of a novel prediction model to identify patients in need of specialized trauma care during field triage: design and rationale of the GOAT study
van der Sluijs, R., Debray, T. P. A., Poeze, M., Leenen, L. P. H., & van Heijl, M. (2019) · Diagnostic and Prognostic Research · doi:10.1186/s41512-019-0058-5 · Cited by 26
Self-citation
Incorporating repeated measurements into prediction models in the critical care setting: a framework, systematic review and meta-analysis
Plate, J. D. J., van de Leur, R. R., Leenen, L. P. H., Hietbrink, F., Peelen, L. M., & Eijkemans, M. J. C. (2019) · BMC Medical Research Methodology · doi:10.1186/s12874-019-0847-0 · Cited by 29
External validation of the Khorana score for the prediction of venous thromboembolism in cancer patients: A systematic review and meta-analysis
Huang, X., Chen, H., Meng, S., Pu, L., Xu, X., Xu, P., He, S., Hu, X., Li, Y., & Wang, G. (2024) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2024.104867 · Cited by 24
Toolkit of methodological resources to conduct systematic reviews
Figuls, M. R. I., García, L. M., Solà, I., Alonso‐Coello, P., Bonfill, X., & Zamora, J. (2020) · F1000Research · doi:10.12688/f1000research.22032.2 · Cited by 25
FINDRISC in Latin America: a systematic review of diagnosis and prognosis models
Carrillo-Larco, R. M., Aparcana-Granda, D. J., Mejia, J. R., & Bernabé‐Ortiz, A. (2020) · BMJ Open Diabetes Research & Care · doi:10.1136/bmjdrc-2019-001169 · Cited by 27
A Systematic Review and Critical Assessment of Breast Cancer Risk Prediction Tools Incorporating a Polygenic Risk Score for the General Population
Mbuya-Bienge, C., Pashayan, N., Kazemali, C. D., Lapointe, J., Simard, J., & Nabi, H. (2023) · Cancers · doi:10.3390/cancers15225380 · Cited by 24
Prognostic role of the Donor Risk Index, the Eurotransplant Donor Risk Index, and the Balance of Risk score on graft loss after liver transplantation
Lozanovski, V. J., Probst, P., Arefidoust, A., Ramouz, A., Aminizadeh, E., Nikdad, M., Khajeh, E., Ghamarnejad, O., Shafiei, S., Ali‐Hasan‐Al‐Saegh, S., et al. (2021) · Transplant International · doi:10.1111/tri.13861 · Cited by 25
External validation of models for predicting cumulative live birth over multiple complete cycles of IVF treatment
Ratna, M. B., Bhattacharya, S., & McLernon, D. J. (2023) · Human Reproduction · doi:10.1093/humrep/dead165 · Cited by 23
Prognostic risk models for incident hypertension: A PRISMA systematic review and meta-analysis
Schjerven, F. E., Lindseth, F., & Steinsland, I. (2024) · PLoS ONE · doi:10.1371/journal.pone.0294148 · Cited by 24
Prognostic models for adverse pregnancy outcomes in low-income and middle-income countries: a systematic review
Heestermans, T., Payne, B. A., Kayode, G. A., Amoakoh‐Coleman, M., Schuit, E., Rijken, M. J., Klipstein‐Grobusch, K., Bloemenkamp, K. W. M., Grobbee, D. E., & Browne, J. L. (2019) · BMJ Global Health · doi:10.1136/bmjgh-2019-001759 · Cited by 25
Predicting major adverse cardiovascular events for secondary prevention: protocol for a systematic review and meta-analysis of risk prediction models
Akyea, R. K., Leonardi‐Bee, J., Asselbergs, F. W., Patel, R. S., Durrington, P. N., Wierzbicki, A. S., Ibiwoye, O. H., Kai, J., Qureshi, N., & Weng, S. F. (2020) · BMJ Open · doi:10.1136/bmjopen-2019-034564 · Cited by 26
Prognostic models for outcome prediction following in-hospital cardiac arrest using pre-arrest factors: a systematic review, meta-analysis and critical appraisal
van Ravenhorst, C. G., Schluep, M., Endeman, H., Stolker, R.-J., & Hoeks, S. E. (2023) · Critical Care · doi:10.1186/s13054-023-04306-y · Cited by 23
Guidance to best tools and practices for systematic reviews
Kolaski, K., Logan, L. R., & Ioannidis, J. P. A. (2023) · BMC Infectious Diseases · doi:10.1186/s12879-023-08304-x · Cited by 24
Prognostic factors and prediction models for acute aortic dissection: a systematic review
Ren, Y., Huang, S., Li, Q., Liu, C., Li, L., Tan, J., Zou, K., & Sun, X. (2021) · BMJ Open · doi:10.1136/bmjopen-2020-042435 · Cited by 23
Efficacy of interventions to increase physical activity for people with heart failure: a meta-analysis
Amirova, A., Fteropoulli, T., Williams, P. R., & Haddad, M. (2021) · Open Heart · doi:10.1136/openhrt-2021-001687 · Cited by 25
Prediction models for self-harm and suicide: a systematic review and critical appraisal
Seyedsalehi, A., Bailey, J. P. M., Ogonah, M. G. T., Fanshawe, T. R., & Fazel, S. (2025) · BMC Medicine · doi:10.1186/s12916-025-04367-6 · Cited by 25
Performance of Pediatric Mortality Prediction Models in Low- and Middle-Income Countries: A Systematic Review and Meta-Analysis
Muttalib, F., Clavel, V., Yaeger, L., Shah, V. S., & Adhikari, N. K. J. (2020) · The Journal of Pediatrics · doi:10.1016/j.jpeds.2020.05.016 · Cited by 24
Systematic Review and Meta-Analysis of the Diagnostic Accuracy of the International Academy of Cytology Yokohama System for Reporting Breast Fine-Needle Aspiration Biopsy in Diagnosing Breast Cancer
Paul, P., Azad, S., Agrawal, S., Rao, S., & Chowdhury, N. (2022) · Acta Cytologica · doi:10.1159/000527346 · Cited by 23
Predictive models of Alzheimer’s disease dementia risk in older adults with mild cognitive impairment: a systematic review and critical appraisal
Wang, X., Zhou, S., Ye, N., Li, Y., Zhou, P., Gao, C., & Hu, H. Z. (2024) · BMC Geriatrics · doi:10.1186/s12877-024-05044-8 · Cited by 22
The HEART score in predicting major adverse cardiac events in patients presenting to the emergency department with possible acute coronary syndrome: protocol for a systematic review and meta-analysis
Byrne, C. J., Toarta, C., Backus, B. E., & Holt, T. (2018) · Systematic Reviews · doi:10.1186/s13643-018-0816-4 · Cited by 22
Prognostic factors for the development of incontinence‐associated dermatitis ( IAD ): A systematic review
Deprez, J., Ohde, N., Eilegård, A., Bååth, C., Hommel, A., Hultin, L., Josefson, A., Kottner, J., & Beeckman, D. (2024) · International Wound Journal · doi:10.1111/iwj.14962 · Cited by 21
Hearing Loss in Enlarged Vestibular Aqueduct: A Prognostic Factor Systematic Review of the Literature
Saeed, S. R., Kenth, J., Black, G. C. M., Saeed, S. R., Stivaros, S. M., & Bruce, I. A. (2020) · Otology & Neurotology · doi:10.1097/mao.0000000000002843 · Cited by 21
Reproducibility of prediction models in health services research
Belbasis, L., & Panagiotou, O. A. (2022) · BMC Research Notes · doi:10.1186/s13104-022-06082-4 · Cited by 23
Telehealth applications used for self-efficacy levels of family caregivers for individuals with dementia: A systematic review and Meta-analysis
Söylemez, B. A., Özgül, E., Küçükgüçlü, Ö., & Yener, G. (2022) · Geriatric Nursing · doi:10.1016/j.gerinurse.2022.12.001 · Cited by 21
Risk prediction models for breast cancer-related lymphedema: A systematic review and meta-analysis
Shen, A., Wei, X., Zhu, F., Sun, M., Ke, S., Qiang, W., & Lü, Q. (2023) · European Journal of Oncology Nursing · doi:10.1016/j.ejon.2023.102326 · Cited by 22
External validation, update and development of prediction models for pre-eclampsia using an Individual Participant Data (IPD) meta-analysis: the International Prediction of Pregnancy Complication Network (IPPIC pre-eclampsia) protocol
for the IPPIC Collaborative Network, Allotey, J., Snell, K. I. E., Chan, C., Hooper, R., Dodds, J. P., Rogozińska, E., Khan, K. S., Poston, L., Kenny, L. C., et al. (2017) · Diagnostic and Prognostic Research · doi:10.1186/s41512-017-0016-z · Cited by 21
Self-citation
Systematic review of risk prediction scores for venous thromboembolism following joint replacement
Kunutsor, S. K., Beswick, A. D., Whitehouse, M. R., & Blom, A. W. (2018) · Thrombosis Research · doi:10.1016/j.thromres.2018.06.024 · Cited by 22
Meta-analysis of Calibration, Discrimination, and Stratum-Specific Likelihood Ratios for the CRB-65 Score
Ebell, M. H., Walsh, M. E., Fahey, T. P., Kearney, M., & Marchello, C. S. (2019) · Journal of General Internal Medicine · doi:10.1007/s11606-019-04869-z · Cited by 21
Multidimensional screening for predicting pain problems in adults: a systematic review of screening tools and validation studies
Veirman, E., Ryckeghem, D. M. L. V., Paepe, A. L. D., Kirtley, O. J., & Crombez, G. (2019) · PAIN Reports · doi:10.1097/pr9.0000000000000775 · Cited by 22
Prediction models for diagnosis and prognosis of the colonization or infection of multidrug-resistant organisms in adults: a systematic review, critical appraisal, and meta-analysis
Liu, X., Liu, X., Jin, C., Luo, Y., Yang, L., Ning, X., Zhuo, C., & Xiao, F. (2024) · Clinical Microbiology and Infection · doi:10.1016/j.cmi.2024.07.005 · Cited by 20
Multibiomarker disease activity score: an objective tool for monitoring rheumatoid arthritis? A systematic review and meta-analysis
Meznerics, F. A., Kemény, L. V., Gunther, E. E., Bakó, E., Dembrovszky, F., Szabó, B., Ascsillán, A. A., Lutz, E., Csupor, D., Hegyi, P. J., et al. (2022) · Rheumatology · doi:10.1093/rheumatology/keac715 · Cited by 20
Validity of three risk prediction models for dementia or cognitive impairment in Australia
Geethadevi, G. M., Peel, R., Bell, J. S., Cross, A. J., Hancock, S. J., Ilomäki, J., Tang, T., Attia, J., & George, J. (2022) · Age and Ageing · doi:10.1093/ageing/afac307 · Cited by 20
Guidance to Best Tools and Practices for Systematic Reviews
Kolaski, K., Logan, L. R., & Ioannidis, J. P. A. (2023) · JBJS Reviews · doi:10.2106/jbjs.rvw.23.00077 · Cited by 24
Prognostic factors for change in memory test performance after memory training in healthy older adults: a systematic review and outline of statistical challenges
Roheger, M., Folkerts, A., Krohm, F., Skoetz, N., & Kalbe, E. (2020) · Diagnostic and Prognostic Research · doi:10.1186/s41512-020-0071-8 · Cited by 20
Predictors of disease severity in children presenting from the community with febrile illnesses: a systematic review of prognostic studies
Chandna, A., Tan, R., Carter, M. J., Bruel, A. V. D., Verbakel, J. Y. J., Koshiaris, C., Salim, N., Lubell, Y., Turner, P., & Keitel, K. (2021) · BMJ Global Health · doi:10.1136/bmjgh-2020-003451 · Cited by 20
Prognostic role of selection criteria for liver transplantation in patients with hepatocellular carcinoma: a network meta-analysis
Lozanovski, V. J., Ramouz, A., Aminizadeh, E., Ali‐Hasan‐Al‐Saegh, S., Khajeh, E., Probst, H., Picardi, S., Rupp, C., Chang, D., Probst, P., et al. (2021) · BJS Open · doi:10.1093/bjsopen/zrab130 · Cited by 20
Machine learning models for risk prediction of cancer-associated thrombosis: a systematic review and meta-analysis
Chen, K., Zhang, Y., Zhang, L., Zhang, W., & Chen, Y. (2024) · Journal of Thrombosis and Haemostasis · doi:10.1016/j.jtha.2024.11.001 · Cited by 20
Individual participant data validation of the PICNICC prediction model for febrile neutropenia
Phillips, B., Morgan, J. E., Haeusler, G. M., & Riley, R. D. (2019) · Archives of Disease in Childhood · doi:10.1136/archdischild-2019-317308 · Cited by 19
Self-citation
Prognostic prediction models for pregnancy complications in women with gestational diabetes: a protocol for systematic review, critical appraisal and meta-analysis
Cooray, S. D., Boyle, J. A., Soldatos, G., Wijeyaratne, L. A., & Teede, H. J. (2019) · Systematic Reviews · doi:10.1186/s13643-019-1151-0 · Cited by 20
Prediction models for living organ transplantation are poorly developed, reported, and validated: a systematic review
Haller, M. C., Aschauer, C., Wallisch, C., Leffondré, K., van Smeden, M., Oberbauer, R. W., & Heinze, G. (2022) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2022.01.025 · Cited by 19

Authors: Debray, T. P. A., Damen, J. A. A. G., Snell, K. I. E., Ensor, J., Hooft, L., Reitsma, J. B., Riley, R. D., & Moons, K. G. M.
Affiliations: University Medical Center Utrecht (NL)
Keele University (GB)
Corresponding author: Debray, Thomas P A
ORCID: Debray, Thomas P A
Damen, Johanna A A G
Snell, Kym I E
Ensor, Joie
Hooft, Lotty
Reitsma, Johannes B
Riley, Richard D
Moons, Karel G M
Venue: BMJ
Publisher: BMJ
Published: 2017-01-05
Volume: 356
Pages: i6460
ISSN: 1756-1833 (ISSN-L)
DOI: 10.1136/bmj.i6460
OpenAlex: W2570878489
Cited by: 657
References: 48
Citations by year: 2026: 109 · 2025: 98 · 2024: 94 · 2023: 81 · 2022: 64 · 2021: 82 · 2020: 56 · 2019: 33 · 2018: 27 · 2017: 11
FWCI: 8.62
Type: journal article
Language: en
Open access: bronze
doi.org
Licence: www.bmj.org/licenses/tdm/1.0/terms-and-conditions.html (tdm)
Locations: BMJ (publishedVersion)
PubMed (publishedVersion)
Pure Amsterdam UMC (publishedVersion)
Keele Research Repository (Keele University) (submittedVersion, cc-by)
Data Archiving and Networked Services (DANS) (submittedVersion)
Utrecht University Repository (Utrecht University) (submittedVersion, other-oa)
HighWire Press Open Archive (submittedVersion)
University of Birmingham Research Portal (University of Birmingham) (submittedVersion)
Funders: Medical Research Council (MR/L004933/1, G0902393)
Topics: Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Clinical practice guidelines implementation
Keywords: prediction model validation, systematic reviews, meta-analysis, predictive performance, discrimination (statistics), calibration, EuroSCORE, postoperative mortality, coronary artery bypass grafting, risk prediction model
MeSH terms: Systematic Reviews as Topic, Coronary Artery Bypass, Decision Support Techniques, Humans, Meta-Analysis as Topic, Risk Assessment, Validation Studies as Topic

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

A guide to systematic review and meta-analysis of prediction model performance

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Self-check

Citations

Cites

Cited by

Related

Metadata

Record

About these checks