PROBAST: A Tool to Assess Risk of Bias and Applicability of Prediction Model Studies: Explanation and Elaboration
Open accessThe DOI matches its Crossref record; 194 of the 201 references it cites were found in a registry or an index.
Abstract
Prediction models in health care use predictors to estimate for an individual the probability that a condition or disease is already present (diagnostic model) or will occur in the future (prognostic model). Publications on prediction models have become more common in recent years, and competing prediction models frequently exist for the same outcome or target population. Health care providers, guideline developers, and policymakers are often unsure which model to use or recommend, and in which persons or settings. Hence, systematic reviews of these studies are increasingly demanded, required, and performed. A key part of a systematic review of prediction models is examination of risk of bias and applicability to the intended population and setting. To help reviewers with this process, the authors developed PROBAST (Prediction model Risk Of Bias ASsessment Tool) for studies developing, validating, or updating (for example, extending) prediction models, both diagnostic and prognostic. PROBAST was developed through a consensus process involving a group of experts in the field. It includes 20 signaling questions across 4 domains (participants, predictors, outcome, and analysis). This explanation and elaboration document describes the rationale for including each domain and signaling question and guides researchers, reviewers, readers, and guideline developers in how to use them to assess risk of bias and applicability concerns. All concepts are illustrated with published examples across different topics. The latest version of the PROBAST checklist, accompanying documents, and filled-in examples can be downloaded from www.probast.org.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The text we found for this paper looks like another document, so the self-check wasn’t run.
Citations
Cites
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: the PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & for the PRISMA Group (2009) · BMJ · doi:10.1136/bmj.b2535 · Cited by 83,823
Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & the PRISMA Group* (2009) · Annals of Internal Medicine · doi:10.7326/0003-4819-151-4-200908180-00135 · Cited by 37,554
The Cochrane Collaboration's tool for assessing risk of bias in randomised trials
Higgins, J. P. T., Altman, D. G., Gotzsche, P. C., Juni, P., Moher, D., Oxman, A. D., Savovic, J., Schulz, K. F., Weeks, L., Sterne, J. A. C., et al. (2011) · BMJ · doi:10.1136/bmj.d5928 · Cited by 33,817
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000100 · Cited by 28,164
Self-citationROBINS-I: a tool for assessing risk of bias in non-randomised studies of interventions
Sterne, J. A., Hernán, M. A., Reeves, B. C., Savović, J., Berkman, N. D., Viswanathan, M., Henry, D., Altman, D. G., Ansari, M. T., Boutron, I., et al. (2016) · BMJ · doi:10.1136/bmj.i4919 · Cited by 20,329
Self-citationQUADAS-2: a revised tool for the quality assessment of diagnostic accuracy studies
Whiting, P. F., Rutjes, A. W. S., Westwood, M. E., Mallett, S., Deeks, J. J., Reitsma, J. B., Leeflang, M. M. G., Sterne, J. A. C., Bossuyt, P. M. M., & the QUADAS-2 Group* (2011) · Annals of Internal Medicine · doi:10.7326/0003-4819-155-8-201110180-00009 · Cited by 14,199
Self-citationLiberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · Annals of Internal Medicine · doi:10.7326/0003-4819-151-4-200908180-00136 · Cited by 10,349
Self-citationMeasuring the Accuracy of Diagnostic Systems
Swets, J. A. (1988) · Science · doi:10.1126/science.3287615 · Cited by 10,058
Multiple imputation using chained equations: Issues and guidance for practice
White, I. R., Royston, P., & Wood, A. M. (2011) · Statistics in Medicine · doi:10.1002/sim.4067 · Cited by 9,792
A simulation study of the number of events per variable in logistic regression analysis
Peduzzi, P., Concato, J., Kemper, E., Holford, T. R., & Feinstein, A. R. (1996) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(96)00236-3 · Cited by 9,655
Research works printed but not linked: 2
- 10.1177/0962280218785504.30032705 · doi:10.1177/0962280218785504.30032705
- Wong SS, 2003, AMIA Annu Symp Proc, 728
Cited by
Items 701–800 of 1,003
Ugwu, G. C., Jalali, F., Liu, G., Li, G., Langendijk, J. A., & Alizadeh, B. Z. (2025) · Radiotherapy and Oncology · doi:10.1016/j.radonc.2025.111350 · Cited by 7
Tan, J., Qi, Y., Liu, C., Xiong, Y., He, Q., Zhang, G., Chen, M., He, G., Wang, W., Liu, X., et al. (2019) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2019.07.009 · Cited by 7
Aparcana-Granda, D. J., Ascencio, E. J., & Carrillo-Larco, R. (2022) · BMJ Open · doi:10.1136/bmjopen-2021-058921 · Cited by 6
Frère, C., Crichi, B., Wahl, C., Lesteven, É., Connault, J., Durant, C., Rueda-Camino, J. A., Yannoutsos, A., Bensaoula, O., Maignan, C. L., et al. (2022) · Journal of Clinical Medicine · doi:10.3390/jcm11133729 · Cited by 7
Pommerich, U. M., Stubbs, P. W., Eggertsen, P. P., Fabricius, J., & Nielsen, J. F. (2023) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2023.02.009 · Cited by 8
Pilowsky, J. K., Huben, A. V., Elliott, R. M., & Roche, M. A. (2023) · Australian Critical Care · doi:10.1016/j.aucc.2023.05.002 · Cited by 8
Monahan, A. C., & Feldman, S. S. (2023) · Interactive Journal of Medical Research · doi:10.2196/42016 · Cited by 9
A Hybrid Model for 30-Day Syncope Prognosis Prediction in the Emergency Department
Dipaola, F., Gatti, M., Menè, R., Shiffer, D., Levra, A. G., Solbiati, M., Villa, P., Costantino, G., & Furlan, R. (2023) · Journal of Personalized Medicine · doi:10.3390/jpm14010004 · Cited by 7
“Firstly, the dataset we employed is relatively small with a notably low event-per-variable ratio [35,36].”
MethodSánchez, J., Jaimes, F. A., García, E., Zakzuk, J., Cardona, R., & Velásquez‐Lopera, M. M. (2024) · PLoS ONE · doi:10.1371/journal.pone.0295791 · Cited by 9
Risk Prediction Models for Sarcopenia in Dialysis Patients: A Systematic Review
Leng, Y.-J., Wang, G., Xie, R.-N., Jiang, X., Li, C.-X., Nie, Z., & Li, T. (2024) · Journal of Renal Nutrition · doi:10.1053/j.jrn.2024.05.009 · Cited by 8
den Eynde, R. V., Vrancken, A., Foubert, R., Tuand, K., Vandendriessche, T., Schrijvers, A., Verbrugghe, P., Devos, T., CALSTER, B. V., & Rex, S. (2024) · Transfusion · doi:10.1111/trf.18108 · Cited by 8
Kanavos, T., Birbas, E., & Zanos, T. P. (2024) · Cancers · doi:10.3390/cancers17010069 · Cited by 8
“The judgment on the overall applicability concerns was governed by the same rules [19,20].”
Methodology of the Updated and Expanded Australasian Bronchiolitis Guideline
Loveys, K., Tavender, E. J., Babl, F. E., Cotterell, E., Haskell, L., O’Brien, S., Oakley, E. A., Wilson, C. L., Borland, M. L., & Dalziel, S. R. (2025) · Journal of Paediatrics and Child Health · doi:10.1111/jpc.70145 · Cited by 7
Shin, D. H., Yoo, S., Jun, K. I., Kim, H., Kang, C. K., Song, K., Choe, P. G., Park, W. B., Bang, J. H., Kim, E. S., et al. (2020) · Scientific Reports · doi:10.1038/s41598-020-73098-w · Cited by 8
Chichareon, P., Klaveren, D. V., Modolo, R., Kogame, N., Takahashi, K., Chang, C. C., Tomaniak, M., Yuan, J., Xie, L., Song, Y., et al. (2021) · Catheterization and Cardiovascular Interventions · doi:10.1002/ccd.29490 · Cited by 11
Zhong, J., Si, L., Zhang, G., Huo, J., Xing, Y., Hu, Y., Zhang, H., & Yao, W. (2021) · Systematic Reviews · doi:10.1186/s13643-021-01683-9 · Cited by 11
Bai, Z., Ma, Y., Shi, Z., Li, T., Hu, S., & Shi, B. (2021) · Therapeutics and Clinical Risk Management · doi:10.2147/tcrm.s320533 · Cited by 7
Talakey, A. A., Hughes, F. J., & Bernabé, E. (2022) · Journal Of Clinical Periodontology · doi:10.1111/jcpe.13596 · Cited by 8
Risk prediction models for symptomatic patients with bladder and kidney cancer: a systematic review
Harrison, H., Usher‐Smith, J. A., Li, L., Roberts, L. E., Lin, Z., Thompson, R. E., Rossi, S. H., Stewart, G. D., Walter, F. M., Griffin, S. J., et al. (2021) · Apollo (University of Cambridge) · doi:10.17863/cam.74775 · Cited by 7
Predicting complications of spine surgery: external validation of three models
Coia, M., & Baker, J. F. (2022) · The Spine Journal · doi:10.1016/j.spinee.2022.07.092 · Cited by 8
Veerbeek, J. M., Ottiger, B., Cazzoli, D., Vanbellingen, T., & Nyffeler, T. (2022) · Frontiers in Neurology · doi:10.3389/fneur.2022.999595 · Cited by 9
Accuracy of papillary thyroid cancer prognostic nomograms: a systematic review
Garo, M. L., Deandreis, D., Campennì, A., Vrachimis, A., Ovčariček, P. P., & Giovanella, L. (2023) · Endocrine Connections · doi:10.1530/ec-22-0457 · Cited by 10
Luo, Q., Luo, Y., Cui, T., & Li, T. (2023) · Archives of Sexual Behavior · doi:10.1007/s10508-023-02574-x · Cited by 7
Teo, Z. L., Kwee, A. K., Lim, J. C. W., Lam, C. S. P., Ho, D., Maurer‐Stroh, S., Su, Y., Chesterman, S. A., Chen, T., Tan, C. C., et al. (2023) · Annals of the Academy of Medicine Singapore · doi:10.47102/annals-acadmedsg.2022452 · Cited by 10
Kleuskens, D. G., van Veen, C. M. C., Groenendaal, F., Ganzevoort, W., Gordijn, S. J., van Rijn, B. B., Lely, A. T., Schuit, E., & Kooiman, J. (2023) · Ultrasound in Obstetrics and Gynecology · doi:10.1002/uog.26245 · Cited by 8
“CHARMS was used to extract information on study design, population characteristics, predictors and outcomes assessed by the prediction models, and statistical analysis, including handling of missing data, model-building strategies and model-performance measurements 9,10 .”
BackgroundMethodInfluentialPrognostic value of platelet combined with serum procalcitonin in patients with sepsis
Chen, J., Tu, X., Huang, M., Xie, Y., Lin, Y., & Hu, J. (2023) · Medicine · doi:10.1097/md.0000000000034953 · Cited by 8
“[6,7] Therefore, finding laboratory indicators that can quickly assist in diagnosing sepsis is one of the urgent problems to be solved in critical care medicine.[8,9] Under inflammatory conditions, platelets (PLTs) have a role in promoting coagulation factor activation and cell aggregation, which can lead to host resp…”
BackgroundBoyles, T. H., Stadelman, A., Ellis, J. P., Cresswell, F. V., Lutje, V., Wasserman, S. A., Tiffin, N., & Wilkinson, R. J. (2019) · Wellcome Open Research · doi:10.12688/wellcomeopenres.15056.3 · Cited by 12
Li, J., Chen, Y., Chen, S., Wang, S., Zhang, D., Wang, J., Postmus, D., Zeng, H., Qin, G., Shen, Y., et al. (2020) · medRxiv · doi:10.1101/2020.05.13.20100370 · Cited by 7
van Slobbe, R., Herrmannova, D., Boeke, D. J., Lima-Walton, E. S., Abu-Hanna, A., & Vagliano, I. (2025) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2025.105815 · Cited by 7
Yan, A., Yip, D., Peterson, G. M., Samarawickrema, I., Naunton, M., Newman, P., & Mortazavi, R. (2024) · Cancers · doi:10.3390/cancers16183165 · Cited by 6
“…analysis of 475 patients with 83 VTE events showed the same degree of significance, a low number of events of interest (i.e., less than 100 for external validation) is considered as a bias according to the Prediction model Risk Of Bias ASessment Tool (PROBAST - Version of 15/05/2019) [22].”
BackgroundHunt, A., Law, H., Carney, R., Mulholland, R. E., Flores, A., Smith, C. T., Varese, F., Parker, S., Yung, A. R., & Bonnett, L. J. (2024) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2024.1408738 · Cited by 11
“The tool was informed by a Delphi procedure involving 38 experts and was re fi ned through piloting and enables a focussed and transparent approach to assessing the ROB and applicability of studies that develop, validate, or update prediction models for individualised predictions (40).”
Ebrahimi, R., Rahmani, M., Fallahtafti, P., Raeini, A. G., Azarboo, A., Jalali, A., & Mehrani, M. (2024) · Therapeutic Advances in Cardiovascular Disease · doi:10.1177/17539447241290438 · Cited by 15
“34 Many studies used laboratory data such as neutrophil counts or D-dimer levels, which were not available at the time that the model was intended to be used.”
Xu, Z., Scharp, D., Hobensack, M., Ye, J., Zou, J., Ding, S., Shang, J., & Topaz, M. (2024) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocae278 · Cited by 7
Todd, E., Orr, R., Gamage, E., West, E. C., Jabeen, T., McGuinness, A. J., George, V., Phuong-Nguyen, K., Voglsanger, L. M., Jennings, L., et al. (2024) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2024.109521 · Cited by 6
Nomali, M., Yaseri, M., Nedjat, S., Azizi, F., Mansournia, M. A., Navid, H., Danaei, G., Woodward, M., Fahimfar, N., Steyerberg, E. W., et al. (2025) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2025.111736 · Cited by 7
Efficacy of artificial intelligence in cleft care: A systematic review
Shah, J., Yoon, J., Lowe, K. M., Ko, J., & Oberoi, S. (2025) · Seminars in Orthodontics · doi:10.1053/j.sodo.2025.03.006 · Cited by 7
Chan, W., Lau, S., Mak, A., Yau, C., Fung, C.-F., Hou, H. L.-Y., Kwong, D. L. �., Lee, V. H.-F., & Choi, C. (2025) · Age and Ageing · doi:10.1093/ageing/afaf095 · Cited by 6
Wu, F., Wang, T., Xing, Y., Cai, W., & Zhang, R. (2025) · Nursing in Critical Care · doi:10.1111/nicc.70063 · Cited by 8
“The PROBAST checklist is a tool for critically assessing studies that develop, validate or update personalized risk prediction models [38].”
InfluentialYao, S., Ma, G., Dong, Y., Zhao, M., Chen, L., Qi, W., & Shen, H. (2025) · PLoS ONE · doi:10.1371/journal.pone.0324004 · Cited by 7
Al‐Jabri, M. M., & Anshasi, H. A. (2025) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2025.106008 · Cited by 7
Horvat, C. M., Klug, J., Li, R., Raffa, J. D., Pollard, T., Celi, L. A., Plovock, M., Emanuele, K., Garver, M., Hochheiser, H., et al. (2025) · Critical Care Medicine · doi:10.1097/ccm.0000000000006740 · Cited by 7
Zhang, L., Tian, J., Liu, X., Wang, L., & Yang, L. (2025) · Geriatric Nursing · doi:10.1016/j.gerinurse.2025.103530 · Cited by 7
Bull, C. F., Kisely, S. R., Betts, K. S., & Hu, Y. (2025) · Child Abuse & Neglect · doi:10.1016/j.chiabu.2025.107630 · Cited by 13
Xie, X.-R., Yu, M., Xu, R. H., Liu, Y., & Zhang, J. (2025) · Risk Management and Healthcare Policy · doi:10.2147/rmhp.s542262 · Cited by 8
Shen, W., Peng, J., & Lu, J. (2025) · Academic Radiology · doi:10.1016/j.acra.2025.09.010 · Cited by 8
Liu, X., Bin, C., Gao, Q., Li, M., Xue, L., Zhou, Z., Liu, M., Ji, X., & Wei, S. (2026) · Biomarker Research · doi:10.1186/s40364-026-00914-2 · Cited by 9
Chen, L., Liu, C.-H., Kang, S., Du, L., Ma, F., Li, C., Bai, L., Li, H., & Tang, H. (2022) · BMC Infectious Diseases · doi:10.1186/s12879-022-07113-y · Cited by 7
The promise of artificial intelligence for kidney pathophysiology
Jiang, J. J., Chan, L., & Nadkarni, G. N. (2022) · Current Opinion in Nephrology & Hypertension · doi:10.1097/mnh.0000000000000808 · Cited by 9
When (not) to apply clinical risk prediction models to improve patient care
Lee, A. S. Y., & Moonesinghe, R. (2023) · Anaesthesia · doi:10.1111/anae.15990 · Cited by 6
“The overall risk of bias was rated either unclear or high, mainly due to statistical analysis limitations, but there were no concerns about the applicability of most clinical prediction models using the prediction model risk of bias assessment tool (PROBAST) [12].”
MethodBaciu, M., O'Sullivan, L., Torlay, L., & Banjac, S. (2023) · Revue Neurologique · doi:10.1016/j.neurol.2023.02.067 · Cited by 9
Villiger, R., Méan, M., Stalder, O., Limacher, A., Rodondi, N., Righini, M., & Aujesky, D. (2023) · Journal of Thrombosis and Haemostasis · doi:10.1016/j.jtha.2023.04.025 · Cited by 7
Multivariable Prediction Models for Traumatic Spinal Cord Injury: A Systematic Review
Hakimjavadi, R., Basiratzadeh, S., Wai, E. K., Baddour, N., Kingwell, S. P., Michalowski, W., Stratton, A. C., Tsai, E. C., Viktor, H. L., & Phan, P. (2023) · Topics in Spinal Cord Injury Rehabilitation · doi:10.46292/sci23-00010 · Cited by 7
Levis, B., Snell, K. I. E., Damen, J. A., Hattle, M., Ensor, J., Dhiman, P., Navarro, C. L. A., Takwoingi, Y., Whiting, P. F., Debray, T. P. A., et al. (2023) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2023.10.022 · Cited by 6
Self-citationOdrobina, I. (2024) · Diagnostics · doi:10.3390/diagnostics14040443 · Cited by 9
“Another initiative emerged and developed the “Prediction model Risk Of Bias Assessment Tool” or PROBAST tool [46,47].”
Yao, Y., Fu, Y. H. H., Zhou, G., Wang, X., Li, L., Mao, Y., Wang, J., Tan, Z., Jiang, M., Yi, X., et al. (2024) · Quantitative Imaging in Medicine and Surgery · doi:10.21037/qims-23-1148 · Cited by 7
Davis, S., Pandor, A., Sampson, F. C., Hamilton, J., Nelson‐Piercy, C., Hunt, B. J., Daru, J., Goodacre, S. W., Carser, R., Rooney, G., et al. (2024) · Health Technology Assessment · doi:10.3310/dfwt3873 · Cited by 12
Nopour, R. (2024) · Health Informatics Journal · doi:10.1177/14604582241285794 · Cited by 8
“27”
Sufriyana, H., Chen, C., Chiu, H., Sumazin, P., Yang, P., Kang, J., & Su, E. C. (2024) · American Journal of Infection Control · doi:10.1016/j.ajic.2024.10.027 · Cited by 6
Abou-Foul, A. K., Dretzke, J., Albon, E., Kristunas, C., Moore, D., Karwath, A., Gkoutos, G. V., Mehanna, H. M., & Nankivell, P. (2024) · Frontiers in Oncology · doi:10.3389/fonc.2024.1478385 · Cited by 10
Cong, X., Song, S., Li, Y., Song, K., MacLeod, C., Cheng, Y., Lv, J., Yu, C., Sun, D., Pei, P., et al. (2024) · BMC Medicine · doi:10.1186/s12916-024-03754-9 · Cited by 8
Alemu, M., Alemu, S. M., Bagheri, N., Wangdi, K., & Chateau, D. G. (2025) · Open Heart · doi:10.1136/openhrt-2024-003147 · Cited by 8
“We included HRs because they directly quantify the impact of each predictor on individual CVD risk, providing clinically relevant insights beyond c-statistics.”
Hu, H., Li, J., Ge, H., Wu, B., Feng, T., Wu, X., & Wu, X. (2025) · Nursing in Critical Care · doi:10.1111/nicc.13306 · Cited by 9
“22 It includes four domains (20 questions totally): participants, predictors, outcome and analysis.”
Gomes, D., Lambiase, P. D., SCHILLING, R. J., Cappato, R., Adragão, P., & Providencia, R. A. (2025) · EP Europace · doi:10.1093/europace/euaf091 · Cited by 6
“17 Major arrhythmic events prediction in BrS AI-derived models, in the work Lee et al. , 26 only the external validation of existing risk scores was considered.”
Ön, B. I., Reeve, K. A., Havla, J. B., Burns, J., Gosteli, M., Lutterotti, A., Schippling, S., Mansmann, U., & Held, U. (2020) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd013606 · Cited by 6
Golpe, R., Esteban, C., Figueira-GonÇalves, J. M., Diago, C. A. A., Cid, N. B., Arámburu, A., García‐Talavera, I., Cristeto, M., & Acosta-Sorensen, M. (2020) · Pulmonology · doi:10.1016/j.pulmoe.2020.10.008 · Cited by 7
Vale, L. D., Kunonga, P., Coughlan, D., Kontogiannis, V., Astin, M., Beyer, F. R., Richmond, C., Wilson, D., Bajwa, D. S., Javanbakht, M., et al. (2021) · Health Technology Assessment · doi:10.3310/hta25640 · Cited by 7
Youssef, A., van der Hoorn, M., Lith, J. M. M. V., van EEKELEN, R., du Fossé, N. A., & Lashley, L. E. E. L. O. (2022) · F&S Reviews · doi:10.1016/j.xfnr.2022.02.002 · Cited by 6
Barreto, P. G. D. S., Rezende, R. B., Santos, A. L., Silva, F. D. O., Bezerra, V. R., Freire, E. C., & do Brasil, P. E. A. A. (2022) · British Journal of Clinical Pharmacology · doi:10.1111/bcp.15312 · Cited by 6
Chang, W., Naylor, J., Natarajan, P., Menounos, S., Monuja, M., & Adie, S. (2022) · Systematic Reviews · doi:10.1186/s13643-022-02039-7 · Cited by 7
Liu, X., Tao, L., Wang, M., Li, H., & Xu, W. (2022) · Clinical Breast Cancer · doi:10.1016/j.clbc.2022.10.010 · Cited by 10
Zuo, W., Lin, J., Sun, R., Su, Y., & Ma, G. (2022) · Annals of Medicine · doi:10.1080/07853890.2022.2141466 · Cited by 7
“Applicability was categorized as a high, unclear, or low concern, which suggested the agreement between included studies and review question [17].”
BackgroundChen, J. W., Heidsma, C. M., Engelsman, A. F., Kabaktepe, E., van Dieren, S., Falconi, M., Besselink, M. G., & van Dijkum, E. J. M. N. (2023) · Cancers · doi:10.3390/cancers15051525 · Cited by 8
“should be chosen based on their relationship to the predicted outcome and not solely on the basis of their statistical significance [59].”
Backgrounddos Santos, A. L., Pinhati, C. C., Perdigão, J., Galante, S. C., Silva, L., Veloso, I. Y., Silva, A. C. S. E., & OLIVEIRA, E. A. (2024) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2024.102824 · Cited by 9
Aoyama, M., Miyashita, M., Masukawa, K., Morita, T., Kizawa, Y., Tsuneto, S., Shima, Y., & Akechi, T. (2021) · Psycho-Oncology · doi:10.1002/pon.5630 · Cited by 6
Prevalence of multimorbidity and its impact on survival in people with motor neuron disease
Glasmacher, S. A., Kearns, P. K. A., Larraz, J., Stirland, L., Mehta, A. R., Newton, J. L., Weir, C. J., Chandran, S., & Pal, S. (2021) · European Journal of Neurology · doi:10.1111/ene.14940 · Cited by 6
Xu, J., Guo, Y., Wang, F., Xu, H., Lucero, R., Bian, J., & Prosperi, M. (2022) · BMJ Open · doi:10.1136/bmjopen-2021-059715 · Cited by 6
Cárdenas-Fuentes, G., de Basea, M. B., Cobo, I., Subirana, I., Ceresa, M., Famada, E., Gimeno‐Santos, E., Delgado‐Ortiz, L., Faner, R., Molina‐Molina, M., et al. (2023) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2023.04.011 · Cited by 6
“, demographic, clinical, and laboratory results) to estimate the probability of developing a future clinical event [5].”
BackgroundAndrew, B. Y., Habib, A. S., & Taicher, B. M. (2023) · Anesthesia & Analgesia · doi:10.1213/ane.0000000000006543 · Cited by 7
“15,16 Furthermore, the addition of new risk factors to such an approach, as is recommended in the consensus guidelines, represents the creation of an entirely unvalidated risk assessment model with unknown performance characteristics.”
BackgroundTimbrook, T. T., & Fowler, M. J. (2023) · Antibiotics · doi:10.3390/antibiotics12091452 · Cited by 8
Wang, J., Yuan, T., Ling, X., Li, Q., Tang, X., Cai, W., Zou, H., & Li, L. (2020) · Diagnostic and Prognostic Research · doi:10.1186/s41512-020-00088-x · Cited by 6
Taylor, M., Martin, G. P., Abah, U. D., Sperrin, M., Smith, M. O., Bhullar, D., Shackcloth, M. J., Woolley, S., West, D., Shah, R. D., et al. (2021) · Interactive Cardiovascular and Thoracic Surgery · doi:10.1093/icvts/ivab200 · Cited by 10
Prediction Models for Post‐Stroke Hospital Readmission: A Systematic Review
Mao, Y., Liu, Q., Fan, H., Li, E., He, W., Ouyang, X., Wang, X., Qiu, L., & Dong, H. (2024) · Public Health Nursing · doi:10.1111/phn.13441 · Cited by 5
Zhong, Y., Cao, S., Chen, L., Li, T., & Ye, W. (2025) · BMC Nephrology · doi:10.1186/s12882-025-03990-y · Cited by 7
“According to PROBAST [15], the sample size for model development studies should be determined based on the number of events per variable (EPV).”
InfluentialWang, Y., Shi, Y., Li, W., Rong, W., Du, Y., Duan, Y., & Peng, L.-L. (2025) · World Journal of Surgical Oncology · doi:10.1186/s12957-025-03726-0 · Cited by 5
“The prediction model risk of bias assessment tool (PRO-BAST) [13], which was independently completed by two researchers who had received evidence-based training in oncology care, was used to evaluate the bias risk and applicability of the included studies.”
InfluentialDehghan, S., Moghaddasi, H., Rabiei, R., Choobineh, H., Maghooli, K., & Vahidi-Asl, M. (2025) · Journal of Education and Health Promotion · doi:10.4103/jehp.jehp_1798_23 · Cited by 10
“[18] It was created to give an organized and transparent technique for assessing the methodological quality of prediction model investigations.”
Tieliwaerdi, X., Manalo, K., Abuduweili, A., Khan, S., Appiah‐Kubi, E., Williams, B. A., & Oehler, A. C. (2025) · Journal of Cardiopulmonary Rehabilitation and Prevention · doi:10.1097/hcr.0000000000000943 · Cited by 8
Xie, R., Le, S., Pei, J., Shi, Y., Tang, M., Sun, X., Deng, G., & Zhao, H. (2025) · Geriatric Nursing · doi:10.1016/j.gerinurse.2025.03.059 · Cited by 9
Alem, A. Z., Mohanty, I., Pati, N. K., & Niyonsenga, T. (2025) · Blood Reviews · doi:10.1016/j.blre.2025.101325 · Cited by 7
Shapiro, D. D., Abel, E. J., Albiges, L. K., Battle, D. J., Berg, S. A., Campbell, M. T., Cella, D. F., Coleman, K., Garmezy, B., Geynisman, D. M., et al. (2025) · Urologic Oncology Seminars and Original Investigations · doi:10.1016/j.urolonc.2025.07.020 · Cited by 5
Mao, Y., Liu, Q., Fan, H., He, W., Zhang, C., Ouyang, X., Li, E., Wang, X., Qiu, L., & Dong, H. (2025) · PLoS ONE · doi:10.1371/journal.pone.0332378 · Cited by 5
Salama, V., Godinich, B. M., Lilly, P. M., Pifer, P. M., Duckworth, A. L., Hall, S. J., Alabboodi, M. J., Siochi, R. A., Clump, D. A., & Emadi, A. (2025) · Cancers · doi:10.3390/cancers17183025 · Cited by 6
“The risk of bias was assessed using the Prediction model Risk of Bias Assessment Tool (PROBAST), which examines four domains (participants, predictors, outcomes, and analysis) through 20 methodological questions to determine the overall risk of bias (checklist in Supplementary File S3) [25–29].”
Kenny, R. P. W., Bhattarai, N., O’Connor, N., Gonzalez-Moral, S. G., O’Keefe, H., Hosseini-Jebeli, S., Meader, N., & Rice, S. J. C. (2025) · Health Technology Assessment · doi:10.3310/ppoh2916 · Cited by 7
A systematic review of prediction models for risk of breast cancer
Re, F., Manaboriboon, N., Raza, I. G. A., Shipley, A., Thompson, L., Tiplady, C., Blum, M., Blum, G., Mucheke, R., Abhari, R. E., et al. (2025) · BMC Cancer · doi:10.1186/s12885-025-14990-4 · Cited by 9
“The Prediction Model Risk Of Bias Assessment Tool (PROBAST) was used to assess the risk of bias and applicability of models [15].”
Lee, A., Chan, M. K., Narayanan, D., Staudenmayer, K., Nassar, A. K., Forrester, J. D., Knowlton, L. M., & Hameed, S. M. (2025) · The Journal of Trauma: Injury, Infection, and Critical Care · doi:10.1097/ta.0000000000004805 · Cited by 7
Zeng, X. G., Chen, X. J., Lai, P., Chen, J., Chen, Z., & Qi, X. (2025) · Frontiers in Medicine · doi:10.3389/fmed.2025.1695394 · Cited by 7
Prediction models and risk scores in different types of heart failure: a review
Wei, Y., Liu, S., Mu, Y., Liang, X., Chen, Z., Liu, Y., & Dong, G. (2025) · Frontiers in Medicine · doi:10.3389/fmed.2025.1652307 · Cited by 7
Predicting Spinal Cord Injury Prognosis Using Machine Learning: Systematic Review and Meta-Analysis
Zhong, L., Huang, Q., Zhang, H., Xue, L., Chen, Y., Wu, J., & Wei, L. (2025) · JMIR AI · doi:10.2196/66233 · Cited by 10
Zhang, X., Chen, Q., Liu, Y., Li, J., Nie, L., Miao, Q., Fu, F., Lyu, T., Tan, Z., Kong, Y., et al. (2026) · JAMA Network Open · doi:10.1001/jamanetworkopen.2025.55454 · Cited by 9
Hourani, A., Jakubowska, Z., & Małyszko, J. (2026) · Journal of Clinical Medicine · doi:10.3390/jcm15031191 · Cited by 6
Karahan, M., Özdemir, E., & Kına, S. (2026) · Aging Clinical and Experimental Research · doi:10.1007/s40520-026-03345-z · Cited by 5
“Furthermore, the reliance on routine preoperative laboratory values enhances the model’s pragmatic feasibility, requiring no additional testing beyond standard hip fracture workup and thus minimizing implementation barriers in resource-constrained settings [44 ].”
Metadata
- Authors
- Moons, K. G. M., Wolff, R. F., Riley, R. D., Whiting, P. F., Westwood, M., Collins, G. S., Reitsma, J. B., Kleijnen, J., & Mallett, S.
- Affiliations
- Utrecht University (NL)
- Kleijnen Systematic Reviews (United Kingdom) (GB)
- Keele University (GB)
- University Hospitals Bristol NHS Foundation Trust (GB)
- Centre for Statistics in Medicine, University of Oxford, Oxford, United Kingdom (G.S.C.)
- Maastricht University (NL)
- Institute of Applied Health Research, National Institute for Health Research Birmingham Biomedical Research Centre, College of Medical and Dental Sciences, University of Birmingham, Birmingham, United Kingdom (S.M.)
- ORCID
- Venue
- Annals of Internal Medicine
- Publisher
- American College of Physicians
- Published
- 2019-01-01
- Volume
- 170
- Issue
- 1
- Pages
- W1-W33
- ISSN
- 0003-4819 (ISSN-L)
- 1539-3704
- OpenAlex
- W2907638671
- Cited by
- 1,669
- References
- 201
- Citations by year
- 2026: 359 · 2025: 330 · 2024: 253 · 2023: 236 · 2022: 193 · 2021: 175 · 2020: 96 · 2019: 24
- FWCI
- 56.12
- Type
- journal article
- Language
- en
- Open access
- Licence
- other-oa
- www.acpjournals.org/journal/aim/text-and-data-mining (tdm)
- Locations
- Annals of Internal Medicine (publishedVersion)
- PubMed (publishedVersion)
- Research Publications (Maastricht University) (publishedVersion, other-oa)
- Utrecht University Repository (Utrecht University) (publishedVersion, other-oa)
- University of Birmingham Research Portal (University of Birmingham) (publishedVersion)
- Bristol Research (University of Bristol) (publishedVersion, other-oa)
- Keele Research Repository (Keele University) (submittedVersion, cc-by)
- UCL Discovery (University College London) (submittedVersion)
- University of Birmingham Research Portal (University of Birmingham) (submittedVersion)
- Explore Bristol Research (submittedVersion, other-oa)
- Research Publications (Maastricht University) (submittedVersion)
- Utrecht University Repository (Utrecht University) (submittedVersion, other-oa)
- Funders
- National Institute for Health Research Birmingham Biomedical Research Centre at the University Hospitals Birmingham NHS Foundation Trust
- Nederlandse Organisatie voor Wetenschappelijk Onderzoek (ZONMW 918.10.615, ZONMW 912.08.004)
- National Institute for Health Research School for Primary Care Research (390)
- National Institute for Health Research Biomedical Research Centre, Oxford
- National Institute for Health Research (NIHR) Collaboration for Leadership in Applied Health Research and Care (CLAHRC) West at University Hospitals Bristol NHS Foundation Trust
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Clinical practice guidelines implementation
- Keywords
- PROBAST, risk of bias assessment, applicability, prediction model, diagnostic model, prognostic model, model validation
- MeSH terms
- Systematic Reviews as Topic, Decision Support Techniques, Diagnosis, Humans, Prognosis, Research Design, Models, Statistical, Bias
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A second model labelled each claim on 2026-10-01 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.