PROBAST: A Tool to Assess Risk of Bias and Applicability of Prediction Model Studies: Explanation and Elaboration
Open accessThe DOI matches its Crossref record; 194 of the 201 references it cites were found in a registry or an index.
Abstract
Prediction models in health care use predictors to estimate for an individual the probability that a condition or disease is already present (diagnostic model) or will occur in the future (prognostic model). Publications on prediction models have become more common in recent years, and competing prediction models frequently exist for the same outcome or target population. Health care providers, guideline developers, and policymakers are often unsure which model to use or recommend, and in which persons or settings. Hence, systematic reviews of these studies are increasingly demanded, required, and performed. A key part of a systematic review of prediction models is examination of risk of bias and applicability to the intended population and setting. To help reviewers with this process, the authors developed PROBAST (Prediction model Risk Of Bias ASsessment Tool) for studies developing, validating, or updating (for example, extending) prediction models, both diagnostic and prognostic. PROBAST was developed through a consensus process involving a group of experts in the field. It includes 20 signaling questions across 4 domains (participants, predictors, outcome, and analysis). This explanation and elaboration document describes the rationale for including each domain and signaling question and guides researchers, reviewers, readers, and guideline developers in how to use them to assess risk of bias and applicability concerns. All concepts are illustrated with published examples across different topics. The latest version of the PROBAST checklist, accompanying documents, and filled-in examples can be downloaded from www.probast.org.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The text we found for this paper looks like another document, so the self-check wasn’t run.
Citations
Cites
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: the PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & for the PRISMA Group (2009) · BMJ · doi:10.1136/bmj.b2535 · Cited by 83,823
Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & the PRISMA Group* (2009) · Annals of Internal Medicine · doi:10.7326/0003-4819-151-4-200908180-00135 · Cited by 37,554
The Cochrane Collaboration's tool for assessing risk of bias in randomised trials
Higgins, J. P. T., Altman, D. G., Gotzsche, P. C., Juni, P., Moher, D., Oxman, A. D., Savovic, J., Schulz, K. F., Weeks, L., Sterne, J. A. C., et al. (2011) · BMJ · doi:10.1136/bmj.d5928 · Cited by 33,817
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000100 · Cited by 28,164
Self-citationROBINS-I: a tool for assessing risk of bias in non-randomised studies of interventions
Sterne, J. A., Hernán, M. A., Reeves, B. C., Savović, J., Berkman, N. D., Viswanathan, M., Henry, D., Altman, D. G., Ansari, M. T., Boutron, I., et al. (2016) · BMJ · doi:10.1136/bmj.i4919 · Cited by 20,329
Self-citationQUADAS-2: a revised tool for the quality assessment of diagnostic accuracy studies
Whiting, P. F., Rutjes, A. W. S., Westwood, M. E., Mallett, S., Deeks, J. J., Reitsma, J. B., Leeflang, M. M. G., Sterne, J. A. C., Bossuyt, P. M. M., & the QUADAS-2 Group* (2011) · Annals of Internal Medicine · doi:10.7326/0003-4819-155-8-201110180-00009 · Cited by 14,199
Self-citationLiberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · Annals of Internal Medicine · doi:10.7326/0003-4819-151-4-200908180-00136 · Cited by 10,349
Self-citationMeasuring the Accuracy of Diagnostic Systems
Swets, J. A. (1988) · Science · doi:10.1126/science.3287615 · Cited by 10,058
Multiple imputation using chained equations: Issues and guidance for practice
White, I. R., Royston, P., & Wood, A. M. (2011) · Statistics in Medicine · doi:10.1002/sim.4067 · Cited by 9,792
A simulation study of the number of events per variable in logistic regression analysis
Peduzzi, P., Concato, J., Kemper, E., Holford, T. R., & Feinstein, A. R. (1996) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(96)00236-3 · Cited by 9,655
Research works printed but not linked: 2
- 10.1177/0962280218785504.30032705 · doi:10.1177/0962280218785504.30032705
- Wong SS, 2003, AMIA Annu Symp Proc, 728
Cited by
Items 901–1,000 of 1,003
Role of artificial intelligence in virtual emergency care: a protocol for a systematic review
Shankar, R., Wang, L., Ho, S. H., Liew, M. F., Gollamudi, S. P. K., & Wong, S. (2025) · BMJ Open · doi:10.1136/bmjopen-2025-103084 · Cited by 5
Diagnostic and prognostic factors in patients with prostate cancer: a systematic review protocol
Beyer, K., Moris, L., Lardas, M., Haire, A., Barletta, F. M., Scuderi, S., Vradi, E., Gandaglia, G., Omar, M. I., MacLennan, S., et al. (2021) · BMJ Open · doi:10.1136/bmjopen-2020-040531 · Cited by 4
Zhao, X., Liao, K., Wang, W., Xu, J., & Meng, L. (2021) · Perioperative Medicine · doi:10.1186/s13741-021-00178-4 · Cited by 6
Bottle, A., Newson, R. B., Faitna, P., Hayhoe, B. W. J., & Cowie, M. (2022) · ESC Heart Failure · doi:10.1002/ehf2.14250 · Cited by 4
“applied the PROBAST tool to critically review each study’s participant, predictor, outcome, and analysis selection.(12,15) Their commonest concerns were a risk of overfitting and no or limited validation.”
MethodPickering, J. W. (2023) · Revista Española de Cardiología (English Edition) · doi:10.1016/j.rec.2023.02.009 · Cited by 5
Wang, C., Liu, S., Tang, Y., Yang, H., & Liu, J. (2023) · Journal of Medical Internet Research · doi:10.2196/46340 · Cited by 9
“However, QUADAS-2 cannot be evaluated against predictive models for diagnosis or prognosis [22], and to refine this, we further introduced the PROBAST (Prediction Model Risk of Bias Assessment Tool) [23], which is well suited to address DL predictive models for binary outcomes [24].”
Kong, J., & Zhang, D.-F. (2024) · Frontiers in Neurology · doi:10.3389/fneur.2023.1335851 · Cited by 6
Machine Learning and Vision: Advancing the Frontiers of Diabetic Cataract Management
Mohammad, N. K., Rajab, I. A., Al-Taie, R. H., & Ismail, M. (2024) · Cureus · doi:10.7759/cureus.66600 · Cited by 7
Iwakami, N., Nagai, T., Furukawa, T. A., Tajika, A., Ōnishi, A., Nishimura, K., Ogata, S., Nakai, M., Takegami, M., Nakano, H., et al. (2020) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2020.01.011 · Cited by 4
Ogero, M. O., Sarguta, R. J., Malla, L., Aluvaala, J., Agweyu, A., & Akech, S. (2020) · Wellcome Open Research · doi:10.12688/wellcomeopenres.15955.1 · Cited by 4
Zuo, W., Zhang, R., Yang, M., Ji, Z., He, Y., Su, Y., Qu, Y., Tao, Z., & Ma, G. (2021) · Quantitative Imaging in Medicine and Surgery · doi:10.21037/qims-20-1274 · Cited by 4
Eslami, S., & Ganjali, R. (2021) · Frontiers in Health Informatics · doi:10.30699/fhi.v10i1.272 · Cited by 5
Mehta, H. B., Wang, L., Malagaris, I., Duan, Y., Rosman, L. M., & Alexander, G. C. (2021) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2021.03.029 · Cited by 5
Jabbari, M., Barati, M., Kalhori, A., Eini‐Zinab, H., Zayeri, F., Poustchi, H., Pourshams, A., Hekmatdoost, A., & Malekzadeh, R. (2024) · Nutrition Metabolism and Cardiovascular Diseases · doi:10.1016/j.numecd.2024.10.008 · Cited by 5
Risk prediction models for incident heart failure: a systematic review and meta-analysis
Navarro, J. A., Doumouras, B. S., Douglas, W. A., Tieu, P., Chan, V., Lau, T. H. A., Bobrowski, D., Yu, C., Wang, C. (., Adam, M., et al. (2024) · Heart · doi:10.1093/eurheartj/ehae666.889 · Cited by 4
Du, Q., Shao, X., Zhang, M., & Cao, G. (2025) · Digital Health · doi:10.1177/20552076241311939 · Cited by 3
Wang, S., Shi, M., Zhou, X. L., Yu, J., Han, M., Zhang, X., Li, Z., & Chen, X. (2025) · BMC Musculoskeletal Disorders · doi:10.1186/s12891-025-08338-z · Cited by 4
“The Prediction Model Risk of Bias Assessment Tool (PROBAST) [14] was utilized to evaluate the quality of risk models.”
A systematic review of natural language processing applications in Trauma & Orthopaedics
Farrow, L., Raja, A., Zhong, M., & Anderson, L. A. (2025) · Bone & Joint Open · doi:10.1302/2633-1462.63.bjo-2024-0081.r1 · Cited by 3
van Dijk, D. A., Stoel, N. G., Meijer, R. J., Repko, R. J. E., van den Boogaard, T. M., Ruhé, H. G., Spijker, J., & Peeters, F. P. M. L. (2025) · Journal of Affective Disorders · doi:10.1016/j.jad.2025.04.050 · Cited by 5
Chase, P. J., Owen, C. M., Bantham, A., Stoutenberg, M., Ajibewa, T. A., Barclay, J., Huang, M. R., Kariuki, J. K., McNamara, G., Stoner, L. R., et al. (2025) · Translational Journal of the American College of Sports Medicine · doi:10.1249/tjx.0000000000000313 · Cited by 7
“…bias assessment was completed using three different tools, including the Cochran Risk of Bias Tool for Randomized Trials (12), the Prediction Model of Risk of Bias Assessment Tool for modeling studies (13), and the Risk of Bias in Non-Randomized Studies of Interventions for the cohort study (14).”
Shang, J., Xue, K., Yang, C., Shi, H., Pan, L., & Zeng, Y. (2025) · Journal of Nursing Care Quality · doi:10.1097/ncq.0000000000000897 · Cited by 3
Risk prediction models for heart failure after myocardial infarction: A systematic review
Shang, H., Wang, J., Cong, Y., Chen, H., Cui, Y., & Guo, J. (2025) · Medicine · doi:10.1097/md.0000000000043480 · Cited by 5
“The included studies were evaluated for risk of bias by 2 researchers using the PROBAST [11] (Predictive Risk of Bias Modeling Risk Assessment Tool) checklist, and when the results were inconsistent, they could be discussed and resolved with the rest of the team.”
A scoping review of models for predicting the risk of postherpetic neuralgia
Zhang, L., Qu, N., Li, T., Duan, L., & Cui, L. (2025) · Frontiers in Medicine · doi:10.3389/fmed.2025.1653680 · Cited by 3
Mao, Y., Fan, H., He, W., Ouyang, X., Wang, X., & Li, E. (2025) · Reviews in Cardiovascular Medicine · doi:10.31083/rcm39409 · Cited by 4
“Previous reviews have either narrowly focused on specific models [30] or lacked rigorous quality appraisal using contemporary tools such as Prediction model Risk Of Bias ASsessment Tool (PROBAST) [31].”
Duan, M., Li, M., He, L., Dai, S., Zhou, L., Liu, Z., Yang, J., Chen, L., Liu, X., & Wu, Z. (2025) · BMC Gastroenterology · doi:10.1186/s12876-025-04342-8 · Cited by 3
“Using two techniques, namely the Grading of Recommendations Assessment, Development and Evaluation (GRADE) [10] and the Prediction model Risk Of Bias Assessment Tool (PROBAST) [11], we were able to detect the quality and potential bias risk of the included research.”
Machine learning surgery duration predictions compared to traditional methods: A systematic review
Park, R. T., Stucky, C. H., & Moser, C. H. (2025) · Perioperative Care and Operating Room Management · doi:10.1016/j.pcorm.2025.100581 · Cited by 4
Predicting the Risk of Stillbirth for Small Infants Using Maternal and Pregnancy Characteristics
Triggs, T., Crawford, K., Flenady, V., & Kumar, S. (2025) · Paediatric and Perinatal Epidemiology · doi:10.1111/ppe.70097 · Cited by 3
“Candidate predictors were selected based on clinical relevance and their known association with stillbirth (Table 1) [18–21].”
Predictive Performance of Raman Spectroscopy in Osteoarthritis: A Systematic Review
Yesmean, M., Shakya, B. R., Mannerkorpi, M., Saarakkala, S. S., & Jansson, M. M. (2025) · Journal of Medical Systems · doi:10.1007/s10916-025-02304-x · Cited by 4
“However, to ensure consistent and transparent assessment, and to avoid publication bias, we applied a single validated framework, the PROBAST tool [34], and reported these studies to capture all available evidence along with their shortcomings [36].”
Tayfur, A., Gülle, H., Delen, M., Zenner, D., Miller, S., Screen, H. R. C., & Morrissey, D. (2025) · Sports Medicine - Open · doi:10.1186/s40798-025-00940-8 · Cited by 3
“PROBAST (Prediction model Risk Of Bias ASsessment Tool) [9, 10] guided the approach to minimise risk of bias and improve applicability.”
Chen, H., Wang, Y., Huang, X., Pu, L., Zhang, S., Li, Q., Zhang, X., Li, Y., Wang, G., & Hu, X. (2025) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2025.105310 · Cited by 3
Risk prediction models for delirium in ICU patients: a systematic review and critical appraisal
Chen, W., Ding, L., Sha, Y., Lü, G., Qian, K., Wang, B., & Wang, H. (2025) · BMC Anesthesiology · doi:10.1186/s12871-025-03562-5 · Cited by 6
“…quality of the included studies was evaluated independently by two reviewers with the Prediction Model Risk of Bias Assessment Tool (PROBAST) [18, 19], which evaluates four domains: participant selection, predictors, outcome assessment, and statistical analysis (e.g., handling of missing…”
InfluentialAraújo, A. L. D., Kowalski, L. P., Santos‐Silva, A. R., Louredo, B. V. R., Saldivia‐Siracusa, C., de Melo, O. A. A. M., Cabral, D., Pelaz, A. C., Guntinas-Lichius, O., de Bree, R., et al. (2025) · Diagnostics · doi:10.3390/diagnostics16010068 · Cited by 3
“Each study was assessed independently by two authors (A.L.D.A. and L.P.K.) through the Prediction model Risk of Bias Assessment Tool (PROBAST) for assessing the RoB and applicability of diagnostic and prognostic prediction model studies [27,28].”
Wang, X., Meng, S., Xiao, X., Liu, L., Chen, H., Li, Y., Zhang, R., Jiang, Q., Liu, S., & Gao, R. (2026) · Journal of Medical Internet Research · doi:10.2196/84617 · Cited by 3
“Two reviewers independently used PROBAST [35] to appraise the risk of bias and the applicability of each included study.”
Zhu, H., Li, F., Guo, S., Xiao, Y., Zhu, W., & Wang, Q. (2026) · Frontiers in Medicine · doi:10.3389/fmed.2025.1699717 · Cited by 4
Kotsyubynska, Y. Z., Kozan, N. M., Chadiuk, V. O., Kostyshyn, А. В., Kotsyubynsky, A. O., & Fentsyk, V. (2026) · Journal of Road Safety · doi:10.33492/jrs-d-26-1-2721386 · Cited by 3
Zheng, X., Zhao, M., Yang, Z., Kang, L., Li, R., Gao, Y., Zhang, G., & Lai, X. (2026) · Frontiers in Neurology · doi:10.3389/fneur.2026.1737871 · Cited by 3
Development of living evidence-informed guidelines, part 4
Verdugo‐Paiva, F., Urquhart, O., Bhosale, A. S., Martins-Pfeifer, C. C., Glick, M., & Carrasco‐Labra, A. (2026) · The Journal of the American Dental Association · doi:10.1016/j.adaj.2025.09.011 · Cited by 11
Hassan, N., Slight, R. D., Morgan, G., Weiand, D., Vellinga, A., Fekry, H., Gallier, S., Sapey, E., & Slight, S. P. (2026) · International Journal of Antimicrobial Agents · doi:10.1016/j.ijantimicag.2026.107768 · Cited by 5
Mou, C., Yan, X., Miao, X., & Zhu, L. (2026) · Frontiers in Public Health · doi:10.3389/fpubh.2026.1778750 · Cited by 6
Maestre-Muñiz, M. M., Arias, Á., & Lucendo, A. J. (2022) · Biomedicines · doi:10.3390/biomedicines10102414 · Cited by 3
Zahra, A., Luijken, K., Abbink, E. J., van den Berg, J. M., Blom, M. T., Elders, P. J. M., Festen, J., Gussekloo, J., Joling, K. J., Melis, R. J. F., et al. (2023) · Diagnostic and Prognostic Research · doi:10.1186/s41512-023-00144-2 · Cited by 5
“org) [11, 12], a quality or risk of a bias assessment tool for prediction model studies.”
MethodSelf-citationKortlever, T. L., de Klaver, W., Vlugt, M. V., Meijer, G. A., Dekker, E., & Bossuyt, P. M. (2023) · Expert Review of Molecular Diagnostics · doi:10.1080/14737159.2023.2279607 · Cited by 3
“Of the 29 included publications, 26 reported on model development and/or validation and were assessed using PROBAST [7].”
BackgroundMethodPan, Z.-M., & Charoenkwan, K. (2024) · Diagnostics · doi:10.3390/diagnostics14182018 · Cited by 3
“The two authors independently evaluated the risk of bias of each model reported in the included studies using the prediction model risk of bias assessment tool (PROBAST) [25,26].”
MethodPostoperative recurrence prediction model for atrial fibrillation: a meta-analysis
Chen, C.-F., & Guo, Y. (2024) · American Journal of Translational Research · doi:10.62347/ijep7120 · Cited by 3
Risk factors for intraoperative hypothermia in patients receiving lung transplants
Huang, J., Miao, Y., Shen, X., Hou, C., Zhang, L., & Zhang, Z. (2024) · Journal of Thoracic Disease · doi:10.21037/jtd-24-777 · Cited by 3
“The risk prediction model estimates the possible risks of the outcome by inferring the quantitative relationship between various risk factors and the probability of occurrence of the outcome, thus informing the development of preventive strategies (10).”
Damen, J. A., Arshi, B., van Smeden, M., Bertagnolio, S., Diaz, J. V., Silva, R., Thwin, S. S., Wynants, L., & Moons, K. G. M. (2024) · Diagnostic and Prognostic Research · doi:10.1186/s41512-024-00181-5 · Cited by 4
Self-citationTait, J., Kellett, S., & Delgadillo, J. (2025) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2025.103003 · Cited by 4
Tonde, B., Traore, M. M., Landa, P., Côté, A., & Laberge, M. (2025) · BMJ Open · doi:10.1136/bmjopen-2024-093771 · Cited by 4
“The risk of bias will be assessed using the Prediction model Risk Of Bias Assessment Tool (PROBAST), 33 34 which is specifically designed for systematic reviews of diagnostic prediction models (online supplemental appendix 3).”
Li, X., Li, Y., Zhu, Z., Tan, B., Zhou, X., Shi, H., Li, X., Zhu, P., & Xu, Y. (2025) · Journal of Medical Internet Research · doi:10.2196/71257 · Cited by 3
“In this study, we rigorously assessed and minimized the risk of bias in accordance with the Prediction model Risk of Bias Assessment Tool [42].”
Yebyo, H. G., Günthard, H. F., Rehfuess, E. A., Serra, N., Haile, S. R., Senn, O., Lucas, G. M., Langselius, O., Thorne, J. E., Marconi, V. C., et al. (2025) · BMJ Medicine · doi:10.1136/bmjmed-2024-001132 · Cited by 4
Dasari, H., Hammache, M., Deveaux-Cattino, B., Foroutan, F., Hales, L., Bourgeois, S., Keepanasseril, A., Nerenberg, K. A., Grandi, S. M., D'Souza, R. D., et al. (2025) · BMJ Open · doi:10.1136/bmjopen-2024-094550 · Cited by 5
“27 28 This dual approach ensures that the methodological quality of both prognostic factor and model studies is rigorously assessed, allowing for a comprehensive and reliable synthesis of the evidence.”
Patel, J. S., & Karanth, D. (2025) · Orthodontics and Craniofacial Research · doi:10.1111/ocr.12944 · Cited by 5
“The study followed the Prediction model Risk of Bias Assessment Tool (PROBAST [21]) to evaluate and minimise potential biases in the development and validation of predictive models.”
Kwok, H. C. K., Falconer, F. R. M., Vandal, A. C., Hill, A. G., & MacCormick, A. D. (2025) · World Journal of Surgery · doi:10.1002/wjs.12684 · Cited by 3
“Two investigators (HK and AM) evaluated the methodologies of the included studies for risk of bias and applicability using PROBAST, which covers 4 domains: selection of participants, predictors of assessment, outcomes of assessment, and analysis [16, 17].”
Chen, J., Zhong, X., Zhai, Y., Zhao, C., Lan, J., Chen, L., & Xia, Z. (2025) · BMC Musculoskeletal Disorders · doi:10.1186/s12891-025-09164-z · Cited by 4
“Each item was answered with the following responses: “yes,” “probably yes,” “no,” “probably no,” or an indication of “no information” [19].”
InfluentialBarreñada, L., Ledger, A., Kotlarz, A., Dhiman, P., Collins, G. S., Wynants, L., Verbakel, J. Y. J., Valentin, L., Timmerman, D., & CALSTER, B. V. (2025) · BMJ Open · doi:10.1136/bmjopen-2025-104141 · Cited by 6
Alizade, R., Safarian, S., Geramifar, P., Parouhan, A., & Mirhosseini, F. (2025) · InfoScience Trends · doi:10.61882/ist.202502.09.02 · Cited by 3
Edwards, S. J., Barton, S., Bacelar, M., Karner, C., Cain, P., Wakefield, V., & Marceniuk, G. (2021) · Health Technology Assessment · doi:10.3310/hta25230 · Cited by 3
Huang, A. W., Haslberger, M., Coulibaly, N., Galárraga, O., Oganisian, A., Belbasis, L., & Panagiotou, O. A. (2022) · Diagnostic and Prognostic Research · doi:10.1186/s41512-022-00119-9 · Cited by 7
Hafermann, L., Klein, N., Rauch, G., Kammer, M., & Heinze, G. (2022) · Entropy · doi:10.3390/e24060847 · Cited by 5
Prosepe, I., Groenwold, R. H. H., Knevel, R., Pajouheshnia, R., & van Geloven, N. (2022) · Frontiers in Epidemiology · doi:10.3389/fepid.2022.899589 · Cited by 5
Living systematic review: Ferramentas para garantir a sua qualidade
de Pinho, I. G., Moresi, E. A. D., & Costa, A. P. (2022) · New Trends in Qualitative Research · doi:10.36367/ntqr.14.2022.e713 · Cited by 4
Current issues in medical epistemology and statistics: a view from the frontline of medicine
Park, J. H. (2022) · Synthese · doi:10.1007/s11229-022-03765-0 · Cited by 4
Smit, L. C. M., Bots, M. L., van der Leeuw, J., Damen, J. A., Blankestijn, P. J., Verhaar, M. C., & Vernooij, R. W. M. (2023) · Cardiorenal Medicine · doi:10.1159/000529791 · Cited by 3
“Studies reporting on the development or external validation of prediction models, tools, or scores were further assessed on risk of bias and applicability on participants, predictors, outcomes, and analyses, using the Prediction model Risk Of Bias ASsessment Tool (PROBAST) [39, 40].”
MethodZhang, X., Zhou, K., You, L., Zhang, J., Chen, Y., Dai, H., Wan, S., Guan, Z., Hu, M., Kang, J., et al. (2023) · PLoS ONE · doi:10.1371/journal.pone.0283307 · Cited by 5
Knauer, R., & Rodner, E. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-42608-7_10 · Cited by 3
“There is a need for feature selection procedures that can find the best subset among all possible subsets for moderate (sub)set sizes, while taking into account the cost to collect predictors in practice [23,39], such as the limited amount of time for measuring them [16,45].”
BackgroundDissanayake, A. S., Ho, K. M., Phillips, T. J., Honeybul, S., & Hankey, G. J. (2023) · Journal of Clinical Neuroscience · doi:10.1016/j.jocn.2023.10.020 · Cited by 3
The application of time-to-event analysis in machine learning prognostic models
Peng, Z.-H., Huang, Z., Tian, J., Chong, T., & Li, Z.-L. (2024) · Journal of Translational Medicine · doi:10.1186/s12967-024-04909-1 · Cited by 3
Lawlor, A., Lin, C., Rivas, J. G., Ibáñez, L., Abad-López, P., Willemse, P.-P. M., Omar, M. I., Remmers, S., Cornford, P. A., Rajwa, P., et al. (2024) · European Urology Open Science · doi:10.1016/j.euros.2024.03.012 · Cited by 3
“Both groups received a guidance document to assist with the process [21], and questions were discussed with the groups by a reviewer (K.B.).”
BackgroundMethodTutorial: dos and don’ts in clinical prediction research for venous thromboembolism
Nemeth, B., Smeets, M. J. R., Cannegieter, S. C., & van Smeden, M. (2024) · Research and Practice in Thrombosis and Haemostasis · doi:10.1016/j.rpth.2024.102480 · Cited by 3
“In addition, the recently published Prediction model Risk Of Bias ASsessment Tool (PROBAST) was designed to assess the risk of bias and applicability of prediction model studies [17].”
MethodKang, J. H.-E., Levine, E. H., Fleet, A., Padilla, M. S., Lee, J. K., Harrison, H., & Usher‐Smith, J. A. (2024) · Journal of Gastroenterology and Hepatology · doi:10.1111/jgh.16682 · Cited by 4
“14 PROBAST, a quality assessment tool for risk prediction models, 13 was used to perform a robust risk of bias assessment for each model and identify methodological limitations in included studies.”
Prediction Models for Mortality in Patients With Moderate to Severe ARDS Treated in the ICU
Daenen, K., Stoof, S. C. M., van Willigen, H. D. G., Boyd, A. C., Dalm, V. A. S. H., Gommers, D. A. M. P. J., Gorp, E. C. M. V., Valkenburg, A. J., Endeman, H., & Huijben, J. A. (2025) · CHEST Critical Care · doi:10.1016/j.chstcc.2025.100132 · Cited by 6
Sun, C., Lin, Y.-H., Ling, G.-X., Gao, H., Feng, X., & Sun, C.-Q. (2025) · World Journal of Diabetes · doi:10.4239/wjd.v16.i4.101310 · Cited by 3
Gao, J., Yao, Y., Xue, J., Chen, R., Yang, X., Xu, J., & Cheng, W. (2025) · BMC Pregnancy and Childbirth · doi:10.1186/s12884-025-07727-5 · Cited by 5
“Of them, item 4.9 “Do the predictors and their assigned weights in the final model correspond to the results from the reported multivariable analysis?” did not apply to ML, which is also part of regression analysis [14].”
InfluentialChen, K., Qu, Y., Han, Y. R., Li, Y., Gao, H., & Zheng, D. (2025) · Journal of Medical Internet Research · doi:10.2196/73528 · Cited by 5
“Many studies struggle to meet these stringent criteria, leading to a higher risk of bias in the statistical analysis [89].”
Systematic review of prognostic models in Parkinson’s disease
Li, Y., McDonald-Webb, M., McLernon, D. J., Counsell, C. E., & Macleod, A. D. (2025) · npj Parkinson s Disease · doi:10.1038/s41531-025-01112-x · Cited by 4
“The recommended method for handling missing data when data are missing at random is multiple imputation 32 .”
InfluentialZackula, R., & Raghuveer, T. S. (2020) · Journal of Perinatology · doi:10.1038/s41372-020-00876-9 · Cited by 3
Nikolakopoulos, I., Nourabadi, S., Eldredge, J. B., Anand, L., Zhang, M., Qiu, M., Rosenberg, D., & Spyropoulos, A. C. (2020) · Journal of Thrombosis and Thrombolysis · doi:10.1007/s11239-020-02191-8 · Cited by 3
Sex as a Prognostic Factor in Systematic Reviews: Challenges and Lessons Learned
Stallings, E., Antequera, A., López‐Alcalde, J., García-Martín, M., Urrútia, G., & Zamora, J. (2021) · Journal of Personalized Medicine · doi:10.3390/jpm11060441 · Cited by 3
Ul-Mulk, Z., & Antoniou, G. A. (2022) · BMJ Open · doi:10.1136/bmjopen-2022-061420 · Cited by 3
Sufriyana, H., Wu, Y., & Su, E. C. (2021) · medRxiv · doi:10.1101/2021.06.16.21258884 · Cited by 3
Systematic human learning by literature and data mining for feature selection in machine learningPreprint
Sufriyana, H., Wu, Y., & Su, E. C. (2021) · Research Square · doi:10.21203/rs.3.pex-1634/v1 · Cited by 3
Zhang, H., Wang, A. Y., Wu, S., Ngo, J., Feng, Y., He, X., Zhang, Y., Wu, X., & Hong, D. (2022) · Research Square · doi:10.21203/rs.3.rs-1209770/v1 · Cited by 3
Abdulazeem, H. M., Whitelaw, S., Schauberger, G., & Klug, S. J. (2022) · medRxiv · doi:10.1101/2022.08.25.22279229 · Cited by 3
Resampled dimensional reduction for feature representation in machine learningPreprint
Sufriyana, H., Wu, Y., & Su, E. C. (2023) · Research Square · doi:10.21203/rs.3.pex-1636/v2 · Cited by 3
He, T. T., Jiao, T. Q., & An, X. M. (2026) · PeerJ · doi:10.7717/peerj.20770 · Cited by 2
Hu, Y., Lu, H. S., Zhang, J., Ren, L., & Yang, M. (2023) · Interdisciplinary Nursing Research · doi:10.1097/nr9.0000000000000012 · Cited by 2
Lafeber, G., van der Endt, V. H. W., Louwers, Y. V., le Cessie, S., van der Hoorn, M., & Lashley, E. E. L. O. (2024) · BMJ Open · doi:10.1136/bmjopen-2023-079394 · Cited by 3
“34 The PROBAST is developed as a general tool for critical appraisal of prediction model studies and consists of 4 domains (participants, predictors, outcome and analysis) containing 20 signalling questions to minimise risk of bias.”
BackgroundMethodJing, C.-Y., Zhang, L., Feng, L., Li, J., Liang, L., Hu, J., & Liao, X. (2024) · Frontiers in Cardiovascular Medicine · doi:10.3389/fcvm.2024.1449058 · Cited by 3
Systematic Review of Studies Investigating Hospital Readmissions in Pediatric Oncology
Hassan, H., Chen, Y., Lu, A. D., Arciniegas, S. E., Yan, A. P., Guo, L. L., & Sung, L. (2024) · Pediatric Blood & Cancer · doi:10.1002/pbc.31459 · Cited by 4
“Methods for appraising the quality of included studies were undertaken using the Newcastle–Ottawa quality assessment tool for retrospective/cohort studies and PROBAST tool for prediction models studies [8, 9].”
Wang, B., Li, D., Geng, Y., Jin, F., Wang, Y., Lv, C., Lv, T., Xue, Y., & Zhang, P. (2024) · European Heart Journal - Digital Health · doi:10.1093/ehjdh/ztae100 · Cited by 2
“19 This reliance may lead to either over or undersmoothing of essential data points.”
The reporting quality and methodological quality of dynamic prediction models for cancer prognosis
Yan, P., Xu, Z., Xu, H., Chu, X., Chen, Y., Yang, C., Xu, S., Cui, H., Zhang, L., Zhang, W., et al. (2025) · BMC Medical Research Methodology · doi:10.1186/s12874-025-02516-2 · Cited by 4
Diomatari, C., Martin, G. P., Jenkins, D. A., & Jani, M. (2025) · Seminars in Arthritis and Rheumatism · doi:10.1016/j.semarthrit.2025.152728 · Cited by 2
Zhang, H., Chen, T., Chen, N., & Liu, L. (2025) · Angiology · doi:10.1177/00033197251326394 · Cited by 3
Naufal, E. R., Shadbolt, C., Wouthuyzen‐Bakker, M., Rele, S., Sahebjada, S., Thuraisingam, S., Babazadeh, S., Choong, P., & Dowsey, M. M. (2025) · Journal of Hospital Infection · doi:10.1016/j.jhin.2025.04.035 · Cited by 2
Chen, H., Wang, J., Zhang, Y. L., Zhao, W., Han, M., Zhang, J., & Li, J. (2025) · International Journal of Orthopaedic and Trauma Nursing · doi:10.1016/j.ijotn.2025.101196 · Cited by 2
A Point-of-Care Prediction Tool for Recurrent Tuberculosis
Cox, S. R., Moe, A. H., Gupte, A., Kadam, A. B., Valawalkar, S., Gupte, N., Lele, G., Kendall, E. A., Baillie, C., Barthwal, M. S., et al. (2025) · Clinical Infectious Diseases · doi:10.1093/cid/ciaf353 · Cited by 2
Lu, Z., Yang, L., Li, J., Wang, J., Wu, W., Fu, L., Wang, B., Tian, T., Zhang, H., Peng, Z., et al. (2025) · BMJ Open · doi:10.1136/bmjopen-2024-092248 · Cited by 2
Exercise Classification in Resistance Training: A Systematic Review of Technological Approaches
Brennan, T. R., Weakley, J. J. S., Johnston, R. D., & Creaby, M. W. (2025) · Sports Medicine · doi:10.1007/s40279-025-02281-8 · Cited by 2
“Further, the PROBAST tool was originally designed for assessment of diagnostic and prognostics models of medical conditions, and elements of the tool are depended upon detailed reporting of model predictors and analysis [18].”
Takada, T., Tambaş, M., Clementel, E., Leeuwenberg, A., Sharabiani, M., Damen, J. A., Dunias, Z. S., Nauta, J. F., Idema, D. L., Choi, J., et al. (2025) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd014745.pub2 · Cited by 9
Self-citationJia, Y., Pei, Z., Zhang, X., Zhang, C., & Kang, X. (2025) · Frontiers in Cardiovascular Medicine · doi:10.3389/fcvm.2025.1616003 · Cited by 3
Metadata
- Authors
- Moons, K. G. M., Wolff, R. F., Riley, R. D., Whiting, P. F., Westwood, M., Collins, G. S., Reitsma, J. B., Kleijnen, J., & Mallett, S.
- Affiliations
- Utrecht University (NL)
- Kleijnen Systematic Reviews (United Kingdom) (GB)
- Keele University (GB)
- University Hospitals Bristol NHS Foundation Trust (GB)
- Centre for Statistics in Medicine, University of Oxford, Oxford, United Kingdom (G.S.C.)
- Maastricht University (NL)
- Institute of Applied Health Research, National Institute for Health Research Birmingham Biomedical Research Centre, College of Medical and Dental Sciences, University of Birmingham, Birmingham, United Kingdom (S.M.)
- ORCID
- Venue
- Annals of Internal Medicine
- Publisher
- American College of Physicians
- Published
- 2019-01-01
- Volume
- 170
- Issue
- 1
- Pages
- W1-W33
- ISSN
- 0003-4819 (ISSN-L)
- 1539-3704
- OpenAlex
- W2907638671
- Cited by
- 1,669
- References
- 201
- Citations by year
- 2026: 359 · 2025: 330 · 2024: 253 · 2023: 236 · 2022: 193 · 2021: 175 · 2020: 96 · 2019: 24
- FWCI
- 56.12
- Type
- journal article
- Language
- en
- Open access
- Licence
- other-oa
- www.acpjournals.org/journal/aim/text-and-data-mining (tdm)
- Locations
- Annals of Internal Medicine (publishedVersion)
- PubMed (publishedVersion)
- Research Publications (Maastricht University) (publishedVersion, other-oa)
- Utrecht University Repository (Utrecht University) (publishedVersion, other-oa)
- University of Birmingham Research Portal (University of Birmingham) (publishedVersion)
- Bristol Research (University of Bristol) (publishedVersion, other-oa)
- Keele Research Repository (Keele University) (submittedVersion, cc-by)
- UCL Discovery (University College London) (submittedVersion)
- University of Birmingham Research Portal (University of Birmingham) (submittedVersion)
- Explore Bristol Research (submittedVersion, other-oa)
- Research Publications (Maastricht University) (submittedVersion)
- Utrecht University Repository (Utrecht University) (submittedVersion, other-oa)
- Funders
- National Institute for Health Research Birmingham Biomedical Research Centre at the University Hospitals Birmingham NHS Foundation Trust
- Nederlandse Organisatie voor Wetenschappelijk Onderzoek (ZONMW 918.10.615, ZONMW 912.08.004)
- National Institute for Health Research School for Primary Care Research (390)
- National Institute for Health Research Biomedical Research Centre, Oxford
- National Institute for Health Research (NIHR) Collaboration for Leadership in Applied Health Research and Care (CLAHRC) West at University Hospitals Bristol NHS Foundation Trust
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Clinical practice guidelines implementation
- Keywords
- PROBAST, risk of bias assessment, applicability, prediction model, diagnostic model, prognostic model, model validation
- MeSH terms
- Systematic Reviews as Topic, Decision Support Techniques, Diagnosis, Humans, Prognosis, Research Design, Models, Statistical, Bias
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A second model labelled each claim on 2026-10-01 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.