Transparent Reporting of a multivariable prediction model for Individual Prognosis Or Diagnosis (TRIPOD): Explanation and Elaboration
Open accessThe DOI matches its Crossref record; 538 of the 538 references it cites were found in a registry or an index.
Abstract
The TRIPOD (Transparent Reporting of a multivariable prediction model for Individual Prognosis Or Diagnosis) Statement includes a 22-item checklist, which aims to improve the reporting of studies developing, validating, or updating a prediction model, whether for diagnostic or prognostic purposes. The TRIPOD Statement aims to improve the transparency of the reporting of a prediction model study regardless of the study methods used. This explanation and elaboration document describes the rationale; clarifies the meaning of each item; and discusses why transparent reporting is important, with a view to assessing risk of bias and clinical usefulness of the prediction model. Each checklist item of the TRIPOD Statement is explained in detail and accompanied by published examples of good reporting. The document also provides a valuable reference of issues to consider when designing, conducting, and analyzing prediction model studies. To aid the editorial process and help peer reviewers and, ultimately, readers and systematic reviewers of prediction model studies, it is recommended that authors include a completed checklist in their submission. The TRIPOD checklist can also be downloaded from www.tripod-statement.org.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The TRIPOD (Transparent Reporting of a multivariable prediction model for Individual Prognosis or Diagnosis) guidelines were used when composing this manuscript [11].”
From The External Validation of a Multivariable Prediction Model for Recurrent Pelvic Organ Prolapse After Native Tissue Repair: A Prospective Cohort Study (2025) · cites this paper as [11]
In the citing paper
“Initial evaluation criteria were based on reporting standards from the Transparent Reporting of a multivariable prediction model for Individual Prognosis or Diagnosis (TRIPOD) checklist 14 and informed by learnings from 3 to 4 algorithm reviews over a 6-month period.”
In the citing paper
“This retrospective study was conducted in accordance with the TRIPOD (Transparent Reporting of a multivariable prediction model for Individual Prognosis or Diagnosis) guidelines [16].”
From Early prediction of bloodstream infections in ICU patients using machine learning methods based on routine laboratory parameters (2025) · cites this paper as [16]
In the citing paper
“The reporting of studies evaluating the incremental value of specific predictors, beyond established predictors or even beyond existing prediction models (18,42), also fits entirely within the remit of TRIPOD”
From Transparent Reporting of a multivariable prediction model for Individual Prognosis Or Diagnosis (TRIPOD): The TRIPOD Statement (2015) · cites this paper as [42]
In the citing paper
“In addition, because many such studies are methodologically weak, we also summarize the qualities of good (and the limitations of less good) studies, regardless of reporting [43].”
From Transparent reporting of a multivariable prediction model for individual prognosis or diagnosis (TRIPOD): the TRIPOD Statement (2015) · cites this paper as [43]
1 more claim about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: the PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & for the PRISMA Group (2009) · BMJ · doi:10.1136/bmj.b2535 · Cited by 83,823
Self-citationPreferred reporting items for systematic reviews and meta-analyses: the PRISMA Statement.
(2009) · PubMed Central · Cited by 44,859
Self-citationPreferred reporting items for systematic reviews and meta-analyses: The PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & the PRISMA Group* (2009) · Annals of Internal Medicine · doi:10.7326/0003-4819-151-4-200908180-00135 · Cited by 37,554
Self-citation(1990) · Choice Reviews Online · doi:10.5860/choice.27-3338 · Cited by 35,305
The Elements of Statistical Learning
Hastie, T., Tibshirani, R., & Friedman, J. (2009) · Springer Series in Statistics · doi:10.1007/978-0-387-84858-7 · Cited by 25,970
DeLong, E. R., DeLong, D. M., & Clarke-Pearson, D. L. (1988) · Biometrics · doi:10.2307/2531595 · Cited by 22,649
Multiple Imputation for Nonresponse in Surveys
Rubin, D. B. (1987) · Wiley Series in Probability and Statistics · doi:10.1002/9780470316696 · Cited by 20,701
Statistical Analysis With Missing Data
Lahiff, M., Little, R. J. A., & Rubin, D. B. (1989) · Journal of the American Statistical Association · doi:10.2307/2289883 · Cited by 17,265
CONSORT 2010 Statement: updated guidelines for reporting parallel group randomised trials
the CONSORT Group, Schulz, K. F., Altman, D. G., & Moher, D. (2010) · BMC Medicine · doi:10.1186/1741-7015-8-18 · Cited by 13,371
Self-citation
Research works printed but not linked: 22
- Moons KG, 2012, External validation, model updating, and impact assessment. Heart, 98, 691
- Kulik DM, 2013, A systematic review of clinical prediction rules for children with acute abdominal pain. J Clin Epidemiol, 66, 95
- Kulik DM, 2013, A systematic review of clinical prediction rules for children with suspected bacterial meningitis. J Emerg Med, 45, 508
- Maguire JL, 2009, A systematic review of clinical prediction rules. Pediatrics, 124, e145
- Warnell I, 2014, Br J Anaesth
- Silverberg N, 2014, J Neurotrauma
- Delebarre M, 2014, Results of a systematic review and analysis. Pediatr Blood Cancer, 61, 1786
- Wong SS, 2003, AMIA Annu Symp Proc, 728
- Debray TP, 2014, J Clin Epidemiol
- 10.1016/S0002-9343(89)80689-8 · doi:10.1016/s0002-9343(89)80689-8 · Paper page
- Rutjes AW, 2007, Health Technol Assess, ix
- Peduzzi P, 1995, II. Accuracy and precision of regression estimates. J Clin Epidemiol, 48, 1503
- Van Calster B, 2014, Med Decis Making
- Baker SG, 2012, Discov Med, 14, 181
- Collins GS, 2013, Primary Care Cardiovascular Journal, 6, 125
- Ioannidis JP, 2014, Potential implications of the new cardiovascular guidelines. JAMA, 311, 463
- Ioannidis JP, 2010, The evidence applied to coronary artery calcium score. JAMA, 303, 1646
- Council for International Organizations of Medical Sciences., 2002, Bull Med Ethics, 182, 17
- Canadian CT Head and C-Spine (CCC) Study Group, 2002, CMAJ, 4, 185
- Simera I, 2013, J Pak Med Assoc, 63, 283
- Crowson CS, 2014, Stat Methods Med Res
- Bertolini G, 2000, J Epidemiol Biostat, 5, 251
Cited by
Collins, G. S., Moons, K. G. M., Dhiman, P., Riley, R. D., Beam, A. L., Van Calster, B., Ghassemi, M., Liu, X., Reitsma, J. B., van Smeden, M., et al. (2024) · BMJ · doi:10.1136/bmj-2023-078378 · Cited by 4,718
“19 20 The 2015 explanation and elaboration document remains an important document to provide background and examples for most of the TRIPOD+AI reporting items 17 (because many items have not changed or have been minimally changed), while we produce a detailed and updated document for TRIPOD+AI.”
BackgroundSelf-citationCollins, G. S., Reitsma, J. B., Altman, D. G., & Moons, K. G. M. (2015) · BMJ · doi:10.1136/bmj.g7594 · Cited by 4,388
“In addition to the TRIPOD Statement, we produced a supporting explanation and elaboration document (43) in a similar style to those for other reporting guidelines (47–49).”
InfluentialSelf-citationCollins, G. S., Reitsma, J. B., Altman, D. G., & Moons, K. G. M. (2015) · British Journal of Cancer · doi:10.1038/bjc.2014.639 · Cited by 3,293
“In addition, because many such studies are methodologically weak, we also summarise the qualities of good (and the limitations of less good) studies, regardless of reporting (Moons et al, 2015).”
InfluentialSelf-citationCollins, G. S., Reitsma, J. B., Altman, D. G., & Moons, K. G. M. (2015) · Annals of Internal Medicine · doi:10.7326/m14-0697 · Cited by 3,267
“The reporting of these studies fits entirely within the remit of TRIPOD (see accompanying explanation and elaboration document [43]).”
BackgroundMethodInfluentialSelf-citationWynants, L., Van Calster, B., Bonten, M. M., Collins, G. S., Debray, T. P., De Vos, M., Haller, M. C., Heinze, G., Moons, K. G., Riley, R. D., et al. (2020) · doi:10.1101/2020.03.24.20041020 · Cited by 3,070
Self-citationPROBAST: A Tool to Assess the Risk of Bias and Applicability of Prediction Model Studies
Wolff, R. F., Moons, K. G. M., Riley, R. D., Whiting, P. F., Westwood, M., Collins, G. S., Reitsma, J. B., Kleijnen, J., Mallett, S., & for the PROBAST Group† (2019) · Annals of Internal Medicine · doi:10.7326/m18-1376 · Cited by 2,984
“A multivariable prediction model is defined as any combination or equation of two or more predictors for estimating the probability or risk for an individual.(7, 8, 33-35)”
InfluentialSelf-citationCalculating the sample size required for developing a clinical prediction model
Riley, R. D., Ensor, J., Snell, K. I. E., Harrell, F. E., Martin, G. P., Reitsma, J. B., Moons, K. G. M., Collins, G., & van Smeden, M. (2020) · BMJ · doi:10.1136/bmj.m441 · Cited by 2,917
Self-citationCalibration: the Achilles heel of predictive analytics
On behalf of Topic Group ‘Evaluating diagnostic tests and prediction models’ of the STRATOS initiative, Van Calster, B., McLernon, D. J., van Smeden, M., Wynants, L., & Steyerberg, E. W. (2019) · BMC Medicine · doi:10.1186/s12916-019-1466-7 · Cited by 2,650
“Reporting on calibration performance is recommended by the TRIPOD (Transparent Reporting of a multivariable prediction model for Individual Prognosis Or Diagnosis) guidelines for prediction modeling studies [12].”
BackgroundMethodSelf-citationWang, X., & Cheng, Z. (2020) · CHEST · doi:10.1016/j.chest.2020.03.012 · Cited by 2,214
“Note that diagnostic models are different from prognostic models in cohort studies, which are usually longitudinal.(20) Variable selection is vital in the process of model building.”
MethodCollins, G. S., Reitsma, J. B., Altman, D. G., & Moons, K. (2015) · BMC Medicine · doi:10.1186/s12916-014-0241-z · Cited by 1,927
Self-citationHuang, Y.-Q., Liang, C.-H., He, L., Tian, J., Liang, C.-S., Chen, X., Ma, Z.-L., & Liu, Z.-Y. (2016) · Journal of Clinical Oncology · doi:10.1200/jco.2015.65.9128 · Cited by 1,765
Moons, K. G. M., Wolff, R. F., Riley, R. D., Whiting, P. F., Westwood, M., Collins, G. S., Reitsma, J. B., Kleijnen, J., & Mallett, S. (2019) · Annals of Internal Medicine · doi:10.7326/m18-1377 · Cited by 1,669
Self-citationArtificial Intelligence in Dentistry: Chances and Challenges
Schwendicke, F., Samek, W., & Krois, J. (2020) · Journal of Dental Research · doi:10.1177/0022034520915714 · Cited by 1,446
“…and established in evidence-based medicine and dentistry; reporting the development and validation of any AI solution along the TRIPOD criteria (Moons et al. 2015); guarantying equitability and non-discrimination; retaining the responsibility with the healthcare professional, who in return…”
MethodRiley, R. D., Snell, K. I., Ensor, J., Burke, D. L., Harrell Jr, F. E., Moons, K. G., & Collins, G. S. (2019) · Statistics in Medicine · doi:10.1002/sim.7992 · Cited by 1,409
Self-citationReporting and Interpreting Decision Curve Analysis: A Guide for Investigators
Van Calster, B., Wynants, L., Verbeek, J. F. M., Verbakel, J. Y., Christodoulou, E., Vickers, A. J., Roobol, M. J., & Steyerberg, E. W. (2018) · European Urology · doi:10.1016/j.eururo.2018.08.038 · Cited by 1,271
“Importantly, evaluating NB is recommended by the TRIPOD guidelines for prediction models [18].”
MethodSelf-citationPrediction models need appropriate internal, internal-external, and external validation
Steyerberg, E. W., & Harrell, F. E. (2016) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2015.04.005 · Cited by 1,304
Self-citationCosta, F., van Klaveren, D., James, S., Heg, D., Räber, L., Feres, F., Pilgrim, T., Hong, M.-K., Kim, H.-S., Colombo, A., et al. (2017) · The Lancet · doi:10.1016/s0140-6736(17)30397-5 · Cited by 1,184
Self-citationNagendran, M., Chen, Y., Lovejoy, C. A., Gordon, A. C., Komorowski, M., Harvey, H., Topol, E. J., Ioannidis, J. P. A., Collins, G. S., & Maruthappu, M. (2020) · BMJ · doi:10.1136/bmj.m689 · Cited by 1,152
Self-citationKnight, S. R., Ho, A., Pius, R., Buchan, I., Carson, G., Drake, T. M., Dunning, J., Fairfield, C. J., Gamble, C., Green, C. A., et al. (2020) · BMJ · doi:10.1136/bmj.m3339 · Cited by 1,029
STARD 2015: An Updated List of Essential Items for Reporting Diagnostic Accuracy Studies
Bossuyt, P. M., Reitsma, J. B., Bruns, D. E., Gatsonis, C. A., Glasziou, P. P., Irwig, L., Lijmer, J. G., Moher, D., Rennie, D., de Vet, H. C. W., et al. (2015) · Clinical Chemistry · doi:10.1373/clinchem.2015.246280 · Cited by 984
Self-citationGoldstein, B. A., Navar, A. M., Pencina, M. J., & Ioannidis, J. P. A. (2017) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocw042 · Cited by 936
Self-citationPrediction models for cardiovascular disease risk in the general population: systematic review
Damen, J. A. A. G., Hooft, L., Schuit, E., Debray, T. P. A., Collins, G. S., Tzoulaki, I., Lassale, C. M., Siontis, G. C. M., Chiocchia, V., Roberts, C., et al. (2016) · BMJ · doi:10.1136/bmj.i2416 · Cited by 935
Self-citationCollins, G. S., Reitsma, J. B., Altman, D. G., & Moons, K. G. M. (2015) · British Journal of Surgery · doi:10.1002/bjs.9736 · Cited by 889
Self-citationExternal validation of prognostic models: what, why, how, when and where?
Ramspek, C. L., Jager, K. J., Dekker, F. W., Zoccali, C., & van Diepen, M. (2021) · Clinical Kidney Journal · doi:10.1093/ckj/sfaa188 · Cited by 887
“For researchers planning an external validation study we highly recommend consulting the Transparent Reporting of a multivariable prediction model for Individual Prognosis Or Diagnosis checklist and explanation and elaboration document [4].”
BackgroundMethodCollins, G. S., Dhiman, P., Andaur Navarro, C. L., Ma, J., Hooft, L., Reitsma, J. B., Logullo, P., Beam, A. L., Peng, L., Van Calster, B., et al. (2021) · BMJ Open · doi:10.1136/bmjopen-2020-048008 · Cited by 852
Self-citationNewsome, P. N., Sasso, M., Deeks, J. J., Paredes, A., Boursier, J., Chan, W.-K., Yilmaz, Y., Czernichow, S., Zheng, M.-H., Wong, V. W.-S., et al. (2020) · The Lancet Gastroenterology & Hepatology · doi:10.1016/s2468-1253(19)30383-8 · Cited by 800
Sample size for binary logistic prediction models: Beyond events per variable criteria
van Smeden, M., Moons, K. G., de Groot, J. A., Collins, G. S., Altman, D. G., Eijkemans, M. J., & Reitsma, J. B. (2019) · Statistical Methods in Medical Research · doi:10.1177/0962280218784726 · Cited by 791
“This minimal sample size criterion has also generally been accepted as a methodological quality item in appraising published prediction modeling studies.(2,14,16) However, some authors have expressed concerns that that the EPV 10 rule-of-thumb is not based on convincing scientific reasoning.”
BackgroundMethodSelf-citationEvaluation of clinical prediction models (part 1): from development to external validation
Collins, G. S., Dhiman, P., Ma, J., Schlussel, M. M., Archer, L., Van Calster, B., Harrell, F. E., Martin, G. P., Moons, K. G. M., van Smeden, M., et al. (2024) · BMJ · doi:10.1136/bmj-2023-074819 · Cited by 798
Self-citationCollins, G. S., Reitsma, J. B., Altman, D. G., & Moons, K. G. M. (2015) · Circulation · doi:10.1161/circulationaha.114.014508 · Cited by 793
“In addition to the TRIPOD Statement, we produced a supporting explanation and elaboration document (43) in a similar style to those for other reporting guidelines (47–49).”
InfluentialSelf-citationA guide to systematic review and meta-analysis of prognostic factor studies
Riley, R. D., Moons, K. G. M., Snell, K. I. E., Ensor, J., Hooft, L., Altman, D. G., Hayden, J., Collins, G. S., & Debray, T. P. A. (2019) · BMJ · doi:10.1136/bmj.k4597 · Cited by 742
Self-citationHuang, Y., Liu, Z., He, L., Chen, X., Pan, D., Ma, Z., Liang, C., Tian, J., & Liang, C. (2016) · Radiology · doi:10.1148/radiol.2016152234 · Cited by 743
Reporting of artificial intelligence prediction models
Collins, G. S., & Moons, K. G. M. (2019) · The Lancet · doi:10.1016/s0140-6736(19)30037-6 · Cited by 701
Self-citationYang, X., Li, J., Hu, D., Chen, J., Li, Y., Huang, J., Liu, X., Liu, F., Cao, J., Shen, C., et al. (2016) · Circulation · doi:10.1161/circulationaha.116.022367 · Cited by 669
Matics, T. J., & Sanchez-Pinto, L. N. (2017) · JAMA Pediatrics · doi:10.1001/jamapediatrics.2017.2352 · Cited by 664
Collins, G. S., Ogundimu, E. O., & Altman, D. G. (2016) · Statistics in Medicine · doi:10.1002/sim.6787 · Cited by 665
“When validating a prognostic model, investigators should clearly explain how they determined their study size, so that their findings can be placed in context [17,18].”
BackgroundSelf-citationA guide to systematic review and meta-analysis of prediction model performance
Debray, T. P. A., Damen, J. A. A. G., Snell, K. I. E., Ensor, J., Hooft, L., Reitsma, J. B., Riley, R. D., & Moons, K. G. M. (2017) · BMJ · doi:10.1136/bmj.i6460 · Cited by 657
“Furthermore, the Transparent Reporting of a multivariable prediction model for Individual Prognosis Or Diagnosis (TRIPOD) statement [23,43] provides several recommendations for the reporting of studies developing, validating, or updating a prediction model, and may be considered here as well.”
BackgroundMethodInfluentialSelf-citationA deep learning-based radiomics model for prediction of survival in glioblastoma multiforme
Lao, J., Chen, Y., Li, Z.-C., Li, Q., Zhang, J., Liu, J., & Zhai, G. (2017) · Scientific Reports · doi:10.1038/s41598-017-10649-8 · Cited by 630
No rationale for 1 variable per 10 events criterion for binary logistic regression analysis
van Smeden, M., de Groot, J. A. H., Moons, K. G. M., Collins, G. S., Altman, D. G., Eijkemans, M. J. C., & Reitsma, J. B. (2016) · BMC Medical Research Methodology · doi:10.1186/s12874-016-0267-3 · Cited by 595
Self-citationRiley, R. D., Ensor, J., Snell, K. I. E., Debray, T. P. A., Altman, D. G., Moons, K. G. M., & Collins, G. S. (2016) · BMJ · doi:10.1136/bmj.i3140 · Cited by 585
“The recent TRIPOD guideline 34 35 also indicates that a model’s predictive performance should be evaluated in relation to key variables, such as age or sex subgroups, rather than just across all individuals combined, which can mask any deficiencies in the model.”
BackgroundMethodSelf-citationKönig, I. R., Fuchs, O., Hansen, G., von Mutius, E., & Kopp, M. V. (2017) · European Respiratory Journal · doi:10.1183/13993003.00391-2017 · Cited by 572
Vollmer, S., Mateen, B. A., Bohner, G., Király, F. J., Ghani, R., Jonsson, P., Cumbers, S., Jonas, A., McAllister, K. S. L., Myles, P., et al. (2020) · BMJ · doi:10.1136/bmj.l6927 · Cited by 497
Self-citationBooth, A., Reed, A. B., Ponzo, S., Yassaee, A., Aral, M., Plans, D., Labrique, A., & Mohan, D. (2021) · PLOS ONE · doi:10.1371/journal.pone.0247461 · Cited by 551
Goldstein, B. A., Navar, A. M., & Carter, R. E. (2016) · European Heart Journal · doi:10.1093/eurheartj/ehw302 · Cited by 543
“36,37 In the traditional regression model framework, internal validation is not necessary because one (ideally) posits an analytic model before fit-ting it to the data.”
BackgroundPark, Y., Kim, N. H., Kwon, T. Y., & Kim, S. G. (2018) · Scientific Reports · doi:10.1038/s41598-018-35073-4 · Cited by 548
Developing clinical prediction models: a step-by-step guide
Efthimiou, O., Seo, M., Chalkou, K., Debray, T., Egger, M., & Salanti, G. (2024) · BMJ · doi:10.1136/bmj-2023-078276 · Cited by 544
Metrics reloaded: recommendations for image analysis validation
Maier-Hein, L., Reinke, A., Godau, P., Tizabi, M. D., Buettner, F., Christodoulou, E., Glocker, B., Isensee, F., Kleesiek, J., Kozubek, M., et al. (2024) · Nature Methods · doi:10.1038/s41592-023-02151-z · Cited by 470
“Firstly, we adopted established consensus building approaches utilized for developing widely used guidelines such as CONSORT 21 , TRIPOD 22 or STARD 23 ).”
BackgroundMethodInfluentialSelf-citationEmergency department triage prediction of clinical outcomes using machine learning models
Raita, Y., Goto, T., Faridi, M. K., Brown, D. F. M., Camargo, C. A., & Hasegawa, K. (2019) · Critical Care · doi:10.1186/s13054-019-2351-7 · Cited by 519
How to Read Articles That Use Machine Learning: Users’ Guides to the Medical Literature
Liu, Y., Chen, P.-H. C., Krause, J., & Peng, L. (2019) · JAMA · doi:10.1001/jama.2019.16489 · Cited by 516
Evaluation of clinical prediction models (part 2): how to undertake an external validation study
Riley, R. D., Archer, L., Snell, K. I. E., Ensor, J., Dhiman, P., Martin, G. P., Bonnett, L. J., & Collins, G. S. (2024) · BMJ · doi:10.1136/bmj-2023-074820 · Cited by 401
“50 64 For example, the guidance recommends specifying all measures calculated to evaluate model performance and, at a minimum, to report calibration (graphically and quantified) and discrimination, along with corresponding confidence intervals.”
MethodEvaluating a New International Risk-Prediction Tool in IgA Nephropathy
Barbour, S. J., Coppo, R., Zhang, H., Liu, Z.-H., Suzuki, Y., Matsuzaki, K., Katafuchi, R., Er, L., Espino-Hernandez, G., Kim, S. J., et al. (2019) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2019.0600 · Cited by 478
Collins, G. S., Reitsma, J. B., Altman, D. G., & Moons, K. G. M. (2015) · Annals of Internal Medicine · doi:10.7326/l15-5093-2 · Cited by 493
Self-citationSauerbrei, W., Taube, S. E., McShane, L. M., Cavenagh, M. M., & Altman, D. G. (2018) · JNCI: Journal of the National Cancer Institute · doi:10.1093/jnci/djy088 · Cited by 486
“A guideline for reporting studies that develop or validate a multivariable prediction model (TRIPOD statement) was published recently (35,36).”
BackgroundSelf-citationHijazi, Z., Oldgren, J., Lindbäck, J., Alexander, J. H., Connolly, S. J., Eikelboom, J. W., Ezekowitz, M. D., Held, C., Hylek, E. M., Lopes, R. D., et al. (2016) · The Lancet · doi:10.1016/s0140-6736(16)00741-8 · Cited by 490
Improving reporting standards for polygenic scores in risk prediction studies
Wand, H., Lambert, S. A., Tamburro, C., Iacocca, M. A., O’Sullivan, J. W., Sillari, C., Kullo, I. J., Rowley, R., Dron, J. S., Brockman, D., et al. (2021) · Nature · doi:10.1038/s41586-021-03243-6 · Cited by 471
The Predictive Approaches to Treatment effect Heterogeneity (PATH) statement
Kent, D. M., Paulus, J. K., van Klaveren, D., D'Agostino, R., Goodman, S., Hayward, R., Ioannidis, J. P. A., Patrick-Lake, B., Morton, S., Pencina, M., et al. (2020) · Annals of Internal Medicine · doi:10.7326/m18-3667 · Cited by 469
Self-citationCausal inference and counterfactual prediction in machine learning for actionable healthcare
Prosperi, M., Guo, Y., Sperrin, M., Koopman, J. S., Min, J. S., He, X., Rich, S., Wang, M., Buchan, I. E., & Bian, J. (2020) · Nature Machine Intelligence · doi:10.1038/s42256-020-0197-y · Cited by 459
Deep learning for cardiovascular medicine: a practical primer
Krittanawong, C., Johnson, K. W., Rosenson, R. S., Wang, Z., Aydar, M., Baber, U., Min, J. K., Tang, W. H. W., Halperin, J. L., & Narayan, S. M. (2019) · European Heart Journal · doi:10.1093/eurheartj/ehz056 · Cited by 435
Collins, G. S., Reitsma, J. B., Altman, D. G., & Moons, K. G. M. (2015) · European Urology · doi:10.1016/j.eururo.2014.11.025 · Cited by 439
Self-citationHijazi, Z., Lindbäck, J., Alexander, J. H., Hanna, M., Held, C., Hylek, E. M., Lopes, R. D., Oldgren, J., Siegbahn, A., Stewart, R. A. H., et al. (2016) · European Heart Journal · doi:10.1093/eurheartj/ehw054 · Cited by 437
“–20 The external validation followed the principles and methods described by Royston and Altman and the reporting followed the recently published TRIPOD statement (protocol checklist, Supplementary material online, Figure G).(13,21) All analyses were performed using R version 3.”
MethodDecision curve analysis to evaluate the clinical benefit of prediction models
Vickers, A. J., & Holland, F. (2021) · The Spine Journal · doi:10.1016/j.spinee.2021.02.024 · Cited by 394
Self-citationMungroop, T. H., van Rijssen, L. B., van Klaveren, D., Smits, F. J., van Woerden, V., Linnemann, R. J., de Pastena, M., Klompmaker, S., Marchegiani, G., Ecker, B. L., et al. (2019) · Annals of Surgery · doi:10.1097/sla.0000000000002620 · Cited by 414
Self-citationAndaur Navarro, C. L., Damen, J. A. A., Takada, T., Nijman, S. W. J., Dhiman, P., Ma, J., Collins, G. S., Bajpai, R., Riley, R. D., Moons, K. G. M., et al. (2021) · BMJ · doi:10.1136/bmj.n2281 · Cited by 415
“36 37 Although TRIPOD was not explicitly doi: 10.1136/bmj.n2281 | BMJ 2021;375:n2281 | the bmj developed for machine learning prediction models, all items are applicable.”
BackgroundInfluentialSelf-citationDong, D., Fang, M.-J., Tang, L., Shan, X.-H., Gao, J.-B., Giganti, F., Wang, R.-P., Chen, X., Wang, X.-X., Palumbo, D., et al. (2020) · Annals of Oncology · doi:10.1016/j.annonc.2020.04.003 · Cited by 416
Metabolomic profiles predict individual multidisease outcomes
Buergel, T., Steinfeldt, J., Ruyoga, G., Pietzner, M., Bizzarri, D., Vojinovic, D., Upmeier zu Belzen, J., Loock, L., Kittner, P., Christmann, L., et al. (2022) · Nature Medicine · doi:10.1038/s41591-022-01980-3 · Cited by 406
(2024) · BMJ · doi:10.1136/bmj.q902 · Cited by 416
“*This checklist is based on the TRIPOD for Abstracts statement published in 2020, 17 but has been revised and updated for consistency with the TRIPOD+AI statement.”
Minimum sample size for external validation of a clinical prediction model with a binary outcome
Riley, R. D., Debray, T. P. A., Collins, G. S., Archer, L., Ensor, J., van Smeden, M., & Snell, K. I. E. (2021) · Statistics in Medicine · doi:10.1002/sim.9025 · Cited by 400
Self-citationGerry, S., Bonnici, T., Birks, J., Kirtley, S., Virdee, P. S., Watkinson, P. J., & Collins, G. S. (2020) · BMJ · doi:10.1136/bmj.m1501 · Cited by 383
Evaluating Discrimination of Risk Prediction Models: The C Statistic
Pencina, M. J., & D’Agostino, R. B. (2015) · JAMA · doi:10.1001/jama.2015.11082 · Cited by 386
van den Goorbergh, R., van Smeden, M., Timmerman, D., & Van Calster, B. (2022) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocac093 · Cited by 362
“Net Benefit is recommended by the TRIPOD reporting guideline for clinical prediction modeling studies.(23) 1528 Journal of the American Medical Informatics Association, 2022, Vol.”
MethodArtificial intelligence in dental research: Checklist for authors, reviewers, readers
Schwendicke, F., Singh, T., Lee, J.-H., Gaudin, R., Chaurasia, A., Wiegand, T., Uribe, S., & Krois, J. (2021) · Journal of Dentistry · doi:10.1016/j.jdent.2021.103610 · Cited by 360
Kuppermann, N., Dayan, P. S., Levine, D. A., Vitale, M., Tzimenatos, L., Tunik, M. G., Saunders, M., Ruddy, R. M., Roosevelt, G., Rogers, A. J., et al. (2019) · JAMA Pediatrics · doi:10.1001/jamapediatrics.2018.5501 · Cited by 368
Minimum sample size for developing a multivariable prediction model: Part I – Continuous outcomes
Riley, R. D., Snell, K. I. E., Ensor, J., Burke, D. L., Harrell, F. E., Moons, K. G. M., & Collins, G. S. (2019) · Statistics in Medicine · doi:10.1002/sim.7993 · Cited by 351
“2, we also show how LR can be expressed in terms of R2 (see Equation (5)).”
BackgroundSelf-citationIn, H., Solsky, I., Palis, B., Langdon-Embry, M., Ajani, J., & Sano, T. (2017) · Annals of Surgical Oncology · doi:10.1245/s10434-017-6078-x · Cited by 351
Bluemke, D. A., Moy, L., Bredella, M. A., Ertl-Wagner, B. B., Fowler, K. J., Goh, V. J., Halpern, E. F., Hess, C. P., Schiebler, M. L., & Weiss, C. R. (2020) · Radiology · doi:10.1148/radiol.2019192515 · Cited by 343
Cutillo, C. M., Sharma, K. R., Foschini, L., Kundu, S., Mackintosh, M., Mandl, K. D., MI in Healthcare Workshop Working Group, Beck, T., Collier, E., Colvis, C., et al. (2020) · npj Digital Medicine · doi:10.1038/s41746-020-0254-2 · Cited by 337
Thorsen-Meyer, H.-C., Nielsen, A. B., Nielsen, A. P., Kaas-Hansen, B. S., Toft, P., Schierbeck, J., Strøm, T., Chmura, P. J., Heimann, M., Dybdahl, L., et al. (2020) · The Lancet Digital Health · doi:10.1016/s2589-7500(20)30018-2 · Cited by 336
“13”
Kattan, M. W., Hess, K. R., Amin, M. B., Lu, Y., Moons, K. G. M., Gershenwald, J. E., Gimotty, P. A., Guinney, J. H., Halabi, S., Lazar, A. J., et al. (2016) · CA: A Cancer Journal for Clinicians · doi:10.3322/caac.21339 · Cited by 336
“Our criteria complement the recently published transparent reporting of a multivariable prediction model for individual prognosis or diagnosis (TRIPOD) document.(10) The TRIPOD sets forth the details deemed necessary for reporting on what was done in a prediction modeling study: development or validation.”
MethodSelf-citationCollins, G. S., Reitsma, J. B., Altman, D. G., & Moons, K. G. M. (2015) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2014.11.010 · Cited by 324
“).”
Self-citationMcDonnell, M. J., Aliberti, S., Goeminne, P. C., Restrepo, M. I., Finch, S., Pesci, A., Dupont, L. J., Fardon, T. C., Wilson, R., Loebinger, M. R., et al. (2016) · The Lancet Respiratory Medicine · doi:10.1016/s2213-2600(16)30320-4 · Cited by 318
Designing deep learning studies in cancer diagnostics
Kleppe, A., Skrede, O.-J., De Raedt, S., Liestøl, K., Kerr, D. J., & Danielsen, H. E. (2021) · Nature Reviews Cancer · doi:10.1038/s41568-020-00327-9 · Cited by 316
Zwanenburg, A. (2019) · European Journal of Nuclear Medicine and Molecular Imaging · doi:10.1007/s00259-019-04391-8 · Cited by 306
Park, J. E., Kim, D., Kim, H. S., Park, S. Y., Kim, J. Y., Cho, S. J., Shin, J. H., & Kim, J. H. (2020) · European Radiology · doi:10.1007/s00330-019-06360-z · Cited by 282
“The details of the checklist are described elsewhere [8], but it consists of 22 main criteria with 37 items.”
MethodHaimovich, A. D., Ravindra, N. G., Stoytchev, S., Young, H. P., Wilson, F. P., van Dijk, D., Schulz, W. L., & Taylor, R. A. (2020) · Annals of Emergency Medicine · doi:10.1016/j.annemergmed.2020.07.022 · Cited by 294
“com).(18) This study was approved by our local institutional review board.”
BackgroundThere is no such thing as a validated prediction model
Van Calster, B., Steyerberg, E. W., Wynants, L., & van Smeden, M. (2023) · BMC Medicine · doi:10.1186/s12916-023-02779-w · Cited by 286
Self-citationten Haaf, K., Jeon, J., Tammemägi, M. C., Han, S. S., Kong, C. Y., Plevritis, S. K., Feuer, E. J., de Koning, H. J., Steyerberg, E. W., & Meza, R. (2017) · PLOS Medicine · doi:10.1371/journal.pmed.1002277 · Cited by 284
Self-citationLeisman, D. E., Harhay, M. O., Lederer, D. J., Abramson, M., Adjei, A. A., Bakker, J., Ballas, Z. K., Barreiro, E., Bell, S. C., Bellomo, R., et al. (2020) · Critical Care Medicine · doi:10.1097/ccm.0000000000004246 · Cited by 271
“els, to which we direct readers for more information (6, 7).”
Backgroundinitiative, F. T. O. T. S., Sauerbrei, W., Perperoglou, A., Schmid, M., Abrahamowicz, M., Becher, H., Binder, H., Dunkler, D., Harrell, F. E., Royston, P., et al. (2020) · Diagnostic and Prognostic Research · doi:10.1186/s41512-020-00074-3 · Cited by 256
Nijman, S., Leeuwenberg, A., Beekers, I., Verkouter, I., Jacobs, J., Bots, M., Asselbergs, F., Moons, K., & Debray, T. (2022) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2021.11.023 · Cited by 269
Self-citationMansournia, M. A., Collins, G. S., Nielsen, R. O., Nazemipour, M., Jewell, N. P., Altman, D. G., & Campbell, M. J. (2021) · British Journal of Sports Medicine · doi:10.1136/bjsports-2020-103652 · Cited by 263
Self-citationUnderstanding artificial intelligence ethics and safety
Leslie, D. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.05684 · Cited by 134
Pylypchuk, R., Wells, S., Kerr, A., Poppe, K., Riddell, T., Harwood, M., Exeter, D., Mehta, S., Grey, C., Wu, B. P., et al. (2018) · The Lancet · doi:10.1016/s0140-6736(18)30664-0 · Cited by 269
Cowley, L. E., Farewell, D. M., Maguire, S., & Kemp, A. M. (2019) · Diagnostic and Prognostic Research · doi:10.1186/s41512-019-0060-y · Cited by 263
Cadrin-Tourigny, J., Bosman, L. P., Nozza, A., Wang, W., Tadros, R., Bhonsale, A., Bourfiss, M., Fortier, A., Lie, Ø. H., Saguner, A. M., et al. (2019) · European Heart Journal · doi:10.1093/eurheartj/ehz103 · Cited by 264
“The final model was fitted using stepwise backward selection based on Akaike’s Information Criterion.6 The discriminative performance of the model was measured using Harrell’s C-statistic.”
MethodInfluentialSynthetic and External Controls in Clinical Trials – A Primer for Researchers
Thorlund, K., Dron, L., Park, J. J., & Mills, E. J. (2020) · Clinical Epidemiology · doi:10.2147/clep.s242097 · Cited by 257
Statistical Primer: developing and validating a risk prediction model†
Grant, S. W., Collins, G. S., & Nashef, S. A. M. (2018) · European Journal of Cardio-Thoracic Surgery · doi:10.1093/ejcts/ezy180 · Cited by 253
“As a result, the Transparent Reporting of a multivariable prediction model for Individual Prognosis or Diagnosis (TRIPOD) recommendations were developed and published in 2015 [22, 23].”
BackgroundDetterbeck, F. C., Chansky, K., Groome, P., Bolejack, V., Crowley, J., Shemanski, L., Kennedy, C., Krasnik, M., Peake, M., Rami-Porta, R., et al. (2016) · Journal of Thoracic Oncology · doi:10.1016/j.jtho.2016.06.028 · Cited by 253
Velupillai, S., Suominen, H., Liakata, M., Roberts, A., Shah, A. D., Morley, K., Osborn, D., Hayes, J., Stewart, R., Downs, J., et al. (2018) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2018.10.005 · Cited by 247
Damen, J. A., Pajouheshnia, R., Heus, P., Moons, K. G. M., Reitsma, J. B., Scholten, R. J. P. M., Hooft, L., & Debray, T. P. A. (2019) · BMC Medicine · doi:10.1186/s12916-019-1340-7 · Cited by 250
Self-citationClinical prediction models: diagnosis versus prognosis
van Smeden, M., Reitsma, J. B., Riley, R. D., Collins, G. S., & Moons, K. G. (2021) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2021.01.009 · Cited by 238
Self-citationBattersby, N. J., Bouliotis, G., Emmertsen, K. J., Juul, T., Glynne-Jones, R., Branagan, G., Christensen, P., Laurberg, S., & Moran, B. J. (2018) · Gut · doi:10.1136/gutjnl-2016-312695 · Cited by 245
Metadata
- Authors
- Moons, K. G. M., Altman, D. G., Reitsma, J. B., Ioannidis, J. P. A., Macaskill, P., Steyerberg, E. W., Vickers, A. J., Ransohoff, D. F., & Collins, G. S.
- Affiliations
- University of North Carolina at Chapel Hill (US)
- From Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Utrecht, the Netherlands; Centre for Statistics in Medicine, Nuffield Department of Orthopaedics, Rheumatology and Musculoskeletal Sciences, Botnar Research Centre, University of Oxford, Oxford, United Kingdom; Stanford Prevention Research Center, School of Medicine, School of Humanities and Sciences, and Meta-Research Innovation Center at Stanford (METRICS), Stanford University, Stanford, California;
- ORCID
- Venue
- Annals of Internal Medicine
- Publisher
- American College of Physicians
- Published
- 2015-01-06
- Volume
- 162
- Issue
- 1
- Pages
- W1-W73
- ISSN
- 0003-4819 (ISSN-L)
- 1539-3704
- OpenAlex
- W1994682257
- Cited by
- 5,147
- References
- 533
- Citations by year
- 2026: 542 · 2025: 556 · 2024: 602 · 2023: 636 · 2022: 700 · 2021: 673 · 2020: 546 · 2019: 289 · 2018: 181 · 2017: 191 · 2016: 143 · 2015: 78
- FWCI
- 178.58
- Type
- journal article
- Language
- en
- Open access
- green
- dspace.library.uu.nl
- Licence
- other-oa
- Locations
- Annals of Internal Medicine (publishedVersion)
- PubMed (publishedVersion)
- EUR Research Repository (Erasmus University Rotterdam) (publishedVersion)
- EUR Research Repository (Erasmus University Rotterdam) (submittedVersion)
- Utrecht University Repository (Utrecht University) (submittedVersion, other-oa)
- University of Birmingham Research Portal (University of Birmingham) (submittedVersion)
- Funders
- Cancer Research UK (16895, C5529)
- National Institute for Health and Care Research (NF-SI-0508-10259, NF-SI-0513-10131)
- ZonMw (918.10.615)
- Medical Research Council (G0902393, G1100513, G0902393/99558)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Clinical practice guidelines implementation
- Keywords
- TRIPOD statement, multivariable prediction models, prognostic model, diagnostic model, reporting transparency, reporting checklist, risk of bias, clinical utility, prediction model validation
- MeSH terms
- Decision Support Techniques, Diagnosis, Humans, Prognosis, Publishing, Reproducibility of Results, Models, Statistical, Multivariate Analysis, Guidelines as Topic, Checklist
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.