Transparent Reporting of a multivariable prediction model for Individual Prognosis Or Diagnosis (TRIPOD): Explanation and Elaboration
Open accessThe DOI matches its Crossref record; 538 of the 538 references it cites were found in a registry or an index.
Abstract
The TRIPOD (Transparent Reporting of a multivariable prediction model for Individual Prognosis Or Diagnosis) Statement includes a 22-item checklist, which aims to improve the reporting of studies developing, validating, or updating a prediction model, whether for diagnostic or prognostic purposes. The TRIPOD Statement aims to improve the transparency of the reporting of a prediction model study regardless of the study methods used. This explanation and elaboration document describes the rationale; clarifies the meaning of each item; and discusses why transparent reporting is important, with a view to assessing risk of bias and clinical usefulness of the prediction model. Each checklist item of the TRIPOD Statement is explained in detail and accompanied by published examples of good reporting. The document also provides a valuable reference of issues to consider when designing, conducting, and analyzing prediction model studies. To aid the editorial process and help peer reviewers and, ultimately, readers and systematic reviewers of prediction model studies, it is recommended that authors include a completed checklist in their submission. The TRIPOD checklist can also be downloaded from www.tripod-statement.org.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The TRIPOD (Transparent Reporting of a multivariable prediction model for Individual Prognosis or Diagnosis) guidelines were used when composing this manuscript [11].”
From The External Validation of a Multivariable Prediction Model for Recurrent Pelvic Organ Prolapse After Native Tissue Repair: A Prospective Cohort Study (2025) · cites this paper as [11]
In the citing paper
“Initial evaluation criteria were based on reporting standards from the Transparent Reporting of a multivariable prediction model for Individual Prognosis or Diagnosis (TRIPOD) checklist 14 and informed by learnings from 3 to 4 algorithm reviews over a 6-month period.”
In the citing paper
“This retrospective study was conducted in accordance with the TRIPOD (Transparent Reporting of a multivariable prediction model for Individual Prognosis or Diagnosis) guidelines [16].”
From Early prediction of bloodstream infections in ICU patients using machine learning methods based on routine laboratory parameters (2025) · cites this paper as [16]
In the citing paper
“The reporting of studies evaluating the incremental value of specific predictors, beyond established predictors or even beyond existing prediction models (18,42), also fits entirely within the remit of TRIPOD”
From Transparent Reporting of a multivariable prediction model for Individual Prognosis Or Diagnosis (TRIPOD): The TRIPOD Statement (2015) · cites this paper as [42]
In the citing paper
“In addition, because many such studies are methodologically weak, we also summarize the qualities of good (and the limitations of less good) studies, regardless of reporting [43].”
From Transparent reporting of a multivariable prediction model for individual prognosis or diagnosis (TRIPOD): the TRIPOD Statement (2015) · cites this paper as [43]
1 more claim about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: the PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & for the PRISMA Group (2009) · BMJ · doi:10.1136/bmj.b2535 · Cited by 83,823
Self-citationPreferred reporting items for systematic reviews and meta-analyses: the PRISMA Statement.
(2009) · PubMed Central · Cited by 44,859
Self-citationPreferred reporting items for systematic reviews and meta-analyses: The PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & the PRISMA Group* (2009) · Annals of Internal Medicine · doi:10.7326/0003-4819-151-4-200908180-00135 · Cited by 37,554
Self-citation(1990) · Choice Reviews Online · doi:10.5860/choice.27-3338 · Cited by 35,305
The Elements of Statistical Learning
Hastie, T., Tibshirani, R., & Friedman, J. (2009) · Springer Series in Statistics · doi:10.1007/978-0-387-84858-7 · Cited by 25,970
DeLong, E. R., DeLong, D. M., & Clarke-Pearson, D. L. (1988) · Biometrics · doi:10.2307/2531595 · Cited by 22,649
Multiple Imputation for Nonresponse in Surveys
Rubin, D. B. (1987) · Wiley Series in Probability and Statistics · doi:10.1002/9780470316696 · Cited by 20,701
Statistical Analysis With Missing Data
Lahiff, M., Little, R. J. A., & Rubin, D. B. (1989) · Journal of the American Statistical Association · doi:10.2307/2289883 · Cited by 17,265
CONSORT 2010 Statement: updated guidelines for reporting parallel group randomised trials
the CONSORT Group, Schulz, K. F., Altman, D. G., & Moher, D. (2010) · BMC Medicine · doi:10.1186/1741-7015-8-18 · Cited by 13,371
Self-citation
Research works printed but not linked: 22
- Moons KG, 2012, External validation, model updating, and impact assessment. Heart, 98, 691
- Kulik DM, 2013, A systematic review of clinical prediction rules for children with acute abdominal pain. J Clin Epidemiol, 66, 95
- Kulik DM, 2013, A systematic review of clinical prediction rules for children with suspected bacterial meningitis. J Emerg Med, 45, 508
- Maguire JL, 2009, A systematic review of clinical prediction rules. Pediatrics, 124, e145
- Warnell I, 2014, Br J Anaesth
- Silverberg N, 2014, J Neurotrauma
- Delebarre M, 2014, Results of a systematic review and analysis. Pediatr Blood Cancer, 61, 1786
- Wong SS, 2003, AMIA Annu Symp Proc, 728
- Debray TP, 2014, J Clin Epidemiol
- 10.1016/S0002-9343(89)80689-8 · doi:10.1016/s0002-9343(89)80689-8 · Paper page
- Rutjes AW, 2007, Health Technol Assess, ix
- Peduzzi P, 1995, II. Accuracy and precision of regression estimates. J Clin Epidemiol, 48, 1503
- Van Calster B, 2014, Med Decis Making
- Baker SG, 2012, Discov Med, 14, 181
- Collins GS, 2013, Primary Care Cardiovascular Journal, 6, 125
- Ioannidis JP, 2014, Potential implications of the new cardiovascular guidelines. JAMA, 311, 463
- Ioannidis JP, 2010, The evidence applied to coronary artery calcium score. JAMA, 303, 1646
- Council for International Organizations of Medical Sciences., 2002, Bull Med Ethics, 182, 17
- Canadian CT Head and C-Spine (CCC) Study Group, 2002, CMAJ, 4, 185
- Simera I, 2013, J Pak Med Assoc, 63, 283
- Crowson CS, 2014, Stat Methods Med Res
- Bertolini G, 2000, J Epidemiol Biostat, 5, 251
Cited by
Items 201–300 of 1,024
Structural and functional radiomics for lung cancer
Wu, G., Jochems, A., Refaee, T., Ibrahim, A., Yan, C., Sanduleanu, S., Woodruff, H. C., & Lambin, P. (2021) · European Journal of Nuclear Medicine and Molecular Imaging · doi:10.1007/s00259-021-05242-1 · Cited by 151
Crossnohere, N. L., Elsaid, M. I., Paskett, J., Bose‐Brill, S., & Bridges, J. F. P. (2022) · Journal of Medical Internet Research · doi:10.1016/j.jval.2022.04.1285 · Cited by 167
The current status of risk-stratified breast screening
Clift, A. K., Dodwell, D. J., Lord, S., Petrou, S., Brady, M., Collins, G. S., & Hippisley‐Cox, J. (2021) · British Journal of Cancer · doi:10.1038/s41416-021-01550-3 · Cited by 156
Prediction meets causal inference: the role of treatment in clinical prediction models
van Geloven, N., Swanson, S. A., Ramspek, C. L., Luijken, K., van Diepen, M., Morris, T. P., Groenwold, R. H. H., van Houwelingen, H. C., Putter, H., & le Cessie, S. (2020) · European Journal of Epidemiology · doi:10.1007/s10654-020-00636-1 · Cited by 122
“lidation of prediction models offers hardly advice on the issue. The only related point on the TRIPOD checklist is that one should describe the treatments that patients received, if relevant (item 5c) [7]. The European Medicines Agency (EMA) has recently released a new guideline thatprovides aframework todeal withaddit…”
BackgroundEvaluation of machine learning algorithms for health and wellness applications: A tutorial
Tohka, J., & van Gils, M. (2021) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2021.104324 · Cited by 131
Andaur Navarro, C. L., Damen, J. A. A., Takada, T., Nijman, S. W. J., Dhiman, P., Ma, J., Collins, G. S., Bajpai, R., Riley, R. D., Moons, K. G. M., et al. (2022) · BMC Medical Research Methodology · doi:10.1186/s12874-021-01469-6 · Cited by 126
“Statement.(15,16) Our results will highlight specific reporting areas that can inform reporting 105 guidelines for ML, such as TRIPOD-AI.”
BackgroundSelf-citationCadrin-Tourigny, J., Bosman, L. P., Nozza, A., Wang, W., Tadros, R., Bhonsale, A., Bourfiss, M., Fortier, A., Lie, Ø. H., Saguner, A. M., et al. (2022) · European Heart Journal · doi:10.1093/eurheartj/ehac180 · Cited by 139
“We conducted an observational, retrospective, longitudinal cohort study in accordance with the Transparent Reporting of a Multivariable Prediction Model for Individual Prognosis or Diagnosis (TRIPOD) statement.(6)”
MethodInfluentialA novel prognostic model for transplant-free survival in primary sclerosing cholangitis
de Vries, E. M., Wang, J., Williamson, K. D., Leeflang, M. M., Boonstra, K., Weersma, R. K., Beuers, U., Chapman, R. W., Geskus, R. B., & Ponsioen, C. Y. (2018) · Gut · doi:10.1136/gutjnl-2016-313681 · Cited by 137
Artificial Intelligence to Predict Lymph Node Metastasis at CT in Pancreatic Ductal Adenocarcinoma
Bian, Y., Zheng, Z., Fang, X., Jiang, H., Zhu, M., Yu, J., Zhao, H., Zhang, L., Yao, J., Lü, L., et al. (2022) · Radiology · doi:10.1148/radiol.220329 · Cited by 142
Chang, T., Cao, Y., Sfreddo, H. J., Dhruba, S. R., Lee, S., Valero, C., Yoo, S., Chowell, D., Morris, L. G. T., & Ruppin, E. (2024) · Nature Cancer · doi:10.1038/s43018-024-00772-7 · Cited by 164
“22, it is believed to be a weak and inefficient form of validation, whereas splitting by time is a stronger approach 36 .”
Henderson, J. T., Thompson, J. H., Burda, B. U., & Cantor, A. (2017) · JAMA · doi:10.1001/jama.2016.18315 · Cited by 130
van Leeuwen, P. J., Hayen, A. D., Thompson, J. E., Moses, D. A., Shnier, R., Böhm, M., Abuodha, M., Haynes, A., Ting, F., Barentsz, J. O., et al. (2017) · British Journal of Urology · doi:10.1111/bju.13814 · Cited by 133
“We also assessed the calibration, that is the agreement between observed and predicted outcomes of the models [16].”
Arias‐Bujanda, N., Regueira‐Iglesias, A., Balsa‐Castro, C., Nibali, L., Donos, N., & Tomás, I. (2019) · Journal Of Clinical Periodontology · doi:10.1111/jcpe.13202 · Cited by 153
Debray, T. P. A., Riley, R. D., Rovers, M. M., Reitsma, J. B., Moons, K. G. M., & Cochrane IPD Meta-analysis Methods group (2015) · PLOS Medicine · doi:10.1371/journal.pmed.1001886 · Cited by 129
“—but less specific—guidance can be found in the recent Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA)-IPD reporting statement [44] and in the very recent Transparent Reporting of a Multivariable Prediction Model for Individual Prognosis or Diagnosis (TRIPOD) reporting guideline for studies…”
BackgroundSelf-citationEmbryo selection with artificial intelligence: how to evaluate and compare methods?
Kragh, M. F., & Karstoft, H. (2021) · Journal of Assisted Reproduction and Genetics · doi:10.1007/s10815-021-02254-6 · Cited by 149
Validity of polygenic risk scores: are we measuring what we think we are?
Janssens, A. C. J. W. (2019) · Human Molecular Genetics · doi:10.1093/hmg/ddz205 · Cited by 129
“The validity of clinical risk models needs to be demonstrated, and the choices in the model development need to be justified (64).”
BackgroundMachine learning and artificial intelligence in haematology
Shouval, R., Fein, J. A., Savani, B. N., Mohty, M., & Nagler, A. (2020) · British Journal of Haematology · doi:10.1111/bjh.16915 · Cited by 139
“4,42,43 Collins and Moons have recently launched an initiative to develop the TRIPOD-ML, which will be methodological guidelines specific to machine learning (TRIPOD-ML).”
InfluentialSultan, A. A., West, J., Grainge, M. J., Riley, R. D., Tata, L. J., Stephansson, O., Fleming, K. M., Nelson‐Piercy, C., & Ludvigsson, J. F. (2016) · BMJ · doi:10.1136/bmj.i6253 · Cited by 145
Prediction or causality? A scoping review of their conflation within current observational research
Ramspek, C. L., Steyerberg, E. W., Riley, R. D., Rosendaal, F. R., Dekkers, O. M., Dekker, F. W., & van Diepen, M. (2021) · European Journal of Epidemiology · doi:10.1007/s10654-021-00794-w · Cited by 145
Self-citationInternal and External Validation of a Machine Learning Risk Score for Acute Kidney Injury
Churpek, M. M., Carey, K. A., Edelson, D. P., Singh, T., Astor, B. C., Gilbert, E. R., Winslow, C., Shah, N., Afshar, M., & Koyner, J. L. (2020) · JAMA Network Open · doi:10.1001/jamanetworkopen.2020.12892 · Cited by 119
A scoping review of artificial intelligence-based methods for diabetes risk prediction
Mohsen, F., Al-Absi, H. R. H., Yousri, N. A., El Hajj, N., & Shah, Z. (2023) · npj Digital Medicine · doi:10.1038/s41746-023-00933-5 · Cited by 125
“Moreover, hold-out validation presents a concern as it reduces the sample size available for model development and may not utilize the data effectively 59,60 .”
MethodTexture analysis of 3D dose distributions for predictive modelling of toxicity rates in radiotherapy
Rossi, L., Bijman, R., Schillemans, W., Aluwini, S., Cavedon, C., Witte, M. G., Incrocci, L., & Heijmen, B. J. M. (2018) · Radiotherapy and Oncology · doi:10.1016/j.radonc.2018.07.027 · Cited by 139
Radiomics and Machine Learning for Radiotherapy in Head and Neck Cancers
Giraud, P., Giraud, P., Gasnier, A., Ayachy, R. E., Kreps, S., Foy, J., Durdux, C., Huguet, F., Burgun, A., & Bibault, J. (2019) · Frontiers in Oncology · doi:10.3389/fonc.2019.00174 · Cited by 136
Pan, P., Li, Y., Xiao, Y., Han, B., Su, L., Su, M., Li, Y., Zhang, S., Jiang, D., Chen, X., et al. (2020) · Journal of Medical Internet Research · doi:10.2196/23128 · Cited by 126
“It is worth noting that this study adhered to the TRIPOD (Transparent Reporting of a multivariable prediction model for Individual Prognosis Or Diagnosis) statement for reporting, and completion of the model construction and verification was guided by PROBAST (Prediction model Risk Of Bias ASsessment Tool) [25,26].”
MethodInfluentialBest Practices in Supervised Machine Learning: A Tutorial for Psychologists
Pargent, F., Schoedel, R., & Stachl, C. (2023) · Advances in Methods and Practices in Psychological Science · doi:10.1177/25152459231162559 · Cited by 164
“There is also a growing literature with specific guidelines for clinical predictive models (Moons et al., 2015; Wolff et al., 2019), which require especially high methodological and ethical standards.”
Monsalves, M. J., Bangdiwala, A. S., Thabane, A., & Bangdiwala, S. I. (2020) · BMC Medical Research Methodology · doi:10.1186/s12874-019-0876-8 · Cited by 151
Cadrin-Tourigny, J., Bosman, L. P., Wang, W., Tadros, R., Bhonsale, A., Bourfiss, M., Lie, Ø. H., Saguner, A. M., Svensson, A., Andorin, A., et al. (2021) · Circulation: Arrhythmia and Electrophysiology · doi:10.1161/circep.120.008509 · Cited by 118
Cai, Y., Cai, Y.-Q., Tang, L.-Y., Wang, Y.-H., Gong, M., Jing, T.-C., Li, H.-J., Li-Ling, J., Hu, W., Yin, Z., et al. (2024) · BMC Medicine · doi:10.1186/s12916-024-03273-7 · Cited by 122
“…performance, we opted for the two most widely reported and strongly recommended indices for discrimination and calibration, namely the c index and calibration plot/table, instead of specificity or sensitivity, as they are not recommended by the TRIPOD and checklist guidelines [34, 35, 158].”
MethodHijazi, Z., Oldgren, J., Lindbäck, J., Alexander, J. H., Connolly, S. J., Eikelboom, J. W., Ezekowitz, M. D., Held, C., Hylek, E. M., Lópes, R. D., et al. (2017) · European Heart Journal · doi:10.1093/eurheartj/ehx584 · Cited by 130
“The reporting followed the TRIPOD statement.(34) All analyses were performed using R version 3.”
MethodA proposed framework for developing quality assessment tools
Whiting, P., Wolff, R., Mallett, S., Simera, I., & Savović, J. (2017) · Systematic Reviews · doi:10.1186/s13643-017-0604-6 · Cited by 121
Andaur Navarro, C. L., Damen, J. A. A., van Smeden, M., Takada, T., Nijman, S. W. J., Dhiman, P., Ma, J., Collins, G. S., Bajpai, R., Riley, R. D., et al. (2023) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2022.11.015 · Cited by 121
“16,17,46,47 However, special attention is required on extending the recommendations to include areas such as data preparation, tunability, fairness, and data leakage.”
BackgroundSelf-citationLevine, L. D., Downes, K. L., Parry, S. I., Elovitz, M. A., Sammel, M. D., & Srinivas, S. K. (2017) · American Journal of Obstetrics and Gynecology · doi:10.1016/j.ajog.2017.11.603 · Cited by 123
Izquierdo, J. L., Ancochea, J., Savana COVID-19 Research Group, & Soriano, J. B. (2020) · Journal of Medical Internet Research · doi:10.2196/21801 · Cited by 123
“Further, we sought to replicate the results of this validation in an a posteriori sensitivity analysis, as per recent recommendations for predictive modeling in COVID-19 [28] and TRIPOD (Transparent Reporting of a multivariable prediction model for Individual Prognosis or Diagnosis) guidance [29].”
MethodLi, Y. Q., Tian, Y., Tan, S. H., Liu, M., Kusumawidjaja, G., Ong, E. H. W., Zhao, C., Tan, T. W. K., Fong, K. W., Sommat, K., et al. (2018) · Journal of Clinical Oncology · doi:10.1200/jco.2017.75.5165 · Cited by 122
Kim, J., Choi, S. J., Lee, S.-H., Lee, H. Y., & Park, H. (2018) · American Journal of Roentgenology · doi:10.2214/ajr.18.19507 · Cited by 123
Rahnenführer, J., Bin, R. D., Benner, A., Ambrogi, F., Lusa, L., Boulesteix, A., Migliavacca, E., Binder, H., Michiels, S., Sauerbrei, W., et al. (2023) · BMC Medicine · doi:10.1186/s12916-023-02858-y · Cited by 165
Hui, E. P., Li, W. F., Ma, B. B. Y., Lam, W. K., Chan, K. C. A., Mo, F. K. F., Ai, Q. Y. H., King, A. D., Wong, C. H., Guo, R., et al. (2020) · Annals of Oncology · doi:10.1016/j.annonc.2020.03.289 · Cited by 124
Falls in People with Multiple Sclerosis
Coote, S., Comber, L., Quinn, G., Santoyo-Medina, C., Kalron, A., & Gunn, H. (2020) · International Journal of MS Care · doi:10.7224/1537-2073.2020-014 · Cited by 116
van Rossum, P. S. N., Fried, D., Zhang, L., Hofstetter, W. L., van Vulpen, M., Meijer, G. J., Court, L. E., & Lin, S. H. (2016) · Journal of Nuclear Medicine · doi:10.2967/jnumed.115.163766 · Cited by 125
“…Act, the checklist from the STAndards for the Reporting of Diagnostic accuracy studies statement (http://www.stard-statement.org) ( 21 ), and the Transparent Reporting of a multivariable prediction model for Individual Prognosis or Diagnosis statement (http://www.tripod-statement. org) ( 22 ).”
Validation of a Machine Learning Algorithm to Predict 180-Day Mortality for Outpatients With Cancer
Manz, C. R., Chen, J., Liu, M., Chivers, C., Regli, S. H., Braun, J., Draugelis, M., Hanson, C. W., Shulman, L. N., Schuchter, L. M., et al. (2020) · JAMA Oncology · doi:10.1001/jamaoncol.2020.4331 · Cited by 117
Shouval, R., Hadanny, A., Nir, S., Iakobishvili, Z., Unger, R., Zahger, D., Alcalai, R., Atar, S., Gottlieb, S., Matetzky, S., et al. (2017) · International Journal of Cardiology · doi:10.1016/j.ijcard.2017.05.067 · Cited by 125
Staartjes, V. E., de Wispelaere, M. P., Vandertop, W. P., & Schröder, M. L. (2018) · The Spine Journal · doi:10.1016/j.spinee.2018.11.009 · Cited by 129
Machine learning in perioperative medicine: a systematic review
Bellini, V., Valente, M., Bertorelli, G., Pifferi, B., Craca, M., Mordonini, M., Lombardo, G., Bottani, E., Del Rio, P., & Bignami, E. (2022) · Journal of Anesthesia, Analgesia and Critical Care · doi:10.1186/s44158-022-00033-y · Cited by 109
“To assess the reporting quality of all included studies, we used the Transparent Reporting of a multivariable prediction model for Individual Prognosis or Diagnosis (TRIPOD) checklist [12].”
MethodPrediction versus aetiology: common pitfalls and how to avoid them
van Diepen, M., Ramspek, C. L., Jager, K. J., Zoccali, C., & Dekker, F. W. (2017) · Nephrology Dialysis Transplantation · doi:10.1093/ndt/gfw459 · Cited by 112
“Such observations have led to the development of the Transparent reporting of a multivariable prediction model for individual prognosis or diagnosis (TRIPOD) guideline [32, 33] for reporting prediction studies, which has been adopted by many leading medical journals.”
BackgroundDean, J., Wong, K. H., Welsh, L. C., Jones, A.-B., Schick, U., Newbold, K. L., Bhide, S. A., Harrington, K. J., Nutting, C. M., & Gulliford, S. (2016) · Radiotherapy and Oncology · doi:10.1016/j.radonc.2016.05.015 · Cited by 124
“[25] for model generation and the transparent reporting of a multivariable prediction model for individual prognosis or diagnosis (TRIPOD) international consensus guidelines for model evaluation [26].”
BackgroundMethodBreathomics in the setting of asthma and chronic obstructive pulmonary disease
Bos, L. D. J., Sterk, P. J., & Fowler, S. J. (2016) · Journal of Allergy and Clinical Immunology · doi:10.1016/j.jaci.2016.08.004 · Cited by 113
Cook, G., Royle, K., Pawlyn, C., Hockaday, A., Shah, V., Kaiser, M., Brown, S., Gregory, W. M., Child, J. A., Davies, F. E., et al. (2019) · The Lancet Haematology · doi:10.1016/s2352-3026(18)30220-5 · Cited by 120
How to conduct a systematic review and meta-analysis of prognostic model studies
Damen, J. A., Moons, K. G. M., van Smeden, M., & Hooft, L. (2022) · Clinical Microbiology and Infection · doi:10.1016/j.cmi.2022.07.019 · Cited by 124
“Therefore, the Transparent Reporting of a multivariable prediction model for Individual Prognosis or Diagnosis (TRIPOD) statement has been published [36,37].”
Self-citationVan Calster, B., Collins, G. S., Vickers, A. J., Wynants, L., Kerr, K. F., Barreñada, L., Varoquaux, G., Singh, K., Moons, K. G., Hernandez-Boussard, T., et al. (2025) · The Lancet Digital Health · doi:10.1016/j.landig.2025.100916 · Cited by 112
Self-citationBogowicz, M., Leijenaar, R. T. H., Tanadini‐Lang, S., Riesterer, O., Pruschy, M. N., Studer, G., Unkelbach, J., Gückenberger, M., Konukoğlu, E., & Lambin, P. (2017) · Radiotherapy and Oncology · doi:10.1016/j.radonc.2017.10.023 · Cited by 119
Pease, M. W., Arefan, D., Barber, J. K., Yuh, E. L., Puccio, A. M., Hochberger, K., Nwachuku, E. L., Roy, S., Casillo, S. M., Temkin, N. R., et al. (2022) · Radiology · doi:10.1148/radiol.212181 · Cited by 126
“We adhered to the Standards for Reporting Diagnostic Accuracy Studies (20) and Transparent Reporting of a Multivariable Prediction Model for Individual Prognosis or Diagnosis (21).”
Serghiou, S., Kyriakopoulou, A., & Ioannidis, J. P. A. (2016) · Molecular Cancer · doi:10.1186/s12943-016-0535-1 · Cited by 115
“Moons KGM, Altman DG, Reitsma JB, Ioannidis JPA, Macaskill P, Steyerberg EW, et al. Transparent Reporting of a multivariable prediction model for Individual Prognosis or Diagnosis (TRIPOD): explanation and elaboration.”
BackgroundSelf-citationTopological data analysis reveals genotype–phenotype relationships in primary ciliary dyskinesia
Shoemark, A., Rubbo, B., Legendre, M., Fassad, M. R., Haarman, E. G., Best, S. K., Bon, I. C. M., Brandsma, J., Burgel, P., Carlsson, G., et al. (2021) · European Respiratory Journal · doi:10.1183/13993003.02359-2020 · Cited by 110
Biomarkers of Vascular Inflammation for Cardiovascular Risk Prognostication
Antonopoulos, A. S., Angelopoulos, A., Papanikolaou, P., Simantiris, S., Oikonomou, E. K., Vamvakaris, K., Koumpoura, A., Farmaki, M., Trivella, M., Vlachopoulos, C. V., et al. (2021) · JACC. Cardiovascular imaging · doi:10.1016/j.jcmg.2021.09.014 · Cited by 115
Implementation frameworks for end-to-end clinical AI: derivation of the SALIENT framework
van der Vegt, A. H., Scott, I. A., Dermawan, K., Schnetler, R. J., Kalke, V. R., & Lane, P. J. (2023) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocad088 · Cited by 109
Brooks, J. M., de Menezes, A. N., Ibrahim, M., Archer, L., Lal, N., Bagnall, C. J., von Zeidler, S. V., Valentine, H. R., Spruce, R. J., Batis, N., et al. (2019) · Clinical Cancer Research · doi:10.1158/1078-0432.ccr-18-3314 · Cited by 125
“Of note, the consistent performance of the classifier despite the heterogeneous nature of the study cohorts and assays is an indication of the strength of the signature (50).”
BackgroundAleksandrova, K., Reichmann, R., Kaaks, R., Jenab, M., Bueno-de-Mesquita, H. B., Dahm, C. C., Eriksen, A. K., Tjønneland, A. M., Artaud, F., Boutron‐Ruault, M., et al. (2021) · BMC Medicine · doi:10.1186/s12916-020-01826-0 · Cited by 118
“The model development and model validation were performed and reported following the TRIPOD guidelines [23, 31] (Supplementary Table 2, Additional File 1).”
MethodDhiman, P., Ma, J., Navarro, C. A., Speich, B., Bullock, G., Damen, J. A., Kirtley, S., Hooft, L., Riley, R. D., Van Calster, B., et al. (2021) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2021.06.024 · Cited by 110
“To address poor reporting and improve the value of clinical prediction models, the Transparent Reporting of a multivariable prediction model for Individual Prognosis Or Diagnosis (TRIPOD) statement was published [ 18 , 19 ].”
MethodSelf-citationPiovani, D., Sokou, R., Tsantes, A. G., Vitello, A. S., & Bonovas, S. (2023) · Healthcare · doi:10.3390/healthcare11162244 · Cited by 136
“Statistical measures of discrimination, calibration, or other measures of model performance, while important [1], are not well-suited for directly and clearly assessing the clinical value of a score or biomarker due to a limited direct applicability to clinical practice [2].”
BackgroundMethodInfluentialHeus, P., Damen, J. A. A. G., Pajouheshnia, R., Scholten, R. J. P. M., Reitsma, J. B., Collins, G. S., Altman, D. G., Moons, K. G. M., & Hooft, L. (2019) · BMJ Open · doi:10.1136/bmjopen-2018-025611 · Cited by 111
Self-citationSilva, K. D., Lee, W. K., Forbes, A., Demmer, R. T., Barton, C., & Enticott, J. (2020) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2020.104268 · Cited by 108
Performance and Validation of a Novel Biomarker-Based Stroke Risk Score for Atrial Fibrillation
Oldgren, J., Hijazi, Z., Lindbäck, J., Alexander, J. H., Connolly, S. J., Eikelboom, J. W., Ezekowitz, M. D., Granger, C. B., Hylek, E. M., Lopes, R. D., et al. (2016) · Circulation · doi:10.1161/circulationaha.116.022802 · Cited by 104
Iba, K., Shinozaki, T., Maruo, K., & Noma, H. (2021) · BMC Medical Research Methodology · doi:10.1186/s12874-020-01201-w · Cited by 123
Berkelmans, G. F. N., Read, S. H., Gudbjörnsdottir, S., Wild, S. H., Franzen, S., van der Graaf, Y., Eliasson, B., Visseren, F. L. J., Paynter, N. P., & Dorresteijn, J. A. N. (2022) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2022.01.011 · Cited by 125
Moore, C. C., Hazard, R., Saulters, K. J., Ainsworth, J. E., Adakun, S. A., Abdallah, A., Andrews, B., Auma, M. A., Baker, T., Banura, P., et al. (2017) · BMJ Global Health · doi:10.1136/bmjgh-2017-000344 · Cited by 110
“Vienna, Austria) for all analyses and used the Transparent Reporting of a multivariable prediction model for Individual Prognosis or Diagnosis (TRIPOD) and Strengthening the Reporting of Observational Studies in Epidemiology checklists in analysing and reporting this study.(17) We created logistic regression models fo…”
MethodTapper, E. B., Parikh, N. D., Sengupta, N., Mellinger, J. L., Ratz, D., Lok, A. S.-F., & Su, G. L. (2017) · Hepatology · doi:10.1002/hep.29628 · Cited by 114
“We report the results of our study in accordance with the recommended framework by the Transparent Reporting of a Multivariable Prediction Model for Individual Prognosis or Diagnosis statement (Supporting Information).((12)) We performed a retrospective cohort study of all adult veterans from the Veterans Affairs (VA)…”
MethodZhang, Z., Wang, Z., Yan, M., Yu, J., Dekker, A. L. A. J., Zhao, L., & Wee, L. (2022) · International Journal of Radiation Oncology*Biology*Physics · doi:10.1016/j.ijrobp.2022.08.047 · Cited by 109
Validation of Risk Assessment Models of Venous Thromboembolism in Hospitalized Medical Patients
Greene, M. T., Spyropoulos, A. C., Chopra, V., Grant, P., Kaatz, S., Bernstein, S. J., & Flanders, S. A. (2016) · The American Journal of Medicine · doi:10.1016/j.amjmed.2016.03.031 · Cited by 116
Fazel, S., Chang, Z., Fanshawe, T., Långström, N., Lichtenstein, P., Larsson, H., & Mallett, S. (2016) · The Lancet Psychiatry · doi:10.1016/s2215-0366(16)00103-6 · Cited by 100
Machine learning and modeling: Data, validation, communication challenges
El Naqa, I., Ruan, D., Valdes, G., Dekker, A., McNutt, T., Ge, Y., Wu, Q. J., Oh, J. H., Thor, M., Smith, W., et al. (2018) · Medical Physics · doi:10.1002/mp.12811 · Cited by 101
Karhade, A. V., Ogink, P. T., Thio, Q. C. B. S., Broekman, M. L. D., Cha, T., Gormley, W. B., Hershman, S. H., Peul, W. C., Bono, C. M., & Schwab, J. H. (2018) · Neurosurgical FOCUS · doi:10.3171/2018.8.focus18340 · Cited by 111
Prediction Models of Mortality in Acute Pancreatitis in Adults: A Systematic Review
Di, M., Liu, H., Yang, Z., Bonis, P. A. L., Tang, J.-L., & Lau, J. W. Y. (2016) · Annals of Internal Medicine · doi:10.7326/m16-0650 · Cited by 120
Analyzing Activity and Injury: Lessons Learned from the Acute:Chronic Workload Ratio
Wang, C., Vargas, J. T., Stokes, T., Steele, R. J., & Shrier, I. (2020) · Sports Medicine · doi:10.1007/s40279-020-01280-1 · Cited by 122
Development and validation of early warning score system: A systematic literature review
Fu, L.-H., Schwartz, J., Moy, A., Knaplund, C., Kang, M.-J., Schnock, K. O., Garcia, J. P., Jia, H., Dykes, P. C., Cato, K., et al. (2020) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2020.103410 · Cited by 102
“A better alternative is splitting by time.[13] Recent studies validated their models on external datasets rather than on the original dataset from which the model was derived.”
BackgroundMethodInfluentialHadjiiski, L. M., Cha, K., Chan, H., Drukker, K., Morra, L., Näppi, J. J., Sahiner, B., Yoshida, H., Chen, Q., Deserno, T. M., et al. (2023) · Medical Physics · doi:10.1002/mp.16188 · Cited by 122
Dhiman, P., Ma, J., Qi, C., Bullock, G. S., Sergeant, J. C., Riley, R. D., & Collins, G. S. (2023) · BMC Medical Research Methodology · doi:10.1186/s12874-023-02008-1 · Cited by 125
“Future research and recommendations Sample size is one of the minimum reporting recommendations in the TRIPOD reporting guideline and signalling question for PROBAST the risk of bias tool for prediction model studies [1, 2, 34, 35].”
MethodBrady, A. P., Allen, B., Chong, J., Kotter, E., Kottler, N. E., Mongan, J., Oakden‐Rayner, L., dos Santos, D. P., Tang, A., Wald, C., et al. (2024) · Insights into Imaging · doi:10.1186/s13244-023-01541-3 · Cited by 119
“By monitoring for individual components of data drift, institutions could trigger re-evaluation of model performance depending on timing and severity of changes and initiate appropriate steps to safeguard patient care.”
BackgroundA new test and graphical tool to assess the goodness of fit of logistic regression models
Nattino, G., Finazzi, S., & Bertolini, G. (2015) · Statistics in Medicine · doi:10.1002/sim.6744 · Cited by 114
“frequencies across strata of risk [6].”
Yusuf, M., Atal, I., Li, J., Smith, P., Ravaud, P., Fergie, M., Callaghan, M., & Selfe, J. (2020) · BMJ Open · doi:10.1136/bmjopen-2019-034568 · Cited by 102
Al‐Rubaie, Z., Askie, L., Ray, J., Hudson, H., & Lord, S. (2016) · BJOG: An International Journal of Obstetrics & Gynaecology · doi:10.1111/1471-0528.14029 · Cited by 99
Sasaki, K., Firl, D. J., Hashimoto, K., Fujiki, M., Diago‐Uso, T., Quintini, C., Eghtesad, B., Fung, J. J., Aucejo, F., & Miller, C. M. (2017) · The Lancet. Gastroenterology & hepatology · doi:10.1016/s2468-1253(17)30106-1 · Cited by 103
Sufriyana, H., Wu, Y., & Su, E. C. (2020) · EBioMedicine · doi:10.1016/j.ebiom.2020.102710 · Cited by 119
“Therefore, this study applied standards for feature extraction, feature selection, model validation, and others that were designed to avoid bias and over fi tting in development of either prognostic factors or the prediction model [25,28,96,97].”
BackgroundMethodHodgson, L. E., Sarnowski, A., Roderick, P. J., Dimitrov, B. D., Venn, R. M., & Forni, L. G. (2017) · BMJ Open · doi:10.1136/bmjopen-2017-016591 · Cited by 100
“30 Calibration describes how well predicted results agree with observed results.(12) 30 The Hosmer-Lemeshow (H-L) test, despite limitations, is the most commonly used calibration statistic.”
BackgroundMethodResultInfluentialShouval, R., Fein, J. A., Shouval, A., Danylesko, I., Shem‐Tov, N., Zlotnik, M., Yerushalmi, R., Shimoni, A., & Nagler, A. (2019) · Blood Advances · doi:10.1182/bloodadvances.2019032268 · Cited by 102
“A model is considered well calibrated if, for example, among a group of 100 patients with a mean predicted risk of 20%, ;20 patients develop the outcome.(17) Finally, within a variety of subpopulations, discrimination was assessed to determine whether each score performed better or worse under a given set of condition…”
MethodGlanz, J. M., Narwaney, K. J., Mueller, S. R., Gardner, E. M., Calcaterra, S. L., Xu, S., Breslin, K. D., & Binswanger, I. A. (2018) · Journal of General Internal Medicine · doi:10.1007/s11606-017-4288-3 · Cited by 110
“Backward elimination is the preferred choice for variable selection in predictive modeling.(20) Continuous variables were tested using simple parametric forms (a single linear term, low-order polynomials, logarithmic) and restricted cubic splines; categorical variables were modeled using indicator variables.”
Methodthe Traumabase® Group, Hamada, S., Rosa, A., Gauss, T., Desclefs, J.-P., Raux, M., Harrois, A., Follin, A., Cook, F., Boutonnet, M., et al. (2018) · Critical Care · doi:10.1186/s13054-018-2026-9 · Cited by 114
“The number of events in our sample far exceeds the required number established using previously published rules (10 events per candidate variable for derivation studies and at least 100 events for validation studies) and therefore is expected to provide robust estimates [20].”
BackgroundMethodRadiomics in Renal Cell Carcinoma—A Systematic Review and Meta-Analysis
Mühlbauer, J., Egen, L., Kowalewski, K., Grilli, M., Walach, M. T., Westhoff, N., Nuhn, P., Laqua, F. C., Baeßler, B., & KRIEGMAIR, M. C. (2021) · Cancers · doi:10.3390/cancers13061348 · Cited by 103
“The poor quality of reporting prediction model studies is a known problem, which amongst others led to the TRIPOD (Transparent Reporting of a multivariable prediction model for Individual Prognosis Or Diagnoses) initiative [13,18].”
BackgroundMoss, T. J., Lake, D. E., Calland, J. F., Enfield, K. B., Delos, J. B., Fairchild, K. D., & Moorman, J. R. (2016) · Critical Care Medicine · doi:10.1097/ccm.0000000000001738 · Cited by 98
“We justify bootstrapping methodology over splitsample or cross-validation techniques by noting that the estimates generated by these alternative strategies are less stable (different splits lead to different results) and exhibit greater bias (samples that vary only by chance will probably show similar performance as i…”
MethodDebray, T. P. A., Collins, G. S., Riley, R. D., Snell, K. I. E., Van Calster, B., Reitsma, J. B., & Moons, K. G. M. (2023) · BMJ · doi:10.1136/bmj-2022-071018 · Cited by 86
“11 12 These details include varying predictor and outcome definitions across clusters, varying (quality of) predictor and outcome measurements, varying inclusion criteria or participation of individuals, the presence and handling of systematically missing data across and within clusters (ie, a…”
BackgroundMethodSelf-citationQUAPAS: An Adaptation of the QUADAS-2 Tool to Assess Prognostic Accuracy Studies
Lee, J., Mulder, F. I., Leeflang, M., Wolff, R. F., Whiting, P. F., & Bossuyt, P. M. (2022) · Annals of Internal Medicine · doi:10.7326/m22-0276 · Cited by 111
Gragnano, F., Klaveren, D. V., Heg, D., Räber, L., Krucoff, M. W., Raposeiras‐Roubín, S., ten Berg, J. M., Leonardi, S., Kimura, T., Corpataux, N., et al. (2024) · Circulation · doi:10.1161/circulationaha.124.072009 · Cited by 104
Key steps and common pitfalls in developing and validating risk models
Wynants, L., Collins, G. S., & CALSTER, B. V. (2016) · BJOG An International Journal of Obstetrics & Gynaecology · doi:10.1111/1471-0528.14170 · Cited by 104
Income and Other Contributors to Poor Outcomes in U.S. Patients with Sarcoidosis
Harper, L. J., Gerke, A. K., Wang, X., Neto, M. L. R., Baughman, R. P., Beyer, K., Drent, M., Judson, M. A., Maier, L. A., Serchuck, L. K., et al. (2019) · American Journal of Respiratory and Critical Care Medicine · doi:10.1164/rccm.201906-1250oc · Cited by 109
“001 Yes 678 (29) 290 (50) 224 (28) 114 (17) No 1,227 (53) 152 (26) 447 (56) 493 (72) Not applicable, did not work 265 (11) 94 (16) 77 (10) 49 (7) Missing 148 (6) 41 (7) 47 (6) 29 (4)”
BackgroundMethodInfluentialTackling COVID-19 through Responsible AI Innovation: Five Steps in the Right Direction
Leslie, D. (2020) · Harvard Data Science Review · doi:10.1162/99608f92.4bb9d7a7 · Cited by 94
Hendriksen, J. M. T., Geersing, G., Lucassen, W. A. M., Erkens, P. M. G., Stoffers, J., van Weert, H. C. P. M., Buller, H. R., Hoes, A. W., & Moons, K. G. M. (2015) · BMJ · doi:10.1136/bmj.h4438 · Cited by 107
Self-citationvan Dijk, L. V., Thor, M., Steenbakkers, R. J. H. M., Apte, A., Zhai, T., Borra, R., Noordzij, W., Estilo, C. L., Lee, N. Y., Langendijk, J. A., et al. (2018) · Radiotherapy and Oncology · doi:10.1016/j.radonc.2018.06.012 · Cited by 94
“2 models in each bootstrap and in the original sample, as suggested by the TRIPOD statement [29].”
Machine learning for predicting chronic diseases: a systematic review
Delpino, F. M., Costa, Â. K., Farias, S. R., Filho, A. D. P. C., Arcêncio, R. A., & Nunes, B. P. (2022) · Public Health · doi:10.1016/j.puhe.2022.01.007 · Cited by 114
Mehta, H. B., Li, S., An, H., Goodwin, J. S., Alexander, G. C., & Segal, J. B. (2022) · Annals of Internal Medicine · doi:10.7326/m21-4204 · Cited by 103
Greco, C., Gennaro, F. D., D’Amato, C., Morganti, R., Corradini, D., Sun, A., Longo, S., Lauro, D., Pierangeli, G., Cortelli, P., et al. (2016) · Diabetic Medicine · doi:10.1111/dme.13310 · Cited by 107
Lamping, F., Jack, T., Rübsamen, N., Sasse, M., Beerbaum, P., Mikolajczyk, R. T., Boehne, M., & Karch, A. (2018) · BMC Pediatrics · doi:10.1186/s12887-018-1082-2 · Cited by 92
“Non-random time splits represent one of the best validation methods when no truly external validation dataset is available and provide considerably more valid results than random splits of datasets; they are therefore considered an intermediate between internal and external validation [27].”
BackgroundMethod
Metadata
- Authors
- Moons, K. G. M., Altman, D. G., Reitsma, J. B., Ioannidis, J. P. A., Macaskill, P., Steyerberg, E. W., Vickers, A. J., Ransohoff, D. F., & Collins, G. S.
- Affiliations
- University of North Carolina at Chapel Hill (US)
- From Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Utrecht, the Netherlands; Centre for Statistics in Medicine, Nuffield Department of Orthopaedics, Rheumatology and Musculoskeletal Sciences, Botnar Research Centre, University of Oxford, Oxford, United Kingdom; Stanford Prevention Research Center, School of Medicine, School of Humanities and Sciences, and Meta-Research Innovation Center at Stanford (METRICS), Stanford University, Stanford, California;
- ORCID
- Venue
- Annals of Internal Medicine
- Publisher
- American College of Physicians
- Published
- 2015-01-06
- Volume
- 162
- Issue
- 1
- Pages
- W1-W73
- ISSN
- 0003-4819 (ISSN-L)
- 1539-3704
- OpenAlex
- W1994682257
- Cited by
- 5,147
- References
- 533
- Citations by year
- 2026: 542 · 2025: 556 · 2024: 602 · 2023: 636 · 2022: 700 · 2021: 673 · 2020: 546 · 2019: 289 · 2018: 181 · 2017: 191 · 2016: 143 · 2015: 78
- FWCI
- 178.58
- Type
- journal article
- Language
- en
- Open access
- green
- dspace.library.uu.nl
- Licence
- other-oa
- Locations
- Annals of Internal Medicine (publishedVersion)
- PubMed (publishedVersion)
- EUR Research Repository (Erasmus University Rotterdam) (publishedVersion)
- EUR Research Repository (Erasmus University Rotterdam) (submittedVersion)
- Utrecht University Repository (Utrecht University) (submittedVersion, other-oa)
- University of Birmingham Research Portal (University of Birmingham) (submittedVersion)
- Funders
- Cancer Research UK (16895, C5529)
- National Institute for Health and Care Research (NF-SI-0508-10259, NF-SI-0513-10131)
- ZonMw (918.10.615)
- Medical Research Council (G0902393, G1100513, G0902393/99558)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Clinical practice guidelines implementation
- Keywords
- TRIPOD statement, multivariable prediction models, prognostic model, diagnostic model, reporting transparency, reporting checklist, risk of bias, clinical utility, prediction model validation
- MeSH terms
- Decision Support Techniques, Diagnosis, Humans, Prognosis, Publishing, Reproducibility of Results, Models, Statistical, Multivariate Analysis, Guidelines as Topic, Checklist
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.