A new concordance measure for risk prediction models in external validation settings
Open accessAbstract
Concordance measures are frequently used for assessing the discriminative ability of risk prediction models. The interpretation of estimated concordance at external validation is difficult if the case‐mix differs from the model development setting. We aimed to develop a concordance measure that provides insight into the influence of case‐mix heterogeneity and is robust to censoring of time‐to‐event data. We first derived a model‐based concordance (mbc) measure that allows for quantification of the influence of case‐mix heterogeneity on discriminative ability of proportional hazards and logistic regression models. This mbc can also be calculated including a regression slope that calibrates the predictions at external validation (c‐mbc), hence assessing the influence of overall regression coefficient validity on discriminative ability. We derived variance formulas for both mbc and c‐mbc. We compared the mbc and the c‐mbc with commonly used concordance measures in a simulation study and in two external validation settings. The mbc was asymptotically equivalent to a previously proposed resampling‐based case‐mix corrected c‐index. The c‐mbc remained stable at the true value with increasing proportions of censoring, while Harrell's c‐index and to a lesser extent Uno's concordance measure increased unfavorably. Variance estimates of mbc and c‐mbc were well in agreement with the simulated empirical variances. We conclude that the mbc is an attractive closed‐form measure that allows for a straightforward quantification of the expected change in a model's discriminative ability due to case‐mix heterogeneity. The c‐mbc also reflects regression coefficient validity and is a censoring‐robust alternative for the c‐index when the proportional hazards assumption holds. Copyright © 2016 John Wiley & Sons, Ltd.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
An additional advantage of IPD is that it becomes possible to adjust discrimination performance for (variation in) subject-level covariates, and thus to gain more understanding in sources of between-study heterogeneity.
“An additional advantage of IPD is that it becomes possible to adjust discrimination performance for (variation in) subject-level covariates, and thus to gain more understanding in sources of between-study heterogeneity.9,10,26,68”
From A framework for meta-analysis of prediction model studies with binary and time-to-event outcomes (2019) · cites this paper as [68]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Nishimura, R., Osako, T., Nishiyama, Y., Tashima, R., Nakano, M., Fujisue, M., Toyozumi, Y., & Arima, N. (2013) · Oncology · doi:10.1159/000353099 · Cited by 13,239 · see citing works
Proportional hazards tests and diagnostics based on weighted residuals
GRAMBSCH, P. M., & THERNEAU, T. M. (1994) · Biometrika · doi:10.1093/biomet/81.3.515 · Cited by 5,885 · see citing works
Assessing the Performance of Prediction Models: A Framework for Traditional and Novel Measures
Steyerberg, E. W., Vickers, A. J., Cook, N. R., Gerds, T., Gonen, M., Obuchowski, N., Pencina, M. J., & Kattan, M. W. (2010) · Epidemiology · doi:10.1097/ede.0b013e3181c30fb2 · Cited by 5,170 · see citing works
Self-citationEvaluating the Yield of Medical Tests
Harrell, F. E. (1982) · JAMA: The Journal of the American Medical Association · doi:10.1001/jama.1982.03320430047030 · Cited by 3,490 · see citing works
Mohr, F. W., Morice, M., Kappetein, A. P., Feldman, T. E., Ståhle, E., Colombo, A., Mack, M. J., Holmes, D. R., Morel, M.-A., Dyck, N. V., et al. (2013) · The Lancet · doi:10.1016/s0140-6736(13)60141-5 · Cited by 1,788 · see citing works
Uno, H., Cai, T., Pencina, M. J., D'Agostino, R. B., & Wei, L. J. (2011) · Statistics in Medicine · doi:10.1002/sim.4154 · Cited by 1,535 · see citing works
Steyerberg, E. W. (2009) · Statistics for Biology and Health · doi:10.1007/978-0-387-77244-8 · Cited by 1,491 · see citing works
Self-citationPencina, M. J., & D’Agostino, R. B. (2004) · Statistics in Medicine · doi:10.1002/sim.1802 · Cited by 1,446 · see citing works
Steyerberg, E. W., Mushkudiani, N. A., Perel, P., Butcher, I., Lü, J., McHugh, G. S., Murray, G. D., Marmarou, A., Roberts, I., Habbema, J. D. F., et al. (2008) · PLoS Medicine · doi:10.1371/journal.pmed.0050165 · Cited by 1,437 · see citing works
Self-citationExternal validation of a Cox prognostic model: principles and methods
Royston, P. J., & Altman, D. G. (2013) · BMC Medical Research Methodology · doi:10.1186/1471-2288-13-33 · Cited by 911 · see citing works
Farooq, V., Klaveren, D. V., Steyerberg, E. W., Meliga, E., Vergouwe, Y., Chieffo, A., Kappetein, A. P., Colombo, A., Holmes, D. R., Mack, M. J., et al. (2013) · The Lancet · doi:10.1016/s0140-6736(13)60108-7 · Cited by 837 · see citing works
Self-citationConcordance probability and discriminatory power in proportional hazards regression
Gönen, M., & Heller, G. (2005) · Biometrika · doi:10.1093/biomet/92.4.965 · Cited by 685 · see citing works
Self-citationA multicenter trial on the efficacy of using tirilazad mesylate in cases of head injury
Marshall, L. F., Maas, A. I. R., Marshall, S. B., Bricolo, A., Fearnside, M. R., Iannotti, F., Klauber, M. R., Lagarrigue, J., Lobato, R., Persson, L., et al. (1998) · Journal of neurosurgery · doi:10.3171/jns.1998.89.4.0519 · Cited by 336 · see citing works
Austin, P. C., & Steyerberg, E. W. (2012) · BMC Medical Research Methodology · doi:10.1186/1471-2288-12-82 · Cited by 270 · see citing works
Self-citationVergouwe, Y., Moons, K. G. M., & Steyerberg, E. W. (2010) · American Journal of Epidemiology · doi:10.1093/aje/kwq223 · Cited by 243 · see citing works
Self-citationMeasures of explained variation for survival data
Korn, E. L., & Simon, R. M. (1990) · Statistics in Medicine · doi:10.1002/sim.4780090503 · Cited by 194 · see citing works
Hukkelhoven, C. W. P. M., Steyerberg, E. W., Farace, E., Habbema, J. D. F., Marshall, L. F., & Maas, A. I. R. (2002) · Journal of neurosurgery · doi:10.3171/jns.2002.97.3.0549 · Cited by 112 · see citing works
Self-citationKimura, T., Morimoto, T., Furukawa, Y., Nakagawa, Y., Kadota, K., Iwabuchi, M., Shizuta, S., Shiomi, H., Tada, T., Tazaki, J., et al. (2011) · Cardiovascular Intervention and Therapeutics · doi:10.1007/s12928-011-0065-0 · Cited by 108 · see citing works
Lambert, J., & Chevret, S. (2014) · Statistical Methods in Medical Research · doi:10.1177/0962280213515571 · Cited by 103 · see citing works
Campos, C. M., Klaveren, D. V., Iqbal, J., Onuma, Y., Zhang, Y., García‐García, H. M., Morel, M., Farooq, V., Shiomi, H., Furukawa, Y., et al. (2014) · Circulation Journal · doi:10.1253/circj.cj-14-0204 · Cited by 73 · see citing works
Self-citationNonparametric Partial Correlation
Quade, D. (1974) · doi:10.1007/978-1-349-02473-5_13 · Cited by 39 · see citing works
A Measure of Explained Variation for Event History Data
Stare, J., Perme, M. P., & Henderson, R. (2010) · Biometrics · doi:10.1111/j.1541-0420.2010.01526.x · Cited by 22 · see citing works
Interpretation of concordance measures for clustered data
Klaveren, D. V., Steyerberg, E. W., & Vergouwe, Y. (2014) · Statistics in Medicine · doi:10.1002/sim.5928 · Cited by 10 · see citing works
Self-citationsurvC1: C-Statistics for Risk Prediction Models with Censored Survival Data
Uno, H. (2011) · doi:10.32614/cran.package.survc1 · Cited by 2 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Moons, K. G. M., Wolff, R. F., Riley, R. D., Whiting, P. F., Westwood, M., Collins, G. S., Reitsma, J. B., Kleijnen, J., & Mallett, S. (2019) · Annals of Internal Medicine · doi:10.7326/m18-1377 · Cited by 1,669 · see citing works
A guide to systematic review and meta-analysis of prediction model performance
Debray, T. P. A., Damen, J. A. A. G., Snell, K. I. E., Ensor, J., Hooft, L., Reitsma, J. B., Riley, R. D., & Moons, K. G. M. (2017) · BMJ · doi:10.1136/bmj.i6460 · Cited by 657 · see citing works
A framework for meta-analysis of prediction model studies with binary and time-to-event outcomes
Debray, T. P., Damen, J. A., Riley, R. D., Snell, K., Reitsma, J. B., Hooft, L., Collins, G. S., & Moons, K. G. (2019) · Statistical Methods in Medical Research · doi:10.1177/0962280218785504 · Cited by 278 · see citing works
Leisman, D. E., Harhay, M. O., Lederer, D. J., Abramson, M., Adjei, A. A., Bakker, J., Ballas, Z. K., Barreiro, E., Bell, S. C., Bellomo, R., et al. (2020) · Critical Care Medicine · doi:10.1097/ccm.0000000000004246 · Cited by 271 · see citing works
Cowley, L., Farewell, D. M., Maguire, S., & Kemp, A. (2019) · Diagnostic and Prognostic Research · doi:10.1186/s41512-019-0060-y · Cited by 265 · see citing works
Kent, D. M., Klaveren, D. V., Paulus, J. K., D’Agostino, R. B., Goodman, S. N., Hayward, R. A., Ioannidis, J. P. A., Patrick‐Lake, B., Morton, S. C., Pencina, M. J., et al. (2019) · Annals of Internal Medicine · doi:10.7326/m18-3668 · Cited by 177 · see citing works
Self-citationMcLernon, D. J., Giardiello, D., CALSTER, B. V., Wynants, L., van Geloven, N., van Smeden, M., Therneau, T. M., Steyerberg, E. W., Initiative, T. G. 6. A. 8. O. T. S., McLernon, D. J., et al. (2022) · Annals of Internal Medicine · doi:10.7326/m22-0844 · Cited by 167 · see citing works
Self-citationSnell, K. I. E., Ensor, J., Debray, T. P. A., Moons, K. G. M., & Riley, R. D. (2017) · Statistical Methods in Medical Research · doi:10.1177/0962280217705678 · Cited by 130 · see citing works
Ramspek, C. L., Evans, M., Wanner, C., Drechsler, C., Chesnaye, N. C., Szymczak, M., Krajewska, M., Torino, C., Porto, G., Hayward, S., et al. (2021) · Journal of the American Society of Nephrology · doi:10.1681/asn.2020071077 · Cited by 91 · see citing works
Wessler, B. S., Nelson, J., Park, J. G., McGinnes, H., Gulati, G., Brazil, R., Van Calster, B., van Klaveren, D., Venema, E., Steyerberg, E., et al. (2021) · Circulation: Cardiovascular Quality and Outcomes · doi:10.1161/circoutcomes.121.007858 · Cited by 83 · see citing works
Self-citationMikolić, A., Polinder, S., Steyerberg, E. W., Helmrich, I. R., Giacino, J. T., Maas, A. I. R., van der Naalt, J., Voormolen, D. C., von Steinbüchel, N., Wilson, L., et al. (2020) · Journal of Neurotrauma · doi:10.1089/neu.2020.7074 · Cited by 70 · see citing works
Self-citationVenema, E., Wessler, B. S., Paulus, J. K., Salah, R., Raman, G., Leung, L. Y., Koethe, B. C., Nelson, J., Park, J. G., Klaveren, D. V., et al. (2021) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2021.06.017 · Cited by 65 · see citing works
Self-citationGulati, G., Upshaw, J., Wessler, B. S., Brazil, R. J., Nelson, J., Klaveren, D. V., Lundquist, C. M., Park, J. G., McGinnes, H., Steyerberg, E. W., et al. (2022) · Circulation Cardiovascular Quality and Outcomes · doi:10.1161/circoutcomes.121.008487 · Cited by 60 · see citing works
Self-citationWynants, L., Kent, D. M., Timmerman, D., Lundquist, C. M., & CALSTER, B. V. (2019) · Diagnostic and Prognostic Research · doi:10.1186/s41512-019-0046-9 · Cited by 45 · see citing works
Predicting disability progression in multiple sclerosis: Insights from advanced statistical modeling
Pellegrini, F., Copetti, M., Sormani, M. P., Bovis, F., de Moor, C., Debray, T. P. A., & Kieseier, B. C. (2019) · Multiple Sclerosis Journal · doi:10.1177/1352458519887343 · Cited by 33 · see citing works
Model-Based ROC Curve: Examining the Effect of Case Mix and Model Calibration on the ROC Plot
Sadatsafavi, M., Saha‐Chaudhuri, P., & Petkau, J. (2021) · Medical Decision Making · doi:10.1177/0272989x211050909 · Cited by 34 · see citing works
Transporting a Prediction Model for Use in a New Target Population
Steingrimsson, J. A., Gatsonis, C. G., Li, B., & Dahabreh, I. J. (2022) · American Journal of Epidemiology · doi:10.1093/aje/kwac128 · Cited by 31 · see citing works
Identifying unreliable predictions in clinical risk models
Myers, P. D., Ng, K., Severson, K., Kartoun, U., Dai, W., Huang, W., Anderson, F. A., & Stultz, C. M. (2020) · npj Digital Medicine · doi:10.1038/s41746-019-0209-7 · Cited by 30 · see citing works
Klaveren, D. V., Rekkas, A., Alsma, J., Verdonschot, R. J. C. G., Koning, D., Kamps, M. J. A., Dormans, T. P. J., Stassen, R. C., Weijer, S., Arnold, K.-S., et al. (2021) · BMJ Open · doi:10.1136/bmjopen-2021-051468 · Cited by 18 · see citing works
Helmrich, I. R., Mikolić, A., Kent, D. M., Lingsma, H. F., Wynants, L., Steyerberg, E. W., & Klaveren, D. V. (2022) · Diagnostic and Prognostic Research · doi:10.1186/s41512-022-00122-0 · Cited by 17 · see citing works
Self-citationHoogland, J., Efthimiou, O., Nguyen, T., & Debray, T. P. A. (2024) · Statistics in Medicine · doi:10.1002/sim.10186 · Cited by 17 · see citing works
Powers, S., McGuire, V. M., Bernstein, L., Canchola, A. J., & Whittemore, A. S. (2017) · Statistical Methods in Medical Research · doi:10.1177/0962280217723945 · Cited by 12 · see citing works
Quandt, F., Meißner, N., Wölfer, T. A., Flottmann, F., Deb‐Chatterji, M., Kellert, L., Fiehler, J., Goyal, M., Saver, J. L., Gerloff, C. P., et al. (2022) · European Stroke Journal · doi:10.1177/23969873221142642 · Cited by 11 · see citing works
de Winkel, J., Maas, C. C. H. M., Roozenbeek, B., Klaveren, D. V., & Lingsma, H. F. (2024) · BMC Medical Research Methodology · doi:10.1186/s12874-024-02280-9 · Cited by 10 · see citing works
External validation of prognostic models predicting outcome after chronic subdural hematoma
Holl, D. C., Mikolić, A., Blaauw, J., Lodewijkx, R., Foppen, M., Jellema, K., Gaag, N. A. V. D., den Hertog, H. M., Jacobs, B., van der Naalt, J., et al. (2022) · Acta Neurochirurgica · doi:10.1007/s00701-022-05216-8 · Cited by 9 · see citing works
de Winkel, J., Roozenbeek, B., Dijkland, S. A., Dammers, R., van Doormaal, P., van der Jagt, M., Klaveren, D. V., Dippel, D. W. J., & Lingsma, H. F. (2024) · BMC Neurology · doi:10.1186/s12883-024-03546-x · Cited by 6 · see citing works
Prognostic models for COVID-19 needed updating to warrant transportability over time and space
van Klaveren, D., Zanos, T. P., Nelson, J., Levy, T. J., Park, J. G., Retel Helmrich, I. R. A., Rietjens, J. A. C., Basile, M. J., Hajizadeh, N., Lingsma, H. F., et al. (2022) · BMC Medicine · doi:10.1186/s12916-022-02651-3 · Cited by 5 · see citing works
Klaveren, D. V., Steyerberg, E. W., Gönen, M., & Vergouwe, Y. (2019) · Diagnostic and Prognostic Research · doi:10.1186/s41512-019-0055-8 · Cited by 5 · see citing works
Self-citationde Jong, V. M. T., Hoogland, J., Moons, K. G. M., Riley, R. D., Nguyen, T., & Debray, T. P. A. (2023) · Statistics in Medicine · doi:10.1002/sim.9817 · Cited by 5 · see citing works
Scheerders, E. R. Y., Klaveren, D. V., Malskat, W. S. J., van Rijn, M. J. E., van der Velden, S. K., Nijsten, T. E. C., & van den Bos, R. R. (2024) · European Journal of Vascular and Endovascular Surgery · doi:10.1016/j.ejvs.2024.05.001 · Cited by 4 · see citing works
Harnessing multi-source data for individualized care in Hodgkin Lymphoma
Parsons, S. K., Rodday, A. M., Upshaw, J. N., Scharman, C. D., Zhu, C., Cao, Y., Tiger, Y. K., Maurer, M. J., & Evens, A. M. (2024) · Blood Reviews · doi:10.1016/j.blre.2024.101170 · Cited by 4 · see citing works
Extending prediction models for use in a new target population with failure time outcomes
Steingrimsson, J. A. (2022) · Biostatistics · doi:10.1093/biostatistics/kxac011 · Cited by 3 · see citing works
Mikolić, A., Brasher, P. M. A., Brubacher, J. R., Panenka, W. J., Scheuermeyer, F. X., Archambault, P. M., Khazei, A., & Silverberg, N. D. (2024) · Journal of Neurotrauma · doi:10.1089/neu.2023.0484 · Cited by 2 · see citing works
Mijderwijk, H.-J., de Winkel, J., Nieboer, D., Abdelaal, A., Germans, M. R., Karadağ, C., Cornelius, J. F., Sorteberg, A. G., Roozenbeek, B., Lingsma, H. F., et al. (2024) · Neurosurgery · doi:10.1227/neu.0000000000003275 · Cited by 2 · see citing works
Performance of Heart Failure Clinical Prediction Models: A Systematic External Validation StudyPreprint
Upshaw, J. N., Nelson, J., Koethe, B. C., Park, J. G., McGinnes, H. L., Wessler, B. S., Konstam, M. A., Udelson, J. E., CALSTER, B. V., Klaveren, D. V., et al. (2021) · medRxiv · doi:10.1101/2021.01.31.21250875 · Cited by 2 · see citing works
Self-citationHegarty, S. E., Linn, K. A., Zhang, H., Teeple, S., Albert, P. S., Parikh, R. B., Courtright, K. R., Kent, D. M., & Chen, J. (2025) · medRxiv · doi:10.1101/2025.01.31.25321489 · Cited by 1 · see citing works
Wessler, B. S., Nelson, J., Park, J. G., McGinnes, H. L., Upshaw, J. N., CALSTER, B. V., Klaveren, D. V., Steyerberg, E. W., & Kent, D. M. (2021) · medRxiv · doi:10.1101/2021.01.21.21250234
Self-citationGulati, G., Brazil, R., Nelson, J., Klaveren, D. V., Lundquist, C. M., Park, J. G., McGinnes, H. L., Steyerberg, E. W., CALSTER, B. V., Wessler, B. S., et al. (2021) · medRxiv · doi:10.1101/2021.01.31.21250871
Self-citationRiley, R. D., Tierney, J. F., & Stewart, L. A. (2021) · Wiley eBooks · doi:10.1002/9781119333784.refs5
The SweDen risk score- predicting death 1-year after myocardial infarctionPreprint
Rylance, R. T., Wagner, P., Olesen, K. K. W., Carlson, J., Alfredsson, J., Jernberg, T., Leósdóttir, M., Johansson, P., Vasko, P., Mæng, M., et al. (2022) · medRxiv · doi:10.1101/2022.09.14.22279852
Rylance, R. T., Wagner, P., Olesen, K. K. W., Carlson, J., Alfredsson, J., Jernberg, T., Leósdóttir, M., Johansson, P., Vasko, P., Mæng, M., et al. (2022) · Open Heart · doi:10.1136/openhrt-2022-002143
Prognostic and treatment effect modeling in medical research
Hoogland, J. (2023) · doi:10.33540/1789
Kiratipaisarl, W., Surawattanasakul, V., Sirikul, W., & Phinyo, P. (2025) · Journal of Clinical Medicine · doi:10.3390/jcm14217617
de Winkel, J., Roozenbeek, B., Dijkland, S. A., Dammers, R., van Doormaal, P., van der Jagt, M., van Klaveren, D., Dippel, D. W. J., & Lingsma, H. F. (2024) · Figshare · doi:10.6084/m9.figshare.26681041
Self-citationvan Klaveren, D., Zanos, T. P., Nelson, J., Levy, T. J., Park, J. G., Retel Helmrich, I. R. A., Rietjens, J. A. C., Basile, M. J., Hajizadeh, N., Lingsma, H. F., et al. (2022) · Figshare · doi:10.6084/m9.figshare.21622824
Self-citationHelmrich, I. R., Mikolić, A., Kent, D. M., Lingsma, H. F., Wynants, L., Steyerberg, E. W., & van Klaveren, D. (2022) · Figshare · doi:10.6084/m9.figshare.19711396
Self-citationde Winkel, J., Maas, C. C. H. M., Roozenbeek, B., van Klaveren, D., & Lingsma, H. F. (2024) · Figshare · doi:10.6084/m9.figshare.26758733
Self-citationLiu, Y., Qiu, J., Jin, Y., Dong, J., Li, J., Wang, J., Duan, Y., Zhang, Z., Zhuo, Z., & Liu, Y. (2026) · European Journal of Radiology · doi:10.1016/j.ejrad.2026.113257
- Authors
- van Klaveren, D., Gönen, M., Steyerberg, E. W., & Vergouwe, Y.
- Affiliations
- Department of Public Health Erasmus University Medical Center Rotterdam The Netherlands
- Memorial Sloan Kettering Cancer Center (US)
- Erasmus MC (NL)
- Venue
- Statistics in Medicine
- Publisher
- Wiley
- Published
- 2016-06
- Volume
- 35
- Issue
- 23
- Pages
- 4136-4152
- ISSN
- 0277-6715 (ISSN-L)
- 1097-0258
- PMC
- PMC5550798
- OpenAlex
- W2417826452
- Cited by
- 48
- References
- 24
- Citations by year
- 2026: 2 · 2025: 2 · 2024: 8 · 2023: 2 · 2022: 12 · 2021: 9 · 2020: 3 · 2019: 5 · 2018: 2 · 2017: 3
- FWCI
- 3.37
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Licence
- Locations
- Statistics in Medicine (publishedVersion)
- PubMed (publishedVersion)
- EUR Research Repository (Erasmus University Rotterdam) (publishedVersion)
- Europe PMC (PubMed Central) (acceptedVersion)
- PubMed Central (acceptedVersion)
- EUR Research Repository (Erasmus University Rotterdam) (submittedVersion)
- Funders
- Netherlands Organisation for Scientific Research (917.11.383.)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Inference
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Keywords
- concordance measures, risk prediction model, external validation, concordance index, Harrell's C-index, censoring, time-to-event data, proportional hazards model, logistic regression, forecast calibration, discriminatory power, variance estimation
- MeSH terms
- Diagnosis-Related Groups, Humans, Models, Statistical, Logistic Models
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review