The Comparison and Evaluation of Forecasters
The DOI matches its Crossref record; 19 of the 19 references it cites were found in a registry or an index.
Abstract
Morris H. DeGroot, Stephen E. Fienberg, The Comparison and Evaluation of Forecasters, Journal of the Royal Statistical Society. Series D (The Statistician), Vol. 32, No. 1/2, Proceedings of the 1982 I.O.S. Annual Conference on Practical Bayesian Statistics (Mar. - Jun., 1983), pp. 12-22
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“DeGroot and Fienberg (1983) showed that these two terms make up proper scoring rules in general, and that probabilistic predictions should minimise refinement loss subject to calibration.”
From Classifier calibration: a survey on how to assess and improve predicted class probabilities (2023) · cites this paper as DeGroot and Fienberg (1983)
Citations
Cites
Discrete Multivariate Analysis: Theory and Practice.
Beniger, J. R., Bishop, Y. M. M., Feinberg, S. E., Holland, P. W., Light, R. J., & Mosteller, F. (1975) · Contemporary Sociology · doi:10.2307/2063625 · Cited by 5,108
Optimal Statistical Decisions.
Siegmund, D., & DeGroot, M. H. (1972) · Journal of the American Statistical Association · doi:10.2307/2284675 · Cited by 3,386
Self-citationThe Analysis of Cross-Classified Categorical Data
Drane, J. W. (1979) · Technometrics · doi:10.1080/00401706.1979.10489789 · Cited by 1,941
Self-citationElicitation of Personal Probabilities and Expectations
Savage, L. J. (1971) · Journal of the American Statistical Association · doi:10.1080/01621459.1971.10482346 · Cited by 1,226
Theory of Games and Statistical Decisions.
Vajda, S., Blackwell, D., & Girshick, M. A. (1955) · Journal of the Royal Statistical Society. Series A (General) · doi:10.2307/2342525 · Cited by 1,032
Blackwell, D. (1951) · Proceedings of the Second Berkeley Symposium on Mathematical Statistics and Probability · doi:10.1525/9780520411586-009 · Cited by 1,024
Dawid, A. P. (1982) · Journal of the American Statistical Association · doi:10.1080/01621459.1982.10477856 · Cited by 625
Reliability of Subjective Probability Forecasts of Precipitation and Temperature
Murphy, A. H., & Winkler, R. L. (1977) · Applied Statistics · doi:10.2307/2346866 · Cited by 386
On the Reconciliation of Probability Assessments
Lindley, D. V., Tversky, A., & Brown, R. V. (1979) · Journal of the Royal Statistical Society. Series A (General) · doi:10.2307/2345078 · Cited by 340
Admissible Probability Measurement Procedures
Shuford, E. H., Albert, A., & Massengill, H. E. (1966) · Psychometrika · doi:10.1007/bf02289503 · Cited by 257
Cited by
Items 501–600 of 604
Stoppa, F., Bhattacharyya, S., de Austri, R. R., Vreeswijk, P. M., Caron, S., Zaharijaš, G., Bloemen, S., Principe, G., Malyshev, D. V., Vodeb, V., et al. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2307.14456 · Cited by 4
The ABC’s of Who Benefits from Working with AI: Ability, Beliefs, and CalibrationPreprint
Caplin, A., Deming, D. J., Li, S., Martin, D. F., Marx, P., Weidmann, B., & Ye, K. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4978700 · Cited by 1
Calibrated Associative Classification
Veloso, A., & Meira, W. (2011) · SpringerBriefs in computer science · doi:10.1007/978-0-85729-525-5_7
Machine Learning Techniques in Applied Econometrics
Sengupta, N. (2015) · KiltHub Repository · doi:10.1184/r1/6720464
Satopää, V., Pemantle, R., & Ungar, L. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1501.06943
Risk Neutral Calibration of Classifiers
Coleman, R. (2003) · Lecture notes in computer science · doi:10.1007/3-540-44886-1_36
“DeGroot and Fienberg [4] investigate classifiers in terms of calibration and refinement which is a measure how close probability estimates comes to zero or one, that is, whether the prediction is unequivocal.”
BackgroundDeGroot, M. H. (2005) · Encyclopedia of Statistical Sciences · doi:10.1002/0471667196.ess2919.pub2
Self-citationLearning from Experts: A SurveyPreprint
Valsecchi, I. (2008) · arXiv (Cornell University) · doi:10.48550/arxiv.0807.2931
Applications Of Machine Learning In Biology And Medicine
Shahri, S. H. (2015)
Quantitative Methods in Population Health: Extensions of Ordinary Regression
Hade, E. M. (2005) · Journal of the American Statistical Association · doi:10.1198/jasa.2005.s18
“Also, the work on calibrating probability forecasters (cf. DeGroot and Fienberg 1983) is relevant, as is more detail on elicitation (cf. Kadane and Winkler 1988).”
BackgroundThe use of utilities and experts in decision-making
Garisch, I., Waal, D., & Groenewald, P. C. N. (1991) · Communication in Statistics- Theory and Methods · doi:10.1080/03610929108830501
Testing Probability Calibrations: Application to Credit Scoring Models
Leippold, M. (2006)
Economic Attributes of Bankruptcy Probabilities Estimated by Maximum Likelihood
Johnstone, D. J. (2009)
Polski, J. P., Smith, R., & Garrett, R. (2011) · Cited by 27
Philosophy of Science Association
Seidenfeld, T. (2010)
DOCTEUR DE L'UNIVERSITÉ DU LUXEMBOURG EN INFORMATIQUE
Bahnsen, A. C. (2015)
Partial orderings of default predictions
Krämer, W., & Posch, P. N. (2015) · Technische Universität Dortmund Eldorado (Technische Universität Dortmund) · doi:10.17877/de290r-16279
Combination Forecasts Based on Markov Chain Monte Carlo Estimation of the Mode
Pang, W.-K., Wong, H., Chan, C. K., & Troutt, M. D. (2011) · IGI Global eBooks · doi:10.4018/978-1-59140-057-8.ch012
Predictive evaluation of logistic models
Seillier‐Moiseiwitsch, F. (1992)
Noble Ape’s Cognitive Simulation
Barbalet, T. S. (2011) · IGI Global eBooks · doi:10.4018/978-1-60960-818-7.ch709
Multivariate Data Modeling and Its Applications to Conditional Outlier Detection
Hong, C. (2018) · D-Scholarship@Pitt (University of Pittsburgh)
On the Calibration of Nested Dichotomies for Large Multiclass TasksPreprint
Leathart, T., Frank, E., Pfahringer, B., & Holmes, G. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1809.02744 · Cited by 1
“Probability calibration for binary classification tasks can be visualised through reliability diagrams (DeGroot and Fienberg 1983).”
Quantifying the uncertainty of event detection in full motion video
Oggero, S., Knegjens, R., Neumann, N. M. P., den Hollander, R. J. M., Burghouts, G. J., & van den Broek, S. P. (2018) · Counterterrorism, Crime Fighting, Forensics, and Surveillance Technologies · doi:10.1117/12.2326671
A Lattice of GamblesPreprint
Cuff, P., Cover, T. M., Kumar, G. R., & Zhao, L. (2012) · arXiv (Cornell University) · doi:10.48550/arxiv.1208.4414
van Leeuwen, D. A., & Brümmer, N. (2014) · Radboud Repository (Radboud University)
Self-Confidence Measures of a Decision Support System Based on Bayesian Networks
Koźniewski, M. (2019) · D-Scholarship@Pitt (University of Pittsburgh)
Characterizing Sources of Uncertainty to Proxy Calibration and Disambiguate Annotator and Data Bias
Ghandeharioun, A., Eoff, B. D., Jou, B., & Picard, R. W. (2019) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2019.00517 · Cited by 15
“Additionally, variations of reliability diagram have been used to show the discrepancy between confidence and accuracy [10, 17, 4].”
MethodRegularising Deep Networks with Deep Generative ModelsPreprint
Willetts, M., Camuto, A., Roberts, S., & Holmes, C. C. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1909.11507 · Cited by 1
“…as you are confident: p(ŷ = y|p̂ = r) = r, ∀r ∈ [0, 1] (25) To see how closely a model approaches perfect calibration, we plot reliability diagrams (Degroot and Fienberg, 1982; Niculescu-Mizil and Caruana, 2005), which show the accuracy of a model as a function of its confidence over M bins…”
BackgroundMethodEM with Bias-Corrected Calibration is Hard-To-Beat at Label Shift AdaptationPreprint
Alexandari, A. M., Kundaje, A. B., & Shrikumar, A. (2019) · arXiv (Cornell University)
Probability Forecasts and Prediction Markets
Mortera, J., & Dawid, A. P. (2022) · Springer series in the data sciences · doi:10.1007/978-3-030-75460-0_6
Individual Survival Distributions: A More Effective Tool for Survival Prediction
Haider, H. (2019) · ERA: Education and Research Archive (University of Alberta) · doi:10.7939/r3-srr8-2788
Qualitätsvergleiche bei Kreditausfallprognosen
Krämer, W. (2005) · Physica-Verlag eBooks · doi:10.1007/3-7908-1606-x_23
Structured DropConnect for Uncertainty Inference in Image ClassificationPreprint
Zheng, W., Xie, J., Liu, W., & Ma, Z. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.08624
“Since exact Bayesian inference is computationally intractable for DNNs, the approximation of the BNN is a hot topic of current research, including deterministic approaches [3], Markov chain Monte Carlo with Hamiltonian dynamics [18], and variational inference [5].”
BackgroundTeaching Uncertainty Quantification in Machine Learning through Use CasesPreprint
Valdenegro-Toro, M. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2108.08712
CoG: a Two-View Co-training Framework for Defending Adversarial Attacks on GraphPreprint
Wu, X., Wu, H., Zhou, X., & Lü, K. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2109.05558
“In the main paper, we use the reliability diagram to demonstrate the miscalibration of GCN. Reliability diagram is a visual representation of model calibration [7,22,11].”
Quantifying Model Predictive Uncertainty with Perturbation TheoryPreprint
Singh, R., & Príncipe, J. C. (2021) · arXiv (Cornell University) · Cited by 1
Frustratingly Easy Uncertainty Estimation for Distribution ShiftPreprint
Salvador, T., Voleti, V., Iannantuono, A., & Oberman, A. M. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.03762 · Cited by 4
“CPCS [Park et al., 2020] minimizes the Brier Score [DeGroot and Fienberg, 1983] weighted by w. TransCal [Wang et al., 2020] minimizes ECE weighted by w, with additional terms to correct for bias and variance in the expectations.”
BackgroundMethodA cluster based model for brain activity data staging
Fonseca, A. R. O., Deolindo, C. S., Miranda, T. A. B., Morya, E., Amaro, E., & Machado, B. S. (2021) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2021.103200
Xu, M., Zhou, Y., Jin, C., de Groot, M., Oxtoby, N. P., Alexander, D. C., & Jacob, J. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.12179
Open set recognition through Monte Carlo dropout-based uncertainty
Schaefer, G., Hu, Q., & Yin, X. (2021) · International Journal of Bio-Inspired Computation · doi:10.1504/ijbic.2021.10043757
Taroni, F., Biedermann, A., Bozza, S., Garbolino, P., & Aitken, C. G. G. (2014) · Wiley eBooks · doi:10.1002/9781118914762.refs
Jolliffe, I. T., & Stephenson, D. B. (2011) · Wiley eBooks · doi:10.1002/9781119960003.refs
Aitken, C. G. G., Taroni, F., & Bozza, S. (2020) · Wiley eBooks · doi:10.1002/9781119245438.ref
Arnold, B. C., & Sarabia, J. M. (2018) · Statistics for social and behavioral sciences · doi:10.1007/978-3-319-93773-1_11
DeGroot, M. H. (2005) · Encyclopedia of Statistical Sciences · doi:10.1002/0471667196.ess3079.pub2
Self-citationDeGroot, M. H. (2004) · Encyclopedia of Statistical Sciences · doi:10.1002/0471667196.ess2919
Self-citationParmigiani, G., & Inoue, L. Y. T. (2009) · Wiley series in probability and statistics · doi:10.1002/9780470746684.refs
Cooke, R. M. (1986) · Elsevier eBooks · doi:10.1016/b978-0-08-032566-8.50033-3
DeGroot, M. H. (2004) · Encyclopedia of Statistical Sciences · doi:10.1002/0471667196.ess3079
Self-citation(1994) · Wiley series in probability and statistics · doi:10.1002/9780470316870.refs
DeGroot, M. H. (2014) · Wiley StatsRef: Statistics Reference Online · doi:10.1002/9781118445112.stat00255
Self-citationDeGroot, M. H. (2014) · Wiley StatsRef: Statistics Reference Online · doi:10.1002/9781118445112.stat00252
Self-citationAdaptive Confidence Calibration
Pearce, J., & Meger, D. (2022) · doi:10.21428/594757db.85f0799f
Interpolation-aware models for train-test consistency in mixup
Hu, Y., Han, C., & Guo, T. (2022) · International Conference on Computer Science and Communication Technology (ICCSCT) · doi:10.1117/12.2661854
“Also, Figure 3 plots a variant of reliability diagrams 33 on 1 -mixup and λ -mixup .”
BackgroundReducing classifier overconfidence against adversaries through graph algorithms
Teixeira, L. V., Jalaian, B. A., & Ribeiro, B. (2023) · Machine Learning · doi:10.1007/s10994-023-06307-y · Cited by 1
“While the topic of calibration has been extensively studied for decades, from the analysis of weather forecasters in the 80 s (DeGroot & Fienberg, 1983), to the standard machine learning classifiers such as SVM (Platt, 1999), Logistic Regression, Naïve Bayes and others (Naeini et al., 2015;…”
BackgroundPrediction Interval of Interface Regions: Machine Learning Nowcasting Approach
Alielden, K., Camporeale, E., Korsós, M. B., & Taroyan, Y. (2023) · Space Weather · doi:10.1029/2022sw003326 · Cited by 3
“A reliability diagram is used to visualize the relationship between the predicted and observed frequencies/probabilities (DeGroot & Fienberg, 1983).”
MethodIncorporating Uncertainty Quantification for the Performance Improvement of Academic Recommenders
Zhu, J., Novelo, L. L., & Yaseen, A. S. (2023) · Knowledge · doi:10.3390/knowledge3030020 · Cited by 1
Dual-Stage OOD Detection Learning with an Unsupervised Start
Kongmanee, J., Thanapattheerakul, T., & Chignell, M. (2023) · doi:10.1145/3628454.3628497
“We used the reliability diagrams introduced in [7, 27] to show if the model was well-calibrated. diagrams plot the expected accuracy of samples as a function of confidence.”
MethodSeckler, H., & Metzler, R. (2023) · Nature Communications · doi:10.1038/s41467-023-43850-7
Beyond Thresholds: A General Approach to Sensor Selection for Practical Deep Learning-based HAR
Cooper, G., & Marculescu, R. (2024) · IEEE/ACM International Conference on Internet-of-Things Design and Implementation (IoTDI) · doi:10.1109/iotdi61053.2024.00005
Rehder, E., & Cordts, M. (2024) · ATZ/MTZ-Fachbuch · doi:10.1007/978-3-658-38486-9_44
Guillon, H., Lane, B., Byrne, C. F., Sandoval-Solís, S., & Pasternack, G. B. (2024) · Earth Surface Processes and Landforms · doi:10.1002/esp.5984
Krzysztofowicz, R. (2024) · Wiley eBooks · doi:10.1002/9781394319060.ref
Probabilistic Forecast of the Ancillary Services Market's Results in a Central Dispatching ModelPreprint
Koechlin, G., Bovera, F., & Secchi, P. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.5063033
Interplay between Bayesian Neural Networks and Deep Learning: A SurveyPreprint
Chen, Y., Yu, S. S., Li, Z., Eshraghian, J. K., & Lim, C. P. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5100162 · Cited by 1
Introduction to the Special Issue on Contemporary Bayesian Prediction
Clarke, B. S., & Rigo, P. (2025) · Statistical Science · doi:10.1214/24-sts963
Forecasts as repeated cheap talk from an expert of unknown statistical bias
Valsecchi, I. (2025) · Journal of Economic Behavior & Organization · doi:10.1016/j.jebo.2025.106955
Ohta, N., Shimomoto, K., Naito, H., Kashino, M., Yoshida, S., & Fukatsu, T. (2025) · Horticulturae · doi:10.3390/horticulturae11050525
GBCE: Enhanced Training Loss to Estimate Accuracy of Models in Production
Matsuno, R. (2025) · Lecture notes in computer science · doi:10.1007/978-981-96-8180-8_3
An Empirical Review of Uncertainty Estimation for Quality Control in CAD Model Segmentation
Vidanes, G., Toal, D. J. J., Keane, A. J., Zhang, D. X., Nuñez, M., & Gregory, J. (2025) · Communications in computer and information science · doi:10.1007/978-3-031-96196-0_4
Tabata, S., Ikawa, F., Toyoda, Ḱ., Yamamoto, R., Kobayashi, S., Kurita, H., & Japan Stroke Data Bank Investigators (2025) · Neurosurgical Review · doi:10.1007/s10143-025-03676-x
“To evaluate the calibration of each scale, we defined the WFNS scale as equally binning the predicted probability of an unfavorable outcome into five subsets and drew a reliability diagram [15–17].”
Geysels, A., CALSTER, B. V., Moor, B. D., Froyman, W., & Timmerman, D. (2025) · Lecture notes in computer science · doi:10.1007/978-3-032-05182-0_6
Mei, Y., Fukushima, H., Miyazaki, Y., & Sato, F. (2025) · International Journal of Automotive Engineering · doi:10.20485/jsaeijae.16.4_112
Information-Theoretic Measures of Metacognition: Bounds and Relation to Group Performance
Meyen, S., Göppert, F., Schrenk, C., von Luxburg, U., & Franz, V. H. (2025) · Open Mind · doi:10.1162/opmi.a.40 · Cited by 5
“In the probability elicitation literature, these two facets are called (1) refinement vs. (2) calibration (DeGroot & Fienberg, 1983).”
Functional Limit Theorems for Probability Forecasts
Nolan, D. (1992) · Birkhäuser Boston eBooks · doi:10.1007/978-1-4612-0367-4_30
Moskvichev, P., & Sejdinović, D. (2025) · Lecture notes in computer science · doi:10.1007/978-981-95-4969-6_21 · Cited by 1
Budgeted Probabilistic Early-Warning Expert System for FX Drawdowns: Design and EUR/USD Case StudyPreprint
Bustarviejo, J., & Bousoño-Calzón, C. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5885956
Ahmad, A., & Idaghdour, Y. (2025) · International Conference on Information Technology Trends (ITT) · doi:10.1109/itt69610.2025.11352933
“Calibration slope [3], AUC [4], Matthews correlation coefficient (MCC) [5], Brier skill score (BSS) [6], and decision-curve net benefit (NB) [7] each capture distinct properties.”
DGSite: A Well-Calibrated Deep Learning Framework for Protein–RNA Binding Site Prediction
Zeng, X., Zhao, L., Wang, H., Zhou, D., Cheng, Y., & Shi, S. (2026) · ACS Omega · doi:10.1021/acsomega.5c12723
Advances in Deep Gaussian Processes : calibration and sparsification
Tran, G.-L. (2020) · theses.fr (ABES) · doi:10.70675/e9163c07z1f0bz4ff2z8c53z17721e5bee8c
Improving Scalability and Inference in Probabilistic Deep Models
Rossi, S. (2022) · theses.fr (ABES) · doi:10.70675/807ea578zd70dz4898zb642zb1cdc00dcd86
Robust Machine Learning Approaches to Wireless Communication Networks
Zecchin, M. (2022) · theses.fr (ABES) · doi:10.70675/9a17dfe5z7c45z4353z8d5dzfac2445840ad
taheri, M., & Klidbary, S. H. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.6829451
Bayesian outcome-specific ensemble modeling for football outcome prediction
Pitso, S. D., Michael, T., & Mosia, M. (2026) · Frontiers in Applied Mathematics and Statistics · doi:10.3389/fams.2026.1754408
A Zero-Inflated Mixed-Effects Spatial Point Process for Grouped Storm Loss Data
Gao, L. Y., Jessup, S., & Yan, T. (2026) · North American Actuarial Journal · doi:10.1080/10920277.2026.2720934
“We also assess the calibration of the zero-inflation in the storm-level claim frequency by examining the reliability curve for the probability of zero claims (DeGroot and Fienberg, 1983).”
Cao, D. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.7049119
Classification in Psychological Research
Kovač, N., Ratković, K., Simeunović, M., Marovac, U., Farahani, H., & Zhao, L. (2026) · Springer eBooks · doi:10.1007/978-3-032-18312-5_18
Huynh, T. T., Trinh, V.-Q., Huynh, D., & Le, N.-H. (2026) · Journal of Information Security and Applications · doi:10.1016/j.jisa.2026.104659 · Cited by 1
Mehmood, S., Alharbi, A. A. K., Alkhattabi, M., Khan, M. A., & Amir, M. '. (2026) · Frontiers in Medicine · doi:10.3389/fmed.2026.1959061
“We assessed model calibration using a comprehensive suite of metrics to address the known limitations of any single measure (54, 55, 59 – 61).”
Lu, B., Zhang, N., Wang, Q., Wang, S., Yang, Z., & Chen, J. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.7629643
Calibration Results for Established Post-hoc Calibration Methods
Huang, W. (2025) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.5281/zenodo.15868156
An Evaluation of Calibration Methods for Data Mining Models in Simulation Problems
Sanjuán, A. B. (2011)
Spoken language variety recognition in Dutch
van Leeuwen, D. A., Dr, H., & Niesler, T. (2014) · Radboud Repository (Radboud University)
Probability Elicitation Methods for Avoiding Biases: An Exposition
Mihajlovits, B. H. (2009) · VCU Scholars Compass (Virginia Commonwealth University) · doi:10.25772/rh2c-wp02
Metadata
- Authors
- DeGroot, M. H., & Fienberg, S. E.
- Affiliations
- Carnegie Mellon University (US)
- Venue
- The Statistician
- Publisher
- JSTOR
- Published
- 1983-03
- Volume
- 32
- Issue
- 1/2
- Pages
- 12
- ISSN
- 0039-0526 (ISSN-L)
- OpenAlex
- W1599263113
- Cited by
- 604
- References
- 18
- Citations by year
- 2026: 14 · 2025: 38 · 2024: 32 · 2023: 51 · 2022: 42 · 2021: 52 · 2020: 48 · 2019: 36 · 2018: 26 · 2017: 20 · 2016: 16 · 2015: 21 · 2014: 12 · 2013: 17 · 2012: 14
- FWCI
- 5.36
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Journal of the Royal Statistical Society Series D (The Statistician) (publishedVersion)
- Defense Technical Information Center (DTIC) (submittedVersion)
- Topics
- Social Sciences › Decision Sciences › Management Science and Operations Research › Forecasting Techniques and Applications
- Physical Sciences › Mathematics › Statistics and Probability › Probability and Statistical Research
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Keywords
- forecast accuracy
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.