Uncertainty as a Form of Transparency: Measuring, Communicating, and Using Uncertainty
Open accessThe DOI matches its Crossref record; 228 of the 229 references it cites were found in a registry or an index, and 1 are not checked yet; 41 of the 135 sources its claims cite were checked for support.
Abstract
Algorithmic transparency entails exposing system properties to various stakeholders for purposes that include understanding, improving, and contesting predictions. Until now, most research into algorithmic transparency has predominantly focused on explainability. Explainability attempts to provide reasons for a machine learning model's behavior to stakeholders. However, understanding a model's specific behavior alone might not be enough for stakeholders to gauge whether the model is wrong or lacks sufficient knowledge to solve the task at hand. In this paper, we argue for considering a complementary form of transparency by estimating and communicating the uncertainty associated with model predictions. First, we discuss methods for assessing uncertainty. Then, we characterize how uncertainty can be used to mitigate model unfairness, augment decision-making, and build trustworthy systems. Finally, we outline methods for displaying uncertainty to stakeholders and recommend how to collect information required for incorporating uncertainty into existing ML pipelines. This work constitutes an interdisciplinary review drawn from literature spanning machine learning, visualization/HCI, design, decision-making, and fairness. We aim to encourage researchers and practitioners to measure, communicate, and use uncertainty as a form of transparency.
Verified 2026-11-19 · 1 reference not checked yet
Overview
CoChat Summary
TL;DR
This paper argues that estimating and communicating uncertainty should be treated as a complementary form of algorithmic transparency alongside explainability. It reviews methods for measuring uncertainty and discusses how uncertainty can support fairness, decision-making, trust, and stakeholder communication.
Key findings
- Uncertainty is split into aleatoric uncertainty (irreducible noise/class overlap) and epistemic uncertainty (reducible with more data); calibration is a precursor to using uncertainty as transparency, and deep ensembles are described as one of the best-performing uncertainty quantification approaches for neural networks, retaining calibration under dataset shift.
- Uncertainty can help address fairness issues: representation bias is epistemic and may be detected via large epistemic uncertainty on validation/deployment data, while feature and label noise are aleatoric and can distort fairness assessments; even a small amount of label noise can greatly impact fairness evaluation.
- In decision-making, uncertainty supports reject options and decision-theoretic action selection; JDM findings indicate risk is considered together with expected outcome, asymmetrically, and tolerance for uncertainty decreases superlinearly as stakes increase.
- Communication is difficult: in a 2010 US/Germany survey, 20% could not identify 10% as the biggest disease risk among 1%, 5%, and 10%, and almost 30% could not answer whether 1 in 10, 1 in 100, or 1 in 1000 represents the largest risk; people interpreted the IPCC’s “very likely” as around 60% probability, whereas the guideline specifies greater than 90%. Quantile dot plots and hypothetical outcome plots (HOPs) are reported to improve some probability/uncertainty judgments.
Methods
- Interdisciplinary literature review, not an empirical study, drawn from machine learning, visualization/HCI, design, decision-making, and fairness.
- Uses a recurring breast cancer diagnostics scenario to illustrate uncertainty in fairness, decision-making, trust formation, and communication.
- Synthesizes uncertainty quantification approaches (Bayesian methods, frequentist methods such as ensembles), evaluation metrics (calibration, NLL, Brier score, ECE), and communication methods (categories, numerical ranges, summary statistics, full distributions, visualizations).
Limitations
- The paper states that its findings should not be treated as conclusive for predicting real-world usability and recommends testing with real users in concrete tasks and settings.
- The paper states that empirical understanding of how decision-makers use aleatoric versus epistemic uncertainty is limited, that JDM literature has mostly focused on discrete outcomes, and that there is not a good understanding of how people perceive uncertainty over continuous outcomes such as error bars.
- Evident from the text: as a review, it provides no primary empirical validation or systematic review protocol; several claims are speculative or drawn from other fields and are framed as open questions for future research.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures




![(c) Cone of uncertainty, showing the uncertainty around the predicted path of the center of a hurricane. Taken from [93].](https://figures.cochat.ai/paper-figures/42e1c0dd14b540788474c4bee4ed993b/uncertainty-as-a-form-of-transparency-measuring-communicating-and-using-figure-5.png)

Verification
Claims the paper makes
28 Valid · 10 Not valid · 60 Not checked · 104 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“When information on the sensitive attribute is unavailable (e.g., information on gender was not collected), but can be predicted from an auxiliary dataset, disparity measures are generally unidentifiable [20,63].”
§ Uncertainty as a Form of Transparency: Measuring, Communicating, and Using Uncertainty > 3.1 Uncertainty and Fairness
What the sources say
- Partly supportedcites [20] 20. Jiahao Chen, Nathan Kallus, Xiaojie Mao, Geoffry Svacha, and Madeleine Udell. 2019. Fairness under unawareness: Assessing disparity when protected class is unobserved. In Proceedings of the conference on fairness, accountability, and transparency. 339-348. sourceExperimental — accuracy not yet measured
Section 1.1 (p. 2) describes assessing disparity when protected-class labels are unavailable and must be imputed from proxy variables. The paper analyzes bias in the resulting disparity estimates, but the cited passages do not establish the broader claim that disparity measures are generally unidentifiable; the Conclusions (p. 9) instead note that the optimal imputation threshold cannot be determined without ground-truth labels. (LLM, conf=0.82)
- Supportedcites [63] 63. Nathan Kallus, Xiaojie Mao, and Angela Zhou. 2019. Assessing algorithmic fairness with unobserved protected class using data combination. arXiv preprint arXiv:1906.00285 (2019). source
The paper’s problem formulation describes a primary dataset missing protected-class labels and an auxiliary dataset containing those labels and proxy variables. Section 4 states that disparity measures are generally unidentifiable from the two datasets because their marginals do not uniquely determine the full joint distribution. The paper notes an exception for perfectly predictive proxies, consistent with the claim’s qualifier ‘generally.’ (LLM, conf=0.94)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“The experimental results of Gupta et al. [44] have shown that enforcing fairness constraints on a noisy sensitive attribute, without assumptions on the structure of the noise, is not guaranteed to lead to any improvement in the fairness properties of our model.”
§ Uncertainty as a Form of Transparency: Measuring, Communicating, and Using Uncertainty > 3.1 Uncertainty and Fairness
What the sources say
- Partly supportedcites [44] 44. Maya Gupta, Andrew Cotter, Mahdi Milani Fard, and Serena Wang. 2018. Proxy fairness. arXiv preprint arXiv:1806.11212 (2018). sourceExperimental — accuracy not yet measured
Section 4 (pp. 3–4) says poorly chosen proxy groups can worsen fairness for the true protected groups, supporting the claim that improvement is not guaranteed. But the paper presents this as a theoretical possibility, while its reported experiments generally found improvements (Conclusions, p. 8). It does not frame the result as an experiment on noisy sensitive attributes without assumptions about the noise structure. (LLM, conf=0.84)
boosted- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“Indeed, Fogliato et al. [35] show that even a small amount of label noise can greatly impact the assessment of the fairness properties of the model.”
§ Uncertainty as a Form of Transparency: Measuring, Communicating, and Using Uncertainty > 3.1 Uncertainty and Fairness
What the sources say
- Supportedcites [35] 35. Riccardo Fogliato, Max G'Sell, and Alexandra Chouldechova. 2020. Fairness Evaluation in Presence of Biased Noisy Labels. arXiv preprint arXiv:2003.13808 (2020). source
The Abstract (p. 1) reports that even small biases in observed labels may call into question conclusions drawn from evaluating a model against those labels. The Conclusion (p. 8) gives an example in which a small gap in arrest likelihood could fully account for observed miscalibration. This supports the claim that a small amount of biased label noise can substantially affect fairness assessment. (LLM, conf=0.89)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“Here, measures of demographic parity and equalized odds computed on the observed data are equal to the true metrics up to a scaling factor, which is proportional to the value of the noise [71]; if the noise rates are known, then the true metrics can be directly estimated.”
§ Uncertainty as a Form of Transparency: Measuring, Communicating, and Using Uncertainty > 3.1 Uncertainty and Fairness
What the sources say
- Supportedcites [71] 71. Alex Lamy, Ziyuan Zhong, Aditya K Menon, and Nakul Verma. 2019. Noise- tolerant fair classification. In Advances in Neural Information Processing Systems. 294-306. source
Section 4.2 (p. 6) states that MC noise scales the fairness measure, giving the clean measure as (1 − α − β) times the corrupted-data measure. Section 3.3 (p. 4) says equalized odds can be captured by adding a constraint for Y = 0, and §4.3 (p. 6) explains how known noise parameters supply the scaling factor. The factor depends on the noise rates; more precisely, it is 1 − α − β, not directly proportional to their value. (LLM, conf=0.88)
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Similarly to noise in the sensitive attribute, Blum and Stangl [11], Jiang and Nachum [59] show that fairness constraints are guaranteed to improve the properties of a predictor only under appropriate assumptions on the label noise.”
§ Uncertainty as a Form of Transparency: Measuring, Communicating, and Using Uncertainty > 3.1 Uncertainty and Fairness
What the sources say
- Partly supportedcites [11] 11. Avrim Blum and Kevin Stangl. 2019. Recovering from biased data: Can fairness constraints improve accuracy? arXiv preprint arXiv:1912.01094 (2019). sourceExperimental — accuracy not yet measured
Section 3.3 (p. 11) says Equal Opportunity-constrained ERM recovers the Bayes-optimal classifier when Group A has sufficient mass and the signal is not too noisy. Section 3.1 (p. 9) also gives a recovery range bounded by the noise parameter η. The claim captures the dependence on noise assumptions, but overgeneralizes the guarantee to fairness constraints generally and omits the paper’s other conditions. (LLM, conf=0.86)
- Partly supportedcites [59] 59. Heinrich Jiang and Ofir Nachum. 2020. Identifying and correcting label bias in machine learning. In International Conference on Artificial Intelligence and Statistics. 702-712. sourceExperimental — accuracy not yet measured
Section 2.1 (p. 2) says that recovering unbiased labels requires an assumption about their relationship to observed biased labels. The Introduction (p. 1) reports a theoretical guarantee for the paper’s re-weighted training method under its model. It does not establish the broader claim that fairness constraints improve a predictor only under appropriate assumptions about label noise. (LLM, conf=0.83)
boostedstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
74 more claims · 11 with their cited sources checked
Create a free account to see all 202 claims and to verify the 24 references still open.
- It may state two separate claims as one. 40
- Probably not a substantial claim. 105
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Uncertainty is considered a critical form of transparency that can alert people about the limitations of AI [10].”
From Investigating Explainability of Generative AI for Code through Scenario-based Design (2022) · cites this paper as [10]
The cited source says what the claim attributes to it.
In the citing paper
“Similar metrics have been used to evaluate the calibration of uncertainty quantification [7,9,64]-the estimated uncertainty should reflect the observed error rate.”
From Understanding the Role of Human Intuition on Reliance in Human-AI Decision-Making with Explanations (2023) · cites this paper as [7]
The cited source says what the claim attributes to it.
In the citing paper
“Uncertainty expression can also increase the system's perceived transparency [13], which is generally shown to enhance trust, whether or not appropriate [56].”
From "I'm Not Sure, But...": Examining the Impact of Large Language Models' Uncertainty Expression on User Reliance and Trust (2024) · cites this paper as [13]
The cited source says what the claim attributes to it.
In the citing paper
“Finally, indicating model uncertainty [19,174,198], for example, by means of color-coding [167], and an explanation for that uncertainty [5,190], can also help users disentangle the role of their prompting and output evaluation ability from that of models' capabilities, further supporting confidence adjustment [197].”
From The Metacognitive Demands and Opportunities of Generative AI (2024) · cites this paper as [19]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Uncertainty as a Form of Transparency: Measuring, Communicating, and Using Uncertainty > References
“137. Yunfeng Zhang, Rachel KE Bellamy, and Wendy A. Kellogg. 2012.”
§ Uncertainty as a Form of Transparency: Measuring, Communicating, and Using Uncertainty > References
“In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (2015).”
Citations
Cites
A Mathematical Theory of Communication
Shannon, C. E. (1948) · Bell System Technical Journal · doi:10.1002/j.1538-7305.1948.tb01338.x · Cited by 88,486
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
Tversky, A., & Kahneman, D. (1974) · Science · doi:10.1126/science.185.4157.1124 · Cited by 28,810
UCI Machine Learning Repository
Asuncion, A. (2007) · Medical Entomology and Zoology · Cited by 25,410
Judgment under Uncertainty: Heuristics and Biases
Tversky, A., & Kahneman, D. (1975) · Utility, Probability, and Human Decision Making · doi:10.1007/978-94-010-1834-0_8 · Cited by 22,650
"Why Should I Trust You?": Explaining the Predictions of Any Classifier
Ribeiro, M. T., Singh, S., & Guestrin, C. (2016) · Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2939672.2939778 · Cited by 17,555
Knight, F. H. (1921) · Cited by 16,535
Breiman, L. (1996) · Machine Learning · doi:10.1007/bf00058655 · Cited by 16,325
Advances in prospect theory: Cumulative representation of uncertainty
Tversky, A., & Kahneman, D. (1992) · Journal of Risk and Uncertainty · doi:10.1007/bf00122574 · Cited by 15,467 · cited 2×
“Research also found that this bias occurs when people are asked to make decisions under risk and that their decisions imply such distortions [125, 137].”
Background(2011) · Cited by 14,317
Research works printed but not linked: 12
- Emily Badger , Claire Cain Miller , Adam Pearce, and Kevin Quealy. 2018 . Income Mobility Charts for Girls, Asian- Americans and Other Groups . Or Make YourOwn. (2018). Emily Badger, Claire Cain Miller, Adam Pearce, and Kevin Quealy. 2018. Income Mobility Charts for Girls, Asian-Americans and Other Groups. Or Make YourOwn. (2018).
- J Martin Bland and Douglas G Altman . 1998. Bayesians and frequentists. BMJ317, 7166 ( 1998 ), 1151--1160. https://doi.org/10.1136/bmj.317.7166.1151arXiv:https://www.bmj.com/content/317/7166/1151.1.full.pdf 10.1136/bmj.317.7166.1151arXiv:https: J Martin Bland and Douglas G Altman. 1998. Bayesians and frequentists. BMJ317, 7166 (1998), 1151--1160. https://doi.org/10.1136/bmj.317.7166.1151arXiv:https://www.bmj.com/content/317/7166/1151.1.full.pdf · doi:10.1136/bmj.317.7166.1151arxiv:https://www.bmj.com/content/317/7166/1151.1.full.pdf
- Shelly Chaiken . 1999. The heuristic-systematic. Dual-process theories social psychology 73 ( 1999 ). Shelly Chaiken. 1999. The heuristic-systematic. Dual-process theories social psychology 73 (1999).
- Marvin S Cohen , Raja Parasuraman , and Jared T Freeman . 1998 . Trust in decision aids: A model and its training implications . In Proc. Command and Control Research and Technology Symp. Citeseer. Marvin S Cohen, Raja Parasuraman, and Jared T Freeman. 1998. Trust in decision aids: A model and its training implications. In Proc. Command and Control Research and Technology Symp. Citeseer.
- Yarin Gal . 2016. Uncertainty in deep learning . University of Cambridge 1, 3( 2016 ). Yarin Gal. 2016. Uncertainty in deep learning. University of Cambridge 1, 3(2016).
- Malik Sajjad Ahmed Nadeem , Jean-Daniel Zucker , and Blaise Hanczar . 2009 . Accuracy-Rejection Curves (ARCs) for Comparing Classification Methods with a Reject Option . In Proceedings of the third International Workshop on Machine Learning in Systems Biology (Proceedings of Machine Learning Research), Saso Dzeroski, Pierre Guerts, and Juho Rousu (Eds.) , Vol. 8 . PMLR, Ljubljana, Slovenia, 65--81. http://proceedings.mlr.press/v8/nadeem10a.html Malik Sajjad Ahmed Nadeem, Jean-Daniel Zucker, and Blaise Hanczar. 2009.Accuracy-Rejection Curves (ARCs) for Comparing Classification Methods with a Reject Option. In Proceedings of the third International Workshop on Machine Learning in Systems Biology (Proceedings of Machine Learning Research), Saso Dzeroski, Pierre Guerts, and Juho Rousu (Eds.), Vol. 8. PMLR, Ljubljana, Slovenia, 65--81. http://proceedings.mlr.press/v8/nadeem10a.html
- 10.5555/2888116.2888120 · doi:10.5555/2888116.2888120
- Jennifer Preece , Helen Sharp , and Yvonne Rogers . 2015. Interaction design: beyond human-computer interaction . John Wiley & Sons . Jennifer Preece, Helen Sharp, and Yvonne Rogers. 2015. Interaction design: beyond human-computer interaction. John Wiley & Sons.
- S Shyam Sundar . 2008. The MAIN model : A heuristic approach to understanding technology effects on credibility . MacArthur Foundation Digital Media andLearning Initiative . S Shyam Sundar. 2008.The MAIN model: A heuristic approach to understanding technology effects on credibility. MacArthur Foundation Digital Media andLearning Initiative.
- 10.5555/3305890.3306024 · doi:10.5555/3305890.3306024
- Anne Marthe van der Bles , Sander van der Linden , Alexandra L. J. Freeman , James Mitchell , Ana B. Galvao , Lisa Zaval , and David J. Spiegelhalter . 2019 . Communicating Uncertainty about Facts , Numbers and Science. 6 , 5 (2019), 181870 . https://doi.org/10/gf2g9j Anne Marthe van der Bles, Sander van der Linden, Alexandra L. J. Freeman,James Mitchell, Ana B. Galvao, Lisa Zaval, and David J. Spiegelhalter. 2019. Communicating Uncertainty about Facts, Numbers and Science. 6, 5 (2019), 181870. https://doi.org/10/gf2g9j
- Claus O. Wilke . 2019. Fundamentals of Data Visualization: A Primer on Making Informative and Compelling Figures ( 1 st edition ed.). O'Reilly Media . Claus O. Wilke. 2019. Fundamentals of Data Visualization: A Primer on Making Informative and Compelling Figures(1st edition ed.). O'Reilly Media.
Cited by
Generative AI and ChatGPT: applications, challenges, and AI-human collaboration
Fui-Hoon Nah, F., Zheng, R., Cai, J., Siau, K., & Chen, L. (2023) · Journal of Information Technology Case and Application Research · doi:10.1080/15228053.2023.2233814 · Cited by 1,363
The Metacognitive Demands and Opportunities of Generative AI
Tankelevitch, L., Kewenig, V., Simkute, A., Scott, A. E., Sarkar, A., Sellen, A., & Rintel, S. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642902 · Cited by 493
Towards trustworthy machine fault diagnosis: A probabilistic Bayesian deep learning framework
Zhou, T., Han, T., & Droguett, E. L. (2022) · Reliability Engineering & System Safety · doi:10.1016/j.ress.2022.108525 · Cited by 260
Socially Responsible AI Algorithms: Issues, Purposes, and Challenges
Cheng, L., Varshney, K. R., & Liu, H. (2021) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.12814 · Cited by 261
Nemani, V., Biggio, L., Huan, X., Hu, Z., Fink, O., Tran, A., Wang, Y., Zhang, X., & Hu, C. (2023) · Mechanical Systems and Signal Processing · doi:10.1016/j.ymssp.2023.110796 · Cited by 243
Metadata
- Authors
- Bhatt, U., Antorán, J., Zhang, Y., Liao, Q. V., Sattigeri, P., Fogliato, R., Melançon, G., Krishnan, R., Stanley, J., Tickoo, O., Nachman, L., Chunara, R., Srikumar, M., Weller, A., & Xiang, A.
- Affiliations
- University of Cambridge (GB)
- IBM (United States) (US)
- Carnegie Mellon University (US)
- Concordia University (CA)
- Intel (United States) (US)
- New York University (US)
- Partnership on AI, San Francisco, CA, USA
- Sony AI, Seattle, WA, USA
- ORCID
- Venue
- Proceedings of the 2021 AAAI/ACM Conference on AI, Ethics, and Society
- Publisher
- ACM
- Published
- 2021-07-21
- Pages
- 401-413
- ISSN
- 3065-8365 (ISSN-L)
- OpenAlex
- W3183398589
- Semantic Scholar
- 3973e0fab69a00f5ed6a81ca408f60c420fa6e61
- Cited by
- 300
- References
- 116
- Citations by year
- 2026: 59 · 2025: 62 · 2024: 65 · 2023: 46 · 2022: 48 · 2021: 18
- FWCI
- 16.64
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Proceedings of the AAAI/ACM Conference on AI Ethics and Society (publishedVersion, cc-by)
- arXiv (Cornell University) (submittedVersion)
- Cambridge University Engineering Department Publications Database (submittedVersion)
- arXiv (Cornell University)
- Funders
- Microsoft Research
- Northwestern University
- Alan Turing Institute (EP/N510129/1., TU/B/000074, N510129)
- DeepMind
- Leverhulme Trust
- Engineering and Physical Sciences Research Council (N510129, EP/N510129/, EP/N510129/1, TU/B/000074, 2275741, EPSRC grant EP/N510129/1, EP/V025279/1)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Physical Sciences › Computer Science › Artificial Intelligence › Adversarial Robustness in Machine Learning
- Keywords
- algorithmic transparency, uncertainty estimation, uncertainty communication, explainability, model fairness, trustworthy systems, decision-making, uncertainty visualization, human-computer interaction, machine learning pipelines, stakeholder awareness
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-24, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-24 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Uncertainty as a Form of Transparency: Measuring, Communicating, and Using Uncertainty. https://app.cochat.ai/papers/10.1145/3461702.3462571
- The paper
- Bhatt, U., Antorán, J., Zhang, Y., Liao, Q. V., Sattigeri, P., Fogliato, R., Melançon, G., Krishnan, R., Stanley, J., Tickoo, O., Nachman, L., Chunara, R., Srikumar, M., Weller, A., & Xiang, A. (2021). Uncertainty as a Form of Transparency: Measuring, Communicating, and Using Uncertainty. Proceedings of the 2021 AAAI/ACM Conference on AI, Ethics, and Society. https://doi.org/10.1145/3461702.3462571
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.