Uncertainty as a Form of Transparency: Measuring, Communicating, and Using Uncertainty
Open accessThe DOI matches its Crossref record; 228 of the 229 references it cites were found in a registry or an index, and 1 are not checked yet; 41 of the 135 sources its claims cite were checked for support.
Abstract
Algorithmic transparency entails exposing system properties to various stakeholders for purposes that include understanding, improving, and contesting predictions. Until now, most research into algorithmic transparency has predominantly focused on explainability. Explainability attempts to provide reasons for a machine learning model's behavior to stakeholders. However, understanding a model's specific behavior alone might not be enough for stakeholders to gauge whether the model is wrong or lacks sufficient knowledge to solve the task at hand. In this paper, we argue for considering a complementary form of transparency by estimating and communicating the uncertainty associated with model predictions. First, we discuss methods for assessing uncertainty. Then, we characterize how uncertainty can be used to mitigate model unfairness, augment decision-making, and build trustworthy systems. Finally, we outline methods for displaying uncertainty to stakeholders and recommend how to collect information required for incorporating uncertainty into existing ML pipelines. This work constitutes an interdisciplinary review drawn from literature spanning machine learning, visualization/HCI, design, decision-making, and fairness. We aim to encourage researchers and practitioners to measure, communicate, and use uncertainty as a form of transparency.
Verified 2026-11-19 · 1 reference not checked yet
Overview
CoChat Summary
TL;DR
This paper argues that estimating and communicating uncertainty should be treated as a complementary form of algorithmic transparency alongside explainability. It reviews methods for measuring uncertainty and discusses how uncertainty can support fairness, decision-making, trust, and stakeholder communication.
Key findings
- Uncertainty is split into aleatoric uncertainty (irreducible noise/class overlap) and epistemic uncertainty (reducible with more data); calibration is a precursor to using uncertainty as transparency, and deep ensembles are described as one of the best-performing uncertainty quantification approaches for neural networks, retaining calibration under dataset shift.
- Uncertainty can help address fairness issues: representation bias is epistemic and may be detected via large epistemic uncertainty on validation/deployment data, while feature and label noise are aleatoric and can distort fairness assessments; even a small amount of label noise can greatly impact fairness evaluation.
- In decision-making, uncertainty supports reject options and decision-theoretic action selection; JDM findings indicate risk is considered together with expected outcome, asymmetrically, and tolerance for uncertainty decreases superlinearly as stakes increase.
- Communication is difficult: in a 2010 US/Germany survey, 20% could not identify 10% as the biggest disease risk among 1%, 5%, and 10%, and almost 30% could not answer whether 1 in 10, 1 in 100, or 1 in 1000 represents the largest risk; people interpreted the IPCC’s “very likely” as around 60% probability, whereas the guideline specifies greater than 90%. Quantile dot plots and hypothetical outcome plots (HOPs) are reported to improve some probability/uncertainty judgments.
Methods
- Interdisciplinary literature review, not an empirical study, drawn from machine learning, visualization/HCI, design, decision-making, and fairness.
- Uses a recurring breast cancer diagnostics scenario to illustrate uncertainty in fairness, decision-making, trust formation, and communication.
- Synthesizes uncertainty quantification approaches (Bayesian methods, frequentist methods such as ensembles), evaluation metrics (calibration, NLL, Brier score, ECE), and communication methods (categories, numerical ranges, summary statistics, full distributions, visualizations).
Limitations
- The paper states that its findings should not be treated as conclusive for predicting real-world usability and recommends testing with real users in concrete tasks and settings.
- The paper states that empirical understanding of how decision-makers use aleatoric versus epistemic uncertainty is limited, that JDM literature has mostly focused on discrete outcomes, and that there is not a good understanding of how people perceive uncertainty over continuous outcomes such as error bars.
- Evident from the text: as a review, it provides no primary empirical validation or systematic review protocol; several claims are speculative or drawn from other fields and are framed as open questions for future research.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures




![(c) Cone of uncertainty, showing the uncertainty around the predicted path of the center of a hurricane. Taken from [93].](https://figures.cochat.ai/paper-figures/42e1c0dd14b540788474c4bee4ed993b/uncertainty-as-a-form-of-transparency-measuring-communicating-and-using-figure-5.png)

Verification
Claims the paper makes
28 Valid · 10 Not valid · 60 Not checked · 104 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“When information on the sensitive attribute is unavailable (e.g., information on gender was not collected), but can be predicted from an auxiliary dataset, disparity measures are generally unidentifiable [20,63].”
§ Uncertainty as a Form of Transparency: Measuring, Communicating, and Using Uncertainty > 3.1 Uncertainty and Fairness
What the sources say
- Partly supportedcites [20] 20. Jiahao Chen, Nathan Kallus, Xiaojie Mao, Geoffry Svacha, and Madeleine Udell. 2019. Fairness under unawareness: Assessing disparity when protected class is unobserved. In Proceedings of the conference on fairness, accountability, and transparency. 339-348. sourceExperimental — accuracy not yet measured
Section 1.1 (p. 2) describes assessing disparity when protected-class labels are unavailable and must be imputed from proxy variables. The paper analyzes bias in the resulting disparity estimates, but the cited passages do not establish the broader claim that disparity measures are generally unidentifiable; the Conclusions (p. 9) instead note that the optimal imputation threshold cannot be determined without ground-truth labels. (LLM, conf=0.82)
- Supportedcites [63] 63. Nathan Kallus, Xiaojie Mao, and Angela Zhou. 2019. Assessing algorithmic fairness with unobserved protected class using data combination. arXiv preprint arXiv:1906.00285 (2019). source
The paper’s problem formulation describes a primary dataset missing protected-class labels and an auxiliary dataset containing those labels and proxy variables. Section 4 states that disparity measures are generally unidentifiable from the two datasets because their marginals do not uniquely determine the full joint distribution. The paper notes an exception for perfectly predictive proxies, consistent with the claim’s qualifier ‘generally.’ (LLM, conf=0.94)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“The experimental results of Gupta et al. [44] have shown that enforcing fairness constraints on a noisy sensitive attribute, without assumptions on the structure of the noise, is not guaranteed to lead to any improvement in the fairness properties of our model.”
§ Uncertainty as a Form of Transparency: Measuring, Communicating, and Using Uncertainty > 3.1 Uncertainty and Fairness
What the sources say
- Partly supportedcites [44] 44. Maya Gupta, Andrew Cotter, Mahdi Milani Fard, and Serena Wang. 2018. Proxy fairness. arXiv preprint arXiv:1806.11212 (2018). sourceExperimental — accuracy not yet measured
Section 4 (pp. 3–4) says poorly chosen proxy groups can worsen fairness for the true protected groups, supporting the claim that improvement is not guaranteed. But the paper presents this as a theoretical possibility, while its reported experiments generally found improvements (Conclusions, p. 8). It does not frame the result as an experiment on noisy sensitive attributes without assumptions about the noise structure. (LLM, conf=0.84)
boosted- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“Indeed, Fogliato et al. [35] show that even a small amount of label noise can greatly impact the assessment of the fairness properties of the model.”
§ Uncertainty as a Form of Transparency: Measuring, Communicating, and Using Uncertainty > 3.1 Uncertainty and Fairness
What the sources say
- Supportedcites [35] 35. Riccardo Fogliato, Max G'Sell, and Alexandra Chouldechova. 2020. Fairness Evaluation in Presence of Biased Noisy Labels. arXiv preprint arXiv:2003.13808 (2020). source
The Abstract (p. 1) reports that even small biases in observed labels may call into question conclusions drawn from evaluating a model against those labels. The Conclusion (p. 8) gives an example in which a small gap in arrest likelihood could fully account for observed miscalibration. This supports the claim that a small amount of biased label noise can substantially affect fairness assessment. (LLM, conf=0.89)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“Here, measures of demographic parity and equalized odds computed on the observed data are equal to the true metrics up to a scaling factor, which is proportional to the value of the noise [71]; if the noise rates are known, then the true metrics can be directly estimated.”
§ Uncertainty as a Form of Transparency: Measuring, Communicating, and Using Uncertainty > 3.1 Uncertainty and Fairness
What the sources say
- Supportedcites [71] 71. Alex Lamy, Ziyuan Zhong, Aditya K Menon, and Nakul Verma. 2019. Noise- tolerant fair classification. In Advances in Neural Information Processing Systems. 294-306. source
Section 4.2 (p. 6) states that MC noise scales the fairness measure, giving the clean measure as (1 − α − β) times the corrupted-data measure. Section 3.3 (p. 4) says equalized odds can be captured by adding a constraint for Y = 0, and §4.3 (p. 6) explains how known noise parameters supply the scaling factor. The factor depends on the noise rates; more precisely, it is 1 − α − β, not directly proportional to their value. (LLM, conf=0.88)
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Similarly to noise in the sensitive attribute, Blum and Stangl [11], Jiang and Nachum [59] show that fairness constraints are guaranteed to improve the properties of a predictor only under appropriate assumptions on the label noise.”
§ Uncertainty as a Form of Transparency: Measuring, Communicating, and Using Uncertainty > 3.1 Uncertainty and Fairness
What the sources say
- Partly supportedcites [11] 11. Avrim Blum and Kevin Stangl. 2019. Recovering from biased data: Can fairness constraints improve accuracy? arXiv preprint arXiv:1912.01094 (2019). sourceExperimental — accuracy not yet measured
Section 3.3 (p. 11) says Equal Opportunity-constrained ERM recovers the Bayes-optimal classifier when Group A has sufficient mass and the signal is not too noisy. Section 3.1 (p. 9) also gives a recovery range bounded by the noise parameter η. The claim captures the dependence on noise assumptions, but overgeneralizes the guarantee to fairness constraints generally and omits the paper’s other conditions. (LLM, conf=0.86)
- Partly supportedcites [59] 59. Heinrich Jiang and Ofir Nachum. 2020. Identifying and correcting label bias in machine learning. In International Conference on Artificial Intelligence and Statistics. 702-712. sourceExperimental — accuracy not yet measured
Section 2.1 (p. 2) says that recovering unbiased labels requires an assumption about their relationship to observed biased labels. The Introduction (p. 1) reports a theoretical guarantee for the paper’s re-weighted training method under its model. It does not establish the broader claim that fairness constraints improve a predictor only under appropriate assumptions about label noise. (LLM, conf=0.83)
boostedstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
74 more claims · 11 with their cited sources checked
Create a free account to see all 202 claims and to verify the 24 references still open.
- It may state two separate claims as one. 40
- Probably not a substantial claim. 105
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Uncertainty is considered a critical form of transparency that can alert people about the limitations of AI [10].”
From Investigating Explainability of Generative AI for Code through Scenario-based Design (2022) · cites this paper as [10]
The cited source says what the claim attributes to it.
In the citing paper
“Similar metrics have been used to evaluate the calibration of uncertainty quantification [7,9,64]-the estimated uncertainty should reflect the observed error rate.”
From Understanding the Role of Human Intuition on Reliance in Human-AI Decision-Making with Explanations (2023) · cites this paper as [7]
The cited source says what the claim attributes to it.
In the citing paper
“Uncertainty expression can also increase the system's perceived transparency [13], which is generally shown to enhance trust, whether or not appropriate [56].”
From "I'm Not Sure, But...": Examining the Impact of Large Language Models' Uncertainty Expression on User Reliance and Trust (2024) · cites this paper as [13]
The cited source says what the claim attributes to it.
In the citing paper
“Finally, indicating model uncertainty [19,174,198], for example, by means of color-coding [167], and an explanation for that uncertainty [5,190], can also help users disentangle the role of their prompting and output evaluation ability from that of models' capabilities, further supporting confidence adjustment [197].”
From The Metacognitive Demands and Opportunities of Generative AI (2024) · cites this paper as [19]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Uncertainty as a Form of Transparency: Measuring, Communicating, and Using Uncertainty > References
“137. Yunfeng Zhang, Rachel KE Bellamy, and Wendy A. Kellogg. 2012.”
§ Uncertainty as a Form of Transparency: Measuring, Communicating, and Using Uncertainty > References
“In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (2015).”
Citations
Cites
A Mathematical Theory of Communication
Shannon, C. E. (1948) · Bell System Technical Journal · doi:10.1002/j.1538-7305.1948.tb01338.x · Cited by 88,486
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
Tversky, A., & Kahneman, D. (1974) · Science · doi:10.1126/science.185.4157.1124 · Cited by 28,810
UCI Machine Learning Repository
Asuncion, A. (2007) · Medical Entomology and Zoology · Cited by 25,410
Judgment under Uncertainty: Heuristics and Biases
Tversky, A., & Kahneman, D. (1975) · Utility, Probability, and Human Decision Making · doi:10.1007/978-94-010-1834-0_8 · Cited by 22,650
"Why Should I Trust You?": Explaining the Predictions of Any Classifier
Ribeiro, M. T., Singh, S., & Guestrin, C. (2016) · Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2939672.2939778 · Cited by 17,555
Knight, F. H. (1921) · Cited by 16,535
Breiman, L. (1996) · Machine Learning · doi:10.1007/bf00058655 · Cited by 16,325
Advances in prospect theory: Cumulative representation of uncertainty
Tversky, A., & Kahneman, D. (1992) · Journal of Risk and Uncertainty · doi:10.1007/bf00122574 · Cited by 15,467 · cited 2×
“Research also found that this bias occurs when people are asked to make decisions under risk and that their decisions imply such distortions [125, 137].”
Background(2011) · Cited by 14,317
Advances in neural information processing systems 7
(1996) · Computers & Mathematics with Applications · doi:10.1016/s0898-1221(96)90463-0 · Cited by 14,281
Gaussian Processes for Machine Learning
Rasmussen, C. E., & Williams, C. K. I. (2005) · doi:10.7551/mitpress/3206.001.0001 · Cited by 11,705
An integrative model of organizational trust
Mayer, R. C., Davis, J. H., & Schoorman, F. D. (1995) · The Academy of Management Review · doi:10.2307/258792 · Cited by 10,736
Pattern Recognition and Machine Learning
(2006) · doi:10.1007/978-0-387-45528-0 · Cited by 9,824
The Elaboration Likelihood Model of Persuasion
Petty, R. E., & Cacioppo, J. T. (1986) · Advances in Experimental Social Psychology · doi:10.1016/s0065-2601(08)60214-2 · Cited by 8,822
Ensemble methods in machine learning
Dietterich, T. G. (2000) · Lecture Notes in Computer Science · doi:10.1007/3-540-45014-9_1 · Cited by 8,408
GRADE guidelines: 3. Rating the quality of evidence
Balshem, H., Helfand, M., Schünemann, H. J., Oxman, A. D., Kunz, R., Brozek, J., Vist, G. E., Falck-Ytter, Y., Meerpohl, J., & Norris, S. (2011) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2010.07.015 · Cited by 8,285
(2006) · Springer eBooks · Cited by 8,123
Dissecting racial bias in an algorithm used to manage the health of populations
Obermeyer, Z., Powers, B., Vogeli, C., & Mullainathan, S. (2019) · Science · doi:10.1126/science.aax2342 · Cited by 7,137
“Why Should I Trust You?”: Explaining the Predictions of Any Classifier
Ribeiro, M., Singh, S., & Guestrin, C. (2016) · Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Demonstrations · doi:10.18653/v1/n16-3020 · Cited by 6,682
Trust in Automation: Designing for Appropriate Reliance
Lee, J. D., & See, K. A. (2004) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/hfes.46.1.50_30392 · Cited by 6,605 · cited 5×
“Rooted in informationprocessing and decision-making theories [29, 85, 147], process models differentiate between an analytic, or systematic, process of trust formation, and an affective, or heuristic, process of trust formation [106, 125, 168].”
BackgroundInfluentialDropout as a bayesian approximation: Representing model uncertainty in deep learning
Gal, Y., & Ghahramani, Z. (2015) · arXiv · doi:10.48550/arxiv.1506.02142 · Cited by 6,471
Information theory, inference, and learning algorithms
(2004) · Choice Reviews Online · doi:10.5860/choice.41-5949 · Cited by 6,362
International Conference on Learning Representations (ICLR 2013)
松尾, 豊. (2013) · 人工知能学会誌 = Journal of Japanese Society for Artificial Intelligence · Cited by 6,286
The genomic and transcriptomic architecture of 2,000 breast tumours reveals novel subgroups
METABRIC Group, Curtis, C., Shah, S. P., Chin, S.-F., Turashvili, G., Rueda, O. M., Dunning, M. J., Speed, D., Lynch, A. G., Samarajiwa, S., et al. (2012) · Nature · doi:10.1038/nature10983 · Cited by 6,097
A Survey on Bias and Fairness in Machine Learning
Mehrabi, N., Morstatter, F., Saxena, N., Lerman, K., & Galstyan, A. (2022) · ACM Computing Surveys · doi:10.1145/3457607 · Cited by 5,812
A Survey on Bias and Fairness in Machine Learning
Mehrabi, N., Morstatter, F., Saxena, N., Lerman, K., & Galstyan, A. (2019) · arXiv · doi:10.48550/arxiv.1908.09635 · Cited by 5,812
Strictly Proper Scoring Rules, Prediction, and Estimation
Gneiting, T., & Raftery, A. E. (2007) · Journal of the American Statistical Association · doi:10.1198/016214506000001437 · Cited by 5,793
Information Theory, Inference, and Learning Algorithms
(2004) · Kybernetes · doi:10.1108/03684920410534506 · Cited by 4,937
An Introduction to the Theory of Statistics
(1911) · Nature · doi:10.1038/087345a0 · Cited by 4,394
Bayesian Learning for Neural Networks
Neal, R. M. (1996) · Lecture Notes in Statistics · doi:10.1007/978-1-4612-0745-0 · Cited by 4,276
Axiomatic attribution for deep networks
Sundararajan, M., Taly, A., & Yan, Q. (2017) · arXiv · doi:10.48550/arxiv.1703.01365 · Cited by 4,087
Simple and Scalable Predictive Uncertainty Estimation using Deep Ensembles
Lakshminarayanan, B., Pritzel, A., & Blundell, C. (2016) · arXiv · doi:10.48550/arxiv.1612.01474 · Cited by 3,666
(2018) · Cited by 3,510
Dwork, C., Hardt, M., Pitassi, T., Reingold, O., & Zemel, R. (2012) · Proceedings of the 3rd Innovations in Theoretical Computer Science Conference · doi:10.1145/2090236.2090255 · Cited by 3,501
On calibration of modern neural networks
Guo, C., Pleiss, G., Sun, Y., & Weinberger, K. Q. (2017) · arXiv · doi:10.48550/arxiv.1706.04599 · Cited by 3,435
The Elaboration Likelihood Model of Persuasion
Petty, R. E., & Cacioppo, J. T. (1986) · Communication and Persuasion · doi:10.1007/978-1-4612-4964-1_1 · Cited by 3,202
Towards A Rigorous Science of Interpretable Machine Learning
Doshi-Velez, F., & Kim, B. (2017) · arXiv · doi:10.48550/arxiv.1702.08608 · Cited by 3,121
Understanding Machine Learning: From Theory to Algorithms
Shalev-Shwartz, S., & Ben-David, S. (2014) · doi:10.1017/cbo9781107298019 · Cited by 3,115
Prospect Theory: An Analysis of Decision Under Risk
Kahneman, D., & Tversky, A. (2013) · World Scientific Handbook in Financial Economics Series · doi:10.1142/9789814417358_0006 · Cited by 3,091
A practical Bayesian framework for backpropagation networks
MacKay, D. J. C. (1992) · Neural Computation · doi:10.1162/neco.1992.4.3.448 · Cited by 2,917 · cited 1×
“In parametric models, like Bayesian Neural Networks (BNNs) [116, 133], this is most often done by treating model weights as random variables instead of single values, and assigning them a prior distribution p (w).”
Method(2015) · Cited by 2,857
Trust in Automation: Integrating Empirical Evidence on Factors That Influence Trust
Hoff, K. A., & Bashir, M. (2015) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720814547570 · Cited by 2,817
Model Cards for Model Reporting
Mitchell, M., Wu, S., Zaldivar, A., Barnes, P., Vasserman, L., Hutchinson, B., Spitzer, E., Raji, I. D., & Gebru, T. (2019) · Proceedings of the Conference on Fairness, Accountability, and Transparency · doi:10.1145/3287560.3287596 · Cited by 2,681
Equality of Opportunity in Supervised Learning
Hardt, M., Price, E., & Srebro, N. (2016) · arXiv · doi:10.48550/arxiv.1610.02413 · Cited by 2,536 · cited 2×
“[66] is guaranteed to reduce the bias of the classifier under an assumption on the noise in the sensitive attributes, namely the independence of the classifier prediction and the observed attribute, conditional on both the outcome and the true sensitive”
BackgroundMethodGebru, T., Morgenstern, J., Vecchione, B., Vaughan, J. W., Wallach, H., Daumé, H., & Crawford, K. (2018) · arXiv · doi:10.48550/arxiv.1803.09010 · Cited by 2,474
Gebru, T., Morgenstern, J., Vecchione, B., Vaughan, J. W., Wallach, H., III, H. D., & Crawford, K. (2021) · Communications of the ACM · doi:10.1145/3458723 · Cited by 2,469
Aleatory or epistemic? Does it matter?
Kiureghian, A. D., & Ditlevsen, O. (2009) · Structural Safety · doi:10.1016/j.strusafe.2008.06.020 · Cited by 2,454 · cited 1×
“focus on those types that we can quantify in ML models: aleatoric uncertainty (also known as indirect uncertainty) and epistemic uncertainty (also known as direct uncertainty) [39, 40, 56].”
BackgroundTechniques for Verifying the Accuracy of Risk Measurement Models
Kupiec, P. H. (1995) · The Journal of Derivatives · doi:10.3905/jod.1995.407942 · Cited by 2,427
(2017) · Managerial Leadership for Librarians · doi:10.5040/9798400682018.ch-003 · Cited by 2,240
Fair prediction with disparate impact: a study of bias in recidivism prediction instruments
Chouldechova, A. (2017) · Big Data · doi:10.1089/big.2016.0047 · Cited by 2,159 · cited 1×
“Often there exist trade-offs between the different notions of fairness [33, 36, 95] (see Appendix E for the definitions of the commonly used fairness metrics).”
BackgroundProbabilistic machine learning and artificial intelligence
Ghahramani, Z. (2015) · Nature · doi:10.1038/nature14541 · Cited by 1,995 · cited 1×
“These methods can be broadly classified into two categories: Bayesian approaches [40, 90, 106] and Frequentist, approaches [14, 70, 113] Bayesian methods explicitly define a hypothesis space of plausible models a priori (before observing any data) and use deductive logic to update these priors given the observed data.”
MethodBayesian Learning via Stochastic Gradient Langevin Dynamics
Welling, M., & Teh, Y. W. (2012) · Cited by 1,860
Violin Plots: A Box Plot-Density Trace Synergism
Hintze, J. L., & Nelson, R. D. (1998) · The American Statistician · doi:10.1080/00031305.1998.10480559 · Cited by 1,802
(2014) · Thammasat University Digital Collections · Cited by 1,732
Hidden in Plain Sight — Reconsidering the Use of Race Correction in Clinical Algorithms
Vyas, D. A., Eisenstein, L. G., & Jones, D. S. (2020) · New England Journal of Medicine · doi:10.1056/nejmms2004740 · Cited by 1,731
Improving predictive inference under covariate shift by weighting the log-likelihood function
Shimodaira, H. (2000) · Journal of Statistical Planning and Inference · doi:10.1016/s0378-3758(00)00115-4 · Cited by 1,678
Preference and belief: Ambiguity and competence in choice under uncertainty
Heath, C., & Tversky, A. (1991) · Journal of Risk and Uncertainty · doi:10.1007/bf00057884 · Cited by 1,654
Proceedings of the 29th International Conference on Machine Learning (ICML-12)
Langford, J. C., & Pineau, J. (2012) · arXiv (Cornell University) · doi:10.48550/arxiv.1207.4676 · Cited by 1,618
Understanding Black-box Predictions via Influence Functions
Koh, P. W., & Liang, P. (2017) · arXiv · doi:10.48550/arxiv.1703.04730 · Cited by 1,514 · cited 1×
“Another form is algorithmic transparency, which exposes information about a model’s behavior to various stakeholders [97, 156, 170].”
BackgroundMitigating Unwanted Biases with Adversarial Learning
Zhang, B. H., Lemoine, B., & Mitchell, M. (2018) · Proceedings of the 2018 AAAI/ACM Conference on AI, Ethics, and Society · doi:10.1145/3278721.3278779 · Cited by 1,387
Weight Uncertainty in Neural Networks
Blundell, C., Cornebise, J., Kavukcuoglu, K., & Wierstra, D. (2015) · arXiv · doi:10.48550/arxiv.1505.05424 · Cited by 1,342
Weight Uncertainty in Neural Network
Blundell, C., Cornebise, J., Kavukcuoglu, K., & Wierstra, D. (2015) · International Conference on Machine Learning · Cited by 1,335
Algorithmic Decision Making and the Cost of Fairness
Corbett-Davies, S., Pierson, E., Feller, A., Goel, S., & Huq, A. (2017) · Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/3097983.3098095 · Cited by 1,149
Miller, S. M. (1987) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.52.2.345 · Cited by 1,139
(2013) · Cited by 1,126
Practical Variational Inference for Neural Networks
Graves, A. (2011) · Cited by 1,078
Credibility and trust of information in online environments: The use of cognitive heuristics
Metzger, M. J., & Flanagin, A. J. (2013) · Journal of Pragmatics · doi:10.1016/j.pragma.2013.07.012 · Cited by 1,000
Keeping the neural networks simple by minimizing the description length of the weights
Hinton, G. E., & van Camp, D. (1993) · Proceedings of the sixth annual conference on Computational learning theory - COLT '93 · doi:10.1145/168304.168306 · Cited by 994 · cited 1×
“Among themost popular are variational inference [20, 57, 71] and stochastic gradient MCMC [32, 184, 194].”
BackgroundObtaining well calibrated probabilities using Bayesian binning
Pakdaman Naeini, M., Cooper, G., & Hauskrecht, M. (2015) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v29i1.9602 · Cited by 991 · cited 1×
“Of the latter type, Expected calibration error (ECE) [131] is popularly used in classification scenarios.”
BackgroundCan You Trust Your Model's Uncertainty? Evaluating Predictive Uncertainty Under Dataset Shift
Ovadia, Y., Fertig, E., Ren, J., Nado, Z., Sculley, D., Nowozin, S., Dillon, J. V., Lakshminarayanan, B., & Snoek, J. (2019) · arXiv · doi:10.48550/arxiv.1906.02530 · Cited by 989
Optimized Pre-Processing for Discrimination Prevention
Calmon, F. P., Wei, D., Vinzamuri, B., Ramamurthy, K. N., & Varshney, K. R. (2017) · neural information processing systems · Cited by 978
Introduction to the Theory of Statistics, 3rd ed.
Kass, G. V., Mood, A. M., Graybill, F. A., & Boes, D. C. (1974) · Journal of the American Statistical Association · doi:10.2307/2286195 · Cited by 975
Kilpatrick, F. P. (1954) · Psychological Bulletin · doi:10.1037/h0050834 · Cited by 967
Inherent Trade-Offs in the Fair Determination of Risk Scores
Kleinberg, J., Mullainathan, S., & Raghavan, M. (2016) · arXiv · doi:10.48550/arxiv.1609.05807 · Cited by 941
A Simple Unified Framework for Detecting Out-of-Distribution Samples and Adversarial Attacks
Lee, K., Lee, K., Lee, H., & Shin, J. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1807.03888 · Cited by 932
Zhang, Y., Liao, Q. V., & Bellamy, R. K. E. (2020) · Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency · doi:10.1145/3351095.3372852 · Cited by 895
Self-citationProceedings of the 2019 CHI Conference on Human Factors in Computing Systems
(2019) · doi:10.1145/3290605 · Cited by 841
Observing the User Experience: A Practitioner's Guide to User Research
Goodman, E., Kuniavsky, M., & Moed, A. (2003) · Cited by 791
Kendall, A., Badrinarayanan, V., & Cipolla, R. (2017) · Procedings of the British Machine Vision Conference 2017 · doi:10.5244/c.31.57 · Cited by 784
Social Data: Biases, Methodological Pitfalls, and Ethical Boundaries
Olteanu, A., Castillo, C., Diaz, F., & Kıcıman, E. (2019) · Frontiers in Big Data · doi:10.3389/fdata.2019.00013 · Cited by 763 · cited 1×
“In addition, if there is a mismatch between the diversity representation in the data used to build an algorithm and the diversity of the target population, the algorithm can suffer from population bias [139].”
BackgroundSocial Data: Biases, Methodological Pitfalls, and Ethical Boundaries
Olteanu, A., Castillo, C., Diaz, F., & Kiciman, E. (2016) · doi:10.2139/ssrn.2886526 · Cited by 763
Visualizing Uncertainty About the Future
Spiegelhalter, D., Pearson, M., & Short, I. (2011) · Science · doi:10.1126/science.1191181 · Cited by 682
Zhang, H., & Maloney, L. T. (2012) · Frontiers in Neuroscience · doi:10.3389/fnins.2012.00001 · Cited by 679
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.1.1 · Cited by 676
Explainable machine learning in deployment
Bhatt, U., Xiang, A., Sharma, S., Weller, A., Taly, A., Jia, Y., Ghosh, J., Puri, R., Moura, J. M. F., & Eckersley, P. (2020) · Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency · doi:10.1145/3351095.3375624 · Cited by 633
Self-citationKruschke, J. K. (2015) · Doing Bayesian Data Analysis · doi:10.1016/b978-0-12-405888-0.00008-8 · Cited by 617
Lum, K., & Isaac, W. (2016) · Significance · doi:10.1111/j.1740-9713.2016.00960.x · Cited by 611
The Disjunction Effect in Choice under Uncertainty
Tversky, A., & Shafir, E. (1992) · Psychological Science · doi:10.1111/j.1467-9280.1992.tb00678.x · Cited by 581
Filho, S. L., & Kane, B. T. (2016) · National Conference on Artificial Intelligence · Cited by 576
The Bagplot: A Bivariate Boxplot
Rousseeuw, P. J., Ruts, I., & Tukey, J. W. (1999) · The American Statistician · doi:10.2307/2686061 · Cited by 568
Forecasting the novel coronavirus COVID-19
Petropoulos, F., & Makridakis, S. (2020) · PLOS ONE · doi:10.1371/journal.pone.0231236 · Cited by 567
Modelling uncertainty in deep learning for camera relocalization
Kendall, A., & Cipolla, R. (2016) · 2016 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2016.7487679 · Cited by 548
The Visual Communication of Risk
Lipkus, I. M., & Hollands, J. G. (1999) · JNCI Monographs · doi:10.1093/oxfordjournals.jncimonographs.a024191 · Cited by 534
Bayesian Active Learning for Classification and Preference Learning
Houlsby, N., Huszár, F., Ghahramani, Z., & Lengyel, M. (2011) · arXiv · doi:10.48550/arxiv.1112.5745 · Cited by 507 · cited 1×
“It is also used to guide methods that require explorations such as active learning [78], continual learning [134], Bayesian optimisation [70], and reinforcement learning [82].”
MethodProbabilistic Backpropagation for Scalable Learning of Bayesian Neural Networks
Hernández-Lobato, J. M., & Adams, R. P. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1502.05336 · Cited by 504
Variational Continual Learning
Nguyen, C. V., Li, Y., Bui, T. D., & Turner, R. E. (2017) · arXiv · doi:10.48550/arxiv.1710.10628 · Cited by 491 · cited 1×
“It is also used to guide methods that require explorations such as active learning [78], continual learning [134], Bayesian optimisation [70], and reinforcement learning [82].”
MethodNumeracy, Ratio Bias, and Denominator Neglect in Judgments of Risk and Probability
Reyna, V. F., & Brainerd, C. J. (2008) · Learning and Individual Differences · doi:10.1016/j.lindif.2007.03.011 · Cited by 481
Numeracy Skill And The Communication, Comprehension, And Use Of Risk-Benefit Information
Peters, E., Hibbard, J., Slovic, P., & Dieckmann, N. (2007) · Health Affairs · doi:10.1377/hlthaff.26.3.741 · Cited by 466
Variational Continual Learning
Turner, R., Bui, T., Li, Y., & Cuong, N. (2019) · Apollo - University of Cambridge Repository · doi:10.17863/cam.35471 · Cited by 438
Stochastic Gradient Hamiltonian Monte Carlo
Chen, T., Fox, E. B., & Guestrin, C. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1402.4102 · Cited by 434
FactSheets: Increasing trust in AI services through supplier's declarations of conformity
Arnold, M., Bellamy, R. K. E., Hind, M., Houde, S., Mehta, S., Mojsilović, A., Nair, R., Ramamurthy, K. N., Olteanu, A., Piorkowski, D., et al. (2019) · IBM Journal of Research and Development · doi:10.1147/jrd.2019.2942288 · Cited by 434
A Simple Baseline for Bayesian Uncertainty in Deep Learning
Maddox, W., Garipov, T., Izmailov, P., Vetrov, D., & Wilson, A. G. (2019) · arXiv · doi:10.48550/arxiv.1902.02476 · Cited by 429 · cited 1×
“These methods can be broadly classified into two categories: Bayesian approaches [5, 20, 32, 51, 57, 63, 69, 92, 118, 184, 194] and Non-Bayesian, or frequentist, approaches [2, 98, 102, 107, 111, 177].”
MethodVariational Dropout and the Local Reparameterization Trick
Kingma, D. P., Salimans, T., & Welling, M. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1506.02557 · Cited by 418
Predictive Entropy Search for Efficient Global Optimization of Black-box Functions
Hernández-Lobato, J. M., Hoffman, M. W., & Ghahramani, Z. (2014) · arXiv · doi:10.48550/arxiv.1406.2541 · Cited by 407
Thieme, A., Belgrave, D., & Doherty, G. (2020) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3398069 · Cited by 406 · cited 1×
“, [81, 173]).”
Decision Making Under Uncertainty: Theory and Application
Kochenderfer, M. J., Amato, C., Chowdhary, G., How, J. P., Reynolds, H. J. D., Thornton, J. R., Torres-Carrasquillo, P. A., Üre, N. K., & Vian, J. (2015) · The MIT Press eBooks · doi:10.7551/mitpress/10187.001.0001 · Cited by 392
Zikmund-Fisher, B. J., Smith, D. M., Ubel, P. A., & Fagerlin, A. (2007) · Medical Decision Making · doi:10.1177/0272989x07303824 · Cited by 353
The effects of communicating uncertainty on public trust in facts and numbers
van der Bles, A. M., van der Linden, S., Freeman, A. L. J., & Spiegelhalter, D. J. (2020) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1913678117 · Cited by 348
Machine Heuristic: When We Trust Computers More than Humans with Our Personal Information
Sundar, S. S., & Kim, J. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300768 · Cited by 347
Communicating the Uncertainty of Harms and Benefits of Medical Interventions
Politi, M. C., Han, P. K. J., & Col, N. F. (2007) · Medical Decision Making · doi:10.1177/0272989x07307270 · Cited by 344
Confidence Distribution, the Frequentist Distribution Estimator of a Parameter: A Review
Xie, M., & Singh, K. (2013) · International Statistical Review · doi:10.1111/insr.12000 · Cited by 319
Theoretical Considerations and Development of a Questionnaire to Measure Trust in Automation
Körber, M. (2019) · Advances in Intelligent Systems and Computing · doi:10.1007/978-3-319-96074-6_2 · Cited by 317 · cited 1×
“Factors communities have a long history of studying trust in automation [74, 99, 106].”
BackgroundClassification with a Reject Option using a Hinge Loss
Bartlett, P. L., & Wegkamp, M. H. (2008) · QUT ePrints (Queensland University of Technology) · doi:10.5555/1390681.1442792 · Cited by 317
Empirical scaling of common verbal phrases associated with numerical probabilities
Lichtenstein, S., & Newman, J. R. (1967) · Psychonomic Science · doi:10.3758/bf03327890 · Cited by 313 · cited 1×
“, likely, probably), these interpretations can vary substantially from one person to another [17, 22, 74].”
BackgroundCommunicating scientific uncertainty
Fischhoff, B., & Davis, A. L. (2014) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1317504111 · Cited by 312
Trust and etiquette in high-criticality automated systems
Parasuraman, R., & Miller, C. A. (2004) · Communications of the ACM · doi:10.1145/975817.975844 · Cited by 311
Inherent Tradeoffs in the Fair Determination of Risk Scores
(2023) · The Societal Impacts of Algorithmic Decision-Making · doi:10.1145/3603195.3603197 · Cited by 310
Jewell, N. P., Lewnard, J. A., & Jewell, B. L. (2020) · JAMA · doi:10.1001/jama.2020.6585 · Cited by 306
Consistency in interpretation of probabilistic phrases
Budescu, D. V., & Wallsten, T. S. (1985) · Organizational Behavior and Human Decision Processes · doi:10.1016/0749-5978(85)90007-x · Cited by 300
Decision Theory for Discrimination-Aware Classification
Kamiran, F., Karim, A., & Zhang, X. (2012) · 2012 IEEE 12th International Conference on Data Mining · doi:10.1109/icdm.2012.45 · Cited by 300
Kendall, A., Badrinarayanan, V., & Cipolla, R. (2015) · arXiv · doi:10.48550/arxiv.1511.02680 · Cited by 292
(2015) · Cited by 291
BatchBALD: Efficient and Diverse Batch Acquisition for Deep Bayesian Active Learning
Kirsch, A., van Amersfoort, J., & Gal, Y. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.08158 · Cited by 283
Data Decisions and Theoretical Implications when Adversarially Learning Fair Representations
Beutel, A., Chen, J., Zhao, Z., & Chi, E. H. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1707.00075 · Cited by 274
Pleiss, G., Raghavan, M., Wu, F., Kleinberg, J. M., & Weinberger, K. Q. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1709.02012 · Cited by 263
Uncertainty Estimation Using a Single Deep Deterministic Neural Network
van Amersfoort, J., Smith, L., Teh, Y. W., & Gal, Y. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.02037 · Cited by 263
Effective Communication of Uncertainty in the IPCC Reports
Budescu, D. V., Por, H.-H., & Broomell, S. B. (2012) · Climatic Change · doi:10.1007/s10584-011-0330-3 · Cited by 261 · cited 1×
“[16] investigated how the general public interpret the uncertainty information in the climate change report published by the Intergovernmental Panel on Climate Change (IPCC).”
BackgroundError Bars Considered Harmful: Exploring Alternate Encodings for Mean and Error
Correll, M., & Gleicher, M. (2014) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2014.2346298 · Cited by 258 · cited 1×
“bars may also overly emphasize the range within the bar [24].”
BackgroundHora, S. C. (1996) · Reliability Engineering & System Safety · doi:10.1016/s0951-8320(96)00077-4 · Cited by 249
Risk and Uncertainty Communication
Spiegelhalter, D. (2017) · Annual Review of Statistics and Its Application · doi:10.1146/annurev-statistics-010814-020148 · Cited by 248
Dropout Sampling for Robust Object Detection in Open-Set Conditions
Miller, D., Nicholson, L., Dayoub, F., & Sunderhauf, N. (2018) · 2018 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2018.8460700 · Cited by 247
A survey on Shari'ah governance practices in Malaysia, GCC countries and the UK: Critical appraisal
Hasan, Z. (2011) · International Journal of Islamic and Middle Eastern Finance and Management · doi:10.1108/17538391111122195 · Cited by 240
Kay, M., Kola, T., Hullman, J. R., & Munson, S. A. (2016) · Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858558 · Cited by 239 · cited 3×
“[64] develop quantile dot plots to convey distributions (see Figure 3b for an example).”
BackgroundSimple and principled uncertainty estimation with deterministic deep learning via distance awareness
Liu, J. Z., Lin, Z., Padhy, S., Tran, D., Bedrax-Weiss, T., & Lakshminarayanan, B. (2020) · arXiv · doi:10.48550/arxiv.2006.10108 · Cited by 237
Linking Trust to Trustworthiness
O’Neill, O. (2018) · International Journal of Philosophical Studies · doi:10.1080/09672559.2018.1454637 · Cited by 233
James, D., Lee, J., & Wheeler, K. (2019) · SpringerBriefs in Applied Sciences and Technology · doi:10.1007/978-981-13-3777-2_2 · Cited by 229
Statistical Numeracy for Health: A Cross-cultural Comparison With Probabilistic National Samples
Galesic, M. (2010) · Archives of Internal Medicine · doi:10.1001/archinternmed.2009.481 · Cited by 221
Measuring Calibration in Deep Learning
Nixon, J., Dusenberry, M., Jerfel, G., Nguyen, T., Liu, J., Zhang, L., & Tran, D. (2019) · arXiv · doi:10.48550/arxiv.1904.01685 · Cited by 209
Li, R., Rivers, C., Tan, Q., Murray, M. B., Toner, E. S., & Lipsitch, M. (2020) · JAMA Network Open · doi:10.1001/jamanetworkopen.2020.8297 · Cited by 208
Kull, M., Perello-Nieto, M., Kängsepp, M., Filho, T. S., Song, H., & Flach, P. (2019) · arXiv · doi:10.48550/arxiv.1910.12656 · Cited by 206
Fairness Without Demographics in Repeated Loss Minimization
Hashimoto, T., Srivastava, M., Namkoong, H., & Liang, P. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1806.08010 · Cited by 199
Sorrentino, R. M., Bobocel, D. R., Gitta, M. Z., Olson, J. M., & Hewitt, E. C. (1988) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.55.3.357 · Cited by 198
Transparency: Motivations and Challenges
Weller, A. (2019) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-28954-6_2 · Cited by 198
Self-citationHullman, J., Resnick, P., & Adar, E. (2015) · PLOS ONE · doi:10.1371/journal.pone.0142444 · Cited by 194 · cited 7×
“Lastly, HOP can also be used to show uncertainty estimates over a range of predictions by showing each model’s predictions in an animation frame [130].”
BackgroundInfluentialIn Pursuit of Error: A Survey of Uncertainty Visualization Evaluation
Hullman, J., Qiao, X., Correll, M., Kale, A., & Kay, M. (2019) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2018.2864889 · Cited by 187 · cited 1×
“[55] review methods for evaluating the success of uncertainty visualization.”
MethodRapid Trust Calibration through Interpretable and Uncertainty-Aware AI
Tomsett, R., Preece, A., Braines, D., Cerutti, F., Chakraborty, S., Srivastava, M., Pearson, G., & Kaplan, L. (2020) · Patterns · doi:10.1016/j.patter.2020.100049 · Cited by 186 · cited 1×
“If well-calibrated and effectively communicated, uncertainty can help stakeholders understand when they should trust model predictions and help developers address fairness issues in their models [123, 138].”
BackgroundWhy is my classifier discriminatory?
Chen, I., Johansson, F. D., & Sontag, D. (2018) · arXiv · doi:10.48550/arxiv.1805.12002 · Cited by 185
Pitfalls of In-Domain Uncertainty Estimation and Ensembling in Deep Learning
Ashukha, A., Lyzhov, A., Molchanov, D., & Vetrov, D. (2020) · arXiv · doi:10.48550/arxiv.2002.06470 · Cited by 178
Bayesian Deep Learning and a Probabilistic Perspective of Generalization
Wilson, A. G., & Izmailov, P. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.08791 · Cited by 171
Predictive Uncertainty Estimation via Prior Networks
Malinin, A., & Gales, M. (2018) · Apollo (University of Cambridge) · doi:10.17863/cam.35237 · Cited by 163
Freeman, L. C. (1966) · Cited by 157
Narayanan, M., Chen, E., He, J., Kim, B., Gershman, S., & Doshi-Velez, F. (2018) · arXiv · doi:10.48550/arxiv.1802.00682 · Cited by 153
Bayesian Uncertainty Estimation for Batch Normalized Deep Networks
Teye, M., Azizpour, H., & Smith, K. C. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1802.06455 · Cited by 153
Statistics notes: Bayesians and frequentists
Bland, J. M., & Altman, D. G. (1998) · BMJ · doi:10.1136/bmj.317.7166.1151 · Cited by 152
Identifying and Correcting Label Bias in Machine Learning
Jiang, H., & Nachum, O. (2019) · arXiv · doi:10.48550/arxiv.1901.04966 · Cited by 152
Fairness Under Unawareness: Assessing Disparity When Protected Class Is Unobserved
Chen, J., Kallus, N., Mao, X., Svacha, G., & Udell, M. (2019) · Proceedings of the Conference on Fairness, Accountability, and Transparency · doi:10.1145/3287560.3287594 · Cited by 150
SDE-Net: Equipping Deep Neural Networks with Uncertainty EstimatesPreprint
Kong, L., Sun, J., & Zhang, C. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2008.10546 · Cited by 145
Evaluating Bayesian Deep Learning Methods for Semantic Segmentation
Mukhoti, J., & Gal, Y. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1811.12709 · Cited by 138
Inherent Trade-Offs in Algorithmic Fairness
Kleinberg, J. (2018) · Abstracts of the 2018 ACM International Conference on Measurement and Modeling of Computer Systems · doi:10.1145/3219617.3219634 · Cited by 125
With Malice Toward None: Assessing Uncertainty via Equalized Coverage
Romano, Y., Barber, R. F., Sabatti, C., & Candès, E. J. (2020) · Harvard Data Science Review · doi:10.1162/99608f92.03f00592 · Cited by 125
Depth Uncertainty in Neural NetworksPreprint
Antorán, J., Allingham, J. U., & Hernández-Lobato, J. M. (2020) · arXiv (Cornell University) · doi:10.17863/cam.69875 · Cited by 115
Self-citationClassification with asymmetric label noise: Consistency and maximal denoising
Blanchard, G., Flaska, M., Handy, G., Pozzi, S. A., & Scott, C. (2016) · Electronic Journal of Statistics · doi:10.1214/16-ejs1193 · Cited by 113
Verbal uncertainty expressions: A critical review of two decades of research
Clark, D. A. (1990) · Current Psychology · doi:10.1007/bf02686861 · Cited by 112
Functional Variational Bayesian Neural Networks
Sun, S., Zhang, G., Shi, J., & Grosse, R. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1903.05779 · Cited by 111
Visual Reasoning Strategies for Effect Size Judgments and Decisions
Kale, A., Kay, M., & Hullman, J. (2021) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2020.3030335 · Cited by 109 · cited 1×
“[62] note that simple heuristics may suffice instead of complex uncertainty visualizations: they find that the best visualizations for understanding effect size may not be the best for decision-making.”
BackgroundCyclical Stochastic Gradient MCMC for Bayesian Deep Learning
Zhang, R., Li, C., Zhang, J., Chen, C., & Wilson, A. G. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1902.03932 · Cited by 108
Probabilistic Modeling of Deep Features for Out-of-Distribution and Adversarial DetectionPreprint
Ahuja, N., Ndiour, I. J., Kalyanpur, T., & Tickoo, O. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1909.11786 · Cited by 107
Self-citationYang, Q., Zimmerman, J., Steinfeld, A., Carey, L., & Antaki, J. F. (2016) · Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858373 · Cited by 105 · cited 1×
“[188] draw on field research with healthcare decision-makers to understand why”
BackgroundA Reductions Approach to Fair Classification
Agarwal, A., Beygelzimer, A., Dudı́k, M., Langford, J. C., & Wallach, H. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1803.02453 · Cited by 95
Predict Responsibly: Improving Fairness and Accuracy by Learning to Defer
Madras, D., Pitassi, T., & Zemel, R. (2017) · arXiv · doi:10.48550/arxiv.1711.06664 · Cited by 90
Well-calibrated Model Uncertainty with Temperature Scaling for Dropout Variational InferencePreprint
Laves, M.-H., Ihler, S., Kortmann, K.-P., & Ortmaier, T. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1909.13550 · Cited by 86
Models as Approximations II: A Model-Free Theory of Parametric Regression
Buja, A., Brown, L., Kuchibhotla, A. K., Berk, R. A., George, E. I., & Zhao, L. H. (2019) · Statistical Science · doi:10.1214/18-sts694 · Cited by 86
Three environmental discourses in human-computer interaction
Goodman, E. (2009) · CHI '09 Extended Abstracts on Human Factors in Computing Systems · doi:10.1145/1520340.1520358 · Cited by 85
Anahideh, H., Asudeh, A., & Thirumuruganathan, S. (2022) · Expert Systems with Applications · doi:10.1016/j.eswa.2022.116981 · Cited by 82
Expectation propagation in linear regression models with spike-and-slab priors
Hernández-Lobato, J. M., Hernández-Lobato, D., & Suárez, A. (2014) · Machine Learning · doi:10.1007/s10994-014-5475-7 · Cited by 80
(2018) · Cited by 78
Validity and usefulness of COVID-19 models
Eker, S. (2020) · Humanities and Social Sciences Communications · doi:10.1057/s41599-020-00553-4 · Cited by 78
On the Expressiveness of Approximate Inference in Bayesian Neural NetworksPreprint
Foong, A. Y. K., Burt, D. R., Li, Y., & Turner, R. E. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1909.00719 · Cited by 76
Hofman, J. M., Goldstein, D. G., & Hullman, J. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376454 · Cited by 75
Theoretical considerations and development of a questionnaire to measure trust in automation
Körber, M. (2018) · doi:10.31234/osf.io/nfc45 · Cited by 71
Active Fairness in Algorithmic Decision Making
Noriega-Campero, A., Bakker, M. A., Garcia-Bulle, B., & Pentland, A. '. (2019) · Proceedings of the 2019 AAAI/ACM Conference on AI, Ethics, and Society · doi:10.1145/3306618.3314277 · Cited by 71
Single-Model Uncertainties for Deep Learning
Tagasovska, N., & López-Paz, D. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1811.00908 · Cited by 70
Assessing algorithmic fairness with unobserved protected class using data combination
Kallus, N., Mao, X., & Zhou, A. (2020) · Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency · doi:10.1145/3351095.3373154 · Cited by 54
Recovering from Biased Data: Can Fairness Constraints Improve Accuracy?
Blum, A. L., & Stangl, K. (2020) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.forc.2020.3 · Cited by 54
Where is the Human?: Bridging the Gap Between AI and HCI
Inkpen, K., Chancellor, S., De Choudhury, M., Veale, M., & Baumer, E. P. S. (2019) · Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290607.3299002 · Cited by 54
Designing Information for Remediating Cognitive Biases in Decision-Making
Zhang, Y., Bellamy, R. K. E., & Kellogg, W. A. (2015) · Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems · doi:10.1145/2702123.2702239 · Cited by 51 · cited 1×
“Research [174, 195] also found that this bias occurs when people are asked to make decisions under risk”
BackgroundSelf-citationGetting a CLUE: A Method for Explaining Uncertainty Estimates
Antorán, J., Bhatt, U., Adel, T., Weller, A., & Hernández-Lobato, J. M. (2021) · Apollo - University of Cambridge Repository · doi:10.17863/cam.69929 · Cited by 49
Self-citationOptimized Score Transformation for Fair ClassificationPreprint
Wei, D., Ramamurthy, K. N., & Calmon, F. P. (2019) · arXiv (Cornell University) · Cited by 49
Conceptual difficulties when interpreting histograms: A review
Boels, L., Bakker, A., Van Dooren, W., & Drijvers, P. (2019) · Educational Research Review · doi:10.1016/j.edurev.2019.100291 · Cited by 47
Radial Bayesian Neural Networks: Beyond Discrete Support In Large-Scale Bayesian Deep Learning
Farquhar, S., Osborne, M., & Gal, Y. (2019) · arXiv · doi:10.48550/arxiv.1907.00865 · Cited by 43
Risk, uncertainty and prophet: The psychological insights of Frank H. Knight
Rakow, T. (2010) · Judgment and Decision Making · doi:10.1017/s1930297500001303 · Cited by 42
Machine Learning Explainability for External Stakeholders
Bhatt, U., Andrus, M., Weller, A., & Xiang, A. (2020) · arXiv · doi:10.48550/arxiv.2007.05408 · Cited by 41
Self-citationYe, N., & Zhu, Z. (2018) · ePrints Soton (University of Southampton) · Cited by 40
Scalable Gaussian process inference using variational methods
Matthews, A. G. D. G. (2016) · Apollo (University of Cambridge) · doi:10.17863/cam.25348 · Cited by 40
Frequentist and Bayesian approaches to data analysis: Evaluation and estimation
Pek, J. C. X., & Zandt, T. V. (2019) · Psychology Learning & Teaching · doi:10.1177/1475725719874542 · Cited by 39
Alaa, A. M., & van der Schaar, M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.13481 · Cited by 38
Robust Optimization for Fairness with Noisy Protected Groups
Wang, S., Guo, W., Narasimhan, H., Cotter, A., Gupta, M. R., & Jordan, M. I. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.09343 · Cited by 37
Research works printed but not linked: 12
- Emily Badger , Claire Cain Miller , Adam Pearce, and Kevin Quealy. 2018 . Income Mobility Charts for Girls, Asian- Americans and Other Groups . Or Make YourOwn. (2018). Emily Badger, Claire Cain Miller, Adam Pearce, and Kevin Quealy. 2018. Income Mobility Charts for Girls, Asian-Americans and Other Groups. Or Make YourOwn. (2018).
- J Martin Bland and Douglas G Altman . 1998. Bayesians and frequentists. BMJ317, 7166 ( 1998 ), 1151--1160. https://doi.org/10.1136/bmj.317.7166.1151arXiv:https://www.bmj.com/content/317/7166/1151.1.full.pdf 10.1136/bmj.317.7166.1151arXiv:https: J Martin Bland and Douglas G Altman. 1998. Bayesians and frequentists. BMJ317, 7166 (1998), 1151--1160. https://doi.org/10.1136/bmj.317.7166.1151arXiv:https://www.bmj.com/content/317/7166/1151.1.full.pdf · doi:10.1136/bmj.317.7166.1151arxiv:https://www.bmj.com/content/317/7166/1151.1.full.pdf
- Shelly Chaiken . 1999. The heuristic-systematic. Dual-process theories social psychology 73 ( 1999 ). Shelly Chaiken. 1999. The heuristic-systematic. Dual-process theories social psychology 73 (1999).
- Marvin S Cohen , Raja Parasuraman , and Jared T Freeman . 1998 . Trust in decision aids: A model and its training implications . In Proc. Command and Control Research and Technology Symp. Citeseer. Marvin S Cohen, Raja Parasuraman, and Jared T Freeman. 1998. Trust in decision aids: A model and its training implications. In Proc. Command and Control Research and Technology Symp. Citeseer.
- Yarin Gal . 2016. Uncertainty in deep learning . University of Cambridge 1, 3( 2016 ). Yarin Gal. 2016. Uncertainty in deep learning. University of Cambridge 1, 3(2016).
- Malik Sajjad Ahmed Nadeem , Jean-Daniel Zucker , and Blaise Hanczar . 2009 . Accuracy-Rejection Curves (ARCs) for Comparing Classification Methods with a Reject Option . In Proceedings of the third International Workshop on Machine Learning in Systems Biology (Proceedings of Machine Learning Research), Saso Dzeroski, Pierre Guerts, and Juho Rousu (Eds.) , Vol. 8 . PMLR, Ljubljana, Slovenia, 65--81. http://proceedings.mlr.press/v8/nadeem10a.html Malik Sajjad Ahmed Nadeem, Jean-Daniel Zucker, and Blaise Hanczar. 2009.Accuracy-Rejection Curves (ARCs) for Comparing Classification Methods with a Reject Option. In Proceedings of the third International Workshop on Machine Learning in Systems Biology (Proceedings of Machine Learning Research), Saso Dzeroski, Pierre Guerts, and Juho Rousu (Eds.), Vol. 8. PMLR, Ljubljana, Slovenia, 65--81. http://proceedings.mlr.press/v8/nadeem10a.html
- 10.5555/2888116.2888120 · doi:10.5555/2888116.2888120
- Jennifer Preece , Helen Sharp , and Yvonne Rogers . 2015. Interaction design: beyond human-computer interaction . John Wiley & Sons . Jennifer Preece, Helen Sharp, and Yvonne Rogers. 2015. Interaction design: beyond human-computer interaction. John Wiley & Sons.
- S Shyam Sundar . 2008. The MAIN model : A heuristic approach to understanding technology effects on credibility . MacArthur Foundation Digital Media andLearning Initiative . S Shyam Sundar. 2008.The MAIN model: A heuristic approach to understanding technology effects on credibility. MacArthur Foundation Digital Media andLearning Initiative.
- 10.5555/3305890.3306024 · doi:10.5555/3305890.3306024
- Anne Marthe van der Bles , Sander van der Linden , Alexandra L. J. Freeman , James Mitchell , Ana B. Galvao , Lisa Zaval , and David J. Spiegelhalter . 2019 . Communicating Uncertainty about Facts , Numbers and Science. 6 , 5 (2019), 181870 . https://doi.org/10/gf2g9j Anne Marthe van der Bles, Sander van der Linden, Alexandra L. J. Freeman,James Mitchell, Ana B. Galvao, Lisa Zaval, and David J. Spiegelhalter. 2019. Communicating Uncertainty about Facts, Numbers and Science. 6, 5 (2019), 181870. https://doi.org/10/gf2g9j
- Claus O. Wilke . 2019. Fundamentals of Data Visualization: A Primer on Making Informative and Compelling Figures ( 1 st edition ed.). O'Reilly Media . Claus O. Wilke. 2019. Fundamentals of Data Visualization: A Primer on Making Informative and Compelling Figures(1st edition ed.). O'Reilly Media.
Cited by
Generative AI and ChatGPT: applications, challenges, and AI-human collaboration
Fui-Hoon Nah, F., Zheng, R., Cai, J., Siau, K., & Chen, L. (2023) · Journal of Information Technology Case and Application Research · doi:10.1080/15228053.2023.2233814 · Cited by 1,363
The Metacognitive Demands and Opportunities of Generative AI
Tankelevitch, L., Kewenig, V., Simkute, A., Scott, A. E., Sarkar, A., Sellen, A., & Rintel, S. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642902 · Cited by 493
Towards trustworthy machine fault diagnosis: A probabilistic Bayesian deep learning framework
Zhou, T., Han, T., & Droguett, E. L. (2022) · Reliability Engineering & System Safety · doi:10.1016/j.ress.2022.108525 · Cited by 260
Socially Responsible AI Algorithms: Issues, Purposes, and Challenges
Cheng, L., Varshney, K. R., & Liu, H. (2021) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.12814 · Cited by 261
Nemani, V., Biggio, L., Huan, X., Hu, Z., Fink, O., Tran, A., Wang, Y., Zhang, X., & Hu, C. (2023) · Mechanical Systems and Signal Processing · doi:10.1016/j.ymssp.2023.110796 · Cited by 243
Metadata
- Authors
- Bhatt, U., Antorán, J., Zhang, Y., Liao, Q. V., Sattigeri, P., Fogliato, R., Melançon, G., Krishnan, R., Stanley, J., Tickoo, O., Nachman, L., Chunara, R., Srikumar, M., Weller, A., & Xiang, A.
- Affiliations
- University of Cambridge (GB)
- IBM (United States) (US)
- Carnegie Mellon University (US)
- Concordia University (CA)
- Intel (United States) (US)
- New York University (US)
- Partnership on AI, San Francisco, CA, USA
- Sony AI, Seattle, WA, USA
- ORCID
- Venue
- Proceedings of the 2021 AAAI/ACM Conference on AI, Ethics, and Society
- Publisher
- ACM
- Published
- 2021-07-21
- Pages
- 401-413
- ISSN
- 3065-8365 (ISSN-L)
- OpenAlex
- W3183398589
- Semantic Scholar
- 3973e0fab69a00f5ed6a81ca408f60c420fa6e61
- Cited by
- 300
- References
- 116
- Citations by year
- 2026: 59 · 2025: 62 · 2024: 65 · 2023: 46 · 2022: 48 · 2021: 18
- FWCI
- 16.64
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Proceedings of the AAAI/ACM Conference on AI Ethics and Society (publishedVersion, cc-by)
- arXiv (Cornell University) (submittedVersion)
- Cambridge University Engineering Department Publications Database (submittedVersion)
- arXiv (Cornell University)
- Funders
- Microsoft Research
- Northwestern University
- Alan Turing Institute (EP/N510129/1., TU/B/000074, N510129)
- DeepMind
- Leverhulme Trust
- Engineering and Physical Sciences Research Council (N510129, EP/N510129/, EP/N510129/1, TU/B/000074, 2275741, EPSRC grant EP/N510129/1, EP/V025279/1)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Physical Sciences › Computer Science › Artificial Intelligence › Adversarial Robustness in Machine Learning
- Keywords
- algorithmic transparency, uncertainty estimation, uncertainty communication, explainability, model fairness, trustworthy systems, decision-making, uncertainty visualization, human-computer interaction, machine learning pipelines, stakeholder awareness
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-24, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-24 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.