Uncertainty as a Form of Transparency: Measuring, Communicating, and Using Uncertainty
Open accessThe DOI matches its Crossref record; 228 of the 229 references it cites were found in a registry or an index, and 1 are not checked yet; 41 of the 135 sources its claims cite were checked for support.
Abstract
Algorithmic transparency entails exposing system properties to various stakeholders for purposes that include understanding, improving, and contesting predictions. Until now, most research into algorithmic transparency has predominantly focused on explainability. Explainability attempts to provide reasons for a machine learning model's behavior to stakeholders. However, understanding a model's specific behavior alone might not be enough for stakeholders to gauge whether the model is wrong or lacks sufficient knowledge to solve the task at hand. In this paper, we argue for considering a complementary form of transparency by estimating and communicating the uncertainty associated with model predictions. First, we discuss methods for assessing uncertainty. Then, we characterize how uncertainty can be used to mitigate model unfairness, augment decision-making, and build trustworthy systems. Finally, we outline methods for displaying uncertainty to stakeholders and recommend how to collect information required for incorporating uncertainty into existing ML pipelines. This work constitutes an interdisciplinary review drawn from literature spanning machine learning, visualization/HCI, design, decision-making, and fairness. We aim to encourage researchers and practitioners to measure, communicate, and use uncertainty as a form of transparency.
Verified 2026-11-19 · 1 reference not checked yet
Overview
CoChat Summary
TL;DR
This paper argues that estimating and communicating uncertainty should be treated as a complementary form of algorithmic transparency alongside explainability. It reviews methods for measuring uncertainty and discusses how uncertainty can support fairness, decision-making, trust, and stakeholder communication.
Key findings
- Uncertainty is split into aleatoric uncertainty (irreducible noise/class overlap) and epistemic uncertainty (reducible with more data); calibration is a precursor to using uncertainty as transparency, and deep ensembles are described as one of the best-performing uncertainty quantification approaches for neural networks, retaining calibration under dataset shift.
- Uncertainty can help address fairness issues: representation bias is epistemic and may be detected via large epistemic uncertainty on validation/deployment data, while feature and label noise are aleatoric and can distort fairness assessments; even a small amount of label noise can greatly impact fairness evaluation.
- In decision-making, uncertainty supports reject options and decision-theoretic action selection; JDM findings indicate risk is considered together with expected outcome, asymmetrically, and tolerance for uncertainty decreases superlinearly as stakes increase.
- Communication is difficult: in a 2010 US/Germany survey, 20% could not identify 10% as the biggest disease risk among 1%, 5%, and 10%, and almost 30% could not answer whether 1 in 10, 1 in 100, or 1 in 1000 represents the largest risk; people interpreted the IPCC’s “very likely” as around 60% probability, whereas the guideline specifies greater than 90%. Quantile dot plots and hypothetical outcome plots (HOPs) are reported to improve some probability/uncertainty judgments.
Methods
- Interdisciplinary literature review, not an empirical study, drawn from machine learning, visualization/HCI, design, decision-making, and fairness.
- Uses a recurring breast cancer diagnostics scenario to illustrate uncertainty in fairness, decision-making, trust formation, and communication.
- Synthesizes uncertainty quantification approaches (Bayesian methods, frequentist methods such as ensembles), evaluation metrics (calibration, NLL, Brier score, ECE), and communication methods (categories, numerical ranges, summary statistics, full distributions, visualizations).
Limitations
- The paper states that its findings should not be treated as conclusive for predicting real-world usability and recommends testing with real users in concrete tasks and settings.
- The paper states that empirical understanding of how decision-makers use aleatoric versus epistemic uncertainty is limited, that JDM literature has mostly focused on discrete outcomes, and that there is not a good understanding of how people perceive uncertainty over continuous outcomes such as error bars.
- Evident from the text: as a review, it provides no primary empirical validation or systematic review protocol; several claims are speculative or drawn from other fields and are framed as open questions for future research.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures




![(c) Cone of uncertainty, showing the uncertainty around the predicted path of the center of a hurricane. Taken from [93].](https://figures.cochat.ai/paper-figures/42e1c0dd14b540788474c4bee4ed993b/uncertainty-as-a-form-of-transparency-measuring-communicating-and-using-figure-5.png)

Verification
Claims the paper makes
28 Valid · 10 Not valid · 60 Not checked · 104 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“When information on the sensitive attribute is unavailable (e.g., information on gender was not collected), but can be predicted from an auxiliary dataset, disparity measures are generally unidentifiable [20,63].”
§ Uncertainty as a Form of Transparency: Measuring, Communicating, and Using Uncertainty > 3.1 Uncertainty and Fairness
What the sources say
- Partly supportedcites [20] 20. Jiahao Chen, Nathan Kallus, Xiaojie Mao, Geoffry Svacha, and Madeleine Udell. 2019. Fairness under unawareness: Assessing disparity when protected class is unobserved. In Proceedings of the conference on fairness, accountability, and transparency. 339-348. sourceExperimental — accuracy not yet measured
Section 1.1 (p. 2) describes assessing disparity when protected-class labels are unavailable and must be imputed from proxy variables. The paper analyzes bias in the resulting disparity estimates, but the cited passages do not establish the broader claim that disparity measures are generally unidentifiable; the Conclusions (p. 9) instead note that the optimal imputation threshold cannot be determined without ground-truth labels. (LLM, conf=0.82)
- Supportedcites [63] 63. Nathan Kallus, Xiaojie Mao, and Angela Zhou. 2019. Assessing algorithmic fairness with unobserved protected class using data combination. arXiv preprint arXiv:1906.00285 (2019). source
The paper’s problem formulation describes a primary dataset missing protected-class labels and an auxiliary dataset containing those labels and proxy variables. Section 4 states that disparity measures are generally unidentifiable from the two datasets because their marginals do not uniquely determine the full joint distribution. The paper notes an exception for perfectly predictive proxies, consistent with the claim’s qualifier ‘generally.’ (LLM, conf=0.94)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“The experimental results of Gupta et al. [44] have shown that enforcing fairness constraints on a noisy sensitive attribute, without assumptions on the structure of the noise, is not guaranteed to lead to any improvement in the fairness properties of our model.”
§ Uncertainty as a Form of Transparency: Measuring, Communicating, and Using Uncertainty > 3.1 Uncertainty and Fairness
What the sources say
- Partly supportedcites [44] 44. Maya Gupta, Andrew Cotter, Mahdi Milani Fard, and Serena Wang. 2018. Proxy fairness. arXiv preprint arXiv:1806.11212 (2018). sourceExperimental — accuracy not yet measured
Section 4 (pp. 3–4) says poorly chosen proxy groups can worsen fairness for the true protected groups, supporting the claim that improvement is not guaranteed. But the paper presents this as a theoretical possibility, while its reported experiments generally found improvements (Conclusions, p. 8). It does not frame the result as an experiment on noisy sensitive attributes without assumptions about the noise structure. (LLM, conf=0.84)
boosted- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“Indeed, Fogliato et al. [35] show that even a small amount of label noise can greatly impact the assessment of the fairness properties of the model.”
§ Uncertainty as a Form of Transparency: Measuring, Communicating, and Using Uncertainty > 3.1 Uncertainty and Fairness
What the sources say
- Supportedcites [35] 35. Riccardo Fogliato, Max G'Sell, and Alexandra Chouldechova. 2020. Fairness Evaluation in Presence of Biased Noisy Labels. arXiv preprint arXiv:2003.13808 (2020). source
The Abstract (p. 1) reports that even small biases in observed labels may call into question conclusions drawn from evaluating a model against those labels. The Conclusion (p. 8) gives an example in which a small gap in arrest likelihood could fully account for observed miscalibration. This supports the claim that a small amount of biased label noise can substantially affect fairness assessment. (LLM, conf=0.89)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“Here, measures of demographic parity and equalized odds computed on the observed data are equal to the true metrics up to a scaling factor, which is proportional to the value of the noise [71]; if the noise rates are known, then the true metrics can be directly estimated.”
§ Uncertainty as a Form of Transparency: Measuring, Communicating, and Using Uncertainty > 3.1 Uncertainty and Fairness
What the sources say
- Supportedcites [71] 71. Alex Lamy, Ziyuan Zhong, Aditya K Menon, and Nakul Verma. 2019. Noise- tolerant fair classification. In Advances in Neural Information Processing Systems. 294-306. source
Section 4.2 (p. 6) states that MC noise scales the fairness measure, giving the clean measure as (1 − α − β) times the corrupted-data measure. Section 3.3 (p. 4) says equalized odds can be captured by adding a constraint for Y = 0, and §4.3 (p. 6) explains how known noise parameters supply the scaling factor. The factor depends on the noise rates; more precisely, it is 1 − α − β, not directly proportional to their value. (LLM, conf=0.88)
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Similarly to noise in the sensitive attribute, Blum and Stangl [11], Jiang and Nachum [59] show that fairness constraints are guaranteed to improve the properties of a predictor only under appropriate assumptions on the label noise.”
§ Uncertainty as a Form of Transparency: Measuring, Communicating, and Using Uncertainty > 3.1 Uncertainty and Fairness
What the sources say
- Partly supportedcites [11] 11. Avrim Blum and Kevin Stangl. 2019. Recovering from biased data: Can fairness constraints improve accuracy? arXiv preprint arXiv:1912.01094 (2019). sourceExperimental — accuracy not yet measured
Section 3.3 (p. 11) says Equal Opportunity-constrained ERM recovers the Bayes-optimal classifier when Group A has sufficient mass and the signal is not too noisy. Section 3.1 (p. 9) also gives a recovery range bounded by the noise parameter η. The claim captures the dependence on noise assumptions, but overgeneralizes the guarantee to fairness constraints generally and omits the paper’s other conditions. (LLM, conf=0.86)
- Partly supportedcites [59] 59. Heinrich Jiang and Ofir Nachum. 2020. Identifying and correcting label bias in machine learning. In International Conference on Artificial Intelligence and Statistics. 702-712. sourceExperimental — accuracy not yet measured
Section 2.1 (p. 2) says that recovering unbiased labels requires an assumption about their relationship to observed biased labels. The Introduction (p. 1) reports a theoretical guarantee for the paper’s re-weighted training method under its model. It does not establish the broader claim that fairness constraints improve a predictor only under appropriate assumptions about label noise. (LLM, conf=0.83)
boostedstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
74 more claims · 11 with their cited sources checked
Create a free account to see all 202 claims and to verify the 24 references still open.
- It may state two separate claims as one. 40
- Probably not a substantial claim. 105
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Uncertainty is considered a critical form of transparency that can alert people about the limitations of AI [10].”
From Investigating Explainability of Generative AI for Code through Scenario-based Design (2022) · cites this paper as [10]
The cited source says what the claim attributes to it.
In the citing paper
“Similar metrics have been used to evaluate the calibration of uncertainty quantification [7,9,64]-the estimated uncertainty should reflect the observed error rate.”
From Understanding the Role of Human Intuition on Reliance in Human-AI Decision-Making with Explanations (2023) · cites this paper as [7]
The cited source says what the claim attributes to it.
In the citing paper
“Uncertainty expression can also increase the system's perceived transparency [13], which is generally shown to enhance trust, whether or not appropriate [56].”
From "I'm Not Sure, But...": Examining the Impact of Large Language Models' Uncertainty Expression on User Reliance and Trust (2024) · cites this paper as [13]
The cited source says what the claim attributes to it.
In the citing paper
“Finally, indicating model uncertainty [19,174,198], for example, by means of color-coding [167], and an explanation for that uncertainty [5,190], can also help users disentangle the role of their prompting and output evaluation ability from that of models' capabilities, further supporting confidence adjustment [197].”
From The Metacognitive Demands and Opportunities of Generative AI (2024) · cites this paper as [19]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Uncertainty as a Form of Transparency: Measuring, Communicating, and Using Uncertainty > References
“137. Yunfeng Zhang, Rachel KE Bellamy, and Wendy A. Kellogg. 2012.”
§ Uncertainty as a Form of Transparency: Measuring, Communicating, and Using Uncertainty > References
“In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (2015).”
Citations
Cites
Items 201–229 of 229
Noise-tolerant fair classification
Lamy, A. L., Zhong, Z., Menon, A. K., & Verma, N. (2019) · arXiv · doi:10.48550/arxiv.1901.10837 · Cited by 36
Raji, I. D., & Yang, J. (2019) · arXiv · doi:10.48550/arxiv.1912.06166 · Cited by 36
From Soft Classifiers to Hard Decisions: How fair can we be?
Canetti, R., Cohen, A., Dikkala, N., Ramnarayan, G., Scheffler, S., & Smith, A. (2019) · Proceedings of the Conference on Fairness, Accountability, and Transparency · doi:10.1145/3287560.3287561 · Cited by 36
Investigating User Confidence for Uncertainty Presentation in Predictive Decision Making
Arshad, S. Z., Zhou, J., Bridon, C., Chen, F., & Wang, Y. (2015) · Proceedings of the Annual Meeting of the Australian Special Interest Group for Computer Human Interaction · doi:10.1145/2838739.2838753 · Cited by 30
(2008) · Cited by 29
Insights into Human-Agent Teaming: Intelligent Agent Transparency and Uncertainty
Stowers, K., Kasdaglis, N., Rupp, M., Chen, J., Barber, D., & Barnes, M. (2017) · Advances in Intelligent Systems and Computing · doi:10.1007/978-3-319-41959-6_13 · Cited by 28
Assessing Algorithmic Fairness with Unobserved Protected Class Using Data Combination
Kallus, N., Mao, X., & Zhou, A. (2019) · arXiv · doi:10.48550/arxiv.1906.00285 · Cited by 28 · cited 1×
“When information on the protected class is unavailable, but it can be predicted from an auxiliary dataset, disparity measures are generally unidentifiable [31, 87].”
BackgroundSuccessor Uncertainties: Exploration and Uncertainty in Temporal Difference Learning
Janz, D., Hron, J., Mazur, P., Hofmann, K., Hernández-Lobato, J. M., & Tschiatschek, S. (2018) · arXiv · doi:10.48550/arxiv.1810.06530 · Cited by 23
Fairness Evaluation in Presence of Biased Noisy Labels
Fogliato, R., G'Sell, M., & Chouldechova, A. (2020) · arXiv · doi:10.48550/arxiv.2003.13808 · Cited by 23
Self-citationHernández-Lobato, D. (2009) · Biblos-e Archivo (Universidad Autónoma de Madrid) · Cited by 18
Modeling Epistemic and Aleatoric Uncertainty with Bayesian Neural Networks and Latent Variables
Depeweg, S. (2019) · Cited by 18
Gupta, M., Cotter, A., Fard, M. M., & Wang, S. (2018) · arXiv · doi:10.48550/arxiv.1806.11212 · Cited by 16
Recovering from Biased Data: Can Fairness Constraints Improve Accuracy?
Blum, A., & Stangl, K. (2019) · arXiv · doi:10.48550/arxiv.1912.01094 · Cited by 13
Entropy and Uncertainty Analysis in Financial Markets
Dionisio, A., Menezes, R., & Mendes, D. A. (2007) · arXiv · doi:10.48550/arxiv.0709.0668 · Cited by 13
Is Your Classifier Actually Biased? Measuring Fairness under Uncertainty with Bernstein Bounds
Ethayarajh, K. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.262 · Cited by 12
A Multistakeholder Approach Towards Evaluating AI Transparency MechanismsPreprint
Lučić, A., Srikumar, M., Bhatt, U., Xiang, A., Taly, A., Liao, Q. V., & de Rijke, M. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2103.14976 · Cited by 12
Self-citationAdvances in Human Factors in Robots and Unmanned Systems
(2019) · Advances in intelligent systems and computing · doi:10.1007/978-3-030-20467-9 · Cited by 11
Toward cognitive assistants for complex decision making under uncertainty
Schum, D. A., Tecuci, G., Marcu, D., & Boicu, M. (2014) · Intelligent Decision Technologies · doi:10.3233/idt-140192 · Cited by 9
Uncertainty in planning: characterisation, evaluation, and feedback
Pearman, A. D. (1985) · Environment and Planning B Planning and Design · doi:10.1068/b120313 · Cited by 6
(2018) · National Conference on Artificial Intelligence · Cited by 4
Back‐Testing Market Risk Models
Dowd, K. (2012) · Wiley eBooks · doi:10.1002/9781118182635.efm0110 · Cited by 4
Goodman, E., Kuniavsky, M., & Moed, A. (2012) · Observing the User Experience · doi:10.1016/b978-0-12-384869-7.00005-x · Cited by 1
δ-CLUE: Diverse Sets of Explanations for Uncertainty Estimates
Ley, D., Bhatt, U., & Weller, A. (2021) · arXiv · doi:10.48550/arxiv.2104.06323
Self-citationVERIFICATION OF FORECASTS EXPRESSED IN TERMS OF PROBABILITY
BRIER, G. W. (1950) · Monthly Weather Review · doi:10.1175/1520-0493(1950)078<0001:vofeit>2.0.co;2
Is Your Classifier Actually Biased? Measuring Fairness under Uncertainty with Bernstein Bounds
Ethayarajh, K. (2020) · arXiv · doi:10.48550/arxiv.2004.12332
Verification of forecasts expressed in terms of probability
BRIER, G. W. (1950) · Monthly Weather Review · doi:10.1175/1520-0493(1950)078%3c0001:vofeit%3e2.0.co;2 · cited 1×
“The most common metrics of the former category are negative log-likelihood (NLL) and Brier score [22].”
Background(2013)
(2019)
Research works printed but not linked: 12
- Emily Badger , Claire Cain Miller , Adam Pearce, and Kevin Quealy. 2018 . Income Mobility Charts for Girls, Asian- Americans and Other Groups . Or Make YourOwn. (2018). Emily Badger, Claire Cain Miller, Adam Pearce, and Kevin Quealy. 2018. Income Mobility Charts for Girls, Asian-Americans and Other Groups. Or Make YourOwn. (2018).
- J Martin Bland and Douglas G Altman . 1998. Bayesians and frequentists. BMJ317, 7166 ( 1998 ), 1151--1160. https://doi.org/10.1136/bmj.317.7166.1151arXiv:https://www.bmj.com/content/317/7166/1151.1.full.pdf 10.1136/bmj.317.7166.1151arXiv:https: J Martin Bland and Douglas G Altman. 1998. Bayesians and frequentists. BMJ317, 7166 (1998), 1151--1160. https://doi.org/10.1136/bmj.317.7166.1151arXiv:https://www.bmj.com/content/317/7166/1151.1.full.pdf · doi:10.1136/bmj.317.7166.1151arxiv:https://www.bmj.com/content/317/7166/1151.1.full.pdf
- Shelly Chaiken . 1999. The heuristic-systematic. Dual-process theories social psychology 73 ( 1999 ). Shelly Chaiken. 1999. The heuristic-systematic. Dual-process theories social psychology 73 (1999).
- Marvin S Cohen , Raja Parasuraman , and Jared T Freeman . 1998 . Trust in decision aids: A model and its training implications . In Proc. Command and Control Research and Technology Symp. Citeseer. Marvin S Cohen, Raja Parasuraman, and Jared T Freeman. 1998. Trust in decision aids: A model and its training implications. In Proc. Command and Control Research and Technology Symp. Citeseer.
- Yarin Gal . 2016. Uncertainty in deep learning . University of Cambridge 1, 3( 2016 ). Yarin Gal. 2016. Uncertainty in deep learning. University of Cambridge 1, 3(2016).
- Malik Sajjad Ahmed Nadeem , Jean-Daniel Zucker , and Blaise Hanczar . 2009 . Accuracy-Rejection Curves (ARCs) for Comparing Classification Methods with a Reject Option . In Proceedings of the third International Workshop on Machine Learning in Systems Biology (Proceedings of Machine Learning Research), Saso Dzeroski, Pierre Guerts, and Juho Rousu (Eds.) , Vol. 8 . PMLR, Ljubljana, Slovenia, 65--81. http://proceedings.mlr.press/v8/nadeem10a.html Malik Sajjad Ahmed Nadeem, Jean-Daniel Zucker, and Blaise Hanczar. 2009.Accuracy-Rejection Curves (ARCs) for Comparing Classification Methods with a Reject Option. In Proceedings of the third International Workshop on Machine Learning in Systems Biology (Proceedings of Machine Learning Research), Saso Dzeroski, Pierre Guerts, and Juho Rousu (Eds.), Vol. 8. PMLR, Ljubljana, Slovenia, 65--81. http://proceedings.mlr.press/v8/nadeem10a.html
- 10.5555/2888116.2888120 · doi:10.5555/2888116.2888120
- Jennifer Preece , Helen Sharp , and Yvonne Rogers . 2015. Interaction design: beyond human-computer interaction . John Wiley & Sons . Jennifer Preece, Helen Sharp, and Yvonne Rogers. 2015. Interaction design: beyond human-computer interaction. John Wiley & Sons.
- S Shyam Sundar . 2008. The MAIN model : A heuristic approach to understanding technology effects on credibility . MacArthur Foundation Digital Media andLearning Initiative . S Shyam Sundar. 2008.The MAIN model: A heuristic approach to understanding technology effects on credibility. MacArthur Foundation Digital Media andLearning Initiative.
- 10.5555/3305890.3306024 · doi:10.5555/3305890.3306024
- Anne Marthe van der Bles , Sander van der Linden , Alexandra L. J. Freeman , James Mitchell , Ana B. Galvao , Lisa Zaval , and David J. Spiegelhalter . 2019 . Communicating Uncertainty about Facts , Numbers and Science. 6 , 5 (2019), 181870 . https://doi.org/10/gf2g9j Anne Marthe van der Bles, Sander van der Linden, Alexandra L. J. Freeman,James Mitchell, Ana B. Galvao, Lisa Zaval, and David J. Spiegelhalter. 2019. Communicating Uncertainty about Facts, Numbers and Science. 6, 5 (2019), 181870. https://doi.org/10/gf2g9j
- Claus O. Wilke . 2019. Fundamentals of Data Visualization: A Primer on Making Informative and Compelling Figures ( 1 st edition ed.). O'Reilly Media . Claus O. Wilke. 2019. Fundamentals of Data Visualization: A Primer on Making Informative and Compelling Figures(1st edition ed.). O'Reilly Media.
Cited by
Generative AI and ChatGPT: applications, challenges, and AI-human collaboration
Fui-Hoon Nah, F., Zheng, R., Cai, J., Siau, K., & Chen, L. (2023) · Journal of Information Technology Case and Application Research · doi:10.1080/15228053.2023.2233814 · Cited by 1,363
The Metacognitive Demands and Opportunities of Generative AI
Tankelevitch, L., Kewenig, V., Simkute, A., Scott, A. E., Sarkar, A., Sellen, A., & Rintel, S. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642902 · Cited by 493
Towards trustworthy machine fault diagnosis: A probabilistic Bayesian deep learning framework
Zhou, T., Han, T., & Droguett, E. L. (2022) · Reliability Engineering & System Safety · doi:10.1016/j.ress.2022.108525 · Cited by 260
Socially Responsible AI Algorithms: Issues, Purposes, and Challenges
Cheng, L., Varshney, K. R., & Liu, H. (2021) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.12814 · Cited by 261
Nemani, V., Biggio, L., Huan, X., Hu, Z., Fink, O., Tran, A., Wang, Y., Zhang, X., & Hu, C. (2023) · Mechanical Systems and Signal Processing · doi:10.1016/j.ymssp.2023.110796 · Cited by 243
Metadata
- Authors
- Bhatt, U., Antorán, J., Zhang, Y., Liao, Q. V., Sattigeri, P., Fogliato, R., Melançon, G., Krishnan, R., Stanley, J., Tickoo, O., Nachman, L., Chunara, R., Srikumar, M., Weller, A., & Xiang, A.
- Affiliations
- University of Cambridge (GB)
- IBM (United States) (US)
- Carnegie Mellon University (US)
- Concordia University (CA)
- Intel (United States) (US)
- New York University (US)
- Partnership on AI, San Francisco, CA, USA
- Sony AI, Seattle, WA, USA
- ORCID
- Venue
- Proceedings of the 2021 AAAI/ACM Conference on AI, Ethics, and Society
- Publisher
- ACM
- Published
- 2021-07-21
- Pages
- 401-413
- ISSN
- 3065-8365 (ISSN-L)
- OpenAlex
- W3183398589
- Semantic Scholar
- 3973e0fab69a00f5ed6a81ca408f60c420fa6e61
- Cited by
- 300
- References
- 116
- Citations by year
- 2026: 59 · 2025: 62 · 2024: 65 · 2023: 46 · 2022: 48 · 2021: 18
- FWCI
- 16.64
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Proceedings of the AAAI/ACM Conference on AI Ethics and Society (publishedVersion, cc-by)
- arXiv (Cornell University) (submittedVersion)
- Cambridge University Engineering Department Publications Database (submittedVersion)
- arXiv (Cornell University)
- Funders
- Microsoft Research
- Northwestern University
- Alan Turing Institute (EP/N510129/1., TU/B/000074, N510129)
- DeepMind
- Leverhulme Trust
- Engineering and Physical Sciences Research Council (N510129, EP/N510129/, EP/N510129/1, TU/B/000074, 2275741, EPSRC grant EP/N510129/1, EP/V025279/1)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Physical Sciences › Computer Science › Artificial Intelligence › Adversarial Robustness in Machine Learning
- Keywords
- algorithmic transparency, uncertainty estimation, uncertainty communication, explainability, model fairness, trustworthy systems, decision-making, uncertainty visualization, human-computer interaction, machine learning pipelines, stakeholder awareness
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-24, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-24 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.