Student or educator? Sign up with your school email and get 6 months of Pro free.

The DOI matches its Crossref record; 61 of the 61 references it cites were found in a registry or an index.

Transparency in the Wild: Navigating Transparency in a Deployed AI System to Broaden Need-Finding Approaches

Open access
Turri, Violet, Morrison, Katelyn, Robinson, Katherine-Marie, Abidi, Collin, Perer, Adam, Forlizzi, Jodi, Dzombak, Rachel · 2024 · The 2024 ACM Conference on Fairness, Accountability, and Transparency

Abstract

Transparency is a critical component when building artificial intelligence (AI) decision-support tools, especially for contexts in which AI outputs impact people or policy. Effectively identifying and addressing user transparency needs in practice remains a challenge. While a number of guidelines and processes for identifying transparency needs have emerged, existing methods tend to approach need-finding with a limited focus that centers around a narrow set of stakeholders and transparency techniques. To broaden this perspective, we employ numerous need-finding methods to investigate transparency mechanisms in a widely deployed AI-decision support tool developed by a wildlife conservation non-profit. Throughout our 5-month case study, we conducted need-finding through semi-structured interviews with end-users, analysis of the tool’s community forum, experiments with their ML model, and analysis of training documents created by end-users. We also held regular meetings with the tool’s product and machine learning teams. By approaching transparency need-finding from a broad lens, we uncover insights into end-users’ transparency needs as well as unexpected uses and challenges with current transparency mechanisms. Our study is one of the first to incorporate such diverse perspectives to reveal an unbiased and rich view of transparency needs. Lastly, we offer the FAccT community recommendations on broadening transparency need-finding approaches, contributing to the evolving field of transparency research.

Overview

Integrity signals

Registry

Crossref · 10.1145/3630106.3658985

Cites

61 of 61 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Show all 58 references

Research works printed but not linked: 10

  1. Chirag Agarwal Satyapriya Krishna Eshika Saxena Martin Pawelczyk Nari Johnson Isha Puri Marinka Zitnik and Himabindu Lakkaraju. 2022. OpenXAI: Towards a Transparent Evaluation of Model Explanations. https://arxiv.org/abs/2206.11104v3 · arXiv
  2. Tanya Y Berger-Wolf, Daniel I Rubenstein, Charles V Stewart, Jason A Holmberg, Jason Parham, Sreejith Menon, Jonathan Crall, Jon Van Oast, Emre Kiciman, and Lucas Joppa. 2017. Wildbook: Crowdsourcing, computer vision, and data science for conservation. arXiv preprint arXiv:1710.08880 (2017). https://arxiv.org/abs/1710.08880 · arXiv
  3. Hugh Beyer and Karen Holtzblatt. 1999. Contextual design. interactions 6, 1 (1999), 32–42. https://dl.acm.org/doi/fullHtml/10.1145/291224.291229 · DOI · Paper page
  4. Stephen Casper, Tong Bu, Yuxiao Li, Jiawei Li, Kevin Zhang, Kaivalya Hariharan, and Dylan Hadfield-Menell. 2023. Red Teaming Deep Neural Networks with Feature Synthesis Tools. In Thirty-seventh Conference on Neural Information Processing Systems. https://arxiv.org/abs/2302.10894 · arXiv
  5. Hussein Mozannar, Jimin J Lee, Dennis Wei, Prasanna Sattigeri, Subhro Das, and David Sontag. 2023. Effective Human-AI Teams via Learned Natural Language Rules and Onboarding. arXiv preprint arXiv:2311.01007 (2023). https://proceedings.neurips.cc/paper_files/paper/2023/file/61355b9c218505505d1bedede9da56b2-Paper-Conference.pdf · arXiv
  6. Sahil Singla and Soheil Feizi. 2022. Salient ImageNet: How to discover spurious features in Deep Learning?. In International Conference on Learning Representations. https://openreview.net/forum?id=XVPqLyNxSyh
  7. Simone Stumpf Adrian Bussone and Dympna O’sullivan. 2016. Explanations considered harmful? user interactions with machine learning systems. In Proceedings of the ACM SIGCHI Conference on Human Factors in Computing Systems (CHI). https://www.yumpu.com/cs/document/view/55465112/explanations-considered-harmful-user-interactions-with-machine-learning-systems
  8. Sana Tonekaboni Shalmali Joshi Melissa D McCradden and Anna Goldenberg. 2019. What clinicians want: contextualizing explainable machine learning for clinical end use. In Machine learning for healthcare conference. PMLR 359–380. http://proceedings.mlr.press/v106/tonekaboni19a/tonekaboni19a.pdf
  9. Michael Williams and Tami Moser. 2019. The art of coding and thematic exploration in qualitative research. International management review 15, 1 (2019), 45–55. https://www.academia.edu/download/82465402/imr-v15n1art4.pdf
  10. 10.1145/3287560.3287596 · DOI · Paper page

Cited by

See all 25

Metadata

Authors
Turri, V., Morrison, K., Robinson, K.-M., Abidi, C., Perer, A., Forlizzi, J., & Dzombak, R.
Affiliations
  • Software Engineering Institute (US)
  • Carnegie Mellon University (US)
Venue
The 2024 ACM Conference on Fairness, Accountability, and Transparency
Publisher
ACM
Published
2024-06-03
Pages
1494-1514
OpenAlex
W4399363537
Cited by
10
References
58
Citations by year
2026: 5 · 2025: 5
FWCI
2.96
Type
conference paper
Language
en
Open access
Locations
ACM Conference on Fairness, Accountability, and Transparency (FAccT) (publishedVersion, cc-by)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
  • Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
  • Social Sciences › Political Science and International Relations › E-Government and Public Services
Keywords
AI transparency, AI decision support, wildlife conservation, end-user perspective, transparency mechanisms, stakeholder perspectives, community forums, training data analysis

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Transparency in the Wild: Navigating Transparency in a Deployed AI System to Broaden Need-Finding Approaches. https://app.cochat.ai/papers/10.1145/3630106.3658985
The paper
Turri, V., Morrison, K., Robinson, K.-M., Abidi, C., Perer, A., Forlizzi, J., & Dzombak, R. (2024). Transparency in the Wild: Navigating Transparency in a Deployed AI System to Broaden Need-Finding Approaches. The 2024 ACM Conference on Fairness, Accountability, and Transparency. https://doi.org/10.1145/3630106.3658985

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.