Cited by 0Ethics and Social Impacts of AIE-Government and Public ServicesExplainable Artificial Intelligence (XAI)

Disclosure or Marketing? Analyzing the Efficacy of Vendor Self-reports for Vetting Public-sector AI

Open access
Kuehnert, Blaine, Johnson, Nari, Dotan, Ravit, Heidari, Hoda·2026·Proceedings of the 2026 ACM Conference on Fairness, Accountability, and Transparency

Abstract

Documentation-based disclosure has become a central governance strategy for responsible AI, particularly in public-sector procurement. Tools such as model cards, datasheets, and AI FactSheets are increasingly expected to support accountability, risk assessment, and informed decision-making across organizational boundaries. Yet there is limited empirical evidence about how these artifacts are produced, interpreted, and used in practice. In this paper, we present a qualitative study of the GovAI Coalition FactSheet, a widely adopted transparency document designed to support AI procurement and governance in government contexts. Drawing on semi-structured interviews with vendors and public-sector practitioners, alongside a systematic analysis of completed FactSheets, we examine how FactSheets are used, what information they surface, and where they fall short. We find that FactSheets are asked to serve multiple and conflicting purposes simultaneously: showcasing vendor offerings, supporting evaluation and due diligence, and facilitating early-stage dialogue between vendors and agencies. These competing expectations, combined with the structural constraints of voluntary and public self-disclosure, limit the ability of FactSheets to function as standalone evaluation or risk-assessment tools. At the same time, our findings suggest that when understood as relational artifacts used to establish trust, shared understanding, and ongoing dialogue, FactSheets can help create conditions that support more meaningful disclosure and governance over time.

Integrity signals

Registry

Crossref · 10.1145/3805689.3812220

Cites

66 of 66 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

The text we found for this paper looks like another document, so its claims and self-check weren’t run. The registry and citation checks still apply.

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The text we found for this paper looks like another document, so the self-check wasn’t run.

Cites

Flagged first, then by citations

Research works printed but not linked: 15

  1. American Association for the Advancement of Science. 2024. Key Questions for Government Leaders to Ask When Considering the Use of AI Systems. Retrieved January 9, 2026 from https://www.aaas.org/sites/default/files/2024-11/EPICenterAIQs.pdf?utm_medium=display&utm_source=epi_center-website&utm_campaign=epi2024_aiqs&utm_id=recAwnv42v13cTFZY
  2. Quinn Anex-Ries. 2025. Deploy First, Ask Later: How the Rush to Adopt AI Across the Federal Government Could Waste Scarce Resources and Hurt People. https://cdt.org/insights/deploy-first-ask-later-how-the-rush-to-adopt-ai-across-the-federal-government-could-waste-scarce-resources-and-hurt-people/
  3. Alexandra Chouldechova, Diana Benavides-Prado, Oleksandr Fialko, and Rhema Vaithianathan. 2018. A case study of algorithm-assisted decision making in child maltreatment hotline screening decisions. In Proceedings of the 1st Conference on Fairness, Accountability and Transparency (Proceedings of Machine Learning Research, Vol. 81), Sorelle A. Friedler and Christo Wilson (Eds.). PMLR, 134–148. https://proceedings.mlr.press/v81/chouldechova18a.html
  4. Virginia Eubanks. 2018. Automating inequality: How high-tech tools profile, police, and punish the poor. St. Martin's Press.
  5. European Union. 2024. Regulation (EU) 2024/1689 of the European Parliament and of the Council of 13 June 2024 laying down harmonised rules on artificial intelligence (Artificial Intelligence Act). Official Journal of the European Union, L 1689, 12 July 2024. https://eur-lex.europa.eu/eli/reg/2024/1689/oj/eng.
  6. Emily Hsu and Quinn Anex-Ries. 2025. A Framework for Assessing AI Transparency in the Public Sector. Retrieved January 8, 2026 from https://web.archive.org/web/20251220141400/https://cdt.org/wp-content/uploads/2025/12/CDT-Public-sector-transparency-120125-final-1.pdf
  7. IEEE Society on Social Implications of Technology. 2025. IEEE 3119-2025: IEEE Standard for the Procurement of Artificial Intelligence and Automated Decision Systems. Retrieved January 9, 2026 from https://standards.ieee.org/ieee/3119/10729/
  8. Thomas Liao, Rohan Taori, Deborah Raji, and Ludwig Schmidt. 2021. Are We Learning Yet? A Meta Review of Evaluation Failures Across Machine Learning. In Proceedings of the Neural Information Processing Systems Track on Datasets and Benchmarks, J. Vanschoren and S. Yeung (Eds.), Vol. 1. https://datasets-benchmarks-proceedings.neurips.cc/paper_files/paper/2021/file/757b505cfd34c64c85ca5b5690ee5293-Paper-round2.pdf
  9. Robert E Lloyd and Clifford P McCue. 2004. What is public procurement? Definitional problems and implications. In International Public Procurement Conference Proceedings, Vol. 3. 2–18.
  10. Roya Pakzad and Cynthia Conti-Cook. 2025. Key Considerations When Procuring AI in the Public Sector. Online Report. Taraaz & The Collaborative Research Center for Resilience (CRCR). https://static1.squarespace.com/static/5d159d288addab0001036c45/t/6890f9066bf93951bedd9485/1754331401682/AI_Procurement_Taraaz_CRCR_2025.pdf Accessed: 2025-01-12.
  11. David S. Rubenstein. 2020. Federal Procurement of Artificial Intelligence: Perils and Possibilities. Retrieved May 9, 2024 from https://rooseveltinstitute.org/wp-content/uploads/2021/08/GDI_Federal-Procurement-of-AI_202012.pdf
  12. David S Rubenstein. 2021. Acquiring ethical AI. Fla. L. Rev. 73 (2021), 747.
  13. Thad Rueter. 2024. Want Gov Tech Innovation? Consider the Legal Issues Too. Retrieved January 10, 2026 from https://www.govtech.com/biz/want-gov-tech-innovation-consider-the-legal-issues-too
  14. Chinmayi Sharma and Sam Adler. 2024. The Power of the Collective Purse: Open-Source AI Governance and the GovAI Coalition. Retrieved January 16, 2025 from https://www.techpolicy.press/the-power-of-the-collective-purse-opensource-ai-governance-and-the-govai-coalition/
  15. The Government AI Coalition. 2024. AI FactSheet. Retrieved January 19, 2025 from https://web.archive.org/web/20241211185508/https://www.sanjoseca.gov/home/showpublisheddocument/109730/638672090591070000

Authors
Kuehnert, B., Johnson, N., Dotan, R., & Heidari, H.
Affiliations
  • Carnegie Mellon University (US)
  • TechBetter, Pittsburgh, Pennsylvania, USA
Venue
Proceedings of the 2026 ACM Conference on Fairness, Accountability, and Transparency
Publisher
ACM
Published
2026-06-25
Pages
687-713
OpenAlex
W7166516926
Cited by
0
References
47
FWCI
0.00
Type
conference paper
Language
en
Open access
Locations
ACM Conference on Fairness, Accountability, and Transparency (FAccT) (publishedVersion, cc-by)
Funders
National Science Foundation (IIS2229881)
Topics
  • Social Sciences › Safety Research › Ethics and Social Impacts of AI
  • Social Sciences › Political Science and International Relations › E-Government and Public Services
  • Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
Keywords
responsible AI, AI governance, model cards, due diligence, AI risk assessment, trust building

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-30.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review