Designing Accountable Systems
Open accessThe DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.
Abstract
Accountability is an often called for property of technical systems. It is a requirement for algorithmic decision systems, autonomous cyber-physical systems, and for software systems in general. As a concept, accountability goes back to the early history of Liberalism and is suggested as a tool to limit the use of power. This long history has also given us many, often slightly differing, definitions of accountability. The problem that software developers now face is to understand what accountability means for their systems and how to reflect it in a system's design. To enable the rigorous study of accountability in a system, we need models that are suitable for capturing such a varied concept. In this paper, we present a method to express and compare different definitions of accountability using Structural Causal Models. We show how these models can be used to evaluate a system's design and present a small use case based on an autonomous car.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Algorithms of Oppression: How Search Engines Reinforce Racism
Noble, S. U. (2020) · doi:10.2307/j.ctt1pwt9w5 · Cited by 2,709
Analysing and Assessing Accountability: A Conceptual Framework 1
Bovens, M. (2007) · European Law Journal · doi:10.1111/j.1468-0386.2007.00378.x · Cited by 2,667
Ananny, M., & Crawford, K. (2018) · New Media & Society · doi:10.1177/1461444816676645 · Cited by 1,836 · cited 1×
“In earlier works, transparency was often seen as a solution, but Ananny and Crawford [1] have shown that transparency alone is not sufficient for accountability.”
BackgroundMittelstadt, B., Russell, C., & Wachter, S. (2019) · Proceedings of the Conference on Fairness, Accountability, and Transparency · doi:10.1145/3287560.3287574 · Cited by 794
A characterization of Markov equivalence classes for acyclic digraphs
Andersson, S. A., Madigan, D., & Perlman, M. D. (1997) · The Annals of Statistics · doi:10.1214/aos/1031833662 · Cited by 425
Accountability in a computerized society
Nissenbaum, H. (1996) · Science and Engineering Ethics · doi:10.1007/bf02639315 · Cited by 346
Hall, A. T., Frink, D. D., & Buckley, M. R. (2017) · Journal of Organizational Behavior · doi:10.1002/job.2052 · Cited by 335
Responsibility and Blame: A Structural-Model Approach
Chockler, H., & Halpern, J. Y. (2004) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1391 · Cited by 325
Moral crumple zones: cautionary tales in human–robot interaction
Elish, M. C. (2019) · Engaging Science, Technology, and Society · doi:10.17351/ests2019.260 · Cited by 321 · cited 2×
“In complex systems, accountability is often deflected and hard to pinpoint, which leads to blame being assigned to humans [12].”
BackgroundMethodWieringa, M. (2020) · Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency · doi:10.1145/3351095.3372833 · Cited by 321 · cited 5×
“Mark Boven’s definition [6] became popular recently in computer science because it was used as the definition in the systematic literature review conducted by [55].”
BackgroundMethodInfluential
Cited by
The public perceptions of algorithmic decision-making systems: Results from a large-scale survey
Aysolmaz, B., Müller, R., & Meacham, D. (2023) · Telematics and Informatics · doi:10.1016/j.tele.2023.101954 · Cited by 56
“Since we could not find established measures for perceived accountability, we developed our own measures by relying on the definitions of ADM system accountability given by Kacianka and Pretschner (2021) and Wieringa (2020).”
Method(2022) · doi:10.1145/3491102.3501868 · Cited by 36
“We employ Bovens’ definition of accountability from the social sciences, which has become popular in computer science recently [45, 96].”
MethodTaking Algorithms to Courts: A Relational Approach to Algorithmic Accountability
Metcalf, J., Singh, R., Moss, E., Tafesse, E., & Watkins, E. A. (2023) · 2023 ACM Conference on Fairness, Accountability, and Transparency · doi:10.1145/3593013.3594092 · Cited by 21
Accountability in Code Review: The Role of Intrinsic Drivers and the Impact of LLMs
Alami, A., Jensen, V., & Ernst, N. (2025) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3721127 · Cited by 11
“M i x e d t e a m r o l e s ( 3 s e n i o r d e v e l o p e r s , a n d 2 m i d - c a r ee r d e v e l o p e r s ) a s r e v i e w e r s a n d a u t h o r s C r o ss - t e a m r e v i e w s .”
Creating characteristically auditable agentic AI systems
Phiri, C. C. (2025) · Proceedings of the Intelligent Robotics FAIR 2025 · doi:10.1145/3759355.3759356 · Cited by 7
Metadata
- Authors
- Kacianka, S., & Pretschner, A.
- Venue
- Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency
- Publisher
- ACM
- Published
- 2021-03
- Pages
- 424-437
- OpenAlex
- W3124558017
- Cited by
- 26
- References
- 11
- FWCI
- 4.54
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Designing Accountable Systems. https://app.cochat.ai/papers/10.1145/3442188.3445905
- The paper
- Kacianka, S., & Pretschner, A. (2021). Designing Accountable Systems. Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency. https://doi.org/10.1145/3442188.3445905
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.