Artificial Intelligence and Decision-Making: the question of Accountability
Open accessThe DOI matches its Crossref record; 20 of the 20 references it cites were found in a registry or an index.
Abstract
Public sector organizations literature has addressed the influence of AI on decision-making process, looking mainly at rationalization and efficiency. However, recent adoptions of AI have been challenged because of their discriminatory nature. As a result, questions emerged on the accountability of AI supported decision-making processes in the public sector. This research sheds light on how AI transforms decision-making processes in the public sector and hence on their accountability. The paper illustrates that AI adoptions lead to the emergency of techno-legal entanglements – assemblages – which might impact upon AI accountability. Building on the findings of some of the most controversial and discussed cases of AI adoption in the public sector – COMPAS in the US and UKVI in the UK – the paper makes the case for a new approach to AI supported public sector decision-making accountability.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Floridi, L., Cowls, J., Beltrametti, M., Chatila, R., Chazerand, P., Dignum, V., Luetge, C., Madelin, R., Pagallo, U., Rossi, F., et al. (2018) · Minds and Machines · doi:10.1007/s11023-018-9482-5 · Cited by 4,774
The ethics of algorithms: Mapping the debate
Mittelstadt, B. D., Allo, P., Taddeo, M., Wachter, S., & Floridi, L. (2016) · Big Data & Society · doi:10.1177/2053951716679679 · Cited by 4,567 · cited 1×
“Overall, scholars accounted for potential problems related to AI governance [12]; from AI ethical standards [13]; to AI’s socially acceptance and trust [14].”
BackgroundAnalysing and Assessing Accountability: A Conceptual Framework 1
Bovens, M. (2007) · European Law Journal · doi:10.1111/j.1468-0386.2007.00378.x · Cited by 2,667
Review of Deep Learning Algorithms and Architectures
Shrestha, A., & Mahmood, A. (2019) · IEEE Access · doi:10.1109/access.2019.2912200 · Cited by 1,883 · cited 1×
“These rules delegate organizations’ decision responsibilities and accountability [40] to technological artefacts that enforce pattern of action that are unique, and not necessarily compatible with the contextual normative, administrative and legal governing logics.”
BackgroundArtificial Intelligence and the Public Sector—Applications and Challenges
Wirtz, B. W., Weyerer, J. C., & Geyer, C. (2019) · International Journal of Public Administration · doi:10.1080/01900692.2018.1498103 · Cited by 1,341 · cited 3×
“The search for AI accountability in this context has been framed as a human/technology control dilemma [8]: humans are not accountable since they are not in full control of AI [23]; or humans are accountable for the technology despite their control over AI [24].”
BackgroundThe responsibility gap: Ascribing responsibility for the actions of learning automata
Matthias, A. (2004) · Ethics and Information Technology · doi:10.1007/s10676-004-3422-1 · Cited by 1,101 · cited 1×
“The search for AI accountability in this context has been framed as a human/technology control dilemma [8]: humans are not accountable since they are not in full control of AI [23]; or humans are accountable for the technology despite their control over AI [24].”
BackgroundSamek, W., Wiegand, T., & Müller, K.-R. (2017) · arXiv · doi:10.48550/arxiv.1708.08296 · Cited by 1,080
Bovens, M., & Zouridis, S. (2002) · Public Administration Review · doi:10.1111/0033-3352.00168 · Cited by 964 · cited 2×
“making process of public sector organizations [3].”
BackgroundWorking and organizing in the age of the learning algorithm
Faraj, S., Pachidi, S., & Sayegh, K. (2018) · Information and Organization · doi:10.1016/j.infoandorg.2018.02.005 · Cited by 929 · cited 1×
“Moreover, the AI algorithm has functions which define unique data patterns which univocally determine how the data are combined and used [55].”
BackgroundEthical Implications and Accountability of Algorithms
Martin, K. (2019) · Journal of Business Ethics · doi:10.1007/s10551-018-3921-3 · Cited by 757 · cited 3×
“Artificial Intelligence adoptions in the public sector are not equally researched as those in the private sector [7].”
BackgroundArtificial intelligence in organizations: New opportunities for phenomenon-based theorizing
von Krogh, G. (2018) · Academy of Management Discoveries · doi:10.5465/amd.2018.0084 · Cited by 641 · cited 1×
“The automation of organization processes redefines fundamental organization practices, delegating the execution of tasks that were previously under the responsibility of organization actors, to the AI algorithms [39].”
BackgroundSousa, W. G. D., Melo, E. R. P. D., Bermejo, P. H. D. S., Farias, R. A. S., & Gomes, A. O. (2019) · Government Information Quarterly · doi:10.1016/j.giq.2019.07.004 · Cited by 501
Accountability of AI Under the Law: The Role of Explanation
Doshi-Velez, F., Kortz, M., Budish, R., Bavitz, C., Gershman, S. J., O'Brien, D., Scott, K., Shieber, S., Waldo, J., Weinberger, D., et al. (2017) · doi:10.2139/ssrn.3064761 · Cited by 457 · cited 2×
“the need to open the “black box” involving decision-making based on AI systems [25], others call for the introduction of designers’ “explanation” as reliable practice to improve the algorithmic transparency [18, 26].”
BackgroundA Layered Model for AI Governance
Gasser, U., & Almeida, V. A. F. (2017) · IEEE Internet Computing · doi:10.1109/mic.2017.4180835 · Cited by 431 · cited 1×
“Overall, scholars accounted for potential problems related to AI governance [12]; from AI ethical standards [13]; to AI’s socially acceptance and trust [14].”
BackgroundTransparency in Algorithmic and Human Decision-Making: Is There a Double Standard?
Zerilli, J., Knott, A., Maclaurin, J., & Gavaghan, C. (2019) · Philosophy & Technology · doi:10.1007/s13347-018-0330-6 · Cited by 420 · cited 1×
“Overall, scholars accounted for potential problems related to AI governance [12]; from AI ethical standards [13]; to AI’s socially acceptance and trust [14].”
BackgroundWill Democracy Survive Big Data and Artificial Intelligence?
Helbing, D., Frey, B. S., Gigerenzer, G., Hafen, E., Hagner, M., Hofstetter, Y., van den Hoven, J., Zicari, R. V., & Zwitter, A. (2019) · Towards Digital Enlightenment · doi:10.1007/978-3-319-90869-4_7 · Cited by 355
de Fine Licht, K., & de Fine Licht, J. (2020) · AI & SOCIETY · doi:10.1007/s00146-020-00960-w · Cited by 334 · cited 1×
“The lack of accountability of AI decision-making systems have raised concerns on the use of AI to support public sector service delivery [21].”
BackgroundPredicting Public Sector Accountability: From Agency Drift to Forum Drift
Schillemans, T., & Busuioc, M. (2015) · Journal of Public Administration Research and Theory · doi:10.1093/jopart/muu024 · Cited by 290 · cited 1×
“Despite the attention given to the relationships between ICT and the formalisation of public organisation practices and processes in literature [15, 16], the how AI impacts Proceedings of the 54th Hawaii International Conference on System Sciences | 2021”
BackgroundDigital discretion: A systematic literature review of ICT and street-level discretion
Busch, P. A., & Henriksen, H. Z. (2018) · Information Polity · doi:10.3233/ip-170050 · Cited by 267
Oswald, M. (2018) · Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences · doi:10.1098/rsta.2017.0359 · Cited by 132 · cited 2×
“the need to open the “black box” involving decision-making based on AI systems [25], others call for the introduction of designers’ “explanation” as reliable practice to improve the algorithmic transparency [18, 26].”
Background
Cited by
Ali, S., Abuhmed, T., El-Sappagh, S., Muhammad, K., Alonso-Moral, J. M., Confalonieri, R., Guidotti, R., Del Ser, J., Díaz-Rodríguez, N., & Herrera, F. (2023) · Information Fusion · doi:10.1016/j.inffus.2023.101805 · Cited by 1,762
Nasarian, E., Alizadehsani, R., Acharya, U. R., & Tsui, K.-L. (2024) · Information Fusion · doi:10.1016/j.inffus.2024.102412 · Cited by 207
The loopholes of algorithmic public services: an “intelligent” accountability research agenda
Bracci, E. (2023) · Accounting, Auditing & Accountability Journal · doi:10.1108/aaaj-06-2022-5856 · Cited by 89
Metadata
- Authors
- Gualdi, F., & Cordella, A.
- Venue
- Proceedings of the Annual Hawaii International Conference on System Sciences
- Published
- 2021
- ISSN
- 1530-1605 (ISSN-L)
- 2572-6862
- OpenAlex
- W3128845074
- Cited by
- 44
- References
- 20
- FWCI
- 6.21
- Type
- conference paper
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.