CoChat

Just accountability structures – a way to promote the safe use of automated decision-making in the public sector

Open access
Hirvonen, Hanne · 2024 · AI & SOCIETY

The DOI matches its Crossref record; 40 of the 40 references it cites were found in a registry or an index; 12 of the 52 sources its claims cite were checked for support.

Abstract

The growing use of automated decision-making (ADM) systems in the public sector and the need to control these has raised many legal questions in academic research and in policymaking. One of the timely means of legal control is accountability, which traditionally includes the ability to impose sanctions on the violator as one dimension. Even though many risks regarding the use of ADM have been noted and there is a common will to promote the safety of these systems, the relevance of the safety research has been discussed little in this context. In this article, I evaluate regulating accountability over the use of ADM in the public sector in relation to the findings of safety research. I conducted the study by focusing on ongoing regulatory projects regarding ADM, the Finnish ADM legislation draft and the EU proposal for the AI Act. The critical question raised in the article is what the role of sanctions is. I ask if official accountability could mean more of an opportunity to learn from mistakes, share knowledge and compensate for harm instead of control via sanctions.

Overview

CoChat Summary

TL;DR

The article evaluates how legal accountability structures for automated decision-making (ADM) in the public sector align with safety research, focusing on Finland’s ADM legislation draft and the EU AI Act proposal. It argues that sanction-centered personal accountability may discourage error reporting and learning, while just-culture and organizational accountability could better support safe ADM use.

Key findings

  • Finland’s draft ADM legislation emphasizes personal official accountability, requiring documentation and naming responsible persons for ADM development, introduction, and monitoring; this aims to ensure individuals can be held accountable but risks a blame culture and criminal sanctions.
  • The EU AI Act proposal builds accountability around providers/users and administrative fines under Article 71, plus product-safety mechanisms such as CE marking and market withdrawal; incident reporting is limited to providers/users of high-risk systems and serious incidents/malfunctioning, with a high threshold and causal-link interpretation left to the reporting party.
  • Safety research, especially the concept of just culture, recommends shifting from retributive to restorative justice and removing barriers to error reporting; clear duties and responsibilities are still valued, and serious or wilful misconduct can remain sanctionable.
  • The paper concludes that safe ADM cannot be improved by focusing on personal accountability or sanctioning organizations alone; more attention should go to organizational culture, information sharing, and learning from mistakes.

Methods

  • Normative legal analysis comparing accountability structures in two regulatory projects against findings from safety research literature.
  • Materials: the Finnish government proposal HE 145/2022 vp and the EU AI Act proposal COM(2021) 206 final, including Presidency compromise texts dated 29.11.2021 and 15.6.2022; the material reflects the situation on 5 January 2023.
  • Analysis focuses on drafted rules concerning accountability, sanctions, and information sharing, with a special focus on public-sector official accountability and sanctions.

Limitations

  • Stated: one article cannot cover all aspects of safety and safe use of ADM; the focus is limited to the public sector, official accountability, and sanctions; the Finnish proposal could also be examined from other angles, but space limits this.
  • Stated: the material is based on the situation on 5 January 2023; Finnish law drafting later continued, ended, and new regulations entered into force on 1 May 2023, while EU preparation continues, so the rules that actually came into force are not fully analyzed.
  • Evident: the research does not separately include data collection; the analysis is conceptual/legal and does not empirically test the effects of accountability structures, and the AI Act analysis relies on draft and compromise texts rather than final law.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1007/s00146-023-01731-z

Cites

40 of 40 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Verification

Claims the paper makes

10 Valid · 3 Not valid · 40 Not checked · 95 Own results and interpretations

41 more claims · 1 with their cited sources checked

Create a free account to see all 148 claims and to verify the 3 references still open.

See all claims — free account
  • It may state two separate claims as one. 36
  • Probably not a substantial claim. 87

Create a free account to see these claims.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Show all 40 references

Research works printed but not linked: 9

  1. Cobbe J, Lee SAM, Singh J (2021) Reviewable automated decision-making: a framework for accountable algorithmic systems. ACM Conference on Fairness, Accountability, and Transparency (FAccT ‘21), Virtual Event. Canada ACM, New York, pp 56–67
  2. Finck M (2019) Automated Decision-Making and Administrative Law (August 5, 2019) Max Planck Institute for Innovation & Competition Research Paper No. 19–10 https://ssrn.com/abstract=3433684. Also in the Oxford Handbook of Comparative Administrative Law, P. Cane et al. (eds.), Oxford, Oxford University Press, 2020, which has not been available to the author.
  3. Hirvonen H (2022) Virkavastuu ja päätösautomaatio – vastuun henkilökohtaisuus kriisissä? Lakimies 3–4(2022):386–418
  4. Jeffcott S, Weyman A, Pidgeon NF, Walls J (2006) Risk, trust, and safety culture in U.K. train operating companies. Risk Anal 26(2):1105–1121. https://doi.org/10.1111/j.1539-6924.2006.00819 · doi:10.1111/j.1539-6924.2006.00819
  5. Meijer A, Grimmelikhuijsen S (2020) Responsible and accountable algorithmization. How to generate citizen trust in governmental usage of algorithms. In: Schuilenburg M, Peeters R (eds) The Algorithmic Society: Technology, Power, and Knowledge, 1st edn. Routledge, Abingdon
  6. Waldman AE (2019) Power, process, and automated decision-making. Fordham L Rev 88:613–632
  7. Widlak A, van Eck M, Peeters R (2020) Towards principles of good digital administration. Fairness accountability and proportionality in automated decision-making. In: Schuilenburg M, Peeters R (eds) The Algorithmic Society: Technology, Power, and Knowledge, 1st edn. Routledge, Abingdon
  8. Journal of Safety Research webpage. A Safety and Health Research Forum. A Joint Publication of the National Safety Council http://www.nsc.org and Elsevier. https://www.journals.elsevier.com/journal-of-safety-research. Accessed 14 Aug 2022
  9. Safety Science webpage. Elsevier. https://www.sciencedirect.com/journal/safety-science. Accessed 15 Aug 2022

Cited by

See all 19

Metadata

Authors
Hirvonen, H.
Affiliations
University of Helsinki (FI)
Corresponding author
Hirvonen, Hanne
Venue
AI & SOCIETY
Published
2023-08-12
Volume
39
Issue
1
Pages
155-167
ISSN
  • 0951-5666 (ISSN-L)
  • 1435-5655
OpenAlex
W4385783856
Cited by
19
References
37
Citations by year
2026: 2 · 2025: 8 · 2024: 7 · 2023: 2
FWCI
34.13
Type
journal article
Language
en
Open access
Licence
Locations
  • AI & Society (publishedVersion, cc-by)
  • Työväentutkimus Vuosikirja (submittedVersion)
Funders
University of Helsinki including Helsinki University Central Hospital
Topics
  • Social Sciences › Law › Digitalization, Law, and Regulation
  • Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
  • Social Sciences › Law › Administrative Law and Governance
Keywords
automated decision-making, public sector, accountability, sanctions, AI regulation, EU AI Act, learning from mistakes, compensation for damages

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-10-07, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-07 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (gpt-6-sol).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Just accountability structures – a way to promote the safe use of automated decision-making in the public sector. https://app.cochat.ai/papers/10.1007/s00146-023-01731-z
The paper
Hirvonen, H. (2024). Just accountability structures – a way to promote the safe use of automated decision-making in the public sector. AI & SOCIETY. https://doi.org/10.1007/s00146-023-01731-z

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.