Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 17 of the 17 references it cites were found in a registry or an index.

From Human Intervention to Human Involvement: A Critical Examination of the Role of Humans in (Semi-)Automated Administrative Decision-Making

Open access
Haitsma, Lucas, Brink, Barbara · 2025 · Digital Government: Research and Practice

Abstract

In view of recent scandals, evolving regulatory demands, and changing perceptions of human involvement in automated systems, this study examines how the role of humans in semi-automated administrative decision-making (AADM) is conceptualized in academic literature. We conducted a qualitative systematic literature review from the public administration, law and socio-technological fields, to critically examine what is understood as human involvement in AADM. Our findings suggest that the literature largely focuses on human intervention in AADM, where individual decision-makers either review automated outputs before deciding (human-in-the-loop) or review automated decisions (human-out-of-the-loop). However, a broader scope on human involvement in AADM—which also includes system designers (human-in-control) and monitoring and supervisory roles responsible for ongoing oversight (human-on-the-loop)—is crucial to fully capture the human-machine dynamic in AADM. These insights can be used to advance the understanding of the human-automation interaction in AADM through a more comprehensive conceptualization of human involvement. This broader, governance-oriented, view has the potential to optimize the interrelationship between human involvement and automation, ultimately improving accountability, effectiveness, and adaptability in AADM. New legislation underscores the importance of meaningful human involvement beyond isolated review points, encompassing design and ongoing oversight.

Overview

Integrity signals

Registry

Crossref · 10.1145/3716173

Cites

17 of 17 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Citations

Cites

Show all 14 references

Research works printed but not linked: 4

  1. 10.1145/10.1145/3287560.3287563 · doi:10.1145/10.1145/3287560.3287563
  2. 10.1007/s00146-023-01777 · doi:10.1007/s00146-023-01777
  3. D. Stokmans and S. Moeliker. 2024. Het UWV wil “menselijker” worden, maar bij de afdeling Handhaving tellen vooral de targets. NRC. Retrieved from https://www.nrc.nl/nieuws/2024/04/19/bij-handhaving-blijft-de-menselijke-maat-zoek-a4196601?t=1717060846.
  4. 10.17176/20230512-181843-0 · doi:10.17176/20230512-181843-0

Cited by

See all 7

Metadata

Authors
Haitsma, L., & Brink, B.
Affiliations
University of Groningen (NL)
Venue
Digital Government: Research and Practice
Published
2025-08-27
Volume
6
Issue
3
Pages
1-17
ISSN
  • 2639-0175 (ISSN-L)
  • 2691-199X
OpenAlex
W4407131097
Cited by
7
References
14
Citations by year
2026: 6 · 2025: 1
FWCI
26.13
Type
journal article
Language
en
Open access
Licence
cc-by
Locations
  • Digital Government Research and Practice (publishedVersion, cc-by)
  • University of Groningen research database (University of Groningen / Centre for Information Technology) (submittedVersion, cc-by)
Topics
  • Social Sciences › Political Science and International Relations › E-Government and Public Services
  • Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
  • Social Sciences › Law › Digitalization, Law, and Regulation
Keywords
human-in-the-loop, human-on-the-loop, human-machine interaction, system design, accountability, meaningful human control

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: From Human Intervention to Human Involvement: A Critical Examination of the Role of Humans in (Semi-)Automated Administrative Decision-Making. https://app.cochat.ai/papers/10.1145/3716173
The paper
Haitsma, L., & Brink, B. (2025). From Human Intervention to Human Involvement: A Critical Examination of the Role of Humans in (Semi-)Automated Administrative Decision-Making. Digital Government: Research and Practice. https://doi.org/10.1145/3716173

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.