Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 72 of the 73 references it cites were found in a registry or an index; 14 of the 42 sources its claims cite were checked for support.

Human–AI Interactions in Public Sector Decision Making: “Automation Bias” and “Selective Adherence” to Algorithmic Advice

Open access
Alon-Barkat, Saar, Busuioc, Madalina · 2023 · Journal of Public Administration Research and Theory

Abstract

Abstract Artificial intelligence algorithms are increasingly adopted as decisional aides by public bodies, with the promise of overcoming biases of human decision-makers. At the same time, they may introduce new biases in the human–algorithm interaction. Drawing on psychology and public administration literatures, we investigate two key biases: overreliance on algorithmic advice even in the face of “warning signals” from other sources (automation bias), and selective adoption of algorithmic advice when this corresponds to stereotypes (selective adherence). We assess these via three experimental studies conducted in the Netherlands: In study 1 (N = 605), we test automation bias by exploring participants’ adherence to an algorithmic prediction compared to an equivalent human-expert prediction. We do not find evidence for automation bias. In study 2 (N = 904), we replicate these findings, and also test selective adherence. We find a stronger propensity for adherence when the advice is aligned with group stereotypes, with no significant differences between algorithmic and human-expert advice. In study 3 (N = 1,345), we replicate our design with a sample of civil servants. This study was conducted shortly after a major scandal involving public authorities’ reliance on an algorithm with discriminatory outcomes (the “childcare benefits scandal”). The scandal is itself illustrative of our theory and patterns diagnosed empirically in our experiment, yet in our study 3, while supporting our prior findings as to automation bias, we do not find patterns of selective adherence. We suggest this is driven by bureaucrats’ enhanced awareness of discrimination and algorithmic biases in the aftermath of the scandal. We discuss the implications of our findings for public sector decision making in the age of automation. Overall, our study speaks to potential negative effects of automation of the administrative state for already vulnerable and disadvantaged citizens.

Overview

CoChat Summary

TL;DR

Three Dutch survey experiments found no general automation bias: participants were not more likely to follow algorithmic advice than equivalent human-expert advice, and in study 3 they were less likely to follow it after the childcare benefits scandal. Selective adherence was found in study 2—advice was followed more when it matched negative stereotypes about a Moroccan-Dutch teacher—but not in study 3 with civil servants.

Key findings

  • Automation bias was not supported across studies 1 and 2: algorithmic versus human-expert advice differences were small and insignificant (study 1 OR = 0.96, p = .876; study 2 OR = 1.16, p = .498; pooled N = 1,509 OR = 1.07, p = .683).
  • In study 3 (N = 1,345 civil servants), participants were significantly less likely to follow algorithmic advice than human advice (OR = 0.54, p = .006; 4.8% vs. 8.6% selected the teacher with the lowest ILE score).
  • Study 2 (N = 792 Dutch-descent respondents) found selective adherence: a Moroccan-Dutch teacher with a low ILE score was 50% more likely not to have their contract renewed than a Dutch teacher with the same score (OR = 1.50, p = .04 one-sided; 12.3% vs. 8.6%).
  • The selective-adherence effect was not exacerbated by algorithmic versus human advice (interaction OR = 0.50, |z| = 1.45, p = .147), and study 3 did not replicate selective adherence: the Moroccan-Dutch teacher was less likely to be sanctioned (OR = 0.57, p = .020).

Methods

  • Three preregistered survey experiments in the Netherlands: study 1 (N = 605) and study 2 (N = 904) among Dutch citizens; study 3 (N = 1,345) among Dutch civil servants.
  • Participants acted as school board members deciding which of three teachers not to renew, using a qualitative HR evaluation and a numeric ILE score; the score was described as produced by an algorithm or human experts, and studies 2–3 manipulated the low-scoring teacher’s name as Dutch or Moroccan-Dutch.
  • Main analysis used logistic regression on a binary outcome of following the ILE score; two-tailed p values are reported uniformly, with one-sided p values for preregistered directional hypotheses.

Limitations

  • The paper states study 3’s sample was not fully representative of the Dutch public sector (women underrepresented, higher mean age), lacked an attention check, and may be affected by social desirability bias; it also notes statistical power limitations for the H3 interaction analysis.
  • The paper states study 3 coincided with the childcare benefits scandal, so results may reflect heightened awareness of algorithmic bias and discrimination rather than stable effects.
  • Evident from the text: all studies use a hypothetical vignette about teacher employment, which may limit external validity to other public-sector decisions and real-world settings.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1093/jopart/muac007

Cites

72 of 72 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

9 Valid · 4 Not valid · 21 Not checked · 135 Own results and interpretations

82 more claims · 1 with their cited sources checked

Create a free account to see all 169 claims and to verify the 5 references still open.

See all claims — free account
  • Probably not a substantial claim. 42
  • It may state two separate claims as one. 48
  • The quote only partly states this claim. 5

Create a free account to see these claims.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

2 more claims about this paper

Create a free account to see every claim other papers make about this one.

See all claims — free account

Statistics recomputed

Every reported test result, recomputed from its test statistic and degrees of freedom. A result shows as not adding up only once an independent check has confirmed it.

  • Consistentχ²(1) = 2.141reported p = .143 · recomputed p = .143

    “χ 2 (1) = 2.141, p = .143”

1 of 1

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

1 of 1

Citations

Cites

Show all 73 references

Research works printed but not linked: 9

  1. Angwin, 2016, Machine bias., ProPublica
  2. Geiger, 2021, How a discriminatory algorithm wrongly accused thousands of families of fraud., Vice
  3. Israni, 2017, When an algorithm helps send you to prison., New York Times
  4. Medium—Open Letter Concerned AI Researchers, 2019, On recent research auditing commercial facial analysis technology, Medium
  5. Milner, 2016, Death by GPS: Are Satnavs changing our brains?, The Guardian
  6. O’Neil, 2016, Weapons of math destruction: How big data increases inequality and threatens democracy
  7. Richardson, 2019, Dirty data, bad predictions: How civil rights violations impact police data, predictive policing systems, and justice., New York University Law Review Online, 94, 192
  8. Turque, 2012, ‘Creative...motivating’ and fired., Washington Post
  9. Volkskrant, 2020, Belastingdienst schuldig aan structurele discriminatie van mensen die toeslagen ontvingen, Volkskrant

Cited by

See all 469

Metadata

Authors
Alon-Barkat, S., & Busuioc, M.
Affiliations
  • University of Haifa , Israel
  • Vrije Universiteit Amsterdam (NL)
Corresponding author
Busuioc, Madalina
Venue
Journal of Public Administration Research and Theory
Published
2022-02-08
Volume
33
Issue
1
Pages
153-169
ISSN
  • 1053-1858 (ISSN-L)
  • 1477-9803
OpenAlex
W4211002924
Cited by
469
References
73
Citations by year
2026: 235 · 2025: 120 · 2024: 68 · 2023: 35 · 2022: 11
FWCI
67.76
Type
journal article
Language
en
Open access
Locations
  • Journal of Public Administration Research and Theory (publishedVersion, cc-by-nc)
  • VU Research Portal (publishedVersion, other-oa)
  • arXiv (Cornell University) (submittedVersion)
  • Data Archiving and Networked Services (DANS) (submittedVersion)
  • arXiv (Cornell University)
Funders
European Union’s Horizon 2020 (716439)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
  • Social Sciences › Political Science and International Relations › E-Government and Public Services
  • Social Sciences › Human Factors and Ergonomics › Human-Automation Interaction and Safety
Keywords
automation bias, algorithmic decision-making, human-AI interaction, public sector decision-making, algorithmic advice, group stereotypes, public sector employees, algorithmic discrimination, administrative automation

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (gpt-6-sol).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Human–AI Interactions in Public Sector Decision Making: “Automation Bias” and “Selective Adherence” to Algorithmic Advice. https://app.cochat.ai/papers/10.1093/jopart/muac007
The paper
Alon-Barkat, S., & Busuioc, M. (2023). Human–AI Interactions in Public Sector Decision Making: “Automation Bias” and “Selective Adherence” to Algorithmic Advice. Journal of Public Administration Research and Theory. https://doi.org/10.1093/jopart/muac007

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.