The agency of algorithms: Understanding human-algorithm interaction in administrative decision-making
The DOI matches its Crossref record; 78 of the 78 references it cites were found in a registry or an index.
Abstract
With the rise of computer algorithms in administrative decision-making, concerns are voiced about their lack of transparency and discretionary space for human decision-makers. However, calls to ‘keep humans in the loop’ may be moot points if we fail to understand how algorithms impact human decision-making and how algorithmic design impacts the practical possibilities for transparency and human discretion. Through a review of recent academic literature, three algorithmic design variables that determine the preconditions for human transparency and discretion and four main sources of variation in ‘human-algorithm interaction’ are identified. The article makes two contributions. First, the existing evidence is analysed and organized to demonstrate that, by working upon behavioural mechanisms of decision-making, the agency of algorithms extends beyond their computer code and can profoundly impact human behaviour and decision-making. Second, a research agenda for studying how computer algorithms affect administrative decision-making is proposed.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“And even if there is a “human in the loop,” the discretion of the human decision-maker may be limited by an algorithmically generated advice (Peeters 2020).”
From Legitimacy of Algorithmic Decision-Making: Six Threats and the Need for a Calibrated Institutional Response (2022) · cites this paper as Peeters 2020
In the citing paper
“Public Administration scholars have also started to recognize the impact of information communication technologies (ICTs) on the nature of human discretion and bureaucracy with some recent attention paid to artificial intelligence [21,23,80,96,128].”
From A Framework of High-Stakes Algorithmic Decision-Making for the Public Sector Developed through a Case Study of Child-Welfare (2021) · cites this paper as [96]
In the citing paper
“Moreover, the calls for human-in-the-loop might be moot if there is a lack of understanding about how algorithms impact human decision-making and how the type of decision-support (i.e.-algorithm design) impacts the practical possibilities for human intervention [96,111,113].”
From A Framework of High-Stakes Algorithmic Decision-Making for the Public Sector Developed through a Case Study of Child-Welfare (2021) · cites this paper as [96]
In the citing paper
“ADM raises concerns about administrative due process, where transparency and maintaining a 'human in the loop' are common safeguards (Peeters 2020).”
From Algorithmic Governance: Experimental Evidence on Citizens' and Public Administrators' Legitimacy Perceptions of Automated Decision‐Making (2026) · cites this paper as Peeters 2020
In the citing paper
“Having a human-in-the-loop is, however, no guarantee to correct errors made by an AI system when decision makers become subject to automation bias (Peeters, 2020).”
From ‘Just like I thought’: Street‐level bureaucrats trust AI recommendations if they confirm their professional judgment (2023) · cites this paper as Peeters, 2020
1 more claim about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Perceived usefulness, perceived ease of use, and user acceptance of information technology
Davis, F. D. (1989) · MIS Quarterly · doi:10.2307/249008 · Cited by 68,483 · cited 1×
“This is also linked to insights from cognitive dissonance theory (Festinger, 1957), prospect theory (Kahneman & Tversky, 1979) and the literature on technology acceptance (Davis, 1989).”
Prospect Theory: An Analysis of Decision under Risk
Kahneman, D., & Tversky, A. (1979) · Econometrica · doi:10.2307/1914185 · Cited by 48,524
The ethics of algorithms: Mapping the debate
Mittelstadt, B. D., Allo, P., Taddeo, M., Wachter, S., & Floridi, L. (2016) · Big Data & Society · doi:10.1177/2053951716679679 · Cited by 4,567 · cited 1×
“Algorithms may lack transparency because they are protected by proprietary laws (Mittelstadt et al., 2016), because they analyse amounts of data that humans cannot process (Burrell, 2016) or because the constant algorithmic modification in machine learning impedes human oversight (Danaher, 2016;…”
Big other: Surveillance Capitalism and the Prospects of an Information Civilization
Zuboff, S. (2015) · Journal of Information Technology · doi:10.1057/jit.2015.5 · Cited by 3,205 · cited 1×
“Beyond public sector research, the impact of algorithms has been extensively analysed and identified as a core part of contemporary business models (Zuboff, 2015) and as a driver for new forms of behavioural control (Couldry & Mejias, 2019).”
How the machine “thinks”: Understanding opacity in machine learning algorithms
Burrell, J. (2016) · Big Data & Society · doi:10.1177/2053951715622512 · Cited by 3,196 · cited 1×
“…may lack transparency because they are protected by proprietary laws (Mittelstadt et al., 2016), because they analyse amounts of data that humans cannot process (Burrell, 2016) or because the constant algorithmic modification in machine learning impedes human oversight (Danaher, 2016; Binns, 2018).”
New Public Management Is Dead--Long Live Digital-Era Governance
Dunleavy, P. (2005) · Journal of Public Administration Research and Theory · doi:10.1093/jopart/mui057 · Cited by 2,638 · cited 1×
“…and how information and communication technology transforms service delivery and triggers organizational change (e.g. Bovens & Zouridis, 2002; Busch & Henriksen, 2018; Cordella & Tempini, 2015; Dunleavy et al., 2006; Fountain, 2004; La Porte et al., 2002; Margetts, 1999; Zuurmond, 1994).”
Bainbridge, L. (1983) · Automatica · doi:10.1016/0005-1098(83)90046-8 · Cited by 2,205 · cited 6×
“This means that it is humanly impossible to carry out the basic function of monitoring for unlikely abnormalities” (Bainbridge, 1983: 776).”
InfluentialData colonialism: rethinking big data’s relation to the contemporary subject
Couldry, N., & Mejias, U. A. (2019) · Television & New Media · doi:10.1177/1527476418796632 · Cited by 1,617 · cited 1×
“Beyond public sector research, the impact of algorithms has been extensively analysed and identified as a core part of contemporary business models (Zuboff, 2015) and as a driver for new forms of behavioural control (Couldry & Mejias, 2019).”
Bovens, M., & Zouridis, S. (2002) · Public Administration Review · doi:10.1111/0033-3352.00168 · Cited by 964 · cited 5×
“In short, levels of automation vary, and, consequently, varying levels of transparency and discretion for human decision-makers at ‘street-level’ and ‘screen-level’ (Bovens & Zouridis, 2002) can be designed into algorithms.”
InfluentialThe Dark (Patterns) Side of UX Design
Gray, C. M., Kou, Y., Battles, B., Hoggatt, J., & Toombs, A. L. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3174108 · Cited by 848 · cited 2×
“…findings focus on the design characteristics of algorithms in organizational contexts in general and, thereby, exclude more specific objectives of algorithmic design such as ‘nudging algorithms’ (O’Keeffe et al., 2019; Ranchordás, 2019) or ‘dark patterns’ (Brignull & Rogers, 2003; Gray et al., 2018).”
Research works printed but not linked: 1
- Houser, 2017, The use of big data analytics by the IRS: Efficient solutions or the end of privacy as we know it, Vanderbilt Journal of Entertainment and Technology Law, 19, 817
Cited by
Alon-Barkat, S., & Busuioc, M. (2023) · Journal of Public Administration Research and Theory · doi:10.1093/jopart/muac007 · Cited by 469
Exploring artificial intelligence adoption in public organizations: a comparative case study
Neumann, O., Guirguis, K., & Steiner, R. (2024) · Public Management Review · doi:10.1080/14719037.2022.2048685 · Cited by 451
“…(Ahonen and Erkkilä 2020; Bovens and Zouridis 2002; Justin, Young, and Wang 2020; Criado, Valero, and Villodre 2020; de Boer and Raaphorst 2021; Peeters, Giest, and Grimmelikhuijsen 2020), organizational changes caused by introducing AI in predictive policing (Meijer, Lorenz, and Wessels…”
BackgroundGrimmelikhuijsen, S. (2023) · Public Administration Review · doi:10.1111/puar.13483 · Cited by 259
Grimmelikhuijsen, S., & Meijer, A. (2022) · Perspectives on Public Management and Governance · doi:10.1093/ppmgov/gvac008 · Cited by 189
Enhancing public service delivery efficiency: Exploring the impact of AI
Kulal, A., Rahiman, H. U., Suvarna, H., Abhishek, N., & Dinesh, S. (2024) · Journal of Open Innovation Technology Market and Complexity · doi:10.1016/j.joitmc.2024.100329 · Cited by 205
Metadata
- Authors
- Peeters, R.
- Corresponding author
- Peeters, Rik
- ORCID
- Peeters, Rik
- Venue
- Information Polity
- Publisher
- SAGE Publications
- Published
- 2020-12-04
- Volume
- 25
- Issue
- 4
- Pages
- 507-522
- ISSN
- 1570-1255 (ISSN-L)
- 1875-8754
- OpenAlex
- W3088216614
- Semantic Scholar
- 2528d7e22c4183abd3fc310485fb26691b56ef12
- Cited by
- 78
- References
- 78
- Citations by year
- 2026: 18 · 2025: 16 · 2024: 13 · 2023: 17 · 2022: 10 · 2021: 3 · 2020: 1
- FWCI
- 10.56
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Information Polity (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Social Sciences › Political Science and International Relations › E-Government and Public Services
- Social Sciences › Law › Artificial Intelligence in Law
- Keywords
- human-algorithm interaction, algorithmic decision-making, administrative decisions, algorithmic transparency, human discretion, algorithmic design, research agenda
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.