The agency of algorithms: Understanding human-algorithm interaction in administrative decision-making
The DOI matches its Crossref record; 78 of the 78 references it cites were found in a registry or an index.
Abstract
With the rise of computer algorithms in administrative decision-making, concerns are voiced about their lack of transparency and discretionary space for human decision-makers. However, calls to ‘keep humans in the loop’ may be moot points if we fail to understand how algorithms impact human decision-making and how algorithmic design impacts the practical possibilities for transparency and human discretion. Through a review of recent academic literature, three algorithmic design variables that determine the preconditions for human transparency and discretion and four main sources of variation in ‘human-algorithm interaction’ are identified. The article makes two contributions. First, the existing evidence is analysed and organized to demonstrate that, by working upon behavioural mechanisms of decision-making, the agency of algorithms extends beyond their computer code and can profoundly impact human behaviour and decision-making. Second, a research agenda for studying how computer algorithms affect administrative decision-making is proposed.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“And even if there is a “human in the loop,” the discretion of the human decision-maker may be limited by an algorithmically generated advice (Peeters 2020).”
From Legitimacy of Algorithmic Decision-Making: Six Threats and the Need for a Calibrated Institutional Response (2022) · cites this paper as Peeters 2020
In the citing paper
“Public Administration scholars have also started to recognize the impact of information communication technologies (ICTs) on the nature of human discretion and bureaucracy with some recent attention paid to artificial intelligence [21,23,80,96,128].”
From A Framework of High-Stakes Algorithmic Decision-Making for the Public Sector Developed through a Case Study of Child-Welfare (2021) · cites this paper as [96]
In the citing paper
“Moreover, the calls for human-in-the-loop might be moot if there is a lack of understanding about how algorithms impact human decision-making and how the type of decision-support (i.e.-algorithm design) impacts the practical possibilities for human intervention [96,111,113].”
From A Framework of High-Stakes Algorithmic Decision-Making for the Public Sector Developed through a Case Study of Child-Welfare (2021) · cites this paper as [96]
In the citing paper
“ADM raises concerns about administrative due process, where transparency and maintaining a 'human in the loop' are common safeguards (Peeters 2020).”
From Algorithmic Governance: Experimental Evidence on Citizens' and Public Administrators' Legitimacy Perceptions of Automated Decision‐Making (2026) · cites this paper as Peeters 2020
In the citing paper
“Having a human-in-the-loop is, however, no guarantee to correct errors made by an AI system when decision makers become subject to automation bias (Peeters, 2020).”
From ‘Just like I thought’: Street‐level bureaucrats trust AI recommendations if they confirm their professional judgment (2023) · cites this paper as Peeters, 2020
1 more claim about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Perceived usefulness, perceived ease of use, and user acceptance of information technology
Davis, F. D. (1989) · MIS Quarterly · doi:10.2307/249008 · Cited by 68,483 · cited 1×
“This is also linked to insights from cognitive dissonance theory (Festinger, 1957), prospect theory (Kahneman & Tversky, 1979) and the literature on technology acceptance (Davis, 1989).”
Prospect Theory: An Analysis of Decision under Risk
Kahneman, D., & Tversky, A. (1979) · Econometrica · doi:10.2307/1914185 · Cited by 48,524
The ethics of algorithms: Mapping the debate
Mittelstadt, B. D., Allo, P., Taddeo, M., Wachter, S., & Floridi, L. (2016) · Big Data & Society · doi:10.1177/2053951716679679 · Cited by 4,567 · cited 1×
“Algorithms may lack transparency because they are protected by proprietary laws (Mittelstadt et al., 2016), because they analyse amounts of data that humans cannot process (Burrell, 2016) or because the constant algorithmic modification in machine learning impedes human oversight (Danaher, 2016;…”
Big other: Surveillance Capitalism and the Prospects of an Information Civilization
Zuboff, S. (2015) · Journal of Information Technology · doi:10.1057/jit.2015.5 · Cited by 3,205 · cited 1×
“Beyond public sector research, the impact of algorithms has been extensively analysed and identified as a core part of contemporary business models (Zuboff, 2015) and as a driver for new forms of behavioural control (Couldry & Mejias, 2019).”
How the machine “thinks”: Understanding opacity in machine learning algorithms
Burrell, J. (2016) · Big Data & Society · doi:10.1177/2053951715622512 · Cited by 3,196 · cited 1×
“…may lack transparency because they are protected by proprietary laws (Mittelstadt et al., 2016), because they analyse amounts of data that humans cannot process (Burrell, 2016) or because the constant algorithmic modification in machine learning impedes human oversight (Danaher, 2016; Binns, 2018).”
New Public Management Is Dead--Long Live Digital-Era Governance
Dunleavy, P. (2005) · Journal of Public Administration Research and Theory · doi:10.1093/jopart/mui057 · Cited by 2,638 · cited 1×
“…and how information and communication technology transforms service delivery and triggers organizational change (e.g. Bovens & Zouridis, 2002; Busch & Henriksen, 2018; Cordella & Tempini, 2015; Dunleavy et al., 2006; Fountain, 2004; La Porte et al., 2002; Margetts, 1999; Zuurmond, 1994).”
Bainbridge, L. (1983) · Automatica · doi:10.1016/0005-1098(83)90046-8 · Cited by 2,205 · cited 6×
“This means that it is humanly impossible to carry out the basic function of monitoring for unlikely abnormalities” (Bainbridge, 1983: 776).”
InfluentialData colonialism: rethinking big data’s relation to the contemporary subject
Couldry, N., & Mejias, U. A. (2019) · Television & New Media · doi:10.1177/1527476418796632 · Cited by 1,617 · cited 1×
“Beyond public sector research, the impact of algorithms has been extensively analysed and identified as a core part of contemporary business models (Zuboff, 2015) and as a driver for new forms of behavioural control (Couldry & Mejias, 2019).”
Bovens, M., & Zouridis, S. (2002) · Public Administration Review · doi:10.1111/0033-3352.00168 · Cited by 964 · cited 5×
“In short, levels of automation vary, and, consequently, varying levels of transparency and discretion for human decision-makers at ‘street-level’ and ‘screen-level’ (Bovens & Zouridis, 2002) can be designed into algorithms.”
InfluentialThe Dark (Patterns) Side of UX Design
Gray, C. M., Kou, Y., Battles, B., Hoggatt, J., & Toombs, A. L. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3174108 · Cited by 848 · cited 2×
“…findings focus on the design characteristics of algorithms in organizational contexts in general and, thereby, exclude more specific objectives of algorithmic design such as ‘nudging algorithms’ (O’Keeffe et al., 2019; Ranchordás, 2019) or ‘dark patterns’ (Brignull & Rogers, 2003; Gray et al., 2018).”
Algorithmic regulation: A critical interrogation
Yeung, K. (2018) · Regulation & Governance · doi:10.1111/rego.12158 · Cited by 842 · cited 1×
“…& Chan, 2018; Smith & O’Malley, 2017), probation and sentencing decisions (Goel et al., 2016; Hamilton, 2015), the allocation of regulatory oversight resources (Yeung, 2018), risk assessment in child protection services (Gillingham, 2016) and individual administrative decisions (Van Eck, 2018).”
A Summary of a Convenient Vocabulary for the Semiotics of Human and Nonhuman Assemblies
Akrich, M., & Latour, B. (1992) · HAL · Cited by 834
Coping During Public Service Delivery: A Conceptualization and Systematic Review of the Literature
Tummers, L. L. G., Bekkers, V., Vink, E., & Musheno, M. (2015) · Journal of Public Administration Research and Theory · doi:10.1093/jopart/muu056 · Cited by 756 · cited 2×
“Relevant literature (academic articles and books) was selected in two steps (cf. Cooper, 2010; Tummers et al., 2015).”
Enticing People to Interact with Large Public Displays in Public Spaces.
Brignull, H., & Rogers, Y. (2003) · Cited by 612
Winner, L. (2020) · Emerging Technologies: Ethics, Law and Governance · doi:10.4324/9781003074960-3 · Cited by 553
(2014) · Digital Commons at University of Maryland Carey Law (University of Maryland Francis King Carey School of Law) · Cited by 524
Edwards, L., & Veale, M. (2017) · doi:10.31228/osf.io/97upg · Cited by 524
The threat of algocracy: reality, resistance and accommodation
Danaher, J. (2016) · Philosophy & Technology · doi:10.1007/s13347-015-0211-1 · Cited by 519 · cited 5×
“…uses algorithms to 1) merely select targets for auditing, 2) select targets and suggest enforcement interventions with human agents left to decide whether to follow these decisions or not, or 3) select targets and enforcement interventions autonomously without human intervention (Danaher, 2016).”
InfluentialAlgorithmic Accountability and Public Reason
Binns, R. (2018) · Philosophy & Technology · doi:10.1007/s13347-017-0263-5 · Cited by 457 · cited 3×
“Algorithms may also lack transparency because they analyse amounts of data that humans cannot process (Kitchin, 2014) or because machine learning causes constant algorithmic modification that impedes human oversight (Binns, 2018; Eubanks, 2018).”
Algorithmic prediction in policing: assumptions, evaluation, and accountability
Bennett Moses, L., & Chan, J. (2018) · Policing and Society · doi:10.1080/10439463.2016.1253695 · Cited by 358 · cited 2×
“…policy studies, a rapidly expanding body of literature has analysed, among other things, the application of algorithms in predictive policing (Bennett Moses & Chan, 2018; Smith & O’Malley, 2017), probation and sentencing decisions (Goel et al., 2016; Hamilton, 2015), the allocation of…”
Picturing Algorithmic Surveillance: The Politics of Facial Recognition Systems
Introna, L., & Wood, D. (2002) · Surveillance & Society · doi:10.24908/ss.v2i2/3.3373 · Cited by 346 · cited 1×
“Algorithmic decision-making refers here to any outcome generated by a sequence of digital rules and criteria without human interference (Introna & Wood, 2004; Le Sueur, 2015).”
Artificial Intelligence, Discretion, and Bureaucracy
Bullock, J. B. (2019) · The American Review of Public Administration · doi:10.1177/0275074019856123 · Cited by 346 · cited 4×
“(Simon, 1947; cf. Bullock, 2019: 752).”
InfluentialCordella, A., & Tempini, N. (2015) · Government Information Quarterly · doi:10.1016/j.giq.2015.03.005 · Cited by 342 · cited 1×
“…and how information and communication technology transforms service delivery and triggers organizational change (e.g. Bovens & Zouridis, 2002; Busch & Henriksen, 2018; Cordella & Tempini, 2015; Dunleavy et al., 2006; Fountain, 2004; La Porte et al., 2002; Margetts, 1999; Zuurmond, 1994).”
Moral crumple zones: cautionary tales in human–robot interaction
Elish, M. C. (2019) · Engaging Science, Technology, and Society · doi:10.17351/ests2019.260 · Cited by 321 · cited 1×
“This can lead to what Elish (2019) calls ‘moral crumple zones’, where human actors bear the brunt of malfunctions in automated decision-making procedures they have little or no control over.”
Big data, bigger dilemmas: A critical review
Ekbia, H., Mattioli, M., Kouper, I., Arave, G., Ghazinejad, A., Bowman, T., Suri, V. R., Tsou, A., Weingart, S., & Sugimoto, C. R. (2015) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.23294 · Cited by 305 · cited 1×
“Algorithms provide ‘actionable insights’ (Ekbia et al., 2015).”
Kroll, J. A., Huey, J., Barocas, S., Felten, E. W., Reidenberg, J. R., Robinson, D. G., & Yu, H. (2017) · FLASH - Fordham Law Archive of Scholarship & History (Fordham University) · Cited by 299
Engin, Z., & Treleaven, P. (2019) · The Computer Journal · doi:10.1093/comjnl/bxy082 · Cited by 284 · cited 1×
“More than just an instrument of government, the use of algorithms implies a different way of governing – of algorithmic governance or ‘algocracy’ (Aneesh, 2006; Danaher, 2016; Engin & Treleaven, 2019).”
Pessimism, computer failure, and information systems development in the public sector
Goldfinch, S. (2007) · Public Administration Review · doi:10.1111/j.1540-6210.2007.00778.x · Cited by 283 · cited 1×
“Other have identified this bias in terms of cyberoptimism (Norris, 2001) or technological idolization (Goldfinch, 2007).”
Big and Open Linked Data (BOLD) in government: A challenge to transparency and privacy?
Janssen, M., & van den Hoven, J. (2015) · Government Information Quarterly · doi:10.1016/j.giq.2015.11.007 · Cited by 272 · cited 1×
“First, algorithms operate as black boxes that impede human oversight to account for possible validity problems or bias in the input data or decision outcomes (Harcourt, 2007; Janssen & Van den Hoven, 2015; Kroll et al., 2016; Pasquale, 2015).”
Digital discretion: A systematic literature review of ICT and street-level discretion
Busch, P. A., & Henriksen, H. Z. (2018) · Information Polity · doi:10.3233/ip-170050 · Cited by 267 · cited 4×
“When ‘digital discretion’ (Busch & Henriksen, 2018), ‘artificial discretion’ (Young et al., 2019) or ‘automated discretion’ (Zouridis et al., 2020) replaces human discretion, there is a risk that organizations hide their responsibility for individual decisions behind technological arguments, such as…”
InfluentialRisk Assessment in Criminal Sentencing
Monahan, J., & Skeem, J. L. (2016) · Annual Review of Clinical Psychology · doi:10.1146/annurev-clinpsy-021815-092945 · Cited by 256 · cited 3×
“…policing and criminal justice – two policy areas where algorithmic applications have been analysed more extensively – show that correctional workers, judges and police officers may fail to scrutinize algorithms or use their own personal judgement (Hannah-Moffat, 2013; Monahan & Skeem, 2016).”
Young, M. M., Bullock, J. B., & Lecy, J. D. (2019) · Perspectives on Public Management and Governance · doi:10.1093/ppmgov/gvz014 · Cited by 255 · cited 5×
“There have, so far, been relatively few empirical studies on the impact of automation on administrative decision-making in public administration (Bullock, 2019; Young et al., 2019: 303).”
InfluentialDemocracy and Bureaucracy in the Age of the Web: Empirical Findings and Theoretical Speculations
la Porte, T. M., Demchak, C. C., & de Jong, M. (2002) · Administration & Society · doi:10.1177/0095399702034004004 · Cited by 239 · cited 1×
“…and how information and communication technology transforms service delivery and triggers organizational change (e.g. Bovens & Zouridis, 2002; Busch & Henriksen, 2018; Cordella & Tempini, 2015; Dunleavy et al., 2006; Fountain, 2004; La Porte et al., 2002; Margetts, 1999; Zuurmond, 1994).”
Hannah-Moffat, K. (2019) · Theoretical Criminology · doi:10.1177/1362480618763582 · Cited by 236 · cited 1×
“Through machine learning, algorithms ‘learn’ new ways of classification and identification of patterns or anomalies (Aradau & Blanke, 2017; Binns, 2018), which indicates a shift in discretion from system designers to the algorithm itself (Hannah-Moffat, 2018).”
Understanding the promises and premises of online health platforms
Van Dijck, J., & Poell, T. (2016) · Big Data & Society · doi:10.1177/2053951716654173 · Cited by 227
From one-stop shop to no-stop shop: An e-government stage model
Scholta, H., Mertens, W., Kowalkiewicz, M., & Becker, J. (2019) · Government Information Quarterly · doi:10.1016/j.giq.2018.11.010 · Cited by 193 · cited 1×
“…a transfer of discretion and transparency to the system-level were automation is designed and managed, thereby transforming classic street-level bureaucrats into screen-level bureaucrats (Bovens & Zouridis, 2002) or even eliminating them completely from standard procedures (Scholta et al., 2019).”
Banks, V. A., Plant, K. L., & Stanton, N. A. (2018) · Safety Science · doi:10.1016/j.ssci.2017.12.023 · Cited by 175 · cited 1×
“Automation is “most dangerous when it behaves in a consistent and reliable manner most of the time” (Banks et al., 2018: 283).”
Peeters, R., & Widlak, A. C. (2018) · Government Information Quarterly · doi:10.1016/j.giq.2018.02.003 · Cited by 171 · cited 6×
“…replaces human discretion, there is a risk that organizations hide their responsibility for individual decisions behind technological arguments, such as algorithmic complexity, system design flaws or lack of access to data (Fosch-Villaronga, 2019; Widlak & Peeters, 2018; Zalnieriute et al., 2019).”
InfluentialSelf-citationActuarial Sentencing: An “Unsettled” Proposition
Hannah-Moffat, K. (2013) · Justice Quarterly · doi:10.1080/07418825.2012.682603 · Cited by 165 · cited 2×
“…policing and criminal justice – two policy areas where algorithmic applications have been analysed more extensively – show that correctional workers, judges and police officers may fail to scrutinize algorithms or use their own personal judgement (Hannah-Moffat, 2013; Monahan & Skeem, 2016).”
Driver Vigilance in Automated Vehicles: Hazard Detection Failures Are a Matter of Time
Greenlee, E. T., DeLucia, P. R., & Newton, D. C. (2018) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720818761711 · Cited by 161 · cited 1×
“In human-machine systems studies, it is well known that, as technology advances, human operators need to transform into supervisors (Greenlee et al., 2018; Strauch, 2018).”
Gillingham, P. (2015) · The British Journal of Social Work · doi:10.1093/bjsw/bcv031 · Cited by 150 · cited 2×
“…& Chan, 2018; Smith & O’Malley, 2017), probation and sentencing decisions (Goel et al., 2016; Hamilton, 2015), the allocation of regulatory oversight resources (Yeung, 2018), risk assessment in child protection services (Gillingham, 2016) and individual administrative decisions (Van Eck, 2018).”
Decision-Making Tools and Their Influence on Caseworkers' Room for Discretion
Høybye-Mortensen, M. (2013) · The British Journal of Social Work · doi:10.1093/bjsw/bct144 · Cited by 150 · cited 1×
“In social work research, there is evidence that caseworkers use less discretion when their algorithmic decision-making support tools are theory-based as compared to tools that require interpretation from the caseworkers themselves (Høybye-Mortensen, 2015).”
Algorithmic Decision-Making and the Control Problem
Zerilli, J., Knott, A., Maclaurin, J., & Gavaghan, C. (2019) · Minds and Machines · doi:10.1007/s11023-019-09513-7 · Cited by 145 · cited 5×
“In terms of control problems (Zerilli et al., 2019), bounded rationality reflects the notion that humans have an epistemic disadvantage compared to machines (‘capacity problem’).”
InfluentialNudging citizens through technology in smart cities
Ranchordás, S. (2020) · International Review of Law, Computers & Technology · doi:10.1080/13600869.2019.1590928 · Cited by 144 · cited 1×
“…findings focus on the design characteristics of algorithms in organizational contexts in general and, thereby, exclude more specific objectives of algorithmic design such as ‘nudging algorithms’ (O’Keeffe et al., 2019; Ranchordás, 2019) or ‘dark patterns’ (Brignull & Rogers, 2003; Gray et al., 2018).”
The Rule of Law and Automation of Government Decision‐Making
Zalnieriute, M., Moses, L. B., & Williams, G. (2019) · The Modern Law Review · doi:10.1111/1468-2230.12412 · Cited by 140 · cited 1×
“…replaces human discretion, there is a risk that organizations hide their responsibility for individual decisions behind technological arguments, such as algorithmic complexity, system design flaws or lack of access to data (Fosch-Villaronga, 2019; Widlak & Peeters, 2018; Zalnieriute et al., 2019).”
The Rule of Law and Automation of Government Decision-Making
Zalnieriute, M., Bennett Moses, L., & Williams, G. (2019) · doi:10.2139/ssrn.3348831 · Cited by 140
Ironies of Automation: Still Unresolved After All These Years
Strauch, B. (2018) · IEEE Transactions on Human-Machine Systems · doi:10.1109/thms.2017.2732506 · Cited by 139 · cited 1×
“In human-machine systems studies, it is well known that, as technology advances, human operators need to transform into supervisors (Greenlee et al., 2018; Strauch, 2018).”
Governing others: Anomaly and the algorithmic subject of security
Aradau, C., & Blanke, T. (2017) · European Journal of International Security · doi:10.1017/eis.2017.14 · Cited by 121 · cited 1×
“Through machine learning, algorithms ‘learn’ new ways of classification and identification of patterns or anomalies (Aradau & Blanke, 2017; Binns, 2018), which indicates a shift in discretion from system designers to the algorithm itself (Hannah-Moffat, 2018).”
The Challenges of Doing Criminology in the Big Data Era: Towards a Digital and Data-driven Approach
Smith, G. J. D., Moses, L. B., & Chan, J. B. L. (2016) · The British Journal of Criminology · doi:10.1093/bjc/azw096 · Cited by 118 · cited 1×
“…procedure are unknown, it is impossible to determine whether the actual outcome is fair and in accordance with legal requirements of due process (Pasquale, 2015; Ponce, 2005) or if an algorithmic risk assessment is based on a valid theoretical model and unbiased assumptions (Smith et al., 2017).”
Negotiated Risk: Actuarial Illusions and Discretion in Probation
Hannah-Moffat, K., Maurutto, P., & Turnbull, S. (2009) · Canadian journal of law and society · doi:10.1017/s0829320100010097 · Cited by 111
Keddell, E. (2019) · Social Sciences · doi:10.3390/socsci8100281 · Cited by 109 · cited 1×
“Keddell (2019) finds that child protection professionals in New Zealand have reservations regarding working with predictive algorithms they are unable to explain to families, while at the same time they are being held accountable for decisions based on them.”
van Eijk, G. (2016) · Punishment & Society · doi:10.1177/1462474516666282 · Cited by 107 · cited 1×
“For example, studies in policing and criminal justice have argued that algorithmic decisions tend to reproduce bias towards already over-policed areas and target groups (Hannah-Moffat, 2016; Harcourt, 2007; Van Eijk, 2017).”
Cognitive Biases in Governing: Technology Preferences in Election Administration
Moynihan, D. P., & Lavertu, S. (2012) · Public Administration Review · doi:10.1111/j.1540-6210.2011.02478.x · Cited by 72 · cited 1×
“In accordance, Moynihan and Lavertu (2012) found evidence for a technology preference among local election officials for e-voting applications based on a general faith in technology.”
Investigation on the impact of human-automation interaction in maritime operations
Pazouki, K., Forbes, N., Norman, R. A., & Woodward, M. D. (2018) · Ocean Engineering · doi:10.1016/j.oceaneng.2018.01.103 · Cited by 71 · cited 1×
“Negotiated use of algorithms in non-routine tasks; trade-off with experiential, moral and affective forms of decision-making. to assume that the system is infallible, and so will no longer actively monitor what is happening, meaning they have become complacent” (Pazouki et al., 2018: 299).”
Individualizing Risk: Moral Judgement, Professional Knowledge and Affect in Parole Evaluations
Werth, R. (2016) · The British Journal of Criminology · doi:10.1093/bjc/azw025 · Cited by 70 · cited 2×
“In policing studies, this has been identified as a rationalization process and as a key characteristic of the ‘techno-moral assemblage’ (Werth, 2017: 822) of algorithmic decision-making.”
Towards principles of good digital administration
Widlak, A. C., van Eck, M., & Peeters, R. (2020) · Routledge eBooks · doi:10.4324/9780429261404-6 · Cited by 66
Self-citationMoon, M. J., & Welch, E. W. (2005) · Review of Public Personnel Administration · doi:10.1177/0734371x05275508 · Cited by 64 · cited 1×
“Studies have demonstrated that public officials are, relative to the general public, more likely to support information and communication technology and more confident in its ability to provide public services (Moon & Welch, 2005).”
Hannah-Moffat, K. (2016) · Psychology, Crime & Law · doi:10.1080/1068316x.2015.1114115 · Cited by 64 · cited 1×
“For example, studies in policing and criminal justice have argued that algorithmic decisions tend to reproduce bias towards already over-policed areas and target groups (Hannah-Moffat, 2016; Harcourt, 2007; Van Eijk, 2017).”
Machine justice: Governing security through the bureaucracy of algorithms
Peeters, R., & Schuilenburg, M. (2018) · Information Polity · doi:10.3233/ip-180074 · Cited by 60 · cited 1×
“…replaces human discretion, there is a risk that organizations hide their responsibility for individual decisions behind technological arguments, such as algorithmic complexity, system design flaws or lack of access to data (Fosch-Villaronga, 2019; Widlak & Peeters, 2018; Zalnieriute et al., 2019).”
Self-citationWidlak, A. C., & Peeters, R. (2019) · International Journal of Electronic Governance · doi:10.1504/ijeg.2020.10025727 · Cited by 60 · cited 1×
“This is confirmed in another study on the way administrative errors spread across multiple organisations through automated data-sharing: data users take the data they receive at face value without verifying the data or looking at a citizen’s factual situation (Widlak & Peeters, 2020).”
Self-citationHoward, J. J., Rabbitt, L. R., & Sirotin, Y. B. (2020) · PLoS ONE · doi:10.1371/journal.pone.0237855 · Cited by 57 · cited 1×
“…recognition finds that it leads to a deterioration of human accuracy since human decision-makers are inclined to follow algorithmic outcomes as a default – thereby reducing the possibility of identifying false positives and possibly also of false negatives in face matching (Howard et al., 2020).”
Good Administration and Administrative Procedures
Ponce (2005) · Indiana Journal of Global Legal Studies · doi:10.2979/gls.2005.12.2.551 · Cited by 56 · cited 1×
“…procedure are unknown, it is impossible to determine whether the actual outcome is fair and in accordance with legal requirements of due process (Pasquale, 2015; Ponce, 2005) or if an algorithmic risk assessment is based on a valid theoretical model and unbiased assumptions (Smith et al., 2017).”
Big Data, Machine Judges, and the Legitimacy of the Criminal Justice SystemPreprint
Simmons, R. (2018) · SSRN Electronic Journal · doi:10.2139/ssrn.3156510 · Cited by 45
Governmental Data Mining and its Alternatives
Zarsky, T. (2011) · bepress Legal Repository · Cited by 39
Screen level bureaucracy: Databases as public records
Landsbergen, D. (2004) · Government Information Quarterly · doi:10.1016/j.giq.2003.12.009 · Cited by 34 · cited 1×
“…traditional bureaucracies with a system-level bureaucracy that generates mass amounts of decisions through automated procedures rather than human assessment – in the process, converting the traditional street-level bureaucrat (Lipsky, 1981) into a screen-level bureaucrat (cf. Landsbergen, 2004).”
Berendt, B., & Preibusch, S. (2017) · Big Data · doi:10.1089/big.2016.0055 · Cited by 32
Opening Black Boxes Is Not Enough – Data-based Surveillance In Discipline and Punish And Today
Matzner, T. (2017) · Foucault Studies · doi:10.22439/fs.v0i0.5340 · Cited by 30 · cited 1×
“Matzner (2017) explicitly states that opening the black box of algorithms is not enough to gain understanding of their impact.”
Personalized Risk Assessments in the Criminal Justice System
Goel, S., Rao, J. M., & Shroff, R. (2016) · American Economic Review · doi:10.1257/aer.p20161028 · Cited by 27 · cited 2×
“…the application of algorithms in predictive policing (Bennett Moses & Chan, 2018; Smith & O’Malley, 2017), probation and sentencing decisions (Goel et al., 2016; Hamilton, 2015), the allocation of regulatory oversight resources (Yeung, 2018), risk assessment in child protection services…”
Driving Politics: Data-Driven Governance and Resistance
Smith, G. J. D., & O’Malley, P. (2016) · The British Journal of Criminology · doi:10.1093/bjc/azw075 · Cited by 26 · cited 2×
“…expanding body of literature has analysed, among other things, the application of algorithms in predictive policing (Bennett Moses & Chan, 2018; Smith & O’Malley, 2017), probation and sentencing decisions (Goel et al., 2016; Hamilton, 2015), the allocation of regulatory oversight resources…”
Ostrom, V. (1996) · Constitutional Political Economy · doi:10.1007/bf00119270 · Cited by 21 · cited 1×
“Regulated discretion in the application of universal laws in specific cases is considered a key mechanism in the Western legal tradition to ensure fair and proportional administrative decisions (Mashaw, 2007; Ostrom, 1996).”
Robot Government: Automated Decision-Making and its Implications for Parliament
Sueur, A. P. L. (2016) · Hart Publishing eBooks · doi:10.5040/9781509906468.ch-009 · Cited by 20
O’Keeffe, M., Traeger, A. C., Hoffmann, T., Ferreira, G. E., Soon, J., & Maher, C. G. (2019) · BMJ Open · doi:10.1136/bmjopen-2019-029540 · Cited by 19 · cited 1×
“…findings focus on the design characteristics of algorithms in organizational contexts in general and, thereby, exclude more specific objectives of algorithmic design such as ‘nudging algorithms’ (O’Keeffe et al., 2019; Ranchordás, 2019) or ‘dark patterns’ (Brignull & Rogers, 2003; Gray et al., 2018).”
Adventures in risk: Predicting Violent andSexual Recidivism in Sentencing Law
Hamilton, M. (2015) · Surrey Research Insight Open Access (The University of Surrey) · Cited by 16
Actuarial risk assessment: Reflections on an emerging social-scientific tool
Silver, E. (2000) · Critical Criminology · doi:10.1007/bf02461041 · Cited by 15 · cited 1×
“In these and other examples, algorithms have agency because human operators see algorithms as rational, scientific and value-neutral (Silver, 2000).”
Automated DiscretionPreprint
Zouridis, S., van Eck, M., & Bovens, M. (2019) · SSRN Electronic Journal · doi:10.2139/ssrn.3453068 · Cited by 13
Adventures in risk: Predicting Violent andSexual Recidivism in Sentencing LawPreprint
Hamilton, M. (2015) · SSRN Electronic Journal · Cited by 8
Widlak, A. C., van Eck, B. M. A., Peeters, R., & Schuilenburg, M. (2021) · Radboud Repository (Radboud University) · Cited by 6
Self-citationvan Eijk, G. (2020) · The Algorithmic Society · doi:10.4324/9780429261404-10 · Cited by 5
Research works printed but not linked: 1
- Houser, 2017, The use of big data analytics by the IRS: Efficient solutions or the end of privacy as we know it, Vanderbilt Journal of Entertainment and Technology Law, 19, 817
Cited by
Alon-Barkat, S., & Busuioc, M. (2023) · Journal of Public Administration Research and Theory · doi:10.1093/jopart/muac007 · Cited by 469
Exploring artificial intelligence adoption in public organizations: a comparative case study
Neumann, O., Guirguis, K., & Steiner, R. (2024) · Public Management Review · doi:10.1080/14719037.2022.2048685 · Cited by 451
“…(Ahonen and Erkkilä 2020; Bovens and Zouridis 2002; Justin, Young, and Wang 2020; Criado, Valero, and Villodre 2020; de Boer and Raaphorst 2021; Peeters, Giest, and Grimmelikhuijsen 2020), organizational changes caused by introducing AI in predictive policing (Meijer, Lorenz, and Wessels…”
BackgroundGrimmelikhuijsen, S. (2023) · Public Administration Review · doi:10.1111/puar.13483 · Cited by 259
Grimmelikhuijsen, S., & Meijer, A. (2022) · Perspectives on Public Management and Governance · doi:10.1093/ppmgov/gvac008 · Cited by 189
Enhancing public service delivery efficiency: Exploring the impact of AI
Kulal, A., Rahiman, H. U., Suvarna, H., Abhishek, N., & Dinesh, S. (2024) · Journal of Open Innovation Technology Market and Complexity · doi:10.1016/j.joitmc.2024.100329 · Cited by 205
Metadata
- Authors
- Peeters, R.
- Corresponding author
- Peeters, Rik
- ORCID
- Peeters, Rik
- Venue
- Information Polity
- Publisher
- SAGE Publications
- Published
- 2020-12-04
- Volume
- 25
- Issue
- 4
- Pages
- 507-522
- ISSN
- 1570-1255 (ISSN-L)
- 1875-8754
- OpenAlex
- W3088216614
- Semantic Scholar
- 2528d7e22c4183abd3fc310485fb26691b56ef12
- Cited by
- 78
- References
- 78
- Citations by year
- 2026: 18 · 2025: 16 · 2024: 13 · 2023: 17 · 2022: 10 · 2021: 3 · 2020: 1
- FWCI
- 10.56
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Information Polity (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Social Sciences › Political Science and International Relations › E-Government and Public Services
- Social Sciences › Law › Artificial Intelligence in Law
- Keywords
- human-algorithm interaction, algorithmic decision-making, administrative decisions, algorithmic transparency, human discretion, algorithmic design, research agenda
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.