The DOI matches its Crossref record; 60 of the 62 references it cites were found in a registry or an index.
Artificial intelligence, bureaucratic form, and discretion in public service
Abstract
This article examines the relationship between Artificial Intelligence (AI), discretion, and bureaucratic form in public organizations. We ask: How is the use of AI both changing and changed by the bureaucratic form of public organizations, and what effect does this have on the use of discretion? The diffusion of information and communication technologies (ICTs) has changed administrative behavior in public organizations. Recent advances in AI have led to its increasing use, but too little is known about the relationship between this distinct form of ICT and to both the exercise of discretion and bureaucratic form along the continuum from street- to system-levels. We articulate a theoretical framework that integrates work on the unique effects of AI on discretion and its relationship to task and organizational context with the theory of system-level bureaucracy. We use this framework to examine two strongly differing cases of public sector AI use: health insurance auditing, and policing. We find AI’s effect on discretion is nonlinear and nonmonotonic as a function of bureaucratic form. At the same time, the use of AI may act as an accelerant in transitioning organizations from street- and screen-level to system-level bureaucracies, even if these organizations previously resisted such changes.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The common agreement between scholars is that automation using AI is only appropriate for repetitive and low discretionary tasks”
From AI adoption and diffusion in public administration: A systematic literature review and future research agenda (2023) · cites this paper as Bullock et al., 2020
In the citing paper
“The accompanying negative aspect is distancing public servants from citizens and inhibiting a rich knowledge generation avenue”
From AI adoption and diffusion in public administration: A systematic literature review and future research agenda (2023) · cites this paper as Bullock, Young, & Wang, 2020
In the citing paper
“While frontline workers share similar characteristics (Maynard-Moody & Musheno, 2003), have previous studies highlighted that the use of AI systems is influenced by the specific type of AI system at hand and the organizational context in which this system is used (Bullock et al., 2020;Meijer et al., 2021).”
From ‘Just like I thought’: Street‐level bureaucrats trust AI recommendations if they confirm their professional judgment (2023) · cites this paper as Bullock et al., 2020
Citations
Cites
Artificial intelligence: a modern approach
(1995) · Choice Reviews Online · doi:10.5860/choice.33-1577 · Cited by 21,974
The future of employment: How susceptible are jobs to computerisation?
Frey, C. B., & Osborne, M. A. (2017) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2016.08.019 · Cited by 8,727
Case Selection Techniques in Case Study Research: A Menu of Qualitative and Quantitative Options
Seawright, J., & Gerring, J. (2008) · Political Research Quarterly · doi:10.1177/1065912907313077 · Cited by 3,827 · cited 1×
“These domains were chosen to provide cases with strongly differing organizational contexts and associated requirements for discretion (Seawright & Gerring, 2008).”
New Public Management Is Dead--Long Live Digital-Era Governance
Dunleavy, P. (2005) · Journal of Public Administration Research and Theory · doi:10.1093/jopart/mui057 · Cited by 2,638 · cited 1×
“A unifying feature across empirical contexts is the recognition that as public organizations increase their use of ICT, and as the tools themselves increase in their scope and capacities, the result is a reshaping of administrative work itself, leading to new forms of bureaucracy (Bovens & Zouridis, 2002; Danaher, 201…”
BackgroundSuperintelligence: paths, dangers, strategies
(2015) · Choice Reviews Online · doi:10.5860/choice.187536 · Cited by 1,979
Rahwan, I., Cebrian, M., Obradovich, N., Bongard, J., Bonnefon, J.-F., Breazeal, C., Crandall, J. W., Christakis, N. A., Couzin, I. D., Jackson, M. O., et al. (2019) · Nature · doi:10.1038/s41586-019-1138-y · Cited by 1,364
Building the Virtual State: Information Technology and Institutional Change
(2002) · Choice Reviews Online · doi:10.5860/choice.39-4209 · Cited by 1,303 · cited 2×
“The diffusion of information and communication technologies (ICTs) over the past several decades has profoundly changed administrative behavior in public organizations (Fountain, 2001).”
BackgroundDietvorst, B. J., Simmons, J. P., & Massey, C. (2018) · Management Science · doi:10.1287/mnsc.2016.2643 · Cited by 1,230
(2018) · Cited by 1,167
The accuracy, fairness, and limits of predicting recidivism
Dressel, J., & Farid, H. (2018) · Science Advances · doi:10.1126/sciadv.aao5580 · Cited by 1,071 · cited 1×
“Predictive policing is an umbrella term for the use of data analytics and operations management to first forecast future criminal activity, and then deploy police resources proactively to prevent occurrences, facilitate arrests (Meijer & Wessels, 2019) and predict recidivism (Dressel & Farid, 2018).”
Bovens, M., & Zouridis, S. (2002) · Public Administration Review · doi:10.1111/0033-3352.00168 · Cited by 964 · cited 3×
“…their use of ICT, and as the tools themselves increase in their scope and capacities, the result is a reshaping of administrative work itself, leading to new forms of bureaucracy (Bovens & Zouridis, 2002; Danaher, 2016; Dunleavy et al., 2006; Peeters & Schuilenburg, 2018; Peeters & Widlak, 2018).”
AI can be sexist and racist — it’s time to make it fair
Zou, J., & Schiebinger, L. (2018) · Nature · doi:10.1038/d41586-018-05707-8 · Cited by 765
Toward understanding the impact of artificial intelligence on labor
Frank, M. R., Autor, D., Bessen, J. E., Brynjolfsson, E., Cebrian, M., Deming, D. J., Feldman, M., Groh, M., Lobo, J., Moro, E., et al. (2019) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1900949116 · Cited by 713
Predictive Policing: The Role of Crime Forecasting in Law Enforcement Operations
Perry, W., McInnis, B., Price, C., Smith, S., & Hollywood, J. (2013) · doi:10.7249/rr233 · Cited by 693
“Big Data Surveillance: The Case of Policing
Brayne, S. (2017) · American Sociological Review · doi:10.1177/0003122417725865 · Cited by 596 · cited 2×
“Studies on the applied use of predictive policing have shown that it is recognized both by management and by street-level employees as a way for management to exert more control and have more certainty about how the street-level officers are spending their time (Brayne, 2017).”
The Rise of Evidence-Based Policing: Targeting, Testing, and Tracking
Sherman, L. W. (2013) · Crime and Justice · doi:10.1086/670819 · Cited by 571
A large-scale analysis of racial disparities in police stops across the United States
Pierson, E., Simoiu, C., Overgoor, J., Corbett-Davies, S., Jenson, D., Shoemaker, A., Ramachandran, V., Barghouty, P., Phillips, C., Shroff, R., et al. (2020) · Nature Human Behaviour · doi:10.1038/s41562-020-0858-1 · Cited by 552
Policy Implementation, Street-level Bureaucracy, and the Importance of Discretion
Tummers, L., & Bekkers, V. (2014) · Public Management Review · doi:10.1080/14719037.2013.841978 · Cited by 535
Digital government and public management research: finding the crossroads
Gil-Garcia, J. R., Dawes, S. S., & Pardo, T. A. (2018) · Public Management Review · doi:10.1080/14719037.2017.1327181 · Cited by 532 · cited 1×
“21st centuries, ICTs became increasingly central to organizational decision-making processes (Gil-Garcia et al., 2018).”
BackgroundThe threat of algocracy: reality, resistance and accommodation
Danaher, J. (2016) · Philosophy & Technology · doi:10.1007/s13347-015-0211-1 · Cited by 519 · cited 2×
“…their use of ICT, and as the tools themselves increase in their scope and capacities, the result is a reshaping of administrative work itself, leading to new forms of bureaucracy (Bovens & Zouridis, 2002; Danaher, 2016; Dunleavy et al., 2006; Peeters & Schuilenburg, 2018; Peeters & Widlak, 2018).”
Street-Level Bureaucracy and E-Government
Buffat, A. (2015) · Public Management Review · doi:10.1080/14719037.2013.771699 · Cited by 394 · cited 2×
“The predictive models analyze the historical data to detect fraud and improperly paid claims (Government Accountability Office, 2012, 2015, 2018c, 2018a, 2019).”
Predictive policing: Review of benefits and drawbacks
Meijer, A., & Wessels, M. (2019) · International Journal of Public Administration · doi:10.1080/01900692.2019.1575664 · Cited by 383
Artificial Intelligence and Its Implications for Income Distribution and Unemployment
Korinek, A., & Stiglitz, J. (2017) · doi:10.3386/w24174 · Cited by 380
McClure, P. K. (2018) · Social Science Computer Review · doi:10.1177/0894439317698637 · Cited by 367
Algorithmic prediction in policing: assumptions, evaluation, and accountability
Bennett Moses, L., & Chan, J. (2018) · Policing and Society · doi:10.1080/10439463.2016.1253695 · Cited by 358
Being smart: Emerging technologies and innovation in the public sector
Gil-Garcia, J. R., Helbig, N., & Ojo, A. (2014) · Government Information Quarterly · doi:10.1016/j.giq.2014.09.001 · Cited by 354
Artificial Intelligence, Discretion, and Bureaucracy
Bullock, J. B. (2019) · The American Review of Public Administration · doi:10.1177/0275074019856123 · Cited by 346
Self-citationA Public Service Gap: Capturing contexts in a comparative approach of street-level bureaucracy
Hupe, P., & Buffat, A. (2014) · Public Management Review · doi:10.1080/14719037.2013.854401 · Cited by 322 · cited 1×
“For example, technology does not just curtail discretion; it can enable it as well by affording new capabilities – whether intentional or not (Buffat, 2015; Hupe & Buffat, 2014; Thunman et al., 2020).”
Digital discretion: A systematic literature review of ICT and street-level discretion
Busch, P. A., & Henriksen, H. Z. (2018) · Information Polity · doi:10.3233/ip-170050 · Cited by 267 · cited 1×
“Macro-level tasks are institutional or enterprise level tasks that include the contextual factor of formulation of rules and general policies for the organization (Busch & Henriksen, 2018).”
The Rise of Big Data Policing: Surveillance, Race, and the Future of Law Enforcement
Ferguson, A. G. (2020) · doi:10.2307/j.ctt1pwtb27 · Cited by 266
Young, M. M., Bullock, J. B., & Lecy, J. D. (2019) · Perspectives on Public Management and Governance · doi:10.1093/ppmgov/gvz014 · Cited by 255
Self-citationThe Rise of Big Data Policing: Surveillance, Race, and the Future of Law Enforcement
(2017) · bepress Legal Repository · doi:10.18574/9781479854608 · Cited by 254
Ferguson, A. G. (2016) · Washington University law review · Cited by 244
Algorithmic justice: Algorithms and big data in criminal justice settings
Završnik, A. (2021) · European Journal of Criminology · doi:10.1177/1477370819876762 · Cited by 238 · cited 1×
“…national level (Fountain, 2001), local level (Busch & Eikebrokk, 2019; Tummers & Bekkers, 2014), and different policy domains including welfare (Hetling et al., 2012; Houston, 2015; Pors, 2015), criminal justice (Hannah-Moffat, 2019; Marks et al., 2015; van Eijk, 2017; Završnik, 2019), and others.”
Hannah-Moffat, K. (2019) · Theoretical Criminology · doi:10.1177/1362480618763582 · Cited by 236 · cited 1×
“…national level (Fountain, 2001), local level (Busch & Eikebrokk, 2019; Tummers & Bekkers, 2014), and different policy domains including welfare (Hetling et al., 2012; Houston, 2015; Pors, 2015), criminal justice (Hannah-Moffat, 2019; Marks et al., 2015; van Eijk, 2017; Završnik, 2019), and others.”
Saunders, J., Hunt, P., & Hollywood, J. S. (2016) · Journal of Experimental Criminology · doi:10.1007/s11292-016-9272-0 · Cited by 193 · cited 1×
“Known implementations of individual-based predictive policing include the City of Chicago’s Strategic Subject List and the use of Palantir’s security/military intelligence platform by the cities of New Orleans, New York, and Los Angeles (Ferguson, 2017; Saunders et al., 2016).”
Disparate Impact in Big Data Policing
Selbst, A. D. (2017) · SSRN Electronic Journal · doi:10.2139/ssrn.2819182 · Cited by 192 · cited 1×
“For example, information asymmetries and resulting moral hazard between street-level officers and their managers, and social and political harm when officers make mistakes or abuse their discretion to needlessly punish individuals and socioeconomic groups (Pierson et al., 2020; Selbst, 2017).”
Peeters, R., & Widlak, A. C. (2018) · Government Information Quarterly · doi:10.1016/j.giq.2018.02.003 · Cited by 171
Actuarial Sentencing: An “Unsettled” Proposition
Hannah-Moffat, K. (2013) · Justice Quarterly · doi:10.1080/07418825.2012.682603 · Cited by 165
To predict and to manage. Predictive policing in the United States
Benbouzid, B. (2019) · Big Data & Society · doi:10.1177/2053951719861703 · Cited by 165
Predictive Policing and Reasonable Suspicion
Ferguson, A. G. (2012) · eYLS (Yale Law School) · Cited by 134
Negotiated Risk: Actuarial Illusions and Discretion in Probation
Hannah-Moffat, K., Maurutto, P., & Turnbull, S. (2009) · Canadian journal of law and society · doi:10.1017/s0829320100010097 · Cited by 111
Frey, W. R., Patton, D. U., Gaskell, M. B., & McGregor, K. A. (2018) · Social Science Computer Review · doi:10.1177/0894439318788314 · Cited by 108
van Eijk, G. (2016) · Punishment & Society · doi:10.1177/1462474516666282 · Cited by 107
Becoming digital – passages to service in the digitized bureaucracy
Pors, A. S. (2015) · Journal of Organizational Ethnography · doi:10.1108/joe-08-2014-0031 · Cited by 82 · cited 1×
“…national level (Fountain, 2001), local level (Busch & Eikebrokk, 2019; Tummers & Bekkers, 2014), and different policy domains including welfare (Hetling et al., 2012; Houston, 2015; Pors, 2015), criminal justice (Hannah-Moffat, 2019; Marks et al., 2015; van Eijk, 2017; Završnik, 2019), and others.”
Machine justice: Governing security through the bureaucracy of algorithms
Peeters, R., & Schuilenburg, M. B. (2018) · Information Polity · doi:10.3233/ip-180074 · Cited by 75
Predictive Policing: The Future of Law Enforcement in the Trinidad and Tobago Police Service (TTPS)
Norton, A. (2013) · International Journal of Computer Applications · doi:10.5120/10070-4680 · Cited by 68
Digital Citizenship and Surveillance| To Pre-Empt A Thief
Andrejevic, M. (2017) · International journal of communication · Cited by 64
The New York City Police Department’s Domain Awareness System
Levine, E. S., Tisch, J., Tasso, A., & Joy, M. (2017) · INFORMS Journal on Applied Analytics · doi:10.1287/inte.2016.0860 · Cited by 46 · cited 1×
“The program is integrated into NYPD’s ‘Domain Awareness System’ (DAS), which is “a citywide network of sensors, databases, devices, software, and infrastructure” (Levine et al., 2017).”
van Eijk, G. (2020) · The British Journal of Criminology · doi:10.1093/bjc/azaa012 · Cited by 44
Thunman, E., Ekström, M., & Bruhn, A. (2020) · Administration & Society · doi:10.1177/0095399720907807 · Cited by 32
A Recommendation Engine to Aid in Identifying Crime Patterns
Chohlas-Wood, A., & Levine, E. S. (2019) · INFORMS Journal on Applied Analytics · doi:10.1287/inte.2019.0985 · Cited by 26
“We Live in a Technological Era, Whether You Like It or Not”
Hetling, A., Watson, S., & Horgan, M. (2012) · Administration & Society · doi:10.1177/0095399712465596 · Cited by 24 · cited 1×
“Scholarship on how ICT implementation affects discretion in public organizations is multifaceted, with theoretical and empirical work alternatively focusing on the national level (Fountain, 2001), local level (Busch & Eikebrokk, 2019; Tummers & Bekkers, 2014), and different policy domains including welfare (Hetling et…”
BackgroundA Survey of Medicare Data Processing and Integration for Fraud Detection
Bauder, R. A., & Khoshgoftaar, T. M. (2018) · IEEE International Conference on Information Reuse and Integration (IRI) · doi:10.1109/iri.2018.00010 · Cited by 23 · cited 1×
“This is another strength of AI, which can be used to quickly integrate heterogeneous data into a single relational database or other structure (Bauder & Khoshgoftaar, 2018; Bostrom, 2014; Dora & Sekharan, 2015).”
Busch, P. A., & Eikebrokk, T. R. (2019) · Hawaii International Conference on System Sciences (HICSS) · doi:10.24251/hicss.2019.379 · Cited by 23
Reducing Child Protection Error in Social Work: Towards a Holistic-Rational Perspective
Houston, S. (2015) · Journal of Social Work Practice · doi:10.1080/02650533.2015.1013526 · Cited by 22 · cited 1×
“…national level (Fountain, 2001), local level (Busch & Eikebrokk, 2019; Tummers & Bekkers, 2014), and different policy domains including welfare (Hetling et al., 2012; Houston, 2015; Pors, 2015), criminal justice (Hannah-Moffat, 2019; Marks et al., 2015; van Eijk, 2017; Završnik, 2019), and others.”
Andrejevic, M. (2017) · Monash University Research Portal (Monash University) · Cited by 20
Human Judgement in Algorithmic Loops; Individual Justice and Automated Decision-MakingPreprint
Binns, R. (2019) · SSRN Electronic Journal · doi:10.31228/osf.io/kz4s2 · Cited by 19
Automatic Justice? Technology, Crime and Social ControlPreprint
Marks, A., Bowling, B., & Keenan, C. (2015) · SSRN Electronic Journal · Cited by 16
Decreasing Improper Payments in a Complex Federal Program
Greer, R., & Bullock, J. B. (2017) · Public Administration Review · doi:10.1111/puar.12809 · Cited by 13
Self-citation
Research works printed but not linked: 2
- Dora, 2015, Healthcare insurance fraud detection leveraging big data analytics, International Journal of Science and Research, 4, 2073
- Simon, H. A. (1997). Administrative Behavior (4th ed.). Simon & Schuster.
Cited by
Madan, R., & Ashok, M. (2023) · Government Information Quarterly · doi:10.1016/j.giq.2022.101774 · Cited by 468
“The accompanying negative aspect is distancing public servants from citizens and inhibiting a rich knowledge generation avenue (Bullock, Young, & Wang, 2020; Young et al., 2019).”
InfluentialExploring artificial intelligence adoption in public organizations: a comparative case study
Neumann, O., Guirguis, K., & Steiner, R. (2024) · Public Management Review · doi:10.1080/14719037.2022.2048685 · Cited by 451
“Some notable exceptions have studied the role of AI in administrative discretion and transparency (Ahonen and Erkkilä 2020; Bovens and Zouridis 2002; Justin, Young, and Wang 2020; Criado, Valero, and Villodre 2020; de Boer and Raaphorst 2021; Peeters, Giest, and Grimmelikhuijsen 2020),…”
Backgroundvan Noordt, C., & Misuraca, G. (2022) · Government Information Quarterly · doi:10.1016/j.giq.2022.101714 · Cited by 356
Grimmelikhuijsen, S. (2023) · Public Administration Review · doi:10.1111/puar.13483 · Cited by 259
OECD (2025) · OECD eBooks · doi:10.1787/795de142-en · Cited by 323
Metadata
- Authors
- Bullock, J., Young, M. M., & Wang, Y.-F.
- Affiliations
- Texas A&M University (US)
- Syracuse University (US)
- School of Public Administration, University of Nebraska-Omaha, Omaha, NE, USA
- Corresponding author
- Bullock, Justin
- Venue
- Information Polity
- Publisher
- SAGE Publications
- Published
- 2020-12-04
- Volume
- 25
- Issue
- 4
- Pages
- 491-506
- ISSN
- 1570-1255 (ISSN-L)
- 1875-8754
- OpenAlex
- W3093679084
- Cited by
- 139
- References
- 62
- Citations by year
- 2026: 31 · 2025: 28 · 2024: 31 · 2023: 17 · 2022: 20 · 2021: 12
- FWCI
- 22.06
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Information Polity (publishedVersion)
- Topics
- Social Sciences › Public Administration › Public Policy and Administration Research
- Social Sciences › Political Science and International Relations › E-Government and Public Services
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Keywords
- artificial intelligence, administrative discretion, public sector organizations, street-level bureaucracy, information and communication technologies, policing, administrative behavior, organizational change
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.