Inside algorithmic bureaucracy: Disentangling automated decision-making and good administration
Open accessThe DOI matches its Crossref record, with a small difference in title or year; 50 of the 52 references it cites were found in a registry or an index; 2 of the 11 sources its claims cite were checked for support.
Abstract
Public administrative bodies around the world are increasingly applying automated, administrative decision-making as underlying technologies such as machine learning mature. Such decision-making is a central element of emerging forms of algorithmic bureaucracies. With its direct exercise of public authority over individual citizens and firms, automated, administrative decision-making makes it particularly important to consider relations to values of good administration. Based on a multiple case-study, the article focuses on how empirical use of automated decision-making influences and transforms issues of good administration in four policy areas in Denmark: Business and social policy; labour market policy; agricultural policy; and tax policy. Supplementing emerging literature, the article exemplifies how public authorities struggle to apply automated decision-making in ways that support rather than undermine good administration. We identify six empirical relations of usage of automated, administrative decision-making and good administration: (I) Giving accurate and comprehensible reasons; (II) Informing addressees’ expectations; (III) Combining material and algorithmic expertise; (IV) Achieving effective oversight; (V) Continuously ensuring quality; and (VI) Managing high complexity. Additionally, we pinpoint related key capabilities for administrative bodies in order to support good administration.
Overview
CoChat Summary
TL;DR
This multiple case-study examines how automated, administrative decision-making (AADM) relates to good administration in four Danish policy areas. It identifies six empirical relations and six corresponding capabilities, showing AADM can both support and undermine good administration.
Key findings
- The paper identifies six empirical relations between AADM usage and good administration: giving accurate and comprehensible reasons; informing addressees’ expectations; combining material and algorithmic expertise; achieving effective oversight; continuously ensuring quality; and managing high complexity.
- Across the four cases, AADM usage had both supportive and undermining effects; all but one relation was observed in all cases, though context shaped whether effects were supportive or undermining.
- In cases 1, 3, and 4, 70–80% of administrative decisions were fully automated; case 2 used semi-automated decision-making where the system suggests procedural steps.
- The paper distils six key capabilities for administrative bodies, including transforming complex algorithms and high-volume data into comprehensible reasons, combining material and algorithmic expertise, ensuring continuous quality assurance, and managing “petite decisions” across wider algorithmic systems.
Methods
- Multiple case-study of four Danish policy areas: illness benefits, work retention, agricultural subsidies, and property value assessment, selected via purposive sampling for variation in professional and political complexity.
- Data collected October 2019–December 2020 through 60 interviews, 159 documents, and 13 observations across the cases.
- Thematic analysis using Boyatzis’ hybrid approach in NVivo, with within-case and cross-case analysis, producing 86 first-order topics, 18 second-order themes, and 6 aggregate dimensions.
Limitations
- The paper states it maintains an “inside-out” focus on administrative bodies and does not know whether the identified relations appear in data from citizens and firms subject to AADM.
- The paper states findings are context-specific and calls for future research on transfer to other policy areas and administrative traditions; it also notes no deterministic relations were found.
- Evident from the text: the study covers only Denmark and four cases, two decision-systems were under implementation, one relation in case 4 was not observed due to implementation stage, and access was not gained to a handful of potentially interesting documents.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
2 Valid · 7 Not valid · 9 Not checked · 105 Own results and interpretations
Every source the paper cites for this claim was checked and supports it.
In the paper
“AADM is a key element of emerging forms of 'algorithmic bureaucracy' (Vogl et al., 2020) where extensive use of technology heavily influences work practices, bureaucratic procedures, responsibilities of public servants, management practices, and organisational structures of public administrative bodies.”
What the sources say
- Supportedcites Vogl et al., 2020 matched to “Smart Technology and the Emergence of Algorithmic Bureaucracy: Artificial Intelligence in UK Local Authorities” (2020) source
The Discussion ('Findings suggest...' / closing of Discussion) defines algorithmic bureaucracy as an emergent form: 'These phenomena suggest a shift from traditional bureaucracy to algorithmic bureaucracy in local authorities' and 'The concept of algorithmic bureaucracy provides a framework to understand how computational algorithms are affecting all offices in the public sector, from the street to the system level,' accounting for automated processes made possible by algorithms, the roles/hierarchy/files of traditional bureaucracy, and their interaction. The Abstract adds that smart technologies 'add a new element to the socio-technical organization of public administration' and that algorithms 'may also change the nature of public administration,' matching the claim's list of affected work practices, procedures, responsibilities and structures; the paper's own caveat is that adoption is 'at an early, but foundational, stage' (nascent), so 'extensive use' is a slight strengthening rather than a mismatch. No passage contradicts the attribution. (LLM, conf=0.82)
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“Particularly the former appears to be rooted in a somehow naïve belief in the quality of public servants' operation of decision-systems not taking into consideration behavioural issues such as automation bias (Cummings, 2006), inappropriate training or high work pressure.”
What the sources say
- Supportedcites Cummings, 2006 matched to “Automation and Accountability in Decision Support System Interface Design” (2006) source
The citation is attached specifically to “automation bias,” not to the citing authors’ explanation about public servants or assessment schemes. In the passage preceding “Automation and Accountability,” Cummings describes people following incorrect automated recommendations despite opportunities to verify them and identifies automation bias as an important design consideration. (LLM, conf=0.90)
hedgedstates a possible causen = 4- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“On a digital map, fields are thus marked green, yellow, and red indicating whether the field is registered as complying with the basis of a given subsidy or not.”
plainSingle case- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The formal memoranda to farmers providing the reason for decisions on agricultural subsidies in case 3 thus often consists of 1015 pages of detailed text and maps making the reason de facto incomprehensible for the average addressee.”
plainstates a causeSingle case- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“If they do, it tends to be in an underdeveloped way, where initiatives are not systematically connected to a holistic approach to transparent decision processes.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
74 more claims
Create a free account to see all 123 claims and every source verdict.
- The quote only partly states this claim. 1
- It may state two separate claims as one. 27
- Probably not a substantial claim. 20
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ 5. Managing relations of automated decision-making and good administration · p. 23
“Each relation manifests itself empirically in ways that both support and undermine good administration.”
§ 5. Managing relations of automated decision-making and good administration · p. 25
“[Example of undermining relation have not been observed.]”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ 3.3 Data collection · p. 12
“Empirical data was collected in relation to each case in the form of interviews, documents, and observations in the period of October 2019 - December 2020 as described in Table 2:”
§ Supplemental Material: Appendix A (Overview of interviews) · p. 35
“August 28, 2019 December 20, 2019”
Citations
Cites
Qualitative Data Analysis: An Expanded Sourcebook
(1994) · Journal of Environmental Psychology · doi:10.1016/s0272-4944(05)80231-2 · Cited by 48,420
Qualitative research and evaluation methods
Patton, M. Q. (1980) · Cited by 35,733
(1998) · Cited by 13,501
A PUBLIC MANAGEMENT FOR ALL SEASONS
HOOD, C. (1991) · Public Administration · doi:10.1111/j.1467-9299.1991.tb00779.x · Cited by 10,159
The ethics of algorithms: Mapping the debate
Mittelstadt, B. D., Allo, P., Taddeo, M., Wachter, S., & Floridi, L. (2016) · Big Data & Society · doi:10.1177/2053951716679679 · Cited by 4,567 · cited 1×
“Administrative bodies ’ usage of AADM is strongly related to ongoing ethical and social debates on advanced technologies (e.g., Mittelstadt et al., 2016) including issues of data bias, threats to equity and lack of accountability.”
Automating Inequality: How High-Tech Tools Profile, Police, and Punish the Poor
Lebovits, H. (2019) · Public Integrity · doi:10.1080/10999922.2018.1511671 · Cited by 3,279
Creating public value: strategic management in government
(1996) · Choice Reviews Online · doi:10.5860/choice.33-4147 · Cited by 2,552
Analyzing Qualitative Data: Systematic Approaches
Bernard, H. R., & Ryan, G. W. (2009) · Cited by 2,373
Jørgensen, T. B., & Bozeman, B. (2007) · Administration & Society · doi:10.1177/0095399707300703 · Cited by 1,082
Two Concepts of Accountability: Accountability as a Virtue and as a Mechanism
Bovens, M. (2010) · West European Politics · doi:10.1080/01402382.2010.486119 · Cited by 1,018
Bovens, M., & Zouridis, S. (2002) · Public Administration Review · doi:10.1111/0033-3352.00168 · Cited by 964
Technicians in the Workplace: Ethnographic Evidence for Bringing Work into Organizational Studies
Barley, S. R. (1996) · Administrative Science Quarterly · doi:10.2307/2393937 · Cited by 755
Street-Level Bureaucracy and E-Government
Buffat, A. (2015) · Public Management Review · doi:10.1080/14719037.2013.771699 · Cited by 394 · cited 1×
“…and increased consistency of decisions (e.g., Jansson and Erlingsson, 2014), authors also point to negative effects such as data bias and lack of transparency (e.g., Eubanks, 2018), accountability dysfunctions (e.g., Smith et al., 2010) and excessive curtailment of discretion (e.g., Buffat, 2015).”
Algorithms in practice: Comparing web journalism and criminal justice
Christin, A. (2017) · Big Data & Society · doi:10.1177/2053951717718855 · Cited by 379 · cited 1×
“To some extent, case 3 thus illustrates how AADM shares traits with the tendency of data fi cation in other sectors (e.g., Christin, 2017).”
Strategies, Structures, and Processes of Organizational Decision
Thompson, J. D., & Tuden, A. (1959) · Comparative Studies in Administration · doi:10.2307/jj.6338492.16 · Cited by 312
Improving public services using artificial intelligence: possibilities, pitfalls, governance
Henman, P. (2020) · Asia Pacific Journal of Public Administration · doi:10.1080/23276665.2020.1816188 · Cited by 310 · cited 2×
“Use of automated , administrative decision-making (henceforth AADM) is on the rise in public administration around the world fuelled by arti fi cial intelligence (AI) and other types of advanced technology (Henman, 2020).”
Dynamic Capabilities in Public Organizations: A literature review and research agenda
Piening, E. P. (2013) · Public Management Review · doi:10.1080/14719037.2012.708358 · Cited by 270 · cited 1×
“Simple said, a capability is an organisation ’ s capacity to deploy resources to achieve a desired outcome (Piening, 2013).”
Beyond design and use: How scholars should study intelligent technologies
Bailey, D. E., & Barley, S. R. (2020) · Information and Organization · doi:10.1016/j.infoandorg.2019.100286 · Cited by 210
Vogl, T. M., Seidelin, C., Ganesh, B., & Bright, J. (2020) · Public Administration Review · doi:10.1111/puar.13286 · Cited by 209
Cobbe, J. (2019) · Legal Studies · doi:10.1017/lst.2019.9 · Cited by 174 · cited 4×
“Due to the reliance on patterns (correlations) in data rather than a priori programmed cause-effect relations it becomes dif fi cult to provide a fi rm, factual reason for the decision (e.g., Cobbe, 2019).”
InfluentialPeeters, R., & Widlak, A. C. (2018) · Government Information Quarterly · doi:10.1016/j.giq.2018.02.003 · Cited by 171
Cobbe, J. (2018) · SSRN Electronic Journal · doi:10.2139/ssrn.3226913 · Cited by 165
Evaluating the performance of e-government in developing countries: A public value perspective
Deng, H., Karunasena, K., & Xu, W. X. (2017) · Internet Research · doi:10.1108/intr-10-2016-0296 · Cited by 159
Assessing public value failure in government adoption of artificial intelligence
Schiff, D. S., Schiff, K. J., & Pierson, P. (2022) · Public Administration · doi:10.1111/padm.12742 · Cited by 155
Automation and Accountability in Decision Support System Interface Design
Cummings, M. L. (2006) · Journal of Technology Studies · doi:10.21061/jots.v32i1.a.4 · Cited by 155 · cited 1×
“Particularly the former appears to be rooted in a somehow na¨ ı ve belief in the quality of public servants ’ operation of decision-systems not taking into consideration behavioural issues such as automation bias (Cummings, 2006), inappropriate training or high work pressure.”
(1982) · Cited by 132
The Welfare State, Citizenship, and Bureaucratic Encounters
Hasenfeld, Y., Rafferty, J. A., & Zald, M. N. (1987) · Annual Review of Sociology · doi:10.1146/annurev.so.13.080187.002131 · Cited by 122
THE ‘IRON CAGE’ STRENGTHENED? DISCRETION AND DIGITAL DISCIPLINE
JORNA, F., & WAGENAAR, P. (2007) · Public Administration · doi:10.1111/j.1467-9299.2007.00640.x · Cited by 107 · cited 3×
“” In their study of automated administration of housing subsidies in The Netherlands, Jorna and Wagenaar (2007: 211) speak of informal “ signalling systems ” of bureaucracies being weakened as public servants do not share the world of addressees and can therefore not provide early warnings of possible low-quality data…”
InfluentialGood Governance: Concept and Context
Addink, H. (2019) · doi:10.1093/oso/9780198841159.001.0001 · Cited by 105
Lips, M. (2019) · Routledge eBooks · doi:10.4324/9781315622408 · Cited by 95
Nations, U. (2020) · United Nations E-Government Survey · doi:10.18356/8bdf045f-en · Cited by 88
Peeters, R. (2020) · Information Polity · doi:10.3233/ip-200253 · Cited by 78 · cited 1×
“Usage ranges on a continuum from semi to fully automated (Peeters, 2020) starting with simple assistance of the decision-system to public servants in the form of presentation of data or suggested procedural steps via suggested decisions to fully automated or even autonomous decisions (the latter…”
Liu, C., & Graham, R. (2021) · Big Data & Society · doi:10.1177/2053951721995218 · Cited by 68
Jansson, G., & Erlingsson, G. Ó. (2014) · Journal of Information Technology & Politics · doi:10.1080/19331681.2014.908155 · Cited by 66 · cited 2×
“Often hailed in terms of ef fi ciency and increased consistency of decisions (e.g., Jansson and Erlingsson, 2014), authors also point to negative effects such as data bias and lack of transparency (e.g., Eubanks, 2018), accountability dysfunctions (e.g., Smith et al., 2010) and excessive curtailment…”
Towards principles of good digital administration
Widlak, A. C., van Eck, M., & Peeters, R. (2020) · Routledge eBooks · doi:10.4324/9780429261404-6 · Cited by 66
Getting Specific about Qualitative Research Generalizability.
Chenail, R. J. (2010) · NSUWorks (Nova Southeastern University) · Cited by 65
Mainstreaming Technological Change in the Study of Public Management
Pollitt, C. (2011) · Public Policy and Administration · doi:10.1177/0952076710378548 · Cited by 56
Good Administration and Administrative Procedures
Ponce (2005) · Indiana Journal of Global Legal Studies · doi:10.2979/gls.2005.12.2.551 · Cited by 56
Automating the Public Sector and Organizing Accountabilities
Smith, M. L., Noorman, M. E., & Martin, A. K. (2010) · Communications of the Association for Information Systems · doi:10.17705/1cais.02601 · Cited by 51
Mashaw, J. L. (2007) · bepress Legal Repository · Cited by 44
Digital Government: Managing Public Sector Reform in the Digital Era
Lips, M. (2019) · Cited by 28
Roehl, U. B. U. (2022) · Progress in IS · doi:10.1007/978-3-030-92644-1_3 · Cited by 26
Trust in Scandinavia: Findings from Moving Borders between Denmark and Germany
Andersen, R. F. (2017) · Scandinavian Political Studies · doi:10.1111/1467-9477.12107 · Cited by 25
Margetts, H. Z. (1995) · Public Policy and Administration · doi:10.1177/095207679501000207 · Cited by 15
Schartum, D. W. (2020) · The Cambridge Handbook of the Law of Algorithms · doi:10.1017/9781108680844.016 · Cited by 13
Developing administrative law into handling the challenges of Digital Government in Denmark
Motzfeldt, H. M., & Næsborg-Andersen, A. (2018) · Cited by 9
Algorithmic Governance and Administrative Law
Appel, S. M., & Coglianese, C. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108680844.009 · Cited by 8
A short guide to ontology and epistemology: Why everyone should be a critical realist
Fryer, T. B. (2020) · Research Explorer (The University of Manchester) · Cited by 8
Remáč, M., & Langbroek, P. M. (2011) · NISPAcee Journal of Public Administration and Policy · doi:10.2478/v10110-011-0005-5 · Cited by 7
Schiff, D. S., Schiff, K. J., & Pierson, P. (2021) · Harvard Dataverse · doi:10.7910/dvn/ligara
The Welfare State, Citizenship, And Bureaucratic Encounters
Hasenfeld, Y. (1987) · Annual Review of Sociology · doi:10.1146/annurev.soc.13.1.387
Fieldwork Techniques for Our Times: Shadowing
Czarniawska, B. (2017) · Qualitative Methodologies in Organization Studies · doi:10.1007/978-3-319-65442-3_3
Research works printed but not linked: 8
- Cane P (2011) Ombudsmen. In: Administrative Law . 5th ed. Oxford, pp. 370-393.
- Danish National Audit Office (2013) Report on the Public Property Assessment (summary) . Copenhagen.
- European Commission (2021) eGovernment Benchmark 2021 - Insight Report. Brussels.
- Faculty of Social Sciences, Aalborg University (2020) Guidelines for promoting responsible research practice . Aalborg. Available at: https://www.handbook.aau.dk/documen t?contentId=459534.
- Margetts H (2021) The digital tools of government. Policy & Internet 13: 163–166.
- Misuraca, G (2020) Rethinking Democracy in the 'Pandemic Society'. Proceedings of the 1st International Forum on Digital and Democracy (IFDaD2020): 1-13
- Yin RK (2009) Case Study Research . 4th ed. Thousand Oaks, CA: Sage Publications.
- Young MM, Bullock JB and Lecy JD (2019) Artificial Discretion as a Tool of Governance. Perspectives on Public Management and Governance 2(4): 301-313.
Cited by
Chandra, Y., & Feng, N. (2025) · Public Management Review · doi:10.1080/14719037.2025.2450680 · Cited by 87
Research on digital discretion—The subjectification of street‐level work in public administration
Johansson, J. (2025) · Review of Policy Research · doi:10.1111/ropr.12637 · Cited by 26
Automating street‐level discretion: A systematic literature review and research agenda
Northcott, E. (2025) · Policy Studies Journal · doi:10.1111/psj.70024 · Cited by 18
Wang, Y. (2025) · Organization Management Journal · doi:10.1108/omj-11-2024-2342 · Cited by 36
KAMU YÖNETİMİNDE ALGORİTMALARIN EGEMENLİĞİ: ALGOKRASİ VE TEHDİTLERİ
Polat, M. (2024) · Kamu Yönetimi ve Teknoloji Dergisi · doi:10.58307/kaytek.1495010 · Cited by 16
Metadata
- Authors
- Roehl, U., & Crompvoets, J.
- Affiliations
- Department of Digitalization, Copenhagen Business School, Frederiksberg, Denmark
- KU Leuven (BE)
- Venue
- Public Policy and Administration
- Publisher
- SAGE Publications
- Published
- 2023-08-31
- Volume
- 40
- Issue
- 2
- Pages
- 322-350
- ISSN
- 0952-0767 (ISSN-L)
- 1749-4192
- OpenAlex
- W4386307797
- Semantic Scholar
- e0bafae94521c646693be16809b292f53fe2c92a
- Cited by
- 21
- References
- 45
- Citations by year
- 2026: 12 · 2025: 5 · 2024: 4
- FWCI
- 20.62
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Licence
- journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
- Locations
- Public Policy and Administration (publishedVersion)
- CBS Research Portal (Copenhagen Business School) (acceptedVersion, other-oa)
- Lirias (submittedVersion, other-oa)
- Topics
- Social Sciences › Political Science and International Relations › E-Government and Public Services
- Social Sciences › Public Administration › Public Policy and Administration Research
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Keywords
- good administration, administrative transparency, explainability, public oversight, administrative expertise, quality assurance, labour market policy, tax policy, agricultural policy, social policy, Denmark
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (qwen3.8-omni-flash and gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
