The DOI matches its Crossref record; 85 of the 85 references it cites were found in a registry or an index; 14 of the 66 sources its claims cite were checked for support.
Legitimacy of Algorithmic Decision-Making: Six Threats and the Need for a Calibrated Institutional Response
Open accessAbstract
The article identifies threats to input, throughput, and output legitimacy and institutional responses.
Overview
CoChat Summary
TL;DR
This conceptual article uses input, throughput, and output legitimacy to synthesize how algorithmic decision-making threatens government legitimacy and what institutional responses may mitigate those threats. It argues there is no silver bullet: a calibrated multiplicity of legal, participatory, transparency, audit, and accountability mechanisms is required.
Key findings
- Algorithmic government is characterized by complexity, opacity, and interdependence, which transform government decision-making and generate legitimacy threats across input, throughput, and output routes.
- The article identifies six threats: erosion of democratic control and limited responsiveness (input); procedural unfairness and insufficient checks and balances (throughput); ineffectiveness/inefficiency and undesirable outcomes such as bias or reduced human contact (output).
- It proposes strategies including strengthening democratic control, civic participation, explainable AI, Data Protection Impact Assessments, legal/human rights assessments, transparency, clarified responsibilities, cost-benefit analyses, periodic audits, bias mitigation, and rights to human contact.
- It concludes that institutional design must be calibrated to risk, with lighter arrangements for minor impacts and heavier arrangements for life-altering decisions such as sentencing.
Methods
- Design: conceptual/theoretical article that reviews and synthesizes public administration and related literature on algorithmic decision-making, legitimacy, and institutional design.
- Data/sample: no empirical sample or original quantitative data; the analysis draws on prior literature and illustrative examples such as predictive policing, welfare fraud detection, and the Dutch CoronaMelder app.
- Main analysis: applies Suchman’s legitimacy definition and Scharpf/Schmidt’s input-throughput-output framework to identify threats, then matches each threat with institutional strategies and a calibrated institutional-design framework.
Limitations
- The paper states that its framework is a point of departure for empirical research and calls for in-depth empirical work using a “life cycle approach” to examine how threats and strategies interact.
- It also states that empirical research is needed to assess whether institutional mechanisms contribute to appropriate and accountable collaborative governance.
- Evident from the text: the article is conceptual and does not test its proposed threats or strategies empirically; examples are illustrative rather than systematically sampled, and no quantitative outcomes are reported.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
13 Valid · 8 Not valid · 49 Not checked · 40 Own results and interpretations
Every source the paper cites for this claim was checked and supports it.
In the paper
“Machine-learning techniques are increasingly used to support or automate decision-making processes in government (Margetts and Dorobantu 2019;Vogl et al. 2020).”
§ Legitimacy of Algorithmic Decision-Making: Six Threats and the Need for a Calibrated Institutional Response > Introduction
What the sources say
- Supportedcites Margetts and Dorobantu 2019 sourceExperimental — accuracy not yet measured
The cited paper has no available full-text snippets in either paper-scoped search, so its wording cannot be checked directly. However, a Semantic Scholar snippet from “Exploring artificial intelligence adoption in public organizations: a comparative case study” explicitly cites Margetts and Dorobantu (2019) for better government decision-making, personalized public services, and reduced administrative burdens (score 0.609). That secondary citation supports the substance of this broad paraphrase. The match in “Benefits and Challenges of Machine Learning in Public Administration” (score 0.711) describes a similar general idea, not a distinctive claim that establishes misattribution. (LLM, conf=0.76)
- Supportedcites Vogl et al. 2020 source
The 'Predictive Analytics and Learning in Complex Systems' section states that 'currently there is growth in the use of machine learning techniques to produce predictions or risk scores' applied by local authorities to decisions in HMO enforcement and children's social care, and that smart technologies 'are also helping with decision-making'. The Discussion (and Abstract) generalize this to public administration: 'Public administration in local authorities is experiencing automation and the adoption of predictive tools', which 'support decisionmaking', alongside automation of routine tasks and the expectation that algorithms 'automate many public service functions'. The disjunction 'support or automate' is satisfied by the support claim; the paper's empirical base is UK local authorities rather than all government, but as a broad background statement our copy clearly treats the topic this way. (LLM, conf=0.85)
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“scarce empirical research into this topic has already indicated that algorithmic decision-making systems are perceived as less legitimate than systems in which humans are involved (Starke and Lünich 2020).”
§ Legitimacy of Algorithmic Decision-Making: Six Threats and the Need for a Calibrated Institutional Response > Introduction
What the sources say
- Supportedcites Starke and Lünich 2020 source
The Abstract (p. 1) reports that respondents tended to perceive systems with ADM as the sole decision-maker as illegitimate. The discussion (p. 13) says respondents viewed outcomes more favorably when humans made or shared decisions, and considered ADM legitimate when humans remained in the loop. These findings support the citing sentence’s characterization of what the study indicated, in the context of EU political decision-making. (LLM, conf=0.90)
hedgedstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“On top of that, the combinations of different datasets may reveal new insights into individuals (Mergel, Rethemeyer, and Isett 2016).”
§ Legitimacy of Algorithmic Decision-Making: Six Threats and the Need for a Calibrated Institutional Response > Throughput Legitimacy: Threats and Strategies for Procedural Fairness
What the sources say
- Supportedcites Mergel, Rethemeyer, and Isett 2016 source
The section “When 1 + 1 = I Know You” says that matching data from multiple public and private sources can produce more comprehensive pictures of individuals. It also describes how combined data can reveal identifying information and inferred behaviors. (LLM, conf=0.94)
hedgedstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“The risk of automation bias occurs in this process: a human being relies too heavily on the algorithm, even in the face of erroneous predictions (Goddard et al. 2011).”
§ Legitimacy of Algorithmic Decision-Making: Six Threats and the Need for a Calibrated Institutional Response > Output Legitimacy: Threats and Strategies for Public Value Creation
What the sources say
- Supportedcites Goddard et al. 2011 source
The BACKGROUND passage (page not provided) defines automation bias as over-accepting computer output and says incorrect advice can lead users to reverse a correct decision. The “Automation bias and complacency” section also describes clinicians favoring erroneous decision-support advice over their own correct decisions. (LLM, conf=0.94)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“potentially produces outcomes that misalign with public values (threatening output legitimacy)”
§ Legitimacy of Algorithmic Decision-Making: Six Threats and the Need for a Calibrated Institutional Response > Introduction
hedgedstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: unclear — It is unclear why the paper says it holds.
45 more claims
Create a free account to see all 110 claims and to verify the 2 references still open.
- Probably not a substantial claim. 43
- It may state two separate claims as one. 26
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Second, emerging research shows that citizens' perceptions strongly influence the political feasibility of adopting algorithmic systems (Grimmelikhuijsen and Meijer 2022;König et al. 2024).”
From Holding AI Accountable Like Herding Cats: The Contingent Impact on the Legitimacy of Algorithmic Bureaucracy (2026) · cites this paper as Grimmelikhuijsen and Meijer 2022
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Legitimacy of Algorithmic Decision-Making: Six Threats and the Need for a Calibrated Institutional Response > Output Legitimacy: Threats and Strategies for Public Value Creation
“Table 4. Summary of Threats and Strategies Concerning Throughput Legitimacy of Algorithmic Government”
§ Legitimacy of Algorithmic Decision-Making: Six Threats and the Need for a Calibrated Institutional Response > Output Legitimacy: Threats and Strategies for Public Value Creation
“Threats to Output Legitimacy Strategies to Strengthen Output Legitimacy”
Citations
Cites
Governing the Commons: The Evolution of Institutions for Collective Action
Ostrom, E. (1990) · doi:10.1017/cbo9780511807763 · Cited by 20,653
Managing Legitimacy: Strategic and Institutional Approaches
Suchman, M. C. (1995) · The Academy of Management Review · doi:10.2307/258788 · Cited by 19,903
Mastering the game of Go with deep neural networks and tree search
Silver, D., Huang, A., Maddison, C. J., Guez, A., Sifre, L., van den Driessche, G., Schrittwieser, J., Antonoglou, I., Panneershelvam, V., Lanctot, M., et al. (2016) · Nature · doi:10.1038/nature16961 · Cited by 15,612
A Survey on Bias and Fairness in Machine Learning
Mehrabi, N., Morstatter, F., Saxena, N., Lerman, K., & Galstyan, A. (2022) · ACM Computing Surveys · doi:10.1145/3457607 · Cited by 5,812
Explanation in artificial intelligence: Insights from the social sciences
Miller, T. (2019) · Artificial Intelligence · doi:10.1016/j.artint.2018.07.007 · Cited by 5,302
Tyler, T. R. (2006) · doi:10.1515/9781400828609 · Cited by 5,156
The ethics of algorithms: Mapping the debate
Mittelstadt, B. D., Allo, P., Taddeo, M., Wachter, S., & Floridi, L. (2016) · Big Data & Society · doi:10.1177/2053951716679679 · Cited by 4,567
Organizational Strategy, Structure, and Process
Miles, R. E., Snow, C. C., Meyer, A. D., & Coleman, H. J. (1978) · Academy of Management Review · doi:10.5465/amr.1978.4305755 · Cited by 4,527
Some Studies in Machine Learning Using the Game of Checkers
Samuel, A. L. (1959) · IBM Journal of Research and Development · doi:10.1147/rd.33.0210 · Cited by 4,443
An Integrative Framework for Collaborative Governance
Emerson, K., Nabatchi, T., & Balogh, S. (2012) · Journal of Public Administration Research and Theory · doi:10.1093/jopart/mur011 · Cited by 3,637
Research works printed but not linked: 4
- Bayamlioglu, 2021, The right to contest automated decisions under the General Data Protection Regulation: Beyond the so called “right to explanation, Regulation and Governance, 1
- Kahneman, 2020, Noise. Flaws in Human Judgement
- Pressman, 1984, Implementation: How great expectations in Washington are dashed in Oakland; Or, why it’s amazing that federal programs work at all, this being a saga of the Economic Development Administration as told by two sympathetic observers who seek to build morals on a foundation
- West, 2005, Digital Government: Technology and Public Sector Performance
Cited by
Implementing AI in the public sector
Mergel, I., Dickinson, H., Stenvall, J., & Gasco, M. (2023) · Public Management Review · doi:10.1080/14719037.2023.2231950 · Cited by 162
Selten, F., Robeer, M., & Grimmelikhuijsen, S. (2023) · Public Administration Review · doi:10.1111/puar.13602 · Cited by 153
Self-citationOrganizing public sector AI adoption: Navigating between separation and integration
Selten, F., & Klievink, B. (2024) · Government Information Quarterly · doi:10.1016/j.giq.2023.101885 · Cited by 147
Maragno, G., Tangi, L., Gastaldi, L., & Benedetti, M. (2023) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2023.102686 · Cited by 224
Moon, M. J. (2023) · Public Administration Review · doi:10.1111/puar.13648 · Cited by 99
Metadata
- Authors
- Grimmelikhuijsen, S., & Meijer, A.
- Affiliations
- Utrecht University (NL)
- Corresponding author
- Grimmelikhuijsen, Stephan
- Venue
- Perspectives on Public Management and Governance
- Publisher
- Oxford University Press (OUP)
- Published
- 2022-03-28
- Volume
- 5
- Issue
- 3
- Pages
- 232-242
- ISSN
- 2398-4910 (ISSN-L)
- 2398-4929
- OpenAlex
- W4210506854
- Cited by
- 189
- References
- 83
- Citations by year
- 2026: 97 · 2025: 48 · 2024: 14 · 2023: 25 · 2022: 4
- FWCI
- 74.27
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Perspectives on Public Management and Governance (publishedVersion, cc-by)
- Utrecht University Repository (Utrecht University) (submittedVersion, other-oa)
- Funders
- Netherlands Organization for Scientific Research (406.DI.19.011)
- Topics
- Social Sciences › Political Science and International Relations › E-Government and Public Services
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Social Sciences › Public Administration › Public Policy and Administration Research
- Keywords
- algorithmic decision-making, government legitimacy, institutional design, input legitimacy, throughput legitimacy, output legitimacy, automated decision-making, citizen participation, algorithmic accountability, public administration
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-09-29, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-09-29 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol and qwen3.8-omni-flash).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Legitimacy of Algorithmic Decision-Making: Six Threats and the Need for a Calibrated Institutional Response. https://app.cochat.ai/papers/10.1093/ppmgov/gvac008
- The paper
- Grimmelikhuijsen, S., & Meijer, A. (2022). Legitimacy of Algorithmic Decision-Making: Six Threats and the Need for a Calibrated Institutional Response. Perspectives on Public Management and Governance. https://doi.org/10.1093/ppmgov/gvac008
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.