The DOI matches its Crossref record; 6 of the 6 references it cites were found in a registry or an index; none of the 55 sources its claims cite is checked for support yet.
Rethinking Administrative Law for Algorithmic Decision Making
Open accessAbstract
The increasing prevalence of algorithmic decision making (ADM) by public authorities raises a number of challenges for administrative law in the form of technical decisions about the necessary metrics for evaluating such systems, their opacity, the scalability of errors, their use of correlation as opposed to causation and so on. If administrative law is to provide the necessary guidance to enable optimal use of such systems, there are a number of ways in which it will need to become more nuanced and advanced. However, if it is able to rise to this challenge, administrative law has the potential not only to do useful work itself in controlling ADM, but also to support the work of the Information Commissioner's Office and provide guidance on the interpretation of concepts such as 'meaningful information' and 'proportionality' within the General Data Protection Regulation.
Overview
CoChat Summary
TL;DR
The article argues that administrative law must become more technically nuanced to govern algorithmic decision making (ADM) by public authorities, especially regarding evaluation metrics, opacity, scalable errors, and correlation versus causation. It maps GDPR/DPA, equality and human rights law, and judicial review grounds onto ADM, using cases such as *Bridges* and *Loomis* to show how courts may need to engage with technical evidence and guard against over-reliance on automated outputs.
Key findings
- Public authorities generally need a specific legal basis to rely wholly on ADM under GDPR Article 22 and DPA 2018; data subjects have rights to meaningful information about the logic involved, human intervention, and contestation, while the PSED and Human Rights Act 1998 also apply.
- Assessing ADM requires choosing among competing metrics: in the paper’s illustrative shape-identification example, sensitivity is 4/14, specificity 2/3, precision 4/7, negative predictive value 6/16, and accuracy 10/23; the preferred metric depends on which errors are most serious.
- In *Bridges*, AFR deployments generated 290 alerts: 82 true positives and 208 false positives. Of 188 male alerts (65%), 64 were true positives (34%) and 124 false positives (66%); of 102 female alerts, 18 were true positives (18%) and 84 false positives (82%). Of true positives, 98% were “white north European”; of false positives, 98.5% were “white north European.” The Court of Appeal found the use unlawful for lack of clear guidance and inadequate discharge of the PSED, and held that human review did not cure the failure to assess possible bias.
- Judicial review grounds—jurisdiction, procedural fairness/reasons, relevance, fettering/non-delegation, and reasonableness/proportionality—will need adjustment for ADM; cases such as *Loomis* (COMPAS not determinative) and *Houston Federation of Teachers* (EVAAS scores) illustrate emerging constraints.
Methods
- Design: doctrinal and conceptual legal analysis, not an empirical study.
- Data/sample: EU and UK legislation (GDPR, UK GDPR, DPA 2018, Equality Act 2010, Human Rights Act 1998), case law (*Bridges*, *Loomis*, *Houston*, *Ivory Coast*, *Bourgass*, etc.), ICO/Alan Turing Institute guidance, and academic commentary on algorithmic decision making.
- Main analysis: applies administrative law grounds of review to public authority ADM and proposes how legal doctrine should adapt to technical choices, transparency, bias, and proportionality.
Limitations
- The paper does not state limitations.
- Evident from the text: it is a conceptual/doctrinal article with no empirical validation or quantitative study; the metrics example is illustrative rather than a tested system.
- Evident from the text: the analysis is focused on UK/EU public law and selected case law, so its prescriptions may not generalize to other jurisdictions or private-sector ADM.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
0 Valid · 5 Not valid · 58 Not checked · 63 Own results and interpretations
In the paper
“with increasing pressure on public finances and the ability of such systems to make decisions more cheaply than humans, it seems unlikely even after the A level debacle that they will disappear from use altogether.”
§ Rethinking Administrative Law for Algorithmic Decision Making > Introduction
What the sources say
- Not matchedcites [6]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
hedgedstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Not matched
In the paper
“The rights under articles 13–15 are therefore triggered as long as there is some form of automated processing in the decision, whether or not the decision is based solely on that automated processing (triggering article 22) or not.”
§ Rethinking Administrative Law for Algorithmic Decision Making > Legislation > Rights Applicable under ADM
What the sources say
- Not matchedcites [39]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Not matched
None of the sources cited for this claim could be matched to a paper in Crossref, so there is nothing to check it against.
In the paper
“The Court of Appeal agreed, holding that the use of the technology was not ‘in accordance with the law’ for the purposes of article 8(2) of the European Convention on Human Rights (ECHR)43 because there was no clear guidance on where the technology could be used and who could be put on a watchlist.”
§ Rethinking Administrative Law for Algorithmic Decision Making > Legislation > The Public Sector Equality Duty and the Human Rights Act 1998
What the sources say
- Not matchedcites [41]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Not matchedcites [43]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Not matched
In the paper
“it seems likely that in future the common law rules of judicial review will also play a role.”
§ Rethinking Administrative Law for Algorithmic Decision Making > The Common Law
What the sources say
- Not matchedcites [48]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
hedgedstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: unclear — It is unclear whether it could be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Not matched
In the paper
“In addition to these rights, at any point, article 15(1)(h) also gives the DS the right to obtain this information actively.”
§ Rethinking Administrative Law for Algorithmic Decision Making > Legislation > Rights Applicable under ADM
What the sources say
- Not matchedcites [26]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Not matched
30 more claims
Create a free account to see all 126 claims and every source verdict.
- Probably not a substantial claim. 61
- It may state two separate claims as one. 58
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Studies that examine administrative law and automation argue that traditional categories, such as rules versus discretion, become less stable when systems combine rigid thresholds with probabilistic scoring and risk rankings (Oswald, 2018; Williams, 2022).”
From Judicial review of algorithmic administrative systems legality evidence and remedies in the smart city state (2026) · cites this paper as Williams, 2022
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“ﺷﻬﺪ اﻟﻌﻘﺪ اﻷﺧﲑ ﲢﻮﻻ ت ودﻋﻢ اﲣﺎذ اﻟﻘﺮ ار.”
From القرار الإداري المؤتمت ومبدأ المشروعية: دراسة في ضوء التنظيم القانوني للذكاء الاصطناعي (2026) · cites this paper as [1]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Algorithmic systems used in public administration increasingly operate as structured decision pathways rather than isolated technical tools, and this functional role requires a corresponding legal understanding within judicial review doctrine (Cobbe, 2019; Williams, 2022).”
From Judicial review of algorithmic administrative systems legality evidence and remedies in the smart city state (2026) · cites this paper as Williams, 2022
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Judicial review, as a central mechanism for supervising administrative power, faces growing difficulty when decisions are generated or shaped by opaque computational processes rather than identifiable public officials (Cobbe, 2019; Williams, 2022).”
From Judicial review of algorithmic administrative systems legality evidence and remedies in the smart city state (2026) · cites this paper as Williams, 2022
The cited source says what the claim attributes to it.
In the citing paper
“This concern is connected to calls for rethinking administrative law for algorithmic decision-making, where the standard ideas of error, irrationality, and relevant considerations may require adaptation to system-based governance (Williams, 2022; Chauhan, 2020).”
From Judicial review of algorithmic administrative systems legality evidence and remedies in the smart city state (2026) · cites this paper as Williams, 2022
2 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
The publisher hasn’t deposited this paper’s reference list.
Cited by
Trust, artificial intelligence and software practitioners: an interdisciplinary agenda
Pink, S., Quilty, E., Grundy, J., & Hoda, R. (2024) · AI & Society · doi:10.1007/s00146-024-01882-7 · Cited by 39
Fair governance with humans and machines.
Hermstrüwer, Y., & Langenbach, P. (2023) · Psychology, Public Policy, and Law · doi:10.1037/law0000381 · Cited by 19
Decision-making power and responsibility in an automated administration
Langer, C. (2024) · Discover Artificial Intelligence · doi:10.1007/s44163-024-00152-1 · Cited by 26
Pacher, A., & Hamann, H. (2023) · Oxford Journal of Legal Studies · doi:10.1093/ojls/gqac032 · Cited by 12
Fair Governance with Humans and MachinesPreprint
Hermstrüwer, Y., & Langenbach, P. (2022) · SSRN Electronic Journal · doi:10.2139/ssrn.4118650 · Cited by 7
Metadata
- Authors
- Williams, R.
- Affiliations
- University of Oxford (GB)
- Corresponding author
- Williams, Rebecca
- ORCID
- Williams, Rebecca
- Venue
- Oxford Journal of Legal Studies
- Publisher
- Oxford University Press (OUP)
- Published
- 2021-10-30
- Volume
- 42
- Issue
- 2
- Pages
- 468-494
- ISSN
- 0143-6503 (ISSN-L)
- 1464-3820
- PMC
- PMC9126137
- OpenAlex
- W3194928852
- Semantic Scholar
- aaab03593283ddc7b3c659a2bb5a591f076be2a4
- Cited by
- 42
- References
- 0
- Citations by year
- 2026: 15 · 2025: 13 · 2024: 6 · 2023: 7 · 2022: 1
- FWCI
- 11.64
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Oxford Journal of Legal Studies (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Funders
- Economic and Social Research Council (ES/S010424/1)
- Topics
- Social Sciences › Law › Administrative Law and Governance
- Social Sciences › Law › Digitalization, Law, and Regulation
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Keywords
- algorithmic decision-making, administrative law, public sector organizations, algorithmic transparency, algorithmic accountability, algorithmic fairness, correlation versus causation, Information Commissioner's Office, General Data Protection Regulation, meaningful information, proportionality, algorithmic errors
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Rethinking Administrative Law for Algorithmic Decision Making. https://app.cochat.ai/papers/10.1093/ojls/gqab032
- The paper
- Williams, R. (2022). Rethinking Administrative Law for Algorithmic Decision Making. Oxford Journal of Legal Studies. https://doi.org/10.1093/ojls/gqab032
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
