Algorithmic regulation and the rule of law
Open accessAbstract
In this brief contribution, I distinguish between code-driven and data-driven regulation as novel instantiations of legal regulation. Before moving deeper into data-driven regulation, I explain the difference between law and regulation, and the relevance of such a difference for the rule of law. I discuss artificial legal intelligence (ALI) as a means to enable quantified legal prediction and argumentation mining which are both based on machine learning. This raises the question of whether the implementation of such technologies should count as law or as regulation, and what this means for their further development. Finally, I propose the concept of ‘agonistic machine learning’ as a means to bring data-driven regulation under the rule of law. This entails obligating developers, lawyers and those subject to the decisions of ALI to re-introduce adversarial interrogation at the level of its computational architecture. This article is part of a discussion meeting issue ‘The growing ubiquity of algorithms in society: implications, impacts and innovations'.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Algorithmic decision-making is usually regarded as incapable of exercising discretion, since there is no room for manoeuvre in a deterministic system.
“Algorithmic decision-making is usually regarded as incapable of exercising this kind of discretion, since there is no room for manoeuvre in a deterministic system.”
From Human Judgment in algorithmic loops: Individual justice and automated <scp>decision‐making</scp> (2022) · cites this paper as Hildebrandt 2018
Section 2 says code-driven decision systems are deterministic and have “no discretion whatsoever,” supporting the claim for that type of algorithmic decision-making. But the section also distinguishes data-driven systems and describes a new type of discretion in their design, so the claim is broader than the paper's account. (LLM, conf=0.84)
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Austin, J. L. (1975) · doi:10.1093/acprof:oso/9780198245537.001.0001 · Cited by 21,496 · see citing works
Searle, J. R. (1969) · doi:10.1017/cbo9781139173438 · Cited by 11,718 · see citing works
Causality: Models, Reasoning, and Inference
Pearl, J. (2009) · doi:10.1017/cbo9780511803161 · Cited by 11,653 · see citing works
How We Became Posthuman: Virtual Bodies in Cybernetics, Literature, and Informatics
Hayles, N. K. (1999) · doi:10.7208/chicago/9780226321394.001.0001 · Cited by 5,284 · see citing works
Intelligible Models for HealthCare: Predicting Pneumonia Risk and Hospital 30-day Readmission
Caruana, R., Lou, Y., Gehrke, J., Koch, P., Sturm, M., & Elhadad, N. (2015) · Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2783258.2788613 · Cited by 1,685 · see citing works
Decentralized Blockchain Technology and the Rise of Lex Cryptographia
Wright, A., & De Filippi, P. (2015) · SSRN Electronic Journal · doi:10.2139/ssrn.2580664 · Cited by 928 · see citing works
Algorithmic regulation: A critical interrogation
Yeung, K. (2018) · Regulation & Governance · doi:10.1111/rego.12158 · Cited by 842 · see citing works
Prediction and explanation in social systems
Hofman, J. M., Sharma, A., & Watts, D. J. (2017) · Science · doi:10.1126/science.aal3856 · Cited by 429 · see citing works
Prediction, persuasion, and the jurisprudence of behaviourism
Pasquale, F., & Cashwell, G. (2018) · University of Toronto Law Journal · doi:10.3138/utlj.2017-0056 · Cited by 44 · see citing works
Flagged first, then by citations
Research works printed but not linked: 30
- Brownsword R. 2016 Technological management and the rule of law. Law Innov. Technol. 8, 100-140. (doi:10.1080/17579961.2016.1161891) · DOI
- Szabo N. 1997 Formalizing and securing relationships on public networks. First Monday 2 (9). (doi:10.5210/fm.v2i9.548) · DOI
- Raskin. 2017 The law and legality of smart contracts. Georgetown Law Technol. Rev. 1, 304-341. See https://ssrn.com/abstract=2959166.
- Surden H. 2017 Values embedded in legal artificial intelligence. University of Colorado Law Legal Studies Research Paper No. 17-17. See https://ssrn.com/abstract=2932333.
- Surden H. 2014 Machine learning and law. Washington Law Rev. 89, 87-115. See https://ssrn.com/abstract=2417415.
- Hildebrandt M. 2017 Law as computation in the era of artificial legal intelligence. Speaking law to the power of statistics. Univ. Toronto Law J. 68(suppl. 1), 12-35. (doi:10.3138/utlj.2017-0044) · DOI
- Katz DM. 2013 Quantitative legal prediction-or-How I learned to stop worrying and start preparing for the data-driven future of the legal services industry. Emory Law J. 62, 909-966. See https://ssrn.com/abstract=2187752.
- Mitchell T. 1997 Machine learning, 1st edn. New York, NY: McGraw-Hill Education.
- Cabitza F. 2016 The unintended consequences of chasing electric zebras. In IEEE SMC Interdisciplinary Workshop on the Human Use of Machine Learning, Venice, Italy, 16 December.
- Cabitza F. 2017 Breeding electric zebras in the fields of medicine. See https://arxiv.org/abs/ 1701.04077.
- Hildebrandt M. 2017 Learning as a machine. Crossovers between humans and machines. J. Learn. Anal. 4, 6-23. (doi:10.18608/jla.2017.41.3) · DOI
- Gutwirth S, De Hert P, De Sutter L. 2008 The trouble with technology regulation from a legal perspective. Why Lessig's 'optimal mix' will not work. In Regulating technologies (eds R Brownsword, K Yeung), pp. 193-218. Oxford, UK: Hart.
- Wiener N. 1988 The human use of human beings: cybernetics and society. Cambridge, MA: Da Capo Press.
- Searle JR. 1969 Speech acts, an essay in the philosophy of language. Cambridge, UK: Cambridge University Press.
- Ricoeur P. 2003 The just. Chicago, IL: University of Chicago Press.
- Evans T, Harris J. 2004 Street-level bureaucracy, social work and the (exaggerated) death of discretion. Br. J. Soc. Work 34, 871-895. (doi:10.1093/bjsw/bch106) · DOI
- Dworkin R. 1978 Taking rights seriously, 5th edn. Cambridge, MA: Harvard University Press.
- Hildebrandt M. 2016 New animism in policing: re-animating the rule of law? In The SAGE handbook of global policing (eds B Bradford, B Jauregui, I Loader, J Steinberg), pp. 406-428.
- Beverley Hills, CA: SAGE.
- Aletras N, Tsarapatsanis D, Preoţiuc-Pietro D, Lampos V. 2016 Predicting judicial decisions of the European Court of Human Rights: a natural language processing perspective. PeerJ Comput. Sci. 2, e93. (doi:10.7717/peerj-cs.93) · DOI
- Hildebrandt M. In press. Privacy as protection of the incomputable self: agonistic machine learning. Theor. Inq. Law 20 (1).
- McQuillan D. 2018 People's councils for ethical machine learning. Social Media Soc. 4, 2056305118768303. (doi:10.1177/2056305118768303) · DOI
- Hildebrandt M, Gutwirth S. 2007 (Re)presentation, pTA citizens' juries and the jury trial. Utrecht Law Rev. 3, 24. (doi:10.18352/ulr.35) · DOI
- Nadim T. 2016 Blind regards: troubling data and their sentinels. Big Data Soc. 3, 2053951716666301. (doi:10.1177/2053951716666301) · DOI
- Rip A. 2003 Constructing expertise: in a third wave of science studies? Soc. Stud. Sci. 33, 419- 434. (doi:10.1177/03063127030333006) · DOI
- Waldron J. 2010 The rule of law and the importance of procedure. NYU School of Law, Public Law Research Paper No. 10-73. See https://ssrn.com/abstract=1688491.
- Radbruch G. 2014 Legal philosophy. In The legal philosophies of Lask, Radbruch, and Dabin, Cambridge, MA: Harvard University Press. (doi:10.4159/harvard.9780674493025) · DOI
- Sculley D, Pasanek BM. 2008 Meaning and mining: the impact of implicit assumptions in data mining for the humanities. Lit. Linguist. Comput. 23, 409-424. (doi:10.1093/llc/fqn019) · DOI
- Hildebrandt M. 2011 The meaning and mining of legal texts. In Understanding digital humanities: the computational turn and new technology (ed DM Berry). London, UK: Palgrave Macmillan.
- Dewey J. 1927 The public & its problems. Chicago, IL: Swallow Press.
Cited by
Sorted by citations
Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models
Srivastava, A., Rastogi, A., Rao, A., Shoeb, A. A. M., Abid, A., Fisch, A., Brown, A. R., Santoro, A., Gupta, A., Garriga-Alonso, A., et al. (2022) · arXiv · doi:10.48550/arxiv.2206.04615 · Cited by 569 · see citing works
Artificial Intelligence Regulation: A framework for governance
de Almeida, P. G. R., dos Santos, C. D., & Farias, J. S. (2021) · Ethics and Information Technology · doi:10.1007/s10676-021-09593-z · Cited by 395 · see citing works
Beyond the individual: Governing AI’s societal harm
Smuha, N. A. (2021) · Internet Policy Review · doi:10.14763/2021.3.1574 · Cited by 143 · see citing works
Human Judgment in algorithmic loops: Individual justice and automated <scp>decision‐making</scp>
Binns, R. (2022) · Regulation & Governance · doi:10.1111/rego.12358 · Cited by 134 · see citing works
The growing ubiquity of algorithms in society: implications, impacts and innovations
Olhede, S. C., & Wolfe, P. J. (2018) · Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences · doi:10.1098/rsta.2017.0364 · Cited by 120 · see citing works
EU Administrative Decision-Making Delegated to Machines – Legal Challenges and Issues
Hubková, P. (2024) · AUC IURIDICA · doi:10.14712/23366478.2024.25 · Cited by 4 · see citing works
L'acte administratif algorithmique
Stepanov, A. (2026) · doi:10.70675/adc05be3za62ez4b4fz81e7zabf744e60dbf
- Authors
- Hildebrandt, M.
- Affiliations
- Vrije Universiteit Brussel (BE)
- Corresponding author
- Hildebrandt, Mireille
- Venue
- Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences
- Publisher
- The Royal Society
- Published
- 2018-08-06
- Volume
- 376
- Issue
- 2128
- Pages
- 20170355
- ISSN
- 1364-503X (ISSN-L)
- 1471-2962
- OpenAlex
- W2887660369
- Cited by
- 222
- References
- 9
- Citations by year
- 2026: 20 · 2025: 25 · 2024: 27 · 2023: 70 · 2022: 31 · 2021: 17 · 2020: 15 · 2019: 15 · 2018: 2
- FWCI
- 53.31
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Philosophical Transactions of the Royal Society A Mathematical Physical and Engineering Sciences (publishedVersion)
- PubMed (publishedVersion)
- Radboud Repository (Radboud University) (submittedVersion, other-oa)
- Radboud Repository (Radboud University) (submittedVersion)
- VUBIR (Vrije Universiteit Brussel) (submittedVersion)
- Topics
- Social Sciences › Political Science and International Relations › Artificial Intelligence in Law
- Social Sciences › Law › Digitalization, Law, and Regulation
- Social Sciences › Safety Research › Ethics and Social Impacts of AI
- Keywords
- algorithmic regulation, rule of law, data-driven regulation, legal prediction, argument mining, machine learning, legal technology
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review