Enslaving the Algorithm: From a “Right to an Explanation” to a “Right to Better Decisions”?
Open accessPublished version of a preprint
The DOI matches its Crossref record; 14 of the 14 references it cites were found in a registry or an index.
Abstract
As concerns about unfairness and discrimination in “black box” machine learning systems rise, a legal “right to an explanation” has emerged as a compellingly attractive approach for challenge and redress. We outline recent debates on the limited provisions in European data protection law, and introduce and analyze newer explanation rights in French administrative law and the draft modernized Council of Europe Convention 108. While individual rights can be useful, in privacy law they have historically unreasonably burdened the average data subject. “Meaningful information” about algorithmic logics is more technically possible than commonly thought, but this exacerbates a new “transparency fallacy”—an illusion of remedy rather than anything substantively helpful. While rights-based approaches deserve a firm place in the toolbox, other forms of governance, such as impact assessments, “soft law,” judicial review, and model repositories deserve more attention, alongside catalyzing agencies acting for users to control algorithmic system design.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“ADM also differs from human decision-making in that issues which might otherwise be considered appropriate for 'policy' judicial reviews can also be relevant to review of individual decisions (which may be termed 'bureaucratic' judicial review 29 ).”
From Administrative law and the machines of government: judicial review of automated public-sector decision-making (2019) · cites this paper as [29]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“such ‘solutions’—e.g. LIME (Ribeiro et al. 2016), SHAP (Lundberg and Lee 2017), Sensitivity Analysis (Oxborough et al. 2018)—do not really succeed in helping developers provide meaningful explanations (Edwards and Veale 2018) that give individuals greater control over what is being inferred about them from their data.”
From From What to How: An Initial Review of Publicly Available AI Ethics Tools, Methods and Research to Translate Principles into Practices (2020) · cites this paper as Edwards and Veale 2018
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“As automated decision-making happens at an increasingly large scale, it will be necessary to establish new forms of ongoing outside scrutiny (Bayamlıoğlu, 2021;Edwards & Veale, 2018;Elkin-Koren, 2020;Vaccaro et al., 2019).”
From Contestable AI by Design: Towards a Framework (2022) · cites this paper as Edwards & Veale, 2018
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Such efforts can be complemented with the use of technological solutions including secure environments which function as depositories for proprietary or sensitive data and models (Edwards & Veale, 2018).”
From Contestable AI by Design: Towards a Framework (2022) · cites this paper as Edwards & Veale, 2018
The cited source says what the claim attributes to it.
In the citing paper
“however, especially when using historical datasets (edwards & Veale, 2018), ai systems may amplify long-standing but previously unrecognized discriminatory patterns embedded in societal or institutional practices.”
From Reflections on the data protection compliance of AI systems under the EU AI Act (2025) · cites this paper as edwards & Veale, 2018
3 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
"Why Should I Trust You?": Explaining the Predictions of Any Classifier
Ribeiro, M. T., Singh, S., & Guestrin, C. (2016) · Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2939672.2939778 · Cited by 17,555 · cited 2×
“It is sometimes possible however to devise explanations of systems which do not need access to the proprietary innards of an ML model using “pedagogical” or “model-agnostic” methods [10, 12].”
Background“Why Should I Trust You?”: Explaining the Predictions of Any Classifier
Ribeiro, M., Singh, S., & Guestrin, C. (2016) · Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Demonstrations · doi:10.18653/v1/n16-3020 · Cited by 6,682
The Black Box Society: The Secret Algorithms That Control Money and Information
Pasquale, F. (2015) · doi:10.4159/harvard.9780674736061 · Cited by 3,796
Explaining nonlinear classification decisions with deep taylor decomposition
Montavon, G., Lapuschkin, S., Binder, A., Samek, W., & Müller, K.-R. (2017) · Pattern Recognition · doi:10.1016/j.patcog.2016.11.008 · Cited by 1,357
The Black Box Society: The Secret Algorithms That Control Money and Information
(2016) · Contemporary Sociology: A Journal of Reviews · doi:10.1177/0094306116641409c · Cited by 1,334
Wachter, S., Mittelstadt, B., & Floridi, L. (2017) · International Data Privacy Law · doi:10.1093/idpl/ipx005 · Cited by 1,308
The Black Box Society: The Secret Algorithms That Control Money and Information
(2015) · Choice Reviews Online · doi:10.5860/choice.190706 · Cited by 533 · cited 2×
“compensation on behalf of a data subject, this might also result in a dubious “ambulance-chasing” industry (similar to the UK furor over wrongly paid payment protection insurance, or PPI). Article 80(2), GDPR, by contrast, permits member states to allow third-party bodies to takeupcomplaints, forexample,againstadataco…”
BackgroundSweeney, L. (2013) · Queue · doi:10.1145/2460276.2460278 · Cited by 477
Tickle, A. B., Andrews, R., Golea, M., & Diederich, J. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/72.728352 · Cited by 438 · cited 1×
“It is sometimes possible however to devise explanations of systems which do not need access to the proprietary innards of an ML model using “pedagogical” or “model-agnostic” methods [10, 12].”
(2013) · eYLS (Yale Law School) · Cited by 376
Research works printed but not linked: 3
- 2017, Big Data Artificial Intelligence Machine Learning and Data Protection
- 10.1023/A:1009628601281 · doi:10.1023/a:1009628601281
- edwards, 2017, Slave to the Algorithm? Why a “Right to an Explanation,” Is Probably Not the Remedy You Are Looking For, Duke Law & Technology Review, 16, 18
Cited by
Items 101–146 of 146
The right to game AI-systems: a speculative right for contestation
van den Boom, F. (2026) · Frontiers in Communication · doi:10.3389/fcomm.2025.1620310 · Cited by 1
Resource allocation by algorithms: people prefer almost any alternative
Michael, H., & Uhl, M. (2026) · AI & Society · doi:10.1007/s00146-026-02886-1 · Cited by 1
“AI could cement or even intensify existing social problems, such as discrimination, and perpetuate historical injustices (Edwards and Veale 2018; Henman 2020; Zajko 2021, 2022).”
Advances in explainable artificial intelligence evaluation and ethics from 2023 to 2025
Pujari, J. J., Nayak, R., Putheti, S., Bikku, T., Shanmugasundaram, P., & Thota, S. (2026) · Discover Artificial Intelligence · doi:10.1007/s44163-026-01473-z · Cited by 3
Bouchagiar, G. (2019) · Review of European Studies · doi:10.5539/res.v11n1p27 · Cited by 4
“There is lack of interpretability (Lisboa, 2013) and experts may not be capable of comprehending how an outcome was reached (Edwards & Veale, 2018: 49).”
BackgroundRight to Contest AI Diagnostics
Ploug, T., & Holm, S. (2021) · Springer eBooks · doi:10.1007/978-3-030-58080-3_267-1 · Cited by 5
Algorytm jako informacja publiczna w prawie europejskim
Mazur, J. (2021) · Wydawnictwa Uniwersytetu Warszawskiego eBooks · doi:10.31338/uw.9788323551355 · Cited by 4
The power of algorithms and keys of participation
Esteves, J. (2022) · Routledge eBooks · doi:10.4324/9781003134176-4 · Cited by 2
Fouquet, D. B. (2023) · Estudios Penales y Criminológicos · doi:10.15304/epc.44.8906 · Cited by 4
Ciudades inteligentes y derechos digitales
Martínez, A. C. I. (2023) · Dykinson eBooks · doi:10.14679/2245 · Cited by 1
Naidu, G., & Krishnan, V. (2025) · International Journal of Intelligence Science · doi:10.4236/ijis.2025.151002 · Cited by 4
Orwellian Odyssey: Smart Borders and the Imperative for Explainability
Nnawuchi, U., & George, C. E. (2025) · Lecture notes in networks and systems · doi:10.1007/978-3-031-90921-4_41 · Cited by 1
Prediction of monetary penalties for data protection cases in multiple languages
Ceross, A., & Zhu, T. (2021) · International Conference on Artificial Intelligence and Law · doi:10.1145/3462757.3466097 · Cited by 1
“Edwards and Veale [8] maintain that an explanation of the logic of a model and its outcomes may have no meaning for an affected individual, giving little recourse by which to challenge the outcome of the automated decision.”
BackgroundThe Role of the Right to Explanation and Its Safeguards in the Realization of Trustworthy AI
Yalçın, O. G. (2022) · Advances in intelligent systems and computing · doi:10.1007/978-3-031-14859-0_16 · Cited by 2
Keller, P. (2022) · SSRN Electronic Journal · doi:10.2139/ssrn.4115750 · Cited by 2
Haynes, M. D. L. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5501087 · Cited by 2
Novazi, Z. (2025) · Law, Technology and Humans · doi:10.5204/lthj.4081
L'acte administratif algorithmique
Stepanov, A. (2026) · doi:10.70675/adc05be3za62ez4b4fz81e7zabf744e60dbf
Protection of Personal Data Regulation and Public Liberties: A Polyhedron With Unexpected Effects
Neves, A. S. (2020) · Advances in information security, privacy, and ethics book series · doi:10.4018/978-1-5225-9489-5.ch001 · Cited by 3
de Ágreda, Á. G. (2021) · UPM Digital Archive (Technical University of Madrid) · doi:10.20868/upm.thesis.67495 · Cited by 3
Mulder, W. D. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-15565-9_11
Gur-Arieh, S. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4557309
Kinder, T., & Stenvall, J. (2024) · Springer texts in business and economics · doi:10.1007/978-3-031-43230-9_4
Resta, G. (2024) · LCF studies in commercial and financial law · doi:10.1007/978-3-031-28497-7_48
Akinlade, E., & M’manga, A. (2025) · IFIP advances in information and communication technology · doi:10.1007/978-3-031-88744-4_6
E-Voting System Using Blockchain App
Bhumbare, R. S., Gaikwad, P., Gutte, A. M., Shaikh, A., & Chaudhari, G. (2025) · Lecture notes in networks and systems · doi:10.1007/978-3-032-06677-0_5
(In)adequate Data Protection and Algorithmic Predictive Analysis: An Unresolved Battle
Horzyk, A. M. (2025) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn64981.2025.11228804
“However, what constitutes a decision was criticized as unclear and undetermined in the GDPR and its accompanying recitals [14].”
Bhatt, N., & Bhatt, J. N. (2025) · Journal of Digital Technologies and Law · doi:10.21202/jdtl.2025.26 · Cited by 1
“Many researchers are of the view that this right of explanations may not always be practical and sufficient (Edwards & Veale, 2018; Taylor, 2023; Doshi-Velez et al., 2017).”
A Formal Framework for Ethics-by-Design in AI Entertainment Systems
Arora, S., Josyula, P., & Rajput, A. (2025) · IEEE International Conference on Cyber Security and Cloud Computing / IEEE International Conference on Edge Computing and Scalable Cloud (CSCloud/EdgeCom) · doi:10.1109/edgecom66327.2025.00019
Transparent and Equitable Metrics and Models
Arias-Duart, A., Cortés, Á., & Cortés, U. (2026) · Springer eBooks · doi:10.1007/978-3-031-61050-9_28-1
Zodpovednosť verejnej správy za nasadenie umelej inteligencie
Novotná, M., Adamová, Z., & Maslen, M. (2026) · AUC IURIDICA · doi:10.14712/23366478.2026.8
Potential Liability Risk With Artificial Intelligence Errors in Financial Reporting
Oluka, A. (2026) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3373-3922-1.ch008 · Cited by 1
La preuve en droit des systèmes d'intelligence artificielle
Pons, R. (2024) · theses.fr (ABES) · doi:10.70675/1e108f6ezfa39z422az8706zed4d031bb110
Transparency in the datafied workplace: Law, workers, and job applicant perspectives
Rigotti, C., Fernandes, D. A., Mut-Piña, A., & Fosch‐Villaronga, E. (2026) · Technology in Society · doi:10.1016/j.techsoc.2026.103387 · Cited by 1
Новые права человека: систематизация и место в контексте российского правопорядка
Быкова, Н. В. (2026) · Vestnik of Russian New University Series Man and society · doi:10.18137/rnu.v9276.26.01.p.060
Wang, Y. Y., Irion, K., Groth, P., & Harmouch, H. (2026) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3805689.3812313
“Table 1 presents an overview of participant characteristics.”
Georgiadou, N., Thanasas, G. L., Theodoridis, K., & Mandilas, Α. (2026) · Springer proceedings in business and economics · doi:10.1007/978-3-032-19314-8_11
Stanizzi, S. (2026) · AI Law Politics · doi:10.5709/alp-02.01.2026-06 · Cited by 1
Algorithmic Governance and Transparency in Automated Decision-Making
Sedano, J. J. F., Valadez, M. E., & Castillo, A. I. D. (2026) · IGI Global eBooks · doi:10.4018/979-8-3373-8592-1.ch005
Justice, Algorithms, and Accountability: Ethical Considerations for AI in the Judiciary
Pandey, A. (2026) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3373-5213-8.ch015
The Triple Bind: Performance, Stability, And Oversight In Ai-Driven Financial Risk Management
Oet, M. V., & Kvedaravičiūtė, E. (2026) · Springer proceedings in complexity · doi:10.1007/978-3-032-21596-3_9
Haynes, M. D. L., & Almatarneh, A. (2026) · Corporate Law & Governance Review · doi:10.22495/clgrv8i3sip6
Wang, J., & Wang, Y. (2026) · PLoS ONE · doi:10.1371/journal.pone.0354902
“…examples include the Algorithm Charter for Aotearoa New Zealand mandating public explanation of algorithms to enhance transparency, and the French Digital Republic Act granting citizens the right to request algorithmic explanations of algorithmic administrative decisions about individuals [76].”
Šipovac, V. (2026) · International Scientific Conference Law Days – Prof. Slavko Carić, PhD · doi:10.5937/pdsc26043s
Abdullah, E. R. O. L. (2026) · Erciyes Üniversitesi Hukuk Fakültesi Dergisi · doi:10.58820/eruhfd.1962353
Legal consciousness in the tech community: A conceptual and analytical framework
Kelemen, K., Falla, A. M. V., & Martires, P. Z. D. (2026) · Computer law & security review · doi:10.1016/j.clsr.2026.106423
“At the same time, socio-legal scholars have critiqued framing law as an external constraint, advocating instead focusing on how law becomes meaningful through social interpretation and practice [26 – 28].”
Metadata
- Authors
- Edwards, L., & Veale, M.
- Affiliations
- University of Strathclyde (GB)
- University College London (GB)
- ORCID
- Veale, Michael
- Venue
- IEEE Security & Privacy
- Published
- 2018-05
- Volume
- 16
- Issue
- 3
- Pages
- 46-54
- ISSN
- 1540-7993 (ISSN-L)
- 1558-4046
- OpenAlex
- W2766279925
- Semantic Scholar
- 581b81c98254c7051dd777a42fda685b6118b2f9
- Cited by
- 141
- References
- 12
- Citations by year
- 2026: 22 · 2025: 16 · 2024: 15 · 2023: 18 · 2022: 18 · 2021: 21 · 2020: 17 · 2019: 11 · 2018: 3
- FWCI
- 119.96
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- IEEE Security & Privacy (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- Arts and Humanities Research Council (AH/K000179/1)
- Topics
- Social Sciences › Law › Digitalization, Law, and Regulation
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Keywords
- algorithmic transparency, algorithmic discrimination, algorithmic fairness, European data protection law, French administrative law, algorithmic accountability, impact assessment, soft law, judicial review, model repository, algorithmic governance, algorithmic decision-making
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.