Why a Right to Legibility of Automated Decision-Making Exists in the General Data Protection Regulation
Open accessThe DOI matches its Crossref record.
Abstract
... In the data-driven economy, the importance of algorithms has grown exponentially while artificial Intelligence applied to customer data management remains problematic for several reasons. Automated decision-making based on complex algorithms can not only determine the acceptance of a mortgage, the price of an insurance policy,1 but can also lead to ‘subtler’ issues. For instance, they can be used to exploit consumers’ specific vulnerabilities in order to distort their purchasing attitudes.2 Oftentimes, these algorithms are not only unknown but also unintelligible by individuals. In some cases, eg where machine-learning technologies are deployed, decision-making algorithms may be unintelligible also to their data controller.3 This situation has led to define the current Information Society as a ‘black box’ society.4 In other terms, as we have explained elsewhere,5 the problem of these algorithms is the lack of ‘readability’ and ‘legibility’ from individuals directly concerned by them.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Most straightforwardly, decisions will be ultra vires in its simplest form when the decision-maker has done something for which they lack legal authority 33 ; where this is the case, they will have acted unlawfully whether the decision was taken by automated means or not.”
From Administrative law and the machines of government: judicial review of automated public-sector decision-making (2019) · cites this paper as [33]
In the citing paper
“However, a passive approval of automated processing falls too short; human oversight rather needs to be an active assessment and verification”
From Check the box! How to deal with automation bias in AI-based personnel selection (2023) · cites this paper as Malgieri and Comandé, 2017
In the citing paper
“The need to conceive explanations as an interactive process has been argued by several authors [56, 58].”
From Beyond explainability: justifiability and contestability of algorithmic decision systems (2022) · cites this paper as [58]
Citations
Cites
Still being checked.
Cited by
Accountability of AI Under the Law: The Role of Explanation
Doshi-Velez, F., Kortz, M., Budish, R., Bavitz, C., Gershman, S. J., O'Brien, D., Scott, K., Shieber, S., Waldo, J., Weinberger, D., et al. (2017) · doi:10.2139/ssrn.3064761 · Cited by 457
Inherent Tradeoffs in the Fair Determination of Risk Scores
(2023) · The Societal Impacts of Algorithmic Decision-Making · doi:10.1145/3603195.3603197 · Cited by 310
A Survey of Methods for Explaining Black Box Models
Guidotti, R., Monreale, A., Ruggieri, S., Turini, F., Giannotti, F., & Pedreschi, D. (2019) · ACM Computing Surveys · doi:10.1145/3236009 · Cited by 629
“Despite divergent opinions among legal scholars regarding the real scope of these clauses [36, 74, 126], there is a general agreement on the need for the implementation of such a principle is urgent and that it represents today a huge open scientific challenge.”
BackgroundLegal requirements on explainability in machine learning
Bibal, A., Lognoul, M., de Streel, A., & Frénay, B. (2021) · Artificial Intelligence and Law · doi:10.1007/s10506-020-09270-4 · Cited by 165
“The majority of scholars support this requirement of explanation (Goodman and Flaxman 2016; Malgieri and Comandé 2017; Edwards and Veale 2018; Selbst and Powles 2017).”
BackgroundDiscrimination, artificial intelligence, and algorithmic decision-making
Borgesius, F. Z. (2025) · arXiv · doi:10.48550/arxiv.2510.13465 · Cited by 152
“164 The Council of Europe’s Steering Committee on Media and Information Society has set up an expert committee on AI: the Committee of Experts on human rights dimensions of automated data processing and different forms of artificial intelligence.”
InfluentialGLocalX—From Local to Global Explanations of Black Box AI Models
Setzu, M., Guidotti, R., Monreale, A., Turini, F., Pedreschi, D., & Giannotti, F. (2021) · Artificial Intelligence · doi:10.1016/j.artint.2021.103457 · Cited by 140
“More specifically, the GDPR introduces a right to meaningful explanations when one is subject to automated AI systems [6, 7, 8].”
BackgroundReviewable Automated Decision-Making: A Framework for Accountable Algorithmic Systems
Cobbe, J., Lee, M. S. A., & Singh, J. (2021) · Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency · doi:10.1145/3442188.3445921 · Cited by 150
“Some proposals have seemingly been prompted by academic debate about the existence, nature, extent, and utility of a so-called ‘right to an explanation’ [26, 31, 44, 64, 74] in GDPR, which was passed in 2016.”
BackgroundCo-design of human-centered, explainable AI for clinical decision support
Panigutti, C., Beretta, A., Fadda, D., Giannotti, F., Pedreschi, D., Perotti, A., & Rinzivillo, S. (2023) · ACM Transactions on Interactive Intelligent Systems · doi:10.1145/3587271 · Cited by 127
“…literature has also debated the existence of a “right to have an explanation” of AI decisions based on the EU GDPR (General Data Protection Regulation) prescription to provide “meaningful information about the logic involved” to the data subject in case of automated decision-making [1, 36, 58, 87].”
BackgroundCobbe, J. (2019) · Legal Studies · doi:10.1017/lst.2019.9 · Cited by 174
Cabitza, F., Campagner, A., Malgieri, G., Natali, C., Schneeberger, D., Stoeger, K., & Holzinger, A. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2022.118888 · Cited by 89
Self-citationPost-Hoc Explanations Fail to Achieve their Purpose in Adversarial Contexts
Bordt, S., Finck, M., Raidl, E., & von Luxburg, U. (2022) · 2022 ACM Conference on Fairness Accountability and Transparency · doi:10.1145/3531146.3533153 · Cited by 89
The European Legal Framework for Medical AI
Schneeberger, D., Stöger, K., & Holzinger, A. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-57321-8_12 · Cited by 85
Beyond explainability: justifiability and contestability of algorithmic decision systems
Henin, C., & Le Métayer, D. (2022) · AI & SOCIETY · doi:10.1007/s00146-021-01251-8 · Cited by 71
BRKAN, M., & BONNET, G. (2020) · European Journal of Risk Regulation · doi:10.1017/err.2020.10 · Cited by 63
Check the box! How to deal with automation bias in AI-based personnel selection
Kupfer, C., Prassl, R., Fleiß, J., Malin, C., Thalmann, S., & Kubicek, B. (2023) · Frontiers in Psychology · doi:10.3389/fpsyg.2023.1118723 · Cited by 59
“However, a passive approval of automated processing falls too short; human oversight rather needs to be an active assessment and verification (Malgieri and Comandé, 2017).”
BackgroundGil González, E., & de Hert, P. (2019) · ERA Forum · doi:10.1007/s12027-018-0546-z · Cited by 51
“An exhaustive discussion about this can be found in Wachter, Mittelstadt and Floridi [49]; Malgieri and Comandé [36] and Goodman and Flaxman [24].”
BackgroundBayamlıoğlu, E. (2022) · Regulation & Governance · doi:10.1111/rego.12391 · Cited by 44
Sarra, C. (2020) · Global Jurist · doi:10.1515/gj-2020-0003 · Cited by 24
Experimental Regulations for AI: Sandboxes for Morals and Mores
Ranchordas, S. (2021) · Morals & Machines · doi:10.5771/2747-5182-2021-1-86 · Cited by 22
Malgieri, G. (2021) · Law and Business · doi:10.2478/law-2021-0003 · Cited by 10
Self-citationGeburczyk, F. (2021) · Computer Law & Security Review · doi:10.1016/j.clsr.2021.105538 · Cited by 7
Geburczyk, F. (2021) · Ruch Prawniczy, Ekonomiczny i Socjologiczny · doi:10.14746/rpeis.2021.83.1.8 · Cited by 2
Novazi, Z. (2025) · Law, Technology and Humans · doi:10.5204/lthj.4081
L'acte administratif algorithmique
Stepanov, A. (2026) · doi:10.70675/adc05be3za62ez4b4fz81e7zabf744e60dbf
Algorithmic monoculture and social welfare
(2023) · The Societal Impacts of Algorithmic Decision-Making · doi:10.1145/3603195.3603202
Metadata
- Authors
- Malgieri, G., & Comandé, G.
- Affiliations
- Scuola Superiore Sant'Anna (IT)
- Corresponding author
- Malgieri, Gianclaudio
- Venue
- International Data Privacy Law
- Publisher
- Oxford University Press (OUP)
- Published
- 2017-11-01
- Volume
- 7
- Issue
- 4
- Pages
- 243-265
- ISSN
- 2044-3994 (ISSN-L)
- 2044-4001
- OpenAlex
- W2770363731
- Semantic Scholar
- f913b4f53acb4b3c7a64e9d1be4bef005492ae4b
- Cited by
- 271
- References
- 0
- Citations by year
- 2026: 15 · 2025: 26 · 2024: 16 · 2023: 96 · 2022: 29 · 2021: 34 · 2020: 24 · 2019: 22 · 2018: 8 · 2017: 1
- FWCI
- 154.09
- Type
- journal article
- Language
- en
- Open access
- green
- papers.ssrn.com
- Locations
- International Data Privacy Law (publishedVersion)
- SSRN Electronic Journal (submittedVersion)
- VUBIR (Vrije Universiteit Brussel) (submittedVersion)
- CINECA IRIS Institutional Research Information System (Sant'Anna School of Advanced Studies) (submittedVersion)
- Topics
- Social Sciences › Law › Digitalization, Law, and Regulation
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Keywords
- automated decision-making, General Data Protection Regulation, algorithmic transparency, algorithmic accountability, black-box algorithms, machine learning, consumer protection, data protection law, algorithmic decision-making
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.