Strengthening legal protection against discrimination by algorithms and artificial intelligence
Open accessPublished version of a preprint
The DOI matches its Crossref record; 3 of the 3 references it cites were found in a registry or an index.
Abstract
Algorithmic decision-making and other types of artificial intelligence (AI) can be used to predict who will commit crime, who will be a good employee, who will default on a loan, etc. However, algorithmic decision-making can also threaten human rights, such as the right to non-discrimination. The paper evaluates current legal protection in Europe against discriminatory algorithmic decisions. The paper shows that non-discrimination law, in particular through the concept of indirect discrimination, prohibits many types of algorithmic discrimination. Data protection law could also help to defend people against discrimination. Proper enforcement of non-discrimination law and data protection law could help to protect people. However, the paper shows that both legal instruments have severe weaknesses when applied to artificial intelligence. The paper suggests how enforcement of current rules can be improved. The paper also explores whether additional rules are needed. The paper argues for sector-specific – rather than general – rules, and outlines an approach to regulate algorithmic decision-making.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Even where discrimination is established, legal scholarship continues to debate what remedies should look like when harm stems from a system’s design and repeated deployment rather than a single unlawful act (Cromvelle, 2025; Zuiderveen Borgesius, 2020).”
From Judicial review of algorithmic administrative systems legality evidence and remedies in the smart city state (2026) · cites this paper as Zuiderveen Borgesius, 2020
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Addressing upstream legality also responds to equality concerns, since proxy discrimination often originates in feature selection or threshold design rather than in explicit decision rules (Gerards and Zuiderveen Borgesius, 2020; Zuiderveen Borgesius, 2020).”
From Judicial review of algorithmic administrative systems legality evidence and remedies in the smart city state (2026) · cites this paper as Zuiderveen Borgesius, 2020
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Issues of discrimination and equality before the law occupy a growing place in discussions of algorithmic administration, as data-driven systems have been shown to reproduce or intensify unequal treatment across protected groups (Gerards and Zuiderveen Borgesius, 2020; Zuiderveen Borgesius, 2020).”
From Judicial review of algorithmic administrative systems legality evidence and remedies in the smart city state (2026) · cites this paper as Zuiderveen Borgesius, 2020
The cited source says what the claim attributes to it.
In the citing paper
“These works often focus on the difficulties of constraining algorithmic discrimination in many contexts, proposing alternative legal frameworks that would allow for more regulatory enforcement of algorithmic bias.”
From Data Governance in the Age of Large-Scale Data-Driven Language Technology (2022) · cites this paper as [146]
The cited source says what the claim attributes to it.
In the citing paper
“A number of prior works, particularly from a U.S.-centric perspective, have connected ML to legal frameworks for human rights, especially antidiscrimination [47, 48, 64, 70, 72, 140, 142, 146].”
From Data Governance in the Age of Large-Scale Data-Driven Language Technology (2022) · cites this paper as [146]
4 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The publisher hasn’t deposited this paper’s reference list.
Cited by
Artificial Intelligence and Business Value: a Literature Review
Enholm, I. M., Papagiannidis, E., Mikalef, P., & Krogstie, J. (2022) · Information Systems Frontiers · doi:10.1007/s10796-021-10186-w · Cited by 1,046
Regulating ChatGPT and other Large Generative AI Models
Hacker, P., Engel, A., & Mauer, M. (2023) · 2023 ACM Conference on Fairness Accountability and Transparency · doi:10.1145/3593013.3594067 · Cited by 466
Ethics and discrimination in artificial intelligence-enabled recruitment practices
Chen, Z. (2023) · Humanities and Social Sciences Communications · doi:10.1057/s41599-023-02079-x · Cited by 450
An AI-based decision support system for predicting mental health disorders
Tutun, S., Johnson, M. E., Ahmed, A., Albizri, A., Irgil, S., Yesilkaya, I., Ucar, E. N., Sengun, T., & Harfouche, A. (2023) · Information Systems Frontiers · doi:10.1007/s10796-022-10282-5 · Cited by 177
“Thus, there have been proposals to create guidelines for integrating ethics into the process of AI-based DSS design to prevent their misuse and potential biases, specifically in the healthcare field (Borgesius, 2020 ; Floridi & Cowls, 2021 ; Johnson et al., 2021).”
BackgroundLarge language models in law: A survey
Lai, J., Gan, W., Wu, J., Qi, Z., & Yu, P. S. (2024) · AI Open · doi:10.1016/j.aiopen.2024.09.002 · Cited by 359
Metadata
- Authors
- Zuiderveen Borgesius, F. J.
- Affiliations
- Institute for Computing and Information Sciences (iCIS), Radboud University, Nijmegen, Netherlands
- Venue
- The International Journal of Human Rights
- Publisher
- Informa UK Limited
- Published
- 2020-03-25
- Volume
- 24
- Issue
- 10
- Pages
- 1572-1593
- ISSN
- 1364-2987 (ISSN-L)
- 1744-053X
- OpenAlex
- W3013880603
- Cited by
- 267
- References
- 0
- Citations by year
- 2026: 29 · 2025: 32 · 2024: 48 · 2023: 94 · 2022: 34 · 2021: 22 · 2020: 7
- FWCI
- 53.42
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- The International Journal of Human Rights (publishedVersion, cc-by-nc-nd)
- arXiv (Cornell University) (submittedVersion)
- Radboud Repository (Radboud University) (submittedVersion)
- Radboud Repository (Radboud University) (submittedVersion, other-oa)
- arXiv (Cornell University)
- Funders
- EU Marie Curie individual grant (7485 14, PROFILE)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Social Sciences › Law › Digitalization, Law, and Regulation
- Social Sciences › Law › Discrimination and Equality Law
- Keywords
- algorithmic discrimination, artificial intelligence, algorithmic decision-making, anti-discrimination law, indirect discrimination, data protection law, legal protection, human rights, law enforcement, sector-specific regulation, European Union law
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Strengthening legal protection against discrimination by algorithms and artificial intelligence. https://app.cochat.ai/papers/10.1080/13642987.2020.1743976
- The paper
- Zuiderveen Borgesius, F. J. (2020). Strengthening legal protection against discrimination by algorithms and artificial intelligence. The International Journal of Human Rights. https://doi.org/10.1080/13642987.2020.1743976
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.