Discrimination in the age of artificial intelligence
Open accessThe DOI matches its Crossref record; 13 of the 13 references it cites were found in a registry or an index.
Abstract
In this paper, I examine whether the use of artificial intelligence (AI) and automated decision-making (ADM) aggravates issues of discrimination as has been argued by several authors. For this purpose, I first take up the lively philosophical debate on discrimination and present my own definition of the concept. Equipped with this account, I subsequently review some of the recent literature on the use AI/ADM and discrimination. I explain how my account of discrimination helps to understand that the general claim in view of the aggravation of discrimination is unwarranted. Finally, I argue that the use of AI/ADM can, in fact, increase issues of discrimination, but in a different way than most critics assume: it is due to its epistemic opacity that AI/ADM threatens to undermine our moral deliberation which is essential for reaching a common understanding of what should count as discrimination. As a consequence, it turns out that algorithms may actually help to detect hidden forms of discrimination.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Dissecting racial bias in an algorithm used to manage the health of populations
Obermeyer, Z., Powers, B., Vogeli, C., & Mullainathan, S. (2019) · Science · doi:10.1126/science.aax2342 · Cited by 7,137
The ethics of algorithms: Mapping the debate
Mittelstadt, B. D., Allo, P., Taddeo, M., Wachter, S., & Floridi, L. (2016) · Big Data & Society · doi:10.1177/2053951716679679 · Cited by 4,567
The Black Box Society: The Secret Algorithms That Control Money and Information
Pasquale, F. (2015) · doi:10.4159/harvard.9780674736061 · Cited by 3,796
Barocas, S., & Selbst, A. D. (2014) · doi:10.2139/ssrn.2477899 · Cited by 3,048
The Black Box Society: The Secret Algorithms That Control Money and Information
(2016) · Contemporary Sociology: A Journal of Reviews · doi:10.1177/0094306116641409c · Cited by 1,334
Algorithmic Bias in Autonomous Systems
Danks, D., & London, A. J. (2017) · Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2017/654 · Cited by 472 · cited 4×
“…the issue of “discrimination in the age of algorithms” (Kleinberg et al. 2018) has become an intensively debated topic (cf. e.g. Zliobaite 2017; Danks and London 2017; Chander 2017; Kim 2017; Gillis and Spiess 2018; Lee 2018; Williams et al. 2018; Gangadharan and Niklas 2019; Obermeyer et…”
BackgroundMethodInfluentialDiscrimination in the Age of Algorithms
Kleinberg, J., Ludwig, J., Mullainathan, S., & Sunstein, C. R. (2018) · Journal of Legal Analysis · doi:10.1093/jla/laz001 · Cited by 401
The Intuitive Appeal of Explainable Machines
Selbst, A. D., & Barocas, S. (2018) · doi:10.2139/ssrn.3126971 · Cited by 392
The philosophical novelty of computer simulation methods
Humphreys, P. (2009) · Synthese · doi:10.1007/s11229-008-9435-2 · Cited by 362
Measuring discrimination in algorithmic decision making
Žliobaitė, I. (2017) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-017-0506-1 · Cited by 272 · cited 2×
“2018) has become an intensively debated topic (cf. e.g. Zliobaite 2017; Danks and London 2017; Chander 2017; Kim 2017; Gillis and Spiess 2018; Lee 2018; Williams et al.”
BackgroundFrom individual to group privacy in big data analytics
Mittelstadt, B. (2017) · Philosophy & Technology · doi:10.1007/s13347-017-0253-7 · Cited by 184
Discrimination, artificial intelligence, and algorithmic decision-making
Borgesius, F. Z. (2025) · arXiv · doi:10.48550/arxiv.2510.13465 · Cited by 152
Chander, A. (2017) · Michigan Law Review · doi:10.36644/mlr.115.6.racist · Cited by 105
Cited by
Unveiling the shadows: beyond the hype of AI in education
Al-Zahrani, A. M. (2024) · Heliyon · doi:10.1016/j.heliyon.2024.e30696 · Cited by 225
“Issues of algorithmic bias and discrimination present another significant challenge [26 – 33].”
BackgroundArtificial intelligence and work: a critical review of recent research from the social sciences
Deranty, J.-P., & Corbin, T. (2024) · AI & SOCIETY · doi:10.1007/s00146-022-01496-x · Cited by 118
“…biases and reproduce discriminatory practices at work, whether the discrimination is built into the algorithms, or management’s use of the algorithm, or as a result of customer’s rating of workers (Noble 2018; Benjamin 2019; Kellogg et al. 2020; Akter et al. 2021; Zajko 2021; Heinrichs 2022).”
Enactive artificial intelligence: subverting gender norms in human-robot interaction
Hipólito, I., Winkle, K., & Lie, M. (2023) · Frontiers in Neurorobotics · doi:10.3389/fnbot.2023.1149303 · Cited by 27
“AI design is not neutral, but rather serves a dominant narrative (Adam, 1996; Thieullent et al., 2016; Fosch-Villaronga et al., 2020; Heinrichs, 2022; Hipólito, 2023); particularly evident in research conducted on algorithmic, machine learning, and datasets bias (Birhane, 2021; Birhane et al.”
BackgroundWaterfield, D. A., Ferreira de Vasconcellos, J., Crawford, M., Doyle, M., Taggart, J., Bayraktar, B., & Henry, D. (2026) · Journal of Special Education Technology · doi:10.1177/01626434261454347 · Cited by 2
Metadata
- Authors
- Heinrichs, B.
- Venue
- AI & SOCIETY
- Published
- 2021-04-04
- Volume
- 37
- Issue
- 1
- Pages
- 143-154
- ISSN
- 0951-5666 (ISSN-L)
- 1435-5655
- OpenAlex
- W3148471254
- Cited by
- 120
- References
- 13
- FWCI
- 28.12
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.