PreprintCited by 359Ethics and Social Impacts of AIExplainable Artificial Intelligence (XAI)Privacy-Preserving Technologies in Data

The DOI matches its DataCite record; 13 of the 14 references it cites were found in a registry or an index.

Avoiding Discrimination through Causal Reasoning

Open access

Kilbertus, Niki, Rojas-Carulla, Mateo, Parascandolo, Giambattista, Hardt, Moritz, Janzing, Dominik, Schölkopf, Bernhard·2017·arXiv

DOI 10.48550/arxiv.1706.02744arXiv 1706.02744

Open this paper in CoChat — free account Open PDF

Abstract

Recent work on fairness in machine learning has focused on various statistical discrimination criteria and how they trade off. Most of these criteria are observational: They depend only on the joint distribution of predictor, protected attribute, features, and outcome. While convenient to work with, observational criteria have severe inherent limitations that prevent them from resolving matters of fairness conclusively. Going beyond observational criteria, we frame the problem of discrimination based on protected attributes in the language of causal reasoning. This viewpoint shifts attention from "What is the right fairness criterion?" to "What do we want to assume about the causal data generating process?" Through the lens of causality, we make several contributions. First, we crisply articulate why and when observational criteria fail, thus formalizing what was before a matter of opinion. Second, our approach exposes previously ignored subtleties and why they are fundamental to the problem. Finally, we put forward natural causal non-discrimination criteria and develop algorithms that satisfy them.

Integrity signals

Registry

DataCite · 10.48550/arxiv.1706.02744

Cites

13 of 13 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

The central role of the propensity score in observational studies for causal effects
ROSENBAUM, P. R., & RUBIN, D. B. (1983) · Biometrika · doi:10.1093/biomet/70.1.41 · Cited by 31,241
Fairness through awareness
Dwork, C., Hardt, M., Pitassi, T., Reingold, O., & Zemel, R. (2012) · Proceedings of the 3rd Innovations in Theoretical Computer Science Conference · doi:10.1145/2090236.2090255 · Cited by 3,501
Self-citation
Equality of Opportunity in Supervised Learning
Hardt, M., Price, E., & Srebro, N. (2016) · arXiv · doi:10.48550/arxiv.1610.02413 · Cited by 2,536
Self-citation
Instrumental Variables and the Search for Identification: From Supply and Demand to Natural Experiments
Angrist, J. D., & Krueger, A. B. (2001) · Journal of Economic Perspectives · doi:10.1257/jep.15.4.69 · Cited by 2,355
Fair prediction with disparate impact: a study of bias in recidivism prediction instruments
Chouldechova, A. (2017) · Big Data · doi:10.1089/big.2016.0047 · Cited by 2,159
Certifying and Removing Disparate Impact
Feldman, M., Friedler, S. A., Moeller, J., Scheidegger, C., & Venkatasubramanian, S. (2015) · Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2783258.2783311 · Cited by 1,827
Sex Bias in Graduate Admissions: Data from Berkeley: Measuring bias is harder than is usually assumed, and the evidence is sometimes contrary to expectation.
Bickel, P. J., Hammel, E. A., & O'Connell, J. W. (1975) · Science · doi:10.1126/science.187.4175.398 · Cited by 659
Fairness Beyond Disparate Treatment & Disparate Impact: Learning Classification without Disparate Mistreatment
Zafar, M. B., Valera, I., Gomez Rodriguez, M., & Gummadi, K. P. (2017) · Proceedings of the 26th International Conference on World Wide Web · doi:10.1145/3038912.3052660 · Cited by 632
On the Causal Interpretation of Race in Regressions Adjusting for Confounding and Mediating Variables
VanderWeele, T. J., & Robinson, W. R. (2014) · Epidemiology · doi:10.1097/ede.0000000000000105 · Cited by 567
On the (im)possibility of fairness
Friedler, S. A., Scheidegger, C., & Venkatasubramanian, S. (2016) · arXiv · doi:10.48550/arxiv.1609.07236 · Cited by 247

Show all 14 references

Sorted by citations

Items 301–359 of 359

Correspondences between Privacy and Nondiscrimination: Why They Should Be Studied Together
Datta, A., Sen, S., & Tschantz, M. C. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1808.01735 · Cited by 4
State of the Art in Fair ML: From Moral Philosophy and Legislation to Fair ClassifiersPreprint
Baumann, E., & Rumberger, J. L. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1811.09539 · Cited by 4
Affirmative Action Policies for Top-k Candidates Selection, With an Application to the Design of Policies for University AdmissionsPreprint
Mathioudakis, M., Castillo, C., Barnabò, G., & Celis, S. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.09947 · Cited by 5
Eliminating Latent Discrimination: Train Then MaskPreprint
Ghili, S., Kazemi, E. M., & Karbasi, A. (2019) · SSRN Electronic Journal · doi:10.2139/ssrn.3309776 · Cited by 3
Fairness Through Causal Awareness: Learning Latent-Variable Models for Biased DataPreprint
Madras, D., Creager, E., Pitassi, T., & Zemel, R. S. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1809.02519 · Cited by 6
Fairness criteria through the lens of directed acyclic graphical modelsPreprint
Baer, B. R., Gilbert, D. E., & Wells, M. T. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.11333 · Cited by 3
Improving Fair Predictions Using Variational Inference In Causal ModelsPreprint
Helwegen, R., Louizos, C., & Forré, P. D. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2008.10880 · Cited by 3
Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing: Tutorial Abstracts
(2022) · doi:10.18653/v1/2022.emnlp-tutorials · Cited by 3
Agent Incentives: A Causal Perspective
Everitt, T., Carey, R., Langlois, E. D., Ortega, P. A., & Legg, S. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i13.17368 · Cited by 2
Counterfactual Situation Testing: From Single to Multidimensional Discrimination
Álvarez, J. M., & Ruggieri, S. (2025) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.17935 · Cited by 4
Multi-dimensional Causality Fairness Learning
Su, C., Yu, G., Wang, J., Guo, W., Zheng, Y., & Domeniconi, C. (2025) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2025.3566011 · Cited by 2
Mitigate discrimination caused by data bias: Learning fair representations with information reinforcement via recurrent encoding
Cai, J., & Zhu, F. (2025) · Expert Systems with Applications · doi:10.1016/j.eswa.2025.129379 · Cited by 2
Fair Multivariate Adaptive Regression Splines for Ensuring Equity and Transparency
Haghighat, P., Gándara, D., Kang, L., & Anahideh, H. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i20.30211 · Cited by 5
MobilityMirror: Bias-Adjusted Transportation Datasets
Rodriguez, L., Salimi, B., Ping, H., Stoyanovich, J., & Howe, B. (2019) · Communications in computer and information science · doi:10.1007/978-3-030-11238-7_2 · Cited by 2
On Learning and Testing of Counterfactual Fairness through Data Preprocessing
Chen, H., Lu, W., Song, R., & Ghosh, P. (2023) · Journal of the American Statistical Association · doi:10.1080/01621459.2023.2186885 · Cited by 6
Investigating the Legality of Bias Mitigation Methods in the United Kingdom
Jorgensen, M., Waller, M., Cocarascu, O., Criado, N., Rodrigues, O., Such, J. M., & Black, E. (2023) · IEEE Technology and Society Magazine · doi:10.1109/mts.2023.3341465 · Cited by 4
Visual Analysis for Spatio-Temporal Event Correlation in Manufacturing
Herr, D., Kurzhals, K., & Ertl, T. (2020) · Hawaii International Conference on System Sciences (HICSS) · doi:10.24251/hicss.2020.164 · Cited by 2
Assessing Disparate Impacts of Personalized Interventions: Identifiability and BoundsPreprint
Kallus, N., & Zhou, A. (2019) · RePEc: Research Papers in Economics · doi:10.48550/arxiv.1906.01552 · Cited by 7
Probabilistic Verification of Fairness Properties via ConcentrationPreprint
Bastani, O., Zhang, X., & Solar-Lezama, A. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1812.02573 · Cited by 2
Fair inference on error-prone outcomesPreprint
Boeschoten, L., van Kesteren, E., Bagheri, A., & Oberski, D. L. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.07621 · Cited by 2
Fairness Constraints in Semi-supervised LearningPreprint
Zhang, T., Zhu, T., Han, M., Li, J., Zhou, W., & Yu, P. S. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2009.06190 · Cited by 7
HOLMES: A Platform for Detecting Malicious Inputs in Secure Collaborative ComputationPreprint
Chen, W., Sotiraki, K., Chang, I., Kantarcıoğlu, M., & Popa, R. A. (2021) · IACR Cryptology ePrint Archive · Cited by 2
5th International Conference on Advanced Research Methods and Analytics (CARMA 2023)
CARMA Scientific Committee, Torres, M. D. R. M., & Toral, S. L. (2023) · doi:10.4995/carma2023.2023.17009 · Cited by 2
Selection Bias in Insurance: Why Portfolio-Specific Fairness Fails to Extend Market-WidePreprint
Côté, M., eacute, O. C. O. T., & Arthur Charpentier, A. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.5018749 · Cited by 2
Individual Fairness for Fuzzy C-Means Clustering
Yang, Z., Yan, B., Zheng, J., Tang, Y., Qian, C., & Zhang, H. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10888003 · Cited by 1
Removing algorithmic discrimination (with minimal individual error)
El-Mhamdi, E.-M., Guerraoui, R., Hoang, L. N., & Maurer, A. (2022) · Theoretical Computer Science · doi:10.1016/j.tcs.2022.04.051 · Cited by 3
Fairness and equity in resource allocation and decision-making
Monachou, F., & Stoica, A.-A. (2022) · ACM SIGecom Exchanges · doi:10.1145/3572885.3572891 · Cited by 1
GroupMixNorm Layer for Learning Fair Models
Pandey, A., Rai, A., Singh, M., Bhatt, D., & Bhowmik, T. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-33374-3_41 · Cited by 1
I Prefer Not to Say: Protecting User Consent in Models with Optional Personal Data
Leemann, T., Pawelczyk, M., Eberle, C. T., & Kasneci, G. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i19.30126 · Cited by 2
Fairness in machine learning with tractable models
Varley, M., & Belle, V. (2021) · Knowledge-Based Systems · doi:10.1016/j.knosys.2020.106715 · Cited by 2
Provably training overparameterized neural network classifiers with non-convex constraints
Chen, Y.-L., Wang, Z., & Kolar, M. (2022) · Electronic Journal of Statistics · doi:10.1214/22-ejs2036 · Cited by 3
Towards an Integrated Approach for Preserving Data Utility, Privacy and Fairness
Bargh, M. S., & Choenni, S. (2022) · 2018 International Conference on Multidisciplinary Research · doi:10.26803/myres.2022.24 · Cited by 1
CausalNLP Tutorial: An Introduction to Causality for Natural Language Processing
Jin, Z., Feder, A., & Zhang, K. (2022) · doi:10.18653/v1/2022.emnlp-tutorials.4 · Cited by 1
In Defense of Synthetic DataPreprint
Rodriguez, L., & Howe, B. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.01351 · Cited by 6
An example of prediction which complies with Demographic Parity and equalizes group-wise risks in the context of regressionPreprint
Chzhen, E., & Schreuder, N. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2011.07158 · Cited by 2
Fairness-guided SMT-based Rectification of Decision Trees and Random ForestsPreprint
Zhang, J., Beschastnikh, I., Mechtaev, S., & Roychoudhury, A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2011.11001 · Cited by 1
Beyond traditional assumptions in fair machine learningPreprint
Kilbertus, N. (2020) · arXiv (Cornell University) · doi:10.17863/cam.59055 · Cited by 1
Self-citation
Interrogating AI Bias through Digital Art
Zinn, Z. (2022) · doi:10.35650/jt.3039.d.2022 · Cited by 1
Assessing Algorithm Fairness Requires Adjustment for Risk Distribution Differences: Re-considering the Equal Opportunity CriterionPreprint
Hegarty, S. E., Linn, K. A., Zhang, H., Teeple, S., Albert, P. S., Parikh, R. B., Courtright, K. R., Kent, D. M., & Chen, J. (2025) · medRxiv · doi:10.1101/2025.01.31.25321489 · Cited by 2
Fairness through Equality of EffortPreprint
Huang, W. Q., Wu, Y., Zhang, L., & Wu, X. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1911.08292
Slice Tuner: A Selective Data Acquisition Framework for Accurate and Fair Machine Learning ModelsPreprint
Tae, K. H., & Whang, S. E. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.04549
Shortcomings of Counterfactual Fairness and a Proposed ModificationPreprint
Beigang, F. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2011.07312
Fair Learning: an optimal transport based approach
Gordaliza, P. (2020) · UVaDOC UVaDOC University of Valladolid Documentary Repository (University of Valladolid) · doi:10.35376/10324/43392
An Information-Theoretic Measure for Enabling Category Exemptions with an Application to Filter Bubbles
Jiang, C., Wu, B., Dutta, S., & Grover, P. (2021) · Communications in computer and information science · doi:10.1007/978-3-030-78818-6_11
Avaliação de Discriminação em Aprendizagem de Máquina usando Técnicas de Interpretabilidade.
Cesaro, J. (2020) · doi:10.11606/d.3.2020.tde-31052021-114333
Impact Remediation: Optimal Interventions to Reduce InequalityPreprint
Bynum, L., Loftus, J. R., & Stoyanovich, J. (2021) · arXiv (Cornell University)
Causal Regularization Using Domain Priors.Preprint
Reddy, A. G., Kancheti, S. S., Balasubramanian, V. N., & Sharma, A. K. (2021) · arXiv (Cornell University)
Questioning causality on sex, gender and COVID-19, and identifying bias in large-scale data-driven analyses: the Bias Priority Recommendations and Bias Catalog for PandemicsPreprint
Díaz-Rodríguez, N., Binkytė-Sadauskienė, R., Bakkali, W., Bookseller, S., Tubaro, P., Bacevičius, A., & Chatila, R. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2104.14492 · Cited by 1
Artificial Intelligence Accountability in Emergent Applications
Zini, J. E. (2023) · Advances in computer and electrical engineering book series · doi:10.4018/978-1-6684-6937-8.ch002
Validation of Risk Management Models for Financial Institutions
Lynch, D., Hasan, I., Siddique, A., Ng, V. K., Iercosan, D., Shcherbakova, A., McArthur, D., Alper, R., Potì, V., Campobasso, F., et al. (2023) · Cambridge University Press eBooks · doi:10.1017/9781108608602 · Cited by 3
Common Elements in Validation of Risk Models Used in Financial Institutions
Lynch, D., Hasan, I., & Siddique, A. R. (2023) · Cambridge University Press eBooks · doi:10.1017/9781108608602.002
Fairness Audits and Debiasing Using \pkg{mlr3fairness}
Pfisterer, F., Wei, S., Vollmer, S. J., Lang, M., & Bischl, B. (2023) · The R Journal · doi:10.32614/rj-2023-034
Exploring Fairness Interpretability with FairnessFriend: A Chatbot Solution
Criscuolo, C., & Dolci, T. (2024) · IEEE International Conference on Data Engineering Workshops (ICDEW) · doi:10.1109/icdew61823.2024.00037
Relative Impact of Pedestrian's Age and Gender on Ethical Decisions of Autonomous Vehicles: Insights from Neuro-Behavioral AnalysisPreprint
Maksimenko, V., Pandey, H., & Bansal, P. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.5047138
Automated Data Bias Mitigation Technique for Algorithmic Fairness
Shi, J. M., & Rong, C. (2025) · The European Journal on Artificial Intelligence · doi:10.1177/30504554251328351
WITHDRAWN: Balancing Fairness and Accuracy in the Development of Trustworthy AI SystemsPreprint
Rana, S. A., Azizul, Z. H., & Awan, A. A. (2025) · Research Square · doi:10.21203/rs.3.rs-7092710/v1
DPTree and DPForest: tree-based methods fulfilling demographic parity
Simon, P.-A., Denuit, M. M., & Trufin, J. (2025) · Annals of Actuarial Science · doi:10.1017/s1748499525100092
Technical fairness and social legitimacy: a conceptual mapping of algorithmic fairness, procedural justice, and explainable AI
Perdana, A. (2026) · AI and Ethics · doi:10.1007/s43681-026-01342-6
Feature relevance quantification in explainable AI: A causal problem
Janzing, D., Minorics, L., & Blöbaum, P. (2019) · arXiv · doi:10.48550/arxiv.1910.13413 · Cited by 207
Self-citation

Authors: Kilbertus, N., Rojas-Carulla, M., Parascandolo, G., Hardt, M., Janzing, D., & Schölkopf, B.
Affiliations: Max Planck Society (DE)
ORCID: Kilbertus, Niki
Hardt, Moritz
Schölkopf, Bernhard
Venue: arXiv
Publisher: arXiv
Published: 2017
ISSN: 2331-8422 (ISSN-L)
DOI: 10.48550/arxiv.1706.02744
arXiv: 1706.02744
OpenAlex: W2624319794
Cited by: 358
References: 14
Citations by year: 2026: 1 · 2025: 17 · 2024: 19 · 2023: 36 · 2022: 39 · 2021: 70 · 2020: 78 · 2019: 65 · 2018: 26 · 2017: 7
Type: posted content
Language: en
Open access: green
arxiv.org
Licence: arxiv.org/licenses/nonexclusive-distrib/1.0/
Locations: arXiv (Cornell University) (submittedVersion)
MPG.PuRe (Max Planck Society) (submittedVersion)
arXiv (Cornell University)
Topics: Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
Physical Sciences › Computer Science › Artificial Intelligence › Privacy-Preserving Technologies in Data
Keywords: algorithmic fairness, discrimination, protected characteristics, causal reasoning

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Avoiding Discrimination through Causal Reasoning

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Citations

Cites

Cited by

Related

Metadata

Record

About these checks