Avoiding Discrimination through Causal Reasoning

Kilbertus, Niki; Rojas-Carulla, Mateo; Parascandolo, Giambattista; Hardt, Moritz; Janzing, Dominik; Schölkopf, Bernhard

doi:10.48550/arxiv.1706.02744

PreprintCited by 359Ethics and Social Impacts of AIExplainable Artificial Intelligence (XAI)Privacy-Preserving Technologies in Data

Avoiding Discrimination through Causal Reasoning

Open access

Kilbertus, Niki, Rojas-Carulla, Mateo, Parascandolo, Giambattista, Hardt, Moritz, Janzing, Dominik, Schölkopf, Bernhard·2017·arXiv

DOI 10.48550/arxiv.1706.02744arXiv 1706.02744

Open this paper in CoChat — free account Open PDF

Abstract

Recent work on fairness in machine learning has focused on various statistical discrimination criteria and how they trade off. Most of these criteria are observational: They depend only on the joint distribution of predictor, protected attribute, features, and outcome. While convenient to work with, observational criteria have severe inherent limitations that prevent them from resolving matters of fairness conclusively. Going beyond observational criteria, we frame the problem of discrimination based on protected attributes in the language of causal reasoning. This viewpoint shifts attention from "What is the right fairness criterion?" to "What do we want to assume about the causal data generating process?" Through the lens of causality, we make several contributions. First, we crisply articulate why and when observational criteria fail, thus formalizing what was before a matter of opinion. Second, our approach exposes previously ignored subtleties and why they are fundamental to the problem. Finally, we put forward natural causal non-discrimination criteria and develop algorithms that satisfy them.

Integrity signals

Registry

DataCite · 10.48550/arxiv.1706.02744

Cites

13 of 13 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Observational fairness criteria have inherent limitations such as indistinguishability but are appealing because of their ease of use.
“Although observational fairness criteria have inherent limitations (Kilbertus et al. 2017;Barocas, Hardt, and Narayanan 2019) such as indistinguishability, these criteria are appealing because of their ease of use.”
From Antidiscrimination Insurance Pricing: Regulations, Fairness Criteria, and Models (2024) · cites this paper as Kilbertus et al. 2017
Causal approaches can help resolve conceptual roadblocks in fairness evaluation since they allow formalizing what makes observations similar.
“Causal approaches can help to resolve these conceptual roadblocks since they allow to formalize the meaning of what makes observations similar [16].”
From Under the Radar -- Auditing Fairness in ML for Humanitarian Mapping (2021) · cites this paper as [16]

The central role of the propensity score in observational studies for causal effects
ROSENBAUM, P. R., & RUBIN, D. B. (1983) · Biometrika · doi:10.1093/biomet/70.1.41 · Cited by 31,241 · see citing works
Fairness through awareness
Dwork, C., Hardt, M., Pitassi, T., Reingold, O., & Zemel, R. (2012) · Proceedings of the 3rd Innovations in Theoretical Computer Science Conference · doi:10.1145/2090236.2090255 · Cited by 3,501 · see citing works
Self-citation
Equality of Opportunity in Supervised Learning
Hardt, M., Price, E., & Srebro, N. (2016) · arXiv · doi:10.48550/arxiv.1610.02413 · Cited by 2,536 · see citing works
Self-citation
Instrumental Variables and the Search for Identification: From Supply and Demand to Natural Experiments
Angrist, J. D., & Krueger, A. B. (2001) · Journal of Economic Perspectives · doi:10.1257/jep.15.4.69 · Cited by 2,355 · see citing works
Fair prediction with disparate impact: a study of bias in recidivism prediction instruments
Chouldechova, A. (2017) · Big Data · doi:10.1089/big.2016.0047 · Cited by 2,159 · see citing works
Certifying and Removing Disparate Impact
Feldman, M., Friedler, S. A., Moeller, J., Scheidegger, C., & Venkatasubramanian, S. (2015) · Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2783258.2783311 · Cited by 1,827 · see citing works
Sex Bias in Graduate Admissions: Data from Berkeley: Measuring bias is harder than is usually assumed, and the evidence is sometimes contrary to expectation.
Bickel, P. J., Hammel, E. A., & O'Connell, J. W. (1975) · Science · doi:10.1126/science.187.4175.398 · Cited by 659 · see citing works
Fairness Beyond Disparate Treatment & Disparate Impact: Learning Classification without Disparate Mistreatment
Zafar, M. B., Valera, I., Gomez Rodriguez, M., & Gummadi, K. P. (2017) · Proceedings of the 26th International Conference on World Wide Web · doi:10.1145/3038912.3052660 · Cited by 632 · see citing works
On the Causal Interpretation of Race in Regressions Adjusting for Confounding and Mediating Variables
VanderWeele, T. J., & Robinson, W. R. (2014) · Epidemiology · doi:10.1097/ede.0000000000000105 · Cited by 567 · see citing works
On the (im)possibility of fairness
Friedler, S. A., Scheidegger, C., & Venkatasubramanian, S. (2016) · arXiv · doi:10.48550/arxiv.1609.07236 · Cited by 247 · see citing works
Exposing the probabilistic causal structure of discrimination
Bonchi, F., Hajian, S., Mishra, B., & Ramazzotti, D. (2017) · International Journal of Data Science and Analytics · doi:10.1007/s41060-016-0040-z · Cited by 86 · see citing works
Fairness in Criminal Justice Risk Assessments: The State of the ArtPreprint
Berk, R. A., Heidari, H., Jabbari, S., Kearns, M. J., & Roth, A. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1703.09207 · Cited by 34 · see citing works
Causal Discrimination Discovery Through Propensity Score Analysis.Preprint
Qureshi, B. M., Kamiran, F., Karim, A., & Ruggieri, S. (2016) · arXiv (Cornell University) · Cited by 12 · see citing works

Flagged first, then by citations

1 of the 14 references couldn’t be matched to a known paper.

Sorted by citations

A Survey on Bias and Fairness in Machine Learning
Mehrabi, N., Morstatter, F., Saxena, N., Lerman, K., & Galstyan, A. (2022) · ACM Computing Surveys · doi:10.1145/3457607 · Cited by 5,812 · see citing works
Toward Causal Representation Learning
Scholkopf, B., Locatello, F., Bauer, S., Ke, N. R., Kalchbrenner, N., Goyal, A., & Bengio, Y. (2021) · Proceedings of the IEEE · doi:10.1109/jproc.2021.3058954 · Cited by 1,170 · see citing works
Self-citation
Fairness definitions explained
Verma, S., & Rubin, J. (2018) · Proceedings of the International Workshop on Software Fairness · doi:10.1145/3194770.3194776 · Cited by 1,124 · see citing works
Counterfactual Fairness
Kusner, M. J., Loftus, J. R., Russell, C., & Silva, R. (2017) · arXiv · doi:10.48550/arxiv.1703.06856 · Cited by 995 · see citing works
Algorithmic Fairness: Choices, Assumptions, and Definitions
Mitchell, S., Potash, E., Barocas, S., D'Amour, A., & Lum, K. (2021) · Annual Review of Statistics and Its Application · doi:10.1146/annurev-statistics-042720-125902 · Cited by 687 · see citing works
Fairness of Exposure in Rankings
Singh, A., & Joachims, T. (2018) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3219819.3220088 · Cited by 607 · see citing works
Towards a standard for identifying and managing bias in artificial intelligence
Schwartz, R., Vassilev, A., Greene, K., Perine, L., Burt, A., & Hall, P. (2022) · doi:10.6028/nist.sp.1270 · Cited by 548 · see citing works
“ination can arise from the encoding of spurious correlations and noisy local dependencies into ML systems during training, there is currently great focus on causal tools [210] and how they can formally incorporate effects of hypothetical actions to solve a wide range of fairness modeling problems.”
Background
Fairness in machine learning: A survey
Caton, S., & Haas, C. (2024) · ACM Computing Surveys · doi:10.1145/3616865 · Cited by 646 · see citing works
Mitigating Gender Bias in Natural Language Processing: Literature Review
Sun, T., Gaut, A., Tang, S., Huang, Y., ElSherief, M., Zhao, J., Mirza, D., Belding, E., Chang, K.-W., & Wang, W. Y. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1159 · Cited by 492 · see citing works
Causal Interpretations of Black-Box Models
Zhao, Q., & Hastie, T. J. (2019) · Journal of Business and Economic Statistics · doi:10.1080/07350015.2019.1624293 · Cited by 465 · see citing works
The Measure and Mismeasure of Fairness
Corbett-Davies, S., Gaebler, J. D., Nilforoshan, H., Shroff, R., & Goel, S. (2018) · arXiv · doi:10.48550/arxiv.1808.00023 · Cited by 444 · see citing works
Examining Gender and Race Bias in Two Hundred Sentiment Analysis Systems
Kiritchenko, S., & Mohammad, S. (2018) · Proceedings of the Seventh Joint Conference on Lexical and Computational Semantics · doi:10.18653/v1/s18-2005 · Cited by 384 · see citing works
Causality for Machine Learning
Schölkopf, B. (2022) · ACM eBooks · doi:10.1145/3501714.3501755 · Cited by 442 · see citing works
Self-citation
Recent Advancements in Emerging Technologies for Healthcare Management Systems: A Survey
Junaid, S. B., Imam, A. A., Balogun, A. O., Silva, L. C. D., Surakat, Y. A., Kumar, G., Abdulkarim, M., Shuaibu, A. N., Garba, A., Sahalu, Y., et al. (2022) · Healthcare · doi:10.3390/healthcare10101940 · Cited by 398 · see citing works
A snapshot of the frontiers of fairness in machine learning
Chouldechova, A., & Roth, A. (2020) · Communications of the ACM · doi:10.1145/3376898 · Cited by 362 · see citing works
Bias and Discrimination in AI: A Cross-Disciplinary Perspective
Ferrer, X., Nuenen, T. V., Such, J. M., Cote, M., & Criado, N. (2021) · IEEE Technology and Society Magazine · doi:10.1109/mts.2021.3056293 · Cited by 308 · see citing works
“In the graph, attributes are presented as nodes joined by edges which, by means of equations, represent the relations between attributes [10].”
Background
Algorithmic fairness in education
Kizilcec, R. F., & Lee, H. (2022) · Routledge eBooks · doi:10.4324/9780429329067-10 · Cited by 302 · see citing works
Fairness in Machine Learning
Oneto, L., & Chiappa, S. (2020) · Studies in computational intelligence · doi:10.1007/978-3-030-43883-8_7 · Cited by 315 · see citing works
Gender bias in artificial intelligence
Leavy, S. (2018) · doi:10.1145/3195570.3195580 · Cited by 285 · see citing works
Towards Fairness in Visual Recognition: Effective Strategies for Bias Mitigation
Wang, Z., Qinami, K., Karakozis, I. C., Genova, K., Nair, P., Hata, K., & Russakovsky, O. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00894 · Cited by 284 · see citing works
Counterfactuals and causability in explainable artificial intelligence: Theory, algorithms, and applications
Chou, Y.-L., Moreira, C., Bruza, P., Ouyang, C., & Jorge, J. (2022) · Information Fusion · doi:10.1016/j.inffus.2021.11.003 · Cited by 302 · see citing works
Towards Out-Of-Distribution Generalization: A Survey
Liu, J., Shen, Z., He, Y., Zhang, X., Xu, R., Yu, H., & Cui, P. (2021) · arXiv · doi:10.48550/arxiv.2108.13624 · Cited by 253 · see citing works
Stable learning establishes some common ground between causal inference and machine learning
Cui, P., & Athey, S. C. (2022) · Nature Machine Intelligence · doi:10.1038/s42256-022-00445-z · Cited by 246 · see citing works
Recent Advances in Trustworthy Explainable Artificial Intelligence: Status, Challenges, and Perspectives
Rawal, A., McCoy, J., Rawat, D. B., Sadler, B. M., & Amant, R. S. (2021) · IEEE Transactions on Artificial Intelligence · doi:10.1109/tai.2021.3133846 · Cited by 243 · see citing works
Causal interpretability for machine learning-problems, methods and evaluation
Moraffah, R., Karami, M., Guo, R., Raglin, A., & Liu, H. (2020) · ACM SIGKDD Explorations Newsletter · doi:10.1145/3400051.3400058 · Cited by 238 · see citing works
A Framework for Understanding Unintended Consequences of Machine Learning
Suresh, H., & Guttag, J. V. (2019) · Cited by 229 · see citing works
A clarification of the nuances in the fairness metrics landscape
Castelnovo, A., Crupi, R., Greco, G., Regoli, D., Penco, I., & Cosentini, A. (2021) · Scientific Reports · doi:10.1038/s41598-022-07939-1 · Cited by 283 · see citing works
Causal Inference in Natural Language Processing: Estimation, Prediction, Interpretation and Beyond
Feder, A., Keith, K. A., Manzoor, E., Pryzant, R., Sridhar, D., Wood-Doughty, Z., Eisenstein, J., Grimmer, J., Reichart, R., Roberts, M. E., et al. (2022) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00511 · Cited by 220 · see citing works
Delayed Impact of Fair Machine Learning
Liu, L. T., Dean, S., Rolf, E., Simchowitz, M., & Hardt, M. (2019) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2019/862 · Cited by 236 · see citing works
Self-citation
Uncovering and Mitigating Algorithmic Bias through Learned Latent Structure
Amini, A., Soleimany, A. P., Schwarting, W., Bhatia, S. N., & Rus, D. (2019) · Proceedings of the 2019 AAAI/ACM Conference on AI, Ethics, and Society · doi:10.1145/3306618.3314243 · Cited by 206 · see citing works
Human Perceptions of Fairness in Algorithmic Decision Making: A Case Study of Criminal Risk Prediction
Grgic-Hlaca, N., Redmiles, E. M., Gummadi, K. P., & Weller, A. (2018) · Proceedings of the 2018 World Wide Web Conference on World Wide Web - WWW '18 · doi:10.1145/3178876.3186138 · Cited by 207 · see citing works
Toward Algorithmic Accountability in Public Services: A Qualitative Study of Affected Community Perspectives on Algorithmic Decision-making in Child Welfare Services
Brown, A., Chouldechova, A., Putnam-Hornstein, E., Tobin, A., & Vaithianathan, R. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300271 · Cited by 207 · see citing works
Fairness in Decision-Making — The Causal Explanation Formula
Zhang, J., & Bareinboim, E. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11564 · Cited by 202 · see citing works
Trustworthy ai: A computational perspective
Liu, H., Wang, Y., Fan, W., Liu, X., Li, Y., Jain, S., Liu, Y., Jain, A., & Tang, J. (2023) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3546872 · Cited by 261 · see citing works
Beyond Distributive Fairness in Algorithmic Decision Making: Feature Selection for Procedurally Fair Learning
Grgić-Hlača, N., Zafar, M. B., Gummadi, K. P., & Weller, A. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11296 · Cited by 184 · see citing works
An empirical characterization of fair machine learning for clinical risk prediction
Pfohl, S. R., Foryciarz, A., & Shah, N. H. (2021) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2020.103621 · Cited by 164 · see citing works
Fairness and Explanation in AI-Informed Decision Making
Angerschmid, A., Zhou, J., Theuermann, K., Chen, F., & Holzinger, A. (2022) · Machine Learning and Knowledge Extraction · doi:10.3390/make4020026 · Cited by 161 · see citing works
Empirical Risk Minimization under Fairness ConstraintsPreprint
Donini, M., Oneto, L., Ben-David, S., Shawe-Taylor, J., & Pontil, M. (2018) · Neural Information Processing Systems · doi:10.48550/arxiv.1802.08626 · Cited by 522 · see citing works
Operationalising ethics in artificial intelligence for healthcare: a framework for AI developers
Solanki, P., Grundy, J., & Hussain, W. (2023) · AI and Ethics · doi:10.1007/s43681-022-00195-z · Cited by 157 · see citing works
“Apply causal reasoning to identify and understand and discrimination based on protected attributes [128]”
Background
On Formalizing Fairness in Prediction with Machine LearningPreprint
Gajane, P., & Pechenizkiy, M. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1710.03184 · Cited by 152 · see citing works
Interventional Fairness: Causal Database Repair for Algorithmic Fairness
Salimi, B., Rodriguez, L., Howe, B., & Suciu, D. (2019) · Proceedings of the 2019 International Conference on Management of Data · doi:10.1145/3299869.3319901 · Cited by 145 · see citing works
Towards Personalized Fairness based on Causal Notion
Li, Y., Chen, H., Xu, S., Ge, Y., & Zhang, Y. (2021) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3404835.3462966 · Cited by 145 · see citing works
Avoiding an Oppressive Future of Machine Learning: A Design Theory for Emancipatory assistants
Kane, G. C., Young, A., Majchrzak, A., & Ransbotham, S. (2021) · MIS Quarterly · doi:10.25300/misq/2021/1578 · Cited by 141 · see citing works
The Disparate Effects of Strategic Manipulation
Hu, L. J., Immorlica, N., & Vaughan, J. W. (2019) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3287560.3287597 · Cited by 135 · see citing works
Fairness in Machine Learning: A Survey
Caton, S., & Haas, C. (2020) · arXiv · doi:10.48550/arxiv.2010.04053 · Cited by 646 · see citing works
Reducing Sentiment Bias in Language Models via Counterfactual Evaluation
Huang, P.-S., Zhang, H., Jiang, R., Stanforth, R., Welbl, J., Rae, J., Maini, V., Yogatama, D., & Kohli, P. (2020) · Findings of the Association for Computational Linguistics: EMNLP 2020 · doi:10.18653/v1/2020.findings-emnlp.7 · Cited by 124 · see citing works
Artificial Intelligence and Music: Open Questions of Copyright Law and Engineering Praxis
Sturm, B. L. T., Iglesias, M. T., Ben‐Tal, O., Miron, M., & Gómez, E. (2019) · Arts · doi:10.3390/arts8030115 · Cited by 122 · see citing works
Algorithmic Fairness from a Non-ideal Perspective
Fazelpour, S., & Lipton, Z. C. (2020) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1145/3375627.3375828 · Cited by 119 · see citing works
An empirical study on the perceived fairness of realistic, imperfect machine learning models
Harrison, G., Hanson, J., Jacinto, C., Ramirez, J., & Ur, B. (2020) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3351095.3372831 · Cited by 114 · see citing works
Putting Fairness Principles into Practice: Challenges, Metrics, and Improvements
Beutel, A., Chen, J., Doshi, T., Qian, H., Woodruff, A., Luu, C., Kreitmann, P., Bischof, J., & Chi, E. H. (2019) · Proceedings of the 2019 AAAI/ACM Conference on AI, Ethics, and Society · doi:10.1145/3306618.3314234 · Cited by 111 · see citing works
Racial categories in machine learning
Benthall, S., & Haynes, B. D. (2019) · Proceedings of the Conference on Fairness, Accountability, and Transparency · doi:10.1145/3287560.3287575 · Cited by 110 · see citing works
Algorithmic Fairness
Pessach, D., & Shmueli, E. (2023) · Springer eBooks · doi:10.1007/978-3-031-24628-9_37 · Cited by 177 · see citing works
Fairness through Causal Awareness
Madras, D., Creager, E., Pitassi, T., & Zemel, R. S. (2019) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3287560.3287564 · Cited by 106 · see citing works
Conditional variance penalties and domain shift robustness
Heinze‐Deml, C., & Meinshausen, N. (2020) · Machine Learning · doi:10.1007/s10994-020-05924-1 · Cited by 108 · see citing works
Policy Learning for Fairness in RankingPreprint
Singh, A., & Joachims, T. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1902.04056 · Cited by 102 · see citing works
Managing bias and unfairness in data for decision support: a survey of machine learning and data engineering approaches to identify and mitigate bias and unfairness within data management and analytics systems
Balayn, A., Lofi, C., & Houben, G.-J. (2021) · The VLDB Journal · doi:10.1007/s00778-021-00671-8 · Cited by 98 · see citing works
Fair Class Balancing: Enhancing Model Fairness without Observing Sensitive Attributes
Yan, S., Kao, H.-T., & Ferrara, E. (2020) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3340531.3411980 · Cited by 96 · see citing works
Counterfactual risk assessments, evaluation, and fairness
Coston, A., Mishler, A., Kennedy, E. H., & Chouldechova, A. (2020) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3351095.3372851 · Cited by 90 · see citing works
Fairness in Algorithmic Decision Making: An Excursion Through the Lens of Causality
Khademi, A., Lee, S., Foley, D., & Honavar, V. (2019) · International World Wide Web Conference (WWW) · doi:10.1145/3308558.3313559 · Cited by 87 · see citing works
Explaining Black-Box Algorithms Using Probabilistic Contrastive Counterfactuals
Galhotra, S., Pradhan, R., & Salimi, B. (2021) · ACM SIGMOD International Conference on Management of Data (SIGMOD) · doi:10.1145/3448016.3458455 · Cited by 87 · see citing works
Residual unfairness in fair machine learning from prejudiced data
Kallus, N., & Zhou, A. (2018) · arXiv · doi:10.48550/arxiv.1806.02887 · Cited by 83 · see citing works
A Framework for Understanding Sources of Harm throughout the Machine Learning Life Cycle
Suresh, H., & Guttag, J. (2021) · Equity and Access in Algorithms, Mechanisms, and Optimization · doi:10.1145/3465416.3483305 · Cited by 82 · see citing works
Responsible data management
Stoyanovich, J., Howe, B., & Jagadish, H. V. (2020) · Proceedings of the VLDB Endowment · doi:10.14778/3415478.3415570 · Cited by 82 · see citing works
Bridging Machine Learning and Mechanism Design towards Algorithmic Fairness
Finocchiaro, J., Maio, R., Monachou, F., Patro, G. K., Raghavan, M., Stoica, A.-A., & Tsirtsis, S. (2021) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3442188.3445912 · Cited by 83 · see citing works
REVISE: A Tool for Measuring and Mitigating Bias in Visual Datasets
Wang, A., Liu, A., Zhang, R., Kleiman, A., Kim, L., Zhao, D., Shirai, I., Narayanan, A., & Russakovsky, O. (2022) · International Journal of Computer Vision · doi:10.1007/s11263-022-01625-5 · Cited by 85 · see citing works
Algorithmic Recourse: from Counterfactual Explanations to Interventions
Karimi, A.-H., Schölkopf, B., & Valera, I. (2020) · arXiv · doi:10.48550/arxiv.2002.06278 · Cited by 76 · see citing works
Self-citation
What's sex got to do with machine learning?
Hu, L., & Kohler-Hausmann, I. (2020) · Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency · doi:10.1145/3351095.3375674 · Cited by 74 · see citing works
Fair classification and social welfare
Hu, L. J., & Chen, Y. (2020) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3351095.3372857 · Cited by 75 · see citing works
Human Perceptions of Fairness in Algorithmic Decision Making: A Case Study of Criminal Risk Prediction
Grgić-Hlača, N., Redmiles, E. M., Gummadi, K. P., & Weller, A. (2018) · arXiv · doi:10.48550/arxiv.1802.09548 · Cited by 75 · see citing works
Causal Reasoning for Algorithmic FairnessPreprint
Loftus, J. R., Russell, C., Kusner, M. J., & Silva, R. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1805.05859 · Cited by 110 · see citing works
Counterfactual Fairness: Unidentification, Bound and Algorithm
Wu, Y., Zhang, L., & Wu, X. (2019) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2019/199 · Cited by 73 · see citing works
On the Applicability of Machine Learning Fairness Notions
Makhlouf, K., Zhioua, S., & Catuscia Palamidessi, A. (2021) · ACM SIGKDD Explorations Newsletter · doi:10.1145/3468507.3468511 · Cited by 83 · see citing works
REVISE: A Tool for Measuring and Mitigating Bias in Visual Datasets
Wang, A., Narayanan, A., & Russakovsky, O. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58580-8_43 · Cited by 72 · see citing works
Asymmetric Shapley values: incorporating causal knowledge into model-agnostic explainabilityPreprint
Frye, C., Rowat, C., & Feige, I. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1910.06358 · Cited by 70 · see citing works
Perfectly parallel fairness certification of neural networks
Urban, C., Christakis, M., Wüstholz, V., & Zhang, F. (2020) · Proceedings of the ACM on Programming Languages · doi:10.1145/3428253 · Cited by 62 · see citing works
Detecting Bias with Generative Counterfactual Face Attribute AugmentationPreprint
Denton, E., Hutchinson, B., Mitchell, M., & Gebru, T. (2019) · arXiv (Cornell University) · Cited by 61 · see citing works
Machine learning fairness notions: Bridging the gap with real-world applications
Makhlouf, K., Zhioua, S., & Catuscia Palamidessi, A. (2021) · Information Processing & Management · doi:10.1016/j.ipm.2021.102642 · Cited by 76 · see citing works
Secure and robust machine learning for healthcare: A survey
Qayyum, A., Qadir, J., Bilal, M., & Al-Fuqaha, A. (2021) · IEEE Reviews in Biomedical Engineering · doi:10.1109/rbme.2020.3013489 · Cited by 59 · see citing works
Fairness Through Robustness
Nanda, V., Dooley, S. W., Singla, S., Feizi, S., & Dickerson, J. P. (2021) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3442188.3445910 · Cited by 58 · see citing works
Probabilistic verification of fairness properties via concentration
Bastani, O., Zhang, X., & Solar-Lezama, A. (2019) · Proceedings of the ACM on Programming Languages · doi:10.1145/3360544 · Cited by 57 · see citing works
Creating Fair Models of Atherosclerotic Cardiovascular Disease Risk
Pfohl, S. R., Marafino, B. J., Coulet, A., Rodriguez, F., Palaniappan, L., & Shah, N. (2018) · AAAI/ACM Conference on AI, Ethics, and Society · doi:10.1145/3306618.3314278 · Cited by 79 · see citing works
FairBatch: Batch Selection for Model FairnessPreprint
Roh, Y., Lee, K., Whang, S. E., & Suh, C. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2012.01696 · Cited by 56 · see citing works
On the Fairness of Causal Algorithmic Recourse
Kügelgen, J. V., Karimi, A.-H., Bhatt, U., Valera, I., Weller, A., & Schölkopf, B. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i9.21192 · Cited by 58 · see citing works
Self-citation
The Impact of Explanations on Layperson Trust in Artificial Intelligence–Driven Symptom Checker Apps: Experimental Study
Woodcock, C., Mittelstadt, B., Busbridge, D., & Blank, G. (2021) · Journal of Medical Internet Research · doi:10.2196/29386 · Cited by 57 · see citing works
Fairness in Algorithmic Decision-Making: Applications in Multi-Winner Voting, Machine Learning, and Recommender Systems
Shrestha, Y. R., & Yang, Y. (2019) · Algorithms · doi:10.3390/a12090199 · Cited by 55 · see citing works
On the Fairness of Disentangled RepresentationsPreprint
Locatello, F., Abbati, G., Rainforth, T., Bauer, S., Schölkopf, B., & Bachem, O. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.13662 · Cited by 61 · see citing works
Self-citation
Visual Analysis of Discrimination in Machine Learning
Wang, Q., Xu, Z., Chen, Z., Wang, Y., Liu, S., & Qu, H. (2020) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2020.3030471 · Cited by 54 · see citing works
Interpretable Data-Based Explanations for Fairness Debugging
Pradhan, R., Zhu, J., Glavic, B., & Salimi, B. (2022) · ACM SIGMOD International Conference on Management of Data (SIGMOD) · doi:10.1145/3514221.3517886 · Cited by 54 · see citing works
A Study of Human–AI Symbiosis for Creative Work: Recent Developments and Future Directions in Deep Learning
Mahmud, B. U., Hong, G. Y., & Fong, B. (2022) · ACM Transactions on Multimedia Computing Communications and Applications · doi:10.1145/3542698 · Cited by 63 · see citing works
Fairness in Semi-Supervised Learning: Unlabeled Data Help to Reduce Discrimination
Zhang, T., Zhu, T., Li, J., Han, M., Zhou, W., & Yu, P. S. (2020) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2020.3002567 · Cited by 54 · see citing works
Why Fairness Cannot Be Automated: Bridging the Gap Between EU Non-Discrimination Law and AIPreprint
Wachter, S., Mittelstadt, B., & Russell, C. (2020) · Computer Law and Security Review · doi:10.2139/ssrn.3547922 · Cited by 448 · see citing works
Silva: Interactively Assessing Machine Learning Fairness Using Causality
Yan, J. N., Gu, Z., Lin, H., & Rzeszotarski, J. M. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376447 · Cited by 54 · see citing works
Fairness-Aware Programming
Albarghouthi, A., & Vinitsky, S. (2019) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3287560.3287588 · Cited by 52 · see citing works
AI and Algorithmic Bias: Source, Detection, Mitigation and Implications
Fu, R., Huang, Y. H., & Singh, P. V. (2020) · doi:10.1287/educ.2020.0215 · Cited by 119 · see citing works
Causal Modeling-Based Discrimination Discovery and Removal: Criteria, Bounds, and Algorithms
Zhang, L., Wu, Y., & Wu, X. (2019) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2018.2872988 · Cited by 51 · see citing works
Measuring the Biases that Matter: The Ethical and Casual Foundations for Measures of Fairness in Algorithms
Glymour, B., & Herington, J. (2019) · Proceedings of the Conference on Fairness, Accountability, and Transparency · doi:10.1145/3287560.3287573 · Cited by 50 · see citing works
Fairness in Risk Assessment Instruments
Mishler, A., Kennedy, E. H., & Chouldechova, A. (2021) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3442188.3445902 · Cited by 61 · see citing works
Procedural fairness in algorithmic decision-making: the role of public engagement
Decker, M. C., Wegner, L., & Leicht-Scholten, C. (2024) · Ethics and Information Technology · doi:10.1007/s10676-024-09811-4 · Cited by 56 · see citing works
Fair Regression with Wasserstein Barycenters
Chzhen, E., Denis, C., Hebiri, M., Oneto, L., & Pontil, M. (2020) · arXiv · doi:10.48550/arxiv.2006.07286 · Cited by 46 · see citing works
“…methods that satisfy “fairness” requirements, while still optimizing prediction performance, see for example [5, 10, 13, 16, 17, 20, 22, 24, 25, 27, 32, 45–47 In this paper we study the problem of learning a real-valued regression function which among those complying with the Demographic…”
Method
On Fairness and Calibration
Raghavan, M. (2023) · ACM eBooks · doi:10.1145/3603195.3603207 · Cited by 49 · see citing works

Authors: Kilbertus, N., Rojas-Carulla, M., Parascandolo, G., Hardt, M., Janzing, D., & Schölkopf, B.
Affiliations: Max Planck Society (DE)
ORCID: Kilbertus, Niki
Hardt, Moritz
Schölkopf, Bernhard
Venue: arXiv
Publisher: arXiv
Published: 2017
ISSN: 2331-8422 (ISSN-L)
DOI: 10.48550/arxiv.1706.02744
arXiv: 1706.02744
OpenAlex: W2624319794
Cited by: 358
References: 14
Citations by year: 2026: 1 · 2025: 17 · 2024: 19 · 2023: 36 · 2022: 39 · 2021: 70 · 2020: 78 · 2019: 65 · 2018: 26 · 2017: 7
Type: posted content
Language: en
Open access: green
arxiv.org
Licence: arxiv.org/licenses/nonexclusive-distrib/1.0/
Locations: arXiv (Cornell University) (submittedVersion)
MPG.PuRe (Max Planck Society) (submittedVersion)
arXiv (Cornell University)
Topics: Social Sciences › Safety Research › Ethics and Social Impacts of AI
Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
Physical Sciences › Computer Science › Artificial Intelligence › Privacy-Preserving Technologies in Data
Keywords: algorithmic fairness, discrimination, protected characteristics, causal reasoning

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Avoiding Discrimination through Causal Reasoning

Abstract

Integrity signals

Claims the paper makes

Claims other papers make about this one

Cites

Cited by

Related

Record

About these checks