A Reductions Approach to Fair Classification
Open accessThe DOI matches its DataCite record; 40 of the 40 references it cites were found in a registry or an index.
Abstract
We present a systematic approach for achieving fairness in a binary classification setting. While we focus on two well-known quantitative definitions of fairness, our approach encompasses many other previously studied definitions as special cases. The key idea is to reduce fair classification to a sequence of cost-sensitive classification problems, whose solutions yield a randomized classifier with the lowest (empirical) error subject to the desired constraints. We introduce two reductions that work for any representation of the cost-sensitive classifier and compare favorably to prior baselines on a variety of data sets, while overcoming several of their disadvantages.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Scikit-learn: Machine Learning in Python
Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., Blondel, M., Müller, A., Nothman, J., Louppe, G., et al. (2012) · arXiv · doi:10.48550/arxiv.1201.0490 · Cited by 71,016
UCI Machine Learning Repository
Asuncion, A. (2007) · Medical Entomology and Zoology · Cited by 25,370
A decision-theoretic generalization of on-line learning and an application to boosting
Freund, Y., & Schapire, R. E. (1997) · Journal of Computer and System Sciences · doi:10.1006/jcss.1997.1504 · Cited by 20,466
Rockafellar, R. T. (1970) · Princeton University Press eBooks · doi:10.1515/9781400873173 · Cited by 10,801
Scikit-learn: Machine Learning in Python
(2011) · Journal of Machine Learning Research · doi:10.5555/1953048.2078195 · Cited by 8,539
Dwork, C., Hardt, M., Pitassi, T., Reingold, O., & Zemel, R. (2012) · Proceedings of the 3rd Innovations in Theoretical Computer Science Conference · doi:10.1145/2090236.2090255 · Cited by 3,501
Barocas, S., & Selbst, A. D. (2014) · doi:10.2139/ssrn.2477899 · Cited by 3,048 · cited 1×
“In response to this scrutiny—and driven by ongoing debates and collaborations with lawyers, policy-makers, social scientists, and others (e.g., Barocas & Selbst, 2016)—machine learning researchers have begun to turn their attention to the topic of “fairness in machine learning,” and, in particular,…”
BackgroundEquality of Opportunity in Supervised Learning
Hardt, M., Price, E., & Srebro, N. (2016) · arXiv · doi:10.48550/arxiv.1610.02413 · Cited by 2,536 · cited 6×
“The second group of approaches eliminate the restriction to specific classifier families and treat the underlying classification method as a “black box,” while implementing a wrapper that either works by pre-processing the data or post-processing the classifier’s predictions (e.g., Kamiran & Calders, 2012; Feldman et…”
BackgroundMethodInfluentialFair prediction with disparate impact: a study of bias in recidivism prediction instruments
Chouldechova, A. (2017) · Big Data · doi:10.1089/big.2016.0047 · Cited by 2,159 · cited 2×
“…2017), overall accuracy equality (Berk et al., 2017), and treatment equality (Berk et al., 2017) can all be expressed as equation (1); in contrast, calibration (Kleinberg et al., 2017) and predictive parity (Chouldechova, 2017) cannot because to do so would require the event E j to depend on h .”
BackgroundRademacher and Gaussian Complexities: Risk Bounds and Structural Results
Bartlett, P. L., & Mendelson, S. (2001) · Lecture Notes in Computer Science · doi:10.1007/3-540-44581-1_15 · Cited by 1,949
Research works printed but not linked: 1
- Zafar, M. B., Valera, I., Rodriguez, M. G., and Gummadi, K. P. Fairness constraints: Mechanisms for fair classifica- tion. In Proceedings of the 20th International Conference on Artificial Intelligence and Statistics (AISTATS), pp. 962-970, 2017.
Cited by
Items 101–200 of 1,005
Moment Multicalibration for Uncertainty EstimationPreprint
Jung, C., Lee, C., Pai, M. M., Roth, A., & Vohra, R. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2008.08037 · Cited by 89
We Need Fairness and Explainability in Algorithmic Hiring
Schumann, C., Foster, J. S., Mattei, N., & Dickerson, J. P. (2020) · Adaptive Agents and Multi-Agents Systems · doi:10.65109/yflu4600 · Cited by 91
Wang, A., Ramaswamy, V. V., & Russakovsky, O. (2022) · 2022 ACM Conference on Fairness Accountability and Transparency · doi:10.1145/3531146.3533101 · Cited by 87
Adversarial Bandits with Knapsacks
Immorlica, N., Sankararaman, K. A., Schapire, R. E., & Slivkins, A. (2022) · Journal of the ACM · doi:10.1145/3557045 · Cited by 91
User Fairness, Item Fairness, and Diversity for Rankings in Two-Sided Markets
Wang, L., & Joachims, T. (2021) · ACM SIGIR International Conference on Theory of Information Retrieval (ICTIR) · doi:10.1145/3471158.3472260 · Cited by 90
Adversarial Bandits with Knapsacks
Immorlica, N., Sankararaman, K. A., Schapire, R. E., & Slivkins, A. (2019) · Annual Symposium on Foundations of Computer Science · doi:10.1109/focs.2019.00022 · Cited by 88
Choraś, M., Pawlicki, M., Puchalski, D., & Kozik, R. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-50423-6_46 · Cited by 86
Fairness-aware configuration of machine learning libraries
Tizpaz-Niari, S., Kumar, A., Tan, G., & Trivedi, A. (2022) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/3510003.3510202 · Cited by 86
Fair-AdaBoost: Extending AdaBoost method to achieve fair classification
Huang, X., Li, Z., Jin, Y., & Zhang, W. (2022) · Expert Systems with Applications · doi:10.1016/j.eswa.2022.117240 · Cited by 86
Leveling Down in Computer Vision: Pareto Inefficiencies in Fair Deep Classifiers
Zietlow, D., Lohaus, M., Balakrishnan, G., Kleindeßner, M., Locatello, F., Schölkopf, B., & Russell, C. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01016 · Cited by 86
Model Multiplicity: Opportunities, Concerns, and Solutions
Black, E., Raghavan, M., & Barocas, S. (2022) · 2022 ACM Conference on Fairness Accountability and Transparency · doi:10.1145/3531146.3533149 · Cited by 85
“12Randomized prediction is often used in the fairness literature to ensure that individuals or groups have similar probabilities of receiving an given outcome fromaclassifier [3, 29].”
How fair can we go in machine learning ? Assessing the boundaries of accuracy and fairness
Valdivia, A., Sánchez‐Monedero, J., & Casillas, J. (2021) · International Journal of Intelligent Systems · doi:10.1002/int.22354 · Cited by 85
Training Well-Generalizing Classifiers for Fairness Metrics and Other Data-Dependent ConstraintsPreprint
Cotter, A., Gupta, M. R., Jiang, H., Srebro, N., Sridharan, K., Wang, S., Woodworth, B., & You, S. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1807.00028 · Cited by 84
New Oracle-Efficient Algorithms for Private Synthetic Data ReleasePreprint
Vietri, G., Tian, G., Bun, M., Steinke, T., & Wu, Z. S. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.05453 · Cited by 84
Information-Theoretic Testing and Debugging of Fairness Defects in Deep Neural Networks
Monjezi, V., Trivedi, A., Tan, G., & Tizpaz-Niari, S. (2023) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse48619.2023.00136 · Cited by 83
FR-Train: A Mutual Information-Based Approach to Fair and Robust TrainingPreprint
Roh, Y., Lee, K., Whang, S. E., & Suh, C. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.10234 · Cited by 83
Empirical Risk Minimization under Fairness Constraints
Donini, M., Oneto, L., Ben-David, S., Shawe-Taylor, J. S., & Pontil, M. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1802.08626 · Cited by 82
Pairwise Fairness for Ranking and Regression
Narasimhan, H., Cotter, A., Gupta, M., & Wang, S. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i04.5970 · Cited by 82
Anahideh, H., Asudeh, A., & Thirumuruganathan, S. (2022) · Expert Systems with Applications · doi:10.1016/j.eswa.2022.116981 · Cited by 82
Aitken, M., Toreini, E., Carmichael, P., Coopamootoo, K., Elliott, K., & van Moorsel, A. (2020) · Big Data & Society · doi:10.1177/2053951720908892 · Cited by 82
Two-Player Games for Efficient Non-Convex Constrained OptimizationPreprint
Cotter, A., Jiang, H., & Sridharan, K. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1804.06500 · Cited by 81
Equalized odds postprocessing under imperfect group informationPreprint
Awasthi, P., Kleindeßner, M., & Morgenstern, J. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.03284 · Cited by 81
Improving the Fairness of Deep Generative Models without RetrainingPreprint
Tan, S., Shen, Y., & Zhou, B. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2012.04842 · Cited by 81
Nakao, Y., Strappelli, L., Stumpf, S., Naseer, A., Regoli, D., & Gamba, G. D. (2022) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2022.2067936 · Cited by 80
Trustworthy LLMs: a Survey and Guideline for Evaluating Large Language Models' Alignment
Liu, Y., Yao, Y., Ton, J.-F., Zhang, X., Guo, R., Cheng, H., Klochkov, Y., Taufiq, M. F., & Li, H. (2023) · arXiv · doi:10.48550/arxiv.2308.05374 · Cited by 79
Fair Transfer Learning with Missing Protected Attributes
Coston, A., Ramamurthy, K. N., Wei, D., Varshney, K. R., Speakman, S., Mustahsan, Z., & Chakraborty, S. (2019) · Proceedings of the 2019 AAAI/ACM Conference on AI, Ethics, and Society · doi:10.1145/3306618.3314236 · Cited by 79
SliceLine: Fast, Linear-Algebra-based Slice Finding for ML Model Debugging
Sagadeeva, S., & Böehm, M. (2021) · ACM SIGMOD International Conference on Management of Data (SIGMOD) · doi:10.1145/3448016.3457323 · Cited by 79
Wang, R., Chaudhari, P., & Davatzikos, C. (2023) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2211613120 · Cited by 78
Smith, C. E., Yu, B., Srivastava, A., Halfaker, A., Terveen, L., & Zhu, H. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376783 · Cited by 77
Amazon SageMaker Clarify: Machine Learning Bias Detection and Explainability in the Cloud
Hardt, M., Chen, X., Cheng, X., Donini, M., Gelman, J., Gollaprolu, S., He, J., Larroy, P., Liu, X., McCarthy, N., et al. (2021) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3447548.3467177 · Cited by 78
On Convexity and Bounds of Fairness-aware Classification
Wu, Y., Zhang, L., & Wu, X. (2019) · International World Wide Web Conference (WWW) · doi:10.1145/3308558.3313723 · Cited by 77
Ortega-Bolaños, R., Bernal-Salcedo, J., Germán Ortiz, M., Galeano Sarmiento, J., Ruz, G. A., & Tabares-Soto, R. (2024) · Artificial Intelligence Review · doi:10.1007/s10462-024-10740-3 · Cited by 76
Fairness in Learning-Based Sequential Decision Algorithms: A Survey
Zhang, X., & Liu, M. (2021) · Studies in systems, decision and control · doi:10.1007/978-3-030-60990-0_18 · Cited by 76
Transfer of Machine Learning Fairness across DomainsPreprint
Schumann, C., Wang, X., Beutel, A., Chen, J., Qian, H., & Ed, H. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.09688 · Cited by 76
AdaFair: Cumulative Fairness Adaptive Boosting
Iosifidis, V., & Ntoutsi, E. (2019) · Proceedings of the 28th ACM International Conference on Information and Knowledge Management · doi:10.1145/3357384.3357974 · Cited by 75
Tolan, S., Miron, M., Gómez, E., & Castillo, C. (2019) · Proceedings of the Seventeenth International Conference on Artificial Intelligence and Law · doi:10.1145/3322640.3326705 · Cited by 75
“penalizes classifiers that yield different error rates [2, 24, 44].”
BackgroundConstrained Learning With Non-Convex Losses
Chamon, L. F. O., Paternain, S., Calvo-Fullana, M., & Ribeiro, A. (2022) · IEEE Transactions on Information Theory · doi:10.1109/tit.2022.3187948 · Cited by 76
Minimax group fairness: algorithms and experiments
Diana, E., Gill, W., Kearns, M., Kenthapadi, K., & Roth, A. (2021) · Proceedings of the 2021 AAAI/ACM Conference on AI, Ethics, and Society · doi:10.1145/3461702.3462523 · Cited by 74
“those of [1, 17]) for equalizing group error rates require negative sample weights, and cannot use linear regression for exact weighted error minimization, despite the convexity of the unweighted problem.”
BackgroundMethodInfluentialAn Algorithmic Framework for Fairness Elicitation
Jung, C., Kearns, M. J., Neel, S., Roth, A., Stapleton, L., & Wu, Z. S. (2019) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.forc.2021.2 · Cited by 98
Enforcing fairness in private federated learning via the modified method of differential multipliersPreprint
Rodríguez-Gálvez, B., Granqvist, F., van Dalen, R. C., & Seigel, M. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2109.08604 · Cited by 76
Shen, H., Deng, W. H., Chattopadhyay, A., Wu, Z. S., Wang, X., & Zhu, H. (2021) · Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency · doi:10.1145/3442188.3445971 · Cited by 71
Active Fairness in Algorithmic Decision Making
Noriega-Campero, A., Bakker, M. A., Garcia-Bulle, B., & Pentland, A. '. (2019) · Proceedings of the 2019 AAAI/ACM Conference on AI, Ethics, and Society · doi:10.1145/3306618.3314277 · Cited by 71
Empirical or Invariant Risk Minimization? A Sample Complexity PerspectivePreprint
Ahuja, K., Wang, J., Dhurandhar, A., Shanmugam, K., & Varshney, K. R. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.16412 · Cited by 71
Detection and Evaluation of Machine Learning Bias
Alelyani, S. (2021) · Applied Sciences · doi:10.3390/app11146271 · Cited by 70
Ensuring Fairness Beyond the Training DataPreprint
Mandal, D., Deng, S., Jana, S., Wing, J. M., & Hsu, D. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.06029 · Cited by 70
Fairness of Exposure in Stochastic BanditsPreprint
Wang, L., Bai, Y., Sun, W., & Joachims, T. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2103.02735 · Cited by 69
Automatic Short Math Answer Grading via In-context Meta-learningPreprint
Zhang, M., Baral, S., Heffernan, N. T., & Lan, A. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2205.15219 · Cited by 70
Software Testing of Generative AI Systems: Challenges and Opportunities
Aleti, A. (2023) · IEEE/ACM International Conference on Software Engineering: Future of Software Engineering (ICSE-FoSE) · doi:10.1109/icse-fose59343.2023.00009 · Cited by 72
Metric-Free Individual Fairness in Online LearningPreprint
Bechavod, Y., Jung, C., & Wu, Z. S. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.05474 · Cited by 69
Luo, Y., Tian, Y., Shi, M., Pasquale, L. R., Shen, L. Q., Zebardast, N., Elze, T., & Wang, M. (2024) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2024.3377552 · Cited by 68
Policy-Gradient Training of Fair and Unbiased Ranking Functions
Yadav, H., Du, Z., & Joachims, T. (2021) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3404835.3462953 · Cited by 68
Stable and Fair ClassificationPreprint
Huang, L., & Vishnoi, N. K. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1902.07823 · Cited by 68
Gándara, D., Anahideh, H., Ison, M. P., & Picchiarini, L. (2024) · AERA Open · doi:10.1177/23328584241258741 · Cited by 67
“The first in-processing technique is exponentiated gradient reduction (ExGR), which is designed to minimize the impact of sensitive features on the model’s predictions (Agarwal et al., 2018).”
Measuring Fairness Under Unawareness of Sensitive Attributes: A Quantification-Based Approach
Fabris, A., Esuli, A., Moreo, A., & Sebastiani, F. (2023) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.14033 · Cited by 67
Touchstone Benchmark: Are We on the Right Way for Evaluating AI Algorithms for Medical Segmentation?
Bassi, P. R. A. S., Li, W., Tang, Y., Isensee, F., Wang, Z., Chen, J., Chou, Y.-C., Roy, S., Kirchhoff, Y., Rokuss, M., et al. (2024) · neural information processing systems · doi:10.52202/079017-0485 · Cited by 67
LIFT: Language-Interfaced Fine-Tuning for Non-Language Machine Learning Tasks
Dinh, T., Zeng, Y., Zhang, R., Lin, Z., Gira, M., Rajput, S., Sohn, J.-Y., Papailiopoulos, D., & Lee, K. (2022) · arXiv · doi:10.48550/arxiv.2206.06565 · Cited by 67
“[179] Alekh Agarwal, Alina Beygelzimer, Miroslav Dudík, John Langford, and Hanna Wallach.”
BackgroundMethodPerrone, V., Donini, M., Zafar, M. B., Schmucker, R., Kenthapadi, K., & Archambeau, C. (2021) · Proceedings of the 2021 AAAI/ACM Conference on AI, Ethics, and Society · doi:10.1145/3461702.3462629 · Cited by 66
“Other approaches are described in [2, 3], where a fair classification task is reduced to a sequence of cost-sensitive classification problems.”
BackgroundLearning Fair Classifiers with Partially Annotated Group Labels
Jung, S., Chun, S., & Moon, T. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01010 · Cited by 66
Balancing Learning Model Privacy, Fairness, and Accuracy With Early Stopping Criteria
Zhang, T., Zhu, T., Gao, K., Zhou, W., & Yu, P. S. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2021.3129592 · Cited by 66
Fair Decision-making Under Uncertainty
Zhang, W., & Weiss, J. C. (2021) · Proceedings · doi:10.1109/icdm51629.2021.00100 · Cited by 66
Fairness for Robust Log Loss Classification
Rezaei, A., Fathony, R., Memarrast, O., & Ziebart, B. D. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i04.6002 · Cited by 65
Zeroth-order algorithms for nonconvex–strongly-concave minimax problems with improved complexities
Wang, Z., Balasubramanian, K., Ma, S., & Razaviyayn, M. (2022) · Journal of Global Optimization · doi:10.1007/s10898-022-01160-0 · Cited by 65
Auditing and Achieving Intersectional Fairness in Classification ProblemsPreprint
Morina, G., Oliinyk, V., Waton, J., Marušić, I., & Georgatzis, K. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1911.01468 · Cited by 65
Explainability for fair machine learningPreprint
Begley, T., Schwedes, T., Frye, C., & Feige, I. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.07389 · Cited by 65
Taking Advantage of Multitask Learning for Fair Classification
Oneto, L., Doninini, M., Elders, A., & Pontil, M. (2019) · Proceedings of the 2019 AAAI/ACM Conference on AI, Ethics, and Society · doi:10.1145/3306618.3314255 · Cited by 64
“In many recent works [2–4 8 9 16 17 17 25 26 28 30 35–38] it has been shown how to enforce these constraints during the learning phase of a classifier.”
BackgroundRobust and Sparse Principal Component Analysis With Adaptive Loss Minimization for Feature Selection
Bian, J., Zhao, D., Nie, F., Wang, R., & Li, X. (2022) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3194896 · Cited by 64
Fair Regression: Quantitative Definitions and Reduction-based Algorithms
Agarwal, A., Dudı́k, M., & Wu, Z. S. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.12843 · Cited by 63
Self-citationLearning Optimal Fair Decision Trees: Trade-offs Between Interpretability, Fairness, and Accuracy
Jo, N., Aghaei, S., Benson, J., Gómez, A., & Vayanos, P. (2023) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1145/3600211.3604664 · Cited by 64
Missing the missing values: The ugly duckling of fairness in machine learning
Fernando, M., Cèsar, F., David, N., & José, H. (2021) · International Journal of Intelligent Systems · doi:10.1002/int.22415 · Cited by 62
Differentially Private Fair Learning
Jagielski, M., Kearns, M., Mao, J., Oprea, A., Roth, A., Sharifi-Malvajerdi, S., & Ullman, J. (2018) · arXiv · doi:10.48550/arxiv.1812.02696 · Cited by 62
Advancing mathematics research with AI-driven formal proof search
Tsoukalas, G., Kovsharov, A., Shirobokov, S., Surina, A., Firsching, M., Bérczi, G., Ruiz, F. J. R., Suggala, A., Wagner, A. Z., Wieser, E., et al. (2026) · Science · doi:10.1126/science.aej2213 · Cited by 62
Equal Opportunity in Online Classification with Partial FeedbackPreprint
Bechavod, Y., Ligett, K., Roth, A., Waggoner, B., & Wu, Z. S. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1902.02242 · Cited by 61
A Dynamic Reweighting Strategy For Fair Federated Learning
Zhao, Z., & Joshi, G. (2022) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp43922.2022.9746300 · Cited by 61
What-is and How-to for Fairness in Machine Learning: A Survey, Reflection, and Perspective
Tang, Z., Zhang, J., & Zhang, K. (2023) · ACM Computing Surveys · doi:10.1145/3597199 · Cited by 62
Zhang, G., Zhang, Y., Zhang, Y., Fan, W., Li, Q., Liu, S., & Chang, S. (2022) · neural information processing systems · doi:10.52202/068431-2489 · Cited by 61
General Fair Empirical Risk Minimization
Oneto, L., Donini, M., & Pontil, M. (2020) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn48605.2020.9206819 · Cited by 61
A minimax framework for quantifying risk-fairness trade-off in regression
Chzhen, E., & Schreuder, N. (2022) · The Annals of Statistics · doi:10.1214/22-aos2198 · Cited by 60
Tutorial on Fairness of Machine Learning in Recommender Systems
Li, Y., Ge, Y., & Zhang, Y. (2021) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3404835.3462814 · Cited by 60
The fairness‐accuracy Pareto front
Wei, S. H., & Niethammer, M. (2021) · Statistical Analysis and Data Mining The ASA Data Science Journal · doi:10.1002/sam.11560 · Cited by 60
Lum, K., Zhang, Y., & Bower, A. (2022) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3531146.3533105 · Cited by 60
Fairness and Bias in Robot Learning
Londoño, L., Hurtado, J. V., Hertz, N., Kellmeyer, P., Vöeneky, S., & Valada, A. (2024) · Proceedings of the IEEE · doi:10.1109/jproc.2024.3403898 · Cited by 60
Algorithmic individual fairness and healthcare: a scoping review
Anderson, J. W., & Visweswaran, S. (2024) · JAMIA Open · doi:10.1093/jamiaopen/ooae149 · Cited by 60
Recent advances in deep learning theoryPreprint
He, F., & Tao, D. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2012.10931 · Cited by 60
Survey on fairness notions and related tensions
Alves, G. T., Bernier, F., Couceiro, M., Makhlouf, K., Palamidessi, C., & Zhioua, S. (2023) · EURO Journal on Decision Processes · doi:10.1016/j.ejdp.2023.100033 · Cited by 59
Dablain, D. A., Krawczyk, B., & Chawla, N. V. (2024) · Discover Data · doi:10.1007/s44248-024-00007-1 · Cited by 60
FAT Forensics: A Python toolbox for algorithmic fairness, accountability and transparency
Sokol, K., Santos‐Rodríguez, R., & Flach, P. A. (2022) · Software Impacts · doi:10.1016/j.simpa.2022.100406 · Cited by 59
Moral Machines or Tyranny of the Majority? A Systematic Review on Predictive Bias in Education
Li, L., Sha, L., Li, Y., Raković, M., Rong, J., Joksimovíc, S., Selwyn, N., Gašević, D., & Chen, G. (2023) · International Conference on Learning Analytics and Knowledge (LAK) · doi:10.1145/3576050.3576119 · Cited by 59
Probably Approximately Correct Constrained LearningPreprint
Chamon, L. F. O., & Ribeiro, A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.05487 · Cited by 59
Review of Mathematical frameworks for Fairness in Machine LearningPreprint
del Barrio, E., Gordaliza, P., & Loubes, J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2005.13755 · Cited by 58
Efficient fair principal component analysis
Kamani, M. M., Haddadpour, F., Forsati, R., & Mahdavi, M. (2022) · Machine Learning · doi:10.1007/s10994-021-06100-9 · Cited by 57
Toward a better trade-off between performance and fairness with kernel-based distribution matchingPreprint
Prost, F., Qian, H., Chen, Q., Ed, H., Chen, J., & Beutel, A. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1910.11779 · Cited by 57
Fairness and Explainability: Bridging the Gap towards Fair Model Explanations
Zhao, Y., Wang, Y., & Derr, T. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i9.26344 · Cited by 56
Evaluating Fairness Using Permutation Tests
DiCiccio, C. J., Vasudevan, S., Basu, K., Kenthapadi, K., & Agarwal, D. (2020) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3394486.3403199 · Cited by 56
Fairness guarantee in multi-class classificationPreprint
Denis, C., Élie, R., Hebiri, M., & Hu, F. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2109.13642 · Cited by 58
LiFT: A Scalable Framework for Measuring Fairness in ML Applications
Vasudevan, S., & Kenthapadi, K. (2020) · Proceedings of the 29th ACM International Conference on Information & Knowledge Management · doi:10.1145/3340531.3412705 · Cited by 55
Risks and Opportunities to Ensure Equity in the Application of Big Data Research in Public Health
Wesson, P., Hswen, Y., Valdes, G., Stojanovski, K., & Handley, M. A. (2022) · Annual Review of Public Health · doi:10.1146/annurev-publhealth-051920-110928 · Cited by 55
Shrestha, Y. R., & Yang, Y. (2019) · Algorithms · doi:10.3390/a12090199 · Cited by 55
Shad, R., Cunningham, J. P., Ashley, E. A., Langlotz, C. P., & Hiesinger, W. (2021) · Nature Machine Intelligence · doi:10.1038/s42256-021-00399-8 · Cited by 55
CLIP the Bias: How Useful is Balancing Data in Multimodal Learning?
Alabdulmohsin, I., Wang, X., Steiner, A., Goyal, P., D’Amour, A., & Zhai, X. (2024) · International Conference on Learning Representations · doi:10.48550/arxiv.2403.04547 · Cited by 55
Soliciting Stakeholders’ Fairness Notions in Child Maltreatment Predictive Systems
Cheng, H.-F., Stapleton, L., Wang, R., Bullock, P., Chouldechova, A., Wu, Z. S. S., & Zhu, H. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445308 · Cited by 54
Metadata
- Authors
- Agarwal, A., Beygelzimer, A., Dudík, M., Langford, J., & Wallach, H.
- Affiliations
- Microsoft (United States) (US)
- Yahoo (United Kingdom) (GB)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2018
- Pages
- 60-69
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1803.02453
- OpenAlex
- W2790744245
- Cited by
- 1,288
- References
- 37
- Citations by year
- 2026: 165 · 2025: 186 · 2024: 185 · 2023: 210 · 2022: 168 · 2021: 154 · 2020: 121 · 2019: 80 · 2018: 18
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- International Conference on Machine Learning
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Physical Sciences › Computer Science › Artificial Intelligence › Imbalanced Data Classification Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Keywords
- fair classification, algorithmic fairness, reduction, cost-sensitive classification, binary classification, fairness constraints
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.