A Reductions Approach to Fair Classification
Open accessThe DOI matches its DataCite record; 40 of the 40 references it cites were found in a registry or an index.
Abstract
We present a systematic approach for achieving fairness in a binary classification setting. While we focus on two well-known quantitative definitions of fairness, our approach encompasses many other previously studied definitions as special cases. The key idea is to reduce fair classification to a sequence of cost-sensitive classification problems, whose solutions yield a randomized classifier with the lowest (empirical) error subject to the desired constraints. We introduce two reductions that work for any representation of the cost-sensitive classifier and compare favorably to prior baselines on a variety of data sets, while overcoming several of their disadvantages.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Scikit-learn: Machine Learning in Python
Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., Blondel, M., Müller, A., Nothman, J., Louppe, G., et al. (2012) · arXiv · doi:10.48550/arxiv.1201.0490 · Cited by 71,016
UCI Machine Learning Repository
Asuncion, A. (2007) · Medical Entomology and Zoology · Cited by 25,370
A decision-theoretic generalization of on-line learning and an application to boosting
Freund, Y., & Schapire, R. E. (1997) · Journal of Computer and System Sciences · doi:10.1006/jcss.1997.1504 · Cited by 20,466
Rockafellar, R. T. (1970) · Princeton University Press eBooks · doi:10.1515/9781400873173 · Cited by 10,801
Scikit-learn: Machine Learning in Python
(2011) · Journal of Machine Learning Research · doi:10.5555/1953048.2078195 · Cited by 8,539
Dwork, C., Hardt, M., Pitassi, T., Reingold, O., & Zemel, R. (2012) · Proceedings of the 3rd Innovations in Theoretical Computer Science Conference · doi:10.1145/2090236.2090255 · Cited by 3,501
Barocas, S., & Selbst, A. D. (2014) · doi:10.2139/ssrn.2477899 · Cited by 3,048 · cited 1×
“In response to this scrutiny—and driven by ongoing debates and collaborations with lawyers, policy-makers, social scientists, and others (e.g., Barocas & Selbst, 2016)—machine learning researchers have begun to turn their attention to the topic of “fairness in machine learning,” and, in particular,…”
BackgroundEquality of Opportunity in Supervised Learning
Hardt, M., Price, E., & Srebro, N. (2016) · arXiv · doi:10.48550/arxiv.1610.02413 · Cited by 2,536 · cited 6×
“The second group of approaches eliminate the restriction to specific classifier families and treat the underlying classification method as a “black box,” while implementing a wrapper that either works by pre-processing the data or post-processing the classifier’s predictions (e.g., Kamiran & Calders, 2012; Feldman et…”
BackgroundMethodInfluentialFair prediction with disparate impact: a study of bias in recidivism prediction instruments
Chouldechova, A. (2017) · Big Data · doi:10.1089/big.2016.0047 · Cited by 2,159 · cited 2×
“…2017), overall accuracy equality (Berk et al., 2017), and treatment equality (Berk et al., 2017) can all be expressed as equation (1); in contrast, calibration (Kleinberg et al., 2017) and predictive parity (Chouldechova, 2017) cannot because to do so would require the event E j to depend on h .”
BackgroundRademacher and Gaussian Complexities: Risk Bounds and Structural Results
Bartlett, P. L., & Mendelson, S. (2001) · Lecture Notes in Computer Science · doi:10.1007/3-540-44581-1_15 · Cited by 1,949
Research works printed but not linked: 1
- Zafar, M. B., Valera, I., Rodriguez, M. G., and Gummadi, K. P. Fairness constraints: Mechanisms for fair classifica- tion. In Proceedings of the 20th International Conference on Artificial Intelligence and Statistics (AISTATS), pp. 962-970, 2017.
Cited by
Items 1,001–1,005 of 1,005
GroupMixNorm Layer for Learning Fair Models
Pandey, A., Rai, A., Singh, M., Bhatt, D., & Bhowmik, T. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-33374-3_41 · Cited by 1
A Group-Level Learning Approach Using Logistic Regression for Fairer Decisions
Elliott, M. T. J., & Deepak, P. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-40953-0_25 · Cited by 1
Mitigating Bias in Image Classification - Pretraining on Diverse Data for Improved Generalization
Shirvalkar, R., & Geetha, M. K. (2023) · International Conference on Electronics, Materials Engineering & Nano-Technology (IEMENTech) · doi:10.1109/iementech60402.2023.10423435 · Cited by 1
S-RAF: A Simulation-Based Robustness Assessment Framework for Responsible Autonomous Driving
Omeiza, D., Somaiya, P., Pattison, J.-A., Ten-Holter, C., Jirotka, M. D., Stilgoe, J., & Kunze, L. (2024) · Proceedings of the AAAI Symposium Series · doi:10.1609/aaaiss.v4i1.31776 · Cited by 1
Classifying Persuasion Modes in Arabic Debates: A Preliminary Language Model-Based Analysis
Al-Zawqari, A., Al-Sharafi, A. G., Ahmed, M., Khader, M., & Vandersteen, G. (2025) · Communications in computer and information science · doi:10.1007/978-3-031-79164-2_21 · Cited by 1
Metadata
- Authors
- Agarwal, A., Beygelzimer, A., Dudík, M., Langford, J., & Wallach, H.
- Affiliations
- Microsoft (United States) (US)
- Yahoo (United Kingdom) (GB)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2018
- Pages
- 60-69
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1803.02453
- OpenAlex
- W2790744245
- Cited by
- 1,288
- References
- 37
- Citations by year
- 2026: 165 · 2025: 186 · 2024: 185 · 2023: 210 · 2022: 168 · 2021: 154 · 2020: 121 · 2019: 80 · 2018: 18
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- International Conference on Machine Learning
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Physical Sciences › Computer Science › Artificial Intelligence › Imbalanced Data Classification Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Keywords
- fair classification, algorithmic fairness, reduction, cost-sensitive classification, binary classification, fairness constraints
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.