The DOI matches its DataCite record; 21 of the 22 references it cites were found in a registry or an index.
On the (im)possibility of fairness
Open accessAbstract
What does it mean for an algorithm to be fair? Different papers use different notions of algorithmic fairness, and although these appear internally consistent, they also seem mutually incompatible. We present a mathematical setting in which the distinctions in previous papers can be made formal. In addition to characterizing the spaces of inputs (the "observed" space) and outputs (the "decision" space), we introduce the notion of a construct space: a space that captures unobservable, but meaningful variables for the prediction. We show that in order to prove desirable properties of the entire decision-making process, different mechanisms for fairness require different assumptions about the nature of the mapping from construct space to decision space. The results in this paper imply that future treatments of algorithmic fairness should more explicitly state assumptions about the relationship between constructs and observations.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“each technical definition carry strong values assumptions which can often be in tension with each other (Friedler et al., 2016; Kleinberg et al., 2017).”
From Social Data: Biases, Methodological Pitfalls, and Ethical Boundaries (2019) · cites this paper as Friedler et al., 2016
In the citing paper
“Recent works expose the impossibility of simultaneously satisfying multiple non-discriminatory objectives, such as equalized opportunity and parity mistreatment [10, 19, 27].”
From Marrying Fairness and Explainability in Supervised Learning (2022) · cites this paper as [19]
Citations
Cites
Grit: perseverance and passion for long-term goals
Duckworth, A. L., Peterson, C., Matthews, M. D., & Kelly, D. R. (2007) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.92.6.1087 · Cited by 6,911
Dwork, C., Hardt, M., Pitassi, T., Reingold, O., & Zemel, R. (2012) · Proceedings of the 3rd Innovations in Theoretical Computer Science Conference · doi:10.1145/2090236.2090255 · Cited by 3,501
Certifying and Removing Disparate Impact
Feldman, M., Friedler, S. A., Moeller, J., Scheidegger, C., & Venkatasubramanian, S. (2015) · Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2783258.2783311 · Cited by 1,827
Self-citation(2013) · Cited by 1,126
Duckworth, A. L., & Yeager, D. S. (2015) · Educational Researcher · doi:10.3102/0013189x15584327 · Cited by 993
Three naive Bayes approaches for discrimination-free classification.
Calders, T., & Verwer, S. (2010) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-010-0190-x · Cited by 764
Efficient noise-tolerant learning from statistical queries
Kearns, M. J. (1998) · Journal of the ACM · doi:10.1145/293347.293351 · Cited by 679
Personality Psychology and Economics
Almlund, M., Duckworth, A. L., Heckman, J., & Kautz, T. (2011) · National Bureau of Economic Research · doi:10.3386/w16822 · Cited by 540 · cited 1×
“Personal qualities, such as self-control, growth mind-set, and grit, are known to be determining factors in later success [2].”
BackgroundGromov–Wasserstein Distances and the Metric Approach to Object Matching
Mémoli, F. (2011) · Foundations of Computational Mathematics · doi:10.1007/s10208-011-9093-5 · Cited by 519
Classifying without discriminating
Kamiran, F., & Calders, T. (2009) · 2009 2nd International Conference on Computer, Control and Communication · doi:10.1109/ic4.2009.4909197 · Cited by 409
Cited by
Sorted by citations
Items 201–265 of 265
Anticipatory Artificial Intelligence
Rovatsos, M. (2017) · Springer eBooks · doi:10.1007/978-3-319-31737-3_45-1 · Cited by 5
AMS-Algorithmen_Bericht_final.pdf
Allhutter, I. D., & Mager, I. A. (2020) · doi:10.1553/ita-pb-2020-02 · Cited by 5
Pareto Efficient Fairness in Supervised Learning: From Extraction to TracingPreprint
Kamani, M. M., Forsati, R., Wang, J. Z., & Mahdavi, M. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2104.01634 · Cited by 16
Fairness as Equality of Opportunity: Normative Guidance from Political PhilosophyPreprint
Khan, F. A., Manis, E., & Stoyanovich, J. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.08259 · Cited by 11
Algorithmic Fairness Criteria as EvidencePreprint
Fleisher, W. (2021) · SSRN Electronic Journal · doi:10.2139/ssrn.3974963 · Cited by 4
A Classification of Feedback Loops and Their Relation to Biases in Automated Decision-Making Systems
Pagan, N., Baumann, J., Elokda, E., De Pasquale, G., Bolognani, S., & Hannák, A. (2023) · arXiv · doi:10.48550/arxiv.2305.06055 · Cited by 4
Jang, T., Wang, X., & Huang, H. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i20.30220 · Cited by 4
Towards a Just Theory of Measurement
Andrus, M., & Gilbert, T. K. (2019) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1145/3306618.3314275 · Cited by 4
Ethics of Artificial Intelligence and Post-non-classical Scientific Rationality
Saveliev, A. M., Zhurenkov, D. A., Poikin, A. E., & Berkutova, T. A. (2021) · IFAC-PapersOnLine · doi:10.1016/j.ifacol.2021.10.480 · Cited by 4
Teaching Responsible Data Science: Charting New Pedagogical TerritoryPreprint
Stoyanovich, J., & Lewis, A. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1912.10564 · Cited by 4
Measuring gender bias in student satisfaction in higher education: a cross-department study
Marques, F., Hernández‐Leo, D., & Castillo, C. (2024) · Cogent Education · doi:10.1080/2331186x.2024.2375183 · Cited by 3
Poe, R. L., & Mestari, S. Z. E. (2024) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3630106.3659015 · Cited by 9
Designing Affirmative Action Policies under Uncertainty
Hertweck, C., Castillo, C., & Mathioudakis, M. (2022) · Journal of Learning Analytics · doi:10.18608/jla.2022.7463 · Cited by 3
Fairness Perception from a Network-Centric Perspective
Masrour, F., Tan, P., & Esfahanian, A. (2020) · Proceedings · doi:10.1109/icdm50108.2020.00145 · Cited by 5
Fairness Through Causal Awareness: Learning Latent-Variable Models for Biased DataPreprint
Madras, D., Creager, E., Pitassi, T., & Zemel, R. S. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1809.02519 · Cited by 6
Fairness-Aware Online PersonalizationPreprint
Lal, G., Geyik, S. C., & Kenthapadi, K. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.15270 · Cited by 3
Where Is the Normative Proof? Assumptions and Contradictions in ML Fairness ResearchPreprint
Cooper, A. F. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.10407 · Cited by 3
Fairness in Missing Data ImputationPreprint
Zhang, Y., & Long, Q. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.12002 · Cited by 3
Finding representative group fairness metrics using correlation estimations
Anahideh, H., Nezami, N., & Asudeh, A. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2024.125652 · Cited by 3
In Defense of Sociotechnical Pragmatism
Watson, D., & Mökander, J. (2023) · Digital ethics lab yearbook · doi:10.1007/978-3-031-28678-0_10 · Cited by 3
A systematic approach to group fairness in automated decision making
Hertweck, C., & Heitz, C. (2021) · Zürcher Hochschule für Angewandte Wissenschaften digital collection (Zurich University of Applied Sciences) · doi:10.21256/zhaw-23113 · Cited by 2
Sampling a Near Neighbor in High Dimensions — Who is the Fairest of Them All?
Aumüller, M., Har-Peled, S., Mahabadi, S., Pagh, R., & Silvestri, F. (2022) · ACM Transactions on Database Systems · doi:10.1145/3502867 · Cited by 17
Getting Fairness Right: Towards a Toolbox for PractitionersPreprint
Ruf, B., Boutharouite, C., & Detyniecki, M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.06920 · Cited by 2
Continuous Subject-in-the-Loop Integration: Centering AI on Marginalized CommunitiesPreprint
Roewer-Després, F., & Berscheid, J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2012.01128 · Cited by 2
Fair for All: Best-effort Fairness Guarantees for ClassificationPreprint
Krishnaswamy, A. K., Jiang, Z., Wang, K., Cheng, Y., & Munagala, K. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2012.10216 · Cited by 3
RAWLSNET: Altering Bayesian Networks to Encode Rawlsian Fair Equality of OpportunityPreprint
Liu, D., Shafi, Z., Fleisher, W., Eliassi‐Rad, T., & Alfeld, S. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2104.03909 · Cited by 2
An Analysis of Pairwise PreferencePreprint
Kronovet, D. (2017) · SSRN Electronic Journal · doi:10.2139/ssrn.3359677 · Cited by 2
Fair Enough? On (Avoiding) Bias in Data, Algorithms and Decisions
Dechesne, F. (2020) · IFIP advances in information and communication technology · doi:10.1007/978-3-030-42504-3_2 · Cited by 1
Peng, K. (2020) · International Conference on Artificial Intelligence and Computer Engineering (ICAICE) · doi:10.1109/icaice51518.2020.00009 · Cited by 1
Ethical AI: Designing Responsible And Trustworthy Systems
Mana, S. C., Kalaiarasi, G., Selvi, D. M., Velvizhi, M. R., & Nair, M. M. C. (2023) · Jupiter Publications Consortium eBooks · doi:10.47715/jpc.978-93-91303-66-2 · Cited by 2
Sterpa, A., Vivo, I. D., & Capasso, C. (2023) · Nuovi Autoritarismi e Democrazie Diritto Istituzioni Società (NAD-DIS) · doi:10.54103/2612-6672/22174 · Cited by 1
Amer-Yahia, S. (2018) · IEEE International Conference on Data Engineering (ICDE) · doi:10.1109/icde.2018.00009 · Cited by 1
Handling Gender Biases in E-Commerce Product Specifications
Suvarna, A., Dey, K., Nagar, S., Madaan, N., & Mehta, S. (2019) · Grace Hopper Celebration India (GHCI) · doi:10.1109/ghci47972.2019.9071916 · Cited by 1
Reviewable Automated Decision-Making: A Framework for Accountable Algorithmic Systems
Cobbe, J., Lee, M. S. A., & Singh, J. P. (2021) · Apollo (University of Cambridge) · doi:10.17863/cam.65493 · Cited by 1
The Impact of Split Classifiers on Group Fairness
Wang, H., Hsu, H., Díaz, M., & Calmon, F. P. (2021) · IEEE International Symposium on Information Theory (ISIT) · doi:10.1109/isit45174.2021.9517723 · Cited by 2
Practical bias correction in neural networks: a credit default prediction case study
Snel, P., & van Otterloo, S. (2022) · doi:10.54822/bewo3288 · Cited by 1
Machine Learning in Population and Public HealthPreprint
Mhasawade, V., Zhao, Y., & Chunara, R. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2008.07278 · Cited by 3
Social Responsibility of AlgorithmsPreprint
Tsoukiàs, A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2012.03319 · Cited by 1
Beyond traditional assumptions in fair machine learningPreprint
Kilbertus, N. (2020) · arXiv (Cornell University) · doi:10.17863/cam.59055 · Cited by 1
Cooper, A. F., & Abrams, E. (2021) · arXiv (Cornell University) · Cited by 1
Everything is Relative: Understanding Fairness with Optimal TransportPreprint
Kwegyir-Aggrey, K., Santorella, R., & Brown, S. M. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2102.10349 · Cited by 3
Explaining how your AI system is fairPreprint
Ruf, B., & Detyniecki, M. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2105.00667 · Cited by 1
Pairwise Fairness for Ordinal RegressionPreprint
Kleindeßner, M., Samadi, S., Zafar, M. B., Kenthapadi, K., & Russell, C. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2105.03153 · Cited by 1
Gerrymandering Individual FairnessPreprint
Räz, T. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2204.11615 · Cited by 3
LUCID–GAN: Conditional Generative Models to Locate UnfairnessPreprint
Algaba, A., Mazijn, C., Prunkl, C., Danckaert, J., & Ginis, V. (2022) · SSRN Electronic Journal · doi:10.2139/ssrn.4289597 · Cited by 1
Access to Population-Level Signaling as a Source of InequalityPreprint
Immorlica, N., Ligett, K., & Ziani, J. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1809.04224 · Cited by 1
Framework for developing algorithmic fairness
Kristiadi, D. P., Sunarya, P. A., Ismanto, M., Dylan, J., Santoso, I. R., & Warnars, H. L. H. S. (2020) · Bulletin of Electrical Engineering and Informatics · doi:10.11591/eei.v9i4.2028 · Cited by 1
Towards Data-Driven Affirmative Action Policies under UncertaintyPreprint
Hertweck, C., Castillo, C., & Mathioudakis, M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.01202
Towards a Flexible Framework for Algorithmic FairnessPreprint
Hacker, P., Wiedemann, E., & Zehlike, M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.07848
How Fair is Fairness-aware Representative Ranking and Methods for Fair RankingPreprint
Saxena, A., Fletcher, G., & Pechenizkiy, M. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2103.01335
Applications of Machine Learning: From Single Cell Biology to Algorithmic Fairness
Vargo, A. (2020) · Deep Blue (University of Michigan)
RStudio AI Blog: Starting to think about AI Fairness
Keydana, S. (2021)
Evaluating the fairness of fine-tuning strategies in self-supervised learningPreprint
Ramapuram, J., Busbridge, D., & Webb, R. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.00538 · Cited by 7
FAIRLEARN:Configurable and Interpretable Algorithmic FairnessPreprint
Kulshrestha, A., & Safro, I. (2021) · arXiv (Cornell University)
Alchalabi, A. E. (2021) · uO Research (University of Ottawa) · doi:10.20381/ruor-27132
Where Is Data Ethics in Postsecondary Data Science Courses?
Lyford, A., & Mei, K. (2022) · Bridging the Gap: Empowering and Educating Today’s Learners in Statistics. Proceedings of the Eleventh International Conference on Teaching Statistics · doi:10.52041/iase.icots11.t3d1
Desafios para a efetivação do direito à explicação na Lei Geral de Proteção de Dados do Brasil
Monteiro, R. L. (2021) · Digital Library of Theses and Dissertations (Universidade de São Paulo) · doi:10.11606/t.2.2021.tde-22072022-120338 · Cited by 1
Racial Equity in Police Use of Social Media Monitoring SoftwarePreprint
Burkhardt, B. C., Borradaile, G., & Gelvin, B. (2023) · SocArXiv (OSF Preprints) · doi:10.31235/osf.io/rz2sp
Fairness Audits and Debiasing Using \pkg{mlr3fairness}
Pfisterer, F., Wei, S., Vollmer, S. J., Lang, M., & Bischl, B. (2023) · The R Journal · doi:10.32614/rj-2023-034
Individual Fairness, Base Rate Tracking and the Lipschitz Condition
Eva, B. (2024) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.15236
Ethical Considerations in the Context of AI-Driven Misinformation Detection
Barbagallo, E., Gadek, G., Faye, G., Khairova, N., Arora, C., Thilakarathne, D. J., Joisten, K., Teixeira, S., Durán, J. M., & Barrantes, M. (2026) · Springer eBooks · doi:10.1007/978-3-031-61050-9_31-1
Chun-wang, L. U. I., & Pusheng, W. A. N. G. (2026) · Frontiers in Medicine · doi:10.3389/fmed.2026.1894905 · Cited by 1
A Convex Framework for Fair Regression
Berk, R., Heidari, H., Jabbari, S., Joseph, M., Kearns, M., Morgenstern, J., Neel, S., & Roth, A. (2017) · arXiv · doi:10.48550/arxiv.1706.02409 · Cited by 198
On the Legal Compatibility of Fairness Definitions
Xiang, A., & Raji, I. D. (2019) · arXiv · doi:10.48550/arxiv.1912.00761 · Cited by 34
Metadata
- Authors
- Friedler, S. A., Scheidegger, C., & Venkatasubramanian, S.
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2016
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1609.07236
- OpenAlex
- W2524301210
- Cited by
- 247
- References
- 22
- Citations by year
- 2026: 2 · 2025: 1 · 2024: 10 · 2023: 18 · 2022: 26 · 2021: 54 · 2020: 47 · 2019: 43 · 2018: 24 · 2017: 20 · 2016: 2
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Physical Sciences › Computer Science › Artificial Intelligence › Privacy-Preserving Technologies in Data
- Keywords
- algorithmic fairness, fairness definitions, decision space, impossibility results, fairness assumptions
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
