The DOI matches its Crossref record; 113 of the 113 references it cites were found in a registry or an index.
Algorithmic Fairness: Choices, Assumptions, and Definitions
Open accessAbstract
A recent wave of research has attempted to define fairness quantitatively. In particular, this work has explored what fairness might mean in the context of decisions based on the predictions of statistical and machine learning models. The rapid growth of this new field has led to wildly inconsistent motivations, terminology, and notation, presenting a serious challenge for cataloging and comparing definitions. This article attempts to bring much-needed order. First, we explicate the various choices and assumptions made—often implicitly—to justify the use of prediction-based decision-making. Next, we show how such choices and assumptions can raise fairness concerns and we present a notationally consistent catalog of fairness definitions from the literature. In doing so, we offer a concise reference for thinking through the choices, assumptions, and fairness considerations of prediction-based decision-making.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The bias of human decision-makers is often influenced by the relationship between the social group and the ground-truth label in a given classification task, which is impacted by underlying social structures leading to differences across social groups35.”
From A benchmarking framework and dataset for learning to defer in human-AI decision-making (2025) · cites this paper as [35]
In the citing paper
“Sociodemographics inequalities in the dataset will lead to inconsistent outcomes for marginalized group [93].”
From Artificial intelligence bias in medical system designs: a systematic review (2023) · cites this paper as [93]
Citations
Cites
Gelman, A., Carlin, J. B., Stern, H. S., & Rubin, D. B. (2003) · doi:10.1201/9780429258480 · Cited by 27,276
Causality: Models, Reasoning, and Inference
Pearl, J. (2009) · doi:10.1017/cbo9780511803161 · Cited by 11,653
Rudin, C. (2019) · Nature Machine Intelligence · doi:10.1038/s42256-019-0048-x · Cited by 10,561 · cited 1×
“This can also have a material effect on the quality of decisions by helping stakeholders to foresee and account for cases in which a model might produce counterintuitive or nonsensical results—and thus help stakeholders avoid or catch errors (Rudin 2019).”
BackgroundRUBIN, D. B. (1976) · Biometrika · doi:10.1093/biomet/63.3.581 · Cited by 9,925
Crenshaw, K. (2018) · Feminist Legal Theory · doi:10.4324/9780429500480-5 · Cited by 9,510
A Theory of Justice: Original Edition
Rawls, J. (1971) · doi:10.4159/9780674042605 · Cited by 9,496
Statistical Decision Theory and Bayesian Analysis
Berger, J. O. (1985) · Springer Series in Statistics · doi:10.1007/978-1-4757-4286-2 · Cited by 7,722 · cited 1×
“…fairness is connected to utility maximization by a set of results showing that,for a certain set of utility functions and scores ψ ( v ), the utility-maximizing decision rule δ is necessarily a single-threshold rule (Karlin & Rubin 1956, Berger 1985, Corbett-Davies et al. 2017, Lipton et al.2018).”
BackgroundCrenshaw, K. (1998) · Feminism And Politics · doi:10.1093/oso/9780198782063.003.0016 · Cited by 5,672
Capps, L. (2003) · JAMA · doi:10.1001/jama.290.18.2487-b · Cited by 4,526
Causal Inference for Statistics, Social, and Biomedical Sciences: An Introduction
Imbens, G. W., & Rubin, D. B. (2015) · doi:10.1017/cbo9781139025751 · Cited by 4,210
Research works printed but not linked: 38
- Alexander M., 2012, The New Jim Crow
- Angwin J, 2016, ProPublica
- Barabas C, Dinakar K, Ito J, Virza M, Zittrain J. 2018. Interventions over predictions: reframing the ethical debate for actuarial risk assessment. arXiv:1712.08238 [cs.LG] · arXiv
- Barocas S, 2018, Fairness and Machine Learning
- Barocas S, 2016, Calif. Law Rev., 104, 671
- Brownsberger WN., 2017, Bill S.770: An act providing community-based sentencing alternatives for primary caretakers of dependent children who have been convicted of non-violent crimes
- Buolamwini J, 2018, Proc. Mach. Learn. Res., 81, 77
- Chouldechova A, 2018, Proc. Mach. Learn. Res., 81, 134
- Courchane M, 2000, J. Hous. Res., 11, 277
- Crenshaw K., 1989, Univ. Chic. Legal Forum, 1989, 8
- Daniller A., 2019, FactTank Blog/Pew Research Center
- De-Arteaga M, Dubrawski A, Chouldechova A. 2018. Learning under selective labels in the presence of expert consistency. arXiv:1807.00905 [cs.LG] · arXiv
- Dieterich W, 2016, COMPAS risk scales: demonstrating accuracy equity and predictive parity
- book, 2016, Big data: a report on algorithmic systems, opportunity, and civil rights
- Flores AW, 2016, Fed. Probat. J., 80, 38
- Fussell S., 2018, Gizmodo
- Fuster A, 2020, SSRN
- Hernán MA, 2018, Causal Inference
- book, 2003, Unequal Treatment: Confronting Racial and Ethnic Disparities in Health Care
- Kearns M, 2018, Proc. Mach. Learn. Res., 80, 2564
- Kleinberg J, 2017, Q. J. Econ., 133, 237
- Kohler-Hausmann I., 2018, Northwestern Univ. Law Rev., 113, 1163
- Koulish R., 2016, Conn. Public Interest Law J., 16, 1
- Larson J, 2016, ProPublica
- book, 2020, The use of pre-trial “risk assessment” instruments: a shared statement of civil rights concerns
- journal, 2018, MODA Project Library
- Miller CC., 2015, New York Times
- Miller CC., 2015, New York Times
- Narayanan A., 2018, 21 fairness definitions and their politics
- Ochigame R, 2018, Beyond legitimation: rethinking fairness, interpretability, and accuracy in machine learning
- O'Neil C., 2016, Weapons of Math Destruction: How Big Data Increases Inequality and Threatens Democracy
- Raphling J., 2018, The Nation
- Rothblum GN, 2018, Proc. Mach. Learn. Res., 80, 5680
- Silva S, 2018, Phylon, 55, 9
- Stoyanovich J., 2018, Freedom to Tinker Blog
- Wexler J., 2018, Google AI Blog
- Zehlike M, 2017, Machine Learning Software
- Zhang J, 2018, Thirty-Second AAAI Conference on Artificial Intelligence, 2037
Cited by
Advances and Open Problems in Federated Learning
Kairouz, P., & McMahan, H. B. (2021) · Foundations and Trends in Machine Learning · doi:10.1561/2200000083 · Cited by 7,772
Model Cards for Model Reporting
Mitchell, M., Wu, S., Zaldivar, A., Barnes, P., Vasserman, L., Hutchinson, B., Spitzer, E., Raji, I. D., & Gebru, T. (2019) · Proceedings of the Conference on Fairness, Accountability, and Transparency · doi:10.1145/3287560.3287596 · Cited by 2,681
Baker, R. S., & Hawn, A. (2022) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-021-00285-9 · Cited by 993
“In the current article, we focus on studying algorithmic bias in terms of situations where model performance is substantially better or worse across mutually exclusive groups (i.e. Gardner et al., 2019; Mehrabi et al., 2019; Mitchell et al., 2021).”
BackgroundInfluentialDecolonial AI: Decolonial Theory as Sociotechnical Foresight in Artificial Intelligence
Mohamed, S., Png, M.-T., & Isaac, W. (2020) · Philosophy & Technology · doi:10.1007/s13347-020-00405-8 · Cited by 912
Fairness in machine learning: A survey
Caton, S., & Haas, C. (2024) · ACM Computing Surveys · doi:10.1145/3616865 · Cited by 646
Metadata
- Authors
- Mitchell, S., Potash, E., Barocas, S., D'Amour, A., & Lum, K.
- Affiliations
- Google (United States) (US)
- Google Research, Cambridge, Massachusetts 02124, USA;
- Venue
- Annual Review of Statistics and Its Application
- Publisher
- Annual Reviews
- Published
- 2021-03-07
- Volume
- 8
- Issue
- 1
- Pages
- 141-163
- ISSN
- 2326-8298 (ISSN-L)
- 2326-831X
- OpenAlex
- W3101206394
- Cited by
- 687
- References
- 110
- Citations by year
- 2026: 104 · 2025: 119 · 2024: 146 · 2023: 136 · 2022: 85 · 2021: 51
- FWCI
- 14.33
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Locations
- Annual Review of Statistics and Its Application (publishedVersion, cc-by)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Social Sciences › Law › Discrimination and Equality Law
- Keywords
- algorithmic fairness, fairness definitions, automated decision-making
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Algorithmic Fairness: Choices, Assumptions, and Definitions. https://app.cochat.ai/papers/10.1146/annurev-statistics-042720-125902
- The paper
- Mitchell, S., Potash, E., Barocas, S., D'Amour, A., & Lum, K. (2021). Algorithmic Fairness: Choices, Assumptions, and Definitions. Annual Review of Statistics and Its Application. https://doi.org/10.1146/annurev-statistics-042720-125902
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.