Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 113 of the 113 references it cites were found in a registry or an index.

Algorithmic Fairness: Choices, Assumptions, and Definitions

Open access
Mitchell, Shira, Potash, Eric, Barocas, Solon, D'Amour, Alexander, Lum, Kristian · 2021 · Annual Review of Statistics and Its Application

Abstract

A recent wave of research has attempted to define fairness quantitatively. In particular, this work has explored what fairness might mean in the context of decisions based on the predictions of statistical and machine learning models. The rapid growth of this new field has led to wildly inconsistent motivations, terminology, and notation, presenting a serious challenge for cataloging and comparing definitions. This article attempts to bring much-needed order. First, we explicate the various choices and assumptions made—often implicitly—to justify the use of prediction-based decision-making. Next, we show how such choices and assumptions can raise fairness concerns and we present a notationally consistent catalog of fairness definitions from the literature. In doing so, we offer a concise reference for thinking through the choices, assumptions, and fairness considerations of prediction-based decision-making.

Overview

Integrity signals

Registry

Crossref · 10.1146/annurev-statistics-042720-125902

Cites

113 of 113 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Show all 110 references

Research works printed but not linked: 38

  1. Alexander M., 2012, The New Jim Crow
  2. Angwin J, 2016, ProPublica
  3. Barabas C, Dinakar K, Ito J, Virza M, Zittrain J. 2018. Interventions over predictions: reframing the ethical debate for actuarial risk assessment. arXiv:1712.08238 [cs.LG] · arXiv
  4. Barocas S, 2018, Fairness and Machine Learning
  5. Barocas S, 2016, Calif. Law Rev., 104, 671
  6. Brownsberger WN., 2017, Bill S.770: An act providing community-based sentencing alternatives for primary caretakers of dependent children who have been convicted of non-violent crimes
  7. Buolamwini J, 2018, Proc. Mach. Learn. Res., 81, 77
  8. Chouldechova A, 2018, Proc. Mach. Learn. Res., 81, 134
  9. Courchane M, 2000, J. Hous. Res., 11, 277
  10. Crenshaw K., 1989, Univ. Chic. Legal Forum, 1989, 8
  11. Daniller A., 2019, FactTank Blog/Pew Research Center
  12. De-Arteaga M, Dubrawski A, Chouldechova A. 2018. Learning under selective labels in the presence of expert consistency. arXiv:1807.00905 [cs.LG] · arXiv
  13. Dieterich W, 2016, COMPAS risk scales: demonstrating accuracy equity and predictive parity
  14. book, 2016, Big data: a report on algorithmic systems, opportunity, and civil rights
  15. Flores AW, 2016, Fed. Probat. J., 80, 38
  16. Fussell S., 2018, Gizmodo
  17. Fuster A, 2020, SSRN
  18. Hernán MA, 2018, Causal Inference
  19. book, 2003, Unequal Treatment: Confronting Racial and Ethnic Disparities in Health Care
  20. Kearns M, 2018, Proc. Mach. Learn. Res., 80, 2564
  21. Kleinberg J, 2017, Q. J. Econ., 133, 237
  22. Kohler-Hausmann I., 2018, Northwestern Univ. Law Rev., 113, 1163
  23. Koulish R., 2016, Conn. Public Interest Law J., 16, 1
  24. Larson J, 2016, ProPublica
  25. book, 2020, The use of pre-trial “risk assessment” instruments: a shared statement of civil rights concerns
  26. journal, 2018, MODA Project Library
  27. Miller CC., 2015, New York Times
  28. Miller CC., 2015, New York Times
  29. Narayanan A., 2018, 21 fairness definitions and their politics
  30. Ochigame R, 2018, Beyond legitimation: rethinking fairness, interpretability, and accuracy in machine learning
  31. O'Neil C., 2016, Weapons of Math Destruction: How Big Data Increases Inequality and Threatens Democracy
  32. Raphling J., 2018, The Nation
  33. Rothblum GN, 2018, Proc. Mach. Learn. Res., 80, 5680
  34. Silva S, 2018, Phylon, 55, 9
  35. Stoyanovich J., 2018, Freedom to Tinker Blog
  36. Wexler J., 2018, Google AI Blog
  37. Zehlike M, 2017, Machine Learning Software
  38. Zhang J, 2018, Thirty-Second AAAI Conference on Artificial Intelligence, 2037

Cited by

See all 855

Metadata

Authors
Mitchell, S., Potash, E., Barocas, S., D'Amour, A., & Lum, K.
Affiliations
  • Google (United States) (US)
  • Google Research, Cambridge, Massachusetts 02124, USA;
Venue
Annual Review of Statistics and Its Application
Published
2021-03-07
Volume
8
Issue
1
Pages
141-163
ISSN
  • 2326-8298 (ISSN-L)
  • 2326-831X
OpenAlex
W3101206394
Cited by
687
References
110
Citations by year
2026: 104 · 2025: 119 · 2024: 146 · 2023: 136 · 2022: 85 · 2021: 51
FWCI
14.33
Type
journal article
Language
en
Open access
Locations
  • Annual Review of Statistics and Its Application (publishedVersion, cc-by)
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
  • Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
  • Social Sciences › Law › Discrimination and Equality Law
Keywords
algorithmic fairness, fairness definitions, automated decision-making

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Algorithmic Fairness: Choices, Assumptions, and Definitions. https://app.cochat.ai/papers/10.1146/annurev-statistics-042720-125902
The paper
Mitchell, S., Potash, E., Barocas, S., D'Amour, A., & Lum, K. (2021). Algorithmic Fairness: Choices, Assumptions, and Definitions. Annual Review of Statistics and Its Application. https://doi.org/10.1146/annurev-statistics-042720-125902

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.