Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 121 of the 123 references it cites were found in a registry or an index; 15 of the 131 sources its claims cite were checked for support.

Towards a critical race methodology in algorithmic fairness

Open access
Hanna, Alex, Denton, Remi, Smart, Andrew, Smith-Loud, Jamila · 2020 · Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency

Abstract

We examine the way race and racial categories are adopted in algorithmic fairness frameworks. Current methodologies fail to adequately account for the socially constructed nature of race, instead adopting a conceptualization of race as a fixed attribute. Treating race as an attribute, rather than a structural, institutional, and relational phenomenon, can serve to minimize the structural aspects of algorithmic unfairness. In this work, we focus on the history of racial categories and turn to critical race theory and sociological work on race and ethnicity to ground conceptualizations of race for fairness research, drawing on lessons from public health, biomedical research, and social survey research. We argue that algorithmic fairness researchers need to take into account the multidimensionality of race, take seriously the processes of conceptualizing and operationalizing race, focus on social processes which produce racial inequality, and consider perspectives of those most affected by sociotechnical systems.

Overview

CoChat Summary

TL;DR

This paper argues that algorithmic fairness research treats race too much like a fixed attribute, when it is better understood as socially constructed, multidimensional, and tied to histories of racial classification and oppression. The authors call for researchers to center operationalization choices, focus on racism rather than race alone, and consider the perspectives of affected communities.

Key findings

  • The paper identifies a recurring problem in fairness work: racial categories are often used as if they are “single dimensional” and interchangeable, which the authors say erases social, economic, and political complexity and can reify race.
  • In the COMPAS case, the authors note that the original ProPublica story had “some 700 citations” on Google Scholar, but the underlying Broward County racial schema included categories such as Black, White, Hispanic, Asian, Native American, and Other, while omitting “Native Hawaiian or Other Pacific Islander” and treating “Hispanic” as a race rather than an ethnicity.
  • The authors argue that race is multidimensional, giving examples including racial identity, self-classification, observed race, reflected race, and phenotype; they say different dimensions are associated with different outcomes and measurements.
  • They recommend disaggregated analysis and transparent reporting of definitions, categories, measurements, and motivations, and they say multiple measures of race should be collected if possible.

Methods

  • This is a conceptual and critical review paper, not an empirical study.
  • The authors synthesize histories of racial classification and scientific racism, and draw lessons from public health, biomedical research, and social survey research.
  • They review algorithmic fairness literature, especially group fairness and disaggregated analysis, to articulate implications for how race should be conceptualized and operationalized.

Limitations

  • The paper does not present original empirical data or experiments; this is evident from the text, which is a review/argument piece rather than a study with a sample or quantitative results.
  • The authors explicitly note that category choices are often constrained by available census or bureaucratic taxonomies, which is a practical limitation for the approaches they recommend.
  • Not stated in the paper.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1145/3351095.3372826

Cites

121 of 121 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Verification

Claims the paper makes

13 Valid · 16 Not valid · 54 Not checked · 85 Own results and interpretations

63 more claims

Create a free account to see all 168 claims and to verify the 7 references still open.

See all claims — free account
  • It may state two separate claims as one. 46
  • Probably not a substantial claim. 78

Create a free account to see these claims.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

1 more claim about this paper

Create a free account to see every claim other papers make about this one.

See all claims — free account

Citations

Cites

Show all 123 references

Research works printed but not linked: 17

  1. Julia Angwin and Jeff Larson. Propublica responds to company's critique of machine bias story. ProPublica, 29, 2016.
  2. Julia Angwin, Jeff Larson, Surya Mattu, and Lauren Kirchner. Machine bias. ProPublica, 2016.
  3. Geoffrey C. Bowker and Susan Leigh Star. Sorting Things Out. MIT Press, 2000.
  4. Patricia Hill Collins. Fighting words: Black women and the search for justice, volume 7. U of Minnesota Press, 1998.
  5. William Dieterich, Christina Mendoza, and Tim Brennan. COMPAS risk scales: Demonstrating accuracy equity and predictive parity. Northpoint Inc, 2016.
  6. Dave Elder-Vass. Towards a realist social constructionism. Sociologia, problemas e práticas, (70):9--24, 2012.
  7. Diana Elliott, Rob Santos, Steven Martin, and Charmaine Runes. Assessing miscounts in the 2020 census. 2019.
  8. Duana Fullwiley. The biologistical construction of race. Social studies of science, 38:695--735, 11 2008.
  9. Michael Herzfeld. The social production of indifference. University of Chicago Press 1993.
  10. Akil Kokayi Khalfani, Tukufu Zuberi, Sulaiman Bah, and Pali J Lehohla. Race and population statistics in south africa. In Tukufu Zuberi and Eduardo Bonilla-Silva, editors, White logic, white methods: racism and methodology, chapter 4, pages 63--92. Rowman & Littlefield Publishers, 2008.
  11. Jeff Larson, Surya Mattu, Lauren Kirchner, and Julia Angwin. How we analyzed the compas recidivism algorithm. ProPublica, 9, 2016.
  12. Adam Liptak. Supreme court leaves census question on citizenship in doubt. The New York Times, 2019.
  13. Katherine McKittrick. Demonic Grounds: Black Women and the Cartographies of Struggle. University of Minnesota Press, ned - new edition edition, 2006.
  14. Michael A Omi. The changing meaning of race. America becoming: Racial trends and their consequences, 1:243--263, 2001.
  15. Ramya Rajagopalan and Joan H Fujimura. Making history via dna, making dna from history. Genetics and the unsettled past: The collision of DNA, race, and history, page 143, 2012.
  16. Rashida Richardson, Jason Schultz, and Kate Crawford. Dirty data, bad predictions: How civil rights violations impact police data, predictive policing systems, and justice. New York University Law Review, 2019.
  17. Blaise Agüera y Arcas, Margaret Mitchell, and Alexander Todorov. Physiognomy's new clothes. Medium, 2017.

Cited by

See all 295

Metadata

Authors
Hanna, A., Denton, R., Smart, A., & Smith-Loud, J.
Affiliations
Google (United States) (US)
Venue
Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency
Publisher
ACM
Published
2020-01-27
Pages
501-512
OpenAlex
W2992319600
Cited by
295
References
123
Citations by year
2026: 30 · 2025: 38 · 2024: 44 · 2023: 49 · 2022: 54 · 2021: 62 · 2020: 14
FWCI
46.42
Type
conference paper
Language
en
Open access
Locations
  • ACM Conference on Fairness, Accountability, and Transparency (FAccT) (publishedVersion, cc-by)
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University) (cc-by)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
  • Social Sciences › Anthropology › Race, Genetics, and Society
  • Social Sciences › Sociology and Political Science › Critical Race Theory in Education
Keywords
critical race theory, algorithmic fairness, racial classification, social construction of race, racial inequality, socio-technical systems

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-10-11, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-11 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (gpt-6-sol).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Towards a critical race methodology in algorithmic fairness. https://app.cochat.ai/papers/10.1145/3351095.3372826
The paper
Hanna, A., Denton, R., Smart, A., & Smith-Loud, J. (2020). Towards a critical race methodology in algorithmic fairness. Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency. https://doi.org/10.1145/3351095.3372826

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.