Towards a critical race methodology in algorithmic fairness
Open accessThe DOI matches its Crossref record; 121 of the 123 references it cites were found in a registry or an index; 15 of the 131 sources its claims cite were checked for support.
Abstract
We examine the way race and racial categories are adopted in algorithmic fairness frameworks. Current methodologies fail to adequately account for the socially constructed nature of race, instead adopting a conceptualization of race as a fixed attribute. Treating race as an attribute, rather than a structural, institutional, and relational phenomenon, can serve to minimize the structural aspects of algorithmic unfairness. In this work, we focus on the history of racial categories and turn to critical race theory and sociological work on race and ethnicity to ground conceptualizations of race for fairness research, drawing on lessons from public health, biomedical research, and social survey research. We argue that algorithmic fairness researchers need to take into account the multidimensionality of race, take seriously the processes of conceptualizing and operationalizing race, focus on social processes which produce racial inequality, and consider perspectives of those most affected by sociotechnical systems.
Overview
CoChat Summary
TL;DR
This paper argues that algorithmic fairness research treats race too much like a fixed attribute, when it is better understood as socially constructed, multidimensional, and tied to histories of racial classification and oppression. The authors call for researchers to center operationalization choices, focus on racism rather than race alone, and consider the perspectives of affected communities.
Key findings
- The paper identifies a recurring problem in fairness work: racial categories are often used as if they are “single dimensional” and interchangeable, which the authors say erases social, economic, and political complexity and can reify race.
- In the COMPAS case, the authors note that the original ProPublica story had “some 700 citations” on Google Scholar, but the underlying Broward County racial schema included categories such as Black, White, Hispanic, Asian, Native American, and Other, while omitting “Native Hawaiian or Other Pacific Islander” and treating “Hispanic” as a race rather than an ethnicity.
- The authors argue that race is multidimensional, giving examples including racial identity, self-classification, observed race, reflected race, and phenotype; they say different dimensions are associated with different outcomes and measurements.
- They recommend disaggregated analysis and transparent reporting of definitions, categories, measurements, and motivations, and they say multiple measures of race should be collected if possible.
Methods
- This is a conceptual and critical review paper, not an empirical study.
- The authors synthesize histories of racial classification and scientific racism, and draw lessons from public health, biomedical research, and social survey research.
- They review algorithmic fairness literature, especially group fairness and disaggregated analysis, to articulate implications for how race should be conceptualized and operationalized.
Limitations
- The paper does not present original empirical data or experiments; this is evident from the text, which is a review/argument piece rather than a study with a sample or quantitative results.
- The authors explicitly note that category choices are often constrained by available census or bureaucratic taxonomies, which is a practical limitation for the approaches they recommend.
- Not stated in the paper.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
13 Valid · 16 Not valid · 54 Not checked · 85 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“While an area of major concern for critical race and technology scholarship, the use of racial categories in algorithmic fairness research (i.e. the research community which has emerged around venues like FA T* and AIES) has largely gone unquestioned.”
What the sources say
- Not matchedcites [22] [22] Joy Buolamwini and Timnit Gebru. Gender shades: Intersectional accuracy disparities in commercial gender classification. In FAT*, pages 77-91, 2018. -
Couldn’t be matched to a paper, so it can’t be checked.
- Supportedcites [12] [12] Sebastian Benthall and Bruce D. Haynes. Racial categories in machine learning. In Proceedings of the Conference on Fairness, Accountability, and Transparency, FAT* '19, 2019. - source
The introduction (p. 1) says that comparatively little attention is given to how protected-class labels are assigned and what their use means for fair machine-learning design. The discussion (p. 9) likewise describes group membership as typically treated as a simple fact. These passages support the claim that the field has largely left its use of racial categories unquestioned. (LLM, conf=0.91)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Not matched
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“In fact, the widespread uncritical adoption of racial categories, standardized or not, can erode awareness of the social and political histories of racial taxonomies and reify racial categories as natural kinds [19, 30, 42, 43, 78, 100, 111].”
What the sources say
- Supportedcites [19] [19] Lundy Braun, Anne Fausto-Sterling, Duana Fullwiley, Evelynn Hammonds, Alondra Nelson, William Quivers, Susan Reverby, and Alexandra E Shields. Racial categories in medical practice: How useful are they? PLoS medicine, 4:e271, 10 2007. - source
In “From Census Categories to Research Plans,” the paper says poorly defined racial categories became reified through widespread use of census categories, and that routine use makes those categories seem almost natural. “Racial Categories Are Historical, Not Natural” explains their historically specific, often hidden social and political meanings. Together, these passages support the citing sentence’s paraphrase. (LLM, conf=0.91)
- Not matchedcites [30] [30] Troy Duster. Race and reification in science. Science, 307(5712):1050-1051, 2005. -
We searched by its title and found no matching paper.
- Not matchedcites [42] [42] Duana Fullwiley. The molecularization of race: Institutionalizing human difference in pharmacogenetics practice. Science as Culture, 16(1):1-30, 2007. -
We searched by its title and found no matching paper.
- Not matchedcites [43] [43] Duana Fullwiley. The biologistical construction of race. Social studies of science, 38:695-735, 11 2008. -
We searched by its title and found no matching paper.
- Not matchedcites [78] [78] Amade M'charek. Beyond fact or fiction: On the materiality of race in practice. Cultural Anthropology, 28:420-442, 07 2013. -
We searched by its title and found no matching paper.
- Partly supportedcites [100] [100] Phia Salter and Glenn Adams. Toward a critical race psychology. Social and Personality Psychology Compass, 7, 11 2013. - sourceExperimental — accuracy not yet measured
The Synergistic foundations section cautions against essentializing identity or reifying problematic categories, supporting the concern about treating racial categories as fixed. The paper does not specifically say that widespread adoption of racial categories, standardized or otherwise, erodes awareness of the social and political histories of racial taxonomies or makes those categories appear to be natural kinds. (LLM, conf=0.78)
- Not checked — no full text of the sourcecites [111] [111] Andrew Smart, Richard Tutton, Paul Martin, George T.H. Ellison, and Richard Ashcroft. The standardization of race and ethnicity in biomedical science editorials and uk biobanks. Social Studies of Science, 38(3):407-423, 2008. - source
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“When race is utilized as a descriptive category, the choices about what categories to use and how to assign individuals to categories significantly impacts the results of analysis [18, 102, 114, 115].”
What the sources say
- Partly supportedcites [18] [18] Jenifer Bratter and Bridget K Gorman. Does multiracial matter? a study of racial disparities in self-rated health. Demography, 48:127-52, 02 2011. - sourceExperimental — accuracy not yet measured
The Self-Rated Health Disparities Using the Best-Race Identity section (page unavailable) finds that keeping multiracial respondents in separate categories produces a substantially better-fitting model than assigning them to single-race categories. But it also reports few differences in disparity patterns and only slight changes in odds ratios. The source therefore supports the importance of classification choices for this health analysis, not the unqualified claim that they significantly change analytical results generally. (LLM, conf=0.85)
- Not checked — no full text of the sourcecites [102] [102] Aliya Saperstein. Double-checking the race box: Examining inconsistency between survey measures of observed and self-reported race. Social Forces, 85(1):57-74, 2006. - source
- Supportedcites [114] [114] Edward Telles, René D. Flores, and Fernando Urrea-Giraldo. Pigmentocracies: Educational inequality, skin color and census ethnoracial identification in eight latin american countries. Research in Social Stratification and Mobility, 40:39 - 58, 2015. - source
The paper states that choosing census ethnoracial categories is consequential for counts and inequality estimates. In §9, Conclusions, it also reports that estimates based on skin color were more consistent and robust than those based on ethnoracial identification, supporting the claim that how people are categorized affects analytical results. (LLM, conf=0.92)
- Not checked — no full text of the sourcecites [115] [115] Edward E. Telles and Nelson Lim. Does it matter who answers the race question? racial classification and income inequality in brazil. Demography, 35(4):465-474, 1998. - source
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The sources with a verdict support this claim; the rest weren’t checked yet, have no full text we could read, or their verdicts aren’t rated yet.
In the paper
“Frameworks for algorithmic audit studies [22, 92] and standardized model reporting guidelines [81] have highlighted the importance of reporting model statistics disaggregated by groups defined along cultural, demographic, or phenotypic lines.”
What the sources say
- Not matchedcites [22] [22] Joy Buolamwini and Timnit Gebru. Gender shades: Intersectional accuracy disparities in commercial gender classification. In FAT*, pages 77-91, 2018. -
We searched by its title and found no matching paper.
- Not checked — no full text of the sourcecites [92] [92] Inioluwa Deborah Raji and Joy Buolamwini. Actionable auditing: Investigating the impact of publicly naming biased performance results of commercial ai products. In AIES, 2019. - source
- Supportedcites [81] [81] Margaret Mitchell, Simone Wu, Andrew Zaldivar, Parker Barnes, Lucy Vasserman, Ben Hutchinson, Elena Spitzer, Inioluwa Deborah Raji, and Timnit Gebru. Model cards for model reporting. In FAT, 2019. - source
The citation to this paper supports the standardized model-reporting-guidelines part of the sentence. The Introduction (p. 2) advocates breaking down quantitative model-performance results by cultural, demographic, and phenotypic groups, and Quantitative Analyses (p. 6) says results should be disaggregated. (LLM, conf=0.95)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Not matched
A result the paper states — it cites no source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“These categories look familiar - they are nearly identical to the way that the US Census defines race.”
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
63 more claims
Create a free account to see all 168 claims and to verify the 7 references still open.
- It may state two separate claims as one. 46
- Probably not a substantial claim. 78
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The call for a global lens in AI accountability is not new [84,155], but the ethical principles in AI are often interpreted, prioritised, contextualised, and implemented differently across the globe [98].”
From Re-imagining Algorithmic Fairness in India and Beyond (2021) · cites this paper as [84]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The labeling of groups may grant legitimacy to these boundaries, define relational differences between groups, and reinforce social hierarchies and power imbalances, often with very real and material consequences that can segregate, marginalize, and oppress (Beukeboom and Burgers 2019; Hanna et al. 2020).”
From Bias and Fairness in Large Language Models: A Survey (2024) · cites this paper as Hanna et al. 2020
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Delineating between social groups is often required to assess disparities, yet can simultaneously legitimize social constructions, reinforce power differentials, and enable systems of oppression (Hanna et al. 2020).”
From Bias and Fairness in Large Language Models: A Survey (2024) · cites this paper as Hanna et al. 2020
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“These strategies tend to ignore or conceal distinct mechanisms of oppression that operate differently for each social group (Hanna et al. 2020).”
From Bias and Fairness in Large Language Models: A Survey (2024) · cites this paper as Hanna et al. 2020
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“We highlight that social groups are often socially constructed, a form of classification with delineations that are not static and may be contested (Hanna et al. 2020).”
From Bias and Fairness in Large Language Models: A Survey (2024) · cites this paper as Hanna et al. 2020
1 more claim about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Seeing like a State: How Certain Schemes to Improve the Human Condition Have Failed
Fukuyama, F., & Scott, J. C. (1998) · Foreign Affairs · doi:10.2307/20048980 · Cited by 8,396
American Apartheid: Segregation and the Making of the Underclass.
Fernandez, R. M., Massey, D. S., & Denton, N. A. (1993) · Contemporary Sociology · doi:10.2307/2074502 · Cited by 6,193
Sorting Things Out: Classification and Its Consequences
Bowker, G. C., & Star, S. L. (1999) · doi:10.7551/mitpress/6352.001.0001 · Cited by 6,188
Statistics and Causal Inference
Holland, P. W. (1986) · Journal of the American Statistical Association · doi:10.1080/01621459.1986.10478354 · Cited by 5,293 · cited 2×
“There has also been significant debate about the appropriate use of racial variables in studies aimed at identifying causal effects [46, 54, 55, 58, 67].”
Bertrand, M., & Mullainathan, S. (2004) · American Economic Review · doi:10.1257/0002828042002561 · Cited by 4,504
Toward a Critical Race Theory of Education
Ladson-Billings, G., & Tate, W. F. (1995) · Teachers College Record: The Voice of Scholarship in Education · doi:10.1177/016146819509700104 · Cited by 3,881 · cited 1×
“"that all difference is both analogous and equivalent" [68].”
Background(2018) · Cited by 3,510
Racial Formation in the United States
Omi, M., & Winant, H. (2014) · doi:10.4324/9780203076804 · Cited by 3,510 · cited 3×
“Projects that "misrecognize" race as natural [27] are driven by the hegemonic nature of racial projects [86].”
BackgroundInfluentialThe Social Construction of What?
Dupre, J., & Hacking, I. (2000) · The Journal of Philosophy · doi:10.2307/2678463 · Cited by 3,444 · cited 1×
“As Hacking [48] has said, social constructivism is the act of "making up people.”
BackgroundFoucault, M. (2005) · doi:10.4324/9780203996645 · Cited by 3,281
Research works printed but not linked: 17
- Julia Angwin and Jeff Larson. Propublica responds to company's critique of machine bias story. ProPublica, 29, 2016.
- Julia Angwin, Jeff Larson, Surya Mattu, and Lauren Kirchner. Machine bias. ProPublica, 2016.
- Geoffrey C. Bowker and Susan Leigh Star. Sorting Things Out. MIT Press, 2000.
- Patricia Hill Collins. Fighting words: Black women and the search for justice, volume 7. U of Minnesota Press, 1998.
- William Dieterich, Christina Mendoza, and Tim Brennan. COMPAS risk scales: Demonstrating accuracy equity and predictive parity. Northpoint Inc, 2016.
- Dave Elder-Vass. Towards a realist social constructionism. Sociologia, problemas e práticas, (70):9--24, 2012.
- Diana Elliott, Rob Santos, Steven Martin, and Charmaine Runes. Assessing miscounts in the 2020 census. 2019.
- Duana Fullwiley. The biologistical construction of race. Social studies of science, 38:695--735, 11 2008.
- Michael Herzfeld. The social production of indifference. University of Chicago Press 1993.
- Akil Kokayi Khalfani, Tukufu Zuberi, Sulaiman Bah, and Pali J Lehohla. Race and population statistics in south africa. In Tukufu Zuberi and Eduardo Bonilla-Silva, editors, White logic, white methods: racism and methodology, chapter 4, pages 63--92. Rowman & Littlefield Publishers, 2008.
- Jeff Larson, Surya Mattu, Lauren Kirchner, and Julia Angwin. How we analyzed the compas recidivism algorithm. ProPublica, 9, 2016.
- Adam Liptak. Supreme court leaves census question on citizenship in doubt. The New York Times, 2019.
- Katherine McKittrick. Demonic Grounds: Black Women and the Cartographies of Struggle. University of Minnesota Press, ned - new edition edition, 2006.
- Michael A Omi. The changing meaning of race. America becoming: Racial trends and their consequences, 1:243--263, 2001.
- Ramya Rajagopalan and Joan H Fujimura. Making history via dna, making dna from history. Genetics and the unsettled past: The collision of DNA, race, and history, page 143, 2012.
- Rashida Richardson, Jason Schultz, and Kate Crawford. Dirty data, bad predictions: How civil rights violations impact police data, predictive policing systems, and justice. New York University Law Review, 2019.
- Blaise Agüera y Arcas, Margaret Mitchell, and Alexander Todorov. Physiognomy's new clothes. Medium, 2017.
Cited by
Items 101–200 of 293
Evaluating the Impact of Social Determinants on Health Prediction in the Intensive Care Unit
Yang, M. Y., Kwak, G. H., Pollard, T., Celi, L. A., & Ghassemi, M. (2023) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1145/3600211.3604719 · Cited by 33
Intercultural Computing Education: Toward Justice Across Difference
Arawjo, I., & Mogos, A. (2021) · ACM Transactions on Computing Education · doi:10.1145/3458037 · Cited by 29
“Thus, racial identities do not arise naturally, they are developed under various social pressures and surveillance, including researcher identifications, especially when participants are children [63, 68, 77].”
BackgroundWhy, when, and from whom: considerations for collecting and reporting race and ethnicity data in HCI
Chen, Y. T., Smith, A. D. R., Reinecke, K., & To, A. (2023) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581122 · Cited by 30
“For instance, Hanna et al. [42] and Roth [99] have outlined some of these particular dimensions or “proxies”.”
BackgroundInfluentialMulti-dimensional Discrimination in Law and Machine Learning - A Comparative Overview
Roy, A. G., Horstmann, J., & Ntoutsi, E. (2023) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3593013.3593979 · Cited by 43
“Scholarship has emphasised how race is often assumed to be fixed and mono-dimensional, even in work on algorithmic fairness [31].”
BackgroundClinical algorithms, racism, and “fairness” in healthcare: A case of bounded justice
El‐Azab, S. A., & Nong, P. (2023) · Big Data & Society · doi:10.1177/20539517231213820 · Cited by 24
“By way of illustration, race and ethnicity data are critical attributes in algorithmic fairness methodologies that address racial bias, with great emphasis placed on ensuring that clinical data sets are representative of marginalized racial and ethnic groups (Hanna et al., 2020).”
BackgroundCo-producing AIED Ethics Under Lockdown: an Empirical Study of Deliberative Democracy in Action
Swist, T., Shum, S. B., & Gulson, K. Ν. (2024) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-023-00380-z · Cited by 35
“FATE-related research spans diverse spheres of society (Boyd & Crawford, 2012; Diakopoulos, 2014; Hanna et al., 2020; Holstein et al., 2019a), and is now focusing on how these issues manifest in education.”
Products of Positionality: How Tech Workers Shape Identity Concepts in Computer Vision
Scheuerman, M. K., & Brubaker, J. R. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3641890 · Cited by 33
“Hanna et al. similarly argue that the treatment of race as categorical erases the reality that race is socially constructed and meaningful [28].”
BackgroundImage fairness in deep learning: problems, models, and challenges
Tian, H., Zhu, T., Liu, W., & Zhou, W. (2022) · Neural Computing and Applications · doi:10.1007/s00521-022-07136-1 · Cited by 32
“As discussed in [17, 18], an image feature, such as race, cannot be modified from one attribute to another, and enforcing fairness with other methods is inefficient compared to deep model methods [19].”
BackgroundBiju, P. R., & Gayathri, O. (2023) · AI & Society · doi:10.1007/s00146-023-01685-2 · Cited by 29
“However, this research understands that AI fairness debates must be culturally and socially situated (Hanna et al. 2020).”
Andrus, M., Spitzer, E., Brown, J., & Xiang, A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2011.02282 · Cited by 21
“Work in this area has addressed race [13, 35], gender [34, 43, 72], and disability [11], calling into question what it means to even rely on these categories as a basis for assessing unfairness, and what harms are reproduced by relying on these infrastructures of categorization.”
BackgroundSchelenz, L. (2022) · Social and Cultural Studies of Robots and AI · doi:10.1007/978-3-030-88615-8_11 · Cited by 18
An Empirical Analysis of Racial Categories in the Algorithmic Fairness Literature
Abdu, A. A., Pasquetto, I. V., & Jacobs, A. Z. (2023) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3593013.3594083 · Cited by 34
“Additionally, the conference has adopted an increasingly reflexive and self-critical orientation, as exemplified by the existing critiques of racial categories in the algorithmic fairness literature [2, 14].”
BackgroundInfluentialIntersectional Experiences of Unfair Treatment Caused by Automated Computational Systems
van Nuenen, T., Such, J. M., & Coté, M. (2022) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3555546 · Cited by 26
“We thus aim to minimise the definitions and explanations of fairness in AI derived from previous research into our survey instrument [57].”
BackgroundMethodPinney, C., Raj, A., Hanna, A., & Ekstrand, M. D. (2023) · Conference on Human Information Interaction and Retrieval · doi:10.1145/3576840.3578316 · Cited by 35
“Finally, when constructing new data sets for either research or application purposes, we recommend collection and curation that is thoughtful and respectful towards different gender identities, as well as taking into account that there is a danger in collecting demographic information in and of itself, as such informa…”
Self-citationCounterfactual Fairness for Facial Expression Recognition
Cheong, J., Kalkan, S., & Güneş, H. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-25072-9_16 · Cited by 38
“However, this approach of treating race as an attribute fails to take into account the multi-dimensionality of race [21] which represents a research area that future researchers can look into.”
BackgroundConceptualizing Algorithmic Stigmatization
Andalibi, N., Pyle, C., Barta, K., Xian, L., Jacobs, A. Z., & Ackerman, M. S. (2023) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3580970 · Cited by 33
“More substantive approaches to algorithmic harms attend to social context more broadly, drawing from STS [64, 132], critical race theory [21, 93], feminist scholarship [8, 106, 162, 191], legal scholarship [137, 178], and political theory [49, 177].”
BackgroundRepresentation in AI Evaluations
Bergman, A. S., Hendricks, L. A., Rauh, M., Wú, B., Agnew, W. S., Kunesch, M., Duan, I., Gabriel, I., & Isaac, W. S. (2023) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3593013.3594019 · Cited by 35
“Good practice for group selection will naturally be dependent on the context and goals of the technology in question [63, 118], e.g. the common demographic groupings in India are different from the standard groupings based off the sociopolitical context of the United States [124].”
BackgroundSubverting machines, fluctuating identities: Re-learning human categorization
Lu, C., Kay, J., & McKee, K. R. (2022) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3531146.3533161 · Cited by 40
Controlled Analyses of Social Biases in Wikipedia Bios
Field, A., Park, C. Y., Lin, K., & Tsvetkov, Y. (2022) · International World Wide Web Conference (WWW) · doi:10.1145/3485447.3512134 · Cited by 37
“Identity traits are fluid, difficult to operationalize, and depend on social context [9, 21].”
BackgroundFrom Explanation to Recommendation: Ethical Standards for Algorithmic Recourse
Sullivan, E., & Verreault-Julien, P. (2022) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1145/3514094.3534185 · Cited by 23
Mitigating allocative tradeoffs and harms in an environmental justice data tool
Huynh, B. Q., Chin, E. T., Koenecke, A., Ouyang, D., Ho, D. E., Kiang, M. V., & Rehkopf, D. H. (2024) · Nature Machine Intelligence · doi:10.1038/s42256-024-00793-y · Cited by 25
“In the algorithmic fairness literature, uncertainty has been formulated as a driver of algorithmic bias for ranking algorithms, and race has been found to be inferred from models that do not include it as a variable 5,20,39 .”
Das, D., Guha, S., Brubaker, J. R., & Semaan, B. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642669 · Cited by 49
“AI systems’ reductionist representations rely on codified stereotypes [21] and induce essentialization of certain identities [82], which Scheuerman et al. in the case of computer vision (CV) characterized as an “extended colonial project” [149].”
Disentangling Perceptions of Offensiveness: Cultural and Moral Correlates
Davani, A. M., Díaz, M., Baker, D., & Prabhakaran, V. (2024) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3630106.3659021 · Cited by 53
Naudts, L. (2024) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3630106.3658934 · Cited by 26
“They enable the state to track and monitor citizen’s daily activities, and if need be, interfere in their actions in highly dynamic, adaptive and/or autonomous ways [22, 41, 67].”
BackgroundConstructing categories: Moving beyond protected classes in algorithmic fairness
Belitz, C., Ocumpaugh, J. L., RITTER, S., Baker, R. S., Fancsali, S. E., & Bosch, N. (2022) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.24643 · Cited by 22
Fairness Through Robustness: Investigating Robustness Disparity in Deep LearningPreprint
Nanda, V., Dooley, S. W., Singla, S., Feizi, S., & Dickerson, J. P. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.12621 · Cited by 15
“We know this to be reductive and serves to minimize the contextualization within which race and gender derive their meaning [6, 21].”
BackgroundKim, S., Ho, J., Li, Y., Fan, B., Yang, W. Y., Ramey, J. B., Fox, S., Zhu, H., Zimmerman, J., & Eslami, M. (2024) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3686905 · Cited by 21
“Such findings align with existing and contentious debates around whether identity such as gender and race should be even considered as a factor in making data-driven decisions [28, 68, 91].”
Bias in AI systems: integrating formal and socio-technical approaches
Ahmad, A., Vallès, Y., & Idaghdour, Y. (2026) · Frontiers in Big Data · doi:10.3389/fdata.2025.1686452 · Cited by 33
The Psychosocial Impacts of Generative AI Harms
Vassel, F.-M., Shieh, E., Sugimoto, C. R., & Monroe‐White, T. (2024) · Proceedings of the AAAI Symposium Series · doi:10.1609/aaaiss.v3i1.31251 · Cited by 29
“Foundational AI bias and fairness studies (Buolamwini and Gebru 2018; Hanna et al. 2020) reveal that marginalized communities are disproportionately impacted by sociotechnical harms generated by algorithmic systems.”
BackgroundEvaluating Food Packaging Waste in Schools: A Systematic Literature Review
Heiges, J., Lee, D. L., Vollmer, L., Wobbekind, K., Thompson, H. R., Gosliner, W. A., Madsen, K. A., O’Neill, K., & Ritchie, L. D. (2022) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph19095607 · Cited by 29
Causal Inference in Natural Language Processing: Estimation, Prediction, Interpretation and BeyondPreprint
Feder, A., Keith, K. A., Manzoor, E., et al. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2109.00725 · Cited by 14
“However, there are important questions about the legitimacy of treating attributes like race as variables subject to intervention (e.g., Kohler-Hausmann, 2018; Hanna et al., 2020), and Kilbertus et al.”
BackgroundDrage, E., & Frabetti, F. (2024) · Science, Technology, & Human Values · doi:10.1177/01622439231164660 · Cited by 13
“These attempts to pinpoint and extract the source of a system’s racism or sexism are of most value when they acknowledge that race and gender are both materially lived and socially constructed (Hanna et al. 2020).”
Dass, R. K., Petersen, N., Omori, M. K., Lave, T. R., & Visser, U. (2022) · AI & Society · doi:10.1007/s00146-022-01440-z · Cited by 17
“Given these ongoing debates, a growing body of research has focused on identifying current limitations (Buolamwini and Gebru 2018; Hanna et al. 2020; Raji and Fried 2021), working towards technical solutions (Ryu et al. 2017; Kärkkäinen and Joo 2021; Dass et al. 2020), forcing the industry to be…”
BackgroundMartin, D., Prabhakaran, V., Kuhlberg, J., Smart, A., & Isaac, W. S. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.09663 · Cited by 13
“conceptions such as race and gender in CBSD models as well as in machine learning [40, 50].”
Self-citationWhat's Fair About Individual Fairness?Preprint
Fleisher, W. (2021) · SSRN Electronic Journal · doi:10.2139/ssrn.3819799 · Cited by 13
Tanksley, T., Smith, A. D. R., Sharma, S., & Huff, E. W. (2025) · Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713510 · Cited by 19
Not Just a Preference: Reducing Biased Decision-making on Dating Websites
Ma, Z., & Gajos, K. Z. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3517587 · Cited by 19
“However, algorithms that allocate resources in a racially blind way only reproduce existing social biases [46].”
BackgroundCounterspeakers’ Perspectives: Unveiling Barriers and AI Needs in the Fight against Online Hate
Mun, J., Buerger, C., Liang, J. T., Garland, J., & Sap, M. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642025 · Cited by 45
Measuring diversity in Hollywood through the large-scale computational analysis of film
Bamman, D., Samberg, R., So, R. J., & Zhou, N. (2024) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2409770121 · Cited by 18
Fairness and Discrimination in Information Access SystemsPreprint
Ekstrand, M. D., Das, A., Burke, R., & Díaz, F. (2021) · arXiv (Cornell University) · Cited by 13
Lee, S., Choi, D., Truong, L., Sawhney, N., & Paakki, H. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713091 · Cited by 26
“Additionally, to prevent reinforcing stereotypes or biases, AI systems should be trained on diverse datasets and regularly audited for fairness [58], promoting an inclusive environment that respects each individual’s unique cultural journey [24].”
Fairness Beyond the Algorithmic Frame: Actionable Recommendations for an Intersectional Approach
Vethman, S., Smit, Q. T. S., van Liebergen, N. M., & Veenman, C. J. (2025) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3715275.3732210 · Cited by 18
Manifestations of xenophobia in AI systems
Tomašev, N., Maynard, J. L., & Gabriel, I. (2024) · AI & Society · doi:10.1007/s00146-024-01893-4 · Cited by 25
“For while the category of "race" is socially constructed, contested, and multifaceted (Hanna et al. 2020; Benjamin 2019), it seems clear that a person can encounter racial discrimination without also necessarily having their membership of the civic community called into question.”
The Neutrality Fallacy: When Algorithmic Fairness Interventions are (Not) Positive Action
Weerts, H., Xenidis, R., Tarissan, F., Olsen, H. P., & Pechenizkiy, M. (2024) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3630106.3659025 · Cited by 24
Alsoubai, A., Park, J., Qadir, S., Stringhini, G., Razi, A., & Wiśniewski, P. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642315 · Cited by 16
Lewis, A., Dangol, A., Suh, H., Olszewski, A., Fogarty, J. A., & Kientz, J. A. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3714131 · Cited by 22
“We assessed for cultural bias, linguistic bias, and disability bias, informed by prior literature exploring bias in language and image models [37, 57], AI fairness [18, 42, 51, 58], and critical racial equity, disability, and intersectional frameworks [16, 62, 82].”
Affirmative Algorithms: Relational Equality as Algorithmic Fairness
Zhang, M. (2022) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3531146.3533115 · Cited by 19
“1 Hence there has been a call to understand algorithmic fairness beyond statistical equality by drawing from other fields such as philosophy, feminist studies, and critical race theory [18, 43, 45].”
BackgroundOn the site of predictive justice
Lazar, S., & Stone, J. O. H. (2023) · Noûs · doi:10.1111/nous.12477 · Cited by 20
Data stratification analysis on the propagation of discriminatory effects in binary classification
Minatel, D., da Silva, A. C. M., dos Santos, N. R., Cúri, M., Marcacini, R. M., & Lopes, A. D. A. (2023) · doi:10.5753/kdmile.2023.232582 · Cited by 11
“However, in the context of smooth discriminatory effect, this process must consider some criteria to balance the class distributions based on settings that aggregate fair sense [Hanna et al. 2020; Gerdon et al. 2022].”
Engineering equity: designing diversity-aware AI to reflect humanity
Shin, D. (2025) · AI & Society · doi:10.1007/s00146-025-02314-w · Cited by 12
“Inter-disciplinary teams, including experts in social sciences, ethics, and law, should be involved in the development process to ensure that these models are not just technically sound but also socially responsible (Hanna et al. 2020).”
Social norm bias: residual harms of fairness-aware algorithms
Cheng, M., De‐Arteaga, M., Mackey, L. W., & Kalai, A. T. (2023) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-022-00910-8 · Cited by 21
“These approaches do not account for the complex, multi-dimensional nature of concepts like gender and race [17, 34].”
BackgroundWhy Fair Labels Can Yield Unfair Predictions: Graphical Conditions for Introduced Unfairness
Ashurst, C., Carey, R., Chiappa, S., & Everitt, T. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i9.21182 · Cited by 26
“We highlight four limitations, starting with the most general: 1) Fairness definitions require us to define and formalise group membership, an exercise that is fraught with practical and ethical difficulties (West, Whittaker, and Crawford 2019; Kohler-Hausmann 2018; Hanna et al. 2020).”
BackgroundCheng, L., Gallegos, I. O., Ouyang, D., Goldin, J. S., & Ho, D. E. (2023) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3593013.3594034 · Cited by 19
Performative Ethics From Within the Ivory Tower: How CS Practitioners Uphold Systems of Oppression
McFadden, Z., & Alvarez, L. (2024) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.15423 · Cited by 14
“As Hanna et al. note, “treating race [or any marginalized aspect of identity] as an attribute, rather than a structural, institutional, and relational phenomenon, in turn, serves to minimize the structural aspects of algorithmic unfairness” (Hanna et al., 2020).”
BackgroundIntersectional biases in narratives produced by open-ended prompting of generative language models
Shieh, E., Vassel, F.-M., Sugimoto, C. R., & Monroe‐White, T. (2026) · Nature Communications · doi:10.1038/s41467-025-68004-9 · Cited by 32
“Given our context of studying fi ctional characters generated by LMs, our study instead measures observed identity 46 via associations between identity categories and textual proxies.”
InfluentialBalancing Act: Evaluating People’s Perceptions of Fair Ranking Metrics
Alkhathlan, M., Cachel, K., Shrestha, H., Harrison, L., & Rundensteiner, E. A. (2024) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3630106.3659018 · Cited by 14
What Is Fair? Defining Fairness in Machine Learning for Health
Gao, J., Chou, B., McCaw, Z. R., Thurston, H., Varghese, P., Hong, C., & Gronsbell, J. L. (2025) · Statistics in Medicine · doi:10.1002/sim.70234 · Cited by 30
“We also highlight complementary work that interrogates the broader question of how certain protected attributes, such as race [131] and gender [139], are conceptualized and operationalized within algorithmic systems [124, 140].”
Fairness Hacking: The Malicious Practice of Shrouding Unfairness in Algorithms
Meding, K., & Hagendorff, T. (2024) · Philosophy & Technology · doi:10.1007/s13347-023-00679-8 · Cited by 19
“PhenomenasuchasSimpson’sparadox(Sharmaetal.,2022)andfairness gerrymanderingdisadvantagingsubgroupsdespitegroupfairness,(Kearnsetal.,2018) furtherunderpinthisinsightandaresimilartofairnesshacking.”
Ionescu, S., Hannák, A., & Joseph, K. (2021) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3442188.3445904 · Cited by 17
Productive myopia: Racialized organizations and edtech
Crooks, R. N. (2021) · Big Data & Society · doi:10.1177/20539517211050499 · Cited by 10
“Beyond organizational studies and sociology, Ray’s theory of racialized organizations has been cited in works on, among other topics, algorithmic fairness (Hanna et al., 2020), public health disparities (Garcia et al., 2021), and education (Lerma et al., 2020; Vargas and Villa-Palomino, 2019).”
BackgroundImperfect Inferences: A Practical Assessment
Rieke, A., Southerland, V., Svirsky, D., & Hsu, M. (2022) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3531146.3533140 · Cited by 16
“These authors critique the very notion of using these categories as a basis for assessing unfairness, and the potential harms relying on these categories might create [4].”
BackgroundIonescu, S., Hannák, A., & Pagan, N. (2023) · ACM Conference on Recommender Systems (RecSys) · doi:10.1145/3604915.3608841 · Cited by 22
Decoding the algorithmic operations of Australia's National Disability Insurance Scheme
van Toorn, G., & Carney, T. (2024) · Australian Journal of Social Issues · doi:10.1002/ajs4.342 · Cited by 16
Deep Learning: Systems and Responsibility
Wasay, A., Chatterjee, S., & Idreos, S. (2021) · ACM SIGMOD International Conference on Management of Data (SIGMOD) · doi:10.1145/3448016.3457541 · Cited by 14
Keith, K. A., Rice, D. R., & O’Connor, B. (2021) · doi:10.18653/v1/2021.cinlp-1.2 · Cited by 13
“However, inspired by the causal consistency arguments from Hernán (2016),9 we examine several competing versions of treatment for our theoretical case study of U.S. Supreme Court oral arguments and explain the reasons we eventually choose version #5 (in bold): 1.”
BackgroundRecommenders with a mission: assessing diversity in newsrecommendationsPreprint
Vrijenhoek, S., Kaya, M., Metoui, N., Möller, J. E., Odijk, D., & Helberger, N. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2012.10185 · Cited by 13
“[18] argue that race and ethnicity are strongly social constructs that should not be treated as objective differences between groups.”
Beyond "Fairness:" Structural (In)justice Lenses on AI for EducationPreprint
Madaio, M., Blodgett, S. L., Mayfield, E., & Dixon‐Román, E. J. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2105.08847 · Cited by 49
“…may be inappropriate or inconsistent; for example, Hanna et al. delineate the many ways in which race has been operationalized in measurements of algorithmic fairness, from interviewer-observed, appearance-based classifications to self-declared racial classifications [Hanna et al., 2020].”
BackgroundUnlawful Proxy Discrimination: A Framework for Challenging Inherently Discriminatory Algorithms
Weerts, H., Kelly‐Lyth, A., Binns, R., & Adams‐Prassl, J. (2024) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3630106.3659010 · Cited by 22
Gebru, T., & Denton, E. (2024) · Foundations and Trends® in Computer Graphics and Vision · doi:10.1561/0600000102 · Cited by 16
Self-citationUnderstanding Human-AI Misalignment in LLM-Based Job-Seeking Support for Neurodivergent Users
Hall, K., Ma, M., Zhang, X., Swain, V. D., & Kim, J. G. (2025) · International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS) · doi:10.1145/3663547.3746361 · Cited by 10
“These issues underscore the need for interaction designs, in addition to better training data, that help users understand model boundaries for more engaged and aware use [14, 30].”
Sharma, S., & Shakya, H. K. (2023) · Communications in computer and information science · doi:10.1007/978-3-031-25088-0_58 · Cited by 7
Sikstrom, L., Maslej, M. M., Findlay, Z., Strudwick, G., Hui, K., Zaheer, J., Hill, S., & Buchman, D. Z. (2023) · BMJ Open · doi:10.1136/bmjopen-2022-069255 · Cited by 7
Beyond the ML Model: Applying Safety Engineering Frameworks to Text-to-Image Development
Rismani, S., Shelby, R. M., Smart, A., Santos, R. D., Moon, A., & Rostamzadeh, N. (2023) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1145/3600211.3604685 · Cited by 27
“To intervene in these concerns, researchers have proposed quantitative [23, 40], qualitative [26, 44, 51, 59], and epistemological frameworks [22, 29, 52] to better identify and manage the social and ethical risks of ML systems; however, many proposed evaluation methods focus narrowly on the performance and properties…”
BackgroundSelf-citationCritical computational social science
Shugars, S. (2024) · EPJ Data Science · doi:10.1140/epjds/s13688-023-00433-2 · Cited by 7
“Much like pre-computational efforts to standardize categories and measures, these big data mechanism systematically erase some identities—choosing, for example, not to collect or report data on racial and gender minorities who comprise a relatively small share of the population [4, 45].”
BackgroundThe Use and Misuse of Counterfactuals in Ethical Machine Learning
Kasirzadeh, A., & Smart, A. (2021) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3442188.3445886 · Cited by 134
“[23] use critical race theory and argue that the multi-dimensionality of race should be taken into account whenever this phenomenon becomes relevant to the machine learning community, and challenges practitioners to explicitly ask who is doing the categorizing and for what purpose? Barocas et al.”
BackgroundSelf-citationLocality of Technical Objects and the Role of Structural Interventions for Systemic Change
Cortés, E. C., Rajtmajer, S. M., & Ghosh, D. (2022) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3531146.3534646 · Cited by 9
ProportionNet: Balancing Fairness and Revenue for Auction Design with Deep LearningPreprint
Kuo, K., Ostuni, A., Horishny, E., Curry, M. J., Dooley, S. W., Chiang, P.-Y., Goldstein, T., & Dickerson, J. P. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.06398 · Cited by 36
Measurement as governance in and for responsible AIPreprint
Jacobs, A. Z. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2109.05658 · Cited by 24
“We can then functionally connect our understanding of consequential validity to large and nearby conversations: for instance, race as and of technology [5, 70], from the larger context of critical race theory [18, 32].”
BackgroundSituating questions of data, power, and racial formation
Shelby, R. M., & Henne, K. (2022) · Big Data & Society · doi:10.1177/20539517221090938 · Cited by 9
“…approaches to race and other social hierarchies in machine learning (Hoffmann, 2019), strategies for operationalizing the multidimensionality of race in sociotechnical systems (Hanna et al., 2020), and frameworks for addressing racialized harms, such as algorithmic reparation (Davis et al., 2021).”
BackgroundEthnography and Machine Learning: Synergies and New Directions
Li, Z., & Abramson, C. M. (2023) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780197653609.013.36 · Cited by 12
Action-guidance and AI ethics: the case of fair machine learning
Sahlgren, O. (2024) · AI and Ethics · doi:10.1007/s43681-024-00437-2 · Cited by 11
“This is no simple task because those comparison classes may include complex social categories (e.g., ‘race’ and ‘gender’) that are notoriously difficult to operationalize and measure [12].”
Conceptual scaffolding for the philosophy of medicine
Friedman, Y. (2024) · Medicine Health Care and Philosophy · doi:10.1007/s11019-024-10231-w · Cited by 10
Behind the Mask: Demographic bias in name detection for PII masking
Mansfield, C., Paullada, A., & Howell, K. (2022) · Workshop on Language Technology for Equality, Diversity, Inclusion (LT-EDI) · doi:10.18653/v1/2022.ltedi-1.10 · Cited by 20
Unlearning Descartes: Sentient AI is a Political Problem
Hull, G. (2023) · Journal of Social Computing · doi:10.23919/jsc.2023.0020 · Cited by 9
Ethnic Classifications in Algorithmic Fairness: Concepts, Measures and Implications in Practice
Jaime, S., & Kern, C. A. (2024) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3630106.3658902 · Cited by 19
Racial/Ethnic Categories in AI and Algorithmic Fairness: Why They Matter and What They Represent
Mickel, J. (2024) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3630106.3659050 · Cited by 21
“It is unclear since the dataset developers do not discuss how a person’s racial identity is determined [3, 25] Are physical characteristics asked of an individual?”
BackgroundMethodInfluentialWhat Knowledge Do We Produce from Social Media Data and How?
Garcia, A. A., Yang, T., & Miceli, M. (2025) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3701216 · Cited by 12
Twenty-Five Years of Charles Mills’s Racial Contract in Sociology
Maghbouleh, N. (2022) · Sociology of Race and Ethnicity · doi:10.1177/23326492221119888 · Cited by 6
Towards Labor Transparency in Situated Computational Systems Impact Research
Jing, F. S., Berger, S., & Sandoval, . C. B. (2023) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3593013.3594060 · Cited by 7
Black Innovation: Creating and Appropriating Technology to Survive and Thrive
Klassen, S. (2022) · International ACM SIGGROUP Conference on Supporting Group Work (GROUP) · doi:10.1145/3565967.3571762 · Cited by 7
Dirty Data Labeled Dirt Cheap: Epistemic Injustice in Machine Learning SystemsPreprint
Hull, G. (2022) · SSRN Electronic Journal · doi:10.2139/ssrn.4137697 · Cited by 6
Smuha, N. A. (2021) · SSRN Electronic Journal · doi:10.2139/ssrn.4093683 · Cited by 9
Martinez, R., Hollebeke, M. V., Squire, K. D., Wu, T., & Zamarato, M. (2025) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3706599.3706679 · Cited by 5
Algorithmic Reproductive Justice
Fledderjohann, J., Knowles, B., & Miller, E. (2024) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3630106.3658903 · Cited by 12
“…the operationalisation of such socially constructed categories erases information needed to understand the patterns of difference the AI is rendering as objective fact; and, relatedly, with the growing body of work adopting a feminist approach to AI ethics [38, 58, 71, 75, 87, 121, 126, 127, 135].”
BackgroundInfluentialLa discriminación en una sociedad automatizada: Contribuciones desde América Latina
Gutiérrez, C. M. (2021) · Revista Chilena de Derecho y Tecnología · doi:10.5354/0719-2584.2021.58793 · Cited by 18
Cunningham, J. L. (2023) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3544549.3577057 · Cited by 12
Park, J., Gracie, J., Alsoubai, A., Razi, A., & Wiśniewski, P. (2024) · ACM International Conference on Interaction Design and Children (IDC) · doi:10.1145/3628516.3655799 · Cited by 11
AI and the Future of Work: Bridging Divides for Marginalised Workers
Kyriakidou, O., Goumas, B., Manteli, M., & Tasoula, E. (2025) · International perspectives on equality, diversity and inclusion · doi:10.1108/s2051-233320250000012023 · Cited by 7
Disaggregated Interventions to Reduce Inequality
Bynum, L., Loftus, J. R., & Stoyanovich, J. (2021) · ACM Conference on Equity and Access in Algorithms, Mechanisms, and Optimization (EAAMO) · doi:10.1145/3465416.3483286 · Cited by 12
“[12] for an overview from the perspective of algorithmic fairness).”
BackgroundMethodInfluentialCampedelli, G. M. (2019) · SocArXiv (OSF Preprints) · doi:10.31235/osf.io/853fx · Cited by 6
Metadata
- Authors
- Hanna, A., Denton, R., Smart, A., & Smith-Loud, J.
- Affiliations
- Google (United States) (US)
- Venue
- Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency
- Publisher
- ACM
- Published
- 2020-01-27
- Pages
- 501-512
- OpenAlex
- W2992319600
- Semantic Scholar
- 6e7e095f46deb297713dcde05991faf635768d29
- Cited by
- 295
- References
- 123
- Citations by year
- 2026: 30 · 2025: 38 · 2024: 44 · 2023: 49 · 2022: 54 · 2021: 62 · 2020: 14
- FWCI
- 46.42
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- ACM Conference on Fairness, Accountability, and Transparency (FAccT) (publishedVersion, cc-by)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University) (cc-by)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Social Sciences › Anthropology › Race, Genetics, and Society
- Social Sciences › Sociology and Political Science › Critical Race Theory in Education
- Keywords
- critical race theory, algorithmic fairness, racial classification, social construction of race, racial inequality, socio-technical systems
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-11, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-11 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.