Assessing risk, automating racism
The DOI matches its Crossref record; 18 of the 19 references it cites were found in a registry or an index.
Abstract
A health care algorithm reflects underlying racial bias in society
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Digital media, particularly with artificial intelligence (AI) and algorithmic decision-making, often rely on historical data that may contain biases, leading to the reinforcement of existing prejudices.172,173”
From Digital Ecosystems, Children, and Adolescents: Technical Report (2026) · cites this paper as [172]
In the citing paper
“Racism in particular has been a core focus of this literature, with multiple empirical examples of how structural racism becomes embedded in both the data used to create these tools and the output they produce.5–7”
From Equity and AI Governance at Academic Medical Centers (2024) · cites this paper as [5]
In the citing paper
“This literature includes analysis of how AI/ML and predictive models can reflect, entrench, or create existing inequities.”
From Equity and AI Governance at Academic Medical Centers (2024) · cites this paper as [5]
In the citing paper
“Algorithmic management might perpetuate societal biases and reproduce discriminatory practices at work, whether the discrimination is built into the algorithms, or management's use of the algorithm, or as a result of customer's rating of workers (Noble 2018;Benjamin 2019;Kellogg et al. 2020;Akter et al. 2021;Zajko 2021;Heinrichs 2022).”
From Artificial intelligence and work: a critical review of recent research from the social sciences (2024) · cites this paper as Benjamin 2019
Citations
Cites
Dissecting racial bias in an algorithm used to manage the health of populations
Obermeyer, Z., Powers, B., Vogeli, C., & Mullainathan, S. (2019) · Science · doi:10.1126/science.aax2342 · Cited by 7,137
Automating Inequality: How High-Tech Tools Profile, Police, and Punish the Poor
Lebovits, H. (2019) · Public Integrity · doi:10.1080/10999922.2018.1511671 · Cited by 3,279
Algorithms of Oppression: How Search Engines Reinforce Racism
Noble, S. U. (2020) · doi:10.2307/j.ctt1pwt9w5 · Cited by 2,709
Merz, S. (2020) · Ethnic and Racial Studies · doi:10.1080/01419870.2020.1715454 · Cited by 1,870
Review of “Race After Technology: Abolitionist Tools for the New Jim Code”
Jipguep-Akhtar, M. (2020) · Social Forces · doi:10.1093/sf/soz162 · Cited by 1,473
(2007) · Choice Reviews Online · doi:10.5860/choice.44-5683 · Cited by 1,296
(2018) · Cited by 1,167
Miller, J. (2007) · Psychiatric Services · doi:10.1176/appi.ps.58.10.1380 · Cited by 649
Body and Soul: The Black Panther Party and the Fight against Medical Discrimination
Nelson, A. (2011) · University of Minnesota Press eBooks · doi:10.5749/minnesota/9780816676484.001.0001 · Cited by 487
Reproducing Race: An Ethnography of Pregnancy as a Site of Racialization
Bridges, K. (2019) · University of California Press eBooks · doi:10.1525/9780520949447 · Cited by 289
Cited by
Items 201–300 of 377
Machine Learning in Sociology: Current and Future Applications
Garip, F., & Macy, M. W. (2023) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780197653609.013.11 · Cited by 4
Zink, A., Boone, C., Maddox, K. E. J., Chernew, M. E., & Neprash, H. T. (2024) · The American Journal of Managed Care · doi:10.37765/ajmc.2024.89556 · Cited by 5
An NLP‐Based Framework to Spot Extremist Networks in Social Media
Rozo, A. Z., López, D. D., Pastor-Galindo, J., Mármol, F. G., & Karabiyik, Ü. (2024) · Complexity · doi:10.1155/2024/3380488 · Cited by 3
Feminist automation: Can bots have feminist politics?
Richterich, A., & Wyatt, S. (2024) · New Media & Society · doi:10.1177/14614448241251801 · Cited by 5
“Phan (2019) and Benjamin (2019a) have moreover warned that artificial intelligence (AI) systems simultaneously automate and disguise racial and gender discrimination.”
InfluentialOnline Racism and Its Impact on Children, Adolescents, and Emerging Adults of Color
Tynes, B. M., Willis, H. A., Maxie-Moreman, A. D., Ortiz, S. M., & English, D. (2024) · Springer eBooks · doi:10.1007/978-3-031-69362-5_39 · Cited by 4
What is the resource footprint of a computer science department? Place, people, and Pedagogy
Mian, S. I., Twisleton, D., & Timm, D. (2020) · Data & Policy · doi:10.1017/dap.2020.12 · Cited by 4
“…example, Association for Computing Machinery (ACM) U.S. Public Policy Council and ACM Europe Policy Committee (2017), O ’ Neil (2017), Torresen (2018), Benjamin (2019), Birhane (2019), Birhane and Cummins (2019), Birhane and van Dijk (2020), Floridi and Cowls (2019), Jordan et al. (2019),…”
Bonner, T. J., Ayyanar, P., Milam, A. J., & Blocker, R. C. (2024) · The American Journal of Managed Care · doi:10.37765/ajmc.2024.89547 · Cited by 3
Why we should talk about institutional (dis)trustworthiness and medical machine learning
Proost, M. D., & Pozzi, G. (2024) · Medicine Health Care and Philosophy · doi:10.1007/s11019-024-10235-6 · Cited by 3
“According to Benjamin (2019), the context of structural and interpersonal racism in healthcare cannot be overlooked: as the author argues, “a ‘lack of trust’ on the part of Black patients is not the issue; instead, it is a lack of trustworthiness on the part of the medical industry”.”
Motegi, M., Noda, T., Morino, T., Torii, J., Ohto, H., Yoshida, S., Tada, H., Matsuyama, T., & Chikamatsu, K. (2025) · Journal of Adolescent Health · doi:10.1016/j.jadohealth.2025.06.018 · Cited by 2
Dialogues of Sense and Algorithm: Reconfiguring Arts-Based Research in the AI Era
Guo, J., & Fang, H. (2025) · Qualitative Inquiry · doi:10.1177/10778004251393201 · Cited by 3
“In recent years, critical AI studies have repeatedly shown that AI systems are not only limited by the absence of sensory input but also deeply shaped by the cultural biases embedded in their training data (Benjamin, 2019; Crawford, 2021; Foka & von Bonsdorff, 2025; Noble, 2018).”
Cabaço, G. D., & Rodrigues, L. (2026) · Children · doi:10.3390/children13020260 · Cited by 5
“These observations underscore the need for AI governance frameworks that explicitly address the social and structural determinants embedded in health data and healthcare systems [49].”
Understanding Algorithmic Aversion: A Bold Rejection of Digital Dominion
Ling, X., & Yan, S. (2026) · Communications of the ACM · doi:10.1145/3758088 · Cited by 2
Campbell, E., Oyefolu, O., Gillani, S., Goodtree, H., Kelly, A., Rivers, C., & Watson, C. (2026) · JMIR Public Health and Surveillance · doi:10.2196/88470 · Cited by 3
Research integrity and data ethics in AI-driven integrated healthcare: a critical appraisal
Zeng, W., Wei, H., Chen, Y., Tang, J., Ge, J., & Chen, H. (2026) · Frontiers in Public Health · doi:10.3389/fpubh.2026.1838551 · Cited by 2
“Historical patterns of discrimination encoded in medical records—such as differential referral rates or diagnostic delays—can be learned and amplified by algorithms (46).”
Robots Behaving Badly: Algorithmic Colonialism and the Consequences of AI
Carlson, B. L., & Worrell, T. (2026) · Journal of Sociology · doi:10.1177/14407833261451525 · Cited by 3
Mitroff, I. I., & Storesund, R. (2020) · Management, change, strategy and positive leadership · doi:10.1007/978-3-030-43279-9 · Cited by 2
Hammer or Measuring Tape? Artificial Intelligence and Justice in Healthcare
Heinrichs, J.-H. (2023) · Cambridge Quarterly of Healthcare Ethics · doi:10.1017/s0963180123000257 · Cited by 2
da Silva, T. R. (2023) · Sexualidad Salud y Sociedad (Rio de Janeiro) · doi:10.1590/1984-6487.sess.2023.39.e22304.a.en · Cited by 4
“…Benjamin points out that “all these variables are structured by racial domination – from job market discrimination to ghettoization – the survey measures the extent to which an individual’s life chances have been impacted by racism without ever asking an individual’s race (Benjamin, 2019, p. 81).”
Social work’s opportunity and obligation to achieve population health equity
Bussey, S. R., & Dobrof, J. (2024) · Social Work in Health Care · doi:10.1080/00981389.2024.2302620 · Cited by 4
“…within healthcare professionals’ interpretation of racial/ethnic identity), as well as balance human intelligence gathering (such as social work assessments of risk) with artificial intelligence systems to mitigate racialized biases woven into AI systems (Benjamin, 2019; Obermeyer et al., 2019).”
BackgroundTerritories of Knowledge: the Bioethical Debate on Responsible and Decolonial AI
Nas, E. (2024) · Mediações Revista de Ciências Sociais · doi:10.5433/2176-6665.2024v29n3e50076 · Cited by 2
Vasquez, F. E., & Oltmann, S. M. (2025) · Journal of Documentation · doi:10.1108/jd-09-2024-0226 · Cited by 4
Edwards, F. (2025) · Journal of Policy Analysis and Management · doi:10.1002/pam.70001 · Cited by 2
Resist, Regulate, Reimagine, and Reinforce: How Social Workers can Advocate for Digital Inclusion
Dillard, S. (2022) · Columbia Social Work Review · doi:10.52214/cswr.v20i1.9643 · Cited by 2
“Ruha Benjamin refers to this as (Benjamin, 2019).”
BackgroundMethodInfluentialInfrastructural media and discrimination: McLuhan’s method as an ethic of understanding
Dowd, J. (2023) · Explorations in Media Ecology · doi:10.1386/eme_00159_1 · Cited by 2
David, P., Onno, J., Pourraz, J., & Khan, F. A. (2024) · Digital Health · doi:10.1177/20552076241239778 · Cited by 5
“Whereas algorithms have been critically analyzed through their construction, 7 we aim at analyzing algorithms uses and insertion into their context through this tweaking work.”
MethodMeasurement of Ethical Issues in Software ProductsPreprint
Tria, F. D. (2020) · Preprints.org · doi:10.20944/preprints202006.0294.v1 · Cited by 2
The Extremism Machine: Exploring the Effects of Digital Capitalism on the Far-Right Field
Lindsay, A. (2024) · Open Access Victoria University of Wellington | Te Herenga Waka (Figshare) · doi:10.26686/wgtn.25476043 · Cited by 4
What is digital parenting? A systematic review of past measurement and blueprint for the futurePreprint
Modecki, K. L., Goldberg, R., Wiśniewski, P., & Orben, A. C. (2022) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/7zng6_v1 · Cited by 4
Oakes, E., Tsao, Y., & Borden, V. M. H. (2023) · The AIR professional file · doi:10.34315/apf1622023 · Cited by 2
Tore, P. A. D., Schiavo, F., Domenico, M. D., & Mangione, G. R. (2024) · Integrated science · doi:10.1007/978-3-031-58363-6_17 · Cited by 9
Coded Bias in Applicant Tracking Systems
Dhanabal, P., & Hao, E. (2024) · Journal of Purdue Undergraduate Research · doi:10.7771/2158-4052.1720 · Cited by 2
Anonymous dissent: Protest, privacy, and photographic surveillance in digital media
Canella, G., & Bock, M. A. (2025) · New Media & Society · doi:10.1177/14614448251349830 · Cited by 3
“Social media feeds, healthcare systems and judicial sentencing programs have all been shown to contain algorithmic biases—replicating the disparities that racialized people in the US have faced for centuries (Benjamin, 2019a, 2019b).”
Ethical strategic framing of algorithmic authority in global organizations
Kumar, D. (2025) · Journal of Information Communication and Ethics in Society · doi:10.1108/jices-05-2025-0122 · Cited by 2
Developing AI Standards that Serve the Majority World
Karanicolas, M. (2025) · Data science, machine intelligence, and law · doi:10.1007/978-3-032-02762-7_15 · Cited by 1
Patchwork surveillance and accountability labor: China's Health Code Systems during COVID-19
Xing, J. L., & Zheng, E. L. (2026) · Big Data & Society · doi:10.1177/20539517261419359 · Cited by 1
“In the digital era, scholars further warn of the potential for such systems to cause mass privacy invasion and rigid political control (Benjamin, 2019; Pasquale, 2016).”
Are We Still Sleepwalking? Rethinking Technological Somnambulism in the Age of AI
Wang, H. (2026) · Philosophy of engineering and technology · doi:10.1007/978-3-032-17371-3_8 · Cited by 1
Şenyapar, H. N. D. (2026) · Management · doi:10.58691/man/220195 · Cited by 2
“Predictive analytics and risk-scoring tools are often justified in terms of efficiency and objectivity; however, empirical evidence indicates that these systems frequently encode historical biases and institutional inequalities (Benjamin, 2019).”
Theatre of the Tech-Oppressed: Exploring Algorithmic Injustice Through Participatory Performances
Babai, N., Durall, E., Iivari, N., Kinnula, M., & Iversen, O. S. (2026) · Participatory Design Conference · doi:10.1145/3796624.3796649 · Cited by 1
“Across performances, youth illustrated how data is never just data, aligned with existing research showing how data is never neutral, but always entangled with histories of classification, surveillance, and exclusion [8, 52, 55].”
Teaching Justice: Reimagining STEM Education for Ethical AI Systems
Lubin, K.-L. (2026) · IEEE Technology and Society Magazine · doi:10.1109/mts.2026.3684716 · Cited by 1
Banday, M. U. L. (2026) · Gender Work and Organization · doi:10.1111/gwao.70203 · Cited by 1
Hütt, M. ‐., & Schubert, C. (2020) · Springer Reference Geisteswissenschaften · doi:10.1007/978-3-658-23715-8_39-1 · Cited by 4
AI and Social Impact: A Review of Current Use Cases and Broader Implications
Moore, S., Brown, S. M., & Butler, W. (2022) · Advances in information security, privacy, and ethics book series · doi:10.4018/978-1-7998-8693-8.ch008 · Cited by 3
Graham, S. S. (2022) · Oxford University Press eBooks · doi:10.1093/oso/9780197644461.003.0005 · Cited by 1
Clapp, M. A., James, K. E., McCoy, T. H., Perlis, R. H., & Kaimal, A. J. (2023) · American Journal of Perinatology · doi:10.1055/a-2008-8598 · Cited by 1
Queere KI als materiell-diskursive Apparate
Kühnen, A.-K. (2022) · AI critique · doi:10.14361/9783839461891-003 · Cited by 1
Computing Must Pay Attention to Outcomes to Achieve Equity
Trim, M. (2022) · ACM SIGCAS Computers and Society · doi:10.1145/3585066.3585068 · Cited by 1
de Sales, E. R., & Lui, L. (2023) · Revista de gestão dos países de língua portuguesa · doi:10.12660/rgplp.v22n2.2023.88882 · Cited by 13
The Place and Value of Large-Scale Qualitative Data Analysis
Weller, S., Davidson, E., Edwards, R., & Jamieson, L. (2023) · Springer eBooks · doi:10.1007/978-3-031-36324-5_1 · Cited by 1
Cearns, J., & Knox, H. (2024) · The Cambridge Journal of Anthropology · doi:10.3167/cja.2024.420103 · Cited by 2
Inteligência artificial e injustiça: para além de uma análise ética encantada dos algoritmos
Cambraia, L., & Pyrrho, M. (2024) · Revista Iberoamericana de Bioética · doi:10.14422/rib.i25.y2024.001 · Cited by 4
Na, X., Liu, H., Xu, S., Su, C., Sun, J., Zhang, W., & Lü, L. (2025) · Chaos Solitons & Fractals · doi:10.1016/j.chaos.2025.116781 · Cited by 1
US hospital algorithm discriminates against black patients, study finds
Dyer, O. (2019) · BMJ · doi:10.1136/bmj.l6232 · Cited by 1
Burnazoglu, M. (2023) · Utrecht University Repository (Utrecht University) · doi:10.33540/1388 · Cited by 6
Hislop, M. (2023) · Research Square · doi:10.21203/rs.3.rs-3249460/v1 · Cited by 1
Mitigating Algorithmic Bias in Healthcare AI for Equitable Care
Yang, Y. T. (2024) · Wiley eBooks · doi:10.1002/9781394263752.ch6 · Cited by 1
Prehn (Worimi), J., Carlson (Aboriginal), B., Walter (Palawa), M., Lovett (Wongaibon/Ngiyampaa), R., & Maher (Yamatji, N. (2026) · Journal of Sociology · doi:10.1177/14407833261460137
Mitroff, I. I., & Storesund, R. (2020) · Management, change, strategy and positive leadership · doi:10.1007/978-3-030-43279-9_3
Knowledge Systems for Material Sustainability
Kokai, A. (2020) · eScholarship (California Digital Library)
AI and Constitutionalism: The Challenges Ahead
Casonato, C. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-69128-8_9 · Cited by 3
Coloniality and the Science of Applied Behavior Analysis
Pritchett, M. (2020) · University of North Texas Digital Library (University of North Texas) · doi:10.12794/metadc1703416
Dumbwaiters and Smartphones: The Responsibility of Intelligence
Schwartz, S. W. (2022) · Social and cultural studies of robots and AI · doi:10.1007/978-3-030-88615-8_5
Spithoff, S. M., Stockdale, J., Rowe, R., McPhail, B. M., & Persaud, N. (2022) · Canadian Medical Association Journal · doi:10.1503/cmaj.210455-f
(2022) · Duke University Press eBooks · doi:10.1215/9781478022299-018
(2022) · Duke University Press eBooks · doi:10.1215/9781478022299-017
(2022) · Duke University Press eBooks · doi:10.1215/9781478022299-016
(2022) · Duke University Press eBooks · doi:10.1215/9781478022299-013
(2022) · Duke University Press eBooks · doi:10.1215/9781478022299-003
(2022) · Duke University Press eBooks · doi:10.1215/9781478022299-005
(2022) · Duke University Press eBooks · doi:10.1215/9781478022299-008
(2022) · Duke University Press eBooks · doi:10.1215/9781478022299-004
(2022) · Duke University Press eBooks · doi:10.1215/9781478022299-006
(2022) · Duke University Press eBooks · doi:10.1215/9781478022299-015
(2022) · Duke University Press eBooks · doi:10.1215/9781478022299-010
(2022) · Duke University Press eBooks · doi:10.1215/9781478022299-014
(2022) · Duke University Press eBooks · doi:10.1215/9781478022299-001
(2022) · Duke University Press eBooks · doi:10.1215/9781478022299-009
Digital Archives, Digital Exhibits, and Digital Collections
(2022) · Duke University Press eBooks · doi:10.1215/9781478022299-012
Graham, S. S. (2022) · Oxford University Press eBooks · doi:10.1093/oso/9780197644461.003.0002
Graham, S. S. (2022) · Oxford University Press eBooks · doi:10.1093/oso/9780197644461.003.0003
Graham, S. S. (2022) · Oxford University Press eBooks · doi:10.1093/oso/9780197644461.002.0006
Graham, S. S. (2022) · Oxford University Press eBooks · doi:10.1093/oso/9780197644461.003.0006
Graham, S. S. (2022) · Oxford University Press eBooks · doi:10.1093/oso/9780197644461.003.0004
Introduction: Promise and Peril in Health AI
Graham, S. S. (2022) · Oxford University Press eBooks · doi:10.1093/oso/9780197644461.003.0001
Ethics, Justice, and Health AI
Graham, S. S. (2022) · Oxford University Press eBooks · doi:10.1093/oso/9780197644461.003.0007
Graham, S. S. (2022) · Oxford University Press eBooks · doi:10.1093/oso/9780197644461.002.0003 · Cited by 1
Graham, S. S. (2022) · Oxford University Press eBooks · doi:10.1093/oso/9780197644461.005.0001
Conclusion: Just Futures for Deep Medicine
Graham, S. S. (2022) · Oxford University Press eBooks · doi:10.1093/oso/9780197644461.003.0009
Graham, S. S. (2022) · Oxford University Press eBooks · doi:10.1093/oso/9780197644461.003.0008
Graham, S. S. (2022) · Oxford University Press eBooks · doi:10.1093/oso/9780197644461.002.0007
Queere KI: Zum Coming-out smarter Maschinen
Klipphahn, M., Koster, A.-K., & Bruss, S. M. D. S. (2022) · AI critique · doi:10.1515/9783839461891 · Cited by 12
Ecosystemic Thinking: Beyond Human Narcissism in AI
Lois, C. &., Baio, C., & Solomon, L. H. (2022) · Springer series on cultural computing · doi:10.1007/978-3-031-10960-7_6 · Cited by 1
Duguet, A. (2022) · Presses de l'Université Toulouse Capitole eBooks · doi:10.4000/books.putc.15470 · Cited by 1
BIG DATA FROM SOCIAL MEDIA PERSPECTIVE: A CASE STUDY WITH FACEBOOK
DİNÇ, S. (2023) · Fenerbahçe Üniversitesi Sosyal Bilimler Dergisi · doi:10.58620/fbujoss.1310830 · Cited by 1
Introduction: Ethical Data Science
Washington, A. L. (2023) · Oxford University Press eBooks · doi:10.1093/oso/9780197693025.003.0001
Washington, A. L. (2023) · Oxford University Press eBooks · doi:10.1093/oso/9780197693025.002.0004
Washington, A. L. (2023) · Oxford University Press eBooks · doi:10.1093/oso/9780197693025.003.0003
Model: Dear Validity, Advice for Wayward Algorithms
Washington, A. L. (2023) · Oxford University Press eBooks · doi:10.1093/oso/9780197693025.003.0004
Washington, A. L. (2023) · Oxford University Press eBooks · doi:10.1093/oso/9780197693025.003.0007
Conclusion: Prediction in the Public Interest
Washington, A. L. (2023) · Oxford University Press eBooks · doi:10.1093/oso/9780197693025.003.0009
Predict: Show Us Your Work or Someone Gets Hurt
Washington, A. L. (2023) · Oxford University Press eBooks · doi:10.1093/oso/9780197693025.003.0008
Metadata
- Authors
- Benjamin, R.
- Affiliations
- Princeton University (US)
- Corresponding author
- Benjamin, Ruha
- ORCID
- Benjamin, Ruha
- Venue
- Science
- Published
- 2019-10-25
- Volume
- 366
- Issue
- 6464
- Pages
- 421-422
- ISSN
- 0036-8075 (ISSN-L)
- 1095-9203
- OpenAlex
- W2981451251
- Semantic Scholar
- 0108b58175e0511476964f59a36701e8ca3a070f
- Cited by
- 378
- References
- 19
- Citations by year
- 2026: 61 · 2025: 43 · 2024: 61 · 2023: 61 · 2022: 86 · 2021: 40 · 2020: 25 · 2019: 1
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Science (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Social Sciences › Anthropology › Race, Genetics, and Society
- Keywords
- algorithmic bias, racial bias, algorithmic risk assessment, automated decision-making, health disparities, algorithmic fairness
- MeSH terms
- Black or African American, Humans, Racism
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.