Assessing risk, automating racism
The DOI matches its Crossref record; 18 of the 19 references it cites were found in a registry or an index.
Abstract
A health care algorithm reflects underlying racial bias in society
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Digital media, particularly with artificial intelligence (AI) and algorithmic decision-making, often rely on historical data that may contain biases, leading to the reinforcement of existing prejudices.172,173”
From Digital Ecosystems, Children, and Adolescents: Technical Report (2026) · cites this paper as [172]
In the citing paper
“Racism in particular has been a core focus of this literature, with multiple empirical examples of how structural racism becomes embedded in both the data used to create these tools and the output they produce.5–7”
From Equity and AI Governance at Academic Medical Centers (2024) · cites this paper as [5]
In the citing paper
“This literature includes analysis of how AI/ML and predictive models can reflect, entrench, or create existing inequities.”
From Equity and AI Governance at Academic Medical Centers (2024) · cites this paper as [5]
In the citing paper
“Algorithmic management might perpetuate societal biases and reproduce discriminatory practices at work, whether the discrimination is built into the algorithms, or management's use of the algorithm, or as a result of customer's rating of workers (Noble 2018;Benjamin 2019;Kellogg et al. 2020;Akter et al. 2021;Zajko 2021;Heinrichs 2022).”
From Artificial intelligence and work: a critical review of recent research from the social sciences (2024) · cites this paper as Benjamin 2019
Citations
Cites
Dissecting racial bias in an algorithm used to manage the health of populations
Obermeyer, Z., Powers, B., Vogeli, C., & Mullainathan, S. (2019) · Science · doi:10.1126/science.aax2342 · Cited by 7,137
Automating Inequality: How High-Tech Tools Profile, Police, and Punish the Poor
Lebovits, H. (2019) · Public Integrity · doi:10.1080/10999922.2018.1511671 · Cited by 3,279
Algorithms of Oppression: How Search Engines Reinforce Racism
Noble, S. U. (2020) · doi:10.2307/j.ctt1pwt9w5 · Cited by 2,709
Merz, S. (2020) · Ethnic and Racial Studies · doi:10.1080/01419870.2020.1715454 · Cited by 1,870
Review of “Race After Technology: Abolitionist Tools for the New Jim Code”
Jipguep-Akhtar, M. (2020) · Social Forces · doi:10.1093/sf/soz162 · Cited by 1,473
(2007) · Choice Reviews Online · doi:10.5860/choice.44-5683 · Cited by 1,296
(2018) · Cited by 1,167
Miller, J. (2007) · Psychiatric Services · doi:10.1176/appi.ps.58.10.1380 · Cited by 649
Body and Soul: The Black Panther Party and the Fight against Medical Discrimination
Nelson, A. (2011) · University of Minnesota Press eBooks · doi:10.5749/minnesota/9780816676484.001.0001 · Cited by 487
Reproducing Race: An Ethnography of Pregnancy as a Site of Racialization
Bridges, K. (2019) · University of California Press eBooks · doi:10.1525/9780520949447 · Cited by 289
Cited by
Ethical Machine Learning in Healthcare
Chen, I. Y., Pierson, E., Rose, S., Joshi, S., Ferryman, K., & Ghassemi, M. (2021) · Annual Review of Biomedical Data Science · doi:10.1146/annurev-biodatasci-092820-114757 · Cited by 645
“While there is scholarship addressing social implications and algorithmic fairness in general, there has been less work at the intersection of health, ML, and fairness (14, 15, 16), despite the potential life-or-death impacts of those models (8, 17).”
BackgroundOpening the black box: the promise and limitations of explainable machine learning in cardiology
Petch, J., Di, S., & Nelson, W. (2022) · Canadian Journal of Cardiology · doi:10.1016/j.cjca.2021.09.004 · Cited by 552
“10 Black boxes also limit the clinical actionability of model predictions, which further undermines their usefulness to clinicians.”
Algorithmic bias in data-driven innovation in the age of AI
Akter, S., McCarthy, G., Sajib, S., Michael, K., Dwivedi, Y. K., D’Ambra, J., & Shen, K. N. (2021) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2021.102387 · Cited by 440
Kickbusch, I., Piselli, D., Agrawal, A., Balicer, R., Banner, O., Adelhardt, M., Capobianco, E., Fabian, C., Singh Gill, A., Lupton, D., et al. (2021) · The Lancet · doi:10.1016/s0140-6736(21)01824-9 · Cited by 414
Power to the People? Opportunities and Challenges for Participatory AI
Birhane, A., Isaac, W., Prabhakaran, V., Diaz, M., Elish, M. C., Gabriel, I., & Mohamed, S. (2022) · Equity and Access in Algorithms Mechanisms and Optimization · doi:10.1145/3551624.3555290 · Cited by 330
“In parallel to the expansion of data enrichment and moderation, problematic applications of machine learning tools in high stakes domains such as criminal justice [10, 57, 73], healthcare [7, 9], and hiring [2, 71] have prompted both researchers, civil society, and regulators to increasingly urge greater use participa…”
Background
Metadata
- Authors
- Benjamin, R.
- Affiliations
- Princeton University (US)
- Corresponding author
- Benjamin, Ruha
- ORCID
- Benjamin, Ruha
- Venue
- Science
- Published
- 2019-10-25
- Volume
- 366
- Issue
- 6464
- Pages
- 421-422
- ISSN
- 0036-8075 (ISSN-L)
- 1095-9203
- OpenAlex
- W2981451251
- Semantic Scholar
- 0108b58175e0511476964f59a36701e8ca3a070f
- Cited by
- 378
- References
- 19
- Citations by year
- 2026: 61 · 2025: 43 · 2024: 61 · 2023: 61 · 2022: 86 · 2021: 40 · 2020: 25 · 2019: 1
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Science (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Social Sciences › Anthropology › Race, Genetics, and Society
- Keywords
- algorithmic bias, racial bias, algorithmic risk assessment, automated decision-making, health disparities, algorithmic fairness
- MeSH terms
- Black or African American, Humans, Racism
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Assessing risk, automating racism. https://app.cochat.ai/papers/10.1126/science.aaz3873
- The paper
- Benjamin, R. (2019). Assessing risk, automating racism. Science. https://doi.org/10.1126/science.aaz3873
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.