Dissecting Racial Bias in an Algorithm that Guides Health Decisions for 70 Million People
The DOI matches its Crossref record.
Abstract
A single algorithm drives an important health care decision for over 70 million people in the US. When health systems anticipate that a patient will have especially complex and intensive future health care needs, she is enrolled in a 'care management' program, which provides considerable additional resources: greater attention from trained providers and help with coordination of her care.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Furthermore, such datasets often stem from relatively few institutions, geographic regions or patient demographics, and might therefore contain unquantifiable bias due to their incompleteness with respect to co-variables such as comorbidities, ethnicity, gender and so on 19 .”
From Secure, privacy-preserving and federated machine learning in medical imaging (2020) · cites this paper as [19]
In the citing paper
“Also, non-availability of the sociodemographic information in the algorithmic design will generate biased predictions [101].”
From Artificial intelligence bias in medical system designs: a systematic review (2023) · cites this paper as [101]
In the citing paper
“The questionnaire-based healthcare app suffered from racial inequalities as it suggested different diagnoses for different race of people keeping all other parameters identical [101,108].”
From Artificial intelligence bias in medical system designs: a systematic review (2023) · cites this paper as [101]
Citations
Cited by
Secure, privacy-preserving and federated machine learning in medical imaging
Kaissis, G. A., Makowski, M. R., Rückert, D., & Braren, R. F. (2020) · Nature Machine Intelligence · doi:10.1038/s42256-020-0186-1 · Cited by 1,676
Inherent Tradeoffs in the Fair Determination of Risk Scores
(2023) · The Societal Impacts of Algorithmic Decision-Making · doi:10.1145/3603195.3603197 · Cited by 310
Ahmad, K., Maabreh, M., Ghaly, M., Khan, K., Qadir, J., & Al-Fuqaha, A. (2022) · Computer Science Review · doi:10.1016/j.cosrev.2021.100452 · Cited by 291
“Similarly, the smart system used to predict the health care needs of about 70 million patients in the US was assigning higher risks (scores) to black patient compared to white patients with the same medical conditions [47].”
MethodCheXclusion: Fairness gaps in deep chest X-ray classifiers
Seyyed-Kalantari, L., Liu, G., McDermott, M., Chen, I. Y., & Ghassemi, M. (2020) · Biocomputing 2021 · doi:10.1142/9789811232701_0022 · Cited by 275
Scheuerman, M. K., Paul, J. M., & Brubaker, J. R. (2019) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3359246 · Cited by 252
“In the realm of algorithmic fairness, Obermeyer and Mullainathan uncovered significant racial bias against black patients in algorithmic auto-enrollment for care programs [82].”
Background
Metadata
- Authors
- Obermeyer, Z., & Mullainathan, S.
- Affiliations
- University of California, Berkeley (US)
- University of Chicago (US)
- Venue
- Proceedings of the Conference on Fairness, Accountability, and Transparency
- Publisher
- ACM
- Published
- 2019-01-29
- Pages
- 89-89
- OpenAlex
- W2911122801
- Semantic Scholar
- 5bd4d39f985259b1d1748fe008acb582ecafc526
- Cited by
- 124
- References
- 0
- Citations by year
- 2026: 9 · 2025: 12 · 2024: 13 · 2023: 36 · 2022: 13 · 2021: 18 · 2020: 16 · 2019: 7
- Type
- conference abstract
- Language
- en
- Open access
- closed
- Locations
- ACM Conference on Fairness, Accountability, and Transparency (FAccT) (publishedVersion)
- Funders
- National Institute for Health Care Management
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Health Sciences › Health Professions › Health Information Management › Artificial Intelligence in Healthcare
- Keywords
- racial bias, algorithmic decision-making, prediction model, healthcare resource allocation, health disparities, algorithmic fairness
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Dissecting Racial Bias in an Algorithm that Guides Health Decisions for 70 Million People. https://app.cochat.ai/papers/10.1145/3287560.3287593
- The paper
- Obermeyer, Z., & Mullainathan, S. (2019). Dissecting Racial Bias in an Algorithm that Guides Health Decisions for 70 Million People. Proceedings of the Conference on Fairness, Accountability, and Transparency. https://doi.org/10.1145/3287560.3287593
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.