Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 38 of the 39 references it cites were found in a registry or an index, and 1 are not checked yet.

AI recognition of patient race in medical imaging: a modelling study

Open access

Abstract

BACKGROUND: Previous studies in medical imaging have shown disparate abilities of artificial intelligence (AI) to detect a person's race, yet there is no known correlation for race on medical imaging that would be obvious to human experts when interpreting the images. We aimed to conduct a comprehensive evaluation of the ability of AI to recognise a patient's racial identity from medical images. METHODS: Using private (Emory CXR, Emory Chest CT, Emory Cervical Spine, and Emory Mammogram) and public (MIMIC-CXR, CheXpert, National Lung Cancer Screening Trial, RSNA Pulmonary Embolism CT, and Digital Hand Atlas) datasets, we evaluated, first, performance quantification of deep learning models in detecting race from medical images, including the ability of these models to generalise to external environments and across multiple imaging modalities. Second, we assessed possible confounding of anatomic and phenotypic population features by assessing the ability of these hypothesised confounders to detect race in isolation using regression models, and by re-evaluating the deep learning models by testing them on datasets stratified by these hypothesised confounding variables. Last, by exploring the effect of image corruptions on model performance, we investigated the underlying mechanism by which AI models can recognise race. FINDINGS: In our study, we show that standard AI deep learning models can be trained to predict race from medical images with high performance across multiple imaging modalities, which was sustained under external validation conditions (x-ray imaging [area under the receiver operating characteristics curve (AUC) range 0·91-0·99], CT chest imaging [0·87-0·96], and mammography [0·81]). We also showed that this detection is not due to proxies or imaging-related surrogate covariates for race (eg, performance of possible confounders: body-mass index [AUC 0·55], disease distribution [0·61], and breast density [0·61]). Finally, we provide evidence to show that the ability of AI deep learning models persisted over all anatomical regions and frequency spectrums of the images, suggesting the efforts to control this behaviour when it is undesirable will be challenging and demand further study. INTERPRETATION: The results from our study emphasise that the ability of AI deep learning models to predict self-reported race is itself not the issue of importance. However, our finding that AI can accurately predict self-reported race, even from corrupted, cropped, and noised medical images, often when clinical experts cannot, creates an enormous risk for all model deployments in medical imaging. FUNDING: National Institute of Biomedical Imaging and Bioengineering, MIDRC grant of National Institutes of Health, US National Science Foundation, National Library of Medicine of the National Institutes of Health, and Taiwan Ministry of Science and Technology.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1016/s2589-7500(22)00063-2

Cites

38 of 39 references verified0 citation errors · 0 not checkable

Statistics

Figures

Figure 1: The effect on model performance of adding a low-pass filter and a high-pass filter for various diameters in the MXR dataset MXR=MIMIC-CXR dataset.
Figure 1: The effect on model performance of adding a low-pass filter and a high-pass filter for various diameters in the MXR dataset MXR=MIMIC-CXR dataset.CC BY · PubMed Central
Figure 2: Samples of the images after low-pass filters and high-pass filters in MXR dataset HPF=high-pass filtering. LPF=low-pass filtering. MXR=MIMIC-CXR dataset.
Figure 2: Samples of the images after low-pass filters and high-pass filters in MXR dataset HPF=high-pass filtering. LPF=low-pass filtering. MXR=MIMIC-CXR dataset.CC BY · PubMed Central

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

5 more claims about this paper

Create a free account to see every claim other papers make about this one.

See all claims — free account

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 35 references

Cited by

See all 611

Metadata

Authors
Gichoya, J. W., Banerjee, I., Bhimireddy, A. R., Burns, J. L., Celi, L. A., Chen, L.-C., Correa, R., Dullerud, N., Ghassemi, M., Huang, S.-C., Kuo, P.-C., Lungren, M. P., Palmer, L. J., Price, B. J., Purkayastha, S., Pyrros, A. T., Oakden-Rayner, L., Okechukwu, C., Seyyed-Kalantari, L., Trivedi, H., Wang, R., Zaiman, Z., & Zhang, H.
Affiliations
  • Emory University (US)
  • Arizona State University (US)
  • Indiana University – Purdue University Indianapolis (US)
  • Beth Israel Deaconess Medical Center (US)
  • National Tsing Hua University (TW)
  • University of Toronto (CA)
  • Massachusetts Institute of Technology (US)
  • Stanford Medicine (US)
  • The University of Adelaide (AU)
  • Florida State University (US)
  • DuPage Medical Group (US)
  • Georgia Institute of Technology (US)
Corresponding author
Gichoya, Judy Wawira
Venue
The Lancet Digital Health
Publisher
Elsevier BV
Published
2022-06
Volume
4
Issue
6
Pages
e406-e414
ISSN
2589-7500 (ISSN-L)
OpenAlex
W4280519765
Cited by
611
References
35
Citations by year
2026: 151 · 2025: 152 · 2024: 150 · 2023: 109 · 2022: 40
FWCI
33.96
Type
journal article
Language
en
Open access
Licence
Locations
  • The Lancet Digital Health (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • PubMed Central (acceptedVersion, cc-by)
  • arXiv (Cornell University) (submittedVersion)
  • IUScholarWorks (Indiana University) (submittedVersion, cc-by)
  • Purdue University Indianapolis (Indiana University) (submittedVersion, cc-by)
  • arXiv (Cornell University) (cc-by)
Funders
  • NSF
  • Ministry of Science and Technology, Taiwan (MOST109-2222-E-007-004-MY3)
  • National Science Foundation (1928481)
  • National Institutes of Health
  • NLM (R01LM012966)
  • National Institute of Biomedical Imaging and Bioengineering (75N92020C00008, 75N92020C00021, R01 EB017205)
Topics
  • Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
  • Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
  • Social Sciences › Anthropology › Race, Genetics, and Society
Keywords
race prediction, artificial intelligence, diagnostic imaging, deep learning, chest radiography, chest CT, mammography, cervical spine imaging, external validation, image corruption robustness, algorithmic bias, racial disparities in health care, algorithmic fairness, model interpretability
MeSH terms
Deep Learning, Artificial Intelligence, Humans, Lung Neoplasms, Retrospective Studies, Early Detection of Cancer

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: AI recognition of patient race in medical imaging: a modelling study. https://app.cochat.ai/papers/10.1016/s2589-7500(22)00063-2
The paper
Gichoya, J. W., Banerjee, I., Bhimireddy, A. R., Burns, J. L., Celi, L. A., Chen, L.-C., Correa, R., Dullerud, N., Ghassemi, M., Huang, S.-C., Kuo, P.-C., Lungren, M. P., Palmer, L. J., Price, B. J., Purkayastha, S., Pyrros, A. T., Oakden-Rayner, L., Okechukwu, C., Seyyed-Kalantari, L., . . . Zhang, H. (2022). AI recognition of patient race in medical imaging: a modelling study. The Lancet Digital Health. https://doi.org/10.1016/s2589-7500(22)00063-2

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.