Cited by 32Artificial Intelligence in Healthcare and EducationMachine Learning in HealthcareForensic Anthropology and Bioarchaeology Studies

Predicting patient demographics from chest Radiographs with deep learning

Adleberg, Jason, Wardeh, Amr, Doo, Florence X., Marinelli, Brett, Cook, Tessa S., Mendelson, David S., Kagen, Alexander·2022·Journal of the American College of Radiology

Abstract

Background Deep learning models are increasingly informing medical decision making, for instance, in the detection of acute intracranial hemorrhage and pulmonary embolism. However, many models are trained on medical image databases that poorly represent the diversity of the patients they serve. In turn, many artificial intelligence models may not perform as well on assisting providers with important medical decisions for underrepresented populations.Purpose Assessment of the ability of deep learning models to classify the self-reported gender, age, self-reported ethnicity, and insurance status of an individual patient from a given chest radiograph.Methods Models were trained and tested with 55,174 radiographs in the MIMIC Chest X-ray (MIMIC-CXR) database. External validation data came from two separate databases, one from CheXpert and another from a multihospital urban health care system after institutional review board approval. Macro-averaged area under the curve (AUC) values were used to evaluate performance of models. Code used for this study is open-source and available at https://github.com/ai-bias/cxr-bias, and pixelstopatients.com/models/demographics.Results Accuracy of models to predict gender was nearly perfect, with 0.999 (95% confidence interval: 0.99-0.99) AUC on held-out test data and 0.994 (0.99-0.99) and 0.997 (0.99-0.99) on external validation data. There was high accuracy to predict age and ethnicity, ranging from 0.854 (0.80-0.91) to 0.911 (0.88-0.94) AUC, and moderate accuracy to predict insurance status, with AUC ranging from 0.705 (0.60-0.81) on held-out test data to 0.675 (0.54-0.79) on external validation data.Conclusions Deep learning models can predict the age, self-reported gender, self-reported ethnicity, and insurance status of a patient from a chest radiograph. Visualization techniques are useful to ensure deep learning models function as intended and to demonstrate anatomical regions of interest. These models can be used to ensure that training data are diverse, thereby ensuring artificial intelligence models that work on diverse populations.

Integrity signals

Registry

Crossref · 10.1016/j.jacr.2022.06.008

Cites

28 of 28 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Information on social determinants of health like area deprivation index are learned and encoded on chest X-rays.

    “More concerning about these models is that information on social determinants of health like area deprivation index are learned and encoded on the CXRs.”

    From AI pitfalls and what not to do: mitigating bias in AI (2023) · cites this paper as [29]

  • Chest X-rays can be used to predict demographic information including insurance, self-reported race, and age.

    “CXRs can also be used to predict demographic information—including insurance, self-reported race, and age. 28,29”

    From AI pitfalls and what not to do: mitigating bias in AI (2023) · cites this paper as [29]

Cites

Flagged first, then by citations

Cited by

Sorted by citations

Authors
Adleberg, J., Wardeh, A., Doo, F. X., Marinelli, B., Cook, T. S., Mendelson, D. S., & Kagen, A.
Affiliations
  • Mount Sinai Health System (US)
  • Upstate University Hospital (US)
  • University of Pennsylvania (US)
  • Icahn School of Medicine at Mount Sinai (US)
Corresponding author
Adleberg, Jason
Venue
Journal of the American College of Radiology
Publisher
Elsevier BV
Published
2022-10
Volume
19
Issue
10
Pages
1151-1161
ISSN
1546-1440 (ISSN-L)
OpenAlex
W4291002614
Cited by
32
References
28
Citations by year
2026: 3 · 2025: 9 · 2024: 7 · 2023: 12 · 2022: 1
FWCI
2.19
Type
journal article
Language
en
Open access
closed
Locations
  • Journal of the American College of Radiology (publishedVersion)
  • PubMed (publishedVersion)
Topics
  • Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
  • Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning in Healthcare
  • Social Sciences › Arts and Humanities › Archeology › Forensic Anthropology and Bioarchaeology Studies
Keywords
chest radiograph, gender classification, age estimation, ethnicity prediction, insurance status, algorithmic bias, underrepresented groups, MIMIC-CXR, CheXpert, external validation, model interpretability, training data diversity
MeSH terms
Deep Learning, Artificial Intelligence, Ethnicity, Humans, Radiography, Radiography, Thoracic

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review