Cited by 15COVID-19 diagnosis using AIArtificial Intelligence in Healthcare and EducationMachine Learning in Healthcare

Detecting racial/ethnic health disparities using deep learning from frontal chest radiography

Open access
Pyrros, Ayis, Rodríguez-Fernández, Jorge Mario, Borstelmann, Stephen M., Gichoya, Judy Wawira, Horowitz, Jeanne M., Fornelli, Brian, Siddiqui, Nasir, Velichko, Yury +2 more·2022·Journal of the American College of Radiology

Abstract

Purpose The aim of this study was to assess racial/ethnic and socioeconomic disparities in the difference between atherosclerotic vascular disease prevalence measured by a multitask convolutional neural network (CNN) deep learning model using frontal chest radiographs (CXRs) and the prevalence reflected by administrative hierarchical condition category codes in two cohorts of patients with coronavirus disease 2019 (COVID-19).Methods A CNN model, previously published, was trained to predict atherosclerotic disease from ambulatory frontal CXRs. The model was then validated on two cohorts of patients with COVID-19: 814 ambulatory patients from a suburban location (presenting from March 14, 2020, to October 24, 2020, the internal ambulatory cohort) and 485 hospitalized patients from an inner-city location (hospitalized from March 14, 2020, to August 12, 2020, the external hospitalized cohort). The CNN model predictions were validated against electronic health record administrative codes in both cohorts and assessed using the area under the receiver operating characteristic curve (AUC). The CXRs from the ambulatory cohort were also reviewed by two board-certified radiologists and compared with the CNN-predicted values for the same cohort to produce a receiver operating characteristic curve and the AUC. The atherosclerosis diagnosis discrepancy, Δ vasc, referring to the difference between the predicted value and presence or absence of the vascular disease HCC categorical code, was calculated. Linear regression was performed to determine the association of Δ vasc with the covariates of age, sex, race/ethnicity, language preference, and social deprivation index. Logistic regression was used to look for an association between the presence of any hierarchical condition category codes with Δ vasc and other covariates.Results The CNN prediction for vascular disease from frontal CXRs in the ambulatory cohort had an AUC of 0.85 (95% confidence interval, 0.82-0.89) and in the hospitalized cohort had an AUC of 0.69 (95% confidence interval, 0.64-0.75) against the electronic health record data. In the ambulatory cohort, the consensus radiologists' reading had an AUC of 0.89 (95% confidence interval, 0.86-0.92) relative to the CNN. Multivariate linear regression of Δ vasc in the ambulatory cohort demonstrated significant negative associations with non-English-language preference (β = -0.083, P < .05) and Black or Hispanic race/ethnicity (β = -0.048, P < .05) and positive associations with age (β = 0.005, P < .001) and sex (β = 0.044, P < .05). For the hospitalized cohort, age was also significant (β = 0.003, P < .01), as was social deprivation index (β = 0.002, P < .05). The Δ vasc variable (odds ratio [OR], 0.34), Black or Hispanic race/ethnicity (OR, 1.58), non-English-language preference (OR, 1.74), and site (OR, 0.22) were independent predictors of having one or more hierarchical condition category codes (P < .01 for all) in the combined patient cohort.Conclusions A CNN model was predictive of aortic atherosclerosis in two cohorts (one ambulatory and one hospitalized) with COVID-19. The discrepancy between the CNN model and the administrative code, Δ vasc, was associated with language preference in the ambulatory cohort; in the hospitalized cohort, this discrepancy was associated with social deprivation index. The absence of administrative code(s) was associated with Δ vasc in the combined cohorts, suggesting that Δ vasc is an independent predictor of health disparities. This may suggest that biomarkers extracted from routine imaging studies and compared with electronic health record data could play a role in enhancing value-based health care for traditionally underserved or disadvantaged patients for whom barriers to care exist.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1016/j.jacr.2021.09.010

Cites

19 of 19 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • AI may exacerbate societal healthcare disparities.

    “There is a significant concern that AI may exacerbate societal healthcare disparities [24].”
  • Recent studies have shown that AI models can learn features that are 'invisible' to a human expert.

    “Recent studies have shown that AI models can learn features that are “invisible” to a human expert.”

    From AI pitfalls and what not to do: mitigating bias in AI (2023) · cites this paper as [27]

  • Chest X-rays can be used to predict ICD-10 codes related to cardiac disease, including conduction abnormalities, with accuracies above 0.76.

    “For example, CXRs can be used to predict ICD-10 codes related to cardiac disease (including conduction abnormalities) with accuracies of above 0.76. 27”

    From AI pitfalls and what not to do: mitigating bias in AI (2023) · cites this paper as [27]

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Cited by

Sorted by citations

Authors
Pyrros, A., Rodríguez-Fernández, J. M., Borstelmann, S. M., Gichoya, J. W., Horowitz, J. M., Fornelli, B., Siddiqui, N., Velichko, Y., Koyejo, O., & Galanter, W.
Affiliations
  • Adventist Hinsdale Hospital (US)
  • University of Illinois Chicago (US)
  • University of Central Florida (US)
  • Emory University (US)
  • Northwestern University (US)
Corresponding author
Pyrros, Ayis
Venue
Journal of the American College of Radiology
Publisher
Elsevier BV
Published
2022-01
Volume
19
Issue
1
Pages
184-191
ISSN
1546-1440 (ISSN-L)
OpenAlex
W4205855895
Cited by
15
References
19
Citations by year
2026: 2 · 2025: 4 · 2024: 3 · 2023: 3 · 2022: 3
FWCI
1.85
Type
journal article
Language
en
Update notices
erratum (2022-03-01)
Open access
Locations
  • Journal of the American College of Radiology (publishedVersion)
  • PubMed (publishedVersion)
  • PubMed Central (acceptedVersion)
Funders
  • University of Illinois at Chicago Center for Clinical and Translational Science
  • National Institutes of Health
  • National Institute of Biomedical Imaging and Bioengineering (75N92020C00008, 75N92020C00021)
Topics
  • Health Sciences › Medicine › Radiology, Nuclear Medicine and Imaging › COVID-19 diagnosis using AI
  • Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
  • Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning in Healthcare
Keywords
racial and ethnic health disparities, socioeconomic disparities, atherosclerosis, convolutional neural networks, COVID-19 pandemic, language preference, social deprivation index, radiologist consensus, hospitalized patients, outpatients, cardiovascular risk stratification
MeSH terms
Deep Learning, COVID-19, SARS-CoV-2, Social Deprivation, Ethnicity, Carcinoma, Hepatocellular, Humans, Liver Neoplasms, Radiography, Retrospective Studies

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review