Cited by 121Radiomics and Machine Learning in Medical ImagingCancer Immunotherapy and BiomarkersAI in cancer detection

Predicting benefit from immune checkpoint inhibitors in patients with non-small-cell lung cancer by CT-based ensemble deep learning: a retrospective study

Open access
Saad, Maliazurina B, Hong, Lingzhi, Aminu, Muhammad, Vokes, Natalie I, Chen, Pingjun, Salehjahromi, Morteza, Qin, Kang, Sujit, Sheeba J +41 more·2023·The Lancet Digital Health

Abstract

BACKGROUND: Only around 20-30% of patients with non-small-cell lung cancer (NCSLC) have durable benefit from immune-checkpoint inhibitors. Although tissue-based biomarkers (eg, PD-L1) are limited by suboptimal performance, tissue availability, and tumour heterogeneity, radiographic images might holistically capture the underlying cancer biology. We aimed to investigate the application of deep learning on chest CT scans to derive an imaging signature of response to immune checkpoint inhibitors and evaluate its added value in the clinical context. METHODS: In this retrospective modelling study, 976 patients with metastatic, EGFR/ALK negative NSCLC treated with immune checkpoint inhibitors at MD Anderson and Stanford were enrolled from Jan 1, 2014, to Feb 29, 2020. We built and tested an ensemble deep learning model on pretreatment CTs (Deep-CT) to predict overall survival and progression-free survival after treatment with immune checkpoint inhibitors. We also evaluated the added predictive value of the Deep-CT model in the context of existing clinicopathological and radiological metrics. FINDINGS: Our Deep-CT model demonstrated robust stratification of patient survival of the MD Anderson testing set, which was validated in the external Stanford set. The performance of the Deep-CT model remained significant on subgroup analyses stratified by PD-L1, histology, age, sex, and race. In univariate analysis, Deep-CT outperformed the conventional risk factors, including histology, smoking status, and PD-L1 expression, and remained an independent predictor after multivariate adjustment. Integrating the Deep-CT model with conventional risk factors demonstrated significantly improved prediction performance, with overall survival C-index increases from 0·70 (clinical model) to 0·75 (composite model) during testing. On the other hand, the deep learning risk scores correlated with some radiomics features, but radiomics alone could not reach the performance level of deep learning, indicating that the deep learning model effectively captured additional imaging patterns beyond known radiomics features. INTERPRETATION: This proof-of-concept study shows that automated profiling of radiographic scans through deep learning can provide orthogonal information independent of existing clinicopathological biomarkers, bringing the goal of precision immunotherapy for patients with NSCLC closer. FUNDING: National Institutes of Health, Mark Foundation Damon Runyon Foundation Physician Scientist Award, MD Anderson Strategic Initiative Development Program, MD Anderson Lung Moon Shot Program, Andrea Mugnaini, and Edward L C Smith.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1016/s2589-7500(23)00082-1

Cites

30 of 30 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • These efforts include histology and CT-based models for survival prediction and correlation of CT imaging features with histology risk factors.

    “These efforts include histology (102) and CT-based (103) models for survival prediction, and the correlation of CT imaging features with histology risk factors (104).”

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Cited by

Sorted by citations

Authors
Saad, M. B., Hong, L., Aminu, M., Vokes, N. I., Chen, P., Salehjahromi, M., Qin, K., Sujit, S. J., Lu, X., Young, E., Al-Tashi, Q., Qureshi, R., Wu, C. C., Carter, B. W., Lin, S. H., Lee, P. P., Gandhi, S., Chang, J. Y., Li, R., Gensheimer, M. F., Wakelee, H. A., Neal, J. W., Lee, H.-S., Cheng, C., Velcheti, V., Lou, Y., Petranovic, M., Rinsurongkawong, W., Le, X., Rinsurongkawong, V., Spelman, A., Elamin, Y. Y., Negrao, M. V., Skoulidis, F., Gay, C. M., Cascone, T., Antonoff, M. B., Sepesi, B., Lewis, J., Wistuba, I. I., Hazle, J. D., Chung, C., Jaffray, D., Gibbons, D. L., Vaporciyan, A., Lee, J. J., Heymach, J. V., Zhang, J., & Wu, J.
Affiliations
  • The University of Texas MD Anderson Cancer Center (US)
  • City Of Hope National Medical Center (US)
  • Stanford Medicine (US)
  • Baylor College of Medicine (US)
  • NYU Langone Health (US)
  • Mayo Clinic (US)
Corresponding author
  • Heymach, John V
  • Zhang, Jianjun
  • Wu, Jia
Venue
The Lancet Digital Health
Publisher
Elsevier BV
Published
2023-07
Volume
5
Issue
7
Pages
e404-e420
ISSN
2589-7500 (ISSN-L)
OpenAlex
W4378801059
Cited by
121
References
30
Citations by year
2026: 31 · 2025: 53 · 2024: 34 · 2023: 3
FWCI
20.04
Type
journal article
Language
en
Update notices
erratum (2023-07-01)
Open access
Locations
  • The Lancet Digital Health (publishedVersion, cc-by-nc-nd)
  • PubMed (publishedVersion)
  • PubMed Central (acceptedVersion, cc-by-nc-nd)
  • Digital Commons-TMC (Texas Medical Center) (submittedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
Funders
  • National Institutes of Health
  • National Institutes of Health Clinical Center (R00 CA218667, R01 CA262425)
  • Conquer Cancer Foundation
  • University of Texas MD Anderson Cancer Center (P30 CA016672)
  • Rexanna's Foundation
Topics
  • Health Sciences › Medicine › Radiology, Nuclear Medicine and Imaging › Radiomics and Machine Learning in Medical Imaging
  • Health Sciences › Medicine › Oncology › Cancer Immunotherapy and Biomarkers
  • Physical Sciences › Computer Science › Artificial Intelligence › AI in cancer detection
Keywords
non-small cell lung cancer, immune checkpoint inhibitors, predictive biomarkers, chest CT, ensemble deep learning, radiomics, overall survival prediction, progression-free survival, PD-L1, precision immunotherapy, metastatic lung cancer
MeSH terms
Deep Learning, Immune Checkpoint Inhibitors, Carcinoma, Non-Small-Cell Lung, Humans, Lung Neoplasms, Retrospective Studies, United States, B7-H1 Antigen

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review