Predicting response to cancer immunotherapy using noninvasive radiomic biomarkers
Open accessThe DOI matches its Crossref record; 42 of the 42 references it cites were found in a registry or an index.
Abstract
INTRODUCTION: Immunotherapy is regarded as one of the major breakthroughs in cancer treatment. Despite its success, only a subset of patients responds-urging the quest for predictive biomarkers. We hypothesize that artificial intelligence (AI) algorithms can automatically quantify radiographic characteristics that are related to and may therefore act as noninvasive radiomic biomarkers for immunotherapy response. PATIENTS AND METHODS: In this study, we analyzed 1055 primary and metastatic lesions from 203 patients with advanced melanoma and non-small-cell lung cancer (NSCLC) undergoing anti-PD1 therapy. We carried out an AI-based characterization of each lesion on the pretreatment contrast-enhanced CT imaging data to develop and validate a noninvasive machine learning biomarker capable of distinguishing between immunotherapy responding and nonresponding. To define the biological basis of the radiographic biomarker, we carried out gene set enrichment analysis in an independent dataset of 262 NSCLC patients. RESULTS: The biomarker reached significant performance on NSCLC lesions (up to 0.83 AUC, P < 0.001) and borderline significant for melanoma lymph nodes (0.64 AUC, P = 0.05). Combining these lesion-wide predictions on a patient level, immunotherapy response could be predicted with an AUC of up to 0.76 for both cancer types (P < 0.001), resulting in a 1-year survival difference of 24% (P = 0.02). We found highly significant associations with pathways involved in mitosis, indicating a relationship between increased proliferative potential and preferential response to immunotherapy. CONCLUSIONS: These results indicate that radiographic characteristics of lesions on standard-of-care imaging may function as noninvasive biomarkers for response to immunotherapy, and may show utility for improved patient stratification in both neoadjuvant and palliative settings.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538
Subramanian, A., Tamayo, P., Mootha, V. K., Mukherjee, S., Ebert, B. L., Gillette, M. A., Paulovich, A., Pomeroy, S. L., Golub, T. R., Lander, E. S., et al. (2005) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0506580102 · Cited by 53,625
Improved Survival with Ipilimumab in Patients with Metastatic Melanoma
Hodi, F. S., O'Day, S. J., McDermott, D. F., Weber, R. W., Sosman, J. A., Haanen, J. B., Gonzalez, R., Robert, C., Schadendorf, D., Hassel, J. C., et al. (2010) · New England Journal of Medicine · doi:10.1056/nejmoa1003466 · Cited by 15,155
Self-citationNivolumab versus docetaxel in advanced nonsquamous non-small-cell lung cancer
Borghaei, H., Paz-Ares, L., Horn, L., Spigel, D. R., Steins, M., Ready, N. E., Chow, L. Q., Vokes, E. E., Felip, E., Holgado, E., et al. (2015) · New England Journal of Medicine · doi:10.1056/nejmoa1507643 · Cited by 9,335
Nivolumab versus Docetaxel in Advanced Squamous-Cell Non–Small-Cell Lung Cancer
Brahmer, J., Reckamp, K. L., Baas, P., Crinò, L., Eberhardt, W. E. E., Poddubskaya, E., Antonia, S., Pluzanski, A., Vokes, E. E., Holgado, E., et al. (2015) · New England Journal of Medicine · doi:10.1056/nejmoa1504627 · Cited by 8,447
Mutational landscape determines sensitivity to PD-1 blockade in non–small cell lung cancer
Rizvi, N. A., Hellmann, M. D., Snyder, A., Kvistborg, P., Makarov, V., Havel, J. J., Lee, W., Yuan, J., Wong, P., Ho, T. S., et al. (2015) · Science · doi:10.1126/science.aaa1348 · Cited by 7,802
Molecular signatures database (MSigDB) 3.0
Liberzon, A., Subramanian, A., Pinchback, R., Thorvaldsdóttir, H., Tamayo, P., & Mesirov, J. P. (2011) · Bioinformatics · doi:10.1093/bioinformatics/btr260 · Cited by 7,111 · cited 1×
“14 on the C2 collection version Molecular Signature Database (MSigDB) [39].”
BackgroundPembrolizumab plus chemotherapy in metastatic non–small-cell lung cancer
Gandhi, L., Rodríguez-Abreu, D., Gadgeel, S., Esteban, E., Felip, E., De Angelis, F., Domine, M., Clingan, P., Hochmair, M. J., Powell, S. F., et al. (2018) · New England Journal of Medicine · doi:10.1056/nejmoa1801005 · Cited by 6,607 · cited 1×
“While standard of care for patients with aggressive cancer showing rapid expansion is platinum-doublet chemotherapy, these results provides the biological rationale for previous work demonstrating why combination therapy is a viable option in first-line metastatic settings [43].”
ResultComputational Radiomics System to Decode the Radiographic Phenotype
(2017) · doi:10.1158/0008-5472.can-17-0339 · Cited by 6,593
Herbst, R. S., Baas, P., Kim, D.-W., Felip, E., Pérez-Gracia, J. L., Han, J.-Y., Molina, J., Kim, J.-H., Arvis, C. D., Ahn, M.-J., et al. (2016) · The Lancet · doi:10.1016/s0140-6736(15)01281-7 · Cited by 6,449
Decoding tumour phenotype by noninvasive imaging using a quantitative radiomics approach
Aerts, H. J. W. L., Velazquez, E. R., Leijenaar, R. T. H., Parmar, C., Grossmann, P., Carvalho, S., Bussink, J., Monshouwer, R., Haibe-Kains, B., Rietveld, D., et al. (2014) · Nature Communications · doi:10.1038/ncomms5006 · Cited by 5,132 · cited 1×
“profiles and tumor microenvironments in NSCLC [23, 32, 41, 42].”
Self-citationArtificial intelligence in radiology
Hosny, A., Parmar, C., Quackenbush, J., Schwartz, L. H., & Aerts, H. J. W. L. (2018) · Nature Reviews Cancer · doi:10.1038/s41568-018-0016-5 · Cited by 3,803
Self-citationIFN-γ–related mRNA profile predicts clinical response to PD-1 blockade
Ayers, M., Lunceford, J., Nebozhyn, M., Murphy, E., Loboda, A., Kaufman, D. R., Albright, A., Cheng, J. D., Kang, S. P., Shankaran, V., et al. (2017) · Journal of Clinical Investigation · doi:10.1172/jci91190 · Cited by 3,788
Greaves, M., & Maley, C. C. (2012) · Nature · doi:10.1038/nature10762 · Cited by 3,162
Clonal neoantigens elicit T cell immunoreactivity and sensitivity to immune checkpoint blockade
McGranahan, N., Furness, A. J. S., Rosenthal, R., Ramskov, S., Lyngaa, R., Saini, S. K., Jamal-Hanjani, M., Wilson, G. A., Birkbak, N. J., Hiley, C. T., et al. (2016) · Science · doi:10.1126/science.aaf1490 · Cited by 3,065
Self-citationNivolumab plus ipilimumab in lung cancer with a high tumor mutational burden
Hellmann, M. D., Ciuleanu, T.-E., Pluzanski, A., Lee, J. S., Otterson, G. A., Audigier-Valette, C., Minenza, E., Linardou, H., Burgers, S., Salman, P., et al. (2018) · New England Journal of Medicine · doi:10.1056/nejmoa1801946 · Cited by 3,063
The Regression Analysis of Binary Sequences
Cox, D. R. (1958) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1958.tb00292.x · Cited by 2,813
Weber, J. S., D'Angelo, S. P., Minor, D., Hodi, F. S., Gutzmer, R., Neyns, B., Hoeller, C., Khushalani, N. I., Miller, W. H., Lao, C. D., et al. (2015) · The Lancet Oncology · doi:10.1016/s1470-2045(15)70076-8 · Cited by 2,676
The tumor microenvironment and its role in promoting tumor growth
Whiteside, T. L. (2008) · Oncogene · doi:10.1038/onc.2008.271 · Cited by 2,376
Rough set methods in feature selection and recognition
Świniarski, R. W., & Skowron, A. (2002) · Pattern Recognition Letters · doi:10.1016/s0167-8655(02)00196-4 · Cited by 816
Vascular Normalization as an Emerging Strategy to Enhance Cancer Immunotherapy
Huang, Y., Goel, S., Duda, D. G., Fukumura, D., & Jain, R. K. (2013) · Cancer Research · doi:10.1158/0008-5472.can-12-4354 · Cited by 669
The Potential of Radiomic-Based Phenotyping in Precision Medicine: A Review
Aerts, H. J. W. L. (2016) · JAMA Oncology · doi:10.1001/jamaoncol.2016.2631 · Cited by 669
Self-citationEvaluation of a Tree-based Pipeline Optimization Tool for Automating Data Science
Olson, R. S., Bartley, N., Urbanowicz, R. J., & Moore, J. H. (2016) · Proceedings of the Genetic and Evolutionary Computation Conference 2016 · doi:10.1145/2908812.2908918 · Cited by 595
Li, H., Zhu, Y., Burnside, E. S., Drukker, K., Hoadley, K. A., Fan, C., Conzen, S. D., Whitman, G. J., Sutton, E. J., Net, J. M., et al. (2016) · Radiology · doi:10.1148/radiol.2016152110 · Cited by 461
Kickingereder, P., Burth, S., Wick, A., Götz, M., Eidel, O., Schlemmer, H.-P., Maier-Hein, K. H., Wick, W., Bendszus, M., Radbruch, A., et al. (2016) · Radiology · doi:10.1148/radiol.2016160845 · Cited by 446
Radiomic Machine-Learning Classifiers for Prognostic Biomarkers of Head and Neck Cancer
Parmar, C., Grossmann, P., Rietveld, D., Rietbergen, M. M., Lambin, P., & Aerts, H. J. W. L. (2015) · Frontiers in Oncology · doi:10.3389/fonc.2015.00272 · Cited by 407
Self-citationPredictive biomarkers in PD-1/PD-L1 checkpoint blockade immunotherapy
Meng, X., Huang, Z., Teng, F., Xing, L., & Yu, J. (2015) · Cancer Treatment Reviews · doi:10.1016/j.ctrv.2015.11.001 · Cited by 401
Somatic Mutations Drive Distinct Imaging Phenotypes in Lung Cancer
Rios Velazquez, E., Parmar, C., Liu, Y., Coroller, T. P., Cruz, G., Stringfield, O., Ye, Z., Makrigiorgos, M., Fennessy, F., Mak, R. H., et al. (2017) · Cancer Research · doi:10.1158/0008-5472.can-17-0122 · Cited by 391
Self-citationDefining the biological basis of radiomic phenotypes in lung cancer
Grossmann, P., Stringfield, O., El-Hachem, N., Bui, M. M., Rios Velazquez, E., Parmar, C., Leijenaar, R. T., Haibe-Kains, B., Lambin, P., Gillies, R. J., et al. (2017) · eLife · doi:10.7554/elife.23421 · Cited by 365
Self-citationRadiomic phenotype features predict pathological response in non-small cell lung cancer
Coroller, T. P., Agrawal, V., Narayan, V., Hou, Y., Grossmann, P., Lee, S. W., Mak, R. H., & Aerts, H. J. W. L. (2016) · Radiotherapy and Oncology · doi:10.1016/j.radonc.2016.04.004 · Cited by 327
Self-citationMa, W., Gilligan, B. M., Yuan, J., & Li, T. (2016) · Journal of Hematology & Oncology · doi:10.1186/s13045-016-0277-y · Cited by 327
The Regression Analysis of Binary Sequences
Cox, D. R. (1959) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1959.tb00334.x · Cited by 321
Proceedings of the Genetic and Evolutionary Computation Conference 2016
(2016) · doi:10.1145/2908812 · Cited by 293
Programmed Death-Ligand 1 Immunohistochemistry in Lung Cancer: In what state is this art?
Kerr, K. M., Tsao, M.-S., Nicholson, A. G., Yatabe, Y., Wistuba, I. I., & Hirsch, F. R. (2015) · Journal of Thoracic Oncology · doi:10.1097/jto.0000000000000526 · Cited by 269
Prasanna, P., Patel, J., Partovi, S., Madabhushi, A., & Tiwari, P. (2017) · European Radiology · doi:10.1007/s00330-016-4637-3 · Cited by 261
Prasanna, P., Patel, J., Partovi, S., Madabhushi, A., & Tiwari, P. (2017) · European Radiology · doi:10.1007/s00330-017-4815-y · Cited by 202
Antibodies and Antimatter: The Resurgence of Immuno-PET
Wu, A. M. (2009) · Journal of Nuclear Medicine · doi:10.2967/jnumed.108.056887 · Cited by 184
Kirienko, M., Cozzi, L., Antunovic, L., Lozza, L., Fogliata, A., Voulaz, E., Rossi, A., Chiti, A., & Sollini, M. (2018) · European Journal of Nuclear Medicine and Molecular Imaging · doi:10.1007/s00259-017-3837-7 · Cited by 179
Marino, F. Z., Ascierto, P. A., Rossi, G., Staibano, S., Montella, M., Russo, D., Alfano, R., Morabito, A., Botti, G., & Franco, R. (2017) · Expert Opinion on Biological Therapy · doi:10.1080/14712598.2017.1309387 · Cited by 77
He, Y., Rozeboom, L. M., Rivard, C. J., Ellison, K. E., Dziadziuszko, R., Yu, H., Zhou, C., & Hirsch, F. R. (2017) · Medical Science Monitor · doi:10.12659/msm.899909 · Cited by 61
Wolchok, J. D., Chiarion‐Sileni, V., Gonzalez, R. C., Rutkowski, P. L., Grob, J., Cowey, C. L., Lao, C. D., Schadendorf, D., Ferrucci, P. F., Smylie, M., et al. (2015) · Journal of Clinical Oncology · doi:10.1200/jco.2015.33.18_suppl.lba1 · Cited by 45
Self-citationFave, X. J., Zhang, L., Yang, J., Mackin, D., Balter, P. A., Gomez, D. R., Followill, D. S., Jones, A. K., Stingo, F. C., Mohan, R., et al. (2017) · International Journal of Radiation Oncology*Biology*Physics · doi:10.1016/j.ijrobp.2017.01.195 · Cited by 16
Cited by
Neoadjuvant checkpoint blockade for cancer immunotherapy
Topalian, S. L., Taube, J. M., & Pardoll, D. M. (2020) · Science · doi:10.1126/science.aax0182 · Cited by 1,001
Predicting cancer outcomes with radiomics and artificial intelligence in radiology
Bera, K., Braman, N., Gupta, A., Velcheti, V., & Madabhushi, A. (2022) · Nature Reviews Clinical Oncology · doi:10.1038/s41571-021-00560-7 · Cited by 819
Vanguri, R. S., Luo, J., Aukerman, A. T., Egger, J. V., Fong, C. J., Horvat, N., Pagano, A., Araujo-Filho, J. D. A. B., Geneslaw, L., Rizvi, H., et al. (2022) · Nature Cancer · doi:10.1038/s43018-022-00416-8 · Cited by 395
Artificial Intelligence for Predictive Biomarker Discovery in Immuno-Oncology: A Systematic Review
Prelaj, A., Miskovic, V., Zanitti, M., Trovo, F., Genova, C., Viscardi, G., Rebuzzi, S. E., Mazzeo, L., Provenzano, L., Kosta, S., et al. (2024) · Annals of Oncology · doi:10.1016/j.annonc.2023.10.125 · Cited by 340
Defining clinically useful biomarkers of immune checkpoint inhibitors in solid tumours
Holder, A. M., Dedeilia, A., Sierra-Davidson, K., Cohen, S., Liu, D., Parikh, A., & Boland, G. M. (2024) · Nature Reviews Cancer · doi:10.1038/s41568-024-00705-7 · Cited by 298
Metadata
- Authors
- Trebeschi, S., Drago, S. G., Birkbak, N. J., Kurilova, I., Cǎlin, A. M., Delli Pizzi, A., Lalezari, F., Lambregts, D. M. J., Rohaan, M. W., Parmar, C., Rozeman, E. A., Hartemink, K. J., Swanton, C., Haanen, J. B. A. G., Blank, C. U., Smit, E. F., Beets-Tan, R. G. H., & Aerts, H. J. W. L.
- Venue
- Annals of Oncology
- Publisher
- Elsevier BV
- Published
- 2019-06
- Volume
- 30
- Issue
- 6
- Pages
- 998-1004
- ISSN
- 0923-7534 (ISSN-L)
- OpenAlex
- W2923501617
- Cited by
- 566
- References
- 42
- FWCI
- 40.05
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.