Classifying non-small cell lung cancer types and transcriptomic subtypes using convolutional neural networks
Open accessThe DOI matches its Crossref record; 22 of the 22 references it cites were found in a registry or an index.
Abstract
Objective: Non-small cell lung cancer is a leading cause of cancer death worldwide, and histopathological evaluation plays the primary role in its diagnosis. However, the morphological patterns associated with the molecular subtypes have not been systematically studied. To bridge this gap, we developed a quantitative histopathology analytic framework to identify the types and gene expression subtypes of non-small cell lung cancer objectively. Materials and Methods: We processed whole-slide histopathology images of lung adenocarcinoma (n = 427) and lung squamous cell carcinoma patients (n = 457) in the Cancer Genome Atlas. We built convolutional neural networks to classify histopathology images, evaluated their performance by the areas under the receiver-operating characteristic curves (AUCs), and validated the results in an independent cohort (n = 125). Results: To establish neural networks for quantitative image analyses, we first built convolutional neural network models to identify tumor regions from adjacent dense benign tissues (AUCs > 0.935) and recapitulated expert pathologists’ diagnosis (AUCs > 0.877), with the results validated in an independent cohort (AUCs = 0.726-0.864). We further demonstrated that quantitative histopathology morphology features identified the major transcriptomic subtypes of both adenocarcinoma and squamous cell carcinoma (P < .01). Discussion: Our study is the first to classify the transcriptomic subtypes of non-small cell lung cancer using fully automated machine learning methods. Our approach does not rely on prior pathology knowledge and can discover novel clinically relevant histopathology patterns objectively. The developed procedure is generalizable to other tumor types or diseases.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Generative adversarial networks
Goodfellow, I., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., Courville, A., & Bengio, Y. (2020) · Communications of the ACM · doi:10.1145/3422622 · Cited by 18,384
Siegel, R. L., Miller, K. D., & Jemal, A. (2016) · CA: A Cancer Journal for Clinicians · doi:10.3322/caac.21332 · Cited by 16,003
Gulshan, V., Peng, L., Coram, M., Stumpe, M. C., Wu, D., Narayanaswamy, A., Venugopalan, S., Widner, K., Madams, T., Cuadros, J., et al. (2016) · JAMA · doi:10.1001/jama.2016.17216 · Cited by 7,697 · cited 1×
“17 These algorithms have demonstrated expert-level performance in several clinical domains including screening for diabetic retinopathy, 18 identifying malignant dermatological lesions, 19 and detecting cancer cells in pathology images.”
BackgroundShin, H.-C., Roth, H. R., Gao, M., Lu, L., Xu, Z., Nogues, I., Yao, J., Mollura, D., & Summers, R. M. (2016) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2016.2528162 · Cited by 5,759
Comprehensive molecular profiling of lung adenocarcinoma
The Cancer Genome Atlas Research Network (2014) · Nature · doi:10.1038/nature13385 · Cited by 5,732
A New Initiative on Precision Medicine
Collins, F. S., & Varmus, H. (2015) · New England Journal of Medicine · doi:10.1056/nejmp1500523 · Cited by 5,202
Generative Adversarial Networks
Goodfellow, I. J., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., Courville, A., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1406.2661 · Cited by 4,477
Comprehensive genomic characterization of squamous cell lung cancers
The Cancer Genome Atlas Research Network (2012) · Nature · doi:10.1038/nature11404 · Cited by 3,994
Ehteshami Bejnordi, B., Veta, M., Johannes van Diest, P., van Ginneken, B., Karssemeijer, N., Litjens, G., van der Laak, J. A. W. M., and the CAMELYON16 Consortium, Hermsen, M., Manson, Q. F., et al. (2017) · JAMA · doi:10.1001/jama.2017.14585 · Cited by 3,293
Scagliotti, G. V., Parikh, P., von Pawel, J., Biesma, B., Vansteenkiste, J., Manegold, C., Serwatowski, P., Gatzemeier, U., Digumarti, R., Zukin, M., et al. (2008) · Journal of Clinical Oncology · doi:10.1200/jco.2007.15.0375 · Cited by 3,203
Coudray, N., Ocampo, P. S., Sakellaropoulos, T., Narula, N., Snuderl, M., Fenyö, D., Moreira, A. L., Razavian, N., & Tsirigos, A. (2018) · Nature Medicine · doi:10.1038/s41591-018-0177-5 · Cited by 2,930 · cited 2×
“We built upon previous studies that associated quantitative pathology features with diagnosis(21,47,48) and genetic mutations.(21) Our results demonstrated that the deep learning framework identified histopathology slides with tumor cells, captured the cell morphologies related to lung cancer diagnosis, and correlated…”
BackgroundMethodArtificial intelligence in healthcare
Yu, K.-H., Beam, A. L., & Kohane, I. S. (2018) · Nature Biomedical Engineering · doi:10.1038/s41551-018-0305-z · Cited by 2,817 · cited 2×
“Large-scale collection of rarer cancer types and prospective studies on the efficacy of the developed models are required to enable comprehensive cancer diagnostic systems.(51) In addition, all of the histopathology images in this study were gathered retrospectively, and the updated International Association for the S…”
BackgroundSelf-citationInternational network of cancer genome projects
The International Cancer Genome Consortium (2010) · Nature · doi:10.1038/nature08987 · Cited by 2,299 · cited 1×
“The ICGC follows a similar protocol for data collection and curation, and this dataset includes 57 slides of adjacent benign tissue from adenocarcinoma patients and 20 adjacent benign slides from squamous cell carcinoma patients.(35,36) All histopathology images were collected from primary, untreated tumors.”
MethodPotential Biases in Machine Learning Algorithms Using Electronic Health Record Data
Gianfrancesco, M. A., Tamang, S., Yazdany, J., & Schmajuk, G. (2018) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2018.3763 · Cited by 1,395 · cited 1×
“58,59 Large-scale collection of rarer cancer types and prospective studies on the efficacy of the developed models are required to enable comprehensive cancer diagnostic systems.”
BackgroundImage analysis and machine learning in digital pathology: challenges and opportunities
Madabhushi, A., & Lee, G. (2016) · Medical Image Analysis · doi:10.1016/j.media.2016.06.037 · Cited by 1,093
Yu, K.-H., Zhang, C., Berry, G. J., Altman, R. B., Ré, C., Rubin, D. L., & Snyder, M. (2016) · Nature Communications · doi:10.1038/ncomms12474 · Cited by 972 · cited 1×
“We built upon previous studies that associated quantitative pathology features with diagnosis 21,47,48 and genetic mutations.”
MethodSelf-citationAdapting to Artificial Intelligence: Radiologists and Pathologists as Information Specialists
Jha, S., & Topol, E. J. (2016) · JAMA · doi:10.1001/jama.2016.17438 · Cited by 622
OpenSlide: A vendor-neutral software foundation for digital pathology
Goode, A., Gilbert, B., Harkes, J., Jukic, D., & Satyanarayanan, M. (2013) · Journal of Pathology Informatics · doi:10.4103/2153-3539.119005 · Cited by 546
Quantitative Image Analysis of Cellular Heterogeneity in Breast Tumors Complements Genomic Profiling
Yuan, Y., Failmezger, H., Rueda, O. M., Ali, H. R., Gräf, S., Chin, S.-F., Schwarz, R. F., Curtis, C., Dunning, M. J., Bardwell, H., et al. (2012) · Science Translational Medicine · doi:10.1126/scitranslmed.3004330 · Cited by 426
Deep Convolutional Neural Networks Enable Discrimination of Heterogeneous Digital Pathology Images
Khosravi, P., Kazemi, E., Imielinski, M., Elemento, O., & Hajirasouliha, I. (2018) · EBioMedicine · doi:10.1016/j.ebiom.2017.12.026 · Cited by 334
Framing the challenges of artificial intelligence in medicine
Yu, K.-H., & Kohane, I. S. (2019) · BMJ Quality & Safety · doi:10.1136/bmjqs-2018-008551 · Cited by 233 · cited 1×
“Although these 2 subtypes comprise more than 80% of non-small cell lung cancer, the diagnostic performance of rarer types of tumors, such as giant cell carcinoma of the lung or small cell lung carcinoma, cannot be evaluated based on the available data.(58,59) Large-scale collection of rarer cancer types and prospectiv…”
BackgroundSelf-citation
Cited by
Deep learning in cancer diagnosis, prognosis and treatment selection
Tran, K. A., Kondrashova, O., Bradley, A., Williams, E. D., Pearson, J. V., & Waddell, N. (2021) · Genome Medicine · doi:10.1186/s13073-021-00968-x · Cited by 932
A pathology foundation model for cancer diagnosis and prognosis prediction
Wang, X., Zhao, J., Marostica, E., Yuan, W., Jin, J., Zhang, J., Li, R., Tang, H., Wang, K., Li, Y., et al. (2024) · Nature · doi:10.1038/s41586-024-07894-z · Cited by 580
Self-citationIntegrating spatial gene expression and breast tumour morphology via deep learning
He, B., Bergenstråhle, L., Stenbeck, L., Abid, A., Andersson, A., Borg, Å., Maaskola, J., Lundeberg, J., & Zou, J. (2020) · Nature Biomedical Engineering · doi:10.1038/s41551-020-0578-x · Cited by 507
Artificial intelligence in histopathology: enhancing cancer research and clinical oncology
Shmatko, A., Ghaffari Laleh, N., Gerstung, M., & Kather, J. N. (2022) · Nature Cancer · doi:10.1038/s43018-022-00436-4 · Cited by 446
“Other studies focused on established tumor subtypes defined by transcriptional signatures that could be recapitulated by AI from H&E slides alone, for instance, in lung cancer 82 and colorectal cancer 76 .”
BackgroundArtificial intelligence-based multi-omics analysis fuels cancer precision medicine
He, X., Liu, X., Zuo, F., Shi, H., & Jing, J. (2023) · Seminars in Cancer Biology · doi:10.1016/j.semcancer.2022.12.009 · Cited by 445
Metadata
- Authors
- Yu, K.-H., Wang, F., Berry, G. J., Ré, C., Altman, R. B., Snyder, M., & Kohane, I. S.
- Venue
- Journal of the American Medical Informatics Association
- Publisher
- Oxford University Press (OUP)
- Published
- 2020-05-01
- Volume
- 27
- Issue
- 5
- Pages
- 757-769
- ISSN
- 1067-5027 (ISSN-L)
- 1527-974X
- OpenAlex
- W3023087441
- Cited by
- 121
- References
- 22
- FWCI
- 7.96
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.