The DOI matches its Crossref record; 52 of the 52 references it cites were found in a registry or an index.
Weakly Supervised Deep Learning for Whole Slide Lung Cancer Image Analysis
Abstract
Histopathology image analysis serves as the gold standard for cancer diagnosis. Efficient and precise diagnosis is quite critical for the subsequent therapeutic treatment of patients. So far, computer-aided diagnosis has not been widely applied in pathological field yet as currently well-addressed tasks are only the tip of the iceberg. Whole slide image (WSI) classification is a quite challenging problem. First, the scarcity of annotations heavily impedes the pace of developing effective approaches. Pixelwise delineated annotations on WSIs are time consuming and tedious, which poses difficulties in building a large-scale training dataset. In addition, a variety of heterogeneous patterns of tumor existing in high magnification field are actually the major obstacle. Furthermore, a gigapixel scale WSI cannot be directly analyzed due to the immeasurable computational cost. How to design the weakly supervised learning methods to maximize the use of available WSI-level labels that can be readily obtained in clinical practice is quite appealing. To overcome these challenges, we present a weakly supervised approach in this article for fast and effective classification on the whole slide lung cancer images. Our method first takes advantage of a patch-based fully convolutional network (FCN) to retrieve discriminative blocks and provides representative deep features with high efficiency. Then, different context-aware block selection and feature aggregation strategies are explored to generate globally holistic WSI descriptor which is ultimately fed into a random forest (RF) classifier for the image-level prediction. To the best of our knowledge, this is the first study to exploit the potential of image-level labels along with some coarse annotations for weakly supervised learning. A large-scale lung cancer WSI dataset is constructed in this article for evaluation, which validates the effectiveness and feasibility of the proposed method. Extensive experiments demonstrate the superior performance of our method that surpasses the state-of-the-art approaches by a significant margin with an accuracy of 97.3%. In addition, our method also achieves the best performance on the public lung cancer WSIs dataset from The Cancer Genome Atlas (TCGA). We highlight that a small number of coarse annotations can contribute to further accuracy improvement. We believe that weakly supervised learning methods have great potential to assist pathologists in histology image diagnosis in the near future.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
A Threshold Selection Method from Gray-Level Histograms
Otsu, N. (1979) · IEEE Transactions on Systems, Man, and Cybernetics · doi:10.1109/tsmc.1979.4310076 · Cited by 43,398
Rethinking the Inception Architecture for Computer Vision
Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., & Wojna, Z. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.308 · Cited by 32,138
Large-Scale Machine Learning with Stochastic Gradient Descent
Bottou, L. (2010) · Proceedings of COMPSTAT'2010 · doi:10.1007/978-3-7908-2604-3_16 · Cited by 5,795
Coudray, N., Ocampo, P. S., Sakellaropoulos, T., Narula, N., Snuderl, M., Fenyö, D., Moreira, A. L., Razavian, N., & Tsirigos, A. (2018) · Nature Medicine · doi:10.1038/s41591-018-0177-5 · Cited by 2,930 · cited 2×
“Regarding the high-level WSI classification task [33]–[39], due to the lack of detailed annotations of cancer regions, previous studies applied domain-specific handcrafted features to depict morphological character, texture, and statistic property of malignant tumor [33], [34], [40] along with the”
BackgroundH-DenseUNet: Hybrid Densely Connected UNet for Liver and Tumor Segmentation From CT Volumes
Li, X., Chen, H., Qi, X., Dou, Q., Fu, C.-W., & Heng, P.-A. (2018) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2018.2845918 · Cited by 2,473
Self-citationA Theoretical Analysis of Feature Pooling in Visual Recognition
Boureau, Y.-L., Ponce, J., & LeCun, Y. (2010) · Cited by 1,661
Mitosis Detection in Breast Cancer Histology Images with Deep Neural Networks
Cireşan, D. C., Giusti, A., Gambardella, L. M., & Schmidhuber, J. (2013) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-40763-5_51 · Cited by 1,536 · cited 2×
“Also, lots of histopathology image recognition tasks have been well studied by researchers, for example, mitosis detection in breast cancer histopathology images [9], [10]; gland instance segmentation in colon images [11]; and nuclear atypia scoring for breast cancer assessment [12].”
BackgroundPredicting cancer outcomes from histology and genomics using convolutional networks
Mobadersany, P., Yousefi, S., Amgad, M., Gutman, D. A., Barnholtz-Sloan, J. S., Velázquez Vega, J. E., Brat, D. J., & Cooper, L. A. D. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1717139115 · Cited by 1,084
Deep learning as a tool for increased accuracy and efficiency of histopathological diagnosis
Litjens, G., Sánchez, C. I., Timofeeva, N., Hermsen, M., Nagtegaal, I., Kovacs, I., Hulsbergen - van de Kaa, C., Bult, P., van Ginneken, B., & van der Laak, J. (2016) · Scientific Reports · doi:10.1038/srep26286 · Cited by 1,069 · cited 1×
“The normalized cumulative histogram with percentile analysis [15] and connected component features of WSI probability maps [15], [17], [18] were widely utilized in the second-stage decision fusion model.”
MethodYu, K.-H., Zhang, C., Berry, G. J., Altman, R. B., Ré, C., Rubin, D. L., & Snyder, M. (2016) · Nature Communications · doi:10.1038/ncomms12474 · Cited by 972
Patch-Based Convolutional Neural Network for Whole Slide Tissue Image Classification
Hou, L., Samaras, D., Kurc, T. M., Gao, Y., Davis, J. E., & Saltz, J. H. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.266 · Cited by 866
Deep Learning for Identifying Metastatic Breast Cancer
Wang, D., Khosla, A., Gargeya, R., Irshad, H., & Beck, A. H. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1606.05718 · Cited by 756
Automatic Detection of Cerebral Microbleeds From MR Images via 3D Convolutional Neural Networks
Dou, Q., Chen, H., Yu, L., Zhao, L., Qin, J., Wang, D., Mok, V. C., Shi, L., & Heng, P.-A. (2016) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2016.2528129 · Cited by 679
Self-citationDCAN: Deep Contour-Aware Networks for Accurate Gland Segmentation
Chen, H., Qi, X., Yu, L., & Heng, P.-A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.273 · Cited by 623
Self-citationMultiple instance classification: Review, taxonomy and comparative study
Amores, J. (2013) · Artificial Intelligence · doi:10.1016/j.artint.2013.06.003 · Cited by 557
DCAN: Deep contour-aware networks for object instance segmentation from histology images
Chen, H., Qi, X., Yu, L., Dou, Q., Qin, J., & Heng, P.-A. (2017) · Medical Image Analysis · doi:10.1016/j.media.2016.11.004 · Cited by 510
Self-citationDetecting Cancer Metastases on Gigapixel Pathology Images
Liu, Y., Gadepalli, K., Norouzi, M., Dahl, G. E., Kohlberger, T., Boyko, A., Venugopalan, S., Timofeev, A., Nelson, P. Q., Corrado, G. S., et al. (2017) · arXiv · doi:10.48550/arxiv.1703.02442 · Cited by 506 · cited 1×
“Furthermore, a range of magnification levels of WSIs were also considered to improve the performance [17], [20].”
BackgroundDeep learning of feature representation with multiple instance learning for medical image analysis
Xu, Y., Mo, T., Feng, Q., Zhong, P., Lai, M., & Chang, E. I.-C. (2014) · 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2014.6853873 · Cited by 354
Deep learning for classification of colorectal polyps on whole-slide images
Korbar, B., Olofson, A. M., Miraflor, A. P., Nicka, C. M., Suriawinata, M. A., Torresani, L., Suriawinata, A. A., & Hassanpour, S. (2017) · Journal of Pathology Informatics · doi:10.4103/jpi.jpi_34_17 · Cited by 349
WSISA: Making Survival Prediction from Whole Slide Histopathological Images
Zhu, X., Yao, J., Zhu, F., & Huang, J. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.725 · Cited by 292
Weakly supervised histopathology cancer image segmentation and classification
Xu, Y., Zhu, J.-Y., Chang, E. I.-C., Lai, M., & Tu, Z. (2014) · Medical Image Analysis · doi:10.1016/j.media.2014.01.010 · Cited by 283
Mitosis Detection in Breast Cancer Histology Images via Deep Cascaded Networks
Chen, H., Dou, Q., Wang, X., Qin, J., & Heng, P. (2016) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v30i1.10140 · Cited by 255
Self-citationBarker, J., Hoogi, A., Depeursinge, A., & Rubin, D. L. (2016) · Medical Image Analysis · doi:10.1016/j.media.2015.12.002 · Cited by 216
Deep Multi-instance Networks with Sparse Label Assignment for Whole Mammogram Classification
Zhu, W., Lou, Q., Vang, Y. S., & Xie, X. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-66179-7_69 · Cited by 214
3-D Fully Convolutional Networks for Multimodal Isointense Infant Brain Image Segmentation
Nie, D., Wang, L., Adeli, E., Lao, C., Lin, W., & Shen, D. (2019) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2018.2797905 · Cited by 191
Comprehensive Computational Pathological Image Analysis Predicts Lung Cancer Prognosis
Luo, X., Zang, X., Yang, L., Huang, J., Liang, F., Rodriguez-Canales, J., Wistuba, I. I., Gazdar, A., Xie, Y., & Xiao, G. (2017) · Journal of Thoracic Oncology · doi:10.1016/j.jtho.2016.10.017 · Cited by 189
Xu, Y., Jia, Z., Ai, Y., Zhang, F., Lai, M., & Chang, E. I.-C. (2015) · 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2015.7178109 · Cited by 187
Bejnordi, B. E., Zuidhof, G., Balkenhol, M., Hermsen, M., Bult, P., van Ginneken, B., Karssemeijer, N., Litjens, G., & van der Laak, J. (2017) · Journal of Medical Imaging · doi:10.1117/1.jmi.4.4.044504 · Cited by 185
Ultrasound Standard Plane Detection Using a Composite Neural Network Framework
Chen, H., Wu, L., Dou, Q., Qin, J., Li, S., Cheng, J.-Z., Ni, D., & Heng, P.-A. (2017) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2017.2685080 · Cited by 164
Self-citationCourtiol, P., Tramel, E. W., Sanselme, M., & Wainrib, G. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1802.02212 · Cited by 162
Wang, S., Chen, A., Yang, L., Cai, L., Xie, Y., Fujimoto, J., Gazdar, A. F., & Xiao, G. (2018) · Scientific Reports · doi:10.1038/s41598-018-27707-4 · Cited by 152
Mercan, C., Aksoy, S., Mercan, E., Shapiro, L. G., Weaver, D. L., & Elmore, J. G. (2017) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2017.2758580 · Cited by 149
Chen, H., Shen, C., Qin, J., Ni, D., Shi, L., Cheng, J. C. Y., & Heng, P. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24553-9_63 · Cited by 143
Self-citationAutomated histological classification of whole-slide images of gastric biopsy specimens
Yoshida, H., Shimazu, T., Kiyuna, T., Marugame, A., Yamashita, Y., Cosatto, E., Taniguchi, H., Sekine, S., & Ochiai, A. (2017) · Gastric Cancer · doi:10.1007/s10120-017-0731-8 · Cited by 102
Fine-Grained Recurrent Neural Networks for Automatic Prostate Segmentation in Ultrasound Images
Yang, X., Yu, L., Wu, L., Wang, Y., Ni, D., Qin, J., & Heng, P. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.10761 · Cited by 93
Self-citationLin, H., Chen, H., Dou, Q., Wang, L., Qin, J., & Heng, P. (2018) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv.2018.00065 · Cited by 88
Self-citationNovel image markers for non-small cell lung cancer classification and survival prediction
Wang, H., Xing, F., Su, H., Stromberg, A. J., & Yang, L. (2014) · BMC Bioinformatics · doi:10.1186/1471-2105-15-310 · Cited by 81
Stacked Predictive Sparse Decomposition for Classification of Histology Sections
Chang, H., Zhou, Y., Borowsky, A. D., Barner, K. E., Spellman, P. T., & Parvin, B. (2014) · International Journal of Computer Vision · doi:10.1007/s11263-014-0790-9 · Cited by 69
Persistent Homology for Fast Tumor Segmentation in Whole Slide Histology Images
Qaiser, T., Sirinukunwattana, K., Nakane, K., Tsang, Y., Epstein, D., & Rajpoot, N. (2016) · Procedia Computer Science · doi:10.1016/j.procs.2016.07.033 · Cited by 60
Bejnordi, B., Litjens, G., Hermsen, M., Karssemeijer, N., & van der Laak, J. A. (2015) · Medical Imaging · doi:10.1117/12.2081768 · Cited by 54
A Global Covariance Descriptor for Nuclear Atypia Scoring in Breast Histopathology Images
Khan, A. M., Sirinukunwattana, K., & Rajpoot, N. (2015) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2015.2447008 · Cited by 52
Classification of Tumor Histology via Morphometric Context
Chang, H., Borowsky, A. D., Spellman, P. T., & Parvin, B. (2013) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2013.286 · Cited by 46
Classification of lung cancer histology images using patch-level summary statistics
Khurram, S. A., Graham, S., Shaban, M., Qaiser, T., & Rajpoot, N. (2018) · SPIE Medical Imaging: Digital and Computational Pathology · doi:10.1117/12.2293855 · Cited by 46
A Similarity-Based Classification Framework for Multiple-Instance Learning
Xiao, Y., Liu, B., Hao, Z., & Cao, L. (2014) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2013.2257749 · Cited by 40
Weakly Supervised Multilabel Clustering and its Applications in Computer Vision
Xia, Y., Nie, L., Zhang, L., Yang, Y., Hong, R., & Li, X. (2016) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2015.2501385 · Cited by 34
Representation-Aggregation Networks for Segmentation of Multi-Gigapixel Histology ImagesPreprint
Agarwalla, A., Shaban, M., & Rajpoot, N. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1707.08814 · Cited by 22
Multi-instance multi-label learning for whole slide breast histopathology
Mercan, C., Mercan, E., Aksoy, S., et al. (2016) · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · doi:10.1117/12.2216458 · Cited by 13
Contexts-Constrained Multiple Instance Learning for Histopathology Image Analysis
Xu, Y. L., Zhang, J., Chang, E., Lai, M., & Tu, Z. (2012) · Cited by 6
LUNG CANCER SUBTYPE CLASSIFICATION FROM WHOLE SLIDE HISTOPATHOLOGICAL IMAGES
Ganti, D. (2015) · UTA ResearchCommons (University of Texas Arlington) · Cited by 2
Cited by
Deep learning in histopathology: the path to the clinic
van der Laak, J., Litjens, G., & Ciompi, F. (2021) · Nature Medicine · doi:10.1038/s41591-021-01343-4 · Cited by 902
Deep neural network models for computational histopathology: A survey
Srinidhi, C. L., Ciga, O., & Martel, A. L. (2021) · Medical Image Analysis · doi:10.1016/j.media.2020.101813 · Cited by 749
Deep learning in cancer pathology: a new generation of clinical biomarkers
Echle, A., Rindtorff, N. T., Brinker, T. J., Luedde, T., Pearson, A. T., & Kather, J. N. (2021) · British Journal of Cancer · doi:10.1038/s41416-020-01122-x · Cited by 667
Yao, J., Zhu, X., Jonnagaddala, J., Hawkins, N., & Huang, J. (2020) · Medical Image Analysis · doi:10.1016/j.media.2020.101789 · Cited by 522
Zhang, H., Meng, Y., Zhao, Y., Qiao, Y., Yang, X., Coupland, S. E., & Zheng, Y. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01824 · Cited by 484
Metadata
- Authors
- Wang, X., Chen, H., Gan, C., Lin, H., Dou, Q., Tsougenis, E., Huang, Q., Cai, M., & Heng, P.-A.
- Venue
- IEEE Transactions on Cybernetics
- Published
- 2020-09
- Volume
- 50
- Issue
- 9
- Pages
- 3950-3962
- ISSN
- 2168-2267 (ISSN-L)
- 2168-2275
- OpenAlex
- W2971376088
- Cited by
- 408
- References
- 52
- FWCI
- 16.12
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.