The DOI matches its Crossref record; 58 of the 58 references it cites were found in a registry or an index.
Patch-Based Convolutional Neural Network for Whole Slide Tissue Image Classification
Open accessAbstract
Convolutional Neural Networks (CNN) are state-of-the-art models for many image classification tasks. However, to recognize cancer subtypes automatically, training a CNN on gigapixel resolution Whole Slide Tissue Images (WSI) is currently computationally impossible. The differentiation of cancer subtypes is based on cellular-level visual features observed on image patch scale. Therefore, we argue that in this situation, training a patch-level classifier on image patches will perform better than or similar to an image-level classifier. The challenge becomes how to intelligently combine patch-level classification results and model the fact that not all patches will be discriminative. We propose to train a decision fusion model to aggregate patch-level predictions given by patch-level CNNs, which to the best of our knowledge has not been shown before. Furthermore, we formulate a novel Expectation-Maximization (EM) based method that automatically locates discriminative patches robustly by utilizing the spatial relationships of patches. We apply our method to the classification of glioma and non-small-cell lung carcinoma cases into subtypes. The classification accuracy of our method is similar to the inter-observer agreement between pathologists. Although it is impossible to train CNNs on WSIs, we experimentally demonstrate using a comparable non-cancer dataset of smaller images that a patch-based CNN can outperform an image-based CNN.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
LIBSVM: A library for support vector machines
Chang, C.-C., & Lin, C.-J. (2011) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/1961189.1961199 · Cited by 40,918
Chen, L.-C., Papandreou, G., Kokkinos, I., Murphy, K., & Yuille, A. L. (2016) · arXiv · doi:10.48550/arxiv.1606.00915 · Cited by 22,392
Chen, L.-C., Papandreou, G., Kokkinos, I., Murphy, K., & Yuille, A. L. (2018) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2699184 · Cited by 22,392
Book Review: Pattern Recognition and Machine Learning
Nasrabadi, N. M. (2007) · Journal of Electronic Imaging · doi:10.1117/1.2819119 · Cited by 22,066
Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification
He, K., Zhang, X., Ren, S., & Sun, J. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.123 · Cited by 19,741
Multiresolution gray-scale and rotation invariant texture classification with local binary patterns
Ojala, T., Pietikainen, M., & Maenpaa, T. (2002) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2002.1017623 · Cited by 15,398
Representation Learning: A Review and New Perspectives
Bengio, Y., Courville, A., & Vincent, P. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.50 · Cited by 13,001
Cited by
Clinical-grade computational pathology using weakly supervised deep learning on whole slide images
Campanella, G., Hanna, M. G., Geneslaw, L., Miraflor, A., Werneck Krauss Silva, V., Busam, K. J., Brogi, E., Reuter, V. E., Klimstra, D. S., & Fuchs, T. J. (2019) · Nature Medicine · doi:10.1038/s41591-019-0508-1 · Cited by 2,799
Saltz, J., Gupta, R., Hou, L., Kurc, T., Singh, P., Nguyen, V., Samaras, D., Shroyer, K. R., Zhao, T., Batiste, R., et al. (2018) · Cell Reports · doi:10.1016/j.celrep.2018.03.086 · Cited by 1,027
Self-citationPredicting cancer outcomes from histology and genomics using convolutional networks
Mobadersany, P., Yousefi, S., Amgad, M., Gutman, D. A., Barnholtz-Sloan, J. S., Velázquez Vega, J. E., Brat, D. J., & Cooper, L. A. D. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1717139115 · Cited by 1,084
Li, B., Li, Y., & Eliceiri, K. W. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.01409 · Cited by 957
Machine Learning Methods for Histopathological Image Analysis
Komura, D., & Ishikawa, S. (2018) · Computational and Structural Biotechnology Journal · doi:10.1016/j.csbj.2018.01.001 · Cited by 937
Deep learning in histopathology: the path to the clinic
van der Laak, J., Litjens, G., & Ciompi, F. (2021) · Nature Medicine · doi:10.1038/s41591-021-01343-4 · Cited by 902
Hollon, T. C., Pandian, B., Adapa, A. R., Urias, E., Save, A. V., Khalsa, S. S. S., Eichberg, D. G., D’Amico, R. S., Farooq, Z. U., Lewis, S., et al. (2020) · Nature Medicine · doi:10.1038/s41591-019-0715-9 · Cited by 790
“…the fact that normal brain tissue and nondiagnostic regions have similar histologic features among all patients, resulting in high patch-level classification accuracy for normal brain, and eliminating the need to train an additional classifier based on the patch-level probability histograms 39 .”
Parisot, S., Ktena, S. I., Ferrante, E., Lee, M., Guerrero, R., Glocker, B., & Rueckert, D. (2018) · Medical Image Analysis · doi:10.1016/j.media.2018.06.001 · Cited by 794
Deep neural network models for computational histopathology: A survey
Srinidhi, C. L., Ciga, O., & Martel, A. L. (2021) · Medical Image Analysis · doi:10.1016/j.media.2020.101813 · Cited by 749
Scaling Vision Transformers to Gigapixel Images via Hierarchical Self-Supervised Learning
Chen, R. J., Chen, C., Li, Y., Chen, T. Y., Trister, A. D., Krishnan, R. G., & Mahmood, F. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01567 · Cited by 621
Artificial Intelligence and Digital Pathology: Challenges and Opportunities
Tizhoosh, H. R., & Pantanowitz, L. (2018) · Journal of Pathology Informatics · doi:10.4103/jpi.jpi_53_18 · Cited by 544
Deep learning-based classification of mesothelioma improves prediction of patient outcome
Courtiol, P., Maussion, C., Moarii, M., Pronier, E., Pilcer, S., Sefta, M., Manceron, P., Toldo, S., Zaslavskiy, M., Le Stang, N., et al. (2019) · Nature Medicine · doi:10.1038/s41591-019-0583-3 · Cited by 544
Artificial intelligence and computational pathology
Cui, M., & Zhang, D. Y. (2021) · Laboratory Investigation · doi:10.1038/s41374-020-00514-0 · Cited by 544
A deep learning model to predict RNA-Seq expression of tumours from whole-slide images
Schmauch, B., Romagnoni, A., Pronier, E., Saillard, C., Maillé, P., Calderaro, J., Kamoun, A., Sefta, M., Toldo, S., Zaslavskiy, M., et al. (2020) · Nature Communications · doi:10.1038/s41467-020-17678-4 · Cited by 533
Yao, J., Zhu, X., Jonnagaddala, J., Hawkins, N., & Huang, J. (2020) · Medical Image Analysis · doi:10.1016/j.media.2020.101789 · Cited by 522
Zhang, H., Meng, Y., Zhao, Y., Qiao, Y., Yang, X., Coupland, S. E., & Zheng, Y. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01824 · Cited by 484
Deep learning in microscopy image analysis: a survey
Xing, F., Xie, Y., Su, H., Liu, F., & Yang, L. (2018) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2017.2766168 · Cited by 460
Abels, E., Pantanowitz, L., Aeffner, F., Zarella, M. D., van der Laak, J., Bui, M. M., Vemuri, V. N., Parwani, A. V., Gibbs, J., Agosto‐Arroyo, E., et al. (2019) · The Journal of Pathology · doi:10.1002/path.5331 · Cited by 459
Deep learning with multimodal representation for pancancer prognosis prediction
Cheerla, A., & Gevaert, O. (2019) · Bioinformatics · doi:10.1093/bioinformatics/btz342 · Cited by 421
Weakly Supervised Deep Learning for Whole Slide Lung Cancer Image Analysis
Wang, X., Chen, H., Gan, C., Lin, H., Dou, Q., Tsougenis, E., Huang, Q., Cai, M., & Heng, P.-A. (2020) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2019.2935141 · Cited by 408
Multimodal Co-Attention Transformer for Survival Prediction in Gigapixel Whole Slide Images
Chen, R. J., Lu, M. Y., Weng, W.-H., Chen, T. Y., Williamson, D. F., Manz, T., Shady, M., & Mahmood, F. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00398 · Cited by 398
Deep Learning Models for Histopathological Classification of Gastric and Colonic Epithelial Tumours
Iizuka, O., Kanavati, F., Kato, K., Rambeau, M., Arihiro, K., & Tsuneki, M. (2020) · Scientific Reports · doi:10.1038/s41598-020-58467-9 · Cited by 395
Salvi, M., Acharya, U. R., Molinari, F., & Meiburger, K. M. (2021) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2020.104129 · Cited by 386
Couture, H. D., Williams, L. A., Geradts, J., Nyante, S. J., Butler, E. N., Marron, J. S., Perou, C. M., Troester, M. A., & Niethammer, M. (2018) · npj Breast Cancer · doi:10.1038/s41523-018-0079-1 · Cited by 327
Methods for Segmentation and Classification of Digital Microscopy Tissue Images
Vu, Q. D., Graham, S., Kurc, T., To, M. N. N., Shaban, M., Qaiser, T., Koohbanani, N. A., Khurram, S. A., Kalpathy-Cramer, J., Zhao, T., et al. (2019) · Frontiers in Bioengineering and Biotechnology · doi:10.3389/fbioe.2019.00053 · Cited by 336
Self-citationDeep Learning for Whole Slide Image Analysis: An Overview
Dimitriou, N., Arandjelović, O., & Caie, P. D. (2019) · Frontiers in Medicine · doi:10.3389/fmed.2019.00264 · Cited by 332
Pneumonia detection in chest X-ray images using convolutional neural networks and transfer learning
Jain, R., Nagrath, P., Kataria, G., Sirish Kaushik, V., & Jude Hemanth, D. (2020) · Measurement · doi:10.1016/j.measurement.2020.108046 · Cited by 325
Transfer adaptation learning: A decade survey
Zhang, L., & Gao, X. (2024) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3183326 · Cited by 314
Thoracic Disease Identification and Localization with Limited Supervision
Li, Z., Wang, C., Han, M., Xue, Y., Wei, W., Li, L.-J., & Fei-Fei, L. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00865 · Cited by 313
Pathologist-level interpretable whole-slide cancer diagnosis with deep learning
Zhang, Z., Chen, P., McGough, M., Xing, F., Wang, C., Bui, M., Xie, Y., Sapkota, M., Cui, L., Dhillon, J., et al. (2019) · Nature Machine Intelligence · doi:10.1038/s42256-019-0052-1 · Cited by 311
WSISA: Making Survival Prediction from Whole Slide Histopathological Images
Zhu, X., Yao, J., Zhu, F., & Huang, J. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.725 · Cited by 292
(2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-00889-5 · Cited by 284
Pantanowitz, L., Sharma, A., Carter, A. B., Kurc, T., Sussman, A., & Saltz, J. (2018) · Journal of Pathology Informatics · doi:10.4103/jpi.jpi_69_18 · Cited by 282
Self-citationLi, X., Li, C., Rahaman, M. M., Sun, H., Li, X., Wu, J., Yao, Y., & Grzegorzek, M. (2022) · Artificial Intelligence Review · doi:10.1007/s10462-021-10121-0 · Cited by 278
Brain Tumor Detection and Segmentation in MR Images Using Deep Learning
Sajid, S., Hussain, S., & Sarwar, A. (2019) · Arabian Journal for Science and Engineering · doi:10.1007/s13369-019-03967-8 · Cited by 266
Segmentation of glioma tumors in brain using deep convolutional neural network
Hussain, S., Anwar, S. M., & Majid, M. (2018) · Neurocomputing · doi:10.1016/j.neucom.2017.12.032 · Cited by 257
A Graph-Transformer for Whole Slide Image Classification
Zheng, Y., Gindra, R. H., Green, E. J., Burks, E. J., Betke, M., Beane, J. E., & Kolachalama, V. B. (2022) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2022.3176598 · Cited by 255
Weakly-supervised learning for lung carcinoma classification using deep learning
Kanavati, F., Toyokawa, G., Momosaki, S., Rambeau, M., Kozuma, Y., Shoji, F., Yamazaki, K., Takeo, S., Iizuka, O., & Tsuneki, M. (2020) · Scientific Reports · doi:10.1038/s41598-020-66333-x · Cited by 250
Context-aware convolutional neural network for grading of colorectal cancer histology images
Shaban, M., Awan, R., Fraz, M. M., Azam, A., Tsang, Y.-W., Snead, D., & Rajpoot, N. M. (2020) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2020.2971006 · Cited by 179
Visual Language Pretrained Multiple Instance Zero-Shot Transfer for Histopathology Images
Lu, M. Y., Chen, B., Zhang, A., Williamson, D. F. K., Chen, R. J., Ding, T., Le, L. P., Chuang, Y.-S., & Mahmood, F. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52729.2023.01893 · Cited by 122
Histopathological Whole Slide Image Analysis Using Context-Based CBIR
Zheng, Y., Jiang, Z., Zhang, H., Xie, F., Ma, Y., Shi, H., & Zhao, Y. (2018) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2018.2796130 · Cited by 109
Cross-scale multi-instance learning for pathological image diagnosis
Deng, R., Cui, C., Remedios, L. W., Bao, S., Womick, R. M., Chiron, S., Li, J., Roland, J. T., Lau, K. S., Liu, Q., et al. (2024) · Medical Image Analysis · doi:10.1016/j.media.2024.103124 · Cited by 95
“However, annotating images pixel- or patchwise is computationally expensive for a standard supervised deep learning system (Hou et al., 2016; Mousavi et al., 2015; Maksoud et al., 2020; Dimitriou et al., 2019).”
BackgroundMethodInfluentialFully Convolutional Networks for Surface Defect Inspection in Industrial Environment
Yu, Z., Wu, X., & Gu, X. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-68345-4_37 · Cited by 77
Cheplygina, V., de Bruijne, M., & Pluim, J. P. W. (2019) · Medical Image Analysis · doi:10.1016/j.media.2019.03.009 · Cited by 93
Morphological Prototyping for Unsupervised Slide Representation Learning in Computational Pathology
Song, A. H., Chen, R. J., Ding, T., Williamson, D. F. K., Jaume, G., & Mahmood, F. (2024) · 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52733.2024.01099 · Cited by 79
Alsaafin, A., Safarpoor, A., Sikaroudi, M., Hipp, J. D., & Tizhoosh, H. R. (2023) · Communications Biology · doi:10.1038/s42003-023-04583-x · Cited by 40
SimTriplet: Simple Triplet Representation Learning with a Single GPU
Liu, Q., Louis, P. C., Lu, Y., Jha, A., Zhao, M., Deng, R., Yao, T., Roland, J. T., Yang, H., Zhao, S., et al. (2021) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-87196-3_10 · Cited by 38
Weakly supervised joint whole-slide segmentation and classification in prostate cancer
Pati, P., Jaume, G., Ayadi, Z., Thandiackal, K., Bozorgtabar, B., Gabrani, M., & Goksel, O. (2023) · Medical Image Analysis · doi:10.1016/j.media.2023.102915 · Cited by 37
Qiu, L., Zhao, L., Hou, R., Zhao, W., Zhang, S., Lin, Z., Teng, H., & Zhao, J. (2023) · Computerized Medical Imaging and Graphics · doi:10.1016/j.compmedimag.2022.102176 · Cited by 35
Cai, L., Huang, S., Zhang, Y., Lu, J., & Zhang, Y. (2025) · Medical Image Analysis · doi:10.1016/j.media.2025.103631 · Cited by 33
Pre-training in Medical Data: A Survey
Qiu, Y., Lin, F., Chen, W., & Xu, M. (2023) · Machine Intelligence Research · doi:10.1007/s11633-022-1382-8 · Cited by 30
One label is all you need: Interpretable AI-enhanced histopathology for oncology
Tavolara, T. E., Su, Z., Gurcan, M. N., & Niazi, M. K. K. (2023) · Seminars in Cancer Biology · doi:10.1016/j.semcancer.2023.09.006 · Cited by 28
Wang, X., Bao, N., Xin, X., Tan, J., Li, H., Zhou, S., & Liu, H. (2022) · Quantitative Imaging in Medicine and Surgery · doi:10.21037/qims-21-1155 · Cited by 20
Unsupervised Learning Based on Multiple Descriptors for WSIs Diagnosis
Sheikh, T. S., Kim, J.-Y., Shim, J., & Cho, M. (2022) · Diagnostics · doi:10.3390/diagnostics12061480 · Cited by 19
Improving Representation Learning for Histopathologic Images with Cluster Constraints
Wu, W., Gao, C., DiPalma, J., Vosoughi, S., & Hassanpour, S. (2023) · 2023 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01957 · Cited by 16
Dropout-Enabled Ensemble Learning for Multi-scale Biomedical Data
Momeni, A., Thibault, M., & Gevaert, O. (2019) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-11723-8_41 · Cited by 12
Qi, X., Karagoz, K., Ren, J., Foran, D. J., & Gatza, M. (2018) · Medical Imaging 2018: Imaging Informatics for Healthcare, Research, and Applications · doi:10.1117/12.2293193 · Cited by 11
Using Sparse Patch Annotation for Tumor Segmentation in Histopathological Images
Liu, Y., He, Q., Duan, H., Shi, H., Han, A., & He, Y. (2022) · Sensors · doi:10.3390/s22166053 · Cited by 10
Metadata
- Authors
- Hou, L., Samaras, D., Kurc, T. M., Gao, Y., Davis, J. E., & Saltz, J. H.
- Venue
- 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
- Publisher
- IEEE
- Published
- 2016-06
- Volume
- 2016
- Pages
- 2424-2433
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W2302302587
- Cited by
- 866
- References
- 58
- FWCI
- 31.77
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.