The DOI matches its Crossref record; 51 of the 51 references it cites were found in a registry or an index.
DTFD-MIL: Double-Tier Feature Distillation Multiple Instance Learning for Histopathology Whole Slide Image Classification
Open accessAbstract
Multiple instance learning (MIL) has been increasingly used in the classification of histopathology whole slide images (WSIs). However, MIL approaches for this specific classification problem still face unique challenges, particularly those related to small sample cohorts. In these, there are limited number of WSI slides (bags), while the resolution of a single WSI is huge, which leads to a large number of patches (instances) cropped from this slide. To address this issue, we propose to virtually enlarge the number of bags by introducing the concept of pseudo-bags, on which a double-tier MIL framework is built to effectively use the intrinsic features. Besides, we also contribute to deriving the instance probability under the framework of attentionbased MIL, and utilize the derivation to help construct and analyze the proposed framework. The proposed method outperforms other latest methods on the CAMELYON-16 by substantially large margins, and is also better in performance on the TCGA lung cancer dataset. The proposed framework is ready to be extended for wider MIL applications. The code is available at: https://github. com/hrzhang1123/DTFD-MIL.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization
Selvaraju, R. R., Cogswell, M., Das, A., Vedantam, R., Parikh, D., & Batra, D. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.74 · Cited by 24,513
Learning Deep Features for Discriminative Localization
Zhou, B., Khosla, A., Lapedriza, A., Oliva, A., & Torralba, A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.319 · Cited by 11,428
Ehteshami Bejnordi, B., Veta, M., Johannes van Diest, P., van Ginneken, B., Karssemeijer, N., Litjens, G., van der Laak, J. A. W. M., and the CAMELYON16 Consortium, Hermsen, M., Manson, Q. F., et al. (2017) · JAMA · doi:10.1001/jama.2017.14585 · Cited by 3,293 · cited 12×
“To further explore the proposed instance probability derivation, we train a classic AB-MIL model, and generate the heatmaps of 5 sub-fields of 5 slides from CAMELYON-16.”
MethodInfluentialSolving the multiple instance problem with axis-parallel rectangles
Dietterich, T. G., Lathrop, R. H., & Lozano-Pérez, T. (1997) · Artificial Intelligence · doi:10.1016/s0004-3702(96)00034-3 · Cited by 2,866
Clinical-grade computational pathology using weakly supervised deep learning on whole slide images
Campanella, G., Hanna, M. G., Geneslaw, L., Miraflor, A., Werneck Krauss Silva, V., Busam, K. J., Brogi, E., Reuter, V. E., Klimstra, D. S., & Fuchs, T. J. (2019) · Nature Medicine · doi:10.1038/s41591-019-0508-1 · Cited by 2,799
Data-efficient and weakly supervised computational pathology on whole-slide images
Lu, M. Y., Williamson, D. F. K., Chen, T. Y., Chen, R. J., Barbieri, M., & Mahmood, F. (2021) · Nature Biomedical Engineering · doi:10.1038/s41551-020-00682-w · Cited by 2,282
A Framework for Multiple-Instance Learning
Maron, O., & Lozano‐Pérez, T. (1997) · neural information processing systems · Cited by 1,230
Deep learning as a tool for increased accuracy and efficiency of histopathological diagnosis
Litjens, G., Sánchez, C. I., Timofeeva, N., Hermsen, M., Nagtegaal, I., Kovacs, I., Hulsbergen - van de Kaa, C., Bult, P., van Ginneken, B., & van der Laak, J. (2016) · Scientific Reports · doi:10.1038/srep26286 · Cited by 1,069 · cited 1×
“The increasing use of WSIs in histopathology results in digital pathology providing huge improvements in workflow and diagnosis decision-making by pathologists [7,21,24,29,31], but it also stimulates the need for intelligent or automatic analytical tools of WSIs [11, 20, 36, 40, 44, 48, 49].”
BackgroundLi, B., Li, Y., & Eliceiri, K. W. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.01409 · Cited by 957
Is object localization for free? - Weakly-supervised learning with convolutional neural networks
Oquab, M., Bottou, L., Laptev, I., & Sivic, J. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298668 · Cited by 886
Patch-Based Convolutional Neural Network for Whole Slide Tissue Image Classification
Hou, L., Samaras, D., Kurc, T. M., Gao, Y., Davis, J. E., & Saltz, J. H. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.266 · Cited by 866
Deep Learning for Identifying Metastatic Breast Cancer
Wang, D., Khosla, A., Gargeya, R., Irshad, H., & Beck, A. H. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1606.05718 · Cited by 756
Seed, Expand and Constrain: Three Principles for Weakly-Supervised Image Segmentation
Kolesnikov, A., & Lampert, C. H. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46493-0_42 · Cited by 719
From image-level to pixel-level labeling with Convolutional Networks
Pinheiro, P. O., & Collobert, R. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298780 · Cited by 673
Attention-based Deep Multiple Instance Learning
Ilse, M., Tomczak, J. M., & Welling, M. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1802.04712 · Cited by 636
Weakly-Supervised Semantic Segmentation Network with Deep Seeded Region Growing
Huang, Z., Wang, X., Wang, J., Liu, W., & Wang, J. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00733 · Cited by 591
Multiple instance classification: Review, taxonomy and comparative study
Amores, J. (2013) · Artificial Intelligence · doi:10.1016/j.artint.2013.06.003 · Cited by 557
Revisiting multiple instance neural networks
Wang, X., Yan, Y., Tang, P., Bai, X., & Liu, W. (2018) · Pattern Recognition · doi:10.1016/j.patcog.2017.08.026 · Cited by 498
Review of the current state of whole slide imaging in pathology
Pantanowitz, L., Valenstein, P. N., Evans, A. J., Kaplan, K. J., Pfeifer, J. D., Wilbur, D. C., Collins, L. C., & Colgan, T. J. (2011) · Journal of Pathology Informatics · doi:10.4103/2153-3539.83746 · Cited by 435
Weakly Supervised Deep Learning for Whole Slide Lung Cancer Image Analysis
Wang, X., Chen, H., Gan, C., Lin, H., Dou, Q., Tsougenis, E., Huang, Q., Cai, M., & Heng, P.-A. (2020) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2019.2935141 · Cited by 408
Histology image analysis for carcinoma detection and grading
He, L., Long, L. R., Antani, S., & Thoma, G. R. (2012) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2011.12.007 · Cited by 389
Weakly-Supervised Semantic Segmentation by Iteratively Mining Common Object Features
Wang, X., You, S., Li, X., & Ma, H. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00147 · Cited by 326
Weakly-supervised learning for lung carcinoma classification using deep learning
Kanavati, F., Toyokawa, G., Momosaki, S., Rambeau, M., Kozuma, Y., Shoji, F., Yamazaki, K., Takeo, S., Iizuka, O., & Tsuneki, M. (2020) · Scientific Reports · doi:10.1038/s41598-020-66333-x · Cited by 250
Neural Image Compression for Gigapixel Histopathology Image Analysis
Tellez, D., Litjens, G., van der Laak, J., & Ciompi, F. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2936841 · Cited by 242
Fully Convolutional Multi-Class Multiple Instance Learning
Pathak, D., Shelhamer, E., Long, J., & Darrell, T. J. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1412.7144 · Cited by 236
Deep Multi-instance Networks with Sparse Label Assignment for Whole Mammogram Classification
Zhu, W., Lou, Q., Vang, Y. S., & Xie, X. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-66179-7_69 · Cited by 214
Digital pathology image analysis: opportunities and challenges
Madabhushi, A. (2009) · Imaging in Medicine · doi:10.2217/iim.09.9 · Cited by 209
Zhao, Y., Yang, F., Fang, Y., Liu, H., Zhou, N., Zhang, J., Sun, J., Yang, S., Menze, B., Fan, X., et al. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00489 · Cited by 188
Self-citationHistoSegNet: Semantic Segmentation of Histological Tissue Type in Whole Slide Images
Chan, L., Hosseini, M. S., Rowsell, C. H., Plataniotis, K. N., & Damaskinos, S. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.01076 · Cited by 184
CAMEL: A Weakly Supervised Learning Framework for Histopathology Image Segmentation
Xu, G., Song, Z., Sun, Z., Ku, C., Yang, Z., Liu, C., Wang, S., Ma, J., & Xu, W. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.01078 · Cited by 180
Feng, J., & Zhou, Z.-H. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.10890 · Cited by 161
Multiple Instance Learning with Center Embeddings for Histopathology Classification
Chikontwe, P., Kim, M., Nam, S. J., Go, H., & Park, S. H. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-59722-1_50 · Cited by 145
Spatial Uncertainty-Aware Semi-Supervised Crowd Counting
Meng, Y., Zhang, H., Zhao, Y., Yang, X., Qian, X., Huang, X., & Zheng, Y. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01526 · Cited by 143
Self-citationWei, Y., Shen, Z., Cheng, B., Shi, H., Xiong, J., Feng, J., & Huang, T. S. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01252-6_27 · Cited by 140
Streaming Convolutional Neural Networks for End-to-End Learning With Multi-Megapixel Images
Pinckaers, H., van Ginneken, B., & Litjens, G. J. S. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.3019563 · Cited by 140
Cornish, T. C., Swapp, R. E., & Kaplan, K. J. (2012) · Advances in Anatomic Pathology · doi:10.1097/pap.0b013e318253459e · Cited by 136
Zigzag Learning for Weakly Supervised Object Detection
Zhang, X., Feng, J., Xiong, H., & Tian, Q. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00448 · Cited by 131
Weakly Supervised Multiple Instance Learning Histopathological Tumor Segmentation
Lerousseau, M., Vakalopoulou, M., Classe, M., Adam, J., Battistella, E., Carré, A., Estienne, T., Henry, T., Deutsch, É., & Nikos Paragios, A. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-59722-1_45 · Cited by 109
Sharma, Y., Shrivastava, A., Ehsan, L., Moskaluk, C. A., Syed, S., & Brown, D. E. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2103.10626 · Cited by 103
Min-Entropy Latent Model for Weakly Supervised Object Detection
Wan, F., Wei, P., Han, Z., Jiao, J., & Ye, Q. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2898858 · Cited by 97
Cancer Metastasis Detection With Neural Conditional Random FieldPreprint
Li, Y., & Ping, W. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1806.07064 · Cited by 92
Wang, Y., Kartasalo, K., Weitz, P., Ács, B., Valkonen, M., Larsson, C., Ruusuvuori, P., Hartman, J., & Rantalainen, M. (2021) · Cancer Research · doi:10.1158/0008-5472.can-21-0482 · Cited by 84
Multi-instance multi-label image classification: A neural approach
Chen, Z., Chi, Z., Fu, H. C., & Feng, D. D. (2012) · Neurocomputing · doi:10.1016/j.neucom.2012.08.001 · Cited by 77
Weakly supervised object recognition with convolutional neural networks
Oquab, M., Bottou, L., Laptev, I., & Šivic, J. (2014) · Cited by 69
Multi-Instance Multi-Scale CNN for Medical Image Classification
Li, S., Liu, Y., Sui, X., Chen, C., Tjio, G., Ting, D. S. W., & Goh, R. S. M. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-32251-9_58 · Cited by 66
Zhang, H., Kalirai, H., Acha‐Sagredo, A., Yang, X., Zheng, Y., & Coupland, S. E. (2020) · Translational Vision Science & Technology · doi:10.1167/tvst.9.2.50 · Cited by 54
Self-citationMultiple instance learning with graph neural networksPreprint
Tu, M., Huang, J., He, X., & Zhou, B. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.04881 · Cited by 51
(2021) · arXiv (Cornell University) · Cited by 31
Beyond Classification: Whole Slide Tissue Histopathology Analysis By End-To-End Part Learning
Xie, C., Muhammad, H., Vanderbilt, C., Caso, R., Yarlagadda, D. V. K., Campanella, G. S. V., & Fuchs, T. J. (2020) · Medical Imaging with Deep Learning · Cited by 26
Towards Learning Spatially Discriminative Feature Representations
Wang, C., Xiao, J., Han, Y., Yang, Q., Song, S., & Huang, G. M. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00136 · Cited by 25
Godson, L., Alemi, N., Nsengimana, J., Cook, G. P., Clarke, E. L., Treanor, D. E., Bishop, D. T., Newton‐Bishop, J., & Gooya, A. (2022) · White Rose Research Online (University of Leeds, The University of Sheffield, University of York) · doi:10.48550/arxiv.2202.11524 · Cited by 3
Cited by
Visual Language Pretrained Multiple Instance Zero-Shot Transfer for Histopathology Images
Lu, M. Y., Chen, B., Zhang, A., Williamson, D. F. K., Chen, R. J., Ding, T., Le, L. P., Chuang, Y.-S., & Mahmood, F. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52729.2023.01893 · Cited by 122
MambaMIL: Enhancing Long Sequence Modeling with Sequence Reordering in Computational Pathology
Yang, S., Wang, Y., & Chen, H. (2024) · Lecture Notes in Computer Science · doi:10.1007/978-3-031-72083-3_28 · Cited by 114
Cross-scale multi-instance learning for pathological image diagnosis
Deng, R., Cui, C., Remedios, L. W., Bao, S., Womick, R. M., Chiron, S., Li, J., Roland, J. T., Lau, K. S., Liu, Q., et al. (2024) · Medical Image Analysis · doi:10.1016/j.media.2024.103124 · Cited by 95
“, 2021); (8) A Double-Tier Feature Distillation when aggregating features from multiple scales and multiple locations (Zhang et al., 2022); (9) a Hierarchical Image Pyramid Transformer (HIPT) with self-supervised learning (Chen et al.”
MethodMachine learning methods for histopathological image analysis: updates in 2024
Komura, D., Ochi, M., & Ishikawa, S. (2025) · Computational and Structural Biotechnology Journal · doi:10.1016/j.csbj.2024.12.033 · Cited by 76
Morphological Prototyping for Unsupervised Slide Representation Learning in Computational Pathology
Song, A. H., Chen, R. J., Ding, T., Williamson, D. F. K., Jaume, G., & Mahmood, F. (2024) · 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52733.2024.01099 · Cited by 79
Metadata
- Authors
- Zhang, H., Meng, Y., Zhao, Y., Qiao, Y., Yang, X., Coupland, S. E., & Zheng, Y.
- Venue
- 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
- Publisher
- IEEE
- Published
- 2022-06
- Pages
- 18780-18790
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W4312765357
- Cited by
- 484
- References
- 51
- FWCI
- 57.21
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.