MILD-Net: Minimal information loss dilated network for gland instance segmentation in colon histology images
Open accessThe DOI matches its Crossref record; 49 of the 49 references it cites were found in a registry or an index.
Abstract
HighlightsAccurate gland instance segmentation in colon histology images using a novel minimal information loss dilated network.Uncertainty quantification using the concept of random transformation sampling.A variant of the proposed framework for simultaneous gland and lumen segmentation.Detailed experimentation and comparative analysis on two independent colorectal adenocarcinoma datasets.Perform gland instance segmentation on two further datasets containing whole‐slide images to demonstrate the extensibility of the proposed method. Graphical abstract Figure. No caption available. ABSTRACT The analysis of glandular morphology within colon histopathology images is an important step in determining the grade of colon cancer. Despite the importance of this task, manual segmentation is laborious, time‐consuming and can suffer from subjectivity among pathologists. The rise of computational pathology has led to the development of automated methods for gland segmentation that aim to overcome the challenges of manual segmentation. However, this task is non‐trivial due to the large variability in glandular appearance and the difficulty in differentiating between certain glandular and non‐glandular histological structures. Furthermore, a measure of uncertainty is essential for diagnostic decision making. To address these challenges, we propose a fully convolutional neural network that counters the loss of information caused by max‐pooling by re‐introducing the original image at multiple points within the network. We also use atrous spatial pyramid pooling with varying dilation rates for preserving the resolution and multi‐level aggregation. To incorporate uncertainty, we introduce random transformations during test time for an enhanced segmentation result that simultaneously generates an uncertainty map, highlighting areas of ambiguity. We show that this map can be used to define a metric for disregarding predictions with high uncertainty. The proposed network achieves state‐of‐the‐art performance on the GlaS challenge dataset and on a second independent colorectal adenocarcinoma dataset. In addition, we perform gland instance segmentation on whole‐slide images from two further datasets to highlight the generalisability of our method. As an extension, we introduce MILD‐NetSymbol for simultaneous gland and lumen segmentation, to increase the diagnostic power of the network. Symbol. No caption available.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
U-Net: Convolutional Networks for Biomedical Image Segmentation
Ronneberger, O., Fischer, P., & Brox, T. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24574-4_28 · Cited by 99,404
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Fully convolutional networks for semantic segmentation
Long, J., Shelhamer, E., & Darrell, T. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298965 · Cited by 38,834
Chen, L.-C., Papandreou, G., Kokkinos, I., Murphy, K., & Yuille, A. L. (2016) · arXiv · doi:10.48550/arxiv.1606.00915 · Cited by 22,392
Chen, L.-C., Papandreou, G., Kokkinos, I., Murphy, K., & Yuille, A. L. (2018) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2699184 · Cited by 22,392
Book Review: Pattern Recognition and Machine Learning
Nasrabadi, N. M. (2007) · Journal of Electronic Imaging · doi:10.1117/1.2819119 · Cited by 22,066
SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation
Badrinarayanan, V., Kendall, A., & Cipolla, R. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2644615 · Cited by 19,631
Proceedings of IEEE Conference on Computer Vision and Pattern Recognition
(1993) · doi:10.1109/cvpr.1993 · Cited by 17,667
A survey on deep learning in medical image analysis
Litjens, G., Kooi, T., Bejnordi, B. E., Setio, A. A. A., Ciompi, F., Ghafoorian, M., van der Laak, J. A. W. M., van Ginneken, B., & Sánchez, C. I. (2017) · Medical Image Analysis · doi:10.1016/j.media.2017.07.005 · Cited by 15,332
(2010) · Cited by 14,134
Advances in Neural Information Processing Systems 29
Teymur, O., Zygalakis, K., & Calderhead, B. (2016) · Cited by 13,887
TensorFlow: A system for large-scale machine learning
Abadi, M., Barham, P., Chen, J., Chen, Z., Davis, A., Dean, J., Devin, M., Ghemawat, S., Irving, G., Isard, M., et al. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1605.08695 · Cited by 11,822
Multi-scale context aggregation by dilated convolutions
Yu, F., & Koltun, V. (2015) · arXiv · doi:10.48550/arxiv.1511.07122 · Cited by 7,738 · cited 2×
“Instead, dilated convolution uses sparse kernels (Yu and Koltun, 2015), such that the resolution of the original image is preserved, without significantly increasing the number of parameters.”
BackgroundDropout as a bayesian approximation: Representing model uncertainty in deep learning
Gal, Y., & Ghahramani, Z. (2015) · arXiv · doi:10.48550/arxiv.1506.02142 · Cited by 6,471
Deep learning in medical image analysis
Shen, D., Wu, G., & Suk, H.-I. (2017) · Annual Review of Biomedical Engineering · doi:10.1146/annurev-bioeng-071516-044442 · Cited by 4,968
Ehteshami Bejnordi, B., Veta, M., Johannes van Diest, P., van Ginneken, B., Karssemeijer, N., Litjens, G., van der Laak, J. A. W. M., and the CAMELYON16 Consortium, Hermsen, M., Manson, Q. F., et al. (2017) · JAMA · doi:10.1001/jama.2017.14585 · Cited by 3,293
Self-citationWhat Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?
Kendall, A., & Gal, Y. (2017) · arXiv · doi:10.48550/arxiv.1703.04977 · Cited by 3,088 · cited 2×
“Generally, this uncertainty is estimated through a data dependent noise model (Kendall and Gal, 2017), however it would require us to modify the existing architecture.”
BackgroundFully Convolutional Networks for Semantic Segmentation
Long, J., Shelhamer, E., & Darrell, T. J. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1411.4038 · Cited by 2,489
Histopathological Image Analysis: A Review
Gurcan, M. N., Boucheron, L. E., Can, A., Madabhushi, A., Rajpoot, N. M., & Yener, B. (2009) · IEEE Reviews in Biomedical Engineering · doi:10.1109/rbme.2009.2034865 · Cited by 2,052
Self-citationMitosis Detection in Breast Cancer Histology Images with Deep Neural Networks
Cireşan, D. C., Giusti, A., Gambardella, L. M., & Schmidhuber, J. (2013) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-40763-5_51 · Cited by 1,536 · cited 2×
“…role in automated digitalized histology image analysis, with Rajpoot, 2018; Chen et al., 2017; Sirinukunwattana et al., 2016), mitosis detection (Cireşan et al., 2013; image retrieval (Sapkota et al., 2018; Shi et al., 2017), cancer type classification (Graham et al., 2018; Kong focused on the…”
BackgroundPattern Recognition and Machine Learning
Maindonald, J. (2007) · Journal of Statistical Software · doi:10.18637/jss.v017.b05 · Cited by 1,349
Pathology and Genetics of Tumours of the Digestive System
(2001) · Histopathology · doi:10.1046/j.1365-2559.2001.01219.x · Cited by 1,314
Sirinukunwattana, K., Raza, S. E. A., Tsang, Y.-W., Snead, D. R. J., Cree, I. A., & Rajpoot, N. M. (2016) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2016.2525803 · Cited by 1,224
Self-citationGland segmentation in colon histology images: The glas challenge contest
Sirinukunwattana, K., Pluim, J. P. W., Chen, H., Qi, X., Heng, P.-A., Guo, Y. B., Wang, L. Y., Matuszewski, B. J., Bruni, E., Sanchez, U., et al. (2017) · Medical Image Analysis · doi:10.1016/j.media.2016.08.008 · Cited by 979
Self-citationColorectal carcinoma: Pathologic aspects.
Fleming, M., Ravula, S., Tatishchev, S. F., & Wang, H. L. (2012) · PubMed · doi:10.3978/j.issn.2078-6891.2012.030 · Cited by 713
DCAN: Deep Contour-Aware Networks for Accurate Gland Segmentation
Chen, H., Qi, X., Yu, L., & Heng, P.-A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.273 · Cited by 623
Self-citationAggNet: Deep Learning From Crowds for Mitosis Detection in Breast Cancer Histology Images
Albarqouni, S., Baur, C., Achilles, F., Belagiannis, V., Demirci, S., & Navab, N. (2016) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2016.2528120 · Cited by 606
Washington, M. K., Berlin, J., Branton, P., Burgart, L. J., Carter, D. K., Fitzgibbons, P. L., Halling, K., Frankel, W., Jessup, J., Kakar, S., et al. (2009) · Archives of Pathology & Laboratory Medicine · doi:10.5858/133.10.1539 · Cited by 529
DCAN: Deep contour-aware networks for object instance segmentation from histology images
Chen, H., Qi, X., Yu, L., Dou, Q., Qin, J., & Heng, P.-A. (2017) · Medical Image Analysis · doi:10.1016/j.media.2016.11.004 · Cited by 510
Self-citationAssessment of algorithms for mitosis detection in breast cancer histopathology images
Veta, M., van Diest, P. J., Willems, S. M., Wang, H., Madabhushi, A., Cruz-Roa, A., Gonzalez, F., Larsen, A. B. L., Vestergaard, J. S., Dahl, A. B., et al. (2015) · Medical Image Analysis · doi:10.1016/j.media.2014.11.010 · Cited by 480
Self-citationSuggestive Annotation: A Deep Active Learning Framework for Biomedical Image Segmentation
Yang, L., Zhang, Y., Chen, J., Zhang, S., & Chen, D. Z. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-66179-7_46 · Cited by 480
Deep Adversarial Networks for Biomedical Image Segmentation Utilizing Unannotated Images
Zhang, Y., Yang, L., Chen, J., Fredericksen, M., Hughes, D. P., & Chen, D. Z. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-66179-7_47 · Cited by 379
Pathology and genetics: Tumours of the digestive system
Haboubi, N. (2000) · Surgical Oncology · doi:10.1016/s0960-7404(01)00003-2 · Cited by 374
2018 IEEE Winter Conference on Applications of Computer Vision (WACV)
(2018) · doi:10.1109/wacv41190.2018 · Cited by 350
Mitosis Detection in Breast Cancer Histology Images via Deep Cascaded Networks
Chen, H., Dou, Q., Wang, X., Qin, J., & Heng, P. (2016) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v30i1.10140 · Cited by 255
Self-citationGland Instance Segmentation Using Deep Multichannel Neural Networks
Xu, Y., Li, Y., Wang, Y., Liu, M., Fan, Y., Lai, M., & Chang, E. I.-C. (2017) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2017.2686418 · Cited by 176
Glandular Morphometrics for Objective Grading of Colorectal Adenocarcinoma Histology Images
Awan, R., Sirinukunwattana, K., Epstein, D., Jefferyes, S., Qidwai, U., Aftab, Z., Mujeeb, I., Snead, D., & Rajpoot, N. (2017) · Scientific Reports · doi:10.1038/s41598-017-16516-w · Cited by 161
Self-citationQaiser, T., Mukherjee, A., Reddy PB, C., Munugoti, S. D., Tallam, V., Pitkäaho, T., Lehtimäki, T., Naughton, T., Berseth, M., Pedraza, A., et al. (2018) · Histopathology · doi:10.1111/his.13333 · Cited by 157
Self-citationDeep Learning for Medical Image Analysis
Senaras, C., & Gurcan, M. N. (2018) · Journal of Pathology Informatics · doi:10.4103/jpi.jpi_27_18 · Cited by 130
Gland Instance Segmentation by Deep Multichannel Side Supervision
Xu, Y., Li, Y., Liu, M., Wang, Y., Lai, M., & Chang, E. I.-C. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46723-8_57 · Cited by 104
Lin, H., Chen, H., Dou, Q., Wang, L., Qin, J., & Heng, P. (2018) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv.2018.00065 · Cited by 88
Self-citationCancer Metastasis Detection via Spatially Structured Deep Network
Kong, B., Wang, X., Li, Z., Song, Q., & Zhang, S. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-59050-9_19 · Cited by 72
SAMS-NET: Stain-aware multi-scale network for instance-based nuclei segmentation in histology images
Graham, S., & Rajpoot, N. (2018) · IEEE International Symposium on Biomedical Imaging (ISBI) · doi:10.1109/isbi.2018.8363645 · Cited by 65
Self-citationClassification of lung cancer histology images using patch-level summary statistics
Khurram, S. A., Graham, S., Shaban, M., Qaiser, T., & Rajpoot, N. (2018) · SPIE Medical Imaging: Digital and Computational Pathology · doi:10.1117/12.2293855 · Cited by 46
Self-citationSupervised graph hashing for histopathology image retrieval and classification
Shi, X., Xing, F., Xu, K., Xie, Y., Su, H., & Yang, L. (2017) · Medical Image Analysis · doi:10.1016/j.media.2017.07.009 · Cited by 41
Deep Convolutional Hashing for Low-Dimensional Binary Embedding of Histopathological Images
Sapkota, M., Shi, X., Xing, F., & Yang, L. (2018) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2018.2827703 · Cited by 35
MIMONet: Gland Segmentation Using Multi-Input-Multi-Output Convolutional Neural Network
Raza, S. E. A., Cheung, L., Epstein, D. B. A., Pelengaris, S., Khan, M., & Rajpoot, N. (2017) · Communications in computer and information science · doi:10.1007/978-3-319-60964-5_61 · Cited by 31
Self-citationTumor Segmentation in Whole Slide Images Using Persistent Homology and Deep Convolutional Features
Qaiser, T., Tsang, Y., Epstein, D. B. A., & Rajpoot, N. (2017) · Communications in computer and information science · doi:10.1007/978-3-319-60964-5_28 · Cited by 27
Self-citation
Cited by
Deep learning in histopathology: the path to the clinic
van der Laak, J., Litjens, G., & Ciompi, F. (2021) · Nature Medicine · doi:10.1038/s41591-021-01343-4 · Cited by 902
Deep neural network models for computational histopathology: A survey
Srinidhi, C. L., Ciga, O., & Martel, A. L. (2021) · Medical Image Analysis · doi:10.1016/j.media.2020.101813 · Cited by 749
Transformer-based unsupervised contrastive learning for histopathological image classification
Wang, X., Yang, S., Zhang, J., Wang, M., Zhang, J., Yang, W., Huang, J., & Han, X. (2022) · Medical Image Analysis · doi:10.1016/j.media.2022.102559 · Cited by 751
Segment anything model for medical images?
Huang, Y., Yang, X., Liu, L., Zhou, H., Chang, A., Zhou, X., Chen, R., Yu, J., Chen, J., Chen, C., et al. (2024) · Medical Image Analysis · doi:10.1016/j.media.2023.103061 · Cited by 536
“The authors of this paper sincerely appreciate all the challenge organizers and owners for providing the public MIS datasets including AbdomenCT-1K, ACDC, AMOS 2022, AutoLaparo,BrainPTM 2021, BraTS20,CAMUS, CHAOS, CHASE-DB1, Chest CT segmentation, CRAG, crossMoDA, CVC-ClinicDB,DRIVE, EndoTect 2020, EPFL-EM, ETIS-Larib…”
Salvi, M., Acharya, U. R., Molinari, F., & Meiburger, K. M. (2021) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2020.104129 · Cited by 386
Metadata
- Authors
- Graham, S., Chen, H., Gamper, J., Dou, Q., Heng, P.-A., Snead, D., Tsang, Y. W., & Rajpoot, N.
- Venue
- Medical Image Analysis
- Publisher
- Elsevier BV
- Published
- 2019-02
- Volume
- 52
- Pages
- 199-211
- ISSN
- 1361-8415 (ISSN-L)
- OpenAlex
- W2805735218
- Cited by
- 338
- References
- 49
- FWCI
- 15.28
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.