Locality Sensitive Deep Learning for Detection and Classification of Nuclei in Routine Colon Cancer Histology Images
The DOI matches its Crossref record; 43 of the 43 references it cites were found in a registry or an index.
Abstract
Detection and classification of cell nuclei in histopathology images of cancerous tissue stained with the standard hematoxylin and eosin stain is a challenging task due to cellular heterogeneity. Deep learning approaches have been shown to produce encouraging results on histopathology images in various studies. In this paper, we propose a Spatially Constrained Convolutional Neural Network (SC-CNN) to perform nucleus detection. SC-CNN regresses the likelihood of a pixel being the center of a nucleus, where high probability values are spatially constrained to locate in the vicinity of the centers of nuclei. For classification of nuclei, we propose a novel Neighboring Ensemble Predictor (NEP) coupled with CNN to more accurately predict the class label of detected cell nuclei. The proposed approaches for detection and classification do not require segmentation of nuclei. We have evaluated them on a large dataset of colorectal adenocarcinoma images, consisting of more than 20,000 annotated nuclei belonging to four different classes. Our results show that the joint detection and classification of the proposed SC-CNN and NEP produces the highest average F1 score as compared to other recently published approaches. Prospectively, the proposed methods could offer benefit to pathology practice in terms of quantitative analysis of tissue constituents in whole-slide images, and potentially lead to a better understanding of cancer.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Sirinukunwattana et al. [292] utilized 100 histology images of colorectal adenocarcinoma to detect cell nuclei using CNNs.”
From Review of deep learning: concepts, CNN architectures, challenges, applications, future directions (2021) · cites this paper as [292]
The cited source says what the claim attributes to it.
In the citing paper
“This CNN detects the center of nuclei using the surrounding spatial context and spatial regression.”
From Review of deep learning: concepts, CNN architectures, challenges, applications, future directions (2021) · cites this paper as [292]
In the citing paper
“Some recent studies have shown that deep learning algorithms are successfully used for medical image segmentation [58], computer aided diagnosis [59,60,61], disease detection and classification [62,63,64,65] and medical image retrieval [66,67].”
From Medical image analysis using convolutional neural networks: a review (2018) · cites this paper as [65]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155 · cited 2×
“In both networks, a rectified linear unit (ReLU) activation function [32] is used after each convolution layer and the first two fully-connected layers (1st, 3rd, 5th and 6th layer).”
MethodU-Net: Convolutional Networks for Biomedical Image Segmentation
Ronneberger, O., Fischer, P., & Brox, T. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24574-4_28 · Cited by 99,404
(2014) · Cited by 33,419
Book Review: Pattern Recognition and Machine Learning
Nasrabadi, N. M. (2007) · Journal of Electronic Imaging · doi:10.1117/1.2819119 · Cited by 22,066 · cited 2×
“…(i.e., weight vectors and bias values) in the network, we solve (2) using the following loss function: (10) where is the cross-entropy loss [29]–[31] defined by (11) and is a small constant, which is set to be the ratio of the total number of non-zero probability pixels and zero probability…”
MethodU-Net: Convolutional Networks for Biomedical Image SegmentationPreprint
Ronneberger, O., Fischer, P., & Brox, T. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1505.04597 · Cited by 17,820 · cited 1×
“The use of small patches not only increases the amount of training data which is crucial for CNNs, but essentially also localizes our analysis to small nuclei in images [10], [11].”
BackgroundPattern Recognition and Machine Learning
(2006) · doi:10.1007/978-0-387-45528-0 · Cited by 9,824
(2012) · Cited by 9,062
A human colon cancer cell capable of initiating tumour growth in immunodeficient mice
O’Brien, C. A., Pollett, A., Gallinger, S., & Dick, J. E. (2007) · Nature · doi:10.1038/nature05372 · Cited by 4,087 · cited 1×
“other factors involved in tumor development [1], [2].”
BackgroundPattern recognition and machine learning
(2007) · Choice Reviews Online · doi:10.5860/choice.44-5091 · Cited by 2,650
(2015) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-24553-9 · Cited by 2,285
Research works printed but not linked: 1
- cruz-roa, 2013, Medical Image Computing and Computer-Assisted Intervention-MICCAI 2013, 403
Cited by
A survey on deep learning in medical image analysis
Litjens, G., Kooi, T., Bejnordi, B. E., Setio, A. A. A., Ciompi, F., Ghafoorian, M., van der Laak, J. A. W. M., van Ginneken, B., & Sánchez, C. I. (2017) · Medical Image Analysis · doi:10.1016/j.media.2017.07.005 · Cited by 15,332
“An interesting example is the paper by Sirinukunwattana et al. (2016) , which details a method directly predicting the center locations of nuclei and shows that this outperforms classification- based center localization.”
MethodReview of deep learning: concepts, CNN architectures, challenges, applications, future directions
Alzubaidi, L., Zhang, J., Humaidi, A. J., Al-Dujaili, A., Duan, Y., Al-Shamma, O., Santamaría, J., Fadhel, M. A., Al-Amidie, M., & Farhan, L. (2021) · Journal of Big Data · doi:10.1186/s40537-021-00444-8 · Cited by 7,906
Deep learning in medical image analysis
Shen, D., Wu, G., & Suk, H.-I. (2017) · Annual Review of Biomedical Engineering · doi:10.1146/annurev-bioeng-071516-044442 · Cited by 4,968
“(100) proposed a spatially constrained CNN (SC-CNN) to detect and classify nuclei in histopathology images.”
BackgroundCoudray, N., Ocampo, P. S., Sakellaropoulos, T., Narula, N., Snuderl, M., Fenyö, D., Moreira, A. L., Razavian, N., & Tsirigos, A. (2018) · Nature Medicine · doi:10.1038/s41591-018-0177-5 · Cited by 2,930
A survey on deep learning and its applications
Dong, S., Wang, P., & Abbas, K. (2021) · Computer Science Review · doi:10.1016/j.cosrev.2021.100379 · Cited by 1,800
The rise of deep learning in drug discovery
Chen, H., Engkvist, O., Wang, Y., Olivecrona, M., & Blaschke, T. (2018) · Drug Discovery Today · doi:10.1016/j.drudis.2018.01.039 · Cited by 1,770
Greenspan, H., van Ginneken, B., & Summers, R. M. (2016) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2016.2553401 · Cited by 1,700
“[15] detected and classified nuclei in histopathological images.”
BackgroundDeep Learning Applications in Medical Image Analysis
Ker, J., Wang, L., Rao, J., & Lim, T. (2018) · IEEE Access · doi:10.1109/access.2017.2788044 · Cited by 1,481
“[72] also used CNNs, but to detect cell nuclei in 100 colorectal adenocarcinoma histology images.”
MethodHover-Net: Simultaneous segmentation and classification of nuclei in multi-tissue histology images
Graham, S., Vu, Q. D., Raza, S. E. A., Azam, A., Tsang, Y. W., Kwak, J. T., & Rajpoot, N. (2019) · Medical Image Analysis · doi:10.1016/j.media.2019.101563 · Cited by 1,423
“Note, because SC-CNN does not produce a segmentation mask, we do not report the PQ for this method.”
BackgroundInfluentialSelf-citationMedical image analysis using convolutional neural networks: a review
Anwar, S. M., Majid, M., Qayyum, A., Awais, M., Alnowami, M., & Khan, M. K. (2018) · Journal of Medical Systems · doi:10.1007/s10916-018-1088-1 · Cited by 1,431
Attention-based Deep Multiple Instance Learning
Ilse, M., Tomczak, J. M., & Welling, M. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1802.04712 · Cited by 636
Deep learning for digital pathology image analysis: A comprehensive tutorial with selected use cases
Janowczyk, A., & Madabhushi, A. (2016) · Journal of Pathology Informatics · doi:10.4103/2153-3539.186902 · Cited by 1,348
“In particular, detection of invasive ductal carcinomas (IDCs),[9] mitosis detection,[8] neuron segmentation,[15] colon gland segmentation,[16] nuclei segmentation[17-19] and detection,[20] brain tumor classification,[21] epithelial tumor nuclei identification,[22] epithelium segmentation,[23] and glioma grading[24] ha…”
MethodDeep Learning for Medical Image Processing: Overview, Challenges and the Future
Razzak, M. I., Naz, S., & Zaib, A. (2018) · Lecture Notes in Computational Vision and Biomechanics · doi:10.1007/978-3-319-65981-7_12 · Cited by 1,248
A Dataset and a Technique for Generalized Nuclear Segmentation for Computational Pathology
Kumar, N., Verma, R., Sharma, S., Bhargava, S., Vahadane, A., & Sethi, A. (2017) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2017.2677499 · Cited by 1,126
Image analysis and machine learning in digital pathology: challenges and opportunities
Madabhushi, A., & Lee, G. (2016) · Medical Image Analysis · doi:10.1016/j.media.2016.06.037 · Cited by 1,093
“recently showed the use of locality sensitive deep learning to automatically detect and classify individual nuclei in routine colon cancer histology images (Sirinukunwattana et al., 2016).”
InfluentialPredicting cancer outcomes from histology and genomics using convolutional networks
Mobadersany, P., Yousefi, S., Amgad, M., Gutman, D. A., Barnholtz-Sloan, J. S., Velázquez Vega, J. E., Brat, D. J., & Cooper, L. A. D. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1717139115 · Cited by 1,084
“Data augmentation techniques have been adopted to address this problem, where randomized rotations and transformations of contrast and brightness are used to synthesize additional training data (9, 11, 14, 15, 17, 19, 25, 26, 33).”
MethodClassification of breast cancer histology images using Convolutional Neural Networks
Araújo, T., Aresta, G., Castro, E., Rouco, J., Aguiar, P., Eloy, C., Polónia, A., & Campilho, A. (2017) · PLOS ONE · doi:10.1371/journal.pone.0177544 · Cited by 1,013
Convolutional neural networks in medical image understanding: a survey
Sarvamangala, D. R., & Kulkarni, R. V. (2022) · Evolutionary Intelligence · doi:10.1007/s12065-020-00540-3 · Cited by 917
Saltz, J., Gupta, R., Hou, L., Kurc, T., Singh, P., Nguyen, V., Samaras, D., Shroyer, K. R., Zhao, T., Batiste, R., et al. (2018) · Cell Reports · doi:10.1016/j.celrep.2018.03.086 · Cited by 1,027
“The CNN is a supervised deep learning method that has been successfully applied in a large number of image analysis problems (Ciresxan et al., 2013; Huang et al., 2016; Xie et al., 2015a,2015b;Wang et al., 2016; Sirinukunwattana et al., 2016; Bayramoglu and Heikkila, 2016; Su et al., 2015; Hou et al., 2016a; Murthy et…”
Deep learning in histopathology: the path to the clinic
van der Laak, J., Litjens, G., & Ciompi, F. (2021) · Nature Medicine · doi:10.1038/s41591-021-01343-4 · Cited by 902
Composition Loss for Counting, Density Map Estimation and Localization in Dense Crowds
Idrees, H., Tayyab, M., Athrey, K., Zhang, D., Al-Maadeed, S., Rajpoot, N., & Shah, M. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01216-8_33 · Cited by 851
Self-citationAcharya, U. R., Fujita, H., Lih, O. S., Hagiwara, Y., Tan, J. H., & Adam, M. (2017) · Information Sciences · doi:10.1016/j.ins.2017.04.012 · Cited by 752
aLow-dose CT via convolutional neural network
Chen, H., Zhang, Y., Zhang, W., Liao, P., Li, K., Zhou, J., & Wang, G. (2017) · Biomedical Optics Express · doi:10.1364/boe.8.000679 · Cited by 755
Deep neural network models for computational histopathology: A survey
Srinidhi, C. L., Ciga, O., & Martel, A. L. (2021) · Medical Image Analysis · doi:10.1016/j.media.2020.101813 · Cited by 749
Ball, J. E., Anderson, D. T., & Chan, C. S. (2017) · Journal of Applied Remote Sensing · doi:10.1117/1.jrs.11.042609 · Cited by 746
AI in Medical Imaging Informatics: Current Challenges and Future Directions
Panayides, A. S., Amini, A., Filipovic, N. D., Sharma, A., Tsaftaris, S. A., Young, A., Foran, D., Do, N., Golemati, S., Kurc, T., et al. (2020) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2020.2991043 · Cited by 713
“Light microscopy is often used to analyze biopsy samples for potential cancers as well as for studying tissue-healing processes [1], [31].”
Segmentation of Nuclei in Histopathology Images by Deep Regression of the Distance Map
Naylor, P., Laé, M., Reyal, F., & Walter, T. (2019) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2018.2865709 · Cited by 685
“cessfully applied to the detection [8], [17], [29], [30] and”
BackgroundMethodBayesian Loss for Crowd Count Estimation With Point Supervision
Ma, Z., Wei, X., Hong, X., & Gong, Y. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00624 · Cited by 617
Deep neural network improves fracture detection by clinicians
Lindsey, R., Daluiski, A., Chopra, S., Lachapelle, A., Mozer, M., Sicular, S., Hanel, D., Gardner, M., Gupta, A., Hotchkiss, R., et al. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1806905115 · Cited by 640
“Within medical imaging, deep learning has shown immense initial promise at tasks, such as predicting the severity of diabetic retinopathy from retinal fundus images (14), classifying skin lesions (15), and analyzing histopathology (16, 17).”
BackgroundDeep learning based tissue analysis predicts outcome in colorectal cancer
Bychkov, D., Linder, N., Turkki, R., Nordling, S., Kovanen, P. E., Verrill, C., Walliander, M., Lundin, M., Haglund, C., & Lundin, J. (2018) · Scientific Reports · doi:10.1038/s41598-018-21758-3 · Cited by 644
Deep Learning and Its Applications in Biomedicine
Cao, C., Liu, F., Tan, H., Song, D., Shu, W., Li, W., Zhou, Y., Bo, X., & Xie, Z. (2018) · Genomics, Proteomics & Bioinformatics · doi:10.1016/j.gpb.2017.07.003 · Cited by 624
“Medical images analysis CNN Brain tumor segmentation, won top 2 in BRATS [108] Segmentation of pancreas in CT [113] Knee cartilage segmentation [114] Segmentation of hippocampus [117] Predict semantic descriptions from medical images [118] Segmentation of MR brain images [121] Anatomy-specific classification of medica…”
Method3D deeply supervised network for automated segmentation of volumetric medical images
Dou, Q., Yu, L., Chen, H., Jin, Y., Yang, X., Qin, J., & Heng, P.-A. (2017) · Medical Image Analysis · doi:10.1016/j.media.2017.05.001 · Cited by 613
Basha, S. H. S., Dubey, S. R., Pulabaigari, V., & Mukherjee, S. (2020) · Neurocomputing · doi:10.1016/j.neucom.2019.10.008 · Cited by 574
“, natural and bio-medical images) of datasets like CIFAR-10 and CIFAR-100 [18], Tiny ImageNet [21], and CRCHistoPhenotypes [22].”
BackgroundMethodInfluentialCai, C. J., Winter, S., Steiner, D., Wilcox, L., & Terry, M. (2019) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3359206 · Cited by 594
“Deep neural networks (DNNs) are increasingly being developed for use in medical applications, such as cancer detection and grading [66, 70]).”
BackgroundSarwinda, D., Paradisa, R. H., Bustamam, A., & Anggia, P. (2021) · Procedia Computer Science · doi:10.1016/j.procs.2021.01.025 · Cited by 545
A Multi-Organ Nucleus Segmentation Challenge
Kumar, N., Verma, R., Anand, D., Zhou, Y., Onder, O. F., Tsougenis, E., Chen, H., Heng, P.-A., Li, J., Hu, Z., et al. (2020) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2019.2947628 · Cited by 553
Self-citationDeep learning for image-based cancer detection and diagnosis − A survey
Hu, Z., Tang, J., Wang, Z., Zhang, K., Zhang, L., & Sun, Q. (2018) · Pattern Recognition · doi:10.1016/j.patcog.2018.05.014 · Cited by 509
DCAN: Deep contour-aware networks for object instance segmentation from histology images
Chen, H., Qi, X., Yu, L., Dou, Q., Qin, J., & Heng, P.-A. (2017) · Medical Image Analysis · doi:10.1016/j.media.2016.11.004 · Cited by 510
Masud, M., Sikder, N., Nahid, A.-A., Bairagi, A. K., & AlZain, M. A. (2021) · Sensors · doi:10.3390/s21030748 · Cited by 464
“[18] Colon Histopathological SC-CNN – 78.”
MethodA Coefficient of Determination for Generalized Linear Models
Zhang, D. (2017) · The American Statistician · doi:10.1080/00031305.2016.1256839 · Cited by 444
Deep learning in microscopy image analysis: a survey
Xing, F., Xie, Y., Su, H., Liu, F., & Yang, L. (2018) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2017.2766168 · Cited by 460
Deep convolutional neural networks for brain image analysis on magnetic resonance imaging: a review
Bernal, J., Kushibar, K., Asfaw, D. S., Valverde, S., Oliver, A., Martí, R., & Lladó, X. (2019) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2018.08.008 · Cited by 368
Salvi, M., Acharya, U. R., Molinari, F., & Meiburger, K. M. (2021) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2020.104129 · Cited by 386
“Sirinukuwattana et al. [139] proposed a post-processing based on neighbors to classify colon cancer histology images.”
BackgroundDeep Learning Models for Histopathological Classification of Gastric and Colonic Epithelial Tumours
Iizuka, O., Kanavati, F., Kato, K., Rambeau, M., Arihiro, K., & Tsuneki, M. (2020) · Scientific Reports · doi:10.1038/s41598-020-58467-9 · Cited by 395
Medical image classification using synergic deep learning
Zhang, J., Xie, Y., Wu, Q., & Xia, Y. (2019) · Medical Image Analysis · doi:10.1016/j.media.2019.02.010 · Cited by 397
CellViT: Vision Transformers for precise cell segmentation and classification
Hörst, F., Rempe, M., Heine, L., Seibold, C., Keyl, J., Baldini, G., Ugurel, S., Siveke, J., Grünwald, B., Egger, J., et al. (2024) · Medical Image Analysis · doi:10.1016/j.media.2024.103143 · Cited by 338
Video Summarization Using Deep Neural Networks: A Survey
Apostolidis, E., Adamantidou, E., Metsai, A. I., Mezaris, V., & Patras, I. (2021) · Proceedings of the IEEE · doi:10.1109/jproc.2021.3117472 · Cited by 350
Freeman, K., Geppert, J., Stinton, C., Todkill, D., Johnson, S., Clarke, A., & Taylor-Phillips, S. (2021) · BMJ · doi:10.1136/bmj.n1872 · Cited by 338
“…screening programmes, the use of deep learning in medicine is increasing, and has been considered in the diagnosis of melanoma, 49 ophthalmic diseases (age-related macular degeneration 50 and glaucoma 51 ), and in interpretation of histological, 52 radiological, 53 and electrocardiogram 54 images.”
BackgroundDeep Adversarial Training for Multi-Organ Nuclei Segmentation in Histopathology Images
Mahmood, F., Borders, D., Chen, R. J., Mckay, G. N., Salimian, K. J., Baras, A., & Durr, N. J. (2020) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2019.2927182 · Cited by 340
“More specifically, convolutional neural networks (CNNs) have recently demonstrated state-of-the-art performance in nuclei segmentation [24, 30, 31].”
BackgroundThe present and future of deep learning in radiology
Saba, L., Biswas, M., Kuppili, V., Cuadrado Godia, E., Suri, H. S., Edla, D. R., Omerzu, T., Laird, J. R., Khanna, N. N., Mavrogeni, S., et al. (2019) · European Journal of Radiology · doi:10.1016/j.ejrad.2019.02.038 · Cited by 353
Graham, S., Chen, H., Gamper, J., Dou, Q., Heng, P.-A., Snead, D., Tsang, Y. W., & Rajpoot, N. (2019) · Medical Image Analysis · doi:10.1016/j.media.2018.12.001 · Cited by 338
Self-citationDeep learning for classification of colorectal polyps on whole-slide images
Korbar, B., Olofson, A. M., Miraflor, A. P., Nicka, C. M., Suriawinata, M. A., Torresani, L., Suriawinata, A. A., & Hassanpour, S. (2017) · Journal of Pathology Informatics · doi:10.4103/jpi.jpi_34_17 · Cited by 349
Methods for Segmentation and Classification of Digital Microscopy Tissue Images
Vu, Q. D., Graham, S., Kurc, T., To, M. N. N., Shaban, M., Qaiser, T., Koohbanani, N. A., Khurram, S. A., Kalpathy-Cramer, J., Zhao, T., et al. (2019) · Frontiers in Bioengineering and Biotechnology · doi:10.3389/fbioe.2019.00053 · Cited by 336
“Methods for segmentation and classification have been proposed by several research projects (Xing and Yang 2016; Peikari and Martel, 2016; Zheng et al. 2017; Gurcan et al., 2009; Senaras, 2018; Chen et al, 2017; Wang et al. 2016; Xie et al. 2015; Sirinukunwattana et al. 2016; Ghaznavi et al., 2013; Manivannan et al. 2…”
BackgroundSelf-citationRecent advances in deep learning
Wang, X., Zhao, Y., & Pourpanah, F. (2020) · International Journal of Machine Learning and Cybernetics · doi:10.1007/s13042-020-01096-5 · Cited by 321
PanNuke Dataset Extension, Insights and Baselines
Gamper, J., Koohbanani, N. A., Benes, K., Graham, S., Jahanifar, M., Khurram, S. A., Azam, A. S., Hewitt, K. J., & Rajpoot, N. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.10778 · Cited by 146
Self-citationMehmood, S., Ghazal, T. M., Khan, M. A., Zubair, M., Naseem, M. T., Faiz, T., & Ahmad, M. (2022) · IEEE Access · doi:10.1109/access.2022.3150924 · Cited by 292
“The previous studies have the following limitations: • Inefficient algorithms, resulting in higher computational cost and time utilization [10], [11], [14].”
BackgroundGoing Deep in Medical Image Analysis: Concepts, Methods, Challenges, and Future Directions
Altaf, F., Islam, S. M. S., Akhtar, N., & Janjua, N. K. (2019) · IEEE Access · doi:10.1109/access.2019.2929365 · Cited by 286
A comprehensive review of deep learning in colon cancer
Pacal, I., Karaboga, D., Basturk, A., Akay, B., & Nalbantoglu, U. (2020) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2020.104003 · Cited by 283
PanNuke: An Open Pan-Cancer Histology Dataset for Nuclei Instance Segmentation and Classification
Gamper, J., Alemi Koohbanani, N., Benet, K., Khuram, A., & Rajpoot, N. (2019) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-23937-4_2 · Cited by 245
Self-citationPhysician perspectives on integration of artificial intelligence into diagnostic pathology
Sarwar, S., Dent, A., Faust, K., Richer, M., Djuric, U., Van Ommeren, R., & Diamandis, P. (2019) · npj Digital Medicine · doi:10.1038/s41746-019-0106-0 · Cited by 297
Li, X., Li, C., Rahaman, M. M., Sun, H., Li, X., Wu, J., Yao, Y., & Grzegorzek, M. (2022) · Artificial Intelligence Review · doi:10.1007/s10462-021-10121-0 · Cited by 278
Self supervised contrastive learning for digital histopathology
Ciga, O., Xu, T., & Martel, A. L. (2022) · Machine Learning with Applications · doi:10.1016/j.mlwa.2021.100198 · Cited by 294
Geospatial immune variability illuminates differential evolution of lung adenocarcinoma
TRACERx Consortium, AbdulJabbar, K., Raza, S. E. A., Rosenthal, R., Jamal-Hanjani, M., Veeriah, S., Akarca, A., Lund, T., Moore, D. A., Salgado, R., et al. (2020) · Nature Medicine · doi:10.1038/s41591-020-0900-x · Cited by 286
Self-citationDisease Staging and Prognosis in Smokers Using Deep Learning in Chest Computed Tomography
González, G., Ash, S. Y., Vegas-Sánchez-Ferrero, G., Onieva Onieva, J., Rahaghi, F. N., Ross, J. C., Díaz, A., San José Estépar, R., & Washko, G. R. (2018) · American Journal of Respiratory and Critical Care Medicine · doi:10.1164/rccm.201705-0860oc · Cited by 281
Machine Learning for Lung Cancer Diagnosis, Treatment, and Prognosis
Li, Y., Wu, X., Yang, P., Jiang, G., & Luo, Y. (2022) · Genomics, Proteomics & Bioinformatics · doi:10.1016/j.gpb.2022.11.003 · Cited by 263
“[52] Micro-Net [53]; SC-CNN [54] An ensemble model based”
BackgroundMethodInfluentialDeep Instance Segmentation of Teeth in Panoramic X-Ray Images
Jader, G., Fontineli, J., Ruiz, M., Abdalla, K., Pithon, M., & Oliveira, L. (2018) · 2018 31st SIBGRAPI Conference on Graphics, Patterns and Images (SIBGRAPI) · doi:10.1109/sibgrapi.2018.00058 · Cited by 238
ToothNet: Automatic Tooth Instance Segmentation and Identification From Cone Beam CT Images
Cui, Z., Li, C., & Wang, W. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00653 · Cited by 232
“CNNs-based methods for medical image analysis have demonstrated excellent performance on many challenging tasks, including classification [35], detection [38] and segmentation [9, 40].”
MethodUnbiased spatial proteomics with single-cell resolution in tissues
Mund, A., Brunner, A.-D., & Mann, M. (2022) · Molecular Cell · doi:10.1016/j.molcel.2022.05.022 · Cited by 259
Halicek, M., Fabelo, H., Ortega, S., Callico, G. M., & Fei, B. (2019) · Cancers · doi:10.3390/cancers11060756 · Cited by 243
MoNuSAC2020: A Multi-Organ Nuclei Segmentation and Classification Challenge
Verma, R., Kumar, N., Patil, A., Kurian, N. C., Rane, S., Graham, S., Vu, Q. D., Zwager, M., Raza, S. E. A., Rajpoot, N., et al. (2021) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2021.3085712 · Cited by 210
“For example, SC-CNN uses a novel neighboring ensemble predictor to label individual nuclei that follows detection by a spatially constrained convolutional neural network [32], while Hover-Net performs”
MethodSelf-citationNuclei segmentation in histopathology images using deep neural networks
Naylor, P., Lae, M., Reyal, F., & Walter, T. (2017) · 2017 IEEE 14th International Symposium on Biomedical Imaging (ISBI 2017) · doi:10.1109/isbi.2017.7950669 · Cited by 202
“Indeed, deep neural networks have been used for the localization and classification of nuclei in histopathology data from breast and colon cancer [4, 5], but these previously published approaches do no allow for segmentation.”
MethodThe state of the art of deep learning models in medical science and their challenges
Bhatt, C., Kumar, I., Vijayakumar, V., Singh, K. U., & Kumar, A. (2021) · Multimedia Systems · doi:10.1007/s00530-020-00694-1 · Cited by 222
Weakly Supervised Deep Nuclei Segmentation Using Partial Points Annotation in Histopathology Images
Qu, H., Wu, P., Huang, Q., Yi, J., Yan, Z., Li, K., Riedlinger, G. M., De, S., Zhang, S., & Metaxas, D. N. (2020) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2020.3002244 · Cited by 189
“Sirinukunwattana et al. [25] improved SR-CNN by using a spatial-constrained layer.”
MethodRelevance of deep learning to facilitate the diagnosis of HER2 status in breast cancer
Vandenberghe, M. E., Scott, M. L. J., Scorer, P. W., Söderberg, M., Balcerzak, D., & Barker, C. (2017) · Scientific Reports · doi:10.1038/srep45938 · Cited by 209
Machine Learning‐Enabled Smart Sensor Systems
Ha, N., Xu, K., Ren, G., Mitchell, A., & Ou, J. Z. (2020) · Advanced Intelligent Systems · doi:10.1002/aisy.202000063 · Cited by 207
Recurrent Attentive Zooming for Joint Crowd Counting and Precise Localization
Liu, C., Weng, X., & Mu, Y. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00131 · Cited by 196
Wang, X., Yang, W., Weinreb, J., Han, J., Li, Q., Kong, X., Yan, Y., Ke, Z., Luo, B., Liu, T., et al. (2017) · Scientific Reports · doi:10.1038/s41598-017-15720-y · Cited by 194
Efficient deep learning model for mitosis detection using breast histopathology images
Saha, M., Chakraborty, C., & Racoceanu, D. (2018) · Computerized Medical Imaging and Graphics · doi:10.1016/j.compmedimag.2017.12.001 · Cited by 194
“…Generic features [17] Color-based Blue ratio [19] Maximization of relative-entropy [11] Spectral band selection [38] Gamma-Gaussian Mixture Model [39] Chan-Vese level set [40] SCILAIM software used for mitosis detection using Feulgen Stained BC images [41] Contextual learning based Learning…”
BackgroundMethodHabibzadeh Motlagh, M., Jannesari, M., Rezaei, Z., Totonchi, M., & Baharvand, H. (2018) · Tenth International Conference on Machine Vision (ICMV 2017) · doi:10.1117/12.2311282 · Cited by 194
Sharp Multiple Instance Learning for DeepFake Video Detection
Li, X., Lang, Y., Chen, Y., Mao, X., He, Y., Wang, S., Xue, H., & Lu, Q. (2020) · Proceedings of the 28th ACM International Conference on Multimedia · doi:10.1145/3394171.3414034 · Cited by 157
“The boom of deep learning-based approaches further enhances the ability of multi-instance learning by a large margin [34, 52], especially for medical image scenarios [39, 47].”
BackgroundAccurate diagnosis of colorectal cancer based on histopathology images using artificial intelligence
Wang, K. S., Yu, G., Xu, C., Meng, X. H., Zhou, J., Zheng, C., Deng, Z., Shang, L., Liu, R., Su, S., et al. (2021) · BMC Medicine · doi:10.1186/s12916-021-01942-5 · Cited by 176
Breast cancer diagnosis in DCE-MRI using mixture ensemble of convolutional neural networks
Rasti, R., Teshnehlab, M., & Phung, S. L. (2017) · Pattern Recognition · doi:10.1016/j.patcog.2017.08.004 · Cited by 185
MuDeRN: Multi-category classification of breast histopathological image using deep residual networks
Gandomkar, Z., Brennan, P. C., & Mello-Thoms, C. (2018) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2018.04.005 · Cited by 180
Hägele, M., Seegerer, P., Lapuschkin, S., Bockmayr, M., Samek, W., Klauschen, F., Müller, K.-R., & Binder, A. (2020) · Scientific Reports · doi:10.1038/s41598-020-62724-2 · Cited by 165
Artificial Intelligence-based methods in head and neck cancer diagnosis: an overview
Mahmood, H., Shaban, M., Rajpoot, N., & Khurram, S. A. (2021) · British Journal of Cancer · doi:10.1038/s41416-021-01386-x · Cited by 167
Self-citationDeep Learning–Based Segmentation and Quantification in Experimental Kidney Histopathology
Bouteldja, N., Klinkhammer, B. M., Bülow, R. D., Droste, P., Otten, S. W., Freifrau von Stillfried, S., Moellmann, J., Sheehan, S. M., Korstanje, R., Menzel, S., et al. (2021) · Journal of the American Society of Nephrology · doi:10.1681/asn.2020050597 · Cited by 174
Context-aware convolutional neural network for grading of colorectal cancer histology images
Shaban, M., Awan, R., Fraz, M. M., Azam, A., Tsang, Y.-W., Snead, D., & Rajpoot, N. M. (2020) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2020.2971006 · Cited by 179
Self-citationRMDL: Recalibrated multi-instance deep learning for whole slide gastric image classification
Wang, S., Zhu, Y., Yu, L., Chen, H., Lin, H., Wan, X., Fan, X., & Heng, P.-A. (2019) · Medical Image Analysis · doi:10.1016/j.media.2019.101549 · Cited by 178
Shaban, M., Khurram, S. A., Fraz, M. M., Alsubaie, N., Masood, I., Mushtaq, S., Hassan, M., Loya, A., & Rajpoot, N. M. (2019) · Scientific Reports · doi:10.1038/s41598-019-49710-z · Cited by 176
Self-citationCellular community detection for tissue phenotyping in colorectal cancer histology images
Javed, S., Mahmood, A., Fraz, M. M., Koohbanani, N. A., Benes, K., Tsang, Y.-W., Hewitt, K., Epstein, D., Snead, D., & Rajpoot, N. (2020) · Medical Image Analysis · doi:10.1016/j.media.2020.101696 · Cited by 170
Self-citationConvolution Neural Networks for diagnosing colon and lung cancer histopathological imagesPreprint
Mangal, S., Chaurasia, A., & Khajanchi, A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2009.03878 · Cited by 226
Low-Frequency Noise Suppression Method Based on Improved DnCNN in Desert Seismic Data
Zhao, Y., Li, Y., Dong, X., & Yang, B. (2019) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2018.2882058 · Cited by 165
“In many fields, such as image denoising [5], feature learning [6], action recognition [7], image classification [8], and object detection [9] have achieved remarkable results.”
BackgroundMahmood, H., Shaban, M., Indave, B. I., Santos-Silva, A. R., Rajpoot, N., & Khurram, S. A. (2020) · Oral Oncology · doi:10.1016/j.oraloncology.2020.104885 · Cited by 161
Self-citationSparse autoencoder for unsupervised nucleus detection and representation in histopathology images
Hou, L., Nguyen, V., Kanevsky, A. B., Samaras, D., Kurc, T. M., Zhao, T., Gupta, R. R., Gao, Y., Chen, W., Foran, D., et al. (2019) · Pattern Recognition · doi:10.1016/j.patcog.2018.09.007 · Cited by 160
Glandular Morphometrics for Objective Grading of Colorectal Adenocarcinoma Histology Images
Awan, R., Sirinukunwattana, K., Epstein, D., Jefferyes, S., Qidwai, U., Aftab, Z., Mujeeb, I., Snead, D., & Rajpoot, N. (2017) · Scientific Reports · doi:10.1038/s41598-017-16516-w · Cited by 161
Self-citationDeep learning in digital pathology image analysis: a survey
Deng, S., Zhang, X., Yan, W., Chang, E. I.-C., Fan, Y., Lai, M., & Xu, Y. (2020) · Frontiers of Medicine · doi:10.1007/s11684-020-0782-9 · Cited by 160
A deep learning algorithm for one-step contour aware nuclei segmentation of histopathology images
Cui, Y., Zhang, G., Liu, Z., Xiong, Z., & Hu, J. (2019) · Medical & Biological Engineering & Computing · doi:10.1007/s11517-019-02008-8 · Cited by 138
“Unlike prior binary classifiers [17, 29, 36], which only discriminate nuclei against the background, our nuclei-boundary segmentation model predicts the nuclei and their contours at the same time.”
BackgroundKrithiga, R., & Geetha, P. (2020) · Archives of Computational Methods in Engineering · doi:10.1007/s11831-020-09470-w · Cited by 183
Learning to detect lymphocytes in immunohistochemistry with deep learning
Swiderska-Chadaj, Z., Pinckaers, H., van Rijthoven, M., Balkenhol, M., Melnikova, M., Geessink, O., Manson, Q., Sherman, M., Polonia, A., Parry, J., et al. (2019) · Medical Image Analysis · doi:10.1016/j.media.2019.101547 · Cited by 162
Orbit Image Analysis: An open-source whole slide image analysis tool
Stritt, M., Stalder, A. K., & Vezzali, E. (2020) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1007313 · Cited by 152
Metadata
- Authors
- Sirinukunwattana, K., Raza, S. E. A., Tsang, Y.-W., Snead, D. R. J., Cree, I. A., & Rajpoot, N. M.
- Affiliations
- University of Warwick (GB)
- University Hospital Coventry (GB)
- ORCID
- Venue
- IEEE Transactions on Medical Imaging
- Published
- 2016-05
- Volume
- 35
- Issue
- 5
- Pages
- 1196-1206
- ISSN
- 0278-0062 (ISSN-L)
- 1558-254X
- OpenAlex
- W2312404985
- Cited by
- 1,224
- References
- 41
- Citations by year
- 2026: 36 · 2025: 66 · 2024: 107 · 2023: 131 · 2022: 153 · 2021: 173 · 2020: 163 · 2019: 172 · 2018: 121 · 2017: 85 · 2016: 15
- FWCI
- 106.55
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- IEEE Transactions on Medical Imaging (publishedVersion)
- PubMed (publishedVersion)
- Warwick Research Archive Portal (University of Warwick) (acceptedVersion)
- Qatar University QSpace (Qatar University) (submittedVersion)
- Funders
- Qatar National Research Fund (NPRP5-1345-1-228)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › AI in cancer detection
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Biophysics › Cell Image Analysis Techniques
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Digital Imaging for Blood Diseases
- Keywords
- nucleus detection, colon cancer, colorectal adenocarcinoma, histopathological images, H&E staining, whole slide images, cell nucleus
- MeSH terms
- Machine Learning, Cell Nucleus, Colon, Colonic Neoplasms, Histocytochemistry, Humans, Image Interpretation, Computer-Assisted, Neural Networks, Computer, Cell Proliferation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.