The DOI matches its Crossref record; 44 of the 44 references it cites were found in a registry or an index.
A Dataset and a Technique for Generalized Nuclear Segmentation for Computational Pathology
Abstract
Nuclear segmentation in digital microscopic tissue images can enable extraction of high-quality features for nuclear morphometrics and other analysis in computational pathology. Conventional image processing techniques, such as Otsu thresholding and watershed segmentation, do not work effectively on challenging cases, such as chromatin-sparse and crowded nuclei. In contrast, machine learning-based segmentation can generalize across various nuclear appearances. However, training machine learning algorithms requires data sets of images, in which a vast number of nuclei have been annotated. Publicly accessible and annotated data sets, along with widely agreed upon metrics to compare techniques, have catalyzed tremendous innovation and progress on other image classification problems, particularly in object recognition. Inspired by their success, we introduce a large publicly accessible data set of hematoxylin and eosin (H&E)-stained tissue images with more than 21000 painstakingly annotated nuclear boundaries, whose quality was validated by a medical doctor. Because our data set is taken from multiple hospitals and includes a diversity of nuclear appearances from several patients, disease states, and organs, techniques trained on it are likely to generalize well and work right out-of-the-box on other H&E-stained images. We also propose a new metric to evaluate nuclear segmentation results that penalizes object- and pixel-level errors in a unified manner, unlike previous metrics that penalize only one type of error. We also propose a segmentation technique based on deep learning that lays a special emphasis on identifying the nuclear boundaries, including those between the touching or overlapping nuclei, and works well on a diverse set of test images.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Fiji: an open-source platform for biological-image analysis
Schindelin, J., Arganda-Carreras, I., Frise, E., Kaynig, V., Longair, M., Pietzsch, T., Preibisch, S., Rueden, C., Saalfeld, S., Schmid, B., et al. (2012) · Nature Methods · doi:10.1038/nmeth.2019 · Cited by 66,890
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380
Learning Multiple Layers of Features from Tiny Images
Krizhevsky, A. (2024) · doi:10.57702/zp44cu3g · Cited by 23,395
(2010) · International Conference on Machine Learning · Cited by 13,995
Measures of the Amount of Ecologic Association Between Species
Dice, L. R. (1945) · Ecology · doi:10.2307/1932409 · Cited by 11,874
CellProfiler: image analysis software for identifying and quantifying cell phenotypes
Carpenter, A. E., Jones, T. R., Lamprecht, M. R., Clarke, C., Kang, I. H., Friman, O., Guertin, D. A., Chang, J. H., Lindquist, R. A., Moffat, J., et al. (2006) · Genome Biology · doi:10.1186/gb-2006-7-10-r100 · Cited by 5,157
Ucf101: A dataset of 101 human actions classes from videos in the wild
Soomro, K., Zamir, A. R., & Shah, M. (2012) · arXiv · doi:10.48550/arxiv.1212.0402 · Cited by 4,575
THE DISTRIBUTION OF THE FLORA IN THE ALPINE ZONE. 1
Jaccard, P. (1912) · New Phytologist · doi:10.1111/j.1469-8137.1912.tb05611.x · Cited by 4,561
Cited by
Cellpose: a generalist algorithm for cellular segmentation
Stringer, C., Wang, T., Michaelos, M., & Pachitariu, M. (2021) · Nature Methods · doi:10.1038/s41592-020-01018-x · Cited by 4,369
Hover-Net: Simultaneous segmentation and classification of nuclei in multi-tissue histology images
Graham, S., Vu, Q. D., Raza, S. E. A., Azam, A., Tsang, Y. W., Kwak, J. T., & Rajpoot, N. (2019) · Medical Image Analysis · doi:10.1016/j.media.2019.101563 · Cited by 1,423
Deep learning for cellular image analysis
Moen, E., Bannon, D., Kudo, T., Graf, W., Covert, M., & Van Valen, D. (2019) · Nature Methods · doi:10.1038/s41592-019-0403-1 · Cited by 1,225
Transformers in medical imaging: A survey
Shamshad, F., Khan, S., Zamir, S. W., Khan, M. H., Hayat, M., Khan, F. S., & Fu, H. (2023) · Medical Image Analysis · doi:10.1016/j.media.2023.102802 · Cited by 1,296
Medical Transformer: Gated Axial-Attention for Medical Image Segmentation
Valanarasu, J. M. J., Oza, P., Hacihaliloglu, I., & Patel, V. M. (2021) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-87193-2_4 · Cited by 1,248
Digital pathology and artificial intelligence
Niazi, M. K. K., Parwani, A. V., & Gurcan, M. N. (2019) · The Lancet Oncology · doi:10.1016/s1470-2045(19)30154-8 · Cited by 1,232
“In [17], the authors created a well annotated database consisting of 30 WSI of digitized tissue samples from several organs.”
BackgroundInfluentialWang, H., Cao, P., Wang, J., & Zaiane, O. R. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i3.20144 · Cited by 1,111
Nuclei Segmentation with Recurrent Residual Convolutional Neural Networks based U-Net (R2U-Net)
Alom, M. Z., Yakopcic, C., Taha, T. M., & Asari, V. K. (2018) · NAECON 2018 - IEEE National Aerospace and Electronics Conference · doi:10.1109/naecon.2018.8556686 · Cited by 1,020
Machine Learning Methods for Histopathological Image Analysis
Komura, D., & Ishikawa, S. (2018) · Computational and Structural Biotechnology Journal · doi:10.1016/j.csbj.2018.01.001 · Cited by 937
Redefining Radiology: A Review of Artificial Intelligence Integration in Medical Imaging
Najjar, R. (2023) · Diagnostics · doi:10.3390/diagnostics13172760 · Cited by 886
Chen, R. J., Lu, M. Y., Wang, J., Williamson, D. F. K., Rodig, S. J., Lindeman, N. I., & Mahmood, F. (2022) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2020.3021387 · Cited by 729
Segmentation of Nuclei in Histopathology Images by Deep Regression of the Distance Map
Naylor, P., Laé, M., Reyal, F., & Walter, T. (2019) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2018.2865709 · Cited by 685
A Multi-Organ Nucleus Segmentation Challenge
Kumar, N., Verma, R., Anand, D., Zhou, Y., Onder, O. F., Tsougenis, E., Chen, H., Heng, P.-A., Li, J., Hu, Z., et al. (2020) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2019.2947628 · Cited by 553
Self-citationAdvances in medical image analysis with vision Transformers: A comprehensive review
Azad, R., Kazerouni, A., Heidari, M., Aghdam, E. K., Molaei, A., Jia, Y., Jose, A., Roy, R., & Merhof, D. (2024) · Medical Image Analysis · doi:10.1016/j.media.2023.103000 · Cited by 485
Transformers in medical image analysis
He, K., Gan, C., Li, Z., Rekik, I., Yin, Z., Ji, W., Gao, Y., Wang, Q., Zhang, J., & Shen, D. (2023) · Intelligent Medicine · doi:10.1016/j.imed.2022.07.002 · Cited by 475
Artificial intelligence (AI) and big data in cancer and precision oncology
Dlamini, Z., Francies, F. Z., Hull, R., & Marima, R. (2020) · Computational and Structural Biotechnology Journal · doi:10.1016/j.csbj.2020.08.019 · Cited by 398
Salvi, M., Acharya, U. R., Molinari, F., & Meiburger, K. M. (2021) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2020.104129 · Cited by 386
Artificial intelligence for digital and computational pathology
Song, A. H., Jaume, G., Williamson, D. F. K., Lu, M. Y., Vaidya, A., Miller, T. R., & Mahmood, F. (2023) · Nature Reviews Bioengineering · doi:10.1038/s44222-023-00096-8 · Cited by 356
Deep Adversarial Training for Multi-Organ Nuclei Segmentation in Histopathology Images
Mahmood, F., Borders, D., Chen, R. J., Mckay, G. N., Salimian, K. J., Baras, A., & Durr, N. J. (2020) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2019.2927182 · Cited by 340
CellViT: Vision Transformers for precise cell segmentation and classification
Hörst, F., Rempe, M., Heine, L., Seibold, C., Keyl, J., Baldini, G., Ugurel, S., Siveke, J., Grünwald, B., Egger, J., et al. (2024) · Medical Image Analysis · doi:10.1016/j.media.2024.103143 · Cited by 338
RIC-Unet: An Improved Neural Network Based on Unet for Nuclei Segmentation in Histology Images
Zeng, Z., Xie, W., Zhang, Y., & Lu, Y. (2019) · IEEE Access · doi:10.1109/access.2019.2896920 · Cited by 280
Translational AI and deep learning in diagnostic pathology
Serag, A., Ion-Margineanu, A., Qureshi, H., McMillan, R., Saint Martin, M.-J., Diamond, J., O'Reilly, P., & Hamilton, P. (2019) · Frontiers in Medicine · doi:10.3389/fmed.2019.00185 · Cited by 274
“The third challenge was the Multi-organ nuclei segmentation (MoNuSeg) challenge and was based on a public dataset (56) containing 30 images and around 22,000 nuclear boundary annotations from multiple organs.”
MethodRetCCL: Clustering-guided contrastive learning for whole-slide image retrieval
Wang, X., Du, Y., Yang, S., Zhang, J., Wang, M., Zhang, J., Yang, W., Huang, J., & Han, X. (2023) · Medical Image Analysis · doi:10.1016/j.media.2022.102645 · Cited by 218
SegDiff: Image Segmentation with Diffusion Probabilistic Models
Amit, T., Shaharbany, T., Nachmani, E., & Wolf, L. (2021) · arXiv · doi:10.48550/arxiv.2112.00390 · Cited by 179
“The MoNuSeg dataset [25, 26] contains a training set with 30 microscopic images from seven organs, with annotations of 21,623 individual nuclei.”
MethodNuClick: A deep learning framework for interactive segmentation of microscopic images
Alemi Koohbanani, N., Jahanifar, M., Zamani Tajadin, N., & Rajpoot, N. (2020) · Medical Image Analysis · doi:10.1016/j.media.2020.101771 · Cited by 147
Concept attribution: explaining cnn decisions to physicians
M., G., V., A., S., M.-M., & H., M. (2020) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2020.103865 · Cited by 95
Device-Circuit-Architecture Co-Exploration for Computing-in-Memory Neural Accelerators
Jiang, W., Lou, Q., Yan, Z., Yang, L., Hu, J., Hu, X. S., & Shi, Y. (2021) · IEEE Transactions on Computers · doi:10.1109/tc.2020.2991575 · Cited by 96
Histographs: graphs in histopathology
Anand, D., Gadiya, S., & Sethi, A. (2020) · Medical Imaging 2020: Digital Pathology · doi:10.1117/12.2550114 · Cited by 53
“To robustly detect all nuclei – including epithelial, stroma, inflammatory – we trained a fully convolutional neural network by augmenting a large annotated multi-organ dataset, 6 such that it was robust to change in organs, magnification, disease states, and stain appearance.”
MethodSelf-citationMulti-modality artificial intelligence in digital pathology
Qiao, Y., Zhao, L., Luo, C., Luo, Y., Wu, Y., Li, S., Bu, D., & Zhao, Y. (2022) · Briefings in Bioinformatics · doi:10.1093/bib/bbac367 · Cited by 44
One label is all you need: Interpretable AI-enhanced histopathology for oncology
Tavolara, T. E., Su, Z., Gurcan, M. N., & Niazi, M. K. K. (2023) · Seminars in Cancer Biology · doi:10.1016/j.semcancer.2023.09.006 · Cited by 28
A review of current systems for annotation of cell and tissue images in digital pathology
Korzynska, A., Roszkowiak, L., Zak, J., & Siemion, K. (2021) · Biocybernetics and Biomedical Engineering · doi:10.1016/j.bbe.2021.04.012 · Cited by 26
Tian, Z., He, Y., Sun, L., Li, Y., & Du, S. (2024) · Neurocomputing · doi:10.1016/j.neucom.2024.128184 · Cited by 5
Metadata
- Authors
- Kumar, N., Verma, R., Sharma, S., Bhargava, S., Vahadane, A., & Sethi, A.
- Venue
- IEEE Transactions on Medical Imaging
- Published
- 2017-07
- Volume
- 36
- Issue
- 7
- Pages
- 1550-1560
- ISSN
- 0278-0062 (ISSN-L)
- 1558-254X
- OpenAlex
- W2592905743
- Cited by
- 1,126
- References
- 44
- FWCI
- 34.28
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.