The DOI matches its Crossref record; 47 of the 47 references it cites were found in a registry or an index.
Recurrent Saliency Transformation Network: Incorporating Multi-stage Visual Cues for Small Organ Segmentation
Open accessAbstract
We aim at segmenting small organs (e.g., the pancreas) from abdominal CT scans. As the target often occupies a relatively small region in the input image, deep neural networks can be easily confused by the complex and variable background. To alleviate this, researchers proposed a coarse-to-fine approach [46], which used prediction from the first (coarse) stage to indicate a smaller input region for the second (fine) stage. Despite its effectiveness, this algorithm dealt with two stages individually, which lacked optimizing a global energy function, and limited its ability to incorporate multi-stage visual cues. Missing contextual information led to unsatisfying convergence in iterations, and that the fine stage sometimes produced even lower segmentation accuracy than the coarse stage. This paper presents a Recurrent Saliency Transformation Network. The key innovation is a saliency transformation module, which repeatedly converts the segmentation probability map from the previous iteration as spatial weights and applies these weights to the current iteration. This brings us two-fold benefits. In training, it allows joint optimization over the deep networks dealing with different input scales. In testing, it propagates multi-stage visual information throughout iterations to improve segmentation accuracy. Experiments in the NIH pancreas segmentation dataset demonstrate the state-of-the-art accuracy, which outperforms the previous best by an average of over 2%. Much higher accuracies are also reported on several small organs in a larger dataset collected by ourselves. In addition, our approach enjoys better convergence properties, making it more efficient and reliable in practice.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
U-Net: Convolutional Networks for Biomedical Image Segmentation
Ronneberger, O., Fischer, P., & Brox, T. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24574-4_28 · Cited by 99,404
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2577031 · Cited by 73,472
Fully convolutional networks for semantic segmentation
Long, J., Shelhamer, E., & Darrell, T. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298965 · Cited by 38,834
Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation
Girshick, R., Donahue, J., Darrell, T., & Malik, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.81 · Cited by 32,684
The pascal visual object classes (VOC) challenge
Everingham, M., Van Gool, L., Williams, C. K. I., Winn, J., & Zisserman, A. (2010) · International Journal of Computer Vision · doi:10.1007/s11263-009-0275-4 · Cited by 19,599
V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentation
Milletari, F., Navab, N., & Ahmadi, S.-A. (2016) · 2016 Fourth International Conference on 3D Vision (3DV) · doi:10.1109/3dv.2016.79 · Cited by 11,931
Speech recognition with deep recurrent neural networks
Graves, A., Mohamed, A.-R., & Hinton, G. (2013) · 2013 IEEE International Conference on Acoustics, Speech and Signal Processing · doi:10.1109/icassp.2013.6638947 · Cited by 8,893
Semantic Image Segmentation with Deep Convolutional Nets and Fully Connected CRFs
Chen, L.-C., Papandreou, G., Kokkinos, I., Murphy, K., & Yuille, A. L. (2014) · arXiv · doi:10.48550/arxiv.1412.7062 · Cited by 4,213
Self-citationEfficient multi-scale 3D CNN with fully connected CRF for accurate brain lesion segmentation
Kamnitsas, K., Ledig, C., Newcombe, V. F. J., Simpson, J. P., Kane, A. D., Menon, D. K., Rueckert, D., & Glocker, B. (2017) · Medical Image Analysis · doi:10.1016/j.media.2016.10.004 · Cited by 3,498 · cited 2×
“Our approach can be applied to detecting the lesion areas of an organ [17][45], or a specific type of vision problems such as hair segmentation in a face [28], or detecting the targets which are consistently small in the input images [38].”
MethodRefineNet: Multi-path Refinement Networks for High-Resolution Semantic Segmentation
Lin, G., Milan, A., Shen, C., & Reid, I. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.549 · Cited by 3,287
Brain tumor segmentation with Deep Neural Networks
Havaei, M., Davy, A., Warde-Farley, D., Biard, A., Courville, A., Bengio, Y., Pal, C., Jodoin, P.-M., & Larochelle, H. (2017) · Medical Image Analysis · doi:10.1016/j.media.2016.05.004 · Cited by 3,278
Attention to Scale: Scale-Aware Semantic Image Segmentation
Chen, L.-C., Yang, Y., Wang, J., Xu, W., & Yuille, A. L. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.396 · Cited by 1,377
Self-citation(2011) · Cited by 1,192
Comparison and evaluation of methods for liver segmentation from CT datasets
Heimann, T., van Ginneken, B., Styner, M. A., Arzhaeva, Y., Aurich, V., Bauer, C., Beck, A., Becker, C., Beichel, R., Bekes, G., et al. (2009) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2009.2013851 · Cited by 1,135
Recurrent convolutional neural network for object recognition
Liang, M., & Hu, X. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298958 · Cited by 976
Automatic lung segmentation for accurate quantitation of volumetric X-ray CT images
Hu, S., Hoffman, E. A., & Reinhardt, J. M. (2001) · IEEE Transactions on Medical Imaging · doi:10.1109/42.929615 · Cited by 940
DeepOrgan: Multi-level Deep Convolutional Networks for Automated Pancreas Segmentation
Roth, H. R., Lu, L., Farag, A., Shin, H.-C., Liu, J., Turkbey, E. B., & Summers, R. M. (2015) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-24553-9_68 · Cited by 784
Deep Learning for Identifying Metastatic Breast Cancer
Wang, D., Khosla, A., Gargeya, R., Irshad, H., & Beck, A. H. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1606.05718 · Cited by 756
Recurrent Convolutional Neural Networks for Scene Labeling
Pinheiro, P. O., & Collobert, R. (2014) · Infoscience (Ecole Polytechnique Fédérale de Lausanne) · Cited by 621
Brosch, T., Tang, L. Y. W., Yoo, Y., Li, D. K. B., Traboulsee, A., & Tam, R. (2016) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2016.2528821 · Cited by 460
3D Deeply Supervised Network for Automatic Liver Segmentation from CT Volumes
Dou, Q., Chen, H., Jin, Y., Yu, L., Qin, J., & Heng, P.-A. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46723-8_18 · Cited by 344
Yu, L., Yang, X., Chen, H., Qin, J., & Heng, P. A. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.10510 · Cited by 341
Roth, H. R., Lu, L., Lay, N., Harrison, A. P., Farag, A., Sohn, A., & Summers, R. M. (2018) · Medical Image Analysis · doi:10.1016/j.media.2018.01.006 · Cited by 325
Instance-Level Salient Object Segmentation
Li, G., Xie, Y., Lin, L., & Yu, Y. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.34 · Cited by 281
A Fixed-Point Model for Pancreas Segmentation in Abdominal CT Scans
Zhou, Y., Xie, L., Shen, W., Wang, Y., Fishman, E. K., & Yuille, A. L. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-66182-7_79 · Cited by 275
Self-citationMitosis Detection in Breast Cancer Histology Images via Deep Cascaded Networks
Chen, H., Dou, Q., Wang, X., Qin, J., & Heng, P. (2016) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v30i1.10140 · Cited by 255
Recurrent Attentional Networks for Saliency Detection
Kuen, J., Wang, Z., & Wang, G. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.399 · Cited by 231
Zoom Better to See Clearer: Human and Object Parsing with Hierarchical Auto-Zoom Net
Xia, F., Wang, P., Chen, L.-C., & Yuille, A. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-46454-1_39 · Cited by 157
Self-citationComputer-Aided Kidney Segmentation on Abdominal CT Images
Lin, D.-T., Lei, C., & Hung, S.-W. (2006) · IEEE Transactions on Information Technology in Biomedicine · doi:10.1109/titb.2005.855561 · Cited by 154
Handbook of Pattern Recognition and Computer Vision
Chen, C. H. (2015) · WORLD SCIENTIFIC eBooks · doi:10.1142/9503 · Cited by 148
Spatial Aggregation of Holistically-Nested Networks for Automated Pancreas Segmentation
Roth, H. R., Lü, L., Farag, A. A., Sohn, A., & Summers, R. M. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-46723-8_52 · Cited by 144
Cai, J., Lü, L., Xie, Y., Xing, F., & Yang, L. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1707.04912 · Cited by 141
Hierarchical, learning-based automatic liver segmentation
Ling, H., Zhou, S., Zheng, Y., Georgescu, B., Suehling, M., & Comaniciu, D. (2008) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2008.4587393 · Cited by 140
Linguraru, M. G., Sandberg, J. K., Li, Z., Shah, F. A., & Summers, R. M. (2010) · Medical Physics · doi:10.1118/1.3284530 · Cited by 138
Multi-organ Segmentation Based on Spatially-Divided Probabilistic Atlas from 3D Abdominal CT Images
Chu, C., Oda, M., Kitasaka, T., Misawa, K., Fujiwara, M., Hayashi, Y., Nimura, Y., Rueckert, D., & Mori, K. (2013) · Lecture notes in computer science · doi:10.1007/978-3-642-40763-5_21 · Cited by 115
Deep Supervision for Pancreatic Cyst Segmentation in Abdominal CT Scans
Zhou, Y., Xie, L., Fishman, E. K., & Yuille, A. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-66179-7_26 · Cited by 106
Self-citationLuo, L., Li, H., & Rusinkiewicz, S. M. (2013) · ACM Transactions on Graphics · doi:10.1145/2461912.2462026 · Cited by 102
Dense Volume-to-Volume Vascular Boundary Detection
Merkow, J., Marsden, A. L., Kriegman, D. J., & Zhuowen Tu, A. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-46726-9_43 · Cited by 94
Graph Cuts Framework for Kidney Segmentation with Prior Shape Constraints
Ali, A., Farag, A. A., & El-Baz, A. S. (2007) · Springer eBooks · doi:10.1007/978-3-540-75757-3_47 · Cited by 93
Coarse-to-Fine Stacked Fully Convolutional Nets for lymph node segmentation in ultrasound images
Zhang, Y., Ying, M. T. C., Yang, L., Ahuja, A. T., & Chen, D. Z. (2016) · IEEE International Conference on Bioinformatics and Biomedicine (BIBM) · doi:10.1109/bibm.2016.7822557 · Cited by 81
Object Recognition with and without Objects
Zhu, Z., Xie, L., & Yuille, A. (2017) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2017/505 · Cited by 69
Self-citationGeodesic Patch-Based Segmentation
Wang, Z., Bhatia, K. K., Glocker, B., de Marvao, A., Dawes, T. J. W., Misawa, K., Mori, K., & Rueckert, D. (2014) · Lecture notes in computer science · doi:10.1007/978-3-319-10404-1_83 · Cited by 60
Learning to Localize Little Landmarks
Singh, S., Hoiem, D., & Forsyth, D. A. (2016) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2016.35 · Cited by 18
Deep Learning for Medical Image Segmentation
Sarkar, K., & Li, B. (2022) · IGI Global eBooks · doi:10.4018/978-1-6684-7544-7.ch044 · Cited by 2
Cited by
Attention U-Net: Learning Where to Look for the Pancreas
Oktay, O., Schlemper, J., Folgoc, L. L., Lee, M., Heinrich, M., Misawa, K., Mori, K., McDonagh, S., Hammerla, N. Y., Kainz, B., et al. (2018) · arXiv · doi:10.48550/arxiv.1804.03999 · Cited by 5,458
TransUNet: Transformers Make Strong Encoders for Medical Image Segmentation
Chen, J., Lu, Y., Yu, Q., Luo, X., Adeli, E., Wang, Y., Lu, L., Yuille, A. L., & Zhou, Y. (2021) · arXiv · doi:10.48550/arxiv.2102.04306 · Cited by 4,206
“magnetic resonance (MR) [17], organ segmentation from computed tomography (CT) [7, 9, 18,20] and polyp segmentation [21] from colonoscopy videos.”
BackgroundMethodSelf-citationAttention gated networks: learning to leverage salient regions in medical images
Schlemper, J., Oktay, O., Schaap, M., Heinrich, M., Kainz, B., Glocker, B., & Rueckert, D. (2019) · Medical Image Analysis · doi:10.1016/j.media.2019.01.012 · Cited by 2,014
Chen, J., Mei, J., Li, X., Lu, Y., Yu, Q., Wei, Q., Luo, X., Xie, Y., Adeli, E., Wang, Y., et al. (2024) · Medical Image Analysis · doi:10.1016/j.media.2024.103280 · Cited by 1,365
Self-citationEmbracing imperfect datasets: A review of deep learning solutions for medical image segmentation
Tajbakhsh, N., Jeyaseelan, L., Li, Q., Chiang, J. N., Wu, Z., & Ding, X. (2020) · Medical Image Analysis · doi:10.1016/j.media.2020.101693 · Cited by 1,095
Metadata
- Authors
- Yu, Q., Xie, L., Wang, Y., Zhou, Y., Fishman, E. K., & Yuille, A. L.
- Venue
- 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition
- Publisher
- IEEE
- Published
- 2018-06
- Pages
- 8280-8289
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W2771252144
- Cited by
- 253
- References
- 47
- FWCI
- 10.08
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.