The DOI matches its Crossref record; 55 of the 55 references it cites were found in a registry or an index.
STC: A Simple to Complex Framework for Weakly-Supervised Semantic Segmentation
Open accessAbstract
Recently, significant improvement has been made on semantic object segmentation due to the development of deep convolutional neural networks (DCNNs). Training such a DCNN usually relies on a large number of images with pixel-level segmentation masks, and annotating these images is very costly in terms of both finance and human effort. In this paper, we propose a simple to complex (STC) framework in which only image-level annotations are utilized to learn DCNNs for semantic segmentation. Specifically, we first train an initial segmentation network called Initial-DCNN with the saliency maps of simple images (i.e., those with a single category of major object(s) and clean background). These saliency maps can be automatically obtained by existing bottom-up salient object detection techniques, where no supervision information is needed. Then, a better network called Enhanced-DCNN is learned with supervision from the predicted segmentation masks of simple images based on the Initial-DCNN as well as the image-level annotations. Finally, more pixel-level segmentation masks of complex images (two or more categories of objects with cluttered background), which are inferred by using Enhanced-DCNN and image-level annotations, are utilized as the supervision information to learn the Powerful-DCNN for semantic segmentation. Our method utilizes 40K simple images from Flickr.com and 10K complex images from PASCAL VOC for step-wisely boosting the segmentation network. Extensive experimental results on PASCAL VOC 2012 segmentation benchmark well demonstrate the superiority of the proposed STC framework compared with other state-of-the-arts.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
Microsoft COCO: Common Objects in Context
Lin, T.-Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollár, P., & Zitnick, C. L. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10602-1_48 · Cited by 45,460
Fully convolutional networks for semantic segmentation
Long, J., Shelhamer, E., & Darrell, T. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298965 · Cited by 38,834
Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation
Girshick, R., Donahue, J., Darrell, T., & Malik, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.81 · Cited by 32,684
Girshick, R. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.169 · Cited by 28,105
A model of saliency-based visual attention for rapid scene analysis
Itti, L., Koch, C., & Niebur, E. (1998) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.730558 · Cited by 11,271
Caffe: Convolutional Architecture for Fast Feature Embedding
Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., & Darrell, T. (2014) · Proceedings of the 22nd ACM international conference on Multimedia · doi:10.1145/2647868.2654889 · Cited by 11,077
Cited by
The Cityscapes Dataset for Semantic Urban Scene Understanding
Cordts, M., Omran, M., Ramos, S., Rehfeld, T., Enzweiler, M., Benenson, R., Franke, U., Roth, S., & Schiele, B. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.350 · Cited by 12,433
Structure-Measure: A New Way to Evaluate Foreground Maps
Fan, D.-P., Cheng, M.-M., Liu, Y., Li, T., & Borji, A. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.487 · Cited by 2,092
Self-citationCSRNet: Dilated Convolutional Neural Networks for Understanding the Highly Congested Scenes
Li, Y., Zhang, X., & Chen, D. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00120 · Cited by 1,698
Deeply Supervised Salient Object Detection with Short Connections
Hou, Q., Cheng, M.-M., Hu, X., Borji, A., Tu, Z., & Torr, P. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.563 · Cited by 1,143
Self-citationThe Cityscapes Dataset for Semantic Urban Scene Understanding
Cordts, M., Omran, M., Ramos, S., Rehfeld, T., Enzweiler, M., Benenson, R., Franke, U., Roth, S., & Schiele, B. (2016) · arXiv · doi:10.48550/arxiv.1604.01685 · Cited by 1,174
A review of semantic segmentation using deep neural networks
Guo, Y., Liu, Y., Georgiou, T., & Lew, M. S. (2018) · International Journal of Multimedia Information Retrieval · doi:10.1007/s13735-017-0141-z · Cited by 882
Wei, Y., Feng, J., Liang, X., Cheng, M.-M., Zhao, Y., & Yan, S. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.687 · Cited by 863
Self-citationRicher Convolutional Features for Edge Detection
Liu, Y., Cheng, M.-M., Hu, X., Wang, K., & Bai, X. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.622 · Cited by 780
Self-citationSelf-Supervised Equivariant Attention Mechanism for Weakly Supervised Semantic Segmentation
Wang, Y., Zhang, J., Kan, M., Shan, S., & Chen, X. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01229 · Cited by 770
Simple Does It: Weakly Supervised Instance and Semantic Segmentation
Khoreva, A., Benenson, R., Hosang, J., Hein, M., & Schiele, B. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.181 · Cited by 764
Richer Convolutional Features for Edge Detection
Liu, Y., Cheng, M.-M., Hu, X., Bian, J.-W., Zhang, L., Bai, X., & Tang, J. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2878849 · Cited by 751
Self-citationArtificial intelligence for the metaverse: A survey
Huynh-The, T., Pham, Q.-V., Pham, X.-Q., Nguyen, T. T., Han, Z., & Kim, D.-S. (2023) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2022.105581 · Cited by 710
A Survey on Curriculum Learning
Wang, X., Chen, Y., & Zhu, W. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3069908 · Cited by 692
Self-citationReverse Attention for Salient Object Detection
Chen, S., Tan, X., Wang, B., & Hu, X. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01240-3_15 · Cited by 684
Deeply Supervised Salient Object Detection with Short Connections
Hou, Q., Cheng, M.-M., Hu, X., Borji, A., Tu, Z., & Torr, P. H. S. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2815688 · Cited by 676
Self-citationWei, Y., Xiao, H., Shi, H., Jie, Z., Feng, J., & Huang, T. S. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00759 · Cited by 627
Self-citationA Brief Survey on Semantic Segmentation with Deep Learning
Hao, S., Zhou, Y., & Guo, Y. (2020) · Neurocomputing · doi:10.1016/j.neucom.2019.11.118 · Cited by 596
Adversarial Complementary Learning for Weakly Supervised Object Localization
Zhang, X., Wei, Y., Feng, J., Yang, Y., & Huang, T. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00144 · Cited by 592
Self-citationWeakly-Supervised Semantic Segmentation Network with Deep Seeded Region Growing
Huang, Z., Wang, X., Wang, J., Liu, W., & Wang, J. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00733 · Cited by 591
SG-One: Similarity Guidance Network for One-Shot Semantic Segmentation
Zhang, X., Wei, Y., Yang, Y., & Huang, T. S. (2020) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2020.2992433 · Cited by 570
Self-citationSurvey on semantic segmentation using deep learning techniques
Lateef, F., & Ruichek, Y. (2019) · Neurocomputing · doi:10.1016/j.neucom.2019.02.003 · Cited by 559
Tell Me Where to Look: Guided Attention Inference Network
Li, K., Wu, Z., Peng, K.-C., Ernst, J., & Fu, Y. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00960 · Cited by 535
FickleNet: Weakly and Semi-Supervised Semantic Image Segmentation Using Stochastic Inference
Lee, J., Kim, E., Lee, S., Lee, J., & Yoon, S. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00541 · Cited by 457
Contrast Prior and Fluid Pyramid Integration for RGBD Salient Object Detection
Zhao, J.-X., Cao, Y., Fan, D.-P., Cheng, M.-M., Li, X.-Y., & Zhang, L. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00405 · Cited by 412
Self-citationSalient Object Detection via Integrity Learning
Zhuge, M., Fan, D.-P., Liu, N., Zhang, D., Xu, D., & Shao, L. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3179526 · Cited by 403
Attention-Based Dropout Layer for Weakly Supervised Object Localization
Choe, J., & Shim, H. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00232 · Cited by 388
Salient Objects in Clutter: Bringing Salient Object Detection to the Foreground
Fan, D.-P., Cheng, M.-M., Liu, J.-J., Gao, S.-H., Hou, Q., & Borji, A. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01267-0_12 · Cited by 347
Self-citationW-TALC: Weakly-Supervised Temporal Activity Localization and Classification
Paul, S., Roy, S., & Roy-Chowdhury, A. K. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01225-0_35 · Cited by 340
Learning Selective Self-Mutual Attention for RGB-D Saliency Detection
Liu, N., Zhang, N., & Han, J. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01377 · Cited by 335
Weakly-Supervised Semantic Segmentation by Iteratively Mining Common Object Features
Wang, X., You, S., Li, X., & Ma, H. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00147 · Cited by 326
Recent advances on image edge detection: A comprehensive review
Jing, J., Liu, S., Wang, G., Zhang, W., & Sun, C. (2022) · Neurocomputing · doi:10.1016/j.neucom.2022.06.083 · Cited by 298
Weakly Supervised Instance Segmentation Using Class Peak Response
Zhou, Y., Zhu, Y., Ye, Q., Qiu, Q., & Jiao, J. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00399 · Cited by 296
Mining Cross-Image Semantics for Weakly Supervised Semantic Segmentation
Sun, G., Wang, W., Dai, J., & Van Gool, L. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58536-5_21 · Cited by 288
Image Data Augmentation Approaches: A Comprehensive Survey and Future Directions
Kumar, T., Brennan, R., Mileo, A., & Bendechache, M. (2024) · IEEE Access · doi:10.1109/access.2024.3470122 · Cited by 287
Constrained-CNN losses for weakly supervised segmentation
Kervadec, H., Dolz, J., Tang, M., Granger, E., Boykov, Y., & Ben Ayed, I. (2019) · Medical Image Analysis · doi:10.1016/j.media.2019.02.009 · Cited by 278
Single-Stage Semantic Segmentation From Image Labels
Araslanov, N., & Roth, S. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00431 · Cited by 275
Devil in the Details: Towards Accurate Single and Multiple Human Parsing
Ruan, T., Liu, T., Huang, Z., Wei, Y., Wei, S., & Zhao, Y. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33014814 · Cited by 268
Self-citationLee, S., Lee, M., Lee, J., & Shim, H. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00545 · Cited by 263
Ji, Y., Zhang, H., Zhang, Z., & Liu, M. (2021) · Information Sciences · doi:10.1016/j.ins.2020.09.003 · Cited by 262
Integral Object Mining via Online Attention Accumulation
Jiang, P.-T., Hou, Q., Cao, Y., Cheng, M.-M., Wei, Y., & Xiong, H. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00216 · Cited by 254
Self-citationWeakly- and Semi-supervised Panoptic Segmentation
Li, Q., Arnab, A., & Torr, P. H. S. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01267-0_7 · Cited by 171
Robust Object Co-Segmentation Using Background Prior
Han, J., Quan, R., Zhang, D., & Nie, F. (2018) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2781424 · Cited by 169
Naive-Student: Leveraging Semi-Supervised Learning in Video Sequences for Urban Scene Segmentation
Chen, L.-C., Lopes, R. G., Cheng, B., Collins, M. D., Cubuk, E. D., Zoph, B., Adam, H., & Shlens, J. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58545-7_40 · Cited by 165
Interactive Object Segmentation With Inside-Outside Guidance
Zhang, S., Liew, J. H., Wei, Y., Wei, S., & Zhao, Y. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01225 · Cited by 142
Self-citationSelf Paced Deep Learning for Weakly Supervised Object Detection
Sangineto, E., Nabi, M., Culibrk, D., & Sebe, N. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2804907 · Cited by 114
Synthesizing Supervision for Learning Deep Saliency Network without Human Annotation
Zhang, D., Han, J., Zhang, Y., & Xu, D. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2900649 · Cited by 118
Large-Scale Unsupervised Semantic Segmentation
Gao, S., Li, Z.-Y., Yang, M.-H., Cheng, M.-M., Han, J., & Torr, P. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3218275 · Cited by 88
Self-citationDigital Twin-based Anomaly Detection with Curriculum Learning in Cyber-physical Systems
Xu, Q., Ali, S., & Yue, T. (2023) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3582571 · Cited by 49
Visual Semantic Information Pursuit: A Survey
Liu, D., Bober, M., & Kittler, J. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2950025 · Cited by 39
Metadata
- Authors
- Wei, Y., Liang, X., Chen, Y., Shen, X., Cheng, M.-M., Feng, J., Zhao, Y., & Yan, S.
- Venue
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- Published
- 2017-11-01
- Volume
- 39
- Issue
- 11
- Pages
- 2314-2320
- ISSN
- 0162-8828 (ISSN-L)
- 2160-9292
- 1939-3539
- OpenAlex
- W2133515615
- Cited by
- 576
- References
- 55
- FWCI
- 43.58
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.