The DOI matches its Crossref record; 52 of the 52 references it cites were found in a registry or an index.
Railroad is not a Train: Saliency as Pseudo-pixel Supervision for Weakly Supervised Semantic Segmentation
Open accessAbstract
Existing studies in weakly-supervised semantic segmentation (WSSS) using image-level weak supervision have several limitations: sparse object coverage, inaccurate object boundaries, and co-occurring pixels from non-target objects. To overcome these challenges, we propose a novel framework, namely Explicit Pseudo-pixel Supervision (EPS), which learns from pixel-level feedback by combining two weak supervisions; the image-level label provides the object identity via the localization map and the saliency map from the off-the-shelf saliency detection model offers rich boundaries. We devise a joint training strategy to fully utilize the complementary relationship between both information. Our method can obtain accurate object boundaries and discard co-occurring pixels, thereby significantly improving the quality of pseudo-masks. Experimental results show that the proposed method remarkably outperforms existing methods by resolving key challenges of WSSS and achieves the new state-of-the-art performance on both PASCAL VOC 2012 and MS COCO 2014 datasets. The code is available at https://github.com/halbielee/EPS.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
Microsoft COCO: Common Objects in Context
Lin, T.-Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollár, P., & Zitnick, C. L. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10602-1_48 · Cited by 45,460
Chen, L.-C., Papandreou, G., Kokkinos, I., Murphy, K., & Yuille, A. L. (2016) · arXiv · doi:10.48550/arxiv.1606.00915 · Cited by 22,392
Chen, L.-C., Papandreou, G., Kokkinos, I., Murphy, K., & Yuille, A. L. (2018) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2699184 · Cited by 22,392
Learning Deep Features for Discriminative Localization
Zhou, B., Khosla, A., Lapedriza, A., Oliva, A., & Torralba, A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.319 · Cited by 11,428
The Pascal Visual Object Classes Challenge: A Retrospective
Everingham, M., Eslami, S. M. A., Van Gool, L., Williams, C. K. I., Winn, J., & Zisserman, A. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-014-0733-5 · Cited by 7,139
Semantic Image Segmentation with Deep Convolutional Nets and Fully Connected CRFs
Chen, L.-C., Papandreou, G., Kokkinos, I., Murphy, K., & Yuille, A. L. (2014) · arXiv · doi:10.48550/arxiv.1412.7062 · Cited by 4,213
Efficient Inference in Fully Connected CRFs with Gaussian Edge Potentials
Krähenbühl, P., & Koltun, V. (2012) · arXiv · doi:10.48550/arxiv.1210.5644 · Cited by 2,908
Semantic contours from inverse detectors
Hariharan, B., Arbelaez, P., Bourdev, L., Maji, S., & Malik, J. (2011) · 2011 International Conference on Computer Vision · doi:10.1109/iccv.2011.6126343 · Cited by 1,624
Wider or Deeper: Revisiting the ResNet Model for Visual Recognition
Wu, Z., Shen, C., & van den Hengel, A. (2019) · Pattern Recognition · doi:10.1016/j.patcog.2019.01.006 · Cited by 1,589
The Role of Context for Object Detection and Semantic Segmentation in the Wild
Mottaghi, R., Chen, X., Liu, X., Cho, N.-G., Lee, S.-W., Fidler, S., Urtasun, R., & Yuille, A. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.119 · Cited by 1,438
Self-citationLearning to Detect Salient Objects with Image-Level Supervision
Wang, L., Lu, H., Wang, Y., Feng, M., Wang, D., Yin, B., & Ruan, X. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.404 · Cited by 1,265
Deeply Supervised Salient Object Detection with Short Connections
Hou, Q., Cheng, M.-M., Hu, X., Borji, A., Tu, Z., & Torr, P. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.563 · Cited by 1,143
ScribbleSup: Scribble-Supervised Convolutional Networks for Semantic Segmentation
Lin, D., Dai, J., Jia, J., He, K., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.344 · Cited by 1,129 · cited 1×
“, image-level labels [36, 37], scribbles [29], or bounding boxes [22]) and aims at achieving competitive performances to the fully-supervised model, which requires pixel-level labels.”
BackgroundAhn, J., & Kwak, S. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00523 · Cited by 872
Wei, Y., Feng, J., Liang, X., Cheng, M.-M., Zhao, Y., & Yan, S. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.687 · Cited by 863
Pyramid Feature Attention Network for Saliency Detection
Zhao, T., & Wu, X. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00320 · Cited by 772
Self-Supervised Equivariant Attention Mechanism for Weakly Supervised Semantic Segmentation
Wang, Y., Zhang, J., Kan, M., Shan, S., & Chen, X. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01229 · Cited by 770
Simple Does It: Weakly Supervised Instance and Semantic Segmentation
Khoreva, A., Benenson, R., Hosang, J., Hein, M., & Schiele, B. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.181 · Cited by 764
Seed, Expand and Constrain: Three Principles for Weakly-Supervised Image Segmentation
Kolesnikov, A., & Lampert, C. H. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46493-0_42 · Cited by 719
From image-level to pixel-level labeling with Convolutional Networks
Pinheiro, P. O., & Collobert, R. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298780 · Cited by 673
Wei, Y., Xiao, H., Shi, H., Jie, Z., Feng, J., & Huang, T. S. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00759 · Cited by 627
Constrained Convolutional Neural Networks for Weakly Supervised Segmentation
Pathak, D., Krahenbuhl, P., & Darrell, T. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.209 · Cited by 617
Weakly Supervised Learning of Instance Segmentation With Inter-Pixel Relations
Ahn, J., Cho, S., & Kwak, S. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00231 · Cited by 613
Weakly-Supervised Semantic Segmentation Network with Deep Seeded Region Growing
Huang, Z., Wang, X., Wang, J., Liu, W., & Wang, J. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00733 · Cited by 591
STC: A Simple to Complex Framework for Weakly-Supervised Semantic Segmentation
Wei, Y., Liang, X., Chen, Y., Shen, X., Cheng, M.-M., Feng, J., Zhao, Y., & Yan, S. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2636150 · Cited by 576
Tell Me Where to Look: Guided Attention Inference Network
Li, K., Wu, Z., Peng, K.-C., Ernst, J., & Fu, Y. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00960 · Cited by 535
FickleNet: Weakly and Semi-Supervised Semantic Image Segmentation Using Stochastic Inference
Lee, J., Kim, E., Lee, S., Lee, J., & Yoon, S. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00541 · Cited by 457
Self-citationWeakly-Supervised Semantic Segmentation by Iteratively Mining Common Object Features
Wang, X., You, S., Li, X., & Ma, H. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00147 · Cited by 326
Weakly-Supervised Semantic Segmentation via Sub-Category Exploration
Chang, Y.-T., Wang, Q., Hung, W.-C., Piramuthu, R., Tsai, Y.-H., & Yang, M.-H. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00901 · Cited by 318
Mining Cross-Image Semantics for Weakly Supervised Semantic Segmentation
Sun, G., Wang, W., Dai, J., & Van Gool, L. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58536-5_21 · Cited by 288
Single-Stage Semantic Segmentation From Image Labels
Araslanov, N., & Roth, S. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00431 · Cited by 275
Integral Object Mining via Online Attention Accumulation
Jiang, P.-T., Hou, Q., Cao, Y., Cheng, M.-M., Wei, Y., & Xiong, H. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00216 · Cited by 254
Joint Learning of Saliency Detection and Weakly Supervised Semantic Segmentation
Zeng, Y., Zhuge, Y., Lu, H., & Zhang, L. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00732 · Cited by 212
CIAN: Cross-Image Affinity Net for Weakly Supervised Semantic Segmentation
Fan, J., Zhang, Z., Tan, T., Song, C., & Xiao, J. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i07.6705 · Cited by 207
Learning Integral Objects With Intra-Class Discriminator for Weakly-Supervised Semantic Segmentation
Fan, J., Zhang, Z., Song, C., & Tan, T. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00434 · Cited by 207
Reliability Does Matter: An End-to-End Weakly Supervised Semantic Segmentation Approach
Zhang, B., Xiao, J., Wei, Y., Sun, M., & Huang, K. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i07.6971 · Cited by 204
Exploiting Saliency for Object Segmentation from Image Level Labels
Oh, S. J., Benenson, R., Khoreva, A., Akata, Z., Fritz, M., & Schiele, B. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.535 · Cited by 191
Evaluating Weakly Supervised Object Localization Methods Right
Choe, J., Oh, S. J., Lee, S., Chun, S., Akata, Z., & Shim, H. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00320 · Cited by 190
Self-citationLiu, Y., Wu, Y.-H., Wen, P., Shi, Y., Qiu, Y., & Cheng, M. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.3023152 · Cited by 178
Weakly Supervised Semantic Segmentation with Boundary Exploration
Chen, L., Wu, W., Fu, C., Han, X., & Zhang, Y. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58574-7_21 · Cited by 175
Discovering Class-Specific Pixels for Weakly-Supervised Semantic Segmentation
Chaudhry, A., Dokania, P. K., & Torr, P. H. S. (2017) · British Machine Vision Conference (BMVC) · doi:10.5244/c.31.20 · Cited by 151
Two-Phase Learning for Weakly Supervised Object Localization
Kim, D., Cho, D., Yoo, D., & Kweon, I. S. (2017) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.382 · Cited by 142
Joint Learning of Saliency Detection and Weakly Supervised Semantic SegmentationPreprint
Zeng, Y., Zhuge, Y., Lu, H., & Zhang, L. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1909.04161 · Cited by 127
Choe, J., Lee, S., & Shim, H. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.2999099 · Cited by 120
Self-citationAssociating Inter-image Salient Instances for Weakly Supervised Semantic Segmentation
Fan, R., Hou, Q., Cheng, M., Yu, G., Martin, R. R., & Hu, S. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01240-3_23 · Cited by 104
Saliency Guided Self-Attention Network for Weakly and Semi-Supervised Semantic Segmentation
Yao, Q., & Gong, X. (2020) · IEEE Access · doi:10.1109/access.2020.2966647 · Cited by 94
DeepUSPS: Deep Robust Unsupervised Saliency Prediction via Self-supervision
Nguyen, T. N., Dax, M., Mummadi, C. K., Ngo, N., Nguyen, T., Lou, Z., & Brox, T. (2019) · neural information processing systems · Cited by 75
Deep Salient Object Detection With Dense Connections and Distraction Diagnosis
Xiao, H., Feng, J., Wei, Y., Zhang, M., & Yan, S. (2018) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2018.2830098 · Cited by 74
Zhang, T., Lin, G., Liu, W., Cai, J., & Kot, A. C. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58542-6_40 · Cited by 63
Employing Multi-estimations for Weakly-Supervised Semantic Segmentation
Fan, J., Zhang, Z., & Tan, T. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58520-4_20 · Cited by 62
Improving Weakly-Supervised Object Localization By Micro-Annotation
Kolesnikov, A., & Lampert, C. H. (2016) · British Machine Vision Conference (BMVC) · doi:10.5244/c.30.92 · Cited by 24
Cited by
Multi-class Token Transformer for Weakly Supervised Semantic Segmentation
Xu, L., Ouyang, W., Bennamoun, M., Boussaid, F., & Xu, D. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.00427 · Cited by 305
Ru, L., Zhan, Y., Yu, B., & Du, B. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01634 · Cited by 281
Metadata
- Authors
- Lee, S., Lee, M., Lee, J., & Shim, H.
- Venue
- 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
- Publisher
- IEEE
- Published
- 2021-06
- Pages
- 5491-5501
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W3163196445
- Cited by
- 263
- References
- 52
- FWCI
- 16.72
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.