Large-Scale Unsupervised Semantic Segmentation
Open accessThe DOI matches its Crossref record; 147 of the 156 references it cites were found in a registry or an index; 10 of the 19 sources its claims cite were checked for support.
Abstract
Empowered by large datasets, e.g., ImageNet and MS COCO, unsupervised learning on large-scale data has enabled significant advances for classification tasks. However, whether the large-scale unsupervised semantic segmentation can be achieved remains unknown. There are two major challenges: i) we need a large-scale benchmark for assessing algorithms; ii) we need to develop methods to simultaneously learn category and shape representation in an unsupervised manner. In this work, we propose a new problem of large-scale unsupervised semantic segmentation (LUSS) with a newly created benchmark dataset to help the research progress. Building on the ImageNet dataset, we propose the ImageNet-S dataset with 1.2 million training images and 50k high-quality semantic segmentation annotations for evaluation. Our benchmark has a high data diversity and a clear task objective. We also present a simple yet effective method that works surprisingly well for LUSS. In addition, we benchmark related un/weakly/fully supervised methods accordingly, identifying the challenges and possible directions of LUSS. The benchmark and source code is publicly available at https://github.com/LUSSeg.
Overview
CoChat Summary
TL;DR
The paper proposes large-scale unsupervised semantic segmentation (LUSS) and introduces ImageNet-S, a benchmark built from ImageNet with 919 categories and nearly 50k pixel-level annotated images. It also presents a simple LUSS method using enhanced representation learning and pixel-attention, and benchmarks related un/weakly/fully supervised approaches.
Key findings
- ImageNet-S contains 1,183,322 training, 12,419 validation, and 27,423 testing images from 919 categories; 39,842 validation/testing images and 9,190 training images are annotated with precise pixel-level masks.
- The dataset includes ImageNet-S50 (50 categories; 64,431 train / 752 val / 1,682 test) and ImageNet-S300 (300 categories; 384,862 train / 4,097 val / 9,088 test) in addition to the full ImageNet-S.
- Most images contain one category, while 8.6% of images have more than one category.
- The authors correct 296 mislabeled images and find 942 images with missing labels during annotation.
Methods
- The paper defines LUSS as assigning labels to pixels from large-scale data without human-annotation supervision, requiring simultaneous learning of category and shape representations.
- The proposed method includes unsupervised representation learning with a non-contrastive pixel-to-pixel representation alignment strategy, a deep-to-shallow supervision strategy, and a pixel-attention scheme for label generation and fine-tuning.
- The benchmark is built from ImageNet by removing unsegmentable categories, annotating pixel-level masks, and evaluating related unsupervised, weakly supervised, and fully supervised methods.
Limitations
- The paper states that existing unsupervised semantic segmentation methods focus on small datasets and few easy categories, and some use supervised prior knowledge such as pre-trained weights, edge detection, or saliency detection, making evaluation difficult.
- It identifies LUSS challenges including simultaneous shape and category representation learning, semantic clustering at large scale, and high computational cost.
- The provided text is truncated before the experimental results and any explicit limitations section, so quantitative LUSS performance and author-stated limitations beyond the benchmark discussion are not available.
Model-written summary of a shortened version of the paper’s full text (it is longer than we read). Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
4 Valid · 2 Not valid · 2 Not checked · 18 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Existing segmentation datasets can hardly support LUSS due to the large image complexity but small data scale.”
§ 3 LARGE-SCALE UNSUPERVISED SEMANTIC SEG- > 3.1 Large-scale LUSS Dataset: ImageNet-S
What the sources say
- Partly supportedcites [10] matched to “The Pascal Visual Object Classes Challenge: A Retrospective” (2015) sourceExperimental — accuracy not yet measured
Section 2.3.3 says the segmentation dataset needed to grow and that segmentation annotations required substantially more effort than detection annotations. Section 4.2 describes difficult images with occlusion and background clutter, but in an analysis of classification results. The paper does not say that existing segmentation datasets can hardly support LUSS or attribute such a limitation to the combination of image complexity and small data scale. (LLM, conf=0.80)
- Partly supportedcites [7] matched to “The Cityscapes Dataset for Semantic Urban Scene Understanding” (2016) sourceExperimental — accuracy not yet measured
The Introduction states that existing urban-scene datasets are often small and do not fully capture the complexity of real-world inner-city traffic scenes, limiting progress in street-scene understanding. It does not extend that assessment to all segmentation datasets or specifically address LUSS. (LLM, conf=0.84)
- Partly supportedcites [8] matched to “Semantic Understanding of Scenes Through the ADE20K Dataset” (2019) sourceExperimental — accuracy not yet measured
The Introduction (p. 2) describes limitations in existing segmentation datasets’ object and scene coverage, and Table 1 (p. 8) compares their image counts and objects per image. These passages support concerns about dataset coverage and scale, but the paper does not assess whether those datasets can support LUSS or attribute any such difficulty to the combination of image complexity and small data scale. (LLM, conf=0.80)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The sources with a verdict support this claim; the rest weren’t checked yet, have no full text we could read, or their verdicts aren’t rated yet.
In the paper
“However, recent research [112], [113] suggested that performance on the ImageNet and downstream datasets is not always consistent due to the inconstancy of data distribution, data domain, and task objective.”
§ 3 LARGE-SCALE UNSUPERVISED SEMANTIC SEG- > 3.1 Large-scale LUSS Dataset: ImageNet-S
What the sources say
- Supportedcites [112] matched to “When Does Contrastive Visual Representation Learning Work?” (2022) source
The ‘Pretraining domain matters’ section reports that in-domain pretraining consistently outperforms cross-domain pretraining, including ImageNet pretraining on iNat21. ‘SSL beyond ImageNet’ links differing results to pretraining and downstream data distributions, while §4.4 (‘Task granularity’) shows that performance also depends on the downstream classification task’s granularity. The copy provides section labels but no page numbers for these passages. (LLM, conf=0.87)
- Not checked — no full text of the sourcecites [113] matched to “Contrasting Contrastive Self-Supervised Representation Learning Pipelines” (2021) source
hedgedstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
A result the paper states — it cites no source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The training set and validation/testing sets have similar distributions.”
§ 3 LARGE-SCALE UNSUPERVISED SEMANTIC SEG- > 3.1 Large-scale LUSS Dataset: ImageNet-S
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“As shown in Table 1, the ImageNet-S dataset (see Figure 2) is much larger than existing datasets in terms of image amount and category diversity (see Figure 3).”
§ 3 LARGE-SCALE UNSUPERVISED SEMANTIC SEG- > 3.1 Large-scale LUSS Dataset: ImageNet-S
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Building on the ImageNet dataset, we propose the ImageNet-S dataset with 1.2 million training images and 50k high-quality semantic segmentation annotations for evaluation.”
- Also stated in: § 1 INTRODUCTION · hedged
“We remove the unsegmentable categories, e.g., bookshop, and utilize 919 categories with about 1.2 million images in ImageNet for training.”
- Also stated in: § 3.1 Large-scale LUSS Dataset: ImageNet-S · plain
“after removing the unsegmentable categories in the ImageNet dataset, e.g., bookshop, valley, and library, the ImageNet-S dataset contains 1,183,322 training, 12,419 validation, and 27,423 testing images from 919 categories.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § 1 INTRODUCTION · hedged
2 more claims
Create a free account to see all 26 claims and every source verdict.
- It may state two separate claims as one. 15
- Probably not a substantial claim. 6
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
U-Net: Convolutional Networks for Biomedical Image Segmentation
Ronneberger, O., Fischer, P., & Brox, T. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24574-4_28 · Cited by 99,404
Densely Connected Convolutional Networks
Huang, G., Liu, Z., Van Der Maaten, L., & Weinberger, K. Q. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.243 · Cited by 48,566
Microsoft COCO: Common Objects in Context
Lin, T.-Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollár, P., & Zitnick, C. L. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10602-1_48 · Cited by 45,460
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380
Fully convolutional networks for semantic segmentation
Long, J., Shelhamer, E., & Darrell, T. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298965 · Cited by 38,834
Swin Transformer: Hierarchical Vision Transformer using Shifted Windows
Liu, Z., Lin, Y., Cao, Y., Hu, H., Wei, Y., Zhang, Z., Lin, S., & Guo, B. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00986 · Cited by 35,534
Rethinking the Inception Architecture for Computer Vision
Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., & Wojna, Z. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.308 · Cited by 32,138
He, K., Gkioxari, G., Dollar, P., & Girshick, R. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.322 · Cited by 29,137
Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization
Selvaraju, R. R., Cogswell, M., Das, A., Vedantam, R., Parikh, D., & Batra, D. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.74 · Cited by 24,513
Chen, L.-C., Papandreou, G., Kokkinos, I., Murphy, K., & Yuille, A. L. (2018) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2699184 · Cited by 22,392
Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation
Chen, L.-C., Zhu, Y., Papandreou, G., Schroff, F., & Adam, H. (2018) · arXiv · doi:10.48550/arxiv.1802.02611 · Cited by 20,063
Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation
Chen, L.-C., Zhu, Y., Papandreou, G., Schroff, F., & Adam, H. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01234-2_49 · Cited by 20,054
SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation
Badrinarayanan, V., Kendall, A., & Cipolla, R. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2644615 · Cited by 19,631
The pascal visual object classes (VOC) challenge
Everingham, M., Van Gool, L., Williams, C. K. I., Winn, J., & Zisserman, A. (2010) · International Journal of Computer Vision · doi:10.1007/s11263-009-0275-4 · Cited by 19,599 · cited 1×
“We also transfer pre-trained models to the semantic segmentation task on the PASCAL VOC dataset [127], using ResNet-50 based Deeplab V3+ [13] network.”
MethodEfficientNet: Rethinking Model Scaling for Convolutional Neural Networks
Tan, M., & Le, Q. V. (2019) · arXiv · doi:10.48550/arxiv.1905.11946 · Cited by 17,072
Momentum Contrast for Unsupervised Visual Representation Learning
He, K., Fan, H., Wu, Y., Xie, S., & Girshick, R. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00975 · Cited by 13,347
The Hungarian method for the assignment problem
Kuhn, H. W. (1955) · Naval Research Logistics Quarterly · doi:10.1002/nav.3800020109 · Cited by 13,120
Aggregated Residual Transformations for Deep Neural Networks
Xie, S., Girshick, R., Dollar, P., Tu, Z., & He, K. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.634 · Cited by 12,465
Learning Deep Features for Discriminative Localization
Zhou, B., Khosla, A., Lapedriza, A., Oliva, A., & Torralba, A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.319 · Cited by 11,428
Liu, Z., Mao, H., Wu, C.-Y., Feichtenhofer, C., Darrell, T., & Xie, S. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01167 · Cited by 8,494
Multi-scale context aggregation by dilated convolutions
Yu, F., & Koltun, V. (2015) · arXiv · doi:10.48550/arxiv.1511.07122 · Cited by 7,738 · cited 2×
“S EMANTIC segmentation [1], [2], [3], [4], [5], [6], [7], aiming to label image pixels with category information, has drawn much attention in recent years.”
BackgroundThe Pascal Visual Object Classes Challenge: A Retrospective
Everingham, M., Eslami, S. M. A., Van Gool, L., Williams, C. K. I., Winn, J., & Zisserman, A. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-014-0733-5 · Cited by 7,139 · cited 13×
“PASCAL VOC 2012 [11] 20 1464 1449 1456 CityScapes [8] 19 2975 500 1525 ADE20K [9] 150 20210 2000 3000”
BackgroundMethodInfluentialRepresentation Learning with Contrastive Predictive Coding
Oord, A. V. D., Li, Y., & Vinyals, O. (2018) · arXiv · doi:10.48550/arxiv.1807.03748 · Cited by 6,242
Efficient Graph-Based Image Segmentation
Felzenszwalb, P. F., & Huttenlocher, D. P. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000022288.19776.77 · Cited by 6,176
Context Encoders: Feature Learning by Inpainting
Pathak, D., Krahenbuhl, P., Donahue, J., Darrell, T., & Efros, A. A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.278 · Cited by 5,691
Dimensionality Reduction by Learning an Invariant Mapping
Hadsell, R., Chopra, S., & LeCun, Y. (2006) · 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 2 (CVPR'06) · doi:10.1109/cvpr.2006.100 · Cited by 5,336
Learning a Similarity Metric Discriminatively, with Application to Face Verification
Chopra, S., Hadsell, R., & LeCun, Y. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.202 · Cited by 4,036
Rethinking Semantic Segmentation from a Sequence-to-Sequence Perspective with Transformers
Zheng, S., Lu, J., Zhao, H., Zhu, X., Luo, Z., Wang, Y., Fu, Y., Feng, J., Xiang, T., Torr, P. H. S., et al. (2020) · arXiv · doi:10.48550/arxiv.2012.15840 · Cited by 4,004
Self-citationExploring Simple Siamese Representation Learning
Chen, X., & He, K. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.01549 · Cited by 3,725
Unsupervised Feature Learning via Non-parametric Instance Discrimination
Wu, Z., Xiong, Y., Yu, S. X., & Lin, D. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00393 · Cited by 3,664
Kuznetsova, A., Rom, H., Alldrin, N., Uijlings, J., Krasin, I., Pont-Tuset, J., Kamali, S., Popov, S., Malloci, M., Kolesnikov, A., et al. (2018) · arXiv · doi:10.48550/arxiv.1811.00982 · Cited by 3,653
He, K., Gkioxari, G., Dollar, P., & Girshick, R. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2844175 · Cited by 3,457
Res2Net: A New Multi-Scale Backbone Architecture
Gao, S.-H., Cheng, M.-M., Zhao, K., Zhang, X.-Y., Yang, M.-H., & Torr, P. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2938758 · Cited by 3,385
Self-citationZhang, R., Isola, P., & Efros, A. A. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46487-9_40 · Cited by 3,178
Unsupervised Learning of Visual Representations by Solving Jigsaw Puzzles
Noroozi, M., & Favaro, P. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46466-4_5 · Cited by 2,775 · cited 1×
“, colorization [58], [59], [60], jigsaw puzzles [61], [62], [63], inpainting [64], adversarial learning [65], [66], context prediction [67], [68], counting [69], rotation predictions [63], [70], cross-domain prediction [71], contrastive learning [25], [26], [27], [72], [73], [74], non-contrastive learning [35], [36],…”
Deep Clustering for Unsupervised Learning of Visual Features
Caron, M., Bojanowski, P., Joulin, A., & Douze, M. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01264-9_9 · Cited by 2,674
BDD100K: A Diverse Driving Dataset for Heterogeneous Multitask Learning
Yu, F., Chen, H., Wang, X., Xian, W., Chen, Y., Liu, F., Madhavan, V., & Darrell, T. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00271 · Cited by 2,641 · cited 3×
“For instance, the PASCAL VOC segmentation dataset only contains about 2k images, while the BDD100K [10] focuses on road scenes.”
BackgroundUnsupervised Visual Representation Learning by Context Prediction
Doersch, C., Gupta, A., & Efros, A. A. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.167 · Cited by 2,629
Unsupervised Learning of Visual Features by Contrasting Cluster Assignments
Caron, M., Misra, I., Mairal, J., Goyal, P., Bojanowski, P., & Joulin, A. (2020) · arXiv · doi:10.48550/arxiv.2006.09882 · Cited by 2,499
Revisiting Unreasonable Effectiveness of Data in Deep Learning Era
Sun, C., Shrivastava, A., Singh, S., & Gupta, A. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.97 · Cited by 2,484
Unsupervised Representation Learning by Predicting Image Rotations
Gidaris, S., Singh, P., & Komodakis, N. (2018) · arXiv · doi:10.48550/arxiv.1803.07728 · Cited by 2,477
Global Contrast Based Salient Region Detection
Cheng, M.-M., Mitra, N. J., Huang, X., Torr, P. H. S., & Hu, S.-M. (2015) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2014.2345401 · Cited by 2,463
Self-citationLearning to detect natural image boundaries using local brightness, color, and texture cues
Martin, D. R., Fowlkes, C. C., & Malik, J. (2004) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2004.1273918 · Cited by 2,420
Tian, Y., Krishnan, D., & Isola, P. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58621-8_45 · Cited by 1,997
Learning deep representations by mutual information estimation and maximization
Hjelm, R. D., Fedorov, A., Lavoie-Marchildon, S., Grewal, K., Bachman, P., Trischler, A., & Bengio, Y. (2018) · arXiv · doi:10.48550/arxiv.1808.06670 · Cited by 1,991
Improved Baselines with Momentum Contrastive Learning
Chen, X., Fan, H., Girshick, R., & He, K. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.04297 · Cited by 1,956
Semantic Understanding of Scenes Through the ADE20K Dataset
Zhou, B., Zhao, H., Puig, X., Xiao, T., Fidler, S., Barriuso, A., & Torralba, A. (2019) · International Journal of Computer Vision · doi:10.1007/s11263-018-1140-0 · Cited by 1,831
Kuznetsova, A., Rom, H., Alldrin, N., Uijlings, J., Krasin, I., Pont-Tuset, J., Kamali, S., Popov, S., Malloci, M., Kolesnikov, A., et al. (2020) · International Journal of Computer Vision · doi:10.1007/s11263-020-01316-z · Cited by 1,738
Semantic contours from inverse detectors
Hariharan, B., Arbelaez, P., Bourdev, L., Maji, S., & Malik, J. (2011) · 2011 International Conference on Computer Vision · doi:10.1109/iccv.2011.6126343 · Cited by 1,624
Wider or Deeper: Revisiting the ResNet Model for Visual Recognition
Wu, Z., Shen, C., & van den Hengel, A. (2019) · Pattern Recognition · doi:10.1016/j.patcog.2019.01.006 · Cited by 1,589
Self-Supervised Learning of Pretext-Invariant Representations
Misra, I., & van der Maaten, L. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00674 · Cited by 1,435 · cited 3×
“, colorization [122, 47, 54], jigsaw puzzles [73, 75, 71], and rotation predictions [35, 71], enable models to learn task-”
BackgroundCOCO-Stuff: Thing and Stuff Classes in Context
Caesar, H., Uijlings, J., & Ferrari, V. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00132 · Cited by 1,277
Contrastive Learning with Hard Negative SamplesPreprint
Robinson, J., Chuang, C.-Y., Sra, S., & Jegelka, S. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.04592 · Cited by 1,225
Exploring the Limits of Weakly Supervised Pretraining
Mahajan, D., Girshick, R., Ramanathan, V., He, K., Paluri, M., Li, Y., Bharambe, A., & van der Maaten, L. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01216-8_12 · Cited by 1,224
The Cityscapes Dataset for Semantic Urban Scene Understanding
Cordts, M., Omran, M., Ramos, S., Rehfeld, T., Enzweiler, M., Benenson, R., Franke, U., Roth, S., & Schiele, B. (2016) · arXiv · doi:10.48550/arxiv.1604.01685 · Cited by 1,174
Discriminative Unsupervised Feature Learning with Convolutional Neural NetworksPreprint
Dosovitskiy, A., Springenberg, J. T., Riedmiller, M., & Brox, T. (2014) · arXiv (Cornell University) · Cited by 1,153
Invariant Information Clustering for Unsupervised Image Classification and Segmentation
Ji, X., Vedaldi, A., & Henriques, J. F. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00996 · Cited by 1,125
Data-Efficient Image Recognition with Contrastive Predictive Coding
Hénaff, O. J., Srinivas, A., De Fauw, J., Razavi, A., Doersch, C., Eslami, S. M. A., & Oord, A. V. D. (2019) · arXiv · doi:10.48550/arxiv.1905.09272 · Cited by 1,014
Ahn, J., & Kwak, S. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00523 · Cited by 872
Wei, Y., Feng, J., Liang, X., Cheng, M.-M., Zhao, Y., & Yan, S. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.687 · Cited by 863
Self-citationIizuka, S., Simo-Serra, E., & Ishikawa, H. (2016) · ACM Transactions on Graphics · doi:10.1145/2897824.2925974 · Cited by 814
Rethinking BiSeNet For Real-time Semantic Segmentation
Fan, M., Lai, S., Huang, J., Wei, X., Chai, Z., Luo, J., & Wei, X. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00959 · Cited by 785
What makes for good views for contrastive learning
Tian, Y., Sun, C., Poole, B., Krishnan, D., Schmid, C., & Isola, P. (2020) · arXiv · doi:10.48550/arxiv.2005.10243 · Cited by 773
Self-Supervised Equivariant Attention Mechanism for Weakly Supervised Semantic Segmentation
Wang, Y., Zhang, J., Kan, M., Shan, S., & Chen, X. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01229 · Cited by 770
Barlow Twins: Self-Supervised Learning via Redundancy Reduction
Žbontar, J., Jing, L., Misra, I., LeCun, Y., & Deny, S. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2103.03230 · Cited by 751
Singh, K. K., & Lee, Y. J. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.381 · Cited by 724
Seed, Expand and Constrain: Three Principles for Weakly-Supervised Image Segmentation
Kolesnikov, A., & Lampert, C. H. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46493-0_42 · Cited by 719
Dense Contrastive Learning for Self-Supervised Visual Pre-Training
Wang, X., Zhang, R., Shen, C., Kong, T., & Li, L. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00304 · Cited by 660
Tell Me Where to Look: Guided Attention Inference Network
Li, K., Wu, Z., Peng, K.-C., Ernst, J., & Fu, Y. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00960 · Cited by 647
Wei, Y., Xiao, H., Shi, H., Jie, Z., Feng, J., & Huang, T. S. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00759 · Cited by 627
Donahue, J., Krähenbühl, P., & Darrell, T. J. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1605.09782 · Cited by 616
Weakly Supervised Learning of Instance Segmentation With Inter-Pixel Relations
Ahn, J., Cho, S., & Kwak, S. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00231 · Cited by 613
Prototypical Contrastive Learning of Unsupervised Representations
Li, J., Zhou, P., Xiong, C., & Hoi, S. C. H. (2020) · arXiv · doi:10.48550/arxiv.2005.04966 · Cited by 611
Unsupervised Embedding Learning via Invariant and Spreading Instance Feature
Ye, M., Zhang, X., Yuen, P. C., & Chang, S.-F. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00637 · Cited by 601
Adversarial Complementary Learning for Weakly Supervised Object Localization
Zhang, X., Wei, Y., Feng, J., Yang, Y., & Huang, T. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00144 · Cited by 592
Weakly-Supervised Semantic Segmentation Network with Deep Seeded Region Growing
Huang, Z., Wang, X., Wang, J., Liu, W., & Wang, J. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00733 · Cited by 591
STC: A Simple to Complex Framework for Weakly-Supervised Semantic Segmentation
Wei, Y., Liang, X., Chen, Y., Shen, X., Cheng, M.-M., Feng, J., Zhao, Y., & Yan, S. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2636150 · Cited by 576
Self-citationDebiased Contrastive LearningPreprint
Chuang, C.-Y., Robinson, J., Lin, Y.-C., Torralba, A. B., & Jegelka, S. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.00224 · Cited by 534
Segmentation Transformer: Object-Contextual Representations for Semantic Segmentation
Yuan, Y., Chen, X., Chen, X., & Wang, J. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1909.11065 · Cited by 496
Boundary IoU: Improving Object-Centric Image Segmentation Evaluation
Cheng, B., Girshick, R., Dollar, P., Berg, A. C., & Kirillov, A. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.01508 · Cited by 495
SuperParsing: Scalable Nonparametric Image Parsing with Superpixels
Tighe, J., & Lazebnik, S. (2010) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-15555-0_26 · Cited by 477
Tian, Y., Krishnan, D., & Isola, P. (2019) · arXiv · doi:10.48550/arxiv.1906.05849 · Cited by 465
Colorization as a Proxy Task for Visual Understanding
Larsson, G., Maire, M., & Shakhnarovich, G. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.96 · Cited by 458
FickleNet: Weakly and Semi-Supervised Semantic Image Segmentation Using Stochastic Inference
Lee, J., Kim, E., Lee, S., Lee, J., & Yoon, S. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00541 · Cited by 457
Local Aggregation for Unsupervised Learning of Visual Embeddings
Zhuang, C., Zhai, A., & Yamins, D. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00610 · Cited by 417
He, K., Gkioxari, G., Dollár, P., & Girshick, R. (2017) · arXiv · doi:10.48550/arxiv.1703.06870 · Cited by 406
Exploring Simple Siamese Representation Learning
Chen, X., & He, K. (2020) · arXiv · doi:10.48550/arxiv.2011.10566 · Cited by 381
Xie, Z., Lin, Y., Zhang, Z., Cao, Y., Lin, S., & Hu, H. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.01641 · Cited by 370
Nonparametric Scene Parsing via Label Transfer
Liu, C., Yuen, J., & Torralba, A. (2011) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2011.131 · Cited by 368
Large Scale Adversarial Representation Learning
Donahue, J., & Simonyan, K. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1907.02544 · Cited by 351
(2019) · neural information processing systems · Cited by 350
Weakly-Supervised Semantic Segmentation by Iteratively Mining Common Object Features
Wang, X., You, S., Li, X., & Ma, H. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00147 · Cited by 326
Representation Learning by Learning to Count
Noroozi, M., Pirsiavash, H., & Favaro, P. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.628 · Cited by 324
Weakly-Supervised Semantic Segmentation via Sub-Category Exploration
Chang, Y.-T., Wang, Q., Hung, W.-C., Piramuthu, R., Tsai, Y.-H., & Yang, M.-H. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00901 · Cited by 318
Self-citationSelf-Erasing Network for Integral Object AttentionPreprint
Hou, Q., Jiang, P.-T., Wei, Y., & Cheng, M. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1810.09821 · Cited by 308
Self-citationImproving Semantic Segmentation via Decoupled Body and Edge Supervision
Li, X., Li, X., Zhang, L., Cheng, G., Shi, J., Lin, Z., Tan, S., & Tong, Y. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58520-4_26 · Cited by 304
Self-citationUnderstanding self-supervised Learning Dynamics without Contrastive PairsPreprint
Tian, Y., Chen, X., & Ganguli, S. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2102.06810 · Cited by 300
Boosting Self-Supervised Learning via Knowledge Transfer
Noroozi, M., Vinjimoor, A., Favaro, P., & Pirsiavash, H. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00975 · Cited by 296
Mining Cross-Image Semantics for Weakly Supervised Semantic Segmentation
Sun, G., Wang, W., Dai, J., & Van Gool, L. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58536-5_21 · Cited by 288
Anti-Adversarially Manipulated Attributions for Weakly and Semi-Supervised Semantic Segmentation
Lee, J., Kim, E., & Yoon, S. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00406 · Cited by 268
Unsupervised Pre-Training of Image Features on Non-Curated Data
Caron, M., Bojanowski, P., Mairal, J., & Joulin, A. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00305 · Cited by 258
Unsupervised Semantic Segmentation by Contrasting Object Mask Proposals
Van Gansbeke, W., Vandenhende, S., Georgoulis, S., & Van Gool, L. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00990 · Cited by 231 · cited 5×
“MaskContrast [32] is initialized with the MoCo pre-trained weights and trained with extra saliency maps as supervision.”
BackgroundMethodInfluentialUnsupervised Learning by Predicting Noise
Bojanowski, P., & Joulin, A. (2017) · arXiv · doi:10.48550/arxiv.1704.05310 · Cited by 228
Highly Efficient Salient Object Detection with 100K Parameters
Gao, S.-H., Tan, Y.-Q., Cheng, M.-M., Lu, C., Chen, Y., & Yan, S. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58539-6_42 · Cited by 220
Self-citationCIAN: Cross-Image Affinity Net for Weakly Supervised Semantic Segmentation
Fan, J., Zhang, Z., Tan, T., Song, C., & Xiao, J. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i07.6705 · Cited by 207
Learning Integral Objects With Intra-Class Discriminator for Weakly-Supervised Semantic Segmentation
Fan, J., Zhang, Z., Song, C., & Tan, T. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00434 · Cited by 207
Online Deep Clustering for Unsupervised Representation Learning
Zhan, X., Xie, J., Liu, Z., Ong, Y.-S., & Loy, C. C. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00672 · Cited by 203
Self-supervised Learning from a Multi-view PerspectivePreprint
Tsai, Y.-H. H., Wu, Y., Salakhutdinov, R., & Morency, L. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.05576 · Cited by 203
AET vs. AED: Unsupervised Representation Learning by Auto-Encoding Transformations Rather Than Data
Zhang, L., Qi, G.-J., Wang, L., & Luo, J. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00265 · Cited by 200
Spatial Pyramid Based Graph Reasoning for Semantic Segmentation
Li, X., Yang, Y., Zhao, Q., Shen, T., Lin, Z., & Liu, H. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00897 · Cited by 194
Jiang, P.-T., Yang, Y., Hou, Q., & Wei, Y. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01638 · Cited by 192
Learning Statistical Texture for Semantic Segmentation
Zhu, L., Ji, D., Zhu, S., Gan, W., Wu, W., & Yan, J. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.01235 · Cited by 190
Cross-Domain Self-Supervised Multi-task Feature Learning Using Synthetic Imagery
Ren, Z., & Lee, Y. J. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00086 · Cited by 190
Beyer, L., Hénaff, O. J., Kolesnikov, A., Zhai, X., & Oord, A. V. D. (2020) · arXiv · doi:10.48550/arxiv.2006.07159 · Cited by 176
Weakly Supervised Semantic Segmentation with Boundary Exploration
Chen, L., Wu, W., Fu, C., Han, X., & Zhang, Y. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58574-7_21 · Cited by 175
Self-Supervised Difference Detection for Weakly-Supervised Semantic Segmentation
Shimoda, W., & Yanai, . (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00531 · Cited by 161
PiCIE: Unsupervised Semantic Segmentation using Invariance and Equivariance in Clustering
Hyun Cho, J., Mall, U., Bala, K., & Hariharan, B. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.01652 · Cited by 159
Liu, Y., Wu, Y.-H., Wen, P., Shi, Y., Qiu, Y., & Cheng, M.-M. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.3023152 · Cited by 157
Self-citationJoint Semantic Segmentation and Boundary Detection Using Iterative Pyramid Contexts
Zhen, M., Wang, J., Zhou, L., Li, S., Shen, T., Shang, J., Fang, T., & Quan, L. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01368 · Cited by 147
Recognition by association via learning per-exemplar distances
Malisiewicz, T., & Efros, A. A. (2008) · 2008 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2008.4587462 · Cited by 133
A Broad Study on the Transferability of Visual Representations with Contrastive Learning
Islam, A., Chen, C.-F., Panda, R., Karlinsky, L., Radke, R. J., & Feris, R. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00872 · Cited by 130
Joint Learning of Saliency Detection and Weakly Supervised Semantic SegmentationPreprint
Zeng, Y., Zhuge, Y., Lu, H., & Zhang, L. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1909.04161 · Cited by 127
SegSort: Segmentation by Discriminative Sorting of Segments
Hwang, J.-J., Yu, S., Shi, J., Collins, M., Yang, T.-J., Zhang, X., & Chen, L.-C. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00743 · Cited by 124 · cited 4×
“Due to insufficient data, a few unsupervised segmentation methods [29], [30], [31], [32] mainly focus on small data with small diversity, thus not suitable for the LUSS task.”
BackgroundMethodInfluentialImprovements to Context Based Self-Supervised Learning
Mundhenk, T. N., Ho, D., & Chen, B. Y. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00973 · Cited by 124
Hu, Q., Wang, X., Hu, W., & Qi, G.-J. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00113 · Cited by 122
A Highly Efficient Model to Study the Semantics of Salient Object Detection
Cheng, M., Gao, S., Borji, A., Tan, Y., Zheng, L. L., & Wang, M. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3107956 · Cited by 122
Self-citationRegion Mutual Information Loss for Semantic SegmentationPreprint
Zhao, S., Wang, Y., Yang, Z., & Cai, D. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1910.12037 · Cited by 121
Self-Supervised Feature Learning by Learning to Spot Artifacts
Jenni, S., & Favaro, P. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00289 · Cited by 115
What makes instance discrimination good for transfer learning?
Zhao, N., Wu, Z., Lau, R. W. H., & Lin, S. (2020) · arXiv · doi:10.48550/arxiv.2006.06606 · Cited by 115
When Does Contrastive Visual Representation Learning Work?
Cole, E., Yang, X., Wilber, K., Aodha, O. M., & Belongie, S. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01434 · Cited by 105
ClusterFit: Improving Generalization of Visual Representations
Yan, X., Misra, I., Gupta, A., Ghadiyaram, D., & Mahajan, D. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00654 · Cited by 98
SELF-LABELLING VIA SIMULTANEOUS CLUSTERING AND REPRESENTATION LEARNING
Asano, Y. M., Rupprecht, C., & Vedaldi, A. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1911.05371 · Cited by 94
Online Attention Accumulation for Weakly Supervised Semantic Segmentation
Jiang, P.-T., Han, L.-H., Hou, Q., Cheng, M., & Wei, Y. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3092573 · Cited by 87
Self-citationSpatially Consistent Representation Learning
Roh, B., Shin, W., Kim, I., & Kim, S. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00120 · Cited by 85
Representative Batch Normalization with Feature Calibration
Gao, S., Han, Q., Li, D., Cheng, M., & Peng, P. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00856 · Cited by 81
Self-citationRF-Next: Efficient Receptive Field Search for Convolutional Neural Networks
Gao, S., Li, Z., Qi, H., Cheng, M., & Wang, L. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3183829 · Cited by 81
Self-citationEfficientFCN: Holistically-Guided Decoding for Semantic Segmentation
Liu, J., He, J., Zhang, J., Ren, J., & Li, H. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58574-7_1 · Cited by 75
Autoregressive Unsupervised Image Segmentation
Ouali, Y., Hudelot, C., & Tami, M. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58571-6_9 · Cited by 75
Self-Supervised Relational Reasoning for Representation LearningPreprint
Patacchiola, M., & Storkey, A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.05849 · Cited by 65
Parametric Instance Classification for Unsupervised Visual Feature LearningPreprint
Cao, Y., Xie, Z., Liu, B., Lin, Y., Zhang, Z., & Hu, H. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.14618 · Cited by 48
Learning to Predict Context-Adaptive Convolution for Semantic Segmentation
Liu, J., He, J., Qiao, Y., Ren, J., & Li, H. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58595-2_46 · Cited by 35
Unsupervised Representation Learning by InvariancePropagationPreprint
Wang, F., Liu, H., Guo, D., & Fuchun, S. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.11694 · Cited by 35
Mix-and-Match Tuning for Self-Supervised Semantic Segmentation
Zhan, X., Liu, Z., Luo, P., Tang, X., & Loy, C. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.12331 · Cited by 34
Contrasting Contrastive Self-Supervised Representation Learning Pipelines
Kotar, K., Ilharco, G., Schmidt, L., Ehsani, K., & Mottaghi, R. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00980 · Cited by 28 · cited 4×
“However, recent research [117], [118] suggested that performance on the ImageNet and downstream datasets is not always consistent due to the inconstancy of data distribution, data domain, and task objective.”
BackgroundInfluentialFixing Localization Errors to Improve Image Classification
Sun, G., Khan, S., Li, W., Cholakkal, H., Khan, F. S., & Gool, L. V. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58595-2_17 · Cited by 13
Cross-Dataset Collaborative Learning for Semantic Segmentation.Preprint
Wang, L., Li, D., Zhu, Y., Tian, L., & Shan, Y. (2021) · arXiv (Cornell University) · Cited by 6
Research works printed but not linked: 4
- 10.5555/3524938.3525087 · doi:10.5555/3524938.3525087
- 10.5555/3495724.3497510 · doi:10.5555/3495724.3497510
- Russell, Segmenting scenes by matching image composites, 1580
- Li, Prototypical contrastive learning of unsupervised representations
Cited by
A Highly Efficient Model to Study the Semantics of Salient Object Detection
Cheng, M., Gao, S., Borji, A., Tan, Y., Zheng, L. L., & Wang, M. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3107956 · Cited by 122
Self-citationCorrMatch: Label Propagation via Correlation Matching for Semi-Supervised Semantic Segmentation
Sun, B., Yang, Y., Zhang, L., Cheng, M., & Hou, Q. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00299 · Cited by 176
Self-citationAlpha-CLIP: A CLIP Model Focusing on Wherever you Want
Sun, Z., Fang, Y., Wu, T., Zhang, P., Zang, Y., Kong, S., Xiong, Y., Lin, D., & Wang, J. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01237 · Cited by 263
Masked Diffusion Transformer is a Strong Image Synthesizer
Gao, S., Zhou, P., Cheng, M.-M., & Yan, S. (2023) · 2023 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.02117 · Cited by 91
“Training of DPMs also unavoidably requires a large number of time steps to ensure the convergence of SDEs, making it very computationally expensive, especially in this era where large-scale models [11,35] and data [9,14,44] are often used to improve generation performance.”
BackgroundSelf-citationSelf-Supervised Learning of Object Parts for Semantic Segmentation
Ziegler, A., & Asano, Y. M. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01410 · Cited by 165
Metadata
- Authors
- Gao, S., Li, Z.-Y., Yang, M.-H., Cheng, M.-M., Han, J., & Torr, P.
- Affiliations
- Nankai University (CN)
- University of California, Merced (US)
- Northwestern Polytechnical University (CN)
- University of Oxford (GB)
- Venue
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- Published
- 2023-06-01
- Volume
- 45
- Issue
- 6
- Pages
- 7457-7476
- ISSN
- 0162-8828 (ISSN-L)
- 2160-9292
- 1939-3539
- OpenAlex
- W4307844773
- Cited by
- 88
- References
- 156
- Citations by year
- 2026: 10 · 2025: 33 · 2024: 26 · 2023: 14
- FWCI
- 6.30
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- IEEE Transactions on Pattern Analysis and Machine Intelligence (publishedVersion)
- PubMed (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- National Key Research and Development Program of China (2018AAA0100400)
- National Natural Science Foundation of China (62225604)
- Fundamental Research Funds for the Central Universities (63223050)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Medical Image Segmentation Techniques
- Keywords
- unsupervised semantic segmentation, benchmark dataset, weakly supervised segmentation, ImageNet
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-07, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-07 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.