Large-Scale Unsupervised Semantic Segmentation
Open accessThe DOI matches its Crossref record; 146 of the 156 references it cites were found in a registry or an index; 10 of the 19 sources its claims cite were checked for support.
Abstract
Empowered by large datasets, e.g., ImageNet and MS COCO, unsupervised learning on large-scale data has enabled significant advances for classification tasks. However, whether the large-scale unsupervised semantic segmentation can be achieved remains unknown. There are two major challenges: i) we need a large-scale benchmark for assessing algorithms; ii) we need to develop methods to simultaneously learn category and shape representation in an unsupervised manner. In this work, we propose a new problem of large-scale unsupervised semantic segmentation (LUSS) with a newly created benchmark dataset to help the research progress. Building on the ImageNet dataset, we propose the ImageNet-S dataset with 1.2 million training images and 50k high-quality semantic segmentation annotations for evaluation. Our benchmark has a high data diversity and a clear task objective. We also present a simple yet effective method that works surprisingly well for LUSS. In addition, we benchmark related un/weakly/fully supervised methods accordingly, identifying the challenges and possible directions of LUSS. The benchmark and source code is publicly available at https://github.com/LUSSeg.
Overview
CoChat Summary
TL;DR
The paper proposes large-scale unsupervised semantic segmentation (LUSS) and introduces ImageNet-S, a benchmark built from ImageNet with 919 categories and nearly 50k pixel-level annotated images. It also presents a simple LUSS method using enhanced representation learning and pixel-attention, and benchmarks related un/weakly/fully supervised approaches.
Key findings
- ImageNet-S contains 1,183,322 training, 12,419 validation, and 27,423 testing images from 919 categories; 39,842 validation/testing images and 9,190 training images are annotated with precise pixel-level masks.
- The dataset includes ImageNet-S50 (50 categories; 64,431 train / 752 val / 1,682 test) and ImageNet-S300 (300 categories; 384,862 train / 4,097 val / 9,088 test) in addition to the full ImageNet-S.
- Most images contain one category, while 8.6% of images have more than one category.
- The authors correct 296 mislabeled images and find 942 images with missing labels during annotation.
Methods
- The paper defines LUSS as assigning labels to pixels from large-scale data without human-annotation supervision, requiring simultaneous learning of category and shape representations.
- The proposed method includes unsupervised representation learning with a non-contrastive pixel-to-pixel representation alignment strategy, a deep-to-shallow supervision strategy, and a pixel-attention scheme for label generation and fine-tuning.
- The benchmark is built from ImageNet by removing unsegmentable categories, annotating pixel-level masks, and evaluating related unsupervised, weakly supervised, and fully supervised methods.
Limitations
- The paper states that existing unsupervised semantic segmentation methods focus on small datasets and few easy categories, and some use supervised prior knowledge such as pre-trained weights, edge detection, or saliency detection, making evaluation difficult.
- It identifies LUSS challenges including simultaneous shape and category representation learning, semantic clustering at large scale, and high computational cost.
- The provided text is truncated before the experimental results and any explicit limitations section, so quantitative LUSS performance and author-stated limitations beyond the benchmark discussion are not available.
Model-written summary of a shortened version of the paper’s full text (it is longer than we read). Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
4 Valid · 2 Not valid · 2 Not checked · 18 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Existing segmentation datasets can hardly support LUSS due to the large image complexity but small data scale.”
§ 3 LARGE-SCALE UNSUPERVISED SEMANTIC SEG- > 3.1 Large-scale LUSS Dataset: ImageNet-S
What the sources say
- Partly supportedcites [10] sourceExperimental — accuracy not yet measured
Section 2.3.3 says the segmentation dataset needed to grow and that segmentation annotations required substantially more effort than detection annotations. Section 4.2 describes difficult images with occlusion and background clutter, but in an analysis of classification results. The paper does not say that existing segmentation datasets can hardly support LUSS or attribute such a limitation to the combination of image complexity and small data scale. (LLM, conf=0.80)
- Partly supportedcites [7] sourceExperimental — accuracy not yet measured
The Introduction states that existing urban-scene datasets are often small and do not fully capture the complexity of real-world inner-city traffic scenes, limiting progress in street-scene understanding. It does not extend that assessment to all segmentation datasets or specifically address LUSS. (LLM, conf=0.84)
- Partly supportedcites [8] sourceExperimental — accuracy not yet measured
The Introduction (p. 2) describes limitations in existing segmentation datasets’ object and scene coverage, and Table 1 (p. 8) compares their image counts and objects per image. These passages support concerns about dataset coverage and scale, but the paper does not assess whether those datasets can support LUSS or attribute any such difficulty to the combination of image complexity and small data scale. (LLM, conf=0.80)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The sources with a verdict support this claim; the rest weren’t checked yet, have no full text we could read, or their verdicts aren’t rated yet.
In the paper
“However, recent research [112], [113] suggested that performance on the ImageNet and downstream datasets is not always consistent due to the inconstancy of data distribution, data domain, and task objective.”
§ 3 LARGE-SCALE UNSUPERVISED SEMANTIC SEG- > 3.1 Large-scale LUSS Dataset: ImageNet-S
What the sources say
- Supportedcites [112] source
The ‘Pretraining domain matters’ section reports that in-domain pretraining consistently outperforms cross-domain pretraining, including ImageNet pretraining on iNat21. ‘SSL beyond ImageNet’ links differing results to pretraining and downstream data distributions, while §4.4 (‘Task granularity’) shows that performance also depends on the downstream classification task’s granularity. The copy provides section labels but no page numbers for these passages. (LLM, conf=0.87)
- Not checked — no full text of the sourcecites [113] source
hedgedstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
A result the paper states — it cites no source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The training set and validation/testing sets have similar distributions.”
§ 3 LARGE-SCALE UNSUPERVISED SEMANTIC SEG- > 3.1 Large-scale LUSS Dataset: ImageNet-S
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“As shown in Table 1, the ImageNet-S dataset (see Figure 2) is much larger than existing datasets in terms of image amount and category diversity (see Figure 3).”
§ 3 LARGE-SCALE UNSUPERVISED SEMANTIC SEG- > 3.1 Large-scale LUSS Dataset: ImageNet-S
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Building on the ImageNet dataset, we propose the ImageNet-S dataset with 1.2 million training images and 50k high-quality semantic segmentation annotations for evaluation.”
- Also stated in: § 1 INTRODUCTION · hedged
“We remove the unsegmentable categories, e.g., bookshop, and utilize 919 categories with about 1.2 million images in ImageNet for training.”
- Also stated in: § 3.1 Large-scale LUSS Dataset: ImageNet-S · plain
“after removing the unsegmentable categories in the ImageNet dataset, e.g., bookshop, valley, and library, the ImageNet-S dataset contains 1,183,322 training, 12,419 validation, and 27,423 testing images from 919 categories.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § 1 INTRODUCTION · hedged
2 more claims
Create a free account to see all 26 claims and every source verdict.
- It may state two separate claims as one. 15
- Probably not a substantial claim. 6
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
U-Net: Convolutional Networks for Biomedical Image Segmentation
Ronneberger, O., Fischer, P., & Brox, T. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24574-4_28 · Cited by 99,404
Densely Connected Convolutional Networks
Huang, G., Liu, Z., Van Der Maaten, L., & Weinberger, K. Q. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.243 · Cited by 48,566
Microsoft COCO: Common Objects in Context
Lin, T.-Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollár, P., & Zitnick, C. L. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10602-1_48 · Cited by 45,460
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380
Fully convolutional networks for semantic segmentation
Long, J., Shelhamer, E., & Darrell, T. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298965 · Cited by 38,834
Swin Transformer: Hierarchical Vision Transformer using Shifted Windows
Liu, Z., Lin, Y., Cao, Y., Hu, H., Wei, Y., Zhang, Z., Lin, S., & Guo, B. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00986 · Cited by 35,534
Rethinking the Inception Architecture for Computer Vision
Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., & Wojna, Z. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.308 · Cited by 32,138
He, K., Gkioxari, G., Dollar, P., & Girshick, R. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.322 · Cited by 29,137
Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization
Selvaraju, R. R., Cogswell, M., Das, A., Vedantam, R., Parikh, D., & Batra, D. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.74 · Cited by 24,513
Research works printed but not linked: 4
- 10.5555/3524938.3525087 · doi:10.5555/3524938.3525087
- 10.5555/3495724.3497510 · doi:10.5555/3495724.3497510
- Russell, Segmenting scenes by matching image composites, 1580
- Li, Prototypical contrastive learning of unsupervised representations
Cited by
A Highly Efficient Model to Study the Semantics of Salient Object Detection
Cheng, M., Gao, S., Borji, A., Tan, Y., Zheng, L. L., & Wang, M. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3107956 · Cited by 122
Self-citationCorrMatch: Label Propagation via Correlation Matching for Semi-Supervised Semantic Segmentation
Sun, B., Yang, Y., Zhang, L., Cheng, M., & Hou, Q. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00299 · Cited by 175
Self-citationAlpha-CLIP: A CLIP Model Focusing on Wherever you Want
Sun, Z., Fang, Y., Wu, T., Zhang, P., Zang, Y., Kong, S., Xiong, Y., Lin, D., & Wang, J. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01237 · Cited by 263
Masked Diffusion Transformer is a Strong Image Synthesizer
Gao, S., Zhou, P., Cheng, M.-M., & Yan, S. (2023) · 2023 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.02117 · Cited by 91
Self-citationSelf-Supervised Learning of Object Parts for Semantic Segmentation
Ziegler, A., & Asano, Y. M. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01410 · Cited by 165
A closer look at the explainability of Contrastive language-image pre-training
Li, Y., Wang, H., Duan, Y., Zhang, J., & Li, X. (2025) · Pattern Recognition · doi:10.1016/j.patcog.2025.111409 · Cited by 282
RF-Next: Efficient Receptive Field Search for Convolutional Neural Networks
Gao, S., Li, Z., Qi, H., Cheng, M., & Wang, L. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3183829 · Cited by 81
Self-citationGround truth based comparison of saliency maps algorithms
Szczepankiewicz, K., Popowicz, A., Charkiewicz, K., Nałęcz-Charkiewicz, K., Szczepankiewicz, M., Lasota, S., Zawistowski, P., & Radlak, K. (2023) · Scientific Reports · doi:10.1038/s41598-023-42946-w · Cited by 58
Highly Efficient and Unsupervised Framework for Moving Object Detection in Satellite Videos
Xiao, C., An, W., Zhang, Y., Su, Z., Li, M., Sheng, W., Pietikäinen, M., & Liu, L. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3409824 · Cited by 62
DFormerv2: Geometry Self-Attention for RGBD Semantic Segmentation
Yin, B.-W., Cao, J.-L., Cheng, M., & Hou, Q. (2025) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52734.2025.01802 · Cited by 111
Self-citationOverview of Multi-Robot Collaborative SLAM from the Perspective of Data Fusion
Chen, W., Wang, X., Gao, S., Shang, G., Zhou, C., Li, Z., Xu, C., & Hu, K. (2023) · Machines · doi:10.3390/machines11060653 · Cited by 60
Self-citationGuo, P., Meng, W., & Bao, Y. (2023) · Construction and Building Materials · doi:10.1016/j.conbuildmat.2023.134812 · Cited by 33
Sparse Visual Counterfactual Explanations in Image Space
Boreiko, V., Augustin, M., Croce, F., Berens, P., & Hein, M. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-16788-1_9 · Cited by 55
ImageNet-E: Benchmarking Neural Network Robustness via Attribute Editing
Li, X., Chen, Y., Zhu, Y. P., Wang, S., Zhang, R., & Xue, H. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01951 · Cited by 44
Hu, V. T., Zhang, D. W., Asano, Y. M., Burghouts, G. J., & Snoek, C. G. M. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01766 · Cited by 59
Extracting Semantic Knowledge From GANs With Unsupervised Learning
Xu, J., Zhang, Z., & Hu, X. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3262140 · Cited by 25
Rapid Salient Object Detection With Difference Convolutional Neural Networks
Su, Z., Liu, L., Müller, M., Zhang, J., Wofk, D., Cheng, M., & Pietikäinen, M. (2025) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2025.3583968 · Cited by 36
Self-citationRethinking Self-Supervised Semantic Segmentation: Achieving End-to-End Segmentation
Liu, Y., Zeng, J., Tao, X., & Fang, G. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3432326 · Cited by 23
A human-in-the-loop method for pulmonary nodule detection in CT scans
Zeng, Q., Xie, Y., Lu, Z., & Xia, Y. (2024) · Visual Intelligence · doi:10.1007/s44267-024-00052-z · Cited by 19
SERE: Exploring Feature Self-Relation for Self-Supervised Transformer
Li, Z.-Y., Gao, S., & Cheng, M. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3309979 · Cited by 22
Self-citationMedScale-Former: Self-guided multiscale transformer for medical image segmentation
Karimijafarbigloo, S., Azad, R., Kazerouni, A., & Merhof, D. (2025) · Medical Image Analysis · doi:10.1016/j.media.2025.103554 · Cited by 17
Semantic matters: A constrained approach for zero-shot video action recognition
Quan, Z., Chen, J., Deguchi, D., Sun, J., Zhang, C., Li, Y., & Murase, H. (2025) · Pattern Recognition · doi:10.1016/j.patcog.2025.111402 · Cited by 23
NamedMask: Distilling Segmenters from Complementary Foundation Models
Shin, G., Xie, W., & Albanie, S. (2023) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw59228.2023.00524 · Cited by 23
Guo, P., Moghaddas, S. A., Liu, Y., Meng, W., Li, V. C., & Bao, Y. (2025) · Journal of Sustainable Cement-Based Materials · doi:10.1080/21650373.2025.2462183 · Cited by 29
Deep transfer learning for image classification: a survey
Plested, J., Phiri, M., & Gedeon, T. (2026) · Artificial Intelligence Review · doi:10.1007/s10462-026-11491-z · Cited by 126
Zero-shot Unsupervised Transfer Instance Segmentation
Shin, G., Albanie, S., & Xie, W. (2023) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw59228.2023.00513 · Cited by 12
Mai, Z., Zhang, P., Tu, C.-H., Chen, H.-Y., Nguyen, Q.-H., Zhang, L., & Chao, W. (2025) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52734.2025.01383 · Cited by 41
AeroClick: An advanced single-click interactive framework for aeroengine defect segmentation
Qi, H., Kong, X., Wang, Z., Gu, J., & Cheng, L. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2024.125093 · Cited by 9
FALIP: Visual Prompt as Foveal Attention Boosts CLIP Zero-Shot Performance
Zhuang, J., Hu, J., Mu, L., Hu, R., Liang, X., Ye, J., & Hu, H. R. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-72684-2_14 · Cited by 21
Self-supervised Semantic Segmentation: Consistency over Transformation
Karimijafarbigloo, S., Azad, R., Kazerouni, A., Velichko, Y., Bağcı, U., & Merhof, D. (2023) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw60793.2023.00280 · Cited by 7
Transformer framework for depth-assisted UDA semantic segmentation
Song, Y., Shi, J., Zou, D., Liu, C., Bai, S., Shu, X., Qian, Q., Xu, D., Yuan, Y., & Sun, Y. (2024) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2024.109206 · Cited by 7
Reducing Human Annotation Effort Using Self-supervised Learning for Image Segmentation
Siriborvornratanakul, T. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-60606-9_26 · Cited by 5
Generalized Probabilistic Graphical Modeling for Multi-View Bipartite Graph Clustering
Li, L., Pan, Y., Yao, Y., Zhang, J., Liu, M., Zhu, X., Liu, X., Li, K., Tsang, I. W.-H., & Li, K. (2025) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2025.3596764 · Cited by 5
Saadati, S., Hashemi, M., & NEZHAT, C. R. (2025) · Machine Learning with Applications · doi:10.1016/j.mlwa.2025.100767 · Cited by 6
BatStyler: Advancing Multi-Category Style Generation for Source-Free Domain Generalization
Xu, X., Qi, L., Zhou, J., et al. (2025) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2025.3525715 · Cited by 5
Towards Evaluating the Robustness of Visual State Space Models
Malik, H. S., Shamshad, F., Naseer, M., Nandakumar, K., Khan, F. S., & Khan, S. H. (2025) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw67362.2025.00339 · Cited by 9
Imbalance-Aware Discriminative Clustering for Unsupervised Semantic Segmentation
Liu, M., Zhang, J., & Tang, W. (2024) · International Journal of Computer Vision · doi:10.1007/s11263-024-02083-x · Cited by 4
DeepCut++: Graph-based unsupervised segmentation with feature fusion and diffusion learning
Aghayengejeh, N. P., Balafar, M. A., Tanha, J., & Baradarani, A. (2025) · Knowledge-Based Systems · doi:10.1016/j.knosys.2025.114975 · Cited by 8
Research on Transformer Fault Diagnosis and Maintenance Strategy Generation Based on TransQwen Model
Xue, Z., Wang, B., Ma, H., Zhang, J., Zhang, H., & Zhou, J. (2025) · Processes · doi:10.3390/pr13071977 · Cited by 4
Improving ViT interpretability with patch-level mask prediction
Kang, J., Heo, B., & Choe, J. (2024) · Pattern Recognition Letters · doi:10.1016/j.patrec.2024.11.018 · Cited by 4
Unbiased Semantic Decoding With Vision Foundation Models for Few-Shot Segmentation
Wang, J., Zhang, B., Pang, J., Liu, W., Liu, B., & Chen, H. (2025) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2025.3611497 · Cited by 5
Malik, H. S., Huzaifa, M. U., Naseer, M., Khan, S. H., & Khan, F. S. (2024) · Lecture notes in computer science · doi:10.1007/978-981-96-0917-8_23 · Cited by 8
Weakly supervised semantic segmentation based on deep learning
Weikang, X., Zhou, Q., Cui, J., Zhiyi, M., Wu, X., Ou, W., Wang, J., Wenyu, L., & 163318,China, 大. 1. C. P. S.-B. D. P. S. B. D. (2024) · Journal of Image and Graphics · doi:10.11834/jig.230628 · Cited by 3
Universal Organizer of Segment Anything Model for Unsupervised Semantic Segmentation
Li, T., Pei, G., Cai, X., Wang, Q., Liu, H., & Yao, Y. (2024) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme57554.2024.10687775 · Cited by 3
Enhancing Representations Through Heterogeneous Self-Supervised Learning
Li, Z.-Y., Yin, B., Liu, Y., Liu, L., & Cheng, M. (2025) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2025.3558989 · Cited by 7
Self-citationConcept-Level Semantic Transfer and Context-Level Distribution Modeling for Few-Shot Segmentation
Luo, Y., Chen, J., Cong, R., Ip, H. H. S., & Kwong, S. (2025) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2025.3554013 · Cited by 5
Passive Non-Line-of-Sight Imaging with Parallel Encoder
Du, X., Geng, R., Zhang, J., Chen, Y., & Hu, Y. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10887600 · Cited by 2
PASS-SAM: Integration of Segment Anything Model for Large-Scale Unsupervised Semantic Segmentation
Tang, Y., Chen, R., Pei, G., et al. (2025) · Computational Visual Media · doi:10.26599/cvm.2025.9450432 · Cited by 2
Explain with Confidence: Fusing Saliency Maps for Faithful and Interpretable Weakly-Supervised Model
Somani, A., Sekh, A. A., & Prasad, D. K. (2025) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw69036.2025.00036 · Cited by 4
Building element recognition with MTL-AINet considering view perspectives
Zhang, R., Jing, M., Lu, G., Yi, X., Shi, S., Huang, Y., & Liu, L. (2023) · Open Geosciences · doi:10.1515/geo-2022-0506 · Cited by 1
S2FB IoU: Improving Boundary-based Object-Centric Image Segmentation Quality Evaluation
Filali, R. E., Jdaba, S., Xie, R., et al. (2024) · ACM International Conference on Multimedia in Asia (MMAsia) · doi:10.1145/3696409.3700238 · Cited by 1
Qiao, H., Qian, W., Hu, H., Huang, X., & Li, J. (2024) · Sensors · doi:10.3390/s24165205 · Cited by 1
LaFAM: Unsupervised Feature Attribution with Label-Free Activation Maps
Karjauv, A., & Albayrak, Ş. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-70893-0_24 · Cited by 4
Progressive Proxy Anchor Propagation for Unsupervised Semantic Segmentation
Seong, H. S., Moon, W., Lee, S., & Heo, J. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-72967-6_26 · Cited by 4
Explain and Monitor Deep Learning Models for Computer Vision using Obz AI
Chung, N. C., & Binda, J. (2025) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3746252.3761486 · Cited by 1
Repurposing SAM for User-Defined Semantics Aware Segmentation
Kundu, R., Paul, S., Dutta, A., & Roy–Chowdhury, A. K. (2025) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw67362.2025.00347 · Cited by 1
Research progress and challenges in real-time semantic segmentation for deep learning
Wang, Z., & Qu, S. (2024) · Journal of Image and Graphics · doi:10.11834/jig.230605 · Cited by 2
GiVE: Guiding Visual Encoder to Perceive Overlooked Information
Li, J., Ma, J., Zhang, X., Li, Y., & Shi, J. (2025) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme59968.2025.11210151 · Cited by 3
Decouple Before Align: Visual Disentanglement Enhances Prompt Tuning
Zhang, F., Zhou, T., Yao, J., Zhang, Y., Tsang, I. W.-H., & Wang, Y. (2025) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2025.3594894 · Cited by 12
Generating Visual Explanations from Deep Networks Using Implicit Neural Representations
Byra, M., & Skibbe, H. (2025) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv61041.2025.00327 · Cited by 1
FuzzySegNet: Deep Fuzzy Neural Network for Corrupted Image Segmentation
Wang, X., Han, H.-G., & Wu, X. (2024) · China Automation Congress (CAC) · doi:10.1109/cac63892.2024.10865617 · Cited by 1
Visualization and Analysis of CNN Adversarial Training
Liu, D. (2024) · Smart innovation, systems and technologies · doi:10.1007/978-981-97-5181-5_13
Boundary Constraint and Dynamic Graph Feature Decoupling for Weakly Supervised Semantic Segmentation
Liu, Z., Li, B., Li, C., Ding, S., Yu, M., & Huang, D. (2026) · IEEE Transactions on Emerging Topics in Computational Intelligence · doi:10.1109/tetci.2026.3686171
A Fast Retrieval Algorithm for Person Re-Identification Based on Hash
Huang, Y., Han, F., Chen, J., Cao, J., & Shan, C. (2025) · International Conference on Intelligent Computing and Data Mining (ICDM) · doi:10.1109/icdm68174.2025.11309542
Effective Optimization of Root Selection Towards Improved Explanation of Deep Classifiers
Zhang, X., Zhong, S.-H., & Jiang, J. (2024) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3664647.3680866
Igah, C. O., Ricardo, F. A., Dimonyeka, C., Moru, D. K., Iparraguirre, O., & Borro, D. (2026) · Neurocomputing · doi:10.1016/j.neucom.2026.135237
FedMTL: Federated Semantic Segmentation in Multi-type Label Scenarios
Yao, J., Dong, C., Li, X., & Jiao, Y. (2025) · Arabian Journal for Science and Engineering · doi:10.1007/s13369-025-10342-3 · Cited by 1
Efficient Framework for Unsupervised and Semi-Supervised Segmentation and Localization of VideosPreprint
Saadati, S., & Sepahvand, A. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.6597662
PAT-ViT: Token Pruning-based Adversarial Tuning for Robust Vision Transformers
Yang, Y., Luo, Y.-J., Chen, W., Wu, A.-Y. A., Huang, S.-H., & Bereković, M. (2025) · IEEE International Symposium on Circuits and Systems proceedings · doi:10.1109/iscas56072.2025.11044207
Class-disentangled attribution with gradient guidance for CLIP
Li, F., Meng, Z., Tan, C., & Yin, Y. (2026) · Journal of King Saud University - Computer and Information Sciences · doi:10.1007/s44443-026-00779-3
Evaluating Harmony: Neural Network Explanation Metrics and Human Perception
Vukadin, D., Šilić, M., Delač, G., & Vladimir, K. (2024) · International Convention on Information and Communication Technology, Electronics and Microelectronics · doi:10.1109/mipro60963.2024.10569295
AI-Based Automatic Prostate Gland Segmentation in Multi-modal Medical Imaging: A Review
Xu, D., Jin, R., Lu, F., Li, D., Xiang, D., Zhang, L., Zhou, H., Shi, F., Zhu, W., Cai, J., et al. (2025) · IEEE Transactions on Artificial Intelligence · doi:10.1109/tai.2025.3640597 · Cited by 4
A Study on Semi-Supervised Semantic Segmentation of Ship Flame Images
Wan, J., Chen, Y., & Zheng, X. (2023) · IEEE International Conference on Parallel and Distributed Systems (ICPADS) · doi:10.1109/icpads60453.2023.00177 · Cited by 1
SERE: Exploring Feature Self-relation for Self-supervised TransformerPreprint
Li, Z., Gao, S., & Cheng, M. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2206.05184
Self-citationSu, J., Luo, Q., Sun, S., Hou, Y., Zhang, X., Heikkilä, J., Yang, C., & Liu, L. (2026) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2026.3673339
NLOS-R 2 : Alternate Reconstruction and Recognition for Non-Line-of-Sight Understanding
Wang, Y., Geng, R., Zhang, J., et al. (2025) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme59968.2025.11209224
Piekarek, Ł., & Szyc, K. (2025) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw69036.2025.00030 · Cited by 2
Federated semantic segmentation method with heterogeneous labeled data
Dong, C., Yao, J., Li, X., & Jiao, Y. (2024) · International Conference on Artificial Intelligence and Electromechanical Automation (AIEA) · doi:10.1109/aiea62095.2024.10692700
CE-FAM: Concept-Based Explanation via Fusion of Activation Maps
Kuroki, M., & Yamasaki, T. (2025) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51701.2025.00139 · Cited by 2
FuseTeacher: Modality-Fused Encoders are Strong Vision Supervisors
Xie, C.-W., Sun, S., Zhao, L., Li, P., Ma, S., & Zheng, Y. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-73195-2_17
SkipPLUS: Skip the First Few Layers to Better Explain Vision Transformers
Mehri, F., Fayyaz, M., Baghshah, M. S., & Pilehvar, M. T. (2024) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw63382.2024.00025 · Cited by 8
FIG: Frequency-Based Integrated Gradients for Robust Feature Attribution
Yang, K., Niu, Z., Xie, F., et al. (2026) · IEEE International Conference on Acoustics, Speech, and Signal Processing · doi:10.1109/icassp55912.2026.11463908
Owen-Based Semantics and Hierarchy-Aware Explanation (O-Shap)
Zhou, X., Xiao, C., & Weng, Y. (2025) · Proceedings · doi:10.1109/icdm65498.2025.00187
Metadata
- Authors
- Gao, S., Li, Z.-Y., Yang, M.-H., Cheng, M.-M., Han, J., & Torr, P.
- Affiliations
- Nankai University (CN)
- University of California, Merced (US)
- Northwestern Polytechnical University (CN)
- University of Oxford (GB)
- Venue
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- Published
- 2023-06-01
- Volume
- 45
- Issue
- 6
- Pages
- 7457-7476
- ISSN
- 0162-8828 (ISSN-L)
- 2160-9292
- 1939-3539
- OpenAlex
- W4307844773
- Cited by
- 88
- References
- 156
- Citations by year
- 2026: 10 · 2025: 33 · 2024: 26 · 2023: 14
- FWCI
- 6.30
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- IEEE Transactions on Pattern Analysis and Machine Intelligence (publishedVersion)
- PubMed (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- National Key Research and Development Program of China (2018AAA0100400)
- National Natural Science Foundation of China (62225604)
- Fundamental Research Funds for the Central Universities (63223050)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Medical Image Segmentation Techniques
- Keywords
- unsupervised semantic segmentation, benchmark dataset, weakly supervised segmentation, ImageNet
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-07, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-07 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.