The DOI matches its DataCite record; 74 of the 75 references it cites were found in a registry or an index.
Causal Intervention for Weakly-Supervised Semantic Segmentation
Open accessAbstract
We present a causal inference framework to improve Weakly-Supervised Semantic Segmentation (WSSS). Specifically, we aim to generate better pixel-level pseudo-masks by using only image-level labels -- the most crucial step in WSSS. We attribute the cause of the ambiguous boundaries of pseudo-masks to the confounding context, e.g., the correct image-level classification of "horse" and "person" may be not only due to the recognition of each instance, but also their co-occurrence context, making the model inspection (e.g., CAM) hard to distinguish between the boundaries. Inspired by this, we propose a structural causal model to analyze the causalities among images, contexts, and class labels. Based on it, we develop a new method: Context Adjustment (CONTA), to remove the confounding bias in image-level classification and thus provide better pseudo-masks as ground-truth for the subsequent segmentation model. On PASCAL VOC 2012 and MS-COCO, we show that CONTA boosts various popular WSSS methods to new state-of-the-arts.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“CONTA [63] attributes the cause of the ambiguous boundaries of segmentation to the confounding context and clears this spurious association through the backdoor intervention.”
From Unbiased Embodied Visual Representation Learning with Causal Inference and Cross-Modality Alignment (2025) · cites this paper as [63]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
U-Net: Convolutional Networks for Biomedical Image Segmentation
Ronneberger, O., Fischer, P., & Brox, T. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24574-4_28 · Cited by 99,404
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
Microsoft COCO: Common Objects in Context
Lin, T.-Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollár, P., & Zitnick, C. L. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10602-1_48 · Cited by 45,460
Fully convolutional networks for semantic segmentation
Long, J., Shelhamer, E., & Darrell, T. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298965 · Cited by 38,834
(2016) · Cited by 31,590
Girshick, R. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.169 · Cited by 28,105
Research works printed but not linked: 3
- [16][16] Ross Girshick. Fast r-cnn. In ICCV , 2015. 4 -
- [34][34] Min Lin, Qiang Chen, and Shuicheng Yan. Network in network. In ICLR , 2014. 5 -
- [74][74] Bolei Zhou, Aditya Khosla, Agata Lapedriza, Aude Oliva, and Antonio Torralba. Learning deep features for discriminative localization. In CVPR , 2016. 1, 4, 5, 16, 17
Cited by
Sorted by citations
Items 301–362 of 362
Weakly supervised semantic segmentation based on deep learning
Weikang, X., Zhou, Q., Cui, J., Zhiyi, M., Wu, X., Ou, W., Wang, J., Wenyu, L., & 163318，China, 大. 1. C. P. S.-B. D. P. S. B. D. (2024) · Journal of Image and Graphics · doi:10.11834/jig.230628 · Cited by 3
Toward Quantifiable Face Age Transformation Under Attribute Unbias
Lin, L., Wang, T., Liu, H., Zhu, C., & Chen, J. (2024) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2024.3422661 · Cited by 3
Addressing Noisy Pixels in Weakly Supervised Semantic Segmentation with Weights Assigned
Qian, F., Yang, J., Tang, S., Gao, C., & Yan, J. (2024) · Mathematics · doi:10.3390/math12162520 · Cited by 2
Liu, W., Ni, Z., Zhu, X., Chen, Q., Ni, L., & Xia, P. (2025) · Medical Image Analysis · doi:10.1016/j.media.2025.103741 · Cited by 2
Inter-image Token Relation Learning for weakly supervised semantic segmentation
Tang, J., Cheng, K., Wei, L., & Zhan, Y. (2025) · Journal of Visual Communication and Image Representation · doi:10.1016/j.jvcir.2025.104576 · Cited by 2
Self-citationImproving Weakly Supervised Sound Event Detection with Causal Intervention
Xin, Y., Yang, D., Cui, F., Wang, Y., & Zou, Y. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10096245 · Cited by 2
David, L., Pedrini, H., & Dias, Z. (2024) · Journal of Visual Communication and Image Representation · doi:10.1016/j.jvcir.2024.104187 · Cited by 2
Recursive Counterfactual Deconfounding for image recognition
Sun, J., Gao, M., Wang, H., & Dong, Q. (2025) · Knowledge-Based Systems · doi:10.1016/j.knosys.2025.113245 · Cited by 2
Causal recurrent intervention for cross-modal cardiac image segmentation
Lin, Q., Guo, S., Zhang, H., & Gao, Z. (2025) · Computerized Medical Imaging and Graphics · doi:10.1016/j.compmedimag.2025.102549 · Cited by 2
Self-citationTowards Causality Inference for Very Important Person Localization
Wang, X., Wang, Z., Liu, W., Xu, X., Zhao, Q., & Satoh, S. (2022) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3503161.3548014 · Cited by 2
Wang, Y., Luo, F., Zhang, H., & Huo, Z. (2022) · International Conference on Networks, Communication and Computing (ICNCC) · doi:10.1145/3579895.3579903 · Cited by 2
Self-citationCin-Seg: Causal Invariance for Tag-Supervised Segmentation on Medical Images
Chen, Z., Tian, Z., Zhu, J., Du, S., & Sun, Q. (2024) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2024.3400353 · Cited by 2
Self-citationBoosting Weakly-Supervised Image Segmentation via Representation, Transform, and Compensator
Wang, C., Zhang, D., & Yan, R. (2024) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2024.3413778 · Cited by 2
Self-citationWeakly Supervised Semantic Segmentation with Patch-Based Metric Learning Enhancement
Chan, P. P. K., Chen, K., Xu, L., Hu, X., & Yeung, D. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-86365-4_38 · Cited by 2
Topic-Aware Causal Intervention for Counterfactual DetectionPreprint
Nguyen, T. T., & Nguyen, T.-M. (2023) · doi:10.36227/techrxiv.24225808.v1 · Cited by 2
CIFair: Constructing continuous domains of invariant features for image fair classifications
Tian, H., Liu, B., Zhu, T., Zhou, W., & Yu, P. S. (2023) · Knowledge-Based Systems · doi:10.1016/j.knosys.2023.110417 · Cited by 1
Multiscale Superpixel Affinity for Improved Weakly Supervised Semantic Segmentation
Fu, Y. W., Wang, W., & Zhu, L. (2024) · Chinese Control and Decision Conference (CCDC) · doi:10.1109/ccdc62350.2024.10588216 · Cited by 1
A Weakly Supervised Semantic Segmentation Method Based on Improved Conformer
Shen, X., & Wang, M. (2025) · Computers, materials & continua/Computers, materials & continua (Print) · doi:10.32604/cmc.2025.059149 · Cited by 1
Fujimori, I., Oono, M., & Shishibori, M. (2025) · Journal of Visual Communication and Image Representation · doi:10.1016/j.jvcir.2025.104404 · Cited by 1
Causal Inference Hashing for Long-Tailed Image Retrieval
Jin, L., Lu, Z., Li, Z., Pan, Y., Dai, L., Tang, J., & Jain, R. (2025) · IEEE Transactions on Image Processing · doi:10.1109/tip.2025.3588054 · Cited by 1
Self-citationWeakly supervised semantic segmentation with multi-task learning and segment anything model
Xue, Z., Guo, D., Chen, D., & Liu, S. (2025) · Neurocomputing · doi:10.1016/j.neucom.2025.131131 · Cited by 1
Weak-shot Semantic Segmentation Based on Encoder-Decoder Structure
Zhang, Y., Wang, Y., Wei, Y., Feng, B., Hu, X., Guo, D., & Zou, B. (2023) · International Conference on Software Engineering and Computer Science (CSECS) · doi:10.1109/csecs60003.2023.10428525 · Cited by 1
Multiple Instance Learning with Fine-grained Causal Intervention for Histopathological Diagnosis
Song, X. (2024) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn60899.2024.10651005 · Cited by 1
Hierarchical Activation Dual-Backbone Network for Weakly Supervised Semantic Segmentation
Zhang, C., & Zhang, L. (2024) · IEEE Sensors Journal · doi:10.1109/jsen.2024.3457312 · Cited by 1
WSSS-CRAM: precise segmentation of histopathological images via class region activation mapping
Pan, N., Mi, X., Li, H., Ge, X., Sui, X., & Jiang, Y. (2024) · Frontiers in Microbiology · doi:10.3389/fmicb.2024.1483052 · Cited by 1
Wang, W., Zeng, C., Wang, H., & Zhou, L. (2024) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2024.104260 · Cited by 1
Structural Relation Multi-Class Token Transformer for Weakly Supervised Semantic Segmentation
Peng, D., & Kameyama, W. (2024) · IEICE Transactions on Information and Systems · doi:10.1587/transinf.2024edp7125 · Cited by 1
Xu, R., Wang, C., Xu, S., Meng, W., & Zhang, X. (2025) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2025.3545166 · Cited by 2
Qin, Y., & Ai, X. (2025) · Advanced Engineering Informatics · doi:10.1016/j.aei.2025.103237 · Cited by 1
Research on Fault Diagnosis Method Based on Structural Causal Model in Tennessee Eastman Process
Pu, H., Liu, J., Chen, Z., Yang, X., Ren, C., Xu, Z., & Jian, Y. (2023) · Lecture notes in electrical engineering · doi:10.1007/978-981-99-2730-2_79 · Cited by 1
Joint Image Restoration For Weakly Supervised Semantic Segmentation
Mai, J., Zhang, C., Ma, C., & Yang, W. (2023) · Chinese Control Conference (CCC) · doi:10.23919/ccc58697.2023.10239739 · Cited by 1
An adaptive incremental two-stage framework for crack defect detection
Guo, Q., Li, C., Deng, X., Dong, X., & Zhang, C. (2024) · Multimedia Tools and Applications · doi:10.1007/s11042-024-18133-y · Cited by 1
Towards Omni-supervised Referring Expression Segmentation
Huang, M., Zhou, Y., Luo, G., Jiang, G., Zhuang, W., & Sun, X. (2024) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme57554.2024.10687826 · Cited by 1
Image segmentation with less manual labeling effort
Liu, W. (2022) · doi:10.32657/10356/162800 · Cited by 1
Unbiased Embodied Visual Representation Learning with Causal Inference and Cross-Modality Alignment
Kang, J., Chen, B., Zhong, P., Wang, Y., Yang, H., & Sheng, Y. (2025) · ACM Transactions on Multimedia Computing, Communications, and Applications · doi:10.1145/3760261
Towards robust inference against distribution shifts in computer vision
Tang, K. (2021) · DR-NTU (Nanyang Technological University) · doi:10.32657/10356/154119
Critical Analysis of Deconfounded Pretraining to Improve Visio-Linguistic Models
Cornille, N., Laenen, K., & Moens, M.-F. (2022) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2022.736791 · Cited by 1
Li, Z., Xuan, S., Wang, L., & Wang, K. (2022) · Current Medical Imaging Formerly Current Medical Imaging Reviews · doi:10.2174/1573405618666220820112145
Rolling Bearing Fault Diagnosis with Disentangled and Robust Causal Model
Ding, X., Wang, H., Wang, S., Zhang, Y., Zhu, Q., & Zhou, H. (2022) · International Conference on Sensing, Measurement & Data Analytics in the era of Artificial Intelligence (ICSMD) · doi:10.1109/icsmd57530.2022.10058362
ICTCAM: Introducing Convolution to Transformer-Based Weakly Supervised Semantic Segmentation
Tan, D., Liu, Y., Xiao, H., Peng, Y., & Zhang, M. (2022) · IEEE International Conference on Computer and Communications (ICCC) · doi:10.1109/iccc56324.2022.10065791
DCAM: Disturbed class activation maps for weakly supervised semantic segmentation
Lei, J., Yang, G., Wang, S., Feng, Z., & Liang, R. (2023) · Journal of Visual Communication and Image Representation · doi:10.1016/j.jvcir.2023.103852
3D Nuclei Segmentation through Deep Learning
Rojas, R., Navarro, C. F., Orellana, G. A., Lemus, C. G., & Castañeda, V. (2023) · IEEE Conference on Artificial Intelligence (CAI) · doi:10.1109/cai54212.2023.00137
Joint Statistical and Causal Feature Modulated Face Anti-Spoofing
Dong, X., Wang, T., Li, Z., & Liu, H. (2023) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme55011.2023.00210
Exploring Information Bottleneck for Weakly Supervised Semantic Segmentation
Qin, J., Lyu, Y., & Wang, X. (2023) · Frontiers in artificial intelligence and applications · doi:10.3233/faia230480
Mo, J., Jun-liang, H., Yuan, H., & Lin, L. (2023) · International Conference on Artificial Intelligence and Computer Science (AICS) · doi:10.1117/12.3009544
Ness, P. M., Marijan, D., & Bose, S. (2023) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3583780.3614960
Self-attention fusion and modulation for weakly supervised semantic segmentation
Shi, D., Li, J., & Liu, Q. (2023) · Journal of Image and Graphics · doi:10.11834/jig.221121
ECT: Enhancement Cross Training for Weakly Supervised Semantic Segmentation
Mai, J., Ma, C., Zhang, C., & Yang, W. (2023) · Youth Academic Annual Conference of Chinese Association of Automation (YAC) · doi:10.1109/yac59482.2023.10401660
Bi-Branch Weakly Supervised Semantic Segmentation with Transformer
Wang, Y. (2024) · Academic Journal of Computing & Information Science · doi:10.25236/ajcis.2024.070303
High-fidelity Pseudo-labels for Boosting Weakly-Supervised Segmentation
Jonnarth, A., Zhang, Y., & Felsberg, M. (2024) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv57701.2024.00105
The Study of Weakly Supervised Semantic Segmentation Algorithm Based on Explicit Pseudo-PixelPreprint
Ma, K., Guo, Y., & Li, G. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4830895
Discovering an inference recipe for weakly-supervised object localization
Lee, S., Mun, C., Uh, Y., Choe, J., & Byun, H. (2024) · Pattern Recognition · doi:10.1016/j.patcog.2024.110838
Weakly Supervised Semantic Segmentation Network Based on Feature Decoupling and Pixel Aggregation
Ding, X., & Zhao, W. (2024) · China Automation Congress (CAC) · doi:10.1109/cac63892.2024.10865471
Lyu, Y., Xu, L., Bennamoun, M., Boussaïd, F., & Dwivedi, G. (2024) · International Conference on Digital Image Computing: Techniques and Applications (DICTA) · doi:10.1109/dicta63115.2024.00052 · Cited by 1
GMM-Based Bootstrap Prototype-Aware Learning For Weakly Supervised Semantic Segmentation
Wu, Y. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10889275
Learning High-Order Features for Fine-Grained Visual Categorization with Causal Inference
Zhang, Y., Wan, Y., Hao, J., Yang, Z., & Li, H. (2025) · Mathematics · doi:10.3390/math13081340
Synergy-driven multi-modal prompting for weakly supervised semantic segmentation
Zhao, Y., Liu, C., Wang, Z., Peng, X., Chen, Z., & Wu, Q. M. J. (2025) · Neurocomputing · doi:10.1016/j.neucom.2025.130504
Enhanced Foreground–Background Discrimination for Weakly Supervised Semantic Segmentation
Liu, Z., Li, B., Yu, M., Gao, G., & Li, C. (2025) · IET Computer Vision · doi:10.1049/cvi2.70029
Joint Attention Mechanism and Multi-task Learning for Weakly Supervised Skin Image Segmentation
Wang, Y., Wang, Q., & Fan, H. (2025) · IEEE Congress on Evolutionary Computation (CEC) · doi:10.1109/cec65147.2025.11043093
Cost Analysis of PEM Electrolysis Utilizing Small Modular Reactors in H2 Production
Bonyaniakbarabadi, M. (2025) · doi:10.31390/gradschool_theses.6203
Metadata
- Authors
- Zhang, D., Zhang, H., Tang, J., Hua, X., & Sun, Q.
- Affiliations
- Nanjing University of Science and Technology (CN)
- Nanyang Technological University (SG)
- Singapore Management University (SG)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2020
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 2009.12547
- OpenAlex
- W3088940539
- Cited by
- 353
- References
- 75
- Citations by year
- 2025: 49 · 2024: 87 · 2023: 104 · 2022: 70 · 2021: 40 · 2020: 3
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- Rare & Special e-Zone (The Hong Kong University of Science and Technology) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Medical Image Segmentation Techniques
- Keywords
- weakly supervised semantic segmentation, pseudo-mask generation, image-level labels, structural causal models, confounding
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
