Perspective-Adaptive Convolutions for Scene Parsing
The DOI matches its Crossref record; 58 of the 58 references it cites were found in a registry or an index.
Abstract
Many existing scene parsing methods adopt Convolutional Neural Networks with receptive fields of fixed sizes and shapes, which frequently results in inconsistent predictions of large objects and invisibility of small objects. To tackle this issue, we propose perspective-adaptive convolutions to acquire receptive fields of flexible sizes and shapes during scene parsing. Through adding a new perspective regression layer, we can dynamically infer the position-adaptive perspective coefficient vectors utilized to reshape the convolutional patches. Consequently, the receptive fields can be adjusted automatically according to the various sizes and perspective deformations of the objects in scene images. Our proposed convolutions are differentiable to learn the convolutional parameters and perspective coefficients in an end-to-end way without any extra training supervision of object sizes. Furthermore, considering that the standard convolutions lack contextual information and spatial dependencies, we propose a context adaptive bias to capture both local and global contextual information through average pooling on the local feature patches and global feature maps, followed by flexible attentive summing to the convolutional results. The attentive weights are position-adaptive and context-aware, and can be learned through adding an additional context regression layer. Experiments on Cityscapes and ADE20K datasets well demonstrate the effectiveness of the proposed methods.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2577031 · Cited by 73,472
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2015) · arXiv · doi:10.48550/arxiv.1506.01497 · Cited by 70,812
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333 · cited 3×
“This network transfers the ResNet101 model [3] pre-trained on ImageNet dataset [4] to the convolu-tional-deconvolutional structure.”
BackgroundMethodFully convolutional networks for semantic segmentation
Long, J., Shelhamer, E., & Darrell, T. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298965 · Cited by 38,834
He, K., Gkioxari, G., Dollar, P., & Girshick, R. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.322 · Cited by 29,137
Chen, L.-C., Papandreou, G., Kokkinos, I., Murphy, K., & Yuille, A. L. (2018) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2699184 · Cited by 22,392
SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation
Badrinarayanan, V., Kendall, A., & Cipolla, R. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2644615 · Cited by 19,631
Cited by
CGNet: A Light-Weight Context Guided Network for Semantic Segmentation
Wu, T., Tang, S., Zhang, R., Cao, J., & Zhang, Y. (2021) · IEEE Transactions on Image Processing · doi:10.1109/tip.2020.3042065 · Cited by 859
Self-citationDomain-Aware Visual Bias Eliminating for Generalized Zero-Shot Learning
Min, S., Yao, H., Xie, H., Wang, C., Zha, Z.-J., & Zhang, Y. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01268 · Cited by 181
Self-citationBoundary Perception Guidance: A Scribble-Supervised Semantic Segmentation Approach
Wang, B., Qi, G.-J., Tang, S., Zhang, T., Wei, Y., Li, L., & Zhang, Y. (2019) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2019/508 · Cited by 86
Self-citationPale Transformer: A General Vision Transformer Backbone with Pale-Shaped Attention
Wu, S., Wu, T., Tan, H., & Guo, G. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i3.20176 · Cited by 110
Few-Shot Structured Domain Adaptation for Virtual-to-Real Scene Parsing
Zhang, J., Chen, Z., Huang, J., Lin, L., & Zhang, D. (2019) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2019.00008 · Cited by 28
PMMN: Pre-trained multi-Modal network for scene text recognition
Zhang, Y., Fu, Z., Huang, F., & Liu, Y. (2021) · Pattern Recognition Letters · doi:10.1016/j.patrec.2021.07.016 · Cited by 21
Self-citationA Deep Semantic Segmentation Network With Semantic and Contextual Refinements
Wang, Z., Liu, D., Wu, L. Y., Wang, S., Guo, X., & Qi, L. (2025) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2025.3543037 · Cited by 20
A Non-Linear Convolution Network for Image Processing
Marsi, S., Bhattacharya, J., Molina, R., & Ramponi, G. (2021) · Electronics · doi:10.3390/electronics10020201 · Cited by 16
Cracks identification using mask region-based denoised deformable convolutional network
Kee, K. W., Lim, K. H., Lim, C. H., Lim, W. L., & Yap, H. E. (2022) · Multimedia Tools and Applications · doi:10.1007/s11042-022-13422-w · Cited by 6
Zhong, D., Cai, L., Li, S., Wang, W., Zhu, Y., Liu, Y., & Yang, R. (2025) · Remote Sensing · doi:10.3390/rs17173082 · Cited by 5
Progressive Knowledge-Embedded Unified Perceptual Parsing for Scene Understanding
Zheng, W., Yan, L., Wang, F., & Gou, C. (2021) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw53098.2021.00179 · Cited by 5
Multi-Resolution and Multi-Domain Analysis of Off-Road Datasets for Autonomous Driving
Mayuku, O., Surgenor, B. W., & Marshall, J. A. (2021) · Canadian Conference on Computer and Robot Vision · doi:10.1109/crv52889.2021.00030 · Cited by 8
Consensus Feature Network for Scene Parsing
Wu, T., Tang, S., Zhang, R., & Guo, G. (2021) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2021.3094333 · Cited by 7
Self-citationDeep Learning Model with GA-based Visual Feature Selection and Context Integration
Mandal, R., Azam, B., Verma, B., & Zhang, M. (2021) · IEEE Congress on Evolutionary Computation (CEC) · doi:10.1109/cec45853.2021.9504753 · Cited by 4
Cross-Domain Traffic Scene Understanding by Integrating Deep Learning and Topic Model
Yang, Y., Dong, H., Liu, G., Zhang, L., & Li, L. (2022) · Computational Intelligence and Neuroscience · doi:10.1155/2022/8884669 · Cited by 3
Deep Learning for Robot Vision
Mamilla, K. R., & Anto, S. (2021) · Smart innovation, systems and technologies · doi:10.1007/978-981-33-4443-3_34 · Cited by 1
Spatial Pyramid-based Wavelet Embedding Deep Convolutional Neural Network for Semantic Segmentation
Liu, J., Liu, Y., & Sun, Q. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-02375-0_24 · Cited by 1
Counterfactual Balancing Feature Alignment for Few-Shot Cross-Domain Scene Parsing
Sun, C. M., Chen, Z., & Lin, L. (2023) · IEEE Access · doi:10.1109/access.2023.3263561 · Cited by 4
A Novel Optimized Context-Based Deep Architecture for Scene Parsing
Mandal, R., Verma, B., Azam, B., & Selvaraj, H. (2023) · Communications in computer and information science · doi:10.1007/978-981-99-1645-0_29 · Cited by 1
Context-Based Deep Learning Architecture with Optimal Integration Layer for Image Parsing
Mandal, R., Azam, B., & Verma, B. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-92270-2_25 · Cited by 1
2020 Index IEEE Transactions on Pattern Analysis and Machine Intelligence Vol. 42
(2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.3036557 · Cited by 3
Log-Polar Space Convolution for Convolutional Neural NetworksPreprint
Su, B., & Wen, J.-R. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2107.11943 · Cited by 3
Distorted Vehicle Detection and Distance Estimation by Metric Learning-Based SSD
Zhang, F., Jin, Y., Kan, S., Zhang, L., Cen, Y., & Jin, W. (2021) · International Journal of Computational Intelligence Systems · doi:10.2991/ijcis.d.210419.001
Genetic Algorithms for Optimising Context-based Neural Networks for Image Segmentation
Mandal, R., Azam, B., Verma, B., & Zhang, M. (2022) · IEEE Symposium Series on Computational Intelligence (SSCI) · doi:10.1109/ssci51031.2022.10022103
Metadata
- Authors
- Zhang, R., Tang, S., Zhang, Y., Li, J., & Yan, S.
- Affiliations
- Chinese Academy of Sciences (CN)
- Qihoo 360 (China) (CN)
- Venue
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- Published
- 2020-04-01
- Volume
- 42
- Issue
- 4
- Pages
- 909-924
- ISSN
- 0162-8828 (ISSN-L)
- 2160-9292
- 1939-3539
- OpenAlex
- W2907052985
- Cited by
- 25
- References
- 58
- Citations by year
- 2025: 2 · 2023: 2 · 2022: 5 · 2021: 10 · 2020: 4
- FWCI
- 2.32
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- Locations
- IEEE Transactions on Pattern Analysis and Machine Intelligence (publishedVersion)
- PubMed (publishedVersion)
- Funders
- National Natural Science Foundation of China (61525206, 61572472)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Remote-Sensing Image Classification
- Keywords
- scene parsing, semantic segmentation, receptive field adaptation, attention mechanism, small object detection, cityscape, ADE20K
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.