The DOI matches its Crossref record; 54 of the 54 references it cites were found in a registry or an index.
Transformer Meets Convolution: A Bilateral Awareness Network for Semantic Segmentation of Very Fine Resolution Urban Scene Images
Open accessAbstract
Semantic segmentation from very fine resolution (VFR) urban scene images plays a significant role in several application scenarios including autonomous driving, land cover classification, urban planning, etc. However, the tremendous details contained in the VFR image, especially the considerable variations in scale and appearance of objects, severely limit the potential of the existing deep learning approaches. Addressing such issues represents a promising research field in the remote sensing community, which paves the way for scene-level landscape pattern analysis and decision making. In this paper, we propose a Bilateral Awareness Network which contains a dependency path and a texture path to fully capture the long-range relationships and fine-grained details in VFR images. Specifically, the dependency path is conducted based on the ResT, a novel Transformer backbone with memory-efficient multi-head self-attention, while the texture path is built on the stacked convolution operation. In addition, using the linear attention mechanism, a feature aggregation module is designed to effectively fuse the dependency features and texture features. Extensive experiments conducted on the three large-scale urban scene image segmentation datasets, i.e., ISPRS Vaihingen dataset, ISPRS Potsdam dataset, and UAVid dataset, demonstrate the effectiveness of our BANet. Specifically, a 64.6% mIoU is achieved on the UAVid dataset.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
U-Net: Convolutional Networks for Biomedical Image Segmentation
Ronneberger, O., Fischer, P., & Brox, T. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24574-4_28 · Cited by 99,404
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Fully convolutional networks for semantic segmentation
Long, J., Shelhamer, E., & Darrell, T. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298965 · Cited by 38,834
Swin Transformer: Hierarchical Vision Transformer using Shifted Windows
Liu, Z., Lin, Y., Cao, Y., Hu, H., Wei, Y., Zhang, Z., Lin, S., & Guo, B. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00986 · Cited by 35,534
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S., & Szegedy, C. (2015) · arXiv · doi:10.48550/arxiv.1502.03167 · Cited by 27,818
Xception: Deep Learning with Depthwise Separable Convolutions
Chollet, F. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.195 · Cited by 20,380
(2010) · International Conference on Machine Learning · Cited by 13,995
Wang, X., Girshick, R., Gupta, A., & He, K. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00813 · Cited by 11,596
Multi-scale context aggregation by dilated convolutions
Yu, F., & Koltun, V. (2015) · arXiv · doi:10.48550/arxiv.1511.07122 · Cited by 7,738
Dual Attention Network for Scene Segmentation
Fu, J., Liu, J., Tian, H., Li, Y., Bao, Y., Fang, Z., & Lu, H. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00326 · Cited by 7,351
Random forest classifier for remote sensing classification
Pal, M. (2005) · International Journal of Remote Sensing · doi:10.1080/01431160412331269698 · Cited by 3,283
CCNet: Criss-Cross Attention for Semantic Segmentation
Huang, Z., Wang, X., Huang, L., Huang, C., Wei, Y., & Liu, W. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00069 · Cited by 3,045
BiSeNet: Bilateral Segmentation Network for Real-Time Semantic Segmentation
Yu, C., Wang, J., Peng, C., Gao, C., Yu, G., & Sang, N. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01261-8_20 · Cited by 2,968
Efficient Inference in Fully Connected CRFs with Gaussian Edge Potentials
Krähenbühl, P., & Koltun, V. (2012) · arXiv · doi:10.48550/arxiv.1210.5644 · Cited by 2,908
Deep learning in remote sensing applications: A meta-analysis and review
Ma, L., Liu, Y., Zhang, X., Ye, Y., Yin, G., & Johnson, B. A. (2019) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2019.04.015 · Cited by 2,456
ResUNet-a: A deep learning framework for semantic segmentation of remotely sensed data
Diakogiannis, F. I., Waldner, F., Caccetta, P., & Wu, C. (2020) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2020.01.013 · Cited by 2,153
ICNet for Real-Time Semantic Segmentation on High-Resolution Images
Zhao, H., Qi, X., Shen, X., Shi, J., & Jia, J. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01219-9_25 · Cited by 1,709
Zhang, Q., & Seto, K. C. (2011) · Remote Sensing of Environment · doi:10.1016/j.rse.2011.04.032 · Cited by 712
Unmanned Aerial Vehicle for Remote Sensing Applications—A Review
Yao, H., Qin, R., & Chen, X. (2019) · Remote Sensing · doi:10.3390/rs11121443 · Cited by 711
Classification with an edge: Improving semantic image segmentation with boundary detection
Marmanis, D., Schindler, K., Wegner, J. D., Galliani, S., Datcu, M., & Stilla, U. (2018) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2017.11.009 · Cited by 670
Beyond RGB: Very high resolution urban remote sensing with multimodal deep networks
Audebert, N., Le Saux, B., & Lefèvre, S. (2018) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2017.11.011 · Cited by 655
Kampffmeyer, M., Salberg, A.-B., & Jenssen, R. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2016.90 · Cited by 605
Joint deep learning for land cover and land use classification
Zhang, C., Sargent, I., Pan, X., Li, H., Gardiner, A., Hare, J., & Atkinson, P. M. (2019) · Remote Sensing of Environment · doi:10.1016/j.rse.2018.11.014 · Cited by 451
Li, R., Zheng, S., Zhang, C., Duan, C., Wang, L., & Atkinson, P. M. (2021) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2021.09.005 · Cited by 443
Self-citationAn object-based convolutional neural network (OCNN) for urban land use classification
Zhang, C., Sargent, I., Pan, X., Li, H., Gardiner, A., Hare, J., & Atkinson, P. M. (2018) · Remote Sensing of Environment · doi:10.1016/j.rse.2018.06.034 · Cited by 436
UAVid: A semantic segmentation dataset for UAV imagery
Lyu, Y., Vosselman, G., Xia, G.-S., Yilmaz, A., & Yang, M. Y. (2020) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2020.05.009 · Cited by 424
A Novel Transformer Based Semantic Segmentation Scheme for Fine-Resolution Remote Sensing Images
Wang, L., Li, R., Duan, C., Zhang, C., Meng, X., & Fang, S. (2022) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2022.3143368 · Cited by 414
Self-citationMultiattention Network for Semantic Segmentation of Fine-Resolution Remote Sensing Images
Li, R., Zheng, S., Zhang, C., Duan, C., Su, J., Wang, L., & Atkinson, P. M. (2022) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2021.3093977 · Cited by 341
Self-citationMultistage Attention ResU-Net for Semantic Segmentation of Fine-Resolution Remote Sensing Images
Li, R., Zheng, S., Duan, C., Su, J., & Zhang, C. (2022) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2021.3063381 · Cited by 296
Self-citationSemantic labeling in very high resolution images via a self-cascaded convolutional neural network
Liu, Y., Fan, B., Wang, L., Bai, J., Xiang, S., & Pan, C. (2018) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2017.12.007 · Cited by 290
Self-citationMarcos, D., Volpi, M., Kellenberger, B., & Tuia, D. (2018) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2018.01.021 · Cited by 282
Audebert, N., Le Saux, B., & Lefèvre, S. (2017) · Remote Sensing · doi:10.3390/rs9040368 · Cited by 264
Road Structure Refined CNN for Road Extraction in Aerial Image
Wei, Y., Wang, Z., & Xu, M. (2017) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2017.2672734 · Cited by 217
TreeUNet: Adaptive Tree convolutional neural networks for subdecimeter aerial image segmentation
Yue, K., Yang, L., Li, R., Hu, W., Zhang, F., & Li, W. (2019) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2019.07.007 · Cited by 189
Self-citationHigh-Resolution Aerial Image Labeling With Convolutional Neural Networks
Maggiori, E., Tarabalka, Y., Charpiat, G., & Alliez, P. (2017) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2017.2740362 · Cited by 187
AlignSeg: Feature-Aligned Segmentation Networks
Huang, Z., Wei, Y., Wang, X., Shi, H., Liu, W., & Huang, T. S. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3062772 · Cited by 182
ShelfNet for Fast Semantic Segmentation
Zhuang, J., Yang, J., Gu, L., & Dvornek, N. C. (2019) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2019.00113 · Cited by 161
Real-Time Semantic Segmentation With Fast Attention
Hu, P., Perazzi, F., Heilbron, F. C., Wang, O., Lin, Z., Saenko, K., & Sclaroff, S. (2021) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2020.3039744 · Cited by 159
Dense Dilated Convolutions’ Merging Network for Land Cover Classification
Liu, Q., Kampffmeyer, M., Jenssen, R., & Salberg, A.-B. (2020) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2020.2976658 · Cited by 148
Parsing very high resolution urban scene images by learning deep ConvNets with edge-aware loss
Zheng, X., Huan, L., Xia, G.-S., & Gong, J. (2020) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2020.09.019 · Cited by 147
Efficient semantic segmentation with pyramidal fusion
Oršić, M., & Šegvić, S. (2020) · Pattern Recognition · doi:10.1016/j.patcog.2020.107611 · Cited by 136
MACU-Net for Semantic Segmentation of Fine-Resolution Remotely Sensed Images
Li, R., Duan, C., Zheng, S., Zhang, C., & Atkinson, P. M. (2021) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2021.3052886 · Cited by 136
Self-citationRobust Rooftop Extraction From Visible Band Images Using Higher Order CRF
Li, E., Femiani, J. C., Xu, S., Zhang, X., & Wonka, P. (2015) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2015.2400462 · Cited by 134
Guo, Y., Jia, X., & Paull, D. (2018) · IEEE Transactions on Image Processing · doi:10.1109/tip.2018.2808767 · Cited by 134
Air Pollution Prediction with Multi-Modal Data and Deep Neural Networks
Kalajdjieski, J., Zdravevski, E., Corizzo, R., Lameski, P., Kalajdziski, S., Pires, I. M., García, N. M., & Trajkovik, V. (2020) · Remote Sensing · doi:10.3390/rs12244142 · Cited by 126
Scale Sequence Joint Deep Learning (SS-JDL) for land use and land cover classification
Zhang, C., Harrison, P. A., Pan, X., Li, H., Sargent, I. M. J., & Atkinson, P. M. (2019) · Remote Sensing of Environment · doi:10.1016/j.rse.2019.111593 · Cited by 118
Zhang, C., Atkinson, P. M., George, C., Wen, Z., Diazgranados, M., & Gerard, F. (2020) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2020.09.025 · Cited by 110
Real-time Semantic Segmentation with Context Aggregation Network
Yang, M. Y., Kumaar, S., Lyu, Y., & Nex, F. (2021) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2021.06.006 · Cited by 92
Leena Matikainen, A., & Karila, K. (2011) · Remote Sensing · doi:10.3390/rs3081777 · Cited by 90
Kampffmeyer, M., Salberg, A.-B., & Jenssen, R. (2018) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2018.2834961 · Cited by 74
Maxwell, A. E., Bester, M. S., Guillén, L. A., Ramezan, C. A., Carpinello, D. J., Fan, Y., Hartley, F., Maynard, S. M., & Pyron, J. (2020) · Remote Sensing · doi:10.3390/rs12244145 · Cited by 71
Duan, C., Pan, J. H., & Li, R. (2020) · Remote Sensing · doi:10.3390/rs12203446 · Cited by 47
Self-citationZhang, Y., Wang, C., Ji, Y., Chen, J., Deng, Y., Chen, J., & Jie, Y. (2020) · Remote Sensing · doi:10.3390/rs12244182 · Cited by 45
Scale-Aware Neural Network for Semantic Segmentation of Multi-Resolution Remote Sensing Images
Wang, L., Zhang, C., Li, R., Duan, C., Meng, X., & Atkinson, P. M. (2021) · Remote Sensing · doi:10.3390/rs13245015 · Cited by 37
Self-citation
Cited by
Wang, L., Li, R., Zhang, C., Fang, S., Duan, C., Meng, X., & Atkinson, P. M. (2022) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2022.06.008 · Cited by 1,349
Self-citationLi, R., Zheng, S., Zhang, C., Duan, C., Wang, L., & Atkinson, P. M. (2021) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2021.09.005 · Cited by 443
Self-citationA Novel Transformer Based Semantic Segmentation Scheme for Fine-Resolution Remote Sensing Images
Wang, L., Li, R., Duan, C., Zhang, C., Meng, X., & Fang, S. (2022) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2022.3143368 · Cited by 414
Self-citationWu, H., Huang, P., Zhang, M., Tang, W., & Yu, X. (2023) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2023.3314641 · Cited by 360
Metadata
- Authors
- Wang, L., Li, R., Wang, D., Duan, C., Wang, T., & Meng, X.
- Venue
- Remote Sensing
- Publisher
- MDPI AG
- Published
- 2021-08-04
- Volume
- 13
- Issue
- 16
- Pages
- 3065
- ISSN
- 2072-4292 (ISSN-L)
- OpenAlex
- W3190334976
- Cited by
- 281
- References
- 54
- FWCI
- 17.57
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.