CoChat
Cited by 229

The DOI matches its Crossref record; 20 of the 20 references it cites were found in a registry or an index.

Efficient Transformer for Remote Sensing Image Segmentation

Open access
Xu, Zhiyong, Zhang, Weicun, Zhang, Tianxiang, Yang, Zhifang, Li, Jiangyun · 2021 · Remote Sensing

Abstract

Semantic segmentation for remote sensing images (RSIs) is widely applied in geological surveys, urban resources management, and disaster monitoring. Recent solutions on remote sensing segmentation tasks are generally addressed by CNN-based models and transformer-based models. In particular, transformer-based architecture generally struggles with two main problems: a high computation load and inaccurate edge classification. Therefore, to overcome these problems, we propose a novel transformer model to realize lightweight edge classification. First, based on a Swin transformer backbone, a pure Efficient transformer with mlphead is proposed to accelerate the inference speed. Moreover, explicit and implicit edge enhancement methods are proposed to cope with object edge problems. The experimental results evaluated on the Potsdam and Vaihingen datasets present that the proposed approach significantly improved the final accuracy, achieving a trade-off between computational complexity (Flops) and accuracy (Efficient-L obtaining 3.23% mIoU improvement on Vaihingen and 2.46% mIoU improvement on Potsdam compared with HRCNet_W48). As a result, it is believed that the proposed Efficient transformer will have an advantage in dealing with remote sensing image segmentation problems.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.3390/rs13183585

Cites

20 of 20 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Research works printed but not linked: 29

  1. Witharana, 2020, Understanding the synergies of deep learning and data fusion of multispectral and panchromatic high resolution commercial satellite imagery for automated ice-wedge polygon detection, ISPRS J. Photogramm. Remote Sens., 170, 174, 10.1016/j.isprsjprs.2020.10.010 · DOI
  2. Zhang, 2021, State and parameter estimation of the AquaCrop model for winter wheat using sensitivity informed particle filter, Comput. Electron. Agric., 180, 105909, 10.1016/j.compag.2020.105909 · DOI
  3. Zhang, J., Lin, S., Ding, L., and Bruzzone, L. (2020). Multi-Scale Context Aggregation for Semantic Segmentation of Remote Sensing Images. Remote Sens., 12. · DOI · Paper page
  4. Xu, Z., Zhang, W., Zhang, T., and Li, J. (2021). HRCNet: High-resolution context extraction network for semantic segmentation of remote sensing images. Remote Sens., 13. · DOI
  5. Long, J., Shelhamer, E., and Darrell, T. (2015, January 7–12). Fully convolutional networks for semantic segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA. · DOI · Paper page
  6. Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, Ł., and Polosukhin, I. (2017). Attention is all you need. arXiv.
  7. Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., and Gelly, S. (2020). An image is worth 16x16 words: Transformers for image recognition at scale. arXiv.
  8. Zhang, Q., and Yang, Y. (2021). ResT: An Efficient Transformer for Visual Recognition. arXiv.
  9. Tolstikhin, I., Houlsby, N., Kolesnikov, A., Beyer, L., Zhai, X., Unterthiner, T., Yung, J., Keysers, D., Uszkoreit, J., and Lucic, M. (2021). Mlp-mixer: An all-mlp architecture for vision. arXiv.
  10. Chu, X., Tian, Z., Wang, Y., Zhang, B., Ren, H., Wei, X., Xia, H., and Shen, C. (2021). Twins: Revisiting the design of spatial attention in vision transformers. arXiv.
  11. Jin, Y., Xu, W., Zhang, C., Luo, X., and Jia, H. (2021). Boundary-aware refined network for automatic building extraction in very high-resolution urban aerial images. Remote Sens., 13. · DOI
  12. Chen, L.C., Papandreou, G., Schroff, F., and Adam, H. (2017). Rethinking atrous convolution for semantic image segmentation. arXiv.
  13. Zhao, H., Shi, J., Qi, X., Wang, X., and Jia, J. (2017, January 21–26). Pyramid scene parsing network. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA. · DOI · Paper page
  14. Fu, J., Liu, J., Tian, H., Li, Y., Bao, Y., Fang, Z., and Lu, H. (2019, January 16–20). Dual attention network for scene segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA. · DOI · Paper page
  15. Chen, J., Lu, Y., Yu, Q., Luo, X., Adeli, E., Wang, Y., Lu, L., Yuille, A.L., and Zhou, Y. (2021). Transunet: Transformers make strong encoders for medical image segmentation. arXiv.
  16. Xie, E., Wang, W., Yu, Z., Anandkumar, A., Alvarez, J.M., and Luo, P. (2021). SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformers. arXiv.
  17. Yang, G., Zhang, Q., and Zhang, G. (2020). EANet: Edge-Aware Network for the Extraction of Buildings from Aerial Images. Remote Sens., 12. · DOI
  18. Sun, K., Zhao, Y., Jiang, B., Cheng, T., Xiao, B., Liu, D., Mu, Y., Wang, X., Liu, W., and Wang, J. (2019). High-resolution representations for labeling pixels and regions. arXiv.
  19. Haut, 2018, Low–high-power consumption architectures for deep-learning models applied to hyperspectral image classification, IEEE Geosci. Remote Sens. Lett., 16, 776, 10.1109/LGRS.2018.2881045 · DOI
  20. Zhang, C., Jiang, W., and Zhao, Q. (2021). Semantic Segmentation of Aerial Imagery via Split-Attention Networks with Disentangled Nonlocal and Edge Supervision. Remote Sens., 13. · DOI
  21. Zhang, T., Su, J., Xu, Z., Luo, Y., and Li, J. (2021). Sentinel-2 satellite imagery for urban land cover classification by optimized random forest classifier. Appl. Sci., 11. · DOI
  22. Yuan, W., Zhang, W., Lai, Z., and Zhang, J. (2020). Extraction of Yardang characteristics using object-based image analysis and canny edge detection methods. Remote Sens., 12. · doi:10.3390/rs12040726
  23. Sugano, H., and Miyamoto, R. (2008, January 12–14). Parallel implementation of morphological processing on cell/BE with OpenCV interface. Proceedings of the 2008 3rd International Symposium on Communications, Control and Signal Processing, St. Julians, Malta.
  24. He, J., Deng, Z., Zhou, L., Wang, Y., and Qiao, Y. (2019, January 15–20). Adaptive pyramid context network for semantic segmentation. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA. · DOI · Paper page
  25. Yin, M., Yao, Z., Cao, Y., Li, X., Zhang, Z., Lin, S., and Hu, H. (2020). Disentangled non-local neural networks. European Conference on Computer Vision, Springer. · DOI · Paper page
  26. Zhao, H., Zhang, Y., Liu, S., Shi, J., Loy, C.C., Lin, D., and Jia, J. (2018, January 8–14). Psanet: Point-wise spatial attention network for scene parsing. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany. · DOI · Paper page
  27. Zhou, B., Zhao, H., Puig, X., Fidler, S., Barriuso, A., and Torralba, A. (2017, January 21–26). Scene parsing through ade20k dataset. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA. · DOI · Paper page
  28. Ruder, S. (2016). An overview of gradient descent optimization algorithms. arXiv.
  29. Wang, J., Shen, L., Qiao, W., Dai, Y., and Li, Z. (2019). Deep feature fusion with integration of residual connection and attention model for classification of VHR remote sensing images. Remote Sens., 11. · DOI

Cited by

See all 229

Metadata

Authors
Xu, Z., Zhang, W., Zhang, T., Yang, Z., & Li, J.
Venue
Remote Sensing
Publisher
MDPI AG
Published
2021-09-09
Volume
13
Issue
18
Pages
3585
ISSN
2072-4292 (ISSN-L)
OpenAlex
W3200870516
Cited by
229
References
20
FWCI
15.79
Type
journal article
Language
en
Open access
gold
Funders
  • Scientific and Technological Innovation Foundation of Shunde Graduate School, USTB (BK20BE014)
  • Fundamental Research Funds for the China Central Universities of USTB (FRF-DF-19-002)

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.