Student or educator? Sign up with your school email and get 6 months of Pro free.
Cited by 1,349

The DOI matches its Crossref record; 69 of the 69 references it cites were found in a registry or an index.

UNetFormer: A UNet-like transformer for efficient semantic segmentation of remote sensing urban scene imagery

Open access
Wang, Libo, Li, Rui, Zhang, Ce, Fang, Shenghui, Duan, Chenxi, Meng, Xiaoliang, Atkinson, Peter M.·2022·ISPRS Journal of Photogrammetry and Remote Sensing

Abstract

Semantic segmentation of remotely sensed urban scene images is required in a wide range of practical applications, such as land cover mapping, urban change detection, environmental protection, and economic assessment.Driven by rapid developments in deep learning technologies, the convolutional neural network (CNN) has dominated semantic segmentation for many years. CNN adopts hierarchical feature representation, demonstrating strong capabilities for local information extraction. However, the local property of the convolution layer limits the network from capturing the global context. Recently, as a hot topic in the domain of computer vision, Transformer has demonstrated its great potential in global information modelling, boosting many vision-related tasks such as image classification, object detection, and particularly semantic segmentation. In this paper, we propose a Transformer-based decoder and construct a UNet-like Transformer (UNetFormer) for real-time urban scene segmentation. For efficient segmentation, the UNetFormer selects the lightweight ResNet18 as the encoder and develops an efficient global-local attention mechanism to model both global and local information in the decoder. Extensive experiments reveal that our method not only runs faster but also produces higher accuracy compared with state-of-the-art lightweight models. Specifically, the proposed UNetFormer achieved 67.8% and 52.4% mIoU on the UAVid and LoveDA datasets, respectively, while the inference speed can achieve up to 322.4 FPS with a 512x512 input on a single NVIDIA GTX 3090 GPU. In further exploration, the proposed Transformer-based decoder combined with a Swin Transformer encoder also achieves the state-of-the-art result (91.3% F1 and 84.1% mIoU) on the Vaihingen dataset. The source code will be freely available at https://github.com/WangLibo1995/GeoSeg.

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1016/j.isprsjprs.2022.06.008

Cites

69 of 69 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 69 references

Research works printed but not linked: 17

  1. Cao, H., Wang, Y., Chen, J., Jiang, D., Zhang, X., Tian, Q., Wang, M., 2021. Swin-unet: Unet-like pure transformer for medical image segmentation. arXiv preprint arXiv:2105.05537. · arXiv
  2. Chen, 2021, Remote sensing image change detection with transformers, IEEE Trans. Geosci. Remote Sens.
  3. Chen, J., Lu, Y., Yu, Q., Luo, X., Adeli, E., Wang, Y., Lu, L., Yuille, A.L., Zhou, Y., 2021b. Transunet: Transformers make strong encoders for medical image segmentation. arXiv preprint arXiv:2102.04306. · arXiv
  4. Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., Gelly, S., 2020. An image is worth 16x16 words: Transformers for image recognition at scale. arXiv preprint arXiv:2010.11929. · arXiv
  5. Li, G., Yun, I., Kim, J., Kim, J., 2019. Dabnet: Depth-wise asymmetric bottleneck for real-time semantic segmentation. arXiv preprint arXiv:1907.11357. · arXiv
  6. Li, 2022, Land cover classification from remote sensing images based on multi-scale fully convolutional network, Geo-spatial Information Science, 1
  7. Li, 2021, Multiattention network for semantic segmentation of fine-resolution remote sensing images, IEEE Trans. Geosci. Remote Sens.
  8. Poudel, R.P., Bonde, U., Liwicki, S., Zach, C., 2018. Contextnet: Exploring context and detail for semantic segmentation in real-time. arXiv preprint arXiv:1805.04554. · arXiv
  9. Poudel, R.P., Liwicki, S., Cipolla, R., 2019. Fast-scnn: Fast semantic segmentation network. arXiv preprint arXiv:1902.04502. · arXiv
  10. Shen, 2019, Optimizing multiscale segmentation with local spectral heterogeneity measure for high resolution remote sensing images, ISPRS J. Photogramm. Remote Sens., 157, 13, 10.1016/j.isprsjprs.2019.08.014 · doi:10.1016/j.isprsjprs.2019.08.014
  11. Sherrah, J., 2016. Fully convolutional networks for dense semantic labelling of high-resolution aerial imagery. arXiv preprint arXiv:1606.02585. · arXiv
  12. Vakalopoulou, 2015, Building detection in very high resolution multispectral data with deep learning features, 2015 IEEE international geoscience and remote sensing symposium (IGARSS), IEEE, 1873
  13. Vaswani, 2017, Attention is all you need, Adv. Neural Inf. Process. Syst., 5998
  14. Wang, J., Zheng, Z., Ma, A., Lu, X., Zhong, Y., 2021a. LoveDA: A Remote Sensing Land-Cover Dataset for Domain Adaptive Semantic Segmentation. arXiv preprint arXiv:2110.08733. · arXiv
  15. Wang, 2022, A Novel Transformer Based Semantic Segmentation Scheme for Fine-Resolution Remote Sensing Images, IEEE Geosci. Remote Sens. Lett., 19, 1
  16. Zhang, Q., Yang, Y., 2021. ResT: An Efficient Transformer for Visual Recognition. arXiv preprint arXiv:2105.13677. · arXiv
  17. Zhu, X., Su, W., Lu, L., Li, B., Wang, X., Dai, J., 2020. Deformable DETR: Deformable Transformers for End-to-End Object Detection. arXiv preprint arXiv:2010.04159. · arXiv

Cited by

See all 1,349

Metadata

Authors
Wang, L., Li, R., Zhang, C., Fang, S., Duan, C., Meng, X., & Atkinson, P. M.
Venue
ISPRS Journal of Photogrammetry and Remote Sensing
Publisher
Elsevier BV
Published
2022-08
Volume
190
Pages
196-214
ISSN
0924-2716 (ISSN-L)
OpenAlex
W4283450732
Cited by
1,349
References
69
FWCI
92.54
Type
journal article
Language
en
Open access
green
Licence
  • www.elsevier.com/tdm/userlicense/1.0/ (tdm)
  • www.elsevier.com/legal/tdmrep-license (tdm)

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: UNetFormer: A UNet-like transformer for efficient semantic segmentation of remote sensing urban scene imagery. https://app.cochat.ai/papers/10.1016/j.isprsjprs.2022.06.008
The paper
Wang, L., Li, R., Zhang, C., Fang, S., Duan, C., Meng, X., & Atkinson, P. M. (2022). UNetFormer: A UNet-like transformer for efficient semantic segmentation of remote sensing urban scene imagery. ISPRS Journal of Photogrammetry and Remote Sensing. https://doi.org/10.1016/j.isprsjprs.2022.06.008

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.