TransUNetCD: A Hybrid Transformer Network for Change Detection in Optical Remote-Sensing Images
The DOI matches its Crossref record; 47 of the 47 references it cites were found in a registry or an index.
Abstract
In the change detection (CD) task, the UNet architecture has achieved superior results. However, due to the inherent limitation of convolution operations, UNet is inadequate in learning global context and long-range spatial relations. Transformers can capture long-range feature dependencies, but the lack of low-level details may result in limited localization capabilities. Therefore, this article proposes an end-to-end encoding–decoding hybrid transformer model for CD, TransUNetCD, which has the advantages of both transformers and UNet. The model encodes the tokenized image patches from the convolutional neural network (CNN) feature map to extract rich global context information. The decoder upsamples the encoded features, connects them with higher-resolution multiscale features through skip connections to learn local–global semantic features, and restores the full spatial resolution of the feature map to achieve precise localization. The model proposed in this article not only solves the problem that redundant information is generated when extracting low-level features under the UNet framework, but also solves the problem that the relationship between each feature layer cannot be fully modeled and the optimal feature difference representation cannot be obtained. On this basis, we introduce a difference enhancement module to generate a difference feature map containing rich change information. By weighting each pixel and selectively aggregating features, the effectiveness of the network and the accuracy of extracting changing features are improved. The results on multiple datasets demonstrate that, compared to state-of-the-art methods, the TransUNetCD can further reduce false alarms and missed alarms, and the edge of the changing area is more accurate. The model has the highest score in each metric than other baseline models and has a robust generalization ability.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deformable DETR: Deformable Transformers for End-to-End Object Detection
Zhu, X., Su, W., Lu, L., Li, B., Wang, X., & Dai, J. (2020) · arXiv · doi:10.48550/arxiv.2010.04159 · Cited by 6,027 · cited 1×
“Transformers have been used in image classification [34], object detection [37], semantic segmentation [38], [39], image recognition [40], and video captioning [41], [42].”
MethodGrad-CAM++: Generalized Gradient-Based Visual Explanations for Deep Convolutional Networks
Chattopadhay, A., Sarkar, A., Howlader, P., & Balasubramanian, V. N. (2018) · 2018 IEEE Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv.2018.00097 · Cited by 3,639
Lu, D., Mausel, P., Brondízio, E., & Moran, E. (2004) · International Journal of Remote Sensing · doi:10.1080/0143116031000139863 · Cited by 3,226
Ji, S., Wei, S., & Lu, M. (2019) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2018.2858817 · Cited by 1,973
Chen, H., & Shi, Z. (2020) · Remote Sensing · doi:10.3390/rs12101662 · Cited by 1,903
Fully Convolutional Siamese Networks for Change Detection
Caye Daudt, R., Le Saux, B., & Boulch, A. (2018) · 2018 25th IEEE International Conference on Image Processing (ICIP) · doi:10.1109/icip.2018.8451652 · Cited by 1,743
Adão, T., Hruška, J., Pádua, L., Bessa, J., Peres, E., Morais, R., & Sousa, J. (2017) · Remote Sensing · doi:10.3390/rs9111110 · Cited by 1,318
Zhang, C., Yue, P., Tapete, D., Jiang, L., Shangguan, B., Huang, L., & Liu, G. (2020) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2020.06.003 · Cited by 1,215
SNUNet-CD: A Densely Connected Siamese Network for Change Detection of VHR Images
Fang, S., Li, K., Shao, J., & Li, Z. (2022) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2021.3056416 · Cited by 1,182
Celik, T. (2009) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2009.2025059 · Cited by 1,158
End-to-End Change Detection for High Resolution Satellite Images Using Improved UNet++
Peng, D., Zhang, Y., & Guan, H. (2019) · Remote Sensing · doi:10.3390/rs11111382 · Cited by 804
Shi, Q., Liu, M., Li, S., Liu, X., Wang, F., & Zhang, L. (2022) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2021.3085870 · Cited by 698
Chen, J., Yuan, Z., Peng, J., Chen, L., Huang, H., Zhu, J., Liu, Y., & Li, H. (2021) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2020.3037893 · Cited by 679
Nielsen, A. A., Conradsen, K., & Simpson, J. J. (1998) · Remote Sensing of Environment · doi:10.1016/s0034-4257(97)00162-4 · Cited by 667
End-to-End Dense Video Captioning with Masked Transformer
Zhou, L., Zhou, Y., Corso, J. J., Socher, R., & Xiong, C. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00911 · Cited by 605
CHANGE DETECTION IN REMOTE SENSING IMAGES USING CONDITIONAL ADVERSARIAL NETWORKS
Lebedev, M. A., Vizilter, Y. V., Vygolov, O. V., Knyaz, V. A., & Rubis, A. Y. (2018) · The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences · doi:10.5194/isprs-archives-xlii-2-565-2018 · Cited by 567
Forest change detection by statistical object-based method
Desclée, B., Bogaert, P., & Defourny, P. (2006) · Remote Sensing of Environment · doi:10.1016/j.rse.2006.01.013 · Cited by 514
Urban Change Detection for Multispectral Earth Observation Using Convolutional Neural Networks
Daudt, R. C., Le Saux, B., Boulch, A., & Gousseau, Y. (2018) · IGARSS 2018 - 2018 IEEE International Geoscience and Remote Sensing Symposium · doi:10.1109/igarss.2018.8518015 · Cited by 466
Spatial-Spectral Transformer for Hyperspectral Image Classification
He, X., Chen, Y., & Lin, Z. (2021) · Remote Sensing · doi:10.3390/rs13030498 · Cited by 462 · cited 1×
“With the gradual development of transformers, the research has also been carried out in the field of remote sensing, mainly focusing on image classification [43]–[45], object detection [46], semantic segmentation [47], [48], and image fusion [49].”
MethodLambin, E. F., & Strahlers, A. H. (1994) · Remote Sensing of Environment · doi:10.1016/0034-4257(94)90144-9 · Cited by 457
A Novel Transformer Based Semantic Segmentation Scheme for Fine-Resolution Remote Sensing Images
Wang, L., Li, R., Duan, C., Zhang, C., Meng, X., & Fang, S. (2022) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2022.3143368 · Cited by 414
Optical Remote Sensing Image Change Detection Based on Attention Mechanism and Image Difference
Peng, X., Zhong, R., Li, Z., & Li, Q. (2021) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2020.3033009 · Cited by 379
Self-citationSlow Feature Analysis for Change Detection in Multispectral Imagery
Wu, C., Du, B., & Zhang, L. (2014) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2013.2266673 · Cited by 349
A Feature Difference Convolutional Neural Network-Based Change Detection Method
Zhang, M., & Shi, W. (2020) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2020.2981051 · Cited by 320
Mondini, A. C., Guzzetti, F., Reichenbach, P., Rossi, M., Cardinali, M., & Ardizzone, F. (2011) · Remote Sensing of Environment · doi:10.1016/j.rse.2011.03.006 · Cited by 313
SwinBERT: End-to-End Transformers with Sparse Attention for Video Captioning
Lin, K., Li, L., Lin, C.-C., Ahmed, F., Gan, Z., Liu, Z., Lu, Y., & Wang, L. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01742 · Cited by 305
Landslide Inventory Mapping From Bitemporal Images Using Deep Convolutional Neural Networks
Lei, T., Zhang, Y., Lv, Z., et al. (2019) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2018.2889307 · Cited by 289
Multi-Scale High-Resolution Vision Transformer for Semantic Segmentation
Gu, J., Kwon, H., Wang, D., Ye, W., Li, M., Chen, Y.-H., Lai, L., Chandra, V., & Pan, D. Z. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01178 · Cited by 251
Triplet-Based Semantic Relation Learning for Aerial Remote Sensing Image Change Detection
Zhang, M., Xu, G., Chen, K., Yan, M., & Sun, X. (2019) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2018.2869608 · Cited by 248
S2Looking: A Satellite Side-Looking Dataset for Building Change Detection
Shen, L., Lu, Y., Chen, H., Wei, H., Xie, D., Yue, J., Chen, R., Lv, S., & Jiang, B. (2021) · Remote Sensing · doi:10.3390/rs13245094 · Cited by 234
Ding, L., Lin, D., Lin, S., Zhang, J., Cui, X., Wang, Y., Tang, H., & Bruzzone, L. (2022) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2022.3168697 · Cited by 204
From W-Net to CDGAN: Bitemporal Change Detection via Deep Learning Techniques
Hou, B., Liu, Q., Wang, H., & Wang, Y. (2020) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2019.2948659 · Cited by 174
A CNN-Transformer Hybrid Approach for Crop Classification Using Multitemporal Multisensor Images
Li, Z., Chen, G., & Zhang, T. (2020) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2020.2971763 · Cited by 162
Detecting Urban Changes with Recurrent Neural Networks from Multitemporal Sentinel-2 Data
Papadomanolaki, M., Verma, S., Vakalopoulou, M., Gupta, S., & Karantzalos, K. (2019) · IGARSS 2019 - 2019 IEEE International Geoscience and Remote Sensing Symposium · doi:10.1109/igarss.2019.8900330 · Cited by 159
When CNNs Meet Vision Transformer: A Joint Framework for Remote Sensing Scene Classification
Deng, P., Xu, K., & Huang, H. B. (2021) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2021.3109061 · Cited by 156
Ding, Q., Shao, Z., Huang, X., & Altan, O. (2021) · International Journal of Applied Earth Observation and Geoinformation · doi:10.1016/j.jag.2021.102591 · Cited by 129
An improved change detection approach using tri-temporal logic-verified change vector analysis
Du, P., Wang, X., Chen, D., Liu, S., Lin, C., & Meng, Y. (2020) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2020.01.026 · Cited by 96
Oil Spill Detection via Multitemporal Optical Remote Sensing Images: A Change Detection Perspective
Liu, S., Chi, M., Zou, Y., Samat, A., Benediktsson, J. A., & Plaza, A. (2017) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2016.2639540 · Cited by 82
Incorporating Metric Learning and Adversarial Network for Seasonal Invariant Change Detection
Zhao, W., Mou, L., Chen, J., Bo, Y., & Emery, W. J. (2019) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2019.2953879 · Cited by 75
Deep Siamese Networks Based Change Detection with Remote Sensing Images
Yang, L., Chen, Y., Song, S., Li, F., & Huang, G. M. (2021) · Remote Sensing · doi:10.3390/rs13173394 · Cited by 68
Li, W., Cao, D., Peng, Y., & Yang, C. (2021) · Remote Sensing · doi:10.3390/rs13183724 · Cited by 61
Zheng, Y., Sun, P., Zhou, Z., Xu, W., & Ren, Q. (2021) · Remote Sensing · doi:10.3390/rs13132623 · Cited by 47
Change Detection Based on the Combination of Improved SegNet Neural Network and Morphology
Bin, Z., Gao, H., Wang, X., Xu, M., & Zhu, X. (2018) · International Conference on Image, Vision and Computing (ICIVC) · doi:10.1109/icivc.2018.8492747 · Cited by 29
Khusni, U., Dewangkoro, H. I., & Arymurthy, A. M. (2020) · International Conference of Computer and Informatics Engineering (IC2IE) · doi:10.1109/ic2ie50715.2020.9274617 · Cited by 29
Alimjan, G., Jiaermuhamaiti, Y., Jumahong, H., Zhu, S., & Nurmamat, P. (2021) · International Journal of Pattern Recognition and Artificial Intelligence · doi:10.1142/s0218001421590497 · Cited by 18
Chen, H., Wu, C., & Du, B. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2108.08157 · Cited by 7
Jiang, Y. L., Hu, L., Zhang, Y., et al. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2108.07955 · Cited by 4
Cited by
Transformers in Remote Sensing: A Survey
Aleissaee, A. A., Kumar, A., Anwer, R. M., Khan, S., Cholakkal, H., Xia, G.-S., & Khan, F. S. (2023) · Remote Sensing · doi:10.3390/rs15071860 · Cited by 417
RS-Mamba for Large Remote Sensing Image Dense Prediction
Zhao, S., Chen, H., Zhang, X., Xiao, P., Bai, L., & Ouyang, W. (2024) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2024.3425540 · Cited by 323
Change Detection Methods for Remote Sensing in the Last Decade: A Comprehensive Review
Cheng, G., Huang, Y., Li, X., Lyu, S., Xu, Z., Zhao, H., Zhao, Q., & Xiang, S. (2024) · Remote Sensing · doi:10.3390/rs16132355 · Cited by 263
Metadata
- Authors
- Li, Q., Zhong, R., Du, X., & Du, Y.
- Venue
- IEEE Transactions on Geoscience and Remote Sensing
- Published
- 2022
- Volume
- 60
- Pages
- 1-19
- ISSN
- 0196-2892 (ISSN-L)
- 1558-0644
- OpenAlex
- W4226361741
- Cited by
- 347
- References
- 47
- FWCI
- 30.10
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.