The DOI matches its Crossref record; 46 of the 46 references it cites were found in a registry or an index.
Remote Sensing Image Change Detection With Transformers
Open accessAbstract
Modern change detection (CD) has achieved remarkable success by the powerful discriminative ability of deep convolutions. However, high-resolution remote sensing CD remains challenging due to the complexity of objects in the scene. Objects with the same semantic concept may show distinct spectral characteristics at different times and spatial locations. Most recent CD pipelines using pure convolutions are still struggling to relate long-range concepts in space-time. Nonlocal self-attention approaches show promising performance via modeling dense relationships among pixels, yet are computationally inefficient. Here, we propose a bitemporal image transformer (BIT) to efficiently and effectively model contexts within the spatial-temporal domain. Our intuition is that the high-level concepts of the change of interest can be represented by a few visual words, that is, semantic tokens. To achieve this, we express the bitemporal image into a few tokens and use a transformer encoder to model contexts in the compact token-based space-time. The learned context-rich tokens are then fed back to the pixel-space for refining the original features via a transformer decoder. We incorporate BIT in a deep feature differencing-based CD framework. Extensive experiments on three CD datasets demonstrate the effectiveness and efficiency of the proposed method. Notably, our BIT-based model significantly outperforms the purely convolutional baseline using only three times lower computational costs and model parameters. Based on a naive backbone (ResNet18) without sophisticated structures (e.g., feature pyramid network (FPN) and UNet), our model surpasses several state-of-the-art CD methods, including better than four recent attention-based methods in terms of efficiency and accuracy. Our code is available athttps://github.com/justchenhao/BIT_CD.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
End-to-End Object Detection with Transformers
Carion, N., Massa, F., Synnaeve, G., Usunier, N., Kirillov, A., & Zagoruyko, S. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58452-8_13 · Cited by 18,285
End-to-End Object Detection with Transformers
Carion, N., Massa, F., Synnaeve, G., Usunier, N., Kirillov, A., & Zagoruyko, S. (2020) · arXiv · doi:10.48550/arxiv.2005.12872 · Cited by 18,253
Wang, X., Girshick, R., Gupta, A., & He, K. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00813 · Cited by 11,596 · cited 1×
“Moreover, we replace our BIT with a Non-local [56] self-attention layer, which is able to model relations within the pixel-based space-time.”
MethodUNet++: A Nested U-Net Architecture for Medical Image Segmentation
Zhou, Z., Rahman Siddiquee, M. M., Tajbakhsh, N., & Liang, J. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-00889-5_1 · Cited by 9,610
Rethinking Semantic Segmentation from a Sequence-to-Sequence Perspective with Transformers
Zheng, S., Lu, J., Zhao, H., Zhu, X., Luo, Z., Wang, Y., Fu, Y., Feng, J., Xiang, T., Torr, P. H. S., et al. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00681 · Cited by 4,008 · cited 1×
“…transformer-based models show comparable or even better performance as the convolutional counterparts in various visual tasks, including image classification [33–35], segmentation [35–37], object detection [36, 38, 39], image generation [40, 41], image captioning [42], and super-resolution [43, 44].”
BackgroundReview Article Digital change detection techniques using remotely-sensed data
SINGH, A. (1989) · International Journal of Remote Sensing · doi:10.1080/01431168908903939 · Cited by 3,849
Taming Transformers for High-Resolution Image Synthesis
Esser, P., Rombach, R., & Ommer, B. (2020) · arXiv · doi:10.48550/arxiv.2012.09841 · Cited by 2,514
Taming Transformers for High-Resolution Image Synthesis
Esser, P., Rombach, R., & Ommer, B. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.01268 · Cited by 2,514
Pre-Trained Image Processing Transformer
Chen, H., Wang, Y., Guo, T., Xu, C., Deng, Y., Liu, Z., Ma, S., Xu, C., Xu, C., & Gao, W. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.01212 · Cited by 2,308 · cited 1×
“models show comparable or even better performance as the convolutional counterparts in various visual tasks, including image classification [33]–[35], segmentation [35]–[37], object detection [36], [38], [39], image generation [40], [41], image captioning [42], and super-resolution [43], [44].”
BackgroundSelf-citationJi, S., Wei, S., & Lu, M. (2019) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2018.2858817 · Cited by 1,973
Chen, H., & Shi, Z. (2020) · Remote Sensing · doi:10.3390/rs12101662 · Cited by 1,903
Self-citationFully Convolutional Siamese Networks for Change Detection
Caye Daudt, R., Le Saux, B., & Boulch, A. (2018) · 2018 25th IEEE International Conference on Image Processing (ICIP) · doi:10.1109/icip.2018.8451652 · Cited by 1,743
Zhang, C., Yue, P., Tapete, D., Jiang, L., Shangguan, B., Huang, L., & Liu, G. (2020) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2020.06.003 · Cited by 1,215
SNUNet-CD: A Densely Connected Siamese Network for Change Detection of VHR Images
Fang, S., Li, K., Shao, J., & Li, Z. (2022) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2021.3056416 · Cited by 1,182
Learning Texture Transformer Network for Image Super-Resolution
Yang, F., Yang, H., Fu, J., Lu, H., & Guo, B. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00583 · Cited by 966
End-to-End Change Detection for High Resolution Satellite Images Using Improved UNet++
Peng, D., Zhang, Y., & Guan, H. (2019) · Remote Sensing · doi:10.3390/rs11111382 · Cited by 804
Chen, J., Yuan, Z., Peng, J., Chen, L., Huang, H., Zhu, J., Liu, Y., & Li, H. (2021) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2020.3037893 · Cited by 679
Liu, Y., Pang, C., Zhan, Z., Zhang, X., & Yang, X. (2021) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2020.2988032 · Cited by 654
Vision Transformers for Remote Sensing Image Classification
Bazi, Y., Bashmal, L., Rahhal, M. M. A., Dayil, R. A., & Ajlan, N. A. (2021) · Remote Sensing · doi:10.3390/rs13030516 · Cited by 637
Change Detection Based on Artificial Intelligence: State-of-the-Art and Challenges
Shi, W., Zhang, M., Zhang, R., Chen, S., & Zhan, Z. (2020) · Remote Sensing · doi:10.3390/rs12101688 · Cited by 595
Change Detection Based on Deep Siamese Convolutional Network for Optical Aerial Images
Zhan, Y., Fu, K., Yan, M., Sun, X., Wang, H., & Qiu, X. (2017) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2017.2738149 · Cited by 588
CHANGE DETECTION IN REMOTE SENSING IMAGES USING CONDITIONAL ADVERSARIAL NETWORKS
Lebedev, M. A., Vizilter, Y. V., Vygolov, O. V., Knyaz, V. A., & Rubis, A. Y. (2018) · The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences · doi:10.5194/isprs-archives-xlii-2-565-2018 · Cited by 567
Urban Change Detection for Multispectral Earth Observation Using Convolutional Neural Networks
Daudt, R. C., Le Saux, B., Boulch, A., & Gousseau, Y. (2018) · IGARSS 2018 - 2018 IEEE International Geoscience and Remote Sensing Symposium · doi:10.1109/igarss.2018.8518015 · Cited by 466
He, J., Zhao, L., Yang, H., Zhang, M., & Li, W. (2020) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2019.2934760 · Cited by 383
Optical Remote Sensing Image Change Detection Based on Attention Mechanism and Image Difference
Peng, X., Zhong, R., Li, Z., & Li, Q. (2021) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2020.3033009 · Cited by 379
A Feature Difference Convolutional Neural Network-Based Change Detection Method
Zhang, M., & Shi, W. (2020) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2020.2981051 · Cited by 320
de Bem, P., de Carvalho Junior, O., Fontes Guimarães, R., & Trancoso Gomes, R. (2020) · Remote Sensing · doi:10.3390/rs12060901 · Cited by 295
Zhang, D., Zhang, H., Tang, J., Wang, M., Hua, X., & Sun, Q. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58604-1_20 · Cited by 277
Triplet-Based Semantic Relation Learning for Aerial Remote Sensing Image Change Detection
Zhang, M., Xu, G., Chen, K., Yan, M., & Sun, X. (2019) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2018.2869608 · Cited by 248
Jiang, H., Hu, X., Li, K., Zhang, J., Gong, J., & Zhang, M. (2020) · Remote Sensing · doi:10.3390/rs12030484 · Cited by 242
Self-Supervised Pretraining of Transformers for Satellite Image Time Series Classification
Yuan, Y., & Lin, L. (2021) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2020.3036602 · Cited by 204
From W-Net to CDGAN: Bitemporal Change Detection via Deep Learning Techniques
Hou, B., Liu, Q., Wang, H., & Wang, Y. (2020) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2019.2948659 · Cited by 174
Ji, S., Shen, Y., Lu, M., & Zhang, Y. (2019) · Remote Sensing · doi:10.3390/rs11111343 · Cited by 167
Adversarial Instance Augmentation for Building Change Detection in Remote Sensing Images
Chen, H., Li, W., & Shi, Z. (2022) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2021.3066802 · Cited by 166
Self-citationA CNN-Transformer Hybrid Approach for Crop Classification Using Multitemporal Multisensor Images
Li, Z., Chen, G., & Zhang, T. (2020) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2020.2971763 · Cited by 162
Wang, M., Tan, K., Jia, X., Wang, X., & Chen, Y. (2020) · Remote Sensing · doi:10.3390/rs12020205 · Cited by 135
Word–Sentence Framework for Remote Sensing Image Captioning
Wang, Q., Huang, W. F., Zhang, X., & Li, X. (2020) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2020.3044054 · Cited by 126
The Temporal Dynamics of Slums Employing a CNN-Based Change Detection Approach
Liu, R., Kuffer, M., & Persello, C. (2019) · Remote Sensing · doi:10.3390/rs11232844 · Cited by 113
Incorporating Metric Learning and Adversarial Network for Seasonal Invariant Change Detection
Zhao, W., Mou, L., Chen, J., Bo, Y., & Emery, W. J. (2019) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2019.2953879 · Cited by 75
Fang, B., Pan, L., & Kou, R. (2019) · Remote Sensing · doi:10.3390/rs11111292 · Cited by 67
SIAMESE NETWORK WITH MULTI-LEVEL FEATURES FOR PATCH-BASED CHANGE DETECTION IN SATELLITE IMAGERY
Rahman, F. U., Vasu, B., Cor, J. D. V., Kerekes, J. P., & Savakis, A. E. (2018) · IEEE Global Conference on Signal and Information Processing · doi:10.1109/globalsip.2018.8646512 · Cited by 65
Remote sensing image caption generation via transformer and reinforcement learning
Shen, X., Liu, B., Zhou, Y. Z., & Zhao, J. (2020) · Multimedia Tools and Applications · doi:10.1007/s11042-020-09294-7 · Cited by 57
Bao, T., Fu, C., Fang, T., et al. (2020) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2019.2955309 · Cited by 56
Building change detection via a combination of CNNs using only RGB aerial imageries
Nemoto, K., Imaizumi, T., Hikosaka, S., Hamaguchi, R., Sato, M., & Fujita, A. (2017) · Remote Sensing Technologies and Applications in Urban Environments · doi:10.1117/12.2277912 · Cited by 47
Cited by
Liu, M., Chai, Z., Deng, H., & Liu, R. (2022) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2022.3177235 · Cited by 409
Change Detection on Remote Sensing Images Using Dual-Branch Multilevel Intertemporal Network
Feng, Y., Jiang, J., Xu, H., & Zheng, J. (2023) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2023.3241257 · Cited by 371
Feng, Y., Xu, H., Jiang, J., Liu, H., & Zheng, J. (2022) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2022.3168331 · Cited by 339
RS-Mamba for Large Remote Sensing Image Dense Prediction
Zhao, S., Chen, H., Zhang, X., Xiao, P., Bai, L., & Ouyang, W. (2024) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2024.3425540 · Cited by 323
Self-citationRingMo: A Remote Sensing Foundation Model With Masked Image Modeling
Sun, X., Wang, P., Lu, W., Zhu, Z., Lu, X., He, Q., Li, J., Rong, X., Yang, Z., Chang, H., et al. (2023) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2022.3194732 · Cited by 323
Metadata
- Authors
- Chen, H., Qi, Z., & Shi, Z.
- Venue
- IEEE Transactions on Geoscience and Remote Sensing
- Published
- 2022
- Volume
- 60
- Pages
- 1-14
- ISSN
- 0196-2892 (ISSN-L)
- 1558-0644
- OpenAlex
- W3180045188
- Cited by
- 1,189
- References
- 46
- FWCI
- 63.17
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.