Change Detection on Remote Sensing Images Using Dual-Branch Multilevel Intertemporal Network
The DOI matches its Crossref record; 43 of the 43 references it cites were found in a registry or an index.
Abstract
Change detection (CD) of remote sensing (RS) images is mushrooming up accompanied by the on-going innovation of convolutional neural networks (CNNs). Yet with the high-speed technology upgrade, the obstacle that identifies unbalanced variations in foreground–background categories still lies on the table, especially in cases with limited samples and massive interference such as seasonal turnover, illumination intensity, and building reformation. Moreover, to date, neither of the off-the-shelf methods probes the feasibility of direct interaction between bitemporal images before accessing difference features. In this article, we propose a dual-branch multilevel intertemporal network (DMINet) to efficiently and effectively derive the change representations. Specifically, by unifying self-attention (SelfAtt) and cross-attention (CrossAtt) in a single module, we present an intertemporal joint-attention (JointAtt) block to steer the global feature distribution of each input, motivating information coupling between intralevel representations and meanwhile suppressing the task-irrelevant interferences. In addition, centering more on the detection of difference features, a reliable architecture is designed by spotlighting two concerns, i.e., the difference acquisition using subtraction and concatenation as well as the multilevel difference aggregation using incremental feature alignment. Based on a naive backbone without sophisticated structures, i.e., ResNet18, our model outperforms other state-of-the-art (SOTA) methods on four CD datasets, especially in cases with rarely samples. Moreover, the achievement is attained with light overheads.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Swin Transformer: Hierarchical Vision Transformer using Shifted Windows
Liu, Z., Lin, Y., Cao, Y., Hu, H., Wei, Y., Zhang, Z., Lin, S., & Guo, B. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00986 · Cited by 35,534
End-to-End Object Detection with Transformers
Carion, N., Massa, F., Synnaeve, G., Usunier, N., Kirillov, A., & Zagoruyko, S. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58452-8_13 · Cited by 18,285
End-to-End Object Detection with Transformers
Carion, N., Massa, F., Synnaeve, G., Usunier, N., Kirillov, A., & Zagoruyko, S. (2020) · arXiv · doi:10.48550/arxiv.2005.12872 · Cited by 18,253
Rethinking Semantic Segmentation from a Sequence-to-Sequence Perspective with Transformers
Zheng, S., Lu, J., Zhao, H., Zhu, X., Luo, Z., Wang, Y., Fu, Y., Feng, J., Xiang, T., Torr, P. H. S., et al. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00681 · Cited by 4,008 · cited 1×
“…datasets, the transformer-based models demonstrate equivalent or even superior performance as the convolutional counter-parts, including image classification [22], semantic segmentation [22], [41], object detection [22], [42], image generation [43], video retrieval [44], and target tracking [45].”
BackgroundRethinking Semantic Segmentation from a Sequence-to-Sequence Perspective with Transformers
Zheng, S., Lu, J., Zhao, H., Zhu, X., Luo, Z., Wang, Y., Fu, Y., Feng, J., Xiang, T., Torr, P. H. S., et al. (2020) · arXiv · doi:10.48550/arxiv.2012.15840 · Cited by 4,004
Ji, S., Wei, S., & Lu, M. (2019) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2018.2858817 · Cited by 1,973
Chen, H., & Shi, Z. (2020) · Remote Sensing · doi:10.3390/rs12101662 · Cited by 1,903
Fully Convolutional Siamese Networks for Change Detection
Caye Daudt, R., Le Saux, B., & Boulch, A. (2018) · 2018 25th IEEE International Conference on Image Processing (ICIP) · doi:10.1109/icip.2018.8451652 · Cited by 1,743
Chen, X., Yan, B., Zhu, J., Wang, D., Yang, X., & Lu, H. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00803 · Cited by 1,588 · cited 1×
“…datasets, the transformer-based models demonstrate equivalent or even superior performance as the convolutional counter-parts, including image classification [22], semantic segmentation [22], [41], object detection [22], [42], image generation [43], video retrieval [44], and target tracking [45].”
BackgroundZhang, C., Yue, P., Tapete, D., Jiang, L., Shangguan, B., Huang, L., & Liu, G. (2020) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2020.06.003 · Cited by 1,215
Remote Sensing Image Change Detection With Transformers
Chen, H., Qi, Z., & Shi, Z. (2022) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2021.3095166 · Cited by 1,189
SNUNet-CD: A Densely Connected Siamese Network for Change Detection of VHR Images
Fang, S., Li, K., Shao, J., & Li, Z. (2022) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2021.3056416 · Cited by 1,182
Celik, T. (2009) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2009.2025059 · Cited by 1,158
SiamCAR: Siamese Fully Convolutional Classification and Regression for Visual Tracking
Guo, D., Wang, J., Cui, Y., Wang, Z., & Chen, S. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00630 · Cited by 984
Shi, Q., Liu, M., Li, S., Liu, X., Wang, F., & Zhang, L. (2022) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2021.3085870 · Cited by 698
Liu, Y., Pang, C., Zhan, Z., Zhang, X., & Yang, X. (2021) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2020.2988032 · Cited by 654
Multi-modal Transformer for Video Retrieval
Gabeur, V., Sun, C., Alahari, K., & Schmid, C. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58548-8_13 · Cited by 615
Change Detection Based on Deep Siamese Convolutional Network for Optical Aerial Images
Zhan, Y., Fu, K., Yan, M., Sun, X., Wang, H., & Qiu, X. (2017) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2017.2738149 · Cited by 588
Unsupervised Deep Change Vector Analysis for Multiple-Change Detection in VHR Images
Saha, S., Bovolo, F., & Bruzzone, L. (2019) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2018.2886643 · Cited by 523
SwinSUNet: Pure Transformer Network for Remote Sensing Image Change Detection
Zhang, C., Wang, L., Cheng, S., & Li, Y. (2022) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2022.3160007 · Cited by 483
Peng, D., Bruzzone, L., Zhang, Y., Guan, H., Ding, H., & Huang, X. (2021) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2020.3011913 · Cited by 441
Multitask learning for large-scale semantic change detection
Caye Daudt, R., Le Saux, B., Boulch, A., & Gousseau, Y. (2019) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2019.07.003 · Cited by 402
Feng, Y., Xu, H., Jiang, J., Liu, H., & Zheng, J. (2022) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2022.3168331 · Cited by 339
Self-citationLearning Compact and Discriminative Stacked Autoencoder for Hyperspectral Image Classification
Zhou, P., Han, J., Cheng, G., & Zhang, B. (2019) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2019.2893180 · Cited by 289
Triplet-Based Semantic Relation Learning for Aerial Remote Sensing Image Change Detection
Zhang, M., Xu, G., Chen, K., Yan, M., & Sun, X. (2019) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2018.2869608 · Cited by 248
Hyperspectral and LiDAR Data Classification Based on Structural Optimization Transmission
Zhang, M., Li, W., Zhang, Y., et al. (2022) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2022.3169773 · Cited by 233
Building Change Detection Based on Satellite Stereo Imagery and Digital Surface Models
Tian, J., Cui, S., & Reinartz, P. H. (2013) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2013.2240692 · Cited by 231
Meta Faster R-CNN: Towards Accurate Few-Shot Object Detection with Attentive Feature Alignment
Han, G., Huang, S., Ma, J., He, Y., & Chang, S.-F. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i1.19959 · Cited by 211
An attention-fused network for semantic segmentation of very-high-resolution remote sensing imagery
Yang, X., Li, S., Chen, Z., Chanussot, J., Jia, X., Zhang, B., Li, B., & Chen, P. (2021) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2021.05.004 · Cited by 189
Efficient Saliency-Based Object Detection in Remote Sensing Images Using Deep Belief Networks
Diao, W., Sun, X., Zheng, X., Dou, F., Wang, H., & Fu, K. (2016) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2015.2498644 · Cited by 182
Asymmetric Feature Fusion Network for Hyperspectral and SAR Image Classification
Li, W., Gao, Y., Zhang, M., Tao, R., & Du, Q. (2023) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3149394 · Cited by 168
Hyperspectral and SAR Image Classification via Multiscale Interactive Fusion Network
Wang, J., Li, W., Gao, Y., Zhang, M., Tao, R., & Du, Q. (2023) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3171572 · Cited by 165
Tang, X., Zhang, H., Mou, L., Liu, F., Zhang, X., Zhu, X. X., & Jiao, L. (2021) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2021.3106381 · Cited by 160
Li, Z., Yan, C., Sun, Y., & Xin, Q. (2022) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2022.3159544 · Cited by 155
Hyperspectral Image Classification Using Mixed Convolutions and Covariance Pooling
Zheng, J., Feng, Y., Bai, C., & Zhang, J. (2020) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2020.2995575 · Cited by 154
Self-citationBai, B., Fu, W., Lu, T., et al. (2021) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2021.3106697 · Cited by 152
Guo, Q., Zhang, J., Zhu, S., Zhong, C., & Zhang, Y. (2021) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2021.3131993 · Cited by 123
Song, K., & Jiang, J. (2021) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2021.3077545 · Cited by 111
Self-citationLi, W., Wang, J., Gao, Y., Zhang, M., Tao, R., & Zhang, B. (2022) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2022.3166252 · Cited by 98
Song, F., Zhang, S., Leí, T., Song, Y., & Peng, Z. (2022) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2022.3165885 · Cited by 84
Negri, R. G., Frery, A. C., Casaca, W. C. D. O., de Azevedo, S. C., Dias, M. A., da Silva, E. A., & Alcântara, E. (2020) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2020.3009483 · Cited by 58
Feng, Y., Zheng, J., Qin, M., Bai, C., & Zhang, J. (2021) · Remote Sensing · doi:10.3390/rs13214407 · Cited by 49
Self-citationSolo-to-Collaborative Dual-Attention Network for One-Shot Object Detection in Remote Sensing Images
Li, L., Yao, X., Cheng, G., Xu, M., Han, J., & Han, J. (2021) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2021.3091003 · Cited by 39
Metadata
- Authors
- Feng, Y., Jiang, J., Xu, H., & Zheng, J.
- Venue
- IEEE Transactions on Geoscience and Remote Sensing
- Published
- 2023
- Volume
- 61
- Pages
- 1-15
- ISSN
- 0196-2892 (ISSN-L)
- 1558-0644
- OpenAlex
- W4318767292
- Cited by
- 371
- References
- 43
- FWCI
- 40.97
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.