The DOI matches its Crossref record; 54 of the 54 references it cites were found in a registry or an index.
A Spatial-Temporal Attention-Based Method and a New Dataset for Remote Sensing Image Change Detection
Open accessAbstract
Remote sensing image change detection (CD) is done to identify desired significant changes between bitemporal images. Given two co-registered images taken at different times, the illumination variations and misregistration errors overwhelm the real object changes. Exploring the relationships among different spatial–temporal pixels may improve the performances of CD methods. In our work, we propose a novel Siamese-based spatial–temporal attention neural network. In contrast to previous methods that separately encode the bitemporal images without referring to any useful spatial–temporal dependency, we design a CD self-attention mechanism to model the spatial–temporal relationships. We integrate a new CD self-attention module in the procedure of feature extraction. Our self-attention module calculates the attention weights between any two pixels at different times and positions and uses them to generate more discriminative features. Considering that the object may have different scales, we partition the image into multi-scale subregions and introduce the self-attention in each subregion. In this way, we could capture spatial–temporal dependencies at various scales, thereby generating better representations to accommodate objects of various sizes. We also introduce a CD dataset LEVIR-CD, which is two orders of magnitude larger than other public datasets of this field. LEVIR-CD consists of a large set of bitemporal Google Earth images, with 637 image pairs (1024 × 1024) and over 31 k independently labeled change instances. Our proposed attention module improves the F1-score of our baseline model from 83.9 to 87.3 with acceptable computational overhead. Experimental results on a public remote sensing image CD dataset show our method outperforms several other state-of-the-art methods.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Densely Connected Convolutional Networks
Huang, G., Liu, Z., Van Der Maaten, L., & Weinberger, K. Q. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.243 · Cited by 48,566
Fully convolutional networks for semantic segmentation
Long, J., Shelhamer, E., & Darrell, T. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298965 · Cited by 38,834
Unpaired image-to-image translation using cycle-consistent adversarial networks
Zhu, J.-Y., Park, T., Isola, P., & Efros, A. A. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.244 · Cited by 23,602
Chen, L.-C., Papandreou, G., Kokkinos, I., Murphy, K., & Yuille, A. L. (2016) · arXiv · doi:10.48550/arxiv.1606.00915 · Cited by 22,392
Chen, L.-C., Papandreou, G., Kokkinos, I., Murphy, K., & Yuille, A. L. (2018) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2699184 · Cited by 22,392
SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation
Badrinarayanan, V., Kendall, A., & Cipolla, R. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2644615 · Cited by 19,631
Zhao, H., Shi, J., Qi, X., Wang, X., & Jia, J. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.660 · Cited by 16,438
A feature-integration theory of attention.
Treisman, A. M., & Gelade, G. (1980) · Cognitive Psychology · doi:10.1016/0010-0285(80)90005-5 · Cited by 12,366
Wang, X., Girshick, R., Gupta, A., & He, K. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00813 · Cited by 11,596 · cited 3×
“The non-local neural networks [35] extended the self-attention mechanism in many computer vision tasks, such as video classification, object detection and pose estimation.”
BackgroundResultInfluentialShow, Attend and Tell: Neural Image Caption Generation with Visual Attention
Xu, K., Ba, J., Kiros, R., Cho, K., Courville, A., Salakhutdinov, R., Zemel, R., & Bengio, Y. (2015) · arXiv · doi:10.48550/arxiv.1502.03044 · Cited by 8,248
Dimensionality Reduction by Learning an Invariant Mapping
Hadsell, R., Chopra, S., & LeCun, Y. (2006) · 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 2 (CVPR'06) · doi:10.1109/cvpr.2006.100 · Cited by 5,336
Review Article Digital change detection techniques using remotely-sensed data
SINGH, A. (1989) · International Journal of Remote Sensing · doi:10.1080/01431168908903939 · Cited by 3,849
DOTA: A Large-Scale Dataset for Object Detection in Aerial Images
Xia, G.-S., Bai, X., Ding, J., Zhu, Z., Belongie, S., Luo, J., Datcu, M., Pelillo, M., & Zhang, L. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00418 · Cited by 3,414
Deep Learning in Remote Sensing: A Comprehensive Review and List of Resources
Zhu, X. X., Tuia, D., Mou, L., Xia, G.-S., Zhang, L., Xu, F., & Fraundorfer, F. (2017) · IEEE Geoscience and Remote Sensing Magazine · doi:10.1109/mgrs.2017.2762307 · Cited by 3,400
The class imbalance problem: A systematic study1
Japkowicz, N., & Stephen, S. (2002) · Intelligent Data Analysis · doi:10.3233/ida-2002-6504 · Cited by 3,295
Cheng, G., Zhou, P., & Han, J. (2016) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2016.2601622 · Cited by 1,771
Fully Convolutional Siamese Networks for Change Detection
Caye Daudt, R., Le Saux, B., & Boulch, A. (2018) · 2018 25th IEEE International Conference on Image Processing (ICIP) · doi:10.1109/icip.2018.8451652 · Cited by 1,743
A Unified Multi-scale Deep Convolutional Neural Network for Fast Object Detection
Cai, Z., Fan, Q., Feris, R. S., & Vasconcelos, N. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46493-0_22 · Cited by 1,605 · cited 1×
“Context plays an important role in many visual tasks, such as video surveillance [53], semantic segmentation [46,54] and object detection [55].”
BackgroundCheng, G., Yang, C., Yao, X., Guo, L., & Han, J. (2018) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2017.2783902 · Cited by 1,226
Multi-Similarity Loss With General Pair Weighting for Deep Metric Learning
Wang, X., Han, X., Huang, W., Dong, D., & Scott, M. R. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00516 · Cited by 854
Water Feature Extraction and Change Detection Using Multitemporal Landsat Imagery
Rokni, K., Ahmad, A., Selamat, A., & Hazini, S. (2014) · Remote Sensing · doi:10.3390/rs6054173 · Cited by 708
Nielsen, A. A., Conradsen, K., & Simpson, J. J. (1998) · Remote Sensing of Environment · doi:10.1016/s0034-4257(97)00162-4 · Cited by 667
PCA‐based land‐use change detection and analysis using multitemporal and multisensor satellite data
Deng, J. S., Wang, K., Deng, Y. H., & Qi, G. J. (2008) · International Journal of Remote Sensing · doi:10.1080/01431160801950162 · Cited by 656
Change Detection in Synthetic Aperture Radar Images Based on Deep Neural Networks
Gong, M., Zhao, J., Liu, J., Miao, Q., & Jiao, L. (2016) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2015.2435783 · Cited by 638
Mou, L., Bruzzone, L., & Zhu, X. X. (2019) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2018.2863224 · Cited by 633
Change Detection Based on Deep Siamese Convolutional Network for Optical Aerial Images
Zhan, Y., Fu, K., Yan, M., Sun, X., Wang, H., & Qiu, X. (2017) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2017.2738149 · Cited by 588
A critical synthesis of remotely sensed optical image change detection techniques
Tewkesbury, A. P., Comber, A. J., Tate, N. J., Lamb, A., & Fisher, P. F. (2015) · Remote Sensing of Environment · doi:10.1016/j.rse.2015.01.006 · Cited by 525
Liu, J., Gong, M., Qin, K., & Zhang, P. (2018) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2016.2636227 · Cited by 522
Urban Change Detection for Multispectral Earth Observation Using Convolutional Neural Networks
Daudt, R. C., Le Saux, B., Boulch, A., & Gousseau, Y. (2018) · IGARSS 2018 - 2018 IEEE International Geoscience and Remote Sensing Symposium · doi:10.1109/igarss.2018.8518015 · Cited by 466
Slow Feature Analysis for Change Detection in Multispectral Imagery
Wu, C., Du, B., & Zhang, L. (2014) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2013.2266673 · Cited by 349
Learning a Transferable Change Rule from a Recurrent Neural Network for Land Cover Change Detection
Lyu, H., Lu, H., & Mou, L. (2016) · Remote Sensing · doi:10.3390/rs8060506 · Cited by 334
Nemmour, H., & Chibani, Y. (2006) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2006.09.004 · Cited by 316
IM, J., & JENSEN, J. (2005) · Remote Sensing of Environment · doi:10.1016/j.rse.2005.09.008 · Cited by 310
3D change detection – Approaches and applications
Qin, R., Tian, J., & Reinartz, P. (2016) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2016.09.013 · Cited by 291
Discriminative Deep Metric Learning for Face and Kinship Verification
Lu, J., Hu, J., & Tan, Y.-P. (2017) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2717505 · Cited by 275
Change Detection in Optical Aerial Images by a Multilayer Conditional Mixed Markov Model
Benedek, C., & Sziranyi, T. (2009) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2009.2022633 · Cited by 260
Triplet-Based Semantic Relation Learning for Aerial Remote Sensing Image Change Detection
Zhang, M., Xu, G., Chen, K., Yan, M., & Sun, X. (2019) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2018.2869608 · Cited by 248
Zou, Z., & Shi, Z. (2018) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2773199 · Cited by 238
Self-citationBuilding Change Detection in Multitemporal Very High Resolution SAR Images
Marin, C., Bovolo, F., & Bruzzone, L. (2015) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2014.2363548 · Cited by 227
Zhong, P., & Wang, R. (2007) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2007.907109 · Cited by 180
Coupled Adversarial Training for Remote Sensing Image Super-Resolution
Lei, S., Shi, Z., & Zou, Z. (2019) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2019.2959020 · Cited by 159
Self-citationContext Driven Scene Parsing with Attention to Rare Classes
Yang, J., Price, B. L., Cohen, S. D., & Yang, M. (2014) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2014.415 · Cited by 149
Wang, M., Tan, K., Jia, X., Wang, X., & Chen, Y. (2020) · Remote Sensing · doi:10.3390/rs12020205 · Cited by 141
Constrained optical flow for aerial image change detection
Bourdis, N., Marraud, D., & Sahbi, H. (2011) · IEEE International Geoscience and Remote Sensing Symposium (IGARSS) · doi:10.1109/igarss.2011.6050150 · Cited by 113
The Temporal Dynamics of Slums Employing a CNN-Based Change Detection Approach
Liu, R., Kuffer, M., & Persello, C. (2019) · Remote Sensing · doi:10.3390/rs11232844 · Cited by 113
Exploring the Potential of Machine Learning for Automatic Slum Identification from VHR Imagery
Duque, J. C., Patino, J. E., & Betancourt, A. (2017) · Remote Sensing · doi:10.3390/rs9090895 · Cited by 100
DSSNet: A Simple Dilated Semantic Segmentation Network for Hyperspectral Imagery Classification
Pan, B., Xu, X., Shi, Z., Zhang, N., Luo, H., & Lan, X. (2020) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2019.2960528 · Cited by 100
Self-citationDiversity-Promoting Deep Structural Metric Learning for Remote Sensing Scene Classification
Gong, Z., Zhong, P., Yu, Y., & Hu, W. (2017) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2017.2748120 · Cited by 91
Lv, Z., Liu, T., Wan, Y., Benediktsson, J. A., & Zhang, X. (2018) · Remote Sensing · doi:10.3390/rs10030472 · Cited by 56
Remote Sensing Image Change Detection Based on Information Transmission and Attention Mechanism
Liu, R., Zhi-hong, C., Zhang, L., et al. (2019) · IEEE Access · doi:10.1109/access.2019.2947286 · Cited by 49
Spatiotemporal Group Context for Pedestrian Counting
Wang, J., Fu, W., Liu, J., & Lu, H. (2014) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2014.2308616 · Cited by 20
Unsupervised change detection using Spatial Transformer Networks
Chianucci, D., & Savakis, A. E. (2016) · IEEE Western New York Image and Signal Processing Workshop (WNYISPW) · doi:10.1109/wnyipw.2016.7904833 · Cited by 14
Learning to Segment Objects of Various Sizes in VHR Aerial Images
Chen, H., Shi, T., Xia, Z., Liu, D., Wu, X., & Shi, Z. (2018) · Communications in computer and information science · doi:10.1007/978-981-13-1702-6_33 · Cited by 4
Self-citation
Research works printed but not linked: 21
- Huang, 2013, Building change detection from multitemporal high-resolution remotely sensed images based on a morphological building index, IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens., 7, 105, 10.1109/JSTARS.2013.2252423 · doi:10.1109/jstars.2013.2252423
- Mahdavi, S., Salehi, B., Huang, W., Amani, M., and Brisco, B. (2019). A PolSAR Change Detection Index Based on Neighborhood Information for Flood Mapping. Remote Sens., 11. · doi:10.3390/rs11161854
- Chen, 2013, Multi-Decadal Mangrove Forest Change Detection and Prediction in Honduras, Central America, with Landsat Imagery and a Markov Chain Model, Remote Sens., 5, 6408, 10.3390/rs5126408 · doi:10.3390/rs5126408
- Liu, B., Chen, J., Chen, J., and Zhang, W. (2018). Land Cover Change Detection Using Multiple Shape Parameters of Spectral and NDVI Curves. Remote Sens., 10. · doi:10.3390/rs10081251
- Johnson, 1998, Change vector analysis: A technique for the multispectral monitoring of land cover and condition, Int. J. Remote Sens., 19, 411, 10.1080/014311698216062 · doi:10.1080/014311698216062
- Gapper, J.J., El-Askary, H.M., Linstead, E., and Piechota, T. (2019). Coral Reef Change Detection in Remote Pacific Islands Using Support Vector Machine Classifiers. Remote Sens., 11. · doi:10.3390/rs11131525
- Kasetkasem, 2002, An image change detection algorithm based on Markov random field models, IEEE Trans. Geosci. Remote Sens., 40, 1815, 10.1109/TGRS.2002.802498 · DOI
- Zong, 2019, Building change detection from remotely sensed images based on spatial domain analysis and Markov random field, J. Appl. Remote Sens., 13, 1, 10.1117/1.JRS.13.024514 · doi:10.1117/1.jrs.13.024514
- Malpica, 2013, Change detection of buildings from satellite imagery and lidar data, Int. J. Remote Sens., 34, 1652, 10.1080/01431161.2012.725483 · doi:10.1080/01431161.2012.725483
- Bachofer, F., Braun, A., Adamietz, F., Murray, S., d’Angelo, P., Kyazze, E., Mumuhire, A.P., and Bower, J. (2019). Building Stock and Building Typology of Kigali, Rwanda. Int. Conf. Data Technol. Appl., 4. · doi:10.3390/data4030105
- Liu, Y., Pang, C., Zhan, Z., Zhang, X., and Yang, X. (2019). Building Change Detection for Remote Sensing Images Using a Dual Task Constrained Deep Siamese Convolutional Network Model. arXiv.
- He, K., Zhang, X., Ren, S., and Sun, J. (July, January 26). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, CA, USA.
- Simonyan, K., and Zisserman, A. (2014). Very deep convolutional networks for large-scale image recognition. arXiv.
- Castelluccio, M., Poggi, G., Sansone, C., and Verdoliva, L. (2015). Land use classification in remote sensing images by convolutional neural networks. arXiv.
- Bahdanau, D., Cho, K., and Bengio, Y. (2014). Neural machine translation by jointly learning to align and translate. arXiv.
- Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, Ł., and Polosukhin, I. (2017). Attention is all you need. Advances in Neural Information Processing Systems, MIT Press.
- Chen, 2012, A semisupervised context-sensitive change detection technique via gaussian process, IEEE Geosci. Remote Sens. Lett., 10, 236, 10.1109/LGRS.2012.2199279 · doi:10.1109/lgrs.2012.2199279
- Qingqing, H., Yu, M., Jingbo, C., Anzhi, Y., and Lei, L. (2017, January 23–28). Landslide change detection based on spatio-temporal context. Proceedings of the 2017 IEEE International Geoscience and Remote Sensing Symposium (IGARSS), Fort Worth, TX, USA. · DOI
- Paszke, A., Gross, S., Chintala, S., Chanan, G., Yang, E., DeVito, Z., Lin, Z., Desmaison, A., Antiga, L., and Lerer, A. (2017, January 4–9). Automatic differentiation in PyTorch. Proceedings of the 2017 Neural Information Processing Systems, Long Beach, CA, USA.
- Kingma, D.P., and Ba, J. (2014). Adam: A method for stochastic optimization. arXiv.
- Huo, 2016, Learning relationship for very high resolution image change detection, IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens., 9, 3384, 10.1109/JSTARS.2016.2569598 · doi:10.1109/jstars.2016.2569598
Cited by
Remote Sensing Image Change Detection With Transformers
Chen, H., Qi, Z., & Shi, Z. (2022) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2021.3095166 · Cited by 1,189
Self-citationSNUNet-CD: A Densely Connected Siamese Network for Change Detection of VHR Images
Fang, S., Li, K., Shao, J., & Li, Z. (2022) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2021.3056416 · Cited by 1,182
A Transformer-Based Siamese Network for Change Detection
Bandara, W. G. C., & Patel, V. M. (2022) · IGARSS 2022 - 2022 IEEE International Geoscience and Remote Sensing Symposium · doi:10.1109/igarss46834.2022.9883686 · Cited by 1,095
Shi, Q., Liu, M., Li, S., Liu, X., Wang, F., & Zhang, L. (2022) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2021.3085870 · Cited by 698
Revisiting Weak-to-Strong Consistency in Semi-Supervised Semantic Segmentation
Yang, L., Qi, L., Feng, L., Zhang, W., & Shi, Y. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52729.2023.00699 · Cited by 580
Metadata
- Authors
- Chen, H., & Shi, Z.
- Venue
- Remote Sensing
- Publisher
- MDPI AG
- Published
- 2020-05-22
- Volume
- 12
- Issue
- 10
- Pages
- 1662
- ISSN
- 2072-4292 (ISSN-L)
- OpenAlex
- W3027225766
- Cited by
- 1,903
- References
- 54
- FWCI
- 77.73
- Type
- journal article
- Language
- en
- Open access
- gold
- Funders
- the National Key R&D Programof China (2017YFC1405605)
- the Beijing Natural Science Foundation (4192034)
- Shanghai Association for Science and Technology (SAST2018096)
- National Natural Science Foundation of China (61671037)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.