Exploiting Deep Matching and SAR Data for the Geo-Localization Accuracy Improvement of Optical Satellite Images
Open accessThe DOI matches its Crossref record; 55 of the 55 references it cites were found in a registry or an index.
Abstract
Improving the geo-localization of optical satellite images is an important pre-processing step for many remote sensing tasks like monitoring by image time series or scene analysis after sudden events. These tasks require geo-referenced and precisely co-registered multi-sensor data. Images captured by the high resolution synthetic aperture radar (SAR) satellite TerraSAR-X exhibit an absolute geo-location accuracy within a few decimeters. These images represent therefore a reliable source to improve the geo-location accuracy of optical images, which is in the order of tens of meters. In this paper, a deep learning-based approach for the geo-localization accuracy improvement of optical satellite images through SAR reference data is investigated. Image registration between SAR and optical images requires few, but accurate and reliable matching points. These are derived from a Siamese neural network. The network is trained using TerraSAR-X and PRISM image pairs covering greater urban areas spread over Europe, in order to learn the two-dimensional spatial shifts between optical and SAR image patches. Results confirm that accurate and reliable matching points can be generated with higher matching accuracy and precision with respect to state-of-the-art approaches.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Most of the image registration methods using deep learning are based on a Siamese network (Bromley et al., 1994;Merkle et al., 2017;He et al., 2018;Hughes et al., 2018a;Wang et al., 2018b).”
From Deep learning in remote sensing applications: A meta-analysis and review (2019) · cites this paper as Merkle et al., 2017
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S., & Szegedy, C. (2015) · arXiv · doi:10.48550/arxiv.1502.03167 · Cited by 27,818
Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification
He, K., Zhang, X., Ren, S., & Sun, J. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.123 · Cited by 19,741
Multi-scale context aggregation by dilated convolutions
Yu, F., & Koltun, V. (2015) · arXiv · doi:10.48550/arxiv.1511.07122 · Cited by 7,738 · cited 2×
“In contrast, dilated convolutions [46] systematically aggregate information through an exponential growth of the receptive without degradation in resolution.”
BackgroundMethodA Non-Local Algorithm for Image Denoising
Buades, A., Coll, B., & Morel, J.-M. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.38 · Cited by 7,616
(2010) · Journal of Machine Learning Research · doi:10.5555/1756006.1953039 · Cited by 4,051
Deep learning-based classification of hyperspectral data
Chen, Y., Lin, Z., Zhao, X., Wang, G., & Gu, Y. (2014) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2014.2329330 · Cited by 2,679
SIGNATURE VERIFICATION USING A “SIAMESE” TIME DELAY NEURAL NETWORK
BROMLEY, J., BENTZ, J. W., BOTTOU, L., GUYON, I., LECUN, Y., MOORE, C., SÄCKINGER, E., & SHAH, R. (1994) · Series in Machine Perception and Artificial Intelligence · doi:10.1142/9789812797926_0003 · Cited by 2,350
Pansharpening by Convolutional Neural Networks
Masi, G., Cozzolino, D., Verdoliva, L., & Scarpa, G. (2016) · Remote Sensing · doi:10.3390/rs8070594 · Cited by 1,152
Cited by
Items 101–131 of 131
Wu, Y., Bai, Z., Gong, M., BoYiTing, Q. U., Li, H., Zhang, M., Ma, W., & Miao, Q. (2021) · Scientia Sinica Technologica · doi:10.1360/sst-2021-0193 · Cited by 3
Wang, M. Y.-F., Ye, Y., Sun, M., Tan, X., & Li, L. (2020) · ISPRS annals of the photogrammetry, remote sensing and spatial information sciences · doi:10.5194/isprs-annals-v-1-2020-117-2020 · Cited by 2
Robust matching of optical and SAR images based on deep feature reconstruction enhancement
Chao, Y., Chang, L., Tang, T., & Ye, Y. (2025) · National Remote Sensing Bulletin · doi:10.11834/jrs.20254295 · Cited by 2
Bertrand, S., Bourmaud, G., Vacar, C., & Bombrun, L. (2025) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2025.3624474 · Cited by 2
Zhang, Y., Liu, R., Zhang, Z., Shi, L., Weng, L., & Hu, L. (2025) · Remote Sensing · doi:10.3390/rs17213571 · Cited by 2
Multi-Source Remote Sensing Image Matching in Mountainous Areas Based on Spatial Structure Features
Liu, X., Jiang, F., Zhang, Q., Fang, S., Zhang, S., Yan, Y., Xiang, P., & Xiong, Q. (2025) · IEEE Access · doi:10.1109/access.2025.3635291 · Cited by 2
Physics-Aware Deep Learning for SAR and InSAR Remote Sensing: Models, Methods, and Open Challenges
Taricco, G. (2026) · Remote Sensing · doi:10.3390/rs18152567 · Cited by 2
Two-Stage Registration for Optical and SAR Images With Combined Features and Graph Neural Networks
Wu, W., Ning, C., Guo, J., Zhang, T., & Jia, X. (2024) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2024.3451524 · Cited by 2
Gençay, S., & Özcan, C. (2024) · Acta Polytechnica Hungarica · doi:10.12700/aph.21.11.2024.11.4 · Cited by 2
Neural network algorithm for optical-SAR image registration based on a uniform grid of points
Volkov, V. V., & Shvets, E. A. (2024) · Computer Optics · doi:10.18287/2412-6179-co-1426 · Cited by 2
Amit, A. S. M. S., Zhang, X., Shagar, M. M. B., Liu, Z., Li, X., & Meng, F. (2025) · IEEE International Conference on Pattern Recognition and Machine Learning (PRML) · doi:10.1109/prml66062.2025.11160240 · Cited by 2
Robust Self-supervised Correspondence Learning for SAR-optical Image Matching
An, C., Cao, F., Wang, P., & Shi, T. (2022) · International Conference on Computer Science, Electronic Information Engineering and Intelligent Control Technology (CEI) · doi:10.1109/cei57409.2022.9950181 · Cited by 2
Identifying corresponding SAR-Optical patches using Inception-inspired Pseudo-Siamese CNN
Patidar, D., & Sharma, N. (2022) · IEEE International Geoscience and Remote Sensing Symposium (IGARSS) · doi:10.1109/igarss46834.2022.9884356 · Cited by 1
Deep Convolutional Network Based on Attention Mechanism for Matching Optical and SAR Images
He, H., Yu, S. S., Zhou, F., Zhang, H., & Chen, L. (2024) · The international archives of the photogrammetry, remote sensing and spatial information sciences/International archives of the photogrammetry, remote sensing and spatial information sciences · doi:10.5194/isprs-archives-xlviii-1-2024-201-2024 · Cited by 1
SAR-optical deep UNet matching with Gabor jet model
Islam, S. M., Ghosh, S., Choudhury, A., & Pal, A. (2024) · Image and signal processing for remote sensing. Conference · doi:10.1117/12.3036263 · Cited by 1
Fault Displacement Detection Caused by Large Earthquake Using Extended Deepmatching
Kumon, Y., & Iwasaki, A. (2020) · IEEE International Geoscience and Remote Sensing Symposium (IGARSS) · doi:10.1109/igarss39084.2020.9323200
(2021) · Wiley eBooks · doi:10.1002/9781119646181.biblio
Similarity Analysis Between SAR Target Images Based on Siamese Network
Park, J. (2022) · Journal of the Korea Institute of Military Science and Technology · doi:10.9766/kimst.2022.25.5.462
Uss, M., Vozel, B., Лукин, В. В., & Chehdi, K. (2022) · IEEE International Geoscience and Remote Sensing Symposium (IGARSS) · doi:10.1109/igarss46834.2022.9883816
A Strong Scattering Solution with Applications to Remote Sensing Systems Modelling
Blackledge, J. (2023) · Irish Signals and Systems Conference · doi:10.1109/issc59246.2023.10162073
Scene-Level Matching Between Remote Sensing Optical and SAR Images
Zhong, H., Yan, Y., Gu, G., Su, N., & Zhang, H. (2023) · IEEE International Geoscience and Remote Sensing Symposium (IGARSS) · doi:10.1109/igarss52108.2023.10281652
Perspective Chapter: Simulation and Analysis of Synthetic Aperture Radar Images
Blackledge, J. (2023) · IntechOpen eBooks · doi:10.5772/intechopen.1002781
Automatic Matching of Optical and SAR Images Based on Attention Structure Features
Deng, J., Yang, C., Gong, G., Zhao, H. Y., Wang, L., & Ye, Y. (2023) · Journal of Physics Conference Series · doi:10.1088/1742-6596/2650/1/012046
Uss, M., Vozel, B., & Лукин, В. В. (2024) · IEEE KhPI Week on Advanced Technology (KhPIWeek) · doi:10.1109/khpiweek61434.2024.10878083
Prinos, K., Mungale, A., Gettings, K., Akhmejanov, T., & Mehta, D. (2025) · IEEE High Performance Extreme Computing Conference · doi:10.1109/hpec67600.2025.11196443
Qing, G., Xiong, B., Zhou, J., Zhao, L., & Kuang, G. (2025) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2025.3627228
Colin‐Koeniguer, E., Plyer, A., & Tong, A. C. H. (2026) · Elsevier eBooks · doi:10.1016/b978-0-44-343796-0.00011-5
Dai, H., Tan, J., Lysenko, V. S., & Guo, Y. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.6829862
Multi-Modal Remote Sensing Image Registration: A Comprehensive Review, Challenges, and Prospects
Han, Z., Ye, Y., Wu, Q., Chen, J., Zhu, B., & Hao, S. (2026) · Photogrammetric Engineering & Remote Sensing · doi:10.14358/pers.26-00034r2
A “World-Wide Web” for Mediation in the AI Era: Evidence From Antalya Diplomacy Forum
Turan, A., & UCUZAL, H. (2026) · IGI Global eBooks · doi:10.4018/979-8-3373-9529-6.ch019
RPC Bias Compensation of KOMPSAT-3 Optical Imagery Based on KOMPSAT-5 SAR
Lee, H., Han, D., & Yang, D. (2026) · Remote Sensing · doi:10.3390/rs18203626
Metadata
- Authors
- Merkle, N., Luo, W., Auer, S., Müller, R., & Urtasun, R.
- Affiliations
- Deutsches Zentrum für Luft- und Raumfahrt e. V. (DLR) (DE)
- University of Toronto (CA)
- Corresponding author
- Merkle, Nina
- Venue
- Remote Sensing
- Publisher
- MDPI AG
- Published
- 2017-06-10
- Volume
- 9
- Issue
- 6
- Pages
- 586
- ISSN
- 2072-4292 (ISSN-L)
- OpenAlex
- W2608922915
- Cited by
- 120
- References
- 55
- Citations by year
- 2026: 6 · 2025: 6 · 2024: 17 · 2023: 15 · 2022: 18 · 2021: 21 · 2020: 16 · 2019: 10 · 2018: 11
- FWCI
- 8.51
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Remote Sensing (publishedVersion, cc-by)
- elib (German Aerospace Center) (acceptedVersion)
- TSpace (University of Toronto) (submittedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Satellite Image Processing and Photogrammetry
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Image and Video Retrieval Techniques
- Physical Sciences › Engineering › Media Technology › Advanced Image Fusion Techniques
- Keywords
- geolocation, optical satellite imagery, synthetic aperture radar, TerraSAR-X, PRISM, image registration, Siamese network, urban environment
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.