The DOI matches its Crossref record; 44 of the 44 references it cites were found in a registry or an index.
Fast and Robust Matching for Multimodal Remote Sensing Image Registration
Open accessAbstract
While image matching has been studied in remote sensing community for decades, matching multimodal data [e.g., optical, light detection and ranging (LiDAR), synthetic aperture radar (SAR), and map] remains a challenging problem because of significant nonlinear intensity differences between such data. To address this problem, we present a novel fast and robust template matching framework integrating local descriptors for multimodal images. First, a local descriptor [such as histogram of oriented gradient (HOG) and local self-similarity (LSS) or speeded-up robust feature (SURF)] is extracted at each pixel to form a pixelwise feature representation of an image. Then, we define a fast similarity measure based on the feature representation using the fast Fourier transform (FFT) in the frequency domain. A template matching strategy is employed to detect correspondences between images. In this procedure, we also propose a novel pixelwise feature representation using orientated gradients of images, which is named channel features of orientated gradients (CFOG). This novel feature is an extension of the pixelwise HOG descriptor with superior performance in image matching and computational efficiency. The major advantages of the proposed matching framework include: 1) structural similarity representation using the pixelwise feature description and 2) high computational efficiency due to the use of FFT. The proposed matching framework has been evaluated using many different types of multimodal images, and the results demonstrate its superior matching performance with respect to the state-of-the-art methods.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Distinctive Image Features from Scale-Invariant Keypoints
Lowe, D. G. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000029664.99615.94 · Cited by 55,589
Histograms of Oriented Gradients for Human Detection
Dalal, N., & Triggs, B. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.177 · Cited by 33,584
Speeded-Up Robust Features (SURF)
Bay, H., Ess, A., Tuytelaars, T., & Van Gool, L. (2008) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2007.09.014 · Cited by 13,557 · cited 1×
“Recently, the local invariant features, such as shape context [13], speeded-up robust feature (SURF) [14], and scale-invariant feature transform (SIFT) [15], have been widely used for the matching of remote sensing images [16]–[19], although these features are robust to scale, rotation, and linear…”
BackgroundImage registration methods: a survey
Zitová, B., & Flusser, J. (2003) · Image and Vision Computing · doi:10.1016/s0262-8856(03)00137-9 · Cited by 6,423 · cited 2×
“A key step to integrate multimodal data for these applications is image registration, which aligns two or more images captured by different sensors, at different times, or from different viewpoints [5].”
BackgroundShape matching and object recognition using shape contexts
Belongie, S., Malik, J., & Puzicha, J. (2002) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.993558 · Cited by 6,306
An FFT-based technique for translation, rotation, and scale-invariant image registration
Reddy, B. S., & Chatterji, B. N. (1996) · IEEE Transactions on Image Processing · doi:10.1109/83.506761 · Cited by 1,836
DAISY: An Efficient Dense Descriptor Applied to Wide-Baseline Stereo
Tola, E., Lepetit, V., & Fua, P. (2010) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2009.77 · Cited by 1,405 · cited 2×
“Note that the trilinear interpolation in a one-cell block can be regarded as a convolution operation with a triangular kernel, which can be efficiently computed at each pixel of an image [42].”
BackgroundLarge Displacement Optical Flow: Descriptor Matching in Variational Motion Estimation
Brox, T., & Malik, J. (2011) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2010.143 · Cited by 1,295
Matching Local Self-Similarities across Images and Videos
Shechtman, E., & Irani, M. (2007) · 2007 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2007.383198 · Cited by 1,076
MIND: Modality independent neighbourhood descriptor for multi-modal deformable registration
Heinrich, M. P., Jenkinson, M., Bhushan, M., Matin, T., Gleeson, F. V., Brady, S. M., & Schnabel, J. A. (2012) · Medical Image Analysis · doi:10.1016/j.media.2012.05.008 · Cited by 707
Image registration by maximization of combined mutual information and gradient information
Pluim, J. P. W., Maintz, J. B. A., & Viergever, M. A. (2000) · IEEE Transactions on Medical Imaging · doi:10.1109/42.876307 · Cited by 670
Earthquake Damage Assessment of Buildings Using VHR Optical and SAR Imagery
Brunner, D., Lemoine, G., & Bruzzone, L. (2010) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2009.2038274 · Cited by 586
Self-citationRobust Registration of Multimodal Remote Sensing Images Based on Structural Similarity
Ye, Y., Shan, J., Bruzzone, L., & Shen, L. (2017) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2017.2656380 · Cited by 487
Self-citationA contour-based approach to multisensor image registration
Li, H., Manjunath, B. S., & Mitra, S. K. (1995) · IEEE Transactions on Image Processing · doi:10.1109/83.366480 · Cited by 485
Robust Feature Matching for Remote Sensing Image Registration via Locally Linear Transforming
Ma, J., Zhou, H., Zhao, J., Gao, Y., Jiang, J., & Tian, J. (2015) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2015.2441954 · Cited by 474
Bruzzone, L., & Bovolo, F. (2013) · Proceedings of the IEEE · doi:10.1109/jproc.2012.2197169 · Cited by 330
Self-citationMutual-Information-Based Registration of TerraSAR-X and Ikonos Imagery in Urban Areas
Suri, S., & Reinartz, P. (2010) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2009.2034842 · Cited by 330
Cole-Rhodes, A. A., Johnson, K. L., LeMoigne, J., & Zavorin, I. (2003) · IEEE Transactions on Image Processing · doi:10.1109/tip.2003.819237 · Cited by 264
Remote Sensing Image Matching Based on Adaptive Binning SIFT Descriptor
Sedaghat, A., & Ebadi, H. (2015) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2015.2420659 · Cited by 221
Automatic Image Registration Through Image Segmentation and SIFT
Goncalves, H., Corte-Real, L., & Goncalves, J. A. (2011) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2011.2109389 · Cited by 214
Mutual information-based image registration for remote sensing data
Chen, H.-M., Arora, M. K., & Varshney, P. K. (2003) · International Journal of Remote Sensing · doi:10.1080/0143116031000117047 · Cited by 189
Ye, Y., & Shan, J. (2014) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2014.01.009 · Cited by 186
Self-citationYu, L., Zhang, D., & Holden, E. (2008) · Computers & Geosciences · doi:10.1016/j.cageo.2007.10.005 · Cited by 158
Ye, Y., & Shen, L. (2016) · ISPRS annals of the photogrammetry, remote sensing and spatial information sciences · doi:10.5194/isprs-annals-iii-1-9-2016 · Cited by 155
Self-citationRobust Optical-to-SAR Image Matching Based on Shape Properties
Ye, Y., Shen, L., Hao, M., Wang, J., & Xu, Z. (2017) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2017.2660067 · Cited by 150
Self-citationA local phase based invariant feature for remote sensing image matching
Ye, Y., Shan, J., Hao, S., Bruzzone, L., & Qin, Y. (2018) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2018.06.010 · Cited by 130
Self-citationMatching by Tone Mapping: Photometric Invariant Template Matching
Hel-Or, Y., Hel-Or, H. Z., & David, E. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.138 · Cited by 111
Fully Automatic Subpixel Image Registration of Multiangle CHRIS/Proba Data
Ma, J., Chan, J. C.-W., & Canters, F. (2010) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2010.2042813 · Cited by 101
Kelman, A., Sofka, M., & Stewart, C. V. (2007) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2007.383426 · Cited by 91
Illumination-invariant image matching for autonomous UAV localisation based on optical sensing
Wan, X., Liu, J. G., Yan, H., & Morgan, G. L. K. (2016) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2016.05.016 · Cited by 80
Tuia, D., Marcos, D., & Camps‐Valls, G. (2016) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2016.07.004 · Cited by 67
Feature-based image registration using the shape context
Huang, L., & Li, Z. (2010) · International Journal of Remote Sensing · doi:10.1080/01431161003621585 · Cited by 62
Uniform competency-based local feature extraction for remote sensing images
Sedaghat, A., & Mohammadi, N. (2017) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2017.11.019 · Cited by 61
Automatic Remote-sensing Image Registration Using SURF
Bouchiha, R., & Besbes, K. (2013) · International Journal of Computer Theory and Engineering · doi:10.7763/ijcte.2013.v5.653 · Cited by 59
Efficient FFT-Accelerated Approach to Invariant Optical–LIDAR Registration
Wong, A. M., & Orchard, J. (2008) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2008.2001685 · Cited by 46
A multi-resolution area-based technique for automatic multi-modal image registration
Bunting, P., Labrosse, F., & Lucas, R. (2009) · Image and Vision Computing · doi:10.1016/j.imavis.2009.12.005 · Cited by 46
Multimodal Remote Sensing Image Registration With Accuracy Estimation at Local and Global Scales
Uss, M., Vozel, B., Лукин, В. В., & Chehdi, K. (2016) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2016.2587321 · Cited by 45
A Spatial-Feature-Enhanced MMI Algorithm for Multimodal Airborne Image Registration
Fan, X., Rhody, H. E., & Saber, E. S. (2010) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2010.2040390 · Cited by 43
Robust Affine-Invariant Line Matching for High Resolution Remote Sensing Images
Chen, M., & Shao, Z. (2013) · Photogrammetric Engineering & Remote Sensing · doi:10.14358/pers.79.8.753 · Cited by 42
The Illumination Robustness of Phase Correlation for Image Alignment
Wan, X., Liu, J. G., & Yan, H. (2015) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2015.2429740 · Cited by 36
Feature matching evaluation for multimodal correspondence
Gesto, M., Tombari, F., González‐Aguilera, D., López-Fernández, L., & Rodríguez‐Gonzálvez, P. (2017) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2017.05.007 · Cited by 34
CHAIR: automatic image registration based on correlation and Hough transform
Gonçalves, H. M. D. S. L. M., Gonçalves, J. A., Côrte-Real, L., & Teodoro, A. C. (2012) · International Journal of Remote Sensing · doi:10.1080/01431161.2012.701345 · Cited by 30
Fast and robust structure-based multimodal geospatial image matching
Ye, Y., Bruzzone, L., Shan, J., et al. (2017) · IEEE International Geoscience and Remote Sensing Symposium (IGARSS) · doi:10.1109/igarss.2017.8128160 · Cited by 10
Self-citationYe, Y. (2017) · The international archives of the photogrammetry, remote sensing and spatial information sciences/International archives of the photogrammetry, remote sensing and spatial information sciences · doi:10.5194/isprs-archives-xlii-2-w7-1009-2017 · Cited by 8
Self-citation
Cited by
A review of multimodal image matching: Methods and applications
Jiang, X., Ma, J., Xiao, G., Shao, Z., & Guo, X. (2021) · Information Fusion · doi:10.1016/j.inffus.2021.02.012 · Cited by 532
Triple Robustness Augmentation Local Features for multi-source image registration
Wang, C., Xu, L., Xu, R., Xu, S., Meng, W., Wang, R., & Zhang, X. (2023) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2023.03.023 · Cited by 22
Metadata
- Authors
- Ye, Y., Bruzzone, L., Shan, J., Bovolo, F., & Zhu, Q.
- Venue
- IEEE Transactions on Geoscience and Remote Sensing
- Published
- 2019-11
- Volume
- 57
- Issue
- 11
- Pages
- 9059-9070
- ISSN
- 0196-2892 (ISSN-L)
- 1558-0644
- OpenAlex
- W2887116847
- Cited by
- 414
- References
- 44
- FWCI
- 15.31
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.