The DOI matches its Crossref record; 49 of the 49 references it cites were found in a registry or an index.
Robust Registration of Multimodal Remote Sensing Images Based on Structural Similarity
Open accessAbstract
Automatic registration of multimodal remote sensing data [e.g., optical, light detection and ranging (LiDAR), and synthetic aperture radar (SAR)] is a challenging task due to the significant nonlinear radiometric differences between these data. To address this problem, this paper proposes a novel feature descriptor named the histogram of orientated phase congruency (HOPC), which is based on the structural properties of images. Furthermore, a similarity metric named HOPCncc is defined, which uses the normalized correlation coefficient (NCC) of the HOPC descriptors for multimodal registration. In the definition of the proposed similarity metric, we first extend the phase congruency model to generate its orientation representation and use the extended model to build HOPCncc. Then, a fast template matching scheme for this metric is designed to detect the control points between images. The proposed HOPCncc aims to capture the structural similarity between images and has been tested with a variety of optical, LiDAR, SAR, and map data. The results show that HOPCncc is robust against complex nonlinear radiometric differences and outperforms the state-of-the-art similarities metrics (i.e., NCC and mutual information) in matching performance. Moreover, a robust registration method is also proposed in this paper based on HOPCncc, which is evaluated using six pairs of multimodal remote sensing images. The experimental results demonstrate the effectiveness of the proposed method for multimodal image registration.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Distinctive Image Features from Scale-Invariant Keypoints
Lowe, D. G. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000029664.99615.94 · Cited by 55,589
Histograms of Oriented Gradients for Human Detection
Dalal, N., & Triggs, B. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.177 · Cited by 33,584
A Computational Approach to Edge Detection
Canny, J. (1986) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.1986.4767851 · Cited by 30,004
Fischler, M. A., & Bolles, R. C. (1981) · Communications of the ACM · doi:10.1145/358669.358692 · Cited by 25,893
Speeded-Up Robust Features (SURF)
Bay, H., Ess, A., Tuytelaars, T., & Van Gool, L. (2008) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2007.09.014 · Cited by 13,557
ORB: An efficient alternative to SIFT or SURF
Rublee, E., Rabaud, V., Konolige, K., & Bradski, G. (2011) · 2011 International Conference on Computer Vision · doi:10.1109/iccv.2011.6126544 · Cited by 11,037
Object Detection with Discriminatively Trained Part-Based Models
Felzenszwalb, P. F., Girshick, R. B., McAllester, D., & Ramanan, D. (2010) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2009.167 · Cited by 9,853
A performance evaluation of local descriptors
Mikolajczyk, K., & Schmid, C. (2005) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2005.188 · Cited by 6,723
Image registration methods: a survey
Zitová, B., & Flusser, J. (2003) · Image and Vision Computing · doi:10.1016/s0262-8856(03)00137-9 · Cited by 6,423
The importance of phase in signals
Oppenheim, A. V., & Lim, J. S. (1981) · Proceedings of the IEEE · doi:10.1109/proc.1981.12022 · Cited by 1,868
Alahi, A., Ortiz, R., & Vandergheynst, P. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6247715 · Cited by 1,775
Matching Local Self-Similarities across Images and Videos
Shechtman, E., & Irani, M. (2007) · 2007 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2007.383198 · Cited by 1,076
MIND: Modality independent neighbourhood descriptor for multi-modal deformable registration
Heinrich, M. P., Jenkinson, M., Bhushan, M., Matin, T., Gleeson, F. V., Brady, S. M., & Schnabel, J. A. (2012) · Medical Image Analysis · doi:10.1016/j.media.2012.05.008 · Cited by 707
Image registration by maximization of combined mutual information and gradient information
Pluim, J. P. W., Maintz, J. B. A., & Viergever, M. A. (2000) · IEEE Transactions on Medical Imaging · doi:10.1109/42.876307 · Cited by 670
Feature detection from local energy
Morrone, M. C., & Owens, R. A. (1987) · Pattern Recognition Letters · doi:10.1016/0167-8655(87)90013-4 · Cited by 655
Earthquake Damage Assessment of Buildings Using VHR Optical and SAR Imagery
Brunner, D., Lemoine, G., & Bruzzone, L. (2010) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2009.2038274 · Cited by 586
Self-citationUniform Robust Scale-Invariant Feature Matching for Optical Remote Sensing Images
Sedaghat, A., Mokhtarzade, M., & Ebadi, H. (2011) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2011.2144607 · Cited by 334
Intensity-Based Image Registration by Minimizing Residual Complexity
Myronenko, A., & Song, X. (2010) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2010.2053043 · Cited by 325
Combining efficient object localization and image classification
Harzallah, H., Jurie, F., & Schmid, C. (2009) · 2009 IEEE 12th International Conference on Computer Vision · doi:10.1109/iccv.2009.5459257 · Cited by 295
Piecewise linear mapping functions for image registration
Goshtasby, A. (1986) · Pattern Recognition · doi:10.1016/0031-3203(86)90044-0 · Cited by 283
A fast area-based stereo matching algorithm
Stefano, L. D., Marchionni, M., & Mattoccia, S. (2004) · Image and Vision Computing · doi:10.1016/j.imavis.2004.03.009 · Cited by 277
Non-local Shape Descriptor: A New Similarity Metric for Deformable Multi-modal Registration
Heinrich, M. P., Jenkinson, M., Bhushan, M., Matin, T., Gleeson, F. V., Brady, J. M., & Schnabel, J. A. (2011) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-23629-7_66 · Cited by 268
Cole-Rhodes, A. A., Johnson, K. L., LeMoigne, J., & Zavorin, I. (2003) · IEEE Transactions on Image Processing · doi:10.1109/tip.2003.819237 · Cited by 264
ARRSI: Automatic Registration of Remote-Sensing Images
Wong, A., & Clausi, D. A. (2007) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2007.892601 · Cited by 236
Remote Sensing Image Matching Based on Adaptive Binning SIFT Descriptor
Sedaghat, A., & Ebadi, H. (2015) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2015.2420659 · Cited by 221
On the possibility of automatic multisensor image registration
Inglada, J., & Giros, A. (2004) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2004.835294 · Cited by 215
Automatic Image Registration Through Image Segmentation and SIFT
Goncalves, H., Corte-Real, L., & Goncalves, J. A. (2011) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2011.2109389 · Cited by 214
Delaunay triangulations in TIN creation: an overview and a linear-time algorithm
Tsai, V. J. D. (1993) · International Journal of Geographical Information Systems · doi:10.1080/02693799308901979 · Cited by 191
Mutual information-based image registration for remote sensing data
Chen, H.-M., Arora, M. K., & Varshney, P. K. (2003) · International Journal of Remote Sensing · doi:10.1080/0143116031000117047 · Cited by 189
Ye, Y., & Shan, J. (2014) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2014.01.009 · Cited by 186
Self-citationRotation-Invariant HOG Descriptors Using Fourier Analysis in Polar and Spherical Coordinates
Liu, K., Skibbe, H., Schmidt, T., Blein, T., Palme, K. J., Brox, T., & Ronneberger, O. (2013) · International Journal of Computer Vision · doi:10.1007/s11263-013-0634-z · Cited by 165
Yu, L., Zhang, D., & Holden, E. (2008) · Computers & Geosciences · doi:10.1016/j.cageo.2007.10.005 · Cited by 158
Ye, Y., & Shen, L. (2016) · ISPRS annals of the photogrammetry, remote sensing and spatial information sciences · doi:10.5194/isprs-annals-iii-1-9-2016 · Cited by 155
Self-citationData-driven visual similarity for cross-domain image matching
Shrivastava, A., Malisiewicz, T., Gupta, A. K., & Efros, A. A. (2011) · ACM Transactions on Graphics · doi:10.1145/2070781.2024188 · Cited by 155
Robust Optical-to-SAR Image Matching Based on Shape Properties
Ye, Y., Shen, L., Hao, M., Wang, J., & Xu, Z. (2017) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2017.2660067 · Cited by 150
Self-citationMatching by Tone Mapping: Photometric Invariant Template Matching
Hel-Or, Y., Hel-Or, H. Z., & David, E. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.138 · Cited by 111
Tsai, C.-L., Li, C.-Y., Yang, G., & Lin, K.-S. (2009) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2009.2030324 · Cited by 111
Self-similarity weighted mutual information: A new nonrigid image registration metric
Rivaz, H. J., Karimaghaloo, Z., & Collins, D. L. (2013) · Medical Image Analysis · doi:10.1016/j.media.2013.12.003 · Cited by 109
Fully Automatic Subpixel Image Registration of Multiangle CHRIS/Proba Data
Ma, J., Chan, J. C.-W., & Canters, F. (2010) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2010.2042813 · Cited by 101
Wavelet-based image registration technique for high-resolution remote sensing images
Hong, G., & Zhang, Y. (2008) · Computers & Geosciences · doi:10.1016/j.cageo.2008.03.005 · Cited by 98
Image Registration Based on Autocorrelation of Local Structure
Li, Z., Mahapatra, D., Tielbeek, J. A. W., Stoker, J., A, L. J. V. V., & Vos, F. M. (2015) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2015.2455416 · Cited by 92
Kelman, A., Sofka, M., & Stewart, C. V. (2007) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2007.383426 · Cited by 91
Sui, H., Xu, C., Liu, J., & Hua, F. (2015) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2015.2431498 · Cited by 89
HAIRIS: A Method for Automatic Image Registration Through Histogram-Based Image Segmentation
Gonçalves, H. M. D. S. L. M., Gonçalves, J. A., & Côrte-Real, L. (2010) · IEEE Transactions on Image Processing · doi:10.1109/tip.2010.2076298 · Cited by 70
Improving the SIFT descriptor with smooth derivative filters
Moreno, P., Bernardino, A. J. M., & Santos-Victor, J. (2008) · Pattern Recognition Letters · doi:10.1016/j.patrec.2008.08.012 · Cited by 68
A multi-resolution area-based technique for automatic multi-modal image registration
Bunting, P., Labrosse, F., & Lucas, R. (2009) · Image and Vision Computing · doi:10.1016/j.imavis.2009.12.005 · Cited by 46
Han, Y., Choi, J., Byun, Y.-G., & Kim, Y. (2014) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2013.2291001 · Cited by 41
CHAIR: automatic image registration based on correlation and Hough transform
Gonçalves, H. M. D. S. L. M., Gonçalves, J. A., Côrte-Real, L., & Teodoro, A. C. (2012) · International Journal of Remote Sensing · doi:10.1080/01431161.2012.701345 · Cited by 30
A comparative study of DEM registration approaches
Ravanbakhsh, M., & Fraser, C. S. (2013) · Journal of Spatial Science · doi:10.1080/14498596.2012.759091 · Cited by 26
Research works printed but not linked: 4
- kovesi, 1999, Image features from phase congruency, VIDERE J Comput Vis Res, 1, 1
- 10.1109/TIP.2005.847287 · doi:10.1109/tip.2005.847287
- 10.1109/TGRS.2015.2487457 · doi:10.1109/tgrs.2015.2487457
- 10.1109/ICCV.2011.6126389 · DOI
Cited by
Deep learning in remote sensing applications: A meta-analysis and review
Ma, L., Liu, Y., Zhang, X., Ye, Y., Yin, G., & Johnson, B. A. (2019) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2019.04.015 · Cited by 2,456
Self-citationImage Matching from Handcrafted to Deep Features: A Survey
Ma, J., Jiang, X., Fan, A., Jiang, J., & Yan, J. (2021) · International Journal of Computer Vision · doi:10.1007/s11263-020-01359-2 · Cited by 990
RIFT: Multi-Modal Image Matching Based on Radiation-Variation Insensitive Feature Transform
Li, J., Hu, Q., & Ai, M. (2020) · IEEE Transactions on Image Processing · doi:10.1109/tip.2019.2959244 · Cited by 651
A review of multimodal image matching: Methods and applications
Jiang, X., Ma, J., Xiao, G., Shao, Z., & Guo, X. (2021) · Information Fusion · doi:10.1016/j.inffus.2021.02.012 · Cited by 532
Fast and Robust Matching for Multimodal Remote Sensing Image Registration
Ye, Y., Bruzzone, L., Shan, J., Bovolo, F., & Zhu, Q. (2019) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2019.2924684 · Cited by 414
Self-citation
Metadata
- Authors
- Ye, Y., Shan, J., Bruzzone, L., & Shen, L.
- Venue
- IEEE Transactions on Geoscience and Remote Sensing
- Published
- 2017-05
- Volume
- 55
- Issue
- 5
- Pages
- 2941-2958
- ISSN
- 0196-2892 (ISSN-L)
- 1558-0644
- OpenAlex
- W2589547048
- Cited by
- 487
- References
- 49
- FWCI
- 25.76
- Type
- journal article
- Language
- en
- Open access
- green
- Funders
- National Key and Development Research Program of China (2016YFB0501403, 2016YFB0502603)
- National Natural Science Foundation of China (41401369, 41401374)
- Science and Technology Program of Sichuan, China (2015SZ0046)
- Fundamental Research Funds for the Central Universities (2682016CX083)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.