The DOI matches its Crossref record; 57 of the 57 references it cites were found in a registry or an index.
RIFT: Multi-Modal Image Matching Based on Radiation-Variation Insensitive Feature Transform
Abstract
Traditional feature matching methods, such as scale-invariant feature transform (SIFT), usually use image intensity or gradient information to detect and describe feature points; however, both intensity and gradient are sensitive to nonlinear radiation distortions (NRD). To solve this problem, this paper proposes a novel feature matching algorithm that is robust to large NRD. The proposed method is called radiation-variation insensitive feature transform (RIFT). There are three main contributions in RIFT. First, RIFT uses phase congruency (PC) instead of image intensity for feature point detection. RIFT considers both the number and repeatability of feature points and detects both corner points and edge points on the PC map. Second, RIFT originally proposes a maximum index map (MIM) for feature description. The MIM is constructed from the log-Gabor convolution sequence and is much more robust to NRD than traditional gradient map. Thus, RIFT not only largely improves the stability of feature detection but also overcomes the limitation of gradient information for feature description. Third, RIFT analyses the inherent influence of rotations on the values of the MIM and realises rotation invariance. We use six different types of multi-modal image datasets to evaluate RIFT, including optical-optical, infrared-optical, synthetic aperture radar (SAR)-optical, depth-optical, map-optical, and day-night datasets. Experimental results show that RIFT is superior to SIFT and SAR-SIFT on multi-modal images. To the best of our knowledge, RIFT is the first feature matching algorithm that can achieve good performance on all the abovementioned types of multi-modal images. The source code of RIFT and the multi-modal image datasets are publicly available1.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Distinctive Image Features from Scale-Invariant Keypoints
Lowe, D. G. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000029664.99615.94 · Cited by 55,589
Speeded-Up Robust Features (SURF)
Bay, H., Ess, A., Tuytelaars, T., & Van Gool, L. (2008) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2007.09.014 · Cited by 13,557 · cited 3×
“However, even if the matching is successful, the NCMs are also small, i.e., 24, 24, and 23.”
BackgroundMethodA Combined Corner and Edge Detector
Harris, C., & Stephens, M. (1988) · Procedings of the Alvey Vision Conference 1988 · doi:10.5244/c.2.23 · Cited by 12,901
ORB: An efficient alternative to SIFT or SURF
Rublee, E., Rabaud, V., Konolige, K., & Bradski, G. (2011) · 2011 International Conference on Computer Vision · doi:10.1109/iccv.2011.6126544 · Cited by 11,037
ORB-SLAM: A Versatile and Accurate Monocular SLAM System
Mur-Artal, R., Montiel, J. M. M., & Tardos, J. D. (2015) · IEEE Transactions on Robotics · doi:10.1109/tro.2015.2463671 · Cited by 6,778
Image registration methods: a survey
Zitová, B., & Flusser, J. (2003) · Image and Vision Computing · doi:10.1016/s0262-8856(03)00137-9 · Cited by 6,423
The Fourier Transform and Its Applications
Bracewell, R., & Kahn, P. B. (1966) · American Journal of Physics · doi:10.1119/1.1973431 · Cited by 5,737
MonoSLAM: Real-time single camera SLAM
Davison, A. J., Reid, I. D., Molton, N. D., & Stasse, O. (2007) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2007.1049 · Cited by 3,959
Robust wide-baseline stereo from maximally stable extremal regions
Matas, J., Chum, O., Urban, M., & Pajdla, T. (2004) · Image and Vision Computing · doi:10.1016/j.imavis.2004.02.006 · Cited by 3,686
(1986) · Cited by 3,616
Scalable Recognition with a Vocabulary Tree
Nister, D., & Stewenius, H. (2006) · 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 2 (CVPR'06) · doi:10.1109/cvpr.2006.264 · Cited by 3,579
BRISK: Binary Robust invariant scalable keypoints
Leutenegger, S., Chli, M., & Siegwart, R. Y. (2011) · 2011 International Conference on Computer Vision · doi:10.1109/iccv.2011.6126542 · Cited by 3,450
PCA-SIFT: a more distinctive representation for local image descriptors
Ke, Y., & Sukthankar, R. (2004) · Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004. · doi:10.1109/cvpr.2004.1315206 · Cited by 3,237
Remote Sensing Digital Image Analysis: An Introduction
Richards, J. A., & Jia, X. (2006) · Springer eBooks · doi:10.1007/3-540-29711-1 · Cited by 2,759
Alignment by Maximization of Mutual Information
Viola, P., & Wells III, W. M. (1997) · International Journal of Computer Vision · doi:10.1023/a:1007958904918 · Cited by 2,610
Remote sensing, models, and methods for image processing
Schowengerdt, R. A. (1997) · Cited by 2,122
Hill, D. L. G., Batchelor, P. G., Holden, M., & Hawkes, D. J. (2001) · Physics in Medicine and Biology · doi:10.1088/0031-9155/46/3/201 · Cited by 2,093
The importance of phase in signals
Oppenheim, A. V., & Lim, J. S. (1981) · Proceedings of the IEEE · doi:10.1109/proc.1981.12022 · Cited by 1,868
Faster and Better: A Machine Learning Approach to Corner Detection
Rosten, E., Porter, R., & Drummond, T. (2010) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2008.275 · Cited by 1,849
Remote Sensing Digital Image Analysis: An Introduction
Richards, J. A., & Jia, X. (1999) · Springer eBooks · doi:10.1007/978-3-662-03978-6 · Cited by 1,533
ASIFT: A New Framework for Fully Affine Invariant Image Comparison
Morel, J.-M., & Yu, G. (2009) · SIAM Journal on Imaging Sciences · doi:10.1137/080732730 · Cited by 1,468
The Fourier Transform and its Applications
Cattermole, K. W. (1965) · Electronics and Power · doi:10.1049/ep.1965.0268 · Cited by 1,417
Fast Normalized Cross-Correlation
Yoo, J.-C., & Han, T. H. (2009) · Circuits, Systems and Signal Processing · doi:10.1007/s00034-009-9130-7 · Cited by 1,115
Indexing based on scale invariant interest points
Mikolajczyk, K., & Schmid, C. (2002) · Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001 · doi:10.1109/iccv.2001.937561 · Cited by 1,101
Matching Local Self-Similarities across Images and Videos
Shechtman, E., & Irani, M. (2007) · 2007 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2007.383198 · Cited by 1,076
BRIEF: Computing a Local Binary Descriptor Very Fast
Calonder, M., Lepetit, V., Ozuysal, M., Trzcinski, T., Strecha, C., & Fua, P. (2012) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2011.222 · Cited by 866
Fast Normalized Cross-Correlation
Lewis, J. P. (2010) · Cited by 737
Medical image registration: a review
Oliveira, F. P. M., & Tavares, J. M. R. S. (2014) · Computer Methods in Biomechanics and Biomedical Engineering · doi:10.1080/10255842.2012.670855 · Cited by 737
Feature detection from local energy
Morrone, M. C., & Owens, R. A. (1987) · Pattern Recognition Letters · doi:10.1016/0167-8655(87)90013-4 · Cited by 655
SAR-SIFT: A SIFT-Like Algorithm for SAR Images
Dellinger, F., Delon, J., Gousseau, Y., Michel, J., & Tupin, F. (2015) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2014.2323552 · Cited by 634
Registration of Translated and Rotated Images Using Finite Fourier Transforms
De Castro, E., & Morandi, C. (1987) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.1987.4767966 · Cited by 601
Robust Registration of Multimodal Remote Sensing Images Based on Structural Similarity
Ye, Y., Shan, J., Bruzzone, L., & Shen, L. (2017) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2017.2656380 · Cited by 487
Phase Congruency Detects Corners and Edges
Kovesi, P. D. (2003) · UWA Profiles and Research Repository (University of Western Australia) · Cited by 428
Phase congruency: A low-level image invariant
Kovesi, P. (2000) · Psychological Research · doi:10.1007/s004260000024 · Cited by 386
Uniform Robust Scale-Invariant Feature Matching for Optical Remote Sensing Images
Sedaghat, A., Mokhtarzade, M., & Ebadi, H. (2011) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2011.2144607 · Cited by 334
Correlation Techniques of Image Registration
Pratt, W. (1974) · IEEE Transactions on Aerospace and Electronic Systems · doi:10.1109/taes.1974.307828 · Cited by 316
A Partial Intensity Invariant Feature Descriptor for Multimodal Retinal Image Registration
Chen, J., Tian, J., Lee, N., Zheng, J., Smith, R. T., & Laine, A. F. (2010) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2010.2042169 · Cited by 311
Development and Status of Image Matching in Photogrammetry
Gruen, A. (2012) · The Photogrammetric Record · doi:10.1111/j.1477-9730.2011.00671.x · Cited by 249
ARRSI: Automatic Registration of Remote-Sensing Images
Wong, A., & Clausi, D. A. (2007) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2007.892601 · Cited by 236
Remote Sensing Image Matching Based on Adaptive Binning SIFT Descriptor
Sedaghat, A., & Ebadi, H. (2015) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2015.2420659 · Cited by 221
Self-Invertible 2D Log-Gabor Wavelets
Fischer, S., Šroubek, F., Perrinet, L., Redondo, R., & Cristóbal, G. (2007) · International Journal of Computer Vision · doi:10.1007/s11263-006-0026-8 · Cited by 179
Object Recognition as Many-to-Many Feature Matching
Demirci, M. F., Shokoufandeh, A., Keselman, Y., Bretzner, L., & Dickinson, S. (2006) · International Journal of Computer Vision · doi:10.1007/s11263-006-6993-y · Cited by 146
Fan, J., Wu, Y., Li, M., Liang, W., & Cao, Y. (2018) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2018.2815523 · Cited by 142
A local phase based invariant feature for remote sensing image matching
Ye, Y., Shan, J., Hao, S., Bruzzone, L., & Qin, Y. (2018) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2018.06.010 · Cited by 129
Tong, X., Ye, Z., Xu, Y., Liu, S., Li, L., Xie, H., & Li, T. (2015) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2015.2391999 · Cited by 123
Correlation-Coefficient-Based Fast Template Matching Through Partial Elimination
Mahmood, A., & Khan, S. B. J. (2011) · IEEE Transactions on Image Processing · doi:10.1109/tip.2011.2171696 · Cited by 116
SAR Image Registration Using Phase Congruency and Nonlinear Diffusion-Based SIFT
Fan, J., Wu, Y., Wang, F., et al. (2014) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2014.2351396 · Cited by 102
Log-Gabor Filters for Image-Based Vehicle Verification
Arróspide, J., & Salgado, L. (2013) · IEEE Transactions on Image Processing · doi:10.1109/tip.2013.2249080 · Cited by 99
Robust feature matching via support-line voting and affine-invariant ratios
Li, J., Hu, Q., Ai, M., & Zhong, R. (2017) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2017.08.009 · Cited by 67
Self-citationUniform competency-based local feature extraction for remote sensing images
Sedaghat, A., & Mohammadi, N. (2017) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2017.11.019 · Cited by 59
High-resolution image registration based on improved SURF detector and localized GTM
Sedaghat, A., & Mohammadi, N. (2018) · International Journal of Remote Sensing · doi:10.1080/01431161.2018.1528402 · Cited by 56
LAM: Locality affine-invariant feature matching
Li, J., Hu, Q., & Ai, M. (2019) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2019.05.006 · Cited by 49
Self-citationRobust Feature Matching for Remote Sensing Image Registration Based on $L_{q}$ -Estimator
Li, J., Hu, Q., & Ai, M. (2016) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2016.2620147 · Cited by 33
Self-citationRobust feature matching for geospatial images via an affine‐invariant coordinate system
Li, J., Hu, Q., & Ai, M. (2017) · The Photogrammetric Record · doi:10.1111/phor.12201 · Cited by 23
Self-citationDEM orientation based on local feature correspondence with global DEMs
Sedaghat, A., & Naeini, A. A. (2017) · GIScience & Remote Sensing · doi:10.1080/15481603.2017.1364879 · Cited by 15
BIPCO: ultrasound feature points based on phase congruency detector and binary pattern descriptor
Dall’Alba, D., & Fiorini, P. (2015) · International Journal of Computer Assisted Radiology and Surgery · doi:10.1007/s11548-015-1204-3 · Cited by 6
A remote sensing adapted image registration method based on SIFT and phase congruency
Fan, D., Ye, Y., Li, P., et al. (2011) · International Conference on Image Analysis and Signal Processing · doi:10.1109/iasp.2011.6109056 · Cited by 4
Cited by
A review of multimodal image matching: Methods and applications
Jiang, X., Ma, J., Xiao, G., Shao, Z., & Guo, X. (2021) · Information Fusion · doi:10.1016/j.inffus.2021.02.012 · Cited by 532
SuperFusion: A Versatile Image Registration and Fusion Network with Semantic Awareness
Tang, L., Deng, Y., Ma, Y., Huang, J., & Ma, J. (2022) · IEEE/CAA Journal of Automatica Sinica · doi:10.1109/jas.2022.106082 · Cited by 488
A Deep Learning Semantic Template Matching Framework for Remote Sensing Image Registration
Li, L., Han, L., Ding, M., Cao, H., & Hu, H. (2021) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2021.09.012 · Cited by 67
Multimodal Remote Sensing Image Matching via Learning Features and Attention Mechanism
Zhang, Y., Lan, C., Zhang, H., Ma, G., & Li, H. (2024) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2023.3348980 · Cited by 37
Triple Robustness Augmentation Local Features for multi-source image registration
Wang, C., Xu, L., Xu, R., Xu, S., Meng, W., Wang, R., & Zhang, X. (2023) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2023.03.023 · Cited by 22
Metadata
- Authors
- Li, J., Hu, Q., & Ai, M.
- Venue
- IEEE Transactions on Image Processing
- Published
- 2020
- Volume
- 29
- Pages
- 3296-3310
- ISSN
- 1057-7149 (ISSN-L)
- 1941-0042
- OpenAlex
- W2996444841
- Cited by
- 651
- References
- 57
- FWCI
- 16.20
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.