The DOI matches its Crossref record; 36 of the 36 references it cites were found in a registry or an index.
SOSNet: Second Order Similarity Regularization for Local Descriptor Learning
Open accessAbstract
Despite the fact that Second Order Similarity (SOS) has been used with significant success in tasks such as graph matching and clustering, it has not been exploited for learning local descriptors. In this work, we explore the potential of \sos in the field of descriptor learning by building upon the intuition that a positive pair of matching points should exhibit similar distances with respect to other points in the embedding space. Thus, we propose a novel regularization term, named Second Order Similarity Regularization (SOSR), that follows this principle. By incorporating SOSR into training, our learned descriptor achieves state-of-the-art performance on several challenging benchmarks containing distinct tasks ranging from local patch retrieval to structure from motion. Furthermore, by designing a von Mises-Fischer distribution based evaluation method, we link the utilization of the descriptor space to the matching performance, thus demonstrating the effectiveness of our proposed SOSR. Extensive experimental results, empirical evidence, and in-depth analysis are provided, indicating that SOSR can significantly boost the matching performance of the learned descriptor.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
Distinctive Image Features from Scale-Invariant Keypoints
Lowe, D. G. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000029664.99615.94 · Cited by 55,589
(2008) · Journal of Machine Learning Research · Cited by 33,051
(2017) · Cited by 11,625
A performance evaluation of local descriptors
Mikolajczyk, K., & Schmid, C. (2005) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2005.188 · Cited by 6,723
Pixelwise View Selection for Unstructured Multi-View Stereo
Schönberger, J. L., Zheng, E., Frahm, J.-M., & Pollefeys, M. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46487-9_31 · Cited by 2,315
Deep Metric Learning via Lifted Structured Feature Embedding
Song, H. O., Xiang, Y., Jegelka, S., & Savarese, S. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.434 · Cited by 1,630
Learning to compare image patches via convolutional neural networks
Zagoruyko, S., & Komodakis, N. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7299064 · Cited by 1,140
MatchNet: Unifying feature and metric learning for patch-based matching
Han, X., Leung, T., Jia, Y., Sukthankar, R., & Berg, A. C. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298948 · Cited by 825
Discriminative Learning of Deep Convolutional Feature Point Descriptors
Simo-Serra, E., Trulls, E., Ferraz, L., Kokkinos, I., Fua, P., & Moreno-Noguer, F. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.22 · Cited by 804
Clustering on the Unit Hypersphere using von Mises-Fisher Distributions
Banerjee, A., Dhillon, I. S., Ghosh, J., & Sra, S. (2005) · MPG.PuRe (Max Planck Society) · doi:10.5555/1046920.1088718 · Cited by 766
Benchmarking 6DOF Outdoor Visual Localization in Changing Conditions
Sattler, T., Maddern, W., Toft, C., Torii, A., Hammarstrand, L., Stenborg, E., Safari, D., Okutomi, M., Pollefeys, M., Sivic, J., et al. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00897 · Cited by 699
L2-Net: Deep Learning of Discriminative Patch Descriptor in Euclidean Space
Tian, Y., Fan, B., & Wu, F. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.649 · Cited by 601
Self-citationCNN Image Retrieval Learns from BoW: Unsupervised Fine-Tuning with Hard Examples
Radenović, F., Tolias, G., & Chum, O. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46448-0_1 · Cited by 551
Learning local feature descriptors with triplets and shallow convolutional neural networks
Balntas, V., Riba, E., Ponsa, D., & Mikolajczyk, K. (2016) · Procedings of the British Machine Vision Conference 2016 · doi:10.5244/c.30.119 · Cited by 529
Self-citationDiscriminative Learning of Local Image Descriptors
Brown, M., Hua, G., & Winder, S. (2011) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2010.54 · Cited by 466
Reweighted Random Walks for Graph Matching
Cho, M., Lee, J., & Lee, K. M. (2010) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-15555-0_36 · Cited by 455
Learning Local Feature Descriptors Using Convex Optimisation
Simonyan, K., Vedaldi, A., & Zisserman, A. (2014) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2014.2301163 · Cited by 352
Local Intensity Order Pattern for feature description
Wang, Z., Fan, B., & Wu, F. (2011) · 2011 International Conference on Computer Vision · doi:10.1109/iccv.2011.6126294 · Cited by 317
Self-citationComparative Evaluation of Hand-Crafted and Learned Local Features
Schonberger, J. L., Hardmeier, H., Sattler, T., & Pollefeys, M. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.736 · Cited by 310
Working hard to know your neighbor's margins: Local descriptor learning loss
Mishchuk, A., Mishkin, D., Radenović, F., & Matas, J. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1705.10872 · Cited by 291
Zhou, F., & De la Torre, F. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6247667 · Cited by 272
Winder, S., Hua, G., & Brown, M. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206839 · Cited by 253
Local Descriptors Optimized for Average Precision
He, K., Lu, Y., & Sclaroff, S. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00069 · Cited by 210
GeoDesc: Learning Local Descriptors by Integrating Geometry Constraints
Luo, Z., Shen, T., Zhou, L., Zhu, S., Zhang, R., Yao, Y., Fang, T., & Quan, L. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01240-3_11 · Cited by 181
Domain-size pooling in local descriptors: DSP-SIFT
Dong, J., & Soatto, S. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7299145 · Cited by 176
Boosting Binary Keypoint Descriptors
Trzcinski, T., Christoudias, M., Fua, P., & Lepetit, V. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.370 · Cited by 174
Learning Spread-Out Local Feature Descriptors
Zhang, X., Yu, F. X., Kumar, S., & Chang, S. (2017) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.492 · Cited by 142
Progressive graph matching: Making a move of graphs via probabilistic voting
Cho, M., & Lee, K. M. (2012) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2012.6247701 · Cited by 133
HPatches: A benchmark and evaluation of handcrafted and learned local descriptors
Balntas, V., Lenc, K., Vedaldi, A., Tuytelaars, T., Matas, J., & Mikolajczyk, K. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2915233 · Cited by 132
Self-citationLearning Linear Discriminant Projections for Dimensionality Reduction of Image Descriptors
Cai, H., Mikolajczyk, K., & Matas, J. (2010) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2010.89 · Cited by 100
Receptive Fields Selection for Binary Feature Description
Fan, B., Kong, Q., Trzcinski, T. P., Wang, Z., Pan, C., & Fua, P. (2014) · IEEE Transactions on Image Processing · doi:10.1109/tip.2014.2317981 · Cited by 87
Self-citationBOLD - Binary online learned descriptor for efficient image matching
Balntas, V., Tang, L., & Mikolajczyk, K. (2015) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2015.7298850 · Cited by 75
Self-citationDimensionality's Blessing: Clustering Images by Underlying Distribution
Lin, W.-Y., Lai, J., Liu, S., & Matsushita, Y. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00606 · Cited by 11
Directional Statistics-based Deep Metric Learning for Image Classification and RetrievalPreprint
Zhe, X., Chen, S., & Yan, H. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1802.09662 · Cited by 6
Cited by
Image Matching from Handcrafted to Deep Features: A Survey
Ma, J., Jiang, X., Fan, A., Jiang, J., & Yan, J. (2021) · International Journal of Computer Vision · doi:10.1007/s11263-020-01359-2 · Cited by 990
LightGlue: Local Feature Matching at Light Speed
Lindenberger, P., Sarlin, P.-E., & Pollefeys, M. (2023) · 2023 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01616 · Cited by 943
A review of multimodal image matching: Methods and applications
Jiang, X., Ma, J., Xiao, G., Shao, Z., & Guo, X. (2021) · Information Fusion · doi:10.1016/j.inffus.2021.02.012 · Cited by 532
Image matching across wide baselines: From paper to practice
Jin, Y., Mishkin, D., Mishchuk, A., Matas, J., Fua, P., Yi, K. M., & Trulls, E. (2021) · International Journal of Computer Vision · doi:10.1007/s11263-020-01385-0 · Cited by 388
Unifying Deep Local and Global Features for Image Search
Cao, B., Araujo, A., & Sim, J. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58565-5_43 · Cited by 366
Metadata
- Authors
- Tian, Y., Yu, X., Fan, B., Wu, F., Heijnen, H., & Balntas, V.
- Venue
- 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
- Publisher
- IEEE
- Published
- 2019-06
- Pages
- 11008-11017
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W2939052861
- Cited by
- 366
- References
- 36
- FWCI
- 14.42
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.