The DOI matches its Crossref record; 38 of the 38 references it cites were found in a registry or an index.
Key.Net: Keypoint Detection by Handcrafted and Learned CNN Filters
Abstract
We introduce a novel approach for keypoint detection task that combines handcrafted and learned CNN filters within a shallow multi-scale architecture. Handcrafted filters provide anchor structures for learned filters, which localize, score and rank repeatable features. Scale-space representation is used within the network to extract keypoints at different levels. We design a loss function to detect robust features that exist across a range of scales and to maximize the repeatability score. Our Key.Net model is trained on data synthetically created from ImageNet and evaluated on HPatches benchmark. Results show that our approach outperforms state-of-the-art detectors in terms of repeatability, matching performance and complexity.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Distinctive Image Features from Scale-Invariant Keypoints
Lowe, D. G. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000029664.99615.94 · Cited by 55,589
Speeded-Up Robust Features (SURF)
Bay, H., Ess, A., Tuytelaars, T., & Van Gool, L. (2008) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2007.09.014 · Cited by 13,557 · cited 1×
“Later, SURF [20] accelerated the detection process by using integral images and an approximation of the Hessian matrix.”
MethodA Combined Corner and Edge Detector
Harris, C., & Stephens, M. (1988) · Procedings of the Alvey Vision Conference 1988 · doi:10.5244/c.2.23 · Cited by 12,901
ORB: An efficient alternative to SIFT or SURF
Rublee, E., Rabaud, V., Konolige, K., & Bradski, G. (2011) · 2011 International Conference on Computer Vision · doi:10.1109/iccv.2011.6126544 · Cited by 11,037
A performance evaluation of local descriptors
Mikolajczyk, K., & Schmid, C. (2005) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2005.188 · Cited by 6,723
Self-citationMachine Learning for High-Speed Corner Detection
Rosten, E., & Drummond, T. (2006) · Lecture Notes in Computer Science · doi:10.1007/11744023_34 · Cited by 4,555
Robust wide-baseline stereo from maximally stable extremal regions
Matas, J., Chum, O., Urban, M., & Pajdla, T. (2004) · Image and Vision Computing · doi:10.1016/j.imavis.2004.02.006 · Cited by 3,686
BRISK: Binary Robust invariant scalable keypoints
Leutenegger, S., Chli, M., & Siegwart, R. Y. (2011) · 2011 International Conference on Computer Vision · doi:10.1109/iccv.2011.6126542 · Cited by 3,450
Scale & Affine Invariant Interest Point Detectors
Mikolajczyk, K., & Schmid, C. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000027790.02288.f2 · Cited by 3,436
Self-citationSuperPoint: Self-Supervised Interest Point Detection and Description
DeTone, D., Malisiewicz, T., & Rabinovich, A. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2018.00060 · Cited by 3,355
A comparison of affine region detectors
Mikolajczyk, K., Tuytelaars, T., Schmid, C., Zisserman, A., Matas, J., Schaffalitzky, F., Kadir, T., & Gool, L. V. (2005) · International Journal of Computer Vision · doi:10.1007/s11263-005-3848-x · Cited by 2,939
Self-citationFaster and Better: A Machine Learning Approach to Corner Detection
Rosten, E., Porter, R., & Drummond, T. (2010) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2008.275 · Cited by 1,849
LIFT: Learned Invariant Feature Transform
Yi, K. M., Trulls, E., Lepetit, V., & Fua, P. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46466-4_28 · Cited by 1,202
Local Invariant Feature Detectors: A Survey
Tuytelaars, T., & Mikolajczyk, K. (2007) · Foundations and Trends® in Computer Graphics and Vision · doi:10.1561/0600000017 · Cited by 1,186
Self-citationFast Explicit Diffusion for Accelerated Features in Nonlinear Scale Spaces
Alcantarilla, P., Nuevo, J., & Bartoli, A. (2013) · Procedings of the British Machine Vision Conference 2013 · doi:10.5244/c.27.13 · Cited by 1,173
Learning to compare image patches via convolutional neural networks
Zagoruyko, S., & Komodakis, N. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7299064 · Cited by 1,140
Indexing based on scale invariant interest points
Mikolajczyk, K., & Schmid, C. (2002) · Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001 · doi:10.1109/iccv.2001.937561 · Cited by 1,101
Self-citationMatchNet: Unifying feature and metric learning for patch-based matching
Han, X., Leung, T., Jia, Y., Sukthankar, R., & Berg, A. C. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298948 · Cited by 825
Learning to Find Good Correspondences
Yi, K. M., Trulls, E., Ono, Y., Lepetit, V., Salzmann, M., & Fua, P. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00282 · Cited by 552
TILDE: A Temporally Invariant Learned DEtector
Verdie, Y., Yi, K. M., Fua, P., & Lepetit, V. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7299165 · Cited by 332
LF-Net: Learning Local Features from Images
Ono, Y., Trulls, E., Fua, P., & Yi, K. M. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1805.09662 · Cited by 322
Working hard to know your neighbor's margins: Local descriptor learning loss
Mishchuk, A., Mishkin, D., Radenović, F., & Matas, J. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1705.10872 · Cited by 291
Repeatability Is Not Enough: Learning Affine Regions via Discriminability
Mishkin, D., Radenović, F., & Matas, J. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01240-3_18 · Cited by 233
Object Recognition using Local Affine Frames on Distinguished Regions
Obdrzalek, S., & Matas, J. (2002) · Procedings of the British Machine Vision Conference 2002 · doi:10.5244/c.16.9 · Cited by 198
Quad-Networks: Unsupervised Learning to Rank for Interest Point Detection
Savinov, N., Seki, A., Ladicky, L., Sattler, T., & Pollefeys, M. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.418 · Cited by 184
Domain-size pooling in local descriptors: DSP-SIFT
Dong, J., & Soatto, S. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7299145 · Cited by 176
Learning to Compare Image Patches via Convolutional Neural Networks
Zagoruyko, S., & Nikos Komodakis, A. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1504.03641 · Cited by 159
Toward Geometric Deep SLAMPreprint
DeTone, D., Malisiewicz, T., & Rabinovich, A. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1707.07410 · Cited by 158
Learning to Assign Orientations to Feature Points
Yi, K. M., Verdié, Y., Fua, P., & Lepetit, V. (2016) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2016.19 · Cited by 137
Learning Covariant Feature Detectors
Lenc, K., & Vedaldi, A. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-49409-8_11 · Cited by 133
HPatches: A benchmark and evaluation of handcrafted and learned local descriptors
Balntas, V., Lenc, K., Vedaldi, A., Tuytelaars, T., Matas, J., & Mikolajczyk, K. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2915233 · Cited by 132
Self-citationLIFT: Learned Invariant Feature TransformPreprint
Yi, K. M., Trulls, E., Lepetit, V., & Fua, P. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1603.09114 · Cited by 128
Learning Discriminative and Transformation Covariant Local Feature Detectors
Zhang, X., Yu, F. X., Karaman, S., & Chang, S. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.523 · Cited by 122
The Gaussian scale-space paradigm and the multiscale local jet
Florack, L. M. J., Romeny, B. M. T. H., Viergever, M. A., & Koenderink, J. J. (1996) · International Journal of Computer Vision · doi:10.1007/bf00126140 · Cited by 115
Hartmann, W., Havlena, M., & Konrad Schindler, B. (2014) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2014.9 · Cited by 104
End-to-End Learning of Keypoint Detector and Descriptor for Pose Invariant 3D Matching
Georgakis, G., Karanam, S., Wu, Z., Ernst, J., & Košecká, J. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00210 · Cited by 64
Large scale evaluation of local image feature detectors on homography datasets
Lenc, K., & Vedaldi, A. (2018) · Oxford University Research Archive (ORA) (University of Oxford) · doi:10.48550/arxiv.1807.07939 · Cited by 39
Learning Covariant Feature DetectorsPreprint
Lenc, K., & Vedaldi, A. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1605.01224 · Cited by 22
Cited by
Image Matching from Handcrafted to Deep Features: A Survey
Ma, J., Jiang, X., Fan, A., Jiang, J., & Yan, J. (2021) · International Journal of Computer Vision · doi:10.1007/s11263-020-01359-2 · Cited by 990
A review of multimodal image matching: Methods and applications
Jiang, X., Ma, J., Xiao, G., Shao, Z., & Guo, X. (2021) · Information Fusion · doi:10.1016/j.inffus.2021.02.012 · Cited by 532
Unifying Deep Local and Global Features for Image Search
Cao, B., Araujo, A., & Sim, J. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58565-5_43 · Cited by 366
ASLFeat: Learning Local Features of Accurate Shape and Localization
Luo, Z., Zhou, L., Bai, X., Chen, H., Zhang, J., Yao, Y., Li, S., Fang, T., & Quan, L. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00662 · Cited by 357
Kornia: an Open Source Differentiable Computer Vision Library for PyTorch
Riba, E., Mishkin, D., Ponsa, D., Rublee, E., & Bradski, G. (2020) · 2020 IEEE Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv45572.2020.9093363 · Cited by 333
Self-citation
Metadata
- Authors
- Laguna, A. B., Riba, E., Ponsa, D., & Mikolajczyk, K.
- Venue
- 2019 IEEE/CVF International Conference on Computer Vision (ICCV)
- Publisher
- IEEE
- Published
- 2019-10
- Pages
- 5835-5843
- OpenAlex
- W3009931536
- Cited by
- 276
- References
- 38
- FWCI
- 9.19
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.