The DOI matches its Crossref record; 42 of the 42 references it cites were found in a registry or an index.
Spatial Pyramid-Enhanced NetVLAD With Weighted Triplet Loss for Place Recognition
Abstract
We propose an end-to-end place recognition model based on a novel deep neural network. First, we propose to exploit the spatial pyramid structure of the images to enhance the vector of locally aggregated descriptors (VLAD) such that the enhanced VLAD features can reflect the structural information of the images. To encode this feature extraction into the deep learning method, we build a spatial pyramid-enhanced VLAD (SPE-VLAD) layer. Next, we impose weight constraints on the terms of the traditional triplet loss (T-loss) function such that the weighted T-loss (WT-loss) function avoids the suboptimal convergence of the learning process. The loss function can work well under weakly supervised scenarios in that it determines the semantically positive and negative samples of each query through not only the GPS tags but also the Euclidean distance between the image representations. The SPE-VLAD layer and the WT-loss layer are integrated with the VGG-16 network or ResNet-18 network to form a novel end-to-end deep neural network that can be easily trained via the standard backpropagation method. We conduct experiments on three benchmark data sets, and the results demonstrate that the proposed model defeats the state-of-the-art deep learning approaches applied to place recognition.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Reducing the dimensionality of data with neural networks
Hinton, G. E., & Salakhutdinov, R. R. (2006) · Science · doi:10.1126/science.1127647 · Cited by 20,928
Nonlinear Dimensionality Reduction by Locally Linear Embedding
Roweis, S. T., & Saul, L. K. (2000) · Science · doi:10.1126/science.290.5500.2323 · Cited by 14,965
(2017) · Cited by 11,625
Laplacian Eigenmaps for Dimensionality Reduction and Data Representation
Belkin, M., & Niyogi, P. (2003) · Neural Computation · doi:10.1162/089976603321780317 · Cited by 7,621
MonoSLAM: Real-time single camera SLAM
Davison, A. J., Reid, I. D., Molton, N. D., & Stasse, O. (2007) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2007.1049 · Cited by 3,959 · cited 1×
“Place recognition is the core technique of many important applications such as simultaneous localization and mapping (SLAM) [4] and autonomous navigation [5], [6].”
BackgroundObject retrieval with large vocabularies and fast spatial matching
Philbin, J., Chum, O., Isard, M., Sivic, J., & Zisserman, A. (2007) · 2007 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2007.383172 · Cited by 2,929
Shape and motion from image streams under orthography: a factorization method
Tomasi, C., & Kanade, T. (1992) · International Journal of Computer Vision · doi:10.1007/bf00129684 · Cited by 2,878
Aggregating local descriptors into a compact image representation
Jegou, H., Douze, M., Schmid, C., & Perez, P. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5540039 · Cited by 2,692
SCA-CNN: Spatial and Channel-Wise Attention in Convolutional Networks for Image Captioning
Chen, L., Zhang, H., Xiao, J., Nie, L., Shao, J., Liu, W., & Chua, T.-S. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.667 · Cited by 1,992
Hamming Embedding and Weak Geometric Consistency for Large Scale Image Search
Jegou, H., Douze, M., & Schmid, C. (2008) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-88682-2_24 · Cited by 1,901 · cited 1×
“The typical global feature representations include bag-of-word (BoW) [12], [15], vector of locally aggregated descriptors (VLAD) [16], Hamming embedding [17], and Fisher vector (FV) [18].”
BackgroundNetVLAD: CNN architecture for weakly supervised place recognitionPreprint
Arandjelović, R., Gronát, P., Torii, A., Pajdla, T., & Šivic, J. (2015) · arXiv (Cornell University) · Cited by 1,790
Aggregating Local Image Descriptors into Compact Codes
Jegou, H., Perronnin, F., Douze, M., Sanchez, J., Perez, P., & Schmid, C. (2012) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2011.235 · Cited by 1,503
Principal Manifolds and Nonlinear Dimensionality Reduction via Tangent Space Alignment
Zhang, Z., & Zha, H. (2004) · SIAM Journal on Scientific Computing · doi:10.1137/s1064827502419154 · Cited by 1,479
Evaluating the Visualization of What a Deep Neural Network Has Learned
Samek, W., Binder, A., Montavon, G., Lapuschkin, S., & Muller, K.-R. (2017) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2016.2599820 · Cited by 1,164
Visual Place Recognition: A Survey
Lowry, S., Sünderhauf, N., Newman, P., Leonard, J. J., Cox, D., Corke, P., & Milford, M. J. (2016) · IEEE Transactions on Robotics · doi:10.1109/tro.2015.2496823 · Cited by 1,079
Context-based vision system for place and object recognition
Torralba, Murphy, Freeman, & Rubin (2003) · Proceedings Ninth IEEE International Conference on Computer Vision · doi:10.1109/iccv.2003.1238354 · Cited by 867
Large-Scale Image Retrieval with Attentive Deep Local Features
Noh, H., Araujo, A., Sim, J., Weyand, T., & Han, B. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.374 · Cited by 847
City-Scale Location Recognition
Schindler, G., Brown, M., & Szeliski, R. (2007) · 2007 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2007.383150 · Cited by 626
Principal Manifolds and Nonlinear Dimension Reduction via Local Tangent Space Alignment
Zhang, Z., & Zha, H. (2002) · arXiv (Cornell University) · doi:10.48550/arxiv.cs/0212008 · Cited by 526
Convolutional Neural Network Architecture for Geometric Matching
Rocco, I., Arandjelovic, R., & Sivic, J. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.12 · Cited by 496
City-scale landmark identification on mobile devices
Chen, D. M., Baatz, G., Koser, K., Tsai, S. S., Vedantham, R., Pylvanainen, T., Roimela, K., Chen, X., Bach, J., Pollefeys, M., et al. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995610 · Cited by 400
Visual Place Recognition with Repetitive Structures
Torii, A., Sivic, J., Pajdla, T., & Okutomi, M. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.119 · Cited by 359
Autonomous navigation for BigDog
Wooden, D., Malchano, M., Blankespoor, K., Howardy, A., Rizzi, A. A., & Raibert, M. (2010) · 2010 IEEE International Conference on Robotics and Automation · doi:10.1109/robot.2010.5509226 · Cited by 272
Avoiding Confusing Features in Place Recognition
Knopp, J., Sivic, J., & Pajdla, T. (2010) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-15549-9_54 · Cited by 208
Convolutional Sparse Autoencoders for Image Classification
Luo, W., Li, J., Yang, J. J., Xu, W. H., & Zhang, J. (2017) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2017.2712793 · Cited by 177
Self-citationLarge-Scale Location Recognition and the Geometric Burstiness Problem
Sattler, T., Havlena, M., Konrad Schindler, B., & Pollefeys, M. (2016) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2016.175 · Cited by 175
Hyperpoints and Fine Vocabularies for Large-Scale Location Recognition
Sattler, T., Havlena, M., Radenovic, F., Schindler, K., & Pollefeys, M. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.243 · Cited by 158
Exploring Auxiliary Context: Discrete Semantic Transfer Hashing for Scalable Image Retrieval
Zhu, L., Huang, Z., Li, Z., Xie, L., & Shen, H. T. (2018) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2018.2797248 · Cited by 158
DisLocation: Scalable Descriptor Distinctiveness for Location Recognition
Arandjelović, R., & Zisserman, A. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-16817-3_13 · Cited by 140
Graph-Based Discriminative Learning for Location Recognition
Cao, S., & Snavely, N. (2013) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2013.96 · Cited by 128
24/7 Place Recognition by View Synthesis
Torii, A., Arandjelović, R., Šivic, J., Okutomi, M., & Pajdla, T. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2667665 · Cited by 121
Pairwise geometric matching for large-scale object retrieval
Li, X., Larson, M., & Hanjalić, A. (2015) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2015.7299151 · Cited by 114
Learning and Calibrating Per-Location Classifiers for Visual Place Recognition
Gronát, P., Obozinski, G., Šivic, J., & Pajdla, T. (2013) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2013.122 · Cited by 102
Manifold Preserving: An Intrinsic Approach for Semisupervised Distance Metric Learning
Ying, S., Wen, Z., Shi, J., Peng, Y., Peng, J., & Qiao, H. (2017) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2017.2691005 · Cited by 76
Weakly Supervised Object Detection via Object-Specific Pixel Gradient
Shen, Y., Ji, R., Wang, C., Li, X., & Li, X. (2018) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2018.2816021 · Cited by 68
Learning to Predict Consequences as a Method of Knowledge Transfer in Reinforcement Learning
Chalmers, E., Bermudez-Contreras, E. J., Robertson, B., Luczak, A., & Gruber, A. J. (2017) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2017.2690910 · Cited by 59
Convolutional neural network architecture for geometric matching
Rocco, I., Arandjelović, R., & Šivic, J. (2017) · HAL (Le Centre pour la Communication Scientifique Directe) · doi:10.48550/arxiv.1703.05593 · Cited by 51
Multiple VLAD Encoding of CNNs for Image Classification
Li, Q., Peng, Q., & Yan, C. (2018) · Computing in Science & Engineering · doi:10.1109/mcse.2018.108164530 · Cited by 24
Improving Sparsity and Scalability in Regularized Nonconvex Truncated-Loss Learning Problems
Tao, Q., Wu, G., & Chu, D. (2017) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2017.2705429 · Cited by 8
Cited by
Rethinking RGB-D Salient Object Detection: Models, Data Sets, and Large-Scale Benchmarks
Fan, D.-P., Lin, Z., Zhang, Z., Zhu, M., & Cheng, M.-M. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.2996406 · Cited by 702
Patch-NetVLAD: Multi-Scale Fusion of Locally-Global Descriptors for Place Recognition
Hausler, S., Garg, S., Xu, M., Milford, M., & Fischer, T. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.01392 · Cited by 444
An Edge Traffic Flow Detection Scheme Based on Deep Learning in an Intelligent Transportation System
Chen, C., Liu, B., Wan, S., Qiao, P., & Pei, Q. (2021) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2020.3025687 · Cited by 429
Elharrouss, O., Almaadeed, N., Al-Maadeed, S., & Akbari, Y. (2020) · Neural Processing Letters · doi:10.1007/s11063-019-10163-0 · Cited by 341
Rethinking Visual Geo-localization for Large-Scale Applications
Berton, G., Masone, C., & Caputo, B. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.00483 · Cited by 272
Metadata
- Authors
- Yu, J., Zhu, C., Zhang, J., Huang, Q., & Tao, D.
- Venue
- IEEE Transactions on Neural Networks and Learning Systems
- Published
- 2020-02
- Volume
- 31
- Issue
- 2
- Pages
- 661-674
- ISSN
- 2162-237X (ISSN-L)
- 2162-2388
- OpenAlex
- W2940791172
- Cited by
- 352
- References
- 42
- FWCI
- 27.60
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.