The DOI matches its Crossref record; 33 of the 33 references it cites were found in a registry or an index.
Deep learning features at scale for visual place recognition
Open accessAbstract
The success of deep learning techniques in the computer vision domain has triggered a range of initial investigations into their utility for visual place recognition, all using generic features from networks that were trained for other types of recognition tasks. In this paper, we train, at large scale, two CNN architectures for the specific place recognition task and employ a multi-scale feature encoding method to generate condition- and viewpoint-invariant features. To enable this training to occur, we have developed a massive Specific PlacEs Dataset (SPED) with hundreds of examples of place appearance change at thousands of different places, as opposed to the semantic place type datasets currently available. This new dataset enables us to set up a training regime that interprets place recognition as a classification problem. We comprehensively evaluate our trained networks on several challenging benchmark place recognition datasets and demonstrate that they achieve an average 10% increase in performance over other place recognition algorithms and pre-trained CNNs. By analyzing the network responses and their differences from pre-trained networks, we provide insights into what a network learns when training for place recognition, and what these results signify for future research in this area.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation
Girshick, R., Donahue, J., Darrell, T., & Malik, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.81 · Cited by 32,684
Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2015) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2015.2389824 · Cited by 11,971
Dimensionality Reduction by Learning an Invariant Mapping
Hadsell, R., Chopra, S., & LeCun, Y. (2006) · 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 2 (CVPR'06) · doi:10.1109/cvpr.2006.100 · Cited by 5,336
Caffe: Convolutional Architecture for Fast Feature Embedding
Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., & Darrell, T. J. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1408.5093 · Cited by 3,752
SUN database: Large-scale scene recognition from abbey to zoo
Xiao, J., Hays, J., Ehinger, K. A., Oliva, A., & Torralba, A. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5539970 · Cited by 3,283
Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10578-9_23 · Cited by 3,034
(2014) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 2,534
PoseNet: A Convolutional Network for Real-Time 6-DOF Camera Relocalization
Kendall, A., Grimes, M., & Cipolla, R. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.336 · Cited by 2,489
Fei-Fei, L., Fergus, R., & Perona, P. (2007) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2005.09.012 · Cited by 2,359
Deep Metric Learning Using Triplet Network
Hoffer, E., & Ailon, N. (2015) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-24261-3_7 · Cited by 2,134
NetVLAD: CNN architecture for weakly supervised place recognitionPreprint
Arandjelović, R., Gronát, P., Torii, A., Pajdla, T., & Šivic, J. (2015) · arXiv (Cornell University) · Cited by 1,790
FAB-MAP: Probabilistic Localization and Mapping in the Space of Appearance
Cummins, M., & Newman, P. (2008) · The International Journal of Robotics Research · doi:10.1177/0278364908090961 · Cited by 1,472
Neural Codes for Image Retrieval
Babenko, A., Slesarev, A., Chigorin, A., & Lempitsky, V. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10590-1_38 · Cited by 1,192
SeqSLAM: Visual route-based navigation for sunny summer days and stormy winter nights
Milford, M. J., & Wyeth, G. F. (2012) · 2012 IEEE International Conference on Robotics and Automation · doi:10.1109/icra.2012.6224623 · Cited by 981
Self-citationAggregating Local Deep Features for Image Retrieval
Yandex, A. B., & Lempitsky, V. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.150 · Cited by 674
On the performance of ConvNet features for place recognition
Sunderhauf, N., Shirazi, S., Dayoub, F., Upcroft, B., & Milford, M. (2015) · 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2015.7353986 · Cited by 544
Self-citationFast and Incremental Method for Loop-Closure Detection Using Bags of Visual Words
Angeli, A., Filliat, D., Doncieux, S., & Meyer, J.-A. (2008) · IEEE Transactions on Robotics · doi:10.1109/tro.2008.2004514 · Cited by 514
Place Recognition with ConvNet Landmarks: Viewpoint-Robust, Condition-Robust, Training-Free
Suenderhauf, N., Shirazi, S., Jacobson, A., Dayoub, F., Pepperell, E., Upcroft, B., & Milford, M. (2015) · Robotics: Science and Systems XI · doi:10.15607/rss.2015.xi.022 · Cited by 379
Self-citationHighly scalable appearance-only SLAM - FAB-MAP 2.0
Cummins, M., & Newman, P. (2009) · Robotics: Science and Systems V · doi:10.15607/rss.2009.v.039 · Cited by 282
FAB-MAP + RatSLAM: Appearance-based SLAM for multiple times of day
Glover, A. J., Maddern, W. P., Milford, M. J., & Wyeth, G. F. (2010) · 2010 IEEE International Conference on Robotics and Automation · doi:10.1109/robot.2010.5509547 · Cited by 213
Self-citationConvolutional Neural Network-based Place Recognition
Chen, Z., Lam, O., Jacobson, A., & Milford, M. J. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1411.1509 · Cited by 201
Self-citationSIFT, SURF & seasons: Appearance-based long-term localization in outdoor environments
Valgren, C., & Lilienthal, A. J. (2010) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2009.09.010 · Cited by 195
Robust Visual Robot Localization Across Seasons Using Network Flows
Naseer, T., Spinello, L., Burgard, W., & Stachniss, C. (2014) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v28i1.9057 · Cited by 186
Liu, L., Shen, C., & van den Hengel, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7299107 · Cited by 180
Self-citationConsistent Temporal Variations in Many Outdoor Scenes
Jacobs, N., Roman, N., & Pless, R. (2007) · 2007 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2007.383258 · Cited by 167
Vision-based place recognition: how low can you go?
Milford, M. J. (2013) · The International Journal of Robotics Research · doi:10.1177/0278364913490323 · Cited by 143
Self-citationScene Signatures: Localised and Point-less Features for Localisation
McManus, C., Upcroft, B., & Newmann, P. (2014) · Robotics: Science and Systems · doi:10.15607/rss.2014.x.023 · Cited by 117
Self-citationAppearance change prediction for long-term navigation across seasons
Neubert, P., Sünderhauf, N., & Protzel, P. (2013) · European Conference on Mobile Robots · doi:10.1109/ecmr.2013.6698842 · Cited by 108
Superpixel-based appearance change prediction for long-term navigation across seasons
Neubert, P., Sünderhauf, N., & Protzel, P. (2014) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2014.08.005 · Cited by 83
Training a Convolutional Neural Network for Appearance-Invariant Place RecognitionPreprint
Gomez-Ojeda, R., López-Antequera, M., Petkov, N., & González-Jiménez, J. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1505.07428 · Cited by 65
Transforming morning to afternoon using linear regression techniques
Lowry, S. M., Milford, M. J., & Wyeth, G. F. (2014) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2014.6907432 · Cited by 46
Self-citationVisual Place Recognition Using Landmark Distribution Descriptors
Panphattarasap, P., & Calway, A. D. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-54190-7_30 · Cited by 35
Cited by
Benchmarking 6DOF Outdoor Visual Localization in Changing Conditions
Sattler, T., Maddern, W., Toft, C., Torii, A., Hammarstrand, L., Stenborg, E., Safari, D., Okutomi, M., Pollefeys, M., Sivic, J., et al. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00897 · Cited by 699
Performance Analysis of Google Colaboratory as a Tool for Accelerating Deep Learning Applications
Carneiro, T., Medeiros Da Nobrega, R. V., Nepomuceno, T., Bian, G.-B., De Albuquerque, V. H. C., & Filho, P. P. R. (2018) · IEEE Access · doi:10.1109/access.2018.2874767 · Cited by 589
Patch-NetVLAD: Multi-Scale Fusion of Locally-Global Descriptors for Place Recognition
Hausler, S., Garg, S., Xu, M., Milford, M., & Fischer, T. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.01392 · Cited by 444
Self-citationRethinking Visual Geo-localization for Large-Scale Applications
Berton, G., Masone, C., & Caputo, B. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.00483 · Cited by 272
Schonberger, J. L., Pollefeys, M., Geiger, A., & Sattler, T. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00721 · Cited by 267
Metadata
- Authors
- Chen, Z., Jacobson, A., Sunderhauf, N., Upcroft, B., Liu, L., Shen, C., Reid, I., & Milford, M.
- Venue
- 2017 IEEE International Conference on Robotics and Automation (ICRA)
- Publisher
- IEEE
- Published
- 2017-05
- Pages
- 3223-3230
- ISSN
- 1050-4729 (ISSN-L)
- OpenAlex
- W2580440899
- Cited by
- 344
- References
- 33
- FWCI
- 12.13
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.