The DOI matches its Crossref record; 39 of the 39 references it cites were found in a registry or an index.
On the performance of ConvNet features for place recognition
Open accessAbstract
After the incredible success of deep learning in the computer vision domain, there has been much interest in applying Convolutional Network (ConvNet) features in robotic fields such as visual navigation and SLAM. Unfortunately, there are fundamental differences and challenges involved. Computer vision datasets are very different in character to robotic camera data, real-time performance is essential, and performance priorities can be different. This paper comprehensively evaluates and compares the utility of three state-of-the-art ConvNets on the problems of particular relevance to navigation for robots; viewpoint-invariance and condition-invariance, and for the first time enables real-time place recognition performance using ConvNets with large maps by integrating a variety of existing (locality-sensitive hashing) and novel (semantic search space partitioning) optimization techniques. We present extensive experiments on four real world datasets cultivated to evaluate each of the specific challenges in place recognition. The results demonstrate that speed-ups of two orders of magnitude can be achieved with minimal accuracy degradation, enabling real-time performance. We confirm that networks trained for semantic place categorization also perform better at (specific) place recognition when faced with severe appearance changes and provide a reference for which networks and layers are optimal for different aspects of the place recognition problem.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380
Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation
Girshick, R., Donahue, J., Darrell, T., & Malik, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.81 · Cited by 32,684
Visualizing and understanding convolutional networks
Zeiler, M. D., & Fergus, R. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10590-1_53 · Cited by 15,839
Backpropagation Applied to Handwritten Zip Code Recognition
LeCun, Y., Boser, B., Denker, J. S., Henderson, D., Howard, R. E., Hubbard, W., & Jackel, L. D. (1989) · Neural Computation · doi:10.1162/neco.1989.1.4.541 · Cited by 11,891
Caffe: Convolutional Architecture for Fast Feature Embedding
Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., & Darrell, T. (2014) · Proceedings of the 22nd ACM international conference on Multimedia · doi:10.1145/2647868.2654889 · Cited by 11,077
Improving neural networks by preventing co-adaptation of feature detectors
Hinton, G. E., Srivastava, N., Krizhevsky, A., Sutskever, I., & Salakhutdinov, R. R. (2012) · arXiv · doi:10.48550/arxiv.1207.0580 · Cited by 6,382
CNN Features Off-the-Shelf: An Astounding Baseline for Recognition
Razavian, A. S., Azizpour, H., Sullivan, J., & Carlsson, S. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops · doi:10.1109/cvprw.2014.131 · Cited by 4,451
DeCAF: A Deep Convolutional Activation Feature for Generic Visual Recognition
Donahue, J., Jia, Y., Vinyals, O., Hoffman, J., Zhang, N., Tzeng, E., & Darrell, T. (2013) · arXiv · doi:10.48550/arxiv.1310.1531 · Cited by 4,019 · cited 1×
“Several research groups have recently shown that ConvNets outperform classical approaches for object classification or detection that are based on handcrafted features [15], [16], [26]–[28].”
BackgroundOverFeat: Integrated Recognition, Localization and Detection using Convolutional Networks
Sermanet, P., Eigen, D., Zhang, X., Mathieu, M., Fergus, R., & LeCun, Y. (2013) · arXiv · doi:10.48550/arxiv.1312.6229 · Cited by 2,680
(2014) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 2,534
Similarity estimation techniques from rounding algorithms
Charikar, M. S. (2002) · Proceedings of the thiry-fourth annual ACM symposium on Theory of computing · doi:10.1145/509907.509965 · Cited by 2,220
FAB-MAP: Probabilistic Localization and Mapping in the Space of Appearance
Cummins, M., & Newman, P. (2008) · The International Journal of Robotics Research · doi:10.1177/0278364908090961 · Cited by 1,472 · cited 3×
“Previous work [3], [32] established that FAB-MAP [18], [19] is not capable of handling the severe appearance changes of the Nordland and St. Lucia datasets.”
BackgroundImproving deep neural networks for LVCSR using rectified linear units and dropout
Dahl, G. E., Sainath, T. N., & Hinton, G. E. (2013) · 2013 IEEE International Conference on Acoustics, Speech and Signal Processing · doi:10.1109/icassp.2013.6639346 · Cited by 1,310
SeqSLAM: Visual route-based navigation for sunny summer days and stormy winter nights
Milford, M. J., & Wyeth, G. F. (2012) · 2012 IEEE International Conference on Robotics and Automation · doi:10.1109/icra.2012.6224623 · Cited by 981 · cited 1×
“The recent literature proposes a variety of approaches to address the challenges of this field [1]–[14].”
BackgroundSelf-citationContext-based vision system for place and object recognition
Torralba, Murphy, Freeman, & Rubin (2003) · Proceedings Ninth IEEE International Conference on Computer Vision · doi:10.1109/iccv.2003.1238354 · Cited by 867
Similarity estimation techniques from rounding algorithms
Charikar, M. (2002) · doi:10.1145/509961.509965 · Cited by 659
Appearance-only SLAM at large scale with FAB-MAP 2.0
Cummins, M., & Newman, P. (2011) · The International Journal of Robotics Research · doi:10.1177/0278364910385483 · Cited by 609
Place Recognition with ConvNet Landmarks: Viewpoint-Robust, Condition-Robust, Training-Free
Suenderhauf, N., Shirazi, S., Jacobson, A., Dayoub, F., Pepperell, E., Upcroft, B., & Milford, M. (2015) · Robotics: Science and Systems XI · doi:10.15607/rss.2015.xi.022 · Cited by 379
Self-citationSUN Database: Exploring a Large Collection of Scene Categories
Xiao, J., Ehinger, K. A., Hays, J., Torralba, A., & Oliva, A. (2016) · International Journal of Computer Vision · doi:10.1007/s11263-014-0748-y · Cited by 331
Sliding window filter with application to planetary landing
Sibley, G., Matthies, L., & Sukhatme, G. (2010) · Journal of Field Robotics · doi:10.1002/rob.20360 · Cited by 259
Are We There Yet? Challenging SeqSLAM on a 3000 km Journey Across All Four Seasons
Suenderhauf, N., Neubert, P., & Protzel, P. (2013) · QUT ePrints (Queensland University of Technology) · Cited by 241
FAB-MAP + RatSLAM: Appearance-based SLAM for multiple times of day
Glover, A. J., Maddern, W. P., Milford, M. J., & Wyeth, G. F. (2010) · 2010 IEEE International Conference on Robotics and Automation · doi:10.1109/robot.2010.5509547 · Cited by 213
Self-citationRandomized algorithms and NLP: using locality sensitive hash function for high speed noun clustering
Ravichandran, D., Pantel, P., & Hovy, E. (2005) · Proceedings of the 43rd Annual Meeting on Association for Computational Linguistics - ACL '05 · doi:10.3115/1219840.1219917 · Cited by 208
Convolutional Neural Network-based Place Recognition
Chen, Z., Lam, O., Jacobson, A., & Milford, M. J. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1411.1509 · Cited by 201
Self-citationRobust Visual Robot Localization Across Seasons Using Network Flows
Naseer, T., Spinello, L., Burgard, W., & Stachniss, C. (2014) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v28i1.9057 · Cited by 186
Shady dealings: Robust, long-term visual localisation using illumination invariance
McManus, C., Churchill, W., Maddern, W., Stewart, A. D., & Newman, P. M. (2014) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2014.6906961 · Cited by 140
Scene Signatures: Localised and Point-less Features for Localisation
McManus, C., Upcroft, B., & Newmann, P. (2014) · Robotics: Science and Systems · doi:10.15607/rss.2014.x.023 · Cited by 131
Self-citationAll-environment visual place recognition with SMART
Pepperell, E., Corke, P., & Milford, M. J. (2014) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2014.6907067 · Cited by 131
Self-citationPractice makes perfect? Managing and leveraging visual experiences for lifelong navigation
Churchill, W., & Newman, P. M. (2012) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2012.6224596 · Cited by 126
Appearance change prediction for long-term navigation across seasons
Neubert, P., Sünderhauf, N., & Protzel, P. (2013) · European Conference on Mobile Robots · doi:10.1109/ecmr.2013.6698842 · Cited by 119
Superpixel-based appearance change prediction for long-term navigation across seasons
Neubert, P., Sünderhauf, N., & Protzel, P. (2014) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2014.08.005 · Cited by 93
Dealing with shadows: Capturing intrinsic scene appearance for image-based outdoor localisation
Corke, P., Paul, R., Churchill, W., & Newman, P. M. (2013) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2013.6696648 · Cited by 89
Feature Co-occurrence Maps: Appearance-based localisation throughout the day
Johns, E., & Yang, G. (2013) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2013.6631024 · Cited by 84
Transforming morning to afternoon using linear regression techniques
Lowry, S. M., Milford, M. J., & Wyeth, G. F. (2014) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2014.6907432 · Cited by 46
Self-citationParticle Filters for Robot Navigation
Stachniss, C. (2012) · Foundations and Trends in Robotics · doi:10.1561/2300000013 · Cited by 32
Lighting invariant urban street classification
Upcroft, B., McManus, C., Churchill, W., Maddern, W., & Newman, P. M. (2014) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2014.6907082 · Cited by 31
Self-citationContinuous appearance-based trajectory SLAM
Maddern, W., Milford, M. J., & Wyeth, G. F. (2011) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2011.5979963 · Cited by 27
Self-citationLowry, S. M., Wyeth, G. F., & Milford, M. J. (2014) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2014.6906932 · Cited by 18
Self-citation
Cited by
PoseNet: A Convolutional Network for Real-Time 6-DOF Camera Relocalization
Kendall, A., Grimes, M., & Cipolla, R. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.336 · Cited by 2,489
Visual Place Recognition: A Survey
Lowry, S., Sünderhauf, N., Newman, P., Leonard, J. J., Cox, D., Corke, P., & Milford, M. J. (2016) · IEEE Transactions on Robotics · doi:10.1109/tro.2015.2496823 · Cited by 1,079
Self-citationBenchmarking 6DOF Outdoor Visual Localization in Changing Conditions
Sattler, T., Maddern, W., Toft, C., Torii, A., Hammarstrand, L., Stenborg, E., Safari, D., Okutomi, M., Pollefeys, M., Sivic, J., et al. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00897 · Cited by 699
“Learning-based localization has been proposed to solve both loop-closure detection [17, 45, 64, 66] and pose estimation [19, 31, 74].”
BackgroundRobotic grasp detection using deep convolutional neural networks
Kumra, S., & Kanan, C. (2017) · 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2017.8202237 · Cited by 536
Patch-NetVLAD: Multi-Scale Fusion of Locally-Global Descriptors for Place Recognition
Hausler, S., Garg, S., Xu, M., Milford, M., & Fischer, T. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.01392 · Cited by 444
Self-citation
Metadata
- Authors
- Sunderhauf, N., Shirazi, S., Dayoub, F., Upcroft, B., & Milford, M.
- Venue
- 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)
- Publisher
- IEEE
- Published
- 2015-09
- Pages
- 4297-4304
- OpenAlex
- W301022506
- Cited by
- 544
- References
- 39
- FWCI
- 82.46
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.