Appearance-only SLAM at large scale with FAB-MAP 2.0
Open accessThe DOI matches its Crossref record; 48 of the 48 references it cites were found in a registry or an index.
Abstract
We describe a new formulation of appearance-only SLAM suitable for very large scale place recognition. The system navigates in the space of appearance, assigning each new observation to either a new or a previously visited location, without reference to metric position. The system is demonstrated performing reliable online appearance mapping and loop-closure detection over a 1000 km trajectory, with mean filter update times of 14 ms. The scalability of the system is achieved by defining a sparse approximation to the FAB-MAP model suitable for implementation using an inverted index. Our formulation of the problem is fully probabilistic and naturally incorporates robustness against perceptual aliasing. We also demonstrate that the approach substantially outperforms the standard term-frequency inverse-document-frequency (tf-idf) ranking measure. The 1000 km data set comprising almost a terabyte of omni-directional and stereo imagery is available for use, and we hope that it will serve as a benchmark for future systems.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Fischler, M. A., & Bolles, R. C. (1981) · Communications of the ACM · doi:10.1145/358669.358692 · Cited by 25,893
The anatomy of a large-scale hypertextual Web search engine
Brin, S., & Page, L. (1998) · Computer Networks and ISDN Systems · doi:10.1016/s0169-7552(98)00110-x · Cited by 16,004
SURF: Speeded Up Robust Features
Bay, H., Tuytelaars, T., & Van Gool, L. (2006) · Lecture Notes in Computer Science · doi:10.1007/11744023_32 · Cited by 14,955
Introduction to information retrieval
(2009) · Choice Reviews Online · doi:10.5860/choice.46-2715 · Cited by 12,278
Introduction to Information Retrieval
Manning, C. D., Raghavan, P., & Schütze, H. (2008) · doi:10.1017/cbo9780511809071 · Cited by 11,288
Video Google: a text retrieval approach to object matching in videos
Sivic, & Zisserman (2003) · Proceedings Ninth IEEE International Conference on Computer Vision · doi:10.1109/iccv.2003.1238663 · Cited by 6,367 · cited 2×
“The basic data representation used is the bag-of-words approach developed in the computer vision community (Sivic and Zisserman 2003).”
MethodScalable Recognition with a Vocabulary Tree
Nister, D., & Stewenius, H. (2006) · 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 2 (CVPR'06) · doi:10.1109/cvpr.2006.264 · Cited by 3,579
Object retrieval with large vocabularies and fast spatial matching
Philbin, J., Chum, O., Isard, M., Sivic, J., & Zisserman, A. (2007) · 2007 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2007.383172 · Cited by 2,929
FAST APPROXIMATE NEAREST NEIGHBORS WITH AUTOMATIC ALGORITHM CONFIGURATION
(2009) · Proceedings of the Fourth International Conference on Computer Vision Theory and Applications · doi:10.5220/0001787803310340 · Cited by 2,640
Computer vision and pattern recognition
Zheng, N., Loizou, G., Jiang, X., Lan, X., & Li, X. (2007) · International Journal of Computer Mathematics · doi:10.1080/00207160701303912 · Cited by 2,463
Hamming Embedding and Weak Geometric Consistency for Large Scale Image Search
Jegou, H., Douze, M., & Schmid, C. (2008) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-88682-2_24 · Cited by 1,901 · cited 3×
“Also of direct relevance is the research on content-based image retrieval systems in the computer vision community, where systems have been described that deal with more than a million images (Philbin et al. 2007; Chum et al. 2007; Nistér and Stewenius 2006; Jégou et al. 2008).”
BackgroundMethodResultApproximating discrete probability distributions with dependence trees
Chow, C., & Liu, C. (1968) · IEEE Transactions on Information Theory · doi:10.1109/tit.1968.1054142 · Cited by 1,720
2007 IEEE Conference on Computer Vision and Pattern Recognition
(2007) · doi:10.1109/cvpr12085.2007 · Cited by 1,688
FAB-MAP: Probabilistic Localization and Mapping in the Space of Appearance
Cummins, M., & Newman, P. (2008) · The International Journal of Robotics Research · doi:10.1177/0278364908090961 · Cited by 1,472 · cited 10×
“Keywords Robotics, SLAM, appearance-based navigation, FAB-MAP”
BackgroundMethodResultInfluentialSelf-citationTotal Recall: Automatic Query Expansion with a Generative Feature Model for Object Retrieval
Chum, O., Philbin, J., Sivic, J., Isard, M., & Zisserman, A. (2007) · 2007 IEEE 11th International Conference on Computer Vision · doi:10.1109/iccv.2007.4408891 · Cited by 859
Creating efficient codebooks for visual recognition
Jurie, F., & Triggs, B. (2005) · Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1 · doi:10.1109/iccv.2005.66 · Cited by 713
Optimised KD-trees for fast image descriptor matching
Silpa-Anan, C., & Hartley, R. (2008) · 2008 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2008.4587638 · Cited by 677
City-Scale Location Recognition
Schindler, G., Brown, M., & Szeliski, R. (2007) · 2007 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2007.383150 · Cited by 626
Fast and Incremental Method for Loop-Closure Detection Using Bags of Visual Words
Angeli, A., Filliat, D., Doncieux, S., & Meyer, J.-A. (2008) · IEEE Transactions on Robotics · doi:10.1109/tro.2008.2004514 · Cited by 514
Appearance-based place recognition for topological localization
Ulrich, I., & Nourbakhsh, I. (2002) · Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065) · doi:10.1109/robot.2000.844734 · Cited by 512
On the burstiness of visual elements
Jegou, H., Douze, M., & Schmid, C. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206609 · Cited by 405
Mapping a Suburb With a Single Camera Using a Biologically Inspired SLAM System
Milford, M. J., & Wyeth, G. F. (2008) · IEEE Transactions on Robotics · doi:10.1109/tro.2008.2004520 · Cited by 378
2009 IEEE International Conference on Robotics and Automation
(2009) · doi:10.1109/icra14741.2009 · Cited by 322
Highly scalable appearance-only SLAM - FAB-MAP 2.0
Cummins, M., & Newman, P. (2009) · Robotics: Science and Systems V · doi:10.15607/rss.2009.v.039 · Cited by 282
Self-citationPerformance guarantees for hierarchical clustering
Dasgupta, S., & Long, P. M. (2005) · Journal of Computer and System Sciences · doi:10.1016/j.jcss.2004.10.006 · Cited by 234
Konolige, K., Bowman, J., Chen, J. D., Mihelich, P., Calonder, M., Lepetit, V., & Fua, P. (2010) · The International Journal of Robotics Research · doi:10.1177/0278364910370376 · Cited by 227
Topological mapping, localization and navigation using image collections
Fraundorfer, F., Engels, C., & Nister, D. (2007) · 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems · doi:10.1109/iros.2007.4399123 · Cited by 202
Map Matching and Data Association for Large-Scale Two-dimensional Laser Scan-based SLAM
Bosse, M., & Zlot, R. (2008) · The International Journal of Robotics Research · doi:10.1177/0278364908091366 · Cited by 175
International Conference on Computer Vision Theory and Applications
Daubney, B., Gibson, D., & Campbell, N. (2008) · Cited by 172
Unified Loop Closing and Recovery for Real Time Monocular SLAM
Eade, E. D., & Drummond, T. W. (2008) · Procedings of the British Machine Vision Conference 2008 · doi:10.5244/c.22.6 · Cited by 153
Toward a Unified Bayesian Approach to Hybrid Metric--Topological SLAM
Blanco, J., Fernández‐Madrigal, J., & González, J. (2008) · IEEE Transactions on Robotics · doi:10.1109/tro.2008.918049 · Cited by 144
Navigating, Recognizing and Describing Urban Spaces With Vision and Lasers
Newman, P., Sibley, G., Smith, M., Cummins, M., Harrison, A., Mei, C., Posner, I., Shade, R., Schroeter, D., Murphy, L., et al. (2009) · The International Journal of Robotics Research · doi:10.1177/0278364909341483 · Cited by 134
Self-citationFast scale invariant feature detection and matching on programmable graphics hardware
Cornelis, N., & Gool, L. V. (2008) · 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops · doi:10.1109/cvprw.2008.4563087 · Cited by 134
Appearance-based loop detection from 3D laser data using the normal distributions transform
Magnusson, M., Andreasson, H., Nüchter, A., & Lilienthal, A. J. (2009) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/robot.2009.5152712 · Cited by 133
Keypoint design and evaluation for place recognition in 2D lidar maps
Bosse, M. C., & Zlot, R. (2009) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2009.07.009 · Cited by 132
FAB-MAP 3D: Topological mapping with spatial and visual appearance
Paul, R., & Newman, P. (2010) · 2010 IEEE International Conference on Robotics and Automation · doi:10.1109/robot.2010.5509587 · Cited by 125
Self-citationRobust and efficient robotic mapping
Teller, S. J., Leonard, J. J., & Olson, E. (2008) · Cited by 105
Accelerated appearance-only SLAM
Cummins, M., & Newman, P. M. (2008) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/robot.2008.4543473 · Cited by 95
Self-citationAn image-to-map loop closing method for monocular SLAM
Williams, B., Cummins, M., Neira, J., Newman, P. M., Reid, I. D., & Tardós, J. D. (2008) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2008.4650996 · Cited by 80
Self-citationRobust place recognition using local appearance based methods
Dudek, G., & Jugessur, D. (2002) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/robot.2000.844735 · Cited by 63
On the burstiness of visual elements
Jegou, H., Douze, M., & Schmid, C. (2009) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvprw.2009.5206609 · Cited by 53
An Accelerated Chow and Liu Algorithm: Fitting Tree Distributions to High-Dimensional Sparse Data
Meilă, M. (1999) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 51
Konolige, K., Bowman, J., Chen, J. D., Mihelich, P., Calonder, M., Lepetit, V., & Fua, P. (2009) · Robotics: Science and Systems · doi:10.15607/rss.2009.v.020 · Cited by 46
Ten-fold Improvement in Visual Odometry Using Landmark Matching
Zhu, Z., Oskiper, T., Samarasekera, S., Kumar, R., & Sawhney, H. (2007) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2007.4409062 · Cited by 41
Fast Probabilistic Labeling of City Maps
Posner, I., Cummins, M., & Newman, P. M. (2008) · Robotics: Science and Systems · doi:10.15607/rss.2008.iv.003 · Cited by 36
Self-citationTree of Words for Visual Loop Closure Detection in Urban SLAM
Callmer, J., Granström, K., Nieto, J. I., & Ramos, F. T. (2008) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · Cited by 30
Probabilistic localization and mapping in appearance space
Cummins, M. (2009) · OpenGrey (Institut de l'Information Scientifique et Technique) · doi:10.5287/ora-rjpgozj1k · Cited by 18
Self-citationProbabilistic topological maps
Dellaert, F., & Ranganathan, A. (2008) · Cited by 8
Cited by
ORB-SLAM: A Versatile and Accurate Monocular SLAM System
Mur-Artal, R., Montiel, J. M. M., & Tardos, J. D. (2015) · IEEE Transactions on Robotics · doi:10.1109/tro.2015.2463671 · Cited by 6,778
“While our current implementation makes use of ORB, the techniques proposed are not restricted to these features.”
MethodBags of Binary Words for Fast Place Recognition in Image Sequences
Galvez-López, D., & Tardos, J. D. (2012) · IEEE Transactions on Robotics · doi:10.1109/tro.2012.2197158 · Cited by 1,913
Visual Place Recognition: A Survey
Lowry, S., Sünderhauf, N., Newman, P., Leonard, J. J., Cox, D., Corke, P., & Milford, M. J. (2016) · IEEE Transactions on Robotics · doi:10.1109/tro.2015.2496823 · Cited by 1,079
Self-citationSimultaneous Localization and Mapping: A Survey of Current Trends in Autonomous Driving
Bresson, G., Alsayed, Z., Yu, L., & Glaser, S. (2017) · IEEE Transactions on Intelligent Vehicles · doi:10.1109/tiv.2017.2749181 · Cited by 885
“0 [137]) and PIRF-Nav (Position Invariant Robust Feature Navigation) [138] are two”
3-D Mapping With an RGB-D Camera
Endres, F., Hess, J., Sturm, J., Cremers, D., & Burgard, W. (2014) · IEEE Transactions on Robotics · doi:10.1109/tro.2013.2279412 · Cited by 820
Metadata
- Authors
- Cummins, M., & Newman, P.
- Venue
- The International Journal of Robotics Research
- Publisher
- SAGE Publications
- Published
- 2010-11-12
- Volume
- 30
- Issue
- 9
- Pages
- 1100-1123
- ISSN
- 0278-3649 (ISSN-L)
- 1741-3176
- OpenAlex
- W1974093076
- Cited by
- 609
- References
- 48
- FWCI
- 38.82
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.