Cited by 699Robotics and Sensor-Based LocalizationAdvanced Image and Video Retrieval Techniques3D Surveying and Cultural Heritage

Benchmarking 6DOF Outdoor Visual Localization in Changing Conditions

Open access
Sattler, Torsten, Maddern, Will, Toft, Carl, Torii, Akihiko, Hammarstrand, Lars, Stenborg, Erik, Safari, Daniel, Okutomi, Masatoshi +4 more·2018·2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition

Abstract

Visual localization enables autonomous vehicles to navigate in their surroundings and augmented reality applications to link virtual to real worlds. Practical visual localization approaches need to be robust to a wide variety of viewing condition, including day-night changes, as well as weather and seasonal variations, while providing highly accurate 6 degree-of-freedom (6DOF) camera pose estimates. In this paper, we introduce the first benchmark datasets specifically designed for analyzing the impact of such factors on visual localization. Using carefully created ground truth poses for query images taken under a wide variety of conditions, we evaluate the impact of various factors on 6DOF camera pose estimation accuracy through extensive experiments with state-of-the-art localization approaches. Based on our results, we draw conclusions about the difficulty of different conditions, showing that long-term localization is far from solved, and propose promising avenues for future work, including sequence-based localization approaches and the need for better local features. Our benchmark is available at visuallocalization.net.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1109/cvpr.2018.00897

Cites

74 of 74 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 16

  1. [7][7] A. Bosch, A. Zisserman, and X. Munoz. Image classification using random forests and ferns. In Proc. ICCV , 2007. 11 -
  2. [16][16] D. M. Chen, G. Baatz, K. K¨ oser, S. S. Tsai, R. Vedantham, T. Pylv¨ an¨ ainen, K. Roimela, X. Chen, J. Bach, M. Pollefeys, - B. Girod, and R. Grzeszczuk. City-Scale Landmark Identification on Mobile Devices. In Proc. CVPR , 2011. 2, 3 -
  3. [21][21] M. Cummins and P. Newman. Appearance-only slam at large scale with fab-map 2.0. The International Journal of Robotics Research , 30(9):1100-1123, 2011. 10 -
  4. [22][22] M. Donoser and D. Schmalstieg. Discriminative Featureto-Point Matching in Image-Based Locallization. In Proc. CVPR , 2014. 2 -
  5. [23][23] J. Engel, T. Sch¨ ops, and D. Cremers. LSD-SLAM: Largescale direct monocular SLAM. In Proc. ECCV , 2014. 3 -
  6. [27][27] A. Glover, W. Maddern, M. Warren, S. Reid, M. Milford, and G. Wyeth. openFABMAP: An open source toolbox for appearance-based loop closure detection. In Proc. ICRA , 2012. 10 -
  7. [40][40] C. Liu, J. Yuen, A. Torralba, J. Sivic, and W. T. Freeman. SIFT Flow: Dense correspondence across different scenes. In Proc. ECCV , pages 28-42, 2008. 11 -
  8. [46][46] W. Maddern, G. Pascoe, C. Linegar, and P. Newman. 1 Year, 1000km: The Oxford RobotCar Dataset. IJRR , 36(1):3-15, 2017. 2, 4 -
  9. [53][53] J. Philbin, O. Chum, M. Isard, J. Sivic, and A. Zisserman. Object retrieval with large vocabularies and fast spatial matching. In Proc. CVPR , 2007. 9 -
  10. [56][56] T. Sattler, M. Havlena, F. Radenovic, K. Schindler, and M. Pollefeys. Hyperpoints and fine vocabularies for largescale location recognition. In Proc. ICCV , 2015. 1, 2 -
  11. [70][70] L. Sv¨ arm, O. Enqvist, F. Kahl, and M. Oskarsson. CityScale Localization for Cameras with Known Vertical Direction. IEEE PAMI , 39(7):1455-1461, 2017. 1, 2, 5, 9 -
  12. [72][72] A. Teynor and H. Burkhardt. Fast codebook generation by sequential data analysis for object classification. In International Symposium on Visual Computing , pages 610-620. Springer, 2007. 10 -
  13. [74][74] A. Torii, R. Arandjelovi´ c, J. Sivic, M. Okutomi, and T. Pajdla. 24/7 place recognition by view synthesis. In Proc. CVPR , 2015. 10, 11 -
  14. [76][76] A. Torii, J. Sivic, M. Okutomi, and T. Pajdla. Visual place recognition with repetitive structures. IEEE PAMI , 2015. 2 -
  15. [77][77] A. Vedaldi and B. Fulkerson. VLFeat - an open and portable library of computer vision algorithms. In Proc. ACMM , 2010. 10 -
  16. [82][82] H. Zhou, T. Sattler, and D. W. Jacobs. Evaluating Local Features for Day-Night Matching. In Proc. ECCV Workshops , 2016. 11

Cited by

Sorted by citations

Authors
Sattler, T., Maddern, W., Toft, C., Torii, A., Hammarstrand, L., Stenborg, E., Safari, D., Okutomi, M., Pollefeys, M., Sivic, J., Kahl, F., & Pajdla, T.
Affiliations
  • ETH Zurich (CH)
  • University of Oxford (GB)
  • Chalmers University of Technology (SE)
  • Tokyo Institute of Technology (JP)
  • Lund University (SE)
Venue
2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition
Publisher
IEEE
Published
2018-06
Pages
8601-8610
ISSN
1063-6919 (ISSN-L)
OpenAlex
W2740418457
Cited by
699
References
74
Citations by year
2026: 40 · 2025: 74 · 2024: 108 · 2023: 101 · 2022: 93 · 2021: 105 · 2020: 102 · 2019: 58 · 2018: 18
FWCI
122.82
Type
conference paper
Language
en
Open access
Locations
  • IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings (publishedVersion)
  • arXiv (Cornell University) (submittedVersion)
  • Chalmers Research (Chalmers University of Technology) (submittedVersion)
  • Lund University Publications (Lund University) (submittedVersion)
Funders
  • Canadian Institute for Advanced Research
  • Stiftelsen för Strategisk Forskning
  • Vetenskapsrådet (2016-04445)
  • Horizon 2020 Framework Programme
  • Engineering and Physical Sciences Research Council (EP/M019918/1, H2020)
  • Japan Society for the Promotion of Science (15H05313, 15003)
  • European Regional Development Fund (02.1.01/0.0/0.0, H2020, CZ.02, CZ.02.1.01, CZ.02.1.01/0.0/0.0)
  • FP7 Ideas: European Research Council (336845)
Topics
  • Physical Sciences › Engineering › Aerospace Engineering › Robotics and Sensor-Based Localization
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Image and Video Retrieval Techniques
  • Physical Sciences › Earth and Planetary Sciences › Geology › 3D Surveying and Cultural Heritage
Keywords
visual localization, outdoor localization, benchmark dataset, long-term localization, local features, autonomous vehicles, augmented reality

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review