Cited by 201Robotics and Sensor-Based LocalizationAdvanced Vision and Imaging3D Surveying and Cultural Heritage

Visual Odometry Revisited: What Should Be Learnt?

Open access
Zhan, Huangying, Weerasekera, Chamara Saroj, Bian, Jia-Wang, Reid, Ian·2020·2020 IEEE International Conference on Robotics and Automation (ICRA)

Abstract

In this work we present a monocular visual odometry (VO) algorithm which leverages geometry-based methods and deep learning. Most existing VO/SLAM systems with superior performance are based on geometry and have to be carefully designed for different application scenarios. Moreover, most monocular systems suffer from scale-drift issue. Some recent deep learning works learn VO in an end-to-end manner but the performance of these deep systems is still not comparable to geometry-based methods. In this work, we revisit the basics of VO and explore the right way for integrating deep learning with epipolar geometry and Perspective-n-Point (PnP) method. Specifically, we train two convolutional neural networks (CNNs) for estimating single-view depths and two-view optical flows as intermediate outputs. With the deep predictions, we design a simple but robust frame-to-frame VO algorithm (DF-VO) which outperforms pure deep learning-based and geometry-based methods. More importantly, our system does not suffer from the scale-drift issue being aided by a scale consistent single-view depth CNN. Extensive experiments on KITTI dataset shows the robustness of our system and a detailed ablation study shows the effect of different factors in our system. Code is available at here: DF-VO.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1109/icra40945.2020.9197374

Cites

62 of 62 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • DF-VO with the Best-N correspondence selection scheme has already outperformed existing VO/SLAM baselines.

    “As shown in (Zhan et al. 2020), DF-VO with this correspondence selection scheme has already outperformed existing VO/SLAM baselines.”

    From DF-VO: What Should Be Learnt for Visual Odometry? (2021) · cites this paper as Zhan et al. 2020

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

4 of the 66 references couldn’t be matched to a known paper.

Research works printed but not linked: 4

  1. D. Scaramuzza and F. Fraundorfer, "Visual odometry: Part i: The first 30 years and fundamentals," IEEE Robotics & Automation Magazine, vol. 18, no. 4, pp. 80-92, 2011.
  2. Z. Zhang, "Determining the epipolar geometry and its uncertainty: A review," International Journal on Computer Vision (IJCV), vol. 27, no. 2, pp. 161-195, 1998.
  3. C. Godard, O. Mac Aodha, M. Firman, and G. J. Brostow, "Digging into self-supervised monocular depth prediction," in IEEE Interna- tional Conference on Computer Vision (ICCV), 2019.
  4. A. Paszke, S. Gross, S. Chintala, G. Chanan, E. Yang, Z. DeVito, Z. Lin, A. Desmaison, L. Antiga, and A. Lerer, "Automatic differen- tiation in PyTorch," in NIPS Autodiff Workshop, 2017.

Cited by

Sorted by citations

Authors
Zhan, H., Weerasekera, C. S., Bian, J.-W., & Reid, I.
Affiliations
The University of Adelaide (AU)
Venue
2020 IEEE International Conference on Robotics and Automation (ICRA)
Publisher
IEEE
Published
2020-05
Pages
4203-4210
ISSN
1050-4729 (ISSN-L)
OpenAlex
W3091687063
Cited by
201
References
66
Citations by year
2026: 18 · 2025: 28 · 2024: 37 · 2023: 37 · 2022: 33 · 2021: 30 · 2020: 17 · 2019: 1
FWCI
43.12
Type
conference paper
Language
en
Open access
Locations
  • Proceedings - IEEE International Conference on Robotics and Automation/Proceedings (publishedVersion)
  • arXiv (Cornell University) (submittedVersion)
  • Adelaide Research & Scholarship (AR&S) (University of Adelaide) (submittedVersion)
  • arXiv (Cornell University)
Funders
Australian Centre for Robotic Vision
Topics
  • Physical Sciences › Engineering › Aerospace Engineering › Robotics and Sensor-Based Localization
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Vision and Imaging
  • Physical Sciences › Earth and Planetary Sciences › Geology › 3D Surveying and Cultural Heritage
Keywords
monocular visual odometry, scale drift, single-view depth estimation, optical flow, epipolar geometry, perspective-n-point, convolutional neural networks

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review