Cited by 705Advanced Vision and ImagingRobotics and Sensor-Based Localization3D Surveying and Cultural Heritage

Unsupervised Learning of Monocular Depth Estimation and Visual Odometry with Deep Feature Reconstruction

Open access
Zhan, Huangying, Garg, Ravi, Weerasekera, Chamara Saroj, Li, Kejie, Agarwal, Harsh, Reid, Ian M.·2018·2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition

Abstract

Despite learning based methods showing promising results in single view depth estimation and visual odometry, most existing approaches treat the tasks in a supervised manner. Recent approaches to single view depth estimation explore the possibility of learning without full supervision via minimizing photometric error. In this paper, we explore the use of stereo sequences for learning depth and visual odometry. The use of stereo sequences enables the use of both spatial (between left-right pairs) and temporal (forward backward) photometric warp error, and constrains the scene depth and camera motion to be in a common, real-world scale. At test time our framework is able to estimate single view depth and two-view odometry from a monocular sequence. We also show how we can improve on a standard photometric warp loss by considering a warp of deep features. We show through extensive experiments that: (i) jointly training for single view depth and visual odometry improves depth prediction because of the additional constraint imposed on depths and achieves competitive results for visual odometry; (ii) deep feature-based warping loss improves upon simple photometric warp loss for both single view depth estimation and visual odometry. Our method outperforms existing learning based methods on the KITTI driving dataset in both tasks. The source code is available at https://github.com/Huangying-Zhan/Depth-VO-Feat.

Integrity signals

Registry

Crossref · 10.1109/cvpr.2018.00043

Cites

45 of 45 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Well-trained deep networks enable scale-consistent predictions over long videos.

    “More surprisingly, they show that the welltrained networks enable scale-consistent predictions over long videos, while the accuracy is still inferior to traditional methods because of ignoring geometric information.”

    From DF-VO: What Should Be Learnt for Visual Odometry? (2021) · cites this paper as Zhan et al. 2018

  • Using stereo sequences during training solves both scale problems because the known stereo baseline aligns deep predictions with real-world scale and makes them scale-consistent.

    “One solution to solve both scale problems is using stereo sequences during training (Godard et al. 2019; Li et al. 2017; Zhan et al. 2018), the deep predictions are aligned with real-world scale and scale-consistent because of the constraint introduced by the known stereo baseline.”

    From DF-VO: What Should Be Learnt for Visual Odometry? (2021) · cites this paper as Zhan et al. 2018

  • The method shows superior performance on the KITTI Depth Prediction Benchmark using improved ground truth depths.

    “Like [1], we use these instead of the reprojected LIDAR scans to compare our method against several existing baseline algorithms, still showing superior performance.”

    From Digging Into Self-Supervised Monocular Depth Estimation (2019) · cites this paper as [1]

Cites

Flagged first, then by citations

4 of the 49 references couldn’t be matched to a known paper.

Cited by

Sorted by citations

Authors
Zhan, H., Garg, R., Weerasekera, C. S., Li, K., Agarwal, H., & Reid, I. M.
Affiliations
  • The University of Adelaide (AU)
  • Indian Institute of Technology BHU (IN)
Venue
2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition
Publisher
IEEE
Published
2018-06
Pages
340-349
ISSN
1063-6919 (ISSN-L)
OpenAlex
W2962816904
Cited by
705
References
49
Citations by year
2026: 21 · 2025: 42 · 2024: 72 · 2023: 88 · 2022: 85 · 2021: 153 · 2020: 115 · 2019: 115 · 2018: 14
FWCI
29.45
Type
conference paper
Language
en
Open access
Locations
  • IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings (publishedVersion)
  • arXiv (Cornell University) (submittedVersion)
  • Adelaide Research & Scholarship (AR&S) (University of Adelaide) (submittedVersion)
  • arXiv (Cornell University)
Funders
Australian Centre for Robotic Vision
Topics
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Vision and Imaging
  • Physical Sciences › Engineering › Aerospace Engineering › Robotics and Sensor-Based Localization
  • Physical Sciences › Earth and Planetary Sciences › Geology › 3D Surveying and Cultural Heritage
Keywords
monocular depth estimation, visual odometry, unsupervised learning

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review