Cited by 389Advanced Vision and ImagingRobotics and Sensor-Based LocalizationAdvanced Neural Network Applications

Depth From Videos in the Wild: Unsupervised Monocular Depth Learning From Unknown Cameras

Open access
Gordon, Ariel, Li, Hanhan, Jonschkowski, Rico, Angelova, Anelia·2019·2019 IEEE/CVF International Conference on Computer Vision (ICCV)

Abstract

We present a novel method for simultaneous learning of depth, egomotion, object motion, and camera intrinsics from monocular videos, using only consistency across neighboring video frames as supervision signal. Similarly to prior work, our method learns by applying differentiable warping to frames and comparing the result to adjacent ones, but it provides several improvements: We address occlusions geometrically and differentiably, directly using the depth maps as predicted during training. We introduce randomized layer normalization, a novel powerful regularizer, and we account for object motion relative to the scene. To the best of our knowledge, our work is the first to learn the camera intrinsic parameters, including lens distortion, from video in an unsupervised manner, thereby allowing us to extract accurate depth and motion from arbitrary videos of unknown origin at scale. We evaluate our results on the Cityscapes, KITTI and EuRoC datasets, establishing new state of the art on depth prediction and odometry, and demonstrate qualitatively that depth prediction can be learned from a collection of YouTube videos. The code will be open sourced once anonymity is lifted.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1109/iccv.2019.00907

Cites

54 of 54 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 6

  1. O. Bogdan, V. Eckstein, F. Rameau, and J.-C. Bazin. Deep- calib: A deep learning approach for automatic intrinsic cal- ibration of wide field-of-view cameras. In Proceedings of the 15th ACM SIGGRAPH European Conference on Visual Media Production, CVMP '18, pages 6:1-6:10, New York, NY, USA, 2018. ACM.
  2. V. Casser, S. Pirk, R. Mahjourian, and A. Angelova. Un- supervised learning of depth and ego-motion: A structured approach. In AAAI-19, 2019.
  3. C. Godard, O. M. Aodha, and G. J. Brostow. Unsuper- vised monocular depth estimation with left-right consis- tency. CVPR, 2017.
  4. H. Kato, Y. Ushiku, and T. Harada. Neural 3d mesh ren- derer. In The IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2018.
  5. A. Pilzer, D. Xu, M. Puscas, E. Ricci, and N. Sebe. Un- supervised adversarial depth estimation using cycled gen- erative networks. In 2018 International Conference on 3D Vision (3DV), pages 587-595, Sep. 2018.
  6. T. Zhou, M. Brown, N. Snavely, and D. Lowe. Unsuper- vised learning of depth and ego-motion from video. CVPR, 2017.

Cited by

Sorted by citations

Authors
Gordon, A., Li, H., Jonschkowski, R., & Angelova, A.
Affiliations
Google (United States) (US)
Venue
2019 IEEE/CVF International Conference on Computer Vision (ICCV)
Publisher
IEEE
Published
2019-10
Pages
8976-8985
OpenAlex
W2935920407
Cited by
389
References
52
Citations by year
2026: 17 · 2025: 21 · 2024: 51 · 2023: 72 · 2022: 73 · 2021: 86 · 2020: 60 · 2019: 9
FWCI
18.60
Type
conference paper
Language
en
Open access
Locations
  • IEEE/CVF International Conference on Computer Vision (ICCV) (publishedVersion)
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
Topics
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Vision and Imaging
  • Physical Sciences › Engineering › Aerospace Engineering › Robotics and Sensor-Based Localization
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
Keywords
camera motion estimation, object motion estimation, lens distortion, occlusion handling

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review