Depth Map Prediction from a Single Image using a Multi-Scale Deep Network
Open accessAbstract
Predicting depth is an essential component in understanding the 3D geometry of a scene. While for stereo images local correspondence suffices for estimation, finding depth relations from a single image is less straightforward, requiring integration of both global and local information from various cues. Moreover, the task is inherently ambiguous, with a large source of uncertainty coming from the overall scale. In this paper, we present a new method that addresses this task by employing two deep network stacks: one that makes a coarse global prediction based on the entire image, and another that refines this prediction locally. We also apply a scale-invariant error to help measure depth relations rather than scale. By leveraging the raw datasets as large sources of training data, our method achieves state-of-the-art results on both NYU Depth and KITTI, and matches detailed depth boundaries without the need for superpixelation.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Virtually all existing architectures for dense prediction are based on convolutional networks.
“Virtually all existing architectures for dense prediction are based on convolutional networks [6,31,34,42,49,50,53].”
From Vision Transformers for Dense Prediction (2021) · cites this paper as [34]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
No citation lists for this paper
No citation lists for this paper yet — checked again daily.
References 19 · Cited by 3,442
Research works printed but not linked: 14
- [1][1] J. Deng, W. Dong, R. Socher, L. Li, K. Li, and L. Fei-fei. Imagenet: A large-scale hierarchical image database. In CVPR , 2009. -
- [2][2] D. F. Fouhey, A. Gupta, and M. Hebert. Data-driven 3d primitives for single image understanding. In ICCV , 2013. -
- [4][4] R. Hadsell, P. Sermanet, J. Ben, A. Erkan, M. Scoffier, K. Kavukcuoglu, U. Muller, and Y. LeCun. Learning long-range vision for autonomous off-road driving. Journal of Field Robotics , 26(2):120-144, 2009. -
- [7][7] K. Karsch, C. Liu, S. B. Kang, and N. England. Depth extraction from video using nonparametric sampling. In TPAMI , 2014. -
- [8][8] K. Konda and R. Memisevic. Unsupervised learning of depth and motion. In arXiv:1312.3429v2 , 2013. - · arXiv
- [10][10] A. Levin, R. Fergus, F. Durand, and W. T. Freeman. Image and depth from a conventional camera with a coded aperture. In SIGGRAPH , 2007. -
- [12][12] M. P. Lubor Ladicky, Jianbo Shi. Pulling things out of perspective. In CVPR , 2014. -
- [13][13] R. Memisevic and C. Conrad. Stereopsis via deep learning. In NIPS Workshop on Deep Learning , 2011. -
- [15][15] A. Saxena, S. H. Chung, and A. Y. Ng. Learning depth from single monocular images. In NIPS , 2005. -
- [14][14] J. Michels, A. Saxena, and A. Y. Ng. High speed obstacle avoidance using monocular vision and reinforcement learning. In ICML , pages 593-600, 2005. -
- [16][16] A. Saxena, M. Sun, and A. Y. Ng. Make3d: Learning 3-d scene structure from a single still image. TPAMI , 2008. -
- [17][17] D. Scharstein and R. Szeliski. A taxonomy and evaluation of dense two-frame stereo correspondence algorithms. IJCV , 47:7-42, 2002. -
- [19][19] F. H. Sinz, J. Q. Candela, G. H. Bakır, C. E. Rasmussen, and M. O. Franz. Learning depth from stereo. In Pattern Recognition , pages 245-252. Springer, 2004. -
- [21][21] K. Yamaguchi, T. Hazan, D. Mcallester, and R. Urtasun. Continuous markov random fields for robust stereo estimation. In arXiv:1204.1393v1 , 2012. - · arXiv
- Authors
- Eigen, D., Puhrsch, C., & Fergus, R.
- Affiliations
- New York University (US)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2014
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1406.2283
- OpenAlex
- W2171740948
- Cited by
- 3,442
- References
- 19
- Citations by year
- 2026: 13 · 2025: 174 · 2024: 425 · 2023: 419 · 2022: 357 · 2021: 529 · 2020: 470 · 2019: 463 · 2018: 276 · 2017: 151 · 2016: 109 · 2015: 52 · 2014: 4
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Vision and Imaging
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Engineering › Media Technology › Image Processing Techniques and Applications
- Keywords
- depth estimation, multi-scale network, scale invariance, depth uncertainty, NYU Depth V2
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
