The DOI matches its Crossref record; 56 of the 56 references it cites were found in a registry or an index.
Self-Supervised Monocular Depth Hints
Open accessAbstract
Monocular depth estimators can be trained with various forms of self-supervision from binocular-stereo data to circumvent the need for high-quality laser-scans or other ground-truth data. The disadvantage, however, is that the photometric reprojection losses used with self-supervised learning typically have multiple local minima. These plausible-looking alternatives to ground-truth can restrict what a regression network learns, causing it to predict depth maps of limited quality. As one prominent example, depth discontinuities around thin structures are often incorrectly estimated by current state-of-the-art methods. Here, we study the problem of ambiguous reprojections in depth-prediction from stereo-based self-supervision, and introduce Depth Hints to alleviate their effects. Depth Hints are complementary depth-suggestions obtained from simple off-the-shelf stereo algorithms. These hints enhance an existing photometric loss function, and are used to guide a network to learn better weights. They require no additional data, and are assumed to be right only sometimes. We show that using our Depth Hints gives a substantial boost when training several leading self-supervised-from-stereo models, not just our own. Further, combined with other good practices, we produce state-of-the-art depth predictions on the KITTI benchmark.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“[27] uses a different split of the data, which is not the same as the Eigen split.”
From Digging Into Self-Supervised Monocular Depth Estimation (2019) · cites this paper as [27]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
Image quality assessment: from error visibility to structural similarity
Wang, Z., Bovik, A. C., Sheikh, H. R., & Simoncelli, E. P. (2004) · IEEE Transactions on Image Processing · doi:10.1109/tip.2003.819861 · Cited by 57,892
Are we ready for autonomous driving? The KITTI vision benchmark suite
Geiger, A., Lenz, P., & Urtasun, R. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6248074 · Cited by 14,897
Stereo Processing by Semiglobal Matching and Mutual Information
Hirschmüller, H. (2007) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2007.1166 · Cited by 4,199
Depth Map Prediction from a Single Image using a Multi-Scale Deep Network
Eigen, D., Puhrsch, C., & Fergus, R. (2014) · arXiv · doi:10.48550/arxiv.1406.2283 · Cited by 3,442
Unsupervised Monocular Depth Estimation with Left-Right Consistency
Godard, C., Aodha, O. M., & Brostow, G. J. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.699 · Cited by 3,270
Self-citationWhat Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?
Kendall, A., & Gal, Y. (2017) · arXiv · doi:10.48550/arxiv.1703.04977 · Cited by 3,088
Unsupervised Learning of Depth and Ego-Motion from Video
Zhou, T., Brown, M., Snavely, N., & Lowe, D. G. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.700 · Cited by 2,910
Loss Functions for Image Restoration With Neural Networks
Zhao, H., Gallo, O., Frosio, I., & Kautz, J. (2016) · IEEE Transactions on Computational Imaging · doi:10.1109/tci.2016.2644865 · Cited by 2,659
Digging Into Self-Supervised Monocular Depth Estimation
Godard, C., Aodha, O. M., Firman, M., & Brostow, G. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00393 · Cited by 2,561
Self-citationMayer, N., Ilg, E., Hausser, P., Fischer, P., Cremers, D., Dosovitskiy, A., & Brox, T. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.438 · Cited by 2,488
Deeper Depth Prediction with Fully Convolutional Residual Networks
Laina, I., Rupprecht, C., Belagiannis, V., Tombari, F., & Navab, N. (2016) · International Conference on 3D Vision (3DV) · doi:10.1109/3dv.2016.32 · Cited by 2,105
Deep Ordinal Regression Network for Monocular Depth Estimation
Fu, H., Gong, M., Wang, C., Batmanghelich, K., & Tao, D. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00214 · Cited by 1,991
Pyramid Stereo Matching Network
Chang, J.-R., & Chen, Y. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00567 · Cited by 1,931
Accurate and Efficient Stereo Processing by Semi-Global Matching and Mutual Information
Hirschmüller, H. (2005) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2005.56 · Cited by 1,731
Unsupervised CNN for Single View Depth Estimation: Geometry to the Rescue
Garg, R., BG, V. K., Carneiro, G., & Reid, I. (2016) · arXiv · doi:10.48550/arxiv.1603.04992 · Cited by 1,632
Unsupervised CNN for Single View Depth Estimation: Geometry to the Rescue
Garg, R., B.G., V. K., Carneiro, G., & Reid, I. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46484-8_45 · Cited by 1,632
GeoNet: Unsupervised Learning of Dense Depth, Optical Flow and Camera Pose
Yin, Z., & Shi, J. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00212 · Cited by 1,280
Mayer, N., Ilg, E., Cremers, D., Dosovitskiy, A., & Brox, T. (2016) · Cited by 1,214
Uhrig, J., Schneider, N., Schneider, L., Franke, U., Brox, T., & Geiger, A. (2017) · 2017 International Conference on 3D Vision (3DV) · doi:10.1109/3dv.2017.00012 · Cited by 924
Unsupervised Learning of Depth and Ego-Motion from Monocular Video Using 3D Geometric Constraints
Mahjourian, R., Wicke, M., & Angelova, A. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00594 · Cited by 775
Zhan, H., Garg, R., Weerasekera, C. S., Li, K., Agarwal, H., & Reid, I. M. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00043 · Cited by 705
Semi-Supervised Deep Learning for Monocular Depth Map Prediction
Kuznietsov, Y., Stuckler, J., & Leibe, B. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.238 · Cited by 680
Learning Depth from Monocular Videos Using Direct Methods
Wang, C., Buenaposada, J. M., Zhu, R., & Lucey, S. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00216 · Cited by 667
Ranjan, A., Jampani, V., Balles, L., Kim, K., Sun, D., Wulff, J., & Black, M. J. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.01252 · Cited by 659
DF-Net: Unsupervised Joint Learning of Depth and Flow Using Cross-Task Consistency
Zou, Y., Luo, Z., & Huang, J. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01228-1_3 · Cited by 494
Hu, J., Özay, M., Zhang, Y., & Okatani, T. (2019) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv.2019.00116 · Cited by 422
Stereo DSO: Large-Scale Direct Sparse Visual Odometry with Stereo Cameras
Wang, R., Schwörer, M., & Cremers, D. (2017) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.421 · Cited by 406
Learning Depth with Convolutional Spatial Propagation Network
Cheng, X., Wang, P., & Yang, R. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2947374 · Cited by 358
Deep Virtual Stereo Odometry: Leveraging Deep Depth Prediction for Monocular Direct Sparse Odometry
Yang, N., Wang, R., Stückler, J., & Cremers, D. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01237-3_50 · Cited by 346
Learning Depth with Convolutional Spatial Propagation Network
Cheng, X., Wang, P., & Yang, R. (2018) · arXiv · doi:10.48550/arxiv.1810.02695 · Cited by 345
Every Pixel Counts ++: Joint Learning of Geometry and Motion with 3D Holistic Understanding
Luo, C., Yang, Z., Wang, P., Wang, Y., Xu, W., Nevatia, R., & Yuille, A. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2930258 · Cited by 316
Learning Monocular Depth Estimation Infusing Traditional Stereo Knowledge
Tosi, F., Aleotti, F., Poggi, M., & Mattoccia, S. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.01003 · Cited by 253
Bailer, C., Taetz, B., & Stricker, D. (2015) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.457 · Cited by 236
Unsupervised Learning of Depth and Ego-Motion from VideoPreprint
Zhou, T., Brown, M., Snavely, N., et al. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1704.07813 · Cited by 217
SuperDepth: Self-Supervised, Super-Resolved Monocular Depth Estimation
Pillai, S., Ambruş, R., & Gaidon, A. (2019) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2019.8793621 · Cited by 214
Learning Monocular Depth by Distilling Cross-Domain Stereo Networks
Guo, X., Li, H., Yi, S., Ren, J., & Wang, X. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01252-6_30 · Cited by 208
Luo, Y., Ren, J., Lin, M., Pang, J., Sun, W., Li, H., & Lin, L. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00024 · Cited by 205
EdgeStereo: An Effective Multi-task Learning Network for Stereo Matching and Edge Detection
Song, X., Zhao, X., Fang, L., Hu, H., & Yu, Y. (2020) · International Journal of Computer Vision · doi:10.1007/s11263-019-01287-w · Cited by 204
LEGO: Learning Edge with Geometry all at Once by Watching Videos
Yang, Z., Wang, P., Wang, Y., Xu, W. H., & Nevatia, R. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00031 · Cited by 191
Learning Monocular Depth Estimation with Unsupervised Trinocular Assumptions
Poggi, M., Tosi, F., & Mattoccia, S. (2018) · International Conference on 3D Vision (3DV) · doi:10.1109/3dv.2018.00045 · Cited by 179
Deep Ordinal Regression Network for Monocular Depth EstimationPreprint
Fu, H., Gong, M., Wang, C., et al. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1806.02446 · Cited by 171
Unsupervised Learning of Geometry From Videos With Edge-Aware Depth-Normal Consistency
Yang, Z., Wang, P., Xu, W. H., Zhao, L., & Nevatia, R. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.12257 · Cited by 156
Supervising the New with the Old: Learning SFM from SFM
Klodt, M., & Vedaldi, A. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01249-6_43 · Cited by 147
GeoNet: Unsupervised Learning of Dense Depth, Optical Flow and Camera PosePreprint
Yin, Z., & Shi, J. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1803.02276 · Cited by 120
Unsupervised Learning of Geometry with Edge-aware Depth-Normal ConsistencyPreprint
Yang, Z., Wang, P., Xu, W. H., Zhao, L., & Nevatia, R. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1711.03665 · Cited by 104
Zhan, H., Garg, R., Weerasekera, C. S., et al. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1803.03893 · Cited by 85
Structured Adversarial Training for Unsupervised Monocular Depth Estimation
Mehta, I., Sakurikar, P., & Narayanan, P. J. (2018) · International Conference on 3D Vision (3DV) · doi:10.1109/3dv.2018.00044 · Cited by 53
Learning Monocular Depth by Distilling Cross-domain Stereo NetworksPreprint
Guo, X., Li, H., Yi, S., et al. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1808.06586 · Cited by 33
Guided Optical Flow LearningPreprint
Zhu, Y., Lan, Z., Newsam, S. D., & Hauptmann, A. G. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1702.02295 · Cited by 32
Every Pixel Counts ++: Joint Learning of Geometry and Motion with 3D Holistic UnderstandingPreprint
Luo, C., Yang, Z., Wang, P., et al. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1810.06125 · Cited by 29
Single View Stereo MatchingPreprint
Luo, Y. G., Ren, J., Lin, M., et al. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1803.02612 · Cited by 15
EdgeStereo: An Effective Multi-Task Learning Network for Stereo Matching and Edge DetectionPreprint
Song, X., Zhao, X., Fang, L., et al. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1903.01700 · Cited by 13
Learning monocular depth estimation infusing traditional stereo knowledgePreprint
Tosi, F., Aleotti, F., Poggi, M., et al. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1904.04144 · Cited by 13
Geometry meets semantics for semi-supervised monocular depth estimationPreprint
Ramirez, P. Z., Poggi, M., Tosi, F., Mattoccia, S., & Stefano, L. D. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1810.04093 · Cited by 9
Research works printed but not linked: 2
- kuznietsov, 2017, Semisupervised deep learning for monocular depth map prediction, CVPR
- 10.1109/CVPR.2016.438 · DOI · Paper page
Cited by
Sorted by citations
Digging Into Self-Supervised Monocular Depth Estimation
Godard, C., Aodha, O. M., Firman, M., & Brostow, G. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00393 · Cited by 2,561
Self-citationDeep learning for monocular depth estimation: A review
Ming, Y., Meng, X., Fan, C., & Yu, H. L. (2021) · Neurocomputing · doi:10.1016/j.neucom.2020.12.089 · Cited by 490
Monocular depth estimation based on deep learning: An overview
Zhao, C., Sun, Q., Zhang, C., Tang, Y. S., & Qian, F. (2020) · Science China Technological Sciences · doi:10.1007/s11431-020-1582-8 · Cited by 344
MonoViT: Self-Supervised Monocular Depth Estimation with a Vision Transformer
Zhao, C., Zhang, Y., Poggi, M., Tosi, F., Guo, X., Zhu, Z. D., Huang, G., Tang, Y. S., & Mattoccia, S. (2022) · International Conference on 3D Vision (3DV) · doi:10.1109/3dv57658.2022.00077 · Cited by 330
On the Uncertainty of Self-Supervised Monocular Depth Estimation
Poggi, M., Aleotti, F., Tosi, F., & Mattoccia, S. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00329 · Cited by 291
Metadata
- Authors
- Watson, J., Firman, M., Brostow, G., & Turmukhambetov, D.
- Affiliations
- University College London (GB)
- Venue
- 2019 IEEE/CVF International Conference on Computer Vision (ICCV)
- Publisher
- IEEE
- Published
- 2019-10
- Pages
- 2162-2171
- OpenAlex
- W2973531541
- Cited by
- 275
- References
- 46
- Citations by year
- 2026: 15 · 2025: 26 · 2024: 46 · 2023: 64 · 2022: 47 · 2021: 47 · 2020: 29 · 2019: 1
- FWCI
- 9.99
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- IEEE/CVF International Conference on Computer Vision (ICCV) (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- UCL Discovery (University College London) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Vision and Imaging
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Robotics and Sensor-Based Localization
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Keywords
- monocular depth estimation, self-supervised learning, depth discontinuities, thin structures, KITTI dataset
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
