The DOI matches its Crossref record; 45 of the 45 references it cites were found in a registry or an index.
Neural Window Fully-connected CRFs for Monocular Depth Estimation
Abstract
Estimating the accurate depth from a single image is challenging since it is inherently ambiguous and ill-posed. While recent works design increasingly complicated and powerful networks to directly regress the depth map, we take the path of CRFs optimization. Due to the expensive computation, CRFs are usually performed between neighborhoods rather than the whole graph. To leverage the potential of fully-connected CRFs, we split the input into windows and perform the FC-CRFs optimization within each window, which reduces the computation complexity and makes FC-CRFs feasible. To better capture the relationships between nodes in the graph, we exploit the multi-head attention mechanism to compute a multi-head potential function, which is fed to the networks to output an optimized depth map. Then we build a bottom-up-top-down structure, where this neural window FC-CRFs module serves as the decoder, and a vision transformer serves as the encoder. The experiments demonstrate that our method significantly improves the performance across all metrics on both the KITTI and NYUv2 datasets, compared to previous methods. Furthermore, the proposed method can be directly applied to panorama images and outperforms all previous panorama methods on the MatterPort3D dataset.11Project page: https://weihaosky.github.io/newcrfs
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Exploiting Generative AI to Scale up Intelligent Tutoring Systems
Jakubův, J., Chvalovský, K., Goertzel, Z., Kaliszyk, C., Olšák, M., Piotrowski, B., Schulz, S., Suda, M., & Urban, J. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.itp.2023.19 · Cited by 76,658
Swin Transformer: Hierarchical Vision Transformer using Shifted Windows
Liu, Z., Lin, Y., Cao, Y., Hu, H., Wei, Y., Zhang, Z., Lin, S., & Guo, B. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00986 · Cited by 35,534
Chen, L.-C., Papandreou, G., Kokkinos, I., Murphy, K., & Yuille, A. L. (2016) · arXiv · doi:10.48550/arxiv.1606.00915 · Cited by 22,392
Chen, L.-C., Papandreou, G., Kokkinos, I., Murphy, K., & Yuille, A. L. (2018) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2699184 · Cited by 22,392
Zhao, H., Shi, J., Qi, X., Wang, X., & Jia, J. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.660 · Cited by 16,438
Are we ready for autonomous driving? The KITTI vision benchmark suite
Geiger, A., Lenz, P., & Urtasun, R. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6248074 · Cited by 14,897
Indoor segmentation and support inference from rgbd images
Silberman, N., Hoiem, D., Kohli, P., & Fergus, R. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-33715-4_54 · Cited by 5,760
Depth Map Prediction from a Single Image using a Multi-Scale Deep Network
Eigen, D., Puhrsch, C., & Fergus, R. (2014) · arXiv · doi:10.48550/arxiv.1406.2283 · Cited by 3,442
Efficient Inference in Fully Connected CRFs with Gaussian Edge Potentials
Krähenbühl, P., & Koltun, V. (2012) · arXiv · doi:10.48550/arxiv.1210.5644 · Cited by 2,908
Vision Transformers for Dense Prediction
Ranftl, R., Bochkovskiy, A., & Koltun, V. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01196 · Cited by 2,373 · cited 3×
“Since the state-of-theart performance on NYUv2 dataset has been saturated for a while, some methods have begun to use additional data to pretrain the model and then finetune it on NYUv2 training set [10, 28].”
BackgroundMethodDeep Ordinal Regression Network for Monocular Depth Estimation
Fu, H., Gong, M., Wang, C., Batmanghelich, K., & Tao, D. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00214 · Cited by 1,991
Matterport3D: Learning from RGB-D Data in Indoor Environments
Chang, A., Dai, A., Funkhouser, T., Halber, M., Niebner, M., Savva, M., Song, S., Zeng, A., & Zhang, Y. (2017) · 2017 International Conference on 3D Vision (3DV) · doi:10.1109/3dv.2017.00081 · Cited by 1,858
Make3D: Learning 3D Scene Structure from a Single Still Image
Saxena, A., Sun, M., & Ng, A. Y. (2009) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2008.132 · Cited by 1,736
(2005) · Cited by 981
Deep convolutional neural fields for depth estimation from a single image
Liu, F., Shen, C., & Lin, G. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7299152 · Cited by 892
AdaBins: Depth Estimation Using Adaptive Bins
Farooq Bhat, S., Alhashim, I., & Wonka, P. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00400 · Cited by 726
Li, B., Shen, C., Dai, Y., van den Hengel, A., & He, M. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298715 · Cited by 590
From Big to Small: Multi-Scale Local Planar Guidance for Monocular Depth Estimation
Lee, J. H., Han, M.-K., Ko, D. W., & Suh, I. H. (2019) · arXiv · doi:10.48550/arxiv.1907.10326 · Cited by 507
Enforcing Geometric Constraints of Virtual Normal for Depth Prediction
Yin, W., Liu, Y., Shen, C., & Yan, Y. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00578 · Cited by 488
High speed obstacle avoidance using monocular vision and reinforcement learning
Michels, J., Saxena, A., & Ng, A. Y. (2005) · Proceedings of the 22nd international conference on Machine learning - ICML '05 · doi:10.1145/1102351.1102426 · Cited by 394
GeoNet: Geometric Neural Network for Joint Depth and Surface Normal Estimation
Qi, X., Liao, R., Liu, Z., Urtasun, R., & Jia, J. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00037 · Cited by 381
Self-supervised Monocular Depth Estimation: Solving the Dynamic Object Problem by Semantic Guidance
Klingner, M., Termöhlen, J.-A., Mikolajczyk, J., & Fingscheidt, T. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58565-5_35 · Cited by 358
Structured Attention Guided Convolutional Neural Fields for Monocular Depth Estimation
Xu, D., Wang, W., Tang, H., Liu, H., Sebe, N., & Ricci, E. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00412 · Cited by 348
Pattern-Affinitive Propagation Across Depth, Surface Normal and Semantic Segmentation
Zhang, Z., Cui, Z., Xu, C., Yan, Y., Sebe, N., & Yang, J. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00423 · Cited by 331
OmniDepth: Dense Depth Estimation for Indoors Spherical Panoramas
Zioulis, N., Karakottas, A., Zarpalas, D., & Daras, P. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01231-1_28 · Cited by 229
Guiding Monocular Depth Estimation Using Depth-Attention Volume
Huynh, L., Nguyen-Ha, P., Matas, J., Rahtu, E., & Heikkilä, J. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58574-7_35 · Cited by 200
BiFuse: Monocular 360 Depth Estimation via Bi-Projection Fusion
Wang, F.-E., Yeh, Y.-H., Sun, M., Chiu, W.-C., & Tsai, Y.-H. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00054 · Cited by 200
Distortion-Aware Convolutional Filters for Dense Prediction in Panoramic Images
Tateno, K., Navab, N., & Tombari, F. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01270-0_43 · Cited by 193
ViP-DeepLab: Learning Visual Perception with Depth-aware Video Panoptic Segmentation
Qiao, S., Zhu, Y., Adam, H., Yuille, A., & Chen, L.-C. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00399 · Cited by 188
HoHoNet: 360 Indoor Holistic Understanding with Latent Horizontal Features
Sun, C. J., Sun, M., & Chen, H.-T. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00260 · Cited by 155
UniFuse: Unidirectional Fusion for 360° Panorama Depth Estimation
Jiang, H., Sheng, Z., Zhu, S., Dong, Z., & Huang, R. (2021) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2021.3058957 · Cited by 133
Self-citationMonocular Depth Estimation Using Multi-Scale Continuous CRFs as Sequential Deep Networks
Xu, D., Ricci, E., Ouyang, W., Wang, X., & Sebe, N. (2018) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2839602 · Cited by 123
Pintore, G., Agus, M., Almansa, E., Schneider, J., & Gobbetti, E. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.01137 · Cited by 117
Patch-Wise Attention Network for Monocular Depth Estimation
Lee, S., Lee, J., Kim, B., Yi, E., & Kim, J. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i3.16282 · Cited by 90
Sparse Auxiliary Networks for Unified Monocular Depth Prediction and Completion
Guizilini, V., Ambruş, R., Burgard, W., & Gaidon, A. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.01093 · Cited by 78
Bidirectional Attention Network for Monocular Depth Estimation
Aich, S., Vianney, J. M. U., Islam, M. A., & Liu, M. K. B. (2021) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra48506.2021.9560885 · Cited by 78
SDNet: Semantically Guided Depth Estimation Network
Ochs, M., Kretz, A., & Mester, R. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-33676-9_20 · Cited by 58
Yuan, W., Hang, K., Kragic, D., Wang, M. Y., & Stork, J. A. (2019) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2019.06.007 · Cited by 54
Self-citationHMM-based surface reconstruction from single images
Nagai, T., Naruse, T., Ikehara, M., & Kurematsu, A. (2003) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2002.1040012 · Cited by 42
Depth estimation with convolutional conditional random field network
Yan, H., & Hu, T. H. (2016) · Neurocomputing · doi:10.1016/j.neucom.2016.06.029 · Cited by 34
Yuan, W., Hang, K., Song, H., Kragić, D., Wang, M. Y., & Stork, J. A. (2019) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2019.8794160 · Cited by 30
Self-citationDRO: Deep Recurrent Optimizer for Structure-from-Motion.Preprint
Gu, X., Yuan, W., Dai, Z., Zhu, S., Tang, C., & Tan, P. (2021) · arXiv (Cornell University) · Cited by 21
Self-citationStereo Matching by Self-supervision of Multiscopic Vision
Yuan, W., Zhang, Y., Wu, B., Zhu, S., Tan, P., Wang, M. Y., & Chen, Q. (2021) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros51168.2021.9636616 · Cited by 17
Self-citationA depth estimating method from a single image using FoE CRF
Wang, X., Hou, C., Pu, L., & Hou, Y. (2014) · Multimedia Tools and Applications · doi:10.1007/s11042-014-2130-z · Cited by 16
MFuseNet: Robust Depth Estimation With Learned Multiscopic Fusion
Yuan, W., Fan, R., Wang, M. Y., & Chen, Q. (2020) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2020.2974422 · Cited by 9
Self-citation
Cited by
Depth Anything: Unleashing the Power of Large-Scale Unlabeled Data
Yang, L., Kang, B., Huang, Z., Xu, X., Feng, J., & Zhao, H. (2024) · 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52733.2024.00987 · Cited by 1,296
Repurposing Diffusion-Based Image Generators for Monocular Depth Estimation
Ke, B., Obukhov, A., Huang, S., Metzger, N., Daudt, R. C., & Schindler, K. (2024) · 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52733.2024.00907 · Cited by 412
SurroundOcc: Multi-Camera 3D Occupancy Prediction for Autonomous Driving
Wei, Y., Zhao, L., Zheng, W., Zhu, Z., Zhou, J., & Lu, J. (2023) · 2023 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01986 · Cited by 260
MAMo: Leveraging Memory and Attention for Monocular Video Depth Estimation
Yasarla, R., Cai, H., Jeong, J., Shi, Y., Garrepalli, R., & Porikli, F. (2023) · 2023 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00804 · Cited by 15
Metadata
- Authors
- Yuan, W., Gu, X., Dai, Z., Zhu, S., & Tan, P.
- Venue
- 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
- Publisher
- IEEE
- Published
- 2022-06
- Pages
- 3906-3915
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W4312819733
- Cited by
- 361
- References
- 45
- FWCI
- 30.32
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.