The DOI matches its Crossref record; 110 of the 110 references it cites were found in a registry or an index.
Metric3D v2: A Versatile Monocular Geometric Foundation Model for Zero-Shot Metric Depth and Surface Normal Estimation
Open accessAbstract
We introduce Metric3D v2, a geometric foundation model designed for zero-shot metric depth and surface normal estimation from single images, critical for accurate 3D recovery. Depth and normal estimation, though complementary, present distinct challenges. State-of-the-art monocular depth methods achieve zero-shot generalization through affine-invariant depths, but fail to recover real-world metric scale. Conversely, current normal estimation techniques struggle with zero-shot performance due to insufficient labeled data. We propose targeted solutions for both metric depth and normal estimation. For metric depth, we present a canonical camera space transformation module that resolves metric ambiguity across various camera models and large-scale datasets, which can be easily integrated into existing monocular models. For surface normal estimation, we introduce a joint depth-normal optimization module that leverages diverse data from metric depth, allowing normal estimators to improve beyond traditional labels. Our model, trained on over 16 million images from thousands of camera models with varied annotations, excels in zero-shot generalization to new camera settings. As shown in Fig. 1, It ranks the 1st in multiple zero-shot and standard benchmarks for metric depth and surface normal prediction. Our method enables the accurate recovery of metric 3D structures on randomly collected internet images, paving the way for plausible single-image metrology. Our model also relieves the scale drift issues of monocular-SLAM (Fig. 3), leading to high-quality metric scale dense mapping. Such applications highlight the versatility of Metric3D v2 models as geometric foundation models.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
High-Resolution Image Synthesis with Latent Diffusion Models
Rombach, R., Blattmann, A., Lorenz, D., Esser, P., & Ommer, B. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01042 · Cited by 20,302
Learning Transferable Visual Models From Natural Language Supervision
Radford, A., Kim, J. W., Hallacy, C., Ramesh, A., Goh, G., Agarwal, S., Sastry, G., Askell, A., Mishkin, P., Clark, J., et al. (2021) · arXiv · doi:10.48550/arxiv.2103.00020 · Cited by 15,293
Are we ready for autonomous driving? The KITTI vision benchmark suite
Geiger, A., Lenz, P., & Urtasun, R. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6248074 · Cited by 14,897
Aggregated Residual Transformations for Deep Neural Networks
Xie, S., Girshick, R., Dollar, P., Tu, Z., & He, K. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.634 · Cited by 12,465
The Cityscapes Dataset for Semantic Urban Scene Understanding
Cordts, M., Omran, M., Ramos, S., Rehfeld, T., Enzweiler, M., Benenson, R., Franke, U., Roth, S., & Schiele, B. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.350 · Cited by 12,433
Vision meets robotics: The KITTI dataset
Geiger, A., Lenz, P., Stiller, C., & Urtasun, R. (2013) · The International Journal of Robotics Research · doi:10.1177/0278364913491297 · Cited by 9,913
Liu, Z., Mao, H., Wu, C.-Y., Feichtenhofer, C., Darrell, T., & Xie, S. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01167 · Cited by 8,494
nuScenes: A Multimodal Dataset for Autonomous Driving
Caesar, H., Bankiti, V., Lang, A. H., Vora, S., Liong, V. E., Xu, Q., Krishnan, A., Pan, Y., Baldan, G., & Beijbom, O. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01164 · Cited by 7,152 · cited 1×
“Evaluation details for monocular depth and normal estimation: a) To demonstrate the robustness of our metric depth estimation method, we evaluate on 7 zero-shot benchmarks, including NYUv2, KITTI [107], ScanNet [108], NuScenes [109], iBIMS-1 [110], and DIODE [111] (both indoor and outdoor).”
ORB-SLAM2: An Open-Source SLAM System for Monocular, Stereo, and RGB-D Cameras
Mur-Artal, R., & Tardos, J. D. (2017) · IEEE Transactions on Robotics · doi:10.1109/tro.2017.2705103 · Cited by 6,898 · cited 1×
“These unique attributes render both depth and surface normals indispensable in various computer vision applications, including 3D reconstruction [1], [2], [3], neural rendering (NeRF) [4], [5], [6], [7], autonomous driving [8], [9], [10], and robotics [11], [12], [13].”
Indoor segmentation and support inference from rgbd images
Silberman, N., Hoiem, D., Kohli, P., & Fergus, R. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-33715-4_54 · Cited by 5,760
ScanNet: Richly-Annotated 3D Reconstructions of Indoor Scenes
Dai, A., Chang, A. X., Savva, M., Halber, M., Funkhouser, T., & Niessner, M. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.261 · Cited by 4,368
Scalability in Perception for Autonomous Driving: Waymo Open Dataset
Sun, P., Kretzschmar, H., Dotiwalla, X., Chouard, A., Patnaik, V., Tsui, P., Guo, J., Zhou, Y., Chai, Y., Caine, B., et al. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00252 · Cited by 3,437
Eigen, D., & Fergus, R. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.304 · Cited by 2,862
(2020) · doi:10.1007/978-3-030-58536-5_24 · Cited by 2,824
Occupancy Networks: Learning 3D Reconstruction in Function Space
Mescheder, L., Oechsle, M., Niemeyer, M., Nowozin, S., & Geiger, A. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00459 · Cited by 2,708
PWC-Net: CNNs for Optical Flow Using Pyramid, Warping, and Cost Volume
Sun, D., Yang, X., Liu, M.-Y., & Kautz, J. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00931 · Cited by 2,648
Vision Transformers for Dense Prediction
Ranftl, R., Bochkovskiy, A., & Koltun, V. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01196 · Cited by 2,373 · cited 5×
“Existing depth estimation methods are categorized into learning metric depth [17], [18], [19], [20], relative depth [21], [22], [23], [24], and affine-invariant depth [25], [26], [27], [28], [29].”
InfluentialPixelwise View Selection for Unstructured Multi-View Stereo
Schönberger, J. L., Zheng, E., Frahm, J.-M., & Pollefeys, M. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46487-9_31 · Cited by 2,315
Deeper Depth Prediction with Fully Convolutional Residual Networks
Laina, I., Rupprecht, C., Belagiannis, V., Tombari, F., & Navab, N. (2016) · 2016 Fourth International Conference on 3D Vision (3DV) · doi:10.1109/3dv.2016.32 · Cited by 1,982
Make3D: Learning 3D Scene Structure from a Single Still Image
Saxena, A., Sun, M., & Ng, A. Y. (2009) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2008.132 · Cited by 1,736
Tanks and temples: benchmarking large-scale scene reconstruction
Knapitsch, A., Park, J., Zhou, Q.-Y., & Koltun, V. (2017) · ACM Transactions on Graphics · doi:10.1145/3072959.3073599 · Cited by 1,707
Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-Shot Cross-Dataset Transfer
Ranftl, R., Lasinger, K., Hafner, D., Schindler, K., & Koltun, V. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.3019967 · Cited by 1,618
Pixel2Mesh: Generating 3D Mesh Models from Single RGB Images
Wang, N., Zhang, Y., Li, Z., Fu, Y., Liu, W., & Jiang, Y.-G. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01252-6_4 · Cited by 1,306
Depth Anything: Unleashing the Power of Large-Scale Unlabeled Data
Yang, L., Kang, B., Huang, Z., Xu, X., Feng, J., & Zhao, H. (2024) · 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52733.2024.00987 · Cited by 1,296
GeoNet: Unsupervised Learning of Dense Depth, Optical Flow and Camera Pose
Yin, Z., & Shi, J. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00212 · Cited by 1,256
PIFu: Pixel-Aligned Implicit Function for High-Resolution Clothed Human Digitization
Saito, S., Huang, Z., Natsume, R., Morishima, S., Li, H., & Kanazawa, A. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00239 · Cited by 1,228
Taskonomy: Disentangling Task Transfer Learning
Zamir, A. R., Sax, A., Shen, W., Guibas, L., Malik, J., & Savarese, S. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00391 · Cited by 1,128
A Multi-view Stereo Benchmark with High-Resolution Images and Multi-camera Videos
Schops, T., Schonberger, J. L., Galliani, S., Sattler, T., Schindler, K., Pollefeys, M., & Geiger, A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.272 · Cited by 915
Zhai, X., Kolesnikov, A., Houlsby, N., & Beyer, L. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01179 · Cited by 891
Depth-supervised NeRF: Fewer Views and Faster Training for Free
Deng, K., Liu, A., Zhu, J.-Y., & Ramanan, D. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01254 · Cited by 841
PIFuHD: Multi-Level Pixel-Aligned Implicit Function for High-Resolution 3D Human Digitization
Saito, S., Simon, T., Saragih, J., & Joo, H. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00016 · Cited by 793
BEVDepth: Acquisition of Reliable Depth for Multi-View 3D Object Detection
Li, Y., Ge, Z., Yu, G., Yang, J., Wang, Z., Shi, Y., Sun, J., & Li, Z. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i2.25233 · Cited by 769
Self-citation3D Packing for Self-Supervised Monocular Depth Estimation
Guizilini, V., Ambrus, R., Pillai, S., Raventos, A., & Gaidon, A. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00256 · Cited by 741
High-Resolution Image Synthesis with Latent Diffusion Models
Rombach, R., Blattmann, A., Lorenz, D., Esser, P., & Ommer, B. (2021) · arXiv · doi:10.48550/arxiv.2112.10752 · Cited by 737
AdaBins: Depth Estimation Using Adaptive Bins
Farooq Bhat, S., Alhashim, I., & Wonka, P. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00400 · Cited by 726
Shape, Illumination, and Reflectance from Shading
Barron, J. T., & Malik, J. (2015) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2014.2377712 · Cited by 656
Li, B., Shen, C., Dai, Y., van den Hengel, A., & He, M. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298715 · Cited by 590
Self-citationRAFT-Stereo: Multilevel Recurrent Field Transforms for Stereo Matching
Lipson, L., Teed, Z., & Deng, J. (2021) · 2021 International Conference on 3D Vision (3DV) · doi:10.1109/3dv53792.2021.00032 · Cited by 536
From Big to Small: Multi-Scale Local Planar Guidance for Monocular Depth Estimation
Lee, J. H., Han, M.-K., Ko, D. W., & Suh, I. H. (2019) · arXiv · doi:10.48550/arxiv.1907.10326 · Cited by 507
Efficient Surfel-Based SLAM using 3D Laser Range Data in Urban Environments
Behley, J., & Stachniss, C. (2018) · Robotics: Science and Systems XIV · doi:10.15607/rss.2018.xiv.016 · Cited by 494
Enforcing Geometric Constraints of Virtual Normal for Depth Prediction
Yin, W., Liu, Y., Shen, C., & Yan, Y. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00578 · Cited by 488
Self-citationDSEC: A Stereo Event Camera Dataset for Driving Scenarios
Gehrig, M., Aarents, W., Gehrig, D., & Scaramuzza, D. (2021) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2021.3068942 · Cited by 428
Repurposing Diffusion-Based Image Generators for Monocular Depth Estimation
Ke, B., Obukhov, A., Huang, S., Metzger, N., Daudt, R. C., & Schindler, K. (2024) · 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52733.2024.00907 · Cited by 412
BAD SLAM: Bundle Adjusted Direct RGB-D SLAM
Schops, T., Sattler, T., & Pollefeys, M. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00022 · Cited by 383
GeoNet: Geometric Neural Network for Joint Depth and Surface Normal Estimation
Qi, X., Liao, R., Liu, Z., Urtasun, R., & Jia, J. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00037 · Cited by 381
Hypersim: A Photorealistic Synthetic Dataset for Holistic Indoor Scene Understanding
Roberts, M., Ramapuram, J., Ranjan, A., Kumar, A., Bautista, M. A., Paczan, N., Webb, R., & Susskind, J. M. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01073 · Cited by 358
Dense Depth Priors for Neural Radiance Fields from Sparse Input Views
Roessle, B., Barron, J. T., Mildenhall, B., Srinivasan, P. P., & Niebner, M. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01255 · Cited by 358
Depth Estimation via Affinity Learned with Convolutional Spatial Propagation Network
Cheng, X., Wang, P., & Yang, R. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01270-0_7 · Cited by 357
Non-local Spatial Propagation Network for Depth Completion
Park, J., Joo, K., Hu, Z., Liu, C.-K., & So Kweon, I. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58601-0_8 · Cited by 354
Iterative Geometry Encoding Volume for Stereo Matching
Xu, G., Wang, X., Ding, X., & Yang, X. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52729.2023.02099 · Cited by 349
Designing deep networks for surface normal estimation
Wang, X., Fouhey, D. F., & Gupta, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298652 · Cited by 338
PENet: Towards Precise and Efficient Image Guided Depth Completion
Hu, M., Wang, S., Li, B., Ning, S., Fan, L., & Gong, X. (2021) · 2021 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra48506.2021.9561035 · Cited by 338
Self-citationPattern-Affinitive Propagation Across Depth, Surface Normal and Semantic Segmentation
Zhang, Z., Cui, Z., Xu, C., Yan, Y., Sebe, N., & Yang, J. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00423 · Cited by 331
Omnidata: A Scalable Pipeline for Making Multi-Task Mid-Level Vision Datasets from 3D Scans
Eftekhar, A., Sax, A., Malik, J., & Zamir, A. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01061 · Cited by 258
A Two-Streamed Network for Estimating Fine-Scaled Depth Maps from Single RGB Images
Li, J., Klein, R., & Yao, A. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.365 · Cited by 250
PandaSet: Advanced Sensor Suite Dataset for Autonomous Driving
Xiao, P., Shao, Z., Hao, S., Zhang, Z., Chai, X., Jiao, J., Li, Z., Wu, J., Sun, K., Jiang, K., et al. (2021) · 2021 IEEE International Intelligent Transportation Systems Conference (ITSC) · doi:10.1109/itsc48978.2021.9565009 · Cited by 250
Unifying Flow, Stereo and Depth Estimation
Xu, H., Zhang, J., Cai, J., Rezatofighi, H., Yu, F., Tao, D., & Geiger, A. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3298645 · Cited by 245
ZoeDepth: Zero-shot Transfer by Combining Relative and Metric Depth
Bhat, S. F., Birkl, R., Wofk, D., Wonka, P., & Müller, M. (2023) · arXiv · doi:10.48550/arxiv.2302.12288 · Cited by 242 · cited 6×
“We present visualization results of our predictions (‘Ours Depth’/‘Ours Normal’), groundtruth labels (‘GT Depth’/‘GT Normal’) and results from other metric depth (‘ZoeDepth’[36]) and surface normal methods (‘Bae et al.’”
InfluentialDrivingStereo: A Large-Scale Dataset for Stereo Matching in Autonomous Driving Scenarios
Yang, G., Song, X., Huang, C., Deng, Z., Shi, J., & Zhou, B. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00099 · Cited by 237
Learning to Recover 3D Scene Shape from a Single Image
Yin, W., Zhang, J., Wang, O., Niklaus, S., Mai, L., Chen, S., & Shen, C. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00027 · Cited by 218
Self-citationMonocular Relative Depth Perception with Web Stereo Data Supervision
Xian, K., Shen, C., Cao, Z., Lu, H., Xiao, Y., Li, R., & Luo, Z. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00040 · Cited by 215
Self-citationMarr Revisited: 2D-3D Alignment via Surface Normal Prediction
Bansal, A., Russell, B., & Gupta, A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.642 · Cited by 213
Transformer-Based Attention Networks for Continuous Pixel-Wise Prediction
Yang, G., Tang, H., Ding, M., Sebe, N., & Ricci, E. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01596 · Cited by 210
Learning Monocular Depth by Distilling Cross-Domain Stereo Networks
Guo, X., Li, H., Yi, S., Ren, J., & Wang, X. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01252-6_30 · Cited by 208
Evaluation of CNN-Based Single-Image Depth Estimation Methods
Koch, T., Liebel, L., Fraundorfer, F., & Körner, M. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-11015-4_25 · Cited by 199
UniDepth: Universal Monocular Metric Depth Estimation
Piccinelli, L., Yang, Y.-H., Sakaridis, C., Segu, M., Li, S., Gool, L. V., & Yu, F. (2024) · 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52733.2024.00963 · Cited by 199
Structure-Guided Ranking Loss for Single Image Depth Prediction
Xian, K., Zhang, J., Wang, O., Mai, L., Lin, Z., & Cao, Z. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00069 · Cited by 192
3D Common Corruptions and Data Augmentation
Kar, O. F., Yeo, T., Atanov, A., & Zamir, A. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01839 · Cited by 191
Fan, R., Wang, H., Cai, P., & Liu, M. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58577-8_21 · Cited by 179
Dense 3D Object Reconstruction from a Single Depth View
Yang, B., Rosa, S., Markham, A., Trigoni, N., & Wen, H. (2018) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2868195 · Cited by 176
Learning Shape Priors for Single-View 3D Completion And Reconstruction
Wu, J., Zhang, C., Zhang, X., Zhang, Z., Freeman, W. T., & Tenenbaum, J. B. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01252-6_40 · Cited by 175
Self-citationMSeg: A Composite Dataset for Multi-Domain Semantic Segmentation
Lambert, J., Liu, Z., Sener, O., Hays, J., & Koltun, V. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00295 · Cited by 171
Robust Consistent Video Depth Estimation
Kopf, J., Rong, X., & Huang, J.-B. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00166 · Cited by 167
Rethinking Inductive Biases for Surface Normal Estimation
Bae, G., & Davison, A. J. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00911 · Cited by 166
Estimating and Exploiting the Aleatoric Uncertainty in Surface Normal Estimation
Bae, G., Budvytis, I., & Cipolla, R. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01289 · Cited by 165
SimpleRecon: 3D Reconstruction Without 3D Convolutions
Sayed, M., Gibson, J., Watson, J., Prisacariu, V. A., Firman, M., & Godard, C. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-19827-4_1 · Cited by 154
FB-BEV: BEV Representation from Forward-Backward View Transformations
Li, Z., Yu, Z., Wang, W., Anandkumar, A., Lü, T., & Álvarez, J. M. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00637 · Cited by 152
A Perceptual Measure for Deep Single Image Camera Calibration
Hold-Geoffroy, Y., Sunkavalli, K., Eisenmann, J., Fisher, M., Gambaretto, E., Hadap, S., & Lalonde, J. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00250 · Cited by 149
Discriminatively Trained Dense Surface Normal Estimation
Ladický, Ľ., Zeisl, B., & Pollefeys, M. (2014) · Lecture notes in computer science · doi:10.1007/978-3-319-10602-1_31 · Cited by 136
NeuRIS: Neural Reconstruction of Indoor Scenes Using Normal Priors
Wang, J., Wang, P., Long, X., Theobalt, C., Komura, T., Liu, L., & Wang, W. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-19824-3_9 · Cited by 133
Self-citationCAM-Convs: Camera-Aware Multi-Scale Convolutions for Single-View Depth
Facil, J. M., Ummenhofer, B., Zhou, H., Montesano, L., Brox, T., & Civera, J. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.01210 · Cited by 130 · cited 2×
“Additionally, we compared our approach with CamConvs [38], which incorporates the camera model in the decoder using a 4-channel feature.”
Auto-Rectify Network for Unsupervised Indoor Depth Estimation
Bian, J.-W., Zhan, H., Wang, N., Chin, T.-J., Shen, C., & Reid, I. D. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3136220 · Cited by 126
Self-citationTowards Zero-Shot Scale-Aware Monocular Depth Estimation
Guizilini, V., Vasiljevic, I., Chen, D., Ambruş, R., & Gaidon, A. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00847 · Cited by 122
Habitat-Matterport 3D Dataset (HM3D): 1000 Large-scale 3D Environments for Embodied AI
Ramakrishnan, S. K., Gokaslan, A., Wijmans, E., Maksymets, O., Clegg, A., Turner, J., Undersander, E., Galuba, W., Westbury, A., Chang, A. X., et al. (2021) · arXiv · doi:10.48550/arxiv.2109.08238 · Cited by 106
Virtual Normal: Enforcing Geometric Constraints for Accurate and Robust Depth Prediction
Yin, W., Liu, Y., & Shen, C. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3097396 · Cited by 105
Self-citationDeep Iterative Surface Normal Estimation
Lenssen, J. E., Osendorfer, C., & Masci, J. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.01126 · Cited by 103
Real-time Scalable Dense Surfel Mapping
Wang, K., Gao, F., & Shen, S. (2019) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2019.8794101 · Cited by 95
Self-citationQi, X., Liu, Z., Liao, R., Torr, P. H. S., Urtasun, R., & Jia, J. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.3020800 · Cited by 94
Adaptive Surface Normal Constraint for Depth Estimation
Long, X., Lin, C. C., Liu, L., Li, W., Theobalt, C., Yang, R., & Wang, W. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01261 · Cited by 92
Self-citationHigh Accuracy Monocular SFM and Scale Correction for Autonomous Driving
Song, S., Chandraker, M. K., & Guest, C. C. (2015) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2015.2469274 · Cited by 87
Unfolding an Indoor Origami World
Fouhey, D. F., Gupta, A., & Hebert, M. (2014) · Lecture notes in computer science · doi:10.1007/978-3-319-10599-4_44 · Cited by 85
Spherical Regression: Learning Viewpoints, Surface Normals and 3D Rotations on N-Spheres
Liao, S., Gavves, E., & Snoek, C. G. M. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00999 · Cited by 80
Towards Accurate Reconstruction of 3D Scene Shape From A Single Monocular Image
Yin, W., Zhang, J., Wang, O., Niklaus, S., Chen, S., Liu, Y., & Shen, C. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3209968 · Cited by 66
Self-citationFrameNet: Learning Local Canonical Frames of 3D Surfaces From a Single RGB Image
Huang, J., Zhou, Y., Funkhouser, T. A., & Guibas, L. J. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00873 · Cited by 62
H$_{2}$-Mapping: Real-Time Dense Mapping Using Hierarchical Hybrid Representation
Jiang, C., Zhang, H., Liu, P., Yu, Z., Cheng, H., Zhou, B., & Shen, S. (2023) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2023.3313051 · Cited by 58
Self-citationOASIS: A Large-Scale Dataset for Single Image 3D in the Wild
Chen, W., Qian, S., Fan, D., Kojima, N., Hamilton, M., & Deng, J. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00076 · Cited by 57
Surface Normal Estimation of Tilted Images via Spatial Rectifier
Do, T., Vuong, K., Roumeliotis, S. I., & Park, H. S. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58548-8_16 · Cited by 56
Generalizing to the Open World: Deep Visual Odometry with Online Adaptation
Li, S., Wu, X., Cao, Y., & Zha, H. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.01298 · Cited by 54
VPLNet: Deep Single View Normal Estimation With Vanishing Points and Lines
Wang, R., Geraghty, D., Matzen, K., Szeliski, R., & Frahm, J. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00077 · Cited by 52
Chen, W., Xiang, D., & Deng, J. (2017) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.173 · Cited by 44
Multiview Stereo with Cascaded Epipolar RAFT
Ma, Z., Teed, Z., & Deng, J. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-19821-2_42 · Cited by 43
Improving Monocular Visual Odometry Using Learned Depth
Sun, L., Yin, W., Xie, E., Li, Z., Sun, C., & Shen, C. (2022) · IEEE Transactions on Robotics · doi:10.1109/tro.2022.3164834 · Cited by 42
Self-citationMapillary Planet-Scale Depth Dataset
López-Antequera, M., Gargallo, P., Hofinger, M., Bulò, S. R., Kuang, Y., & Kontschieder, P. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58536-5_35 · Cited by 36
PolyMaX: General Dense Prediction with Mask Transformer
Yang, X., Yuan, L., Wilber, M. J., Sharma, A., Gu, X., Qiao, S., Debats, S. R., Wang, H., Adam, H., Sirotenko, M., et al. (2024) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv57701.2024.00109 · Cited by 36
Learning Optical Flow and Scene Flow With Bidirectional Camera-LiDAR Fusion
Liu, H., Lu, T., Xu, Y., Liu, J., & Wang, L. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3330866 · Cited by 35
Adaptive Surface Normal Constraint for Geometric Estimation From Monocular Images
Long, X., Zheng, Y., Zheng, Y., Tian, B., Lin, C. C., Liu, L., Zhao, H., Zhou, G., & Wang, W. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3381710 · Cited by 23
Self-citationUASOL, a large-scale high-resolution outdoor stereo dataset
Bauer, Z., Gomez‐Donoso, F., Cruz, E., Orts‐Escolano, S., & Cazorla, M. (2019) · Scientific Data · doi:10.1038/s41597-019-0168-5 · Cited by 19
A Confidence-based Iterative Solver of Depths and Surface Normals for Deep Multi-view Stereo
Zhao, W., Liu, S., Wei, Y., Guo, H., & Liu, Y. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00611 · Cited by 16
DG-Recon: Depth-Guided Neural 3D Scene Reconstruction
Ju, J., Tseng, C.-W., Bailo, O., Dikov, G., & Ghafoorian, M. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01667 · Cited by 16
Robust Geometry-Preserving Depth Estimation Using Differentiable Rendering
Zhang, C., Yin, W., Yu, G., Wang, Z., Chen, T., Fu, B., Zhou, J. T., & Shen, C. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00822 · Cited by 7
Self-citation
Metadata
- Authors
- Hu, M., Yin, W., Zhang, C., Cai, Z., Long, X., Chen, H., Wang, K., Yu, G., Shen, C., & Shen, S.
- Venue
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- Published
- 2024-12
- Volume
- 46
- Issue
- 12
- Pages
- 10579-10596
- ISSN
- 0162-8828 (ISSN-L)
- 2160-9292
- 1939-3539
- OpenAlex
- W4395481595
- Cited by
- 260
- References
- 110
- FWCI
- 36.73
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.