The DOI matches its DataCite record; 99 of the 105 references it cites were found in a registry or an index.
Learning Depth with Convolutional Spatial Propagation Network
Open accessAbstract
Depth prediction is one of the fundamental problems in computer vision. In this paper, we propose a simple yet effective convolutional spatial propagation network (CSPN) to learn the affinity matrix for various depth estimation tasks. Specifically, it is an efficient linear propagation model, in which the propagation is performed with a manner of recurrent convolutional operation, and the affinity among neighboring pixels is learned through a deep convolutional neural network (CNN). We can append this module to any output from a state-of-the-art (SOTA) depth estimation networks to improve their performances. In practice, we further extend CSPN in two aspects: 1) take sparse depth map as additional input, which is useful for the task of depth completion; 2) similar to commonly used 3D convolution operation in CNNs, we propose 3D CSPN to handle features with one additional dimension, which is effective in the task of stereo matching using 3D cost volume. For the tasks of sparse to dense, a.k.a depth completion. We experimented the proposed CPSN conjunct algorithms over the popular NYU v2 and KITTI datasets, where we show that our proposed algorithms not only produce high quality (e.g., 30% more reduction in depth error), but also run faster (e.g., 2 to 5x faster) than previous SOTA spatial propagation network. We also evaluated our stereo matching algorithm on the Scene Flow and KITTI Stereo datasets, and rank 1st on both the KITTI Stereo 2012 and 2015 benchmarks, which demonstrates the effectiveness of the proposed module. The code of CSPN proposed in this work will be released at https://github.com/XinJCheng/CSPN.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“Traditional methods often use euclidean clustering [160] or region-growing methods [161] for grouping points into objects.”
From A Survey of Autonomous Driving: Common Practices and Emerging Technologies (2020) · cites this paper as [160]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
U-Net: Convolutional Networks for Biomedical Image Segmentation
Ronneberger, O., Fischer, P., & Brox, T. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24574-4_28 · Cited by 99,404
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
Fully convolutional networks for semantic segmentation
Long, J., Shelhamer, E., & Darrell, T. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298965 · Cited by 38,834
Chen, L.-C., Papandreou, G., Kokkinos, I., Murphy, K., & Yuille, A. L. (2018) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2699184 · Cited by 22,392
Zhao, H., Shi, J., Qi, X., Wang, X., & Jia, J. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.660 · Cited by 16,438
Normalized cuts and image segmentation
Shi, J., & Malik, J. (2000) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.868688 · Cited by 15,935
Are we ready for autonomous driving? The KITTI vision benchmark suite
Geiger, A., Lenz, P., & Urtasun, R. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6248074 · Cited by 14,897
Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2015) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2015.2389824 · Cited by 11,971
Rethinking Atrous Convolution for Semantic Image Segmentation
Chen, L.-C., Papandreou, G., Schroff, F., & Adam, H. (2017) · arXiv · doi:10.48550/arxiv.1706.05587 · Cited by 7,517
A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms
Scharstein, D., & Szeliski, R. (2002) · International Journal of Computer Vision · doi:10.1023/a:1014573219977 · Cited by 6,740
Factor graphs and the sum-product algorithm
Kschischang, F. R., Frey, B. J., & Loeliger, H.-A. (2001) · IEEE Transactions on Information Theory · doi:10.1109/18.910572 · Cited by 6,486 · cited 3×
“In principal, CSPN could also be derived from meanfield approximation for solving a special type of locally connected conditional random field (CRF) model [91], where we rely the long range dependency on the propagation and”
BackgroundMethodInfluentialLearning a Deep Convolutional Network for Image Super-Resolution
Dong, C., Loy, C. C., He, K., & Tang, X. (2014) · Lecture notes in computer science · doi:10.1007/978-3-319-10593-2_13 · Cited by 5,910
Indoor segmentation and support inference from rgbd images
Silberman, N., Hoiem, D., Kohli, P., & Fergus, R. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-33715-4_54 · Cited by 5,760
Stacked Hourglass Networks for Human Pose Estimation
Newell, A., Yang, K., & Deng, J. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46484-8_29 · Cited by 5,634
Stereo Processing by Semiglobal Matching and Mutual Information
Hirschmüller, H. (2007) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2007.1166 · Cited by 4,199
Unsupervised Monocular Depth Estimation with Left-Right Consistency
Godard, C., Aodha, O. M., & Brostow, G. J. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.699 · Cited by 3,270
FlowNet 2.0: Evolution of Optical Flow Estimation with Deep Networks
Ilg, E., Mayer, N., Saikia, T., Keuper, M., Dosovitskiy, A., & Brox, T. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.179 · Cited by 3,177
Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10578-9_23 · Cited by 3,034
Unsupervised Learning of Depth and Ego-Motion from Video
Zhou, T., Brown, M., Snavely, N., & Lowe, D. G. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.700 · Cited by 2,910
Efficient Inference in Fully Connected CRFs with Gaussian Edge Potentials
Krähenbühl, P., & Koltun, V. (2012) · arXiv · doi:10.48550/arxiv.1210.5644 · Cited by 2,908
Eigen, D., & Fergus, R. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.304 · Cited by 2,862
PWC-Net: CNNs for Optical Flow Using Pyramid, Warping, and Cost Volume
Sun, D., Yang, X., Liu, M.-Y., & Kautz, J. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00931 · Cited by 2,801
Mayer, N., Ilg, E., Hausser, P., Fischer, P., Cremers, D., Dosovitskiy, A., & Brox, T. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.438 · Cited by 2,488
Anisotropic diffusion in image processing
Weickert, J. (1998) · Cited by 2,230
Deeper Depth Prediction with Fully Convolutional Residual Networks
Laina, I., Rupprecht, C., Belagiannis, V., Tombari, F., & Navab, N. (2016) · International Conference on 3D Vision (3DV) · doi:10.1109/3dv.2016.32 · Cited by 2,105
Deep Ordinal Regression Network for Monocular Depth Estimation
Fu, H., Gong, M., Wang, C., Batmanghelich, K., & Tao, D. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00214 · Cited by 1,991
Pyramid Stereo Matching Network
Chang, J.-R., & Chen, Y. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00567 · Cited by 1,931
DeepDriving: Learning Affordance for Direct Perception in Autonomous Driving
Chen, C., Seff, A., Kornhauser, A., & Xiao, J. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.312 · Cited by 1,876
Matterport3D: Learning from RGB-D Data in Indoor Environments
Chang, A., Dai, A., Funkhouser, T., Halber, M., Niebner, M., Savva, M., Song, S., Zeng, A., & Zhang, Y. (2017) · 2017 International Conference on 3D Vision (3DV) · doi:10.1109/3dv.2017.00081 · Cited by 1,858
End-to-End Learning of Geometry and Context for Deep Stereo Regression
Kendall, A., Martirosyan, H., Dasgupta, S., Henry, P., Kennedy, R., Bachrach, A., & Bry, A. (2017) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.17 · Cited by 1,531
Attention to Scale: Scale-Aware Semantic Image Segmentation
Chen, L.-C., Yang, Y., Wang, J., Xu, W., & Yuille, A. (2016) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2016.396 · Cited by 1,453
Mayer, N., Ilg, E., Cremers, D., Dosovitskiy, A., & Brox, T. (2016) · Cited by 1,214
ParseNet: Looking Wider to See BetterPreprint
Liu, W., Rabinovich, A., & Berg, A. C. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1506.04579 · Cited by 1,056
Stereo Matching by Training a Convolutional Neural Network to Compare Image PatchesPreprint
ŽbontarJure, & LeCunYann (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1510.05970 · Cited by 1,019
Uhrig, J., Schneider, N., Schneider, L., Franke, U., Brox, T., & Geiger, A. (2017) · 2017 International Conference on 3D Vision (3DV) · doi:10.1109/3dv.2017.00012 · Cited by 924
Deep convolutional neural fields for depth estimation from a single image
Liu, F., Shen, C., & Lin, G. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7299152 · Cited by 892
SUN3D: A Database of Big Spaces Reconstructed Using SfM and Object Labels
Xiao, J., Owens, A., & Torralba, A. B. (2013) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2013.458 · Cited by 805
Efficient Deep Learning for Stereo Matching
Luo, W., Schwing, A. G., & Urtasun, R. (2016) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2016.614 · Cited by 764
Semi-Supervised Deep Learning for Monocular Depth Map Prediction
Kuznietsov, Y., Stuckler, J., & Leibe, B. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.238 · Cited by 680
As-rigid-as-possible shape manipulation
Igarashi, T., Moscovich, T., & Hughes, J. F. (2005) · ACM Transactions on Graphics · doi:10.1145/1073204.1073323 · Cited by 675
Sparse-to-Dense: Depth Prediction from Sparse Depth Samples and a Single Image
Ma, F., & Karaman, S. (2018) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2018.8460184 · Cited by 668
Li, B., Shen, C., Dai, Y., van den Hengel, A., & He, M. (2015) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2015.7298715 · Cited by 621
The ApolloScape Open Dataset for Autonomous Driving and Its Application
Huang, X., Wang, P., Cheng, X., Zhou, D., Geng, Q., & Yang, R. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2926463 · Cited by 615
Self-citationXu, D., Ouyang, W., Wang, X., & Sebe, N. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00077 · Cited by 551
Image Guided Depth Upsampling Using Anisotropic Total Generalized Variation
Ferstl, D., Reinbacher, C., Ranftl, R., Rüther, M., & Bischof, H. (2013) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2013.127 · Cited by 535
Multi-scale Continuous CRFs as Sequential Deep Networks for Monocular Depth Estimation
Xu, D., Ricci, E., Ouyang, W., Wang, X., & Sebe, N. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.25 · Cited by 484
3D Graph Neural Networks for RGBD Semantic Segmentation
Qi, X., Liao, R., Jia, J., Fidler, S., & Urtasun, R. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.556 · Cited by 482
Self-Supervised Sparse-to-Dense: Self-Supervised Depth Completion from LiDAR and Monocular Camera
Ma, F., Cavalheiro, G. V., & Karaman, S. (2019) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2019.8793637 · Cited by 472
Towards unified depth and semantic prediction from a single image
Wang, P., Shen, X., Lin, Z., Cohen, S. D., Price, B. L., & Yuille, A. (2015) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2015.7298897 · Cited by 455
Self-citationIntel(R) RealSense(TM) Stereoscopic Depth Cameras
Keselman, L., Woodfill, J., Grunnet-Jepsen, A., & Bhowmik, A. K. (2017) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2017.167 · Cited by 455
Deep Depth Completion of a Single RGB-D Image
Zhang, Y., & Funkhouser, T. A. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00026 · Cited by 445
Using Real-Time Stereo Vision for Mobile Robot Navigation
Murray, D., & Little, J. J. (2000) · Autonomous Robots · doi:10.1023/a:1008987612352 · Cited by 403
GeoNet: Geometric Neural Network for Joint Depth and Surface Normal Estimation
Qi, X., Liao, R., Liu, Z., Urtasun, R., & Jia, J. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00037 · Cited by 391
Chen, L.-C., Barron, J. T., Papandreou, G., Murphy, K. P., & Yuille, A. (2016) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2016.492 · Cited by 378
Learning for Disparity Estimation Through Feature Constancy
Liang, Z., Feng, Y., Guo, Y., Liu, H., Chen, W., Qiao, L., Zhou, L., & Zhang, J. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00297 · Cited by 363
Structured Attention Guided Convolutional Neural Fields for Monocular Depth Estimation
Xu, D., Wang, W., Tang, H., Liu, H., Sebe, N., & Ricci, E. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00412 · Cited by 358
Depth Map Super-Resolution by Deep Multi-Scale Guidance
Hui, T.-W., Loy, C. C., & Tang, X. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-46487-9_22 · Cited by 350
Designing deep networks for surface normal estimation
Wang, X., Fouhey, D. F., & Gupta, A. (2015) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2015.7298652 · Cited by 348
Barron, J. T., & Poole, B. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-46487-9_38 · Cited by 339
Epipolar Geometry in Stereo, Motion and Object Recognition
Xu, G., & Zhang, Z. (1996) · Computational imaging and vision · doi:10.1007/978-94-015-8668-9 · Cited by 325
Every Pixel Counts ++: Joint Learning of Geometry and Motion with 3D Holistic Understanding
Luo, C., Yang, Z., Wang, P., Wang, Y., Xu, W., Nevatia, R., & Yuille, A. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2930258 · Cited by 316
Self-citationColor-Guided Depth Recovery From RGB-D Data Using an Adaptive Autoregressive Model
Yang, J., Ye, X., Li, K., Hou, C., & Wang, Y. (2014) · IEEE Transactions on Image Processing · doi:10.1109/tip.2014.2329776 · Cited by 311
SGM-Nets: Semi-Global Matching with Neural Networks
Seki, A., & Pollefeys, M. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.703 · Cited by 280
A Two-Streamed Network for Estimating Fine-Scaled Depth Maps from Single RGB Images
Li, J., Klein, R., & Yao, A. (2017) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.365 · Cited by 259
Epipolar Geometry in Stereo, Motion and Object Recognition: A Unified Approach
Xu, G., & Zhang, Z. (1996) · Cited by 240
Learning Affinity via Spatial Propagation NetworksPreprint
Liu, S., Mello, S. D., Gu, J., Zhong, G., Yang, M., & Kautz, J. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1710.01020 · Cited by 225
Look Deeper into Depth: Monocular Depth Estimation with Semantic Booster and Attention-Driven Loss
Jiao, J., Cao, Y. S., Song, Y., & Lau, R. W. H. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01267-0_4 · Cited by 218
Displets: Resolving stereo ambiguities using object knowledge
Güney, F., & Geiger, A. (2015) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2015.7299044 · Cited by 217
Luo, Y., Ren, J., Lin, M., Pang, J., Sun, W., Li, H., & Lin, L. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00024 · Cited by 205
EdgeStereo: A Context Integrated Residual Pyramid Network for Stereo Matching
Song, X., Zhao, X., Hu, H., & Fang, L. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-20873-8_2 · Cited by 201
Improved Stereo Matching with Constant Highway Networks and Reflective Confidence Learning
Shaked, A., & Wolf, L. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.730 · Cited by 194
Menze, M., Heipke, C., & Geiger, A. (2017) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2017.09.013 · Cited by 192
LEGO: Learning Edge with Geometry all at Once by Watching Videos
Yang, Z., Wang, P., Wang, Y., Xu, W. H., & Nevatia, R. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00031 · Cited by 191
Self-citationTorontoCity: Seeing the World with a Million Eyes
Wang, S., Bai, M., Mattyus, G., Chu, H., Luo, W., Yang, B., Liang, J., Cheverie, J., Fidler, S., & Urtasun, R. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.327 · Cited by 186
PM-Huber: PatchMatch with Huber Regularization for Stereo Matching
Heise, P., Klose, S., Jensen, B., & Knoll, A. (2013) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2013.293 · Cited by 170
Stereoscopic inpainting: Joint color and depth completion from stereo images
Wang, L., Jin, H., Yang, R., & Gong, M. (2008) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2008.4587704 · Cited by 170
Self-citationMeshStereo: A Global Stereo Model with Mesh Alignment Regularization for View Interpolation
Zhang, C., Li, Z., Cheng, Y., Cai, R., Chao, H., & Rui, Y. (2015) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.238 · Cited by 162
ATGV-Net: Accurate Depth Super-Resolution
Riegler, G., Rüther, M., & Bischof, H. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-46487-9_17 · Cited by 157
Unsupervised Learning of Geometry From Videos With Edge-Aware Depth-Normal Consistency
Yang, Z., Wang, P., Xu, W. H., Zhao, L., & Nevatia, R. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.12257 · Cited by 156
Self-citationConvolutional Random Walk Networks for Semantic Image Segmentation
Bertasius, G., Torresani, L., Yu, S. X., & Shi, J. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.650 · Cited by 136
Parse geometry from a line: Monocular depth estimation with partial laser observation
Liao, Y., Huang, L., Wang, Y., Kodagoda, S., Yu, Y., & Liu, Y. (2017) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2017.7989590 · Cited by 121
Data-driven depth map refinement via multi-scale sparse representation
Kwon, H., Tai, Y., & Lin, S. C.-F. (2015) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2015.7298611 · Cited by 95
Deep Depth Super-Resolution: Learning Depth Super-Resolution Using Deep Convolutional Neural Network
Song, X., Dai, Y., & Qin, X. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-54190-7_22 · Cited by 89
Variational Depth Superresolution Using Example-Based Edge Representations
Ferstl, D., Rüther, M., & Bischof, H. (2015) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.66 · Cited by 89
Self-Supervised Relative Depth Learning for Urban Scene Understanding
Jiang, H., Larsson, G., Maire, M., Shakhnarovich, G., & Miller, E. G. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01252-6_2 · Cited by 83
Affinity CNN: Learning Pixel-Centric Pairwise Relations for Figure/Ground Embedding
Maire, M., Narihira, T., & Yu, S. X. (2016) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2016.26 · Cited by 55
From Point Clouds to Mesh Using Regression
Ladický, Ľ., Saurer, O., Jeong, S., Maninchedda, F., & Pollefeys, M. (2017) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.420 · Cited by 47
Stereo matching, reconstruction and refinement of 3D curves using deformable contours
Bascle, B., & Rachid Deriche, B. (2002) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.1993.378185 · Cited by 47
Depth image enhancement using local tangent plane approximations
Matsuo, K., & Aoki, Y. (2015) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2015.7298980 · Cited by 46
Monocular Depth Estimation Using Whole Strip Masking and Reliability-Based Refinement
Heo, M., Lee, J., Kim, K. R., Kim, H., & Kim, C. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01225-0_3 · Cited by 46
Learning to Diffuse: A New Perspective to Design PDEs for Visual Analysis
Liu, R., Zhong, G., Cao, J., Lin, Z., Shan, S., & Luo, Z. (2016) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2522415 · Cited by 45
Learning Deep Correspondence through Prior and Posterior Feature ConstancyPreprint
Liang, Z., Feng, Y., Guo, Y., Liu, H., Qiao, L., Chen, W., Zhou, L. P., & Zhang, J. (2017) · arXiv (Cornell University) · Cited by 24
Efficient deep learning for stereo matching with larger image patches
Feng, Y., Liang, Z., & Liu, H. (2017) · International Congress on Image and Signal Processing, BioMedical Engineering and Informatics (CISP-BMEI) · doi:10.1109/cisp-bmei.2017.8301999 · Cited by 17
Learning for Active 3D Mapping
Zimmermann, K., Petricek, T., Šalanský, V., & Svoboda, T. (2017) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.171 · Cited by 14
Obstacle Avoidance Using Stereo CameraPreprint
Haque, A. U., & Nejadpak, A. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1705.04114 · Cited by 7
Research works printed but not linked: 5
- J. Biswas and M. Veloso, "Depth camera based localization and naviga- tion for indoor mobile robots," in RGB-D Workshop at RSS, vol. 2011, 2011, p. 21. 1
- X. Huang, X. Cheng, Q. Geng, B. Cao, D. Zhou, P. Wang, Y. Lin, and R. Yang, "The apolloscape dataset for autonomous driving," arXiv preprint arXiv:1803.06184, 2018. 1 · arXiv
- P. Wang, X. Shen, B. Russell, S. Cohen, B. L. Price, and A. L. Yuille, "SURGE: surface regularized geometry estimation from a single image," in NIPS, 2016. 2, 3, 9
- L.-C. Chen, G. Papandreou, F. Schroff, and H. Adam, "Rethinking atrous convolution for semantic image segmentation," arXiv preprint arXiv:1706.05587, 2017. 3 · arXiv
- S. A. Gershgorin, "Uber die abgrenzung der eigenwerte einer matrix," . , no. 6, pp. 749-754, 1931. 4
Cited by
Sorted by citations
A Survey of Autonomous Driving: Common Practices and Emerging Technologies
Yurtsever, E., Lambert, J., Carballo, A., & Takeda, K. (2020) · IEEE Access · doi:10.1109/access.2020.2983149 · Cited by 1,889
“therefore necessary, which is in fact possible through single camera [156] though stereo or multi-view systems are more robust [157].”
BackgroundRAFT-Stereo: Multilevel Recurrent Field Transforms for Stereo Matching
Lipson, L., Teed, Z., & Deng, J. (2021) · International Conference on 3D Vision (3DV) · doi:10.1109/3dv53792.2021.00032 · Cited by 570
DeepVCP: An End-to-End Deep Neural Network for Point Cloud Registration
Lu, W., Wan, G., Zhou, Y., Fu, X., Yuan, P., & Song, S. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00010 · Cited by 401
CFNet: Cascade and Fused Cost Volume for Robust Stereo Matching
Shen, Z., Dai, Y., & Rao, Z. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.01369 · Cited by 375
Iterative Geometry Encoding Volume for Stereo Matching
Xu, G., Wang, X., Ding, X., & Yang, X. Y. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.02099 · Cited by 407
Metadata
- Authors
- Cheng, X., Wang, P., & Yang, R.
- Affiliations
- Baidu (China) (CN)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2018
- Volume
- 42
- Issue
- 10
- Pages
- 2361-2379
- ISSN
- 0162-8828 (ISSN-L)
- arXiv
- 1810.02695
- OpenAlex
- W2980467688
- Cited by
- 345
- References
- 105
- Citations by year
- 2026: 25 · 2025: 53 · 2024: 53 · 2023: 57 · 2022: 57 · 2021: 59 · 2020: 24 · 2019: 16 · 2018: 1
- FWCI
- 17.43
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- IEEE Transactions on Pattern Analysis and Machine Intelligence (publishedVersion)
- PubMed (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- Baidu
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Vision and Imaging
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Engineering › Media Technology › Image Processing Techniques and Applications
- Keywords
- depth estimation, depth completion, stereo matching, spatial pyramid pooling, 3D convolution
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
