The DOI matches its Crossref record; 31 of the 31 references it cites were found in a registry or an index.
Efficient Deep Learning for Stereo Matching
Abstract
In the past year, convolutional neural networks have been shown to perform extremely well for stereo estimation. However, current architectures rely on siamese networks which exploit concatenation followed by further processing layers, requiring a minute of GPU computation per image pair. In contrast, in this paper we propose a matching network which is able to produce very accurate results in less than a second of GPU computation. Towards this goal, we exploit a product layer which simply computes the inner product between the two representations of a siamese architecture. We train our network by treating the problem as multi-class classification, where the classes are all possible disparities. This allows us to get calibrated scores, which result in much better matching performance when compared to existing approaches.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Are we ready for autonomous driving? The KITTI vision benchmark suite
Geiger, A., Lenz, P., & Urtasun, R. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6248074 · Cited by 14,897
Self-citationSLIC Superpixels Compared to State-of-the-Art Superpixel Methods
Achanta, R., Shaji, A., Smith, K., Lucchi, A., Fua, P., & Süsstrunk, S. (2012) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2012.120 · Cited by 9,201
(2010) · Cited by 8,261
Flownet: Learning optical flow with convolutional networks
Dosovitskiy, A., Fischer, P., Ilg, E., Hausser, P., Hazirbas, C., Golkov, V., Smagt, P. V. D., Cremers, D., & Brox, T. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.316 · Cited by 4,313
Object scene flow for autonomous vehicles
Menze, M., & Geiger, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298925 · Cited by 2,270
Learning to compare image patches via convolutional neural networks
Zagoruyko, S., & Komodakis, N. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7299064 · Cited by 1,140
Stereo Matching by Training a Convolutional Neural Network to Compare Image Patches
Žbontar, J., & LeCun, Y. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1510.05970 · Cited by 931
Learning Conditional Random Fields for Stereo
Scharstein, D., & Pal, C. (2007) · 2007 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2007.383191 · Cited by 851
Segment-Based Stereo Matching Using Belief Propagation and a Self-Adapting Dissimilarity Measure
Klaus, A., Sormann, M., & Karner, K. (2006) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr.2006.1033 · Cited by 837
Computing the stereo matching cost with a convolutional neural network
Zbontar, J., & LeCun, Y. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298767 · Cited by 796
Cited by
Fully-Convolutional Siamese Networks for Object Tracking
Bertinetto, L., Valmadre, J., Henriques, J. F., Vedaldi, A., & Torr, P. H. S. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-48881-3_56 · Cited by 4,546
Unsupervised Monocular Depth Estimation with Left-Right Consistency
Godard, C., Aodha, O. M., & Brostow, G. J. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.699 · Cited by 3,270
Pyramid Stereo Matching Network
Chang, J.-R., & Chen, Y.-S. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00567 · Cited by 1,807
End-to-End Learning of Geometry and Context for Deep Stereo Regression
Kendall, A., Martirosyan, H., Dasgupta, S., Henry, P., Kennedy, R., Bachrach, A., & Bry, A. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.17 · Cited by 1,470
MVSNet: Depth Inference for Unstructured Multi-view Stereo
Yao, Y., Luo, Z., Li, S., Fang, T., & Quan, L. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01237-3_47 · Cited by 1,455
Image Matching from Handcrafted to Deep Features: A Survey
Ma, J., Jiang, X., Fan, A., Jiang, J., & Yan, J. (2021) · International Journal of Computer Vision · doi:10.1007/s11263-020-01359-2 · Cited by 990
Group-Wise Correlation Stereo Network
Guo, X., Yang, K., Yang, W., Wang, X., & Li, H. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00339 · Cited by 742
Deep learning in optical metrology: a review
Zuo, C., Qian, J., Feng, S., Yin, W., Li, Y., Fan, P., Han, J., Qian, K., & Chen, Q. (2022) · Light: Science & Applications · doi:10.1038/s41377-022-00714-x · Cited by 711
Recurrent MVSNet for High-Resolution Multi-View Stereo Depth Inference
Yao, Y., Luo, Z., Li, S., Shen, T., Fang, T., & Quan, L. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00567 · Cited by 666
Computer Vision for Autonomous Vehicles: Problems, Datasets and State of the Art
Janai, J., Güney, F., Behl, A., & Geiger, A. (2020) · Foundations and Trends® in Computer Graphics and Vision · doi:10.1561/0600000079 · Cited by 643
Autonomous Cars: Research Results, Issues, and Future Challenges
Hussain, R., & Zeadally, S. (2019) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2018.2869360 · Cited by 631
UNISURF: Unifying Neural Implicit Surfaces and Radiance Fields for Multi-View Reconstruction
Oechsle, M., Peng, S., & Geiger, A. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00554 · Cited by 622
Ball, J. E., Anderson, D. T., & Chan, C. S. (2017) · Journal of Applied Remote Sensing · doi:10.1117/1.jrs.11.042609 · Cited by 746
Detail-Revealing Deep Video Super-Resolution
Tao, X., Gao, H., Liao, R., Wang, J., & Jia, J. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.479 · Cited by 556
DeepMVS: Learning Multi-view Stereopsis
Huang, P.-H., Matzen, K., Kopf, J., Ahuja, N., & Huang, J.-B. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00298 · Cited by 493
SegStereo: Exploiting Semantic Information for Disparity Estimation
Yang, G., Zhao, H., Shi, J., Deng, Z., & Jia, J. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01234-2_39 · Cited by 375
Learning for Disparity Estimation Through Feature Constancy
Liang, Z., Feng, Y., Guo, Y., Liu, H., Chen, W., Qiao, L., Zhou, L., & Zhang, J. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00297 · Cited by 354
Cost Volume Pyramid Based Depth Inference for Multi-View Stereo
Yang, J., Mao, W., Alvarez, J. M., & Liu, M. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00493 · Cited by 346
Learning Depth with Convolutional Spatial Propagation Network
Cheng, X., Wang, P., & Yang, R. (2018) · arXiv · doi:10.48550/arxiv.1810.02695 · Cited by 345
“Following [28], several methods were proposed to increase computational efficiency [80], [81], or matching cost accuracy [82] with stronger network and confidence predictions.”
MethodLearning Depth with Convolutional Spatial Propagation Network
Cheng, X., Wang, P., & Yang, R. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2947374 · Cited by 341
A Survey on Deep Learning Techniques for Stereo-Based Depth Estimation
Laga, H., Jospin, L. V., Boussaid, F., & Bennamoun, M. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.3032602 · Cited by 336
Kornia: an Open Source Differentiable Computer Vision Library for PyTorch
Riba, E., Mishkin, D., Ponsa, D., Rublee, E., & Bradski, G. (2020) · 2020 IEEE Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv45572.2020.9093363 · Cited by 333
Learning Parallax Attention for Stereo Image Super-Resolution
Wang, L., Wang, Y., Liang, Z., Lin, Z., Yang, J., An, W., & Guo, Y. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.01253 · Cited by 320
Shin, C., Jeon, H.-G., Yoon, Y., Kweon, I. S., & Kim, S. J. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00499 · Cited by 319
DeepPruner: Learning Efficient Stereo Matching via Differentiable PatchMatch
Duggal, S., Wang, S., Ma, W.-C., Hu, R., & Urtasun, R. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00448 · Cited by 317
Self-citationL3-Net: Towards Learning Based LiDAR Localization for Autonomous Driving
Lu, W., Zhou, Y., Wan, G., Hou, S., & Song, S. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00655 · Cited by 311
HITNet: Hierarchical Iterative Tile Refinement Network for Real-time Stereo Matching
Tankovich, V., Hane, C., Zhang, Y., Kowdle, A., Fanello, S., & Bouaziz, S. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.01413 · Cited by 309
Sensors and AI Techniques for Situational Awareness in Autonomous Ships: A Review
Thombre, S., Zhao, Z., Ramm-Schmidt, H., Vallet Garcia, J. M., Malkamaki, T., Nikolskiy, S., Hammarberg, T., Nuortie, H., H. Bhuiyan, M. Z., Sarkka, S., et al. (2022) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2020.3023957 · Cited by 283
Real-Time Self-Adaptive Deep Stereo
Tonioni, A., Tosi, F., Poggi, M., Mattoccia, S., & Stefano, L. D. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00028 · Cited by 277
SGM-Nets: Semi-Global Matching with Neural Networks
Seki, A., & Pollefeys, M. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.703 · Cited by 269
Relational Embedding for Few-Shot Classification
Kang, D., Kwon, H., Min, J., & Cho, M. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00870 · Cited by 266
Hierarchical Deep Stereo Matching on High-Resolution Images
Yang, G., Manela, J., Happold, M., & Ramanan, D. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00566 · Cited by 261
Learning Proximal Operators: Using Denoising Networks for Regularizing Inverse Imaging Problems
Meinhardt, T., Moeller, M., Hazirbas, C., & Cremers, D. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.198 · Cited by 257
Superpixel Segmentation With Fully Convolutional Networks
Yang, F., Sun, Q., Jin, H., & Zhou, Z. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01398 · Cited by 257
Luo, Y., Ren, J., Lin, M., Pang, J., Sun, W., Li, H., & Lin, L. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00024 · Cited by 205
Unsupervised Adversarial Depth Estimation Using Cycled Generative Networks
Pilzer, A., Xu, D., Puscas, M., Ricci, E., & Sebe, N. (2018) · 2018 International Conference on 3D Vision (3DV) · doi:10.1109/3dv.2018.00073 · Cited by 192
Merkle, N., Luo, W., Auer, S., Müller, R., & Urtasun, R. (2017) · Remote Sensing · doi:10.3390/rs9060586 · Cited by 120
Self-citationUnsupervised Monocular Depth Estimation with Left-Right Consistency
Godard, C., Mac Aodha, O., & Brostow, G. J. (2016) · arXiv · doi:10.48550/arxiv.1609.03677 · Cited by 28
Optical Flow Estimation with Deep Learning, a Survey on Recent Advances
Savian, S., Elahi, M., & Tillo, T. (2020) · Unsupervised and Semi-Supervised Learning · doi:10.1007/978-3-030-32583-1_12 · Cited by 29
Duran, O., & Turan, B. (2022) · Measurement · doi:10.1016/j.measurement.2022.110732 · Cited by 25
Siamese Networks for Few-Shot Learning on Edge Embedded Devices
Lungu, I. A., Aimar, A., Hu, Y., Delbruck, T., & Liu, S.-C. (2020) · IEEE Journal on Emerging and Selected Topics in Circuits and Systems · doi:10.1109/jetcas.2020.3033155 · Cited by 24
Enhanced multi view 3D reconstruction with improved MVSNet
Li, G., Li, K., Zhang, G., Zhu, Z., Wang, P., Wang, Z., & Fu, C. (2024) · Scientific Reports · doi:10.1038/s41598-024-64805-y · Cited by 8
Siamese Encoding and Alignment by Multiscale Learning with Self-Supervision
Mitchell, E., Keselj, S., Popovych, S., Buniatyan, D., & Seung, H. S. (2019) · arXiv · doi:10.48550/arxiv.1904.02643
Metadata
- Authors
- Luo, W., Schwing, A. G., & Urtasun, R.
- Venue
- 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
- Publisher
- IEEE
- Published
- 2016-06
- Pages
- 5695-5703
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W2440384215
- Cited by
- 741
- References
- 31
- FWCI
- 36.06
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.