The DOI matches its Crossref record; 80 of the 80 references it cites were found in a registry or an index.
A taxonomy and evaluation of dense two-frame stereo correspondence algorithms
Abstract
Stereo matching is one of the most active research areas in computer vision. While a large number of algorithms for stereo correspondence have been developed, relatively little work has been done on characterizing their performance. In this paper, we present a taxonomy of dense, two-frame stereo methods designed to assess the different components and design decisions made in individual stereo algorithms. Using this taxonomy, we compare existing stereo methods and present experiments evaluating the performance of many different variants. In order to establish a common software platform and a collection of data sets for easy evaluation, we have designed a stand-alone, flexible C++ implementation that enables the evaluation of individual components and that can be easily extended to include new algorithms. We have also produced several new multiframe stereo data sets with ground truth, and are making both the code and data sets available on the Web.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Stochastic relaxation, gibbs distributions, and the bayesian restoration of images.
Geman, S., & Geman, D. (1984) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.1984.4767596 · Cited by 17,949
Performance of optical flow techniques
Barron, J. L., Fleet, D. J., & Beauchemin, S. S. (1994) · International Journal of Computer Vision · doi:10.1007/bf01420984 · Cited by 4,305
A survey of image registration techniques
Brown, L. G. (1992) · ACM Computing Surveys · doi:10.1145/146370.146374 · Cited by 4,057
Blake, A., & Zisserman, A. (1987) · The MIT Press eBooks · doi:10.7551/mitpress/7132.001.0001 · Cited by 2,105
Non-parametric local transforms for computing visual correspondence
Zabih, R., & Woodfill, J. (1994) · Lecture Notes in Computer Science · doi:10.1007/bfb0028345 · Cited by 1,763
Self-citationComputational vision and regularization theory
Poggio, T., Torre, V., & Koch, C. (1985) · Nature · doi:10.1038/317314a0 · Cited by 1,412
Marr, D., & Poggio, T. (1976) · Science · doi:10.1126/science.968482 · Cited by 1,377
A Theory of Shape by Space Carving
Kutulakos, K. N., & Seitz, S. M. (2000) · International Journal of Computer Vision · doi:10.1023/a:1008191222954 · Cited by 1,254
Hierarchical model-based motion estimation
Bergen, J. R., Anandan, P., Hanna, K. J., & Hingorani, R. (1992) · Lecture Notes in Computer Science · doi:10.1007/3-540-55426-2_27 · Cited by 1,154
Computing visual correspondence with occlusions using graph cuts
Kolmogorov, V., & Zabih, R. (2002) · Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001 · doi:10.1109/iccv.2001.937668 · Cited by 1,119
Self-citationA computational framework and an algorithm for the measurement of visual motion
Anandan, P. (1989) · International Journal of Computer Vision · doi:10.1007/bf00158167 · Cited by 1,073
A stereo matching algorithm with an adaptive window: theory and experiment
Kanade, T., & Okutomi, M. (1994) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.310690 · Cited by 1,068
Okutomi, M., & Kanade, T. (1993) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.206955 · Cited by 939
Stereo by Intra- and Inter-Scanline Search Using Dynamic Programming
Ohta, Y., & Kanade, T. (1985) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.1985.4767639 · Cited by 932
Epipolar-plane image analysis: An approach to determining structure from motion
Bolles, R. C., Baker, H. H., & Marimont, D. H. (1987) · International Journal of Computer Vision · doi:10.1007/bf00128525 · Cited by 892
Structure from stereo-a review
Dhond, U. R., & Aggarwal, J. K. (1989) · IEEE Transactions on Systems, Man, and Cybernetics · doi:10.1109/21.44067 · Cited by 867
Dynamic 3D models with local and global deformations: deformable superquadrics
Terzopoulos, D., & Metaxas, D. (1991) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.85659 · Cited by 781
Regularization of Inverse Visual Problems Involving Discontinuities
Terzopoulos, D. (1986) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.1986.4767807 · Cited by 767
Probabilistic Solution of Ill-Posed Problems in Computational Vision
Marroquin, J., Mitter, S., & Poggio, T. (1987) · Journal of the American Statistical Association · doi:10.1080/01621459.1987.10478393 · Cited by 766
Black, M. J., & Rangarajan, A. (1996) · International Journal of Computer Vision · doi:10.1007/bf00131148 · Cited by 757
Kalman filter-based algorithms for estimating depth from image sequences
Matthies, L., Kanade, T., & Szeliski, R. (1989) · International Journal of Computer Vision · doi:10.1007/bf00133032 · Cited by 716
Self-citationA space-sweep approach to true multi-image matching
Collins, R. T. (1996) · Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.1996.517097 · Cited by 610
A pixel dissimilarity measure that is insensitive to image sampling
Birchfield, S., & Tomasi, C. (1998) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.677269 · Cited by 585
Computational Experiments with a Feature Based Stereo Algorithm
Grimson, W. E. L. (1985) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.1985.4767615 · Cited by 529
A cooperative algorithm for stereo matching and occlusion detection
Zitnick, C. L., & Takeo Kanade, A. (2000) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.865184 · Cited by 502
Photorealistic Scene Reconstruction by Voxel Coloring
Seitz, S. M., & Dyer, C. R. (1999) · International Journal of Computer Vision · doi:10.1023/a:1008176507526 · Cited by 492
A maximum-flow formulation of the N-camera stereo correspondence problem
Roy, S., & Cox, I. J. (2002) · Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271) · doi:10.1109/iccv.1998.710763 · Cited by 485
PMF: A Stereo Correspondence Algorithm Using a Disparity Gradient Limit
Pollard, S. B., Mayhew, J. E. W., & Frisby, J. P. (1985) · Perception · doi:10.1068/p140449 · Cited by 473
A Maximum Likelihood Stereo Algorithm
Cox, I. J., Hingorani, S. L., Rao, S. B., & Maggs, B. M. (1996) · Computer Vision and Image Understanding · doi:10.1006/cviu.1996.0040 · Cited by 470
Fast approximate energy minimization via graph cuts
Boykov, Y., Veksler, O., & Zabih, R. (1999) · Proceedings of the Seventh IEEE International Conference on Computer Vision · doi:10.1109/iccv.1999.791245 · Cited by 470
Self-citationBobick, A. F., & Intille, S. S. (1999) · International Journal of Computer Vision · doi:10.1023/a:1008150329890 · Cited by 460
A framework for the robust estimation of optical flow
Black, M. J., & Anandan, P. (2002) · 1993 (4th) International Conference on Computer Vision · doi:10.1109/iccv.1993.378214 · Cited by 454
Parallel and deterministic algorithms from MRFs: surface reconstruction
Geiger, D., & Girosi, F. (1991) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.134040 · Cited by 447
A parallel stereo algorithm that produces dense depth maps and preserves image features
Fua, P. (1993) · Machine Vision and Applications · doi:10.1007/bf01212430 · Cited by 441
Variational principles, surface evolution, PDEs, level set methods, and the stereo problem
Faugeras, O., & Keriven, R. (1998) · IEEE Transactions on Image Processing · doi:10.1109/83.661183 · Cited by 424
Algorithms for subpixel registration
Tian, Q., & Huhns, M. N. (1986) · Computer Vision, Graphics, and Image Processing · doi:10.1016/0734-189x(86)90028-9 · Cited by 375
Handling occlusions in dense multi-view stereo
Kang, S. B., Szeliski, R., & Chai, J. (2005) · Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001 · doi:10.1109/cvpr.2001.990462 · Cited by 353
Self-citationLayered representation for motion analysis
Wang, J. Y. A., & Adelson, E. H. (2002) · Proceedings of IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.1993.341105 · Cited by 273
The theory and practice of Bayesian image labeling
Chou, P. B., & Brown, C. M. (1990) · International Journal of Computer Vision · doi:10.1007/bf00054995 · Cited by 272
A global matching framework for stereo computation
Tao, H., Sawhney, H. S., & Kumar, R. (2002) · Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001 · doi:10.1109/iccv.2001.937562 · Cited by 268
Spline-Based Image Registration
Szeliski, R., & Coughlan, J. (1997) · International Journal of Computer Vision · doi:10.1023/a:1007996332012 · Cited by 255
Self-citationDetection of binocular disparities
Prazdny, K. (1985) · Biological Cybernetics · doi:10.1007/bf00363999 · Cited by 254
Object-centered surface reconstruction: Combining multi-image stereo and shading
Fua, P., & Leclerc, Y. G. (1995) · International Journal of Computer Vision · doi:10.1007/bf01428192 · Cited by 246
Occlusions and binocular stereo
Geiger, D., Ladendorf, B., & Yuille, A. (1992) · Lecture Notes in Computer Science · doi:10.1007/3-540-55426-2_48 · Cited by 243
Stochastic stereo matching over scale
Barnard, S. T. (1989) · International Journal of Computer Vision · doi:10.1007/bf00054836 · Cited by 242
Stereo Matching with Nonlinear Diffusion
Scharstein, D., & Szeliski, R. (1998) · International Journal of Computer Vision · doi:10.1023/a:1008015117424 · Cited by 241
Self-citationMultiway cut for stereo and motion with slanted surfaces
Birchfield, S., & Tomasi, C. (1999) · Proceedings of the Seventh IEEE International Conference on Computer Vision · doi:10.1109/iccv.1999.791261 · Cited by 239
A Bayesian approach to binocular steropsis
Belhumeur, P. N. (1996) · International Journal of Computer Vision · doi:10.1007/bf00055146 · Cited by 239
Development of a video-rate stereo machine
Kanade, T., Kano, H., Kimura, S., Yoshida, A., & Oda, K. (2002) · Proceedings 1995 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human Robot Interaction and Cooperative Robots · doi:10.1109/iros.1995.525868 · Cited by 231
Depth discontinuities by pixel-to-pixel stereo
Birchfield, S. T., & Tomasi, C. (2002) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.1998.710850 · Cited by 228
Signal matching through scale space
Witkin, A., Terzopoulos, D., & Kass, M. (1987) · International Journal of Computer Vision · doi:10.1007/bf00123162 · Cited by 228
Efficient graph-based energy minimization methods in computer vision
Zabih, R., & Veksler, O. (1999) · Cited by 223
Self-citationPractical Real-Time Imaging Stereo Matcher
Nishihara, H. K. (1984) · Optical Engineering · doi:10.1117/12.7973334 · Cited by 209
Computational framework for determining stereo correspondence from a set of linear spatial filters
Jones, D. G., & Malik, J. (1992) · Image and Vision Computing · doi:10.1016/0262-8856(92)90015-u · Cited by 191
Occlusions, discontinuities, and epipolar lines in stereo
Ishikawa, H., & Geiger, D. (1998) · Lecture Notes in Computer Science · doi:10.1007/bfb0055670 · Cited by 190
Computer Matching of Areas in Stereo Images
Hannah, M. J. (1974) · doi:10.21236/ad0786720 · Cited by 184
A layered approach to stereo reconstruction
Baker, S., Szeliski, R., & Anandan, P. (2002) · Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231) · doi:10.1109/cvpr.1998.698642 · Cited by 178
Self-citationA variable window approach to early vision
Boykov, Y., Veksler, O., & Zabih, R. (1998) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.735802 · Cited by 170
Self-citationStereo Matching with Transparency and Matting
Szeliski, R., & Golland, P. (1999) · International Journal of Computer Vision · doi:10.1023/a:1008192912624 · Cited by 158
Self-citationA locally adaptive window for signal matching
Okutomi, M., & Takeo Kanade, A. (1992) · International Journal of Computer Vision · doi:10.1007/bf00128133 · Cited by 155
An Experimental Comparison of Stereo Algorithms
Szeliski, R., & Zabih, R. (2000) · Lecture notes in computer science · doi:10.1007/3-540-44480-7_1 · Cited by 138
Self-citationQuam, L. H. (1987) · Elsevier eBooks · doi:10.1016/b978-0-08-051581-6.50015-5 · Cited by 127
Dynamic histogram warping of image pairs for constant image brightness
Cox, I. J., Roy, S., & Hingorani, S. L. (2002) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.1995.537491 · Cited by 125
View Synthesis Using Stereo Vision
Scharstein, D. (1999) · Lecture notes in computer science · doi:10.1007/3-540-48725-5 · Cited by 119
Self-citationPrediction error as a quality metric for motion and stereo
Szeliski, R. (1999) · Proceedings of the Seventh IEEE International Conference on Computer Vision · doi:10.1109/iccv.1999.790301 · Cited by 118
Self-citationOcclusion detectable stereo-occlusion patterns in camera matrix
Nakamura, Y., Matsuura, T., Satoh, K., & Ohta, Y. (1996) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.1996.517099 · Cited by 106
Techniques for disparity measurement
Jenkin, M. R. M., Jepson, A. D., & Tsotsos, J. K. (1991) · CVGIP Image Understanding · doi:10.1016/1049-9660(91)90002-7 · Cited by 106
Precise sub-pixel estimation on area-based matching
Shimizu, M., & Okutomi, M. (2002) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2001.937503 · Cited by 101
Matching images by comparing their gradient fields
Scharstein, D. (2002) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr.1994.576363 · Cited by 95
Self-citationA multibaseline stereo system with active illumination and real-time image acquisition
Kang, S. B., WEBB, J. A. C., Zitnick, C. L., & Takeo Kanade, A. (2002) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.1995.466802 · Cited by 89
Performance evaluation of scene registration and stereo matching for cartographic feature extraction
Hsieh, Y. C., McKeown, D. M., & Perlant, F. P. (1992) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.121790 · Cited by 89
Stereo matching by compact windows via minimum ratio cycle
Veksler, O. (2002) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2001.937563 · Cited by 83
Visual Integration and Detection of Discontinuities: The Key Role of Intensity Edges
Gamble, E. B., & Poggio, T. (1987) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 69
Brightness-based Stereo Matching
Gennert, M. A. (2005) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/ccv.1988.589984 · Cited by 51
Local, global, and multilevel stereo matching
Yang, Y., Yuille, A., & Lu, J. (2002) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.1993.340969 · Cited by 48
Performance evaluation of stereo for tele-presence
Mulligan, J., Isler, V., & Daniilidis, K. (2002) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2001.937675 · Cited by 46
Prediction Of Correlation Errors In Stereo-Pair Images
Ryan, T. W., Gray, R. T., & Hunt, B. R. (1980) · Optical Engineering · doi:10.1117/12.7972515 · Cited by 44
Arnold, R. D. (1983) · Defense Technical Information Center (DTIC) · Cited by 42
A nonlinear diffusion model for discontinuous disparity and half-occlusions in stereo
Shah, J. (2002) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.1993.341004 · Cited by 26
Linear image features in stereopsis
Kass, M. (1988) · International Journal of Computer Vision · doi:10.1007/bf00133572 · Cited by 21
Cited by
A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms
Scharstein, D., & Szeliski, R. (2002) · International Journal of Computer Vision · doi:10.1023/a:1014573219977 · Cited by 6,740
Self-citationAn experimental comparison of min-cut/max- flow algorithms for energy minimization in vision
Boykov, Y., & Kolmogorov, V. (2004) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2004.60 · Cited by 4,577
DehazeNet: An End-to-End System for Single Image Haze Removal
Cai, B., Xu, X., Jia, K., Qing, C., & Tao, D. (2016) · IEEE Transactions on Image Processing · doi:10.1109/tip.2016.2598681 · Cited by 3,367
A Database and Evaluation Methodology for Optical Flow
Baker, S., Scharstein, D., Lewis, J. P., Roth, S., Black, M. J., & Szeliski, R. (2011) · International Journal of Computer Vision · doi:10.1007/s11263-010-0390-2 · Cited by 2,205
Self-citationMake3D: Learning 3D Scene Structure from a Single Still Image
Saxena, A., Sun, M., & Ng, A. Y. (2009) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2008.132 · Cited by 1,736
Metadata
- Authors
- Scharstein, D., Szeliski, R., & Zabih, R.
- Venue
- Proceedings IEEE Workshop on Stereo and Multi-Baseline Vision (SMBV 2001)
- Publisher
- IEEE Comput. Soc
- Published
- 2002-11-14
- Pages
- 131-140
- OpenAlex
- W4234282793
- Cited by
- 1,084
- References
- 80
- FWCI
- 10.05
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.