Nonlinear disparity mapping for stereoscopic 3D
The DOI matches its Crossref record; 35 of the 35 references it cites were found in a registry or an index.
Abstract
This paper addresses the problem of remapping the disparity range of stereoscopic images and video. Such operations are highly important for a variety of issues arising from the production, live broadcast, and consumption of 3D content. Our work is motivated by the observation that the displayed depth and the resulting 3D viewing experience are dictated by a complex combination of perceptual, technological, and artistic constraints. We first discuss the most important perceptual aspects of stereo vision and their implications for stereoscopic content creation. We then formalize these insights into a set of basic disparity mapping operators. These operators enable us to control and retarget the depth of a stereoscopic scene in a nonlinear and locally adaptive fashion. To implement our operators, we propose a new strategy based on stereoscopic warping of the input video streams. From a sparse set of stereo correspondences, our algorithm computes disparity and image-based saliency estimates, and uses them to compute a deformation of the input views so as to meet the target disparities. Our approach represents a practical solution for actual stereo production and display that does not require camera calibration, accurate dense depth maps, occlusion handling, or inpainting. We demonstrate the performance and versatility of our method using examples from live action post-production, 3D display size adaptation, and live broadcast. An additional user study and ground truth comparison further provide evidence for the quality and practical relevance of the presented work.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Image quality assessment: from error visibility to structural similarity
Wang, Z., Bovik, A. C., Sheikh, H. R., & Simoncelli, E. P. (2004) · IEEE Transactions on Image Processing · doi:10.1109/tip.2003.819861 · Cited by 57,892
Distinctive Image Features from Scale-Invariant Keypoints
Lowe, D. G. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000029664.99615.94 · Cited by 55,589
Levoy, M., & Hanrahan, P. (1996) · Proceedings of the 23rd annual conference on Computer graphics and interactive techniques · doi:10.1145/237170.237199 · Cited by 3,755
Lucas-Kanade 20 Years On: A Unifying Framework
Baker, S., & Matthews, I. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000011205.11775.fd · Cited by 3,155
Gortler, S. J., Grzeszczuk, R., Szeliski, R., & Cohen, M. F. (1996) · Proceedings of the 23rd annual conference on Computer graphics and interactive techniques · doi:10.1145/237170.237200 · Cited by 2,458
Vergence–accommodation conflicts hinder visual performance and cause visual fatigue
Hoffman, D. M., Girshick, A. R., Akeley, K., & Banks, M. S. (2008) · Journal of Vision · doi:10.1167/8.3.33 · Cited by 1,625
High-quality video view interpolation using a layered representation
Zitnick, C. L., Kang, S. B., Uyttendaele, M., Winder, S., & Szeliski, R. (2004) · ACM Transactions on Graphics · doi:10.1145/1015706.1015766 · Cited by 1,385
High Dynamic Range Imaging: Acquisition, Display, and Image-Based Lighting
Reinhard, E., Ward, G., Pattanaik, S., Debevec, P. E., Heidrich, W., & Myszkowski, K. (2010) · Cited by 1,359
The Method of Paired Comparisons.
Curnow, R. N., & David, H. A. (1964) · Journal of the Royal Statistical Society. Series A (General) · doi:10.2307/2344014 · Cited by 1,271
British Machine Vision Conference (BMVC)
Damen, D., & Hogg, D. (2007) · Cited by 1,213
Shade, J., Gortler, S., He, L.-W., & Szeliski, R. (1998) · Proceedings of the 25th annual conference on Computer graphics and interactive techniques - SIGGRAPH '98 · doi:10.1145/280814.280882 · Cited by 1,115
Perceiving Layout and Knowing Distances
Cutting, J. E., & Vishton, P. M. (1995) · Perception of Space and Motion · doi:10.1016/b978-012240530-3/50005-5 · Cited by 1,029
Visual Discomfort and Visual Fatigue of Stereoscopic Displays: A Review
Lambooij, M., Fortuin, M., Heynderickx, I., & IJsselsteijn, W. (2009) · Journal of Imaging Science and Technology · doi:10.2352/j.imagingsci.technol.2009.53.3.030201 · Cited by 1,006
Spatio-temporal Saliency detection using phase spectrum of quaternion fourier transform
Guo, C., Ma, Q., & Zhang, L. (2008) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2008.4587715 · Cited by 843
Seitz, S. M., & Dyer, C. R. (1996) · Proceedings of the 23rd annual conference on Computer graphics and interactive techniques · doi:10.1145/237170.237196 · Cited by 719
A Fast Approximation of the Bilateral Filter Using a Signal Processing Approach
Paris, S., & Durand, F. (2006) · Lecture Notes in Computer Science · doi:10.1007/11744085_44 · Cited by 481
Content-preserving warps for 3D video stabilization
Liu, F., Gleicher, M., Jin, H., & Agarwala, A. (2009) · ACM Transactions on Graphics · doi:10.1145/1531326.1531350 · Cited by 467
Matusik, W., & Pfister, H. (2004) · ACM Transactions on Graphics · doi:10.1145/1015706.1015805 · Cited by 454
Reinhard, E., Ward, G., Pattanaik, S. N., & Debevec, P. E. (2005) · Cited by 372
Anisotropic Huber-L1 Optical Flow
Werlberger, M., Trobin, W., Pock, T., Wedel, A., Cremers, D., & Bischof, H. (2009) · Procedings of the British Machine Vision Conference 2009 · doi:10.5244/c.23.108 · Cited by 354
A stereo display prototype with multiple focal distances
Akeley, K., Watt, S. J., Girshick, A. R., & Banks, M. S. (2004) · ACM Transactions on Graphics · doi:10.1145/1015706.1015804 · Cited by 315
A Disparity Gradient Limit for Binocular Fusion
Burt, P., & Julesz, B. (1980) · Science · doi:10.1126/science.7367885 · Cited by 264
Howard, I. P., & Rogers, B. J. (2008) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780195367607.001.0001 · Cited by 228
Stereo image quality: effects of mixed spatio-temporal resolution
Stelmach, L. B., Tam, W. J., Meegan, D. V., & Vincent, A. (2000) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/76.825717 · Cited by 193
Intermediate view interpolation based on multiview video plus depth for advanced 3D video systems
Smolic, A., Muller, K., Dix, K., Merkle, P., Kauff, P., & Wiegand, T. (2008) · 2008 15th IEEE International Conference on Image Processing · doi:10.1109/icip.2008.4712288 · Cited by 177
Self-citationMoving gradients: a path-based method for plausible image interpolation
Mahajan, D., Huang, F.-C., Matusik, W., Ramamoorthi, R., & Belhumeur, P. (2009) · ACM Transactions on Graphics · doi:10.1145/1531326.1531348 · Cited by 172
Shamir, A., & Sorkine, O. (2009) · ACM SIGGRAPH ASIA 2009 Courses · doi:10.1145/1665817.1665828 · Cited by 170
SCRAMSAC: Improving RANSAC's efficiency with a spatial consistency filter
Sattler, T., Leibe, B., & Kobbelt, L. (2009) · 2009 IEEE 12th International Conference on Computer Vision · doi:10.1109/iccv.2009.5459459 · Cited by 158
Why Is Spatial Stereoresolution So Low?
Banks, M. S., Gepshtein, S., & Landy, M. S. (2004) · Journal of Neuroscience · doi:10.1523/jneurosci.3852-02.2004 · Cited by 155
Semi-automatic stereo extraction from video footage
Guttmann, M., Wolf, L., & Cohen‐Or, D. (2009) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2009.5459158 · Cited by 135
Optimizing content-preserving projections for wide-angle images
Carroll, R., Agrawal, M., & Agarwala, A. (2009) · ACM Transactions on Graphics · doi:10.1145/1531326.1531349 · Cited by 134
Efficient Dense Stereo with Occlusions for New View-Synthesis by Four-State Dynamic Programming
Criminisi, A., Blake, A., Rother, C., Shotton, J., & Torr, P. H. S. (2006) · International Journal of Computer Vision · doi:10.1007/s11263-006-8525-1 · Cited by 120
The method of paired comparisons
David, H. A. 1. (1988) · Cited by 118
Motion-aware temporal coherence for video resizing
Wang, Y.-S., Fu, H., Sorkine, O., et al. (2009) · ACM Transactions on Graphics · doi:10.1145/1618452.1618473 · Cited by 115
Just enough reality: comfortable 3-D viewing via microstereopsis
Siegel, M., & Nagata, S. (2000) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/76.836283 · Cited by 63
Cited by
Light Field Image Processing: An Overview
Wu, G., Masia, B., Jarabo, A., Zhang, Y., Wang, L., Dai, Q., Chai, T., & Liu, Y. (2017) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2017.2747126 · Cited by 586
Resolving the Vergence-Accommodation Conflict in Head-Mounted Displays
Kramida, G. (2016) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2015.2473855 · Cited by 379
3D High-Efficiency Video Coding for Multi-View Video and Depth Data
Müller, K., Schwarz, H., Marpe, D., Bartnik, C., Bosse, S., Brust, H., Hinz, T., Lakshman, H., Merkle, P., Rhee, F. H., et al. (2013) · IEEE Transactions on Image Processing · doi:10.1109/tip.2013.2264820 · Cited by 353
Metadata
- Authors
- Lang, M., Hornung, A., Wang, O., Poulakos, S., Smolic, A., & Gross, M.
- Venue
- ACM Transactions on Graphics
- Published
- 2010-07-26
- Volume
- 29
- Issue
- 4
- Pages
- 1-10
- ISSN
- 0730-0301 (ISSN-L)
- 1557-7368
- OpenAlex
- W2103997188
- Cited by
- 336
- References
- 35
- FWCI
- 51.60
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.