The DOI matches its Crossref record; 23 of the 23 references it cites were found in a registry or an index.
Variational Light Field Analysis for Disparity Estimation and Super-Resolution
Abstract
We develop a continuous framework for the analysis of 4D light fields, and describe novel variational methods for disparity reconstruction as well as spatial and angular super-resolution. Disparity maps are estimated locally using epipolar plane image analysis without the need for expensive matching cost minimization. The method works fast and with inherent subpixel accuracy since no discretization of the disparity space is necessary. In a variational framework, we employ the disparity maps to generate super-resolved novel views of a scene, which corresponds to increasing the sampling rate of the 4D light field in spatial as well as angular direction. In contrast to previous work, we formulate the problem of view synthesis as a continuous inverse problem, which allows us to correctly take into account foreshortening effects caused by scene geometry transformations. All optimization problems are solved with state-of-the-art convex relaxation techniques. We test our algorithms on a number of real-world examples as well as our new benchmark data set for light fields, and compare results to a multiview stereo method. The proposed method is both faster as well as more accurate. Data sets and source code are provided online for additional evaluation.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems
Beck, A., & Teboulle, M. (2009) · SIAM Journal on Imaging Sciences · doi:10.1137/080716542 · Cited by 11,952
Levoy, M., & Hanrahan, P. (1996) · Proceedings of the 23rd annual conference on Computer graphics and interactive techniques · doi:10.1145/237170.237199 · Cited by 3,755
chambolle (2004) · doi:10.1023/b:jmiv.0000011321.19549.88 · Cited by 3,227
Mean squared error: Love it or leave it? A new look at Signal Fidelity Measures
Wang, Z., & Bovik, A. C. (2009) · IEEE Signal Processing Magazine · doi:10.1109/msp.2008.930649 · Cited by 3,175
Gortler, S. J., Grzeszczuk, R., Szeliski, R., & Cohen, M. F. (1996) · Proceedings of the 23rd annual conference on Computer graphics and interactive techniques · doi:10.1145/237170.237200 · Cited by 2,458
Light Field Photography with a Hand-held Plenoptic Camera
Ng, R., Levoy, M., Brédif, M., Duval, G., Horowitz, M., & Hanrahan, P. (2005) · HAL · Cited by 1,749
The Plenoptic Function and the Elements of Early Vision
Adelson, E. H., & Bergen, J. R. (1991) · Computational Models of Visual Processing · doi:10.7551/mitpress/2002.003.0004 · Cited by 1,515
Plenoptic modeling: an image-based rendering system
McMillan, L., & Bishop, G. (1995) · Proceedings of the 22nd annual conference on Computer graphics and interactive techniques - SIGGRAPH '95 · doi:10.1145/218380.218398 · Cited by 1,262
Limits on super-resolution and how to break them
Baker, S., & Kanade, T. (2002) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2002.1033210 · Cited by 1,205
Limits on super-resolution and how to break them
Baker, S., & Kanade, T. (2002) · Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662) · doi:10.1109/cvpr.2000.854852 · Cited by 1,184
Computational Models of Visual Processing
(1991) · The MIT Press eBooks · doi:10.7551/mitpress/2002.001.0001 · Cited by 1,073
Epipolar-plane image analysis: An approach to determining structure from motion
Bolles, R. C., Baker, H. H., & Marimont, D. H. (1987) · International Journal of Computer Vision · doi:10.1007/bf00128525 · Cited by 892
Optimal Orientation Detection of Linear Symmetry
Bigün, J. (1987) · Cited by 471
Globally consistent depth labeling of 4D light fields
Wanner, S., & Goldlüecke, B. (2012) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2012.6247656 · Cited by 344
Self-citationFocused plenoptic camera and rendering
Georgiev, T. G., & Lumsdaine, A. (2010) · Journal of Electronic Imaging · doi:10.1117/1.3442712 · Cited by 286
Using plane + parallax for calibrating dense camera arrays
Vaish, V., Wilburn, B., Joshi, N., & Levoy, M. (2004) · Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004. · doi:10.1109/cvpr.2004.1315006 · Cited by 245
Global Solutions of Variational Models with Convex Regularization
Pock, T., Cremers, D., Bischof, H., & Chambolle, A. (2010) · SIAM Journal on Imaging Sciences · doi:10.1137/090757617 · Cited by 159
Spatial and Angular Variational Super-Resolution of 4D Light Fields
Wanner, S., & Goldlüecke, B. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-33715-4_44 · Cited by 118
Self-citationSuper Resolution With Probabilistic Motion Estimation
Protter, M., & Elad, M. (2009) · IEEE Transactions on Image Processing · doi:10.1109/tip.2009.2022440 · Cited by 93
Superresolution texture maps for multiview reconstruction
Goldlüecke, B., & Cremers, D. (2009) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2009.5459378 · Cited by 58
Generating EPI Representations of 4D Light Fields with a Single Lens Focused Plenoptic Camera
Wanner, S., Keuper, J., & Jähne, B. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-24028-7_9 · Cited by 56
Self-citationGeys, I., Koninckx, T. P., & Gool, L. V. (2004) · doi:10.1109/3dpvt.2004.61 · Cited by 28
Geys, I., Koninckx, T. P., & Gool, L. V. (2004) · International Symposium on 3D Data Processing, Visualization and Transmission · doi:10.1109/tdpvt.2004.1335283 · Cited by 18
Cited by
Learning-based view synthesis for light field cameras
Kalantari, N. K., Wang, T.-C., & Ramamoorthi, R. (2016) · ACM Transactions on Graphics · doi:10.1145/2980179.2980251 · Cited by 726
Light Field Image Processing: An Overview
Wu, G., Masia, B., Jarabo, A., Zhang, Y., Wang, L., Dai, Q., Chai, T., & Liu, Y. (2017) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2017.2747126 · Cited by 586
Learning a Deep Convolutional Network for Light-Field Image Super-Resolution
Yoon, Y., Jeon, H.-G., Yoo, D., Lee, J.-Y., & Kweon, I. S. (2015) · 2015 IEEE International Conference on Computer Vision Workshop (ICCVW) · doi:10.1109/iccvw.2015.17 · Cited by 403
Soft 3D reconstruction for view synthesis
Penner, E., & Zhang, L. (2017) · ACM Transactions on Graphics · doi:10.1145/3130800.3130855 · Cited by 358
Robust depth estimation for light field via spinning parallelogram operator
Zhang, S., Sheng, H., Li, C., Zhang, J., & Xiong, Z. (2016) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2015.12.007 · Cited by 326
Metadata
- Authors
- Wanner, S., & Goldluecke, B.
- Venue
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- Published
- 2014-03
- Volume
- 36
- Issue
- 3
- Pages
- 606-619
- ISSN
- 0162-8828 (ISSN-L)
- 2160-9292
- OpenAlex
- W2042687553
- Cited by
- 615
- References
- 23
- FWCI
- 34.20
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.