The DOI matches its Crossref record; 28 of the 28 references it cites were found in a registry or an index.
EPINET: A Fully-Convolutional Neural Network Using Epipolar Geometry for Depth from Light Field Images
Open accessAbstract
Light field cameras capture both the spatial and the angular properties of light rays in space. Due to its property, one can compute the depth from light fields in uncontrolled lighting environments, which is a big advantage over active sensing devices. Depth computed from light fields can be used for many applications including 3D modelling and refocusing. However, light field images from hand-held cameras have very narrow baselines with noise, making the depth estimation difficult. Many approaches have been proposed to overcome these limitations for the light field depth estimation, but there is a clear trade-off between the accuracy and the speed in these methods. In this paper, we introduce a fast and accurate light field depth estimation method based on a fully-convolutional neural network. Our network is designed by considering the light field geometry and we also overcome the lack of training data by proposing light field specific data augmentation methods. We achieved the top rank in the HCI 4D Light Field Benchmark on most metrics, and we also demonstrate the effectiveness of the proposed method on real-world light-field images.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Fully convolutional networks for semantic segmentation
Long, J., Shelhamer, E., & Darrell, T. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298965 · Cited by 38,834
(2016) · Cited by 11,679
Flownet: Learning optical flow with convolutional networks
Dosovitskiy, A., Fischer, P., Ilg, E., Hausser, P., Hazirbas, C., Golkov, V., Smagt, P. V. D., Cremers, D., & Brox, T. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.316 · Cited by 4,313
Levoy, M., & Hanrahan, P. (1996) · Proceedings of the 23rd annual conference on Computer graphics and interactive techniques · doi:10.1145/237170.237199 · Cited by 3,755
Gortler, S. J., Grzeszczuk, R., Szeliski, R., & Cohen, M. F. (1996) · Proceedings of the 23rd annual conference on Computer graphics and interactive techniques · doi:10.1145/237170.237200 · Cited by 2,458
Mayer, N., Ilg, E., Cremers, D., Dosovitskiy, A., & Brox, T. (2016) · Cited by 1,214
High performance imaging using large camera arrays
Wilburn, B., Joshi, N., Vaish, V., Talvala, E.-V., Antunez, E., Barth, A., Adams, A., Horowitz, M., & Levoy, M. (2005) · ACM Transactions on Graphics · doi:10.1145/1073204.1073259 · Cited by 1,042
Efficient Deep Learning for Stereo Matching
Luo, W., Schwing, A. G., & Urtasun, R. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.614 · Cited by 741
Learning-based view synthesis for light field cameras
Kalantari, N. K., Wang, T.-C., & Ramamoorthi, R. (2016) · ACM Transactions on Graphics · doi:10.1145/2980179.2980251 · Cited by 726
A Dataset and Evaluation Methodology for Depth Estimation on 4D Light Fields
Honauer, K., Johannsen, O., Kondermann, D., & Goldluecke, B. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-54187-7_2 · Cited by 642
Variational Light Field Analysis for Disparity Estimation and Super-Resolution
Wanner, S., & Goldluecke, B. (2014) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.147 · Cited by 615
Decoding, Calibration and Rectification for Lenselet-Based Plenoptic Cameras
Dansereau, D. G., Pizarro, O., & Williams, S. B. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.137 · Cited by 533
Depth from Combining Defocus and Correspondence Using Light-Field Cameras
Tao, M. W., Hadap, S., Malik, J., & Ramamoorthi, R. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.89 · Cited by 506
Accurate depth map estimation from a lenslet light field camera
Jeon, H., Park, J., Choe, G., et al. (2015) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2015.7298762 · Cited by 464
Self-citationLearning a Deep Convolutional Network for Light-Field Image Super-Resolution
Yoon, Y., Jeon, H.-G., Yoo, D., Lee, J.-Y., & Kweon, I. S. (2015) · 2015 IEEE International Conference on Computer Vision Workshop (ICCVW) · doi:10.1109/iccvw.2015.17 · Cited by 403
Self-citationGlobally consistent depth labeling of 4D light fields
Wanner, S., & Goldlüecke, B. (2012) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2012.6247656 · Cited by 344
Robust depth estimation for light field via spinning parallelogram operator
Zhang, S., Sheng, H., Li, C., Zhang, J., & Xiong, Z. (2016) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2015.12.007 · Cited by 326
Constant Time Weighted Median Filtering for Stereo Matching and Beyond
Ma, Z., He, K., Wei, Y., Sun, J., & Wu, E. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.13 · Cited by 292
Learning to Synthesize a 4D RGBD Light Field from a Single Image
Srinivasan, P. P., Wang, T., Sreelal, A., Ramamoorthi, R., & Ng, R. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.246 · Cited by 244
Light-Field Image Super-Resolution Using Convolutional Neural Network
Yoon, Y., Jeon, H., Yoo, D., et al. (2017) · IEEE Signal Processing Letters · doi:10.1109/lsp.2017.2669333 · Cited by 205
Self-citationDepth Estimation with Occlusion Modeling Using Light-Field Cameras
Wang, T.-C., Efros, A. A., & Ramamoorthi, R. (2016) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2515615 · Cited by 191
A 4D Light-Field Dataset and CNN Architectures for Material Recognition
Wang, T.-C., Zhu, J.-Y., Hiroaki, E., Chandraker, M., Efros, A. A., & Ramamoorthi, R. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46487-9_8 · Cited by 173
Line Assisted Light Field Triangulation and Stereo Matching
Yu, Z., Xinqing Guo, A., Ling, H., Lumsdaine, A., & Jingyi Yu, A. (2013) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2013.347 · Cited by 165
Convolutional Networks for Shape from Light Field
Heber, S., & Pock, T. (2016) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2016.407 · Cited by 126
Robust Light Field Depth Estimation for Noisy Scene with Occlusion
Williem, W., & Park, I. K. (2016) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2016.476 · Cited by 115
What Sparse Light Field Coding Reveals about Scene Structure
Johannsen, O., Sulc, A., & Goldlüecke, B. (2016) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2016.355 · Cited by 106
Neural EPI-Volume Networks for Shape from Light Field
Heber, S., Yu, W. B., & Pock, T. (2017) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.247 · Cited by 106
Shape from Light Field Meets Robust PCA
Heber, S., & Pock, T. (2014) · Lecture notes in computer science · doi:10.1007/978-3-319-10599-4_48 · Cited by 88
Cited by
Data augmentation: A comprehensive survey of modern approaches
Mumuni, A., & Mumuni, F. (2022) · Array · doi:10.1016/j.array.2022.100258 · Cited by 891
Adaptive EPI-Matching Cost for Light Field Disparity Estimation
Wang, T., Sheng, H., Chen, R., Cong, R., Zhao, M., & Cui, Z. (2024) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2024.3488147 · Cited by 348
Metadata
- Authors
- Shin, C., Jeon, H.-G., Yoon, Y., Kweon, I. S., & Kim, S. J.
- Venue
- 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition
- Publisher
- IEEE
- Published
- 2018-06
- Pages
- 4748-4757
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W2964178790
- Cited by
- 319
- References
- 28
- FWCI
- 8.77
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.