The DOI matches its Crossref record; 63 of the 63 references it cites were found in a registry or an index.
Disentangling Light Fields for Super-Resolution and Disparity Estimation
Open accessAbstract
Light field (LF) cameras record both intensity and directions of light rays, and encode 3D scenes into 4D LF images. Recently, many convolutional neural networks (CNNs) have been proposed for various LF image processing tasks. However, it is challenging for CNNs to effectively process LF images since the spatial and angular information are highly inter-twined with varying disparities. In this paper, we propose a generic mechanism to disentangle these coupled information for LF image processing. Specifically, we first design a class of domain-specific convolutions to disentangle LFs from different dimensions, and then leverage these disentangled features by designing task-specific modules. Our disentangling mechanism can well incorporate the LF structure prior and effectively handle 4D LF data. Based on the proposed mechanism, we develop three networks (i.e., DistgSSR, DistgASR and DistgDisp) for spatial super-resolution, angular super-resolution and disparity estimation. Experimental results show that our networks achieve state-of-the-art performance on all these three tasks, which demonstrates the effectiveness, efficiency, and generality of our disentangling mechanism. Project page: https://yingqianwang.github.io/DistgLF/.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Accurate Image Super-Resolution Using Very Deep Convolutional Networks
Kim, J., Lee, J. K., & Lee, K. M. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.182 · Cited by 7,870
Enhanced Deep Residual Networks for Single Image Super-Resolution
Lim, B., Son, S., Kim, H., Nah, S., & Lee, K. M. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2017.151 · Cited by 7,736
Image Super-Resolution Using Very Deep Residual Channel Attention Networks
Zhang, Y., Li, K., Li, K., Wang, L., Zhong, B., & Fu, Y. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01234-2_18 · Cited by 5,708
Self-citationLearning a Deep Convolutional Network for Image Super-Resolution
Dong, C., Loy, C. C., He, K., & Tang, X. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10593-2_13 · Cited by 5,494
Levoy, M., & Hanrahan, P. (1996) · Proceedings of the 23rd annual conference on Computer graphics and interactive techniques · doi:10.1145/237170.237199 · Cited by 3,755
Learning-based view synthesis for light field cameras
Kalantari, N. K., Wang, T.-C., & Ramamoorthi, R. (2016) · ACM Transactions on Graphics · doi:10.1145/2980179.2980251 · Cited by 726
Variational Light Field Analysis for Disparity Estimation and Super-Resolution
Wanner, S., & Goldluecke, B. (2014) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.147 · Cited by 615
Light Field Image Processing: An Overview
Wu, G., Masia, B., Jarabo, A., Zhang, Y., Wang, L., Dai, Q., Chai, T., & Liu, Y. (2017) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2017.2747126 · Cited by 586
Self-citationAccurate depth map estimation from a lenslet light field camera
Jeon, H., Park, J., Choe, G., Park, J., Bok, Y., Tai, Y., & Kweon, I. S. (2015) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2015.7298762 · Cited by 542
Depth from Combining Defocus and Correspondence Using Light-Field Cameras
Tao, M. W., Hadap, S., Malik, J., & Ramamoorthi, R. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.89 · Cited by 506
Learning a Deep Convolutional Network for Light-Field Image Super-Resolution
Yoon, Y., Jeon, H.-G., Yoo, D., Lee, J.-Y., & Kweon, I. S. (2015) · 2015 IEEE International Conference on Computer Vision Workshop (ICCVW) · doi:10.1109/iccvw.2015.17 · Cited by 403
The Light Field Camera: Extended Depth of Field, Aliasing, and Superresolution
Bishop, T. E., & Favaro, P. (2012) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2011.168 · Cited by 369
Robust depth estimation for light field via spinning parallelogram operator
Zhang, S., Sheng, H., Li, C., Zhang, J., & Xiong, Z. (2016) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2015.12.007 · Cited by 326
Shin, C., Jeon, H.-G., Yoon, Y., Kweon, I. S., & Kim, S. J. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00499 · Cited by 319
High performance imaging using large camera arrays
Wilburn, B., Joshi, N., Vaish, V., Talvala, E.-V., Antunez, E., Barth, A., Adams, A., Horowitz, M., & Levoy, M. (2005) · ACM SIGGRAPH 2005 Papers · doi:10.1145/1186822.1073259 · Cited by 258
Light Field Spatial Super-Resolution Using Deep Efficient Spatial-Angular Separable Convolution
Yeung, H. W. F., Hou, J., Chen, X., Chen, J., Chen, Z., & Chung, Y. Y. (2019) · IEEE Transactions on Image Processing · doi:10.1109/tip.2018.2885236 · Cited by 248
Residual Networks for Light Field Image Super-Resolution
Zhang, S., Lin, Y., & Sheng, H. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.01130 · Cited by 247
Light-Field Image Super-Resolution Using Convolutional Neural Network
Yoon, Y., Jeon, H., Yoo, D., Lee, J., & Kweon, I. S. (2017) · IEEE Signal Processing Letters · doi:10.1109/lsp.2017.2669333 · Cited by 220
Light Field Reconstruction Using Shearlet Transform
Vagharshakyan, S., Bregovic, R., & Gotchev, A. (2018) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2653101 · Cited by 217
Light Field Reconstruction Using Deep Convolutional Network on EPI
Wu, G., Zhao, M., Wang, L., Dai, Q., Chai, T., & Liu, Y. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.178 · Cited by 214
Self-citationLight Field Inpainting Propagation via Low Rank Matrix Completion
Le Pendu, M., Jiang, X., & Guillemot, C. (2018) · IEEE Transactions on Image Processing · doi:10.1109/tip.2018.2791864 · Cited by 212
Spatial-Angular Interaction for Light Field Image Super-Resolution
Wang, Y., Wang, L., Yang, J., An, W., Yu, J., & Guo, Y. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58592-1_18 · Cited by 208
Self-citationMitra, K., & Veeraraghavan, A. (2012) · 2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops · doi:10.1109/cvprw.2012.6239346 · Cited by 198
Depth Estimation with Occlusion Modeling Using Light-Field Cameras
Wang, T.-C., Efros, A. A., & Ramamoorthi, R. (2016) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2515615 · Cited by 191
Wang, Y., Liu, F., Zhang, K., Hou, G., Sun, Z., & Tan, T. (2018) · IEEE Transactions on Image Processing · doi:10.1109/tip.2018.2834819 · Cited by 189
Self-citationJin, J., Hou, J., Chen, J., & Kwong, S. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00233 · Cited by 188
Light Field Image Super-Resolution Using Deformable Convolution
Wang, Y., Yang, J., Wang, L., Ying, X., Wu, T., An, W., & Guo, Y. (2021) · IEEE Transactions on Image Processing · doi:10.1109/tip.2020.3042059 · Cited by 177
Self-citationFast Light Field Reconstruction with Deep Coarse-to-Fine Modeling of Spatial-Angular Clues
Yeung, H. W. F., Hou, J., Chen, J., Chung, Y. Y., & Chen, X. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01231-1_9 · Cited by 175
Attention-Based View Selection Networks for Light-Field Disparity Estimation
Tsai, Y.-J., Liu, Y.-L., Ouhyoung, M., & Chuang, Y. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i07.6888 · Cited by 174
High-Dimensional Dense Residual Convolutional Neural Network for Light Field Reconstruction
Meng, N., So, H. K., Sun, X., & Lam, E. Y. M. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2945027 · Cited by 170
Light Field Reconstruction Using Convolutional Network on EPI and Extended Applications
Wu, G., Liu, Y., Fang, L., Dai, Q., & Chai, T. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2845393 · Cited by 164
Self-citationSelective Light Field Refocusing for Camera Arrays Using Bokeh Rendering and Superresolution
Wang, Y., Yang, J., Guo, Y., Xiao, C., & An, W. (2018) · IEEE Signal Processing Letters · doi:10.1109/lsp.2018.2885213 · Cited by 156
Self-citationConvolutional Networks for Shape from Light Field
Heber, S., & Pock, T. (2016) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2016.407 · Cited by 149
Robust Light Field Depth Estimation Using Occlusion-Noise Aware Data Costs
Williem, W., Park, I. K., & Lee, K. M. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2746858 · Cited by 149
Learning Sheared EPI Structure for Light Field Reconstruction
Wu, G., Liu, Y., Dai, Q., et al. (2019) · IEEE Transactions on Image Processing · doi:10.1109/tip.2019.2895463 · Cited by 148
Self-citationGeometry-Consistent Light Field Super-Resolution via Graph-Based Regularization
Rossi, M., & Frossard, P. (2018) · IEEE Transactions on Image Processing · doi:10.1109/tip.2018.2828983 · Cited by 147
End-to-End View Synthesis for Light Field Imaging with Pseudo 4DCNN
Wang, Y., Liu, F., Wang, Z., Hou, G., Sun, Z., & Tan, T. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01216-8_21 · Cited by 147
Self-citationLearning Light Field Angular Super-Resolution via a Geometry-Aware Network
Jin, J., Hou, J., Yuan, H., & Kwong, S. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i07.6771 · Cited by 142
Jin, J., Hou, J., Chen, J., Zeng, H., Kwong, S., & Jingyi Yu, A. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.3026039 · Cited by 125
End-to-End Light Field Spatial Super-Resolution Network Using Multiple Epipolar Geometry
Zhang, S., Song, C., & Lin, Y. (2021) · IEEE Transactions on Image Processing · doi:10.1109/tip.2021.3079805 · Cited by 122
Depth from a Light Field Image with Learning-Based Matching Costs
Jeon, H., Park, J., Choe, G., Park, J., Bok, Y., Tai, Y., & Kweon, I. S. (2018) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2794979 · Cited by 118
Occlusion-aware depth estimation for light field using multi-orientation EPIs
Sheng, H., Zhao, P., Zhang, S., Zhang, J., & Yang, D. (2017) · Pattern Recognition · doi:10.1016/j.patcog.2017.09.010 · Cited by 107
Neural EPI-Volume Networks for Shape from Light Field
Heber, S., Yu, W. B., & Pock, T. (2017) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.247 · Cited by 106
Super Resolution of Light Field Images Using Linear Subspace Projection of Patch-Volumes
Farrugia, R. A., Galea, C., & Guillemot, C. M. (2017) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2017.2747127 · Cited by 105
DeOccNet: Learning to See Through Foreground Occlusions in Light Fields
Wang, Y., Wu, T., Yang, J., Wang, L., An, W., & Guo, Y. (2020) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv45572.2020.9093448 · Cited by 100
Self-citationAttention-based Multi-Level Fusion Network for Light Field Depth Estimation
Chen, J., Zhang, S., & Lin, Y. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i2.16185 · Cited by 93
Light-Field Image Superresolution Using a Combined Deep CNN Based on EPI
Yuan, Y., Cao, Z., & Su, L. (2018) · IEEE Signal Processing Letters · doi:10.1109/lsp.2018.2856619 · Cited by 91
Revisiting Light Field Rendering with Deep Anti-Aliasing Neural Network
Wu, G., Liu, Y., Fang, L., & Chai, T. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3073739 · Cited by 83
Self-citationLight Field Super-Resolution with Zero-Shot Learning
Cheng, Z., Xiong, Z., Chen, C., Liu, D., & Zha, Z.-J. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00988 · Cited by 82
Light Field Super-Resolution via LFBM5D Sparse Coding
Alain, M., & Smolić, A. (2018) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2018.8451162 · Cited by 79
Light Field Super-Resolution via Adaptive Feature Remixing
Ko, K., Koh, Y. J., Chang, S., & Kim, C. (2021) · IEEE Transactions on Image Processing · doi:10.1109/tip.2021.3069291 · Cited by 79
Spatial-Angular Attention Network for Light Field Reconstruction
Wu, G., Wang, Y., Liu, Y., Fang, L., & Chai, T. (2021) · IEEE Transactions on Image Processing · doi:10.1109/tip.2021.3122089 · Cited by 78
Self-citationLearning Fused Pixel and Feature-Based View Reconstructions for Light Fields
Shi, J., Jiang, X., & Guillemot, C. M. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00263 · Cited by 75
Deep Spatial-Angular Regularization for Light Field Imaging, Denoising, and Super-Resolution
Guo, M., Hou, J., Jin, J., Chen, J., & Chau, L. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3087485 · Cited by 73
Light Field Intrinsics with a Deep Encoder-Decoder Network
Alperovich, A., Johannsen, O., Strecke, M., & Goldlüecke, B. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00953 · Cited by 68
Multi-Angular Epipolar Geometry Based Light Field Angular Reconstruction Network
Liu, D., Huang, Y., Wu, Q., Ma, R., & An, P. (2020) · IEEE Transactions on Computational Imaging · doi:10.1109/tci.2020.3037413 · Cited by 62
Single image super-resolution via BM3D sparse coding
Egiazarian, K., & Katkovnik, V. (2015) · 2015 23rd European Signal Processing Conference (EUSIPCO) · doi:10.1109/eusipco.2015.7362905 · Cited by 58
EPI-Patch Based Convolutional Neural Network for Depth Estimation on 4D Light Field
Luo, Y., Zhou, W., Fang, J., Liang, L., Zhang, H., & Dai, G. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-70090-8_65 · Cited by 54
Learning to Think Outside the Box: Wide-Baseline Light Field Depth Estimation with EPI-Shift
Leistner, T., Schilling, H., Mackowiak, R., Gumhold, S., & Rother, C. (2019) · International Conference on 3D Vision (3DV) · doi:10.1109/3dv.2019.00036 · Cited by 52
Light field denoising by sparse 5D transform domain collaborative filtering
Alain, M., & Smolić, A. (2017) · IEEE International Workshop on Multimedia Signal Processing (MMSP) · doi:10.1109/mmsp.2017.8122232 · Cited by 51
Light Field View Synthesis via Aperture Disparity and Warping Confidence Map
Meng, N., Li, K., Liu, J., & Lam, E. Y. (2021) · IEEE Transactions on Image Processing · doi:10.1109/tip.2021.3066293 · Cited by 30
Deep Spatial-Angular Regularization for Compressive Light Field Reconstruction over Coded Apertures
Guo, M., Hou, J., Jin, J., Chen, J., & Chau, L. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58536-5_17 · Cited by 28
Mask4D: 4D Convolution Network for Light Field Occlusion Removal
Li, Y., Yang, W., Xu, Z., et al. (2021) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp39728.2021.9413449 · Cited by 25
Cited by
Adaptive EPI-Matching Cost for Light Field Disparity Estimation
Wang, T., Sheng, H., Chen, R., Cong, R., Zhao, M., & Cui, Z. (2024) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2024.3488147 · Cited by 348
Metadata
- Authors
- Wang, Y., Wang, L., Wu, G., Yang, J., An, W., Yu, J., & Guo, Y.
- Venue
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- Published
- 2023-01-01
- Volume
- 45
- Issue
- 1
- Pages
- 425-443
- ISSN
- 0162-8828 (ISSN-L)
- 2160-9292
- 1939-3539
- OpenAlex
- W4213117431
- Cited by
- 321
- References
- 63
- FWCI
- 21.37
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.