Light field image denoising using a linear 4D frequency-hyperfan all-in-focus filter
The DOI matches its Crossref record; 12 of the 12 references it cites were found in a registry or an index.
Abstract
Imaging in low light is problematic as sensor noise can dominate imagery, and increasing illumination or aperture size is not always effective or practical. Computational photography offers a promising solution in the form of the light field camera, which by capturing redundant information offers an opportunity for elegant noise rejection. We show that the light field of a Lambertian scene has a 4D hyperfan-shaped frequency-domain region of support at the intersection of a dual-fan and a hypercone. By designing and implementing a filter with appropriately shaped passband we accomplish denoising with a single all-in-focus linear filter. Drawing examples from the Stanford Light Field Archive and images captured using a commercially available lenselet- based plenoptic camera, we demonstrate that the hyperfan outperforms competing methods including synthetic focus, fan-shaped antialiasing filters, and a range of modern nonlinear image and video denoising techniques. We show the hyperfan preserves depth of field, making it a single-step all-in-focus denoising filter suitable for general-purpose light field rendering. We include results for different noise types and levels, over a variety of metrics, and in real-world scenarios. Finally, we show that the hyperfan’s performance scales with aperture count.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Light-field cameras offer several advantages over standard cameras, such as depth estimation, noise reduction [57], video stabilization [227], isolation of distractors [58], and specularity removal [119].”
From Past, Present, and Future of Simultaneous Localization and Mapping: Toward the Robust-Perception Age (2016) · cites this paper as [57]
Citations
Cites
Image quality assessment: from error visibility to structural similarity
Wang, Z., Bovik, A. C., Sheikh, H. R., & Simoncelli, E. P. (2004) · IEEE Transactions on Image Processing · doi:10.1109/tip.2003.819861 · Cited by 57,892
$rm K$-SVD: An Algorithm for Designing Overcomplete Dictionaries for Sparse Representation
Aharon, M., Elad, M., & Bruckstein, A. (2006) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2006.881199 · Cited by 9,451
Image Denoising Via Sparse and Redundant Representations Over Learned Dictionaries
Elad, M., & Aharon, M. (2006) · IEEE Transactions on Image Processing · doi:10.1109/tip.2006.881969 · Cited by 5,321
A Review of Image Denoising Algorithms, with a New One
Buades, A., Coll, B., & Morel, J. M. (2005) · Multiscale Modeling & Simulation · doi:10.1137/040616024 · Cited by 4,083
Light Field Photography with a Hand-held Plenoptic Camera
Ng, R., Levoy, M., Brédif, M., Duval, G., Horowitz, M., & Hanrahan, P. (2005) · HAL · Cited by 1,749
High performance imaging using large camera arrays
Wilburn, B., Joshi, N., Vaish, V., Talvala, E.-V., Antunez, E., Barth, A., Adams, A., Horowitz, M., & Levoy, M. (2005) · ACM Transactions on Graphics · doi:10.1145/1073204.1073259 · Cited by 1,042
Epipolar-plane image analysis: An approach to determining structure from motion
Bolles, R. C., Baker, H. H., & Marimont, D. H. (1987) · International Journal of Computer Vision · doi:10.1007/bf00128525 · Cited by 892
Veeraraghavan, A., Raskar, R., Agrawal, A., Mohan, A., & Tumblin, J. (2007) · ACM SIGGRAPH 2007 papers · doi:10.1145/1275808.1276463 · Cited by 469
Video Denoising By Sparse 3D Transform-Domain Collaborative Filtering
Dabov, K., Foi, A., & Egiazarian, K. (2007) · doi:10.5281/zenodo.40233 · Cited by 373
Synthetic aperture confocal imaging
Levoy, M., Chen, B., Vaish, V., Horowitz, M., McDowall, I., & Bolas, M. (2004) · ACM Transactions on Graphics · doi:10.1145/1015706.1015806 · Cited by 188
Cited by
Past, Present, and Future of Simultaneous Localization and Mapping: Toward the Robust-Perception Age
Cadena, C., Carlone, L., Carrillo, H., Latif, Y., Scaramuzza, D., Neira, J., Reid, I., & Leonard, J. J. (2016) · IEEE Transactions on Robotics · doi:10.1109/tro.2016.2624754 · Cited by 3,596
“Light-field cameras offer several advantages over standard cameras, such as depth estimation, noise reduction [58], video stabilization [227], isolation of distractors [59], and specularity removal [119].”
Past, present, and future of simultaneous localization and mapping: Toward the robust-perception age
Cadena, C., Carlone, L., Carrillo, H., Latif, Y., Scaramuzza, D., Neira, J., Reid, I. D., & Leonard, J. J. (2016) · Zurich Open Repository and Archive (University of Zurich) · doi:10.5167/uzh-138892 · Cited by 3,048
Decoding, Calibration and Rectification for Lenselet-Based Plenoptic Cameras
Dansereau, D. G., Pizarro, O., & Williams, S. B. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.137 · Cited by 533
Self-citationLu, H., Li, Y., Uemura, T., Kim, H., & Serikawa, S. (2018) · Future Generation Computer Systems · doi:10.1016/j.future.2018.01.001 · Cited by 290
Linear Volumetric Focus for Light Field Cameras
Dansereau, D. G., Pizarro, O. R., & Williams, S. B. (2015) · ACM Transactions on Graphics · doi:10.1145/2665074 · Cited by 157
Self-citationTowards a Quality Metric for Dense Light Fields
Adhikarla, V. K., Vinkler, M., Sumin, D., Mantiuk, R., Myszkowski, K., Seidel, H., & Didyk, P. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.396 · Cited by 132
A Light Transport Framework for Lenslet Light Field Cameras
Liang, C., & Ramamoorthi, R. (2015) · ACM Transactions on Graphics · doi:10.1145/2665075 · Cited by 117
Depth from a Light Field Image with Learning-Based Matching Costs
Jeon, H., Park, J., Choe, G., Park, J., Bok, Y., Tai, Y., & Kweon, I. S. (2018) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2794979 · Cited by 118
A Fourier Disparity Layer Representation for Light Fields
Pendu, M. L., Guillemot, C. M., & Smolic, A. (2019) · IEEE Transactions on Image Processing · doi:10.1109/tip.2019.2922099 · Cited by 73
Deep Spatial-Angular Regularization for Light Field Imaging, Denoising, and Super-Resolution
Guo, M., Hou, J., Jin, J., Chen, J., & Chau, L. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3087485 · Cited by 73
Madanayake, A., Wijenayake, C. A., Dansereau, D. G., Gunaratne, T., Bruton, L. T., & Williams, S. B. (2013) · IEEE Circuits and Systems Magazine · doi:10.1109/mcas.2012.2237141 · Cited by 59
Self-citationLight Field Denoising via Anisotropic Parallax Analysis in a CNN Framework
Chen, J., Hou, J., & Chau, L. (2018) · IEEE Signal Processing Letters · doi:10.1109/lsp.2018.2861212 · Cited by 56
Harnessing Multi-View Perspective of Light Fields for Low-Light Imaging
Lamba, M., Rachavarapu, K. K., & Mitra, K. (2020) · IEEE Transactions on Image Processing · doi:10.1109/tip.2020.3045617 · Cited by 59
Light field denoising by sparse 5D transform domain collaborative filtering
Alain, M., & Smolić, A. (2017) · IEEE International Workshop on Multimedia Signal Processing (MMSP) · doi:10.1109/mmsp.2017.8122232 · Cited by 51
Light Filed Image Quality Assessment by Local and Global Features of Epipolar Plane Image
Fang, Y., Wei, K., Hou, J., Wen, W., & İmamoğlu, N. (2018) · IEEE International Conference on Multimedia Big Data · doi:10.1109/bigmm.2018.8499086 · Cited by 51
Multi-Volumetric Refocusing of Light Fields
Jayaweera, S. S., Edussooriya, C. U. S., Wijenayake, C. A., Agathoklis, P., & Bruton, L. T. (2020) · IEEE Signal Processing Letters · doi:10.1109/lsp.2020.3043990 · Cited by 46
Five-Dimensional Depth-Velocity Filtering for Enhancing Moving Objects in Light Field Videos
Edussooriya, C. U. S., Dansereau, D. G., Bruton, L. T., & Agathoklis, P. (2015) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2015.2408559 · Cited by 45
Self-citationMulti-Stream Progressive Restoration for Low-Light Light Field Enhancement and Denoising
Wang, X., Lin, Y., & Zhang, S. (2023) · IEEE Transactions on Computational Imaging · doi:10.1109/tci.2023.3241550 · Cited by 44
Light field denoising: exploiting the redundancy of an epipolar sequence representation
Sepas‐Moghaddam, A., Correia, P. L., & Pereira, F. M. B. (2016) · 3DTV-Conference: The True Vision - Capture, Transmission and Display of 3D Video · doi:10.1109/3dtv.2016.7548963 · Cited by 28
PMSNet: Parallel Multi-Scale Network for Accurate Low-Light Light-Field Image Enhancement
Wang, X., Chen, K., Wang, Z., & Huang, W. (2023) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2023.3291498 · Cited by 28
Fast and Efficient Restoration of Extremely Dark Light Fields
Lamba, M., & Mitra, K. (2022) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv51458.2022.00321 · Cited by 27
Multi-depth filtering and occlusion suppression in 4-D light fields: Algorithms and architectures
Liyanage, N., Wijenayake, C. A., Edussooriya, C. U. S., Madanayake, A., Agathoklis, P., Bruton, L. T., & Ambikairajah, E. (2019) · Signal Processing · doi:10.1016/j.sigpro.2019.107294 · Cited by 22
Real-Time Light Field Denoising Using a Novel Linear 4-D Hyperfan Filter
Premaratne, S. U., Liyanage, N., Edussooriya, C. U. S., & Wijenayake, C. A. (2020) · IEEE Transactions on Circuits and Systems I Regular Papers · doi:10.1109/tcsi.2020.2981387 · Cited by 19
A new imaging model of Lytro light field camera and its calibration
Duan, H., Mei, L., Wang, J., Song, L., & Liu, N. (2018) · Neurocomputing · doi:10.1016/j.neucom.2018.05.118 · Cited by 17
Dynamic spectral-based underwater colour correction
Bongiorno, D. L., Bryson, M., & Williams, S. B. (2013) · MTS/IEEE OCEANS Conference (OCEANS) · doi:10.1109/oceans-bergen.2013.6607982 · Cited by 16
Self-citationBenefits of plenoptic cameras for robot vision during close range on-orbit servicing maneuvers
Lingenauber, M., Strobl, K. H., Oumer, N. W., & Kriegel, S. (2017) · IEEE Aerospace Conference (AERO) · doi:10.1109/aero.2017.7943666 · Cited by 16
Denoising multi-view images by soft thresholding: A short-time DFT approach
Tomita, K., Tsutake, C., Takahashi, K., & Fujii, T. (2022) · Signal Processing Image Communication · doi:10.1016/j.image.2022.116710 · Cited by 14
A novel 5-D depth–velocity filter for enhancing noisy light field videos
Edussooriya, C. U. S., Bruton, L. T., & Agathoklis, P. (2016) · Multidimensional Systems and Signal Processing · doi:10.1007/s11045-016-0460-x · Cited by 14
Probabilistic-Based Feature Embedding of 4-D Light Fields for Compressive Imaging and Denoising
Lyu, X., & Hou, J. (2024) · International Journal of Computer Vision · doi:10.1007/s11263-023-01974-9 · Cited by 12
Underwater Light Field Depth Map Restoration Using Deep Convolutional Neural Fields
Lu, H., Li, Y., Kim, H., & Serikawa, S. (2017) · Studies in computational intelligence · doi:10.1007/978-3-319-69877-9_33 · Cited by 12
Real-Time Light Field Signal Processing Using 4D/5D Linear Digital Filter FPGA Circuits
Edussooriya, C. U. S., Wijenayake, C. A., Madanayake, A., Liyanage, N., Premaratne, S. U., Vorhies, J. T., Dansereau, D. G., Agathoklis, P., & Bruton, L. T. (2021) · IEEE Transactions on Circuits & Systems II Express Briefs · doi:10.1109/tcsii.2021.3057388 · Cited by 13
Self-citationLight Field Denoising Using 4D Anisotropic Diffusion
Allain, P., Guillo, L., & Guillemot, C. M. (2019) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2019.8682709 · Cited by 11
Robust dense light field reconstruction from sparse noisy sampling
Zhou, W., Shi, J., Hong, Y.-J., Lin, L., & Kuruoğlu, E. E. (2021) · Signal Processing · doi:10.1016/j.sigpro.2021.108121 · Cited by 13
Mask-Aware Light Field De-Occlusion With Gated Feature Aggregation and Texture-Semantic Attention
Chen, J., An, P., Huang, X., Chen, Y., Yang, C., & Shen, L. (2025) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2025.3543048 · Cited by 8
Bell, K., & Brennan, M. L. (2013) · Oceanography · doi:10.5670/oceanog.2013.supplement.01 · Cited by 9
4D FIR digital filter realizations
Kousoulis, M. T., & Antoniou, G. E. (2014) · IEEE Latin American Symposium on Circuits and Systems (LASCAS) · doi:10.1109/lascas.2014.6820246 · Cited by 8
A Study of Light Field Streaming for An Interactive Refocusing Application
Alain, M., Ozcinar, C., & Smolić, A. (2019) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2019.8803558 · Cited by 8
Tensor-Based Light Field Denoising by Integrating Super-Resolution
Liu, Y., Qi, N., Cheng, Z., Liu, D., Ling, Q. H., & Xiong, Z. (2018) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2018.8451105 · Cited by 7
Chen, Z., Chen, Y., Jiang, G., Yu, M., Xu, H., & Luo, T. (2024) · IEEE Transactions on Broadcasting · doi:10.1109/tbc.2024.3420748 · Cited by 6
Chen, Y., Jiang, G., Yu, M., Jiang, Z., & Ho, Y. (2021) · IEEE Sensors Journal · doi:10.1109/jsen.2021.3083885 · Cited by 6
Depth Estimation Through a Generative Model of Light Field Synthesis
Sajjadi, M. S. M., Köhler, R., Schölkopf, B., & Hirsch, M. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-45886-1_35 · Cited by 6
Reduced-Complexity Depth Filtering and Occlusion Suppression using Modulated-Sparse Light Fields
Liyanage, N., Wijenayake, C. A., Edussooriya, C. U. S., & Eliathamby Ambikairajah, A. (2019) · IEEE International Symposium on Circuits and Systems proceedings · doi:10.1109/iscas.2019.8702412 · Cited by 5
Wave-digital filter circuits for single-chip 4-D light field depth-based enhancement
Gullapalli, S. K., Edussooriya, C. U. S., Wijenayake, C. A., Dansereau, D. G., Bruton, L. T., & Madanayake, A. (2021) · Multidimensional Systems and Signal Processing · doi:10.1007/s11045-020-00751-y · Cited by 5
Self-citationHybrid Spatial and Frequency Network for Light Field Image Restoration
Duong, V. V., Huu, T. N., Yim, J., & Jeon, B. (2025) · IEEE Transactions on Computational Imaging · doi:10.1109/tci.2025.3587603 · Cited by 6
Interests of refocused images calibrated in depth with a multi-view camera for control by vision
Riou, C., Colicchio, B., Lauffenburger, J.-P., & Cudel, C. (2017) · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · doi:10.1117/12.2264237 · Cited by 4
Light Field Vision for Artificial Intelligence
Xu, Y., & Lam, M.-L. (2016) · Studies in computational intelligence · doi:10.1007/978-3-319-46245-5_11 · Cited by 3
Inverse of Affine Radon Transform for Light Field Reconstruction From Focal Stack
Qiu, J., Kang, X., Su, Z., Li, Q., & Liu, C. (2018) · IEEE Access · doi:10.1109/access.2018.2883693 · Cited by 3
Chekakta, Z., & Aouf, N. (2024) · IEEE Sensors Journal · doi:10.1109/jsen.2024.3435748 · Cited by 3
Exploiting parallax in panoramic capture to construct light fields
Dansereau, D. G., Wood, D. A., Montabone, S., & Williams, S. B. (2014) · QUT ePrints (Queensland University of Technology) · Cited by 3
Self-citationKhan, A. M., Hossain, M. M., Covaci, A., Sirlantzis, K., & Qi, Q. (2025) · IET Image Processing · doi:10.1049/ipr2.70099 · Cited by 2
Fast and robust Fourier domain ranging for light field
Guo, Z., Wu, J., Chen, X., Ma, S., Yang, P., & Xu, B. (2019) · Optical Engineering · doi:10.1117/1.oe.58.7.073102 · Cited by 2
Linear view/image restoration for dense light fields
Kodama, K., & Kubota, A. (2014) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2014.7026105 · Cited by 2
Hybrid Light Field Image Denoising Network using 4D-DCT Separated Transform
Duong, V. V., Huu, T. N., Yim, J., & Jeon, B. (2023) · IEEE International Conference on Visual Communications and Image Processing (VCIP) · doi:10.1109/vcip59821.2023.10402729 · Cited by 2
Tensor-Based Light Field Denoising By Exploiting Non-Local Similarities Across Multiple Resolutions
Wang, C., Qi, N., & Zhu, Q. X. (2020) · Proceedings - International Conference on Image Processing · doi:10.1109/icip40778.2020.9190646 · Cited by 2
Imaging Model and Calibration of Lytro Light Field Camera
Duan, H., Wang, J., Song, L., Liu, N., & Mei, L. (2017) · Communications in computer and information science · doi:10.1007/978-981-10-7305-2_34 · Cited by 1
Learning Light Field Denoising with Symmetrical Refocusing Strategy
Song, C., Lin, Y., Wang, W., An, D. W., & Zhang, S. (2024) · IEEE Transactions on Computational Imaging · doi:10.1109/tci.2024.3507642 · Cited by 1
Blind Unitary Transform Learning for Inverse Problems in Light-Field Imaging
Blocker, C. J., & Fessler, J. A. (2019) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2019.00487 · Cited by 1
On plenoptic sub-aperture view recovery
Seifi, M., Sabater, N., Drazic, V., & Pérez, P. (2016) · European Signal Processing Conference (EUSIPCO) · doi:10.1109/eusipco.2016.7760377
Allain, P., Guillo, L., & Guillemot, C. M. (2019) · IEEE Transactions on Computational Imaging · doi:10.1109/tci.2019.2919229
Spectral Analysis of Re-parameterized Light Field and Its Application in Light Field Denoising
Wang, T., He, D., Liu, C., & Qiu, J. (2022) · Frontiers in Optics · doi:10.1364/fio.2022.jw5b.64
Tiantian, 王. W., Di, 何. H., Liu, C., & Jun, 邱. Q. (2023) · Acta Optica Sinica · doi:10.3788/aos230659
Light Field Image and Video Compression
Bakir, N. (2020) · theses.fr (ABES) · doi:10.70675/6ec279f3zeb31z4faeza746zacfc954ef21b
Labussière, M. (2021) · theses.fr (ABES) · doi:10.70675/0a7797dfzfd82z429azb2abz7d02e0924198 · Cited by 4
Metadata
- Authors
- Dansereau, D. G., Bongiorno, D. L., Pizarro, O., & Williams, S. B.
- Affiliations
- The University of Sydney (AU)
- Venue
- SPIE Proceedings
- Publisher
- SPIE
- Published
- 2013-02-14
- Volume
- 8657
- Pages
- 86570P
- ISSN
- 0277-786X (ISSN-L)
- OpenAlex
- W1986879390
- Cited by
- 63
- References
- 12
- Citations by year
- 2025: 3 · 2024: 4 · 2023: 4 · 2022: 3 · 2021: 6 · 2020: 5 · 2019: 8 · 2018: 7 · 2017: 6 · 2016: 7 · 2015: 3 · 2014: 3 · 2013: 4
- FWCI
- 3.62
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE (publishedVersion)
- Funders
- Australian Government
- New South Wales Government
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Image and Signal Denoising Methods
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Image Enhancement Techniques
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Vision and Imaging
- Keywords
- plenoptic camera, low-light imaging, sensor noise, light field rendering, computational photography
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.