Cited by 1,221Image and Signal Denoising MethodsImage Enhancement TechniquesAdvanced Image Processing Techniques

Toward Convolutional Blind Denoising of Real Photographs

Open access
Guo, Shi, Yan, Zifei, Zhang, Kai, Zuo, Wangmeng, Zhang, Lei·2019·2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)

Abstract

While deep convolutional neural networks (CNNs) have achieved impressive success in image denoising with additive white Gaussian noise (AWGN), their performance remains limited on real-world noisy photographs. The main reason is that their learned models are easy to overfit on the simplified AWGN model which deviates severely from the complicated real-world noise model. In order to improve the generalization ability of deep CNN denoisers, we suggest training a convolutional blind denoising network (CBDNet) with more realistic noise model and real-world noisy-clean image pairs. On the one hand, both signal-dependent noise and in-camera signal processing pipeline is considered to synthesize realistic noisy images. On the other hand, real-world noisy photographs and their nearly noise-free counterparts are also included to train our CBDNet. To further provide an interactive strategy to rectify denoising result conveniently, a noise estimation subnetwork with asymmetric learning to suppress under-estimation of noise level is embedded into CBDNet. Extensive experimental results on three datasets of real-world noisy photographs clearly demonstrate the superior performance of CBDNet over state-of-the-arts in terms of quantitative met- rics and visual quality. The code has been made available at https://github.com/GuoShi28/CBDNet.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1109/cvpr.2019.00181

Cites

7 of 7 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 51

  1. Abdelrahman Abdelhamed, Stephen Lin, and Michael S Brown. A high-quality denoising dataset for smartphone cameras. In Proceedings of the IEEE Conference on Com- puter Vision and Pattern Recognition, pages 1692-1700, 2018.
  2. Saeed Anwar, Cong Phuoc Huynh, and Fatih Murat Porikli. Chaining identity mapping modules for image denoising. CoRR, abs/1712.02933, 2017. · arXiv
  3. Harold Christopher Burger, Christian J. Schuler, and Stefan Harmeling. Image denoising: Can plain neural networks compete with bm3d? 2012 IEEE Conference on Computer Vision and Pattern Recognition, pages 2392-2399, 2012.
  4. Vladimir Bychkovsky, Sylvain Paris, Eric Chan, and Frédo Durand. Learning photographic global tonal adjustment with a database of input / output image pairs. In The Twenty- Fourth IEEE Conference on Computer Vision and Pattern Recognition, 2011.
  5. Priyam Chatterjee and Peyman Milanfar. Is denoising dead? IEEE Transactions on Image Processing, 19:895-911, 2010.
  6. Guangyong Chen, Fengyuan Zhu, and Pheng-Ann Heng. An efficient statistical method for image noise level estimation. 2015 IEEE International Conference on Computer Vision (ICCV), pages 477-485, 2015.
  7. Jingwen Chen, Jiawei Chen, Hongyang Chao, and Ming Yang. Image blind denoising with generative adversarial net- work based noise modeling. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pages 3155-3164, 2018.
  8. Yunjin Chen and Thomas Pock. Trainable nonlinear reaction diffusion: A flexible framework for fast and effective image restoration. IEEE Transactions on Pattern Analysis and Ma- chine Intelligence, 39:1256-1272, 2017.
  9. Kostadin Dabov, Alessandro Foi, Vladimir Katkovnik, and Karen O. Egiazarian. Color image denoising via sparse 3d collaborative filtering with grouping constraint in luminance- chrominance space. 2007 IEEE International Conference on Image Processing, 1:I -313-I -316, 2007.
  10. Weisheng Dong, Lei Zhang, Guangming Shi, and Xin Li. Nonlocally centralized sparse representation for im- age restoration. IEEE Transactions on Image Processing, 22:1620-1630, 2013.
  11. Alessandro Foi, Mejdi Trimeche, Vladimir Katkovnik, and Karen O. Egiazarian. Practical poissonian-gaussian noise modeling and fitting for single-image raw-data. IEEE Trans- actions on Image Processing, 17:1737-1754, 2008.
  12. Michael D. Grossberg and Shree K. Nayar. Modeling the space of camera response functions. IEEE Transactions on Pattern Analysis and Machine Intelligence, 26:1272-1282, 2004.
  13. Youngbae Hwang, Jun-Sik Kim, and In-So Kweon. Difference-based image noise modeling using skellam distri- bution. IEEE Transactions on Pattern Analysis and Machine Intelligence, 34:1329-1341, 2012.
  14. Viren Jain and H. Sebastian Seung. Natural image denoising with convolutional networks. In NIPS, 2008.
  15. Justin Johnson, Alexandre Alahi, and Li Fei-Fei. Perceptual losses for real-time style transfer and super-resolution. In European Conference on Computer Vision, pages 694-711. Springer, 2016.
  16. Seon Joo Kim, Hai Ting Lin, Zheng Lu, Sabine Süsstrunk, Stephen Lin, and Michael S. Brown. A new in-camera imaging model for color computer vision and its application. IEEE Transactions on Pattern Analysis and Machine Intelli- gence, 34:2289-2302, 2012.
  17. Marc Lebrun, Antoni Buades, and Jean-Michel Morel. A nonlocal bayesian image denoising algorithm. SIAM Journal on Imaging Sciences, 6(3):1665-1688, 2013.
  18. Marc Lebrun, Miguel Colom, and Jean-Michel Morel. Mul- tiscale image blind denoising. IEEE Transactions on Image Processing, 24:3149-3161, 2015.
  19. Jaakko Lehtinen, Jacob Munkberg, Jon Hasselgren, Samuli Laine, Tero Karras, Miika Aittala, and Timo Aila. Noise2noise: Learning image restoration without clean data. arXiv preprint arXiv:1803.04189, 2018. · arXiv
  20. Anat Levin, Boaz Nadler, Frédo Durand, and William T. Freeman. Patch complexity, finite pixel correlations and op- timal denoising. In ECCV, 2012.
  21. Ce Liu, Richard Szeliski, Sing Bing Kang, C. Lawrence Zit- nick, and William T. Freeman. Automatic estimation and removal of noise from a single image. IEEE Transactions on Pattern Analysis and Machine Intelligence, 30:299-314, 2008.
  22. Pengju Liu, Hongzhi Zhang, Kai Zhang, Liang Lin, and Wangmeng Zuo. Multi-level wavelet-cnn for image restora- tion. CoRR, abs/1805.07071, 2018. · arXiv
  23. Xinhao Liu, Masayuki Tanaka, and Masatoshi Okutomi. Single-image noise level estimation for blind denoising. IEEE Transactions on Image Processing, 22:5226-5237, 2013.
  24. Xinhao Liu, Masayuki Tanaka, and Masatoshi Okutomi. Practical signal-dependent noise parameter estimation from a single noisy image. IEEE Transactions on Image Process- ing, 23:4361-4371, 2014.
  25. Kede Ma, Zhengfang Duanmu, Qingbo Wu, Zhou Wang, Hongwei Yong, Hongliang Li, and Lei Zhang. Waterloo exploration database: New challenges for image quality as- sessment models. IEEE Transactions on Image Processing, 26:1004-1016, 2016.
  26. Henrique S Malvar, Li-wei He, and Ross Cutler. High- quality linear interpolation for demosaicing of bayer- patterned color images. In Acoustics, Speech, and Signal Processing, 2004. Proceedings.(ICASSP'04). IEEE Interna- tional Conference on, volume 3, pages iii-485. IEEE, 2004.
  27. Xiao-Jiao Mao, Chunhua Shen, and Yu-Bin Yang. Image restoration using very deep convolutional encoder-decoder networks with symmetric skip connections. In NIPS, 2016.
  28. Charles H. Martin and Michael W. Mahoney. Rethinking generalization requires revisiting old ideas: statistical me- chanics approaches and complex learning behavior. CoRR, abs/1710.09553, 2017. · arXiv
  29. D. Martin, C. Fowlkes, D. Tal, and J. Malik. A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecologi- cal statistics. In Proc. 8th Int'l Conf. Computer Vision, vol- ume 2, pages 416-423, July 2001.
  30. Ben Mildenhall, Jonathan T Barron, Jiawen Chen, Dillon Sharlet, Ren Ng, and Robert Carroll. Burst denoising with kernel prediction networks. In Proceedings of the IEEE Con- ference on Computer Vision and Pattern Recognition, pages 2502-2510, 2018.
  31. Vinod Nair and Geoffrey E. Hinton. Rectified linear units improve restricted boltzmann machines. In ICML, 2010.
  32. Seonghyeon Nam, Youngbae Hwang, Yasuyuki Matsushita, and Seon Joo Kim. A holistic approach to cross-channel image noise modeling and its application to image denois- ing. 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 1683-1691, 2016.
  33. Alberto Ortiz and Gabriel Oliver. Radiometric calibration of ccd sensors: dark current and fixed pattern noise estima- tion. IEEE International Conference on Robotics and Au- tomation, 2004. Proceedings. ICRA '04. 2004, 5:4730-4735 Vol.5, 2004.
  34. Tobias Plotz and Stefan Roth. Benchmarking denoising al- gorithms with real photographs. 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 2750-2759, 2017.
  35. Javier Portilla. Blind non-white noise removal in images using gaussian scale mixtures in the wavelet domain. In Benelux Signal Processing Symposium, 2004.
  36. Javier Portilla. Full blind denoising through noise covariance estimation using gaussian scale mixtures in the wavelet do- main. 2004 International Conference on Image Processing, 2004. ICIP '04., 2:1217-1220 Vol.2, 2004.
  37. Stanislav Pyatykh, Jürgen Hesser, and Lei Zheng. Im- age noise level estimation by principal component analysis. IEEE Transactions on Image Processing, 22:687-699, 2013.
  38. Tamer F. Rabie. Robust estimation approach for blind de- noising. IEEE Transactions on Image Processing, 14:1755- 1765, 2005.
  39. Yaniv Romano, Michael Elad, and Peyman Milanfar. The little engine that could: Regularization by denoising (red). CoRR, abs/1611.02862, 2016. · arXiv
  40. Stefan Roth and Michael J. Black. Fields of experts: a frame- work for learning image priors. 2005 IEEE Computer Soci- ety Conference on Computer Vision and Pattern Recognition (CVPR'05), 2:860-867 vol. 2, 2005.
  41. Karen Simonyan and Andrew Zisserman. Very deep convo- lutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556, 2014. · arXiv
  42. Ying Tai, Jian Yang, Xiaoming Liu, and Chunyan Xu. Mem- net: A persistent memory network for image restoration. 2017 IEEE International Conference on Computer Vision (ICCV), pages 4549-4557, 2017.
  43. Andrea Vedaldi and Karel Lenc. Matconvnet -convolutional neural networks for matlab. In ACM Multimedia, 2015.
  44. Junyuan Xie, Linli Xu, and Enhong Chen. Image denoising and inpainting with deep neural networks. In NIPS, 2012.
  45. Jun Xu, Lei Zhang, and David Zhang. A trilateral weighted sparse coding scheme for real-world image denoising. In European Conference on Computer Vision, 2018.
  46. Jun Xu, Lei Zhang, David Zhang, and Xiangchu Feng. Multi-channel weighted nuclear norm minimization for real color image denoising. 2017 IEEE International Conference on Computer Vision (ICCV), pages 1105-1113, 2017.
  47. Dong Yang and Jian Sun. Bm3d-net: A convolutional neural network for transform-domain collaborative filtering. IEEE Signal Processing Letters, 25:55-59, 2018.
  48. Kai Zhang, Wangmeng Zuo, Yunjin Chen, Deyu Meng, and Lei Zhang. Beyond a gaussian denoiser: Residual learning of deep cnn for image denoising. IEEE Transactions on Image Processing, 26:3142-3155, 2017.
  49. Kai Zhang, Wangmeng Zuo, and Lei Zhang. Ffdnet: Toward a fast and flexible solution for cnn based image denoising. CoRR, abs/1710.04026, 2017. · arXiv
  50. Fengyuan Zhu, Guangyong Chen, and Pheng-Ann Heng. From noise modeling to blind image denoising. 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 420-429, 2016.
  51. Daniel Zoran and Yair Weiss. From learning models of natu- ral image patches to whole image restoration. 2011 Inter- national Conference on Computer Vision, pages 479-486, 2011.

Cited by

Sorted by citations

Authors
Guo, S., Yan, Z., Zhang, K., Zuo, W., & Zhang, L.
Affiliations
  • Hong Kong Polytechnic University (HK)
  • Harbin Institute of Technology (CN)
  • Hong Kong Polytechnic Univ.
Venue
2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
Publisher
IEEE
Published
2019-06
Pages
1712-1722
ISSN
1063-6919 (ISSN-L)
OpenAlex
W2963725279
Cited by
1,221
References
7
Citations by year
2026: 97 · 2025: 162 · 2024: 189 · 2023: 210 · 2022: 208 · 2021: 195 · 2020: 123 · 2019: 35 · 2018: 2
FWCI
45.72
Type
conference paper
Language
en
Open access
Locations
  • IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings (publishedVersion)
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
Funders
  • National Natural Science Foundation of China (61671182, 61672446, 61872118)
  • Hong Kong Polytechnic University
Topics
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Image and Signal Denoising Methods
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Image Enhancement Techniques
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Image Processing Techniques
Keywords
blind image denoising, signal-dependent noise, noise estimation, asymmetric learning, convolutional neural networks

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review