The DOI matches its Crossref record; 75 of the 75 references it cites were found in a registry or an index.
Denoising Prior Driven Deep Neural Network for Image Restoration
Open accessAbstract
Deep neural networks (DNNs) have shown very promising results for various image restoration (IR) tasks. However, the design of network architectures remains a major challenging for achieving further improvements. While most existing DNN-based methods solve the IR problems by directly mapping low quality images to desirable high-quality images, the observation models characterizing the image degradation processes have been largely ignored. In this paper, we first propose a denoising-based IR algorithm, whose iterative steps can be computed efficiently. Then, the iterative process is unfolded into a deep neural network, which is composed of multiple denoisers modules interleaved with back-projection (BP) modules that ensure the observation consistencies. A convolutional neural network (CNN) based denoiser that can exploit the multi-scale redundancies of natural images is proposed. As such, the proposed network not only exploits the powerful denoising ability of DNNs, but also leverages the prior of the observation model. Through end-to-end training, both the denoisers and the BP modules can be jointly optimized. Experimental results on several IR tasks, e.g., image denoisig, super-resolution and deblurring show that the proposed method can lead to very competitive and often state-of-the-art results on several IR tasks, including image denoising, deblurring, and super-resolution.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
U-Net: Convolutional Networks for Biomedical Image Segmentation
Ronneberger, O., Fischer, P., & Brox, T. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24574-4_28 · Cited by 99,404
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2577031 · Cited by 73,472
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2015) · arXiv · doi:10.48550/arxiv.1506.01497 · Cited by 70,812
Fully convolutional networks for semantic segmentation
Long, J., Shelhamer, E., & Darrell, T. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298965 · Cited by 38,834
Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification
He, K., Zhang, X., Ren, S., & Sun, J. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.123 · Cited by 19,741
Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network
Ledig, C., Theis, L., Huszar, F., Caballero, J., Cunningham, A., Acosta, A., Aitken, A., Tejani, A., Totz, J., Wang, Z., et al. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.19 · Cited by 12,696
Image denoising by sparse 3-D transform-domain collaborative filtering
Dabov, K., Foi, A., Katkovnik, V., & Egiazarian, K. (2007) · IEEE Transactions on Image Processing · doi:10.1109/tip.2007.901238 · Cited by 9,283
Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoising
Zhang, K., Zuo, W., Chen, Y., Meng, D., & Zhang, L. (2017) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2662206 · Cited by 8,983
Accurate Image Super-Resolution Using Very Deep Convolutional Networks
Kim, J., Lee, J. K., & Lee, K. M. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.182 · Cited by 7,870
Enhanced Deep Residual Networks for Single Image Super-Resolution
Lim, B., Son, S., Kim, H., Nah, S., & Lee, K. M. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2017.151 · Cited by 7,736
A Non-Local Algorithm for Image Denoising
Buades, A., Coll, B., & Morel, J.-M. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.38 · Cited by 7,616
Learning a Deep Convolutional Network for Image Super-Resolution
Dong, C., Loy, C. C., He, K., & Tang, X. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10593-2_13 · Cited by 5,494
Image Denoising Via Sparse and Redundant Representations Over Learned Dictionaries
Elad, M., & Aharon, M. (2006) · IEEE Transactions on Image Processing · doi:10.1109/tip.2006.881969 · Cited by 5,321
Accelerating the Super-Resolution Convolutional Neural Network
Dong, C., Loy, C. C., & Tang, X. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46475-6_25 · Cited by 3,786
Deep Learning for Generic Object Detection: A Survey
Liu, L., Ouyang, W., Wang, X., Fieguth, P., Chen, J., Liu, X., & Pietikäinen, M. (2020) · International Journal of Computer Vision · doi:10.1007/s11263-019-01247-4 · Cited by 2,965
Deep Learning for Generic Object Detection: A Survey
Liu, L., Ouyang, W., Wang, X., Fieguth, P., Chen, J., Liu, X., & Pietikäinen, M. (2018) · arXiv · doi:10.48550/arxiv.1809.02165 · Cited by 2,965
Example-based super-resolution
Freeman, W. T., Jones, T. R., & Pasztor, E. C. (2002) · IEEE Computer Graphics and Applications · doi:10.1109/38.988747 · Cited by 2,498
Fully Convolutional Networks for Semantic Segmentation
Long, J., Shelhamer, E., & Darrell, T. J. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1411.4038 · Cited by 2,489
Image Super-Resolution via Deep Recursive Residual Network
Tai, Y., Yang, J., & Liu, X. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.298 · Cited by 2,415
Learning Fast Approximations of Sparse Coding
Gregor, K., & LeCun, Y. (2010) · International Conference on Machine Learning · Cited by 2,400
Weighted Nuclear Norm Minimization with Application to Image Denoising
Gu, S., Zhang, L., Zuo, W., & Feng, X. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.366 · Cited by 2,316 · cited 3×
“Motivated by the fact that natural images often contain rich repetitive structures, nonolocal regularization techniques [2], [4], [5], [8] combining the NLSS with the sparse representation and low-rank approximation, have shown significant improvements over their local counterparts.”
BackgroundMethodLearning Deep CNN Denoiser Prior for Image Restoration
Zhang, K., Zuo, W., Gu, S., & Zhang, L. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.300 · Cited by 2,116 · cited 6×
“For this case, we compare the proposed method with DD-CNN [36], which has much better results than their earlier DnCNN [24].”
BackgroundMethodInfluentialA New TwIST: Two-Step Iterative Shrinkage/Thresholding Algorithms for Image Restoration
Bioucas-Dias, J. M., & Figueiredo, M. A. T. (2007) · IEEE Transactions on Image Processing · doi:10.1109/tip.2007.909319 · Cited by 2,064 · cited 1×
“Numerous regularizers have been developed, ranging from the well-known total variation (TV) regularizer [13], the sparsity-base regularizers with off-the-shelf transforms or learned dictionaries [1], [3], [14], [15], to the nonlocal self-similarity (NLSS) inspired regularizers [2], [8], [25].”
BackgroundMemNet: A Persistent Memory Network for Image Restoration
Tai, Y., Yang, J., Liu, X., & Xu, C. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.486 · Cited by 1,883
An Iterative Regularization Method for Total Variation-Based Image Restoration
Osher, S., Burger, M., Goldfarb, D., Xu, J., & Yin, W. (2005) · Multiscale Modeling & Simulation · doi:10.1137/040605412 · Cited by 1,787
Self-citationSparse Representation for Color Image Restoration
Mairal, J., Elad, M., & Sapiro, G. (2008) · IEEE Transactions on Image Processing · doi:10.1109/tip.2007.911828 · Cited by 1,716
From learning models of natural image patches to whole image restoration
Zoran, D., & Weiss, Y. (2011) · 2011 International Conference on Computer Vision · doi:10.1109/iccv.2011.6126278 · Cited by 1,522
Nonlocally Centralized Sparse Representation for Image Restoration
Dong, W., Zhang, L., Shi, G., & Li, X. (2013) · IEEE Transactions on Image Processing · doi:10.1109/tip.2012.2235847 · Cited by 1,505
Self-citationImage super-resolution as sparse representation of raw image patches
Yang, J., Wright, J., Huang, T., & Ma, Y. (2008) · 2008 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2008.4587647 · Cited by 1,475
A+: Adjusted Anchored Neighborhood Regression for Fast Super-Resolution
Timofte, R., De Smet, V., & Van Gool, L. (2015) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-16817-3_8 · Cited by 1,408
Image Super-Resolution Using Dense Skip Connections
Tong, T., Li, G., Liu, X., & Gao, Q. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.514 · Cited by 1,373
Chen, Y., & Pock, T. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2596743 · Cited by 1,344
Image denoising: Can plain neural networks compete with BM3D?
Burger, H. C., Schuler, C. J., & Harmeling, S. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6247952 · Cited by 1,325
Global Convergence of ADMM in Nonconvex Nonsmooth Optimization
Wang, Y., Yin, W., & Zeng, J. (2019) · Journal of Scientific Computing · doi:10.1007/s10915-018-0757-z · Cited by 1,268
Self-citationUnderstanding and evaluating blind deconvolution algorithms
Levin, A., Weiss, Y., Durand, F., & Freeman, W. T. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206815 · Cited by 1,208
Plug-and-Play priors for model based reconstruction
Venkatakrishnan, S. V., Bouman, C. A., & Wohlberg, B. (2013) · 2013 IEEE Global Conference on Signal and Information Processing · doi:10.1109/globalsip.2013.6737048 · Cited by 1,178
Xu, Y., & Yin, W. (2013) · SIAM Journal on Imaging Sciences · doi:10.1137/120887795 · Cited by 1,160
Self-citationDong, W., Zhang, L., Shi, G., & Wu, X. (2011) · IEEE Transactions on Image Processing · doi:10.1109/tip.2011.2108306 · Cited by 1,124
Self-citationDeep ADMM-Net for compressive sensing MRI
Yang, Y., Sun, J. Z., Li, H., & Xu, Z. (2016) · neural information processing systems · Cited by 1,024
Dong, W., Lei Zhang, A., Shi, G., Member, S., Xiaolin Wu, C., & Member, S. (2011) · Cited by 1,023
Self-citationThe Little Engine That Could: Regularization by Denoising (RED)
Romano, Y., Elad, M., & Milanfar, P. (2017) · SIAM Journal on Imaging Sciences · doi:10.1137/16m1102884 · Cited by 934
Plug-and-Play ADMM for Image Restoration: Fixed-Point Convergence and Applications
Chan, S. H., Wang, X., & Elgendy, O. A. (2017) · IEEE Transactions on Computational Imaging · doi:10.1109/tci.2016.2629286 · Cited by 904
Roth, S., & Black, M. J. (2009) · International Journal of Computer Vision · doi:10.1007/s11263-008-0197-6 · Cited by 847
Deep Convolutional Neural Network for Image Deconvolution
Li, X., Ren, J., Liu, C., & Jia, J. (2014) · Rare & Special e-Zone (The Hong Kong University of Science and Technology) · Cited by 836
Deep Networks for Image Super-Resolution with Sparse Prior
Wang, Z., Liu, D., Yang, J., Han, W., & Huang, T. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.50 · Cited by 784
Learning to Refine Object Segments
Pinheiro, P. O., Lin, T.-Y., Collobert, R., & Dollár, P. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46448-0_5 · Cited by 731
Bolte, J., Daniilidis, A., & Lewis, A. (2007) · SIAM Journal on Optimization · doi:10.1137/050644641 · Cited by 671
Nonlocal Image Restoration With Bilateral Variance Estimation: A Low-Rank Approach
Dong, W., Shi, G., & Li, X. (2013) · IEEE Transactions on Image Processing · doi:10.1109/tip.2012.2221729 · Cited by 655
Self-citationBM3D Frames and Variational Image Deblurring
Danielyan, A., Katkovnik, V., & Egiazarian, K. (2012) · IEEE Transactions on Image Processing · doi:10.1109/tip.2011.2176954 · Cited by 611
Yu, G., Sapiro, G., & Mallat, S. (2012) · IEEE Transactions on Image Processing · doi:10.1109/tip.2011.2176743 · Cited by 561
Shrinkage Fields for Effective Image Restoration
Schmidt, U., & Roth, S. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.349 · Cited by 543
Sparsity-based image denoising via dictionary learning and structural clustering
Dong, W., Li, X., Zhang, L., & Shi, G. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995478 · Cited by 465
Self-citationImage Super-Resolution by TV-Regularization and Bregman Iteration
Marquina, A., & Osher, S. J. (2008) · Journal of Scientific Computing · doi:10.1007/s10915-008-9214-8 · Cited by 458
1 BM3D frames and variational image deblurring
Danielyan, A., Katkovnik, V., Egiazarian, K., & Member, S. (2012) · Cited by 414
First-order methods almost always avoid strict saddle points
Lee, J. D., Panageas, I., Piliouras, G., Simchowitz, M., Jordan, M. I., & Recht, B. (2019) · Mathematical Programming · doi:10.1007/s10107-019-01374-3 · Cited by 377
Local binary features for texture classification: Taxonomy and experimental study
Liu, L., Fieguth, P., Guo, Y., Wang, X., & Pietikäinen, M. (2017) · Pattern Recognition · doi:10.1016/j.patcog.2016.08.032 · Cited by 369
What Regularized Auto-Encoders Learn from the Data Generating DistributionPreprint
Alain, G., & Bengio, Y. (2013) · arXiv (Cornell University) · Cited by 328
Image Super-Resolution With Sparse Neighbor Embedding
Gao, X., Zhang, K., Tao, D., & Li, X. (2012) · IEEE Transactions on Image Processing · doi:10.1109/tip.2012.2190080 · Cited by 313
Texture Classification from Random Features
Liu, L., & Fieguth, P. (2012) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2011.145 · Cited by 289
Learning Proximal Operators: Using Denoising Networks for Regularizing Inverse Imaging Problems
Meinhardt, T., Moeller, M., Hazirbas, C., & Cremers, D. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.198 · Cited by 257
Understanding and evaluating blind deconvolution algorithms
Levin, A., Weiss, Y., Durand, F., & Freeman, W. T. (2009) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvprw.2009.5206815 · Cited by 239
Image Super-Resolution via Dual-State Recurrent Networks
Han, W., Chang, S., Liu, D., Yu, M., Witbrock, M., & Huang, T. S. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00178 · Cited by 227
Dong, W., Shi, G., Ma, Y., & Li, X. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0808-y · Cited by 205
Self-citationWhat regularized auto-encoders learn from the data-generating distribution
AlainGuillaume, & BengioYoshua (2014) · Journal of Machine Learning Research · doi:10.5555/2627435.2750359 · Cited by 162
Maximal Sparsity with Deep Networks?Preprint
Xin, B., Wang, Y., Gao, W., & Wipf, D. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1605.01636 · Cited by 139
Turning a denoiser into a super-resolver using plug and play priors
Brifman, A., Romano, Y., & Elad, M. (2016) · 2016 IEEE International Conference on Image Processing (ICIP) · doi:10.1109/icip.2016.7532589 · Cited by 91
Image restoration and reconstruction using variable splitting and class-adapted image priors
Teodoro, A. M., Bioucas‐Dias, J. M., & Figueiredo, M. A. T. (2016) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2016.7533014 · Cited by 81
Adaptive Residual Networks for High-Quality Image Restoration
Zhang, Y., Sun, L., Yan, C. C., Ji, X., & Dai, Q. (2018) · IEEE Transactions on Image Processing · doi:10.1109/tip.2018.2812081 · Cited by 80
Image Restoration using Autoencoding Priors
Bigdeli, S., & Zwicker, M. (2018) · International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP) · doi:10.5220/0006532100330044 · Cited by 38
Image Restoration using Autoencoding PriorsPreprint
Bigdeli, S., & Zwicker, M. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1703.09964 · Cited by 33
Deeply Aggregated Alternating Minimization for Image Restoration
Kim, Y., Jung, H., Min, D., & Sohn, K. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.38 · Cited by 31
A Survey of Recent Advances in Texture Representation.
Liu, L., Chen, J., Fieguth, P., Zhao, G., Chellappa, R., & Pietikäinen, M. (2018) · Cited by 29
Cited by
Plug-and-Play Image Restoration With Deep Denoiser Prior
Zhang, K., Li, Y., Zuo, W., Zhang, L., Van Gool, L., & Timofte, R. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3088914 · Cited by 1,113
Residual Dense Network for Image Restoration
Zhang, Y., Tian, Y., Kong, Y., Zhong, B., & Fu, Y. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.2968521 · Cited by 897
Xiao, J., Fu, X., Liu, A., Wu, F., & Zha, Z.-J. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3183612 · Cited by 389
Self-citationAMP-Net: Denoising-Based Deep Unfolding for Compressive Image Sensing
Zhang, Z., Liu, Y., Liu, J., Wen, F., & Zhu, C. (2021) · IEEE Transactions on Image Processing · doi:10.1109/tip.2020.3044472 · Cited by 311
Deep Generalized Unfolding Networks for Image Restoration
Mou, C., Wang, Q., & Zhang, J. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01688 · Cited by 290
Metadata
- Authors
- Dong, W., Wang, P., Yin, W., Shi, G., Wu, F., & Lu, X.
- Venue
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- Published
- 2019-10-01
- Volume
- 41
- Issue
- 10
- Pages
- 2305-2318
- ISSN
- 0162-8828 (ISSN-L)
- 2160-9292
- 1939-3539
- OpenAlex
- W2784344583
- Cited by
- 515
- References
- 75
- FWCI
- 21.56
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.