The DOI matches its Crossref record; 73 of the 73 references it cites were found in a registry or an index.
Deep Unfolding Network for Image Super-Resolution
Open accessAbstract
Learning-based single image super-resolution (SISR) methods are continuously showing superior effectiveness and efficiency over traditional model-based methods, largely due to the end-to-end training. However, different from model-based methods that can handle the SISR problem with different scale factors, blur kernels and noise levels under a unified MAP (maximum a posteriori) framework, learning-based methods generally lack such flexibility. To address this issue, this paper proposes an end-to-end trainable unfolding network which leverages both learningbased methods and model-based methods. Specifically, by unfolding the MAP inference via a half-quadratic splitting algorithm, a fixed number of iterations consisting of alternately solving a data subproblem and a prior subproblem can be obtained. The two subproblems then can be solved with neural modules, resulting in an end-to-end trainable, iterative network. As a result, the proposed network inherits the flexibility of model-based methods to super-resolve blurry, noisy images for different scale factors via a single model, while maintaining the advantages of learning-based methods. Extensive experiments demonstrate the superiority of the proposed deep unfolding network in terms of flexibility, effectiveness and also generalizability.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
U-Net: Convolutional Networks for Biomedical Image Segmentation
Ronneberger, O., Fischer, P., & Brox, T. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24574-4_28 · Cited by 99,404
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Boyd, S., Parikh, N., Chu, E., Peleato, B., & Eckstein, J. (2011) · Foundations and Trends® in Machine Learning · doi:10.1561/2200000016 · Cited by 17,075
Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network
Ledig, C., Theis, L., Huszar, F., Caballero, J., Cunningham, A., Acosta, A., Aitken, A., Tejani, A., Totz, J., Wang, Z., et al. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.19 · Cited by 12,696
Boyd, S. (2010) · now publishers, Inc. eBooks · doi:10.1561/9781601984616 · Cited by 12,677
Image Super-Resolution Using Deep Convolutional Networks
Dong, C., Loy, C. C., He, K., & Tang, X. (2016) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2015.2439281 · Cited by 10,105
Martin, D., Fowlkes, C., Tal, D., & Malik, J. (2002) · Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001 · doi:10.1109/iccv.2001.937655 · Cited by 8,216
Accurate Image Super-Resolution Using Very Deep Convolutional Networks
Kim, J., Lee, J. K., & Lee, K. M. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.182 · Cited by 7,870
Enhanced Deep Residual Networks for Single Image Super-Resolution
Lim, B., Son, S., Kim, H., Nah, S., & Lee, K. M. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2017.151 · Cited by 7,736
(2011) · Cited by 6,993
Image Super-Resolution Using Very Deep Residual Channel Attention Networks
Zhang, Y., Li, K., Li, K., Wang, L., Zhong, B., & Fu, Y. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01234-2_18 · Cited by 5,708
ESRGAN: Enhanced Super-Resolution Generative Adversarial Networks
Wang, X., Yu, K., Wu, S., Gu, J., Liu, Y., Dong, C., Qiao, Y., & Loy, C. C. (2019) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-11021-5_5 · Cited by 4,731
A First-Order Primal-Dual Algorithm for Convex Problems with Applications to Imaging
Chambolle, A., & Pock, T. (2011) · Journal of Mathematical Imaging and Vision · doi:10.1007/s10851-010-0251-1 · Cited by 4,336
NTIRE 2017 Challenge on Single Image Super-Resolution: Dataset and Study
Agustsson, E., & Timofte, R. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2017.150 · Cited by 4,295
Self-citationCubic convolution interpolation for digital image processing
Keys, R. (1981) · IEEE Transactions on Acoustics, Speech, and Signal Processing · doi:10.1109/tassp.1981.1163711 · Cited by 3,255
Deep Laplacian Pyramid Networks for Fast and Accurate Super-Resolution
Lai, W.-S., Huang, J.-B., Ahuja, N., & Yang, M.-H. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.618 · Cited by 2,976
FFDNet: Toward a Fast and Flexible Solution for CNN-Based Image Denoising
Zhang, K., Zuo, W., & Zhang, L. (2018) · IEEE Transactions on Image Processing · doi:10.1109/tip.2018.2839891 · Cited by 2,678
Self-citationLearning Deep CNN Denoiser Prior for Image Restoration
Zhang, K., Zuo, W., Gu, S., & Zhang, L. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.300 · Cited by 2,116 · cited 3×
“The compared methods include RCAN [70], ZSSR [51], IKC [20] and IRCNN [65].”
BackgroundMethodResultSelf-citationNonlocally Centralized Sparse Representation for Image Restoration
Dong, W., Zhang, L., Shi, G., & Li, X. (2013) · IEEE Transactions on Image Processing · doi:10.1109/tip.2012.2235847 · Cited by 1,505
Image super-resolution as sparse representation of raw image patches
Yang, J., Wright, J., Huang, T., & Ma, Y. (2008) · 2008 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2008.4587647 · Cited by 1,475
NTIRE 2017 Challenge on Single Image Super-Resolution: Methods and Results
Timofte, R., Agustsson, E., Gool, L. V., Yang, M.-H., Zhang, L., Lim, B., Son, S., Kim, H., Nah, S., Lee, K. M., et al. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2017.149 · Cited by 1,441
Self-citationA+: Adjusted Anchored Neighborhood Regression for Fast Super-Resolution
Timofte, R., De Smet, V., & Van Gool, L. (2015) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-16817-3_8 · Cited by 1,408
Self-citationChen, Y., & Pock, T. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2596743 · Cited by 1,344
ISTA-Net: Interpretable Optimization-Inspired Deep Network for Image Compressive Sensing
Zhang, J., & Ghanem, B. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00196 · Cited by 1,309
Fast Image Recovery Using Variable Splitting and Constrained Optimization
Afonso, M. V., Bioucas-Dias, J. M., & Figueiredo, M. A. T. (2010) · IEEE Transactions on Image Processing · doi:10.1109/tip.2010.2047910 · Cited by 1,223
Understanding and evaluating blind deconvolution algorithms
Levin, A., Weiss, Y., Durand, F., & Freeman, W. T. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206815 · Cited by 1,208
Plug-and-Play priors for model based reconstruction
Venkatakrishnan, S. V., Bouman, C. A., & Wohlberg, B. (2013) · 2013 IEEE Global Conference on Signal and Information Processing · doi:10.1109/globalsip.2013.6737048 · Cited by 1,178
Learning a Single Convolutional Super-Resolution Network for Multiple Degradations
Zhang, K., Zuo, W., & Zhang, L. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00344 · Cited by 1,124
Self-citationEnhanceNet: Single Image Super-Resolution Through Automated Texture Synthesis
Sajjadi, M. S. M., Scholkopf, B., & Hirsch, M. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.481 · Cited by 1,058
Elad, M., & Feuer, A. (1997) · IEEE Transactions on Image Processing · doi:10.1109/83.650118 · Cited by 1,035
Deep ADMM-Net for compressive sensing MRI
Yang, Y., Sun, J. Z., Li, H., & Xu, Z. (2016) · neural information processing systems · Cited by 1,024
Zero-Shot Super-Resolution Using Deep Internal Learning
Shocher, A., Cohen, N., & Irani, M. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00329 · Cited by 936
FFDNet: Toward a fast and flexible solution for CNN-Based image denoising
Zhang, K., Zuo, W., & Zhang, L. (2018) · TUScholarShare (Temple University) · Cited by 916
Self-citationPlug-and-Play ADMM for Image Restoration: Fixed-Point Convergence and Applications
Chan, S. H., Wang, X., & Elgendy, O. A. (2017) · IEEE Transactions on Computational Imaging · doi:10.1109/tci.2016.2629286 · Cited by 904
Roth, S., & Black, M. J. (2009) · International Journal of Computer Vision · doi:10.1007/s11263-008-0197-6 · Cited by 847
Blind Image Deblurring Using Dark Channel Prior
Pan, J., Sun, D., Pfister, H., & Yang, M.-H. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.180 · Cited by 779
Learned Primal-Dual Reconstruction
Adler, J., & Oktem, O. (2018) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2018.2799231 · Cited by 758
Advances and challenges in super‐resolution
Farsiu, S., Robinson, D., Elad, M., & Milanfar, P. (2004) · International Journal of Imaging Systems and Technology · doi:10.1002/ima.20007 · Cited by 681
Single-Image Super-Resolution: A Benchmark
Yang, C.-Y., Ma, C., & Yang, M.-H. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10593-2_25 · Cited by 615
FSRNet: End-to-End Learning Face Super-Resolution with Facial Priors
Chen, Y., Tai, Y., Liu, X., Shen, C., & Yang, J. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00264 · Cited by 581
Blind Super-Resolution With Iterative Kernel Correction
Gu, J., Lu, H., Zuo, W., & Dong, C. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00170 · Cited by 580
Shrinkage Fields for Effective Image Restoration
Schmidt, U., & Roth, S. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.349 · Cited by 543
The relativistic discriminator: a key element missing from standard GAN
Jolicoeur‐Martineau, A. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1807.00734 · Cited by 532
On Bayesian Adaptive Video Super Resolution
Liu, C., & Sun, D. (2014) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.127 · Cited by 526
Meta-SR: A Magnification-Arbitrary Network for Super-Resolution
Hu, X., Mu, H., Zhang, X., Wang, Z., Tan, T., & Sun, J. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00167 · Cited by 526
Deep Plug-And-Play Super-Resolution for Arbitrary Blur Kernels
Zhang, K., Zuo, W., & Zhang, L. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00177 · Cited by 408
Self-citationA Statistical Prediction Model Based on Sparse Representations for Single Image Super-Resolution
Peleg, T., & Elad, M. (2014) · IEEE Transactions on Image Processing · doi:10.1109/tip.2014.2305844 · Cited by 407
RankSRGAN: Generative Adversarial Networks With Ranker for Image Super-Resolution
Zhang, W., Liu, Y., Dong, C., & Qiao, Y. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00319 · Cited by 405
Non-local Color Image Denoising with Convolutional Neural Networks
Lefkimmiatis, S. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.623 · Cited by 363
An axiomatic approach to image interpolation
Caselles, V., Morel, J.-M., & Sbert, C. (1998) · IEEE Transactions on Image Processing · doi:10.1109/83.661188 · Cited by 341
Neural Blind Deconvolution Using Deep Priors
Ren, D., Zhang, K., Wang, Q., Hu, Q., & Zuo, W. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00340 · Cited by 320
Self-citationShen, Z., Lai, W.-S., Xu, T., Kautz, J., & Yang, M.-H. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00862 · Cited by 213
Group Sparsity: The Hinge Between Filter Pruning and Decomposition for Network Compression
Li, Y., Gu, S., Mayer, C., Van Gool, L., & Timofte, R. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00804 · Cited by 208
Self-citationAccurate Blur Models vs. Image Priors in Single Image Super-resolution
Efrat, N., Glasner, D., Apartsin, A., Nadler, B., & Levin, A. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.352 · Cited by 200
Unsupervised Learning for Real-World Super-Resolution
Lugmayr, A., Danelljan, M., & Timofte, R. (2019) · 2019 IEEE/CVF International Conference on Computer Vision Workshop (ICCVW) · doi:10.1109/iccvw.2019.00423 · Cited by 195
Self-citationIs image super-resolution helpful for other vision tasks?
Dai, D., Wang, Y., Chen, Y., & Gool, L. V. (2016) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv.2016.7477613 · Cited by 176
Zhao, N., Wei, Q., Basarab, A., Nicolas Dobigeon, B., Kouamé, D., & Tourneret, J. (2016) · IEEE Transactions on Image Processing · doi:10.1109/tip.2016.2567075 · Cited by 164
Modeling the Performance of Image Restoration From Motion Blur
Boracchi, G., & Foi, A. (2012) · IEEE Transactions on Image Processing · doi:10.1109/tip.2012.2192126 · Cited by 162
Deep Image Demosaicking Using a Cascade of Convolutional Residual Denoising Networks
Kokkinos, F., & Lefkimmiatis, S. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01264-9_19 · Cited by 148
Conditioned Regression Models for Non-blind Single Image Super-Resolution
Riegler, G., Schulter, S., Rüther, M., & Bischof, H. (2015) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.67 · Cited by 119
Learning to Push the Limits of Efficient FFT-Based Image Deconvolution
Kruse, J., Rother, C., & Schmidt, U. (2017) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.491 · Cited by 114
Learning optimized MAP estimates in continuously-valued MRF models
Samuel, K. G. G., & Tappen, M. F. (2009) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2009.5206774 · Cited by 113
Review of image interpolation and super-resolution
Siu, W.-C., & Hung, K.-W. (2012) · PolyU Institutional Research Archive (Hong Kong Polytechnic University) · Cited by 108
Training an Active Random Field for Real-Time Image Denoising
Barbu, A. (2009) · IEEE Transactions on Image Processing · doi:10.1109/tip.2009.2028254 · Cited by 105
Reducing boundary artifacts in image deconvolution
Liu, R., & Jia, J. (2008) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2008.4711802 · Cited by 101
Singh, A., Porikli, F., & Ahuja, N. (2014) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2014.364 · Cited by 82
ProxImaL: efficient image optimization using proximal algorithms
Heide, F., Diamond, S., Nießner, M., Ragan‐Kelley, J., Heidrich, W., & Wetzstein, G. (2016) · ACM Transactions on Graphics · doi:10.1145/2897824.2925875 · Cited by 76
Deblurring Face Images Using Uncertainty Guided Multi-Stream Semantic Networks
Yasarla, R., Perazzi, F., & Patel, V. M. (2020) · IEEE Transactions on Image Processing · doi:10.1109/tip.2020.2990354 · Cited by 75
Learning non-local range Markov Random field for image restoration
Sun, J. Z., & Tappen, M. F. (2011) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2011.5995520 · Cited by 68
Unified Single-Image and Video Super-Resolution via Denoising Algorithms
Brifman, A., Romano, Y., & Elad, M. (2019) · IEEE Transactions on Image Processing · doi:10.1109/tip.2019.2924173 · Cited by 47
An Iterative Framework of Cascaded Deblocking and Superresolution for Compressed Images
Li, T., He, X., Qing, L., et al. (2017) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2017.2766889 · Cited by 41
Zhang, K., Zhou, X., Zhang, H., & Zuo, W. (2015) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-24075-6_65 · Cited by 24
Self-citation
Cited by
Plug-and-Play Image Restoration With Deep Denoiser Prior
Zhang, K., Li, Y., Zuo, W., Zhang, L., Van Gool, L., & Timofte, R. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3088914 · Cited by 1,113
Self-citationURetinex-Net: Retinex-based Deep Unfolding Network for Low-light Image Enhancement
Wu, W., Weng, J., Zhang, P., Wang, X., Yang, W., & Jiang, J. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.00581 · Cited by 809
Learning Continuous Image Representation with Local Implicit Image Function
Chen, Y., Liu, S., & Wang, X. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00852 · Cited by 782
Designing a Practical Degradation Model for Deep Blind Image Super-Resolution
Zhang, K., Liang, J., Van Gool, L., & Timofte, R. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00475 · Cited by 760
Self-citationUnsupervised Degradation Representation Learning for Blind Super-Resolution
Wang, L., Wang, Y., Dong, X., Xu, Q., Yang, J., An, W., & Guo, Y. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.01044 · Cited by 412
Metadata
- Authors
- Zhang, K., Van Gool, L., & Timofte, R.
- Venue
- 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
- Publisher
- IEEE
- Published
- 2020-06
- Pages
- 3214-3223
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W3012811655
- Cited by
- 638
- References
- 73
- FWCI
- 27.82
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.