Turning a denoiser into a super-resolver using plug and play priors
The DOI matches its Crossref record; 26 of the 26 references it cites were found in a registry or an index.
Abstract
Denoising and Super-Resolution are two inverse problems that have been extensively studied. Over the years, these two tasks were treated as two distinct problems that deserve a different algorithmic solution. In this paper we wish to exploit the recently introduced Plug-and-Play Prior (PPP) approach to connect between the two. Using the PPP, we turn leading denoisers into super-resolution solvers. As a case-study we demonstrate this on the NCSR algorithm, which has two variants: one for denoising and one for superresolution. We show that by using the NCSR denoiser, one can get equal or even better results when compared with the NCSR super-resolution.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Boyd, S., Parikh, N., Chu, E., Peleato, B., & Eckstein, J. (2011) · Foundations and Trends® in Machine Learning · doi:10.1561/2200000016 · Cited by 17,075
Nonlinear total variation based noise removal algorithms
Rudin, L. I., Osher, S., & Fatemi, E. (1992) · Physica D: Nonlinear Phenomena · doi:10.1016/0167-2789(92)90242-f · Cited by 15,704
Boyd, S. (2010) · now publishers, Inc. eBooks · doi:10.1561/9781601984616 · Cited by 12,677
$rm K$-SVD: An Algorithm for Designing Overcomplete Dictionaries for Sparse Representation
Aharon, M., Elad, M., & Bruckstein, A. (2006) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2006.881199 · Cited by 9,451
Self-citationImage denoising by sparse 3-D transform-domain collaborative filtering
Dabov, K., Foi, A., Katkovnik, V., & Egiazarian, K. (2007) · IEEE Transactions on Image Processing · doi:10.1109/tip.2007.901238 · Cited by 9,283
A Non-Local Algorithm for Image Denoising
Buades, A., Coll, B., & Morel, J.-M. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.38 · Cited by 7,616 · cited 1×
“NCSR combines the sparse-coding and dictionary learning [24] with the nonlocal self-similarity assumption [14].”
MethodImage Denoising Via Sparse and Redundant Representations Over Learned Dictionaries
Elad, M., & Aharon, M. (2006) · IEEE Transactions on Image Processing · doi:10.1109/tip.2006.881969 · Cited by 5,321
Self-citationFrom Sparse Solutions of Systems of Equations to Sparse Modeling of Signals and Images
Bruckstein, A. M., Donoho, D. L., & Elad, M. (2009) · SIAM Review · doi:10.1137/060657704 · Cited by 2,183
Self-citationSuper-resolution from a single image
Glasner, D., Bagon, S., & Irani, M. (2009) · 2009 IEEE 12th International Conference on Computer Vision · doi:10.1109/iccv.2009.5459271 · Cited by 1,889 · cited 1×
“Single Image Super-Resolution (SISR) [2] [3] [4] [5] [6] [7] [8] [9] is the process of recovering a High-Resolution (HR) image x ∈ R sM×sN from its blurred, decimated, and noisy Low-Resolution (LR) measurement y ∈ R M×N .”
BackgroundNonlocally Centralized Sparse Representation for Image Restoration
Dong, W., Zhang, L., Shi, G., & Li, X. (2013) · IEEE Transactions on Image Processing · doi:10.1109/tip.2012.2235847 · Cited by 1,505
Kernel Regression for Image Processing and Reconstruction
Takeda, H., Farsiu, S., & Milanfar, P. (2007) · IEEE Transactions on Image Processing · doi:10.1109/tip.2006.888330 · Cited by 1,340
Generalizing motion edits with Gaussian processes
Ikemoto, L., Arikan, O., & Forsyth, D. (2009) · ACM Transactions on Graphics · doi:10.1145/1477926.1477927 · Cited by 1,214
Plug-and-Play priors for model based reconstruction
Venkatakrishnan, S. V., Bouman, C. A., & Wohlberg, B. (2013) · 2013 IEEE Global Conference on Signal and Information Processing · doi:10.1109/globalsip.2013.6737048 · Cited by 1,178 · cited 8×
“Inspired by the PPP scheme [1], in this section we describe how to translate Equation (3) to a sequence of denoising problems , which minimize a much simpler function – Equation (5).”
InfluentialThe finite ridgelet transform for image representation
Do, M. N., & Vetterli, M. (2003) · IEEE Transactions on Image Processing · doi:10.1109/tip.2002.806252 · Cited by 711
Image and video upscaling from local self-examples
Freedman, G., & Fattal, R. (2011) · ACM Transactions on Graphics · doi:10.1145/1944846.1944852 · Cited by 679
Yu, G., Sapiro, G., & Mallat, S. (2012) · IEEE Transactions on Image Processing · doi:10.1109/tip.2011.2176743 · Cited by 561
Multi-Scale Patch-Based Image Restoration
Papyan, V., & Elad, M. (2016) · IEEE Transactions on Image Processing · doi:10.1109/tip.2015.2499698 · Cited by 262
Self-citationSuper-resolution from internet-scale scene matching
Sun, L., & Hays, J. H. (2012) · IEEE International Conference on Computational Photography (ICCP) · doi:10.1109/iccphot.2012.6215221 · Cited by 179
Single Image Interpolation Via Adaptive Nonlocal Sparsity-Based Modeling
Romano, Y., Protter, M., & Elad, M. (2014) · IEEE Transactions on Image Processing · doi:10.1109/tip.2014.2325774 · Cited by 121
Self-citationA General Framework for Regularized, Similarity-Based Image Restoration
Kheradmand, A., & Milanfar, P. (2014) · IEEE Transactions on Image Processing · doi:10.1109/tip.2014.2362059 · Cited by 119
Natural Images, Gaussian Mixtures and Dead Leaves
Zoran, D., & Weiss, Y. (2012) · neural information processing systems · Cited by 110
Expected Patch Log Likelihood with a Sparse Prior
Sulam, J., & Elad, M. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-14612-6_8 · Cited by 57
Self-citationAdapted waveform analysis as a tool for modeling, feature extraction, and denoising
Coifman, R. R., & Wickerhauser, M. V. (1994) · Optical Engineering · doi:10.1117/12.173206 · Cited by 35
Improving K-SVD denoising by post-processing its method-noise
Romano, Y., & Elad, M. (2013) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2013.6738090 · Cited by 33
Self-citationPatch-disagreement as away to improve K-SVD denoising
Romano, Y., & Elad, M. (2015) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2015.7178176 · Cited by 25
Self-citationLearning Nonlinear Spectral Filters for Color Image Reconstruction
Moeller, M., Diebold, J., Gilboa, G., & Cremers, D. (2015) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.41 · Cited by 16
Cited by
Learning Deep CNN Denoiser Prior for Image Restoration
Zhang, K., Zuo, W., Gu, S., & Zhang, L. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.300 · Cited by 2,116
“Some of the other related work can be found in [6, 12, 48, 49, 54, 58].”
BackgroundThe Little Engine That Could: Regularization by Denoising (RED)
Romano, Y., Elad, M., & Milanfar, P. (2017) · SIAM Journal on Imaging Sciences · doi:10.1137/16m1102884 · Cited by 934
“[33,38]), a common practical strategy to achieve 202 a high-quality estimation is to increase the value of β as a function of the iterations: Starting 203 from a relatively small value, i.”
Self-citationPlug-and-Play ADMM for Image Restoration: Fixed-Point Convergence and Applications
Chan, S. H., Wang, X., & Elgendy, O. A. (2017) · IEEE Transactions on Computational Imaging · doi:10.1109/tci.2016.2629286 · Cited by 904
“A few recent reports ha ve concurred similar observations [13], [16]–[18].”
MethodResultDenoising Prior Driven Deep Neural Network for Image Restoration
Dong, W., Wang, P., Yin, W., Shi, G., Wu, F., & Lu, X. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2873610 · Cited by 515
Deep Plug-And-Play Super-Resolution for Arbitrary Blur Kernels
Zhang, K., Zuo, W., & Zhang, L. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00177 · Cited by 408
“During the past few years, a flurry of plug-and-play works have been developed from the following aspects: 1) different variable splitting algorithms, such as halfquadratic splitting (HQS) algorithm [1], alternating direction method of multipliers (ADMM) algorithm [8], FISTA [4], and primal-dual algorithm [11, 42]; 2)…”
Method
Metadata
- Authors
- Brifman, A., Romano, Y., & Elad, M.
- Affiliations
- Technion – Israel Institute of Technology (IL)
- Venue
- 2016 IEEE International Conference on Image Processing (ICIP)
- Publisher
- IEEE
- Published
- 2016-09
- Pages
- 1404-1408
- ISSN
- 1522-4880 (ISSN-L)
- OpenAlex
- W2512704900
- Cited by
- 91
- References
- 26
- Citations by year
- 2026: 4 · 2025: 4 · 2024: 4 · 2023: 8 · 2022: 7 · 2021: 14 · 2020: 16 · 2019: 13 · 2018: 12 · 2017: 7 · 2016: 2
- FWCI
- 3.93
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- Proceedings - International Conference on Image Processing (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Image and Signal Denoising Methods
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Image Processing Techniques
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Image Enhancement Techniques
- Keywords
- plug-and-play priors, image super-resolution, image denoising, inverse problems, image restoration
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.