Plug-and-Play ADMM for Image Restoration: Fixed-Point Convergence and Applications
Open accessThe DOI matches its Crossref record; 58 of the 58 references it cites were found in a registry or an index.
Abstract
Alternating direction method of multiplier (ADMM) is a widely used algorithm for solving constrained optimization problems in image restoration. Among many useful features, one critical feature of the ADMM algorithm is its modular structure, which allows one to plug in any off-the-shelf image denoising algorithm for a subproblem in the ADMM algorithm. Because of the plug-in nature, this type of ADMM algorithms is coined the name “Plug-and-Play ADMM.” Plug-and-Play ADMM has demonstrated promising empirical results in a number of recent papers. However, it is unclear under what conditions and by using what denoising algorithms would it guarantee convergence. Also, since Plug-and-Play ADMM uses a specific way to split the variables, it is unclear if fast implementation can be made for common Gaussian and Poissonian image restoration problems. In this paper, we propose a Plug-and-Play ADMM algorithm with provable fixed-point convergence. We show that for any denoising algorithm satisfying an asymptotic criteria, called bounded denoisers, Plug-and-Play ADMM converges to a fixed point under a continuation scheme. We also present fast implementations for two image restoration problems on superresolution and single-photon imaging. We compare Plug-and-Play ADMM with state-of-the-art algorithms in each problem type and demonstrate promising experimental results of the algorithm.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Boyd, S., Parikh, N., Chu, E., Peleato, B., & Eckstein, J. (2011) · Foundations and Trends® in Machine Learning · doi:10.1561/2200000016 · Cited by 17,075
Boyd, S. (2010) · now publishers, Inc. eBooks · doi:10.1561/9781601984616 · Cited by 12,677
Learning a Deep Convolutional Network for Image Super-Resolution
Dong, C., Loy, C. C., He, K., & Tang, X. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10593-2_13 · Cited by 5,494
Multirate Systems and Filter Banks
Vaidyanathan, P. P. (1992) · CaltechAUTHORS (California Institute of Technology) · Cited by 5,457
A Review of Image Denoising Algorithms, with a New One
Buades, A., Coll, B., & Morel, J. M. (2005) · Multiscale Modeling & Simulation · doi:10.1137/040616024 · Cited by 4,083
Introduction to Applied Nonlinear Dynamical Systems and Chaos
Wiggins, S., & Mazel, D. S. (1990) · Computers in Physics · doi:10.1063/1.4822950 · Cited by 3,780
Introduction to Applied Nonlinear Dynamical Systems and Chaos
Wiggins, S. (1990) · Texts in Applied Mathematics · doi:10.1007/978-1-4757-4067-7 · Cited by 2,784
A New Alternating Minimization Algorithm for Total Variation Image Reconstruction
Wang, Y., Yang, J., Yin, W., & Zhang, Y. (2008) · SIAM Journal on Imaging Sciences · doi:10.1137/080724265 · Cited by 1,975
Image super-resolution as sparse representation of raw image patches
Yang, J., Wright, J., Huang, T., & Ma, Y. (2008) · 2008 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2008.4587647 · Cited by 1,475
Proximité et dualité dans un espace hilbertien
Moreau, J. J. (1965) · Bulletin de la Société mathématique de France · doi:10.24033/bsmf.1625 · Cited by 1,462
Fast Image Recovery Using Variable Splitting and Constrained Optimization
Afonso, M. V., Bioucas-Dias, J. M., & Figueiredo, M. A. T. (2010) · IEEE Transactions on Image Processing · doi:10.1109/tip.2010.2047910 · Cited by 1,223
Plug-and-Play priors for model based reconstruction
Venkatakrishnan, S. V., Bouman, C. A., & Wohlberg, B. (2013) · 2013 IEEE Global Conference on Signal and Information Processing · doi:10.1109/globalsip.2013.6737048 · Cited by 1,178
A Relationship Between Arbitrary Positive Matrices and Doubly Stochastic Matrices
Sinkhorn, R. (1964) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177703591 · Cited by 1,032
Robust smoothing of gridded data in one and higher dimensions with missing values
Garcia, D. (2010) · Computational Statistics & Data Analysis · doi:10.1016/j.csda.2009.09.020 · Cited by 1,021
Fast Alternating Direction Optimization Methods
Goldstein, T., O'Donoghue, B., Setzer, S., & Baraniuk, R. (2014) · SIAM Journal on Imaging Sciences · doi:10.1137/120896219 · Cited by 785
Group-Based Sparse Representation for Image Restoration
Zhang, J., Zhao, D., & Gao, W. (2014) · IEEE Transactions on Image Processing · doi:10.1109/tip.2014.2323127 · Cited by 768
BM3D Frames and Variational Image Deblurring
Danielyan, A., Katkovnik, V., & Egiazarian, K. (2012) · IEEE Transactions on Image Processing · doi:10.1109/tip.2011.2176954 · Cited by 611
A Tour of Modern Image Filtering: New Insights and Methods, Both Practical and Theoretical
Milanfar, P. (2013) · IEEE Signal Processing Magazine · doi:10.1109/msp.2011.2179329 · Cited by 605
An Augmented Lagrangian Method for Total Variation Video Restoration
Chan, S. H., Khoshabeh, R., Gibson, K. B., Gill, P. E., & Nguyen, T. Q. (2011) · IEEE Transactions on Image Processing · doi:10.1109/tip.2011.2158229 · Cited by 488
Self-citationForWaRD: Fourier-Wavelet Regularized Deconvolution for Ill-Conditioned Systems
Neelamani, R., Choi, H., & Baraniuk, R. (2004) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2003.821103 · Cited by 442
1 BM3D frames and variational image deblurring
Danielyan, A., Katkovnik, V., Egiazarian, K., & Member, S. (2012) · Cited by 414
A Statistical Prediction Model Based on Sparse Representations for Single Image Super-Resolution
Peleg, T., & Elad, M. (2014) · IEEE Transactions on Image Processing · doi:10.1109/tip.2014.2305844 · Cited by 407
Ramani, S., Blu, T., & Unser, M. (2008) · IEEE Transactions on Image Processing · doi:10.1109/tip.2008.2001404 · Cited by 397
Restoration of Poissonian Images Using Alternating Direction Optimization
Figueiredo, M. A. T., & Bioucas-Dias, J. M. (2010) · IEEE Transactions on Image Processing · doi:10.1109/tip.2010.2053941 · Cited by 372
Optimal Inversion of the Generalized Anscombe Transformation for Poisson-Gaussian Noise
Makitalo, M., & Foi, A. (2013) · IEEE Transactions on Image Processing · doi:10.1109/tip.2012.2202675 · Cited by 363
An Efficient TVL1 Algorithm for Deblurring Multichannel Images Corrupted by Impulsive Noise
Yang, J., Zhang, Y., & Yin, W. (2009) · SIAM Journal on Scientific Computing · doi:10.1137/080732894 · Cited by 336
Restoration of Poissonian images using alternating direction optimization
Figueiredo, M. A. T., & Bioucas‐Dias, J. M. (2010) · Cited by 325
Plug-and-Play Priors for Bright Field Electron Tomography and Sparse Interpolation
Sreehari, S., Venkatakrishnan, S. V., Wohlberg, B., Buzzard, G. T., Drummy, L. F., Simmons, J. P., & Bouman, C. A. (2016) · IEEE Transactions on Computational Imaging · doi:10.1109/tci.2016.2599778 · Cited by 300
Single image super-resolution using Gaussian process regression
He, H., & Siu, W.-C. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995713 · Cited by 294
Poisson Noise Reduction with Non-local PCA
Salmon, J., Harmany, Z., Deledalle, C.-A., & Willett, R. (2014) · Journal of Mathematical Imaging and Vision · doi:10.1007/s10851-013-0435-6 · Cited by 294
This is SPIRAL-TAP: Sparse Poisson Intensity Reconstruction ALgorithms—Theory and Practice
Harmany, Z. T., Marcia, R. F., & Willett, R. M. (2012) · IEEE Transactions on Image Processing · doi:10.1109/tip.2011.2168410 · Cited by 286
Non-Parametric Bayesian Dictionary Learning for Sparse Image Representations
Zhou, M., Chen, H., Ren, L. Q., Sapiro, G., Carin, L., & Paisley, J. W. (2009) · neural information processing systems · Cited by 257
Natural image denoising: Optimality and inherent bounds
Levin, A., & Nadler, B. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995309 · Cited by 235
Universal discrete denoising: known channel
Weissman, T., Ordentlich, E., Seroussi, G., Verdu, S., & Weinberger, M. J. (2005) · IEEE Transactions on Information Theory · doi:10.1109/tit.2004.839518 · Cited by 233
Nguyen, N., Milanfar, P., & Golub, G. (2001) · IEEE Transactions on Image Processing · doi:10.1109/83.941854 · Cited by 229
Hong, M., Luo, Z.-Q. T., & Razaviyayn, M. (2015) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2015.7178689 · Cited by 159
Algorithms and software for total variation image reconstruction via first-order methods
Dahl, J., Hansen, P. C., Jensen, S. H., & Jensen, T. L. (2010) · Numerical Algorithms · doi:10.1007/s11075-009-9310-3 · Cited by 159
1 Deconvolving Images with Unknown Boundaries Using the Alternating Direction Method of MultipliersPreprint
Almeida, M. S. C., & Figueiredo, M. A. T. (2016) · Cited by 144
Poisson inverse problems by the Plug-and-Play scheme
Rond, A., Giryes, R., & Elad, M. (2016) · Journal of Visual Communication and Image Representation · doi:10.1016/j.jvcir.2016.09.009 · Cited by 138
Deconvolving Images With Unknown Boundaries Using the Alternating Direction Method of Multipliers
Almeida, M. S. C., & Figueiredo, M. (2013) · IEEE Transactions on Image Processing · doi:10.1109/tip.2013.2258354 · Cited by 137
Patch Complexity, Finite Pixel Correlations and Optimal Denoising
Levin, A., Nadler, B., Durand, F., & Freeman, W. T. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-33715-4_6 · Cited by 125
Bits From Photons: Oversampled Image Acquisition Using Binary Poisson Statistics
Yang, F. H., Lu, Y. M., Sbaiz, L., & Vetterli, M. (2011) · IEEE Transactions on Image Processing · doi:10.1109/tip.2011.2179306 · Cited by 121
Depth Reconstruction From Sparse Samples: Representation, Algorithm, and Sampling
Liu, L.-K., Chan, S. H., & Nguyen, T. Q. (2015) · IEEE Transactions on Image Processing · doi:10.1109/tip.2015.2409551 · Cited by 101
Self-citationSymmetrizing Smoothing Filters
Milanfar, P. (2013) · SIAM Journal on Imaging Sciences · doi:10.1137/120875843 · Cited by 91
Turning a denoiser into a super-resolver using plug and play priors
Brifman, A., Romano, Y., & Elad, M. (2016) · 2016 IEEE International Conference on Image Processing (ICIP) · doi:10.1109/icip.2016.7532589 · Cited by 91 · cited 3×
“A few recent reports ha ve concurred similar observations [13], [16]–[18].”
MethodResultCompressive Imaging via Approximate Message Passing With Image Denoising
Tan, J., Ma, Y., & Baron, D. (2015) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2015.2408558 · Cited by 86
Postprocessing of Compressed Images via Sequential Denoising
Dar, Y., Bruckstein, A. M., Elad, M., & Giryes, R. (2016) · IEEE Transactions on Image Processing · doi:10.1109/tip.2016.2558825 · Cited by 73
Accelerated Edge-Preserving Image Restoration Without Boundary Artifacts
Matakos, A., Ramani, S., & Fessler, J. A. (2013) · IEEE Transactions on Image Processing · doi:10.1109/tip.2013.2244218 · Cited by 67
The Quanta Image Sensor (QIS): Concepts and Challenges
Fossum, E. R. (2011) · Imaging and Applied Optics · doi:10.1364/cosi.2011.jtue1 · Cited by 66
BM3D-AMP: A new image recovery algorithm based on BM3D denoising
Metzler, C. A., Maleki, A., & Baraniuk, R. G. (2015) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2015.7351377 · Cited by 53
Efficient image reconstruction for gigapixel quantum image sensors
Chan, S. H., & Lu, Y. M. (2014) · IEEE Global Conference on Signal and Information Processing · doi:10.1109/globalsip.2014.7032129 · Cited by 32
Self-citationApproximate Message Passing Algorithm With Universal Denoising and Gaussian Mixture Learning
Ma, Y., Zhu, J., & Baron, D. (2016) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2016.2599484 · Cited by 30
Hong, M., Luo, Z.-Q. T., & Razaviyayn, M. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1410.1390 · Cited by 19
A Context Quantization Approach to Universal Denoising
Sivaramakrishnan, K., & Weissman, T. (2009) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2008.2011847 · Cited by 15
Algorithm-Induced Prior for Image RestorationPreprint
Chan, S. H. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1602.00715 · Cited by 13
Self-citationImage reconstruction and threshold design for Quanta Image Sensors
Elgendy, O. A., & Chan, S. H. (2016) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2016.7532503 · Cited by 12
Self-citationUnderstanding symmetric smoothing filters via Gaussian mixtures
Chan, S. H., Zickler, T. E., & Lu, Y. (2015) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2015.7351252 · Cited by 7
Self-citationCompressive imaging via approximate message passing with wavelet-based image denoising
Tan, J., Ma, Y., & Baron, D. (2014) · IEEE Global Conference on Signal and Information Processing · doi:10.1109/globalsip.2014.7032152 · Cited by 6
Research works printed but not linked: 3
- bouman, 2015, Model Based in Image Processing
- poor, 1998, An Introduction to Signal Detection and Estimation
- huang, 0, Single image super-resolution using transformed self-exemplars, Proc IEEE Conf Comput Vision Pattern Recognit, 5197
Cited by
FFDNet: Toward a Fast and Flexible Solution for CNN-Based Image Denoising
Zhang, K., Zuo, W., & Zhang, L. (2018) · IEEE Transactions on Image Processing · doi:10.1109/tip.2018.2839891 · Cited by 2,678
Learning Deep CNN Denoiser Prior for Image Restoration
Zhang, K., Zuo, W., Gu, S., & Zhang, L. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.300 · Cited by 2,116
“Some of the other related work can be found in [6, 12, 48, 49, 54, 58].”
BackgroundMoDL: Model-Based Deep Learning Architecture for Inverse Problems
Aggarwal, H. K., Mani, M. P., & Jacob, M. (2019) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2018.2865356 · Cited by 1,069
Plug-and-Play Image Restoration With Deep Denoiser Prior
Zhang, K., Li, Y., Zuo, W., Zhang, L., Van Gool, L., & Timofte, R. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3088914 · Cited by 1,113
FFDNet: Toward a fast and flexible solution for CNN-Based image denoising
Zhang, K., Zuo, W., & Zhang, L. (2018) · TUScholarShare (Temple University) · Cited by 916
Metadata
- Authors
- Chan, S. H., Wang, X., & Elgendy, O. A.
- Affiliations
- Purdue University West Lafayette (US)
- Venue
- IEEE Transactions on Computational Imaging
- Published
- 2017-03
- Volume
- 3
- Issue
- 1
- Pages
- 84-98
- ISSN
- 2333-9403 (ISSN-L)
- 2334-0118
- OpenAlex
- W2346305596
- Cited by
- 904
- References
- 58
- Citations by year
- 2026: 85 · 2025: 130 · 2024: 134 · 2023: 114 · 2022: 102 · 2021: 103 · 2020: 93 · 2019: 75 · 2018: 48 · 2017: 18
- FWCI
- 32.42
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- IEEE Transactions on Computational Imaging (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Image and Signal Denoising Methods
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Image Processing Techniques
- Physical Sciences › Computer Science › Computational Theory and Mathematics › Optimization and Variational Analysis
- Keywords
- image restoration, fixed point convergence, image denoising, super-resolution, single-photon imaging, shot noise, Gaussian noise, variable splitting
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.