The DOI matches its Crossref record; 52 of the 52 references it cites were found in a registry or an index.
Majorization–Minimization Algorithms for Wavelet-Based Image Restoration
Abstract
Standard formulations of image/signal deconvolution under wavelet-based priors/regularizers lead to very high-dimensional optimization problems involving the following difficulties: the non-Gaussian (heavy-tailed) wavelet priors lead to objective functions which are nonquadratic, usually nondifferentiable, and sometimes even nonconvex; the presence of the convolution operator destroys the separability which underlies the simplicity of wavelet-based denoising. This paper presents a unified view of several recently proposed algorithms for handling this class of optimization problems, placing them in a common majorization-minimization (MM) framework. One of the classes of algorithms considered (when using quadratic bounds on nondifferentiable log-priors) shares the infamous "singularity issue" (SI) of "iteratively reweighted least squares" (IRLS) algorithms: the possibility of having to handle infinite weights, which may cause both numerical and convergence issues. In this paper, we prove several new results which strongly support the claim that the SI does not compromise the usefulness of this class of algorithms. Exploiting the unified MM perspective, we introduce a new algorithm, resulting from using l1 bounds for nonconvex regularizers; the experiments confirm the superior performance of this method, when compared to the one based on quadratic majorization. Finally, an experimental comparison of the several algorithms, reveals their relative merits for different standard types of scenarios.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Regression shrinkage and selection via the lasso
Tibshirani, R. (1996) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1996.tb02080.x · Cited by 51,482
Maximum Likelihood from Incomplete Data Via the EM Algorithm
Dempster, A. P., Laird, N. M., & Rubin, D. B. (1977) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1977.tb01600.x · Cited by 50,444
A Wavelet Tour of Signal Processing
(1999) · Elsevier eBooks · doi:10.1016/b978-0-12-466606-1.x5000-4 · Cited by 16,227
Efron, B., Hastie, T., Johnstone, I., & Tibshirani, R. (2004) · The Annals of Statistics · doi:10.1214/009053604000000067 · Cited by 9,357
Huber, P. J. (1981) · Wiley Series in Probability and Statistics · doi:10.1002/0471725250 · Cited by 7,066
Atomic Decomposition by Basis Pursuit
Chen, S. S., Donoho, D. L., & Saunders, M. A. (1998) · SIAM Journal on Scientific Computing · doi:10.1137/s1064827596304010 · Cited by 6,845
An iterative thresholding algorithm for linear inverse problems with a sparsity constraint.
Daubechies, I., Defrise, M., & De Mol, C. (2004) · Communications on Pure and Applied Mathematics · doi:10.1002/cpa.20042 · Cited by 4,958
On the Convergence Properties of the EM Algorithm
Wu, C. F. J. (1983) · The Annals of Statistics · doi:10.1214/aos/1176346060 · Cited by 3,269
Signal Recovery by Proximal Forward-Backward Splitting
Combettes, P. L., & Wajs, V. R. (2005) · Multiscale Modeling & Simulation · doi:10.1137/050626090 · Cited by 2,678
Convex Analysis and Minimization Algorithms I
Hiriart-Urruty, J.-B., & Lemaréchal, C. (1993) · Grundlehren der mathematischen Wissenschaften · doi:10.1007/978-3-662-02796-7 · Cited by 2,378
Image denoising using scale mixtures of gaussians in the wavelet domain
Portilla, J., Strela, V., Wainwright, M. J., & Simoncelli, E. P. (2003) · IEEE Transactions on Image Processing · doi:10.1109/tip.2003.818640 · Cited by 2,255
Axelsson, O. (1994) · Cambridge University Press eBooks · doi:10.1017/cbo9780511624100 · Cited by 2,085
Translation-Invariant De-Noising
Coifman, R. R., & Donoho, D. L. (1995) · Lecture Notes in Statistics · doi:10.1007/978-1-4612-2544-7_9 · Cited by 1,914
Introduction to Wavelets and Wavelet Transforms: A Primer
Burrus, C. S., Gopinath, R. A., Guo, H., Odegard, J. E., & Selesnick, I. (1997) · Cited by 1,794
Hunter, D. R., & Lange, K. (2004) · The American Statistician · doi:10.1198/0003130042836 · Cited by 1,783
Wavelet-based statistical signal processing using hidden Markov models
Crouse, M. S., Nowak, R. D., & Baraniuk, R. G. (1998) · IEEE Transactions on Signal Processing · doi:10.1109/78.668544 · Cited by 1,643
Self-citationAn EM algorithm for wavelet-based image restoration
Figueiredo, M. A. T., & Nowak, R. D. (2003) · IEEE Transactions on Image Processing · doi:10.1109/tip.2003.814255 · Cited by 1,219
Self-citationScale Mixtures of Normal Distributions
Andrews, D. F., & Mallows, C. L. (1974) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1974.tb00989.x · Cited by 1,163
Low-complexity image denoising based on statistical modeling of wavelet coefficients
Kivanc Mihcak, M., Kozintsev, I., Ramchandran, K., & Moulin, P. (1999) · IEEE Signal Processing Letters · doi:10.1109/97.803428 · Cited by 780
10.2 Maximum Likelihood from Incomplete Data
(2024) · Hierarchical Quantile Modeling · doi:10.1051/978-2-7598-3719-9.c026 · Cited by 780
Woods, J. W. (1978) · Proceedings of the IEEE · doi:10.1109/proc.1978.11031 · Cited by 699
(1979) · Pattern Recognition · doi:10.1016/0031-3203(79)90032-3 · Cited by 643
Another proof of the defect relation for moving targets
Shirosaki, M. (1991) · Tohoku Mathematical Journal · doi:10.2748/tmj/1178227459 · Cited by 614
Noise removal via Bayesian wavelet coring
Simoncelli, E. P., & Adelson, E. H. (2002) · Proceedings of 3rd IEEE International Conference on Image Processing · doi:10.1109/icip.1996.559512 · Cited by 612
Nonlinear Solution of Linear Inverse Problems by Wavelet–Vaguelette Decomposition
Donoho, D. L. (1995) · Applied and Computational Harmonic Analysis · doi:10.1006/acha.1995.1008 · Cited by 608
Bivariate shrinkage with local variance estimation
Sendur, L., & Selesnick, I. W. (2002) · IEEE Signal Processing Letters · doi:10.1109/lsp.2002.806054 · Cited by 579
On Sparse Representations in Arbitrary Redundant Bases
Fuchs, J.-J. (2004) · IEEE Transactions on Information Theory · doi:10.1109/tit.2004.828141 · Cited by 563
Analysis of multiresolution image denoising schemes using generalized Gaussian and complexity priors
Moulin, P., & Liu, J. (1999) · IEEE Transactions on Information Theory · doi:10.1109/18.761332 · Cited by 500
Regularization of Wavelet Approximations
Antoniadis, A., & Fan, J. (2001) · Journal of the American Statistical Association · doi:10.1198/016214501753208942 · Cited by 498
Noise reduction using an undecimated discrete wavelet transform
Lang, M., Guo, H., Odegard, J. E., Burrus, C. S., & Wells, R. O. (1996) · IEEE Signal Processing Letters · doi:10.1109/97.475823 · Cited by 484
De Pierro, A. R. (1995) · IEEE Transactions on Medical Imaging · doi:10.1109/42.370409 · Cited by 475
ForWaRD: Fourier-Wavelet Regularized Deconvolution for Ill-Conditioned Systems
Neelamani, R., Choi, H., & Baraniuk, R. (2004) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2003.821103 · Cited by 442
Unconditional Bases Are Optimal Bases for Data Compression and for Statistical Estimation
Donoho, D. L. (1993) · Applied and Computational Harmonic Analysis · doi:10.1006/acha.1993.1008 · Cited by 421
Monotonic algorithms for transmission tomography
Erdogan, H., & Fessler, J. A. (1999) · IEEE Transactions on Medical Imaging · doi:10.1109/42.802758 · Cited by 351
Globally convergent algorithms for maximum a posteriori transmission tomography
Lange, K., & Fessler, J. A. (1995) · IEEE Transactions on Image Processing · doi:10.1109/83.465107 · Cited by 313
Why Simple Shrinkage Is Still Relevant for Redundant Representations?
Elad, M. (2006) · IEEE Transactions on Information Theory · doi:10.1109/tit.2006.885522 · Cited by 291
Astronomical image representation by the curvelet transform
Starck, J. L., Donoho, D. L., & Candès, E. J. (2003) · Astronomy & Astrophysics · doi:10.1051/0004-6361:20021571 · Cited by 264
Wavelet-based image estimation: an empirical Bayes approach using Jeffrey's noninformative prior
Figueiredo, M. A. T., & Nowak, R. D. (2001) · IEEE Transactions on Image Processing · doi:10.1109/83.941856 · Cited by 235
Self-citationOn the Convergence of the Lagged Diffusivity Fixed Point Method in Total Variation Image Restoration
Chan, T. F., & Mulet, P. (1999) · SIAM Journal on Numerical Analysis · doi:10.1137/s0036142997327075 · Cited by 194
A bound optimization approach to wavelet-based image deconvolution
Figueiredo, M. A. T., & Nowak, R. D. (2005) · IEEE International Conference on Image Processing 2005 · doi:10.1109/icip.2005.1530172 · Cited by 189
Self-citationBioucas-Dias, J. M. (2006) · IEEE Transactions on Image Processing · doi:10.1109/tip.2005.863972 · Cited by 175
Self-citationMonotonicity of quadratic-approximation algorithms
Böhning, D., & Lindsay, B. G. (1988) · Annals of the Institute of Statistical Mathematics · doi:10.1007/bf00049423 · Cited by 170
Wavelet domain image restoration with adaptive edge-preserving regularization
Belge, M., Kilmer, M. E., & Miller, E. L. (2000) · IEEE Transactions on Image Processing · doi:10.1109/83.841937 · Cited by 160
Wavelets and curvelets for image deconvolution: a combined approach
Starck, J., Nguyen, M. K., & Murtagh, F. D. (2003) · Signal Processing · doi:10.1016/s0165-1684(03)00150-6 · Cited by 157
Spatially adaptive wavelet-based multiscale image restoration
Banham, M. R., & Katsaggelos, A. K. (1996) · IEEE Transactions on Image Processing · doi:10.1109/83.491338 · Cited by 130
Image Denoising with Shrinkage and Redundant Representations
Elad, M., Matalon, B., & Zibulevsky, M. (2006) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2006.143 · Cited by 91
More on sparse representations in arbitrary bases
Fuchs, J. J. (2003) · IFAC Proceedings Volumes · doi:10.1016/s1474-6670(17)34942-x · Cited by 46
Image deconvolution using hidden Markov tree modeling of complex wavelet packets
Jalobeanu, A., Kingsbury, N. G., & Zerubia, J. B. (2002) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2001.958988 · Cited by 41
Burger, M., Kaltenbacher, B., & Neubauer, A. (2015) · Springer eBooks · doi:10.1007/978-1-4939-0790-8_9 · Cited by 32
Models of Noise and Robust Estimation
Girosi, F. (1991) · Defense Technical Information Center (DTIC) · Cited by 23
Deblurring-by-Denoising using Spatially Adaptive Gaussian Scale Mixtures in Overcomplete Pyramids
Guerrero-Colon, J. A., & Portilla, J. (2006) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2006.312413 · Cited by 20
Iterative Image Deconvolution Using Overcomplete Representations
Chaux, C., Combettes, P. L., Pesquet, J.-C., et al. (2006) · HAL · doi:10.5281/zenodo.52716 · Cited by 9
Cited by
Enhancing Sparsity by Reweighted ℓ 1 Minimization
Candès, E. J., Wakin, M. B., & Boyd, S. P. (2008) · Journal of Fourier Analysis and Applications · doi:10.1007/s00041-008-9045-x · Cited by 4,863
Parikh, N., & Boyd, S. (2014) · Foundations and Trends® in Optimization · doi:10.1561/2400000003 · Cited by 4,102
From Sparse Solutions of Systems of Equations to Sparse Modeling of Signals and Images
Bruckstein, A. M., Donoho, D. L., & Elad, M. (2009) · SIAM Review · doi:10.1137/060657704 · Cited by 2,183
A New TwIST: Two-Step Iterative Shrinkage/Thresholding Algorithms for Image Restoration
Bioucas-Dias, J. M., & Figueiredo, M. A. T. (2007) · IEEE Transactions on Image Processing · doi:10.1109/tip.2007.909319 · Cited by 2,064
Self-citationSparse Reconstruction by Separable Approximation
Wright, S. J., Nowak, R. D., & Figueiredo, M. A. T. (2009) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2009.2016892 · Cited by 1,854
Self-citation
Metadata
- Authors
- Figueiredo, M. A. T., Bioucas-Dias, J. M., & Nowak, R. D.
- Venue
- IEEE Transactions on Image Processing
- Published
- 2007-12
- Volume
- 16
- Issue
- 12
- Pages
- 2980-2991
- ISSN
- 1057-7149 (ISSN-L)
- 1941-0042
- OpenAlex
- W1975377467
- Cited by
- 548
- References
- 52
- FWCI
- 27.93
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.