The DOI matches its Crossref record; 35 of the 35 references it cites were found in a registry or an index.
Why Simple Shrinkage Is Still Relevant for Redundant Representations?
Abstract
Shrinkage is a well known and appealing denoising technique, introduced originally by Donoho and Johnstone in 1994. The use of shrinkage for denoising is known to be optimal for Gaussian white noise, provided that the sparsity on the signal's representation is enforced using a unitary transform. Still, shrinkage is also practiced with nonunitary, and even redundant representations, typically leading to very satisfactory results. In this correspondence we shed some light on this behavior. The main argument in this work is that such simple shrinkage could be interpreted as the first iteration of an algorithm that solves the basis pursuit denoising (BPDN) problem. While the desired solution of BPDN is hard to obtain in general, we develop a simple iterative procedure for the BPDN minimization that amounts to stepwise shrinkage. We demonstrate how the simple shrinkage emerges as the first iteration of this novel algorithm. Furthermore, we show how shrinkage can be iterated, turning into an effective algorithm that minimizes the BPDN via simple shrinkage steps, in order to further strengthen the denoising effect
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Nonlinear total variation based noise removal algorithms
Rudin, L. I., Osher, S., & Fatemi, E. (1992) · Physica D: Nonlinear Phenomena · doi:10.1016/0167-2789(92)90242-f · Cited by 15,704
De-noising by soft-thresholding
Donoho, D. L. (1995) · IEEE Transactions on Information Theory · doi:10.1109/18.382009 · Cited by 9,619
Ideal spatial adaptation by wavelet shrinkage
Donoho, D. L., & Johnstone, I. M. (1994) · Biometrika · doi:10.1093/biomet/81.3.425 · Cited by 8,760
Atomic Decomposition by Basis Pursuit
Chen, S. S., Donoho, D. L., & Saunders, M. A. (2001) · SIAM Review · doi:10.1137/s003614450037906x · Cited by 5,085
An iterative thresholding algorithm for linear inverse problems with a sparsity constraint.
Daubechies, I., Defrise, M., & De Mol, C. (2004) · Communications on Pure and Applied Mathematics · doi:10.1002/cpa.20042 · Cited by 4,958
Adapting to Unknown Smoothness via Wavelet Shrinkage
Donoho, D. L., & Johnstone, I. M. (1995) · Journal of the American Statistical Association · doi:10.1080/01621459.1995.10476626 · Cited by 4,630
Pati, Y. C., Rezaiifar, R., & Krishnaprasad, P. S. (2002) · Proceedings of 27th Asilomar Conference on Signals, Systems and Computers · doi:10.1109/acssc.1993.342465 · Cited by 4,323
Adaptive wavelet thresholding for image denoising and compression
Chang, S. G., Yu, B., & Vetterli, M. (2000) · IEEE Transactions on Image Processing · doi:10.1109/83.862633 · Cited by 2,936
Image denoising using scale mixtures of gaussians in the wavelet domain
Portilla, J., Strela, V., Wainwright, M. J., & Simoncelli, E. P. (2003) · IEEE Transactions on Image Processing · doi:10.1109/tip.2003.818640 · Cited by 2,255
The curvelet transform for image denoising
Starck, J.-L., Candes, E. J., & Donoho, D. L. (2002) · IEEE Transactions on Image Processing · doi:10.1109/tip.2002.1014998 · Cited by 2,253
Sparse signal reconstruction from limited data using FOCUSS: a re-weighted minimum norm algorithm
Gorodnitsky, I. F., & Rao, B. D. (1997) · IEEE Transactions on Signal Processing · doi:10.1109/78.558475 · Cited by 1,834
Wavelet Shrinkage: Asymptopia?
Donoho, D. L., Johnstone, I. M., Kerkyacharian, G., & Picard, D. (1995) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1995.tb02032.x · Cited by 1,749
An EM algorithm for wavelet-based image restoration
Figueiredo, M. A. T., & Nowak, R. D. (2003) · IEEE Transactions on Image Processing · doi:10.1109/tip.2003.814255 · Cited by 1,219
Efficient and reliable schemes for nonlinear diffusion filtering
Weickert, J., Romeny, B. M. T. H., & Viergever, M. A. (1998) · IEEE Transactions on Image Processing · doi:10.1109/83.661190 · Cited by 1,130
Minimax estimation via wavelet shrinkage
Donoho, D. L., & Johnstone, I. M. (1998) · The Annals of Statistics · doi:10.1214/aos/1024691081 · Cited by 1,005
Spatially adaptive wavelet thresholding with context modeling for image denoising
Chang, S. G., Yu, B., & Vetterli, M. (2000) · IEEE Transactions on Image Processing · doi:10.1109/83.862630 · Cited by 893
On the origin of the bilateral filter and ways to improve it
Elad, M. (2002) · IEEE Transactions on Image Processing · doi:10.1109/tip.2002.801126 · Cited by 791
Self-citationThe finite ridgelet transform for image representation
Do, M. N., & Vetterli, M. (2003) · IEEE Transactions on Image Processing · doi:10.1109/tip.2002.806252 · Cited by 711
Wedgelets: nearly minimax estimation of edges
Donoho, D. L. (1999) · The Annals of Statistics · doi:10.1214/aos/1018031261 · Cited by 638
Noise removal via Bayesian wavelet coring
Simoncelli, E. P., & Adelson, E. H. (2002) · Proceedings of 3rd IEEE International Conference on Image Processing · doi:10.1109/icip.1996.559512 · Cited by 612
Analysis of multiresolution image denoising schemes using generalized Gaussian and complexity priors
Moulin, P., & Liu, J. (1999) · IEEE Transactions on Information Theory · doi:10.1109/18.761332 · Cited by 500
Noise reduction using an undecimated discrete wavelet transform
Lang, M., Guo, H., Odegard, J. E., Burrus, C. S., & Wells, R. O. (1996) · IEEE Signal Processing Letters · doi:10.1109/97.475823 · Cited by 484
Redundant Multiscale Transforms and Their Application for Morphological Component Separation
Starck, J.-L., Elad, M., & Donoho, D. (2004) · Advances in Imaging and Electron Physics · doi:10.1016/s1076-5670(04)32006-9 · Cited by 443
Self-citationNoise Reduction by Wavelet Thresholding
Jansen, M. (2001) · Lecture Notes in Statistics · doi:10.1007/978-1-4613-0145-5 · Cited by 390
Recovering edges in ill-posed inverse problems: optimality of curvelet frames
Candès, E. J., & Donoho, D. L. (2002) · The Annals of Statistics · doi:10.1214/aos/1028674842 · Cited by 322
Do, M. N., & Vetterli, M. (2003) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2003.815389 · Cited by 267
Astronomical image representation by the curvelet transform
Starck, J. L., Donoho, D. L., & Candès, E. J. (2003) · Astronomy & Astrophysics · doi:10.1051/0004-6361:20021571 · Cited by 264
Steidl, G., Weickert, J., Brox, T., Mrázek, P., & Welk, M. (2004) · SIAM Journal on Numerical Analysis · doi:10.1137/s0036142903422429 · Cited by 250
Do, M. N., & Vetterli, M. (2002) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2002.802019 · Cited by 212
Translation-Invariant Contourlet Transform and Its Application to Image Denoising
Esla, R., & Radha, H. (2006) · IEEE Transactions on Image Processing · doi:10.1109/tip.2006.881992 · Cited by 156
Linear and Nonlinear Image Deblurring: A Documented Study
Carasso, A. S. (1999) · SIAM Journal on Numerical Analysis · doi:10.1137/s0036142997320413 · Cited by 129
Adaptive image denoising using scale and space consistency
Scharcanski, J., Jung, C. R., & Clarke, R. T. (2002) · IEEE Transactions on Image Processing · doi:10.1109/tip.2002.802528 · Cited by 56
Weighted overcomplete denoising
Guleryuz, O. G. (2004) · doi:10.1109/acssc.2003.1292330 · Cited by 51
Adaptive image denoising and edge enhancement in scale-space using the wavelet transform
Jung, C. R., & Scharcanski, J. (2002) · Pattern Recognition Letters · doi:10.1016/s0167-8655(02)00220-9 · Cited by 35
Improved denoising of images using modelling of a redundant contourlet transform
Matalon, B., Elad, M., & Zibulevsky, M. (2005) · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · doi:10.1117/12.614449 · Cited by 27
Self-citation
Cited by
Figueiredo, M. A. T., Nowak, R. D., & Wright, S. J. (2007) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2007.910281 · Cited by 3,524
From Sparse Solutions of Systems of Equations to Sparse Modeling of Signals and Images
Bruckstein, A. M., Donoho, D. L., & Elad, M. (2009) · SIAM Review · doi:10.1137/060657704 · Cited by 2,183
Self-citationA New TwIST: Two-Step Iterative Shrinkage/Thresholding Algorithms for Image Restoration
Bioucas-Dias, J. M., & Figueiredo, M. A. T. (2007) · IEEE Transactions on Image Processing · doi:10.1109/tip.2007.909319 · Cited by 2,064
Sparse Reconstruction by Separable Approximation
Wright, S. J., Nowak, R. D., & Figueiredo, M. A. T. (2009) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2009.2016892 · Cited by 1,854
Bregman Iterative Algorithms for $\ell_1$-Minimization with Applications to Compressed Sensing
Yin, W., Osher, S., Goldfarb, D., & Darbon, J. (2008) · SIAM Journal on Imaging Sciences · doi:10.1137/070703983 · Cited by 1,414
Metadata
- Authors
- Elad, M.
- Venue
- IEEE Transactions on Information Theory
- Published
- 2006-12
- Volume
- 52
- Issue
- 12
- Pages
- 5559-5569
- ISSN
- 0018-9448 (ISSN-L)
- OpenAlex
- W2148556090
- Cited by
- 291
- References
- 35
- FWCI
- 28.23
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.