The DOI matches its Crossref record; 35 of the 35 references it cites were found in a registry or an index.
Why Simple Shrinkage Is Still Relevant for Redundant Representations?
Abstract
Shrinkage is a well known and appealing denoising technique, introduced originally by Donoho and Johnstone in 1994. The use of shrinkage for denoising is known to be optimal for Gaussian white noise, provided that the sparsity on the signal's representation is enforced using a unitary transform. Still, shrinkage is also practiced with nonunitary, and even redundant representations, typically leading to very satisfactory results. In this correspondence we shed some light on this behavior. The main argument in this work is that such simple shrinkage could be interpreted as the first iteration of an algorithm that solves the basis pursuit denoising (BPDN) problem. While the desired solution of BPDN is hard to obtain in general, we develop a simple iterative procedure for the BPDN minimization that amounts to stepwise shrinkage. We demonstrate how the simple shrinkage emerges as the first iteration of this novel algorithm. Furthermore, we show how shrinkage can be iterated, turning into an effective algorithm that minimizes the BPDN via simple shrinkage steps, in order to further strengthen the denoising effect
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Nonlinear total variation based noise removal algorithms
Rudin, L. I., Osher, S., & Fatemi, E. (1992) · Physica D: Nonlinear Phenomena · doi:10.1016/0167-2789(92)90242-f · Cited by 15,704
De-noising by soft-thresholding
Donoho, D. L. (1995) · IEEE Transactions on Information Theory · doi:10.1109/18.382009 · Cited by 9,619
Ideal spatial adaptation by wavelet shrinkage
Donoho, D. L., & Johnstone, I. M. (1994) · Biometrika · doi:10.1093/biomet/81.3.425 · Cited by 8,760
Atomic Decomposition by Basis Pursuit
Chen, S. S., Donoho, D. L., & Saunders, M. A. (2001) · SIAM Review · doi:10.1137/s003614450037906x · Cited by 5,085
An iterative thresholding algorithm for linear inverse problems with a sparsity constraint.
Daubechies, I., Defrise, M., & De Mol, C. (2004) · Communications on Pure and Applied Mathematics · doi:10.1002/cpa.20042 · Cited by 4,958
Adapting to Unknown Smoothness via Wavelet Shrinkage
Donoho, D. L., & Johnstone, I. M. (1995) · Journal of the American Statistical Association · doi:10.1080/01621459.1995.10476626 · Cited by 4,630
Pati, Y. C., Rezaiifar, R., & Krishnaprasad, P. S. (2002) · Proceedings of 27th Asilomar Conference on Signals, Systems and Computers · doi:10.1109/acssc.1993.342465 · Cited by 4,323
Adaptive wavelet thresholding for image denoising and compression
Chang, S. G., Yu, B., & Vetterli, M. (2000) · IEEE Transactions on Image Processing · doi:10.1109/83.862633 · Cited by 2,936
Image denoising using scale mixtures of gaussians in the wavelet domain
Portilla, J., Strela, V., Wainwright, M. J., & Simoncelli, E. P. (2003) · IEEE Transactions on Image Processing · doi:10.1109/tip.2003.818640 · Cited by 2,255
The curvelet transform for image denoising
Starck, J.-L., Candes, E. J., & Donoho, D. L. (2002) · IEEE Transactions on Image Processing · doi:10.1109/tip.2002.1014998 · Cited by 2,253
Cited by
Figueiredo, M. A. T., Nowak, R. D., & Wright, S. J. (2007) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2007.910281 · Cited by 3,524
From Sparse Solutions of Systems of Equations to Sparse Modeling of Signals and Images
Bruckstein, A. M., Donoho, D. L., & Elad, M. (2009) · SIAM Review · doi:10.1137/060657704 · Cited by 2,183
Self-citationA New TwIST: Two-Step Iterative Shrinkage/Thresholding Algorithms for Image Restoration
Bioucas-Dias, J. M., & Figueiredo, M. A. T. (2007) · IEEE Transactions on Image Processing · doi:10.1109/tip.2007.909319 · Cited by 2,064
Sparse Reconstruction by Separable Approximation
Wright, S. J., Nowak, R. D., & Figueiredo, M. A. T. (2009) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2009.2016892 · Cited by 1,854
Bregman Iterative Algorithms for $\ell_1$-Minimization with Applications to Compressed Sensing
Yin, W., Osher, S., Goldfarb, D., & Darbon, J. (2008) · SIAM Journal on Imaging Sciences · doi:10.1137/070703983 · Cited by 1,414
Dictionaries for Sparse Representation Modeling
Rubinstein, R., Bruckstein, A. M., & Elad, M. (2010) · Proceedings of the IEEE · doi:10.1109/jproc.2010.2040551 · Cited by 1,306
Self-citationIterative Thresholding for Sparse Approximations
Blumensath, T., & Davies, M. E. (2008) · Journal of Fourier Analysis and Applications · doi:10.1007/s00041-008-9035-z · Cited by 1,248
Alternating Direction Algorithms for $\ell_1$-Problems in Compressive Sensing
Yang, J., & Zhang, Y. (2011) · SIAM Journal on Scientific Computing · doi:10.1137/090777761 · Cited by 1,201
A Fast Approach for Overcomplete Sparse Decomposition Based on Smoothed $\ell ^{0}$ Norm
Mohimani, H., Babaie-Zadeh, M., & Jutten, C. (2009) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2008.2007606 · Cited by 1,091
Fixed-Point Continuation for $\ell_1$-Minimization: Methodology and Convergence
Hale, E. T., Yin, W., & Zhang, Y. (2008) · SIAM Journal on Optimization · doi:10.1137/070698920 · Cited by 909
A Nonlocal SAR Image Denoising Algorithm Based on LLMMSE Wavelet Shrinkage
Parrilli, S., Poderico, M., Angelino, C. V., & Verdoliva, L. (2012) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2011.2161586 · Cited by 752
On the Role of Sparse and Redundant Representations in Image Processing
Elad, M., Figueiredo, M. A. T., & Ma, Y. (2010) · Proceedings of the IEEE · doi:10.1109/jproc.2009.2037655 · Cited by 663
Self-citationDouble Sparsity: Learning Sparse Dictionaries for Sparse Signal Approximation
Rubinstein, R., Zibulevsky, M., & Elad, M. (2010) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2009.2036477 · Cited by 616
Self-citationMajorization–Minimization Algorithms for Wavelet-Based Image Restoration
Figueiredo, M. A. T., Bioucas-Dias, J. M., & Nowak, R. D. (2007) · IEEE Transactions on Image Processing · doi:10.1109/tip.2007.909318 · Cited by 548
The Undecimated Wavelet Decomposition and its Reconstruction
Starck, J.-L., Fadili, J., & Murtagh, F. (2007) · IEEE Transactions on Image Processing · doi:10.1109/tip.2006.887733 · Cited by 530
A Douglas–Rachford Splitting Approach to Nonsmooth Convex Variational Signal Recovery
Combettes, P. L., & Pesquet, J.-C. (2007) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2007.910264 · Cited by 490
Sparse Coding via Thresholding and Local Competition in Neural Circuits
Rozell, C. J., Johnson, D. H., Baraniuk, R. G., & Olshausen, B. A. (2008) · Neural Computation · doi:10.1162/neco.2008.03-07-486 · Cited by 456
L1-L2 Optimization in Signal and Image Processing
Zibulevsky, M., & Elad, M. (2010) · IEEE Signal Processing Magazine · doi:10.1109/msp.2010.936023 · Cited by 426
Self-citationDifferential Privacy via Wavelet Transforms
Xiao, X., Wang, G., & Gehrke, J. (2011) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2010.247 · Cited by 369
From Local Kernel to Nonlocal Multiple-Model Image Denoising
Katkovnik, V., Foi, A., Egiazarian, K., & Astola, J. (2010) · International Journal of Computer Vision · doi:10.1007/s11263-009-0272-7 · Cited by 353
A framelet-based image inpainting algorithm
Cai, J.-F., Chan, R. H., & Shen, Z. (2008) · Applied and Computational Harmonic Analysis · doi:10.1016/j.acha.2007.10.002 · Cited by 338
Inpainting and Zooming Using Sparse Representations
Fadili, M. J., Starck, J.-L., & Murtagh, F. (2008) · The Computer Journal · doi:10.1093/comjnl/bxm055 · Cited by 333
FISTA-Net: Learning a Fast Iterative Shrinkage Thresholding Network for Inverse Problems in Imaging
Xiang, J., Dong, Y., & Yang, Y. (2021) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2021.3054167 · Cited by 320
Morphological Component Analysis: An Adaptive Thresholding Strategy
Bobin, J., Starck, J.-L., Fadili, J. M., Moudden, Y., & Donoho, D. L. (2007) · IEEE Transactions on Image Processing · doi:10.1109/tip.2007.907073 · Cited by 314
Three-Dimensional SAR Focusing From Multipass Signals Using Compressive Sampling
Budillon, A., Evangelista, A., & Schirinzi, G. (2011) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2010.2054099 · Cited by 306
Shen, Y., Wen, Z., & Zhang, Y. (2014) · Optimization Methods and Software · doi:10.1080/10556788.2012.700713 · Cited by 299
Wen, Z., Yin, W., Goldfarb, D., & Zhang, Y. (2010) · SIAM Journal on Scientific Computing · doi:10.1137/090747695 · Cited by 280
Seismic denoising with nonuniformly sampled curvelets
Hennenfent, G., & Herrmann, F. J. (2006) · Computing in Science & Engineering · doi:10.1109/mcse.2006.49 · Cited by 261
Metadata
- Authors
- Elad, M.
- Venue
- IEEE Transactions on Information Theory
- Published
- 2006-12
- Volume
- 52
- Issue
- 12
- Pages
- 5559-5569
- ISSN
- 0018-9448 (ISSN-L)
- OpenAlex
- W2148556090
- Cited by
- 291
- References
- 35
- FWCI
- 28.23
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.