The DOI matches its Crossref record; 46 of the 46 references it cites were found in a registry or an index.
Learning Sparsifying Transforms
Abstract
The sparsity of signals and images in a certain transform domain or dictionary has been exploited in many applications in signal and image processing. Analytical sparsifying transforms such as Wavelets and DCT have been widely used in compression standards. Recently, synthesis sparsifying dictionaries that are directly adapted to the data have become popular especially in applications such as image denoising, inpainting, and medical image reconstruction. While there has been extensive research on learning synthesis dictionaries and some recent work on learning analysis dictionaries, the idea of learning sparsifying transforms has received no attention. In this work, we propose novel problem formulations for learning sparsifying transforms from data. The proposed alternating minimization algorithms give rise to well-conditioned square transforms. We show the superiority of our approach over analytical sparsifying transforms such as the DCT for signal and image representation. We also show promising performance in signal denoising using the learnt sparsifying transforms. The proposed approach is much faster than previous approaches involving learnt synthesis, or analysis dictionaries.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Donoho, D. L. (2006) · IEEE Transactions on Information Theory · doi:10.1109/tit.2006.871582 · Cited by 23,994
Donoho, D. L. (2004) · Cited by 16,703
A Wavelet Tour of Signal Processing
(1999) · Elsevier eBooks · doi:10.1016/b978-0-12-466606-1.x5000-4 · Cited by 16,227
Candes, E. J., Romberg, J., & Tao, T. (2006) · IEEE Transactions on Information Theory · doi:10.1109/tit.2005.862083 · Cited by 15,639
$rm K$-SVD: An Algorithm for Designing Overcomplete Dictionaries for Sparse Representation
Aharon, M., Elad, M., & Bruckstein, A. (2006) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2006.881199 · Cited by 9,451
Efron, B., Hastie, T., Johnstone, I., & Tibshirani, R. (2004) · The Annals of Statistics · doi:10.1214/009053604000000067 · Cited by 9,357
Decoding by Linear Programming
Candes, E. J., & Tao, T. (2005) · IEEE Transactions on Information Theory · doi:10.1109/tit.2005.858979 · Cited by 7,121
Sparse MRI: The application of compressed sensing for rapid MR imaging
Lustig, M., Donoho, D., & Pauly, J. M. (2007) · Magnetic Resonance in Medicine · doi:10.1002/mrm.21391 · Cited by 6,952
Emergence of simple-cell receptive field properties by learning a sparse code for natural images
Olshausen, B. A., & Field, D. J. (1996) · Nature · doi:10.1038/381607a0 · Cited by 5,694
Image Denoising Via Sparse and Redundant Representations Over Learned Dictionaries
Elad, M., & Aharon, M. (2006) · IEEE Transactions on Image Processing · doi:10.1109/tip.2006.881969 · Cited by 5,321
The contourlet transform: an efficient directional multiresolution image representation
Do, M. N., & Vetterli, M. (2005) · IEEE Transactions on Image Processing · doi:10.1109/tip.2005.859376 · Cited by 3,952
Greed is Good: Algorithmic Results for Sparse Approximation
Tropp, J. A. (2004) · IEEE Transactions on Information Theory · doi:10.1109/tit.2004.834793 · Cited by 3,635
Donoho, D. L. (2006) · Communications on Pure and Applied Mathematics · doi:10.1002/cpa.20132 · Cited by 2,490
Subspace Pursuit for Compressive Sensing Signal Reconstruction
Dai, W., & Milenkovic, O. (2009) · IEEE Transactions on Information Theory · doi:10.1109/tit.2009.2016006 · Cited by 2,388
Online Learning for Matrix Factorization and Sparse Coding
Mairal, J., Bach, F., Ponce, J., & Sapiro, G. (2009) · arXiv (Cornell University) · doi:10.48550/arxiv.0908.0050 · Cited by 2,258
From Sparse Solutions of Systems of Equations to Sparse Modeling of Signals and Images
Bruckstein, A. M., Donoho, D. L., & Elad, M. (2009) · SIAM Review · doi:10.1137/060657704 · Cited by 2,183
Sparse Representation for Color Image Restoration
Mairal, J., Elad, M., & Sapiro, G. (2008) · IEEE Transactions on Image Processing · doi:10.1109/tip.2007.911828 · Cited by 1,716
Dictionaries for Sparse Representation Modeling
Rubinstein, R., Bruckstein, A. M., & Elad, M. (2010) · Proceedings of the IEEE · doi:10.1109/jproc.2010.2040551 · Cited by 1,306
Exact Reconstruction of Sparse Signals via Nonconvex Minimization
Chartrand, R. (2007) · IEEE Signal Processing Letters · doi:10.1109/lsp.2007.898300 · Cited by 1,277
Method of optimal directions for frame design
Engan, K., Aase, S. O., & Hakon Husoy, J. (1999) · 1999 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings. ICASSP99 (Cat. No.99CH36258) · doi:10.1109/icassp.1999.760624 · Cited by 1,253
MR Image Reconstruction From Highly Undersampled k-Space Data by Dictionary Learning
Ravishankar, S., & Bresler, Y. (2011) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2010.2090538 · Cited by 1,059
Self-citationA unified approach to short-time Fourier analysis and synthesis
Allen, J. B., & Rabiner, L. R. (1977) · Proceedings of the IEEE · doi:10.1109/proc.1977.10770 · Cited by 1,046
Ridgelets: a key to higher-dimensional intermittency?
Candès, E. J., & Donoho, D. L. (1999) · Philosophical Transactions of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences · doi:10.1098/rsta.1999.0444 · Cited by 893
Blind Source Separation by Sparse Decomposition in a Signal Dictionary
Zibulevsky, M., & Pearlmutter, B. A. (2001) · Neural Computation · doi:10.1162/089976601300014385 · Cited by 766
Ramirez, I., Sprechmann, P., & Sapiro, G. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5539964 · Cited by 753
Analysis versus synthesis in signal priors
Elad, M., Milanfar, P., & Rubinstein, R. (2007) · Inverse Problems · doi:10.1088/0266-5611/23/3/007 · Cited by 698
Hadamard transform image coding
Pratt, W. K., Kane, J., & Andrews, H. C. (1969) · Proceedings of the IEEE · doi:10.1109/proc.1969.6869 · Cited by 657
Double Sparsity: Learning Sparse Dictionaries for Sparse Signal Approximation
Rubinstein, R., Zibulevsky, M., & Elad, M. (2010) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2009.2036477 · Cited by 616
Neuromagnetic source imaging with FOCUSS: a recursive weighted minimum norm algorithm
Gorodnitsky, I. F., George, J. S., & Rao, B. D. (1995) · Electroencephalography and Clinical Neurophysiology · doi:10.1016/0013-4694(95)00107-a · Cited by 567
Learning Multiscale Sparse Representations for Image and Video Restoration
Mairal, J., Sapiro, G., & Elad, M. (2008) · Multiscale Modeling & Simulation · doi:10.1137/070697653 · Cited by 460
Marcellin, M. W., Gormish, M. J., Bilgin, A., & Boliek, M. P. (2002) · Proceedings DCC 2000. Data Compression Conference · doi:10.1109/dcc.2000.838192 · Cited by 405
Recursive Least Squares Dictionary Learning Algorithm
Skretting, K., & Engan, K. (2010) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2010.2040671 · Cited by 387
Image Sequence Denoising via Sparse and Redundant Representations
Protter, M., & Elad, M. (2009) · IEEE Transactions on Image Processing · doi:10.1109/tip.2008.2008065 · Cited by 323
k-t SPARSE: High frame rate dynamic MRI exploiting spatio-temporal sparsity
Lustig, M. S., Santos, J. M., Donoho, D. L., & Pauly, J. M. (2006) · Cited by 313
Signal recovery from random projections
Candes, E. J., & Romberg, J. K. (2005) · SPIE Proceedings · doi:10.1117/12.600722 · Cited by 299
Practical Signal Recovery from Random Projections
Romberg, J. (2005) · Cited by 281
Dictionary Learning for Sparse Approximations With the Majorization Method
Yaghoobi, M., Blumensath, T., & Davies, M. E. (2009) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2009.2016257 · Cited by 213
Sparse and Redundant Modeling of Image Content Using an Image-Signature-Dictionary
Aharon, M., & Elad, M. (2008) · SIAM Journal on Imaging Sciences · doi:10.1137/07070156x · Cited by 166
Dictionary Identification—Sparse Matrix-Factorization via $\ell_1$-Minimization
Gribonval, R., & Schnass, K. (2010) · IEEE Transactions on Information Theory · doi:10.1109/tit.2010.2048466 · Cited by 160
Constrained Overcomplete Analysis Operator Learning for Cosparse Signal Modelling
Yaghoobi, M., Nam, S., Gribonval, R., & Davies, M. E. (2013) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2013.2250968 · Cited by 105
Solving Log-Determinant Optimization Problems by a Newton-CG Primal Proximal Point Algorithm
Wang, C., Sun, D., & Toh, K.-C. (2010) · SIAM Journal on Optimization · doi:10.1137/090772514 · Cited by 98
Image modeling and enhancement via structured sparse model selection
Yu, G., Sapiro, G., & Mallat, S. (2010) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2010.5653853 · Cited by 78
Learning Analysis Sparsity Priors
Gabriel Peyré, A., & Fadili, J. M. (2010) · Base Institutionnelle de Recherche de l'université Paris-Dauphine (BIRD) (University Paris-Dauphine) · Cited by 53
Analysis Operator Learning For Overcomplete Cosparse Representations
Davies, M. E., Gribonval, R., Nam, S., & Yaghoobi, M. (2011) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.5281/zenodo.42656 · Cited by 50
Sparse representations for limited data tomography
Liao, H. Y., & Sapiro, G. (2008) · IEEE International Symposium on Biomedical Imaging (ISBI) · doi:10.1109/isbi.2008.4541261 · Cited by 48
Learning sparsifying transforms for image processing
Ravishankar, S., & Bresler, Y. (2012) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2012.6466951 · Cited by 28
Self-citation
Cited by
LEARN: Learned Experts’ Assessment-Based Reconstruction Network for Sparse-Data CT
Chen, H., Zhang, Y., Chen, Y., Zhang, J., Zhang, W., Sun, H., Lv, Y., Liao, P., Zhou, J., & Wang, G. (2018) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2018.2805692 · Cited by 433
Image Reconstruction: From Sparsity to Data-Adaptive Methods and Machine Learning
Ravishankar, S., Ye, J. C., & Fessler, J. A. (2020) · Proceedings of the IEEE · doi:10.1109/jproc.2019.2936204 · Cited by 294
Self-citation
Metadata
- Authors
- Ravishankar, S., & Bresler, Y.
- Venue
- IEEE Transactions on Signal Processing
- Published
- 2013-03
- Volume
- 61
- Issue
- 5
- Pages
- 1072-1086
- ISSN
- 1053-587X (ISSN-L)
- 1941-0476
- OpenAlex
- W2141039087
- Cited by
- 344
- References
- 46
- FWCI
- 19.70
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.