The DOI matches its Crossref record; 3 of the 3 references it cites were found in a registry or an index.
$rm K$-SVD: An Algorithm for Designing Overcomplete Dictionaries for Sparse Representation
Abstract
In recent years there has been a growing interest in the study of sparse representation of signals. Using an overcomplete dictionary that contains prototype signal-atoms, signals are described by sparse linear combinations of these atoms. Applications that use sparse representation are many and include compression, regularization in inverse problems, feature extraction, and more. Recent activity in this field has concentrated mainly on the study of pursuit algorithms that decompose signals with respect to a given dictionary. Designing dictionaries to better fit the above model can be done by either selecting one from a prespecified set of linear transforms or adapting the dictionary to a set of training signals. Both of these techniques have been considered, but this topic is largely still open. In this paper we propose a novel algorithm for adapting dictionaries in order to achieve sparse signal representations. Given a set of training signals, we seek the dictionary that leads to the best representation for each member in this set, under strict sparsity constraints. We present a new method-the K-SVD algorithm-generalizing the K-means clustering process. K-SVD is an iterative method that alternates between sparse coding of the examples based on the current dictionary and a process of updating the dictionary atoms to better fit the data. The update of the dictionary columns is combined with an update of the sparse representations, thereby accelerating convergence. The K-SVD algorithm is flexible and can work with any pursuit method (e.g., basis pursuit, FOCUSS, or matching pursuit). We analyze this algorithm and demonstrate its results both on synthetic tests and in applications on real image data
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Maximum Likelihood from Incomplete Data Via the EM Algorithm
Dempster, A. P., Laird, N. M., & Rubin, D. B. (1977) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1977.tb01600.x · Cited by 50,444
An Information-Maximization Approach to Blind Separation and Blind Deconvolution
Bell, A. J., & Sejnowski, T. J. (1995) · Neural Computation · doi:10.1162/neco.1995.7.6.1129 · Cited by 8,986
Sparse coding with an overcomplete basis set: A strategy employed by V1?
Olshausen, B. A., & Field, D. J. (1997) · Vision Research · doi:10.1016/s0042-6989(97)00169-7 · Cited by 3,642
Cited by
Image Super-Resolution Using Deep Convolutional Networks
Dong, C., Loy, C. C., He, K., & Tang, X. (2016) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2015.2439281 · Cited by 10,105
Dictionary learning for integrative, multimodal and scalable single-cell analysis
Hao, Y., Stuart, T., Kowalski, M. H., Choudhary, S., Hoffman, P., Hartman, A., Srivastava, A., Molla, G., Madad, S., Fernandez-Granda, C., et al. (2024) · Nature Biotechnology · doi:10.1038/s41587-023-01767-y · Cited by 5,631
Image Denoising Via Sparse and Redundant Representations Over Learned Dictionaries
Elad, M., & Aharon, M. (2006) · IEEE Transactions on Image Processing · doi:10.1109/tip.2006.881969 · Cited by 5,321
Self-citationNTIRE 2017 Challenge on Single Image Super-Resolution: Dataset and Study
Agustsson, E., & Timofte, R. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2017.150 · Cited by 4,295
Hyperspectral Unmixing Overview: Geometrical, Statistical, and Sparse Regression-Based Approaches
Bioucas-Dias, J. M., Plaza, A., Dobigeon, N., Parente, M., Du, Q., Gader, P., & Chanussot, J. (2012) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2012.2194696 · Cited by 2,836
Chen, C. L. P., & Liu, Z. (2018) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2017.2716952 · Cited by 1,957
Sparse Representation for Color Image Restoration
Mairal, J., Elad, M., & Sapiro, G. (2008) · IEEE Transactions on Image Processing · doi:10.1109/tip.2007.911828 · Cited by 1,716
Self-citationNonlocally Centralized Sparse Representation for Image Restoration
Dong, W., Zhang, L., Shi, G., & Li, X. (2013) · IEEE Transactions on Image Processing · doi:10.1109/tip.2012.2235847 · Cited by 1,505
Image denoising: Can plain neural networks compete with BM3D?
Burger, H. C., Schuler, C. J., & Harmeling, S. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6247952 · Cited by 1,325
Toward Convolutional Blind Denoising of Real Photographs
Guo, S., Yan, Z., Zhang, K., Zuo, W., & Zhang, L. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00181 · Cited by 1,221
Deep Learning on Image Denoising: An overview
Tian, C., Fei, L., Zheng, W., Xu, Y., Zuo, W., & Lin, C.-W. (2020) · Neural Networks · doi:10.1016/j.neunet.2020.07.025 · Cited by 1,091
Enhanced Performance of Brain Tumor Classification via Tumor Region Augmentation and Partition
Cheng, J., Huang, W., Cao, S., Yang, R., Yang, W., Yun, Z., Wang, Z., & Feng, Q. (2015) · PLOS ONE · doi:10.1371/journal.pone.0140381 · Cited by 879
aLow-dose CT via convolutional neural network
Chen, H., Zhang, Y., Zhang, W., Liao, P., Li, K., Zhou, J., & Wang, G. (2017) · Biomedical Optics Express · doi:10.1364/boe.8.000679 · Cited by 755
Machine learning in acoustics: Theory and applications
Bianco, M. J., Gerstoft, P., Traer, J., Ozanich, E., Roch, M. A., Gannot, S., & Deledalle, C.-A. (2019) · The Journal of the Acoustical Society of America · doi:10.1121/1.5133944 · Cited by 609
Internal statistics of a single natural image
Zontak, M., & Irani, M. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995401 · Cited by 375
Li, M., Hsu, W., Xie, X., Cong, J., & Gao, W. (2020) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2020.2968472 · Cited by 321
Unsupervised feature learning for 3D scene labeling
Lai, K., Bo, L., & Fox, D. (2014) · 2014 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2014.6907298 · Cited by 317
Transfer adaptation learning: A decade survey
Zhang, L., & Gao, X. (2024) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3183326 · Cited by 314
Stowell, D., & Plumbley, M. D. (2014) · PeerJ · doi:10.7717/peerj.488 · Cited by 295
Sparse coding based visual tracking: Review and experimental comparison
Zhang, S., Yao, H., Sun, X., & Lu, X. (2013) · Pattern Recognition · doi:10.1016/j.patcog.2012.10.006 · Cited by 284
Bhattacharya, S., & Lane, N. D. (2016) · Proceedings of the 14th ACM Conference on Embedded Networked Sensor Systems CD-ROM · doi:10.1145/2994551.2994564 · Cited by 236
Faults and Diagnosis Methods of Permanent Magnet Synchronous Motors: A Review
Chen, Y., Liang, S., Li, W., Liang, H., & Wang, C. (2019) · Applied Sciences · doi:10.3390/app9102116 · Cited by 194
Linear Algebraic Structure of Word Senses, with Applications to Polysemy
Arora, S., Li, Y., Liang, Y., Ma, T., & Risteski, A. (2018) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00034 · Cited by 186
Dictionary Learning-Based Sparse Channel Representation and Estimation for FDD Massive MIMO Systems
Ding, Y., & Rao, B. D. (2018) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2018.2843786 · Cited by 161
Large-Margin Multi-Modal Deep Learning for RGB-D Object Recognition
Wang, A., Lu, J., Cai, J., Cham, T.-J., & Wang, G. (2015) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2015.2476655 · Cited by 153
Zhou, H., Chen, J., Dong, G., & Wang, R. (2016) · Mechanical Systems and Signal Processing · doi:10.1016/j.ymssp.2015.11.022 · Cited by 131
Direct face detection and video reconstruction from event cameras
Miyatani, Y., Barua, S., & Veeraraghavan, A. (2016) · 2016 IEEE Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv.2016.7477561 · Cited by 133
Shao, F., Li, K., Lin, W., Jiang, G., Yu, M., & Dai, Q. (2015) · IEEE Transactions on Image Processing · doi:10.1109/tip.2015.2436332 · Cited by 116
Implicit data crimes: Machine learning bias arising from misuse of public data
Shimron, E., Tamir, J. I., Wang, K., & Lustig, M. (2022) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2117203119 · Cited by 112
Yu, L., Guo, Y., Wang, Y., Yu, J., & Chen, P. (2017) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2016.2628401 · Cited by 96
Turning a denoiser into a super-resolver using plug and play priors
Brifman, A., Romano, Y., & Elad, M. (2016) · 2016 IEEE International Conference on Image Processing (ICIP) · doi:10.1109/icip.2016.7532589 · Cited by 91
Self-citationFakePolisher: Making DeepFakes More Detection-Evasive by Shallow Reconstruction
Huang, Y., Juefei-Xu, F., Wang, R., Guo, Q., Ma, L., Xie, X., Li, J., Miao, W., Liu, Y., & Pu, G. (2020) · Proceedings of the 28th ACM International Conference on Multimedia · doi:10.1145/3394171.3413732 · Cited by 71
Chaos and compressive sensing based novel image encryption scheme
Khan, J. S., & Kayhan, S. K. (2021) · Journal of Information Security and Applications · doi:10.1016/j.jisa.2020.102711 · Cited by 65
Light field image denoising using a linear 4D frequency-hyperfan all-in-focus filter
Dansereau, D. G., Bongiorno, D. L., Pizarro, O., & Williams, S. B. (2013) · SPIE Proceedings · doi:10.1117/12.2002239 · Cited by 63
Face Aging Effect Simulation Using Hidden Factor Analysis Joint Sparse Representation
Yang, H., Huang, D., Wang, Y., Wang, H., & Tang, Y. (2016) · IEEE Transactions on Image Processing · doi:10.1109/tip.2016.2547587 · Cited by 58
Energy-Efficient Multi-Mode Compressed Sensing System for Implantable Neural Recordings
Suo, Y., Zhang, J., Xiong, T., Chin, P. S., Etienne-Cummings, R., & Tran, T. D. (2014) · IEEE Transactions on Biomedical Circuits and Systems · doi:10.1109/tbcas.2014.2359180 · Cited by 47
A closed-loop compressive-sensing-based neural recording system
Zhang, J., Mitra, S., Suo, Y., Cheng, A., Xiong, T., Michon, F., Welkenhuysen, M., Kloosterman, F., Chin, P. S., Hsiao, S., et al. (2015) · Journal of Neural Engineering · doi:10.1088/1741-2560/12/3/036005 · Cited by 33
High Speed and High Dynamic Range Video with an Event Camera
Rebecq, H., Ranftl, R., Koltun, V., & Scaramuzza, D. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2963386 · Cited by 50
A group lasso based sparse KNN classifier
Zheng, S., & Ding, C. (2020) · Pattern Recognition Letters · doi:10.1016/j.patrec.2019.12.020 · Cited by 22
Chen, Y., Yang, Y., Pan, X., Meng, X., & Hu, J. (2022) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2022.3183114 · Cited by 22
Facial expression recognition using dual dictionary learning
Moeini, A., Faez, K., Moeini, H., & Safai, A. M. (2017) · Journal of Visual Communication and Image Representation · doi:10.1016/j.jvcir.2017.02.007 · Cited by 21
Fastfood dictionary learning for periocular-based full face hallucination
Juefei-Xu, F., & Savvides, M. (2016) · 2016 IEEE 8th International Conference on Biometrics Theory, Applications and Systems (BTAS) · doi:10.1109/btas.2016.7791174 · Cited by 19
Shah, S. A., Echols, J. T., Sun, C., Wolf, M. J., & Epstein, F. H. (2022) · Magnetic Resonance in Medicine · doi:10.1002/mrm.29348 · Cited by 14
Amortized Neural Networks for Low-Latency Speech Recognition
Macoskey, J., Strimel, G. P., Su, J., & Rastrow, A. (2021) · Interspeech 2021 · doi:10.21437/interspeech.2021-712 · Cited by 12
Learning a Class-specific and Shared Dictionary for Classifying Surface Defects of Steel Sheet
Zhou, S., Chen, Y., Zhang, D., Xie, J., & Zhou, Y. (2017) · ISIJ International · doi:10.2355/isijinternational.isijint-2016-478 · Cited by 9
Improving Dictionary Learning with Gated Sparse Autoencoders
Rajamanoharan, S., Conmy, A., Smith, L., Lieberum, T., Varma, V., Kramár, J., Shah, R., & Nanda, N. (2024) · arXiv · doi:10.48550/arxiv.2404.16014 · Cited by 3
Metadata
- Authors
- Aharon, M., Elad, M., & Bruckstein, A.
- Venue
- IEEE Transactions on Signal Processing
- Published
- 2006-11
- Volume
- 54
- Issue
- 11
- Pages
- 4311-4322
- ISSN
- 1053-587X (ISSN-L)
- OpenAlex
- W2160547390
- Cited by
- 9,451
- References
- 3
- FWCI
- 77.96
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
