The DOI matches its Crossref record; 37 of the 37 references it cites were found in a registry or an index.
Coupled Dictionary Training for Image Super-Resolution
Abstract
In this paper, we propose a novel coupled dictionary training method for single image super-resolution based on patchwise sparse recovery, where the learned couple dictionaries relate the low- and high-resolution image patch spaces via sparse representation. The learning process enforces that the sparse representation of a low-resolution image patch in terms of the low-resolution dictionary can well reconstruct its underlying high-resolution image patch with the dictionary in the highresolution image patch space. We model the learning problem as a bilevel optimization problem, where the optimization includes an 1-norm minimization problem in its constraints. Implicit differentiation is employed to calculate the desired gradient for stochastic gradient descent. We demonstrate that our coupled dictionary learning method can outperform the existing joint dictionary training method both quantitatively and qualitatively. Furthermore, for real applications, we speed up the algorithm approximately 10 times by learning a neural network model for fast sparse inference and selectively processing only those visually salient regions. Extensive experimental comparisons with stateof- the-art super-resolution algorithms validate the effectiveness of our proposed approach.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
De-noising by soft-thresholding
Donoho, D. L. (1995) · IEEE Transactions on Information Theory · doi:10.1109/18.382009 · Cited by 9,619
$rm K$-SVD: An Algorithm for Designing Overcomplete Dictionaries for Sparse Representation
Aharon, M., Elad, M., & Bruckstein, A. (2006) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2006.881199 · Cited by 9,451
Efron, B., Hastie, T., Johnstone, I., & Tibshirani, R. (2004) · The Annals of Statistics · doi:10.1214/009053604000000067 · Cited by 9,357
Image Super-Resolution Via Sparse Representation
Yang, J., Wright, J., Huang, T. S., & Ma, Y. (2010) · IEEE Transactions on Image Processing · doi:10.1109/tip.2010.2050625 · Cited by 5,217
Self-citationExample-based super-resolution
Freeman, W. T., Jones, T. R., & Pasztor, E. C. (2002) · IEEE Computer Graphics and Applications · doi:10.1109/38.988747 · Cited by 2,498
Learning Fast Approximations of Sparse Coding
Gregor, K., & LeCun, Y. (2010) · International Conference on Machine Learning · Cited by 2,400
Efficient sparse coding algorithms
Lee, H., Battle, A., Raina, R., & Ng, A. Y. (2007) · Advances in Neural Information Processing Systems 19 · doi:10.7551/mitpress/7503.003.0105 · Cited by 2,394
Online Learning for Matrix Factorization and Sparse Coding
Mairal, J., Bach, F., Ponce, J., & Sapiro, G. (2009) · arXiv (Cornell University) · doi:10.48550/arxiv.0908.0050 · Cited by 2,258
What is the best multi-stage architecture for object recognition?
Jarrett, K., Kavukcuoglu, K., Ranzato, M. A., & LeCun, Y. (2009) · 2009 IEEE 12th International Conference on Computer Vision · doi:10.1109/iccv.2009.5459469 · Cited by 2,153
Online dictionary learning for sparse coding
Mairal, J., Bach, F., Ponce, J., & Sapiro, G. (2009) · Proceedings of the 26th Annual International Conference on Machine Learning · doi:10.1145/1553374.1553463 · Cited by 2,114
Cited by
Image Super-Resolution Using Deep Convolutional Networks
Dong, C., Loy, C. C., He, K., & Tang, X. (2016) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2015.2439281 · Cited by 10,105
Enhanced Deep Residual Networks for Single Image Super-Resolution
Lim, B., Son, S., Kim, H., Nah, S., & Lee, K. M. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2017.151 · Cited by 7,736
Learning a Deep Convolutional Network for Image Super-Resolution
Dong, C., Loy, C. C., He, K., & Tang, X. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10593-2_13 · Cited by 5,494
Single image super-resolution from transformed self-exemplars
Huang, J.-B., Singh, A., & Ahuja, N. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7299156 · Cited by 3,472
Image Super-Resolution Using Dense Skip Connections
Tong, T., Li, G., Liu, X., & Gao, Q. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.514 · Cited by 1,373
On the use of deep learning for computational imaging
Barbastathis, G., Ozcan, A., & Situ, G. (2019) · Optica · doi:10.1364/optica.6.000921 · Cited by 869
Deep Networks for Image Super-Resolution with Sparse Prior
Wang, Z., Liu, D., Yang, J., Han, W., & Huang, T. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.50 · Cited by 784
Self-citationReal-Time Video Super-Resolution with Spatio-Temporal Networks and Motion Compensation
Caballero, J., Ledig, C., Aitken, A., Acosta, A., Totz, J., Wang, Z., & Shi, W. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.304 · Cited by 763
Self-citationSuper-resolution: a comprehensive survey
Nasrollahi, K., & Moeslund, T. B. (2014) · Machine Vision and Applications · doi:10.1007/s00138-014-0623-4 · Cited by 684
Image super-resolution: the techniques, applications, and future
Yue, L., Shen, H., Li, J., Yuan, Q., Zhang, H., & Zhang, L. (2016) · Signal Processing · doi:10.1016/j.sigpro.2016.05.002 · Cited by 554
A novel multi-modality image fusion method based on image decomposition and sparse representation
Zhu, Z., Yin, H., Chai, Y., Li, Y., & Qi, G. (2018) · Information Sciences · doi:10.1016/j.ins.2017.09.010 · Cited by 408
A Statistical Prediction Model Based on Sparse Representations for Single Image Super-Resolution
Peleg, T., & Elad, M. (2014) · IEEE Transactions on Image Processing · doi:10.1109/tip.2014.2305844 · Cited by 407
Compressive light field photography using overcomplete dictionaries and optimized projections
Marwah, K., Wetzstein, G., Bando, Y., & Raskar, R. (2013) · ACM Transactions on Graphics · doi:10.1145/2461912.2461914 · Cited by 398
Fast Image Super-Resolution Based on In-Place Example Regression
Yang, J., Lin, Z., & Cohen, S. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.141 · Cited by 327
Self-citationSparse Modeling for Image and Vision Processing
Mairal, J. (2014) · now publishers, Inc. eBooks · doi:10.1561/9781680830095 · Cited by 322
RAISR: Rapid and Accurate Image Super Resolution
Romano, Y., Isidoro, J., & Milanfar, P. (2017) · IEEE Transactions on Computational Imaging · doi:10.1109/tci.2016.2629284 · Cited by 280
Robust Single Image Super-Resolution via Deep Networks With Sparse Prior
Liu, D., Wang, Z., Wen, B., Yang, J., Han, W., & Huang, T. S. (2016) · IEEE Transactions on Image Processing · doi:10.1109/tip.2016.2564643 · Cited by 266
Self-citationEnd-to-End Image Super-Resolution via Deep and Shallow Convolutional Networks
Wang, Y., Wang, L., Wang, H., & Li, P. (2019) · IEEE Access · doi:10.1109/access.2019.2903582 · Cited by 143
Personalized Age Progression with Bi-Level Aging Dictionary Learning
Shu, X., Tang, J., Li, Z., Lai, H., Zhang, L., & Yan, S. (2018) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2705122 · Cited by 95
7T-guided super-resolution of 3T MRI
Bahrami, K., Shi, F., Rekik, I., Gao, Y., & Shen, D. (2017) · Medical Physics · doi:10.1002/mp.12132 · Cited by 56
Image super-resolution with densely connected convolutional networks
Kuang, P., Ma, T., Chen, Z., & Li, F. (2019) · Applied Intelligence · doi:10.1007/s10489-018-1234-y · Cited by 33
Metadata
- Authors
- Yang, J., Wang, Z., Lin, Z., Cohen, S., & Huang, T.
- Venue
- IEEE Transactions on Image Processing
- Published
- 2012-08
- Volume
- 21
- Issue
- 8
- Pages
- 3467-3478
- ISSN
- 1057-7149 (ISSN-L)
- 1941-0042
- OpenAlex
- W2088254198
- Cited by
- 793
- References
- 37
- FWCI
- 48.52
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.