The DOI matches its Crossref record; 52 of the 52 references it cites were found in a registry or an index.
Robust Single Image Super-Resolution via Deep Networks With Sparse Prior
Abstract
Single image super-resolution (SR) is an ill-posed problem, which tries to recover a high-resolution image from its low-resolution observation. To regularize the solution of the problem, previous methods have focused on designing good priors for natural images, such as sparse representation, or directly learning the priors from a large data set with models, such as deep neural networks. In this paper, we argue that domain expertise from the conventional sparse coding model can be combined with the key ingredients of deep learning to achieve further improved results. We demonstrate that a sparse coding model particularly designed for SR can be incarnated as a neural network with the merit of end-to-end optimization over training data. The network has a cascaded structure, which boosts the SR performance for both fixed and incremental scaling factors. The proposed training and testing schemes can be extended for robust handling of images with additional degradation, such as noise and blurring. A subjective assessment is conducted and analyzed in order to thoroughly evaluate various SR techniques. Our proposed model is tested on a wide range of images, and it significantly outperforms the existing state-of-the-art methods for various scaling factors both quantitatively and perceptually.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
Image quality assessment: from error visibility to structural similarity
Wang, Z., Bovik, A. C., Sheikh, H. R., & Simoncelli, E. P. (2004) · IEEE Transactions on Image Processing · doi:10.1109/tip.2003.819861 · Cited by 57,892
Self-citation(2010) · International Conference on Machine Learning · Cited by 13,995
Image Super-Resolution Using Deep Convolutional Networks
Dong, C., Loy, C. C., He, K., & Tang, X. (2016) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2015.2439281 · Cited by 10,105
$rm K$-SVD: An Algorithm for Designing Overcomplete Dictionaries for Sparse Representation
Aharon, M., Elad, M., & Bruckstein, A. (2006) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2006.881199 · Cited by 9,451
Image denoising by sparse 3-D transform-domain collaborative filtering
Dabov, K., Foi, A., Katkovnik, V., & Egiazarian, K. (2007) · IEEE Transactions on Image Processing · doi:10.1109/tip.2007.901238 · Cited by 9,283
Martin, D., Fowlkes, C., Tal, D., & Malik, J. (2002) · Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001 · doi:10.1109/iccv.2001.937655 · Cited by 8,216
A Non-Local Algorithm for Image Denoising
Buades, A., Coll, B., & Morel, J.-M. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.38 · Cited by 7,616
Learning a Deep Convolutional Network for Image Super-Resolution
Dong, C., Loy, C. C., He, K., & Tang, X. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10593-2_13 · Cited by 5,494
Image Super-Resolution Via Sparse Representation
Yang, J., Wright, J., Huang, T. S., & Ma, Y. (2010) · IEEE Transactions on Image Processing · doi:10.1109/tip.2010.2050625 · Cited by 5,217
Self-citationAn iterative thresholding algorithm for linear inverse problems with a sparsity constraint.
Daubechies, I., Defrise, M., & De Mol, C. (2004) · Communications on Pure and Applied Mathematics · doi:10.1002/cpa.20042 · Cited by 4,958
Single image super-resolution from transformed self-exemplars
Huang, J.-B., Singh, A., & Ahuja, N. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7299156 · Cited by 3,472
On Single Image Scale-Up Using Sparse-Representations
Zeyde, R., Elad, M., & Protter, M. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-27413-8_47 · Cited by 3,352
Learning and Transferring Mid-level Image Representations Using Convolutional Neural Networks
Oquab, M., Bottou, L., Laptev, I., & Sivic, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.222 · Cited by 3,150 · cited 1×
“This method has proven successful on a number of high-level vision tasks, even if there is a limited amount of training data in the new task [30].”
MethodLow-Complexity Single-Image Super-Resolution based on Nonnegative Neighbor Embedding
Bevilacqua, M., Roumy, A., Guillemot, C., & Morel, M.-L. A. (2012) · Procedings of the British Machine Vision Conference 2012 · doi:10.5244/c.26.135 · Cited by 2,701
Rank Analysis of Incomplete Block Designs: I. The Method of Paired Comparisons
Bradley, R. A., & Terry, M. E. (1952) · Biometrika · doi:10.2307/2334029 · Cited by 2,412
Super-resolution from a single image
Glasner, D., Bagon, S., & Irani, M. (2009) · 2009 IEEE 12th International Conference on Computer Vision · doi:10.1109/iccv.2009.5459271 · Cited by 1,889
Building high-level features using large scale unsupervised learning
Le, Q. V. (2013) · 2013 IEEE International Conference on Acoustics, Speech and Signal Processing · doi:10.1109/icassp.2013.6639343 · Cited by 1,695
RANK ANALYSIS OF INCOMPLETE BLOCK DESIGNS: THE METHOD OF PAIRED COMPARISONS
BRADLEY, R. A., & TERRY, M. E. (1952) · Biometrika · doi:10.1093/biomet/39.3-4.324 · Cited by 1,434
Learning Fast Approximations of Sparse Coding
Gregor, K., & LeCun, Y. (2010) · International Conference on Machine Learning · Cited by 1,413
A+: Adjusted Anchored Neighborhood Regression for Fast Super-Resolution
Timofte, R., De Smet, V., & Van Gool, L. (2015) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-16817-3_8 · Cited by 1,408
Anchored Neighborhood Regression for Fast Example-Based Super-Resolution
Timofte, R., De, V., & Gool, L. V. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.241 · Cited by 1,351
Limits on super-resolution and how to break them
Baker, S., & Kanade, T. (2002) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2002.1033210 · Cited by 1,205
Limits on super-resolution and how to break them
Baker, S., & Kanade, T. (2002) · Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662) · doi:10.1109/cvpr.2000.854852 · Cited by 1,184
Single-Image Super-Resolution Using Sparse Regression and Natural Image Prior
Kim, K. I., & Kwon, Y. (2010) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2010.25 · Cited by 956
Coupled Dictionary Training for Image Super-Resolution
Yang, J., Wang, Z., Lin, Z., Cohen, S., & Huang, T. (2012) · IEEE Transactions on Image Processing · doi:10.1109/tip.2012.2192127 · Cited by 793
Self-citationDeep Networks for Image Super-Resolution with Sparse Prior
Wang, Z., Liu, D., Yang, J., Han, W., & Huang, T. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.50 · Cited by 784
Self-citationImage and video upscaling from local self-examples
Freedman, G., & Fattal, R. (2011) · ACM Transactions on Graphics · doi:10.1145/1944846.1944852 · Cited by 679
Single-Image Super-Resolution: A Benchmark
Yang, C.-Y., Ma, C., & Yang, M.-H. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10593-2_25 · Cited by 615
Heterogeneous Network Embedding via Deep Architectures
Chang, S., Han, W., Tang, J., Qi, G.-J., Aggarwal, C. C., & Huang, T. S. (2015) · Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2783258.2783296 · Cited by 590
Self-citationSingle Image Super-Resolution With Non-Local Means and Steering Kernel Regression
Zhang, K., Gao, X., Tao, D., & Li, X. (2012) · IEEE Transactions on Image Processing · doi:10.1109/tip.2012.2208977 · Cited by 576
Sparse Coding via Thresholding and Local Competition in Neural Circuits
Rozell, C. J., Johnson, D. H., Baraniuk, R. G., & Olshausen, B. A. (2008) · Neural Computation · doi:10.1162/neco.2008.03-07-486 · Cited by 456
Fundamental limits of reconstruction-based superresolution algorithms under local translation
Lin, Z., & Shum, H.-Y. (2004) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2004.1261081 · Cited by 426
Image up-sampling using total-variation regularization with a new observation model
Aly, H. A., & Dubois, E. (2005) · IEEE Transactions on Image Processing · doi:10.1109/tip.2005.851684 · Cited by 348
Fast Image Super-Resolution Based on In-Place Example Regression
Yang, J., Lin, Z., & Cohen, S. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.141 · Cited by 327
Self-citationImage upsampling via imposed edge statistics
Fattal, R. (2007) · ACM Transactions on Graphics · doi:10.1145/1276377.1276496 · Cited by 323
Image Super-Resolution With Sparse Neighbor Embedding
Gao, X., Zhang, K., Tao, D., & Li, X. (2012) · IEEE Transactions on Image Processing · doi:10.1109/tip.2012.2190080 · Cited by 313
Deep Network Cascade for Image Super-resolution
Cui, Z., Chang, H., Shan, S., Zhong, B., & Chen, X. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10602-1_4 · Cited by 255
Centralized sparse representation for image restoration
Dong, W., Zhang, L., & Shi, G. (2011) · 2011 International Conference on Computer Vision · doi:10.1109/iccv.2011.6126377 · Cited by 246
Studying Very Low Resolution Recognition Using Deep Networks
Wang, Z., Chang, S., Yang, Y., Liu, D., & Huang, T. S. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.518 · Cited by 235
Self-citationFast Inference in Sparse Coding Algorithms with Applications to Object Recognition
Kavukcuoglu, K., Ranzato, M., & LeCun, Y. (2010) · arXiv (Cornell University) · doi:10.48550/arxiv.1010.3467 · Cited by 183
Structured Overcomplete Sparsifying Transform Learning with Convergence Guarantees and Applications
Wen, B., Ravishankar, S., & Bresler, Y. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-014-0761-1 · Cited by 158
Self-citationGeometry constrained sparse coding for single image super-resolution
Lu, X., Yuan, H., Yan, P., Yuan, Y., & Li, X. (2012) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2012.6247858 · Cited by 104
Online Sparsifying Transform Learning—Part I: Algorithms
Ravishankar, S., Wen, B., & Bresler, Y. (2015) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2015.2417131 · Cited by 91
Self-citationLearning Super-Resolution Jointly From External and Internal Examples
Wang, Z., Yang, Y., Wang, Z., Chang, S., Yang, J., & Huang, T. S. (2015) · IEEE Transactions on Image Processing · doi:10.1109/tip.2015.2462113 · Cited by 90
Self-citationLearning Super-Resolution Jointly From External and Internal Examples
Wang, Z., Member, S., Yang, Y., Wang, Z., Chang, S., Yang, J., Huang, T. S., & Fellow, L. (2016) · Cited by 89
Self-citationImage Super-Resolution with Fast Approximate Convolutional Sparse Coding
Osendorfer, C., Soyer, H., & van der Smagt, P. (2014) · Lecture notes in computer science · doi:10.1007/978-3-319-12643-2_31 · Cited by 71
Self-tuned deep super resolution
Wang, Z., Yang, Y., Wang, Z., Chang, S., Han, W., Yang, J., & Huang, T. S. (2015) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2015.7301266 · Cited by 66
Self-citationDeng, C. D., Xu, J., Zhang, K., Tao, D., Gao, X., & Li, X. (2015) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2015.2468069 · Cited by 45
Video denoising by online 3D sparsifying transform learning
Wen, B., Ravishankar, S., & Bresler, Y. (2015) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2015.7350771 · Cited by 44
Self-citationSparse Coding and its Applications in Computer Vision
Wang, Z., Yang, J., Zhang, H., Wang, Z., Yang, Y., Liu, D., & Huang, T. S. (2015) · WORLD SCIENTIFIC eBooks · doi:10.1142/9815 · Cited by 33
Self-citation
Cited by
ISTA-Net: Interpretable Optimization-Inspired Deep Network for Image Compressive Sensing
Zhang, J., & Ghanem, B. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00196 · Cited by 1,309
Deep Learning for Single Image Super-Resolution: A Brief Review
Yang, W., Zhang, X., Tian, Y., Wang, W., Xue, J.-H., & Liao, Q. (2019) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2019.2919431 · Cited by 1,154
COVERAGE — A novel database for copy-move forgery detection
Wen, B., Zhu, Y., Subramanian, R., Ng, T.-T., Shen, X., & Winkler, S. (2016) · 2016 IEEE International Conference on Image Processing (ICIP) · doi:10.1109/icip.2016.7532339 · Cited by 440
Self-citationSuper‐resolution musculoskeletal MRI using deep learning
Chaudhari, A. S., Fang, Z., Kogan, F., Wood, J., Stevens, K. J., Gibbons, E. K., Lee, J. H., Gold, G. E., & Hargreaves, B. A. (2018) · Magnetic Resonance in Medicine · doi:10.1002/mrm.27178 · Cited by 406
Deep Convolutional Neural Network for Multi-Modal Image Restoration and Fusion
Deng, X., & Dragotti, P. L. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.2984244 · Cited by 282
Metadata
- Authors
- Liu, D., Wang, Z., Wen, B., Yang, J., Han, W., & Huang, T. S.
- Venue
- IEEE Transactions on Image Processing
- Published
- 2016-07
- Volume
- 25
- Issue
- 7
- Pages
- 3194-3207
- ISSN
- 1057-7149 (ISSN-L)
- 1941-0042
- OpenAlex
- W2345557152
- Cited by
- 266
- References
- 52
- FWCI
- 32.86
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
