The DOI matches its Crossref record; 22 of the 22 references it cites were found in a registry or an index.
Image and video upscaling from local self-examples
Abstract
We propose a new high-quality and efficient single-image upscaling technique that extends existing example-based super-resolution frameworks. In our approach we do not rely on an external example database or use the whole input image as a source for example patches. Instead, we follow a local self-similarity assumption on natural images and extract patches from extremely localized regions in the input image. This allows us to reduce considerably the nearest-patch search time without compromising quality in most images. Tests, that we perform and report, show that the local self-similarity assumption holds better for small scaling factors where there are more example patches of greater relevance. We implement these small scalings using dedicated novel nondyadic filter banks, that we derive based on principles that model the upscaling process. Moreover, the new filters are nearly biorthogonal and hence produce high-resolution images that are highly consistent with the input image without solving implicit back-projection equations. The local and explicit nature of our algorithm makes it simple, efficient, and allows a trivial parallel implementation on a GPU. We demonstrate the new method ability to produce high-quality resolution enhancement, its application to video sequences with no algorithmic modification, and its efficiency to perform real-time enhancement of low-resolution video standard into recent high-definition formats.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Proceedings of IEEE Conference on Computer Vision and Pattern Recognition
(1993) · Proceedings of IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.1993.341010 · Cited by 14,265
Digital Image Processing: PIKS Inside
Pratt, W. K. (2002) · Wiley eBooks · doi:10.1002/0471221325 · Cited by 4,340
Example-based super-resolution
Freeman, W. T., Jones, T. R., & Pasztor, E. C. (2002) · IEEE Computer Graphics and Applications · doi:10.1109/38.988747 · Cited by 2,498
Fast and Robust Multiframe Super Resolution
Farsiu, S., Robinson, M. D., Elad, M., & Milanfar, P. (2004) · IEEE Transactions on Image Processing · doi:10.1109/tip.2004.834669 · Cited by 2,090
New edge-directed interpolation
Li, X., & Orchard, M. T. (2001) · IEEE Transactions on Image Processing · doi:10.1109/83.951537 · Cited by 2,023
Super-resolution from a single image
Glasner, D., Bagon, S., & Irani, M. (2009) · 2009 IEEE 12th International Conference on Computer Vision · doi:10.1109/iccv.2009.5459271 · Cited by 1,889 · cited 8×
“Top images show the input bottom images show: (left) input pixels, (middle) output produced by our method, and (right) the results of Glasner et al. [2009].”
BackgroundMethodInfluentialMallat, S. (1999) · A Wavelet Tour of Signal Processing · doi:10.1016/b978-012466606-1/50008-8 · Cited by 1,770
Proceedings of the IEEE International Conference on Image Processing
Calway, A. D. (1996) · The Institute of Electrical and Electronics Engineers · Cited by 1,578
Freeman, W. T., Pasztor, E. C., & Carmichael, O. T. (2000) · International Journal of Computer Vision · doi:10.1023/a:1026501619075 · Cited by 1,459
Image super-resolution using gradient profile prior
Sun, J., Xu, Z., & Shum, H.-Y. (2008) · 2008 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2008.4587659 · Cited by 916
Cited by
Perceptual Losses for Real-Time Style Transfer and Super-Resolution
Johnson, J., Alahi, A., & Fei-Fei, L. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46475-6_43 · Cited by 11,283
Image Super-Resolution Using Deep Convolutional Networks
Dong, C., Loy, C. C., He, K., & Tang, X. (2016) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2015.2439281 · Cited by 10,105
Enhanced Deep Residual Networks for Single Image Super-Resolution
Lim, B., Son, S., Kim, H., Nah, S., & Lee, K. M. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2017.151 · Cited by 7,736
Learning a Deep Convolutional Network for Image Super-Resolution
Dong, C., Loy, C. C., He, K., & Tang, X. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10593-2_13 · Cited by 5,494
Single image super-resolution from transformed self-exemplars
Huang, J.-B., Singh, A., & Ahuja, N. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7299156 · Cited by 3,472
Deep Laplacian Pyramid Networks for Fast and Accurate Super-Resolution
Lai, W.-S., Huang, J.-B., Ahuja, N., & Yang, M.-H. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.618 · Cited by 2,976
Low-Complexity Single-Image Super-Resolution based on Nonnegative Neighbor Embedding
Bevilacqua, M., Roumy, A., Guillemot, C., & Morel, M.-L. A. (2012) · Procedings of the British Machine Vision Conference 2012 · doi:10.5244/c.26.135 · Cited by 2,701
Deep Learning for Image Super-Resolution: A Survey
Wang, Z., Chen, J., & Hoi, S. C. H. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.2982166 · Cited by 1,969
EnhanceNet: Single Image Super-Resolution Through Automated Texture Synthesis
Sajjadi, M. S. M., Scholkopf, B., & Hirsch, M. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.481 · Cited by 1,058
Learning Texture Transformer Network for Image Super-Resolution
Yang, F., Yang, H., Fu, J., Lu, H., & Guo, B. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00583 · Cited by 966
Fast and Accurate Image Super-Resolution with Deep Laplacian Pyramid Networks
Lai, W.-S., Huang, J.-B., Ahuja, N., & Yang, M.-H. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2865304 · Cited by 953
Learning Enriched Features for Real Image Restoration and Enhancement
Zamir, S. W., Arora, A., Khan, S., Hayat, M., Khan, F. S., Yang, M.-H., & Shao, L. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58595-2_30 · Cited by 946
Zero-Shot Super-Resolution Using Deep Internal Learning
Shocher, A., Cohen, N., & Irani, M. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00329 · Cited by 936
SinGAN: Learning a Generative Model From a Single Natural Image
Shaham, T. R., Dekel, T., & Michaeli, T. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00467 · Cited by 890
Coupled Dictionary Training for Image Super-Resolution
Yang, J., Wang, Z., Lin, Z., Cohen, S., & Huang, T. (2012) · IEEE Transactions on Image Processing · doi:10.1109/tip.2012.2192127 · Cited by 793
Deep Networks for Image Super-Resolution with Sparse Prior
Wang, Z., Liu, D., Yang, J., Han, W., & Huang, T. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.50 · Cited by 784
Single-Image Super-Resolution: A Benchmark
Yang, C.-Y., Ma, C., & Yang, M.-H. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10593-2_25 · Cited by 615
Image Super-Resolution with Non-Local Sparse Attention
Mei, Y., Fan, Y., & Zhou, Y. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00352 · Cited by 607
Toward Real-World Single Image Super-Resolution: A New Benchmark and a New Model
Cai, J., Zeng, H., Yong, H., Cao, Z., & Zhang, L. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00318 · Cited by 583
Frame-Recurrent Video Super-Resolution
Sajjadi, M. S. M., Vemulapalli, R., & Brown, M. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00693 · Cited by 568
Learning Enriched Features for Fast Image Restoration and Enhancement
Zamir, S. W., Arora, A., Khan, S., Hayat, M., Khan, F. S., Yang, M.-H., & Shao, L. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3167175 · Cited by 531
Seven Ways to Improve Example-Based Single Image Super Resolution
Timofte, R., Rothe, R., & Van Gool, L. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.206 · Cited by 449
Structure-Preserving Super Resolution With Gradient Guidance
Ma, C., Rao, Y., Cheng, Y., Chen, C., Lu, J., & Zhou, J. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00779 · Cited by 415
Image Super-Resolution With Cross-Scale Non-Local Attention and Exhaustive Self-Exemplars Mining
Mei, Y., Fan, Y., Zhou, Y., Huang, L., Huang, T. S., & Shi, H. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00573 · Cited by 413
A Statistical Prediction Model Based on Sparse Representations for Single Image Super-Resolution
Peleg, T., & Elad, M. (2014) · IEEE Transactions on Image Processing · doi:10.1109/tip.2014.2305844 · Cited by 407
Blind Deblurring Using Internal Patch Recurrence
Michaeli, T., & Irani, M. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10578-9_51 · Cited by 403
Image Super-Resolution by Neural Texture Transfer
Zhang, Z., Wang, Z., Lin, Z., & Qi, H. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00817 · Cited by 379
Fast Direct Super-Resolution by Simple Functions
Yang, C.-Y., & Yang, M.-H. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.75 · Cited by 332
Nonparametric Blind Super-resolution
Michaeli, T., & Irani, M. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.121 · Cited by 332
Fast Image Super-Resolution Based on In-Place Example Regression
Yang, J., Lin, Z., & Cohen, S. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.141 · Cited by 327
Ultra-Resolving Face Images by Discriminative Generative Networks
Yu, X., & Porikli, F. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46454-1_20 · Cited by 308
Deep Wavelet Prediction for Image Super-Resolution
Guo, T., Mousavi, H. S., Vu, T. H., & Monga, V. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2017.148 · Cited by 301
Robust Single Image Super-Resolution via Deep Networks With Sparse Prior
Liu, D., Wang, Z., Wen, B., Yang, J., Han, W., & Huang, T. S. (2016) · IEEE Transactions on Image Processing · doi:10.1109/tip.2016.2564643 · Cited by 266
A Fully Progressive Approach to Single-Image Super-Resolution
Wang, Y., Perazzi, F., McWilliams, B., Sorkine-Hornung, A., Sorkine-Hornung, O., & Schroers, C. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2018.00131 · Cited by 262
ODE-Inspired Network Design for Single Image Super-Resolution
He, X., Mo, Z., Wang, P., Liu, Y., Yang, M., & Cheng, J. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00183 · Cited by 258
Deep Network Cascade for Image Super-resolution
Cui, Z., Chang, H., Shan, S., Zhong, B., & Chen, X. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10602-1_4 · Cited by 255
Accurate Blur Models vs. Image Priors in Single Image Super-resolution
Efrat, N., Glasner, D., Apartsin, A., Nadler, B., & Levin, A. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.352 · Cited by 200
End-to-End Image Super-Resolution via Deep and Shallow Convolutional Networks
Wang, Y., Wang, L., Wang, H., & Li, P. (2019) · IEEE Access · doi:10.1109/access.2019.2903582 · Cited by 143
Diffusion Models, Image Super-Resolution, and Everything: A Survey
Moser, B. B., Shanbhag, A. S., Raue, F., Frolov, S., Palacio, S., & Dengel, A. (2025) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2024.3476671 · Cited by 117
Turning a denoiser into a super-resolver using plug and play priors
Brifman, A., Romano, Y., & Elad, M. (2016) · 2016 IEEE International Conference on Image Processing (ICIP) · doi:10.1109/icip.2016.7532589 · Cited by 91
Single image super-resolution via BM3D sparse coding
Egiazarian, K., & Katkovnik, V. (2015) · 2015 23rd European Signal Processing Conference (EUSIPCO) · doi:10.1109/eusipco.2015.7362905 · Cited by 58
Image super-resolution with densely connected convolutional networks
Kuang, P., Ma, T., Chen, Z., & Li, F. (2019) · Applied Intelligence · doi:10.1007/s10489-018-1234-y · Cited by 33
Metadata
- Authors
- Freedman, G., & Fattal, R.
- Venue
- ACM Transactions on Graphics
- Published
- 2011-04
- Volume
- 30
- Issue
- 2
- Pages
- 1-11
- ISSN
- 0730-0301 (ISSN-L)
- 1557-7368
- OpenAlex
- W1976416062
- Cited by
- 679
- References
- 22
- FWCI
- 38.65
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.