The DOI matches its Crossref record; 22 of the 22 references it cites were found in a registry or an index.
Image and video upscaling from local self-examples
Abstract
We propose a new high-quality and efficient single-image upscaling technique that extends existing example-based super-resolution frameworks. In our approach we do not rely on an external example database or use the whole input image as a source for example patches. Instead, we follow a local self-similarity assumption on natural images and extract patches from extremely localized regions in the input image. This allows us to reduce considerably the nearest-patch search time without compromising quality in most images. Tests, that we perform and report, show that the local self-similarity assumption holds better for small scaling factors where there are more example patches of greater relevance. We implement these small scalings using dedicated novel nondyadic filter banks, that we derive based on principles that model the upscaling process. Moreover, the new filters are nearly biorthogonal and hence produce high-resolution images that are highly consistent with the input image without solving implicit back-projection equations. The local and explicit nature of our algorithm makes it simple, efficient, and allows a trivial parallel implementation on a GPU. We demonstrate the new method ability to produce high-quality resolution enhancement, its application to video sequences with no algorithmic modification, and its efficiency to perform real-time enhancement of low-resolution video standard into recent high-definition formats.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Proceedings of IEEE Conference on Computer Vision and Pattern Recognition
(1993) · Proceedings of IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.1993.341010 · Cited by 14,265
Digital Image Processing: PIKS Inside
Pratt, W. K. (2002) · Wiley eBooks · doi:10.1002/0471221325 · Cited by 4,340
Example-based super-resolution
Freeman, W. T., Jones, T. R., & Pasztor, E. C. (2002) · IEEE Computer Graphics and Applications · doi:10.1109/38.988747 · Cited by 2,498
Fast and Robust Multiframe Super Resolution
Farsiu, S., Robinson, M. D., Elad, M., & Milanfar, P. (2004) · IEEE Transactions on Image Processing · doi:10.1109/tip.2004.834669 · Cited by 2,090
New edge-directed interpolation
Li, X., & Orchard, M. T. (2001) · IEEE Transactions on Image Processing · doi:10.1109/83.951537 · Cited by 2,023
Super-resolution from a single image
Glasner, D., Bagon, S., & Irani, M. (2009) · 2009 IEEE 12th International Conference on Computer Vision · doi:10.1109/iccv.2009.5459271 · Cited by 1,889 · cited 8×
“Top images show the input bottom images show: (left) input pixels, (middle) output produced by our method, and (right) the results of Glasner et al. [2009].”
BackgroundMethodInfluentialMallat, S. (1999) · A Wavelet Tour of Signal Processing · doi:10.1016/b978-012466606-1/50008-8 · Cited by 1,770
Proceedings of the IEEE International Conference on Image Processing
Calway, A. D. (1996) · The Institute of Electrical and Electronics Engineers · Cited by 1,578
Freeman, W. T., Pasztor, E. C., & Carmichael, O. T. (2000) · International Journal of Computer Vision · doi:10.1023/a:1026501619075 · Cited by 1,459
Image super-resolution using gradient profile prior
Sun, J., Xu, Z., & Shum, H.-Y. (2008) · 2008 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2008.4587659 · Cited by 916
Fundamental limits of reconstruction-based superresolution algorithms under local translation
Lin, Z., & Shum, H.-Y. (2004) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2004.1261081 · Cited by 426
Image upsampling via imposed edge statistics
Fattal, R. (2007) · ACM SIGGRAPH 2007 papers · doi:10.1145/1275808.1276496 · Cited by 416
Self-citationImage Interpolation and Resampling
Thévenaz, P., Blu, T., & Unser, M. (2000) · Handbook of Medical Imaging · doi:10.1016/b978-012077790-7/50030-8 · Cited by 387
Image hallucination with primal sketch priors
Sun, J., Zheng, N.-N., Tao, H., & Shum, H.-Y. (2003) · 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings. · doi:10.1109/cvpr.2003.1211539 · Cited by 375
Shan, Q., Li, Z., Jia, J., & Tang, C.-K. (2008) · ACM Transactions on Graphics · doi:10.1145/1409060.1409106 · Cited by 363
Image up-sampling using total-variation regularization with a new observation model
Aly, H. A., & Dubois, E. (2005) · IEEE Transactions on Image Processing · doi:10.1109/tip.2005.851684 · Cited by 348
Image upsampling via imposed edge statistics
Fattal, R. (2007) · ACM Transactions on Graphics · doi:10.1145/1276377.1276496 · Cited by 323
Self-citationImage Interpolation by Pixel‐Level Data‐Dependent Triangulation
Su, D., & Willis, P. J. (2004) · Computer Graphics Forum · doi:10.1111/j.1467-8659.2004.00752.x · Cited by 123
Using Photographs to Enhance Videos of a Static Scene
Bhat, P., Zitnick, C. L., Snavely, N., Agarwala, A., Agrawala, M., Cohen, M., Curless, B., & Kang, S. B. (2007) · Eurographics · doi:10.5555/2383847.2383889 · Cited by 105
Solving the Inverse Problem of Image Zooming Using “Self-Examples”
Ebrahimi, M., & Vrscay, E. R. (2007) · Lecture notes in computer science · doi:10.1007/978-3-540-74260-9_11 · Cited by 80
Image super-resolution based on local self-similarity
Suetake, N., Sakano, M., & Uchino, E. (2008) · Optical Review · doi:10.1007/s10043-008-0005-0 · Cited by 49
Efficient graphical models for processing images
Tappen, M. F., Russell, B. C., & Freeman, W. T. (2004) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2004.1315229 · Cited by 45
Cited by
Perceptual Losses for Real-Time Style Transfer and Super-Resolution
Johnson, J., Alahi, A., & Fei-Fei, L. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46475-6_43 · Cited by 11,283
Image Super-Resolution Using Deep Convolutional Networks
Dong, C., Loy, C. C., He, K., & Tang, X. (2016) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2015.2439281 · Cited by 10,105
Enhanced Deep Residual Networks for Single Image Super-Resolution
Lim, B., Son, S., Kim, H., Nah, S., & Lee, K. M. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2017.151 · Cited by 7,736
Learning a Deep Convolutional Network for Image Super-Resolution
Dong, C., Loy, C. C., He, K., & Tang, X. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10593-2_13 · Cited by 5,494
Single image super-resolution from transformed self-exemplars
Huang, J.-B., Singh, A., & Ahuja, N. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7299156 · Cited by 3,472
Metadata
- Authors
- Freedman, G., & Fattal, R.
- Venue
- ACM Transactions on Graphics
- Published
- 2011-04
- Volume
- 30
- Issue
- 2
- Pages
- 1-11
- ISSN
- 0730-0301 (ISSN-L)
- 1557-7368
- OpenAlex
- W1976416062
- Cited by
- 679
- References
- 22
- FWCI
- 38.65
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.