The DOI matches its Crossref record; 46 of the 46 references it cites were found in a registry or an index.
Single image super-resolution from transformed self-exemplars
Abstract
Self-similarity based super-resolution (SR) algorithms are able to produce visually pleasing results without extensive training on external databases. Such algorithms exploit the statistical prior that patches in a natural image tend to recur within and across scales of the same image. However, the internal dictionary obtained from the given image may not always be sufficiently expressive to cover the textural appearance variations in the scene. In this paper, we extend self-similarity based SR to overcome this drawback. We expand the internal patch search space by allowing geometric variations. We do so by explicitly localizing planes in the scene and using the detected perspective geometry to guide the patch search process. We also incorporate additional affine transformations to accommodate local shape variations. We propose a compositional model to simultaneously handle both types of transformations. We extensively evaluate the performance in both urban and natural scenes. Even without using any external training databases, we achieve significantly superior results on urban scenes, while maintaining comparable performance on natural scenes as other state-of-the-art SR algorithms.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Image quality assessment: from error visibility to structural similarity
Wang, Z., Bovik, A. C., Sheikh, H. R., & Simoncelli, E. P. (2004) · IEEE Transactions on Image Processing · doi:10.1109/tip.2003.819861 · Cited by 57,892
Martin, D., Fowlkes, C., Tal, D., & Malik, J. (2002) · Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001 · doi:10.1109/iccv.2001.937655 · Cited by 8,216
A Non-Local Algorithm for Image Denoising
Buades, A., Coll, B., & Morel, J.-M. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.38 · Cited by 7,616
Learning a Deep Convolutional Network for Image Super-Resolution
Dong, C., Loy, C. C., He, K., & Tang, X. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10593-2_13 · Cited by 5,494
Image Super-Resolution Via Sparse Representation
Yang, J., Wright, J., Huang, T. S., & Ma, Y. (2010) · IEEE Transactions on Image Processing · doi:10.1109/tip.2010.2050625 · Cited by 5,217
Barnsley, M. F. (1988) · Cited by 3,578
On Single Image Scale-Up Using Sparse-Representations
Zeyde, R., Elad, M., & Protter, M. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-27413-8_47 · Cited by 3,352
PatchMatch: a randomized correspondence algorithm for structural image editing
Barnes, C., Shechtman, E., Finkelstein, A., & Goldman, D. B. (2009) · ACM Transactions on Graphics · doi:10.1145/1531326.1531330 · Cited by 2,880
Example-based super-resolution
Freeman, W. T., Jones, T. R., & Pasztor, E. C. (2002) · IEEE Computer Graphics and Applications · doi:10.1109/38.988747 · Cited by 2,498
Improving resolution by image registration
Irani, M., & Peleg, S. (1991) · CVGIP: Graphical Models and Image Processing · doi:10.1016/1049-9652(91)90045-l · Cited by 1,929
Super-resolution through neighbor embedding
Chang, H., Yeung, D.-Y., & Xiong, Y. (2004) · Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004. · doi:10.1109/cvpr.2004.1315043 · Cited by 1,902
Super-resolution from a single image
Glasner, D., Bagon, S., & Irani, M. (2009) · 2009 IEEE 12th International Conference on Computer Vision · doi:10.1109/iccv.2009.5459271 · Cited by 1,889
A+: Adjusted Anchored Neighborhood Regression for Fast Super-Resolution
Timofte, R., De Smet, V., & Van Gool, L. (2015) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-16817-3_8 · Cited by 1,408
Anchored Neighborhood Regression for Fast Example-Based Super-Resolution
Timofte, R., De, V., & Gool, L. V. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.241 · Cited by 1,351
Single-Image Super-Resolution Using Sparse Regression and Natural Image Prior
Kim, K. I., & Kwon, Y. (2010) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2010.25 · Cited by 956
Koenderink, J. J., & van Doorn, A. J. (1991) · Journal of the Optical Society of America A · doi:10.1364/josaa.8.000377 · Cited by 871
Coupled Dictionary Training for Image Super-Resolution
Yang, J., Wang, Z., Lin, Z., Cohen, S., & Huang, T. (2012) · IEEE Transactions on Image Processing · doi:10.1109/tip.2012.2192127 · Cited by 793
PatchMatch Stereo - Stereo Matching with Slanted Support Windows
Bleyer, M., Rhemann, C., & Rother, C. (2011) · Procedings of the British Machine Vision Conference 2011 · doi:10.5244/c.25.14 · Cited by 736
Image and video upscaling from local self-examples
Freedman, G., & Fattal, R. (2011) · ACM Transactions on Graphics · doi:10.1145/1944846.1944852 · Cited by 679
Single-Image Super-Resolution: A Benchmark
Yang, C.-Y., Ma, C., & Yang, M.-H. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10593-2_25 · Cited by 615
Image melding: combining inconsistent images using patch-based synthesis
Darabi, S., Shechtman, E., Barnes, C., Goldman, D. B., & Sen, P. (2012) · ACM Transactions on Graphics · doi:10.1145/2185520.2185578 · Cited by 550
The Generalized PatchMatch Correspondence Algorithm
Barnes, C., Shechtman, E., Goldman, D. B., & Finkelstein, A. (2010) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-15558-1_3 · Cited by 530
Image upsampling via imposed edge statistics
Fattal, R. (2007) · ACM SIGGRAPH 2007 papers · doi:10.1145/1275808.1276496 · Cited by 416
Internal statistics of a single natural image
Zontak, M., & Irani, M. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995401 · Cited by 375
Gradient Profile Prior and Its Applications in Image Super-Resolution and Enhancement
Sun, J., Sun, J., Xu, Z., & Shum, H.-Y. (2011) · IEEE Transactions on Image Processing · doi:10.1109/tip.2010.2095871 · Cited by 341
Fast Direct Super-Resolution by Simple Functions
Yang, C.-Y., & Yang, M.-H. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.75 · Cited by 332
Nonparametric Blind Super-resolution
Michaeli, T., & Irani, M. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.121 · Cited by 332
Fast Image Super-Resolution Based on In-Place Example Regression
Yang, J., Lin, Z., & Cohen, S. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.141 · Cited by 327
Image upsampling via imposed edge statistics
Fattal, R. (2007) · ACM Transactions on Graphics · doi:10.1145/1276377.1276496 · Cited by 323
Image completion using planar structure guidance
Huang, J.-B., Kang, S. B., Ahuja, N., & Kopf, J. (2014) · ACM Transactions on Graphics · doi:10.1145/2601097.2601205 · Cited by 322
Self-citationNon-rigid dense correspondence with applications for image enhancement
HaCohen, Y., Shechtman, E., Goldman, D. B., & Lischinski, D. (2011) · ACM SIGGRAPH 2011 papers · doi:10.1145/1964921.1964965 · Cited by 287
Non-rigid dense correspondence with applications for image enhancement
HaCohen, Y., Shechtman, E., Goldman, D. B., & Lischinski, D. (2011) · ACM Transactions on Graphics · doi:10.1145/2010324.1964965 · Cited by 247
Exploiting Self-similarities for Single Frame Super-Resolution
Yang, C.-Y., Huang, J.-B., & Yang, M.-H. (2011) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-19318-7_39 · Cited by 190
Self-citationSuper-resolution from internet-scale scene matching
Sun, L., & Hays, J. H. (2012) · IEEE International Conference on Computational Photography (ICCP) · doi:10.1109/iccphot.2012.6215221 · Cited by 156
Single Image Super-resolution Using Deformable Patches
Zhu, Y., Zhang, Y., & Yuille, A. (2014) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2014.373 · Cited by 125
Context-constrained hallucination for image super-resolution
Sun, J. Z., Zhu, J., & Tappen, M. F. (2010) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2010.5540206 · Cited by 123
Depth Super Resolution by Rigid Body Self-Similarity in 3D
Hornáček, M., Rhemann, C., Gelautz, M., & Rother, C. (2013) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2013.149 · Cited by 99
Solving the Inverse Problem of Image Zooming Using “Self-Examples”
Ebrahimi, M., & Vrscay, E. R. (2007) · Lecture notes in computer science · doi:10.1007/978-3-540-74260-9_11 · Cited by 80
Singh, A., Porikli, F., & Ahuja, N. (2014) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2014.364 · Cited by 77
Self-citationImage upsampling via texture hallucination
HaCohen, Y., Fattal, R., & Lischinski, D. (2010) · IEEE International Conference on Computational Photography (ICCP) · doi:10.1109/iccphot.2010.5585097 · Cited by 77
Super-resolution via Transform-Invariant Group-Sparse Regularization
Fernandez‐Granda, C., & Candès, E. J. (2013) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2013.414 · Cited by 59
Super-Resolution Using Sub-Band Self-Similarity
Singh, A., & Ahuja, N. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-16808-1_37 · Cited by 46
Self-citationHighly Overparameterized Optical Flow Using PatchMatch Belief Propagation
Hornáček, M., Besse, F., Kautz, J., Fitzgibbon, A. W., & Rother, C. (2014) · Lecture notes in computer science · doi:10.1007/978-3-319-10578-9_15 · Cited by 34
Planar Affine Rectification from Change of Scale
Chum, O., & Matas, J. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-19282-1_28 · Cited by 31
Transformation guided image completion
Huang, J., Kopf, J., Ahuja, N., & Kang, S. B. (2013) · IEEE International Conference on Computational Photography (ICCP) · doi:10.1109/iccphot.2013.6528313 · Cited by 30
Self-citationSub-band Energy Constraints for Self-Similarity Based Super-resolution
Singh, A., & Ahuja, N. (2014) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr.2014.761 · Cited by 20
Self-citation
Cited by
Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network
Ledig, C., Theis, L., Huszar, F., Caballero, J., Cunningham, A., Acosta, A., Aitken, A., Tejani, A., Totz, J., Wang, Z., et al. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.19 · Cited by 12,696
Perceptual Losses for Real-Time Style Transfer and Super-Resolution
Johnson, J., Alahi, A., & Fei-Fei, L. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46475-6_43 · Cited by 11,283
Image Super-Resolution Using Deep Convolutional Networks
Dong, C., Loy, C. C., He, K., & Tang, X. (2016) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2015.2439281 · Cited by 10,105
Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoising
Zhang, K., Zuo, W., Chen, Y., Meng, D., & Zhang, L. (2017) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2662206 · Cited by 8,983
Enhanced Deep Residual Networks for Single Image Super-Resolution
Lim, B., Son, S., Kim, H., Nah, S., & Lee, K. M. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2017.151 · Cited by 7,736
Metadata
- Authors
- Huang, J.-B., Singh, A., & Ahuja, N.
- Venue
- 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
- Publisher
- IEEE
- Published
- 2015-06
- Pages
- 5197-5206
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W1930824406
- Cited by
- 3,472
- References
- 46
- FWCI
- 49.88
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.