The DOI matches its Crossref record; 46 of the 46 references it cites were found in a registry or an index.
GLEAN: Generative Latent Bank for Large-Factor Image Super-Resolution
Open accessAbstract
We show that pre-trained Generative Adversarial Networks (GANs), e.g., StyleGAN, can be used as a latent bank to improve the restoration quality of large-factor image super-resolution (SR). While most existing SR approaches attempt to generate realistic textures through learning with adversarial loss, our method, Generative LatEnt bANk (GLEAN), goes beyond existing practices by directly leveraging rich and diverse priors encapsulated in a pre-trained GAN. But unlike prevalent GAN inversion methods that require expensive image-specific optimization at runtime, our approach only needs a single forward pass to generate the upscaled image. GLEAN can be easily incorporated in a simple encoder-bank-decoder architecture with multi-resolution skip connections. Switching the bank allows the method to deal with images from diverse categories, e.g., cat, building, human face, and car. Images upscaled by GLEAN show clear improvements in terms of fidelity and texture faithfulness in comparison to existing methods as shown in Fig. 1.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
GAN(Generative Adversarial Nets)
(2017) · Journal of Japan Society for Fuzzy Theory and Intelligent Informatics · doi:10.3156/jsoft.29.5_177_2 · Cited by 19,270
The Unreasonable Effectiveness of Deep Features as a Perceptual Metric
Zhang, R., Isola, P., Efros, A. A., Shechtman, E., & Wang, O. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00068 · Cited by 14,623
Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network
Ledig, C., Theis, L., Huszar, F., Caballero, J., Cunningham, A., Acosta, A., Aitken, A., Tejani, A., Totz, J., Wang, Z., et al. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.19 · Cited by 12,696
A Style-Based Generator Architecture for Generative Adversarial Networks
Karras, T., Laine, S., & Aila, T. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00453 · Cited by 11,714
Perceptual Losses for Real-Time Style Transfer and Super-Resolution
Johnson, J., Alahi, A., & Fei-Fei, L. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46475-6_43 · Cited by 11,283
Image Super-Resolution Using Deep Convolutional Networks
Dong, C., Loy, C. C., He, K., & Tang, X. (2016) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2015.2439281 · Cited by 10,105
Self-citationArcFace: Additive Angular Margin Loss for Deep Face Recognition
Deng, J., Guo, J., Xue, N., & Zafeiriou, S. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00482 · Cited by 7,781
Shi, W., Caballero, J., Huszar, F., Totz, J., Aitken, A. P., Bishop, R., Rueckert, D., & Wang, Z. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.207 · Cited by 7,570
Analyzing and Improving the Image Quality of StyleGAN
Karras, T., Laine, S., Aittala, M., Hellsten, J., Lehtinen, J., & Aila, T. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00813 · Cited by 6,332
Image Super-Resolution Using Very Deep Residual Channel Attention Networks
Zhang, Y., Li, K., Li, K., Wang, L., Zhong, B., & Fu, Y. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01234-2_18 · Cited by 5,708
Learning a Deep Convolutional Network for Image Super-Resolution
Dong, C., Loy, C. C., He, K., & Tang, X. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10593-2_13 · Cited by 5,494
Self-citationSGDR: Stochastic Gradient Descent with Warm Restarts
Loshchilov, I., & Hutter, F. (2016) · arXiv · doi:10.48550/arxiv.1608.03983 · Cited by 5,309
Image Super-Resolution Via Sparse Representation
Yang, J., Wright, J., Huang, T. S., & Ma, Y. (2010) · IEEE Transactions on Image Processing · doi:10.1109/tip.2010.2050625 · Cited by 5,217
ESRGAN: Enhanced Super-Resolution Generative Adversarial Networks
Wang, X., Yu, K., Wu, S., Gu, J., Liu, Y., Dong, C., Qiao, Y., & Loy, C. C. (2019) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-11021-5_5 · Cited by 4,731
Self-citationAccelerating the Super-Resolution Convolutional Neural Network
Dong, C., Loy, C. C., & Tang, X. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46475-6_25 · Cited by 3,786
Self-citationLarge Scale GAN Training for High Fidelity Natural Image Synthesis
Brock, A., Donahue, J., & Simonyan, K. (2018) · arXiv · doi:10.48550/arxiv.1809.11096 · Cited by 3,717
3D Object Representations for Fine-Grained Categorization
Krause, J., Stark, M., Deng, J., & Fei-Fei, L. (2013) · 2013 IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2013.77 · Cited by 3,496
Second-Order Attention Network for Single Image Super-Resolution
Dai, T., Cai, J., Zhang, Y., Xia, S.-T., & Zhang, L. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.01132 · Cited by 2,010
LSUN: Construction of a Large-scale Image Dataset using Deep Learning with Humans in the Loop
Yu, F., Seff, A., Zhang, Y., Song, S., Funkhouser, T., & Xiao, J. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1506.03365 · Cited by 1,245
Recovering Realistic Texture in Image Super-Resolution by Deep Spatial Feature Transform
Wang, X., Yu, K., Dong, C., & Change Loy, C. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00070 · Cited by 1,170
Self-citationEnhanceNet: Single Image Super-Resolution Through Automated Texture Synthesis
Sajjadi, M. S. M., Scholkopf, B., & Hirsch, M. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.481 · Cited by 1,058
SinGAN: Learning a Generative Model From a Single Natural Image
Shaham, T. R., Dekel, T., & Michaeli, T. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00467 · Cited by 890
PULSE: Self-Supervised Photo Upsampling via Latent Space Exploration of Generative Models
Menon, S., Damian, A., Hu, S., Ravi, N., & Rudin, C. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00251 · Cited by 532
In-Domain GAN Inversion for Real Image Editing
Zhu, J., Shen, Y., Zhao, D., & Zhou, B. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58520-4_35 · Cited by 492
Image Super-Resolution by Neural Texture Transfer
Zhang, Z., Wang, Z., Lin, Z., & Qi, H. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00817 · Cited by 379
Image Processing Using Multi-Code GAN Prior
Gu, J., Shen, Y., & Zhou, B. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00308 · Cited by 310
Self-citationCross-Scale Internal Graph Neural Network for Image Super-ResolutionPreprint
Zhou, S., Zhang, J., Zuo, W., & Loy, C. C. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.16673 · Cited by 298
Self-citationSemantic photo manipulation with a generative image priorPreprint
Bau, D., Strobelt, H., Peebles, W., Wulff, J., Zhou, B., Zhu, J.-Y., & Torralba, A. B. (2019) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 291
Exploiting Deep Generative Prior for Versatile Image Restoration and Manipulation
Pan, X., Zhan, X., Dai, B., Lin, D., Loy, C. C., & Luo, P. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3115428 · Cited by 277
Self-citationODE-Inspired Network Design for Single Image Super-Resolution
He, X., Mo, Z., Wang, P., Liu, Y., Yang, M., & Cheng, J. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00183 · Cited by 258
Pixel Recursive Super Resolution
Dahl, R., Norouzi, M., & Shlens, J. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.581 · Cited by 246
Learning to Super-Resolve Blurry Face and Text Images
Xu, X., Sun, D., Pan, J., Zhang, Y., Pfister, H., & Yang, M.-H. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.36 · Cited by 235
Self-citationMa, C., Jiang, Z., Rao, Y., Lu, J., & Zhou, J. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00561 · Cited by 201
Blind Face Restoration via Deep Multi-scale Component Dictionaries
Li, X., Chen, C., Zhou, S., Lin, X., Zuo, W., & Zhang, L. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58545-7_23 · Cited by 196
Cat Head Detection - How to Effectively Exploit Shape and Texture Features
Zhang, W., Sun, J. Z., & Tang, X. (2008) · Lecture notes in computer science · doi:10.1007/978-3-540-88693-8_59 · Cited by 184
Enhanced Blind Face Restoration With Multi-Exemplar Images and Adaptive Spatial Feature Fusion
Li, X., Li, W., Ren, D., Zhang, H., Wang, M., & Zuo, W. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00278 · Cited by 166
Progressive Face Super-Resolution via Attention to Facial LandmarkPreprint
Kim, D., Kim, M., Kwon, G., & Kim, D. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1908.08239 · Cited by 157
Exploiting Deep Generative Prior for Versatile Image Restoration and Manipulation
Pan, X., Zhan, X., Dai, B., Lin, D., Loy, C. C., & Luo, P. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58536-5_16 · Cited by 147
Self-citationTowards Real Scene Super-Resolution With Raw Images
Xu, X., Ma, Y., & Sun, W. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00182 · Cited by 113
Self-citationFace Hallucination Using Cascaded Super-Resolution and Identity Priors
Grm, K., Scheirer, W. J., & Štruc, V. (2019) · IEEE Transactions on Image Processing · doi:10.1109/tip.2019.2945835 · Cited by 111
Perceptual Extreme Super Resolution Network with Receptive Field Block
Shang, T., Dai, Q., Zhu, S., Yang, T., & Guo, Y. (2020) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw50498.2020.00228 · Cited by 107
Generative Hierarchical Features from Synthesizing Images
Xu, Y., Shen, Y., Zhu, J., Yang, C., & Zhou, B. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00441 · Cited by 92
Texture Hallucination for Large-Factor Painting Super-Resolution
Zhang, Y., Zhang, Z., DiVerdi, S., et al. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58571-6_13 · Cited by 30
VarSR: Variational Super-Resolution Network for Very Low Resolution Images
Hyun, S., & Heo, J. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58592-1_26 · Cited by 19
Deep Learning Face Hallucination via Attributes Transfer and Enhancement
Li, M., Sun, Y., Zhang, Z., et al. (2019) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme.2019.00110 · Cited by 17
Cited by
Real-ESRGAN: Training Real-World Blind Super-Resolution with Pure Synthetic Data
Wang, X., Xie, L., Dong, C., & Shan, Y. (2021) · 2021 IEEE/CVF International Conference on Computer Vision Workshops (ICCVW) · doi:10.1109/iccvw54120.2021.00217 · Cited by 1,684
Self-citationRePaint: Inpainting using Denoising Diffusion Probabilistic Models
Lugmayr, A., Danelljan, M., Romero, A., Yu, F., Timofte, R., & Van Gool, L. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01117 · Cited by 1,778
Low-Light Image and Video Enhancement Using Deep Learning: A Survey
Li, C., Guo, C., Han, L., Jiang, J., Cheng, M.-M., Gu, J., & Loy, C. C. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3126387 · Cited by 657
Self-citationExploiting Diffusion Prior for Real-World Image Super-Resolution
Wang, J., Yue, Z., Zhou, S., Chan, K. C. K., & Loy, C. C. (2024) · International Journal of Computer Vision · doi:10.1007/s11263-024-02168-7 · Cited by 439
Self-citationImplicit Diffusion Models for Continuous Super-Resolution
Gao, S., Liu, X., Zeng, B., Xu, S., Li, Y., Luo, X., Liu, J., Zhen, X., & Zhang, B. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52729.2023.00966 · Cited by 276
Metadata
- Authors
- Chan, K. C. K., Wang, X., Xu, X., Gu, J., & Loy, C. C.
- Venue
- 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
- Publisher
- IEEE
- Published
- 2021-06
- Pages
- 14240-14249
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W3108134390
- Cited by
- 268
- References
- 46
- FWCI
- 17.93
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.