The DOI matches its Crossref record; 65 of the 65 references it cites were found in a registry or an index.
SinGAN: Learning a Generative Model From a Single Natural Image
Open accessAbstract
We introduce SinGAN, an unconditional generative model that can be learned from a single natural image. Our model is trained to capture the internal distribution of patches within the image, and is then able to generate high quality, diverse samples that carry the same visual content as the image. SinGAN contains a pyramid of fully convolutional GANs, each responsible for learning the patch distribution at a different scale of the image. This allows generating new samples of arbitrary size and aspect ratio, that have significant variability, yet maintain both the global structure and the fine textures of the training image. In contrast to previous single image GAN schemes, our approach is not limited to texture images, and is not conditional (i.e. it generates samples from noise). User studies confirm that the generated samples are commonly confused to be real images. We illustrate the utility of SinGAN in a wide range of image manipulation tasks.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S., & Szegedy, C. (2015) · arXiv · doi:10.48550/arxiv.1502.03167 · Cited by 27,818
Unpaired image-to-image translation using cycle-consistent adversarial networks
Zhu, J.-Y., Park, T., Isola, P., & Efros, A. A. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.244 · Cited by 23,602
Image-to-Image Translation with Conditional Adversarial Networks
Isola, P., Zhu, J.-Y., Zhou, T., & Efros, A. A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.632 · Cited by 22,930
GAN(Generative Adversarial Nets)
(2017) · Journal of Japan Society for Fuzzy Theory and Intelligent Informatics · doi:10.3156/jsoft.29.5_177_2 · Cited by 19,270
Bootstrap methods: another look at the jackknife
Efron, B. (1979) · The Annals of Statistics · doi:10.1214/aos/1176344552 · Cited by 17,602
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S. (2024) · arXiv (Cornell University) · doi:10.57702/o9raffed · Cited by 14,214
Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network
Ledig, C., Theis, L., Huszar, F., Caballero, J., Cunningham, A., Acosta, A., Aitken, A., Tejani, A., Totz, J., Wang, Z., et al. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.19 · Cited by 12,696
A Style-Based Generator Architecture for Generative Adversarial Networks
Karras, T., Laine, S., & Aila, T. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00453 · Cited by 11,714
Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoising
Zhang, K., Zuo, W., Chen, Y., Meng, D., & Zhang, L. (2017) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2662206 · Cited by 8,983
GANs Trained by a Two Time-Scale Update Rule Converge to a Local Nash Equilibrium
Heusel, M., Ramsauer, H., Unterthiner, T., Nessler, B., & Hochreiter, S. (2017) · arXiv · doi:10.48550/arxiv.1706.08500 · Cited by 8,365
Martin, D., Fowlkes, C., Tal, D., & Malik, J. (2002) · Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001 · doi:10.1109/iccv.2001.937655 · Cited by 8,216
Deep Learning Face Attributes in the Wild
Liu, Z., Luo, P., Wang, X., & Tang, X. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.425 · Cited by 7,747
Enhanced Deep Residual Networks for Single Image Super-Resolution
Lim, B., Son, S., Kim, H., Nah, S., & Lee, K. M. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2017.151 · Cited by 7,736
Improved training of Wasserstein GANs
Gulrajani, I., Ahmed, F., Arjovsky, M., Dumoulin, V., & Courville, A. (2017) · arXiv · doi:10.48550/arxiv.1704.00028 · Cited by 6,800 · cited 1×
“We use the WGAN-GP loss [20], which we found to increase training stability, where the final discrimination score is the average over the patch discrimination map.”
MethodMaking a “Completely Blind” Image Quality Analyzer
Mittal, A., Soundararajan, R., & Bovik, A. C. (2013) · IEEE Signal Processing Letters · doi:10.1109/lsp.2012.2227726 · Cited by 6,766
Image Style Transfer Using Convolutional Neural Networks
Gatys, L. A., Ecker, A. S., & Bethge, M. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.265 · Cited by 6,025
Indoor segmentation and support inference from rgbd images
Silberman, N., Hoiem, D., Kohli, P., & Fergus, R. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-33715-4_54 · Cited by 5,760
Context Encoders: Feature Learning by Inpainting
Pathak, D., Krahenbuhl, P., Donahue, J., Darrell, T., & Efros, A. A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.278 · Cited by 5,691
Progressive Growing of GANs for Improved Quality, Stability, and Variation
Karras, T., Aila, T., Laine, S., & Lehtinen, J. (2017) · arXiv · doi:10.48550/arxiv.1710.10196 · Cited by 4,727
High-Resolution Image Synthesis and Semantic Manipulation with Conditional GANs
Wang, T.-C., Liu, M.-Y., Zhu, J.-Y., Tao, A., Kautz, J., & Catanzaro, B. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00917 · Cited by 4,332
Large Scale GAN Training for High Fidelity Natural Image Synthesis
Brock, A., Donahue, J., & Simonyan, K. (2018) · arXiv · doi:10.48550/arxiv.1809.11096 · Cited by 3,717
Zhang, R., Isola, P., & Efros, A. A. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46487-9_40 · Cited by 3,178
(2014) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 2,534
Generative Image Inpainting with Contextual Attention
Yu, J., Lin, Z., Yang, J., Shen, X., Lu, X., & Huang, T. S. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00577 · Cited by 2,527
Lempitsky, V., Vedaldi, A., & Ulyanov, D. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00984 · Cited by 1,916
Super-resolution from a single image
Glasner, D., Bagon, S., & Irani, M. (2009) · 2009 IEEE 12th International Conference on Computer Vision · doi:10.1109/iccv.2009.5459271 · Cited by 1,889 · cited 2×
“Since small structures tend to recur across scales of natural scenes [17], at test time we upsample the LR image by a factor of r and inject it (together with noise) to the last generator, G0.”
BackgroundPrecomputed Real-Time Texture Synthesis with Markovian Generative Adversarial Networks
Li, C., & Wand, M. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46487-9_43 · Cited by 1,421
Bootstrap Methods: Another Look at the Jackknife
Efron, B. (1992) · Springer Series in Statistics · doi:10.1007/978-1-4612-4380-9_41 · Cited by 1,374
Generative Visual Manipulation on the Natural Image Manifold
Zhu, J.-Y., Krähenbühl, P., Shechtman, E., & Efros, A. A. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46454-1_36 · Cited by 1,171
The Perception-Distortion Tradeoff
Blau, Y., & Michaeli, T. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00652 · Cited by 955
Self-citationZero-Shot Super-Resolution Using Deep Internal Learning
Shocher, A., Cohen, N., & Irani, M. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00329 · Cited by 936
Toward Multimodal Image-to-Image Translation
Zhu, J.-Y., Zhang, R., Pathak, D., Darrell, T. J., Efros, A. A., Wang, O., & Shechtman, E. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1711.11586 · Cited by 906
Ulyanov, D., Vedaldi, A., & Lempitsky, V. (2020) · International Journal of Computer Vision · doi:10.1007/s11263-020-01303-4 · Cited by 719
Image and video upscaling from local self-examples
Freedman, G., & Fattal, R. (2011) · ACM Transactions on Graphics · doi:10.1145/1944846.1944852 · Cited by 679
Summarizing visual data using bidirectional similarity
Simakov, D., Caspi, Y., Shechtman, E., & Irani, M. (2008) · 2008 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2008.4587842 · Cited by 613
The 2018 PIRM Challenge on Perceptual Image Super-Resolution
Blau, Y., Mechrez, R., Timofte, R., Michaeli, T., & Zelnik-Manor, L. (2019) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-11021-5_21 · Cited by 593
Self-citationGenerative Image Modeling Using Style and Structure Adversarial Networks
Wang, X., & Gupta, A. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46493-0_20 · Cited by 574
Invertible Conditional GANs for image editing
Perarnau, G., van de Weijer, J., Raducanu, B., & Álvarez, J. M. (2016) · arXiv · doi:10.48550/arxiv.1611.06355 · Cited by 563
Scribbler: Controlling Deep Image Synthesis with Sketch and Color
Sangkloy, P., Lu, J., Fang, C., Yu, F., & Hays, J. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.723 · Cited by 497
Stacked Generative Adversarial Networks
Huang, X., Li, Y., Poursaeed, O., Hopcroft, J., & Belongie, S. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.202 · Cited by 434
The Contextual Loss for Image Transformation with Non-aligned Data
Mechrez, R., Talmi, I., & Zelnik-Manor, L. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01264-9_47 · Cited by 411
Blind Deblurring Using Internal Patch Recurrence
Michaeli, T., & Irani, M. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10578-9_51 · Cited by 403
Self-citationInternal statistics of a single natural image
Zontak, M., & Irani, M. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995401 · Cited by 375 · cited 1×
“Modeling the internal distribution of patches within a single natural image has been long recognized as a powerful prior in many computer vision tasks [64].”
BackgroundSketchyGAN: Towards Diverse and Realistic Sketch to Image Synthesis
Chen, W., & Hays, J. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00981 · Cited by 345
Deep multi-scale video prediction beyond mean square error
Mathieu, M., Couprie, C., & LeCun, Y. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1511.05440 · Cited by 339
TextureGAN: Controlling Deep Image Synthesis with Texture Patches
Xian, W., Sangkloy, P., Agrawal, V., Raj, A., Lu, J., Fang, C., Yu, F., & Hays, J. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00882 · Cited by 297
Texture Synthesis with Spatial Generative Adversarial NetworksPreprint
Jetchev, N., Bergmann, U., & Vollgraf, R. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.08207 · Cited by 229
Statistics of Patch Offsets for Image Completion
He, K., & Sun, J. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-33709-3_2 · Cited by 187
Non-stationary texture synthesis by adversarial expansion
Zhou, Y., Zhu, Z., Bai, X., Lischinski, D., Cohen-Or, D., & Huang, H. (2018) · ACM Transactions on Graphics · doi:10.1145/3197517.3201285 · Cited by 181
Learning Texture Manifolds with the Periodic Spatial GANPreprint
Bergmann, U., Jetchev, N., & Vollgraf, R. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1705.06566 · Cited by 164
A critical analysis of self-supervision, or what we can learn from a single imagePreprint
Asano, Y. M., Rupprecht, C., & Vedaldi, A. (2019) · Oxford University Research Archive (ORA) (University of Oxford) · doi:10.48550/arxiv.1904.13132 · Cited by 150
The patch transform and its applications to image editing
Cho, T. S., Butman, M., Avidan, S., et al. (2008) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2008.4587642 · Cited by 145
Separating Signal from Noise Using Patch Recurrence across Scales
Zontak, M., Mosseri, I., & Irani, M. (2013) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2013.158 · Cited by 100
Blind dehazing using internal patch recurrence
Bahat, Y., & Irani, M. (2016) · IEEE International Conference on Computational Photography (ICCP) · doi:10.1109/iccphot.2016.7492870 · Cited by 99
Sparse, Smart Contours to Represent and Edit Images
Dekel, T., Gan, C., Krishnan, D., Liu, C., & Freeman, W. T. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00370 · Cited by 84
Self-citationLuan, F., Paris, S., Shechtman, E., & Bala, K. (2018) · Computer Graphics Forum · doi:10.1111/cgf.13478 · Cited by 83
(2007) · ITNOW · doi:10.1093/combul/bwl126 · Cited by 69
Animating animal motion from still
Xu, X., Wan, L., Liu, X., Wong, T., Wang, L., & Leung, C.-S. (2008) · ACM Transactions on Graphics · doi:10.1145/1409060.1409070 · Cited by 57
InGAN: Capturing and Remapping the "DNA" of a Natural ImagePreprint
Shocher, A., Bagon, S., Isola, P., & Irani, M. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1812.00231 · Cited by 53
Revealing and modifying non-local variations in a single image
Dekel, T., Michaeli, T., Irani, M., & Freeman, W. T. (2015) · ACM Transactions on Graphics · doi:10.1145/2816795.2818113 · Cited by 43
Self-citationSaliency Driven Image Manipulation
Mechrez, R., Shechtman, E., & Zelnik‐Manor, L. (2018) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv.2018.00154 · Cited by 23
Surprising Effectiveness of Few-Image Unsupervised Feature Learning.Preprint
Asano, Y. M., Rupprecht, C., & Vedaldi, A. (2019) · arXiv (Cornell University) · Cited by 7
Cited by
Contrastive Learning for Unpaired Image-to-Image Translation
Park, T., Efros, A. A., Zhang, R., & Zhu, J.-Y. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58545-7_19 · Cited by 1,442
A Review on Generative Adversarial Networks: Algorithms, Theory, and Applications
Gui, J., Sun, Z., Wen, Y., Tao, D., & Ye, J. (2023) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2021.3130191 · Cited by 1,231
The Perception-Distortion Tradeoff
Blau, Y., & Michaeli, T. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00652 · Cited by 955
Self-citationILVR: Conditioning Method for Denoising Diffusion Probabilistic Models
Choi, J., Kim, S., Jeong, Y., Gwon, Y., & Yoon, S. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01410 · Cited by 634
Can deep learning beat numerical weather prediction?
Schultz, M. G., Betancourt, C., Gong, B., Kleinert, F., Langguth, M., Leufen, L. H., Mozaffari, A., & Stadtler, S. (2021) · Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences · doi:10.1098/rsta.2020.0097 · Cited by 562
Metadata
- Authors
- Shaham, T. R., Dekel, T., & Michaeli, T.
- Venue
- 2019 IEEE/CVF International Conference on Computer Vision (ICCV)
- Publisher
- IEEE
- Published
- 2019-10
- Pages
- 4569-4579
- OpenAlex
- W2942890911
- Cited by
- 890
- References
- 65
- FWCI
- 39.38
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.