CoChat
Sign Up
PreprintCited by 134Generative Adversarial Networks and Image SynthesisDomain Adaptation and Few-Shot LearningAdvanced Neural Network Applications

The DOI matches its DataCite record; 7 of the 7 references it cites were found in a registry or an index.

High-Fidelity Image Generation With Fewer Labels

Open access
Lucic, Mario, Tschannen, Michael, Ritter, Marvin, Zhai, Xiaohua, Bachem, Olivier, Gelly, Sylvain·2019·arXiv
DOI 10.48550/arxiv.1903.02271arXiv 1903.02271
Open this paper in CoChat — free accountOpen PDF

Abstract

Deep generative models are becoming a cornerstone of modern machine learning. Recent work on conditional generative adversarial networks has shown that learning complex, high-dimensional distributions over natural images is within reach. While the latest models are able to generate high-fidelity, diverse natural images at high resolution, they rely on a vast quantity of labeled data. In this work we demonstrate how one can benefit from recent work on self- and semi-supervised learning to outperform the state of the art on both unsupervised ImageNet synthesis, as well as in the conditional setting. In particular, the proposed approach is able to match the sample quality (as measured by FID) of the current state-of-the-art conditional model BigGAN on ImageNet using only 10% of the labels and outperform it using 20% of the labels.

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.1903.02271

Cites

7 of 7 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Class information is crucial to the success of GANs.

    “As further evidence that class information is crucial to the success of these models, Lucic et al. [36] find that it is helpful to generate synthetic labels when working in a label-limited regime.”

    From Diffusion Models Beat GANs on Image Synthesis (2021) · cites this paper as [36]

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Flagged first, then by citations

Research works printed but not linked: 34

  1. Agrawal, P., Carreira, J., and Malik, J. Learning to see by moving. In International Conference on Computer Vision, 2015.
  2. Arbel, M., Sutherland, D., Bińkowski, M., and Gretton, A. On gradient regularizers for MMD GANs. In Advances in Neural Information Processing Systems, 2018.
  3. Barratt, S. and Sharma, R. A note on the inception score. arXiv preprint arXiv:1801.01973, 2018. · arXiv
  4. Caron, M., Bojanowski, P., Joulin, A., and Douze, M. Deep clustering for unsupervised learning of visual features. European Conference on Computer Vision, 2018.
  5. Chen, T., Lucic, M., Houlsby, N., and Gelly, S. On self modulation for generative adversarial networks. In Inter- national Conference on Learning Representations, 2019a.
  6. De Vries, H., Strub, F., Mary, J., Larochelle, H., Pietquin, O., and Courville, A. C. Modulating early visual pro- cessing by language. In Advances in Neural Information Processing Systems, 2017.
  7. Deng, Z., Zhang, H., Liang, X., Yang, L., Xu, S., Zhu, J., and Xing, E. P. Structured generative adversarial net- works. In Advances in Neural Information Processing Systems, 2017.
  8. Dinh, L., Sohl-Dickstein, J., and Bengio, S. Density esti- mation using real NVP. In International Conference on Learning Representations, 2017.
  9. Doersch, C., Gupta, A., and Efros, A. A. Unsupervised visual representation learning by context prediction. In International Conference on Computer Vision, 2015.
  10. Dumoulin, V., Shlens, J., and Kudlur, M. A learned repre- sentation for artistic style. In International Conference on Learning Representations, 2017.
  11. Gan, Z., Chen, L., Wang, W., Pu, Y., Zhang, Y., Liu, H., Li, C., and Carin, L. Triangle generative adversarial networks. In Advances in Neural Information Processing Systems, 2017.
  12. Gidaris, S., Singh, P., and Komodakis, N. Unsupervised representation learning by predicting image rotations. In International Conference on Learning Representations, 2018.
  13. Goodfellow, I., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., Courville, A., and Bengio, Y. Generative adversarial nets. In Advances in Neural Information Processing Systems, 2014.
  14. Goyal, P., Dollár, P., Girshick, R., Noordhuis, P., Wesolowski, L., Kyrola, A., Tulloch, A., Jia, Y., and He, K. Accurate, large minibatch SGD: training ImageNet in 1 hour. arXiv preprint arXiv:1706.02677, 2017. · arXiv
  15. Jang, E., Devin, C., Vanhoucke, V., and Levine, S. Grasp2Vec: Learning object representations from self- supervised grasping. In Conference on Robot Learning, 2018.
  16. Kalchbrenner, N., van den Oord, A., Simonyan, K., Dani- helka, I., Vinyals, O., Graves, A., and Kavukcuoglu, K. Video pixel networks. In International Conference on Machine Learning, 2017.
  17. Kurach, K., Lucic, M., Zhai, X., Michalski, M., and Gelly, S. The GAN Landscape: Losses, architectures, regular- ization, and normalization. In International Conference on Machine Learning, 2019.
  18. Lee, H.-Y., Huang, J.-B., Singh, M., and Yang, M.-H. Un- supervised representation learning by sorting sequences. In International Conference on Computer Vision, 2017.
  19. Li, C., Xu, T., Zhu, J., and Zhang, B. Triple Generative Adversarial Nets. In Advances in Neural Information Processing Systems, 2017.
  20. Lucic, M., Kurach, K., Michalski, M., Gelly, S., and Bous- quet, O. Are GANs created equal? A large-scale study. In Advances in Neural Information Processing Systems, 2018.
  21. Menick, J. and Kalchbrenner, N. Generating high fidelity im- ages with subscale pixel networks and multidimensional upscaling. In International Conference on Learning Rep- resentations, 2019.
  22. Miyato, T. and Koyama, M. cgans with projection dis- criminator. In International Conference on Learning Representations, 2018.
  23. Miyato, T., Kataoka, T., Koyama, M., and Yoshida, Y. Spec- tral normalization for generative adversarial networks. International Conference on Learning Representations, 2018.
  24. Noroozi, M. and Favaro, P. Unsupervised learning of visual representations by solving jigsaw puzzles. In European Conference on Computer Vision, 2016.
  25. Odena, A. Semi-supervised learning with generative ad- versarial networks. arXiv preprint arXiv:1606.01583, 2016. · arXiv
  26. Odena, A., Olah, C., and Shlens, J. Conditional image synthesis with auxiliary classifier GANs. In International Conference on Machine Learning, 2017.
  27. Pinto, L. and Gupta, A. Supersizing self-supervision: Learn- ing to grasp from 50k tries and 700 robot hours. In IEEE International Conference on Robotics and Automation, 2016.
  28. Sajjadi, M. S., Bachem, O., Lucic, M., Bousquet, O., and Gelly, S. Assessing generative models via precision and recall. In Advances in Neural Information Processing Systems, 2018.
  29. Salimans, T., Goodfellow, I., Zaremba, W., Cheung, V., Rad- ford, A., and Chen, X. Improved techniques for training GANs. In Advances in Neural Information Processing Systems, 2016.
  30. Sculley, D. Web-scale k-means clustering. In International Conference on World Wide Web, 2010.
  31. Springenberg, J. T. Unsupervised and semi-supervised learn- ing with categorical generative adversarial networks. In International Conference on Learning Representations, 2016.
  32. Sricharan, K., Bala, R., Shreve, M., Ding, H., Saketh, K., and Sun, J. Semi-supervised conditional GANs. arXiv preprint arXiv:1708.05789, 2017. · arXiv
  33. van den Oord, A., Kalchbrenner, N., and Kavukcuoglu, K. Pixel recurrent neural networks. In International Conference on Machine Learning, 2016b.
  34. Zhai, X., Oliver, A., Kolesnikov, A., and Beyer, L. S 4 L: Self- Supervised Semi-Supervised Learning. arXiv preprint arXiv:1905.03670, 2019. · arXiv

Cited by

Sorted by citations

Metadata

Authors
Lucic, M., Tschannen, M., Ritter, M., Zhai, X., Bachem, O., & Gelly, S.
Affiliations
  • ETH Zurich (CH)
  • Google (United States) (US)
ORCID
Tschannen, Michael
Venue
arXiv
Publisher
arXiv
Published
2019
Pages
4183-4192
ISSN
2331-8422 (ISSN-L)
DOI
10.48550/arxiv.1903.02271
arXiv
1903.02271
OpenAlex
W2920684403
Cited by
134
References
7
Citations by year
2026: 1 · 2025: 7 · 2024: 11 · 2023: 12 · 2022: 13 · 2021: 37 · 2020: 33 · 2019: 18
Type
posted content
Language
en
Open access
Licence
arxiv.org/licenses/nonexclusive-distrib/1.0/
Locations
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
  • International Conference on Machine Learning
Topics
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Generative Adversarial Networks and Image Synthesis
  • Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
Keywords
conditional generative adversarial networks, image generation, self-supervised learning, semi-supervised learning, label efficiency, ImageNet

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review