CoChat
Sign Up
PreprintCited by 4,477Generative Adversarial Networks and Image SynthesisTopic ModelingAdvanced Neural Network Applications

Generative Adversarial Networks

Open access
Goodfellow, Ian J., Pouget-Abadie, Jean, Mirza, Mehdi, Xu, Bing, Warde-Farley, David, Ozair, Sherjil, Courville, Aaron, Bengio, Yoshua·2014·arXiv
DOI 10.48550/arxiv.1406.2661arXiv 1406.2661
Open this paper in CoChat — free accountOpen PDF

Abstract

We propose a new framework for estimating generative models via an adversarial process, in which we simultaneously train two models: a generative model G that captures the data distribution, and a discriminative model D that estimates the probability that a sample came from the training data rather than G. The training procedure for G is to maximize the probability of D making a mistake. This framework corresponds to a minimax two-player game. In the space of arbitrary functions G and D, a unique solution exists, with G recovering the training data distribution and D equal to 1/2 everywhere. In the case where G and D are defined by multilayer perceptrons, the entire system can be trained with backpropagation. There is no need for any Markov chains or unrolled approximate inference networks during either training or generation of samples. Experiments demonstrate the potential of the framework through qualitative and quantitative evaluation of the generated samples.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.1406.2661

Cites

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Korshunov and Marcel produced a notable deepfake dataset consisting of 620 videos based on the GAN model using the open source code Faceswap-GAN.

    “Korshunov and Marcel [63] produced a notable deep- fake dataset consisting of 620 videos based on the GAN model using the open source code Faceswap-GAN [58].”

    From Deep learning for deepfakes creation and detection: A survey (2022) · cites this paper as [58]

    The Introduction and §3, “Adversarial nets” (page unavailable), describe the GAN framework, supporting the reference to a GAN model. They do not identify the Faceswap-GAN code or report Korshunov and Marcel’s 620-video dataset. In the citing sentence, [63] is attached to the dataset claim, while [58] follows Faceswap-GAN; this source supports the underlying model but not that specific code. (LLM, conf=0.85)

    Experimental — accuracy not yet measured

  • Generative models can expand the training set of a neural network and assist in learning various tasks.

    “the use of some generative model to expand the training set of the neural network, which can assist in learning various tasks.”

    From The overfitted brain: Dreams evolved to assist generalization (2021) · cites this paper as [146]

    The Introduction says the generative model produces samples, and the future-work discussion says features from the discriminator or inference net could improve classifiers when labeled data is limited. Our copy does not say those generated samples are used to expand another neural network’s training set, or establish that doing so assists with various tasks. (LLM, conf=0.83)

    Experimental — accuracy not yet measured

  • GAN was introduced by Ian Goodfellow in 2014.

    “One such technology is the generative adversarial network (GAN), which was introduced by Ian Goodfellow in 2014.4”

    From Deepfakes: A new threat to image fabrication in scientific publications? (2022) · cites this paper as [4]

  • GANs have found applications in chemistry, such as the first deep learning GAN used in anti-cancer compound design.

    “GANs (95), inspired by game theory and deep learning, have found applications in chemistry, such as the first deep learning GAN used in anti-cancer compound design (96).”

    From Artificial Intelligence for Drug Discovery: Are We There Yet? (2024) · cites this paper as [96]

  • Over one-third of the selected compounds demonstrated activity in cancer assays or were patented for their anti-cancer potential.

    “Over one-third of the selected compounds demonstrated activity in cancer assays or were patented for their anti-cancer potential (96).”

    From Artificial Intelligence for Drug Discovery: Are We There Yet? (2024) · cites this paper as [96]

    The Experiments section reports results on MNIST, the Toronto Face Database, and CIFAR-10, not selected compounds or cancer assays. Searches for the claimed activity, patents, and anti-cancer potential found no passage addressing them in our copy. (LLM, conf=0.78)

    Experimental — accuracy not yet measured

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Still being checked.

Research works printed but not linked: 24

  1. Bastien, F., Lamblin, P., Pascanu, R., Bergstra, J., Goodfellow, I. J., Bergeron, A., Bouchard, N., and Bengio, Y. (2012). Theano: new features and speed improvements. Deep Learning and Unsupervised Feature Learning NIPS 2012 Workshop.
  2. Bengio, Y., Mesnil, G., Dauphin, Y., and Rifai, S. (2013a). Better mixing via deep representations. In ICML'13.
  3. Bengio, Y., Thibodeau-Laufer, E., and Yosinski, J. (2014a). Deep generative stochastic networks trainable by backprop. In ICML'14.
  4. Bengio, Y., Thibodeau-Laufer, E., Alain, G., and Yosinski, J. (2014b). Deep generative stochastic net- works trainable by backprop. In Proceedings of the 30th International Conference on Machine Learning (ICML'14).
  5. Bergstra, J., Breuleux, O., Bastien, F., Lamblin, P., Pascanu, R., Desjardins, G., Turian, J., Warde-Farley, D., and Bengio, Y. (2010). Theano: a CPU and GPU math expression compiler. In Proceedings of the Python for Scientific Computing Conference (SciPy). Oral Presentation.
  6. Breuleux, O., Bengio, Y., and Vincent, P. (2011). Quickly generating representative samples from an RBM-derived process. Neural Computation, 23(8), 2053-2073.
  7. Glorot, X., Bordes, A., and Bengio, Y. (2011). Deep sparse rectifier neural networks. In AISTATS'2011.
  8. Goodfellow, I. J., Warde-Farley, D., Mirza, M., Courville, A., and Bengio, Y. (2013a). Maxout networks. In ICML'2013.
  9. Goodfellow, I. J., Mirza, M., Courville, A., and Bengio, Y. (2013b). Multi-prediction deep Boltzmann machines. In NIPS'2013.
  10. Goodfellow, I. J., Warde-Farley, D., Lamblin, P., Dumoulin, V., Mirza, M., Pascanu, R., Bergstra, J., Bastien, F., and Bengio, Y. (2013c). Pylearn2: a machine learning research library. arXiv preprint arXiv:1308.4214. · arXiv
  11. Gutmann, M. and Hyvarinen, A. (2010). Noise-contrastive estimation: A new estimation principle for unnormalized statistical models. In AISTATS'2010.
  12. Hinton, G., Deng, L., Dahl, G. E., Mohamed, A., Jaitly, N., Senior, A., Vanhoucke, V., Nguyen, P., Sainath, T., and Kingsbury, B. (2012a). Deep neural networks for acoustic modeling in speech recognition. IEEE Signal Processing Magazine, 29(6), 82-97.
  13. Hinton, G. E., Srivastava, N., Krizhevsky, A., Sutskever, I., and Salakhutdinov, R. (2012b). Improving neural networks by preventing co-adaptation of feature detectors. Technical report, arXiv:1207.0580. · arXiv
  14. Jarrett, K., Kavukcuoglu, K., Ranzato, M., and LeCun, Y. (2009). What is the best multi-stage architecture for object recognition? In Proc. International Conference on Computer Vision (ICCV'09), pages 2146-2153. IEEE.
  15. Kingma, D. P. and Welling, M. (2014). Auto-encoding variational bayes. In Proceedings of the Interna- tional Conference on Learning Representations (ICLR).
  16. Krizhevsky, A., Sutskever, I., and Hinton, G. (2012). ImageNet classification with deep convolutional neural networks. In NIPS'2012.
  17. LeCun, Y., Bottou, L., Bengio, Y., and Haffner, P. (1998). Gradient-based learning applied to document recognition. Proceedings of the IEEE, 86(11), 2278-2324.
  18. Rezende, D. J., Mohamed, S., and Wierstra, D. (2014). Stochastic backpropagation and approximate inference in deep generative models. Technical report, arXiv:1401.4082. · arXiv
  19. Rifai, S., Bengio, Y., Dauphin, Y., and Vincent, P. (2012). A generative process for sampling contractive auto-encoders. In ICML'12.
  20. Salakhutdinov, R. and Hinton, G. E. (2009). Deep Boltzmann machines. In AISTATS'2009, pages 448- 455.
  21. Smolensky, P. (1986). Information processing in dynamical systems: Foundations of harmony theory. In D. E. Rumelhart and J. L. McClelland, editors, Parallel Distributed Processing, volume 1, chapter 6, pages 194-281. MIT Press, Cambridge.
  22. Tieleman, T. (2008). Training restricted Boltzmann machines using approximations to the likelihood gradient. In W. W. Cohen, A. McCallum, and S. T. Roweis, editors, ICML 2008, pages 1064-1071. ACM.
  23. Vincent, P., Larochelle, H., Bengio, Y., and Manzagol, P.-A. (2008). Extracting and composing robust features with denoising autoencoders. In ICML 2008.
  24. Younes, L. (1999). On the convergence of Markovian stochastic algorithms with rapidly decreasing ergodicity rates. Stochastics and Stochastic Reports, 65(3), 177-228.

Cited by

Sorted by citations

Related

Authors
Goodfellow, I. J., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., Courville, A., & Bengio, Y.
Affiliations
  • Université de Montréal (CA)
  • École Polytechnique (FR)
  • Indian Institute of Technology Delhi (IN)
ORCID
Venue
arXiv
Publisher
arXiv
Published
2014
ISSN
2331-8422 (ISSN-L)
DOI
10.48550/arxiv.1406.2661
arXiv
1406.2661
OpenAlex
W4298289240
Cited by
4,477
References
0
Citations by year
2026: 160 · 2025: 428 · 2024: 689 · 2023: 858 · 2022: 717 · 2021: 909 · 2020: 302 · 2019: 242 · 2018: 134 · 2017: 32 · 2016: 2 · 2012: 1
Type
posted content
Language
en
Open access
Licence
arxiv.org/licenses/nonexclusive-distrib/1.0/
Locations
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
Funders
  • Canadian Institute for Advanced Research
  • Compute Canada
  • Canada Research Chairs
Topics
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Generative Adversarial Networks and Image Synthesis
  • Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
Keywords
key-value cache, large language models, long-context inference, memory footprint reduction, autoregressive decoding

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review