The DOI matches its DataCite record; 32 of the 34 references it cites were found in a registry or an index.
f-GAN: Training Generative Neural Samplers using Variational Divergence Minimization
Open accessAbstract
Generative neural samplers are probabilistic models that implement sampling using feedforward neural networks: they take a random input vector and produce a sample from a probability distribution defined by the network weights. These models are expressive and allow efficient computation of samples and derivatives, but cannot be used for computing likelihoods or for marginalization. The generative-adversarial training method allows to train such models through the use of an auxiliary discriminative neural network. We show that the generative-adversarial approach is a special case of an existing more general variational divergence estimation approach. We show that any f-divergence can be used for training generative neural samplers. We discuss the benefits of various choices of divergence functions on training complexity and the quality of the obtained generative models.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
GAN（Generative Adversarial Nets）
淳司, 柴. (2017) · Journal of Japan Society for Fuzzy Theory and Intelligent Informatics · doi:10.3156/jsoft.29.5_177_2 · Cited by 20,507
Unsupervised representation learning with deep convolutional generative adversarial networks
Radford, A., Metz, L., & Chintala, S. (2015) · arXiv · doi:10.48550/arxiv.1511.06434 · Cited by 12,235
Improved Techniques for Training GANs
Salimans, T., Goodfellow, I., Zaremba, W., Cheung, V., Radford, A., & Chen, X. (2016) · arXiv · doi:10.48550/arxiv.1606.03498 · Cited by 6,965
Strictly Proper Scoring Rules, Prediction, and Estimation
Gneiting, T., & Raftery, A. E. (2007) · Journal of the American Statistical Association · doi:10.1198/016214506000001437 · Cited by 5,793
Fast and Accurate Deep Network Learning by Exponential Linear Units (ELUs)
Clevert, D.-A., Unterthiner, T., & Hochreiter, S. (2015) · arXiv · doi:10.48550/arxiv.1511.07289 · Cited by 4,513
Stochastic Backpropagation and Approximate Inference in Deep Generative ModelsPreprint
Rezende, D. J., Mohamed, S., & Wierstra, D. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1401.4082 · Cited by 3,921
Generating Sequences With Recurrent Neural Networks
Graves, A. (2013) · arXiv · doi:10.48550/arxiv.1308.0850 · Cited by 2,894
Deep Unsupervised Learning using Nonequilibrium Thermodynamics
Sohl-Dickstein, J., Weiss, E. A., Maheswaranathan, N., & Ganguli, S. (2015) · arXiv · doi:10.48550/arxiv.1503.03585 · Cited by 2,637
LSUN: Construction of a Large-scale Image Dataset using Deep Learning with Humans in the LoopPreprint
Yu, F., Seff, A., Zhang, Y., Song, S., Funkhouser, T., & Xiao, J. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1506.03365 · Cited by 2,318
Noise-contrastive estimation: A new estimation principle for unnormalized statistical models
Gutmann, M. U., & Hyvärinen, A. (2010) · Edinburgh Research Explorer (University of Edinburgh) · Cited by 1,588
Fundamentals of Convex Analysis
Hiriart‐Urruty, J., & Lemaréchal, C. (2001) · Springer eBooks · doi:10.1007/978-3-642-56468-0 · Cited by 1,443
GTM: The Generative Topographic Mapping
Bishop, C., Svensén, M., & Williams, C. K. I. (1998) · Neural Computation · doi:10.1162/089976698300017953 · Cited by 1,389
(1994) · Aston Publications Explorer (Aston University) · Cited by 1,245
A General Class of Coefficients of Divergence of One Distribution from Another
Ali, S. M., & Silvey, S. D. (1966) · Journal of the Royal Statistical Society Series B (Statistical Methodology) · doi:10.1111/j.2517-6161.1966.tb00626.x · Cited by 1,208
A note on the evaluation of generative models
Theis, L., Oord, A. V. D., & Bethge, M. (2015) · arXiv · doi:10.48550/arxiv.1511.01844 · Cited by 1,026
Identifying and attacking the saddle point problem in high-dimensional non-convex optimization
Dauphin, Y., Pascanu, R., Gulcehre, C., Cho, K., Ganguli, S., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1406.2572 · Cited by 827
Estimating Divergence Functionals and the Likelihood Ratio by Convex Risk Minimization
Nguyen, X., Wainwright, M. J., & Jordan, M. I. (2010) · IEEE Transactions on Information Theory · doi:10.1109/tit.2010.2068870 · Cited by 701
Generative Moment Matching NetworksPreprint
Li, Y., Swersky, K., & Zemel, R. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1502.02761 · Cited by 657
A Kernel Statistical Test of Independence
Gretton, A., Fukumizu, K., Teo, C. H., Song, L., Schölkopf, B., & Smola, A. J. (2007) · ANU Open Research (Australian National University) · Cited by 657
Information Theory and Statistics: A Tutorial
Csiszár, I., & Shields, P. C. (2004) · now publishers, Inc. eBooks · doi:10.1561/9781933019543 · Cited by 606
On Divergences and Informations in Statistics and Information Theory
Liese, F., & Vajda, I. (2006) · IEEE Transactions on Information Theory · doi:10.1109/tit.2006.881731 · Cited by 578
Hilbert Space Embeddings and Metrics on Probability Measures
Sriperumbudur, B. K., Gretton, A., Fukumizu, K., Schölkopf, B., & Lanckriet, G. R. G. (2010) · Journal of Machine Learning Research · doi:10.5555/1756006.1859901 · Cited by 501
Training generative neural networks via Maximum Mean Discrepancy optimizationPreprint
Dziugaite, G. K., Roy, D. M., & Ghahramani, Z. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1505.03906 · Cited by 498
Divergence measures and message passing
Minka, T. P. (2005) · Cited by 462
The Neural Autoregressive Distribution Estimator
Larochelle, H., & Murray, I. (2011) · Edinburgh Research Explorer (University of Edinburgh) · Cited by 399
How (not) to Train your Generative Model: Scheduled Sampling, Likelihood, Adversary?Preprint
Huszár, F. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1511.05101 · Cited by 291
Bayesian neural networks and density networks
Mackay, D. (1995) · Nuclear Instruments and Methods in Physics Research Section A Accelerators Spectrometers Detectors and Associated Equipment · doi:10.1016/0168-9002(94)00931-7 · Cited by 181
Information, Divergence and Risk for Binary ExperimentsPreprint
Reid, M. D., & Williamson, R. C. (2009) · arXiv (Cornell University) · doi:10.48550/arxiv.0901.0356 · Cited by 169
RNADE: The real-valued neural autoregressive density-estimatorPreprint
Uría, B., Murray, I., & Larochelle, H. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1306.0186 · Cited by 140
On the chi square and higher-order chi distances for approximating f-divergences
Nielsen, F., & Nock, R. (2013) · IEEE Signal Processing Letters · doi:10.1109/lsp.2013.2288355 · Cited by 135
On distinguishability criteria for estimating generative modelsPreprint
Goodfellow, I. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1412.6515 · Cited by 84
Research works printed but not linked: 4
- [10][10] I. Goodfellow, J. Pouget-Abadie, M. Mirza, B. Xu, D. Warde-Farley, S. Ozair, A. Courville, and Y. Bengio. Generative adversarial nets. In NIPS , pages 2672-2680, 2014. -
- [18][18] D. P. Kingma and M. Welling. Auto-encoding variational Bayes. arXiv:1402.0030 , 2013. - · arXiv
- [23][23] A. Makhzani, J. Shlens, N. Jaitly, and I. Goodfellow. Adversarial autoencoders. arXiv:1511.05644 , 2015. - · arXiv
- [32][32] S. Tokui, K. Oono, S. Hido, and J. Clayton. Chainer: a next-generation open source framework for deep learning. In NIPS , 2015. -
Cited by
Sorted by citations
Improved training of Wasserstein GANs
Gulrajani, I., Ahmed, F., Arjovsky, M., Dumoulin, V., & Courville, A. (2017) · arXiv · doi:10.48550/arxiv.1704.00028 · Cited by 6,800
(2017) · International Conference on Machine Learning · Cited by 6,382
“Least squares generative adversarial networks,”
Mao, X., Li, Q., Xie, H., Lau, R. Y. K., Wang, Z., & Smolley, S. P. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.304 · Cited by 5,437
Generative Adversarial Networks: An Overview
Creswell, A., White, T., Dumoulin, V., Arulkumaran, K., Sengupta, B., & Bharath, A. A. (2018) · IEEE Signal Processing Magazine · doi:10.1109/msp.2017.2765202 · Cited by 4,540
Large Scale GAN Training for High Fidelity Natural Image Synthesis
Brock, A., Donahue, J., & Simonyan, K. (2018) · arXiv · doi:10.48550/arxiv.1809.11096 · Cited by 3,717
Metadata
- Authors
- Nowozin, S., Cseke, B., & Tomioka, R.
- Affiliations
- Microsoft (United States) (US)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2016
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1606.00709
- OpenAlex
- W2419501139
- Cited by
- 1,183
- References
- 34
- Citations by year
- 2025: 32 · 2024: 88 · 2023: 110 · 2022: 106 · 2021: 218 · 2020: 262 · 2019: 170 · 2018: 128 · 2017: 57 · 2016: 11
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Generative Adversarial Networks and Image Synthesis
- Physical Sciences › Computer Science › Artificial Intelligence › Adversarial Robustness in Machine Learning
- Physical Sciences › Computer Science › Artificial Intelligence › Neural Networks and Applications
- Keywords
- f-divergence, generative adversarial training, marginalization, divergence functions, training complexity
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
