f-GAN: Training Generative Neural Samplers using Variational Divergence Minimization
Open accessAbstract
Generative neural samplers are probabilistic models that implement sampling using feedforward neural networks: they take a random input vector and produce a sample from a probability distribution defined by the network weights. These models are expressive and allow efficient computation of samples and derivatives, but cannot be used for computing likelihoods or for marginalization. The generative-adversarial training method allows to train such models through the use of an auxiliary discriminative neural network. We show that the generative-adversarial approach is a special case of an existing more general variational divergence estimation approach. We show that any f-divergence can be used for training generative neural samplers. We discuss the benefits of various choices of divergence functions on training complexity and the quality of the obtained generative models.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946 · see citing works
GAN（Generative Adversarial Nets）
淳司, 柴. (2017) · Journal of Japan Society for Fuzzy Theory and Intelligent Informatics · doi:10.3156/jsoft.29.5_177_2 · Cited by 19,268 · see citing works
Unsupervised representation learning with deep convolutional generative adversarial networks
Radford, A., Metz, L., & Chintala, S. (2015) · arXiv · doi:10.48550/arxiv.1511.06434 · Cited by 12,235 · see citing works
Improved Techniques for Training GANs
Salimans, T., Goodfellow, I., Zaremba, W., Cheung, V., Radford, A., & Chen, X. (2016) · arXiv · doi:10.48550/arxiv.1606.03498 · Cited by 6,965 · see citing works
Strictly Proper Scoring Rules, Prediction, and Estimation
Gneiting, T., & Raftery, A. E. (2007) · Journal of the American Statistical Association · doi:10.1198/016214506000001437 · Cited by 5,793 · see citing works
Fast and Accurate Deep Network Learning by Exponential Linear Units (ELUs)
Clevert, D.-A., Unterthiner, T., & Hochreiter, S. (2015) · arXiv · doi:10.48550/arxiv.1511.07289 · Cited by 4,513 · see citing works
Stochastic Backpropagation and Approximate Inference in Deep Generative ModelsPreprint
Rezende, D. J., Mohamed, S., & Wierstra, D. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1401.4082 · Cited by 3,679 · see citing works
Generating Sequences With Recurrent Neural Networks
Graves, A. (2013) · arXiv · doi:10.48550/arxiv.1308.0850 · Cited by 2,894 · see citing works
Deep Unsupervised Learning using Nonequilibrium Thermodynamics
Sohl-Dickstein, J., Weiss, E. A., Maheswaranathan, N., & Ganguli, S. (2015) · arXiv · doi:10.48550/arxiv.1503.03585 · Cited by 2,637 · see citing works
Noise-contrastive estimation: A new estimation principle for unnormalized statistical models
Gutmann, M. U., & Hyvärinen, A. (2010) · Edinburgh Research Explorer (University of Edinburgh) · Cited by 1,588 · see citing works
Fundamentals of Convex Analysis
Hiriart‐Urruty, J., & Lemaréchal, C. (2001) · Springer eBooks · doi:10.1007/978-3-642-56468-0 · Cited by 1,443 · see citing works
GTM: The Generative Topographic Mapping
Bishop, C., Svensén, M., & Williams, C. K. I. (1998) · Neural Computation · doi:10.1162/089976698300017953 · Cited by 1,389 · see citing works
A note on the evaluation of generative modelsPreprint
Theis, L., van den Oord, A., & Bethge, M. (2015) · International Conference on Learning Representations · doi:10.48550/arxiv.1511.01844 · Cited by 1,345 · see citing works
LSUN: Construction of a Large-scale Image Dataset using Deep Learning with Humans in the LoopPreprint
Yu, F., Seff, A., Zhang, Y., Song, S., Funkhouser, T., & Xiao, J. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1506.03365 · Cited by 1,339 · see citing works
(1994) · Aston Publications Explorer (Aston University) · Cited by 1,245 · see citing works
A General Class of Coefficients of Divergence of One Distribution from Another
Ali, S. M., & Silvey, S. D. (1966) · Journal of the Royal Statistical Society Series B (Statistical Methodology) · doi:10.1111/j.2517-6161.1966.tb00626.x · Cited by 1,208 · see citing works
Identifying and attacking the saddle point problem in high-dimensional non-convex optimization
Dauphin, Y., Pascanu, R., Gulcehre, C., Cho, K., Ganguli, S., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1406.2572 · Cited by 827 · see citing works
Estimating Divergence Functionals and the Likelihood Ratio by Convex Risk Minimization
Nguyen, X., Wainwright, M. J., & Jordan, M. I. (2010) · IEEE Transactions on Information Theory · doi:10.1109/tit.2010.2068870 · Cited by 665 · see citing works
A Kernel Statistical Test of Independence
Gretton, A., Fukumizu, K., Teo, C. H., Song, L., Schölkopf, B., & Smola, A. J. (2007) · ANU Open Research (Australian National University) · Cited by 657 · see citing works
Generative Moment Matching NetworksPreprint
Li, Y., Swersky, K., & Zemel, R. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1502.02761 · Cited by 618 · see citing works
Information Theory and Statistics: A Tutorial
Csiszár, I., & Shields, P. C. (2004) · now publishers, Inc. eBooks · doi:10.1561/9781933019543 · Cited by 606 · see citing works
On Divergences and Informations in Statistics and Information Theory
Liese, F., & Vajda, I. (2006) · IEEE Transactions on Information Theory · doi:10.1109/tit.2006.881731 · Cited by 578 · see citing works
Hilbert Space Embeddings and Metrics on Probability Measures
Sriperumbudur, B. K., Gretton, A., Fukumizu, K., Schölkopf, B., & Lanckriet, G. R. G. (2010) · Journal of Machine Learning Research · doi:10.5555/1756006.1859901 · Cited by 501 · see citing works
Divergence measures and message passing
Minka, T. P. (2005) · Cited by 462 · see citing works
The Neural Autoregressive Distribution Estimator
Larochelle, H., & Murray, I. (2011) · Edinburgh Research Explorer (University of Edinburgh) · Cited by 399 · see citing works
How (not) to Train your Generative Model: Scheduled Sampling, Likelihood, Adversary?Preprint
Huszár, F. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1511.05101 · Cited by 181 · see citing works
Bayesian neural networks and density networks
Mackay, D. (1995) · Nuclear Instruments and Methods in Physics Research Section A Accelerators Spectrometers Detectors and Associated Equipment · doi:10.1016/0168-9002(94)00931-7 · Cited by 179 · see citing works
Training generative neural networks via Maximum Mean Discrepancy optimizationPreprint
Dziugaite, G. K., Roy, D. M., & Ghahramani, Z. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1505.03906 · Cited by 171 · see citing works
Information, Divergence and Risk for Binary ExperimentsPreprint
Reid, M. D., & Williamson, R. C. (2009) · arXiv (Cornell University) · doi:10.48550/arxiv.0901.0356 · Cited by 158 · see citing works
RNADE: The real-valued neural autoregressive density-estimatorPreprint
Uría, B., Murray, I., & Larochelle, H. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1306.0186 · Cited by 140 · see citing works
On the chi square and higher-order chi distances for approximating f-divergences
Nielsen, F., & Nock, R. (2013) · IEEE Signal Processing Letters · doi:10.1109/lsp.2013.2288355 · Cited by 135 · see citing works
On distinguishability criteria for estimating generative modelsPreprint
Goodfellow, I. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1412.6515 · Cited by 84 · see citing works
Flagged first, then by citations
2 of the 34 references couldn’t be matched to a known paper.
Research works printed but not linked: 4
- [10][10] I. Goodfellow, J. Pouget-Abadie, M. Mirza, B. Xu, D. Warde-Farley, S. Ozair, A. Courville, and Y. Bengio. Generative adversarial nets. In NIPS , pages 2672-2680, 2014. -
- [18][18] D. P. Kingma and M. Welling. Auto-encoding variational Bayes. arXiv:1402.0030 , 2013. - · arXiv
- [23][23] A. Makhzani, J. Shlens, N. Jaitly, and I. Goodfellow. Adversarial autoencoders. arXiv:1511.05644 , 2015. - · arXiv
- [32][32] S. Tokui, K. Oono, S. Hido, and J. Clayton. Chainer: a next-generation open source framework for deep learning. In NIPS , 2015. -
Cited by
Sorted by citations
Improved training of Wasserstein GANs
Gulrajani, I., Ahmed, F., Arjovsky, M., Dumoulin, V., & Courville, A. (2017) · arXiv · doi:10.48550/arxiv.1704.00028 · Cited by 6,800 · see citing works
(2017) · International Conference on Machine Learning · Cited by 6,382 · see citing works
“Least squares generative adversarial networks,”
Mao, X., Li, Q., Xie, H., Lau, R. Y. K., Wang, Z., & Smolley, S. P. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.304 · Cited by 5,437 · see citing works
Generative Adversarial Networks: An Overview
Creswell, A., White, T., Dumoulin, V., Arulkumaran, K., Sengupta, B., & Bharath, A. A. (2018) · IEEE Signal Processing Magazine · doi:10.1109/msp.2017.2765202 · Cited by 4,540 · see citing works
Large Scale GAN Training for High Fidelity Natural Image Synthesis
Brock, A., Donahue, J., & Simonyan, K. (2018) · arXiv · doi:10.48550/arxiv.1809.11096 · Cited by 3,717 · see citing works
Arjovsky, M., Chintala, S., & Bottou, L. (2017) · arXiv · doi:10.48550/arxiv.1701.07875 · Cited by 2,225 · see citing works
Learning deep representations by mutual information estimation and maximization
Hjelm, R. D., Fedorov, A., Lavoie-Marchildon, S., Grewal, K., Bachman, P., Trischler, A., & Bengio, Y. (2018) · arXiv · doi:10.48550/arxiv.1808.06670 · Cited by 1,991 · see citing works
Self-supervised Learning: Generative or Contrastive
Liu, X., Zhang, F., Hou, Z., Mian, L., Wang, Z., Zhang, J., & Tang, J. (2021) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2021.3090866 · Cited by 1,890 · see citing works
Generative adversarial network in medical imaging: A review
Xin, Y., Walia, E., & Babyn, P. (2019) · Medical Image Analysis · doi:10.1016/j.media.2019.101552 · Cited by 1,883 · see citing works
NIPS 2016 Tutorial: Generative Adversarial NetworksPreprint
Goodfellow, I. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1701.00160 · Cited by 1,735 · see citing works
Generative Modeling by Estimating Gradients of the Data Distribution
Song, Y., & Ermon, S. (2019) · arXiv · doi:10.48550/arxiv.1907.05600 · Cited by 1,453 · see citing works
A Review on Generative Adversarial Networks: Algorithms, Theory, and Applications
Gui, J., Sun, Z., Wen, Y., Tao, D., & Ye, J. (2023) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2021.3130191 · Cited by 1,231 · see citing works
Deep Learning for Single Image Super-Resolution: A Brief Review
Yang, W., Zhang, X., Tian, Y., Wang, W., Xue, J., & Liao, Q. (2019) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2019.2919431 · Cited by 1,169 · see citing works
Recent advances and clinical applications of deep learning in medical image analysis
Chen, X., Wang, X., Zhang, K., Fung, K.-M. A., Thai, T., Moore, K. N., Mannel, R. S., Liu, H., Zheng, B., & Qiu, Y. (2022) · Medical Image Analysis · doi:10.1016/j.media.2022.102444 · Cited by 1,129 · see citing works
A Survey of AI-Generated Content (AIGC)
Cao, Y., Li, S., Liu, Y., Yan, Z., Dai, Y., Yu, P. S., & Sun, L. (2024) · ACM Computing Surveys · doi:10.1145/3704262 · Cited by 1,099 · see citing works
Which Training Methods for GANs do actually Converge?Preprint
Mescheder, L., Geiger, A., & Nowozin, S. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1801.04406 · Cited by 1,029 · see citing works
Self-citationThe Perception-Distortion Tradeoff
Blau, Y., & Michaeli, T. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00652 · Cited by 1,001 · see citing works
A survey of unsupervised deep domain adaptation
Wilson, G., & Cook, D. J. (2020) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3400066 · Cited by 987 · see citing works
Contrastive Representation Learning: A Framework and Review
Le-Khac, P. H., Healy, G., & Smeaton, A. F. (2020) · IEEE Access · doi:10.1109/access.2020.3031549 · Cited by 862 · see citing works
Disentangling by FactorisingPreprint
Kim, H., & Mnih, A. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1802.05983 · Cited by 833 · see citing works
Offline Reinforcement Learning: Tutorial, Review, and Perspectives on Open Problems
Levine, S., Kumar, A., Tucker, G., & Fu, J. (2020) · arXiv · doi:10.48550/arxiv.2005.01643 · Cited by 824 · see citing works
Beyond Transmitting Bits: Context, Semantics, and Task-Oriented Communications
Gündüz, D., Qin, Z., Aguerri, I. E., Dhillon, H. S., Yang, Z., Yener, A., Wong, K., & Chae, C. (2022) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2022.3223408 · Cited by 801 · see citing works
Generative Adversarial Networks (GANs)
Saxena, D., & Cao, J. (2021) · ACM Computing Surveys · doi:10.1145/3446374 · Cited by 798 · see citing works
Bond-Taylor, S., Leach, A., Long, Y., & Willcocks, C. G. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3116668 · Cited by 735 · see citing works
Recent Progress on Generative Adversarial Networks (GANs): A Survey
Pan, Z., Yu, W., Yi, X., Khan, A., Yuan, F., & Zheng, Y. (2019) · IEEE Access · doi:10.1109/access.2019.2905015 · Cited by 699 · see citing works
InfoVAE: Balancing Learning and Inference in Variational Autoencoders
Zhao, S., Song, J., & Ermon, S. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33015885 · Cited by 674 · see citing works
Demystifying MMD GANsPreprint
Bińkowski, M., Sutherland, D. J., Arbel, M., & Gretton, A. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1801.01401 · Cited by 614 · see citing works
Sun, F.-Y., Hoffmann, J., Verma, V., & Tang, J. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1908.01000 · Cited by 604 · see citing works
Generative Adversarial Networks for Extreme Learned Image Compression
Agustsson, E., Tschannen, M., Mentzer, F., Timofte, R., & Gool, L. V. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00031 · Cited by 597 · see citing works
VITAL: VIsual Tracking via Adversarial Learning
Song, Y., Ma, C., Wu, X., Gong, L., Bao, L., Zuo, W., Shen, C., Lau, R. W. H., & Yang, M. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00937 · Cited by 595 · see citing works
Graph Representation Learning via Graphical Mutual Information Maximization
Peng, Z., Huang, W., Luo, M., Zheng, Q., Rong, Y., Xu, T., & Huang, J. (2020) · International World Wide Web Conference (WWW) · doi:10.1145/3366423.3380112 · Cited by 587 · see citing works
Zhang, P., Zhang, B., Zhang, T., Chen, D., Wang, Y., & Wen, F. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.01223 · Cited by 575 · see citing works
MINE: Mutual Information Neural EstimationPreprint
Belghazi, M. I., Baratin, A., Rajeswar, S., Ozair, S., Bengio, Y., Courville, A. C., & Hjelm, R. D. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1801.04062 · Cited by 575 · see citing works
Contrastive Learning with Hard Negative SamplesPreprint
Robinson, J., Chuang, C.-Y., Sra, S., & Jegelka, S. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.04592 · Cited by 504 · see citing works
A comprehensive survey and analysis of generative models in machine learning
Harshvardhan, G. M., Gourisaria, M. K., Pandey, M., & Rautaray, S. S. (2020) · Computer Science Review · doi:10.1016/j.cosrev.2020.100285 · Cited by 437 · see citing works
Peng, X. B., Ma, Z., Abbeel, P., Levine, S., & Kanazawa, A. (2021) · ACM Transactions on Graphics · doi:10.1145/3450626.3459670 · Cited by 423 · see citing works
Self-supervised learning for recommender systems: A survey
Yu, J., Yin, H., Xia, X., Chen, T., Li, J., & Huang, Z. (2024) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2023.3282907 · Cited by 413 · see citing works
Self-Supervised Learning of Graph Neural Networks: A Unified Review
Xie, Y., Zhao, X., Zhang, J., Wang, Z., & Ji, S. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3170559 · Cited by 411 · see citing works
An algorithmic perspective on imitation learning
Osa, T., Pajarinen, J., Neumann, G., Bagnell, J. A., Abbeel, P., & Peters, J. (2018) · Foundations and Trends in Robotics · doi:10.1561/2300000053 · Cited by 405 · see citing works
Adversarial Variational Bayes: Unifying Variational Autoencoders and Generative Adversarial NetworksPreprint
Mescheder, L., Nowozin, S., & Geiger, A. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1701.04722 · Cited by 396 · see citing works
Self-citationShmelkov, K., Schmid, C., & Alahari, K. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01216-8_14 · Cited by 394 · see citing works
How Generative Adversarial Networks and Their Variants Work
Hong, Y., Hwang, U., Yoo, J., & Yoon, S. (2019) · ACM Computing Surveys · doi:10.1145/3301282 · Cited by 389 · see citing works
An Algorithmic Perspective on Imitation Learning
Osa, T., Pajarinen, J., Neumann, G. M., Bagnell, J. A., Abbeel, P., & Peters, J. (2018) · now publishers, Inc. eBooks · doi:10.1561/9781680834116 · Cited by 387 · see citing works
Handling incomplete heterogeneous data using VAEs
Nazábal, A., Olmos, P. M., Zoubin Ghahramani, A., & Valera, I. (2020) · Pattern Recognition · doi:10.1016/j.patcog.2020.107501 · Cited by 369 · see citing works
Amortised MAP Inference for Image Super-resolutionPreprint
Sønderby, C. K., Caballero, J., Theis, L., Shi, W., & Huszár, F. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1610.04490 · Cited by 364 · see citing works
Stabilizing Training of Generative Adversarial Networks through RegularizationPreprint
Roth, K., Lucchi, A., Nowozin, S., & Hofmann, T. (2017) · arXiv (Cornell University) · doi:10.3929/ethz-b-000223162 · Cited by 362 · see citing works
Self-citationLoss-Sensitive Generative Adversarial Networks on Lipschitz Densities
Qi, G.-J. (2019) · International Journal of Computer Vision · doi:10.1007/s11263-019-01265-2 · Cited by 355 · see citing works
A U-Net Based Discriminator for Generative Adversarial Networks
Schönfeld, E., Schiele, B., & Khoreva, A. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00823 · Cited by 353 · see citing works
PassGAN: A Deep Learning Approach for Password Guessing
Hitaj, B., Gasti, P., Ateniese, G., & Pérez‐Cruz, F. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-21568-2_11 · Cited by 343 · see citing works
Style Aggregated Network for Facial Landmark Detection
Dong, X., Yan, Y., Ouyang, W., & Yang, Y. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00047 · Cited by 342 · see citing works
On Mutual Information Maximization for Representation LearningPreprint
Tschannen, M., Djolonga, J., Rubenstein, P. K., Gelly, S., & Lučić, M. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1907.13625 · Cited by 340 · see citing works
Deep Spectral Clustering Using Dual Autoencoder Network
Yang, X., Deng, C. D., Zheng, F., Yan, J., & Liu, W. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00419 · Cited by 338 · see citing works
FD-GAN: Pose-guided Feature Distilling GAN for Robust Person Re-identificationPreprint
Ge, Y., Li, Z., Zhao, H., Yin, G., Yi, S., Wang, X., & Li, H. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1810.02936 · Cited by 331 · see citing works
Wasserstein Auto-EncodersPreprint
Tolstikhin, I., Bousquet, O., Gelly, S., & Schölkopf, B. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1711.01558 · Cited by 329 · see citing works
Behavior Regularized Offline Reinforcement LearningPreprint
Wu, Y., Tucker, G., & Nachum, O. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1911.11361 · Cited by 329 · see citing works
Self-Supervised Learning on Graphs: Contrastive, Generative, or Predictive
Wu, L., Lin, H., Tan, C., Gao, Z., & Li, S. Z. (2021) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2021.3131584 · Cited by 322 · see citing works
Bai, X., Wang, X., Liu, X., Liu, Q., Song, J., Sebe, N., & Kim, B. (2021) · Pattern Recognition · doi:10.1016/j.patcog.2021.108102 · Cited by 313 · see citing works
Paganini, M., de Oliveira, L., & Nachman, B. P. (2018) · Physical Review Letters · doi:10.1103/physrevlett.120.042003 · Cited by 305 · see citing works
GANS for Sequences of Discrete Elements with the Gumbel-softmax DistributionPreprint
Kusner, M. J., & Hernández-Lobato, J. M. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.04051 · Cited by 303 · see citing works
Adversarial Feature Matching for Text GenerationPreprint
Zhang, Y., Gan, Z., Fan, K., Chen, Z., Henao, R., Shen, D., & Carin, L. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1706.03850 · Cited by 292 · see citing works
Learning in Implicit Generative ModelsPreprint
Mohamed, S., & Lakshminarayanan, B. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1610.03483 · Cited by 273 · see citing works
Yang, Q., Zhang, Y., Dai, W., & Pan, S. J. (2020) · Cambridge University Press eBooks · doi:10.1017/9781139061773 · Cited by 272 · see citing works
GAN review: Models and medical image fusion applications
Zhou, T. Y., Li, Q., Lu, H., Cheng, Q., & Zhang, X. (2022) · Information Fusion · doi:10.1016/j.inffus.2022.10.017 · Cited by 269 · see citing works
Generative Adversarial Networks in Computer Vision: A Survey and Taxonomy
Wang, Z., She, Q., & Ward, T. E. (2022) · ACM Computing Surveys · doi:10.1145/3439723 · Cited by 267 · see citing works
Steganographic generative adversarial networks
Volkhonskiy, D., Nazarov, I., & Burnaev, E. V. (2020) · International Conference on Machine Vision · doi:10.1117/12.2559429 · Cited by 266 · see citing works
Disentangling Label Distribution for Long-tailed Visual Recognition
Hong, Y., Han, S., Choi, K., Seo, S., Kim, B., & Chang, B. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00656 · Cited by 265 · see citing works
Adversarial Training for Unsupervised Bilingual Lexicon Induction
Zhang, M., Liu, Y., Luan, H., & Sun, M. (2017) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p17-1179 · Cited by 257 · see citing works
The Numerics of GANsPreprint
Mescheder, L., Nowozin, S., & Geiger, A. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1705.10461 · Cited by 256 · see citing works
Self-citationVideoMoCo: Contrastive Video Representation Learning with Temporally Adversarial Examples
Tian, P., Song, Y., Yang, T., Jiang, W., & Liu, W. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.01105 · Cited by 238 · see citing works
Generative Adversarial Networks and Its Applications in Biomedical Informatics
Lan, L., You, L., Zhang, Z., Fan, Z., Zhao, W., Zeng, N., Chen, Y., & Zhou, X. (2020) · Frontiers in Public Health · doi:10.3389/fpubh.2020.00164 · Cited by 237 · see citing works
Generative Adversarial Networks for Image and Video Synthesis: Algorithms and Applications
Liu, M.-Y., Huang, X., Yu, J., Wang, T.-C., & Mallya, A. (2021) · Proceedings of the IEEE · doi:10.1109/jproc.2021.3049196 · Cited by 236 · see citing works
Finn, C., Christiano, P. F., Abbeel, P., & Levine, S. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.03852 · Cited by 235 · see citing works
Peng, X. B., Guo, Y., Halper, L., Levine, S., & Fidler, S. (2022) · ACM Transactions on Graphics · doi:10.1145/3528223.3530110 · Cited by 228 · see citing works
Li, Y., Li, J., & Wang, Y. (2021) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2021.3098259 · Cited by 226 · see citing works
On the Effectiveness of Least Squares Generative Adversarial Networks
Mao, X., Li, Q., Xie, H., Lau, R. Y. K., Wang, Z., & Smolley, S. P. (2018) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2872043 · Cited by 225 · see citing works
FuseGAN: Learning to Fuse Multi-Focus Image via Conditional Generative Adversarial Network
Guo, X., Nie, R., Cao, J., Zhou, D., Mei, L., & He, K. (2019) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2019.2895292 · Cited by 224 · see citing works
Image Anomaly Detection with Generative Adversarial Networks
Deecke, L., Vandermeulen, R. A., Ruff, L., Mandt, S., & Kloft, M. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-10925-7_1 · Cited by 222 · see citing works
Pre-training Molecular Graph Representation with 3D GeometryPreprint
Liu, S., Wang, H., Li, Z., Lasenby, J., Guo, H., & Tang, J. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.07728 · Cited by 221 · see citing works
Semantics Disentangling for Text-To-Image Generation
Yin, G., Liu, B., Sheng, L., Yu, N., Wang, X., & Shao, J. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00243 · Cited by 218 · see citing works
Statistical Parametric Speech Synthesis Incorporating Generative Adversarial Networks
Saito, Y., Takamichi, S., & Saruwatari, H. (2017) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2017.2761547 · Cited by 217 · see citing works
A Variational Inequality Perspective on Generative Adversarial NetworksPreprint
Gidel, G., Berard, H., Vignoud, G., Vincent, P., & Lacoste-Julien, S. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1802.10551 · Cited by 214 · see citing works
Deep Comprehensive Correlation Mining for Image Clustering
Wu, J., Long, K., Wang, F., Qian, C., Li, C., Lin, Z., & Zha, H. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00824 · Cited by 212 · see citing works
A Comprehensive Survey on Deep Clustering: Taxonomy, Challenges, and Future Directions
Zhou, S., Xu, H., Zheng, Z., Chen, J., Li, Z., Bu, J., Wu, J. X., Wang, X. Y., Zhu, W., & Ester, M. (2024) · ACM Computing Surveys · doi:10.1145/3689036 · Cited by 209 · see citing works
Xu, J., Ren, X., Lin, J., & Sun, X. (2018) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d18-1428 · Cited by 208 · see citing works
Flow-GAN: Combining Maximum Likelihood and Adversarial Learning in Generative Models
Grover, A., Dhar, M., & Ermon, S. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11829 · Cited by 204 · see citing works
Multi-view Graph Contrastive Representation Learning for Drug-Drug Interaction Prediction
Wang, Y., Min, Y., Chen, X. W., & Wu, J. Y. (2021) · International World Wide Web Conference (WWW) · doi:10.1145/3442381.3449786 · Cited by 203 · see citing works
Tan, B., Song, Y., Zhong, E., & Yang, Q. (2015) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/2783258.2783295 · Cited by 198 · see citing works
Ten years of generative adversarial nets (GANs): a survey of the state-of-the-art
Chakraborty, T., S, U. R. K., Naik, S. M., Panja, M., & Manvitha, B. (2024) · Machine Learning Science and Technology · doi:10.1088/2632-2153/ad1f77 · Cited by 198 · see citing works
Generative Modeling Using the Sliced Wasserstein Distance
Deshpande, I., Zhang, Z., & Schwing, A. G. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00367 · Cited by 185 · see citing works
A Selective Overview of Deep Learning
Fan, J., Ma, C., & Zhong, Y. (2021) · Statistical Science · doi:10.1214/20-sts783 · Cited by 181 · see citing works
Infrared and Visible Image Fusion via Texture Conditional Generative Adversarial Network
Yang, Y., Liu, J., Huang, S., Wan, W., Wen, W., & Guan, J. (2021) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2021.3054584 · Cited by 180 · see citing works
AdaGAN: Boosting Generative ModelsPreprint
Tolstikhin, I., Gelly, S., Bousquet, O., Simon-Gabriel, C.-J., & Schölkopf, B. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1701.02386 · Cited by 180 · see citing works
An Introduction to Image Synthesis with Generative Adversarial NetsPreprint
Huang, H., Yu, P. S., & Wang, C. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1803.04469 · Cited by 180 · see citing works
Wasserstein Divergence for GANs
Wu, J., Huang, Z., Thoma, J., Acharya, D., & Gool, L. V. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01228-1_40 · Cited by 178 · see citing works
Many Paths to Equilibrium: GANs Do Not Need to Decrease a Divergence At Every StepPreprint
Fedus, W., Rosca, M., Lakshminarayanan, B., Dai, A. M., Mohamed, S., & Goodfellow, I. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1710.08446 · Cited by 177 · see citing works
Generative Models and Model Criticism via Optimized Maximum Mean DiscrepancyPreprint
Sutherland, D. J., Tung, H.-Y. F., Strathmann, H., De, S., Ramdas, A., Smola, A. J., & Gretton, A. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.04488 · Cited by 174 · see citing works
Sun, Q., Li, J., Peng, H. M., Wu, J. X., Ning, Y., Yu, P. S., & He, L. (2021) · International World Wide Web Conference (WWW) · doi:10.1145/3442381.3449822 · Cited by 172 · see citing works
Adversarial Generation of Natural Language
Subramanian, S., Rajeswar, S., Dutil, F., Pal, C., & Courville, A. C. (2017) · Workshop on Representation Learning for NLP (RepL4NLP) · doi:10.18653/v1/w17-2629 · Cited by 171 · see citing works
InstaGAN: Instance-aware Image-to-Image TranslationPreprint
Mo, S., Cho, M., & Shin, J. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1812.10889 · Cited by 160 · see citing works
A Brief Introduction to Machine Learning for Engineers
Simeone, O. (2018) · Foundations and Trends® in Signal Processing · doi:10.1561/2000000102 · Cited by 153 · see citing works
- Authors
- Nowozin, S., Cseke, B., & Tomioka, R.
- Affiliations
- Microsoft (United States) (US)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2016
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1606.00709
- OpenAlex
- W2419501139
- Cited by
- 1,183
- References
- 34
- Citations by year
- 2025: 32 · 2024: 88 · 2023: 110 · 2022: 106 · 2021: 218 · 2020: 262 · 2019: 170 · 2018: 128 · 2017: 57 · 2016: 11 · 2015: 1
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Generative Adversarial Networks and Image Synthesis
- Physical Sciences › Computer Science › Artificial Intelligence › Adversarial Robustness in Machine Learning
- Physical Sciences › Computer Science › Artificial Intelligence › Neural Networks and Applications
- Keywords
- f-divergence, generative adversarial training, marginalization, divergence functions, training complexity
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
