Improved training of Wasserstein GANs
Open accessAbstract
Generative Adversarial Networks (GANs) are powerful generative models, but suffer from training instability. The recently proposed Wasserstein GAN (WGAN) makes progress toward stable training of GANs, but sometimes can still generate only low-quality samples or fail to converge. We find that these problems are often due to the use of weight clipping in WGAN to enforce a Lipschitz constraint on the critic, which can lead to undesired behavior. We propose an alternative to clipping weights: penalize the norm of gradient of the critic with respect to its input. Our proposed method performs better than standard WGAN and enables stable training of a wide variety of GAN architectures with almost no hyperparameter tuning, including 101-layer ResNets and language models over discrete data. We also achieve high quality generations on CIFAR-10 and LSUN bedrooms.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
By involving the causal dependencies between the data variables from NOTEARS-MLP within the WGAN-GP architecture, the model learns to simulate the true generative process underpinning the real-world data.
“By involving the causal dependencies between the data variables from NOTEARS-MLP within the WGAN-GP architecture, we learn how to simulate the true generative process underpinning the real-world data.”
From Emulating real-world GLP-1 efficacy in type 2 diabetes through causal learning and virtual patients (2025) · cites this paper as [11]
The Introduction (p. 1) identifies this paper as proposing WGAN-GP, and Section 4 (p. 4) describes its gradient-penalty method. The paper does not describe incorporating NOTEARS-MLP causal dependencies or show that WGAN-GP learns the true generative process underlying real-world data. (LLM, conf=0.86)
Experimental — accuracy not yet measuredWGAN sometimes still generates poor samples or fails to converge because WGAN uses weight clipping to enforce a Lipschitz constraint.
“WGAN-GP) (Gulrajani et al. 2017) has indicated that WGAN sometimes still generates poor samples or fails to converge. The reason is that WGAN uses weight clipping to enforce a Lipschitz constraint.”
From Countering Malicious DeepFakes: Survey, Battleground, and Horizon (2022) · cites this paper as Gulrajani et al. 2017
Videos from the publicly available VidTIMIT database were used to generate low and high quality deepfake videos, which can effectively mimic the facial expressions, mouth movements, and eye blinking.
“Videos from the publicly available VidTIMIT database [64] were used to generate low and high quality deep- fake videos, which can effectively mimic the facial ex- pressions, mouth movements, and eye blinking.”
From Deep learning for deepfakes creation and detection: A survey (2022) · cites this paper as [64]
The experiments described in Section 5.4 (p. 7) use CIFAR-10 and LSUN bedrooms, while Section 5.5 (pp. 7–8) uses the Billion Word dataset. Searches for VidTIMIT, deepfake videos, and facial movements found no passage in our copy addressing the attributed claim. (LLM, conf=0.78)
Experimental — accuracy not yet measuredWe designed our emulation model to unify recent developments in machine learning-based generative modelling and causal structure (DAG) learning within a single framework.
“we designed our emulation model to unify recent developments in machine learning-based generative modelling and causal structure (DAG) learning within a single framework.”
From Emulating real-world GLP-1 efficacy in type 2 diabetes through causal learning and virtual patients (2025) · cites this paper as [11]
The Introduction (p. 1) describes GAN training and proposes a gradient penalty, but it does not describe an emulation model combining generative modelling with causal structure learning. Searches for DAG and causal structure learning found no passage addressing that proposed unification; the sentence appears to describe the citing authors’ own model. (LLM, conf=0.76)
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946 · see citing works
Learning Multiple Layers of Features from Tiny Images
Krizhevsky, A. (2024) · doi:10.57702/zp44cu3g · Cited by 23,890 · see citing works
GAN（Generative Adversarial Nets）
淳司, 柴. (2017) · Journal of Japan Society for Fuzzy Theory and Intelligent Informatics · doi:10.3156/jsoft.29.5_177_2 · Cited by 19,268 · see citing works
Unsupervised representation learning with deep convolutional generative adversarial networks
Radford, A., Metz, L., & Chintala, S. (2015) · arXiv · doi:10.48550/arxiv.1511.06434 · Cited by 12,235 · see citing works
Simple Statistical Gradient-Following Algorithms for Connectionist Reinforcement Learning
Williams, R. J. (1992) · Machine Learning · doi:10.1007/bf00992696 · Cited by 7,936 · see citing works
Improved Techniques for Training GANs
Salimans, T., Goodfellow, I., Zaremba, W., Cheung, V., Radford, A., & Chen, X. (2016) · arXiv · doi:10.48550/arxiv.1606.03498 · Cited by 6,965 · see citing works
“Least squares generative adversarial networks,”
Mao, X., Li, Q., Xie, H., Lau, R. Y. K., Wang, Z., & Smolley, S. P. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.304 · Cited by 5,437 · see citing works
Instance Normalization: The Missing Ingredient for Fast StylizationPreprint
Ulyanov, D., Vedaldi, A., & Lempitsky, V. (2016) · arXiv.org · doi:10.48550/arxiv.1607.08022 · Cited by 4,239 · see citing works
Categorical Reparameterization with Gumbel-Softmax
Jang, E., Gu, S., & Poole, B. (2016) · arXiv · doi:10.48550/arxiv.1611.01144 · Cited by 3,616 · see citing works
Conditional Image Generation with PixelCNN DecodersPreprint
van den Oord, A., Kalchbrenner, N., Vinyals, O., Espeholt, L., Graves, A., & Kavukcuoglu, K. (2016) · Neural Information Processing Systems · doi:10.48550/arxiv.1606.05328 · Cited by 3,066 · see citing works
Conditional Image Synthesis With Auxiliary Classifier GANsPreprint
Odena, A., Olah, C., & Shlens, J. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1610.09585 · Cited by 2,968 · see citing works
Towards Principled Methods for Training Generative Adversarial NetworksPreprint
Arjovsky, M., & Bottou, L. (2017) · International Conference on Learning Representations · doi:10.48550/arxiv.1701.04862 · Cited by 2,373 · see citing works
Self-citationSeqGAN: Sequence Generative Adversarial Nets with Policy Gradient
Yu, L., Zhang, W., Wang, Y.-X., & Yu, Y. H. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.10804 · Cited by 2,342 · see citing works
The Concrete Distribution: A Continuous Relaxation of Discrete Random VariablesPreprint
Maddison, C. J., Mnih, A., & Teh, Y. W. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.00712 · Cited by 1,771 · see citing works
LSUN: Construction of a Large-scale Image Dataset using Deep Learning with Humans in the LoopPreprint
Yu, F., Seff, A., Zhang, Y., Song, S., Funkhouser, T., & Xiao, J. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1506.03365 · Cited by 1,339 · see citing works
BEGAN: Boundary Equilibrium Generative Adversarial NetworksPreprint
Berthelot, D., Schumm, T., & Metz, L. (2017) · arXiv.org · doi:10.48550/arxiv.1703.10717 · Cited by 1,217 · see citing works
f-GAN: Training Generative Neural Samplers using Variational Divergence Minimization
Nowozin, S., Cseke, B., & Tomioka, R. (2016) · arXiv · doi:10.48550/arxiv.1606.00709 · Cited by 1,183 · see citing works
Unrolled Generative Adversarial NetworksPreprint
Metz, L., Poole, B., Pfau, D., & Sohl-Dickstein, J. N. (2016) · International Conference on Learning Representations · doi:10.48550/arxiv.1611.02163 · Cited by 1,100 · see citing works
Adversarially Learned InferencePreprint
Dumoulin, V., Belghazi, M. I., Poole, B., Mastropietro, O., Lamb, A., Arjovsky, M., & Courville, A. C. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1606.00704 · Cited by 1,015 · see citing works
Self-citationAdversarial Learning for Neural Dialogue Generation
Li, J., Monroe, W., Shi, T., Jean, S., Ritter, A., & Jurafsky, D. (2017) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d17-1230 · Cited by 880 · see citing works
Stacked Generative Adversarial Networks
Huang, X., Li, Y., Poursaeed, O., Hopcroft, J. E., & Belongie, S. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.202 · Cited by 462 · see citing works
Recurrent Topic-Transition GAN for Visual Paragraph Generation
Liang, X., Hu, Z., Zhang, H., Gan, C., & Xing, E. P. (2017) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.364 · Cited by 209 · see citing works
Improving Neural Machine Translation with Conditional Sequence Generative Adversarial Nets
Yang, Z., Chen, W., Wang, F., & Xu, B. (2017) · North American Chapter of the Association for Computational Linguistics · doi:10.18653/v1/n18-1122 · Cited by 175 · see citing works
Maximum-Likelihood Augmented Discrete Generative Adversarial NetworksPreprint
Che, T., Li, Y., Zhang, R., Hjelm, R. D., Li, W., Song, Y., & Bengio, Y. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1702.07983 · Cited by 168 · see citing works
Improving Generative Adversarial Networks with Denoising Feature Matching
Warde-Farley, D., & Bengio, Y. (2017) · International Conference on Learning Representations · Cited by 151 · see citing works
Boundary-Seeking Generative Adversarial NetworksPreprint
Hjelm, R. D., Jacob, A. P., Che, T., Trischler, A., Cho, K., & Bengio, Y. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1702.08431 · Cited by 144 · see citing works
On the Quantitative Analysis of Decoder-Based Generative ModelsPreprint
Wu, Y., Burda, Y., Salakhutdinov, R., & Grosse, R. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.04273 · Cited by 133 · see citing works
Approximation and Convergence Properties of Generative Adversarial LearningPreprint
Liu, S., Bousquet, O., & Chaudhuri, K. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1705.08991 · Cited by 97 · see citing works
On distinguishability criteria for estimating generative modelsPreprint
Goodfellow, I. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1412.6515 · Cited by 84 · see citing works
Learning to Draw Samples: With Application to Amortized MLE for Generative Adversarial LearningPreprint
Wang, D., & Liu, Q. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.01722 · Cited by 81 · see citing works
Calibrating Energy-based Generative Adversarial NetworksPreprint
Dai, Z., Almahairi, A., Bachman, P., Hovy, E. H., & Courville, A. C. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1702.01691 · Cited by 78 · see citing works
Self-citationImproved generator objectives for GANsPreprint
Poole, B., Alemi, A. A., Sohl‐Dickstein, J., & Angelova, A. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1612.02780 · Cited by 53 · see citing works
Flagged first, then by citations
1 of the 33 references couldn’t be matched to a known paper.
Research works printed but not linked: 5
- [2][2] M. Arjovsky, S. Chintala, and L. Bottou. Wasserstein gan. arXiv preprint arXiv:1701.07875 , 2017. - · arXiv
- [3][3] J. L. Ba, J. R. Kiros, and G. E. Hinton. Layer normalization. arXiv preprint arXiv:1607.06450 , 2016. - · arXiv
- [6][6] C. Chelba, T. Mikolov, M. Schuster, Q. Ge, T. Brants, P. Koehn, and T. Robinson. One billion word benchmark for measuring progress in statistical language modeling. arXiv preprint arXiv:1312.3005 , 2013. - · arXiv
- [9][9] I. Goodfellow, J. Pouget-Abadie, M. Mirza, B. Xu, D. Warde-Farley, S. Ozair, A. Courville, and Y. Bengio. Generative adversarial nets. In Advances in neural information processing systems , pages 2672-2680, 2014. -
- [25][25] C. Villani. Optimal transport: old and new , volume 338. Springer Science & Business Media, 2008. -
Cited by
Sorted by citations
High-Resolution Image Synthesis with Latent Diffusion Models
Rombach, R., Blattmann, A., Lorenz, D., Esser, P., & Ommer, B. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01042 · Cited by 15,880 · see citing works
A Style-Based Generator Architecture for Generative Adversarial Networks
Karras, T., Laine, S., & Aila, T. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00453 · Cited by 11,714 · see citing works
A Comprehensive Survey on Graph Neural Networks
Wu, Z., Pan, S., Chen, F., Long, G., Zhang, C., & Yu, P. S. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.2978386 · Cited by 11,000 · see citing works
Analyzing and Improving the Image Quality of StyleGAN
Karras, T., Laine, S., Aittala, M., Hellsten, J., Lehtinen, J., & Aila, T. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00813 · Cited by 6,332 · see citing works
ESRGAN: Enhanced Super-Resolution Generative Adversarial Networks
Wang, X., Yu, K., Wu, S., Gu, J., Liu, Y., Dong, C., Qiao, Y., & Loy, C. C. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-11021-5_5 · Cited by 5,085 · see citing works
Progressive Growing of GANs for Improved Quality, Stability, and Variation
Karras, T., Aila, T., Laine, S., & Lehtinen, J. (2017) · arXiv · doi:10.48550/arxiv.1710.10196 · Cited by 4,727 · see citing works
Generative Adversarial Networks: An Overview
Creswell, A., White, T., Dumoulin, V., Arulkumaran, K., Sengupta, B., & Bharath, A. A. (2018) · IEEE Signal Processing Magazine · doi:10.1109/msp.2017.2765202 · Cited by 4,540 · see citing works
Self-citationStarGAN: Unified Generative Adversarial Networks for Multi-domain Image-to-Image Translation
Choi, Y., Choi, M., Kim, M., Ha, J.-W., Kim, S., & Choo, J. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00916 · Cited by 4,163 · see citing works
A Comprehensive Survey on Graph Neural Networks
Wu, Z., Pan, S., Chen, F., Long, G., Zhang, C., & Yu, P. (2020) · UTS ePRESS (University of Technology Sydney) · Cited by 3,174 · see citing works
Generative Image Inpainting with Contextual Attention
Yu, J., Lin, Z., Yang, J., Shen, X., Lu, X., & Huang, T. S. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00577 · Cited by 2,633 · see citing works
Obfuscated gradients give a false sense of security: Circumventing defenses to adversarial examples
Athalye, A., Carlini, N., & Wagner, D. (2018) · arXiv · doi:10.48550/arxiv.1802.00420 · Cited by 2,172 · see citing works
Deep Learning for Image Super-Resolution: A Survey
Wang, Z., Chen, J., & Hoi, S. C. H. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.2982166 · Cited by 2,033 · see citing works
Generative adversarial network in medical imaging: A review
Xin, Y., Walia, E., & Babyn, P. (2019) · Medical Image Analysis · doi:10.1016/j.media.2019.101552 · Cited by 1,883 · see citing works
Image Super-Resolution Via Iterative Refinement
Saharia, C., Ho, J., Chan, W., Salimans, T., Fleet, D. J., & Norouzi, M. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3204461 · Cited by 1,829 · see citing works
StarGAN v2: Diverse Image Synthesis for Multiple Domains
Choi, Y., Uh, Y., Yoo, J., & Ha, J.-W. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00821 · Cited by 1,663 · see citing works
Palette: Image-to-Image Diffusion Models
Saharia, C., Chan, W., Chang, H., Lee, C., Ho, J., Salimans, T., Fleet, D., & Norouzi, M. (2022) · Special Interest Group on Computer Graphics and Interactive Techniques Conference Proceedings · doi:10.1145/3528233.3530757 · Cited by 1,717 · see citing works
Yang, Q., Yan, P., Zhang, Y., Yu, H., Shi, Y., Mou, X., Kalra, M. K., Zhang, Y., Sun, L., & Wang, G. (2018) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2018.2827462 · Cited by 1,630 · see citing works
A State-of-the-Art Survey on Deep Learning Theory and Architectures
Alom, M. Z., Taha, T. M., Yakopcic, C., Westberg, S. K. E., Sidike, P., Nasrin, M. S., Hasan, M., Essen, B. C. V., Awwal, A. A. S., & Asari, V. K. (2019) · Electronics · doi:10.3390/electronics8030292 · Cited by 1,643 · see citing works
f-AnoGAN: Fast unsupervised anomaly detection with generative adversarial networks
Schlegl, T., Seeböck, P., Waldstein, S. M., Langs, G., & Schmidt-Erfurth, U. M. (2019) · Medical Image Analysis · doi:10.1016/j.media.2019.01.010 · Cited by 1,561 · see citing works
Deep learning-based electroencephalography analysis: a systematic review
Roy, Y., Banville, H., Albuquerque, I., Gramfort, A., Falk, T. H., & Faubert, J. (2019) · Journal of Neural Engineering · doi:10.1088/1741-2552/ab260c · Cited by 1,532 · see citing works
Learning Implicit Fields for Generative Shape Modeling
Chen, Z., & Zhang, H. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00609 · Cited by 1,477 · see citing works
A survey on security and privacy of federated learning
Mothukuri, V., Parizi, R. M., Pouriyeh, S., Huang, Y., Dehghantanha, A., & Srivastava, G. (2021) · Future Generation Computer Systems · doi:10.1016/j.future.2020.10.007 · Cited by 1,480 · see citing works
A Review on Generative Adversarial Networks: Algorithms, Theory, and Applications
Gui, J., Sun, Z., Wen, Y., Tao, D., & Ye, J. (2023) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2021.3130191 · Cited by 1,231 · see citing works
StackGAN++: Realistic Image Synthesis with Stacked Generative Adversarial Networks
Zhang, H., Xu, T., Li, H., Zhang, S., Wang, X., Huang, X., & Metaxas, D. (2018) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2856256 · Cited by 1,222 · see citing works
DeblurGAN-v2: Deblurring (Orders-of-Magnitude) Faster and Better
Kupyn, O., Martyniuk, T., Wu, J., & Wang, Z. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00897 · Cited by 1,196 · see citing works
Recent advances and clinical applications of deep learning in medical image analysis
Chen, X., Wang, X., Zhang, K., Fung, K.-M. A., Thai, T., Moore, K. N., Mannel, R. S., Liu, H., Zheng, B., & Qiu, Y. (2022) · Medical Image Analysis · doi:10.1016/j.media.2022.102444 · Cited by 1,129 · see citing works
Deep Neural Networks and Tabular Data: A Survey
Borisov, V., Leemann, T., Seßler, K., Haug, J., Pawelczyk, M., & Kasneci, G. (2022) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3229161 · Cited by 1,182 · see citing works
Image2StyleGAN: How to Embed Images Into the StyleGAN Latent Space?
Abdal, R., Qin, Y., & Wonka, P. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00453 · Cited by 1,082 · see citing works
Feature Generating Networks for Zero-Shot Learning
Xian, Y., Lorenz, T., Schiele, B., & Akata, Z. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00581 · Cited by 1,080 · see citing works
A Unifying Review of Deep and Shallow Anomaly Detection
Ruff, L., Kauffmann, J., Vandermeulen, R. A., Montavon, G., Samek, W., Kloft, M., Dietterich, T. G., & Muller, K.-R. (2021) · Proceedings of the IEEE · doi:10.1109/jproc.2021.3052449 · Cited by 1,080 · see citing works
Interpreting the Latent Space of GANs for Semantic Face Editing
Shen, Y., Gu, J., Tang, X., & Zhou, B. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00926 · Cited by 1,063 · see citing works
Learning Texture Transformer Network for Image Super-Resolution
Yang, F., Yang, H., Fu, J., Lu, H., & Guo, B. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00583 · Cited by 1,034 · see citing works
The Perception-Distortion Tradeoff
Blau, Y., & Michaeli, T. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00652 · Cited by 1,001 · see citing works
Generative Model for the Inverse Design of Metasurfaces
Liu, Z., Zhu, D., Rodrigues, S. P., Lee, K., & Cai, W. (2018) · Nano Letters · doi:10.1021/acs.nanolett.8b03171 · Cited by 985 · see citing works
A survey of unsupervised deep domain adaptation
Wilson, G., & Cook, D. J. (2020) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3400066 · Cited by 987 · see citing works
Pros and cons of GAN evaluation measures
Borji, A. (2019) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2018.10.009 · Cited by 963 · see citing works
A review of medical image data augmentation techniques for deep learning applications
Chlap, P., Min, H., Vandenberg, N., Dowling, J., Holloway, L. C., & Haworth, A. (2021) · Journal of Medical Imaging and Radiation Oncology · doi:10.1111/1754-9485.13261 · Cited by 1,008 · see citing works
A Survey on Deep Semi-Supervised Learning
Yang, X., Song, Z., King, I., & Xu, Z. (2022) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2022.3220219 · Cited by 981 · see citing works
SinGAN: Learning a Generative Model From a Single Natural Image
Shaham, T. R., Dekel, T., & Michaeli, T. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00467 · Cited by 936 · see citing works
Alzubaidi, L., Bai, J., Al-Sabaawi, A., Santamaría, J., Albahri, A. S., Al-dabbagh, B. S. N., Fadhel, M. A., Manoufali, M., Zhang, J., Al-Timemy, A. H., et al. (2023) · Journal Of Big Data · doi:10.1186/s40537-023-00727-2 · Cited by 992 · see citing works
Enhancing Underwater Imagery Using Generative Adversarial Networks
Fabbri, C., Islam, J., & Sattar, J. (2018) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2018.8460552 · Cited by 908 · see citing works
The relativistic discriminator: a key element missing from standard GANPreprint
Jolicoeur‐Martineau, A. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1807.00734 · Cited by 901 · see citing works
Wasserstein Distance Guided Representation Learning for Domain Adaptation
Shen, J. G., Qu, Y., Zhang, W., & Yu, Y. H. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11784 · Cited by 895 · see citing works
Luo, Y., Zheng, L., Guan, T., Yu, J., & Yang, Y. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00261 · Cited by 837 · see citing works
AttGAN: Facial attribute editing by only changing what you want
He, Z., Zuo, W., Kan, M., Shan, S., & Chen, X. (2019) · IEEE Transactions on Image Processing · doi:10.1109/tip.2019.2916751 · Cited by 833 · see citing works
Data Augmentation Generative Adversarial NetworksPreprint
Antoniou, A., Storkey, A., & Edwards, H. S. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1711.04340 · Cited by 797 · see citing works
Generative adversarial network: An overview of theory and applications
Aggarwal, A., Mittal, M., & Battineni, G. (2021) · International Journal of Information Management Data Insights · doi:10.1016/j.jjimei.2020.100004 · Cited by 783 · see citing works
Diffusion models in medical imaging: A comprehensive survey
Kazerouni, A., Aghdam, E. K., Heidari, M., Azad, R., Fayyaz, M., Hacihaliloglu, I., & Merhof, D. (2023) · Medical Image Analysis · doi:10.1016/j.media.2023.102846 · Cited by 850 · see citing works
Deep Reinforcement Learning: An Overview
Li, Y. (2017) · arXiv · doi:10.48550/arxiv.1701.07274 · Cited by 762 · see citing works
MedGAN: Medical image translation using GANs
Armanious, K., Jiang, C., Fischer, M., Küstner, T., Hepp, T., Nikolaou, K., Gatidis, S., & Yang, B. (2019) · Computerized Medical Imaging and Graphics · doi:10.1016/j.compmedimag.2019.101684 · Cited by 739 · see citing works
Bond-Taylor, S., Leach, A., Long, Y., & Willcocks, C. G. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3116668 · Cited by 735 · see citing works
Structured Knowledge Distillation for Semantic Segmentation
Liu, Y., Chen, K., Liu, C., Qin, Z., Luo, Z., & Wang, J. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00271 · Cited by 711 · see citing works
Generative Adversarial Networks (GANs)
Saxena, D., & Cao, J. (2021) · ACM Computing Surveys · doi:10.1145/3446374 · Cited by 798 · see citing works
Recent Progress on Generative Adversarial Networks (GANs): A Survey
Pan, Z., Yu, W., Yi, X., Khan, A., Yuan, F., & Zheng, Y. (2019) · IEEE Access · doi:10.1109/access.2019.2905015 · Cited by 699 · see citing works
PointFlow: 3D Point Cloud Generation With Continuous Normalizing Flows
Yang, G., Huang, X., Hao, Z., Liu, M.-Y., Belongie, S., & Hariharan, B. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00464 · Cited by 656 · see citing works
Image Blind Denoising with Generative Adversarial Network Based Noise Modeling
Chen, J., Chen, J., Chao, H., & Yang, M. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00333 · Cited by 616 · see citing works
GANimation: Anatomically-Aware Facial Animation from a Single Image
Pumarola, A., Agudo, A., Martinez, A. M., Sanfeliu, A., & Moreno-Noguer, F. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01249-6_50 · Cited by 621 · see citing works
Ross, A. S., & Doshi‐Velez, F. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11504 · Cited by 621 · see citing works
DeepSMOTE: Fusing Deep Learning and SMOTE for Imbalanced Data
Dablain, D. A., Krawczyk, B., & Chawla, N. V. (2022) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2021.3136503 · Cited by 604 · see citing works
Generative Adversarial Networks for Extreme Learned Image Compression
Agustsson, E., Tschannen, M., Mentzer, F., Timofte, R., & Gool, L. V. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00031 · Cited by 597 · see citing works
F-VAEGAN-D2: A Feature Generating Framework for Any-Shot Learning
Xian, Y., Sharma, S., Schiele, B., & Akata, Z. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.01052 · Cited by 579 · see citing works
Zhang, T., Chen, J., Li, F., Zhang, K., Lv, H., He, S., & Xu, E. (2021) · ISA Transactions · doi:10.1016/j.isatra.2021.02.042 · Cited by 576 · see citing works
Real-valued (Medical) Time Series Generation with Recurrent Conditional GANsPreprint
Esteban, C., Hyland, S. L., & Rätsch, G. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1706.02633 · Cited by 567 · see citing works
Image to Image Translation for Domain Adaptation
Murez, Z., Kolouri, S., Kriegman, D. J., Ramamoorthi, R., & Kim, K. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00473 · Cited by 543 · see citing works
Generative adversarial networks for data augmentation in machine fault diagnosis
Shao, S., Wang, P., & Yan, R. (2019) · Computers in Industry · doi:10.1016/j.compind.2019.01.001 · Cited by 557 · see citing works
Deep Multimodal Representation Learning: A Survey
Guo, W., Wang, J., & Wang, S. (2019) · IEEE Access · doi:10.1109/access.2019.2916887 · Cited by 535 · see citing works
Dreaming to Distill: Data-Free Knowledge Transfer via DeepInversion
Yin, H., Molchanov, P., Alvarez, J. M., Li, Z., Mallya, A., Hoiem, D., Jha, N. K., & Kautz, J. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00874 · Cited by 540 · see citing works
InterFaceGAN: Interpreting the Disentangled Face Representation Learned by GANs
Shen, Y., Yang, C., Tang, X., & Zhou, B. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.3034267 · Cited by 551 · see citing works
You, C., Cong, W., Vannier, M. W., Saha, P. K., Hoffman, E. A., Wang, G., Li, G., Zhang, Y., Zhang, X., Shan, H., et al. (2019) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2019.2922960 · Cited by 529 · see citing works
GANs Trained by a Two Time-Scale Update Rule Converge to a Local Nash Equilibrium
Bynagari, N. B. (2019) · Asian Journal of Applied Science and Engineering · doi:10.18034/ajase.v8i1.9 · Cited by 514 · see citing works
Underwater Image Enhancement Using a Multiscale Dense Generative Adversarial Network
Guo, Y., Li, H., & Zhuang, P. (2019) · IEEE Journal of Oceanic Engineering · doi:10.1109/joe.2019.2911447 · Cited by 512 · see citing works
FakeCatcher: Detection of Synthetic Portrait Videos using Biological Signals
Ciftci, U. A., Demir, I., & Yin, L. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.3009287 · Cited by 499 · see citing works
Image2StyleGAN++: How to Edit the Embedded Images?
Abdal, R., Qin, Y., & Wonka, P. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00832 · Cited by 506 · see citing works
A Review of Generalized Zero-Shot Learning Methods
Pourpanah, F., Abdar, M., Luo, Y., Zhou, X., Wang, R., Lim, C. P., Wang, X., & Wu, Q. M. J. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3191696 · Cited by 493 · see citing works
Generating Natural Adversarial Examples
Zhao, Z., Dua, D., & Singh, S. (2017) · arXiv · doi:10.48550/arxiv.1710.11342 · Cited by 508 · see citing works
Deep Photo Enhancer: Unpaired Learning for Image Enhancement from Photographs with GANs
Chen, Y., Wang, Y.-C., Kao, M.-H., & Chuang, Y. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00660 · Cited by 483 · see citing works
See through Gradients: Image Batch Recovery via GradInversion
Yin, H., Mallya, A., Vahdat, A., Álvarez, J. M., Kautz, J., & Molchanov, P. A. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.01607 · Cited by 482 · see citing works
Xia, W., Zhang, Y., Yang, Y., Xue, J., Zhou, B., & Yang, M. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3181070 · Cited by 496 · see citing works
cGANs with Projection DiscriminatorPreprint
Miyato, T., & Koyama, M. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1802.05637 · Cited by 464 · see citing works
Deep Learning for Deepfakes Creation and Detection: A Survey
Nguyen, T. T., Nguyen, Q. V. H., Nguyen, D. T., Nguyen, D. T., Huynh-The, T., Nahavandi, S., Nguyen, T. T., Pham, Q.-V., & Nguyen, C. M. (2019) · arXiv · doi:10.48550/arxiv.1909.11573 · Cited by 464
Deep learning for deepfakes creation and detection: A survey
Nguyen, T. T., Nguyen, Q. V. H., Nguyen, D. T., Nguyen, D. T., Huynh-The, T., Nahavandi, S., Nguyen, T. T., Pham, Q.-V., & Nguyen, C. M. (2022) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2022.103525 · Cited by 464 · see citing works
Shan, H., Zhang, Y., Yang, Q., Krüger, U., Kalra, M. K., Sun, L., Cong, W., & Wang, G. (2018) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2018.2832217 · Cited by 460 · see citing works
One-Shot Free-View Neural Talking-Head Synthesis for Video Conferencing
Wang, T.-C., Mallya, A., & Liu, M.-Y. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00991 · Cited by 467 · see citing works
Durall, R., Keuper, M., & Keuper, J. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00791 · Cited by 26 · see citing works
Uncertainty quantification in scientific machine learning: Methods, metrics, and comparisons
Psaros, A. F., Meng, X., Zou, Z., Guo, L., & Karniadakis, G. E. (2023) · Journal of Computational Physics · doi:10.1016/j.jcp.2022.111902 · Cited by 464 · see citing works
Dong, H.-W., Hsiao, W.-Y., Yang, L.-C., & Yang, Y.-H. (2017) · AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11312 · Cited by 714 · see citing works
Attributing Fake Images to GANs: Learning and Analyzing GAN Fingerprints
Yu, N., Davis, L. S., & Fritz, M. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00765 · Cited by 491 · see citing works
Adversarially Learned Anomaly Detection
Zenati, H., Romain, M., Foo, C.-S., Lecouat, B., & Chandrasekhar, V. (2018) · Proceedings · doi:10.1109/icdm.2018.00088 · Cited by 450 · see citing works
Structure-Preserving Super Resolution With Gradient Guidance
Ma, C., Rao, Y., Cheng, Y., Chen, C., Lu, J., & Zhou, J. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00779 · Cited by 444 · see citing works
Learning a Deep Multi-Scale Feature Ensemble and an Edge-Attention Guidance for Image Fusion
Liu, J., Fan, X., Jiang, J., Liu, R., & Luo, Z. (2021) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2021.3056725 · Cited by 440 · see citing works
LOGAN: Membership Inference Attacks Against Generative Models
Hayes, J., Melis, L., Danezis, G., & De Cristofaro, E. (2019) · Proceedings on Privacy Enhancing Technologies · doi:10.2478/popets-2019-0008 · Cited by 433 · see citing works
Image-Based 3D Object Reconstruction: State-of-the-Art and Trends in the Deep Learning Era
Han, X.-F., Laga, H., & Bennamoun, M. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2954885 · Cited by 440 · see citing works
Shan, H., Padole, A. M., Homayounieh, F., Krüger, U., Khera, R. D., Nitiwarangkul, C., Kalra, M. K., & Wang, G. (2019) · Nature Machine Intelligence · doi:10.1038/s42256-019-0057-9 · Cited by 426 · see citing works
MMD GAN: Towards Deeper Understanding of Moment Matching NetworkPreprint
Li, C., Chang, W.-C., Cheng, Y., Yang, Y., & Póczos, B. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1705.08584 · Cited by 424 · see citing works
Li, J., Huo, H., Li, C., Wang, R.-H., & Feng, Q. (2020) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2020.2997127 · Cited by 420 · see citing works
Peng, X. B., Ma, Z., Abbeel, P., Levine, S., & Kanazawa, A. (2021) · ACM Transactions on Graphics · doi:10.1145/3450626.3459670 · Cited by 423 · see citing works
Scaling up GANs for Text-to-Image Synthesis
Kang, M., Zhu, J.-Y., Zhang, R., Park, J., Shechtman, E., Paris, S., & Park, T. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00976 · Cited by 426 · see citing works
Ye, H., Liang, L., Li, G. Y., & Juang, B.-H. F. (2020) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2020.2970707 · Cited by 416 · see citing works
A Generative Adversarial Approach for Zero-Shot Learning from Noisy Texts
Zhu, Y., Elhoseiny, M., Liu, B., Peng, X., & Elgammal, A. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00111 · Cited by 412 · see citing works
A de novo molecular generation method using latent vector based generative adversarial network
Prykhodko, O., Johansson, S., Kotsias, P.-C., Arús‐Pous, J., Bjerrum, E. J., Engkvist, O., & Chen, H. (2019) · Journal of Cheminformatics · doi:10.1186/s13321-019-0397-9 · Cited by 395 · see citing works
- Authors
- Gulrajani, I., Ahmed, F., Arjovsky, M., Dumoulin, V., & Courville, A.
- Affiliations
- Mila - Quebec Artificial Intelligence Institute (CA)
- Canadian Institute for Advanced Research (CA)
- ORCID
- Courville, Aaron
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2017
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1704.00028
- OpenAlex
- W2605135824
- Cited by
- 6,800
- References
- 33
- Citations by year
- 2026: 26 · 2025: 538 · 2024: 1006 · 2023: 1013 · 2022: 946 · 2021: 1170 · 2020: 947 · 2019: 719 · 2018: 357 · 2017: 71 · 2016: 2 · 2013: 1 · 2012: 2
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Generative Adversarial Networks and Image Synthesis
- Physical Sciences › Computer Science › Artificial Intelligence › Adversarial Robustness in Machine Learning
- Physical Sciences › Computer Science › Artificial Intelligence › Stochastic Gradient Optimization Techniques
- Keywords
- Wasserstein GAN, generative adversarial networks, training instability, weight clipping, Lipschitz constraint, deep generative models
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
