The DOI matches its Crossref record; 16 of the 16 references it cites were found in a registry or an index.
On the Effectiveness of Least Squares Generative Adversarial Networks
Open accessAbstract
Unsupervised learning with generative adversarial networks (GANs) has proven to be hugely successful. Regular GANs hypothesize the discriminator as a classifier with the sigmoid cross entropy loss function. However, we found that this loss function may lead to the vanishing gradients problem during the learning process. To overcome such a problem, we propose in this paper the Least Squares Generative Adversarial Networks (LSGANs) which adopt the least squares loss for both the discriminator and the generator. We show that minimizing the objective function of LSGAN yields minimizing the Pearson$\chi ^2$divergence. We also show that the derived objective function that yields minimizing the Pearson$\chi ^2$divergence performs better than the classical one of using least squares for classification. There are two benefits of LSGANs over regular GANs. First, LSGANs are able to generate higher quality images than regular GANs. Second, LSGANs perform more stably during the learning process. For evaluating the image quality, we conduct both qualitative and quantitative experiments, and the experimental results show that LSGANs can generate higher quality images than regular GANs. Furthermore, we evaluate the stability of LSGANs in two groups. One is to compare between LSGANs and regular GANs without gradient penalty. We conduct three experiments, including Gaussian mixture distribution, difficult architectures, and a newly proposed method — datasets with small variability, to illustrate the stability of LSGANs. The other one is to compare between LSGANs with gradient penalty (LSGANs-GP) and WGANs with gradient penalty (WGANs-GP). The experimental results show that LSGANs-GP succeed in training for all the difficult architectures used in WGANs-GP, including 101-layer ResNet.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2577031 · Cited by 73,472
Image-to-Image Translation with Conditional Adversarial Networks
Isola, P., Zhu, J.-Y., Zhou, T., & Efros, A. A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.632 · Cited by 22,930
Reducing the dimensionality of data with neural networks
Hinton, G. E., & Salakhutdinov, R. R. (2006) · Science · doi:10.1126/science.1127647 · Cited by 20,928
A fast learning algorithm for deep belief nets
Hinton, G. E., Osindero, S., & Teh, Y.-W. (2006) · Neural Computation · doi:10.1162/neco.2006.18.7.1527 · Cited by 16,336
Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network
Ledig, C., Theis, L., Huszar, F., Caballero, J., Cunningham, A., Acosta, A., Aitken, A., Tejani, A., Totz, J., Wang, Z., et al. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.19 · Cited by 12,696
Self-citationUnsupervised representation learning with deep convolutional generative adversarial networks
Radford, A., Metz, L., & Chintala, S. (2015) · arXiv · doi:10.48550/arxiv.1511.06434 · Cited by 12,235
Conditional Generative Adversarial Nets
Mirza, M., & Osindero, S. (2014) · arXiv · doi:10.48550/arxiv.1411.1784 · Cited by 8,863
GANs Trained by a Two Time-Scale Update Rule Converge to a Local Nash Equilibrium
Heusel, M., Ramsauer, H., Unterthiner, T., Nessler, B., & Hochreiter, S. (2017) · arXiv · doi:10.48550/arxiv.1706.08500 · Cited by 8,365
Research works printed but not linked: 32
- roth, 2017, Stabilizing training of generative adversarial networks through regularization, Proc Advances Neural Inf Process Syst, 2018
- mescheder, 2017, The numerics of GANs, Proc Advances Neural Inf Process Syst, 1825
- che, 0, Mode regularized generative adversarial networks, CoRR
- 10.1109/CVPR.2017.202 · DOI · Paper page
- denton, 2015, Deep generative image models using a laplacian pyramid of adversarial networks, Proc Advances Neural Inf Process Syst, 1486
- li, 0, Alice: Towards understanding adversarial learning for joint distribution matching, Adv Neural Inf Process Syst (NIPS), 5495
- 10.1109/TIT.2010.2068870 · DOI · Paper page
- dai, 0, Calibrating energy-based generative adversarial networks, CoRR
- chen, 2016, Infogan: Interpretable representation learning by information maximizing generative adversarial nets, Proc Advances Neural Inf Process Syst, 2172
- fedus, 0, Many paths to equilibrium: Gans do not need to decrease a divergence at every step, CoRR
- metz, 0, Unrolled generative adversarial networks, CoRR
- qi, 0, Loss-sensitive generative adversarial networks on lipschitz densities, CoRR
- bishop, 2006, Pattern Recognition and Machine Learning
- kodali, 0, On convergence and stability of gans, CoRR
- donahue, 0, Adversarial feature learning, CoRR
- 10.1109/CVPR.2015.7298965 · DOI · Paper page
- kingma, 0, Auto-encoding variational bayes, CoRR
- dumoulin, 0, Adversarially learned inference, CoRR
- salakhutdinov, 2009, Deep Boltzmann machines, Proc Int Conf Artif Intell Statist, 5, 448
- goodfellow, 2016, Deep Learning
- goodfellow, 2014, Generative adversarial nets, Proc Advances Neural Inf Process Syst, 2672
- 10.1109/CVPR.2017.374 · DOI · Paper page
- 10.1109/ICCV.2017.304 · DOI · Paper page
- netzer, 2011, Reading digits in natural images with unsupervised feature learning, Proc NIPS Workshop on Deep Learning and Unsupervised Feature Learning
- hinton, 2009, Replicated softmax: An undirected topic model, Proc Advances Neural Inf Process Syst, 1607
- tieleman, 2012, Lecture 6.5|RMSProp: Divide the gradient by a running average of its recent magnitude, COURSERA Neural Netw Mach Learn, 4, 26
- taylor, 2010, Convolutional learning of spatio-temporal features, Proc Eur Conf Comput Vis, 140
- dieng, 2017, Variational inference via $\chi$? upper bound minimization, Proc Advances Neural Inf Process Syst, 2732
- ganin, 2016, Domain-adversarial training of neural networks, J Mach Learn Res, 17, 2096
- huszár, 0, How (not) to train your generative model: Scheduled sampling, likelihood, adversary?, CoRR
- zhang, 2008, Cat head detection - how to effectively exploit shape and texture features, Proc Eur Conf Comput Vis, 802
- 0, TensorFlow: Large-scale machine learning on heterogeneous systems, CoRR
Cited by
A Review on Generative Adversarial Networks: Algorithms, Theory, and Applications
Gui, J., Sun, Z., Wen, Y., Tao, D., & Ye, J. (2023) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2021.3130191 · Cited by 1,231
Recent Progress on Generative Adversarial Networks (GANs): A Survey
Pan, Z., Yu, W., Yi, X., Khan, A., Yuan, F., & Zheng, Y. (2019) · IEEE Access · doi:10.1109/access.2019.2905015 · Cited by 701
Deep Generative Adversarial Neural Networks for Compressive Sensing MRI
Mardani, M., Gong, E., Cheng, J. Y., Vasanawala, S. S., Zaharchuk, G., Xing, L., & Pauly, J. M. (2019) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2018.2858752 · Cited by 552
Sharpness-Aware Low-Dose CT Denoising Using Conditional Generative Adversarial Network
Yi, X., & Babyn, P. (2018) · Journal of Digital Imaging · doi:10.1007/s10278-018-0056-0 · Cited by 343
Activated Gradients for Deep Neural Networks
Liu, M., Chen, L., Du, X., Jin, L., & Shang, M. (2023) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2021.3106044 · Cited by 304
Metadata
- Authors
- Mao, X., Li, Q., Xie, H., Lau, R. Y. K., Wang, Z., & Smolley, S. P.
- Venue
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- Published
- 2019-12-01
- Volume
- 41
- Issue
- 12
- Pages
- 2947-2960
- ISSN
- 0162-8828 (ISSN-L)
- 2160-9292
- 1939-3539
- OpenAlex
- W2962765321
- Cited by
- 225
- References
- 16
- FWCI
- 13.83
- Type
- journal article
- Language
- en
- Open access
- green
- Licence
- Funders
- Hong Kong Research Grants Council (CityU 11211417)
- City University of Hong Kong (9610367)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: On the Effectiveness of Least Squares Generative Adversarial Networks. https://app.cochat.ai/papers/10.1109/tpami.2018.2872043
- The paper
- Mao, X., Li, Q., Xie, H., Lau, R. Y. K., Wang, Z., & Smolley, S. P. (2019). On the Effectiveness of Least Squares Generative Adversarial Networks. IEEE Transactions on Pattern Analysis and Machine Intelligence. https://doi.org/10.1109/tpami.2018.2872043
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.