Self-Supervised GANs via Auxiliary Rotation Loss
Open accessAbstract
Conditional GANs are at the forefront of natural image synthesis. The main drawback of such models is the necessity for labeled data. In this work we exploit two popular unsupervised learning techniques, adversarial training and self-supervision, and take a step towards bridging the gap between conditional and unconditional GANs. In particular, we allow the networks to collaborate on the task of representation learning, while being adversarial with respect to the classic GAN game. The role of self-supervision is to encourage the discriminator to learn meaningful feature representations which are not forgotten during training. We test empirically both the quality of the learned image representations, and the quality of the synthesized images. Under the same conditions, the self-supervised GAN attains a similar performance to state-of-the-art conditional counterparts. Finally, we show that this approach to fully unsupervised learning can be scaled to attain an FID of 23.4 on unconditional ImageNet generation.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Contrastive learning is a training procedure used in recent artificial intelligence models as a way to efficiently learn semantic representations.
“Contrastive learning [56-58] is in fact a training procedure used in recent artificial intelligence models as a way to efficiently learn semantic representations.”
From How Adversarial REM Dreams May Facilitate Creativity, and Why We Become Aware of Them (2024) · cites this paper as [57]
This trend focuses on developing AI systems that can work alongside humans, improving user experience and efficiency across applications including productivity and healthcare.
“This trend focuses on developing AI systems that can work alongside humans, thereby improving user experience and efficiency across various applications, including productivity and healthcare [275], [276], [277].”
From From Google Gemini to OpenAI Q* (Q-Star): A Survey on Reshaping the Generative Artificial Intelligence (AI) Research Landscape (2025) · cites this paper as [276]
Cites
Labaca-Castro, R. (2023) · Springer eBooks · doi:10.1007/978-3-658-40442-0_9 · Cited by 21,100 · see citing works
GAN(Generative Adversarial Nets)
淳司, 柴. (2017) · Journal of Japan Society for Fuzzy Theory and Intelligent Informatics · doi:10.3156/jsoft.29.5_177_2 · Cited by 19,268 · see citing works
Unsupervised representation learning with deep convolutional generative adversarial networks
Radford, A., Metz, L., & Chintala, S. (2015) · arXiv · doi:10.48550/arxiv.1511.06434 · Cited by 12,235 · see citing works
GANs Trained by a Two Time-Scale Update Rule Converge to a Local Nash Equilibrium
Heusel, M., Ramsauer, H., Unterthiner, T., Nessler, B., & Hochreiter, S. (2017) · arXiv · doi:10.48550/arxiv.1706.08500 · Cited by 8,365 · see citing works
Overcoming catastrophic forgetting in neural networks
Kirkpatrick, J., Pascanu, R., Rabinowitz, N., Veness, J., Desjardins, G., Rusu, A. A., Milan, K., Quan, J., Ramalho, T., Grabska-Barwinska, A., et al. (2017) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1611835114 · Cited by 7,899 · see citing works
Improved Techniques for Training GANs
Salimans, T., Goodfellow, I., Zaremba, W., Cheung, V., Radford, A., & Chen, X. (2016) · arXiv · doi:10.48550/arxiv.1606.03498 · Cited by 6,965 · see citing works
Improved training of Wasserstein GANs
Gulrajani, I., Ahmed, F., Arjovsky, M., Dumoulin, V., & Courville, A. (2017) · arXiv · doi:10.48550/arxiv.1704.00028 · Cited by 6,800 · see citing works
Context Encoders: Feature Learning by Inpainting
Pathak, D., Krahenbuhl, P., Donahue, J., Darrell, T., & Efros, A. A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.278 · Cited by 5,691 · see citing works
“Least squares generative adversarial networks,”
Mao, X., Li, Q., Xie, H., Lau, R. Y. K., Wang, Z., & Smolley, S. P. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.304 · Cited by 5,437 · see citing works
Progressive Growing of GANs for Improved Quality, Stability, and Variation
Karras, T., Aila, T., Laine, S., & Lehtinen, J. (2017) · arXiv · doi:10.48550/arxiv.1710.10196 · Cited by 4,727 · see citing works
Zhang, R., Isola, P., & Efros, A. A. (2016) · European Conference on Computer Vision · doi:10.1007/978-3-319-46487-9_40 · Cited by 3,803 · see citing works
Catastrophic Interference in Connectionist Networks: The Sequential Learning Problem
McCloskey, M., & Cohen, N. J. (1989) · Psychology of Learning and Motivation · doi:10.1016/s0079-7421(08)60536-8 · Cited by 3,770 · see citing works
Large Scale GAN Training for High Fidelity Natural Image Synthesis
Brock, A., Donahue, J., & Simonyan, K. (2018) · arXiv · doi:10.48550/arxiv.1809.11096 · Cited by 3,717 · see citing works
Spectral Normalization for Generative Adversarial Networks
Miyato, T., Kataoka, T., Koyama, M., & Yoshida, Y. (2018) · arXiv · doi:10.48550/arxiv.1802.05957 · Cited by 3,438 · see citing works
Self-Attention Generative Adversarial Networks
Zhang, H., Goodfellow, I., Metaxas, D., & Odena, A. (2018) · arXiv · doi:10.48550/arxiv.1805.08318 · Cited by 3,353 · see citing works
Conditional Image Synthesis With Auxiliary Classifier GANsPreprint
Odena, A., Olah, C., & Shlens, J. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1610.09585 · Cited by 2,968 · see citing works
Unsupervised Learning of Visual Representations by Solving Jigsaw Puzzles
Noroozi, M., & Favaro, P. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46466-4_5 · Cited by 2,775 · see citing works
Deep Clustering for Unsupervised Learning of Visual Features
Caron, M., Bojanowski, P., Joulin, A., & Douze, M. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01264-9_9 · Cited by 2,674 · see citing works
Unsupervised Visual Representation Learning by Context Prediction
Doersch, C., Gupta, A., & Efros, A. A. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.167 · Cited by 2,629 · see citing works
Unsupervised Representation Learning by Predicting Image Rotations
Gidaris, S., Singh, P., & Komodakis, N. (2018) · arXiv · doi:10.48550/arxiv.1803.07728 · Cited by 2,477 · see citing works
Catastrophic forgetting in connectionist networks
French, R. (1999) · Trends in Cognitive Sciences · doi:10.1016/s1364-6613(99)01294-2 · Cited by 2,311 · see citing works
Adversarial Feature LearningPreprint
Donahue, J., Krähenbühl, P., & Darrell, T. (2016) · International Conference on Learning Representations · doi:10.48550/arxiv.1605.09782 · Cited by 1,982 · see citing works
Learning from Simulated and Unsupervised Images through Adversarial Training
Shrivastava, A., Pfister, T., Tuzel, O., Susskind, J., Wang, W., & Webb, R. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.241 · Cited by 1,831 · see citing works
Continual Learning Through Synaptic Intelligence
Zenke, F., Poole, B., & Ganguli, S. (2017) · arXiv · doi:10.48550/arxiv.1703.04200 · Cited by 1,784 · see citing works
LSUN: Construction of a Large-scale Image Dataset using Deep Learning with Humans in the LoopPreprint
Yu, F., Seff, A., Zhang, Y., Song, S., Funkhouser, T., & Xiao, J. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1506.03365 · Cited by 1,339 · see citing works
Supersizing self-supervision: Learning to grasp from 50K tries and 700 robot hours
Pinto, L., & Gupta, A. (2016) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2016.7487517 · Cited by 1,060 · see citing works
Which Training Methods for GANs do actually Converge?Preprint
Mescheder, L., Geiger, A., & Nowozin, S. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1801.04406 · Cited by 1,029 · see citing works
Assessing Generative Models via Precision and RecallPreprint
Sajjadi, M. S. M., Bachem, O., Lučić, M., Bousquet, O., & Gelly, S. (2018) · Neural Information Processing Systems · doi:10.48550/arxiv.1806.00035 · Cited by 815 · see citing works
Discriminative Unsupervised Feature Learning with Convolutional Neural NetworksPreprint
Dosovitskiy, A., Springenberg, J. T., Riedmiller, M., & Brox, T. (2014) · arXiv (Cornell University) · Cited by 790 · see citing works
Split-Brain Autoencoders: Unsupervised Learning by Cross-Channel Prediction
Zhang, R., Isola, P., & Efros, A. A. (2016) · Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2017.76 · Cited by 724 · see citing works
Revisiting Self-Supervised Visual Representation Learning
Kolesnikov, A., Zhai, X., & Beyer, L. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00202 · Cited by 675 · see citing works
Self-citationAgrawal, P., Carreira, J., & Malik, J. (2015) · IEEE International Conference on Computer Vision · doi:10.1109/iccv.2015.13 · Cited by 639 · see citing works
Unsupervised Representation Learning by Sorting Sequences
Lee, H.-Y., Huang, J., Singh, M., & Yang, M. (2017) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.79 · Cited by 529 · see citing works
cGANs with Projection DiscriminatorPreprint
Miyato, T., & Koyama, M. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1802.05637 · Cited by 464 · see citing works
Modulating early visual processing by languagePreprint
de Vries, H., Strub, F., Mary, J., Larochelle, H., Pietquin, O., & Courville, A. C. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1707.00683 · Cited by 368 · see citing works
A Note on the Inception ScorePreprint
Barratt, S. T., & Sharma, R. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1801.01973 · Cited by 366 · see citing works
GANs Trained by a Two Time-Scale Update Rule Converge to a Nash EquilibriumPreprint
Heusel, M., Ramsauer, H., Unterthiner, T., Nessler, B., Klambauer, G., & Hochreiter, S. (2017) · arXiv (Cornell University) · Cited by 364 · see citing works
cGANs with Projection Discriminator
Miyato, T., & Koyama, M. (2018) · Cited by 293 · see citing works
The GAN Landscape: Losses, Architectures, Regularization, and NormalizationPreprint
Kurach, K., Lučić, M., Zhai, X., Michalski, M., & Gelly, S. (2018) · arXiv (Cornell University) · Cited by 125 · see citing works
Self-citationImprovements to Context Based Self-Supervised Learning
Mundhenk, T. N., Ho, D., & Chen, B. Y. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00973 · Cited by 122 · see citing works
Continual Learning in Generative Adversarial NetsPreprint
Seff, A., Beatson, A., Suo, D., & Liu, H. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1705.08395 · Cited by 88 · see citing works
On Self Modulation for Generative Adversarial NetworksPreprint
Chen, T., Lučić, M., Houlsby, N., & Gelly, S. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1810.01365 · Cited by 82 · see citing works
Self-citationGrasp2Vec: Learning Object Representations from Self-Supervised GraspingPreprint
Jang, E., Devin, C., Vanhoucke, V., & Levine, S. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1811.06964 · Cited by 82 · see citing works
On Catastrophic Forgetting and Mode Collapse in Generative Adversarial NetworksPreprint
Thanh-Tung, H., & Tran, T. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1807.04015 · Cited by 41 · see citing works
Generative Adversarial Network Training is a Continual Learning ProblemPreprint
Liang, K. J., Li, C., Wang, G., & Carin, L. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1811.11083 · Cited by 36 · see citing works
An Online Learning Approach to Generative Adversarial NetworksPreprint
Grnarova, P., Levy, K. Y., Lucchi, A., Hofmann, T., & Krause, A. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1706.03269 · Cited by 29 · see citing works
Memorization Precedes Generation: Learning Unsupervised GANs with Memory NetworksPreprint
Kim, Y., Kim, M., & Kim, G. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1803.01500 · Cited by 26 · see citing works
Understanding the Effectiveness of Lipschitz Constraint in Training of GANs via Gradient AnalysisPreprint
Zhou, Z., Song, Y., Yu, L., & Yu, Y. H. (2018) · arXiv (Cornell University) · Cited by 3 · see citing works
Flagged first, then by citations
7 of the 55 references couldn’t be matched to a known paper.
Cited by
Sorted by citations
Self-Supervised Visual Feature Learning With Deep Neural Networks: A Survey
Jing, L., & Tian, Y. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.2992393 · Cited by 2,036 · see citing works
Big Self-Supervised Models are Strong Semi-Supervised LearnersPreprint
Chen, T., Kornblith, S., Swersky, K., Norouzi, M., & Hinton, G. E. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.10029 · Cited by 1,480 · see citing works
Self-citation(2022) · doi:10.1007/978-3-031-20053-3_27 · Cited by 1,060 · see citing works
Bond-Taylor, S., Leach, A., Long, Y., & Willcocks, C. G. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3116668 · Cited by 735 · see citing works
A Survey on Self-Supervised Learning: Algorithms, Applications, and Future Trends
Gui, J., Chen, T., Zhang, J., Cao, Q., Sun, Z., Luo, H., & Tao, D. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3415112 · Cited by 622 · see citing works
Self-citationA comprehensive survey on pretrained foundation models: a history from BERT to ChatGPT
Zhou, C., Li, Q., Li, C., Yu, J., Liu, Y., Wang, G., Zhang, K., Ji, C., Yan, Q., He, L., et al. (2024) · International Journal of Machine Learning and Cybernetics · doi:10.1007/s13042-024-02443-6 · Cited by 704 · see citing works
GAN-based anomaly detection: A review
Xia, X., Pan, X., Li, N., He, X., Ma, L., Zhang, X., & Ding, N. (2022) · Neurocomputing · doi:10.1016/j.neucom.2021.12.093 · Cited by 404 · see citing works
Large Scale Adversarial Representation LearningPreprint
Donahue, J., & Simonyan, K. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1907.02544 · Cited by 398 · see citing works
Differentiable Augmentation for Data-Efficient GAN TrainingPreprint
Zhao, S., Liu, Z., Lin, J., Zhu, J.-Y., & Han, S. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.10738 · Cited by 417 · see citing works
On Data Augmentation for GAN Training
Tran, N.-T., Tran, V.-H., Nguyen, N.-B., Nguyen, T.-K., & Cheung, N. (2021) · IEEE Transactions on Image Processing · doi:10.1109/tip.2021.3049346 · Cited by 399 · see citing works
A U-Net Based Discriminator for Generative Adversarial Networks
Schönfeld, E., Schiele, B., & Khoreva, A. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00823 · Cited by 353 · see citing works
Zhou, Z., Sodha, V., Pang, J., Gotway, M. B., & Liang, J. (2020) · Medical Image Analysis · doi:10.1016/j.media.2020.101840 · Cited by 353 · see citing works
TransGAN: Two Pure Transformers Can Make One Strong GAN, and That Can Scale UpPreprint
Jiang, Y., Chang, S., & Wang, Z. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2102.07074 · Cited by 373 · see citing works
Qi, G.-J., & Luo, J. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.3031898 · Cited by 315 · see citing works
Self-supervised Learning of Adversarial Example: Towards Good Generalizations for Deepfake Detection
Chen, L., Zhang, Y., Song, Y., Liu, L., & Wang, J. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01815 · Cited by 307 · see citing works
Generative Adversarial Networks in Computer Vision: A Survey and Taxonomy
Wang, Z., She, Q., & Ward, T. E. (2022) · ACM Computing Surveys · doi:10.1145/3439723 · Cited by 267 · see citing works
Generative Adversarial Networks in Computer Vision: A Survey and TaxonomyPreprint
Wang, Z., She, Q., & Ward, T. E. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.01529 · Cited by 254 · see citing works
Semi-Supervised and Unsupervised Deep Visual Learning: A Survey
Chen, Y., Mancini, M., Zhu, X., & Akata, Z. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3201576 · Cited by 235 · see citing works
Huang, Z., Zhang, J., Zhang, Y., & Shan, H. (2021) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2021.3128703 · Cited by 235 · see citing works
Co 2 L: Contrastive Continual Learning
Cha, H., Lee, J., & Shin, J. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00938 · Cited by 225 · see citing works
Learning from Extrinsic and Intrinsic Supervisions for Domain Generalization
Wang, S., Yu, L., Li, C., Fu, C., & Heng, P. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58545-7_10 · Cited by 206 · see citing works
Consistency Regularization for Generative Adversarial NetworksPreprint
Zhang, H., Zhang, Z., Odena, A., & Lee, H. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1910.12027 · Cited by 218 · see citing works
Review on self-supervised image recognition using deep neural networks
Ohri, K., & Kumar, M. (2021) · Knowledge-Based Systems · doi:10.1016/j.knosys.2021.107090 · Cited by 179 · see citing works
Towards Faster and Stabilized GAN Training for High-fidelity Few-shot Image SynthesisPreprint
Liu, B., Zhu, Y., Song, K., & Elgammal, A. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2101.04775 · Cited by 176 · see citing works
Self-Supervised Attentive Generative Adversarial Networks for Video Anomaly Detection
Huang, C., Wen, J., Xu, Y. D., Jiang, Q., Yang, J. Y., Wang, Y., & Zhang, D. D. (2022) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3159538 · Cited by 163 · see citing works
A Large-scale Study of Representation Learning with the Visual Task Adaptation BenchmarkPreprint
Zhai, X., Puigcerver, J., Kolesnikov, A., Ruyssen, P., Riquelme, C., Lučić, M., Djolonga, J., Pinto, A. S., Neumann, M., Dosovitskiy, A., et al. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1910.04867 · Cited by 249 · see citing works
Self-citationToward Self-Learning Edge Intelligence in 6G
Xiao, Y., Shi, G., Li, Y., Saad, W., & Poor, H. V. (2020) · IEEE Communications Magazine · doi:10.1109/mcom.001.2000388 · Cited by 158 · see citing works
A Survey on Contrastive Self-Supervised Learning
Jaiswal, A., Babu, A. R., Zadeh, M. Z., Banerjee, D., & Makedon, F. (2020) · Technologies · doi:10.3390/technologies9010002 · Cited by 154 · see citing works
TransGAN: Two Transformers Can Make One Strong GANPreprint
Jiang, Y., Chang, S., & Wang, Z. (2021) · arXiv (Cornell University) · Cited by 147 · see citing works
Freeze the Discriminator: a Simple Baseline for Fine-Tuning GANsPreprint
Mo, S., Cho, M., & Shin, J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.10964 · Cited by 167 · see citing works
High-Fidelity Image Generation With Fewer LabelsPreprint
Lučić, M., Tschannen, M., Ritter, M., Zhai, X., Bachem, O., & Gelly, S. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1903.02271 · Cited by 126 · see citing works
Self-citationQS-Attn: Query-Selected Attention for Contrastive Learning in I2I Translation
Hu, X., Zhou, X., Huang, Q., Shi, Z., Li, S., & Li, Q. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01775 · Cited by 117 · see citing works
Image Augmentations for GAN TrainingPreprint
Zhao, Z., Zhang, Z., Chen, T., Singh, S., & Zhang, H. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.02595 · Cited by 125 · see citing works
Self-citationSelf-Supervised Remote Sensing Feature Learning: Learning Paradigms, Challenges, and Future Works
Tao, C., Qi, J., Guo, M., Zhu, Q., & Li, H. (2023) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2023.3276853 · Cited by 109 · see citing works
McIntosh, T. R., Susnjak, T., Liu, T., Watters, P., Xu, D., Liu, D., & Halgamuge, M. N. (2025) · Technologies · doi:10.3390/technologies13020051 · Cited by 102 · see citing works
“It incorporates generative models like autoencoders and GANs for data distribution learning and original input reconstruction [244], [245], [246], and also includes contrastive methods such as SimCLR [247] and MoCo [248], designed to differentiate between positive and negative sample pairs.”
MethodMorales, E. F., Murrieta-Cid, R., Becerra, I., & Esquivel-Basaldua, M. A. (2021) · Intelligent Service Robotics · doi:10.1007/s11370-021-00398-z · Cited by 101 · see citing works
On Robustness and Transferability of Convolutional Neural Networks
Djolonga, J., Yung, J., Tschannen, M., Romijnders, R., Beyer, L., Kolesnikov, A., Puigcerver, J., Minderer, M., D'Amour, A., Moldovan, D., et al. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.01619 · Cited by 98 · see citing works
Self-citationLin, H., Liu, Y., Li, S., & Qu, X. (2023) · IEEE/CAA Journal of Automatica Sinica · doi:10.1109/jas.2023.123744 · Cited by 99 · see citing works
GAN based augmentation using a hybrid loss function for dermoscopy images
Göçeri, E. (2024) · Artificial Intelligence Review · doi:10.1007/s10462-024-10897-x · Cited by 94 · see citing works
Generative Hierarchical Features from Synthesizing Images
Xu, Y., Shen, Y., Zhu, J., Yang, C., & Zhou, B. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00441 · Cited by 87 · see citing works
Chowdhury, A., Rosenthal, J., Waring, J., & Umeton, R. (2021) · Informatics · doi:10.3390/informatics8030059 · Cited by 85 · see citing works
Zero-Shot Stance Detection via Contrastive Learning
Liang, B., Chen, Z.-X., Gui, L., He, Y.-L., Yang, M., & Xu, R. (2022) · The Web Conference · doi:10.1145/3485447.3511994 · Cited by 102 · see citing works
Self-Supervised Deep Visual Odometry With Online Adaptation
Li, S., Wang, X., Cao, Y., Xue, F., Yan, Z., & Zha, H. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00637 · Cited by 78 · see citing works
Brain stroke lesion segmentation using consistent perception generative adversarial network
Wang, S., Chen, Z., You, S., Wang, B.-C., Shen, Y., & Lei, B. (2022) · Neural Computing and Applications · doi:10.1007/s00521-021-06816-8 · Cited by 77 · see citing works
OBoW: Online Bag-of-Visual-Words Generation for Self-Supervised Learning
Gidaris, S., Bursuc, A., Puy, G., Nikos Komodakis, A., Cord, M., & Pérez, P. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00676 · Cited by 86 · see citing works
Berg, P., Pham, M., & Courty, N. (2022) · Remote Sensing · doi:10.3390/rs14163995 · Cited by 77 · see citing works
Zhao, Z., Luo, Z., Li, J., Chen, C., & Piao, Y. (2020) · Remote Sensing · doi:10.3390/rs12203276 · Cited by 76 · see citing works
A Systematic Survey of Regularization and Normalization in GANs
Li, Z., Usman, M., Tao, R., Xia, P., Wang, C., Chen, H., & Li, B. (2022) · ACM Computing Surveys · doi:10.1145/3569928 · Cited by 74 · see citing works
Koga, Y., Miyazaki, H., & Shibasaki, R. (2020) · Remote Sensing · doi:10.3390/rs12030575 · Cited by 73 · see citing works
Dual Contradistinctive Generative Autoencoder
Parmar, G., Li, D., Lee, K., & Tu, Z. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00088 · Cited by 70 · see citing works
Oyelade, O. N., Ezugwu, A. E.-S., Almutairi, M. S., Saha, A. K., Abualigah, L., & Chiroma, H. (2022) · Scientific Reports · doi:10.1038/s41598-022-09929-9 · Cited by 71 · see citing works
i-Mix: A Domain-Agnostic Strategy for Contrastive Representation LearningPreprint
Lee, K., Zhu, Y., Sohn, K., Li, C., Shin, J., & Lee, H. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.08887 · Cited by 72 · see citing works
Lee, K. S., Tran, N.-T., & Cheung, N. M. (2021) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv48630.2021.00399 · Cited by 66 · see citing works
Mitigating Intensity Bias in Shadow Detection via Feature Decomposition and Reweighting
Zhu, L., Xu, K., Ke, Z., & Lau, R. W. H. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00466 · Cited by 65 · see citing works
Deepfake Network Architecture Attribution
Yang, T., Huang, Z., Cao, J., Li, L., & Li, X. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i4.20391 · Cited by 62 · see citing works
Improved Transformer for High-Resolution GANsPreprint
Zhao, L., Zhang, Z., Chen, T., Metaxas, D., & Zhang, H. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.07631 · Cited by 64 · see citing works
Self-citationKim, G., Park, J., Lee, K., Lee, J., Min, J., Lee, B., Han, D. K., & Ko, H. (2020) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw50498.2020.00236 · Cited by 58 · see citing works
Towards Discovery and Attribution of Open-world GAN Generated Images
Girish, S., Suri, S., Rambhatla, S. S., & Shrivastava, A. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01383 · Cited by 58 · see citing works
Li, M., Huang, X., & Zhang, Z. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00026 · Cited by 55 · see citing works
Dual Contrastive Loss and Attention for GANs
Yu, N., Liu, G., Dündar, A., Tao, A., Catanzaro, B., Davis, L. S., & Fritz, M. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00666 · Cited by 57 · see citing works
HDR Environment Map Estimation for Real-Time Augmented Reality
Somanath, G., & Kurz, D. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.01114 · Cited by 52 · see citing works
SSTN: Self-Supervised Domain Adaptation Thermal Object Detection for Autonomous Driving
Munir, F., Azam, S., & Jeon, M. (2021) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros51168.2021.9636353 · Cited by 51 · see citing works
SSD-GAN: Measuring the Realness in the Spatial and Spectral Domains
Chen, Y., Li, G., Jin, C., Liu, S., & Li, T. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i2.16196 · Cited by 51 · see citing works
A New Perspective on Stabilizing GANs Training: Direct Adversarial Training
Li, Z., Xia, P., Tao, R., Niu, H., & Li, B. (2022) · IEEE Transactions on Emerging Topics in Computational Intelligence · doi:10.1109/tetci.2022.3193373 · Cited by 50 · see citing works
Shen, Y., Sowmya, A., Luo, Y., Liang, X., Shen, D. G., & Ke, J. (2022) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2022.3221724 · Cited by 53 · see citing works
Conditional Self-Supervised Learning for Few-Shot Classification
An, Y., Xue, H., Zhao, X., & Zhang, L. (2021) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2021/295 · Cited by 44 · see citing works
Continual Learning on Noisy Data Streams via Self-Purified Replay
Kim, C. D., Jeong, J., Moon, S., & Kim, G. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00058 · Cited by 44 · see citing works
Quaternion Generative Adversarial Networks
Grassucci, E., Cicero, E., & Comminiello, D. (2022) · Intelligent systems reference library · doi:10.1007/978-3-030-91390-8_4 · Cited by 43 · see citing works
Rethinking Data Augmentation: Self-Supervision and Self-DistillationPreprint
Lee, H., Hwang, S. J., & Shin, J. (2019) · arXiv (Cornell University) · Cited by 43 · see citing works
Auxiliary Training: Towards Accurate and Robust Models
Zhang, L., Yu, M., Chen, T., Shi, Z., Bao, C., & Ma, K. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00045 · Cited by 41 · see citing works
Self-citationConditional Negative Sampling for Contrastive Learning of Visual RepresentationsPreprint
Wu, M., Mosse, M., Zhuang, C., Yamins, D. L. K., & Goodman, N. D. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.02037 · Cited by 52 · see citing works
GridMix: Strong regularization through local context mapping
Baek, K., Bang, D., & Shim, H. (2020) · Pattern Recognition · doi:10.1016/j.patcog.2020.107594 · Cited by 40 · see citing works
Mitigating Label Noise in GANs via Enhanced Spectral Normalization
Chen, Y., Jin, C., Li, G., Li, T. H., & Gao, W. (2023) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2023.3235410 · Cited by 39 · see citing works
Training GANs with Stronger Augmentations via Contrastive DiscriminatorPreprint
Jeong, J., & Shin, J. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2103.09742 · Cited by 39 · see citing works
Data-Efficient Instance Generation from Instance DiscriminationPreprint
Yang, C., Shen, Y., Xu, Y., & Zhou, B. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.04566 · Cited by 43 · see citing works
An effective data enhancement method of deep learning for small weld data defect identification
Yang, W., Xiao, Y., Shen, H., & Wang, Z. (2022) · Measurement · doi:10.1016/j.measurement.2022.112245 · Cited by 36 · see citing works
Lu, Y., Lin, Y., Wu, H., Xian, X., Shi, Y., & Lin, L. (2024) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2024.3387125 · Cited by 36 · see citing works
Improved Contrastive Divergence Training of Energy Based Models
Du, Y., Li, S., Tenenbaum, J., & Mordatch, I. (2020) · arXiv · doi:10.48550/arxiv.2012.01316 · Cited by 36 · see citing works
Self-Supervised GANs With Similarity Loss for Remote Sensing Image Scene Classification
Guo, D., Xia, Y. J., & Luo, X. (2021) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2021.3056883 · Cited by 36 · see citing works
Sock, J., Garcia-Hernando, G., Armagan, A., & Kim, T. (2020) · International Conference on 3D Vision (3DV) · doi:10.1109/3dv50981.2020.00039 · Cited by 34 · see citing works
A Style-aware Discriminator for Controllable Image Translation
Kim, K. H., Park, S., Jeon, E., Kim, T., & Kim, D. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01770 · Cited by 33 · see citing works
Decode-MOT: How Can We Hurdle Frames to Go Beyond Tracking-by-Detection?
Lee, S.-H., Park, D.-H., & Bae, S. (2023) · IEEE Transactions on Image Processing · doi:10.1109/tip.2023.3298538 · Cited by 33 · see citing works
Data Enhancement for Plant Disease Classification Using Generated Lesions
Sun, R., Zhang, M., Yang, K., & Liu, J. (2020) · Applied Sciences · doi:10.3390/app10020466 · Cited by 34 · see citing works
Noise Robust Generative Adversarial Networks
Kaneko, T., & Harada, T. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00843 · Cited by 30 · see citing works
Self-Supervised Visual Learning by Variable Playback Speeds Prediction of a Video
Cho, H., Kim, T., Chang, H. J., & Hwang, W. (2021) · IEEE Access · doi:10.1109/access.2021.3084840 · Cited by 52 · see citing works
Simple Yet Effective Way for Improving the Performance of GAN
Yeo, Y.-J., Shin, Y.-G., Park, S., & Ko, S.-J. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.3045000 · Cited by 28 · see citing works
DeltaGAN: Towards Diverse Few-Shot Image Generation with Sample-Specific Delta
Hong, Y., Niu, L., Zhang, J., & Zhang, L. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-19787-1_15 · Cited by 28 · see citing works
Self-Supervised CycleGAN for Object-Preserving Image-to-Image Domain Adaptation
Xie, X., Chen, J., Li, Y., Shen, L., Ma, K., & Zheng, Y. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58565-5_30 · Cited by 27 · see citing works
Huang, J., Ding, W., Lv, J., Yang, J., Dong, H., Ser, J. D., Xia, J., Ren, T., Wong, S. T. C., & Yang, G. (2022) · Applied Intelligence · doi:10.1007/s10489-021-03092-w · Cited by 27 · see citing works
Self-Supervised Dense Consistency Regularization for Image-to-Image Translation
Ko, M., Cha, E., Suh, S., Lee, H., Han, J., Shin, J., & Han, B. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01776 · Cited by 27 · see citing works
Closing the Gap Between Theory and Practice During Alternating Optimization for GANs
Chen, Y., Sun, S., Li, G., Gao, W., & Li, T. H. (2023) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2023.3274221 · Cited by 27 · see citing works
Sarkar, K., Bag, S., & Tripathi, P. C. (2024) · Neurocomputing · doi:10.1016/j.neucom.2024.127473 · Cited by 26 · see citing works
Self-supervised intermittent fault detection for analog circuits guided by prior knowledge
Fang, X., Qu, J., & Chai, Y. (2023) · Reliability Engineering & System Safety · doi:10.1016/j.ress.2023.109108 · Cited by 26 · see citing works
Inducing Optimal Attribute Representations for Conditional GANs
Bhattarai, B., & Kim, T. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58571-6_5 · Cited by 25 · see citing works
Song, Q., Yao, W., Tian, H., Guo, Y., Muniyandi, R. C., & An, Y. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.122406 · Cited by 25 · see citing works
Can Semantic Labels Assist Self-Supervised Visual Representation Learning?
Wei, L., Xie, L., He, J., Zhang, X., & Tian, Q. C. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i3.20166 · Cited by 26 · see citing works
Image Enhanced Rotation Prediction for Self-Supervised Learning
Yamaguchi, S., Kanai, S., Shioda, T., & Takeda, S. (2021) · Proceedings - International Conference on Image Processing · doi:10.1109/icip42928.2021.9506132 · Cited by 25 · see citing works
Data-Efficient GAN Training Beyond (Just) Augmentations: A Lottery Ticket PerspectivePreprint
Chen, T., Cheng, Y., Gan, Z., Liu, J., & Wang, Z. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2103.00397 · Cited by 29 · see citing works
Self-citationHu, V. T., Zhang, D. W., Asano, Y. M., Burghouts, G., & Snoek, C. G. M. (2022) · Computer Vision and Pattern Recognition · doi:10.1109/cvpr52729.2023.01766 · Cited by 56 · see citing works
Generative Adversarial Networks
Cohen, G., & Giryes, R. (2023) · Springer eBooks · doi:10.1007/978-3-031-24628-9_17 · Cited by 33 · see citing works
- Authors
- Chen, T., Zhai, X., Ritter, M., Lucic, M., & Houlsby, N.
- Affiliations
- University of California, Los Angeles (US)
- Google (United States) (US)
- Google Brain
- Venue
- 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
- Publisher
- IEEE
- Published
- 2019-06
- Pages
- 12146-12155
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W2953327099
- Cited by
- 328
- References
- 55
- Citations by year
- 2026: 7 · 2025: 15 · 2024: 34 · 2023: 43 · 2022: 66 · 2021: 84 · 2020: 65 · 2019: 14
- FWCI
- 18.45
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Generative Adversarial Networks and Image Synthesis
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Digital Media Forensic Detection
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Keywords
- conditional generative adversarial networks, representation learning, adversarial training, unconditional image generation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review