CoChat
Sign Up
PreprintCited by 38Digital Media Forensic DetectionGenerative Adversarial Networks and Image SynthesisAdversarial Robustness in Machine Learning

T-GD: Transferable GAN-generated Images Detection Framework

Open access
Jeon, Hyeonseong, Bang, Youngoh, Kim, Junyaup, Woo, Simon S.·2020·arXiv
DOI 10.48550/arxiv.2008.04115arXiv 2008.04115
Open this paper in CoChat — free accountOpen PDF

Abstract

Recent advancements in Generative Adversarial Networks (GANs) enable the generation of highly realistic images, raising concerns about their misuse for malicious purposes. Detecting these GAN-generated images (GAN-images) becomes increasingly challenging due to the significant reduction of underlying artifacts and specific patterns. The absence of such traces can hinder detection algorithms from identifying GAN-images and transferring knowledge to identify other types of GAN-images as well. In this work, we present the Transferable GAN-images Detection framework T-GD, a robust transferable framework for an effective detection of GAN-images. T-GD is composed of a teacher and a student model that can iteratively teach and evaluate each other to improve the detection performance. First, we train the teacher model on the source dataset and use it as a starting point for learning the target dataset. To train the student model, we inject noise by mixing up the source and target datasets, while constraining the weight variation to preserve the starting point. Our approach is a self-training method, but distinguishes itself from prior approaches by focusing on improving the transferability of GAN-image detection. T-GD achieves high performance on the source dataset by overcoming catastrophic forgetting and effectively detecting state-of-the-art GAN-images with only a small volume of data without any metadata information.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.2008.04115

Cites

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

No references could be resolved yet.

Research works printed but not linked: 36

  1. Choi, Y., Uh, Y., Yoo, J., and Ha, J.-W. Stargan v2: Diverse image synthesis for multiple domains. arXiv preprint arXiv:1912.01865 , 2019. · arXiv
  2. Chollet, F. Xception: Deep learning with depthwise separable convolutions. In Proceedings of the IEEE conference on computer vision and pattern recognition , pp. 12511258, 2017.
  3. Cozzolino, D., Thies, J., R¨ ossler, A., Riess, C., Nießner, M., and Verdoliva, L. Forensictransfer: Weakly-supervised domain adaptation for forgery detection. arXiv preprint arXiv:1812.02510 , 2018. · arXiv
  4. Huang, G., Sun, Y., Liu, Z., Sedra, D., and Weinberger, K. Q. Deep networks with stochastic depth. In European conference on computer vision , pp. 646-661. Springer, 2016.
  5. Ioffe, S. and Szegedy, C. Batch normalization: Accelerating deep network training by reducing internal covariate shift. arXiv preprint arXiv:1502.03167 , 2015. · arXiv
  6. Jeon, H., Bang, Y., and Woo, S. S. Faketalkerdetect: Effective and practical realistic neural talking head detection with a highly unbalanced dataset. In Proceedings of the IEEE International Conference on Computer Vision Workshops , pp. 0-0, 2019.
  7. Jeon, H., Bang, Y., and Woo, S. S. Fdftnet: Facing off fake images using fake detection fine-tuning network. arXiv preprint arXiv:2001.01265 , 2020. · arXiv
  8. Karras, T., Aila, T., Laine, S., and Lehtinen, J. Progressive growing of gans for improved quality, stability, and variation. arXiv preprint arXiv:1710.10196 , 2017. · arXiv
  9. Li, H., Chaudhari, P., Yang, H., Lam, M., Ravichandran, A., Bhotika, R., and Soatto, S. Rethinking the hyperparameters for fine-tuning. arXiv preprint arXiv:2002.11770 , 2020. · arXiv
  10. Li, X., Grandvalet, Y., and Davoine, F. Explicit inductive bias for transfer learning with convolutional networks. arXiv preprint arXiv:1802.01483 , 2018. · arXiv
  11. Li, X., Xiong, H., Wang, H., Rao, Y., Liu, L., and Huan, J. Delta: Deep learning transfer using feature map with attention for convolutional networks. arXiv preprint arXiv:1901.09229 , 2019. · arXiv
  12. Marra, F., Gragnaniello, D., Verdoliva, L., and Poggi, G. Do gans leave artificial fingerprints? In 2019 IEEE Conference on Multimedia Information Processing and Retrieval (MIPR) , pp. 506-511. IEEE, 2019a.
  13. Marra, F., Saltori, C., Boato, G., and Verdoliva, L. Incremental learning for the detection and classification of gan-generated images. arXiv preprint arXiv:1910.01568 , 2019b. · arXiv
  14. Nataraj, L., Mohammed, T. M., Manjunath, B., Chandrasekaran, S., Flenner, A., Bappy, J. H., and RoyChowdhury, A. K. Detecting gan generated fake images using co-occurrence matrices. Electronic Imaging , 2019 (5):532-1, 2019.
  15. Qiao, S., Wang, H., Liu, C., Shen, W., and Yuille, A. Weight standardization. arXiv preprint arXiv:1903.10520 , 2019. · arXiv
  16. RoyChowdhury, A., Chakrabarty, P., Singh, A., Jin, S., Jiang, H., Cao, L., and Learned-Miller, E. Automatic adaptation of object detectors to new domains using selftraining. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition , pp. 780-790, 2019.
  17. Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., Berg, A. C., and Fei-Fei, L. ImageNet Large Scale Visual Recognition Challenge. International Journal of Computer Vision (IJCV) , 115(3):211-252, 2015. doi: 10.1007/s11263-015-0816-y. · DOI · Paper page
  18. Shaham, T. R., Dekel, T., and Michaeli, T. Singan: Learning a generative model from a single natural image. In Proceedings of the IEEE International Conference on Computer Vision , pp. 4570-4580, 2019.
  19. Srivastava, N., Hinton, G., Krizhevsky, A., Sutskever, I., and Salakhutdinov, R. Dropout: a simple way to prevent neural networks from overfitting. The journal of machine learning research , 15(1):1929-1958, 2014.
  20. Szegedy, C., Ioffe, S., Vanhoucke, V., and Alemi, A. A. Inception-v4, inception-resnet and the impact of residual connections on learning. In Thirty-first AAAI conference on artificial intelligence , 2017.
  21. Tan, M. and Le, Q. V. Efficientnet: Rethinking model scaling for convolutional neural networks. arXiv preprint arXiv:1905.11946 , 2019. · arXiv
  22. Tariq, S., Lee, S., Kim, H., Shin, Y ., and Woo, S. S. Detecting both machine and human created fake face images in the wild. In Proceedings of the 2nd international workshop on multimedia privacy and security , pp. 81-87, 2018.
  23. Tariq, S., Lee, S., Kim, H., Shin, Y., and Woo, S. S. Gan is a friend or foe? a framework to detect various fake face images. In Proceedings of the 34th ACM/SIGAPP Symposium on Applied Computing , pp. 1296-1303, 2019.
  24. Wang, S.-Y., Wang, O., Zhang, R., Owens, A., and Efros, A. A. Cnn-generated images are surprisingly easy to spot... for now. arXiv preprint arXiv:1912.11035 , 2019. · arXiv
  25. Wu, Y. and He, K. Group normalization. In Proceedings of the European Conference on Computer Vision (ECCV) , pp. 3-19, 2018.
  26. Xie, Q., Hovy, E., Luong, M.-T., and Le, Q. V. Selftraining with noisy student improves imagenet classification. arXiv preprint arXiv:1911.04252 , 2019. · arXiv
  27. Xie, S., Girshick, R., Doll´ ar, P., Tu, Z., and He, K. Aggregated residual transformations for deep neural networks. In Proceedings of the IEEE conference on computer vision and pattern recognition , pp. 1492-1500, 2017.
  28. Xuan, X., Peng, B., Wang, W., and Dong, J. On the generalization of gan image forensics. In Chinese Conference on Biometric Recognition , pp. 134-141. Springer, 2019.
  29. Yalniz, I. Z., J´ egou, H., Chen, K., Paluri, M., and Mahajan, D. Billion-scale semi-supervised learning for image classification. arXiv preprint arXiv:1905.00546 , 2019. · arXiv
  30. Yim, J., Joo, D., Bae, J., and Kim, J. A gift from knowledge distillation: Fast optimization, network minimization and transfer learning. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition , pp. 41334141, 2017.
  31. Yu, N., Davis, L. S., and Fritz, M. Attributing fake images to gans: Learning and analyzing gan fingerprints. In Proceedings of the IEEE International Conference on Computer Vision , pp. 7556-7566, 2019.
  32. Yun, S., Han, D., Oh, S. J., Chun, S., Choe, J., and Yoo, Y. Cutmix: Regularization strategy to train strong classifiers with localizable features. In Proceedings of the IEEE International Conference on Computer Vision , pp. 60236032, 2019.
  33. Zakharov, E., Shysheya, A., Burkov, E., and Lempitsky, V. Few-shot adversarial learning of realistic neural talking head models. In Proceedings of the IEEE International Conference on Computer Vision , pp. 9459-9468, 2019.
  34. Zamir, A. R., Sax, A., Shen, W., Guibas, L. J., Malik, J., and Savarese, S. Taskonomy: Disentangling task transfer learning. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition , pp. 37123722, 2018.
  35. Zenke, F., Poole, B., and Ganguli, S. Continual learning through synaptic intelligence. Proceedings of machine learning research , 70:3987, 2017.
  36. Zhang, X., Karaman, S., and Chang, S.-F. Detecting and simulating artifacts in gan fake images. arXiv preprint arXiv:1907.06515 , 2019. · arXiv

Cited by

Sorted by citations

Authors
Jeon, H., Bang, Y., Kim, J., & Woo, S. S.
Affiliations
Sungkyunkwan University (KR)
ORCID
Venue
arXiv
Publisher
arXiv
Published
2020
Volume
1
Pages
4746-4761
ISSN
2331-8422 (ISSN-L)
DOI
10.48550/arxiv.2008.04115
arXiv
2008.04115
OpenAlex
W3034547531
Cited by
38
References
0
Citations by year
2026: 1 · 2025: 6 · 2024: 12 · 2023: 5 · 2022: 7 · 2021: 7
Type
posted content
Language
en
Open access
Licence
arxiv.org/licenses/nonexclusive-distrib/1.0/
Locations
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
  • International Conference on Machine Learning
Funders
  • Sungkyunkwan University (2019-0-00421)
  • National IT Industry Promotion Agency
  • National Research Foundation of Korea (2020R1C1C1006004, 2019-0-00421, 2017R1C1B5076474)
  • Ministry of Science and ICT, South Korea (2019-0-00421, 2019-0-01343)
  • Institute for Information and Communications Technology Promotion (2019-0-01343, 2019‐0‐00421)
Topics
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Digital Media Forensic Detection
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Generative Adversarial Networks and Image Synthesis
  • Physical Sciences › Computer Science › Artificial Intelligence › Adversarial Robustness in Machine Learning
Keywords
GAN-generated image detection, generative adversarial networks, knowledge distillation, teacher-student models, catastrophic forgetting, domain adaptation, self-training, transfer learning, synthetic image detection, noise injection

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review