CoChat
Sign Up
PreprintCited by 8

The DOI matches its DataCite record; 1 of the 1 references it cites were found in a registry or an index.

Fourier Spectrum Discrepancies in Deep Network Generated Images

Dzanic, Tarik, Shah, Karan, Witherden, Freddie·2019·arXiv
DOI 10.48550/arxiv.1911.06465arXiv 1911.06465
Open this paper in CoChat — free account

Abstract

Advancements in deep generative models such as generative adversarial networks and variational autoencoders have resulted in the ability to generate realistic images that are visually indistinguishable from real images, which raises concerns about their potential malicious usage. In this paper, we present an analysis of the high-frequency Fourier modes of real and deep network generated images and show that deep network generated images share an observable, systematic shortcoming in replicating the attributes of these high-frequency modes. Using this, we propose a detection method based on the frequency spectrum of the images which is able to achieve an accuracy of up to 99.2% in classifying real and deep network generated images from various GAN and VAE architectures on a dataset of 5000 images with as few as 8 training examples. Furthermore, we show the impact of image transformations such as compression, cropping, and resolution reduction on the classification accuracy and suggest a method for modifying the high-frequency attributes of deep network generated images to mimic real images.

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.1911.06465

Cites

1 of 1 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 1 references

Research works printed but not linked: 22

  1. Tero Karras, Samuli Laine, Miika Aittala, Janne Hellsten, Jaakko Lehtinen, and Timo Aila. "Analyzing and Improving the Image Quality of StyleGAN". In: Proceedings of the 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). IEEE, June 2020.
  2. Tero Karras, Timo Aila, Samuli Laine, and Jaakko Lehtinen. "Progressive Growing of GANs for Improved Quality, Stability, and Variation". In: International Conference on Learning Representations. 2018.
  3. Ali Razavi, Aaron van den Oord, and Oriol Vinyals. "Generating Diverse High-Fidelity Images With VQ-VAE-2". In: Advances in Neural Information Processing Systems. 2019, pp. 14866- 14876.
  4. Stanislav Pidhorskyi, Donald A. Adjeroh, and Gianfranco Doretto. "Adversarial Latent Au- toencoders". In: Proceedings of the 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). IEEE, June 2020.
  5. Paweł Korus. "Digital Image Integrity -A Survey of Protection and Verification Techniques". In: Digital Signal Processing 71 (Dec. 2017), pp. 1-26.
  6. Javier Galbally, Sebastien Marcel, and Julian Fierrez. "Biometric Antispoofing Methods: A Survey in Face Recognition". In: IEEE Access 2 (2014), pp. 1530-1552.
  7. Alessandro Piva. "An Overview on Image Forensics". In: ISRN Signal Processing 2013 (2013), pp. 1-22.
  8. Zinelabidine Boulkenafet, Jukka Komulainen, and Abdenour Hadid. "Face Spoofing Detection Using Colour Texture Analysis". In: IEEE Transactions on Information Forensics and Security 11.8 (Aug. 2016), pp. 1818-1830.
  9. Francesco Marra, Diego Gragnaniello, Luisa Verdoliva, and Giovanni Poggi. "Do GANs Leave Artificial Fingerprints?" In: 2019 IEEE Conference on Multimedia Information Processing and Retrieval (MIPR). IEEE, Mar. 2019.
  10. Xinsheng Xuan, Bo Peng, Wei Wang, and Jing Dong. "On the Generalization of GAN Image Forensics". In: Biometric Recognition. Springer International Publishing, 2019, pp. 134-141.
  11. Sheng-Yu Wang, Oliver Wang, Richard Zhang, Andrew Owens, and Alexei A. Efros. "CNN- Generated Images Are Surprisingly Easy to Spot. . . for Now". In: Proceedings of the 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). IEEE, June 2020.
  12. Ian J. Goodfellow, Jean Pouget-Abadie, Mehdi Mirza, Bing Xu, David Warde-Farley, Sherjil Ozair, Aaron Courville, and Yoshua Bengio. "Generative Adversarial Nets". In: Proceedings of the 27th International Conference on Neural Information Processing Systems -Volume 2. 2014, pp. 2672-2680.
  13. Diederik P. Kingma and Max Welling. Auto-Encoding Variational Bayes. 2013. arXiv: 1312. 6114 [cs.ML].
  14. A. van der Schaaf and J.H. van Hateren. "Modelling the Power Spectra of Natural Images: Statistics and Information". In: Vision Research 36.17 (Sept. 1996), pp. 2759-2770.
  15. Michael Parker. "Image and Video Compression Fundamentals". In: Digital Signal Processing 101 (Second Edition). 2017. Chap. 25, pp. 329-346.
  16. David Salomon and Giovanni Motta. Handbook of Data Compression. Springer London, 2010.
  17. Weiwei Zhang, Jian Sun, and Xiaoou Tang. "Cat Head Detection -How to Effectively Ex- ploit Shape and Texture Features". In: Lecture Notes in Computer Science. Springer Berlin Heidelberg, 2008, pp. 802-816.
  18. Vincent Dumoulin, Ishmael Belghazi, Ben Poole, Olivier Mastropietro, Alex Lamb, Martin Arjovsky, and Aaron Courville. Adversarially Learned Inference. 2016. arXiv: 1606.00704 [cs.LG]. · arXiv
  19. Wenzhe Shi, Jose Caballero, Lucas Theis, Ferenc Huszar, Andrew Aitken, Christian Ledig, and Zehan Wang. Is The Deconvolution Layer The Same As A Convolutional Layer? 2016. arXiv: 1609.07009 [cs.CV]. · arXiv
  20. Anders Boesen Lindbo Larsen, Søren Kaae Sønderby, Hugo Larochelle, and Ole Winther. "Autoencoding Beyond Pixels Using a Learned Similarity Metric". In: Proceedings of the 33rd International Conference on Machine Learning -Volume 48. ICML. 2016, pp. 1558-1566.
  21. Ricard Durall, Margret Keuper, and Janis Keuper. "Watch Your Up-Convolution: CNN Based Generative Deep Neural Networks Are Failing to Reproduce Spectral Distributions". In: Proceedings of the 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). IEEE, June 2020.
  22. Mahyar Khayatkhoei and Ahmed Elgammal. Spatial Frequency Bias in Convolutional Genera- tive Adversarial Networks. 2020. arXiv: 2010.01473 [cs.LG]. · arXiv

Cited by

Sorted by citations

Metadata

Authors
Dzanic, T., Shah, K., & Witherden, F.
Venue
arXiv
Publisher
arXiv
Published
2019
DOI
10.48550/arxiv.1911.06465
arXiv
1911.06465
References
1
Type
Preprint
Licence
arxiv.org/licenses/nonexclusive-distrib/1.0/

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review