CoChat
Sign Up
PreprintCited by 18Digital Media Forensic DetectionAdversarial Robustness in Machine LearningGenerative Adversarial Networks and Image Synthesis

The DOI matches its DataCite record; 1 of the 1 references it cites were found in a registry or an index.

Exposing the Fake: Effective Diffusion-Generated Images Detection

Open access
Ma, Ruipeng, Duan, Jinhao, Kong, Fei, Shi, Xiaoshuang, Xu, Kaidi·2023·arXiv
DOI 10.48550/arxiv.2307.06272arXiv 2307.06272
Open this paper in CoChat — free accountOpen PDF

Abstract

Image synthesis has seen significant advancements with the advent of diffusion-based generative models like Denoising Diffusion Probabilistic Models (DDPM) and text-to-image diffusion models. Despite their efficacy, there is a dearth of research dedicated to detecting diffusion-generated images, which could pose potential security and privacy risks. This paper addresses this gap by proposing a novel detection method called Stepwise Error for Diffusion-generated Image Detection (SeDID). Comprising statistical-based $\text{SeDID}_{\text{Stat}}$ and neural network-based $\text{SeDID}_{\text{NNs}}$, SeDID exploits the unique attributes of diffusion models, namely deterministic reverse and deterministic denoising computation errors. Our evaluations demonstrate SeDID's superior performance over existing methods when applied to diffusion models. Thus, our work makes a pivotal contribution to distinguishing diffusion model-generated images, marking a significant step in the domain of artificial intelligence security.

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.2307.06272

Cites

0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

The publisher hasn’t deposited this paper’s reference list.

Research works printed but not linked: 39

  1. C. A. Choquette-Choo, F. Tramer, N. Carlini, and N. Pa- pernot. Label-only membership inference attacks. In International Conference on Machine Learning, pages 1964-1974, 2021.
  2. R. Corvi, D. Cozzolino, G. Zingarini, G. Poggi, K. Nagano, and L. Verdoliva. On the detection of synthetic im- ages generated by diffusion models. arXiv preprint arXiv:2211.00680, 2022. · arXiv
  3. R. Corvi, D. Cozzolino, G. Zingarini, G. Poggi, K. Nagano, and L. Verdoliva. On the detection of synthetic images generated by diffusion models. In International Confer- ence on Acoustics, Speech and Signal Processing, pages 1-5, 2023.
  4. P. Dhariwal and A. Nichol. Diffusion models beat gans on image synthesis. In Advances in Neural Information Processing Systems, volume 34, pages 8780-8794, 2021.
  5. T. Dockhorn, A. Vahdat, and K. Kreis. Score-based genera- tive modeling with critically-damped langevin diffusion. arXiv preprint arXiv:2112.07068, 2021. · arXiv
  6. J. Duan, F. Kong, S. Wang, X. Shi, and K. Xu. Are diffu- sion models vulnerable to membership inference attacks? arXiv preprint arXiv:2302.01316, 2023. · arXiv
  7. I. Goodfellow, J. Pouget-Abadie, M. Mirza, B. Xu, D. Warde-Farley, S. Ozair, A. Courville, and Y. Ben- gio. Generative adversarial networks. Communications of the ACM, 63(11):139-144, 2020.
  8. J. Ho and T. Salimans. Classifier-free diffusion guidance. arXiv preprint arXiv:2207.12598, 2022. · arXiv
  9. J. Ho, A. Jain, and P. Abbeel. Denoising diffusion prob- abilistic models. In Advances in Neural Information Processing Systems, volume 33, pages 6840-6851, 2020.
  10. B. Hui, Y. Yang, H. Yuan, P. Burlina, N. Z. Gong, and Y. Cao. Practical blind membership inference attack via differ- ential comparisons. arXiv preprint arXiv:2101.01341, 2021. · arXiv
  11. F. Kong, J. Duan, R. Ma, H. Shen, X. Zhu, X. Shi, and K. Xu. An efficient membership inference attack for the diffusion model by proximal initialization. arXiv preprint arXiv:2305.18355, 2023. · arXiv
  12. Z. Kong, W. Ping, J. Huang, K. Zhao, and B. Catanzaro. Diffwave: A versatile diffusion model for audio synthesis. arXiv preprint arXiv:2009.09761, 2020. · arXiv
  13. L. Liu, Y. Ren, Z. Lin, and Z. Zhao. Pseudo numerical meth- ods for diffusion models on manifolds. arXiv preprint arXiv:2202.09778, 2022. · arXiv
  14. Z. Liu, P. Luo, X. Wang, and X. Tang. Deep learning face attributes in the wild. In International Conference on Computer Vision, December 2015.
  15. T. Matsumoto, T. Miura, and N. Yanai. Membership in- ference attacks against diffusion models. arXiv preprint arXiv:2302.03262, 2023. · arXiv
  16. C. Meng, Y. He, Y. Song, J. Song, J. Wu, J.-Y. Zhu, and S. Ermon. Sdedit: Guided image synthesis and editing with stochastic differential equations. In International Conference on Learning Representations, 2021.
  17. M. Nasr, R. Shokri, and A. Houmansadr. Comprehensive privacy analysis of deep learning: Passive and active white-box inference attacks against centralized and fed- erated learning. In IEEE Symposium on Security and Privacy, pages 739-753, 2019.
  18. A. Pyrgelis, C. Troncoso, and E. De Cristofaro. Knock knock, who's there? membership inference on aggregate location data. arXiv preprint arXiv:1708.06145, 2017. · arXiv
  19. A. Ramesh, P. Dhariwal, A. Nichol, C. Chu, and M. Chen. Hierarchical text-conditional image generation with clip latents. arXiv preprint arXiv:2204.06125, 2022. · arXiv
  20. S. Rezaei and X. Liu. On the difficulty of membership inference attacks. In IEEE Conference on Computer Vision and Pattern Recognition, pages 7892-7900, 2021.
  21. J. Ricker, S. Damm, T. Holz, and A. Fischer. Towards the detection of diffusion model deepfakes. arXiv preprint arXiv:2210.14571, 2022. · arXiv
  22. R. Rombach, A. Blattmann, D. Lorenz, P. Esser, and B. Om- mer. High-resolution image synthesis with latent diffu- sion models. In IEEE Conference on Computer Vision and Pattern Recognition, pages 10684-10695, 2022.
  23. A. Sablayrolles, M. Douze, C. Schmid, Y. Ollivier, and H. Jégou. White-box vs black-box: Bayes optimal strate- gies for membership inference. In International Confer- ence on Machine Learning, pages 5558-5567, 2019.
  24. C. Saharia, W. Chan, S. Saxena, L. Li, J. Whang, E. L. Den- ton, K. Ghasemipour, R. Gontijo Lopes, B. Karagol Ayan, T. Salimans, et al. Photorealistic text-to-image diffusion models with deep language understanding. In Advances in Neural Information Processing Systems, volume 35, pages 36479-36494, 2022.
  25. A. Salem, Y. Zhang, M. Humbert, P. Berrang, M. Fritz, and M. Backes. Ml-leaks: Model and data independent membership inference attacks and defenses on machine learning models. arXiv preprint arXiv:1806.01246, 2018. · arXiv
  26. T. Salimans and J. Ho. Progressive distillation for fast sampling of diffusion models. arXiv preprint arXiv:2202.00512, 2022. · arXiv
  27. R. Shokri, M. Stronati, C. Song, and V. Shmatikov. Member- ship inference attacks against machine learning models. In IEEE Symposium on Security and Privacy, pages 3-18, 2017.
  28. J. Sohl-Dickstein, E. Weiss, N. Maheswaranathan, and S. Ganguli. Deep unsupervised learning using nonequi- librium thermodynamics. In International Conference on Machine Learning, pages 2256-2265, 2015.
  29. J. Song, C. Meng, and S. Ermon. Denoising diffusion im- plicit models. arXiv preprint arXiv:2010.02502, 2020a. · arXiv
  30. L. Song and P. Mittal. Systematic evaluation of privacy risks of machine learning models. In USENIX Security Symposium, volume 1, page 4, 2021.
  31. Y. Song and S. Ermon. Generative modeling by estimating gradients of the data distribution. In Advances in Neural Information Processing Systems, volume 32, 2019.
  32. A. Tavanaei. Embedded encoder-decoder in convolu- tional networks towards explainable ai. arXiv preprint arXiv:2007.06712, 2020. · arXiv
  33. S. Truex, L. Liu, M. E. Gursoy, L. Yu, and W. Wei. Demys- tifying membership inference attacks in machine learning as a service. IEEE Transactions on Services Computing, 14(6):2073-2089, 2019.
  34. Z. Wang, J. Bao, W. Zhou, W. Wang, H. Hu, H. Chen, and H. Li. Dire for diffusion-generated image detection. arXiv preprint arXiv:2303.09295, 2023. · arXiv
  35. D. Watson, W. Chan, J. Ho, and M. Norouzi. Learning fast samplers for diffusion models by differentiating through sample quality. In International Conference on Learning Representations, 2022.
  36. Z. Xiao, K. Kreis, and A. Vahdat. Tackling the generative learning trilemma with denoising diffusion gans. arXiv preprint arXiv:2112.07804, 2021. · arXiv
  37. S. Yeom, I. Giacomelli, M. Fredrikson, and S. Jha. Pri- vacy risk in machine learning: Analyzing the connection to overfitting. In IEEE Computer Security Foundations Symposium, pages 268-282, 2018.
  38. C. Yuan, T. Marion, and M. Moghaddam. Dde-gan: Inte- grating a data-driven design evaluator into generative ad- versarial networks for desirable and diverse concept gen- eration. Journal of Mechanical Design, 145(4):041407, 2023.
  39. Z. Zhao, J. Duan, X. Hu, K. Xu, C. Wang, R. Zhang, Z. Du, Q. Guo, and Y. Chen. Unlearnable examples for diffu- sion models: Protect data from unauthorized exploitation. arXiv preprint arXiv:2306.01902, 2023. · arXiv

Cited by

Sorted by citations

Related

Metadata

Authors
Ma, R., Duan, J., Kong, F., Shi, X., & Xu, K.
Affiliations
  • University of Electronic Science and Technology of China (CN)
  • Drexel University (US)
ORCID
Venue
arXiv
Publisher
arXiv
Published
2023
ISSN
2331-8422 (ISSN-L)
DOI
10.48550/arxiv.2307.06272
arXiv
2307.06272
OpenAlex
W4384268537
Cited by
16
References
0
Citations by year
2026: 1 · 2025: 9 · 2024: 6
Type
posted content
Language
en
Open access
Licence
arxiv.org/licenses/nonexclusive-distrib/1.0/
Locations
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
Topics
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Digital Media Forensic Detection
  • Physical Sciences › Computer Science › Artificial Intelligence › Adversarial Robustness in Machine Learning
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Generative Adversarial Networks and Image Synthesis
Keywords
fake image detection, diffusion models, text-to-image generation, AI security

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review