CoChat

Robust Deepfake Detection by Addressing Generalization and Trustworthiness Challenges: A Short Survey

Liu, Ping, Tao, Qiqi, Zhou, Joey · 2024 · Proceedings of the 1st ACM Multimedia Workshop on Multi-modal Misinformation Governance in the Era of Foundation Models

The DOI matches its Crossref record; 70 of the 70 references it cites were found in a registry or an index.

Abstract

The rapid advancement of deep learning technologies has led to a proliferation of deepfake content, posing serious threats to security, privacy, and trust in digital information. This paper explores the evolution of robust deepfake detection methods over recent years from two perspectives, specifically, generalized and trustworthy detection. As numerous generative techniques continuously emerge, generalized detection emphasizes the robustness against data distribution shift represented by unseen manipulation at testing time. By systematically reviewing generalized detection methods, we categorize these approaches into input-level, model-level, and learning-level. Trustworthy detection aims to enhance robustness against attacks that maliciously fail the detection system, including adversarial and backdoor attacks. To address these threats, researchers have developed robust defense strategies, including adversarial feature similarity learning and ensemble methods. By providing an overview of robust detection methods, attack techniques, and defense strategies, this paper highlights the challenges and advancements in creating reliable and generalizable deepfake detection systems.

Overview

Integrity signals

Registry

Crossref · 10.1145/3689090.3689386

Cites

70 of 70 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Citations

Cites

Show all 70 references

Research works printed but not linked: 35

  1. Sifat Muhammad Abdullah, Aravind Cheruvu, Shravya Kanchi, Taejoong Chung, Peng Gao, Murtuza Jadliwala, and Bimal Viswanath. 2024. An Analysis of Recent Advances in Deepfake Image Detection in an Evolving Threat Landscape. arXiv preprint arXiv:2404.16212 (2024). · arXiv
  2. Zhongjie Ba Qingyu Liu Zhenguang Liu Shuang Wu Feng Lin Li Lu and Kui Ren. 2024. Exposing the Deception: Uncovering More Forgery Clues for Deepfake Detection. In AAAI.
  3. Zhaoyu Chen, Bo Li, Kaixun Jiang, Shuang Wu, Shouhong Ding, and Wenqiang Zhang. 2023. Exploring Decision-based Black-box Attacks on Face Forgery Detection. arXiv preprint arXiv:2310.12017 (2023). · arXiv
  4. Xiaoyi Dong, Jianmin Bao, Dongdong Chen, Ting Zhang, Weiming Zhang, Neng- hai Yu, Dong Chen, Fang Wen, and Baining Guo. 2022. Protecting celebrities from deepfake with identity consistency transformer. In CVPR.
  5. Alexey Dosovitskiy Lucas Beyer Alexander Kolesnikov Dirk Weissenborn Xiaohua Zhai Thomas Unterthiner Mostafa Dehghani Matthias Minderer Georg Heigold Sylvain Gelly et al. 2021. An image is worth 16x16 words: Transformers for image recognition at scale. In ICLR.
  6. Xiaoxuan Han, Songlin Yang, Wei Wang, Ziwen He, and Jing Dong. 2023. Is It Possible to Backdoor Face Forgery Detection with Natural Triggers? arXiv preprint arXiv:2401.00414 (2023). · arXiv
  7. Ahmed Abul Hasanaath, Hamzah Luqman, Raed Katib, and Saeed Anwar. 2024. FSBI: Deepfakes Detection with Frequency Enhanced Self-Blended Images. arXiv preprint arXiv:2406.08625v1 (2024). · arXiv
  8. Ziwen He Wei Wang Weinan Guan Jing Dong and Tieniu Tan. 2022. Defeating DeepFakes via Adversarial Visual Reconstruction. In ACM MM.
  9. Yihao Huang, Felix Juefei-Xu, Qing Guo, Xiaofei Xie, Lei Ma, Weikai Miao, Yang Liu, and Geguang Pu. 2020. Fakeretouch: Evading deepfakes detection via the guidance of deliberate noise. arXiv preprint arXiv:2009.09213 (2020). · arXiv
  10. Yihao Huang, Felix Juefei-Xu, Run Wang, Qing Guo, Lei Ma, Xiaofei Xie, Jian- wen Li, Weikai Miao, Yang Liu, and Geguang Pu. 2020. Fakepolisher: Making deepfakes more detection-evasive by shallow reconstruction. In ACM MM.
  11. Chenqi Kong, Anwei Luo, Song Xia, Yi Yu, Haoliang Li, and Alex C Kot. 2024. MoE-FFD: Mixture of Experts for Generalized and Parameter-Efficient Face Forgery Detection. arXiv preprint arXiv:2404.08452 (2024). · arXiv
  12. Seokjun Lee Seung-Won Jung and Hyunseok Seo. 2024. Spectrum Translation for Refinement of Image Generation (STIG) Based on Contrastive Learning and Spectral Filter Profile. In AAAI.
  13. Dongze Li Wei Wang Hongxing Fan and Jing Dong. 2021. Exploring adversarial fake images on face manifold. In CVPR.
  14. Hanzhe Li, Jiaran Zhou, Bin Li, Junyu Dong, and Yuezun Li. 2024. FreqBlender: Enhancing DeepFake Detection by Blending Frequency Knowledge. arXiv preprint arXiv:2404.13872 (2024). · arXiv
  15. Yanjie Li Bin Xie Songtao Guo Yuanyuan Yang and Bin Xiao. 2024. A Survey of Robustness and Safety of 2D and 3D Deep Learning Models against Adversarial Attacks. ACM Comput. Surv. (2024).
  16. Yang Li, Songlin Yang, Wei Wang, Ziwen He, Bo Peng, and Jing Dong. 2024. Counterfactual Explanations for Face Forgery Detection via Adversarial Re- moval of Artifacts. arXiv preprint arXiv:2404.08341 (2024). · arXiv
  17. Jiawei Liang Siyuan Liang Aishan Liu Xiaojun Jia Junhao Kuang and Xiaochun Cao. 2024. Poisoned forgery face: Towards backdoor attacks on face forgery detection. In ICLR.
  18. Honggu Liu, Xiaodan Li, Wenbo Zhou, Yuefeng Chen, Yuan He, Hui Xue, Weim- ing Zhang, and Nenghai Yu. 2021. Spatial-phase shallow learning: rethinking face forgery detection in frequency domain. In CVPR.
  19. Jiatong Liu Mingcheng Zhang Jianpeng Ke and Lina Wang. 2024. AdvShadow: Evading DeepFake Detection via Adversarial Shadow Attack. In ICASSP.
  20. Zihan Liu, Hanyi Wang, Yaoyu Kang, and Shilin Wang. 2024. Mixture of Low- rank Experts for Transferable AI-Generated Image Detection. arXiv preprint arXiv:2404.04883 (2024). · arXiv
  21. Anwei Luo, Rizhao Cai, Chenqi Kong, Xiangui Kang, Jiwu Huang, and Alex C Kot. 2023. Forgery-aware adaptive vision transformer for face forgery detection. arXiv preprint arXiv:2309.11092 (2023). · arXiv
  22. Qingxuan Lv, Yuezun Li, Junyu Dong, Sheng Chen, Hui Yu, Huiyu Zhou, and Shu Zhang. 2023. DomainForensics: Exposing Face Forgery across Domains via Bi-directional Adaptation. arXiv preprint arXiv:2312.10680 (2023). · arXiv
  23. Huy H Nguyen, Junichi Yamagishi, and Isao Echizen. 2024. Exploring Self- Supervised Vision Transformers for Deepfake Detection: A Comparative Anal- ysis. arXiv preprint arXiv:2405.00355 (2024). · arXiv
  24. Maxime Oquab, Timothée Darcet, Théo Moutakanni, Huy Vo, Marc Szafraniec, Vasil Khalidov, Pierre Fernandez, Daniel Haziza, Francisco Massa, Alaaeldin El- Nouby, et al. 2023. Dinov2: Learning robust visual features without supervision. arXiv preprint arXiv:2304.07193 (2023). · arXiv
  25. Alvaro Lopez Pellicer, Yi Li, and Plamen Angelov. 2024. PUDD: Towards Robust Multi-modal Prototype-based Deepfake Detection. In CVPRW.
  26. Ben Pinhasov, Raz Lapid, Rony Ohayon, Moshe Sipper, and Yehudit Aperstein. 2024. XAI-Based Detection of Adversarial Attacks on Deepfake Detectors. arXiv preprint arXiv:2403.02955 (2024). · arXiv
  27. Rui Shao, Tianxing Wu, Liqiang Nie, and Ziwei Liu. 2023. DeepFake-Adapter: Dual-Level Adapter for DeepFake Detection. arXiv preprint arXiv:2306.00863 (2023). · arXiv
  28. Chuangchuang Tan Yao Zhao Shikui Wei Guanghua Gu Ping Liu and Yunchao Wei. 2024. Frequency-Aware Deepfake Detection: Improving Generalizability through Frequency Space Domain Learning. In AAAI.
  29. Dragos-Constantin Tantaru Elisabeta Oneata and Dan Oneata. 2024. Weakly- supervised deepfake localization in diffusion-generated images. In WACV.
  30. Zhikan Wang, Zhongyao Cheng, Jiajie Xiong, Xun Xu, Tianrui Li, Bharadwaj Veeravalli, and Xulei Yang. 2024. A Timely Survey on Vision Transformer for Deepfake Detection. arXiv preprint arXiv:2405.08463 (2024). · arXiv
  31. Simon Woo et al. 2022. Add: Frequency attention and multi-view based knowl- edge distillation to detect low-quality compressed deepfake images. In AAAI.
  32. Simon Woo et al. 2022. Add: Frequency attention and multi-view based knowl- edge distillation to detect low-quality compressed deepfake images. In AAAI.
  33. Mengjie Wu, Jingui Ma, Run Wang, Sidan Zhang, Ziyou Liang, Boheng Li, Chen- hao Lin, Liming Fang, and Lina Wang. 2024. TraceEvader: Making DeepFakes More Untraceable via Evading the Forgery Model Attribution. In AAAI.
  34. Shanmin Yang, Shu Hu, Bin Zhu, Ying Fu, Siwei Lyu, Xi Wu, and Xin Wang. 2023. Improving cross-dataset deepfake detection with deep information de- composition. arXiv preprint arXiv:2310.00359 (2023). · arXiv
  35. We Ye, Xinan He, and Feng Ding. 2024. Decoupling Forgery Semantics for Generalizable Deepfake Detection. arXiv preprint arXiv:2406.09739 (2024). · arXiv

Cited by

See all 3

Metadata

Authors
Liu, P., Tao, Q., & Zhou, J.
Affiliations
  • University of Nevada, Reno (US)
  • Agency for Science, Technology and Research (SG)
Venue
Proceedings of the 1st ACM Multimedia Workshop on Multi-modal Misinformation Governance in the Era of Foundation Models
Publisher
ACM
Published
2024-10-28
Pages
3-11
OpenAlex
W4403507277
Cited by
3
References
54
Citations by year
2025: 3
FWCI
0.62
Type
conference paper
Language
en
Open access
closed
Funders
  • Online Trust and Safety (OTS) Research Programme (MCI-OTS-001)
  • National Research Foundation, Prime Minister's Office, Singapore
Topics
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Digital Media Forensic Detection
  • Physical Sciences › Computer Science › Artificial Intelligence › Adversarial Robustness in Machine Learning
  • Social Sciences › Sociology and Political Science › Misinformation and Its Impacts
Keywords
deepfake detection, robustness, generalization, distribution shift, adversarial attacks, backdoor attacks, ensemble methods, generative models

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Robust Deepfake Detection by Addressing Generalization and Trustworthiness Challenges: A Short Survey. https://app.cochat.ai/papers/10.1145/3689090.3689386
The paper
Liu, P., Tao, Q., & Zhou, J. (2024). Robust Deepfake Detection by Addressing Generalization and Trustworthiness Challenges: A Short Survey. Proceedings of the 1st ACM Multimedia Workshop on Multi-modal Misinformation Governance in the Era of Foundation Models. https://doi.org/10.1145/3689090.3689386

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.