Robust Deepfake Detection by Addressing Generalization and Trustworthiness Challenges: A Short Survey
The DOI matches its Crossref record; 70 of the 70 references it cites were found in a registry or an index.
Abstract
The rapid advancement of deep learning technologies has led to a proliferation of deepfake content, posing serious threats to security, privacy, and trust in digital information. This paper explores the evolution of robust deepfake detection methods over recent years from two perspectives, specifically, generalized and trustworthy detection. As numerous generative techniques continuously emerge, generalized detection emphasizes the robustness against data distribution shift represented by unseen manipulation at testing time. By systematically reviewing generalized detection methods, we categorize these approaches into input-level, model-level, and learning-level. Trustworthy detection aims to enhance robustness against attacks that maliciously fail the detection system, including adversarial and backdoor attacks. To address these threats, researchers have developed robust defense strategies, including adversarial feature similarity learning and ensemble methods. By providing an overview of robust detection methods, attack techniques, and defense strategies, this paper highlights the challenges and advancements in creating reliable and generalizable deepfake detection systems.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Knowledge Distillation: A Survey
Gou, J., Yu, B., Maybank, S. J., & Tao, D. (2021) · International Journal of Computer Vision · doi:10.1007/s11263-021-01453-z · Cited by 3,931
Face X-Ray for More General Face Forgery Detection
Li, L., Bao, J., Zhang, T., Yang, H., Chen, D., Wen, F., & Guo, B. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00505 · Cited by 1,211
Thinking in Frequency: Face Forgery Detection by Mining Frequency-Aware Clues
Qian, Y., Yin, G., Sheng, L., Chen, Z., & Shao, J. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58610-2_6 · Cited by 1,058
On the Detection of Digital Face Manipulation
Dang, H., Liu, F., Stehouwer, J., Liu, X., & Jain, A. K. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00582 · Cited by 764
Generalizing Face Forgery Detection with High-frequency Features
Luo, Y., Zhang, Y., Yan, J., & Liu, W. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.01605 · Cited by 609
Detecting Deepfakes with Self-Blended Images
Shiohara, K., & Yamasaki, T. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01816 · Cited by 503
Sliced and Radon Wasserstein Barycenters of Measures
Bonneel, N., Rabin, J., Peyré, G., & Pfister, H. (2015) · Journal of Mathematical Imaging and Vision · doi:10.1007/s10851-014-0506-3 · Cited by 467
End-to-End Reconstruction-Classification Learning for Face Forgery Detection
Cao, J., Ma, C., Yao, T., Chen, S., Ding, S., & Yang, X. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.00408 · Cited by 428
Learning Self-Consistency for Deepfake Detection
Zhao, T., Xu, X., Xu, M., Ding, H., Xiong, Y., & Xia, W. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01475 · Cited by 383 · cited 1×
“Building on the theme of using real image characteristics, Zhao et al. [101] introduced the Inconsistency Image Generator, which creates well-annotated training datasets by blending genuine images, thus avoiding artifacts typically introduced by deep neural networks.”
Li, J., Xie, H., Li, J., Wang, Z., & Zhang, Y. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00639 · Cited by 357
Research works printed but not linked: 35
- Sifat Muhammad Abdullah, Aravind Cheruvu, Shravya Kanchi, Taejoong Chung, Peng Gao, Murtuza Jadliwala, and Bimal Viswanath. 2024. An Analysis of Recent Advances in Deepfake Image Detection in an Evolving Threat Landscape. arXiv preprint arXiv:2404.16212 (2024). · arXiv
- Zhongjie Ba Qingyu Liu Zhenguang Liu Shuang Wu Feng Lin Li Lu and Kui Ren. 2024. Exposing the Deception: Uncovering More Forgery Clues for Deepfake Detection. In AAAI.
- Zhaoyu Chen, Bo Li, Kaixun Jiang, Shuang Wu, Shouhong Ding, and Wenqiang Zhang. 2023. Exploring Decision-based Black-box Attacks on Face Forgery Detection. arXiv preprint arXiv:2310.12017 (2023). · arXiv
- Xiaoyi Dong, Jianmin Bao, Dongdong Chen, Ting Zhang, Weiming Zhang, Neng- hai Yu, Dong Chen, Fang Wen, and Baining Guo. 2022. Protecting celebrities from deepfake with identity consistency transformer. In CVPR.
- Alexey Dosovitskiy Lucas Beyer Alexander Kolesnikov Dirk Weissenborn Xiaohua Zhai Thomas Unterthiner Mostafa Dehghani Matthias Minderer Georg Heigold Sylvain Gelly et al. 2021. An image is worth 16x16 words: Transformers for image recognition at scale. In ICLR.
- Xiaoxuan Han, Songlin Yang, Wei Wang, Ziwen He, and Jing Dong. 2023. Is It Possible to Backdoor Face Forgery Detection with Natural Triggers? arXiv preprint arXiv:2401.00414 (2023). · arXiv
- Ahmed Abul Hasanaath, Hamzah Luqman, Raed Katib, and Saeed Anwar. 2024. FSBI: Deepfakes Detection with Frequency Enhanced Self-Blended Images. arXiv preprint arXiv:2406.08625v1 (2024). · arXiv
- Ziwen He Wei Wang Weinan Guan Jing Dong and Tieniu Tan. 2022. Defeating DeepFakes via Adversarial Visual Reconstruction. In ACM MM.
- Yihao Huang, Felix Juefei-Xu, Qing Guo, Xiaofei Xie, Lei Ma, Weikai Miao, Yang Liu, and Geguang Pu. 2020. Fakeretouch: Evading deepfakes detection via the guidance of deliberate noise. arXiv preprint arXiv:2009.09213 (2020). · arXiv
- Yihao Huang, Felix Juefei-Xu, Run Wang, Qing Guo, Lei Ma, Xiaofei Xie, Jian- wen Li, Weikai Miao, Yang Liu, and Geguang Pu. 2020. Fakepolisher: Making deepfakes more detection-evasive by shallow reconstruction. In ACM MM.
- Chenqi Kong, Anwei Luo, Song Xia, Yi Yu, Haoliang Li, and Alex C Kot. 2024. MoE-FFD: Mixture of Experts for Generalized and Parameter-Efficient Face Forgery Detection. arXiv preprint arXiv:2404.08452 (2024). · arXiv
- Seokjun Lee Seung-Won Jung and Hyunseok Seo. 2024. Spectrum Translation for Refinement of Image Generation (STIG) Based on Contrastive Learning and Spectral Filter Profile. In AAAI.
- Dongze Li Wei Wang Hongxing Fan and Jing Dong. 2021. Exploring adversarial fake images on face manifold. In CVPR.
- Hanzhe Li, Jiaran Zhou, Bin Li, Junyu Dong, and Yuezun Li. 2024. FreqBlender: Enhancing DeepFake Detection by Blending Frequency Knowledge. arXiv preprint arXiv:2404.13872 (2024). · arXiv
- Yanjie Li Bin Xie Songtao Guo Yuanyuan Yang and Bin Xiao. 2024. A Survey of Robustness and Safety of 2D and 3D Deep Learning Models against Adversarial Attacks. ACM Comput. Surv. (2024).
- Yang Li, Songlin Yang, Wei Wang, Ziwen He, Bo Peng, and Jing Dong. 2024. Counterfactual Explanations for Face Forgery Detection via Adversarial Re- moval of Artifacts. arXiv preprint arXiv:2404.08341 (2024). · arXiv
- Jiawei Liang Siyuan Liang Aishan Liu Xiaojun Jia Junhao Kuang and Xiaochun Cao. 2024. Poisoned forgery face: Towards backdoor attacks on face forgery detection. In ICLR.
- Honggu Liu, Xiaodan Li, Wenbo Zhou, Yuefeng Chen, Yuan He, Hui Xue, Weim- ing Zhang, and Nenghai Yu. 2021. Spatial-phase shallow learning: rethinking face forgery detection in frequency domain. In CVPR.
- Jiatong Liu Mingcheng Zhang Jianpeng Ke and Lina Wang. 2024. AdvShadow: Evading DeepFake Detection via Adversarial Shadow Attack. In ICASSP.
- Zihan Liu, Hanyi Wang, Yaoyu Kang, and Shilin Wang. 2024. Mixture of Low- rank Experts for Transferable AI-Generated Image Detection. arXiv preprint arXiv:2404.04883 (2024). · arXiv
- Anwei Luo, Rizhao Cai, Chenqi Kong, Xiangui Kang, Jiwu Huang, and Alex C Kot. 2023. Forgery-aware adaptive vision transformer for face forgery detection. arXiv preprint arXiv:2309.11092 (2023). · arXiv
- Qingxuan Lv, Yuezun Li, Junyu Dong, Sheng Chen, Hui Yu, Huiyu Zhou, and Shu Zhang. 2023. DomainForensics: Exposing Face Forgery across Domains via Bi-directional Adaptation. arXiv preprint arXiv:2312.10680 (2023). · arXiv
- Huy H Nguyen, Junichi Yamagishi, and Isao Echizen. 2024. Exploring Self- Supervised Vision Transformers for Deepfake Detection: A Comparative Anal- ysis. arXiv preprint arXiv:2405.00355 (2024). · arXiv
- Maxime Oquab, Timothée Darcet, Théo Moutakanni, Huy Vo, Marc Szafraniec, Vasil Khalidov, Pierre Fernandez, Daniel Haziza, Francisco Massa, Alaaeldin El- Nouby, et al. 2023. Dinov2: Learning robust visual features without supervision. arXiv preprint arXiv:2304.07193 (2023). · arXiv
- Alvaro Lopez Pellicer, Yi Li, and Plamen Angelov. 2024. PUDD: Towards Robust Multi-modal Prototype-based Deepfake Detection. In CVPRW.
- Ben Pinhasov, Raz Lapid, Rony Ohayon, Moshe Sipper, and Yehudit Aperstein. 2024. XAI-Based Detection of Adversarial Attacks on Deepfake Detectors. arXiv preprint arXiv:2403.02955 (2024). · arXiv
- Rui Shao, Tianxing Wu, Liqiang Nie, and Ziwei Liu. 2023. DeepFake-Adapter: Dual-Level Adapter for DeepFake Detection. arXiv preprint arXiv:2306.00863 (2023). · arXiv
- Chuangchuang Tan Yao Zhao Shikui Wei Guanghua Gu Ping Liu and Yunchao Wei. 2024. Frequency-Aware Deepfake Detection: Improving Generalizability through Frequency Space Domain Learning. In AAAI.
- Dragos-Constantin Tantaru Elisabeta Oneata and Dan Oneata. 2024. Weakly- supervised deepfake localization in diffusion-generated images. In WACV.
- Zhikan Wang, Zhongyao Cheng, Jiajie Xiong, Xun Xu, Tianrui Li, Bharadwaj Veeravalli, and Xulei Yang. 2024. A Timely Survey on Vision Transformer for Deepfake Detection. arXiv preprint arXiv:2405.08463 (2024). · arXiv
- Simon Woo et al. 2022. Add: Frequency attention and multi-view based knowl- edge distillation to detect low-quality compressed deepfake images. In AAAI.
- Simon Woo et al. 2022. Add: Frequency attention and multi-view based knowl- edge distillation to detect low-quality compressed deepfake images. In AAAI.
- Mengjie Wu, Jingui Ma, Run Wang, Sidan Zhang, Ziyou Liang, Boheng Li, Chen- hao Lin, Liming Fang, and Lina Wang. 2024. TraceEvader: Making DeepFakes More Untraceable via Evading the Forgery Model Attribution. In AAAI.
- Shanmin Yang, Shu Hu, Bin Zhu, Ying Fu, Siwei Lyu, Xi Wu, and Xin Wang. 2023. Improving cross-dataset deepfake detection with deep information de- composition. arXiv preprint arXiv:2310.00359 (2023). · arXiv
- We Ye, Xinan He, and Feng Ding. 2024. Decoupling Forgery Semantics for Generalizable Deepfake Detection. arXiv preprint arXiv:2406.09739 (2024). · arXiv
Cited by
Abdulazeez, F. A., Hasan, M. K., & Abdullah, S. N. H. S. (2025) · doi:10.1109/iceei68459.2025.11330286
“The absence of interpretive frameworks for quantum models makes it difficult to achieve transparency in high-risk situations which requires the creation of explainable AI methods specifically designed for QML [15].”
Real, Fake, And Synthetic - Adversarial Attacks on Three Sides of the Coin
Naeem, S., Tariq, U., Dhall, A., & Al-Nashash, H. A. (2025) · IEEE International Conference on Image Processing Workshops (ICIPW) · doi:10.1109/icipw68931.2025.11386266
“Ad-ditionally, Liu et al. [15] emphasize the need for robust detection frameworks that address generalization and trustworthiness challenges, while Park et al. [16] propose a comprehensive risk analysis for adversarial attacks on biometric systems, underscoring the practical implications of these…”
ADD: An Automated Neural Architecture Search Baseline for Deepfake Detection
Liu, P., Lin, Y., Liu, J., Wei, Y., & Zhou, J. T. (2025) · IEEE International Workshop on Information Forensics and Security · doi:10.1109/wifs66636.2025.00019
“Early deepfake detection methods treated the task as a binary image classification problem using handcrafted features and steganalysis techniques [8], [13], [28].”
Self-citation
Metadata
- Authors
- Liu, P., Tao, Q., & Zhou, J.
- Affiliations
- University of Nevada, Reno (US)
- Agency for Science, Technology and Research (SG)
- Venue
- Proceedings of the 1st ACM Multimedia Workshop on Multi-modal Misinformation Governance in the Era of Foundation Models
- Publisher
- ACM
- Published
- 2024-10-28
- Pages
- 3-11
- OpenAlex
- W4403507277
- Cited by
- 3
- References
- 54
- Citations by year
- 2025: 3
- FWCI
- 0.62
- Type
- conference paper
- Language
- en
- Open access
- closed
- Funders
- Online Trust and Safety (OTS) Research Programme (MCI-OTS-001)
- National Research Foundation, Prime Minister's Office, Singapore
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Digital Media Forensic Detection
- Physical Sciences › Computer Science › Artificial Intelligence › Adversarial Robustness in Machine Learning
- Social Sciences › Sociology and Political Science › Misinformation and Its Impacts
- Keywords
- deepfake detection, robustness, generalization, distribution shift, adversarial attacks, backdoor attacks, ensemble methods, generative models
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Robust Deepfake Detection by Addressing Generalization and Trustworthiness Challenges: A Short Survey. https://app.cochat.ai/papers/10.1145/3689090.3689386
- The paper
- Liu, P., Tao, Q., & Zhou, J. (2024). Robust Deepfake Detection by Addressing Generalization and Trustworthiness Challenges: A Short Survey. Proceedings of the 1st ACM Multimedia Workshop on Multi-modal Misinformation Governance in the Era of Foundation Models. https://doi.org/10.1145/3689090.3689386
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.