Deepfake Forensics via an Adversarial Game
Open accessThe DOI matches its Crossref record; 24 of the 24 references it cites were found in a registry or an index.
Abstract
With the progress in AI-based facial forgery (i.e., deepfake), people are concerned about its abuse. Albeit effort has been made for training models to recognize such forgeries, existing models suffer from poor generalization to unseen forgery technologies and high sensitivity to changes in image/video quality. In this paper, we advocate robust training for improving the generalization ability. We believe training with samples that are adversarially crafted to attack the classification models improves the generalization ability considerably. Considering that AI-based face manipulation often leads to high-frequency artifacts that can be easily spotted (by models) yet difficult to generalize, we further propose a new adversarial training method that attempts to blur out these artifacts, by introducing pixel-wise Gaussian blurring. Plenty of empirical evidence show that, with adversarial training, models are forced to learn more discriminative and generalizable features. Our code: https://github.com/ah651/deepfake_adv.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
Towards Deep Learning Models Resistant to Adversarial Attacks
Madry, A., Makelov, A., Schmidt, L., Tsipras, D., & Vladu, A. (2017) · arXiv · doi:10.48550/arxiv.1706.06083 · Cited by 6,602
StarGAN: Unified Generative Adversarial Networks for Multi-domain Image-to-Image Translation
Choi, Y., Choi, M., Kim, M., Ha, J.-W., Kim, S., & Choo, J. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00916 · Cited by 4,163
FaceForensics++: Learning to Detect Manipulated Facial Images
Rossler, A., Cozzolino, D., Verdoliva, L., Riess, C., Thies, J., & Niessner, M. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00009 · Cited by 3,314
Adversarial machine learning at scale
Kurakin, A., Goodfellow, I., & Bengio, S. (2016) · arXiv · doi:10.48550/arxiv.1611.01236 · Cited by 2,325
Obfuscated gradients give a false sense of security: Circumventing defenses to adversarial examples
Athalye, A., Carlini, N., & Wagner, D. (2018) · arXiv · doi:10.48550/arxiv.1802.00420 · Cited by 2,172
Rich Models for Steganalysis of Digital Images
Fridrich, J., & Kodovsky, J. (2012) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2012.2190402 · Cited by 2,144
MesoNet: a Compact Facial Video Forgery Detection Network
Afchar, D., Nozick, V., Yamagishi, J., & Echizen, I. (2018) · 2018 IEEE International Workshop on Information Forensics and Security (WIFS) · doi:10.1109/wifs.2018.8630761 · Cited by 1,872
Celeb-DF: A Large-Scale Challenging Dataset for DeepFake Forensics
Li, Y., Yang, X., Sun, P., Qi, H., & Lyu, S. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00327 · Cited by 1,846 · cited 6×
“To make the evaluation more comprehensive, we introduced two more deepfake datasets: DFD [48] and Celeb-DF [49].”
MethodInfluentialFace2Face: Real-Time Face Capture and Reenactment of RGB Videos
Thies, J., Zollhofer, M., Stamminger, M., Theobalt, C., & Niessner, M. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.262 · Cited by 1,747
Research works printed but not linked: 37
- 2019, FaceSwap
- 10.1109/ICIP.2014.7026073 · DOI · Paper page
- 10.1109/ICCV.2019.00765 · DOI · Paper page
- Goodfellow, 2014, Explaining and harnessing adversarial examples
- Xiao, 2018, Spatially transformed adversarial examples
- 10.1145/1399504.1360638 · DOI
- 10.1145/2024156.2024164 · DOI · Paper page
- 10.1109/CVPR.2014.537 · DOI · Paper page
- 10.1145/3306346.3323035 · DOI · Paper page
- 2019, DeepFakes
- 2019, ZAO
- 10.3156/jsoft.29.5_177_2 · DOI · Paper page
- 10.1109/CVPR.2019.00379 · DOI · Paper page
- 10.1109/ICCV.2019.00728 · DOI · Paper page
- 10.1109/CVPR.2018.00702 · DOI · Paper page
- 10.1109/ICCV.2017.580 · DOI · Paper page
- 10.1117/12.2078399 · DOI · Paper page
- 10.1109/TIFS.2012.2202227 · DOI · Paper page
- 10.1109/WIFS.2017.8267647 · DOI · Paper page
- 10.1109/AVSS.2018.8639163 · DOI · Paper page
- 10.1109/CVPR46437.2021.00222 · DOI · Paper page
- 10.1109/CVPR46437.2021.00361 · DOI · Paper page
- Uesato, 2019, Are labels required for improving adversarial robustness?
- 10.1007/978-3-030-66823-5_14 · DOI
- 10.1109/ICCV.2019.00033 · DOI · Paper page
- 10.1007/978-3-030-58580-8_4 · DOI · Paper page
- 10.1109/ICCV.2017.244 · DOI · Paper page
- Farnia, Do GANs always have Nash equilibria?, 3029
- Mescheder, 2017, The numerics of GANs
- Tan, 2019, EfficientNet: Rethinking model scaling for convolutional neural networks
- Dufour, 2019, Contributing data to deepfake detection research, Google AI Blog, 1, 1
- Liu, 2019, On the variance of the adaptive learning rate and beyond
- Paszke, PyTorch: An imperative style, high-performance deep learning library, 32, 8026
- 10.1109/CVPR.2017.195 · DOI · Paper page
- 10.1109/TPAMI.2018.2868668 · DOI · Paper page
- 10.1109/CVPR.2016.308 · DOI · Paper page
- 10.1609/aaai.v31i1.11231 · DOI · Paper page
Cited by
A systematic literature review on the effectiveness of deepfake detection techniques
Stroebel, L., Llewellyn, M., Hartley, T., Ip, T. S., & Ahmed, M. (2023) · Journal of Cyber Security Technology · doi:10.1080/23742917.2023.2192888 · Cited by 66
Fully Unsupervised Deepfake Video Detection Via Enhanced Contrastive Learning
Qiao, T., Xie, S., Chen, Y., Retraint, F., & Luo, X. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3356814 · Cited by 48
Generalization of Forgery Detection With Meta Deepfake Detection Model
Tran, V.-N., Kwon, S.-G., Lee, S.-H., Le, H.-S., & Kwon, K.-R. (2023) · IEEE Access · doi:10.1109/access.2022.3232290 · Cited by 47
“The research in [41] recommended intensive training to increase generalization performance.”
Background
Metadata
- Authors
- Wang, Z., Guo, Y., & Zuo, W.
- Venue
- IEEE Transactions on Image Processing
- Published
- 2022
- Volume
- 31
- Pages
- 3541-3552
- ISSN
- 1057-7149 (ISSN-L)
- 1941-0042
- OpenAlex
- W3139371685
- Cited by
- 49
- References
- 24
- FWCI
- 2.99
- Type
- journal article
- Language
- en
- Open access
- green
- Licence
- Funders
- National Key Research and Development Program of China (2021ZD0112100)
- National Natural Science Foundation of China (U19A2073)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Deepfake Forensics via an Adversarial Game. https://app.cochat.ai/papers/10.1109/tip.2022.3172845
- The paper
- Wang, Z., Guo, Y., & Zuo, W. (2022). Deepfake Forensics via an Adversarial Game. IEEE Transactions on Image Processing. https://doi.org/10.1109/tip.2022.3172845
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.