Thinking in Frequency: Face Forgery Detection by Mining Frequency-Aware Clues
Open accessThe DOI matches its Crossref record; 54 of the 55 references it cites were found in a registry or an index.
Abstract
As realistic facial manipulation technologies have achieved remarkable progress, social concerns about potential malicious abuse of these technologies bring out an emerging research topic of face forgery detection. However, it is extremely challenging since recent advances are able to forge faces beyond the perception ability of human eyes, especially in compressed images and videos. We find that mining forgery patterns with the awareness of frequency could be a cure, as frequency provides a complementary viewpoint where either subtle forgery artifacts or compression errors could be well described. To introduce frequency into the face forgery detection, we propose a novel Frequency in Face Forgery Network (F3-Net), taking advantages of two different but complementary frequency-aware clues, 1) frequency-aware decomposed image components, and 2) local frequency statistics, to deeply mine the forgery patterns via our two-stream collaborative learning framework. We apply DCT as the applied frequency-domain transformation. Through comprehensive studies, we show that the proposed F3-Net significantly outperforms competing state-of-the-art methods on all compression qualities in the challenging FaceForensics++ dataset, especially wins a big lead upon low-quality media.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Most of them model deepfake detection as a vanilla binary classification problem, i.e, first use a backbone network to extract a global feature and then feed it into a binary classifier (real/fake).”
From Multi-attentional Deepfake Detection (2021) · cites this paper as [33]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The performance of any deepfake detection method is highly dependent on the quantitative and qualitative aspects of the datasets used for development [18, 21, 25, 40, 44, 47, 49, 51, 52, 61, 63, 69, 72, 75].”
From AV-Deepfake1M: A Large-Scale LLM-Driven Audio-Visual Deepfake Dataset (2024) · cites this paper as [47]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“F3-Net (Frequency in Face Forgery Network) exemplifies this family by mining frequency-aware clues and is incorporated into standardized benchmarking as a representative frequency detector [9].”
From A Review of Tools and Technologies to Combat Deepfakes (2026) · cites this paper as [9]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“However, the performance decreases 1.5% compared with F 3 -Net [33] on the LQ version”
From Multi-attentional Deepfake Detection (2021) · cites this paper as [33]
The cited source says what the claim attributes to it.
In the citing paper
“In order to enhance interaction between the two main branches, a cross-attention module similar to the one proposed in [25] is applied after the first stage of the feature extraction process (i.e., to the output of the two ConvNeXt-T extractors).”
From WaveConViT: Wavelet-Based Convolutional Vision Transformer for Cross-Manipulation Deepfake Video Detection (2025) · cites this paper as [25]
5 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
(2008) · Journal of Machine Learning Research · Cited by 33,051
Xception: Deep Learning with Depthwise Separable Convolutions
Chollet, F. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.195 · Cited by 20,380
GAN(Generative Adversarial Nets)
(2017) · Journal of Japan Society for Fuzzy Theory and Intelligent Informatics · doi:10.3156/jsoft.29.5_177_2 · Cited by 19,270
A Style-Based Generator Architecture for Generative Adversarial Networks
Karras, T., Laine, S., & Aila, T. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00453 · Cited by 11,714
SGDR: Stochastic Gradient Descent with Warm Restarts
Loshchilov, I., & Hutter, F. (2016) · arXiv · doi:10.48550/arxiv.1608.03983 · Cited by 5,309
Ahmed, N., Natarajan, T., & Rao, K. R. (1974) · IEEE Transactions on Computers · doi:10.1109/t-c.1974.223784 · Cited by 5,156
Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning
Szegedy, C., Ioffe, S., Vanhoucke, V., & Alemi, A. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.11231 · Cited by 4,636
StarGAN: Unified Generative Adversarial Networks for Multi-domain Image-to-Image Translation
Choi, Y., Choi, M., Kim, M., Ha, J.-W., Kim, S., & Choo, J. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00916 · Cited by 4,163
SlowFast Networks for Video Recognition
Feichtenhofer, C., Fan, H., Malik, J., & He, K. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00630 · Cited by 4,007
Large Scale GAN Training for High Fidelity Natural Image Synthesis
Brock, A., Donahue, J., & Simonyan, K. (2018) · arXiv · doi:10.48550/arxiv.1809.11096 · Cited by 3,717
FaceForensics++: Learning to Detect Manipulated Facial Images
Rossler, A., Cozzolino, D., Verdoliva, L., Riess, C., Thies, J., & Niessner, M. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00009 · Cited by 3,314
Rich Models for Steganalysis of Digital Images
Fridrich, J., & Kodovsky, J. (2012) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2012.2190402 · Cited by 2,144
MesoNet: a Compact Facial Video Forgery Detection Network
Afchar, D., Nozick, V., Yamagishi, J., & Echizen, I. (2018) · 2018 IEEE International Workshop on Information Forensics and Security (WIFS) · doi:10.1109/wifs.2018.8630761 · Cited by 1,872
Face2Face: Real-Time Face Capture and Reenactment of RGB Videos
Thies, J., Zollhofer, M., Stamminger, M., Theobalt, C., & Niessner, M. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.262 · Cited by 1,747
Deferred neural rendering: image synthesis using neural textures
Thies, J., Zollhöfer, M., & Nießner, M. (2019) · ACM Transactions on Graphics · doi:10.1145/3306346.3323035 · Cited by 1,356
Face X-Ray for More General Face Forgery Detection
Li, L., Bao, J., Zhang, T., Yang, H., Chen, D., Wen, F., & Guo, B. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00505 · Cited by 1,211
CNN-Generated Images Are Surprisingly Easy to Spot… for Now
Wang, S.-Y., Wang, O., Zhang, R., Owens, A., & Efros, A. A. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00872 · Cited by 1,210
Capsule-forensics: Using Capsule Networks to Detect Forged Images and Videos
Nguyen, H. H., Yamagishi, J., & Echizen, I. (2019) · ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2019.8682602 · Cited by 951
A Deep Learning Approach to Universal Image Manipulation Detection Using a New Convolutional Layer
Bayar, B., & Stamm, M. C. (2016) · Proceedings of the 4th ACM Workshop on Information Hiding and Multimedia Security · doi:10.1145/2909827.2930786 · Cited by 838
Gabor filters as texture discriminator
Fogel, I., & Sagi, D. (1989) · Biological Cybernetics · doi:10.1007/bf00204594 · Cited by 742
Two-Stream Neural Networks for Tampered Face Detection
Zhou, P., Han, X., Morariu, V. I., & Davis, L. S. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2017.229 · Cited by 700
Detecting and Simulating Artifacts in GAN Fake Images
Zhang, X., Karaman, S., & Chang, S.-F. (2019) · 2019 IEEE International Workshop on Information Forensics and Security (WIFS) · doi:10.1109/wifs47025.2019.9035107 · Cited by 567
Multi-task Learning for Detecting and Segmenting Manipulated Facial Images and Videos
Nguyen, H. H., Fang, F., Yamagishi, J., & Echizen, I. (2019) · 2019 IEEE 10th International Conference on Biometrics Theory, Applications and Systems (BTAS) · doi:10.1109/btas46853.2019.9185974 · Cited by 549
Wavelet-SRNet: A Wavelet-Based CNN for Multi-scale Face Super Resolution
Huang, H., He, R., Sun, Z., & Tan, T. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.187 · Cited by 518
Image Forgery Localization via Fine-Grained Analysis of CFA Artifacts
Ferrara, P., Bianchi, T., De Rosa, A., & Piva, A. (2012) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2012.2202227 · Cited by 492
Recurrent convolutional strategies for face manipulation detection in videos
Sabir, E., Cheng, J., Jaiswal, A., AbdAlmageed, W., Masi, I., & Natarajan, P. (2019) · arXiv · doi:10.48550/arxiv.1905.00582 · Cited by 443
Attributing Fake Images to GANs: Learning and Analyzing GAN Fingerprints
Yu, N., Davis, L., & Fritz, M. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00765 · Cited by 437
Deepfake Video Detection through Optical Flow Based CNN
Amerini, I., Galteri, L., Caldelli, R., & Del Bimbo, A. (2019) · 2019 IEEE/CVF International Conference on Computer Vision Workshop (ICCVW) · doi:10.1109/iccvw.2019.00152 · Cited by 424 · cited 3×
“Following previous face forgery detection methods [51,19,40,5], we conduct our experiments on the challenging FaceForensics++ [50] dataset.”
BackgroundMethodExposing Digital Image Forgeries by Illumination Color Classification
de Carvalho, T. J., Riess, C., Angelopoulou, E., Pedrini, H., & de Rezende Rocha, A. (2013) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2013.2265677 · Cited by 406
Detection of GAN-Generated Fake Images over Social Networks
Marra, F., Gragnaniello, D., Cozzolino, D., & Verdoliva, L. (2018) · 2018 IEEE Conference on Multimedia Information Processing and Retrieval (MIPR) · doi:10.1109/mipr.2018.00084 · Cited by 399
Cozzolino, D., Poggi, G., & Verdoliva, L. (2017) · Proceedings of the 5th ACM Workshop on Information Hiding and Multimedia Security · doi:10.1145/3082031.3083247 · Cited by 349
Live face detection based on the analysis of Fourier spectra:
Li, J., Wang, Y., Tan, T., & Jain, A. K. (2004) · SPIE Proceedings · doi:10.1117/12.541955 · Cited by 339
Distinguishing computer graphics from natural images using convolution neural networks
Rahmouni, N., Nozick, V., Yamagishi, J., & Echizen, I. (2017) · 2017 IEEE Workshop on Information Forensics and Security (WIFS) · doi:10.1109/wifs.2017.8267647 · Cited by 318
Deep Spatial Gradient and Temporal Depth Learning for Face Anti-Spoofing
Wang, Z., Yu, Z., Zhao, C., Zhu, X., Qin, Y., Zhou, Q., Zhou, F., & Lei, Z. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00509 · Cited by 229
Rotation-invariant texture classification using a complete space-frequency model
Haley, G. M., & Manjunath, B. S. (1999) · IEEE Transactions on Image Processing · doi:10.1109/83.743859 · Cited by 222
Detecting GAN-Generated Imagery Using Saturation Cues
McCloskey, S., & Albright, M. (2019) · 2019 IEEE International Conference on Image Processing (ICIP) · doi:10.1109/icip.2019.8803661 · Cited by 220
Wavelet transforms: an introduction
Bentley, P. M., & McDonnell, J. T. E. (1994) · Electronics & Communication Engineering Journal · doi:10.1049/ecej:19940401 · Cited by 189
Unmasking DeepFakes with simple Features
Durall, R., Keuper, M., Pfreundt, F.-J., & Keuper, J. (2019) · arXiv · doi:10.48550/arxiv.1911.00686 · Cited by 184
JPEG-Phase-Aware Convolutional Neural Network for Steganalysis of JPEG Images
Chen, M., Sedighi, V., Boroumand, M., & Fridrich, J. (2017) · Proceedings of the 5th ACM Workshop on Information Hiding and Multimedia Security · doi:10.1145/3082031.3083248 · Cited by 176
Video forgery detection using correlation of noise residue
Hsu, C.-C., Hung, T.-Y., Lin, C.-W., & Hsu, C.-T. (2008) · 2008 IEEE 10th Workshop on Multimedia Signal Processing · doi:10.1109/mmsp.2008.4665069 · Cited by 175
Steganalysis Features for Content-Adaptive JPEG Steganography
Denemark, T., Boroumand, M., & Fridrich, J. (2016) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2016.2555281 · Cited by 171
Learning to Detect Fake Face Images in the Wild
Hsu, C.-C., Lee, C.-Y., & Zhuang, Y.-X. (2018) · 2018 International Symposium on Computer, Consumer and Control (IS3C) · doi:10.1109/is3c.2018.00104 · Cited by 148
Exposing image splicing with inconsistent local noise variances
Pan, X., Zhang, X., & Lyu, S. (2012) · 2012 IEEE International Conference on Computational Photography (ICCP) · doi:10.1109/iccphot.2012.6215223 · Cited by 120
Illuminant-Based Transformed Spaces for Image Forensics
Carvalho, T., Faria, F. A., Pedrini, H., Torres, R. D. S., & Rocha, A. (2015) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2015.2506548 · Cited by 115
Cozzolino, D., Gragnaniello, D., & Verdoliva, L. (2014) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2014.7026073 · Cited by 114
Autoencoder with recurrent neural networks for video forgery detection
D'Avino, D., Cozzolino, D., Poggi, G., & Verdoliva, L. (2017) · Electronic Imaging · doi:10.2352/issn.2470-1173.2017.7.mwsf-330 · Cited by 109
Fdftnet: facing off fake images using fake detection fine-tuning network
Jeon, H., Bang, Y., & Woo, S. S. (2020) · IFIP Advances in Information and Communication Technology · doi:10.1007/978-3-030-58201-2_28 · Cited by 65
Gunawan, T. S., Hanafiah, S. A. M., Kartiwi, M., Ismail, N., Za’bah, N. F., & Nordin, A. N. (2017) · Indonesian Journal of Electrical Engineering and Computer Science · doi:10.11591/ijeecs.v7.i1.pp131-137 · Cited by 56
Passive forensics in image and video using noise features: A review
Pandey, R. C., Singh, S. K., & Shukla, K. K. (2016) · Digital Investigation · doi:10.1016/j.diin.2016.08.002 · Cited by 49
A Frequency Domain Neural Network for Fast Image Super-resolution
Li, J., You, S., & Robles‐Kelly, A. (2018) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2018.8489155 · Cited by 45
Improving image classification with frequency domain layers for feature extraction
Stuchi, J. A., Angeloni, M. A., Pereira, R. F., Boccato, L., Folego, G., Prado, P. V. D. S., & Attux, R. (2017) · Machine learning for signal processing ... · doi:10.1109/mlsp.2017.8168168 · Cited by 39
Feature extraction using wavelet transform for neural network based image classification
Sarlashkar, A. N., Bodruzzaman, M., & Malkani, M. (2002) · Southeastern Symposium on System Theory (SSST) · doi:10.1109/ssst.1998.660107 · Cited by 34
Image Classification in the Frequency Domain with Neural Networks and Absolute Value DCT
Franzen, F. (2018) · Lecture notes in computer science · doi:10.1007/978-3-319-94211-7_33 · Cited by 11
Research works printed but not linked: 5
- Fujieda, S., Takayama, K., Hachisuka, T.: Wavelet convolutional neural networks for texture classification. arXiv preprint arXiv:1707.07394 (2017) · arXiv
- Goodfellow, I., et al.: Generative adversarial nets. In: Advances in Neural Information Processing Systems, pp. 2672–2680 (2014)
- Karras, T., Aila, T., Laine, S., Lehtinen, J.: Progressive growing of GANs for improved quality, stability, and variation. arXiv preprint arXiv:1710.10196 (2017) · arXiv
- Kay, W., et al.: The kinetics human action video dataset. arXiv preprint arXiv:1705.06950 (2017) · arXiv
- Li, H., Li, B., Tan, S., Huang, J.: Detection of deep network generated images using disparities in color components. arXiv preprint arXiv:1808.07276 (2018) · arXiv
Cited by
Multi-attentional Deepfake Detection
Zhao, H., Wei, T., Zhou, W., Zhang, W., Chen, D., & Yu, N. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00222 · Cited by 1,019
MANIQA: Multi-dimension Attention Network for No-Reference Image Quality Assessment
Yang, S., Wu, T., Shi, S., Lao, S., Gong, Y., Cao, M., Wang, J., & Yang, Y. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw56347.2022.00126 · Cited by 527
Generalizing Face Forgery Detection with High-frequency Features
Luo, Y., Zhang, Y., Yan, J., & Liu, W. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.01605 · Cited by 609
Spatial-Phase Shallow Learning: Rethinking Face Forgery Detection in Frequency Domain
Liu, H., Li, X., Zhou, W., Chen, Y., He, Y., Xue, H., Zhang, W., & Yu, N. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00083 · Cited by 600
Lips Don't Lie: A Generalisable and Robust Approach to Face Forgery Detection
Haliassos, A., Vougioukas, K., Petridis, S., & Pantic, M. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00500 · Cited by 537
Metadata
- Authors
- Qian, Y., Yin, G., Sheng, L., Chen, Z., & Shao, J.
- Affiliations
- Sensetime (China) (CN)
- Beihang University (CN)
- Northwestern Polytechnical University (CN)
- Corresponding author
- Yin, Guojun
- Sheng, Lu
- Venue
- Lecture Notes in Computer Science
- Publisher
- Springer International Publishing
- Published
- 2020
- Pages
- 86-103
- ISSN
- 0302-9743 (ISSN-L)
- 1611-3349
- OpenAlex
- W3094728142
- Semantic Scholar
- 4f899299c366fa1b465afa109412b4597448e554
- Cited by
- 1,058
- References
- 55
- Citations by year
- 2026: 216 · 2025: 287 · 2024: 216 · 2023: 180 · 2022: 111 · 2021: 45 · 2020: 3
- FWCI
- 26.14
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- www.springernature.com/gp/researchers/text-and-data-mining (tdm)
- www.springernature.com/gp/researchers/text-and-data-mining (vor)
- Locations
- Lecture notes in computer science (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- SenseTime Group
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Digital Media Forensic Detection
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Steganography and Watermarking Techniques
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Image and Video Quality Assessment
- Keywords
- face forgery detection, face manipulation, frequency-domain features, discrete cosine transform, two-stream network, compression artifacts, FaceForensics++
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.