The DOI matches its Crossref record; 87 of the 91 references it cites were found in a registry or an index.
Forgery-Aware Adaptive Learning With Vision Transformer for Generalized Face Forgery Detection
Abstract
With the rapid progress of generative models, the current challenge in face forgery detection is how to effectively detect realistic manipulated faces from different unseen domains. Though previous studies show that pre-trained Vision Transformer (ViT) based models can achieve some promising results after fully fine-tuning on the Deepfake dataset, their generalization performances are still unsatisfactory. To this end, we present a Forgery-aware Adaptive Vision Transformer (FA-ViT) under the adaptive learning paradigm for generalized face forgery detection, where the parameters in the pre-trained ViT are kept fixed while the designed adaptive modules are optimized to capture forgery features. Specifically, a global adaptive module is designed to model long-range interactions among input tokens, which takes advantage of self-attention mechanism to mine global forgery clues. To further explore essential local forgery clues, a local adaptive module is proposed to expose local inconsistencies by enhancing the local contextual association. In addition, we introduce a fine-grained adaptive learning module that emphasizes the common compact representation of genuine faces through relationship learning in fine-grained pairs, driving these proposed adaptive modules to be aware of fine-grained forgery-aware information. Extensive experiments demonstrate that our FA-ViT achieves state-of-the-arts results in the cross-dataset evaluation, and enhances the robustness against unseen perturbations. Particularly, FA-ViT achieves 93.83% and 78.32% AUC scores on Celeb-DF and DFDC datasets in the cross-dataset evaluation. The code and trained model have been released at:https://github.com/LoveSiameseCat/FAViT.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
PyTorch: An Imperative Style, High-Performance Deep Learning Library
Paszke, A., Gross, S., Massa, F., Lerer, A., Bradbury, J., Chanan, G., Killeen, T., Lin, Z., Gimelshein, N., Antiga, L., et al. (2019) · arXiv · doi:10.48550/arxiv.1912.01703 · Cited by 31,473
Xception: Deep Learning with Depthwise Separable Convolutions
Chollet, F. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.195 · Cited by 20,380
EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks
Tan, M., & Le, Q. V. (2019) · arXiv · doi:10.48550/arxiv.1905.11946 · Cited by 17,072
Learning Transferable Visual Models From Natural Language Supervision
Radford, A., Kim, J. W., Hallacy, C., Ramesh, A., Goh, G., Agarwal, S., Sastry, G., Askell, A., Mishkin, P., Clark, J., et al. (2021) · arXiv · doi:10.48550/arxiv.2103.00020 · Cited by 15,293
Joint Face Detection and Alignment Using Multitask Cascaded Convolutional Networks
Zhang, K., Zhang, Z., Li, Z., & Qiao, Y. (2016) · IEEE Signal Processing Letters · doi:10.1109/lsp.2016.2603342 · Cited by 6,214
Grad-CAM++: Generalized Gradient-Based Visual Explanations for Deep Convolutional Networks
Chattopadhay, A., Sarkar, A., Howlader, P., & Balasubramanian, V. N. (2018) · 2018 IEEE Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv.2018.00097 · Cited by 3,639
FaceForensics++: Learning to Detect Manipulated Facial Images
Rossler, A., Cozzolino, D., Verdoliva, L., Riess, C., Thies, J., & Niessner, M. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00009 · Cited by 3,314
Tokens-to-Token ViT: Training Vision Transformers from Scratch on ImageNet
Yuan, L., Chen, Y., Wang, T., Yu, W., Shi, Y., Jiang, Z., Tay, F. E. H., Feng, J., & Yan, S. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00060 · Cited by 2,415
Tokens-to-Token ViT: Training Vision Transformers from Scratch on ImageNet
Yuan, L., Chen, Y., Wang, T., Yu, W., Shi, Y., Jiang, Z., Tay, F. E., Feng, J., & Yan, S. (2021) · arXiv · doi:10.48550/arxiv.2101.11986 · Cited by 2,415
MesoNet: a Compact Facial Video Forgery Detection Network
Afchar, D., Nozick, V., Yamagishi, J., & Echizen, I. (2018) · 2018 IEEE International Workshop on Information Forensics and Security (WIFS) · doi:10.1109/wifs.2018.8630761 · Cited by 1,872
Celeb-DF: A Large-Scale Challenging Dataset for DeepFake Forensics
Li, Y., Yang, X., Sun, P., Qi, H., & Lyu, S. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00327 · Cited by 1,846 · cited 1×
“2) Celeb-DF-v2 (CDF) [68] is a high-quality Deepfake dataset specifically centered on celebrity faces.”
Face2Face: Real-Time Face Capture and Reenactment of RGB Videos
Thies, J., Zollhofer, M., Stamminger, M., Theobalt, C., & Niessner, M. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.262 · Cited by 1,747
Deferred neural rendering: image synthesis using neural textures
Thies, J., Zollhöfer, M., & Nießner, M. (2019) · ACM Transactions on Graphics · doi:10.1145/3306346.3323035 · Cited by 1,356
Learning to Generalize: Meta-Learning for Domain Generalization
Li, D., Yang, Y., Song, Y.-Z., & Hospedales, T. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11596 · Cited by 1,251
Face X-Ray for More General Face Forgery Detection
Li, L., Bao, J., Zhang, T., Yang, H., Chen, D., Wen, F., & Guo, B. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00505 · Cited by 1,211
Fine-Tuning can Distort Pretrained Features and Underperform Out-of-DistributionPreprint
Kumar, A., Raghunathan, A., Jones, R., Ma, T., & Liang, P. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2202.10054 · Cited by 1,138
In Ictu Oculi: Exposing AI Created Fake Videos by Detecting Eye Blinking
Li, Y., Chang, M.-C., & Lyu, S. (2018) · 2018 IEEE International Workshop on Information Forensics and Security (WIFS) · doi:10.1109/wifs.2018.8630787 · Cited by 1,089
Thinking in Frequency: Face Forgery Detection by Mining Frequency-Aware Clues
Qian, Y., Yin, G., Sheng, L., Chen, Z., & Shao, J. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58610-2_6 · Cited by 1,058
Multi-attentional Deepfake Detection
Zhao, H., Wei, T., Zhou, W., Zhang, W., Chen, D., & Yu, N. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00222 · Cited by 1,019
ImageNet-21K Pretraining for the MassesPreprint
Ridnik, T., Ben-Baruch, E., Noy, A., & Zelnik‐Manor, L. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2104.10972 · Cited by 1,019
Circle Loss: A Unified Perspective of Pair Similarity Optimization
Sun, Y., Cheng, C., Zhang, Y., Zhang, C., Zheng, L., Wang, Z., & Wei, Y. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00643 · Cited by 987
Capsule-forensics: Using Capsule Networks to Detect Forged Images and Videos
Nguyen, H. H., Yamagishi, J., & Echizen, I. (2019) · ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2019.8682602 · Cited by 951
Conformer: Local Features Coupling Global Representations for Visual Recognition
Peng, Z., Huang, W., Gu, S., Xie, L., Wang, Y., Jiao, J., & Ye, Q. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00042 · Cited by 827
Exploiting Visual Artifacts to Expose Deepfakes and Face Manipulations
Matern, F., Riess, C., & Stamminger, M. (2019) · 2019 IEEE Winter Applications of Computer Vision Workshops (WACVW) · doi:10.1109/wacvw.2019.00020 · Cited by 824
Exposing DeepFake Videos By Detecting Face Warping Artifacts
Li, Y., & Lyu, S. (2018) · arXiv · doi:10.48550/arxiv.1811.00656 · Cited by 785
Searching Central Difference Convolutional Networks for Face Anti-Spoofing
Yu, Z., Zhao, C., Wang, Z., Qin, Y., Su, Z., Li, X., Zhou, F., & Zhao, G. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00534 · Cited by 636
Generalizing Face Forgery Detection with High-frequency Features
Luo, Y., Zhang, Y., Yan, J., & Liu, W. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.01605 · Cited by 609
Spatial-Phase Shallow Learning: Rethinking Face Forgery Detection in Frequency Domain
Liu, H., Li, X., Zhou, W., Chen, Y., He, Y., Xue, H., Zhang, W., & Yu, N. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00083 · Cited by 600
DeeperForensics-1.0: A Large-Scale Dataset for Real-World Face Forgery Detection
Jiang, L., Li, R., Wu, W., Qian, C., & Loy, C. C. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00296 · Cited by 599
Learning in the Frequency Domain
Xu, K., Qin, M., Sun, F., Wang, Y., Chen, Y.-K., & Ren, F. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00181 · Cited by 563
Detecting Deepfakes with Self-Blended Images
Shiohara, K., & Yamasaki, T. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01816 · Cited by 503
Two-Branch Recurrent Network for Isolating Deepfakes in Videos
Masi, I., Killekar, A., Mascarenhas, R. M., Gurudatt, S. P., & AbdAlmageed, W. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58571-6_39 · Cited by 471
AdaptFormer: Adapting Vision Transformers for Scalable Visual Recognition
Chen, S., Ge, C., Tong, Z., Wang, J., Tong, Z., Wang, J., & Luo, P. (2022) · neural information processing systems · doi:10.52202/068431-1212 · Cited by 451
WildDeepfake: A Challenging Real-World Dataset for Deepfake Detection
Zi, B., Chang, M., Chen, J., Ma, X., & Jiang, Y.-G. (2020) · Proceedings of the 28th ACM International Conference on Multimedia · doi:10.1145/3394171.3413769 · Cited by 448
Intriguing Properties of Vision Transformers
Naseer, M., Ranasinghe, K., Khan, S., Hayat, M., Khan, F. S., & Yang, M.-H. (2021) · arXiv · doi:10.48550/arxiv.2105.10497 · Cited by 431
Towards Universal Fake Image Detectors that Generalize Across Generative Models
Ojha, U., Li, Y., & Lee, Y. J. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52729.2023.02345 · Cited by 428
End-to-End Reconstruction-Classification Learning for Face Forgery Detection
Cao, J., Ma, C., Yao, T., Chen, S., Ding, S., & Yang, X. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.00408 · Cited by 428
The deepfake detection challenge (dfdc) dataset
Dolhansky, B., Bitton, J., Pflaum, B., Lu, J., Howes, R., Wang, M., & Ferrer, C. C. (2020) · arXiv · doi:10.48550/arxiv.2006.07397 · Cited by 427
ST-Adapter: Parameter-Efficient Image-To-Video Transfer Learning
Pan, J., Lin, Z., Zhu, X., Shao, J., & Li, H. (2022) · neural information processing systems · doi:10.52202/068431-1919 · Cited by 423
The Deepfake Detection Challenge (DFDC) Preview Dataset
Dolhansky, B., Howes, R., Pflaum, B., Baram, N., & Ferrer, C. C. (2019) · arXiv · doi:10.48550/arxiv.1910.08854 · Cited by 413
Global Texture Enhancement for Fake Face Detection in the Wild
Liu, Z., Qi, X., & Torr, P. H. S. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00808 · Cited by 401
M2TR: Multi-modal Multi-scale Transformers for Deepfake Detection
Wang, J., Wu, Z., Ouyang, W., Han, X., Chen, J., Jiang, Y.-G., & Li, S.-N. (2022) · Proceedings of the 2022 International Conference on Multimedia Retrieval · doi:10.1145/3512527.3531415 · Cited by 368
Li, J., Xie, H., Li, J., Wang, Z., & Zhang, Y. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00639 · Cited by 357
On the Relationship between Self-Attention and Convolutional Layers
Cordonnier, J.-B., Loukas, A., & Jaggi, M. (2019) · arXiv · doi:10.48550/arxiv.1911.03584 · Cited by 354
Local Relation Learning for Face Forgery Detection
Chen, S., Yao, T., Chen, Y., Ding, S., Li, J., & Ji, R. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i2.16193 · Cited by 334
Side Adapter Network for Open-Vocabulary Semantic Segmentation
Xu, M., Zhang, Z., Wei, F., Hu, H., & Bai, X. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52729.2023.00288 · Cited by 316
Zhuang, W., Chu, Q., Tan, Z., Liu, Q., Yuan, H., Miao, C., Luo, Z., & Yu, N. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-20065-6_23 · Cited by 223
Surgical Fine-Tuning Improves Adaptation to Distribution ShiftsPreprint
Lee, Y., Chen, A. S., Tajwar, F., Kumar, A., Yao, H., Liang, P., & Finn, C. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2210.11466 · Cited by 218
Dual Contrastive Learning for General Face Forgery Detection
Sun, K., Yao, T., Chen, S., Ding, S., Li, J., & Ji, R. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i2.20130 · Cited by 209 · cited 3×
“Furthermore, the commonly used cross-entropy loss emphasizes category-level differences but struggles to capture the fine-grained information that reveals subtle differences between manipulated and genuine faces [10], [25], [26].”
Hu, J., Liao, X., Wang, W., & Qin, Z. (2022) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2021.3074259 · Cited by 195
Robust Image Forgery Detection Against Transmission Over Online Social Networks
Wu, H., Zhou, J., Tian, J., Liu, J., & Qiao, Y. (2022) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2022.3144878 · Cited by 188
ISTVT: Interpretable Spatial-Temporal Video Transformer for Deepfake Detection
Zhao, C., Wang, C., Hu, G., Chen, H., Liu, C., & Tang, J. (2023) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2023.3239223 · Cited by 184 · cited 1×
“In response, some methods seek to use Vision Transformers (ViT) for face forgery detection [13], [14], [15], [16].”
MTD-Net: Learning to Detect Deepfakes Images by Multi-Scale Texture Difference
Yang, J., Li, A., Xiao, S., Lu, W., & Gao, X. (2021) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2021.3102487 · Cited by 184
Side-Tuning: A Baseline for Network Adaptation via Additive Side Networks
Zhang, J. O., Sax, A., Zamir, A., Guibas, L., & Malik, J. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58580-8_41 · Cited by 184
Training data-efficient image transformers & distillation through attention
Touvron, H., Cord, M., Douze, M., Massa, F., Sablayrolles, A., & Jégou, H. (2020) · arXiv · doi:10.48550/arxiv.2012.12877 · Cited by 182
F 2 Trans: High-Frequency Fine-Grained Transformer for Face Forgery Detection
Miao, C., Tan, Z., Chu, Q., Liu, H., Hu, H., & Yu, N. (2023) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2022.3233774 · Cited by 172
Transcending Forgery Specificity with Latent Space Augmentation for Generalizable Deepfake Detection
Yan, Z., Luo, Y., Lyu, S., Liu, Q., & Wu, B. (2024) · 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52733.2024.00858 · Cited by 166 · cited 1×
“LSDA [41] diversifies forgery types by augmenting forgery features in the latent space.”
Wang, Y., Yu, K., Chen, C., Hu, X., & Peng, S. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52729.2023.00703 · Cited by 161
Exploiting Fine-Grained Face Forgery Clues via Progressive Enhancement Learning
Gu, Q., Chen, S., Yao, T., Chen, Y., Ding, S., & Yi, R. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i1.19954 · Cited by 158
Zhou, T., Wang, W., Liang, Z., & Shen, J. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00572 · Cited by 156
Domain General Face Forgery Detection by Learning to Weight
Sun, K., Liu, H., Ye, Q., Gao, Y., Liu, J., Shao, L., & Ji, R. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i3.16367 · Cited by 155
Hierarchical Frequency-Assisted Interactive Networks for Face Manipulation Detection
Miao, C., Tan, Z., Chu, Q., Yu, N., & Guo, G. (2022) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2022.3198275 · Cited by 138
Common Sense Reasoning for Deepfake Detection
Zhang, Y., Colman, B., Guo, X. S., Shahriyari, A., & Bharaj, G. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-73223-2_22 · Cited by 134
AUNet: Learning Relations Between Action Units for Face Forgery Detection
Bai, W., Liu, Y., Zhang, Z., Li, B., & Hu, W. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.02367 · Cited by 128
Beyond the Prior Forgery Knowledge: Mining Critical Clues for General Face Forgery Detection
Luo, A., Kong, C., Huang, J., Hu, Y., Kang, X., & Kot, A. C. (2024) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2023.3332218 · Cited by 115
Self-citationLearning Second Order Local Anomaly for General Face Forgery Detection
Fei, J., Dai, Y., Yu, P., Shen, T., Xia, Z., & Weng, J. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01963 · Cited by 115
TALL: Thumbnail Layout for Deepfake Video Detection
Xu, Y., Liang, J., Jia, G., Yang, Z., Zhang, Y., & He, R. (2023) · 2023 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.02071 · Cited by 109 · cited 2×
“In response, some methods seek to use Vision Transformers (ViT) for face forgery detection [13], [14], [15], [16].”
Adaptive Transformers for Robust Few-shot Cross-domain Face Anti-spoofing
Huang, H., Sun, D., Liu, Y., Chu, W., Xiao, T., Yuan, J., Adam, H., & Yang, M. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-19778-9_3 · Cited by 106
Artifacts-Disentangled Adversarial Learning for Deepfake Detection
Li, X., Ni, R., Yang, P., Fu, Z., & Zhao, Y. (2022) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2022.3217950 · Cited by 99
Delving into Sequential Patches for Deepfake Detection
Guan, J., Zhou, H., Hong, Z., Ding, E., Wang, J., Quan, C., & Zhao, Y. (2022) · neural information processing systems · doi:10.52202/068431-0326 · Cited by 97
Detection of Deepfake Videos Using Long-Distance Attention
Lu, W., Liu, L., Zhang, B., Luo, J., Zhao, X., Zhou, Y., & Huang, J. (2023) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3233063 · Cited by 95
Self-citationNGUYEN, D., MEJRI, N., SINGH, I. P., KULESHOVA, P., ASTRID, M., KACEM, A., GHORBEL, E., & AOUADA, D. (2024) · 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52733.2024.01647 · Cited by 93
LiSiam: Localization Invariance Siamese Network for Deepfake Detection
Wang, J., Sun, Y., & Tang, J. (2022) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2022.3186803 · Cited by 91
Guo, Z., Wang, L., Yang, W., Yang, G., & Li, K. (2023) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2023.3289147 · Cited by 78
Face Forgery Detection via Multi-Feature Fusion and Local Enhancement
Zhang, D., Chen, J., Liao, X., Li, F., Chen, J., & Yang, G. (2024) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2024.3390945 · Cited by 77
Improving Deepfake Detection Generalization by Invariant Risk Minimization
Yin, Z., Wang, J., Xiao, Y., Zhao, H., Li, T., Zhou, W., Liu, A., & Liu, X. (2024) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2024.3355651 · Cited by 49
DeepFake-Adapter: Dual-Level Adapter for DeepFake Detection
Shao, R., Wu, T., Nie, L., & Liu, Z. (2025) · International Journal of Computer Vision · doi:10.1007/s11263-024-02274-6 · Cited by 48
WATCHER: Wavelet-Guided Texture-Content Hierarchical Relation Learning for Deepfake Detection
Wang, Y., Chen, C., Zhang, N., & Hu, X. (2024) · International Journal of Computer Vision · doi:10.1007/s11263-024-02116-5 · Cited by 44
Can Vision Transformers Learn without Natural Images?
Nakashima, K., Kataoka, H., Matsumoto, A., Iwata, K., Inoue, N., & Satoh, Y. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i2.20094 · Cited by 40
Transductive Centroid Projection for Semi-supervised Large-Scale Recognition
Liu, Y., Song, G., Shao, J., Xiao, J. J., & Wang, X. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01228-1_5 · Cited by 37
Towards Unified Defense for Face Forgery and Spoofing Attacks via Dual Space Reconstruction Learning
Cao, J., Zhang, K.-Y., Yao, T., Ding, S., Yang, X., & Ma, C. (2024) · International Journal of Computer Vision · doi:10.1007/s11263-024-02151-2 · Cited by 35
Multi-scale Wavelet Transformer for Face Forgery Detection
Liu, J., Wang, J., Zhang, P., Wang, C., Xie, D., & Pu, S. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-26351-4_4 · Cited by 29
Face Forgery Detection via Symmetric Transformer
Song, L., Li, X., Fang, Z., Jin, Z., Chen, Y., & Xu, C. (2022) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3503161.3547806 · Cited by 26
Trade-off between Robustness and Accuracy of Vision Transformers
Li, Y., & Xu, C. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52729.2023.00730 · Cited by 23
HDDA: Human-perception-centric Deepfake Detection Adapter
Ma, X., Tian, J., Chai, Y., Dai, J., Li, Z., Zang, L., & Han, J. (2024) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn60899.2024.10651342 · Cited by 3
Research works printed but not linked: 6
- Hu, LoRA: Low-rank adaptation of large language models, 1
- 2019, Dfd Dataset
- Dosovitskiy, An image is worth 16×16 words: Transformers for image recognition at scale, 1
- 2018, Github Deepfake Faceswap
- 2019, Deepfakes Faceswap
- Maaten, 2008, Visualizing data using t-SNE, J. Mach. Learn. Res., 9, 2579
Cited by
Towards General Visual-Linguistic Face Forgery Detection
Sun, K., Chen, S., Yao, T., Zhou, Z., Ji, J., Sun, X., Lin, C., & Ji, R. (2025) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52734.2025.01823 · Cited by 94
Deepfake Image Forensics for Privacy Protection and Authenticity Using Deep Learning
Sohail, S., Sajjad, S. M., Zafar, A., Iqbal, Z., Muhammad, Z., & Kazim, M. Z. (2025) · Information · doi:10.3390/info16040270 · Cited by 44
Rehearsal-Free and Efficient Continual Learning for Cross-Domain Face Anti-Spoofing
Cai, R., Cui, Y., Yu, Z., Lin, X., Chen, C., & Kot, A. C. (2025) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2025.3601053 · Cited by 26
Self-citationOpen-Set Deepfake Detection: A Parameter-Efficient Adaptation Method With Forgery Style Mixture
Kong, C., Luo, A., Bao, P., Li, H., Wan, R., Zheng, Z., Rocha, A., & Kot, A. C. (2026) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2026.3669190 · Cited by 29
Self-citationCustomized Transformer Adapter With Frequency Masking for Deepfake Detection
Shi, Z., Chen, H., Jia, Y., Zhang, D., Lu, W., & Yang, X. (2025) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2025.3574983 · Cited by 18
Metadata
- Authors
- Luo, A., Cai, R., Kong, C., Ju, Y., Kang, X., Huang, J., & Kot, A. C.
- Affiliations
- Sun Yat-sen University (CN)
- Nanyang Technological University (SG)
- Shenzhen MSU-BIT University (CN)
- Venue
- IEEE Transactions on Circuits and Systems for Video Technology
- Published
- 2025-05
- Volume
- 35
- Issue
- 5
- Pages
- 4116-4129
- ISSN
- 1051-8215 (ISSN-L)
- 1558-2205
- OpenAlex
- W4405741798
- Cited by
- 41
- References
- 91
- Citations by year
- 2026: 25 · 2025: 16
- FWCI
- 5.71
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- Locations
- IEEE Transactions on Circuits and Systems for Video Technology (publishedVersion)
- Funders
- National Natural Science Foundation of China (62072484)
- Natural Science Foundation of Guangdong Province (2514050000889)
- Guangdong Key Laboratory of Information Security Technology (2023B1212060026)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Digital Media Forensic Detection
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Face recognition and analysis
- Physical Sciences › Computer Science › Signal Processing › Biometric Identification and Security
- Keywords
- face forgery detection, deepfake detection, vision transformer, adaptive learning, cross-dataset generalization, pre-trained model fine-tuning
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.