The DOI matches its Crossref record; 87 of the 91 references it cites were found in a registry or an index.
Forgery-Aware Adaptive Learning With Vision Transformer for Generalized Face Forgery Detection
Abstract
With the rapid progress of generative models, the current challenge in face forgery detection is how to effectively detect realistic manipulated faces from different unseen domains. Though previous studies show that pre-trained Vision Transformer (ViT) based models can achieve some promising results after fully fine-tuning on the Deepfake dataset, their generalization performances are still unsatisfactory. To this end, we present a Forgery-aware Adaptive Vision Transformer (FA-ViT) under the adaptive learning paradigm for generalized face forgery detection, where the parameters in the pre-trained ViT are kept fixed while the designed adaptive modules are optimized to capture forgery features. Specifically, a global adaptive module is designed to model long-range interactions among input tokens, which takes advantage of self-attention mechanism to mine global forgery clues. To further explore essential local forgery clues, a local adaptive module is proposed to expose local inconsistencies by enhancing the local contextual association. In addition, we introduce a fine-grained adaptive learning module that emphasizes the common compact representation of genuine faces through relationship learning in fine-grained pairs, driving these proposed adaptive modules to be aware of fine-grained forgery-aware information. Extensive experiments demonstrate that our FA-ViT achieves state-of-the-arts results in the cross-dataset evaluation, and enhances the robustness against unseen perturbations. Particularly, FA-ViT achieves 93.83% and 78.32% AUC scores on Celeb-DF and DFDC datasets in the cross-dataset evaluation. The code and trained model have been released at:https://github.com/LoveSiameseCat/FAViT.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
PyTorch: An Imperative Style, High-Performance Deep Learning Library
Paszke, A., Gross, S., Massa, F., Lerer, A., Bradbury, J., Chanan, G., Killeen, T., Lin, Z., Gimelshein, N., Antiga, L., et al. (2019) · arXiv · doi:10.48550/arxiv.1912.01703 · Cited by 31,473
Xception: Deep Learning with Depthwise Separable Convolutions
Chollet, F. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.195 · Cited by 20,380
EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks
Tan, M., & Le, Q. V. (2019) · arXiv · doi:10.48550/arxiv.1905.11946 · Cited by 17,072
Learning Transferable Visual Models From Natural Language Supervision
Radford, A., Kim, J. W., Hallacy, C., Ramesh, A., Goh, G., Agarwal, S., Sastry, G., Askell, A., Mishkin, P., Clark, J., et al. (2021) · arXiv · doi:10.48550/arxiv.2103.00020 · Cited by 15,293
Joint Face Detection and Alignment Using Multitask Cascaded Convolutional Networks
Zhang, K., Zhang, Z., Li, Z., & Qiao, Y. (2016) · IEEE Signal Processing Letters · doi:10.1109/lsp.2016.2603342 · Cited by 6,214
Grad-CAM++: Generalized Gradient-Based Visual Explanations for Deep Convolutional Networks
Chattopadhay, A., Sarkar, A., Howlader, P., & Balasubramanian, V. N. (2018) · 2018 IEEE Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv.2018.00097 · Cited by 3,639
FaceForensics++: Learning to Detect Manipulated Facial Images
Rossler, A., Cozzolino, D., Verdoliva, L., Riess, C., Thies, J., & Niessner, M. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00009 · Cited by 3,314
Tokens-to-Token ViT: Training Vision Transformers from Scratch on ImageNet
Yuan, L., Chen, Y., Wang, T., Yu, W., Shi, Y., Jiang, Z., Tay, F. E. H., Feng, J., & Yan, S. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00060 · Cited by 2,415
Research works printed but not linked: 6
- Hu, LoRA: Low-rank adaptation of large language models, 1
- 2019, Dfd Dataset
- Dosovitskiy, An image is worth 16×16 words: Transformers for image recognition at scale, 1
- 2018, Github Deepfake Faceswap
- 2019, Deepfakes Faceswap
- Maaten, 2008, Visualizing data using t-SNE, J. Mach. Learn. Res., 9, 2579
Cited by
Towards General Visual-Linguistic Face Forgery Detection
Sun, K., Chen, S., Yao, T., Zhou, Z., Ji, J., Sun, X., Lin, C., & Ji, R. (2025) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52734.2025.01823 · Cited by 94
Deepfake Image Forensics for Privacy Protection and Authenticity Using Deep Learning
Sohail, S., Sajjad, S. M., Zafar, A., Iqbal, Z., Muhammad, Z., & Kazim, M. Z. (2025) · Information · doi:10.3390/info16040270 · Cited by 44
Rehearsal-Free and Efficient Continual Learning for Cross-Domain Face Anti-Spoofing
Cai, R., Cui, Y., Yu, Z., Lin, X., Chen, C., & Kot, A. C. (2025) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2025.3601053 · Cited by 18
Self-citationOpen-Set Deepfake Detection: A Parameter-Efficient Adaptation Method With Forgery Style Mixture
Kong, C., Luo, A., Bao, P., Li, H., Wan, R., Zheng, Z., Rocha, A., & Kot, A. C. (2026) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2026.3669190 · Cited by 29
Self-citationCustomized Transformer Adapter With Frequency Masking for Deepfake Detection
Shi, Z., Chen, H., Jia, Y., Zhang, D., Lu, W., & Yang, X. (2025) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2025.3574983 · Cited by 18
Metadata
- Authors
- Luo, A., Cai, R., Kong, C., Ju, Y., Kang, X., Huang, J., & Kot, A. C.
- Affiliations
- Sun Yat-sen University (CN)
- Nanyang Technological University (SG)
- Shenzhen MSU-BIT University (CN)
- Venue
- IEEE Transactions on Circuits and Systems for Video Technology
- Published
- 2025-05
- Volume
- 35
- Issue
- 5
- Pages
- 4116-4129
- ISSN
- 1051-8215 (ISSN-L)
- 1558-2205
- OpenAlex
- W4405741798
- Cited by
- 41
- References
- 91
- Citations by year
- 2026: 25 · 2025: 16
- FWCI
- 5.71
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- Locations
- IEEE Transactions on Circuits and Systems for Video Technology (publishedVersion)
- Funders
- National Natural Science Foundation of China (62072484)
- Natural Science Foundation of Guangdong Province (2514050000889)
- Guangdong Key Laboratory of Information Security Technology (2023B1212060026)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Digital Media Forensic Detection
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Face recognition and analysis
- Physical Sciences › Computer Science › Signal Processing › Biometric Identification and Security
- Keywords
- face forgery detection, deepfake detection, vision transformer, adaptive learning, cross-dataset generalization, pre-trained model fine-tuning
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Forgery-Aware Adaptive Learning With Vision Transformer for Generalized Face Forgery Detection. https://app.cochat.ai/papers/10.1109/tcsvt.2024.3522091
- The paper
- Luo, A., Cai, R., Kong, C., Ju, Y., Kang, X., Huang, J., & Kot, A. C. (2025). Forgery-Aware Adaptive Learning With Vision Transformer for Generalized Face Forgery Detection. IEEE Transactions on Circuits and Systems for Video Technology. https://doi.org/10.1109/tcsvt.2024.3522091
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.