Generalization of Forgery Detection With Meta Deepfake Detection Model
Open accessThe DOI matches its Crossref record; 82 of the 82 references it cites were found in a registry or an index; 6 of the 7 sources its claims cite were checked for support.
Abstract
Face forgery generating algorithms that produce a range of manipulated videos/images have developed quickly. Consequently, this causes an increase in the production of fake information, making it difficult to identify. Because facial manipulation technologies raise severe concerns, face forgery detection is gaining increasing attention in the area of computer vision. In real-world applications, face forgery detection systems frequently encounter and perform poorly in unseen domains, due to poor generalization. In this paper, we propose a deepfake detection method based on meta-learning called Meta Deepfake Detection (MDD). The goal of the model is to develop a generalized model capable of directly solving new unseen domains without the need for model updates. The MDD algorithm establishes various weights for facial images from various domains. Specifically, MDD uses meta-weight learning to shift information from the source domains to the target domains with meta-optimization steps, which aims for the model to generate effective representations of the source and target domains. We build multi-domain sets using meta splitting strategy to create a meta-train set and meta-test set. Based on these sets, the model determines the gradient descent and obtains backpropagation. The inner and outer loop gradients were aggregated to update the model to enhance generalization. By introducing pair-attention loss and average-center alignment loss, the detection capabilities of the system were substantially enhanced. In addition, we used some evaluation benchmarks established from several popular deepfake datasets to compare the generalization of our proposal in several baselines and assess its effectiveness.
Overview
CoChat Summary
TL;DR
The paper proposes Meta Deepfake Detection (MDD), a meta-learning method for generalizing face forgery detection to unseen domains without model updates. Across several CID and CVD benchmarks, MDD improves AUC over fine-tuned baselines and related methods, with gains attributed to meta-splitting, pair-attention loss, average-center alignment loss, and block shuffling transformation.
Key findings
- On CVD benchmarks, MDD improved AUC over FT-Base from 0.582 to 0.708 on CVD-CV23-1, from 0.672 to 0.788 on CVD-CV23-2, and from 0.717 to 0.821 on CVD-CV23-3.
- On CID benchmarks, MDD improved AUC over FT-Base from 0.903 to 0.931 on CID-DF23, 0.742 to 0.777 on CID-DF40, 0.792 to 0.821 on CID-FF23, 0.669 to 0.691 on CID-FF40, 0.579 to 0.658 on CID-FS23, 0.609 to 0.681 on CID-FS40, 0.764 to 0.791 on CID-NT23, and 0.618 to 0.621 on CID-NT40.
- Ablation on CID-DF23: full MDD reached AUC 0.931, ACC 0.861, LOSS 0.781; without PAL it reached 0.918/0.838/0.819; without ACA 0.921/0.842/0.802; with only softmax loss 0.907/0.829/0.846.
- Block shuffling transformation improved CID-DF23 performance from AUC 0.919 to 0.931, ACC 0.832 to 0.861, and LOSS 0.847 to 0.781. MDD also improved different backbones on CID-DF23: EfficientNet-B0 0.903→0.931, EfficientNet-B4 0.921→0.938, EfficientNet-B7 0.956→0.967, ResNet-50 0.911→0.929.
Methods
- MDD uses meta-learning with meta-splitting: source domains are split into meta-train and meta-test sets, inner-loop and outer-loop gradients are aggregated, and SGD is used for meta-optimization to generalize to unseen target domains without model updates.
- Data come from DFDC, Celeb-DF-v2, and FaceForensics CC; videos are sampled to images, faces are extracted with MTCNN and resized to 224×224 RGB, and only 10 frames of facial extraction are used for training and testing. No data augmentation is used, but block pixel shuffling transformation is applied to part of the extracted face images.
- The backbone is EfficientNet-B0 with 5.3M parameters; hyperparameters include meta-train step-size 0.0005, meta optimization learning rate 0.0005, balancing hyperparameter 0.5, PAL/SOF/ACA balancing hyperparameter 0.01, and batch size 32. Evaluation uses AUC, ACC, and log loss across seven CID/CVD benchmarks, comparing against FT-Base, Multi-task, MLDG, LTW, Multi-Att, and MAML.
Limitations
- The paper states future work will “find a new strategy to develop MDD and experiment with more benchmarks,” indicating the current evaluation is limited to the selected benchmarks.
- The paper states that “the model is less effective for complex models than simples model,” and notes that gains are harder when performance is already high.
- Evident from the text: only 10 frames per video are used for training and testing, and no data augmentation is used except block shuffling, which may limit temporal modeling and robustness; performance on some low-quality settings remains modest, e.g., CID-NT40 AUC improves only from 0.618 to 0.621.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
3 Valid · 1 Not valid · 0 Not checked · 37 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Additionally, several researches in [57] and [58] have demonstrated that creating patches by using characteristics gathered in an image also increases the quality of the training process.”
What the sources say
- Partly supportedcites [57] sourceExperimental — accuracy not yet measured
The Results (p. 7) report better deepfake-detection scores when EfficientNet B0 is used as a patch extractor, and the Conclusions (p. 9) say it extracts visual features. This supports the patch-and-feature aspect of the claim, but the paper measures detection performance, not the quality of the training process itself. (LLM, conf=0.84)
- Partly supportedcites [58] Wodajo, 2021, DeepFake video detection using convolutional vision transformer sourceExperimental — accuracy not yet measured
The Detection section (pp. 4–5) says the model extracts features from face images and splits the resulting feature maps into patches. It does not show that creating those patches improves the quality of training; the Evaluation section (pp. 5–6) reports model performance without isolating the effect of patch creation. (LLM, conf=0.85)
boostedstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“The local spatial structure of the local regions might be destroyed by the shuf ing of the pixels in an image, which prevents the network from extracting valuable features.”
What the sources say
- Partly supportedcites [51] sourceExperimental — accuracy not yet measured
“A. Block Scrambling-Based Image Encryption” (p. 2) describes randomly permuting image blocks, and the same section (p. 3) notes low correlation between blocks after encryption. This supports disruption of spatial relationships between blocks, but not the claim that individual pixels are shuffled or that a network is prevented from extracting features; the paper discusses JPEG compression and jigsaw-puzzle attacks instead. (LLM, conf=0.83)
- Partly supportedcites [52] sourceExperimental — accuracy not yet measured
The “Color-based image encryption” section describes randomly permuting image blocks, which supports the claim’s general premise that scrambling changes the image’s spatial arrangement. It does not say that pixels are shuffled within local regions or that a network is prevented from extracting features; the paper instead evaluates resistance to jigsaw-puzzle reconstruction. (LLM, conf=0.74)
- Partly supportedcites [53] sourceExperimental — accuracy not yet measured
The Brute-Force Attack section (page unavailable) says Tanaka’s method shuffles pixels within blocks, and the Use of Plain Test Images results (page unavailable) say models trained with that scheme could not classify plain test images because of encryption-related damage. The paper does not say that shuffling destroys local spatial structure or specifically prevents the network from extracting useful features; those mechanisms go beyond what our copy reports. (LLM, conf=0.78)
hedgedstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“However, if the blocks of the image are shuf ed in a proper way, it can lead to preserving essential characteristics while also enhancing the quality of the model [55], [56].”
What the sources say
- Not checked — no full text of the sourcecites [55] source
- Partly supportedcites [56] sourceExperimental — accuracy not yet measured
The Related Work section (p. 2) says PatchShuffle shuffles pixels within local patches while largely preserving the image’s global structure. It does not say that shuffling the blocks themselves improves model quality; the performance improvements reported in the Introduction (p. 2) concern Random Erasing, a different operation. (LLM, conf=0.85)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The quality of the model degrades the greatest when the pair-attention loss and average-center alignment loss are not employed.”
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper states — it cites no source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“By introducing pair-attention loss and average-center alignment loss, the detection capabilities of the system were substantially enhanced.”
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
22 more claims
Create a free account to see all 41 claims and every source verdict.
- It may state two separate claims as one. 11
- Probably not a substantial claim. 6
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated major: it would touch a result — a value a result rests on, reported and recomputed p-values on opposite sides of the significance level, two passages that conflict with no sign which is right, or a cited work retracted before this paper was published.
In the paper
§ B. SETTINGS
“In CVD-CV23-2 and CVD-CV23-3, we have used DFDC test set for target domains.”
§ Meta-train:
“| CVD-CV23-2 | NeuralTextures FaceSwap Face2Face DeepFakes | NeuralTextures FaceSwap Face2Face DeepFakes Celeb-DF-v2 | C23 |”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ 1) CID COMPARISONS
“from 0.609 to 0.681 in CID-FS40”
§ C. IMPLEMENTATION DETAILS
“| CID-FS40 | MDD (Ours) | 0.649 | 0.611 | 1.268 |”
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333 · cited 1×
“To evaluate the performance of the model, our comparisons include (i) Base: The model was pre-trained on ImageNet [60] without being fine-tuned on our benchmarks.”
MethodAuto-Encoding Variational Bayes
Kingma, D. P., & Welling, M. (2013) · arXiv · doi:10.48550/arxiv.1312.6114 · Cited by 20,067
Generative adversarial networks
Goodfellow, I., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., Courville, A., & Bengio, Y. (2020) · Communications of the ACM · doi:10.1145/3422622 · Cited by 18,384
EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks
Tan, M., & Le, Q. V. (2019) · arXiv · doi:10.48550/arxiv.1905.11946 · Cited by 17,072
Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks
Finn, C., Abbeel, P., & Levine, S. (2017) · arXiv · doi:10.48550/arxiv.1703.03400 · Cited by 8,512
Joint Face Detection and Alignment Using Multitask Cascaded Convolutional Networks
Zhang, K., Zhang, Z., Li, Z., & Qiao, Y. (2016) · IEEE Signal Processing Letters · doi:10.1109/lsp.2016.2603342 · Cited by 6,214 · cited 3×
“caded convolutional network (MTCNN) [50] library for facial extraction.”
BackgroundMethodRandom Erasing Data Augmentation
Zhong, Z., Zheng, L., Kang, G., Li, S., & Yang, Y. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i07.7000 · Cited by 3,617 · cited 1×
“However, if the blocks of the image are shuffled in a proper way, it can lead to preserving essential characteristics while also enhancing the quality of the model [55], [56].”
BackgroundRandom Erasing Data Augmentation
Zhong, Z., Zheng, L., Kang, G., Li, S., & Yang, Y. (2017) · arXiv · doi:10.48550/arxiv.1708.04896 · Cited by 3,617 · cited 1×
“However, if the blocks of the image are shuffled in a proper way, it can lead to preserving essential characteristics while also enhancing the quality of the model [55], [56].”
BackgroundFaceForensics++: Learning to Detect Manipulated Facial Images
Rossler, A., Cozzolino, D., Verdoliva, L., Riess, C., Thies, J., & Niessner, M. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00009 · Cited by 3,314 · cited 6×
“for deepfake detection have been proposed in [7], [8], [9], [10], and [11].”
BackgroundMethodInfluentialImageNet: A large-scale hierarchical image database
Deng, J. H., Dong, W. F., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvprw.2009.5206848 · Cited by 2,714
Stochastic Backpropagation and Approximate Inference in Deep Generative Models
Rezende, D. J., Mohamed, S., & Wierstra, D. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1401.4082 · Cited by 2,405
Fast Kd-Trees for the Kullback-Leibler Divergence and Other Decomposable Bregman Divergences
Pham, T., & Wagner, H. (2025) · Leibniz international proceedings in informatics · doi:10.4230/lipics.wads.2025.45 · Cited by 2,354
MesoNet: a Compact Facial Video Forgery Detection Network
Afchar, D., Nozick, V., Yamagishi, J., & Echizen, I. (2018) · International Workshop on Information Forensics and Security · doi:10.48550/arxiv.1809.00888 · Cited by 1,940
MesoNet: a Compact Facial Video Forgery Detection Network
Afchar, D., Nozick, V., Yamagishi, J., & Echizen, I. (2018) · 2018 IEEE International Workshop on Information Forensics and Security (WIFS) · doi:10.1109/wifs.2018.8630761 · Cited by 1,872 · cited 1×
“MesoNet [35] presented a method for quickly and effectively identifying face tampering in videos with a focus on two recent methods for creating fake videos that appear to be extremely realistic.”
MethodCeleb-DF: A Large-Scale Challenging Dataset for DeepFake Forensics
Li, Y., Yang, X., Sun, P., Qi, H., & Lyu, S. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00327 · Cited by 1,846 · cited 3×
“To evaluate the quality of our proposed MDD, we use open datasets of facial synthesis, such as DFDC [12], Celeb-DF-v2 [13], FaceForensics ++ [9].”
MethodStarGAN v2: Diverse Image Synthesis for Multiple Domains
Choi, Y., Uh, Y., Yoo, J., & Ha, J.-W. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00821 · Cited by 1,663 · cited 1×
“Star-GANv2 [23] proposed a framework that meets the variety of generated images and scalability across multiple domains when learning a mapping across several visual domains.”
BackgroundLearning to Generalize: Meta-Learning for Domain Generalization
Li, D., Yang, Y., Song, Y.-Z., & Hospedales, T. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11596 · Cited by 1,251 · cited 3×
“We have run official code with our benchmarks (iv) MLDG [14]: This method proposed a novel meta-learning method and a model agnostic training procedure for domain generalization.”
MethodFace X-Ray for More General Face Forgery Detection
Li, L., Bao, J., Zhang, T., Yang, H., Chen, D., Wen, F., & Guo, B. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00505 · Cited by 1,211 · cited 1×
“Many methods for deepfake detection have been proposed in [7], [8], [9], [10], and [11].”
MethodMaskGAN: Towards Diverse and Interactive Facial Image Manipulation
Lee, C.-H., Liu, Z., Wu, L., & Luo, P. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00559 · Cited by 1,130 · cited 2×
“Many manipulation algorithms [4], [5], [6] person without specific skills to produce high-quality fake faces without expert skills and special knowledge for training.”
BackgroundMethodInterpreting the Latent Space of GANs for Semantic Face Editing
Shen, Y., Gu, J., Tang, X., & Zhou, B. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00926 · Cited by 1,063 · cited 1×
“Many manipulation algorithms [4], [5], [6] person without specific skills to produce high-quality fake faces without expert skills and special knowledge for training.”
BackgroundThinking in Frequency: Face Forgery Detection by Mining Frequency-Aware Clues
Qian, Y., Yin, G., Sheng, L., Chen, Z., & Shao, J. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58610-2_6 · Cited by 1,058 · cited 1×
“Many methods for deepfake detection have been proposed in [7], [8], [9], [10], and [11].”
MethodMulti-attentional Deepfake Detection
Zhao, H., Wei, T., Zhou, W., Zhang, W., Chen, D., & Yu, N. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00222 · Cited by 1,019 · cited 1×
“(vi): Multi-attentional model (Multi-Att) [62]: This method proposed a multiple spatial attention network and combined the attention maps-guided high-level semantic information with low-level textural features for face forgery detection.”
MethodCapsule-forensics: Using Capsule Networks to Detect Forged Images and Videos
Nguyen, H. H., Yamagishi, J., & Echizen, I. (2019) · ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2019.8682602 · Cited by 951 · cited 1×
“Capsule-forensics [32] proposed a method that employs a deep convolutional neural network and a capsule network to identify several types of spoofs, including replay attacks that use printed pictures or recorded movies and computer-generated videos.”
MethodAttGAN: Facial attribute editing by only changing what you want
He, Z., Zuo, W., Kan, M., Shan, S., & Chen, X. (2019) · IEEE Transactions on Image Processing · doi:10.1109/tip.2019.2916751 · Cited by 833 · cited 1×
“AttGAN [21] applied an attribute classification constraint to ensure the precise changing of the desired characteristics in the resulting image and preserve attribute-excluding details.”
MethodExploiting Visual Artifacts to Expose Deepfakes and Face Manipulations
Matern, F., Riess, C., & Stamminger, M. (2019) · 2019 IEEE Winter Applications of Computer Vision Workshops (WACVW) · doi:10.1109/wacvw.2019.00020 · Cited by 824
On the Detection of Digital Face Manipulation
Dang, H., Liu, F., Stehouwer, J., Liu, X., & Jain, A. K. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00582 · Cited by 764 · cited 1×
“The work in [30] presented an innovative attention-based layer to boost classification efficiency and generate an attention map showing the altered face areas.”
BackgroundMeta-SGD: Learning to Learn Quickly for Few-Shot Learning
Li, Z., Zhou, F., Chen, F., & Li, H. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1707.09835 · Cited by 763
FSGAN: Subject Agnostic Face Swapping and Reenactment
Nirkin, Y., Keller, Y., & Hassner, T. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00728 · Cited by 706 · cited 1×
“FSGAN [18] proposed Face Swapping GAN, which derives a recurrent neural network (RNN) for face reenactment and adapts to changes in position and expression.”
MethodMulti-task Learning for Detecting and Segmenting Manipulated Facial Images and Videos
Nguyen, H. H., Fang, F., Yamagishi, J., & Echizen, I. (2019) · 2019 IEEE 10th International Conference on Biometrics Theory, Applications and Systems (BTAS) · doi:10.1109/btas46853.2019.9185974 · Cited by 549 · cited 1×
“This method is for a fair comparison with our MDD. (iii) Multi-task [61]: This method proposed a multi-task learning approach to improve the generalization of the model.”
MethodTask Agnostic Meta-Learning for Few-Shot Learning
Jamal, M. A., & Qi, G.-J. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.01199 · Cited by 519 · cited 2×
“TAML [44], which prevents the problem that the model can be biased over some tasks during adapting to new tasks with metalearning technique, especially the tasks that are sampled in the meta-training phase.”
BackgroundFakeCatcher: Detection of Synthetic Portrait Videos using Biological Signals
Ciftci, U. A., Demir, I., & Yin, L. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.3009287 · Cited by 499
The deepfake detection challenge (dfdc) dataset
Dolhansky, B., Bitton, J., Pflaum, B., Lu, J., Howes, R., Wang, M., & Ferrer, C. C. (2020) · arXiv · doi:10.48550/arxiv.2006.07397 · Cited by 427
The Deepfake Detection Challenge (DFDC) Preview Dataset
Dolhansky, B., Howes, R., Pflaum, B., Baram, N., & Ferrer, C. C. (2019) · arXiv · doi:10.48550/arxiv.1910.08854 · Cited by 413
STGAN: A Unified Selective Transfer Network for Arbitrary Image Attribute Editing
Liu, M., Ding, Y., Xia, M., Liu, X., Ding, E., Zuo, W., & Wen, S. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00379 · Cited by 394 · cited 2×
“STGAN [22] presented a selective transfer perspective to utilize the target attribute vector to direct the flexible translation to the desired target domain.”
BackgroundAD-NeRF: Audio Driven Neural Radiance Fields for Talking Head Synthesis
Guo, Y., Chen, K., Liang, S., Liu, Y.-J., Bao, H., & Zhang, J. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00573 · Cited by 384 · cited 1×
“AD-NeRF [28] proposed an audio-driven talking head technique that renders portraits by directly mapping audio characteristics to dynamic neural radiance fields.”
BackgroundDeepFake Detection by Analyzing Convolutional Traces
Guarnera, L., Giudice, O., & Battiato, S. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw50498.2020.00341 · Cited by 374 · cited 1×
“In research [34], with the goal of developing a novel detection technique that can find a forensics trail concealed in images, we concentrate on the analysis of deep fakes of human faces.”
BackgroundCombining EfficientNet and Vision Transformers for Video Deepfake Detection
Coccomini, D. A., Messina, N., Gennaro, C., & Falchi, F. (2022) · Lecture Notes in Computer Science · doi:10.1007/978-3-031-06433-3_19 · Cited by 296 · cited 1×
“Additionally, several researches in [57] and [58] have demonstrated that creating patches by using characteristics gathered in an image also increases the quality of the training process.”
BackgroundNAS-FAS: Static-Dynamic Central Difference Network Search for Face Anti-Spoofing
Yu, Z., Wan, J., Qin, Y., Li, X., Li, S. Z., & Zhao, G. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.3036338 · Cited by 260 · cited 2×
“NAS-FAS [48], presented an approach based on neural architecture search and created a brand-new search space using pooling and central difference”
MethodEncryption-Then-Compression Systems Using Grayscale-Based Image Encryption for JPEG Images
Chuman, T., Sirichotedumrong, W., & Kiya, H. (2019) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2018.2881677 · Cited by 252 · cited 1×
“This is also mentioned in some research related to image encryption [51], [52], [53], [54].”
BackgroundEncryption-Then-Compression Systems Using Grayscale-Based Image Encryption for JPEG Images
Chuman, T., Sirichotedumrong, W., & Kiya, H. (2018) · IEEE Transactions on Information Forensics and Security · doi:10.48550/arxiv.1811.00236 · Cited by 242
OC-FakeDect: Classifying Deepfakes Using One-class Variational Autoencoder
Khalid, H., & Woo, S. S. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw50498.2020.00336 · Cited by 197
Regularized Fine-Grained Meta Face Anti-Spoofing
Shao, R., Lan, X., & Yuen, P. C. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i07.6873 · Cited by 196 · cited 1×
“Some researches used the meta-learning to solve the problem of face forgery detection and face anti-spoofing can be mentioned in the work [45], they designed a novel meta-learning framework named Regularized Fine-grained Meta-learning to identify generalized learning directions in the meta-learning process, which is a…”
MethodFast Context Adaptation via Meta-Learning
Zintgraf, L., Shiarlis, K., Kurin, V., Hofmann, K., & Whiteson, S. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1810.03642 · Cited by 167
MarioNETte: Few-Shot Face Reenactment Preserving Identity of Unseen Targets
Ha, S., Kersner, M., Kim, B., Seo, S., & Kim, D. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i07.6721 · Cited by 157 · cited 2×
“Some related research can be mentioned as MarioNETte [25] which creates professional reen-actments of hidden identities in a few-shot environment to handle attention block of the image, facial landmark transformer, and focus feature alignment.”
BackgroundUnsupervised Learning via Meta-Learning
Hsu, K., Levine, S., & Finn, C. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1810.02334 · Cited by 157
Domain General Face Forgery Detection by Learning to Weight
Sun, K., Liu, H., Ye, Q., Gao, Y., Liu, J., Shao, L., & Ji, R. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i3.16367 · Cited by 155 · cited 3×
“The work in [46] designed a domain generalization model, named learning-to-weight.”
BackgroundMethodInfluentialIncremental learning for the detection and classification of GAN-generated images
Marra, F., Saltori, C., Boato, G., & Verdoliva, L. (2019) · 2019 IEEE International Workshop on Information Forensics and Security (WIFS) · doi:10.1109/wifs47025.2019.9035099 · Cited by 154 · cited 1×
“The work in [39] presented a multi-task incremental learning-based methodology for the detection and classification of manipulated images, the model can adapt to new”
MethodDeepFake video detection using convolutional vision transformer
Wodajo, D., & Atnafu, S. (2021) · arXiv · doi:10.48550/arxiv.2102.11126 · Cited by 147
RSGAN: face swapping and editing using face and hair representation in latent spaces
Natsume, R., Yatagawa, T., & Morishima, S. (2018) · ACM SIGGRAPH 2018 Posters · doi:10.1145/3230744.3230818 · Cited by 140 · cited 1×
“Some remarkable research such as RSGAN [17] proposed a region-separative generative adversarial network, which replaces the handles face and hair appearances in the latent-space representations of the faces and reconstructs the full face to achieve face swapping.”
BackgroundCascade EF-GAN: Progressive Facial Expression Editing With Local Focuses
Wu, R., Zhang, G., Lu, S., & Chen, T. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00507 · Cited by 121
Towards Generalizable Deepfake Detection with Locality-aware AutoEncoder
Du, M., Pentyala, S., Li, Y., & Hu, X. (2020) · Proceedings of the 29th ACM International Conference on Information & Knowledge Management · doi:10.1145/3340531.3411892 · Cited by 114 · cited 1×
“This is also mentioned in some research related to image encryption [51], [52], [53], [54].”
BackgroundLearning to Generalize: Meta-Learning for Domain GeneralizationPreprint
Li, D., Yang, Y., Song, Y.-Z., et al. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1710.03463 · Cited by 113
FReeNet: Multi-Identity Face Reenactment
Zhang, J., Zeng, X., Wang, M., Pan, Y., Liu, L., Liu, Y., Ding, Y., & Fan, C. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00537 · Cited by 111 · cited 1×
“FReeNet [27] proposed a multi-identity face reenactment framework to share a common model and transmit facial expressions from the source face to the target face.”
BackgroundPixel-Based Image Encryption Without Key Management for Privacy-Preserving Deep Neural Networks
Sirichotedumrong, W., Kinoshita, Y., & Kiya, H. (2019) · IEEE Access · doi:10.1109/access.2019.2959017 · Cited by 105 · cited 1×
“This is also mentioned in some research related to image encryption [51], [52], [53], [54].”
BackgroundFakeLocator: Robust Localization of GAN-Based Face Manipulations
Huang, Y., Juefei-Xu, F., Guo, Q., Liu, Y., & Pu, G. (2022) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2022.3141262 · Cited by 102
Exploring Frequency Adversarial Attacks for Face Forgery Detection
Jia, S., Ma, C., Yao, T., Yin, B., Ding, S., & Yang, X. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.00407 · Cited by 97 · cited 1×
“The work in [47] presented a frequency adversarial attack technique based on meta-learning for face forgery detection.”
MethodStarGAN v2: Diverse Image Synthesis for Multiple DomainsPreprint
Choi, Y., Uh, Y., Yoo, J., et al. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1912.01865 · Cited by 96
SSTNet: Detecting Manipulated Faces Through Spatial, Steganalysis and Temporal Features
Wu, X., Xie, Z., Gao, Y., & Xiao, Y. (2020) · ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp40776.2020.9053969 · Cited by 94 · cited 1×
“Many methods for deepfake detection have been proposed in [7], [8], [9], [10], and [11].”
MethodLearning Meta Pattern for Face Anti-Spoofing
Cai, R., Li, Z., Wan, R., Li, H., Hu, Y., & Kot, A. C. (2022) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2022.3158551 · Cited by 91 · cited 1×
“The work in [49] suggested a learnable network to extract Meta Pattern (MP) in their architecture for learning to learn and created a two-stream network utilizing their suggested Hierarchical Fusion Module to hierarchically fuse the input RGB picture and the extracted MP.”
BackgroundDetecting deepfake videos based on spatiotemporal attention and convolutional LSTM
Chen, B., Li, T., & Ding, W. (2022) · Information Sciences · doi:10.1016/j.ins.2022.04.014 · Cited by 88 · cited 1×
“Furthermore, the work in [38] proposed a spatiotemporal attention mechanism combined with Xception-LSTM algorithm to improve deepfake detection.”
MethodMaskGAN: Towards Diverse and Interactive Facial Image ManipulationPreprint
Lee, C., Liu, Z., Wu, L., et al. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1907.11922 · Cited by 83
FSGANv2: Improved Subject Agnostic Face Swapping and Reenactment
Nirkin, Y., Keller, Y., & Hassner, T. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3155571 · Cited by 73
Sirichotedumrong, W., & Kiya, H. (2019) · APSIPA Transactions on Signal and Information Processing · doi:10.1017/atsip.2018.33 · Cited by 71 · cited 1×
“This is also mentioned in some research related to image encryption [51], [52], [53], [54].”
BackgroundMobileFaceSwap: A Lightweight Framework for Video Face Swapping
Xu, Z., Hong, Z., Ding, C., Zhu, Z., Han, J., Liu, J., & Ding, E. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i3.20203 · Cited by 66 · cited 1×
“MobileFaceSwap [20] proposed an advanced face swapping approach with a lightweight Identity-aware Dynamic Network (IDN) to modify the model parameters depending on the identification information dynamically.”
MethodInconsistency-Aware Wavelet Dual-Branch Network for Face Forgery Detection
Jia, G., Zheng, M., Hu, C., Ma, X., Xu, Y., Liu, L., Deng, Y., & He, R. (2021) · IEEE Transactions on Biometrics, Behavior, and Identity Science · doi:10.1109/tbiom.2021.3086109 · Cited by 62 · cited 1×
“Furthermore, the work in [31] designed an inconsistency-aware wavelet dual-branch network to recognize real and fake images.”
BackgroundDeepfake Forensics via an Adversarial Game
Wang, Z., Guo, Y., & Zuo, W. (2021) · IEEE Transactions on Image Processing · doi:10.48550/arxiv.2103.13567 · Cited by 59
FACEGAN: Facial Attribute Controllable rEenactment GAN
Tripathy, S., Kannala, J., & Rahtu, E. (2021) · 2021 IEEE Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv48630.2021.00137 · Cited by 51 · cited 1×
“FACEGAN [29] proposed a model that uses the Action Unit (AU) representation to transfer from the driving face to facial motion.”
MethodRealistic Face Reenactment via Self-Supervised Disentangling of Identity and Pose
Zeng, X., Pan, Y., Wang, M., Zhang, J., & Liu, Y. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i07.6970 · Cited by 50 · cited 1×
“DEA-GAN [26] presented a self-supervised hybrid model that learns an embedded face that is pose-invariant for each video by using a multi-frame deforming auto-encoder.”
MethodDeepfake Forensics via an Adversarial Game
Wang, Z., Guo, Y., & Zuo, W. (2022) · IEEE Transactions on Image Processing · doi:10.1109/tip.2022.3172845 · Cited by 49 · cited 1×
“The research in [41] recommended intensive training to increase generalization performance.”
BackgroundCapsule-Forensics: Using Capsule Networks to Detect Forged Images and VideosPreprint
Nguyen, H. H., Yamagishi, J., & Echizen, I. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1810.11215 · Cited by 49
Thinking in Frequency: Face Forgery Detection by Mining Frequency-aware CluesPreprint
Qian, Y.-Y., Yin, G., Sheng, L., et al. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.09355 · Cited by 42
On the Detection of Digital Face ManipulationPreprint
Dang, H., Liu, F., Stehouwer, J., et al. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1910.01717 · Cited by 41
RSGAN: Face Swapping and Editing using Face and Hair Representation in Latent Spaces
Natsume, R., Yatagawa, T., & Morishima, S. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1804.03447 · Cited by 39
Encryption Inspired Adversarial Defense For Visual Classification
Maung, M., Pyone, A., & Kiya, H. (2020) · 2020 IEEE International Conference on Image Processing (ICIP) · doi:10.1109/icip40778.2020.9190904 · Cited by 26 · cited 1×
“However, if the blocks of the image are shuffled in a proper way, it can lead to preserving essential characteristics while also enhancing the quality of the model [55], [56].”
BackgroundMarioNETte: Few-shot Face Reenactment Preserving Identity of Unseen TargetsPreprint
Ha, S., Kersner, M., Kim, B., et al. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1911.08139 · Cited by 22
Bita-Net: Bi-temporal Attention Network for Facial Video Forgery Detection
Ru, Y., Zhou, W., Liu, Y., Sun, J., & Li, Q. (2021) · IEEE International Joint Conference on Biometrics (IJCB) · doi:10.1109/ijcb52358.2021.9484408 · Cited by 18 · cited 1×
“Bita-Net [37] proposed a model to detect fake faces, which reflects the two-pathway architecture to enhance the forgery detection ability.”
BackgroundFacialGAN: Style Transfer and Attribute Manipulation on Synthetic FacesPreprint
Durall, R., Jam, J., Straßel, D., Yap, M. H., & Keuper, J. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.09425 · Cited by 18
On the Security of Pixel-Based Image Encryption for Privacy-Preserving Deep Neural Networks
Sirichotedumrong, W., Kinoshita, Y., & Kiya, H. (2019) · IEEE Global Conference on Consumer Electronics (GCCE) · doi:10.1109/gcce46687.2019.9014636 · Cited by 18
Cascade EF-GAN: Progressive Facial Expression Editing with Local FocusesPreprint
Wu, R., Zhang, G., Lu, S., et al. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.05905 · Cited by 10
FSGANv2: Improved Subject Agnostic Face Swapping and ReenactmentPreprint
Nirkin, Y., Keller, Y., & Hassner, T. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2202.12972 · Cited by 3
MobileFaceSwap: A Lightweight Framework for Video Face SwappingPreprint
Xu, Z., Hong, Z., Ding, C., et al. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2201.03808
Cited by
Kosarkar, U. P., & Sakarkar, G. (2024) · Multimedia Tools and Applications · doi:10.1007/s11042-024-19220-w · Cited by 210
Exploring autonomous methods for deepfake detection: A detailed survey on techniques and evaluation
Sunil, R., Mer, P., Diwan, A., Mahadeva, R., & Sharma, A. (2025) · Heliyon · doi:10.1016/j.heliyon.2025.e42273 · Cited by 54
Samesh Enathe, V. P., Chandra Mouli, S., & Dheepthi, R. (2024) · International Conference on Advances in Data Engineering and Intelligent Computing Systems (ADICS) · doi:10.1109/adics58448.2024.10533511 · Cited by 12
Raza, A., Basit, A., Amin, A., Arfeen, Z. A., Masud, M. I., Fayyaz, U., & Jumani, T. A. (2026) · AI · doi:10.3390/ai7020068 · Cited by 22
Detecting facial manipulated images via one-class domain generalization
Xu, P., Ma, Z., Mei, X., & Shen, J. (2024) · Multimedia Systems · doi:10.1007/s00530-023-01214-7 · Cited by 7
“To further demonstrate the advantage of our method, we compare the accuracy of our method with that of recent works [2, 22, 28, 34, 36, 38, 39, 42] specifically targeting the generalization of facial manipulation detection on four manipulation techniques of FaceForensics++ with three qualities.”
Metadata
- Authors
- Tran, V.-N., Kwon, S.-G., Lee, S.-H., Le, H.-S., & Kwon, K.-R.
- Affiliations
- Pukyong National University (KR)
- Kyungil University (KR)
- Dong-A University (KR)
- Vietnam National University Ho Chi Minh City (VN)
- Venue
- IEEE Access
- Published
- 2023
- Volume
- 11
- Pages
- 535-546
- ISSN
- 2169-3536 (ISSN-L)
- OpenAlex
- W4312909749
- Semantic Scholar
- f03d0fbdb6ec7eca98c7064eb7a33d15e379b2ca
- Cited by
- 47
- References
- 71
- Citations by year
- 2026: 17 · 2025: 12 · 2024: 16 · 2023: 2
- FWCI
- 2.45
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- IEEE Access (publishedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- Basic Science Research Program through the National Research Foundation of Korea
- Ministry of Education (2020R1I1A306659411, 2020R1F1A1069124)
- Ministry of Science and ICT (MSIT), South Korea, through the Information Technology Research Center (ITRC) Support Program
- Institute for Information & Communications Technology Planning & Evaluation (IITP-2022-2020-0-01797)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Digital Media Forensic Detection
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Face recognition and analysis
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Generative Adversarial Networks and Image Synthesis
- Keywords
- deepfake detection, face forgery detection, meta-learning, domain generalization, unseen domains, face manipulation, fake information
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-09-29, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-09-29 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.