The DOI matches its Crossref record; 45 of the 45 references it cites were found in a registry or an index.
FeatureTransfer: Unsupervised Domain Adaptation for Cross-Domain Deepfake Detection
Open accessAbstract
Recently, various Deepfake detection methods have been proposed, and most of them are based on convolutional neural networks (CNNs). These detection methods suffer from overfitting on the source dataset and do not perform well on cross-domain datasets which have different distributions from the source dataset. To address these limitations, a new method named FeatureTransfer is proposed in this paper, which is a two-stage Deepfake detection method combining with transfer learning. Firstly, The CNN model pretrained on a third-party large-scale Deepfake dataset can be used to extract the more transferable feature vectors of Deepfake videos in the source and target domains. Secondly, these feature vectors are fed into the domain-adversarial neural network based on backpropagation (BP-DANN) for unsupervised domain adaptive training, where the videos in the source domain have real or fake labels, while the videos in the target domain are unlabelled. The experimental results indicate that the proposed method FeatureTransfer can effectively solve the overfitting problem in Deepfake detection and greatly improve the performance of cross-dataset evaluation.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The feature vectors derived from CNN are utilized in Backpropagation Based on Domain-Adversarial Neural Network (BP-DANN) for adversarial TL, leading to higher efficiency than end-to-end adversarial learning.”
From Deepfake detection using deep learning methods: A systematic and comprehensive review (2024) · cites this paper as Chen and Tan (2021)
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Squeeze-and-Excitation Networks
Hu, J., Shen, L., & Sun, G. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00745 · Cited by 35,667 · cited 2×
“(e proposed method is compared with previous Deepfake detection methods, including Xception [16], FSSpotter [18], Face X-Ray [22], and se_resnext101_32× 4 d [37].”
BackgroundMethodLearning Transferable Features with Deep Adaptation Networks
Long, M., Cao, Y., Wang, J., & Jordan, M. I. (2015) · arXiv · doi:10.48550/arxiv.1502.02791 · Cited by 4,505 · cited 1×
“For instance, correlation alignment (CORAL) [28] and maximum mean discrepancy (MMD) [29] are used to reduce the distribution divergence between domains.”
MethodDeep CORAL: Correlation Alignment for Deep Domain Adaptation
Sun, B., & Saenko, K. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-49409-8_35 · Cited by 3,757 · cited 1×
“For instance, correlation alignment (CORAL) [28] and maximum mean discrepancy (MMD) [29] are used to reduce the distribution divergence between domains.”
MethodFaceForensics++: Learning to Detect Manipulated Facial Images
Rossler, A., Cozzolino, D., Verdoliva, L., Riess, C., Thies, J., & Niessner, M. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00009 · Cited by 3,314 · cited 12×
“(e FaceForensics++ (FF) [16] dataset contains 1000 pristine (P) videos and 4000 fake videos generated by using the four most advanced facial manipulation methods, including DeepFakes (DF), Face2Face (F2F), FaceSwap (FS), and NeuralTextures (NT).”
BackgroundMethodInfluentialDlib-ml: A Machine Learning Toolkit
King, D. E. (2009) · doi:10.5555/1577069.1755843 · Cited by 2,777 · cited 1×
“As for face detection [7–9], MTCNN (multitask convolutional neural network) [7] and dlib [8] are mostly used as face detectors.”
MethodUnsupervised Domain Adaptation by Backpropagation
Ganin, Y., & Lempitsky, V. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1409.7495 · Cited by 2,521 · cited 1×
“Some works are based on discrepancy measurement domain-adversarial learning, such as domain-adversarial neural network (DANN) [30], multiadversarial domain adaptation (MADA) [31], and 2 Security and Communication Networks”
BackgroundSqueeze-and-Excitation Networks
Hu, J., Shen, L., Albanie, S., Sun, G. Z., & Wu, E. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1709.01507 · Cited by 1,908 · cited 2×
“(e proposed method is compared with previous Deepfake detection methods, including Xception [16], FSSpotter [18], Face X-Ray [22], and se_resnext101_32× 4 d [37].”
BackgroundMethodMesoNet: a Compact Facial Video Forgery Detection Network
Afchar, D., Nozick, V., Yamagishi, J., & Echizen, I. (2018) · 2018 IEEE International Workshop on Information Forensics and Security (WIFS) · doi:10.1109/wifs.2018.8630761 · Cited by 1,872 · cited 2×
“Based on this, they proposed that CNN can be used to learn the checkerboard effect characteristics to detect Deepfake videos by directly inputting the face images extracted from video frames, such as MesoNet [15] and XceptionNet [16].”
MethodCeleb-DF: A Large-Scale Challenging Dataset for DeepFake Forensics
Li, Y., Yang, X., Sun, P., Qi, H., & Lyu, S. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00327 · Cited by 1,846 · cited 7×
“[19] found that most of the Deepfake detection methods trained and tested on specific datasets can achieve satisfactory performance, but their performances are significantly reduced when themethods are tested on cross-domain datasets, indicating that these methods are overfitting on a specific dataset.”
BackgroundMethodInfluentialDeepfake Video Detection Using Recurrent Neural Networks
Guera, D., & Delp, E. J. (2018) · 2018 15th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS) · doi:10.1109/avss.2018.8639163 · Cited by 1,285 · cited 1×
“To detect the Deepfake images or videos, most of the previous works are based on deep learning methods, which can be categorized into two detectionmethods: CNN-basedmethods [10, 13, 15, 16, 20–22] and RCNN-based methods [11, 17, 18].”
MethodFace X-Ray for More General Face Forgery Detection
Li, L., Bao, J., Zhang, T., Yang, H., Chen, D., Wen, F., & Guo, B. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00505 · Cited by 1,211 · cited 9×
“(e “FSS,” “X-Ray,” “Se_Res,” and “FT” are the short forms of “FSSpotter,” “Face X-Ray,” “se_resnext101_32× 4 d,” and “FeatureTransfer,” respectively.”
MethodInfluentialExposing Deep Fakes Using Inconsistent Head Poses
Yang, X., Li, Y., & Lyu, S. (2019) · ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2019.8683164 · Cited by 1,196 · cited 3×
“Moreover, some Deepfake detection methods [12, 25] are based on traditional machine learning methods, Yang et al.”
BackgroundMethodIn Ictu Oculi: Exposing AI Created Fake Videos by Detecting Eye Blinking
Li, Y., Chang, M.-C., & Lyu, S. (2018) · 2018 IEEE International Workshop on Information Forensics and Security (WIFS) · doi:10.1109/wifs.2018.8630787 · Cited by 1,089 · cited 2×
“[11] found that the people in Deepfake videos blink less frequently.”
BackgroundMethodThinking in Frequency: Face Forgery Detection by Mining Frequency-Aware Clues
Qian, Y., Yin, G., Sheng, L., Chen, Z., & Shao, J. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58610-2_6 · Cited by 1,058
Multi-Adversarial Domain Adaptation
Pei, Z., Cao, Z., Long, M., & Wang, J. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11767 · Cited by 879 · cited 2×
“Some works are based on discrepancy measurement domain-adversarial learning, such as domain-adversarial neural network (DANN) [30], multiadversarial domain adaptation (MADA) [31], and 2 Security and Communication Networks”
BackgroundExploiting Visual Artifacts to Expose Deepfakes and Face Manipulations
Matern, F., Riess, C., & Stamminger, M. (2019) · 2019 IEEE Winter Applications of Computer Vision Workshops (WACVW) · doi:10.1109/wacvw.2019.00020 · Cited by 824 · cited 1×
“[10] found the inconsistent color of the left and right eyes and the geometric deformations of teeth in Deepfake videos.”
BackgroundExposing DeepFake Videos By Detecting Face Warping Artifacts
Li, Y., & Lyu, S. (2018) · arXiv · doi:10.48550/arxiv.1811.00656 · Cited by 785 · cited 2×
“[13] CNN Self-supervised MesoNet [15] CNN RGB XceptionNet [16] CNN RGB Nguyen et al.”
MethodFSGAN: Subject Agnostic Face Swapping and Reenactment
Nirkin, Y., Keller, Y., & Hassner, T. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00728 · Cited by 706 · cited 1×
“(e fake videos in the DFDC-F dataset were created by different methods, including Deepfake Autoencoder (DFAE) [33], MM/NN face swap [34], NTH [35], and FSGAN [36].”
MethodFew-Shot Adversarial Learning of Realistic Neural Talking Head Models
Zakharov, E., Shysheya, A., Burkov, E., & Lempitsky, V. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00955 · Cited by 687 · cited 1×
“(e fake videos in the DFDC-F dataset were created by different methods, including Deepfake Autoencoder (DFAE) [33], MM/NN face swap [34], NTH [35], and FSGAN [36].”
MethodDetecting and Simulating Artifacts in GAN Fake Images
Zhang, X., Karaman, S., & Chang, S.-F. (2019) · 2019 IEEE International Workshop on Information Forensics and Security (WIFS) · doi:10.1109/wifs47025.2019.9035107 · Cited by 567 · cited 1×
“[14] found that the upsample or transposed Hindawi”
BackgroundMulti-task Learning For Detecting and Segmenting Manipulated Facial Images and Videos
Nguyen, H. H., Fang, F., Yamagishi, J., & Echizen, I. (2019) · arXiv · doi:10.48550/arxiv.1906.06876 · Cited by 551
Multi-task Learning for Detecting and Segmenting Manipulated Facial Images and Videos
Nguyen, H. H., Fang, F., Yamagishi, J., & Echizen, I. (2019) · 2019 IEEE 10th International Conference on Biometrics Theory, Applications and Systems (BTAS) · doi:10.1109/btas46853.2019.9185974 · Cited by 549
FakeCatcher: Detection of Synthetic Portrait Videos using Biological Signals
Ciftci, U. A., Demir, I., & Yin, L. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.3009287 · Cited by 499 · cited 3×
“Moreover, some Deepfake detection methods [12, 25] are based on traditional machine learning methods, Yang et al.”
MethodDeepFakes: a New Threat to Face Recognition? Assessment and Detection
Korshunov, P., & Marcel, S. (2018) · arXiv · doi:10.48550/arxiv.1812.08685 · Cited by 497 · cited 5×
“In addition, Xception obtains the best performance on DF-TIMIT (unseen dataset) and FF-FS (seen dataset), while Face X-Ray obtains the best performance on DFD (unseen dataset) in terms of AUC and ERR.”
MethodInfluentialAn ensemble machine learning approach through effective feature extraction to classify fake news
Hakak, S., Alazab, M., Khan, S., Gadekallu, T. R., Maddikunta, P. K. R., & Khan, W. Z. (2021) · Future Generation Computer Systems · doi:10.1016/j.future.2020.11.022 · Cited by 425
The Deepfake Detection Challenge (DFDC) Preview Dataset
Dolhansky, B., Howes, R., Pflaum, B., Baram, N., & Ferrer, C. C. (2019) · arXiv · doi:10.48550/arxiv.1910.08854 · Cited by 413 · cited 8×
“(2) (e feature extractor in preprocessing stage is pretrained on a large-scale Deepfake dataset DFDC-P [23] to extract more transferable feature vectors.”
MethodInfluentialTransfer Learning with Dynamic Adversarial Adaptation Network
Yu, C., Wang, J., Chen, Y., & Huang, M. (2019) · 2019 IEEE International Conference on Data Mining (ICDM) · doi:10.1109/icdm.2019.00088 · Cited by 400 · cited 2×
“transfer learning with dynamic adversarial adaptation network (DAAN) [32].”
BackgroundJaved, A. R., Rehman, S. U., Khan, M. U., Alazab, M., & G, T. R. (2021) · IEEE Transactions on Network Science and Engineering · doi:10.1109/tnse.2021.3059881 · Cited by 331
Multi-Region Probabilistic Histograms for Robust and Scalable Identity Inference
Sanderson, C., & Lovell, B. C. (2009) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-01793-3_21 · Cited by 301 · cited 2×
“(e DeepfakeTIMIT (DF-TIMIT) [38] dataset contains 640 Deepfake videos generated with a GAN-based method [39] and based on VidTIMIT [40] dataset.”
MethodMulti-Task Convolutional Neural Network for Pose-Invariant Face Recognition
Yin, X., & Liu, X. (2018) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2765830 · Cited by 255 · cited 1×
“As for face detection [7–9], MTCNN (multitask convolutional neural network) [7] and dlib [8] are mostly used as face detectors.”
MethodForensicTransfer: Weakly-supervised Domain Adaptation for Forgery Detection
Cozzolino, D., Thies, J., Rössler, A., Riess, C., Nießner, M., & Verdoliva, L. (2018) · arXiv · doi:10.48550/arxiv.1812.02510 · Cited by 221 · cited 4×
“[21] trained the ForensicTransfer on the samples from the source domain and then performed fine-tuning with a small number of samples from the target domain to improve the performance of the ForensicTransfer on the target domain.”
BackgroundMethodInfluentialA Face Emotion Recognition Method Using Convolutional Neural Network and Image Edge Computing
Zhang, H., Jolfaei, A., & Alazab, M. (2019) · IEEE Access · doi:10.1109/access.2019.2949741 · Cited by 205
(2020) · arXiv (Cornell University) · Cited by 204
Applications in Security and Evasions in Machine Learning: A Survey
Sagar, R. V., Jhaveri, R. H., & Borrego, C. (2020) · Electronics · doi:10.3390/electronics9010097 · Cited by 108
DeepFaceLab: A simple, flexible and extensible face swapping framework.
Perov, I., Gao, D., Chervoniy, N., Liu, K., Marangonda, S., Umé, C., Dpfks, Facenheim, C. S., Rp, L., Jiang, J., et al. (2020) · Cited by 106
Celeb-DF: A Large-scale Challenging Dataset for DeepFake ForensicsPreprint
Li, Y., Yang, X., Sun, P., et al. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1909.12962 · Cited by 104 · cited 7×
“[19] found that most of the Deepfake detection methods trained and tested on specific datasets can achieve satisfactory performance, but their performances are significantly reduced when themethods are tested on cross-domain datasets, indicating that these methods are overfitting on a specific dataset.”
BackgroundMethodInfluentialToward Secure Data Fusion in Industrial IoT Using Transfer Learning
Lin, H., Hu, J., Wang, X., Alhamid, M. F., & Piran, M. J. (2021) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2020.3038780 · Cited by 53
FSSPOTTER: Spotting Face-Swapped Video by Spatial and Temporal Clues
Chen, P., Liu, J., Liang, T., Zhou, G., Gao, H., Dai, J., & Han, J. (2020) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme46284.2020.9102914 · Cited by 43 · cited 7×
“(e result with the clip length (T) of 1 in FSSpotter trained on FF-DF dataset is chosen as the image-level result.”
BackgroundMethodInfluentialDetecting and Simulating Artifacts in GAN Fake ImagesPreprint
Zhang, X., Karaman, S., & Chang, S.-F. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1907.06515 · Cited by 39 · cited 1×
“[14] found that the upsample or transposed Hindawi”
BackgroundFacial Action Transfer with Personalized Bilinear Regression
Huang, D., & la Torre, F. D. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-33709-3_11 · Cited by 38 · cited 1×
“(e fake videos in the DFDC-F dataset were created by different methods, including Deepfake Autoencoder (DFAE) [33], MM/NN face swap [34], NTH [35], and FSGAN [36].”
MethodByte-Level Object Identification for Forensic Investigation of Digital Images
Javed, A. R., & Jalil, Z. (2020) · International Conference on Cyber Warfare and Security (ICCWS) · doi:10.1109/iccws48432.2020.9292387 · Cited by 38
Transfer Learning with Dynamic Adversarial Adaptation NetworkPreprint
Yu, C., Wang, J., Chen, Y., et al. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1909.08184 · Cited by 31 · cited 2×
“transfer learning with dynamic adversarial adaptation network (DAAN) [32].”
BackgroundPropagation of Fake News on Social Media: Challenges and Opportunities
Hakak, S., Khan, W. Z., Bhattacharya, S., Gadekallu, T. R., & Choo, K. R. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-66046-8_28 · Cited by 29
Socioscope: I know who you are, a robo, human caller or service number
Azad, M. A., Alazab, M., Riaz, F., Arshad, J., & Abullah, T. (2019) · Future Generation Computer Systems · doi:10.1016/j.future.2019.11.007 · Cited by 16
Author classification using transfer learning and predicting stars in co‐author networks
Abbasi, R., Bashir, A. K., Chen, J., Mateen, A., Piran, M. J., Amin, F., & Luo, B. (2020) · Software Practice and Experience · doi:10.1002/spe.2884 · Cited by 8 · cited 1×
“Recently, transfer learning has been widely used in the field of forensics [21, 26, 27].”
Background
Cited by
Deepfake detection using deep learning methods: A systematic and comprehensive review
Heidari, A., Jafari Navimipour, N., Dag, H., & Unal, M. (2024) · WIREs Data Mining and Knowledge Discovery · doi:10.1002/widm.1520 · Cited by 349
“Likewise, Chen and Tan (2021) introduced feature transfer, a two-stage deepfake detection approach that relies on unsupervised domain adaption.”
BackgroundA Novel Blockchain-Based Deepfake Detection Method Using Federated and Deep Learning Models
Heidari, A., Navimipour, N. J., Dag, H., Talebi, S., & Unal, M. (2024) · Cognitive Computation · doi:10.1007/s12559-024-10255-7 · Cited by 164
“Chen and Tan [42] introduced feature transfer, a two-stage deepfake detection approach that relies on unsupervised domain adaption.”
Fruits Classification and Detection Application Using Deep Learning
Mimma, N.-E.-A., Ahmed, S., Rahman, T., & Khan, R. (2022) · Scientific Programming · doi:10.1155/2022/4194874 · Cited by 70
“According to this approach, the deep learning model was initially trained on source images and evaluated on a dataset from a diferent source [27].”
MethodDeepFake on Face and Expression Swap: A Review
Waseem, S., Abu Bakar, S. A. R. S., Ahmed, B. A., Omar, Z., Eisa, T. A. E., & Dalam, M. E. E. (2023) · IEEE Access · doi:10.1109/access.2023.3324403 · Cited by 65
“Chen et al. [164] proposed a novel two-stage deepfake detection method called FeatureTransfer that leverages transfer learning.”
MethodDeepfakes: evolution and trends
Gil, R., Virgili‐Gomà, J., López, J. M., & García, R. (2023) · Soft Computing · doi:10.1007/s00500-023-08605-y · Cited by 49
“…Li et al. (2021b), Lu et al. (2021), Su et al. (2021), Luo et al. (2021), Biswas et al. (2021), Jiang et al. (2021), Korshunov and Marcel (2021), Chen and Tan (2021), Jin et al. (2021), Khalil et al. (2021), Gu et al. (2021), Yang et al. (2021c), Chintha et al. (2020a), Younus and Hasan…”
Metadata
- Authors
- Chen, B., & Tan, S.
- Affiliations
- Shenzhen University (CN)
- Corresponding author
- Tan, Shunquan
- Venue
- Security and Communication Networks
- Publisher
- Wiley
- Published
- 2021-06-07
- Volume
- 2021
- Pages
- 1-8
- ISSN
- 1939-0114 (ISSN-L)
- 1939-0122
- OpenAlex
- W3172431060
- Cited by
- 23
- References
- 41
- Citations by year
- 2026: 2 · 2025: 6 · 2024: 8 · 2023: 5 · 2022: 2
- FWCI
- 1.35
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Locations
- Security and Communication Networks (publishedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- Funders
- Key-Area Research and Development Program of Guangdong Province (2019B010139003, 61772349, U19B2022, 61872244, 2019B151502001, JCYJ20180305124325555)
- National Natural Science Foundation of China (2019B010139003, 61772349, U19B2022, 61872244, 2019B151502001, JCYJ20180305124325555)
- Guangdong Basic and Applied Basic Research Foundation (2019B010139003, 61772349, U19B2022, 61872244, 2019B151502001, JCYJ20180305124325555)
- Shenzhen R&D Program (2019B010139003, 61772349, U19B2022, 61872244, 2019B151502001, JCYJ20180305124325555)
- Alibaba Group through Alibaba Innovative Research (AIR) Program (2019B010139003, 61772349, U19B2022, 61872244, 2019B151502001, JCYJ20180305124325555)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Digital Media Forensic Detection
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Generative Adversarial Networks and Image Synthesis
- Social Sciences › Sociology and Political Science › Misinformation and Its Impacts
- Keywords
- deepfake detection, unsupervised domain adaptation, domain generalization, transfer learning, domain adversarial neural networks, overfitting, feature extraction
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.