Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 45 of the 45 references it cites were found in a registry or an index.

FeatureTransfer: Unsupervised Domain Adaptation for Cross-Domain Deepfake Detection

Open access
Chen, Baoying, Tan, Shunquan · 2021 · Security and Communication Networks

Abstract

Recently, various Deepfake detection methods have been proposed, and most of them are based on convolutional neural networks (CNNs). These detection methods suffer from overfitting on the source dataset and do not perform well on cross-domain datasets which have different distributions from the source dataset. To address these limitations, a new method named FeatureTransfer is proposed in this paper, which is a two-stage Deepfake detection method combining with transfer learning. Firstly, The CNN model pretrained on a third-party large-scale Deepfake dataset can be used to extract the more transferable feature vectors of Deepfake videos in the source and target domains. Secondly, these feature vectors are fed into the domain-adversarial neural network based on backpropagation (BP-DANN) for unsupervised domain adaptive training, where the videos in the source domain have real or fake labels, while the videos in the target domain are unlabelled. The experimental results indicate that the proposed method FeatureTransfer can effectively solve the overfitting problem in Deepfake detection and greatly improve the performance of cross-dataset evaluation.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1155/2021/9942754

Cites

45 of 45 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

  • Squeeze-and-Excitation Networks

    Hu, J., Shen, L., & Sun, G. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00745 · Cited by 35,667 · cited 2×

    “(e proposed method is compared with previous Deepfake detection methods, including Xception [16], FSSpotter [18], Face X-Ray [22], and se_resnext101_32× 4 d [37].”
    BackgroundMethod
  • Learning Transferable Features with Deep Adaptation Networks

    Long, M., Cao, Y., Wang, J., & Jordan, M. I. (2015) · arXiv · doi:10.48550/arxiv.1502.02791 · Cited by 4,505 · cited 1×

    “For instance, correlation alignment (CORAL) [28] and maximum mean discrepancy (MMD) [29] are used to reduce the distribution divergence between domains.”
    Method
  • Deep CORAL: Correlation Alignment for Deep Domain Adaptation

    Sun, B., & Saenko, K. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-49409-8_35 · Cited by 3,757 · cited 1×

    “For instance, correlation alignment (CORAL) [28] and maximum mean discrepancy (MMD) [29] are used to reduce the distribution divergence between domains.”
    Method
  • FaceForensics++: Learning to Detect Manipulated Facial Images

    Rossler, A., Cozzolino, D., Verdoliva, L., Riess, C., Thies, J., & Niessner, M. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00009 · Cited by 3,314 · cited 12×

    “(e FaceForensics++ (FF) [16] dataset contains 1000 pristine (P) videos and 4000 fake videos generated by using the four most advanced facial manipulation methods, including DeepFakes (DF), Face2Face (F2F), FaceSwap (FS), and NeuralTextures (NT).”
    BackgroundMethodInfluential
  • Dlib-ml: A Machine Learning Toolkit

    King, D. E. (2009) · doi:10.5555/1577069.1755843 · Cited by 2,777 · cited 1×

    “As for face detection [7–9], MTCNN (multitask convolutional neural network) [7] and dlib [8] are mostly used as face detectors.”
    Method
  • Unsupervised Domain Adaptation by Backpropagation

    Ganin, Y., & Lempitsky, V. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1409.7495 · Cited by 2,521 · cited 1×

    “Some works are based on discrepancy measurement domain-adversarial learning, such as domain-adversarial neural network (DANN) [30], multiadversarial domain adaptation (MADA) [31], and 2 Security and Communication Networks”
    Background
  • Squeeze-and-Excitation Networks

    Hu, J., Shen, L., Albanie, S., Sun, G. Z., & Wu, E. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1709.01507 · Cited by 1,908 · cited 2×

    “(e proposed method is compared with previous Deepfake detection methods, including Xception [16], FSSpotter [18], Face X-Ray [22], and se_resnext101_32× 4 d [37].”
    BackgroundMethod
  • MesoNet: a Compact Facial Video Forgery Detection Network

    Afchar, D., Nozick, V., Yamagishi, J., & Echizen, I. (2018) · 2018 IEEE International Workshop on Information Forensics and Security (WIFS) · doi:10.1109/wifs.2018.8630761 · Cited by 1,872 · cited 2×

    “Based on this, they proposed that CNN can be used to learn the checkerboard effect characteristics to detect Deepfake videos by directly inputting the face images extracted from video frames, such as MesoNet [15] and XceptionNet [16].”
    Method
  • Celeb-DF: A Large-Scale Challenging Dataset for DeepFake Forensics

    Li, Y., Yang, X., Sun, P., Qi, H., & Lyu, S. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00327 · Cited by 1,846 · cited 7×

    “[19] found that most of the Deepfake detection methods trained and tested on specific datasets can achieve satisfactory performance, but their performances are significantly reduced when themethods are tested on cross-domain datasets, indicating that these methods are overfitting on a specific dataset.”
    BackgroundMethodInfluential
  • Deepfake Video Detection Using Recurrent Neural Networks

    Guera, D., & Delp, E. J. (2018) · 2018 15th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS) · doi:10.1109/avss.2018.8639163 · Cited by 1,285 · cited 1×

    “To detect the Deepfake images or videos, most of the previous works are based on deep learning methods, which can be categorized into two detectionmethods: CNN-basedmethods [10, 13, 15, 16, 20–22] and RCNN-based methods [11, 17, 18].”
    Method

Show all 41 references

Cited by

Metadata

Authors
Chen, B., & Tan, S.
Affiliations
Shenzhen University (CN)
Corresponding author
Tan, Shunquan
Venue
Security and Communication Networks
Publisher
Wiley
Published
2021-06-07
Volume
2021
Pages
1-8
ISSN
  • 1939-0114 (ISSN-L)
  • 1939-0122
OpenAlex
W3172431060
Cited by
23
References
41
Citations by year
2026: 2 · 2025: 6 · 2024: 8 · 2023: 5 · 2022: 2
FWCI
1.35
Type
journal article
Language
en
Open access
Locations
  • Security and Communication Networks (publishedVersion, cc-by)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
Funders
  • Key-Area Research and Development Program of Guangdong Province (2019B010139003, 61772349, U19B2022, 61872244, 2019B151502001, JCYJ20180305124325555)
  • National Natural Science Foundation of China (2019B010139003, 61772349, U19B2022, 61872244, 2019B151502001, JCYJ20180305124325555)
  • Guangdong Basic and Applied Basic Research Foundation (2019B010139003, 61772349, U19B2022, 61872244, 2019B151502001, JCYJ20180305124325555)
  • Shenzhen R&D Program (2019B010139003, 61772349, U19B2022, 61872244, 2019B151502001, JCYJ20180305124325555)
  • Alibaba Group through Alibaba Innovative Research (AIR) Program (2019B010139003, 61772349, U19B2022, 61872244, 2019B151502001, JCYJ20180305124325555)
Topics
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Digital Media Forensic Detection
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Generative Adversarial Networks and Image Synthesis
  • Social Sciences › Sociology and Political Science › Misinformation and Its Impacts
Keywords
deepfake detection, unsupervised domain adaptation, domain generalization, transfer learning, domain adversarial neural networks, overfitting, feature extraction

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.