The DOI matches its Crossref record; 57 of the 57 references it cites were found in a registry or an index.
Fully Unsupervised Deepfake Video Detection Via Enhanced Contrastive Learning
Abstract
Nowadays, Deepfake videos are widely spread over the Internet, which severely impairs the public trustworthiness and social security. Although more and more reliable detectors have recently sprung up for resisting against that new-emerging tampering technique, some challengeable issues still need to be addressed, such that most of Deepfake video detectors under the framework of the supervised mechanism require a large scale of samples with accurate labels for training. When the amount of the training samples with the true labels are not enough or the training data are maliciously poisoned by adversaries, the supervised classifier is probably not reliable for detection. To tackle that tough issue, it is proposed to design a fully unsupervised Deepfake detector. In particular, in the whole procedure of training or testing, we have no idea of any information about the true labels of samples. First, we novelly design a pseudo-label generator for labeling the training samples, where the traditional hand-crafted features are used to characterize both types of samples. Second, the training samples with the pseudo-labels are fed into the proposed enhanced contrastive learner, in which the discriminative features are further extracted and continually refined by iteration on the guidance of the contrastive loss. Last, relying on the inter-frame correlation, we complete the final binary classification between real and fake videos. A large scale of experimental results empirically verify the effectiveness of our proposed unsupervised Deepfake detector on the benchmark datasets including FF++, Celeb-DF, DFD, DFDC, and UADFV. Furthermore, our proposed well-performed detector is superior to the current unsupervised method, and comparable to the baseline supervised methods. More importantly, when facing the problem of the labeled data poisoned by malicious adversaries or insufficient data for training, our proposed unsupervised Deepfake detector performs its powerful superiority.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“while unsupervised contrastive learning [180] maintains reasonable visual detection performance (81 . 98% ACC).”
From Deepfake detection across image, video, and audio: a comprehensive survey with empirical evaluation of generalization and robustness (2026) · cites this paper as [180]
Citations
Cites
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale
Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., Gelly, S., et al. (2020) · arXiv · doi:10.48550/arxiv.2010.11929 · Cited by 47,472
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380
Rethinking the Inception Architecture for Computer Vision
Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., & Wojna, Z. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.308 · Cited by 32,138
Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization
Selvaraju, R. R., Cogswell, M., Das, A., Vedantam, R., Parikh, D., & Batra, D. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.74 · Cited by 24,513
Xception: Deep Learning with Depthwise Separable Convolutions
Chollet, F. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.195 · Cited by 20,380
EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks
Tan, M., & Le, Q. V. (2019) · arXiv · doi:10.48550/arxiv.1905.11946 · Cited by 17,072
Joint Face Detection and Alignment Using Multitask Cascaded Convolutional Networks
Zhang, K., Zhang, Z., Li, Z., & Qiao, Y. (2016) · IEEE Signal Processing Letters · doi:10.1109/lsp.2016.2603342 · Cited by 6,214
FaceForensics++: Learning to Detect Manipulated Facial Images
Rossler, A., Cozzolino, D., Verdoliva, L., Riess, C., Thies, J., & Niessner, M. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00009 · Cited by 3,314
Deep Clustering for Unsupervised Learning of Visual Features
Caron, M., Bojanowski, P., Joulin, A., & Douze, M. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01264-9_9 · Cited by 2,674
MesoNet: a Compact Facial Video Forgery Detection Network
Afchar, D., Nozick, V., Yamagishi, J., & Echizen, I. (2018) · 2018 IEEE International Workshop on Information Forensics and Security (WIFS) · doi:10.1109/wifs.2018.8630761 · Cited by 1,872
Celeb-DF: A Large-Scale Challenging Dataset for DeepFake Forensics
Li, Y., Yang, X., Sun, P., Qi, H., & Lyu, S. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00327 · Cited by 1,846 · cited 1×
“We conduct extensive experiments on the current benchmark datasets: FaceForensics++ (FF++) [5], UADFV [15], Celeb-DF [47], DeepFake Detection Challenge (DFDC) [48], and DeepFake Detection (DFD) [49].”
MethodFace2Face: Real-Time Face Capture and Reenactment of RGB Videos
Thies, J., Zollhofer, M., Stamminger, M., Theobalt, C., & Niessner, M. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.262 · Cited by 1,747
Deferred neural rendering: image synthesis using neural textures
Thies, J., Zollhöfer, M., & Nießner, M. (2019) · ACM Transactions on Graphics · doi:10.1145/3306346.3323035 · Cited by 1,356
Digital Camera Identification From Sensor Pattern Noise
Luka, J., Fridrich, J., & Goljan, M. (2006) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2006.873602 · Cited by 1,328
Deepfake Video Detection Using Recurrent Neural Networks
Guera, D., & Delp, E. J. (2018) · 2018 15th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS) · doi:10.1109/avss.2018.8639163 · Cited by 1,285
Face X-Ray for More General Face Forgery Detection
Li, L., Bao, J., Zhang, T., Yang, H., Chen, D., Wen, F., & Guo, B. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00505 · Cited by 1,211
Exposing Deep Fakes Using Inconsistent Head Poses
Yang, X., Li, Y., & Lyu, S. (2019) · ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2019.8683164 · Cited by 1,196
In Ictu Oculi: Exposing AI Created Fake Videos by Detecting Eye Blinking
Li, Y., Chang, M.-C., & Lyu, S. (2018) · 2018 IEEE International Workshop on Information Forensics and Security (WIFS) · doi:10.1109/wifs.2018.8630787 · Cited by 1,089
(2022) · doi:10.1007/978-3-031-20053-3_27 · Cited by 1,060
Multi-attentional Deepfake Detection
Zhao, H., Wei, T., Zhou, W., Zhang, W., Chen, D., & Yu, N. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00222 · Cited by 1,019
Capsule-forensics: Using Capsule Networks to Detect Forged Images and Videos
Nguyen, H. H., Yamagishi, J., & Echizen, I. (2019) · ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2019.8682602 · Cited by 951
Laws, K. I. (1980) · doi:10.21236/ada083283 · Cited by 851
YouTube-8M: A Large-Scale Video Classification Benchmark
Abu-El-Haija, S., Kothari, N., Lee, J., Natsev, P., Toderici, G. D., Varadarajan, B., & Vijayanarasimhan, S. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1609.08675 · Cited by 848
Exploiting Visual Artifacts to Expose Deepfakes and Face Manipulations
Matern, F., Riess, C., & Stamminger, M. (2019) · 2019 IEEE Winter Applications of Computer Vision Workshops (WACVW) · doi:10.1109/wacvw.2019.00020 · Cited by 824
Exposing DeepFake Videos By Detecting Face Warping Artifacts
Li, Y., & Lyu, S. (2018) · arXiv · doi:10.48550/arxiv.1811.00656 · Cited by 785
Two-Stream Neural Networks for Tampered Face Detection
Zhou, P., Han, X., Morariu, V. I., & Davis, L. S. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2017.229 · Cited by 700
Rethinking Spatial Dimensions of Vision Transformers
Heo, B., Yun, S., Han, D., Chun, S., Choe, J., & Oh, S. J. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01172 · Cited by 640
Lips Don't Lie: A Generalisable and Robust Approach to Face Forgery Detection
Haliassos, A., Vougioukas, K., Petridis, S., & Pantic, M. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00500 · Cited by 537
Noiseprint: A CNN-Based Camera Model Fingerprint
Cozzolino, D., & Verdoliva, L. (2020) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2019.2916364 · Cited by 499 · cited 1×
“Furthermore, dependent of two very effective noise patterns, referring to Photo-Response Non-Uniformity (PRNU) [27] and noiseprint [28], two rounds of clustering, involving the first multi-classification and the second binary classification, are effectively conducted in sequence.”
MethodDeepFakes: a New Threat to Face Recognition? Assessment and Detection
Korshunov, P., & Marcel, S. (2018) · arXiv · doi:10.48550/arxiv.1812.08685 · Cited by 497
Deep learning for deepfakes creation and detection: A survey
Nguyen, T. T., Nguyen, Q. V. H., Nguyen, D. T., Nguyen, D. T., Huynh-The, T., Nahavandi, S., Nguyen, T. T., Pham, Q.-V., & Nguyen, C. M. (2022) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2022.103525 · Cited by 464
Deep Learning for Deepfakes Creation and Detection: A Survey
Nguyen, T. T., Nguyen, Q. V. H., Nguyen, D. T., Nguyen, D. T., Huynh-The, T., Nahavandi, S., Nguyen, T. T., Pham, Q.-V., & Nguyen, C. M. (2019) · arXiv · doi:10.48550/arxiv.1909.11573 · Cited by 464
Recurrent convolutional strategies for face manipulation detection in videos
Sabir, E., Cheng, J., Jaiswal, A., AbdAlmageed, W., Masi, I., & Natarajan, P. (2019) · arXiv · doi:10.48550/arxiv.1905.00582 · Cited by 443
The deepfake detection challenge (dfdc) dataset
Dolhansky, B., Bitton, J., Pflaum, B., Lu, J., Howes, R., Wang, M., & Ferrer, C. C. (2020) · arXiv · doi:10.48550/arxiv.2006.07397 · Cited by 427
(2019) · Cited by 415
M2TR: Multi-modal Multi-scale Transformers for Deepfake Detection
Wang, J., Wu, Z., Ouyang, W., Han, X., Chen, J., Jiang, Y.-G., & Li, S.-N. (2022) · Proceedings of the 2022 International Conference on Multimedia Retrieval · doi:10.1145/3512527.3531415 · Cited by 368
Steganalysis of JPEG images using rich models
Kodovský, J., & Fridrich, J. (2012) · SPIE Proceedings · doi:10.1117/12.907495 · Cited by 297
Sharp Multiple Instance Learning for DeepFake Video Detection
Li, X., Lang, Y., Chen, Y., Mao, X., He, Y., Wang, S., Xue, H., & Lu, Q. (2020) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3394171.3414034 · Cited by 234
Self-citationHu, J., Liao, X., Wang, W., & Qin, Z. (2022) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2021.3074259 · Cited by 195
Improving the Efficiency and Robustness of Deepfakes Detection through Precise Geometric Features
Sun, Z., Han, Y., Hua, Z., Ruan, N., & Jia, W. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00361 · Cited by 180
Predicting Heart Rate Variations of Deepfake Videos using Neural ODE
Fernandes, S. L., Raj, S., Ortiz, E., Vintila, I., Salter, M., Urosevic, G., & Jha, S. K. (2019) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2019.00213 · Cited by 164
Fake Face Detection Methods: Can They Be Generalized?
Khodabakhsh, A., Ramachandra, R., Raja, K., Wasnik, P., & Busch, C. (2018) · 2018 International Conference of the Biometrics Special Interest Group (BIOSIG) · doi:10.23919/biosig.2018.8553251 · Cited by 151
CORE: Consistent Representation Learning for Face Forgery Detection
Ni, Y., Meng, D., Yu, C., Quan, C., Ren, D., & Zhao, Y. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw56347.2022.00011 · Cited by 136
Learning Second Order Local Anomaly for General Face Forgery Detection
Fei, J., Dai, Y., Yu, P., Shen, T., Xia, Z., & Weng, J. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01963 · Cited by 115
Deep learning for deepfakes creation and detection: a survey
Nguyen, T. T., Nguyen, Q. V. H., Nguyen, D. T., Nguyen, D. T., Huynh-The, T., Nahavandi, S., Nguyen, T. T., Pham, Q.-V., & Nguyen, C. M. (2022) · SSRN Electronic Journal · doi:10.2139/ssrn.4030341 · Cited by 112
Hierarchical Contrastive Inconsistency Learning for Deepfake Video Detection
Gu, Z., Yao, T., Chen, Y., Ding, S., & Ma, L. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-19775-8_35 · Cited by 86
Self-citationDeepfakeUCL: Deepfake Detection via Unsupervised Contrastive Learning
Fung, S., Lu, X., Zhang, C., & Li, C. (2021) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn52387.2021.9534089 · Cited by 84
Fighting Fake News: Two Stream Network for Deepfake Detection via Learnable SRM
Han, B., Han, X., Zhang, H., Li, J., & Cao, X. (2021) · IEEE Transactions on Biometrics, Behavior, and Identity Science · doi:10.1109/tbiom.2021.3065735 · Cited by 77
Unsupervised Learning-Based Framework for Deepfake Video Detection
Zhang, L., Qiao, T., Xu, M., Zheng, N., & Xie, S. (2022) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2022.3182509 · Cited by 74
Self-citationDeepfake Forensics via an Adversarial Game
Zhi, W., Guo, Y., & Zuo, W. (2022) · IEEE Transactions on Image Processing · doi:10.1109/tip.2022.3172845 · Cited by 65
Statistical Model-Based Detector via Texture Weight Map: Application in Re-Sampling Authentication
Qiao, T., Shi, R., Luo, X., Xu, M., Zheng, N., & Wu, Y. (2018) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2018.2872863 · Cited by 58
Self-citationCopy Move Forgery Detection based on double matching
Lyu, Q., Luo, J., Liu, K., Yin, X., Liu, J., & Lu, W. (2021) · Journal of Visual Communication and Image Representation · doi:10.1016/j.jvcir.2021.103057 · Cited by 56
Deepfake Video Detection with Spatiotemporal Dropout Transformer
Zhang, D., Lin, F., Hua, Y., Wang, P., Zeng, D., & Ge, S. (2022) · Proceedings of the 30th ACM International Conference on Multimedia · doi:10.1145/3503161.3547913 · Cited by 50
Towards DeepFake video forensics based on facial textural disparities in multi-color channels
Xia, Z., Qiao, T., Xu, M., Zheng, N., & Xie, S. (2022) · Information Sciences · doi:10.1016/j.ins.2022.06.003 · Cited by 47
Self-citationFinding Facial Forgery Artifacts with Parts-Based Detectors
Schwarcz, S. L., & Chellappa, R. (2021) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw53098.2021.00104 · Cited by 40
Reality Transform Adversarial Generators for Image Splicing Forgery Detection and Localization
Bi, X., Zhang, Z., & Xiao, B. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01403 · Cited by 40
Efficient Privacy-Preserving Forensic Method for Camera Model Identification
Chen, Y., Qiao, T., Retraint, F., & Hu, G. (2022) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2022.3185769 · Cited by 9
Self-citation
Research works printed but not linked: 4
- Neyaz, 2020, Security, privacy and steganographic analysis of faceapp and TikTok, Int. J. Comput. Sci. Secur., 14
- Agarwal, Protecting world leaders against Deepfakes, 38
- 10.5555/3524938.3525087 · doi:10.5555/3524938.3525087
- Dufour, 2019, Contributing data to Deepfake detection research, Google AI Blog, 1
Cited by
DeepFake Detection Based on High-Frequency Enhancement Network for Highly Compressed Content
Gao, J., Xia, Z., Marcialis, G. L., Dang, C., Dai, J., & Feng, X. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2024.123732 · Cited by 67
Advancements in detecting Deepfakes: AI algorithms and future prospects − a review
Singh, L. H., Charanarur, P., & Chaudhary, N. K. (2025) · Discover Internet of Things · doi:10.1007/s43926-025-00154-0 · Cited by 57
Nguyen-Le, H.-H., Tran, V.-T., Nguyen, D.-T., & Le-Khac, N.-A. (2026) · Artificial Intelligence Review · doi:10.1007/s10462-026-11608-4 · Cited by 28
Wang, C., Ma, W., Zhang, S., Gui, J., Li, Q., Liu, Y., & Xia, Z. (2026) · IEEE Transactions on Image Processing · doi:10.1109/tip.2026.3678069 · Cited by 24
Sar, A., Sati, S., Choudhury, T., Joshi, P., Sille, R., Srihari, K., & Bansal, K. (2025) · IEEE Access · doi:10.1109/access.2025.3550770 · Cited by 24
Metadata
- Authors
- Qiao, T., Xie, S., Chen, Y., Retraint, F., & Luo, X.
- Affiliations
- Hangzhou Dianzi University (CN)
- Université de Technologie de Troyes (FR)
- State Key Laboratory of Mathematical Engineering and Advanced Computing, Zhengzhou Science and Technology Institute, Zhengzhou, China
- Venue
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- Published
- 2024-07
- Volume
- 46
- Issue
- 7
- Pages
- 4654-4668
- ISSN
- 0162-8828 (ISSN-L)
- 2160-9292
- 1939-3539
- OpenAlex
- W4391092975
- Semantic Scholar
- 336561ac68e258a14dc2fa283793984c526916d9
- Cited by
- 48
- References
- 57
- Citations by year
- 2026: 22 · 2025: 19 · 2024: 7
- FWCI
- 6.75
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- Locations
- IEEE Transactions on Pattern Analysis and Machine Intelligence (publishedVersion)
- PubMed (publishedVersion)
- HAL (submittedVersion)
- Funders
- Zhejiang Provincial Natural Science Foundation of China (LZ23F020006, LTGG24F020008)
- National Natural Science Foundation of China (U23A20305, 62172435)
- National Key Research and Development Program of China (2022YFB3102900.e)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Digital Media Forensic Detection
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Generative Adversarial Networks and Image Synthesis
- Social Sciences › Sociology and Political Science › Misinformation and Its Impacts
- Keywords
- deepfake detection, unsupervised learning, contrastive learning, pseudo-labeling, inter-frame correlation, video forgery detection
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.