The DOI matches its Crossref record; 103 of the 103 references it cites were found in a registry or an index.
FakeCatcher: Detection of Synthetic Portrait Videos using Biological Signals
Open accessAbstract
The recent proliferation of fake portrait videos poses direct threats on society, law, and privacy [1]. Believing the fake video of a politician, distributing fake pornographic content of celebrities, fabricating impersonated fake videos as evidence in courts are just a few real world consequences of deep fakes. We present a novel approach to detect synthetic content in portrait videos, as a preventive solution for the emerging threat of deep fakes. In other words, we introduce a deep fake detector. We observe that detectors blindly utilizing deep learning are not effective in catching fake content, as generative models produce formidably realistic results. Our key assertion follows that biological signals hidden in portrait videos can be used as an implicit descriptor of authenticity, because they are neither spatially nor temporally preserved in fake content. To prove and exploit this assertion, we first engage several signal transformations for the pairwise separation problem, achieving 99.39% accuracy. Second, we utilize those findings to formulate a generalized classifier for fake content, by analyzing proposed signal transformations and corresponding feature sets. Third, we generate novel signal maps and employ a CNN to improve our traditional classifier for detecting synthetic content. Lastly, we release an "in the wild" dataset of fake portrait videos that we collected as a part of our evaluation process. We evaluate FakeCatcher on several datasets, resulting with 96%, 94.65%, 91.50%, and 91.07% accuracies, on Face Forensics [2], Face Forensics++ [3], CelebDF [4], and on our new Deep Fakes Dataset respectively. In addition, our approach produces a significantly superior detection rate against baselines, and does not depend on the source, generator, or properties of the fake content. We also analyze signals from various facial regions, under image distortions, with varying segment durations, from different generators, against unseen datasets, and under several dimensionality reduction techniques.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Thus far, there have been numerous methods proposed to detect deepfakes [25–29].”
From Deep learning for deepfakes creation and detection: A survey (2022) · cites this paper as [29]
The cited source says what the claim attributes to it.
In the citing paper
“As generative models improve, deepfake statistical variations may more accurately approximate natural patterns (Ciftci etal. 2020).”
From Deepfake video detection: challenges and opportunities (2024) · cites this paper as Ciftci et al. 2020
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“Eye-tracking algorithms, known as gaze tracking, are used to analyse the direction in which the subjects of the input video frames are looking. Analysing the anomalies in the gaze direction throughout the frames is one method utilised in the quest to identify deep fakes (Ciftci etal. 2020).”
From Deepfake video detection: challenges and opportunities (2024) · cites this paper as Ciftci et al. 2020
Experimental — accuracy not yet measuredThe check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“While the ISO/IEC JTC 1/SC 42 was created very recently, another standardisation subcommittee under ISO/IEC JTC1 has a much longer history of nearly 20 years: the ISO/IEC JTC 1/SC 3714 that focuses on biometrics-related technology.”
From Deepfake: definitions, performance metrics and standards, datasets, and a meta-review (2024) · cites this paper as [14]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Cortes, C., & Vapnik, V. (1995) · Machine Learning · doi:10.1007/bf00994018 · Cited by 59,421
Cortes, C., & Vapnik, V. (1995) · Machine-mediated learning · doi:10.1023/a:1022627411411 · Cited by 48,374
LIBSVM: A library for support vector machines
Chang, C.-C., & Lin, C.-J. (2011) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/1961189.1961199 · Cited by 40,918
Rethinking the Inception Architecture for Computer Vision
Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., & Wojna, Z. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.308 · Cited by 32,138
Unpaired image-to-image translation using cycle-consistent adversarial networks
Zhu, J.-Y., Park, T., Isola, P., & Efros, A. A. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.244 · Cited by 23,602
Xception: Deep Learning with Depthwise Separable Convolutions
Chollet, F. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.195 · Cited by 20,380
Labaca-Castro, R. (2023) · Machine Learning under Malware Attack · doi:10.1007/978-3-658-40442-0_9 · Cited by 19,272
GAN(Generative Adversarial Nets)
(2017) · Journal of Japan Society for Fuzzy Theory and Intelligent Informatics · doi:10.3156/jsoft.29.5_177_2 · Cited by 19,270
Robust Real-Time Face Detection
Viola, P., & Jones, M. J. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000013087.49260.fb · Cited by 14,097
Welch, P. (1967) · IEEE Transactions on Audio and Electroacoustics · doi:10.1109/tau.1967.1161901 · Cited by 12,277
Research works printed but not linked: 3
- [60][60] P. Zhou, X. Han, V. I. Morariu, and L. S. Davis, 'Two-stream neural networks for tampered face detection,' in IEEE Conf. on Computer Vision and Pattern Recognition Workshops (CVPRW) , 2017, pp. 18311839. -
- [79][79] S. Butterworth et al. , 'On the theory of filter amplifiers,' Wireless Engineer , vol. 7, no. 6, pp. 536-541, 1930. -
- [88][88] G. Koren, 'Wearable sensor for physiological data acquisition in early education,' https://github.com/get/PPG-Heart-Rate-Classifier/ blob/master/thesis%20excerpt.pdf, 2016, accessed: 2018-11-15. -
Cited by
Multi-attentional Deepfake Detection
Zhao, H., Wei, T., Zhou, W., Zhang, W., Chen, D., & Yu, N. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00222 · Cited by 1,019
Media Forensics and DeepFakes: An Overview
Verdoliva, L. (2020) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2020.3002101 · Cited by 979
The Creation and Detection of Deepfakes: A Survey
Mirsky, Y., & Lee, W. (2022) · ACM Computing Surveys · doi:10.1145/3425780 · Cited by 863
Deepfake Detection: A Systematic Literature Review
Rana, M. S., Nobi, M. N., Murali, B., & Sung, A. H. (2022) · IEEE Access · doi:10.1109/access.2022.3154404 · Cited by 573
Masood, M., Nawaz, M., Malik, K. M., Javed, A., Irtaza, A., & Malik, H. (2023) · Applied Intelligence · doi:10.1007/s10489-022-03766-z · Cited by 543
Deep learning for deepfakes creation and detection: A survey
Nguyen, T. T., Nguyen, Q. V. H., Nguyen, D. T., Nguyen, D. T., Huynh-The, T., Nahavandi, S., Nguyen, T. T., Pham, Q.-V., & Nguyen, C. M. (2022) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2022.103525 · Cited by 464
Deep Learning for Deepfakes Creation and Detection: A Survey
Nguyen, T. T., Nguyen, Q. V. H., Nguyen, D. T., Nguyen, D. T., Huynh-The, T., Nahavandi, S., Nguyen, T. T., Pham, Q.-V., & Nguyen, C. M. (2019) · arXiv · doi:10.48550/arxiv.1909.11573 · Cited by 464
WildDeepfake: A Challenging Real-World Dataset for Deepfake Detection
Zi, B., Chang, M., Chen, J., Ma, X., & Jiang, Y.-G. (2020) · Proceedings of the 28th ACM International Conference on Multimedia · doi:10.1145/3394171.3413769 · Cited by 448
A Survey on Deepfake Video Detection
Yu, P., Xia, Z., Fei, J., & Lu, Y. (2021) · IET Biometrics · doi:10.1049/bme2.12031 · Cited by 253
Detecting Deep-Fake Videos from Appearance and Behavior
Agarwal, S., Farid, H., El-Gaaly, T., & Lim, S.-N. (2020) · 2020 IEEE International Workshop on Information Forensics and Security (WIFS) · doi:10.1109/wifs49906.2020.9360904 · Cited by 242
Detecting Deep-Fake Videos from Phoneme-Viseme Mismatches
Agarwal, S., Farid, H., Fried, O., & Agrawala, M. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw50498.2020.00338 · Cited by 234
Deep learning for face anti-spoofing: A survey
Yu, Z., Qin, Y., Li, X., Zhao, C., Lei, Z., & Zhao, G. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3215850 · Cited by 227
Recurrent convolutional structures for audio spoof and video deepfake detection
Chintha, A., Thai, B., Sohrawardi, S. J., Bhatt, K., Hickerson, A., Wright, M., & Ptucha, R. (2020) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2020.2999185 · Cited by 226
ID-Reveal: Identity-aware DeepFake Video Detection
Cozzolino, D., Rossler, A., Thies, J., Niesner, M., & Verdoliva, L. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01483 · Cited by 221
Deepfake video detection: challenges and opportunities
Kaur, A., Noori Hoshyar, A., Saikrishna, V., Firmin, S., & Xia, F. (2024) · Artificial Intelligence Review · doi:10.1007/s10462-024-10810-6 · Cited by 214
“As generative models improve, deepfake statistical variations may more accurately approximate natural patterns (Ciftci et al. 2020).”
Countering Malicious DeepFakes: Survey, Battleground, and Horizon
Juefei-Xu, F., Wang, R., Huang, Y., Guo, Q., Ma, L., & Liu, Y. (2022) · International Journal of Computer Vision · doi:10.1007/s11263-022-01606-8 · Cited by 191
“FakeCatcher (Ciftci et al., 2020a) has collected over 140 online videos, up to 30GB. Unlike most of the fake datasets, it includes “in the wild” videos, independent of the generative model, resolution, compression, content, and context. iFakeFaceDB (Neves et al., 2020) is a fake image dataset for…”
BackgroundMethodIlyas, H., Javed, A., & Malik, K. M. (2023) · Applied Soft Computing · doi:10.1016/j.asoc.2023.110124 · Cited by 186
MTD-Net: Learning to Detect Deepfakes Images by Multi-Scale Texture Difference
Yang, J., Li, A., Xiao, S., Lu, W., & Gao, X. (2021) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2021.3102487 · Cited by 184
ISTVT: Interpretable Spatial-Temporal Video Transformer for Deepfake Detection
Zhao, C., Wang, C., Hu, G., Chen, H., Liu, C., & Tang, J. (2023) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2023.3239223 · Cited by 184
Evading Deepfake-Image Detectors with White- and Black-Box Attacks
Carlini, N., & Farid, H. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw50498.2020.00337 · Cited by 170
FAMM: Facial Muscle Motions for Detecting Compressed Deepfake Videos Over Social Networks
Liao, X., Wang, Y., Wang, T., Hu, J., & Wu, X. (2023) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2023.3278310 · Cited by 169
Creating, Using, Misusing, and Detecting Deep Fakes
Farid, H. (2022) · Journal of Online Trust and Safety · doi:10.54501/jots.v1i4.56 · Cited by 166
Fake face detection via adaptive manipulation traces extraction network
Guo, Z., Yang, G., Chen, J., & Sun, X. (2021) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2021.103170 · Cited by 165
Predicting Heart Rate Variations of Deepfake Videos using Neural ODE
Fernandes, S. L., Raj, S., Ortiz, E., Vintila, I., Salter, M., Urosevic, G., & Jha, S. K. (2019) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2019.00213 · Cited by 164
Çiftçi, U. A., Demir, İ., & Yin, L. (2020) · IEEE International Joint Conference on Biometrics (IJCB) · doi:10.1109/ijcb48548.2020.9304909 · Cited by 160
Self-citationCamera Measurement of Physiological Vital Signs
McDuff, D. (2023) · ACM Computing Surveys · doi:10.1145/3558518 · Cited by 159
A Comprehensive Review of Deep-Learning-Based Methods for Image Forensics
Camacho, I. C., & Wang, K. (2021) · Journal of Imaging · doi:10.3390/jimaging7040069 · Cited by 158
Zhou, T., Wang, W., Liang, Z., & Shen, J. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00572 · Cited by 156
Deep fake detection and classification using error-level analysis and deep learning
Rafique, R., Gantassi, R., Amin, R., Frnda, J., Mustapha, A., & Alshehri, A. H. (2023) · Scientific Reports · doi:10.1038/s41598-023-34629-3 · Cited by 155
A comprehensive overview of Deepfake: generation, detection, datasets, and opportunities
Seow, J. W., Lim, M. K., Phan, R. C. W., & Liu, J. K. (2022) · Neurocomputing · doi:10.1016/j.neucom.2022.09.135 · Cited by 149
DeepFake video detection using convolutional vision transformer
Wodajo, D., & Atnafu, S. (2021) · arXiv · doi:10.48550/arxiv.2102.11126 · Cited by 147
Deepfakes Detection Techniques Using Deep Learning: A Survey
Almars, A. M. (2021) · Journal of Computer and Communications · doi:10.4236/jcc.2021.95003 · Cited by 143
CLIPping the Deception: Adapting Vision-Language Models for Universal Deepfake Detection
Khan, S. A., & Dang‐Nguyen, D. (2024) · International Conference on Multimedia Retrieval · doi:10.1145/3652583.3658035 · Cited by 140
CORE: Consistent Representation Learning for Face Forgery Detection
Ni, Y., Meng, D., Yu, C., Quan, C., Ren, D., & Zhao, Y. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw56347.2022.00011 · Cited by 136
Deep Learning Methods for Remote Heart Rate Measurement: A Review and Future Research Agenda
Cheng, C.-H., Wong, K. L., Chin, J. W., Chan, T. T., & So, R. H. Y. (2021) · Sensors · doi:10.3390/s21186296 · Cited by 136
Forensics Adapter: Adapting CLIP for Generalizable Face Forgery Detection
Cui, X., Li, Y., Luo, A., Zhou, J., & Dong, J. (2025) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52734.2025.01789 · Cited by 136
FakeTagger: Robust Safeguards against DeepFake Dissemination via Provenance Tracking
Wang, R., Juefei-Xu, F., Luo, M., Liu, Y., & Wang, L. (2021) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3474085.3475518 · Cited by 135
AND-rPPG: A novel denoising-rPPG network for improving remote heart rate estimation
Birla, L., & Puneet, G. (2021) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2021.105146 · Cited by 136
Remote photoplethysmography for heart rate measurement: A review
Xiao, H., Liu, T., Sun, Y., Li, Y., Zhao, S., & Avolio, A. P. (2023) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2023.105608 · Cited by 135
Deepfake: definitions, performance metrics and standards, datasets, and a meta-review
Altuncu, E., Franqueira, V. N. L., & Li, S. (2024) · Frontiers in Big Data · doi:10.3389/fdata.2024.1400024 · Cited by 134
“Deep Fakes Dataset [10]: This dataset contains 142 “in the wild” deepfake portrait videos, collected from a range of online sources including news articles, online forums, mobile apps, and research presentations.”
BackgroundDeepfakeStack: A Deep Ensemble-based Learning Technique for Deepfake Detection
Rana, M. S., & Sung, A. H. (2020) · 2020 7th IEEE International Conference on Cyber Security and Cloud Computing (CSCloud)/2020 6th IEEE International Conference on Edge Computing and Scalable Cloud (EdgeCom) · doi:10.1109/cscloud-edgecom49738.2020.00021 · Cited by 133
A Survey on the Detection and Impacts of Deepfakes in Visual, Audio, and Textual Formats
Mubarak, R., Alsboui, T., Alshaikh, O., Inuwa-Dutse, I., Khan, S., & Parkinson, S. (2023) · IEEE Access · doi:10.1109/access.2023.3344653 · Cited by 132
Improving Generalization by Commonality Learning in Face Forgery Detection
Yu, P., Fei, J., Xia, Z., Zhou, Z., & Weng, J. (2022) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2022.3146781 · Cited by 131
DeepFakesON-Phys: DeepFakes Detection based on Heart Rate Estimation
Hernandez-Ortega, J., Tolosana, R., Fierrez, J., & Morales, A. (2020) · arXiv · doi:10.48550/arxiv.2010.00400
Deepfake Text Detection: Limitations and Opportunities
Pu, J., Sarwar, Z., Abdullah, S. M., Rehman, A., Kim, Y., Bhattacharya, P., Javed, M., & Viswanath, B. (2023) · IEEE Symposium on Security and Privacy (S&P) · doi:10.1109/sp46215.2023.10179387 · Cited by 127
FInfer: Frame Inference-Based Deepfake Detection for High-Visual-Quality Videos
Hu, J., Liao, X., Liang, J., Zhou, W., & Qin, Z. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i1.19978 · Cited by 125
Deep Learning for Deepfakes Creation and Detection: A SurveyPreprint
Nguyen, T. T., Nguyen, M. C., Nguyen, D. T., Nguyen, D. T., & Nahavandi, S. (2020) · arXiv (Cornell University) · doi:10.6084/m9.figshare.12731039.v1 · Cited by 124
Faster Than Lies: Real-time Deepfake Detection using Binary Neural Networks
Lanzino, R., Fontana, F., Diko, A., Marini, M. R., & Cinque, L. (2024) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw63382.2024.00381 · Cited by 123
Deepfake Attacks: Generation, Detection, Datasets, Challenges, and Research Directions
Naitali, A., Ridouani, M., Salahdine, F., & Kaabouch, N. (2023) · Computers · doi:10.3390/computers12100216 · Cited by 117
A review of deep learning‐based approaches for deepfake content detection
(2024) · doi:10.1111/exsy.13570 · Cited by 116
A Review of Image Processing Techniques for Deepfakes
Shahzad, H. F., Rustam, F., Flores, E. S., Mazón, J. L. V., Díez, I. D. L. T., & Ashraf, I. (2022) · Sensors · doi:10.3390/s22124556 · Cited by 116
Deepfake Media Forensics: Status and Future Challenges
Amerini, I., Barni, M., Battiato, S., Bestagini, P., Boato, G., Bruni, V., Caldelli, R., De Natale, F., De Nicola, R., Guarnera, L., et al. (2025) · Journal of Imaging · doi:10.3390/jimaging11030073 · Cited by 113
Detecting Multimedia Generated by Large AI Models: A SurveyPreprint
Li, L., Gupta, N., Zhang, Y., Ren, H., Liu, C.-H., Ding, F., Wang, X., Li, X., Verdoliva, L., & Hu, S. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2402.00045 · Cited by 111
A literature review and perspectives in deepfakes: generation, detection, and applications
Dagar, D., & Vishwakarma, D. K. (2022) · International Journal of Multimedia Information Retrieval · doi:10.1007/s13735-022-00241-w · Cited by 111
Proactive Deepfake Defence via Identity Watermarking
Zhao, Y., Liu, B., Ding, M., Liu, B., Zhu, T., & Yu, X. (2023) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv56688.2023.00458 · Cited by 113
Sun, Z., & Li, X. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3367910 · Cited by 108
Deepfake Detection: A Comprehensive Survey from the Reliability Perspective
Wang, T., Liao, X., Chow, K. P., Lin, X., & Wang, Y. (2025) · ACM Computing Surveys · doi:10.1145/3699710 · Cited by 107
MoE-FFD: Mixture of Experts for Generalized and Parameter-Efficient Face Forgery Detection
Kong, C., Luo, A., Bao, P., Yu, Y., Li, H., Zheng, Z., Wang, S., & Kot, A. C. (2025) · IEEE Transactions on Dependable and Secure Computing · doi:10.1109/tdsc.2025.3604443 · Cited by 106
Ming, Z., Visani, M., Luqman, M. M., & Burie, J.-C. (2020) · Journal of Imaging · doi:10.3390/jimaging6120139 · Cited by 105
Babaei, R., Cheng, S. S. M., Duan, R., & Zhao, S. (2025) · Journal of Sensor and Actuator Networks · doi:10.3390/jsan14010017 · Cited by 103
GAN-Generated Faces Detection: A Survey and New Perspectives
Wang, X., Guo, H., Hu, S., Chang, M.-C., & Lyu, S. (2023) · Frontiers in Artificial Intelligence and Applications · doi:10.3233/faia230558 · Cited by 98
Benchmarking Joint Face Spoofing and Forgery Detection With Visual and Physiological Cues
Yu, Z., Cai, R., Li, Z., Yang, W., Shi, J., & Kot, A. C. (2024) · IEEE Transactions on Dependable and Secure Computing · doi:10.1109/tdsc.2024.3352049 · Cited by 98
A Robust Approach to Multimodal Deepfake Detection
Salvi, D., Liu, H., Mandelli, S., Bestagini, P., Zhou, W., Zhang, W., & Tubaro, S. (2023) · Journal of Imaging · doi:10.3390/jimaging9060122 · Cited by 96
Defending Your Voice: Adversarial Attack on Voice Conversion
Huang, C., Lin, Y. Y., Lee, H.-Y., & Lee, L.-S. (2021) · IEEE Spoken Language Technology Workshop (SLT) · doi:10.1109/slt48900.2021.9383529 · Cited by 96
FedForgery: Generalized Face Forgery Detection With Residual Federated Learning
Liu, D., Dang, Z., Peng, C., Zheng, Y., Li, S., Wang, N., & Gao, X. (2023) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2023.3293951 · Cited by 95
Detection of Deepfake Videos Using Long-Distance Attention
Lu, W., Liu, L., Zhang, B., Luo, J., Zhao, X., Zhou, Y., & Huang, J. (2023) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3233063 · Cited by 95
Learning a deep dual-level network for robust DeepFake detection
Pu, W., Hu, J., Wang, X., Li, Y., Hu, S., Zhu, B., Song, R., Song, Q., Wu, X., & Lyu, S. (2022) · Pattern Recognition · doi:10.1016/j.patcog.2022.108832 · Cited by 93
Detecting Deep-Fake Videos from Aural and Oral Dynamics
Agarwal, S., & Farid, H. (2021) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw53098.2021.00109 · Cited by 92
WildDeepfake: A Challenging Real-World Dataset for Deepfake DetectionPreprint
Zi, B., Chang, M., Chen, J., Ma, X., & Jiang, Y. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2101.01456 · Cited by 91
Usman, M. T., Khan, H., Singh, S. K., Lee, M. Y., & Koo, J. (2024) · IEEE Transactions on Consumer Electronics · doi:10.1109/tce.2024.3476477 · Cited by 90
Analyzing Fairness in Deepfake Detection With Massively Annotated Databases
Xu, Y., Terhörst, P., Pedersen, M., & Raja, K. B. (2024) · IEEE Transactions on Technology and Society · doi:10.1109/tts.2024.3365421 · Cited by 89
DFDT: An End-to-End DeepFake Detection Framework Using Vision Transformer
Khormali, A., & Yuan, J.-S. (2022) · Applied Sciences · doi:10.3390/app12062953 · Cited by 88
Tolosana, R., Romero-Tapiador, S., Vera-Rodríguez, R., González-Sosa, E., & Fiérrez, J. (2022) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2022.104673 · Cited by 87
AI-driven disinformation: a framework for organizational preparation and response
Karinshak, E., & Jin, Y. (2023) · Journal of Communication Management · doi:10.1108/jcom-09-2022-0113 · Cited by 87
Where Do Deep Fakes Look? Synthetic Face Detection via Gaze Tracking
Demir, İ., & Ciftci, U. A. (2021) · ACM Symposium on Eye Tracking Research and Applications (ETRA) · doi:10.1145/3448017.3457387 · Cited by 86
Self-citationA Survey on Learning to Reject
Zhang, X.-Y., Xie, G.-S., Li, X., Mei, T., & Liu, C. (2023) · Proceedings of the IEEE · doi:10.1109/jproc.2023.3238024 · Cited by 86
A systematic literature review on deepfake detection techniques
Sharma, V. K., Garg, R. K., & Caudron, Q. (2024) · Multimedia Tools and Applications · doi:10.1007/s11042-024-19906-1 · Cited by 85
MCL: Multimodal Contrastive Learning for Deepfake Detection
Liu, X., Yu, Y., Li, X., & Zhao, Y. (2023) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2023.3312738 · Cited by 83
Video Transformer for Deepfake Detection with Incremental Learning
Khan, S. A., & Dai, H. (2021) · Proceedings of the 29th ACM International Conference on Multimedia · doi:10.1145/3474085.3475332 · Cited by 79
Seeing is Believing: Exploring Perceptual Differences in DeepFake Videos
Tahir, R., Batool, B., Jamshed, H., Jameel, M., Anwar, M., Ahmed, F., Zaffar, M. A., & Zaffar, M. F. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445699 · Cited by 79
Detecting computer-generated disinformation
Stiff, H., & Johansson, F. (2022) · International Journal of Data Science and Analytics · doi:10.1007/s41060-021-00299-5 · Cited by 79
An efficient deepfake video detection using robust deep learning
Qadir, A., Mahum, R., El-Meligy, M. A., Ragab, A. E., AlSalman, A., & Awais, M. (2024) · Heliyon · doi:10.1016/j.heliyon.2024.e25757 · Cited by 78
Augmented Multi-Scale Spatiotemporal Inconsistency Magnifier for Generalized DeepFake Detection
Yu, Y., Zhao, X., Ni, R., Yang, S., Zhao, Y., & Kot, A. C. (2023) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2023.3237322 · Cited by 76
Exploring deepfake technology: creation, consequences and countermeasures
Alanazi, S., & Asif, S. (2024) · Human-Intelligent Systems Integration · doi:10.1007/s42454-024-00054-8 · Cited by 75
A Study of the Human Perception of Synthetic Faces
Shen, B., RichardWebster, B., O’Toole, A. J., Bowyer, K. W., & Scheirer, W. J. (2021) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/fg52635.2021.9667066 · Cited by 74
PulseEdit: Editing Physiological Signals in Facial Videos for Privacy Protection
Chen, M., Liao, X., Wu, M. H., & Wu, M. H. (2022) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2022.3142993 · Cited by 69
An ensemble of CNNs with self-attention mechanism for DeepFake video detection
Omar, K., Sakr, R., & Alrahmawy, M. (2023) · Neural computing & applications (Print) · doi:10.1007/s00521-023-09196-3 · Cited by 47
Dynamic texture analysis for detecting fake faces in video sequences
Bonomi, M., Pasquini, C., & Boato, G. (2021) · Journal of Visual Communication and Image Representation · doi:10.1016/j.jvcir.2021.103239 · Cited by 68
DeepFake Detection Based on High-Frequency Enhancement Network for Highly Compressed Content
Gao, J., Xia, Z., Marcialis, G. L., Dang, C., Dai, J., & Feng, X. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2024.123732 · Cited by 67
MSVT: Multiple Spatiotemporal Views Transformer for DeepFake Video Detection
Yu, Y., Ni, R., Zhao, Y., Yang, S., Xia, F., Jiang, N., & Zhao, G. (2023) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2023.3281448 · Cited by 67
Deepfake forensics analysis: An explainable hierarchical ensemble of weakly supervised models
Silva, S. H., Bethany, M., Votto, A. M., Scarff, I. H., Beebe, N., & Najafirad, P. (2022) · Forensic Science International: Synergy · doi:10.1016/j.fsisyn.2022.100217 · Cited by 66
The Age of Synthetic Realities: Challenges and Opportunities
Cardenuto, J. P., Yang, J., Padilha, R., Wan, R., Moreira, D., Li, H., Wang, S., Andaló, F., Marcel, S., & Rocha, A. D. R. (2023) · APSIPA Transactions on Signal and Information Processing · doi:10.1561/116.00000138 · Cited by 66
DeepFake on Face and Expression Swap: A Review
Waseem, S., Abu Bakar, S. A. R. S., Ahmed, B. A., Omar, Z., Eisa, T. A. E., & Dalam, M. E. E. (2023) · IEEE Access · doi:10.1109/access.2023.3324403 · Cited by 65
TAR: Generalized Forensic Framework to Detect Deepfakes Using Weakly Supervised Learning
Lee, S., Tariq, S., Kim, J., & Woo, S. S. (2021) · IFIP advances in information and communication technology · doi:10.1007/978-3-030-78120-0_23 · Cited by 65
An Enhanced Deep Learning-Based DeepFake Video Detection and Classification System
Awotunde, J. B., Jimoh, R. G., Imoize, A. L., Abdulrazaq, A. T., Li, C., & Lee, C. (2022) · Electronics · doi:10.3390/electronics12010087 · Cited by 65
Supervised Contrastive Learning for Generalizable and Explainable DeepFakes Detection
Xu, Y., Raja, K., & Pedersen, M. (2022) · 2022 IEEE/CVF Winter Conference on Applications of Computer Vision Workshops (WACVW) · doi:10.1109/wacvw54805.2022.00044 · Cited by 62
Hybrid Transformer Network for Deepfake Detection
Khan, S. A., & Dang‐Nguyen, D. (2022) · International Workshop on Content-Based Multimedia Indexing (CBMI) · doi:10.1145/3549555.3549588 · Cited by 62
Self-Supervised Graph Transformer for Deepfake Detection
Khormali, A., & Yuan, J. S. (2024) · IEEE Access · doi:10.1109/access.2024.3392512 · Cited by 62
DeepFakes Detection Based on Heart Rate Estimation: Single- and Multi-frame
Hernandez‐Ortega, J., Tolosana, R., Fiérrez, J., & Morales, A. (2022) · Advances in computer vision and pattern recognition · doi:10.1007/978-3-030-87664-7_12 · Cited by 62
Detecting Real-Time Deep-Fake Videos Using Active Illumination
Gerstner, C. R., & Farid, H. (2022) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw56347.2022.00015 · Cited by 61
Metadata
- Authors
- Ciftci, U. A., Demir, I., & Yin, L.
- Affiliations
- Computer Science, State University of New York at Binghamton, 14787 Binghamton, New York United States (e-mail: uciftci@binghamton.edu)
- -, Intel Corp, 7198 Los Angeles, California United States (e-mail: idemir@purdue.edu)
- Binghamton University (US)
- ORCID
- Yin, Lijun
- Venue
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- Published
- 2024
- Volume
- PP
- Pages
- 1-1
- ISSN
- 0162-8828 (ISSN-L)
- 2160-9292
- 1939-3539
- OpenAlex
- W2909336075
- Cited by
- 499
- References
- 98
- Citations by year
- 2026: 37 · 2025: 85 · 2024: 116
- FWCI
- 25.27
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- IEEE Transactions on Pattern Analysis and Machine Intelligence (publishedVersion)
- PubMed (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- National Science Foundation (CNS-1629898)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Digital Media Forensic Detection
- Physical Sciences › Computer Science › Signal Processing › Biometric Identification and Security
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Generative Adversarial Networks and Image Synthesis
- Keywords
- deepfake detection, biological signals, signal transformation, CNN classifier, FaceForensics++, generative adversarial networks
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.