The DOI matches its Crossref record; 103 of the 103 references it cites were found in a registry or an index.
FakeCatcher: Detection of Synthetic Portrait Videos using Biological Signals
Open accessAbstract
The recent proliferation of fake portrait videos poses direct threats on society, law, and privacy [1]. Believing the fake video of a politician, distributing fake pornographic content of celebrities, fabricating impersonated fake videos as evidence in courts are just a few real world consequences of deep fakes. We present a novel approach to detect synthetic content in portrait videos, as a preventive solution for the emerging threat of deep fakes. In other words, we introduce a deep fake detector. We observe that detectors blindly utilizing deep learning are not effective in catching fake content, as generative models produce formidably realistic results. Our key assertion follows that biological signals hidden in portrait videos can be used as an implicit descriptor of authenticity, because they are neither spatially nor temporally preserved in fake content. To prove and exploit this assertion, we first engage several signal transformations for the pairwise separation problem, achieving 99.39% accuracy. Second, we utilize those findings to formulate a generalized classifier for fake content, by analyzing proposed signal transformations and corresponding feature sets. Third, we generate novel signal maps and employ a CNN to improve our traditional classifier for detecting synthetic content. Lastly, we release an "in the wild" dataset of fake portrait videos that we collected as a part of our evaluation process. We evaluate FakeCatcher on several datasets, resulting with 96%, 94.65%, 91.50%, and 91.07% accuracies, on Face Forensics [2], Face Forensics++ [3], CelebDF [4], and on our new Deep Fakes Dataset respectively. In addition, our approach produces a significantly superior detection rate against baselines, and does not depend on the source, generator, or properties of the fake content. We also analyze signals from various facial regions, under image distortions, with varying segment durations, from different generators, against unseen datasets, and under several dimensionality reduction techniques.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Thus far, there have been numerous methods proposed to detect deepfakes [25–29].”
From Deep learning for deepfakes creation and detection: A survey (2022) · cites this paper as [29]
The cited source says what the claim attributes to it.
In the citing paper
“As generative models improve, deepfake statistical variations may more accurately approximate natural patterns (Ciftci etal. 2020).”
From Deepfake video detection: challenges and opportunities (2024) · cites this paper as Ciftci et al. 2020
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“Eye-tracking algorithms, known as gaze tracking, are used to analyse the direction in which the subjects of the input video frames are looking. Analysing the anomalies in the gaze direction throughout the frames is one method utilised in the quest to identify deep fakes (Ciftci etal. 2020).”
From Deepfake video detection: challenges and opportunities (2024) · cites this paper as Ciftci et al. 2020
Experimental — accuracy not yet measuredThe check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“While the ISO/IEC JTC 1/SC 42 was created very recently, another standardisation subcommittee under ISO/IEC JTC1 has a much longer history of nearly 20 years: the ISO/IEC JTC 1/SC 3714 that focuses on biometrics-related technology.”
From Deepfake: definitions, performance metrics and standards, datasets, and a meta-review (2024) · cites this paper as [14]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Cortes, C., & Vapnik, V. (1995) · Machine Learning · doi:10.1007/bf00994018 · Cited by 59,421
Cortes, C., & Vapnik, V. (1995) · Machine-mediated learning · doi:10.1023/a:1022627411411 · Cited by 48,374
LIBSVM: A library for support vector machines
Chang, C.-C., & Lin, C.-J. (2011) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/1961189.1961199 · Cited by 40,918
Rethinking the Inception Architecture for Computer Vision
Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., & Wojna, Z. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.308 · Cited by 32,138
Unpaired image-to-image translation using cycle-consistent adversarial networks
Zhu, J.-Y., Park, T., Isola, P., & Efros, A. A. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.244 · Cited by 23,602
Xception: Deep Learning with Depthwise Separable Convolutions
Chollet, F. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.195 · Cited by 20,380
Labaca-Castro, R. (2023) · Machine Learning under Malware Attack · doi:10.1007/978-3-658-40442-0_9 · Cited by 19,272
GAN(Generative Adversarial Nets)
(2017) · Journal of Japan Society for Fuzzy Theory and Intelligent Informatics · doi:10.3156/jsoft.29.5_177_2 · Cited by 19,270
Robust Real-Time Face Detection
Viola, P., & Jones, M. J. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000013087.49260.fb · Cited by 14,097
Welch, P. (1967) · IEEE Transactions on Audio and Electroacoustics · doi:10.1109/tau.1967.1161901 · Cited by 12,277
Unsupervised representation learning with deep convolutional generative adversarial networks
Radford, A., Metz, L., & Chintala, S. (2015) · arXiv · doi:10.48550/arxiv.1511.06434 · Cited by 12,235
Wold, S., Esbensen, K., & Geladi, P. (1987) · Chemometrics and Intelligent Laboratory Systems · doi:10.1016/0169-7439(87)80084-9 · Cited by 11,606
Libsvm : A library for support vector machines
Ferrari, V. (2008) · Medical Entomology and Zoology · Cited by 10,122
Deep Learning Face Attributes in the Wild
Liu, Z., Luo, P., Wang, X., & Tang, X. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.425 · Cited by 7,747
Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcasting
Shi, X., Chen, Z., Wang, H., Yeung, D.-Y., Wong, W.-K., & Woo, W.-C. (2015) · arXiv · doi:10.48550/arxiv.1506.04214 · Cited by 7,709
Improved training of Wasserstein GANs
Gulrajani, I., Ahmed, F., Arjovsky, M., Dumoulin, V., & Courville, A. (2017) · arXiv · doi:10.48550/arxiv.1704.00028 · Cited by 6,800
“Least squares generative adversarial networks,”
Mao, X., Li, Q., Xie, H., Lau, R. Y. K., Wang, Z., & Smolley, S. P. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.304 · Cited by 5,437
Progressive Growing of GANs for Improved Quality, Stability, and Variation
Karras, T., Aila, T., Laine, S., & Lehtinen, J. (2017) · arXiv · doi:10.48550/arxiv.1710.10196 · Cited by 4,727
StarGAN: Unified Generative Adversarial Networks for Multi-domain Image-to-Image Translation
Choi, Y., Choi, M., Kim, M., Ha, J.-W., Kim, S., & Choo, J. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00916 · Cited by 4,163
FaceForensics++: Learning to Detect Manipulated Facial Images
Rossler, A., Cozzolino, D., Verdoliva, L., Riess, C., Thies, J., & Niessner, M. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00009 · Cited by 3,314
Fisher discriminant analysis with kernels
Mika, S., Ratsch, G., Weston, J., Scholkopf, B., & Mullers, K. R. (2003) · Neural Networks for Signal Processing IX: Proceedings of the 1999 IEEE Signal Processing Society Workshop (Cat. No.98TH8468) · doi:10.1109/nnsp.1999.788121 · Cited by 2,661
Globally and locally consistent image completion
Iizuka, S., Simo-Serra, E., & Ishikawa, H. (2017) · ACM Transactions on Graphics · doi:10.1145/3072959.3073659 · Cited by 2,203
MesoNet: a Compact Facial Video Forgery Detection Network
Afchar, D., Nozick, V., Yamagishi, J., & Echizen, I. (2018) · 2018 IEEE International Workshop on Information Forensics and Security (WIFS) · doi:10.1109/wifs.2018.8630761 · Cited by 1,872
Celeb-DF: A Large-Scale Challenging Dataset for DeepFake Forensics
Li, Y., Yang, X., Sun, P., Qi, H., & Lyu, S. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00327 · Cited by 1,846 · cited 1×
“e [37] 96.37% 96.00% 96.75% FF [2] Face2Face [37] 96% 94.24% 97.75% FF++ [3] FaceSwap [59] 95.75% 94.75% 96.75% FF++ [3] Deepfakes [57] 94.87% 93.25% 96.50% FF++ [3] All 94.65% 88.25% 96.25% Celeb-DF [4] Default 91.50% 76.40% 99.41% DF (ours) Mixed 91.07% 85.26% 96.89% FF++ [3] Neural Textures [77] 89.12% 86.75% 91.50…”
InfluentialFace2Face: Real-Time Face Capture and Reenactment of RGB Videos
Thies, J., Zollhofer, M., Stamminger, M., Theobalt, C., & Niessner, M. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.262 · Cited by 1,747
A Multimodal Database for Affect Recognition and Implicit Tagging
Soleymani, M., Lichtenauer, J., Pun, T., & Pantic, M. (2012) · IEEE Transactions on Affective Computing · doi:10.1109/t-affc.2011.25 · Cited by 1,664
Non-contact, automated cardiac pulse measurements using video imaging and blind source separation
Poh, M.-Z., McDuff, D. J., & Picard, R. W. (2010) · Optics Express · doi:10.1364/oe.18.010762 · Cited by 1,643
Handbook of discrete and computational geometry
(1998) · Choice Reviews Online · doi:10.5860/choice.35-5707b · Cited by 1,456
Robust pulse rate from chrominance-based rPPG
de Haan, G., & Jeanne, V. (2013) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2013.2266196 · Cited by 1,378
Eulerian video magnification for revealing subtle changes in the world
Wu, H.-Y., Rubinstein, M., Shih, E., Guttag, J., Durand, F., & Freeman, W. (2012) · ACM Transactions on Graphics · doi:10.1145/2185520.2185561 · Cited by 1,357
Deferred neural rendering: image synthesis using neural textures
Thies, J., Zollhöfer, M., & Nießner, M. (2019) · ACM Transactions on Graphics · doi:10.1145/3306346.3323035 · Cited by 1,356
Deepfake Video Detection Using Recurrent Neural Networks
Guera, D., & Delp, E. J. (2018) · 2018 15th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS) · doi:10.1109/avss.2018.8639163 · Cited by 1,285
Handbook of Discrete and Computational Geometry, Second Edition
(2004) · Chapman & Hall/CRC eBooks · doi:10.1201/9781420035315 · Cited by 1,208
Exposing Deep Fakes Using Inconsistent Head Poses
Yang, X., Li, Y., & Lyu, S. (2019) · ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2019.8683164 · Cited by 1,196
In Ictu Oculi: Exposing AI Created Fake Videos by Detecting Eye Blinking
Li, Y., Chang, M.-C., & Lyu, S. (2018) · 2018 IEEE International Workshop on Information Forensics and Security (WIFS) · doi:10.1109/wifs.2018.8630787 · Cited by 1,089
Capsule-forensics: Using Capsule Networks to Detect Forged Images and Videos
Nguyen, H. H., Yamagishi, J., & Echizen, I. (2019) · ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2019.8682602 · Cited by 951
(2016) · Cited by 844
Exploiting Visual Artifacts to Expose Deepfakes and Face Manipulations
Matern, F., Riess, C., & Stamminger, M. (2019) · 2019 IEEE Winter Applications of Computer Vision Workshops (WACVW) · doi:10.1109/wacvw.2019.00020 · Cited by 824
Exposing DeepFake Videos By Detecting Face Warping Artifacts
Li, Y., & Lyu, S. (2018) · arXiv · doi:10.48550/arxiv.1811.00656 · Cited by 785
DeepPhys: Video-Based Physiological Measurement Using Convolutional Attention Networks
Chen, W., & McDuff, D. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01216-8_22 · Cited by 716
Lip reading sentences in the wild
Chung, J. S., Senior, A., Vinyals, O., & Zisserman, A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.367 · Cited by 702
Two-Stream Neural Networks for Tampered Face Detection
Zhou, P., Han, X., Morariu, V. I., & Davis, L. S. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2017.229 · Cited by 700
Huang, R., Zhang, S., Li, T., & He, R. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.267 · Cited by 687
Li, Y., Liu, S., Yang, J., & Yang, M.-H. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.624 · Cited by 645
GANimation: Anatomically-Aware Facial Animation from a Single Image
Pumarola, A., Agudo, A., Martinez, A. M., Sanfeliu, A., & Moreno-Noguer, F. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01249-6_50 · Cited by 621
Wang, T.-C., Liu, M.-Y., Zhu, J.-Y., Liu, G., Tao, A., Kautz, J., & Catanzaro, B. (2018) · arXiv · doi:10.48550/arxiv.1808.06601 · Cited by 594
Face Spoofing Detection Using Colour Texture Analysis
Boulkenafet, Z., Komulainen, J., & Hadid, A. (2016) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2016.2555286 · Cited by 564
Detecting Pulse from Head Motions in Video
Balakrishnan, G., Durand, F., & Guttag, J. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.440 · Cited by 553
WaveLab and Reproducible Research
Buckheit, J. B., & Donoho, D. L. (1995) · Lecture Notes in Statistics · doi:10.1007/978-1-4612-2544-7_5 · Cited by 537
DeepFakes: a New Threat to Face Recognition? Assessment and Detection
Korshunov, P., & Marcel, S. (2018) · arXiv · doi:10.48550/arxiv.1812.08685 · Cited by 497
Kim, H., Garrido, P., Tewari, A., Xu, W., Thies, J., Niessner, M., Pérez, P., Richardt, C., Zollhöfer, M., & Theobalt, C. (2018) · ACM Transactions on Graphics · doi:10.1145/3197517.3201283 · Cited by 475
(2019) · Cited by 415
Spatial patterns underlying population differences in the background EEG
Koles, Z. J., Lazar, M. S., & Zhou, S. Z. (1990) · Brain Topography · doi:10.1007/bf01129656 · Cited by 364
EEG-based emotion recognition during watching movies
Nie, D., Wang, X.-W., Shi, L.-C., & Lu, B.-L. (2011) · 2011 5th International IEEE/EMBS Conference on Neural Engineering · doi:10.1109/ner.2011.5910636 · Cited by 360
MoFA: Model-Based Deep Convolutional Face Autoencoder for Unsupervised Monocular Reconstruction
Tewari, A., Zollhofer, M., Kim, H., Garrido, P., Bernard, F., Perez, P., & Theobalt, C. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.401 · Cited by 343
Tulyakov, S., Alameda-Pineda, X., Ricci, E., Yin, L., Cohn, J. F., & Sebe, N. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.263 · Cited by 340
Self-citationFaceForensics: A Large-scale Video Dataset for Forgery Detection in Human Faces
Rössler, A., Cozzolino, D., Verdoliva, L., Riess, C., Thies, J., & Nießner, M. (2018) · arXiv · doi:10.48550/arxiv.1803.09179 · Cited by 339
Neural Photo Editing with Introspective Adversarial Networks
Brock, A., Lim, T., Ritchie, J. M., & Weston, N. (2016) · arXiv · doi:10.48550/arxiv.1609.07093 · Cited by 275
Learning Residual Images for Face Attribute Manipulation
Shen, W., & Liu, R. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.135 · Cited by 269
Towards Open-Set Identity Preserving Face Synthesis
Bao, J., Chen, D., Wen, F., Li, H., & Hua, G. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00702 · Cited by 257
Heartbeat Time Series Classification With Support Vector Machines
Kampouraki, A., Manis, G., & Nikou, C. (2009) · IEEE Transactions on Information Technology in Biomedicine · doi:10.1109/titb.2008.2003323 · Cited by 254
Eulerian video magnification for revealing subtle changes in the world
Wu, H., Rubinstein, M., Shih, E. I., et al. (2012) · ACM Transactions on Graphics · doi:10.1145/2185520.2335416 · Cited by 252
Face2Face: real-time face capture and reenactment of RGB videos
Thies, J., Zollhöfer, M., Stamminger, M., Theobalt, C., & Nießner, M. (2018) · Communications of the ACM · doi:10.1145/3292039 · Cited by 244
Identification of deep network generated images using disparities in color components
Li, H., Li, B., Tan, S., & Huang, J. (2020) · Signal Processing · doi:10.1016/j.sigpro.2020.107616 · Cited by 241
Real‐Time EEG‐Based Happiness Detection System
Jatupaiboon, N., Pan-ngum, S., & Israsena, P. (2013) · The Scientific World Journal · doi:10.1155/2013/618649 · Cited by 234
Silva, L., Bellon, O. R. P., & Boyer, K. L. (2005) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2005.108 · Cited by 222
Aligned and non-aligned double JPEG detection using convolutional neural networks
Barni, M., Bondi, L., Bonettini, N., Bestagini, P., Costanzo, A., Maggini, M., Tondi, B., & Tubaro, S. (2017) · Journal of Visual Communication and Image Representation · doi:10.1016/j.jvcir.2017.09.003 · Cited by 221
Neural Photo Editing With Introspective Adversarial Networks
Brock, A., Lim, T., Ritchie, J. M., et al. (2017) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.5281/zenodo.807638 · Cited by 212
Copy-move forgery detection: Survey, challenges and future directions
Warif, N. B. A., Wahab, A. W. A., Idris, M. Y. I., Ramli, R., Salleh, R., Shamshirband, S., & Choo, K.-K. R. (2016) · Journal of Network and Computer Applications · doi:10.1016/j.jnca.2016.09.008 · Cited by 211
Heart-to-heart (H2H): authentication for implanted medical devices
Rostami, M., Juels, A., & Koushanfar, F. (2013) · Proceedings of the 2013 ACM SIGSAC conference on Computer & communications security - CCS '13 · doi:10.1145/2508859.2516658 · Cited by 210
GANimation: One-Shot Anatomically Consistent Facial Animation
Pumarola, A., Agudo, A., Martínez, A. M., Sanfeliu, A., & Moreno-Noguer, F. (2019) · International Journal of Computer Vision · doi:10.1007/s11263-019-01210-3 · Cited by 208
ExprGAN: Facial Expression Editing With Controllable Expression Intensity
Ding, H., Sricharan, K., & Chellappa, R. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.12277 · Cited by 207
Face Anti-spoofing Based on General Image Quality Assessment
Galbally, J., & Marcel, S. (2014) · 2014 22nd International Conference on Pattern Recognition · doi:10.1109/icpr.2014.211 · Cited by 199
Physics-Based Generative Adversarial Models for Image Restoration and Beyond
Pan, J., Dong, J., Liu, Y., Zhang, J., Ren, J., Tang, J., Tai, Y.-W., & Yang, M.-H. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.2969348 · Cited by 191
Neural Photo Editing With Introspective Adversarial Networks
Brock, A., Lim, T., Ritchie, J. M., & Weston, N. (2017) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.5281/zenodo.807637 · Cited by 189
Remote heart rate measurement using low-cost RGB face video: a technical literature review
Rouast, P. V., Adam, M. T. P., Chiong, R., Cornforth, D., & Lux, E. (2018) · Frontiers of Computer Science · doi:10.1007/s11704-016-6243-6 · Cited by 187
Motion-Resistant Remote Imaging Photoplethysmography Based on the Optical Properties of Skin
Feng, L., Po, L.-M., Xu, X., Li, Y., & Ma, R. (2015) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2014.2364415 · Cited by 186
Detecting Both Machine and Human Created Fake Face Images In the Wild
Tariq, S., Lee, S., Kim, H., Shin, Y., & Woo, S. S. (2018) · Proceedings of the 2nd International Workshop on Multimedia Privacy and Security · doi:10.1145/3267357.3267367 · Cited by 174
In Ictu Oculi: Exposing AI Generated Fake Face Videos by Detecting Eye Blinking
Li, Y., Chang, M., & Lyu, S. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1806.02877 · Cited by 169
paGAN: real-time avatars using dynamic textures
Nagano, K., Seo, J., Xing, J., Wei, L., Li, Z., Saito, S., Agarwal, A., Fursund, J., & Li, H. (2018) · ACM Transactions on Graphics · doi:10.1145/3272127.3275075 · Cited by 165
Improving Variational Inference with Inverse Autoregressive Flow
Kingma, D. P., Salimans, T., Józefowicz, R., Chen, X., Sutskever, I., & Welling, M. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1606.04934 · Cited by 164
Automated face swapping and its detection
Zhang, Y., Zheng, L., & Thing, V. L. L. (2017) · 2017 IEEE 2nd International Conference on Signal and Image Processing (ICSIP) · doi:10.1109/siprocess.2017.8124497 · Cited by 154
Fake Face Detection Methods: Can They Be Generalized?
Khodabakhsh, A., Ramachandra, R., Raja, K., Wasnik, P., & Busch, C. (2018) · 2018 International Conference of the Biometrics Special Interest Group (BIOSIG) · doi:10.23919/biosig.2018.8553251 · Cited by 151
Pei, S., & Ding, J. (2007) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2007.896271 · Cited by 139
Speaker Inconsistency Detection in Tampered Video
Korshunov, P., & Marcel, S. (2018) · 2018 26th European Signal Processing Conference (EUSIPCO) · doi:10.23919/eusipco.2018.8553270 · Cited by 97
Signal Classification Based on Spectral Correlation Analysis and SVM in Cognitive Radio
Hu, H., Wang, Y., & Song, J. (2008) · International Conference on Advanced Information Networking and Applications (AINA) · doi:10.1109/aina.2008.27 · Cited by 88
ExprGAN: Facial Expression Editing with Controllable Expression IntensityPreprint
Ding, H., Sricharan, K., & Chellappa, R. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1709.03842 · Cited by 83
Kushwaha, V., Singh, M., Singh, R., Mayank Vatsa, A., Ratha, N., & Chellappa, R. (2018) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2018.00008 · Cited by 82
Heart rate measurement in neonatal patients using a webcamera
Scalise, L., Bernacchia, N., Ercoli, I., & Marchionni, P. (2012) · IEEE International Symposium on Medical Measurements and Applications (MeMeA) · doi:10.1109/memea.2012.6226654 · Cited by 77
Bounded Kalman filter method for motion-robust, non-contact heart rate estimation
Prakash, S. K. A., & Tucker, C. S. (2018) · Biomedical Optics Express · doi:10.1364/boe.9.000873 · Cited by 63
A Novel Framework for Remote Photoplethysmography Pulse Extraction on Compressed Videos
Zhao, C., Lin, C., Chen, W., & Li, Z. G. (2018) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2018.00177 · Cited by 62
Arbitrary Facial Attribute Editing: Only Change What You Want.
He, Z., Zuo, W., Kan, M., Shan, S., & Chen, X. (2017) · Cited by 52
Deep Fakes: A Looming Crisis for National Security, Democracy and Privacy?
Citron, D. K., & Chesney, R. (2018) · bepress Legal Repository · Cited by 42
GANimation: Anatomically-aware Facial Animation from a Single ImagePreprint
Pumarola, A., Agudo, A., Martı́nez, A. M., et al. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1807.09251 · Cited by 41
AttGAN: Facial Attribute Editing by Only Changing What You WantPreprint
He, Z., Zuo, W., Kan, M., et al. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1711.10678 · Cited by 41
Face Transfer with Generative Adversarial NetworkPreprint
Xu, R., Zhou, Z., Zhang, W., & Yu, Y. H. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1710.06090 · Cited by 40
Audiovisual synchrony assessment for replay attack detection in talking face biometrics
Boutellaa, E., Boulkenafet, Z., Komulainen, J., & Hadid, A. (2015) · Multimedia Tools and Applications · doi:10.1007/s11042-015-2848-2 · Cited by 24
Automatic modulation classification based on statistical features and Support Vector Machine
Zhang, W. (2014) · URSI General Assembly and Scientific Symposium · doi:10.1109/ursigass.2014.6929232 · Cited by 19
Learning Multimodal Temporal Representation for Dubbing Detection in Broadcast Media
Le, N., & Odobez, J. (2016) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/2964284.2967211 · Cited by 18
Lyapunov features based EEG signal classification by multi-class SVM
Murugavel, A. S. M., Ramakrishnan, S., Balasamy, K., & Gopalakrishnan, T. (2011) · World Congress on Information and Communication Technologies · doi:10.1109/wict.2011.6141243 · Cited by 15
Roy, A., Tariang, D. B., Chakraborty, R. S., & Naskar, R. (2018) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2018.00205 · Cited by 14
On Realism of Architectural Procedural Models
Beneš, J., Kelly, T., Děchtěrenko, F., Křivánek, J., & Müller, P. (2017) · Computer Graphics Forum · doi:10.1111/cgf.13121 · Cited by 12
Ding, J., & Pei, S. (2006) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.5281/zenodo.39621 · Cited by 7
Research works printed but not linked: 3
- [60][60] P. Zhou, X. Han, V. I. Morariu, and L. S. Davis, 'Two-stream neural networks for tampered face detection,' in IEEE Conf. on Computer Vision and Pattern Recognition Workshops (CVPRW) , 2017, pp. 18311839. -
- [79][79] S. Butterworth et al. , 'On the theory of filter amplifiers,' Wireless Engineer , vol. 7, no. 6, pp. 536-541, 1930. -
- [88][88] G. Koren, 'Wearable sensor for physiological data acquisition in early education,' https://github.com/get/PPG-Heart-Rate-Classifier/ blob/master/thesis%20excerpt.pdf, 2016, accessed: 2018-11-15. -
Cited by
Multi-attentional Deepfake Detection
Zhao, H., Wei, T., Zhou, W., Zhang, W., Chen, D., & Yu, N. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00222 · Cited by 1,019
Media Forensics and DeepFakes: An Overview
Verdoliva, L. (2020) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2020.3002101 · Cited by 979
The Creation and Detection of Deepfakes: A Survey
Mirsky, Y., & Lee, W. (2022) · ACM Computing Surveys · doi:10.1145/3425780 · Cited by 863
Deepfake Detection: A Systematic Literature Review
Rana, M. S., Nobi, M. N., Murali, B., & Sung, A. H. (2022) · IEEE Access · doi:10.1109/access.2022.3154404 · Cited by 573
Masood, M., Nawaz, M., Malik, K. M., Javed, A., Irtaza, A., & Malik, H. (2023) · Applied Intelligence · doi:10.1007/s10489-022-03766-z · Cited by 543
Metadata
- Authors
- Ciftci, U. A., Demir, I., & Yin, L.
- Affiliations
- Computer Science, State University of New York at Binghamton, 14787 Binghamton, New York United States (e-mail: uciftci@binghamton.edu)
- -, Intel Corp, 7198 Los Angeles, California United States (e-mail: idemir@purdue.edu)
- Binghamton University (US)
- ORCID
- Yin, Lijun
- Venue
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- Published
- 2024
- Volume
- PP
- Pages
- 1-1
- ISSN
- 0162-8828 (ISSN-L)
- 2160-9292
- 1939-3539
- OpenAlex
- W2909336075
- Cited by
- 499
- References
- 98
- Citations by year
- 2026: 37 · 2025: 85 · 2024: 116
- FWCI
- 25.27
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- IEEE Transactions on Pattern Analysis and Machine Intelligence (publishedVersion)
- PubMed (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- National Science Foundation (CNS-1629898)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Digital Media Forensic Detection
- Physical Sciences › Computer Science › Signal Processing › Biometric Identification and Security
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Generative Adversarial Networks and Image Synthesis
- Keywords
- deepfake detection, biological signals, signal transformation, CNN classifier, FaceForensics++, generative adversarial networks
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.