Capsule-forensics: Using Capsule Networks to Detect Forged Images and Videos
Open accessThe DOI matches its Crossref record; 29 of the 29 references it cites were found in a registry or an index.
Abstract
Recent advances in media generation techniques have made it easier for attackers to create forged images and videos. State-of-the-art methods enable the real-time creation of a forged version of a single video obtained from a social network. Although numerous methods have been developed for detecting forged images and videos, they are generally targeted at certain domains and quickly become obsolete as new kinds of attacks appear. The method introduced in this paper uses a capsule network to detect various kinds of spoofs, from replay attacks using printed images or recorded videos to computer-generated videos using deep convolutional neural networks. It extends the application of capsule networks beyond their original intention to the solving of inverse graphics problems.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The text we found for this paper looks like another document, so the self-check wasn’t run.
Citations
Cites
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
Dynamic Routing Between Capsules
Sabour, S., Frosst, N., & Hinton, G. E. (2017) · arXiv · doi:10.48550/arxiv.1710.09829 · Cited by 4,167
Rich Models for Steganalysis of Digital Images
Fridrich, J., & Kodovsky, J. (2012) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2012.2190402 · Cited by 2,144
MesoNet: a Compact Facial Video Forgery Detection Network
Afchar, D., Nozick, V., Yamagishi, J., & Echizen, I. (2018) · 2018 IEEE International Workshop on Information Forensics and Security (WIFS) · doi:10.1109/wifs.2018.8630761 · Cited by 1,872
Self-citationFace2Face: Real-Time Face Capture and Reenactment of RGB Videos
Thies, J., Zollhofer, M., Stamminger, M., Theobalt, C., & Niessner, M. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.262 · Cited by 1,747
Hinton, G. E., Krizhevsky, A., & Wang, S. D. (2011) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-21735-7_6 · Cited by 1,360
In Ictu Oculi: Exposing AI Created Fake Videos by Detecting Eye Blinking
Li, Y., Chang, M.-C., & Lyu, S. (2018) · 2018 IEEE International Workshop on Information Forensics and Security (WIFS) · doi:10.1109/wifs.2018.8630787 · Cited by 1,089
Synthesizing Obama: learning lip sync from audio
Suwajanakorn, S., Seitz, S. M., & Kemelmacher-Shlizerman, I. (2017) · ACM Transactions on Graphics · doi:10.1145/3072959.3073640 · Cited by 1,057
Matrix capsules with EM routing
Hinton, G. E., Sabour, S., & Frosst, N. (2018) · International Conference on Learning Representations · Cited by 918
A Deep Learning Approach to Universal Image Manipulation Detection Using a New Convolutional Layer
Bayar, B., & Stamm, M. C. (2016) · Proceedings of the 4th ACM Workshop on Information Hiding and Multimedia Security · doi:10.1145/2909827.2930786 · Cited by 838
Research works printed but not linked: 1
- ito, 2017, Recent advances in biometrics security: A case study of liveness detection in face recognition, APSIPA ASC
Cited by
Celeb-DF: A Large-Scale Challenging Dataset for DeepFake Forensics
Li, Y., Yang, X., Sun, P., Qi, H., & Lyu, S. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00327 · Cited by 1,846
“With the escalated concerns over the DeepFakes, there is a surge of interest in developing DeepFakes detection meth-ods recently [6, 17, 27, 53, 33, 28, 41, 40, 35, 34, 36], with an upcoming dedicated global DeepFake Detection Challenge 1 .”
BackgroundMethodDeepfakes and beyond: A Survey of face manipulation and fake detection
Tolosana, R., Vera-Rodriguez, R., Fierrez, J., Morales, A., & Ortega-Garcia, J. (2020) · Information Fusion · doi:10.1016/j.inffus.2020.06.014 · Cited by 1,237
Thinking in Frequency: Face Forgery Detection by Mining Frequency-Aware Clues
Qian, Y., Yin, G., Sheng, L., Chen, Z., & Shao, J. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58610-2_6 · Cited by 1,058
Multi-attentional Deepfake Detection
Zhao, H., Wei, T., Zhou, W., Zhang, W., Chen, D., & Yu, N. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00222 · Cited by 1,019
“…83.00 53.60 FWA[24] 80.10 56.90 Xception-raw[25] 99.70 48.20 Xception-c23[25] 99.70 65.30 Xception-c40[25] 95.50 65.50 Multi-task[29] 76.30 54.30 Capsule[30] 96.60 57.50 DSP-FWA[24] 93.00 64.60 Two Branch[26] 93.18 73.41 F 3 -Net[33] 98.10 65.17 EfficientNet-B4[39] 99.70 64.29 Ours 99.80 67.44”
InfluentialMedia Forensics and DeepFakes: An Overview
Verdoliva, L. (2020) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2020.3002101 · Cited by 979
The Creation and Detection of Deepfakes: A Survey
Mirsky, Y., & Lee, W. (2022) · ACM Computing Surveys · doi:10.1145/3425780 · Cited by 863
The Creation and Detection of Deepfakes: A Survey
Mirsky, Y., & Lee, W. (2020) · arXiv · doi:10.48550/arxiv.2004.11138 · Cited by 863
Generalizing Face Forgery Detection with High-frequency Features
Luo, Y., Zhang, Y., Yan, J., & Liu, W. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.01605 · Cited by 609
Spatial-Phase Shallow Learning: Rethinking Face Forgery Detection in Frequency Domain
Liu, H., Li, X., Zhou, W., Chen, Y., He, Y., Xue, H., Zhang, W., & Yu, N. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00083 · Cited by 600
Deepfake Detection: A Systematic Literature Review
Rana, M. S., Nobi, M. N., Murali, B., & Sung, A. H. (2022) · IEEE Access · doi:10.1109/access.2022.3154404 · Cited by 573
Multi-task Learning For Detecting and Segmenting Manipulated Facial Images and Videos
Nguyen, H. H., Fang, F., Yamagishi, J., & Echizen, I. (2019) · arXiv · doi:10.48550/arxiv.1906.06876 · Cited by 551
Self-citationMulti-task Learning for Detecting and Segmenting Manipulated Facial Images and Videos
Nguyen, H. H., Fang, F., Yamagishi, J., & Echizen, I. (2019) · 2019 IEEE 10th International Conference on Biometrics Theory, Applications and Systems (BTAS) · doi:10.1109/btas46853.2019.9185974 · Cited by 549
Self-citationFakeCatcher: Detection of Synthetic Portrait Videos using Biological Signals
Ciftci, U. A., Demir, I., & Yin, L. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.3009287 · Cited by 499
Two-Branch Recurrent Network for Isolating Deepfakes in Videos
Masi, I., Killekar, A., Mascarenhas, R. M., Gurudatt, S. P., & AbdAlmageed, W. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58571-6_39 · Cited by 471
Deep learning for deepfakes creation and detection: A survey
Nguyen, T. T., Nguyen, Q. V. H., Nguyen, D. T., Nguyen, D. T., Huynh-The, T., Nahavandi, S., Nguyen, T. T., Pham, Q.-V., & Nguyen, C. M. (2022) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2022.103525 · Cited by 464
“Capsuleforensics [106] Capsule networks - Latent features extracted by VGG-19 network [101] are fed into the capsule network for classification.”
BackgroundMethodInfluentialDeep Learning for Deepfakes Creation and Detection: A Survey
Nguyen, T. T., Nguyen, Q. V. H., Nguyen, D. T., Nguyen, D. T., Huynh-The, T., Nahavandi, S., Nguyen, T. T., Pham, Q.-V., & Nguyen, C. M. (2019) · arXiv · doi:10.48550/arxiv.1909.11573 · Cited by 464
End-to-End Reconstruction-Classification Learning for Face Forgery Detection
Cao, J., Ma, C., Yao, T., Chen, S., Ding, S., & Yang, X. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.00408 · Cited by 428
Learning Self-Consistency for Deepfake Detection
Zhao, T., Xu, X., Xu, M., Ding, H., Xiong, Y., & Xia, W. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01475 · Cited by 383
Deepfake detection using deep learning methods: A systematic and comprehensive review
Heidari, A., Jafari Navimipour, N., Dag, H., & Unal, M. (2024) · WIREs Data Mining and Knowledge Discovery · doi:10.1002/widm.1520 · Cited by 349
“…amount of research has indeed been done on it, including a thorough study and implementation of many common algorithms (Albahar & Almalki, 2019; T. T. Nguyen, Nguyen, et al., 2019; Pashine et al., 2021; Saif & Tehseen, 2022; Shelke & Kasana, 2021; Swathi & Sk, 2021; Weerawardana & Fernando, 2021).”
BackgroundLocal Relation Learning for Face Forgery Detection
Chen, S., Yao, T., Chen, Y., Ding, S., Li, J., & Ji, R. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i2.16193 · Cited by 334
Emotions Don't Lie: An Audio-Visual Deepfake Detection Method using Affective Cues
Mittal, T., Bhattacharya, U., Chandra, R., Bera, A., & Manocha, D. (2020) · Proceedings of the 28th ACM International Conference on Multimedia · doi:10.1145/3394171.3413570 · Cited by 319
DeepFake Detection Based on Discrepancies Between Faces and Their Context
Nirkin, Y., Wolf, L., Keller, Y., & Hassner, T. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3093446 · Cited by 312
Self-supervised Learning of Adversarial Example: Towards Good Generalizations for Deepfake Detection
Chen, L., Zhang, Y., Song, Y., Liu, L., & Wang, J. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01815 · Cited by 307
Kwabena Patrick, M., Felix Adekoya, A., Abra Mighty, A., & Edward, B. Y. (2022) · Journal of King Saud University - Computer and Information Sciences · doi:10.1016/j.jksuci.2019.09.014 · Cited by 282
DeepFake Detection for Human Face Images and Videos: A Survey
Malik, A., Kuribayashi, M., Abdullahi, S. M., & Khan, A. N. (2022) · IEEE Access · doi:10.1109/access.2022.3151186 · Cited by 297
DeepRhythm: Exposing DeepFakes with Attentional Visual Heartbeat Rhythms
Qi, H., Guo, Q., Juefei-Xu, F., Xie, X., Ma, L., Feng, W., Liu, Y., & Zhao, J. (2020) · arXiv · doi:10.48550/arxiv.2006.07634 · Cited by 280
Efficient-CapsNet: capsule network with self-attention routing
Mazzia, V., Salvetti, F., & Chiaberge, M. (2021) · Scientific Reports · doi:10.1038/s41598-021-93977-0 · Cited by 240
A Survey on Deepfake Video Detection
Yu, P., Xia, Z., Fei, J., & Lu, Y. (2021) · IET Biometrics · doi:10.1049/bme2.12031 · Cited by 253
UCF: Uncovering Common Features for Generalizable Deepfake Detection
Yan, Z., Zhang, Y., Fan, Y., & Wu, B. (2023) · 2023 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.02048 · Cited by 241
Deepfake Detection: Current Challenges and Next Steps
Lyu, S. (2020) · 2020 IEEE International Conference on Multimedia & Expo Workshops (ICMEW) · doi:10.1109/icmew46912.2020.9105991 · Cited by 234
Recurrent convolutional structures for audio spoof and video deepfake detection
Chintha, A., Thai, B., Sohrawardi, S. J., Bhatt, K., Hickerson, A., Wright, M., & Ptucha, R. (2020) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2020.2999185 · Cited by 226
Not made for each other- Audio-Visual Dissonance-based Deepfake Detection and Localization
Chugh, K., Gupta, P., Dhall, A., & Subramanian, R. (2020) · Proceedings of the 28th ACM International Conference on Multimedia · doi:10.1145/3394171.3413700 · Cited by 225
DeepRhythm: Exposing DeepFakes with Attentional Visual Heartbeat Rhythms
Qi, H., Guo, Q., Juefei-Xu, F., Xie, X., Ma, L., Feng, W., Liu, Y., & Zhao, J. (2020) · Proceedings of the 28th ACM International Conference on Multimedia · doi:10.1145/3394171.3413707 · Cited by 220
Deepfake video detection: challenges and opportunities
Kaur, A., Noori Hoshyar, A., Saikrishna, V., Firmin, S., & Xia, F. (2024) · Artificial Intelligence Review · doi:10.1007/s10462-024-10810-6 · Cited by 214
“There is a tenfold surge in the worldwide detection of deepfakes across all sectors from 2022 to 2023 deepfake videos may be created using three techniques: lip-sync, face synthesis, and attribute manipulation (Nguyen et al. 2019b; Masood et al. 2023).”
Implicit Identity Driven Deepfake Face Swapping Detection
Huang, B., Wang, Z., Yang, J., Ai, J., Zou, Q., Wang, Q., & Ye, D. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52729.2023.00436 · Cited by 172
Image forgery detection: a survey of recent deep-learning approaches
Zanardelli, M., Guerrini, F., Leonardi, R., & Adami, N. (2023) · Multimedia Tools and Applications · doi:10.1007/s11042-022-13797-w · Cited by 176
An improved dense cnn architecture for deepfake image detection
Patel, Y., Tanwar, S., Bhattacharya, P., Gupta, R., Alsuwian, T., Davidson, I. E., & Mazibuko, T. F. (2023) · IEEE Access · doi:10.1109/access.2023.3251417 · Cited by 196
Hu, J., Liao, X., Wang, W., & Qin, Z. (2022) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2021.3074259 · Cited by 195
Countering Malicious DeepFakes: Survey, Battleground, and Horizon
Juefei-Xu, F., Wang, R., Huang, Y., Guo, Q., Ma, L., & Liu, Y. (2022) · International Journal of Computer Vision · doi:10.1007/s11263-022-01606-8 · Cited by 191
“In addition, there are also a few relatable DeepFake surveys first published in late 2019 and early 2020 (Nguyen et al., 2019d; Tolosana et al., 2020; Lyu, 2020).”
BackgroundMethodInfluentialSpatiotemporal Inconsistency Learning for DeepFake Video Detection
Gu, Z., Chen, Y., Yao, T., Ding, S., Li, J., Huang, F., & Ma, L. (2021) · Proceedings of the 29th ACM International Conference on Multimedia · doi:10.1145/3474085.3475508 · Cited by 189
Deepfake generation and detection: Case study and challenges
Patel, Y., Tanwar, S., Gupta, R., Bhattacharya, P., Davidson, I. E., Nyameko, R., Aluvala, S., & Vimal, V. (2023) · IEEE Access · doi:10.1109/access.2023.3342107 · Cited by 186
Improving the Efficiency and Robustness of Deepfakes Detection through Precise Geometric Features
Sun, Z., Han, Y., Hua, Z., Ruan, N., & Jia, W. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00361 · Cited by 180
Deepfake generation and detection, a survey
Zhang, T. (2022) · Multimedia Tools and Applications · doi:10.1007/s11042-021-11733-y · Cited by 176
F 2 Trans: High-Frequency Fine-Grained Transformer for Face Forgery Detection
Miao, C., Tan, Z., Chu, Q., Liu, H., Hu, H., & Yu, N. (2023) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2022.3233774 · Cited by 172
FAMM: Facial Muscle Motions for Detecting Compressed Deepfake Videos Over Social Networks
Liao, X., Wang, Y., Wang, T., Hu, J., & Wu, X. (2023) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2023.3278310 · Cited by 169
Transcending Forgery Specificity with Latent Space Augmentation for Generalizable Deepfake Detection
Yan, Z., Luo, Y., Lyu, S., Liu, Q., & Wu, B. (2024) · 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52733.2024.00858 · Cited by 166
Fake face detection via adaptive manipulation traces extraction network
Guo, Z., Yang, G., Chen, J., & Sun, X. (2021) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2021.103170 · Cited by 165
Wang, Y., Yu, K., Chen, C., Hu, X., & Peng, S. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52729.2023.00703 · Cited by 161
Zhuang, W., Chu, Q., Tan, Z., Liu, Q., Yuan, H., Miao, C., Luo, Z., & Yu, N. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-20065-6_23 · Cited by 224
A comprehensive overview of Deepfake: generation, detection, datasets, and opportunities
Seow, J. W., Lim, M. K., Phan, R. C. W., & Liu, J. K. (2022) · Neurocomputing · doi:10.1016/j.neucom.2022.09.135 · Cited by 149
DeepFake video detection using convolutional vision transformer
Wodajo, D., & Atnafu, S. (2021) · arXiv · doi:10.48550/arxiv.2102.11126 · Cited by 147
Anti-Forensics for Face Swapping Videos via Adversarial Training
Ding, F., Zhu, G., Li, Y., Zhang, X., Atrey, P. K., & Lyu, S. (2022) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2021.3098422 · Cited by 142
A New Deep Learning-Based Methodology for Video Deepfake Detection Using XGBoost
Ismail, A., Elpeltagy, M., S. Zaki, M., & Eldahshan, K. (2021) · Sensors · doi:10.3390/s21165413 · Cited by 135
A Comprehensive Review of Deep-Learning-Based Methods for Image Forensics
Camacho, I. C., & Wang, K. (2021) · Journal of Imaging · doi:10.3390/jimaging7040069 · Cited by 160
Ciftci, U. A., Demir, I., & Yin, L. (2020) · 2020 IEEE International Joint Conference on Biometrics (IJCB) · doi:10.1109/ijcb48548.2020.9304909 · Cited by 115
DeepfakeStack: A Deep Ensemble-based Learning Technique for Deepfake Detection
Rana, M. S., & Sung, A. H. (2020) · 2020 7th IEEE International Conference on Cyber Security and Cloud Computing (CSCloud)/2020 6th IEEE International Conference on Edge Computing and Scalable Cloud (EdgeCom) · doi:10.1109/cscloud-edgecom49738.2020.00021 · Cited by 133
DeepFake detection algorithm based on improved vision transformer
Heo, Y.-J., Yeo, W.-H., & Kim, B. (2022) · Applied Intelligence · doi:10.1007/s10489-022-03867-9 · Cited by 150
Mitra, A., Mohanty, S. P., Corcoran, P., & Kougianos, E. (2021) · SN Computer Science · doi:10.1007/s42979-021-00495-x · Cited by 145
Comparison of Deepfake Detection Techniques through Deep Learning
Taeb, M., & Chi, H. (2022) · Journal of Cybersecurity and Privacy · doi:10.3390/jcp2010007 · Cited by 109
Deep Learning for Deepfakes Creation and Detection: A Survey
Nguyen, T. T., Nguyen, M. C., Nguyen, D. T., Nguyen, D. T., & Nahavandi, S. (2020) · Figshare · doi:10.6084/m9.figshare.12731039.v1 · Cited by 121
Detect and locate: Exposing face manipulation by semantic-and noise-level telltales
Kong, C., Chen, B., Li, H., Wang, S., Rocha, A., & Kwong, S. (2022) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2022.3169921 · Cited by 120
Improving Generalization by Commonality Learning in Face Forgery Detection
Yu, P., Fei, J., Xia, Z., Zhou, Z., & Weng, J. (2022) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2022.3146781 · Cited by 111
Hierarchical Frequency-Assisted Interactive Networks for Face Manipulation Detection
Miao, C., Tan, Z., Chu, Q., Yu, N., & Guo, G. (2022) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2022.3198275 · Cited by 110
Optical Flow based CNN for detection of unlearnt deepfake manipulations
Caldelli, R., Galteri, L., Amerini, I., & Del Bimbo, A. (2021) · Pattern Recognition Letters · doi:10.1016/j.patrec.2021.03.005 · Cited by 115
Interpretable and Trustworthy Deepfake Detection via Dynamic Prototypes
Trinh, L., Tsang, M., Rambhatla, S., & Liu, Y. (2021) · 2021 IEEE Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv48630.2021.00202 · Cited by 115
Beyond the Prior Forgery Knowledge: Mining Critical Clues for General Face Forgery Detection
Luo, A., Kong, C., Huang, J., Hu, Y., Kang, X., & Kot, A. C. (2024) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2023.3332218 · Cited by 115
Towards Generalizable Deepfake Detection with Locality-aware AutoEncoder
Du, M., Pentyala, S., Li, Y., & Hu, X. (2020) · Proceedings of the 29th ACM International Conference on Information & Knowledge Management · doi:10.1145/3340531.3411892 · Cited by 114
(2020) · doi:10.1007/978-3-030-68821-9_38 · Cited by 113
COSMOS: Catching Out-of-Context Image Misuse Using Self-Supervised Learning
Aneja, S., Bregler, C., & Nießner, M. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i12.26648 · Cited by 142
Deepfake Detection: A Comprehensive Survey from the Reliability Perspective
Wang, T., Liao, X., Chow, K. P., Lin, X., & Wang, Y. (2025) · ACM Computing Surveys · doi:10.1145/3699710 · Cited by 107
FakeLocator: Robust Localization of GAN-Based Face Manipulations
Huang, Y., Juefei-Xu, F., Guo, Q., Liu, Y., & Pu, G. (2022) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2022.3141262 · Cited by 102
A Comprehensive Review of DeepFake Detection Using Advanced Machine Learning and Fusion Methods
Gupta, G., Raja, K., Gupta, M., Jan, T., Whiteside, S. T., & Prasad, M. (2023) · Electronics · doi:10.3390/electronics13010095 · Cited by 99
Shad, H. S., Rizvee, M. M., Roza, N. T., Hoq, S. M. A., Monirujjaman Khan, M., Singh, A., Zaguia, A., & Bourouis, S. (2021) · Computational Intelligence and Neuroscience · doi:10.1155/2021/3111676 · Cited by 93
RetractedSharma, P., Kumar, M., & Sharma, H. K. (2022) · Multimedia Tools and Applications · doi:10.1007/s11042-022-13808-w · Cited by 98
Artifacts-Disentangled Adversarial Learning for Deepfake Detection
Li, X., Ni, R., Yang, P., Fu, Z., & Zhao, Y. (2023) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2022.3217950 · Cited by 93
Le, T.-N., Nguyen, H. H., Yamagishi, J., & Echizen, I. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00996 · Cited by 97
Self-citationFInfer: Frame Inference-Based Deepfake Detection for High-Visual-Quality Videos
Hu, J., Liao, X., Liang, J., Zhou, W., & Qin, Z. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i1.19978 · Cited by 84
Deep Learning for Deepfakes Creation and Detection.Preprint
Nguyen, T. T., Nguyen, C. M., Nguyen, D. T., Nguyen, T. T., & Nahavandi, S. (2019) · arXiv (Cornell University) · Cited by 125
Sentiment analysis with deep neural networks: comparative study and performance assessment
Wadawadagi, R. S., & Pagi, V. B. (2020) · Artificial Intelligence Review · doi:10.1007/s10462-020-09845-2 · Cited by 107
Delving into the Local: Dynamic Inconsistency Learning for DeepFake Video Detection
Gu, Z., Chen, Y., Yao, T., Ding, S., Li, J., & Ma, L. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i1.19955 · Cited by 93
DeepfakeBench: A Comprehensive Benchmark of Deepfake Detection
Yan, Z., Zhang, Y., Yuan, X., Lyu, S., & Wu, B. (2023) · arXiv · doi:10.48550/arxiv.2307.01426 · Cited by 97
“6) Capsule [29]: uses capsule structures [34] based on a VGG19 [38] network as the backbone architecture for deepfake classification.”
BackgroundMethodNGUYEN, D., MEJRI, N., SINGH, I. P., KULESHOVA, P., ASTRID, M., KACEM, A., GHORBEL, E., & AOUADA, D. (2024) · 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52733.2024.01647 · Cited by 93
Chadha, A., Kumar, V., Kashyap, S., & Gupta, M. (2021) · Lecture Notes in Networks and Systems · doi:10.1007/978-981-16-0733-2_39 · Cited by 91
Restricted Black-Box Adversarial Attack Against DeepFake Face Swapping
Dong, J., Wang, Y., Lai, J., & Xie, X. (2023) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2023.3266702 · Cited by 124
Detecting DeepFake, FaceSwap and Face2Face facial forgeries using frequency CNN
Kohli, A., & Gupta, A. (2021) · Multimedia Tools and Applications · doi:10.1007/s11042-020-10420-8 · Cited by 90
Chen, H., Lin, Y., Li, B., & Tan, S. (2023) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2022.3209336 · Cited by 80
Babaei, R., Cheng, S. S. M., Duan, R., & Zhao, S. (2025) · Journal of Sensor and Actuator Networks · doi:10.3390/jsan14010017 · Cited by 103
DFDT: An End-to-End DeepFake Detection Framework Using Vision Transformer
Khormali, A., & Yuan, J.-S. (2022) · Applied Sciences · doi:10.3390/app12062953 · Cited by 88
A Comprehensive Survey on Passive Techniques for Digital Video Forgery Detection
Shelke, N. A., & Kasana, S. S. (2021) · Multimedia Tools and Applications · doi:10.1007/s11042-020-09974-4 · Cited by 87
Detecting fake images by identifying potential texture difference
Yang, J., Xiao, S., Li, A., Lan, G., & Wang, H. (2021) · Future Generation Computer Systems · doi:10.1016/j.future.2021.06.043 · Cited by 86
Benchmarking Joint Face Spoofing and Forgery Detection With Visual and Physiological Cues
Yu, Z., Cai, R., Li, Z., Yang, W., Shi, J., & Kot, A. C. (2024) · IEEE Transactions on Dependable and Secure Computing · doi:10.1109/tdsc.2024.3352049 · Cited by 98
Security in smart cities: A brief review of digital forensic schemes for biometric data
Ross, A., Banerjee, S., & Chowdhury, A. (2020) · Pattern Recognition Letters · doi:10.1016/j.patrec.2020.07.009 · Cited by 85
A comprehensive survey on digital video forensics: Taxonomy, challenges, and future directions
Javed, A. R., Jalil, Z., Zehra, W., Gadekallu, T. R., Suh, D. Y., & Piran, M. J. (2021) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2021.104456 · Cited by 95
A Capsule Network Based Approach for Detection of Audio Spoofing Attacks
Luo, A., Li, E., Liu, Y., Kang, X., & Wang, Z. J. (2021) · ICASSP 2021 - 2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp39728.2021.9414670 · Cited by 84
A literature review and perspectives in deepfakes: generation, detection, and applications
Dagar, D., & Vishwakarma, D. K. (2022) · International Journal of Multimedia Information Retrieval · doi:10.1007/s13735-022-00241-w · Cited by 113
Can ChatGPT Detect DeepFakes? A Study of Using Multimodal Large Language Models for Media Forensics
Jia, S., Lyu, R., Zhao, K., Chen, Y., Yan, Z., Ju, Y., Hu, C., Li, X., Wu, B., & Lyu, S. (2024) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw63382.2024.00436 · Cited by 159
MRE-Net: Multi-Rate Excitation Network for Deepfake Video Detection
Pang, G., Zhang, B., Teng, Z., Qi, Z., & Fan, J. (2023) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2023.3239607 · Cited by 72
Video Transformer for Deepfake Detection with Incremental Learning
Khan, S. A., & Dai, H. (2021) · Proceedings of the 29th ACM International Conference on Multimedia · doi:10.1145/3474085.3475332 · Cited by 79
Seeing is Believing: Exploring Perceptual Differences in DeepFake Videos
Tahir, R., Batool, B., Jamshed, H., Jameel, M., Anwar, M., Ahmed, F., Zaffar, M. A., & Zaffar, M. F. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445699 · Cited by 79
An efficient deepfake video detection using robust deep learning
Qadir, A., Mahum, R., El-Meligy, M. A., Ragab, A. E., AlSalman, A., & Awais, M. (2024) · Heliyon · doi:10.1016/j.heliyon.2024.e25757 · Cited by 78
Metadata
- Authors
- Nguyen, H. H., Yamagishi, J., & Echizen, I.
- Affiliations
- The Graduate University for Advanced Studies, SOKENDAI (JP)
- National Institute of Informatics (JP)
- Venue
- ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)
- Publisher
- IEEE
- Published
- 2019-05
- Pages
- 2307-2311
- ISSN
- 1520-6149 (ISSN-L)
- OpenAlex
- W2963720850
- Cited by
- 951
- References
- 29
- Citations by year
- 2026: 113 · 2025: 196 · 2024: 168 · 2023: 156 · 2022: 136 · 2021: 116 · 2020: 57 · 2019: 9
- FWCI
- 25.92
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- IEEE International Conference on Acoustics Speech and Signal Processing (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- Edinburgh Research Explorer (University of Edinburgh) (submittedVersion, other-oa)
- arXiv (Cornell University)
- Funders
- Japan Society for the Promotion of Science
- Core Research for Evolutional Science and Technology
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Digital Media Forensic Detection
- Physical Sciences › Computer Science › Signal Processing › Biometric Identification and Security
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Steganography and Watermarking Techniques
- Keywords
- image forgery detection, video forgery detection, capsule networks, deepfakes, replay attacks, inverse graphics, multimedia forensics
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.