Deepfake Generation and Detection: Case Study and Challenges
Open accessThe DOI matches its Crossref record; 107 of the 107 references it cites were found in a registry or an index.
Abstract
In smart communities, social media has allowed users easy access to multimedia content. With recent advancements in computer vision and natural language processing, machine learning (ML), and deep learning (DL) models have evolved. With advancements in generative adversarial networks (GAN), it has become possible to create fake images/audio/and video streams of a person or use some person’s audio and visual details to fit other environments. Thus, deepfakes are specifically used to disseminate fake information and propaganda on social circles that tarnish the reputation of an individual or an organization. Recently, many surveys have focused on generating and detecting deepfake images, audio, and video streams. Existing surveys are mostly aligned toward detecting deepfake contents, but the generation process is not suitably discussed. To address the survey gap, the paper proposes a comprehensive review of deepfake generation and detection and the different ML/DL approaches to synthesize deepfake contents. We discuss a comparative analysis of deepfake models and public datasets present for deepfake detection purposes. We discuss the implementation challenges and future research directions regarding optimized approaches and models. A unique case study,IBMMis discussed, which presents a multi-modal overview of deepfake detection. The proposed survey would benefit researchers, industry, and academia to study deepfake generation and subsequent detection schemes.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“As a result, the system becomes highly feasible for deployment in real-world CCTV environments, even on devices with minimal computational resources [30].”
From FL-TENB4: A Federated-Learning-Enhanced Tiny EfficientNetB4-Lite Approach for Deepfake Detection in CCTV Environments (2025) · cites this paper as [30]
In the citing paper
“In deepfake detection systems, time efficiency remains a major challenge, especially for those platforms that handle large amounts of multimedia data [2].”
From Beyond Accuracy: A Deployment-Oriented Benchmark of Deepfake Detection Models (2025) · cites this paper as [2]
In the citing paper
“One major limitation is the reliance on datasets, which are difficult to compile and often lack diversity in manipulation types [2].”
From Beyond Accuracy: A Deployment-Oriented Benchmark of Deepfake Detection Models (2025) · cites this paper as [2]
Citations
Cites
1 retracted
Karthika, S., & Durgadevi, M. (2021) · International Conference on Communication and Electronics Systems (ICCES) · doi:10.1109/icces51350.2021.9489160 · Cited by 139 · cited 1×
“The prominent difference between GAN and DCGAN is that the GAN generator uses a fully connected network, and DCGAN uses a transposed convolutional network, which upscales the images [19].”
BackgroundRetractedUnpaired image-to-image translation using cycle-consistent adversarial networks
Zhu, J.-Y., Park, T., Isola, P., & Efros, A. A. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.244 · Cited by 23,602
A Style-Based Generator Architecture for Generative Adversarial Networks
Karras, T., Laine, S., & Aila, T. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00453 · Cited by 11,714 · cited 1×
“Generally, this is achieved using some powerful GAN, such as StyleGAN [73].”
MethodProgressive Growing of GANs for Improved Quality, Stability, and Variation
Karras, T., Aila, T., Laine, S., & Lehtinen, J. (2017) · arXiv · doi:10.48550/arxiv.1710.10196 · Cited by 4,727 · cited 1×
“Karas et al. resolved this issue and came up with a new GAN model termed as progressively growing GAN (ProGAN) [45], which generated high-resolution images of 1024 ∗ 1024 pixels.”
BackgroundStarGAN: Unified Generative Adversarial Networks for Multi-domain Image-to-Image Translation
Choi, Y., Choi, M., Kim, M., Ha, J.-W., Kim, S., & Choo, J. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00916 · Cited by 4,163
FaceForensics++: Learning to Detect Manipulated Facial Images
Rossler, A., Cozzolino, D., Verdoliva, L., Riess, C., Thies, J., & Niessner, M. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00009 · Cited by 3,314 · cited 1×
“It contains 1000 original videos from YouTube whereas 1000 generated videos using faceswap [100].”
MethodMesoNet: a Compact Facial Video Forgery Detection Network
Afchar, D., Nozick, V., Yamagishi, J., & Echizen, I. (2018) · 2018 IEEE International Workshop on Information Forensics and Security (WIFS) · doi:10.1109/wifs.2018.8630761 · Cited by 1,872
Celeb-DF: A Large-Scale Challenging Dataset for DeepFake Forensics
Li, Y., Yang, X., Sun, P., Qi, H., & Lyu, S. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00327 · Cited by 1,846 · cited 5×
“These are the features that are being used to detect deepfake contents [8], [78].”
BackgroundMethodInfluentialFace2Face: Real-Time Face Capture and Reenactment of RGB Videos
Thies, J., Zollhofer, M., Stamminger, M., Theobalt, C., & Niessner, M. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.262 · Cited by 1,747
Learning to Discover Cross-Domain Relations with Generative Adversarial Networks
Kim, T., Cha, M., Kim, H., Lee, J. K., & Kim, J. (2017) · arXiv · doi:10.48550/arxiv.1703.05192 · Cited by 1,716 · cited 1×
“One such approach is using DiscoGAN [69].”
Deferred neural rendering: image synthesis using neural textures
Thies, J., Zollhöfer, M., & Nießner, M. (2019) · ACM Transactions on Graphics · doi:10.1145/3306346.3323035 · Cited by 1,356
Deepfake Video Detection Using Recurrent Neural Networks
Guera, D., & Delp, E. J. (2018) · 2018 15th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS) · doi:10.1109/avss.2018.8639163 · Cited by 1,285 · cited 5×
“Thus, autoencoders were able to generate the most compact representation of images with minimized loss function than other image compression methods [40].”
BackgroundMethodInfluentialDeepfakes and beyond: A Survey of face manipulation and fake detection
Tolosana, R., Vera-Rodriguez, R., Fierrez, J., Morales, A., & Ortega-Garcia, J. (2020) · Information Fusion · doi:10.1016/j.inffus.2020.06.014 · Cited by 1,237
Exposing Deep Fakes Using Inconsistent Head Poses
Yang, X., Li, Y., & Lyu, S. (2019) · ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2019.8683164 · Cited by 1,196
In Ictu Oculi: Exposing AI Created Fake Videos by Detecting Eye Blinking
Li, Y., Chang, M.-C., & Lyu, S. (2018) · 2018 IEEE International Workshop on Information Forensics and Security (WIFS) · doi:10.1109/wifs.2018.8630787 · Cited by 1,089 · cited 4×
“The first approach of utilizing inconsistencies in blinking patterns was proposed around 2018 [38].”
BackgroundMethodInfluential“Waveglow: a flow-based generative network for speech synthesis,”
Prenger, R., Valle, R., & Catanzaro, B. (2019) · ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2019.8683143 · Cited by 1,004
Capsule-forensics: Using Capsule Networks to Detect Forged Images and Videos
Nguyen, H. H., Yamagishi, J., & Echizen, I. (2019) · ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2019.8682602 · Cited by 951
SinGAN: Learning a Generative Model From a Single Natural Image
Shaham, T. R., Dekel, T., & Michaeli, T. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00467 · Cited by 890 · cited 1×
“Another approach of parallel Voice Conversion has been discussed for the task of singing known as SINGAN [72].”
BackgroundThe Creation and Detection of Deepfakes: A Survey
Mirsky, Y., & Lee, W. (2022) · ACM Computing Surveys · doi:10.1145/3425780 · Cited by 863 · cited 1×
“Mirsky et al. [37] presented a survey on deepfake creation and detection.”
BackgroundThe Creation and Detection of Deepfakes: A Survey
Mirsky, Y., & Lee, W. (2020) · arXiv · doi:10.48550/arxiv.2004.11138 · Cited by 863 · cited 1×
“Mirsky et al. [37] presented a survey on deepfake creation and detection.”
BackgroundAttGAN: Facial attribute editing by only changing what you want
He, Z., Zuo, W., Kan, M., Shan, S., & Chen, X. (2019) · IEEE Transactions on Image Processing · doi:10.1109/tip.2019.2916751 · Cited by 833 · cited 1×
“AttGAN [56] also follows a similar kind of architecture.”
BackgroundExploiting Visual Artifacts to Expose Deepfakes and Face Manipulations
Matern, F., Riess, C., & Stamminger, M. (2019) · 2019 IEEE Winter Applications of Computer Vision Workshops (WACVW) · doi:10.1109/wacvw.2019.00020 · Cited by 824 · cited 3×
“Another approach where multiple visual features called visual artifacts was proposed in [46] by Matern et al. In this paper, for visual artifacts, multiple features were used, such as the color of left and right eyes, reflection of light on the surface, inconsistencies and disproportionate shadows,…”
BackgroundMethodInfluentialMelGAN: generative adversarial networks for conditional waveform synthesis
Kumar, K., Kumar, R., de Boissiere, T., Gestin, L., Teoh, W. Z., Sotelo, J., de Brebisson, A., Bengio, Y., & Courville, A. (2019) · arXiv · doi:10.48550/arxiv.1910.06711 · Cited by 722 · cited 1×
“MelGAN [68] is a non-autoregressive convolutional model that generates audio waveforms using the concept of GANs.”
MethodHiFi-GAN: Generative Adversarial Networks for Efficient and High Fidelity Speech Synthesis
Kong, J., Kim, J., & Bae, J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.05646 · Cited by 722
FSGAN: Subject Agnostic Face Swapping and Reenactment
Nirkin, Y., Keller, Y., & Hassner, T. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00728 · Cited by 706 · cited 1×
“Face swapping GAN (FSGAN) [52] is another model which allows users to replace the face of one person with another while keeping the pose and expression intact.”
BackgroundTwo-Stream Neural Networks for Tampered Face Detection
Zhou, P., Han, X., Morariu, V. I., & Davis, L. S. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2017.229 · Cited by 700 · cited 1×
“As discussed in [80], the image convolution, as well as the steganalysis feature, is used to detect manipulated areas in the image/video.”
MethodASVspoof 2019: Future Horizons in Spoofed and Fake Audio Detection
Todisco, M., Wang, X., Vestman, V., Sahidullah, M., Delgado, H., Nautsch, A., Yamagishi, J., Evans, N., Kinnunen, T., & Lee, K. A. (2019) · arXiv · doi:10.48550/arxiv.1904.05441 · Cited by 688 · cited 1×
“There have been competitions, such as ASVspoof 2017 [75] and ASVspoof 2019 [76] challenges, where manipulated datasets are released along with some baseline solutions.”
BackgroundASVspoof 2019: Future Horizons in Spoofed and Fake Audio Detection
Todisco, M., Wang, X., Vestman, V., Sahidullah, M., Delgado, H., Nautsch, A., Yamagishi, J., Evans, N., Kinnunen, T. H., & Lee, K. A. (2019) · Interspeech 2019 · doi:10.21437/interspeech.2019-2249 · Cited by 687
DeeperForensics-1.0: A Large-Scale Dataset for Real-World Face Forgery Detection
Jiang, L., Li, R., Wu, W., Qian, C., & Loy, C. C. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00296 · Cited by 599
Multi-task Learning For Detecting and Segmenting Manipulated Facial Images and Videos
Nguyen, H. H., Fang, F., Yamagishi, J., & Echizen, I. (2019) · arXiv · doi:10.48550/arxiv.1906.06876 · Cited by 551
Multi-task Learning for Detecting and Segmenting Manipulated Facial Images and Videos
Nguyen, H. H., Fang, F., Yamagishi, J., & Echizen, I. (2019) · 2019 IEEE 10th International Conference on Biometrics Theory, Applications and Systems (BTAS) · doi:10.1109/btas46853.2019.9185974 · Cited by 549
Masood, M., Nawaz, M., Malik, K. M., Javed, A., Irtaza, A., & Malik, H. (2023) · Applied Intelligence · doi:10.1007/s10489-022-03766-z · Cited by 543
The ASVspoof 2017 challenge: assessing the limits of replay spoofing attack detection
Kinnunen, T., Sahidullah, M., Delgado, H., Todisco, M., Evans, N., Yamagishi, J., & Lee, K. A. (2017) · Interspeech 2017 · doi:10.21437/interspeech.2017-1111 · Cited by 535 · cited 1×
“There have been competitions, such as ASVspoof 2017 [75] and ASVspoof 2019 [76] challenges, where manipulated datasets are released along with some baseline solutions.”
BackgroundKietzmann, J., Lee, L. W., McCarthy, I. P., & Kietzmann, T. C. (2020) · Business Horizons · doi:10.1016/j.bushor.2019.11.006 · Cited by 504
DeepFakes: a New Threat to Face Recognition? Assessment and Detection
Korshunov, P., & Marcel, S. (2018) · arXiv · doi:10.48550/arxiv.1812.08685 · Cited by 497 · cited 1×
“There are around 640 videos in this dataset generated using faceswap-GAN [101].”
MethodWildDeepfake: A Challenging Real-World Dataset for Deepfake Detection
Zi, B., Chang, M., Chen, J., Ma, X., & Jiang, Y.-G. (2020) · Proceedings of the 28th ACM International Conference on Multimedia · doi:10.1145/3394171.3413769 · Cited by 448 · cited 1×
“It cou;d be used in addition to other datasets [106].”
MethodThe deepfake detection challenge (dfdc) dataset
Dolhansky, B., Bitton, J., Pflaum, B., Lu, J., Howes, R., Wang, M., & Ferrer, C. C. (2020) · arXiv · doi:10.48550/arxiv.2006.07397 · Cited by 427
Deepfake Video Detection through Optical Flow Based CNN
Amerini, I., Galteri, L., Caldelli, R., & Del Bimbo, A. (2019) · 2019 IEEE/CVF International Conference on Computer Vision Workshop (ICCVW) · doi:10.1109/iccvw.2019.00152 · Cited by 424
The Deepfake Detection Challenge (DFDC) Preview Dataset
Dolhansky, B., Howes, R., Pflaum, B., Baram, N., & Ferrer, C. C. (2019) · arXiv · doi:10.48550/arxiv.1910.08854 · Cited by 413 · cited 1×
“• Facebook Deepfake Detection Challenge Preview (DFDC Preview) : This dataset has 4113 deepfake videos generated out of 1131 original videos which include 66 individuals with different gender, age and race [103].”
BackgroundDetection of GAN-Generated Fake Images over Social Networks
Marra, F., Gragnaniello, D., Cozzolino, D., & Verdoliva, L. (2018) · 2018 IEEE Conference on Multimedia Information Processing and Retrieval (MIPR) · doi:10.1109/mipr.2018.00084 · Cited by 399 · cited 1×
“Based on the study [82] performed in 2018 in which InceptionNet, XceptionNet, and DenseNet were compared, where XceptionNet outperforms all of them.”
MethodSTGAN: A Unified Selective Transfer Network for Arbitrary Image Attribute Editing
Liu, M., Ding, Y., Xia, M., Liu, X., Ding, E., Zuo, W., & Wen, S. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00379 · Cited by 394
“StarGAN-VC: non-parallel many-to-many voice conversion using star generative adversarial networks,”
Kameoka, H., Kaneko, T., Tanaka, K., & Hojo, N. (2018) · 2018 IEEE Spoken Language Technology Workshop (SLT) · doi:10.1109/slt.2018.8639535 · Cited by 371
CycleGAN-VC: Non-parallel Voice Conversion Using Cycle-Consistent Adversarial Networks
Kaneko, T., & Kameoka, H. (2018) · 2018 26th European Signal Processing Conference (EUSIPCO) · doi:10.23919/eusipco.2018.8553236 · Cited by 358 · cited 1×
“The model is often compared to CycleGAN-VC [71], which has a limited one-to-one mapping capability, compared to many-to-many of StarGAN.”
ResultNVAE: A Deep Hierarchical Variational Autoencoder
Vahdat, A., & Kautz, J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.03898 · Cited by 350 · cited 1×
“Some of the notable examples include the variational autoencoders (VAE) [58], VAE-GAN [59], CycleGAN [54], and others.”
BackgroundFaceForensics: A Large-scale Video Dataset for Forgery Detection in Human Faces
Rössler, A., Cozzolino, D., Verdoliva, L., Riess, C., Thies, J., & Nießner, M. (2018) · arXiv · doi:10.48550/arxiv.1803.09179 · Cited by 339
Deep voice 3: scaling text-to-speech with convolutional sequence learning
Ping, W., Peng, K., Gibiansky, A., Arik, S. O., Kannan, A., Narang, S., Raiman, J., & Miller, J. (2017) · arXiv · doi:10.48550/arxiv.1710.07654 · Cited by 313
Deep fake image detection based on pairwise learning
Hsu, C.-C., Zhuang, Y.-X., & Lee, C.-Y. (2020) · Applied Sciences · doi:10.3390/app10010370 · Cited by 304 · cited 1×
“For example, Xuan et al. [23] proposed a two-phase model which pairs a real and fake image together.”
BackgroundA Survey on Deepfake Video Detection
Yu, P., Xia, Z., Fei, J., & Lu, Y. (2021) · IET Biometrics · doi:10.1049/bme2.12031 · Cited by 253 · cited 3×
“Hence, research in this direction is also necessary [31].”
BackgroundInfluentialOne-class learning towards synthetic voice spoofing detection
Zhang, Y., Jiang, F., & Duan, Z. (2021) · IEEE Signal Processing Letters · doi:10.1109/lsp.2021.3076358 · Cited by 241 · cited 2×
“Other significant examples of single model architectures were presented by Zhang et al. [25], who proposed the use of ResNet-18 with a special loss function which improves the performance of the model.”
BackgroundDetecting Deep-Fake Videos from Phoneme-Viseme Mismatches
Agarwal, S., Farid, H., Fried, O., & Agrawala, M. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw50498.2020.00338 · Cited by 234 · cited 1×
“Agarwal et al. in [95] tried to detect lip-sync videos using the inconsistencies in Phoneme and Viseme.”
MethodRecurrent convolutional structures for audio spoof and video deepfake detection
Chintha, A., Thai, B., Sohrawardi, S. J., Bhatt, K., Hickerson, A., Wright, M., & Ptucha, R. (2020) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2020.2999185 · Cited by 226 · cited 1×
“Chintha et al. [94] proposed a system that detects deepfake videos and spoofed audio.”
BackgroundNot made for each other- Audio-Visual Dissonance-based Deepfake Detection and Localization
Chugh, K., Gupta, P., Dhall, A., & Subramanian, R. (2020) · Proceedings of the 28th ACM International Conference on Multimedia · doi:10.1145/3394171.3413700 · Cited by 225 · cited 2×
“Now, the results of these individual models were combined using a learnt weighted average as a part of a MLP. Chugh et al. [97] proposed a system where the detection of deepfake content is based upon dis-harmony between audio and video contents.”
MethodDeep Residual Neural Networks for Audio Spoofing Detection
Alzantot, M., Wang, Z., & Srivastava, M. B. (2019) · Interspeech 2019 · doi:10.21437/interspeech.2019-3174 · Cited by 215
Ji, S., Luo, J., & Yang, X. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2011.06801 · Cited by 203 · cited 1×
“For an audio generation, deepfakes tools like WaveNet, MelNet, Char2Wave, and WaveGlow are mainly preferred [17].”
MethodAn improved dense cnn architecture for deepfake image detection
Patel, Y., Tanwar, S., Bhattacharya, P., Gupta, R., Alsuwian, T., Davidson, I. E., & Mazibuko, T. F. (2023) · IEEE Access · doi:10.1109/access.2023.3251417 · Cited by 196 · cited 1×
“Deep-fakes involve deep neural networks, convolutional neural networks (CNNs), autoencoders, and generative adversarial networks (GANs) as popular generation techniques [10], [11].”
BackgroundSelf-citation9th ISCA Workshop on Speech Synthesis Workshop (SSW 9)
(2016) · doi:10.21437/ssw.2016 · Cited by 195
Deepfake generation and detection, a survey
Zhang, T. (2022) · Multimedia Tools and Applications · doi:10.1007/s11042-021-11733-y · Cited by 176 · cited 1×
“This synthetic and fake content generation (termed as deepfakes) uses different machine learning (ML), and deep learning (DL) algorithms to look and sound real, and works on the superimposition of the face and voice of some person on another person [1].”
BackgroundVulnerability assessment and detection of Deepfake videos
Korshunov, P., & Marcel, S. (2019) · 2019 International Conference on Biometrics (ICB) · doi:10.1109/icb45273.2019.8987375 · Cited by 162 · cited 1×
“Similarly, a lot of deepfakes are used for the creation of fake pornographic content, which includes famous celebrities [6], [7], [8].”
BackgroundTowards Future Internet: The Metaverse Perspective for Diverse Industrial Applications
Bhattacharya, P., Saraswat, D., Savaliya, D., Sanghavi, S., Verma, A., Sakariya, V., Tanwar, S., Sharma, R., Raboacă, M. S., & Manea, D. L. (2023) · Mathematics · doi:10.3390/math11040941 · Cited by 162
Self-citationForgeryNet: A Versatile Benchmark for Comprehensive Forgery Analysis
He, Y., Gan, B., Chen, S., Zhou, Y., Yin, G., Song, L., Sheng, L., Shao, J., & Liu, Z. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00434 · Cited by 161 · cited 1×
“5400 + subjects were used to create this dataset and 36 perturbations were performed [110].”
MethodCampbell, C., Plangger, K., Sands, S., Kietzmann, J., & Bates, K. (2022) · Journal of Advertising Research · doi:10.2501/jar-2022-017 · Cited by 156 · cited 1×
“On a positive note, GAN-enabled deepfakes are used to generate photos of imaginary models for clothing, branding, and related fashion accessories [13].”
MethodFighting Deepfake by Exposing the Convolutional Traces on Images
Guarnera, L., Giudice, O., & Battiato, S. (2020) · IEEE Access · doi:10.1109/access.2020.3023037 · Cited by 149 · cited 1×
“GANs have been used for many applications, such as image-to-image translation, image completion, and text-to-text image generation [44].”
MethodLearning to Detect Fake Face Images in the Wild
Hsu, C.-C., Lee, C.-Y., & Zhuang, Y.-X. (2018) · 2018 International Symposium on Computer, Consumer and Control (IS3C) · doi:10.1109/is3c.2018.00104 · Cited by 148
KoDF: A Large-scale Korean DeepFake Detection Dataset
Kwon, P., You, J., Nam, G., Park, S., & Chae, G. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01057 · Cited by 145 · cited 1×
“It was created using 6 different deepfake manipulation approach and 403 subjects [107].”
MethodDeepfake: a social construction of technology perspective
Kwok, A. O. J., & Koh, S. G. M. (2021) · Current Issues in Tourism · doi:10.1080/13683500.2020.1738357 · Cited by 138 · cited 1×
“At the community front, deepfakes are used to generate fake propaganda and communal hatred (political and religion-based) and can lead to violence and outbreaks among communities [2].”
BackgroundRecent advances in digital image manipulation detection techniques: A brief review
Thakur, R., & Rohilla, R. (2020) · Forensic Science International · doi:10.1016/j.forsciint.2020.110311 · Cited by 125 · cited 2×
“Thus, the researcher has shifted towards AI models for deepfakes content generation, and classification models for detection [22].”
BackgroundYu, H., Tan, Z.-H., Ma, Z., Martin, R., & Guo, J. (2018) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2017.2771947 · Cited by 111 · cited 1×
“In [88], the authors proposed a novel human log - likelihood (HL) scoring method.”
BackgroundMelNet: a generative model for audio in the frequency domain
Vasquez, S., & Lewis, M. (2019) · arXiv · doi:10.48550/arxiv.1906.01083 · Cited by 107 · cited 1×
“Another Network is MelNet [65], which is a generative network with the capabilities to generate audio/music as well as text-to-speech generation.”
BackgroundA Taxonomy of Fake News Classification Techniques: Survey and Implementation Aspects
Rohera, D., Shethna, H., Patel, K., Thakker, U., Tanwar, S., Gupta, R., Hong, W., & Sharma, R. (2022) · IEEE Access · doi:10.1109/access.2022.3159651 · Cited by 107 · cited 1×
“It can be used for spreading fake news [74] as well as questionable content on social media.”
BackgroundSelf-citationEnsemble Models for Spoofing Detection in Automatic Speaker Verification
Chettri, B., Stoller, D., Morfi, V., Ramírez, M. A. M., Benetos, E., & Sturm, B. L. (2019) · Interspeech 2019 · doi:10.21437/interspeech.2019-2505 · Cited by 103
Combating Fake News: Stakeholder Interventions and Potential Solutions
Gupta, A. K., Kumar, N., Prabhat, P., Gupta, R., Tanwar, S., Sharma, G., Bokoro, P. N., & Sharma, R. (2022) · IEEE Access · doi:10.1109/access.2022.3193670 · Cited by 96 · cited 1×
“Manipulations [42]. in audio data could also contribute to the spreading of fake news as well as defamation cases [77].”
BackgroundSelf-citationDeepfake: A Survey on Facial Forgery Technique Using Generative Adversarial Network
Yadav, D., & Salmani, S. (2019) · 2019 International Conference on Intelligent Computing and Control Systems (ICCS) · doi:10.1109/iccs45141.2019.9065881 · Cited by 88 · cited 2×
“Deepfake audio tools have the ability to create entirely realistic lip sync videos in which the audio modalities are manipulated and mapped with the video frames [20].”
BackgroundThe Real Threat of Deepfake Pornography: A Review of Canadian Policy
Karasavva, V., & Noorbhai, A. (2021) · Cyberpsychology, Behavior, and Social Networking · doi:10.1089/cyber.2020.0272 · Cited by 85
Lewis, J. K., Toubal, I. E., Chen, H., Sandesera, V., Lomnitz, M., Hampel-Arias, Z., Prasad, C., & Palaniappan, K. (2020) · 2020 IEEE Applied Imagery Pattern Recognition Workshop (AIPR) · doi:10.1109/aipr50011.2020.9425167 · Cited by 80 · cited 1×
“Thus, it could help to detect whether it is fake or original audio content [21], [87].”
BackgroundWaveFake: A Data Set to Facilitate Audio Deepfake Detection
Frank, J., & Schönherr, L. (2021) · arXiv · doi:10.48550/arxiv.2111.02813 · Cited by 76 · cited 1×
“It was created using 6 different approaches and comprises 2 languages [109].”
MethodToward Robust Audio Spoofing Detection: A Detailed Comparison of Traditional and Learned Features
Balamurali, B. T., Lin, K. E., Lui, S., Chen, J.-M., & Herremans, D. (2019) · IEEE Access · doi:10.1109/access.2019.2923806 · Cited by 75 · cited 1×
“In [92], the authors proposed a hybrid approach in detecting spoofed audio.”
BackgroundImage Feature Detectors for Deepfake Video Detection
Kharbat, F. F., Elamsy, T., Mahmoud, A., & Abdullah, R. (2019) · 2019 IEEE/ACS 16th International Conference on Computer Systems and Applications (AICCSA) · doi:10.1109/aiccsa47632.2019.9035360 · Cited by 66 · cited 3×
“And then classification algorithms are used to classify whether sample content is fake or original [81].”
MethodInfluentialLong Range Acoustic and Deep Features Perspective on ASVspoof 2019
Das, R. K., Yang, J., & Li, H. (2019) · 2019 IEEE Automatic Speech Recognition and Understanding Workshop (ASRU) · doi:10.1109/asru46091.2019.9003845 · Cited by 65 · cited 2×
“Authors in [89] provided a solution for ASVSpoof 2019 challenge.”
BackgroundGeneralized end-to-end detection of spoofing attacks to automatic speaker recognizers
Monteiro, J., Alam, J., & Falk, T. H. (2020) · Computer Speech & Language · doi:10.1016/j.csl.2020.101096 · Cited by 62 · cited 1×
“In the other method proposed by Ling et al. [26] was built upon standard ResNet-based architecture as proposed in [91].”
MethodDua, M., Jain, C., & Kumar, S. (2021) · Journal of Ambient Intelligence and Humanized Computing · doi:10.1007/s12652-021-02960-0 · Cited by 58 · cited 2×
“For example, Dua et al. [27] created an ensemble model made up of three different models and aggregated their results.”
MethodDeepfake Audio Detection: A Deep Learning Based Solution for Group Conversations
Wijethunga, R. L. M. A. P. C., Matheesha, D. M. K., Noman, A. A., De Silva, K. H. V. T. A., Tissera, M., & Rupasinghe, L. (2020) · 2020 2nd International Conference on Advancements in Computing (ICAC) · doi:10.1109/icac51239.2020.9357161 · Cited by 57 · cited 1×
“In [93], the authors leveraged the capabilities of CNN and RNN.”
MethodDeepfake Videos in the Wild: Analysis and Detection
Pu, J., Mangaokar, N., Kelly, L., Bhattacharya, P., Sundaram, K., Javed, M., Wang, B., & Viswanath, B. (2021) · Proceedings of the Web Conference 2021 · doi:10.1145/3442381.3449978 · Cited by 51 · cited 1×
“It consists of 1,689 deepfake content [111].”
Self-citationThe Emerging Threats of Deepfake Attacks and CountermeasuresPreprint
Buo, S. A. (2020) · arXiv (Cornell University) · doi:10.13140/rg.2.2.23089.81762 · Cited by 49 · cited 1×
“In 2019, a video circulated on social media showed the United State speaker of the House Nancy Pelosi, slurring her words and appearing drunk [3].”
Background“Combating deepfakes: multi-LSTM and blockchain as proof of authenticity for digital media,”
Ki Chan, C. C., Kumar, V., Delaney, S., & Gochoo, M. (2020) · 2020 IEEE / ITU International Conference on Artificial Intelligence for Good (AI4G) · doi:10.1109/ai4g50087.2020.9311067 · Cited by 48 · cited 1×
“Some notable video tools include Faceswap, Faceswap-GAN, DeepFaceLab, DFaker, and many others [16].”
MethodImproved Generalizability of Deep-Fakes Detection using Transfer Learning Based CNN Framework
Ranjan, P., Patil, S., & Kazi, F. (2020) · 2020 3rd International Conference on Information and Computer Technologies (ICICT) · doi:10.1109/icict50521.2020.00021 · Cited by 46 · cited 3×
“And hence, improving generalizability [112].”
MethodInfluentialPixelCNN Models with Auxiliary Variables for Natural Image ModelingPreprint
Kolesnikov, A., & Lampert, C. H. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1612.08185 · Cited by 45
A Comparative Evaluation of Local Feature Descriptors for DeepFakes Detection
Akhtar, Z., & Dasgupta, D. (2019) · 2019 IEEE International Symposium on Technologies for Homeland Security (HST) · doi:10.1109/hst47167.2019.9033005 · Cited by 42 · cited 2×
“Among all, the IQM performed best [85] compared to PCM and LDA [8].”
MethodA Comparative Study of Deepfake Video Detection Method
Ramadhani, K. N., & Munir, R. (2020) · 2020 3rd International Conference on Information and Communications Technology (ICOIACT) · doi:10.1109/icoiact50329.2020.9331963 · Cited by 42 · cited 10×
“Similarly, a lot of deepfakes are used for the creation of fake pornographic content, which includes famous celebrities [6], [7], [8].”
BackgroundMethodInfluentialDeepFake Creation and Detection:A Survey
P, S., & Sk, S. (2021) · 2021 Third International Conference on Inventive Research in Computing Applications (ICIRCA) · doi:10.1109/icirca51532.2021.9544522 · Cited by 36 · cited 1×
“Nguyen et al. [32] have discussed deepfake generation tools, and the taxonomy of deepfake detection and they have also discussed video deepfake detection in detail.”
BackgroundA Study on Combating Emerging Threat of Deepfake Weaponization
Katarya, R., & Lal, A. (2020) · 2020 Fourth International Conference on I-SMAC (IoT in Social, Mobile, Analytics and Cloud) (I-SMAC) · doi:10.1109/i-smac49090.2020.9243588 · Cited by 36 · cited 10×
“DL is the technology fueling this rise of deepfakes [21].”
BackgroundMethodInfluentialDeepFake MNIST+: A DeepFake Facial Animation Dataset
Huang, J., Wang, X., Du, B., Du, P., & Xu, C. (2021) · 2021 IEEE/CVF International Conference on Computer Vision Workshops (ICCVW) · doi:10.1109/iccvw54120.2021.00224 · Cited by 35 · cited 1×
“It consists of 10,000 deepfake and 10,000 original content [108].”
BackgroundDeepfake Detection using Biological Features: A SurveyPreprint
Patil, K., Kale, S., Dhokey, J., & Gulhane, A. A. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2301.05819 · Cited by 35
A survey on artificial intelligence techniques for chronic diseases: open issues and challenges
Patel, K., Mistry, C., Mehta, D., Thakker, U., Tanwar, S., Gupta, R., & Kumar, N. (2021) · Artificial Intelligence Review · doi:10.1007/s10462-021-10084-2 · Cited by 34 · cited 1×
“GAN framework closely resembles the minimax two-player game [12].”
MethodSelf-citationDeepfake Detection in Media Files - Audios, Images and Videos
Nasar, B. F., T, S., & Lason, E. R. (2020) · 2020 IEEE Recent Advances in Intelligent Computational Systems (RAICS) · doi:10.1109/raics51191.2020.9332516 · Cited by 31 · cited 2×
“Nasar et al. [24] first converted the audio file into a corresponding spectrogram, and then this spectrogram image is then used to classify the audio using CNN-based architecture.”
BackgroundMethodMultimodal Approach for DeepFake Detection
Lomnitz, M., Hampel-Arias, Z., Sandesara, V., & Hu, S. (2020) · 2020 IEEE Applied Imagery Pattern Recognition Workshop (AIPR) · doi:10.1109/aipr50011.2020.9425192 · Cited by 30 · cited 1×
“In [96], the authors lomnitz et al. have proposed a multi modal based deepfake detection which aims at investigating manipulation detection from various perspectives.”
BackgroundSwapping Face Images with Generative Neural Networks for Deepfake Technology – Experimental Study
Zendran, M., & Rusiecki, A. (2021) · Procedia Computer Science · doi:10.1016/j.procs.2021.08.086 · Cited by 28
A landscape view of deepfake techniques and detection methods
Abdulreda, A. S., & Obaid, A. J. (2022) · International journal of nonlinear analysis and applications · doi:10.22075/ijnaa.2022.5580 · Cited by 26 · cited 1×
“Abdulreda et al. [33] discussed deepfake detection and various facial manipulations.”
BackgroundAttention-Based Convolutional Neural Network for ASV Spoofing Detection
Ling, H., Huang, L., Huang, J., Zhang, B., & Li, P. (2021) · Interspeech 2021 · doi:10.21437/interspeech.2021-1404 · Cited by 25 · cited 5×
“In [26], the authors have built their system considering the original CNN architecture.”
BackgroundMethodInfluentialVAE-GAN Based Zero-shot Outlier Detection
Bekkouch, I. E. I., Nicolae, D. C., Khan, A., Ali, S. I., & Khattak, A. M. (2020) · International Symposium on Computer Science and Intelligent Control (ISCSIC) · doi:10.1145/3440084.3441180 · Cited by 24 · cited 1×
“Some of the notable examples include the variational autoencoders (VAE) [58], VAE-GAN [59], CycleGAN [54], and others.”
BackgroundBig Data, Artificial Intelligence and Machine Learning: A Paradigm Shift in Election Campaigns
Safiullah, M., & Parveen, N. (2022) · doi:10.1002/9781119884392.ch11 · Cited by 20
Dhesi, S., Fontes, L., Machado, P., Ihianle, I. K., Tash, F. F., & Adama, D. A. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2302.11704 · Cited by 18
A Threat of Deepfakes as a Weapon on Digital Platform and their Detection Methods
Khichi, M., & Kumar Yadav, R. (2021) · 2021 12th International Conference on Computing Communication and Networking Technologies (ICCCNT) · doi:10.1109/icccnt51525.2021.9580031 · Cited by 16 · cited 1×
“For generating deepfake videos, the face of Person A needs to be replaced with the face of Person B frame by frame [43].”
MethodEnsembled EfficientNetB3 architecture for multi-class classification of tumours in MRI images
Dudeja, T., Dubey, S. K., & Bhatt, A. K. (2023) · Intelligent Decision Technologies · doi:10.3233/idt-220150 · Cited by 13 · cited 1×
“GANs are also used in the healthcare domain, where it can create artificial medical images of brain tumors in MRI scans for testing and validation models [14].”
Defamatory Political Deepfakes and the First Amendment
Ice, J. (2019) · Case Western Reserve University School of Law Scholarly Commons (Case Western Reserve University) · Cited by 10
Deepfake Detection Based on Incompatibility Between Multiple Modes
Zhang, Y., Zhan, J., Jiang, W., & Fan, Z. (2021) · 2021 International Conference on Intelligent Technology and Embedded Systems (ICITES) · doi:10.1109/icites53477.2021.9637096 · Cited by 7
Deepfake Images, Videos Generation, and Detection Techniques Using Deep Learning
Singh, R., Shrivastava, S., Jatain, A., & Bajaj, S. B. (2022) · Algorithms for intelligent systems · doi:10.1007/978-981-16-9650-3_39 · Cited by 5
Detecting deepfake videos by visual-audio synchronism
Fan, Z., Zhan, J., & Jiang, W. (2021) · ACM International Conference on Embedded Software (EMSOFT) · doi:10.1145/3477244.3477615 · Cited by 2
Research works printed but not linked: 9
- 2023, Uncanny Deepfake Tom Cruise Fools People on Tiktok
- 1999, Number of Expert-Crafted Video Deepfakes Double Every Six Months
- 2022, Faceswap
- 2022, Faceswap-Gan
- 2022, Deepfacelab
- 2022, Dfaker
- Sotelo, Char2Wav: End-to-end speech synthesis
- 10.1109/TPAMI.2020.2970919 · doi:10.1109/tpami.2020.2970919 · Paper page
- 1999, Deep Fake Detection Dataset
Cited by
Deepfake video detection: challenges and opportunities
Kaur, A., Noori Hoshyar, A., Saikrishna, V., Firmin, S., & Xia, F. (2024) · Artificial Intelligence Review · doi:10.1007/s10462-024-10810-6 · Cited by 214
“Video detection employs inter-frame comparison, motion analysis, and temporal coherence Page 19 of 47 159 (Patel et al. 2023).”
Audio Deepfake Detection: What Has Been Achieved and What Lies Ahead
Zhang, B., Cui, H., Nguyen, V., & Whitty, M. (2025) · Sensors · doi:10.3390/s25071989 · Cited by 72
“In addition, Patel et al. [34] conducted a broad review of deepfake generation and detection technologies in 2023, analysing current challenges and research directions through case studies, and Yi et al. [35] provided a detailed classification of feature extraction methods, classification…”
Khan, A. A., Laghari, A. A., Inam, S. A., Ullah, S., Shahzad, M., & Syed, D. (2025) · Discover Computing · doi:10.1007/s10791-025-09550-0 · Cited by 99
“Because of their capacity to withstand the posting of high-quality synthetic material on social media, the idea of technological integration has attracted a lot of interest [51, 52].”
Hynek, N., Gavurova, B., & Kubak, M. (2025) · Journal of Innovation & Knowledge · doi:10.1016/j.jik.2025.100782 · Cited by 47
Kumar, A., Singh, D., Jain, R., Jain, D. K., Gan, C., & Zhao, X. (2025) · Information Fusion · doi:10.1016/j.inffus.2025.102993 · Cited by 59
Metadata
- Authors
- Patel, Y., Tanwar, S., Gupta, R., Bhattacharya, P., Davidson, I. E., Nyameko, R., Aluvala, S., & Vimal, V.
- Affiliations
- Nirma University (IN)
- Amity University (IN)
- Cape Peninsula University of Technology (ZA)
- Department of Electrical, Electronic and Computer Engineering, African Space Innovation Center, Cape Peninsula University of Technology, Bellville, South Africa
- SR University (IN)
- Graphic Era Hill University (IN)
- ORCID
- Venue
- IEEE Access
- Published
- 2023
- Volume
- 11
- Pages
- 143296-143323
- ISSN
- 2169-3536 (ISSN-L)
- OpenAlex
- W4389633690
- Cited by
- 186
- References
- 106
- Citations by year
- 2026: 64 · 2025: 86 · 2024: 36
- FWCI
- 16.88
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- IEEE Access (publishedVersion, cc-by-nc-nd)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Digital Media Forensic Detection
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Generative Adversarial Networks and Image Synthesis
- Social Sciences › Sociology and Political Science › Misinformation and Its Impacts
- Keywords
- deepfakes, deepfake generation, deepfake detection, generative adversarial networks, synthetic media, deepfake datasets, misinformation, propaganda, social media, deepfake audio
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.