Audio deepfakes: A survey
Open accessThe DOI matches its Crossref record; 127 of the 143 references it cites were found in a registry or an index; 32 of the 68 sources its claims cite were checked for support.
Abstract
A deepfake is content or material that is synthetically generated or manipulated using artificial intelligence (AI) methods, to be passed off as real and can include audio, video, image, and text synthesis. The key difference between manual editing and deepfakes is that deepfakes are AI generated or AI manipulated and closely resemble authentic artifacts. In some cases, deepfakes can be fabricated using AI-generated content in its entirety. Deepfakes have started to have a major impact on society with more generation mechanisms emerging everyday. This article makes a contribution in understanding the landscape of deepfakes, and their detection and generation methods. We evaluate various categories of deepfakes especially in audio. The purpose of this survey is to provide readers with a deeper understanding of (1) different deepfake categories; (2) how they could be created and detected; (3) more specifically, how audio deepfakes are created and detected in more detail, which is the main focus of this paper. We found that generative adversarial networks (GANs), convolutional neural networks (CNNs), and deep neural networks (DNNs) are common ways of creating and detecting deepfakes. In our evaluation of over 150 methods, we found that the majority of the focus is on video deepfakes, and, in particular, the generation of video deepfakes. We found that for text deepfakes, there are more generation methods but very few robust methods for detection, including fake news detection, which has become a controversial area of research because of the potential heavy overlaps with human generation of fake content. Our study reveals a clear need to research audio deepfakes and particularly detection of audio deepfakes. This survey has been conducted with a different perspective, compared to existing survey papers that mostly focus on just video and image deepfakes. This survey mainly focuses on audio deepfakes that are overlooked in most of the existing surveys. This article's most important contribution is to critically analyze and provide a unique source of audio deepfake research, mostly ranging from 2016 to 2021. To the best of our knowledge, this is the first survey focusing on audio deepfakes generation and detection in English.
Overview
CoChat Summary
## TL;DR
This 2023 survey argues that audio deepfakes are under-covered relative to video/image deepfakes and provides a detailed overview of how audio deepfakes are generated, detected, and benchmarked. It reports that across the surveyed literature, generation methods have advanced faster than detection, and that audio deepfake research needs better generalization and more robust defenses.
## Key findings
- The authors surveyed over 150 methods and say that audio deepfakes are overlooked in existing surveys; they claim this is the first survey focusing on audio deepfake generation and detection in English.
- In their review, they found that GANs, CNNs, and DNNs are common ways of creating and detecting deepfakes, and that most surveyed work focuses on video deepfakes, especially generation.
- For text deepfakes, they report more generation methods but very few robust detection methods, including fake news detection.
- For audio generation quality, they report that Mean Opinion Score (MOS) is better with single-speaker training data than with multi-speaker datasets, and that sampling rates below 16 kHz significantly reduce perceived quality.
- For replay-attack detection, they note one deep convolutional network method achieved EER = 0% on the ASVspoof 2017 development and evaluation set, compared with prior bests of 12% development EER and 2.76% evaluation EER.
## Methods
- The paper is a survey/review, not an empirical experiment: it synthesizes prior work across audio, text, video, and image deepfakes, with special focus on audio.
- It states that the review covers more than 150 methods, with detailed discussion of audio generation, detection, datasets, and architectures from roughly 2016 to 2021.
- The authors also summarize common datasets and models used in audio deepfake research, including ASVspoof 2015/2017/2019/2021, FoR, and WaveFake, plus architectures such as WaveNet, Tacotron, Tacotron 2, WaveGlow, Deep Voice 3, MelNet, ResNet, TCN, and biLSTM.
## Limitations
- The paper explicitly says it does not discuss the details of the frameworks used for all deepfake categories; instead, it gives more detailed attention to audio and only recent trends for the other categories.
- It also says that the survey of audio deepfakes is not exhaustive for every framework, relying on supplementary tables for summaries and guides.
- Evident from the text: several sections are high-level and descriptive rather than systematic meta-analysis, so the paper does not report a unified quantitative comparison across all methods.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures










Verification
Claims the paper makes
25 Valid · 5 Not valid · 26 Not checked · 20 Own results and interpretations
Every source the paper cites for this claim was checked and supports it.
In the paper
“Accents can be hard to imitate because they lack dialect variation modeling (Kuligowska et al., 2018).”
§ Audio deepfakes: A survey > 3. Deepfake categories > 3.1. Audio deepfakes
What the sources say
- Supportedcites Kuligowska et al., 2018 source
Section 4.2 (Prosody; page not provided) states that speech synthesis systems lack dialect-variation modeling and discusses the difficulty of producing and changing accents. This supports the citing sentence’s paraphrase. (LLM, conf=0.94)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“The ASVspoof 2019 (Wang X. et al., 2020) edition is the first audio spoof detection challenge that considered all three spoofing attack types (replay, text-to-speech and VC).”
§ Audio deepfakes: A survey > 4. Audio deepfake datasets
What the sources say
- Supportedcites Wang X. et al., 2020 source
The Introduction (p. 2) explicitly says ASVspoof 2019 was the first to consider speech synthesis, voice conversion, and replay within a single challenge. It contrasts this with the 2015 and 2017 editions, which addressed synthesis and conversion, and replay, respectively. (LLM, conf=0.95)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“One can sometimes tell it is not human-like because there is no breathing, laughter, pauses, and sighs among other things in human speech (Kuligowska et al., 2018).”
§ Audio deepfakes: A survey > 3. Deepfake categories > 3.1. Audio deepfakes
What the sources say
- Partly supportedcites Kuligowska et al., 2018 sourceExperimental — accuracy not yet measured
Section 4.3 (Spontaneous speech; page unavailable) says current synthesis systems avoid or poorly model features of spontaneous speech, including laughter, sighs and breathing. It mentions hesitations but not pauses, and it does not say these features are always absent. Section 4.2 (Prosody; page unavailable) supports the broader point that synthetic speech can lack natural rhythm. (LLM, conf=0.84)
hedgedstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Faceswapping can also be difficult to identify it as a deepfake when the pictures artifacts are hidden behind the compression artifacts (Mirsky and Lee, 2021).”
§ Audio deepfakes: A survey > 3. Deepfake categories > 3.4. Image deepfakes
What the sources say
- Partly supportedcites Mirsky and Lee, 2021 sourceExperimental — accuracy not yet measured
Section 6.1 (p. 26) describes artifacts used to detect face swaps, and Section 7.2 (p. 31) says compression can evade forensic detectors or raise their false-alarm rate. The paper does not specifically say that compression artifacts hide visible picture artifacts, so the claimed mechanism is not established. (LLM, conf=0.82)
plainstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Given our evaluation of different audio deepfake frameworks' performance, the Mean Opinion Score (MOS) of the generated audio is better when the framework is trained using single speaker datasets (Oord et al., 2016; Ping et al., 2018; Kumar et al., 2019; Kong et al., 2020).”
§ Audio deepfakes: A survey > 6. Discussion and future directions > 6.1. Deepfake generation
What the sources say
- Partly supportedcites Oord et al., 2016 sourceExperimental — accuracy not yet measured
Section 3.2 (p. 6) reports that WaveNet trained on single-speaker datasets achieved higher MOS than baseline synthesizers. But the baselines used the same datasets, so this does not show that single-speaker training produces better MOS than multi-speaker training. Section 3.1 (p. 5) compares speaker counts only on validation performance, not MOS. (LLM, conf=0.85)
- Partly supportedcites Ping et al., 2018 sourceExperimental — accuracy not yet measured
The Results (pp. 8–9, Tables 2–3) report higher MOS values for Deep Voice 3 on its single-speaker dataset than on the multi-speaker VCTK and LibriSpeech datasets. But these are not controlled comparisons of speaker count, and the authors attribute LibriSpeech’s lower score relative to VCTK chiefly to recording quality. The paper therefore supports the observed score pattern, not the broader implication that single-speaker training itself produces better MOS. (LLM, conf=0.85)
- Partly supportedcites Kumar et al., 2019 sourceExperimental — accuracy not yet measured
Section 3.1 (pp. 6–7) reports a MelGAN MOS of 3.61 for a model trained on LJ Speech and 3.49 in a separate VCTK evaluation following discussion of training on a six-speaker dataset. Those scores are in the claimed direction, but the evaluations use different audio and are not a controlled comparison showing that single-speaker training produces better MOS generally. (LLM, conf=0.79)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
14 more claims
Create a free account to see all 76 claims and every source verdict.
- Probably not a substantial claim. 38
- It may state two separate claims as one. 35
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Heidari et al. (2023) and Khanjani et al. (2023) mentioned that blockchains and distributed ledger technologies can be leveraged for enhanced digital content traceability and identity sovereignty.”
From Deepfake: definitions, performance metrics and standards, datasets, and a meta-review (2024) · cites this paper as Khanjani et al., 2023
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Unlike deepfake detection for images and videos, which has been intensively studied [28,29,30,31], audio deepfake detection has been overlooked in most of the existing surveys until recently [32].”
From Audio Deepfake Detection: What Has Been Achieved and What Lies Ahead (2025) · cites this paper as [32]
The cited source says what the claim attributes to it.
In the citing paper
“There have been significant advancements in machine learning models, methods for modifying audio and video, and other approaches along the technological progression of deep fake production (Khanjani etal. 2023).”
From Deepfake video detection: challenges and opportunities (2024) · cites this paper as Khanjani et al. 2023
The cited source says what the claim attributes to it.
In the citing paper
“only three of them (Heidari et al., 2023; Khanjani et al., 2023; Masood et al., 2023) mentioned audio datasets.”
From Deepfake: definitions, performance metrics and standards, datasets, and a meta-review (2024) · cites this paper as Khanjani et al., 2023
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Self-check results appear here once an independent check has confirmed them.
Cited works that were retracted
Works this paper cites that were later retracted, from the retraction notices publishers deposit. Major when the notice came out before this paper was published.
A note, not an issue: for example, a cited work that was retracted only after this paper was published, which its authors could not have known.
In the paper
“Song, 2021, Secure prediction and assessment of sports injuries using deep learning based convolutional neural network, J. Ambient. Intell. Humaniz Comput, 12, 3399, 10.1007/s12652-020-02560-4”
Cited work 10.1007/s12652-020-02560-4 · retracted 2024-06-07 · notice 10.1007/s12652-024-04823-w · this paper published 2023-01-09
Citations
Cites
1 retracted
Song, H., Han, X.-Y., Montenegro, C., & Krishnamoorthy, S. (2021) · Journal of Ambient Intelligence and Humanized Computing · doi:10.1007/s12652-020-02560-4 · Cited by 102
RetractedLeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
Image-to-Image Translation with Conditional Adversarial Networks
Isola, P., Zhu, J.-Y., Zhou, T., & Efros, A. A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.632 · Cited by 22,930
Labaca-Castro, R. (2023) · Machine Learning under Malware Attack · doi:10.1007/978-3-658-40442-0_9 · Cited by 19,272
Sequence to Sequence Learning with Neural Networks
Sutskever, I., Vinyals, O., & Le, Q. V. (2014) · arXiv · doi:10.48550/arxiv.1409.3215 · Cited by 17,766
A Style-Based Generator Architecture for Generative Adversarial Networks
Karras, T., Laine, S., & Aila, T. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00453 · Cited by 11,714
Analyzing and Improving the Image Quality of StyleGAN
Karras, T., Laine, S., Aittala, M., Hellsten, J., Lehtinen, J., & Aila, T. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00813 · Cited by 6,332
Analyzing and Improving the Image Quality of StyleGAN
Karras, T., Laine, S., Aittala, M., Hellsten, J., Lehtinen, J., & Aila, T. (2019) · arXiv · doi:10.48550/arxiv.1912.04958 · Cited by 6,332
“Librispeech: an ASR corpus based on public domain audio books,”
Panayotov, V., Chen, G., Povey, D., & Khudanpur, S. (2015) · 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2015.7178964 · Cited by 6,072
“Least squares generative adversarial networks,”
Mao, X., Li, Q., Xie, H., Lau, R. Y. K., Wang, Z., & Smolley, S. P. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.304 · Cited by 5,437
Natural Language Processing (almost) from Scratch
Collobert, R., Weston, J., Bottou, L., Karlen, M., Kavukcuoglu, K., & Kuksa, P. P. (2011) · arXiv (Cornell University) · doi:10.48550/arxiv.1103.0398 · Cited by 4,962
WaveNet: a generative model for raw audio
Oord, A. V. D., Dieleman, S., Zen, H., Simonyan, K., Vinyals, O., Graves, A., Kalchbrenner, N., Senior, A., & Kavukcuoglu, K. (2016) · arXiv · doi:10.48550/arxiv.1609.03499 · Cited by 4,911
StarGAN: Unified Generative Adversarial Networks for Multi-domain Image-to-Image Translation
Choi, Y., Choi, M., Kim, M., Ha, J.-W., Kim, S., & Choo, J. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00916 · Cited by 4,163
Deep Learning: Methods and Applications
Deng, L., & Yu, D. (2014) · Foundations and Trends® in Signal Processing · doi:10.1561/2000000039 · Cited by 3,480
Natural TTS Synthesis by Conditioning Wavenet on MEL Spectrogram Predictions
Shen, J., Pang, R., Weiss, R. J., Schuster, M., Jaitly, N., Yang, Z., Chen, Z., Zhang, Y., Wang, Y., Skerrv-Ryan, R., et al. (2018) · 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2018.8461368 · Cited by 2,791
VoxCeleb2: Deep Speaker Recognition
Chung, J. S., Nagrani, A., & Zisserman, A. (2018) · Interspeech 2018 · doi:10.21437/interspeech.2018-1929 · Cited by 2,256
Tacotron: towards end-to-end speech synthesis
Wang, Y., Skerry-Ryan, R. J., Stanton, D., Wu, Y., Weiss, R. J., Jaitly, N., Yang, Z., Xiao, Y., Chen, Z., Bengio, S., et al. (2017) · Interspeech 2017 · doi:10.21437/interspeech.2017-1452 · Cited by 1,746 · cited 8×
“Therefore, Tacotron 2 (Shen et al., 2018) system includes two components.”
BackgroundMethodInfluentialDeferred neural rendering: image synthesis using neural textures
Thies, J., Zollhöfer, M., & Nießner, M. (2019) · ACM Transactions on Graphics · doi:10.1145/3306346.3323035 · Cited by 1,356
Deepfakes and beyond: A Survey of face manipulation and fake detection
Tolosana, R., Vera-Rodriguez, R., Fierrez, J., Morales, A., & Ortega-Garcia, J. (2020) · Information Fusion · doi:10.1016/j.inffus.2020.06.014 · Cited by 1,237
Machine Learning and Deep Learning Methods for Cybersecurity
Xin, Y., Kong, L., Liu, Z., Chen, Y., Li, Y., Zhu, H., Gao, M., Hou, H., & Wang, C. (2018) · IEEE Access · doi:10.1109/access.2018.2836950 · Cited by 1,228
In Ictu Oculi: Exposing AI Created Fake Videos by Detecting Eye Blinking
Li, Y., Chang, M.-C., & Lyu, S. (2018) · 2018 IEEE International Workshop on Information Forensics and Security (WIFS) · doi:10.1109/wifs.2018.8630787 · Cited by 1,089
Synthesizing Obama: learning lip sync from audio
Suwajanakorn, S., Seitz, S. M., & Kemelmacher-Shlizerman, I. (2017) · ACM Transactions on Graphics · doi:10.1145/3072959.3073640 · Cited by 1,057
“Waveglow: a flow-based generative network for speech synthesis,”
Prenger, R., Valle, R., & Catanzaro, B. (2019) · ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2019.8683143 · Cited by 1,004
Voice Conversion Based on Maximum-Likelihood Estimation of Spectral Parameter Trajectory
Toda, T., Black, A. W., & Tokuda, K. (2007) · IEEE Transactions on Audio, Speech and Language Processing · doi:10.1109/tasl.2007.907344 · Cited by 937
The Creation and Detection of Deepfakes: A Survey
Mirsky, Y., & Lee, W. (2022) · ACM Computing Surveys · doi:10.1145/3425780 · Cited by 863 · cited 6×
“The last sub-categorization for reenactment is for the body which uses human pose synthesis or pose transfer which is like a facial reenactment (Mirsky and Lee, 2021).”
BackgroundInfluentialThe Creation and Detection of Deepfakes: A Survey
Mirsky, Y., & Lee, W. (2020) · arXiv · doi:10.48550/arxiv.2004.11138 · Cited by 863
Glow: Generative Flow with Invertible 1x1 Convolutions
Kingma, D. P., & Dhariwal, P. (2018) · arXiv · Cited by 825
Combining Markov Random Fields and Convolutional Neural Networks for Image Synthesis
Li, C., & Wand, M. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.272 · Cited by 741
Chan, C., Ginosar, S., Zhou, T., & Efros, A. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00603 · Cited by 737
HiFi-GAN: Generative Adversarial Networks for Efficient and High Fidelity Speech Synthesis
Kong, J., Kim, J., & Bae, J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.05646 · Cited by 722
MelGAN: generative adversarial networks for conditional waveform synthesis
Kumar, K., Kumar, R., de Boissiere, T., Gestin, L., Teoh, W. Z., Sotelo, J., de Brebisson, A., Bengio, Y., & Courville, A. (2019) · arXiv · doi:10.48550/arxiv.1910.06711 · Cited by 722 · cited 2×
“Given our evaluation of different audio deepfake frameworks’ performance, the Mean Opinion Score (MOS) of the generated audio is better when the framework is trained using single speaker datasets (Oord et al., 2016; Ping et al., 2018; Kumar et al., 2019; Kong et al., 2020).”
BackgroundMethodFew-Shot Adversarial Learning of Realistic Neural Talking Head Models
Zakharov, E., Shysheya, A., Burkov, E., & Lempitsky, V. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00955 · Cited by 687
FastSpeech 2: Fast and High-Quality End-to-End Text to Speech
Ren, Y., Hu, C., Tan, X., Qin, T., Zhao, S., Zhao, Z., & Liu, T.-Y. (2020) · arXiv · doi:10.48550/arxiv.2006.04558 · Cited by 580
Loey, M., Smarandache, F., & M. Khalifa, N. E. (2020) · Symmetry · doi:10.3390/sym12040651 · Cited by 538 · cited 1×
“Sometimes, the issue of a dataset shortage could be solved using GAN instead of CNN, and it has really helped in the early phase of COVID19 pandemic to have a novel detection method (Loey et al., 2020).”
BackgroundThe ASVspoof 2017 challenge: assessing the limits of replay spoofing attack detection
Kinnunen, T., Sahidullah, M., Delgado, H., Todisco, M., Evans, N., Yamagishi, J., & Lee, K. A. (2017) · Interspeech 2017 · doi:10.21437/interspeech.2017-1111 · Cited by 535
Transfer learning from speaker verification to multispeaker text-to-speech synthesis
Jia, Y., Zhang, Y., Weiss, R. J., Wang, Q., Shen, J., Ren, F., Chen, Z., Nguyen, P., Pang, R., Moreno, I. L., et al. (2018) · arXiv · doi:10.48550/arxiv.1806.04558 · Cited by 519 · cited 1×
“This only needed 5 s (Jia et al., 2019).”
ASVspoof 2019: A large-scale public database of synthesized, converted and replayed speech
Wang, X., Yamagishi, J., Todisco, M., Delgado, H., Nautsch, A., Evans, N., Sahidullah, M., Vestman, V., Kinnunen, T., Lee, K. A., et al. (2020) · Computer Speech & Language · doi:10.1016/j.csl.2020.101114 · Cited by 505
ASVspoof 2015: the first automatic speaker verification spoofing and countermeasures challenge
Wu, Z., Kinnunen, T., Evans, N., Yamagishi, J., Hanilçi, C., Sahidullah, M., & Sizov, A. (2015) · Interspeech 2015 · doi:10.21437/interspeech.2015-462 · Cited by 484 · cited 2×
“• ASVspoof 2015: This dataset contains text-to-speech and VC samples (Wu et al., 2015).”
BackgroundFully Character-Level Neural Machine Translation without Explicit Segmentation
Lee, J., Cho, K., & Hofmann, T. (2017) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00067 · Cited by 394
Probabilistic forecasting with temporal convolutional neural network
Chen, Y., Kang, Y., Chen, Y., & Wang, Z. (2020) · Neurocomputing · doi:10.1016/j.neucom.2020.03.011 · Cited by 393
High-level feature representation using recurrent neural network for speech emotion recognition
Lee, J., & Tashev, I. (2015) · Interspeech 2015 · doi:10.21437/interspeech.2015-336 · Cited by 388
Deep Voice: Real-time Neural Text-to-Speech
Arık, S. Ö., Chrzanowski, M., Coates, A., Diamos, G., Gibiansky, A., Kang, Y., Li, X., Miller, J. J., Ng, A. Y., Raiman, J., et al. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1702.07825 · Cited by 381
“StarGAN-VC: non-parallel many-to-many voice conversion using star generative adversarial networks,”
Kameoka, H., Kaneko, T., Tanaka, K., & Hojo, N. (2018) · 2018 IEEE Spoken Language Technology Workshop (SLT) · doi:10.1109/slt.2018.8639535 · Cited by 371
CSTR VCTK Corpus: English Multi-speaker Corpus for CSTR Voice Cloning Toolkit (version 0.92)
Yamagishi, J., Veaux, C., & MacDonald, K. (2019) · University of Edinburgh. The Centre for Speech Technology Research (CSTR) · doi:10.7488/ds/2645 · Cited by 356
Emotions Don't Lie: An Audio-Visual Deepfake Detection Method using Affective Cues
Mittal, T., Bhattacharya, U., Chandra, R., Bera, A., & Manocha, D. (2020) · Proceedings of the 28th ACM International Conference on Multimedia · doi:10.1145/3394171.3413570 · Cited by 319 · cited 2×
“Extracting and comparing affecting cues corresponding to perceived emotions from the digital content is also proposed as a way to combat deepfakes (Mittal et al., 2020).”
Background(2017) · International Conference on Learning Representations · Cited by 314
Deep voice 3: scaling text-to-speech with convolutional sequence learning
Ping, W., Peng, K., Gibiansky, A., Arik, S. O., Kannan, A., Narang, S., Raiman, J., & Miller, J. (2017) · arXiv · doi:10.48550/arxiv.1710.07654 · Cited by 313
Audio replay attack detection with deep learning frameworks
Lavrentyeva, G., Novoselov, S., Malykh, E., Kozlov, A., Kudashev, O., & Shchemelinin, V. (2017) · Interspeech 2017 · doi:10.21437/interspeech.2017-360 · Cited by 292
A survey on the application of recurrent neural networks to statistical language modeling
De Mulder, W., Bethard, S., & Moens, M.-F. (2015) · Computer Speech & Language · doi:10.1016/j.csl.2014.09.005 · Cited by 272
FakeSpotter: A Simple yet Robust Baseline for Spotting AI-Synthesized Fake Faces
Wang, R., Juefei-Xu, F., Ma, L., Xie, X., Huang, Y., Wang, J., & Liu, Y. (2020) · Proceedings of the Twenty-Ninth International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2020/476 · Cited by 250
ArunKumar, K. E., Kalaga, D. V., Kumar, C. M. S., Kawaji, M., & Brenza, T. M. (2021) · Chaos, Solitons & Fractals · doi:10.1016/j.chaos.2021.110861 · Cited by 246
One-class learning towards synthetic voice spoofing detection
Zhang, Y., Jiang, F., & Duan, Z. (2021) · IEEE Signal Processing Letters · doi:10.1109/lsp.2021.3076358 · Cited by 241
ASVspoof: The Automatic Speaker Verification Spoofing and Countermeasures Challenge
Wu, Z., Yamagishi, J., Kinnunen, T., Hanilci, C., Sahidullah, M., Sizov, A., Evans, N., Todisco, M., & Delgado, H. (2017) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2017.2671435 · Cited by 229
Recurrent convolutional structures for audio spoof and video deepfake detection
Chintha, A., Thai, B., Sohrawardi, S. J., Bhatt, K., Hickerson, A., Wright, M., & Ptucha, R. (2020) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2020.2999185 · Cited by 226
Statistical Parametric Speech Synthesis Incorporating Generative Adversarial Networks
Saito, Y., Takamichi, S., & Saruwatari, H. (2018) · IEEE/ACM Transactions on Audio, Speech, and Language Processing · doi:10.1109/taslp.2017.2761547 · Cited by 223
A survey on neural speech synthesis
Tan, X., Qin, T., Soong, F., & Liu, T.-Y. (2021) · arXiv · doi:10.48550/arxiv.2106.15561 · Cited by 216 · cited 2×
“Vocoder is a part of AI-generative networks which synthesizes waveforms based on acoustic or linguistic features obtained from previous steps in the network (Tan et al., 2021).”
BackgroundDeep Residual Neural Networks for Audio Spoofing Detection
Alzantot, M., Wang, Z., & Srivastava, M. B. (2019) · Interspeech 2019 · doi:10.21437/interspeech.2019-3174 · Cited by 215
Deep Voice 2: Multi-Speaker Neural Text-to-Speech
Arık, S. Ö., Diamos, G., Gibiansky, A., Miller, J. J., Peng, K., Ping, W., Raiman, J., & Zhou, Y. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1705.08947 · Cited by 206
Generalization of Audio Deepfake Detection
Chen, T., Kumar, A., Nagarsheth, P., Sivaraman, G., & Khoury, E. (2020) · The Speaker and Language Recognition Workshop (Odyssey 2020) · doi:10.21437/odyssey.2020-19 · Cited by 200 · cited 3×
“It is also improved to reduce EER metric as well as solve the generalization problem (Chen T. et al., 2020).”
BackgroundMethodFoR: A Dataset for Synthetic Speech Detection
Reimao, R., & Tzerpos, V. (2019) · 2019 International Conference on Speech Technology and Human-Computer Dialogue (SpeD) · doi:10.1109/sped.2019.8906599 · Cited by 193
Glow-TTS: A Generative Flow for Text-to-Speech via Monotonic Alignment Search
Kim, J., Kim, S., Kong, J., & Yoon, S. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2005.11129 · Cited by 193
A Review of Modern Audio Deepfake Detection Methods: Challenges and Future Directions
Almutairi, Z., & Elgibreen, H. (2022) · Algorithms · doi:10.3390/a15050155 · Cited by 187 · cited 2×
“Most of the features are the spectral features obtained from audio data, a comprehensive review of the different features which are used in audio deepfake detection could be found in Almutairi and Elgibreen (2022).”
BackgroundMethodInfluentialTransformation of formants for voice conversion using artificial neural networks
Narendranath, M., Murthy, H. A., Rajendran, S., & Yegnanarayana, B. (1995) · Speech Communication · doi:10.1016/0167-6393(94)00058-i · Cited by 181
ResNet and Model Fusion for Automatic Spoofing Detection
Chen, Z., Xie, Z., Zhang, W., & Xu, X. (2017) · Interspeech (USB) · doi:10.21437/interspeech.2017-1085 · Cited by 171
Speech emotion recognition using recurrent neural networks with directional self-attention
Li, D., Liu, J., Yang, Z., Sun, L., & Wang, Z. (2021) · Expert Systems with Applications · doi:10.1016/j.eswa.2021.114683 · Cited by 171
Grekousis, G. (2019) · Computers, Environment and Urban Systems · doi:10.1016/j.compenvurbsys.2018.10.008 · Cited by 171
Improving the intelligibility of dysarthric speech
Kain, A. B., Hosom, J.-P., Niu, X., van Santen, J. P. H., Fried-Oken, M., & Staehely, J. (2007) · Speech Communication · doi:10.1016/j.specom.2007.05.001 · Cited by 158
The Voice Conversion Challenge 2016
Toda, T., Chen, L.-H., Saito, D., Villavicencio, F., Wester, M., Wu, Z., & Yamagishi, J. (2016) · Interspeech 2016 · doi:10.21437/interspeech.2016-1066 · Cited by 156 · cited 2×
“A benefit of using voice conversion is it can help those with speech disorders, which is useful for rehabilitation medicine (Abe et al., 1990; Toda et al., 2016).”
BackgroundMethodHigh-resolution neural face swapping for visual effects
Naruniec, J., Helminger, L., Schroers, C., & Weber, R. M. (2020) · Computer Graphics Forum · doi:10.1111/cgf.14062 · Cited by 154
Voice conversion through vector quantization
Abe, M., Nakamura, S., Shikano, K., & Kuwabara, H. (1990) · Journal of the Acoustical Society of Japan (E) · doi:10.1250/ast.11.71 · Cited by 150
Audio Replay Attack Detection Using High-Frequency Features
Witkowski, M., Kacprzak, S., Żelasko, P., Kowalczyk, K., & Gałka, J. (2017) · Interspeech 2017 · doi:10.21437/interspeech.2017-776 · Cited by 140
A deep learning framework for audio deepfake detection
Khochare, J., Joshi, C., Yenarkar, B., Suratkar, S., & Kazi, F. (2022) · Arabian Journal for Science and Engineering · doi:10.1007/s13369-021-06297-w · Cited by 135
DeepSonar: Towards Effective and Robust Detection of AI-Synthesized Fake Voices
Wang, R., Juefei-Xu, F., Huang, Y., Guo, Q., Xie, X., Ma, L., & Liu, Y. (2020) · Proceedings of the 28th ACM International Conference on Multimedia · doi:10.1145/3394171.3413716 · Cited by 131 · cited 7×
“The study (Wang et al., 2020a) proposes an audio deepfake detection system called DeepSonar capable of both VC and text-to-speech samples.”
BackgroundMethodInfluentialForeign accent conversion in computer assisted pronunciation training
Felps, D., Bortfeld, H., & Gutierrez-Osuna, R. (2009) · Speech Communication · doi:10.1016/j.specom.2008.11.004 · Cited by 130
A survey on text generation using generative adversarial networks
de Rosa, G. H., & Papa, J. P. (2021) · Pattern Recognition · doi:10.1016/j.patcog.2021.108098 · Cited by 129
ASVspoof 2021: Automatic Speaker Verification Spoofing and Countermeasures Challenge Evaluation Plan
Delgado, H., Evans, N., Kinnunen, T., Lee, K. A., Liu, X., Nautsch, A., Patino, J., Sahidullah, M., Todisco, M., Wang, X., et al. (2021) · arXiv · doi:10.48550/arxiv.2109.00535 · Cited by 129
“High-quality nonparallel voice conversion based on cycle-consistent adversarial network,”
Fang, F., Yamagishi, J., Echizen, I., & Lorenzo-Trueba, J. (2018) · 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2018.8462342 · Cited by 128
The Future of False Information Detection on Social Media: New Perspectives and Trends
Guo, B., Ding, Y., Yao, L., Liang, Y., & Yu, Z. (2021) · ACM Computing Surveys · doi:10.1145/3393880 · Cited by 122
Replay Attack Detection Using DNN for Channel Discrimination
Nagarsheth, P., Khoury, E., Patil, K., & Garland, M. (2017) · Interspeech (USB) · doi:10.21437/interspeech.2017-1377 · Cited by 112
Deep learning for deepfakes creation and detection: a survey
Nguyen, T. T., Nguyen, Q. V. H., Nguyen, D. T., Nguyen, D. T., Huynh-The, T., Nahavandi, S., Nguyen, T. T., Pham, Q.-V., & Nguyen, C. M. (2022) · SSRN Electronic Journal · doi:10.2139/ssrn.4030341 · Cited by 112
Fraga-Lamas, P., & Fernandez-Carames, T. M. (2020) · IT Professional · doi:10.1109/mitp.2020.2977589 · Cited by 111
Voice Impersonation Using Generative Adversarial Networks
Gao, Y., Singh, R., & Raj, B. (2018) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2018.8462018 · Cited by 109
“Preventing replay attacks on speaker verification systems,”
Villalba, J., & Lleida, E. (2011) · 2011 Carnahan Conference on Security Technology · doi:10.1109/ccst.2011.6095943 · Cited by 108 · cited 2×
“Defense: Some advantages of this category are that to defend against replay attacks one can use text dependent speaker verification (Villalba and Lleida, 2011).”
BackgroundMelNet: a generative model for audio in the frequency domain
Vasquez, S., & Lewis, M. (2019) · arXiv · doi:10.48550/arxiv.1906.01083 · Cited by 107
Kobayashi, K., Toda, T., Neubig, G., Sakti, S., & Nakamura, S. (2014) · Interspeech (USB) · doi:10.21437/interspeech.2014-539 · Cited by 89
End-to-end audio replay attack detection using deep convolutional networks with attention
Tom, F., Jain, M., & Dey, P. (2018) · Interspeech 2018 · doi:10.21437/interspeech.2018-2279 · Cited by 89
Attentive Filtering Networks for Audio Replay Attack Detection
Lai, C.-I., Abad, A., Richmond, K., Yamagishi, J., Dehak, N., & King, S. (2019) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2019.8682640 · Cited by 86
Segment-based speech emotion recognition using recurrent neural networks
Tzinis, E., & Potamianos, A. (2017) · International Conference on Affective Computing and Intelligent Interaction and workshops · doi:10.1109/acii.2017.8273599 · Cited by 85
A Capsule Network Based Approach for Detection of Audio Spoofing Attacks
Luo, A., Li, E., Liu, Y., Kang, X., & Wang, Z. J. (2021) · ICASSP 2021 - 2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp39728.2021.9414670 · Cited by 84
Toward Robust Audio Spoofing Detection: A Detailed Comparison of Traditional and Learned Features
Balamurali, B. T., Lin, K. W. E., Lui, S., Chen, J., & Herremans, D. (2019) · IEEE Access · doi:10.1109/access.2019.2923806 · Cited by 83
Zhang, J.-X., Ling, Z.-H., & Dai, L.-R. (2020) · IEEE/ACM Transactions on Audio, Speech, and Language Processing · doi:10.1109/taslp.2019.2960721 · Cited by 77
WaveFake: A Data Set to Facilitate Audio Deepfake Detection
Frank, J., & Schönherr, L. (2021) · arXiv · doi:10.48550/arxiv.2111.02813 · Cited by 76 · cited 1×
“The dataset (Frank and Schönherr, 2021) consists of 117,985 generated audio clips (196 h total time).”
MethodMethods of deepfake detection based on machine learning
Maksutov, A. A., Morozov, V. O., Lavrenov, A. A., & Smirnov, A. S. (2020) · 2020 IEEE Conference of Russian Young Researchers in Electrical and Electronic Engineering (EIConRus) · doi:10.1109/eiconrus49466.2020.9039057 · Cited by 74 · cited 2×
“encoding manipulation to achieve a desired output (Maksutov et al., 2020).”
BackgroundPijanowski, B. C., Shellito, B. A., Pithadia, S., & Alexandridis, K. (2002) · Lakes & Reservoirs Science Policy and Management for Sustainable Use · doi:10.1046/j.1440-1770.2002.00203.x · Cited by 69
Audio-based snore detection using deep neural networks
Xie, J., Aubert, X. L., Long, X., van Dijk, J., Arsenali, B., Fonseca, P. M., & Overeem, S. (2020) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2020.105917 · Cited by 68
“Combating replay attacks against voice assistants,”
Pradhan, S., Sun, W., Baig, G., & Qiu, L. (2019) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3351258 · Cited by 67
Lightspeech: Lightweight and Fast Text to Speech with Neural Architecture Search
Luo, R., Tan, X., Wang, R., Qin, T., Li, J., Zhao, S., Chen, E., & Liu, T.-Y. (2021) · ICASSP 2021 - 2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp39728.2021.9414403 · Cited by 67
Rangarajan, A. K., & Ramachandran, H. K. (2021) · Expert Systems with Applications · doi:10.1016/j.eswa.2021.115401 · Cited by 63
A Study on Replay Attack and Anti-Spoofing for Automatic Speaker Verification
Li, L., Chen, Y., Wang, D., & Zheng, T. F. (2017) · Interspeech (USB) · doi:10.21437/interspeech.2017-456 · Cited by 62
Huang, L. F., & Pun, C. (2020) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2020.2998870 · Cited by 58
SINGAN: Singing Voice Conversion with Generative Adversarial Networks
Şişman, B., Vijayan, K., Dong, M., & Li, H. (2019) · Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC) · doi:10.1109/apsipaasc47483.2019.9023162 · Cited by 50
“Combating deepfakes: multi-LSTM and blockchain as proof of authenticity for digital media,”
Ki Chan, C. C., Kumar, V., Delaney, S., & Gochoo, M. (2020) · 2020 IEEE / ITU International Conference on Artificial Intelligence for Good (AI4G) · doi:10.1109/ai4g50087.2020.9311067 · Cited by 48
Voice Spoofing Countermeasure for Logical Access Attacks Detection
Arif, T., Javed, A., Alhameed, M., Jeribi, F., & Tahir, A. (2021) · IEEE Access · doi:10.1109/access.2021.3133134 · Cited by 48
Making Sense of Blockchain for AI Deepfakes Technology
Yazdinejad, A., Parizi, R. M., Srivastava, G., & Dehghantanha, A. (2020) · 2020 IEEE Globecom Workshops (GC Wkshps · doi:10.1109/gcwkshps50303.2020.9367545 · Cited by 47
Cotatron: Transcription-Guided Speech Encoder for Any-to-Many Voice Conversion Without Parallel Data
Park, S.-W., Kim, D.-Y., & Joe, M.-C. (2020) · Interspeech 2020 · doi:10.21437/interspeech.2020-1542 · Cited by 47
Voice conversion versus speaker verification: an overview
Wu, Z., & Li, H. (2014) · APSIPA Transactions on Signal and Information Processing · doi:10.1017/atsip.2014.17 · Cited by 45
Adaspeech 2: Adaptive Text to Speech with Untranscribed Data
Yan, Y., Tan, X., Li, B., Qin, T., Zhao, S., Shen, Y., & Liu, T.-Y. (2021) · ICASSP 2021 - 2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp39728.2021.9414872 · Cited by 45
Denoispeech: Denoising Text to Speech with Frame-Level Noise Modeling
Zhang, C., Ren, Y., Tan, X., Liu, J., Zhang, K., Qin, T., Zhao, S., & Liu, T.-Y. (2021) · ICASSP 2021 - 2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp39728.2021.9413934 · Cited by 41
Audio Replay Spoof Attack Detection Using Segment-based Hybrid Feature and DenseNet-LSTM Network
Huang, L. F., & Pun, C. (2019) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2019.8682573 · Cited by 41
Jin, Z.-Y., Mysore, G. J., DiVerdi, S., Lu, J.-W., & Finkelstein, A. (2017) · ACM Transactions on Graphics · doi:10.1145/3072959.3073702 · Cited by 40
Speech synthesis systems: disadvantages and limitations
Kuligowska, K., Kisielewicz, P., & Włodarz, A. (2018) · International Journal of Engineering & Technology · doi:10.14419/ijet.v7i2.28.12933 · Cited by 36
FGGAN: Feature-Guiding Generative Adversarial Networks for Text Generation
Yang, Y., Dan, X., Qiu, X., & Gao, Z. (2020) · IEEE Access · doi:10.1109/access.2020.2993928 · Cited by 30
ASSEM-VC: Realistic Voice Conversion by Assembling Modern Speech Synthesis Techniques
Kim, K.-W., Park, S., Lee, J., & Joe, M.-C. (2022) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp43922.2022.9746139 · Cited by 26
Audio Spoofing Verification using Deep Convolutional Neural Networks by Transfer Learning
P, R. T., Aravind, P. R., Ranjith, C., Nechiyil, U., & Paramparambath, N. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2008.03464 · Cited by 26
On the use of deep recurrent neural networks for detecting audio spoofing attacks
Scardapane, S., Stoffl, L., Röhrbein, F., & Uncini, A. (2017) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2017.7966294 · Cited by 25
Spoofing speech detection using temporal convolutional neural network
Tian, X., Xiao, X., Chng, E. S., & Li, H. (2016) · 2016 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA) · doi:10.1109/apsipa.2016.7820738 · Cited by 23
Deep Learning in Face Synthesis: A Survey on Deepfakes
Zhang, T., Deng, L., Zhang, L., & Dang, X. (2020) · 2020 IEEE 3rd International Conference on Computer and Communication Engineering Technology (CCET) · doi:10.1109/ccet50901.2020.9213159 · Cited by 18
Attention-Based LSTM Algorithm for Audio Replay Detection in Noisy Environments
Li, J., Zhang, X., Sun, M., Zou, X., & Zheng, C. (2019) · Applied Sciences · doi:10.3390/app9081539 · Cited by 15
TextGAIL: Generative Adversarial Imitation Learning for Text GenerationPreprint
Wu, Q., Li, L., & Yu, Z. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2004.13796 · Cited by 15
WaveFake: A data set to facilitate audio DeepFake detection
Frank, J., & Schönherr, L. (2021) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.5281/zenodo.4904578 · Cited by 14
A Trusting News Ecosystem Against Fake News from Humanity and Technology Perspectives
Chen, C., Shae, Z.-Y., Chang, C.-J., Lin, K. T., Tan, S.-M., & Chang, S.-L. (2019) · International Conference on Computational Science and Its Applications · doi:10.1109/iccsa.2019.00011 · Cited by 12
Interconversion of Emotions in Speech Using TD-PSOLA
Akanksh, B., Vekkot, S., & Tripathi, S. (2015) · Advances in intelligent systems and computing · doi:10.1007/978-3-319-28658-7_32 · Cited by 12
DGSAN: Discrete generative self-adversarial network
Montahaei, E., Alihosseini, D., & Baghshah, M. S. (2021) · Neurocomputing · doi:10.1016/j.neucom.2021.03.097 · Cited by 12
Making Speech Synthesis More Accessible to Older People.
Wolters, M. K., Campbell, P., DePlacido, C., Liddell, A., & Owens, D. S. (2007) · Queen Margaret University Publications Repository (Queen Margaret University) · Cited by 10
An Audio Fingerprinting Approach to Replay Attack Detection on ASVSPOOF 2017 Challenge Data
González-Rodríguez, J., Escudero, A., de Benito-Gorrón, D., Labrador, B., & Franco-Pedroso, J. (2018) · The Speaker and Language Recognition Workshop (Odyssey) · doi:10.21437/odyssey.2018-43 · Cited by 5
Research works printed but not linked: 9
- Ajder, 2019, The State of Deepfakes: Landscape, Threats, and Impact, Deeptrace
- Blue, 2022, “Who are you (I Really Wanna Know)? Detecting audio DeepFakes through vocal tract reconstruction,”, 31st USENIX Security Symposium (USENIX Security 22), 2691
- Chauhan, 2020, Establishing environment setup for preventing deepfakes using blockchain technology, Mukt Shabd J, 9, 771
- 2021, Ctrl shift face. YouTube
- Goodfellow, 2016, Deep Learning
- Ito, 2017, The LJ Speech Dataset
- Rea, 2019, Artists Create a Sinister 'deepfake' of Mark Zuckerberg to Teach Facebook (and the rest of us) a Lesson About Digital Propaganda
- Saul, 2020, After biden plays ‘despacito' at an event, trump shares a doctored video replacing it with an anti-police song, The New York Times
- Stupp, 2019, Fraudsters used AI to mimic CEO's voice in unusual cybercrime case, Wall Street J
Cited by
A systematic review of AI literacy scales
Lintner, T. (2024) · npj Science of Learning · doi:10.1038/s41539-024-00264-4 · Cited by 292
“Theemergenceofdeepfakeshasalsoledtoa new generation of disinformation in political campaigns 14 .”
Deepfake video detection: challenges and opportunities
Kaur, A., Noori Hoshyar, A., Saikrishna, V., Firmin, S., & Xia, F. (2024) · Artificial Intelligence Review · doi:10.1007/s10462-024-10810-6 · Cited by 214
“There have been significant advancements in machine learning models, methods for modifying audio and video, and other approaches along the technological progression of deep fake production (Khanjani et al. 2023).”
Abbas, F., & Taeihagh, A. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2024.124260 · Cited by 184
A Survey on Speech Deepfake Detection
Li, M., Ahmadiadli, Y., & Zhang, X.-P. (2025) · ACM Computing Surveys · doi:10.1145/3714458 · Cited by 101
Deepfake: definitions, performance metrics and standards, datasets, and a meta-review
Altuncu, E., Franqueira, V. N. L., & Li, S. (2024) · Frontiers in Big Data · doi:10.3389/fdata.2024.1400024 · Cited by 134
Metadata
- Authors
- Khanjani, Z., Watson, G., & Janeja, V. P.
- Affiliations
- University of Maryland, Baltimore County (US)
- Corresponding author
- Janeja, Vandana P.
- ORCID
- Janeja, Vandana P.
- Venue
- Frontiers in Big Data
- Publisher
- Frontiers Media SA
- Published
- 2023-01-09
- Volume
- 5
- Pages
- 1001063-1001063
- ISSN
- 2624-909X (ISSN-L)
- PMC
- PMC9869423
- OpenAlex
- W4313984387
- Semantic Scholar
- 40cbeff7a8342178645654dfa60c4d0d41af1c2d
- Cited by
- 121
- References
- 143
- Citations by year
- 2026: 36 · 2025: 49 · 2024: 31 · 2023: 5
- FWCI
- 2.53
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Frontiers in Big Data (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Maryland Shared Open Access Repository (USMAI Consortium) (submittedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- National Science Foundation (2210011, 14203)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Speech Recognition and Synthesis
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Digital Media Forensic Detection
- Physical Sciences › Computer Science › Signal Processing › Music and Audio Processing
- Keywords
- deepfake audio, deepfake detection, deepfake generation, generative adversarial networks, convolutional neural networks, deep neural network, fake news detection, synthetic media
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-09-29, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-09-29 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.