Deepfake audio detection with vision transformer based method
The DOI matches its Crossref record; 21 of the 22 references it cites were found in a registry or an index.
Abstract
In addition to easy access to audio on the Internet, developments in deep learning methods have made it possible to produce deep fake audio. Deep fake audio spoofing is carried out with the aim of producing audio files in the content by cloning the voice of the speaker that is planned to be changed as if he said something he did not say. This forgery method, created using artificial intelligence approaches, poses a great threat, especially to speaker verification systems. This study proposes a new method to detect whether the audio is spoofed or original. Spectrogram images are obtained with the Constant-Q Transform approach then they are classified with the vision transformer network. The system is trained with a public dataset named ASVSpoof 2019 and the comparative performance analysis is done on this dataset.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Studies by Wani et al. [105] and Ulutas et al. [142] have further demonstrated that combining SOTA backend models with traditional handcrafted features can outperform systems utilising learning-based features alone, underscoring the importance of a well-chosen backend in achieving optimal performance.”
From Audio Deepfake Detection: What Has Been Achieved and What Lies Ahead (2025) · cites this paper as [142]
In the citing paper
“Ulutas et al. [142] employed CQT-generated spectrograms as input and used the ViT for classification, demonstrating that the ViT outperforms CNNs in detecting deepfake audio and surpasses multiple SOTA methods.”
From Audio Deepfake Detection: What Has Been Achieved and What Lies Ahead (2025) · cites this paper as [142]
Citations
Cites
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale
Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., Gelly, S., et al. (2020) · arXiv · doi:10.48550/arxiv.2010.11929 · Cited by 47,472
ASVspoof 2019: Future Horizons in Spoofed and Fake Audio Detection
Todisco, M., Wang, X., Vestman, V., Sahidullah, M., Delgado, H., Nautsch, A., Yamagishi, J., Evans, N., Kinnunen, T., & Lee, K. A. (2019) · arXiv · doi:10.48550/arxiv.1904.05441 · Cited by 688
ASVspoof 2019: Future Horizons in Spoofed and Fake Audio Detection
Todisco, M., Wang, X., Vestman, V., Sahidullah, M., Delgado, H., Nautsch, A., Yamagishi, J., Evans, N., Kinnunen, T. H., & Lee, K. A. (2019) · Interspeech 2019 · doi:10.21437/interspeech.2019-2249 · Cited by 687
ASVspoof 2015: the first automatic speaker verification spoofing and countermeasures challenge
Wu, Z., Kinnunen, T., Evans, N., Yamagishi, J., Hanilçi, C., Sahidullah, M., & Sizov, A. (2015) · Interspeech 2015 · doi:10.21437/interspeech.2015-462 · Cited by 484 · cited 1×
“Due to the importance of the problem, studies on detecting spoofing attacks on audio in the literature maintain their novelty, but an increase in popularity is observed [1].”
BackgroundA comparison of features for synthetic speech detection
Sahidullah, M., Kinnunen, T., & Hanilçi, C. (2015) · Interspeech 2015 · doi:10.21437/interspeech.2015-472 · Cited by 382 · cited 1×
“These methods were submitted to the ASVSpoof 2019 competition and those reported in works afterward [16-20].”
MethodASVspoof 2021: accelerating progress in spoofed and deepfake speech detection
Yamagishi, J., Wang, X., Todisco, M., Sahidullah, M., Patino, J., Nautsch, A., Liu, X., Lee, K. A., Kinnunen, T., Evans, N., et al. (2021) · 2021 Edition of the Automatic Speaker Verification and Spoofing Countermeasures Challenge · doi:10.21437/asvspoof.2021-8 · Cited by 380
A New Feature for Automatic Speaker Verification Anti-Spoofing: Constant Q Cepstral Coefficients
Todisco, M., Delgado, H., & Evans, N. (2016) · The Speaker and Language Recognition Workshop (Odyssey 2016) · doi:10.21437/odyssey.2016-41 · Cited by 335
One-class learning towards synthetic voice spoofing detection
Zhang, Y., Jiang, F., & Duan, Z. (2021) · IEEE Signal Processing Letters · doi:10.1109/lsp.2021.3076358 · Cited by 241
ASSERT: Anti-Spoofing with Squeeze-Excitation and Residual Networks
Lai, C.-I., Chen, N., Villalba, J., & Dehak, N. (2019) · Interspeech (USB) · doi:10.21437/interspeech.2019-1794 · Cited by 200
Replay and Synthetic Speech Detection with Res2Net Architecture
Li, X., Li, N., Weng, C., Liu, X., Su, D., Yu, D., & Meng, H. (2021) · ICASSP 2021 - 2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp39728.2021.9413828 · Cited by 186 · cited 1×
“[5] CQT ResNet Must enhance to be more generalized”
Background
Cited by
Audio Deepfake Detection: What Has Been Achieved and What Lies Ahead
Zhang, B., Cui, H., Nguyen, V., & Whitty, M. (2025) · Sensors · doi:10.3390/s25071989 · Cited by 72
Hybrid Transformer Architectures With Diverse Audio Features for Deepfake Speech Classification
Zaman, K., Samiul, I. J. A. M., Şah, M., Direkoğlu, C., Okada, S., & Unoki, M. (2024) · IEEE Access · doi:10.1109/access.2024.3478731 · Cited by 56
Transformers and audio detection tasks: An overview
Zaman, K., Li, K., Şah, M., Direkoğlu, C., Okada, S., & Unoki, M. (2024) · Digital Signal Processing · doi:10.1016/j.dsp.2024.104956 · Cited by 48
Deepfakes in digital media forensics: Generation, AI-based detection and challenges
Bendiab, G., Haiouni, H., Moulas, I., & Shiaeles, S. N. (2024) · Journal of Information Security and Applications · doi:10.1016/j.jisa.2024.103935 · Cited by 35
A Hybrid CNN-LSTM Approach for Deepfake Audio Detection
Chitale, M., Dhawale, A., Dubey, M., & Ghane, S. (2024) · International Conference on Artificial Intelligence for Internet of Things (AIIoT) · doi:10.1109/aiiot58432.2024.10574576 · Cited by 30
Metadata
- Authors
- Ulutas, G., Tahaoglu, G., & Ustubioglu, B.
- Affiliations
- Karadeniz Technical University,Department of Computer Engineering,Trabzon,Turkey
- Venue
- 2023 46th International Conference on Telecommunications and Signal Processing (TSP)
- Publisher
- IEEE
- Published
- 2023-07-12
- Pages
- 244-247
- OpenAlex
- W4385577110
- Cited by
- 34
- References
- 22
- Citations by year
- 2026: 7 · 2025: 17 · 2024: 9 · 2023: 1
- FWCI
- 6.04
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- International Conference on Telecommunications and Signal Processing (TSP) (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Speech Recognition and Synthesis
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Digital Media Forensic Detection
- Physical Sciences › Computer Science › Signal Processing › Speech and Audio Processing
- Keywords
- audio deepfake detection, speaker verification, vision transformer, spectrogram images, constant-Q transform, ASVspoof 2019, voice cloning
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Deepfake audio detection with vision transformer based method. https://app.cochat.ai/papers/10.1109/tsp59544.2023.10197715
- The paper
- Ulutas, G., Tahaoglu, G., & Ustubioglu, B. (2023). Deepfake audio detection with vision transformer based method. 2023 46th International Conference on Telecommunications and Signal Processing (TSP). https://doi.org/10.1109/tsp59544.2023.10197715
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.