BTS-E: Audio Deepfake Detection Using Breathing-Talking-Silence Encoder
The DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.
Abstract
Voice phishing (vishing) is increasingly popular due to the development of speech synthesis technology. In particular, the use of deep learning to generate an arbitrary-content audio clip simulating the victim’s voice makes it difficult not only for humans but also for automatic speaker verification (ASV) systems to distinguish. Countermeasure (CM) systems have been developed recently to help ASV combat synthetic speech. In this work, we propose BTS-E, a framework to evaluate the correlation between Breathing, Talking (speech), and Silence sounds in an audio clip, then use this information for deepfake detection tasks. We argue that natural human sounds, such as breathing, are hard to synthesize by Text-to-speech (TTS) system. We conducted a large-scale evaluation using ASVspoof 2019 and 2021 evaluation set to validate our hypothesis. The experiment results show the applicability of the breathing sound feature in detecting deepfake voices. In general, the proposed system significantly increases the performance of the classifier by up to 46%.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
WaveNet: a generative model for raw audio
Oord, A. V. D., Dieleman, S., Zen, H., Simonyan, K., Vinyals, O., Graves, A., Kalchbrenner, N., Senior, A., & Kavukcuoglu, K. (2016) · arXiv · doi:10.48550/arxiv.1609.03499 · Cited by 4,911
Dai, Y., Gieseke, F., Oehmcke, S., Wu, Y., & Barnard, K. (2021) · 2021 IEEE Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv48630.2021.00360 · Cited by 1,274 · cited 1×
“We leverage feature fusion strategies[20] for enhancing the accuracy of an existing countermeasure (CM) system (e.g., RawNet2).”
MethodASVspoof 2019: Future Horizons in Spoofed and Fake Audio Detection
Todisco, M., Wang, X., Vestman, V., Sahidullah, M., Delgado, H., Nautsch, A., Yamagishi, J., Evans, N., Kinnunen, T., & Lee, K. A. (2019) · arXiv · doi:10.48550/arxiv.1904.05441 · Cited by 688 · cited 1×
“ASVspoof challenges[5, 6, 7, 8] have been held since 2015 for spoofed voice detection tasks.”
BackgroundASVspoof 2019: Future Horizons in Spoofed and Fake Audio Detection
Todisco, M., Wang, X., Vestman, V., Sahidullah, M., Delgado, H., Nautsch, A., Yamagishi, J., Evans, N., Kinnunen, T. H., & Lee, K. A. (2019) · Interspeech 2019 · doi:10.21437/interspeech.2019-2249 · Cited by 687
The ASVspoof 2017 challenge: assessing the limits of replay spoofing attack detection
Kinnunen, T., Sahidullah, M., Delgado, H., Todisco, M., Evans, N., Yamagishi, J., & Lee, K. A. (2017) · Interspeech 2017 · doi:10.21437/interspeech.2017-1111 · Cited by 535
ASVspoof 2015: the first automatic speaker verification spoofing and countermeasures challenge
Wu, Z., Kinnunen, T., Evans, N., Yamagishi, J., Hanilçi, C., Sahidullah, M., & Sizov, A. (2015) · Interspeech 2015 · doi:10.21437/interspeech.2015-462 · Cited by 484 · cited 1×
“ASVspoof challenges[5, 6, 7, 8] have been held since 2015 for spoofed voice detection tasks.”
BackgroundEnd-to-End anti-spoofing with RawNet2
Tak, H., Patino, J., Todisco, M., Nautsch, A., Evans, N., & Larcher, A. (2021) · ICASSP 2021 - 2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp39728.2021.9414234 · Cited by 402 · cited 1×
“The B03 (LFCC-LCNN)[9] and B04 (RawNet2)[10] were the best solutions among the four baseline CM systems.”
BackgroundASVspoof 2021: accelerating progress in spoofed and deepfake speech detection
Yamagishi, J., Wang, X., Todisco, M., Sahidullah, M., Patino, J., Nautsch, A., Liu, X., Lee, K. A., Kinnunen, T., Evans, N., et al. (2021) · 2021 Edition of the Automatic Speaker Verification and Spoofing Countermeasures Challenge · doi:10.21437/asvspoof.2021-8 · Cited by 380
A survey on neural speech synthesis
Tan, X., Qin, T., Soong, F., & Liu, T.-Y. (2021) · arXiv · doi:10.48550/arxiv.2106.15561 · Cited by 216 · cited 1×
“The development of neural speech synthesis, such as WaveNet from Google[1], opens a new era that allows realistic and human-like speech generating[2].”
MethodGeneralization of Audio Deepfake Detection
Chen, T., Kumar, A., Nagarsheth, P., Sivaraman, G., & Khoury, E. (2020) · The Speaker and Language Recognition Workshop (Odyssey 2020) · doi:10.21437/odyssey.2020-19 · Cited by 200 · cited 1×
“In terms of methodology, previous works can be divided into two categories: Feature Learning[11, 12] and Backend-Classifier Modeling[13, 14, 15].”
Method
Research works printed but not linked: 17
- 10.21437/ASVSPOOF.2021-13 · DOI
- 10.1109/LSP.2021.3089437 · DOI · Paper page
- 10.21437/Interspeech.2022-11029 · DOI
- 10.21437/Interspeech.2021-438 · DOI · Paper page
- 10.1016/j.specom.2018.01.008 · DOI
- sohn, 1999, A statistical model-based voice activity detection, IEEE Signal Processing Letters, 6
- 10.1109/ITSC.2006.1706829 · DOI
- 10.1109/ICCE-TW52618.2021.9603163 · doi:10.1109/icce-tw52618.2021.9603163
- 10.3390/sym13020214 · DOI
- huang, 2021, Audio replay spoofing attack detection using deep learning feature and long-short-term memory recurrent neural network, Proc AIIPCC
- loshchilov, 2022, Decoupled weight decay regularization, Proc ICLR
- 10.21437/Interspeech.2022-10200 · DOI · Paper page
- 10.21437/Interspeech.2022-10271 · DOI
- 10.21437/Odyssey.2022-13 · DOI
- maaten, 2008, Visualizing data using t-SNE, Journal of Machine Learning Research, 9
- 10.7439/ijasr.v1i7.1975 · DOI
- 10.1007/978-3-319-92627-8_15 · DOI
Cited by
A Survey on the Detection and Impacts of Deepfakes in Visual, Audio, and Textual Formats
Mubarak, R., Alsboui, T., Alshaikh, O., Inuwa-Dutse, I., Khan, S., & Parkinson, S. (2023) · IEEE Access · doi:10.1109/access.2023.3344653 · Cited by 132
Exploring autonomous methods for deepfake detection: A detailed survey on techniques and evaluation
Sunil, R., Mer, P., Diwan, A., Mahadeva, R., & Sharma, A. (2025) · Heliyon · doi:10.1016/j.heliyon.2025.e42273 · Cited by 54
A lightweight feature extraction technique for deepfake audio detection
Chakravarty, N., & Dua, M. (2024) · Multimedia Tools and Applications · doi:10.1007/s11042-024-18217-9 · Cited by 40
“For this aim, machine learning methods such as Support Vector Machines (SVM) [17], Naive Bayes (NB) [18], K-Nearest Neighbours (KNN) [19], and Random Forest (RF) [20] have been used.”
Acoustic Features Analysis for Explainable Machine Learning-Based Audio Spoofing Detection
Bisogni, C., Loia, V., Nappi, M., & Pero, C. (2024) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2024.104145 · Cited by 30
Wang, B., Tang, Y., Wei, F., Ba, Z., & Ren, K. (2024) · IEEE/ACM Transactions on Audio, Speech, and Language Processing · doi:10.1109/taslp.2024.3492796 · Cited by 20
Metadata
- Authors
- Doan, T.-P., Nguyen-Vu, L., Jung, S., & Hong, K.
- Venue
- ICASSP 2023 - 2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)
- Publisher
- IEEE
- Published
- 2023-06-04
- Pages
- 1-5
- ISSN
- 1520-6149 (ISSN-L)
- OpenAlex
- W4375869371
- Cited by
- 50
- References
- 11
- FWCI
- 9.45
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: BTS-E: Audio Deepfake Detection Using Breathing-Talking-Silence Encoder. https://app.cochat.ai/papers/10.1109/icassp49357.2023.10095927
- The paper
- Doan, T.-P., Nguyen-Vu, L., Jung, S., & Hong, K. (2023). BTS-E: Audio Deepfake Detection Using Breathing-Talking-Silence Encoder. ICASSP 2023 - 2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). https://doi.org/10.1109/icassp49357.2023.10095927
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.