CoChat

Audio Deepfake Detection with Self-Supervised XLS-R and SLS Classifier

Zhang, Qishan, Wen, Shuangbing, Hu, Tao · 2024 · Proceedings of the 32nd ACM International Conference on Multimedia
Cited by 56

The DOI matches its Crossref record; 25 of the 25 references it cites were found in a registry or an index.

Abstract

Generative AI technologies, including text-to-speech (TTS) and voice conversion (VC), frequently become indistinguishable from genuine samples, posing challenges for individuals in discerning between real and synthetic content. This indistinguishability undermines trust in media, and the arbitrary cloning of personal voice signals presents significant challenges to privacy and security. In the field of deepfake audio detection, the majority of models achieving higher detection accuracy currently employ self-supervised pre-trained models. However, with the ongoing development of deepfake audio generation algorithms, maintaining high discrimination accuracy against new algorithms grows more challenging. To enhance the sensitivity of deepfake audio features, we propose a deepfake audio detection model that incorporates an SLS (Sensitive Layer Selection) module. Specifically, utilizing the pre-trained XLS-R enables our model to extract diverse audio features from its various layers, each providing distinct discriminative information. Utilizing the SLS classifier, our model captures sensitive contextual information across different layer levels of audio features, effectively employing this information for fake audio detection. Experimental results show that our method achieves state-of-the-art (SOTA) performance on both the ASVspoof 2021 DF and In-the-Wild datasets, with a specific Equal Error Rate (EER) of 1.92% on the ASVspoof 2021 DF dataset and 7.46% on the In-the-Wild dataset. Codes and data can be found at https://github.com/QiShanZhang/SLSforADD.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1145/3664647.3681345

Cites

25 of 25 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 25 references

Research works printed but not linked: 14

  1. 10.1007/s11042-022-13943-4 · doi:10.1007/s11042-022-13943-4
  2. 10.1109/ASRU57964.2023.10389671 · DOI
  3. Massimiliano Todisco Héctor Delgado Kong Aik Lee Md Sahidullah Nicholas Evans Tomi Kinnunen and Junichi Yamagishi. Integrated presentation attack detection and automatic speaker verification: Common features and gaussian back-end fusion. In Interspeech 2018--19th Annual Conference of the International Speech Communication Association. ISCA 2018. · DOI · Paper page
  4. 10.1109/ISCSLP.2010.5684887 · DOI
  5. Massimiliano Todisco, Héctor Delgado, and Nicholas WD Evans. A new feature for automatic speaker verification anti-spoofing: Constant q cepstral coefficients. In Odyssey, volume 2016, pages 283--290, 2016.
  6. 10.1109/ICASSP43922.2022.9746722 · DOI
  7. Yang Xie, Zhenchuan Zhang, and Yingchun Yang. Siamese network with wav2vec feature for spoofing speech detection. In Interspeech, pages 4269--4273, 2021.
  8. 10.1109/ICASSP43922.2022.9747605 · DOI · Paper page
  9. Alexei Baevski, Yuhao Zhou, Abdelrahman Mohamed, and Michael Auli. wav2vec 2.0: A framework for self-supervised learning of speech representations. Advances in neural information processing systems, 33:12449--12460, 2020.
  10. Chenglong Wang, Jiangyan Yi, Jianhua Tao, Chu Yuan Zhang, Shuai Zhang, and Xun Chen. Detection of Cross-Dataset Fake Audio Based on Prosodic and Pronunciation Features. In Proc. INTERSPEECH 2023, pages 3844--3848, 2023.
  11. 10.1109/CVPR.2018.00745 · DOI · Paper page
  12. Niko Brümmer and Edward De Villiers. The bosaris toolkit: Theory, algorithms and code for surviving the new dcf. arXiv preprint arXiv:1304.2865, 2013. · arXiv
  13. Yann LeCun, Yoshua Bengio, and Geoffrey Hinton. Deep learning. nature, 521(7553):436--444, 2015.
  14. 10.1109/ICASSP43922.2022.9746213 · DOI

Cited by

See all 56

Metadata

Authors
Zhang, Q., Wen, S., & Hu, T.
Venue
Proceedings of the 32nd ACM International Conference on Multimedia
Publisher
ACM
Published
2024-10-28
Pages
6765-6773
OpenAlex
W4403791925
Cited by
56
References
25
FWCI
17.04
Type
conference paper
Language
en
Open access
closed
Funders
  • Natural Science Foundation of Hubei Province of China (2023AFD061)
  • Training program of high level scientific research achievements of Hubei Minzu University (PY22011)

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Audio Deepfake Detection with Self-Supervised XLS-R and SLS Classifier. https://app.cochat.ai/papers/10.1145/3664647.3681345
The paper
Zhang, Q., Wen, S., & Hu, T. (2024). Audio Deepfake Detection with Self-Supervised XLS-R and SLS Classifier. Proceedings of the 32nd ACM International Conference on Multimedia. https://doi.org/10.1145/3664647.3681345

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.