CoChat

RawBMamba: End-to-End Bidirectional State Space Model for Audio Deepfake Detection

Open access

The DOI matches its Crossref record; 3 of the 3 references it cites were found in a registry or an index.

Abstract

Fake artefacts for discriminating between bonafide and fake audio can exist in both short-and long-range segments.Therefore, combining local and global feature information can effectively discriminate between bonafide and fake audio.This paper proposes an end-to-end bidirectional state space model, named RawBMamba, to capture both short-and long-range discriminative information for audio deepfake detection.Specifically, we use sinc Layer and multiple convolutional layers to capture short-range features, and then design a bidirectional Mamba to address Mamba's unidirectional modelling problem and further capture long-range feature information.Moreover, we develop a bidirectional fusion module to integrate embeddings, enhancing audio context representation and combining shortand long-range information.The results show that our proposed RawBMamba achieves a 34.1% improvement over Rawformer on ATSVspoof2021 LA dataset, and demonstrates competitive performance on other datasets.Codes will be released on https://github.com/cyjie429/RawBMamba.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.21437/interspeech.2024-698

Cites

0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

The publisher hasn’t deposited this paper’s reference list.

Research works printed but not linked: 27

  1. [1][1] A. Nautsch, X. Wang, N. Evans, T. H. Kinnunen, V. Vestman, M. Todisco, H. Delgado, M. Sahidullah, J. Yamagishi, and K. A. Lee, 'Asvspoof 2019: spoofing countermeasures for the detection of synthesized, converted and replayed speech,' IEEE Transactions on Biometrics, Behavior, and Identity Science , vol. 3, no. 2, pp. 252-265, 2021. -
  2. [2][2] J. Yamagishi, X. Wang, M. Todisco, M. Sahidullah, J. Patino, A. Nautsch, X. Liu, K. A. Lee, T. Kinnunen, N. Evans et al. , 'Asvspoof 2021: accelerating progress in spoofed and deepfake speech detection,' in ASVspoof 2021 Workshop-Automatic Speaker Verification and Spoofing Coutermeasures Challenge , 2021. -
  3. [3][3] J. Yi, R. Fu, J. Tao, S. Nie, H. Ma, C. Wang, T. Wang, Z. Tian, Y. Bai, C. Fan et al. , 'Add 2022: the first audio deep synthesis detection challenge,' in ICASSP 2022-2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) . IEEE, 2022, pp. 9216-9220. -
  4. [5][5] J.-w. Jung, H.-S. Heo, H. Tak, H.-j. Shim, J. S. Chung, B.-J. Lee, H.-J. Yu, and N. Evans, 'Aasist: Audio anti-spoofing using integrated spectro-temporal graph attention networks,' in ICASSP 2022-2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) . IEEE, 2022, pp. 6367-6371. -
  5. [6][6] X. Liu, M. Liu, L. Wang, K. A. Lee, H. Zhang, and J. Dang, 'Leveraging positional-related local-global dependency for synthetic speech detection,' in ICASSP 2023-2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) . IEEE, 2023, pp. 1-5. -
  6. [7][7] J. Xue, C. Fan, J. Yi, C. Wang, Z. Wen, D. Zhang, and Z. Lv, 'Learning from yourself: A self-distillation method for fake speech detection,' in ICASSP 2023-2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) . IEEE, 2023, pp. 1-5. -
  7. [8][8] C. Wang, J. Yi, J. Tao, C. Y. Zhang, S. Zhang, and X. Chen, 'Detection of Cross-Dataset Fake Audio Based on Prosodic and Pronunciation Features,' in Proc. INTERSPEECH 2023 , 2023, pp. 3844-3848. -
  8. [9][9] X. Zhang, J. Yi, J. Tao, C. Wang, and C. Y. Zhang, 'Do you remember? overcoming catastrophic forgetting for fake audio detection,' in International Conference on Machine Learning, ICML 2023 , ser. Proceedings of Machine Learning Research, vol. 202. PMLR, 2023, pp. 41 819-41 831. -
  9. [10][10] X. Zhang, J. Yi, C. Wang, C. Y. Zhang, S. Zeng, and J. Tao, 'What to remember: Self-adaptive continual learning for audio deepfake detection,' in Thirty-Eighth AAAI Conference on Artificial Intelligence, AAAI 2024 , M. J. Wooldridge, J. G. Dy, and S. Natarajan, Eds. AAAI Press, 2024, pp. 19 569-19 577. -
  10. [11][11] C. Fan, M. Ding, J. Tao, R. Fu, J. Yi, Z. Wen, and Z. Lv, 'Dualbranch knowledge distillation for noise-robust synthetic speech detection,' IEEE/ACM Transactions on Audio, Speech, and Language Processing , 2024. -
  11. [12][12] X. Zhang, J. Yoon, M. Bansal, and H. Yao, 'Multimodal representation learning by alternating unimodal adaptation,' in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) , June 2024, pp. 27 456-27 466. -
  12. [14][14] H. Tak, J. Patino, M. Todisco, A. Nautsch, N. Evans, and A. Larcher, 'End-to-end anti-spoofing with rawnet2,' in ICASSP 2021-2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) . IEEE, 2021, pp. 6369-6373. -
  13. [15][15] J. H. Hansen and Z. WANG, 'Audio anti-spoofing using simple attention module and joint optimization based on additive angular margin loss and meta-learning,' in Proc. Interspeech 2022 , 2022, pp. 376-380. -
  14. [16][16] H. Tak, J. Jung, J. Patino, M. Todisco, and N. W. D. Evans, 'Graph attention networks for anti-spoofing,' in Interspeech 2021, 22nd Annual Conference of the International Speech Communication Association, Brno, Czechia, 30 August -3 September 2021 . ISCA, 2021, pp. 2356-2360. -
  15. [17][17] P. Velickovic, G. Cucurull, A. Casanova, A. Romero, P. Li` o, and Y. Bengio, 'Graph attention networks,' in 6th International Conference on Learning Representations, ICLR 2018, Vancouver, BC, Canada, April 30 - May 3, 2018, Conference Track Proceedings . OpenReview.net, 2018. -
  16. [18][18] H. Tak, J.-W. Jung, J. Patino, M. Kamble, M. Todisco, and N. Evans, 'End-to-end spectro-temporal graph attention networks for speaker verification anti-spoofing and speech deepfake detection,' in ASVSPOOF 2021, Automatic Speaker Verification and Spoofing Countermeasures Challenge . ISCA, 2021, pp. 1-8. -
  17. [19][19] A. Vaswani, N. Shazeer, N. Parmar, J. Uszkoreit, L. Jones, A. N. Gomez, Ł. Kaiser, and I. Polosukhin, 'Attention is all you need,' Advances in neural information processing systems , vol. 30, 2017. -
  18. [20][20] X. Zhang, J. Yi, J. Tao, C. Wang, L. Xu, and R. Fu, 'Adaptive fake audio detection with low-rank model squeezing,' in Proceedings of the Workshop on Deepfake Audio Detection and Analysis colocated with 32th International Joint Conference on Artificial Intelligence (IJCAI 2023), 2023 , ser. CEUR Workshop Proceedings, vol. 3597, 2023, pp. 95-100. -
  19. [22][22] A. Gu, I. Johnson, K. Goel, K. Saab, T. Dao, A. Rudra, and C. R´ e, 'Combining recurrent, convolutional, and continuous-time models with linear state space layers,' Advances in neural information processing systems , vol. 34, pp. 572-585, 2021. -
  20. [23][23] A. Gu, K. Goel, A. Gupta, and C. R´ e, 'On the parameterization and initialization of diagonal state space models,' Advances in Neural Information Processing Systems , vol. 35, pp. 35 97135 983, 2022. -
  21. [24][24] A. Gupta, A. Gu, and J. Berant, 'Diagonal state spaces are as effective as structured state spaces,' Advances in Neural Information Processing Systems , vol. 35, pp. 22 982-22 994, 2022. -
  22. [25][25] A. Gu, K. Goel, and C. R´ e, 'Efficiently modeling long sequences with structured state spaces,' in The Tenth International Conference on Learning Representations, ICLR 2022, Virtual Event, April 25-29, 2022 . OpenReview.net, 2022. [Online]. Available: https://openreview.net/forum?id=uYLFoz1vlAC -
  23. [26][26] M. Ravanelli and Y. Bengio, 'Speaker recognition from raw waveform with sincnet,' in 2018 IEEE spoken language technology workshop (SLT) . IEEE, 2018, pp. 1021-1028. -
  24. [27][27] W. Liu, Y. Wen, Z. Yu, M. Li, B. Raj, and L. Song, 'Sphereface: Deep hypersphere embedding for face recognition,' in Proceedings of the IEEE conference on computer vision and pattern recognition , 2017, pp. 212-220. -
  25. [28][28] C. Wang, J. Yi, J. Tao, C. Y . Zhang, S. Zhang, R. Fu, and X. Chen, 'TO-Rawnet: Improving RawNet with TCN and Orthogonal Regularization for Fake Audio Detection,' in Proc. INTERSPEECH 2023 , 2023, pp. 3137-3141. -
  26. [29][29] J. Li, Y. Long, Y. Li, and D. Xu, 'Advanced rawnet2 with attention-based channel masking for synthetic speech detection,' in Proc. INTERSPEECH 2023 , 2023, pp. 2788-2792. -
  27. [30][30] L. Van der Maaten and G. Hinton, 'Visualizing data using t-sne.' Journal of machine learning research , vol. 9, no. 11, 2008.

Cited by

See all 38

Metadata

Authors
Chen, Y., Yi, J., Xue, J., Wang, C., Zhang, X., Dong, S., Zeng, S., Tao, J., Lv, Z., & Fan, C.
Affiliations
  • Anhui University (CN)
  • Chinese Academy of Sciences (CN)
  • Tsinghua University (CN)
Venue
Interspeech 2024
Publisher
ISCA
Published
2024-09-01
Pages
2720-2724
ISSN
2308-457X (ISSN-L)
OpenAlex
W4402112008
Cited by
32
References
0
Citations by year
2026: 14 · 2025: 17 · 2024: 1
FWCI
9.24
Type
conference paper
Language
en
Open access
Locations
Interspeech (USB) (publishedVersion)
Funders
National Natural Science Foundation of China (U21B2010, 62201002, 62306316, 62322120, 62206278, No.62201002)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Speech Recognition and Synthesis
  • Physical Sciences › Computer Science › Signal Processing › Music and Audio Processing
  • Physical Sciences › Computer Science › Signal Processing › Speech and Audio Processing
Keywords
audio deepfake detection, bidirectional state space model, Mamba, audio forensics

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: RawBMamba: End-to-End Bidirectional State Space Model for Audio Deepfake Detection. https://app.cochat.ai/papers/10.21437/interspeech.2024-698
The paper
Chen, Y., Yi, J., Xue, J., Wang, C., Zhang, X., Dong, S., Zeng, S., Tao, J., Lv, Z., & Fan, C. (2024). RawBMamba: End-to-End Bidirectional State Space Model for Audio Deepfake Detection. Interspeech 2024. https://doi.org/10.21437/interspeech.2024-698

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.