CoChat

Fake Speech Detection Using Residual Network with Transformer Encoder

Zhang, Zhenyu, Yi, Xiaowei, Zhao, Xianfeng · 2021 · Proceedings of the 2021 ACM Workshop on Information Hiding and Multimedia Security

The DOI matches its Crossref record; 28 of the 28 references it cites were found in a registry or an index.

Abstract

Fake speech detection aims to distinguish fake speech from natural speech. This paper presents an effective fake speech detection scheme based on residual network with transformer encoder (TE-ResNet) for improving the performance of fake speech detection. Firstly, considering inter-frame correlation of the speech signal, we utilize transformer encoder to extract contextual representations of the acoustic features. Then, a residual network is used to process deep features and calculate score that the speech is fake. Besides, to increase the quantity of training data, we apply five speech data augmentation techniques on the training dataset. Finally, we fuse the different fake speech detection models on score-level by logistic regression for compensating the shortcomings of each single model. The proposed scheme is evaluated on two public speech datasets. Our experiments demonstrate that the proposed TE-ResNet outperforms the existing state-of-the-art methods both on development and evaluation datasets. In addition, the proposed fused model achieves improved performance for detection of unseen fake speech technology, which can obtain equal error rates (EERs) of 3.99% and 5.89% on evaluation set of FoR-normal dataset and ASVspoof 2019 LA dataset respectively.

Overview

Integrity signals

Registry

Crossref · 10.1145/3437880.3460408

Cites

28 of 28 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Show all 28 references

Research works printed but not linked: 5

  1. Bhusan Chettri , Daniel Stoller , Veronica Morfi , Marco A Mart'inez Ram'irez , Emmanouil Benetos, and Bob L Sturm. 2019 . Ensemble models for spoofing detection in automatic speaker verification. arXiv preprint arXiv:1904.04589 (2019). Bhusan Chettri, Daniel Stoller, Veronica Morfi, Marco A Mart'inez Ram'irez, Emmanouil Benetos, and Bob L Sturm. 2019. Ensemble models for spoofing detection in automatic speaker verification. arXiv preprint arXiv:1904.04589 (2019). · arXiv
  2. Jee-weon Jung, Hye-jin Shim, Hee-Soo Heo , and Ha-Jin Yu. 2019. Replay attack detection with complementary high-resolution information using end-to-end DNN for the ASVspoof 2019 Challenge. arXiv preprint arXiv:1904.10134 ( 2019 ). Jee-weon Jung, Hye-jin Shim, Hee-Soo Heo, and Ha-Jin Yu. 2019. Replay attack detection with complementary high-resolution information using end-to-end DNN for the ASVspoof 2019 Challenge. arXiv preprint arXiv:1904.10134 (2019). · arXiv
  3. Diederik P Kingma and Jimmy Ba . 2014 . Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014). Diederik P Kingma and Jimmy Ba. 2014. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014). · arXiv
  4. Alan V Oppenheim , John R Buck , and Ronald W Schafer . 2001. Discrete-time signal processing .Upper Saddle River , NJ : Prentice Hall . Alan V Oppenheim, John R Buck, and Ronald W Schafer. 2001. Discrete-time signal processing .Upper Saddle River, NJ: Prentice Hall.
  5. Zhizheng Wu , Tomi Kinnunen , Eng Siong Chng , Haizhou Li , and Eliathamby Ambikairajah . 2012 . A study on spoofing attack in state-of-the-art speaker verification: The telephone speech case . In Proceedings of The 2012 Asia Pacific Signal and Information Processing Association Annual Summit and Conference. IEEE, 1--5. Zhizheng Wu, Tomi Kinnunen, Eng Siong Chng, Haizhou Li, and Eliathamby Ambikairajah. 2012. A study on spoofing attack in state-of-the-art speaker verification: The telephone speech case. In Proceedings of The 2012 Asia Pacific Signal and Information Processing Association Annual Summit and Conference. IEEE, 1--5.

Cited by

See all 68

Metadata

Authors
Zhang, Z., Yi, X., & Zhao, X.
Affiliations
Chinese Academy of Sciences (CN)
Venue
Proceedings of the 2021 ACM Workshop on Information Hiding and Multimedia Security
Publisher
ACM
Published
2021-06-17
Pages
13-22
OpenAlex
W3175036090
Cited by
66
References
27
Citations by year
2026: 6 · 2025: 20 · 2024: 17 · 2023: 11 · 2022: 12
FWCI
4.62
Type
conference paper
Language
en
Open access
closed
Locations
ACM Workshop on Information Hiding and Multimedia Security (IH&MMSec) (publishedVersion)
Funders
  • NSFC (61902391, 61972390, U1736214, 61802393 and 61872356)
  • IIE CAS Climbing Program
  • National Key Technology R&D Program (2019QY2202, 2019QY(Y)0207 and 2020AAA0140000)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Speech Recognition and Synthesis
  • Physical Sciences › Computer Science › Signal Processing › Speech and Audio Processing
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Digital Media Forensic Detection
Keywords
Transformer encoder, ResNet, score-level fusion, inter-frame correlation, acoustic features

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Fake Speech Detection Using Residual Network with Transformer Encoder. https://app.cochat.ai/papers/10.1145/3437880.3460408
The paper
Zhang, Z., Yi, X., & Zhao, X. (2021). Fake Speech Detection Using Residual Network with Transformer Encoder. Proceedings of the 2021 ACM Workshop on Information Hiding and Multimedia Security. https://doi.org/10.1145/3437880.3460408

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.