CoChat

AntiFake: Using Adversarial Audio to Prevent Unauthorized Speech Synthesis

Open access
Yu, Zhiyuan, Zhai, Shixuan, Zhang, Ning · 2023 · Proceedings of the 2023 ACM SIGSAC Conference on Computer and Communications Security

The DOI matches its Crossref record; the references it cites are not checked yet.

Abstract

The rapid development of deep neural networks and generative AI has catalyzed growth in realistic speech synthesis. While this technology has great potential to improve lives, it also leads to the emergence of ''DeepFake'' where synthesized speech can be misused to deceive humans and machines for nefarious purposes. In response to this evolving threat, there has been a significant amount of interest in mitigating this threat by DeepFake detection.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1145/3576915.3623209

Cites

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

The citation lists are queued

They are fetched later and appear here then.

References 19 · Cited by 44

Research works printed but not linked: 35

  1. Hadi Abdullah et al. 2019. Practical Hidden Voice Attacks against Speech and Speaker Recognition Systems. In 26th Annual Network and Distributed System Security Symposium, NDSS 2019, San Diego, California, USA, February 24-27, 2019.
  2. Hadi Abdullah et al. 2021. Hear "No Eil", See "Kenansville"*: Efficient and transferable black-box attacks on speech recognition and voice identification systems. In 2021 IEEE Symposium on Security and Privacy (SP). IEEE, 712--729.
  3. Muhammad Ejaz Ahmed et al. 2020. Void: A fast and light voice liveness detection system. In 29th USENIX Security Symposium (USENIX Security 20). 2685--2702.
  4. Logan Blue et al. 2022. Who Are You (I Really Wanna Know)? Detecting Audio DeepFakes Through Vocal Tract Reconstruction. In 31st USENIX Security Symposium, USENIX Security 2022. USENIX Association, 2691--2708.
  5. Nicholas Carlini et al. 2016. Hidden voice commands. In 25th USENIX Security Symposium (USENIX Security 16). 513--530.
  6. Nicholas Carlini et al. 2018. Audio adversarial examples: Targeted attacks on speech-to-text. In 2018 IEEE Security and Privacy Workshops (SPW). IEEE, 1--7.
  7. Edresson Casanova et al. 2022. Yourtts: Towards zero-shot multi-speaker tts and zero-shot voice conversion for everyone. In International Conference on Machine Learning. PMLR, 2709--2720.
  8. Guangke Chen et al. 2021. Who is real bob? adversarial attacks on speaker recognition systems. In 2021 IEEE Symposium on Security and Privacy (SP). IEEE.
  9. Tao Chen et al. 2020. Metamorph: Injecting Inaudible Commands into Over-the-air Voice Controlled Systems. In 27th Annual Network and Distributed System Security Symposium, NDSS 2020, San Diego, California, USA, February 23-26, 2020.
  10. Valeriia Cherepanova et al. 2021. LowKey: Leveraging Adversarial Attacks to Protect Social Media Users from Facial Recognition. In 9th International Conference on Learning Representations, ICLR 2021, Austria, May 3-7, 2021.
  11. Ju-Chieh Chou et al. 2019. One-Shot Voice Conversion by Separating Speaker and Content Representations with Instance Normalization. In 20th Annual Conference of the International Speech Communication Association. ISCA, 664--668.
  12. Alexey Dosovitskiy et al. 2021. An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale. In 9th International Conference on Learning Representations, ICLR 2021, Virtual Event, Austria, May 3-7, 2021.
  13. Ian J. Goodfellow et al. 2015. Explaining and Harnessing Adversarial Examples. In 3rd International Conference on Learning Representations, ICLR 2015, San Diego, CA, USA, May 7-9, 2015, Conference Track Proceedings.
  14. Chien-yu Huang et al. 2021. Defending your voice: Adversarial attack on voice conversion. In 2021 IEEE Spoken Language Technology Workshop (SLT). IEEE.
  15. Shehzeen Hussain et al. 2021. {WaveGuard}: Understanding and Mitigating Audio Adversarial Examples. In 30th USENIX Security Symposium, USENIX Security 2021, August 11-13, 2021. USENIX Association, 2273--2290.
  16. Won Jang et al. 2021. UnivNet: A Neural Vocoder with Multi-Resolution Spectrogram Discriminators for High-Fidelity Waveform Generation. In Interspeech 2021, 22nd Annual Conference of the International Speech Communication Association. ISCA, 2207--2211.
  17. Felix Kreuk et al. 2018. Fooling end-to-end speaker verification with adversarial examples. In 2018 IEEE international conference on acoustics, speech and signal processing (ICASSP). IEEE, 1962--1966.
  18. Gabriel Mittag et al. 2021. NISQA: A Deep CNN-Self-Attention Model for Multidimensional Speech Quality Prediction with Crowdsourced Datasets. In Interspeech 2021, 22nd Annual Conference of the International Speech Communication Association. ISCA, 2127--2131.
  19. Yishuang Ning et al. 2019. A Review of Deep Learning Based Speech Synthesis. Applied Sciences, Vol. 9, 19 (2019).
  20. Vassil Panayotov et al. 2015. Librispeech: an asr corpus based on public domain audio books. In 2015 IEEE international conference on acoustics, speech and signal processing (ICASSP). IEEE.
  21. Daniel Povey et al. 2011. The Kaldi speech recognition toolkit. In IEEE 2011 workshop on automatic speech recognition and understanding. IEEE Signal Processing Society.
  22. Lea Schö nherr et al. 2019. Adversarial Attacks Against Automatic Speech Recognition Systems via Psychoacoustic Hiding. In 26th Annual Network and Distributed System Security Symposium (NDSS).
  23. Shawn Shan et al. 2020. Fawkes: Protecting Privacy against Unauthorized Deep Learning Models. In 29th USENIX Security Symposium, USENIX Security 2020.
  24. Jiacheng Shang et al. 2018. Defending against voice spoofing: A robust software-based liveness detection system. In 2018 IEEE 15th International Conference on Mobile Ad Hoc and Sensor Systems (MASS). IEEE, 28--36.
  25. Jonathan Shen et al. 2018. Natural tts synthesis by conditioning wavenet on mel spectrogram predictions. In 2018 IEEE international conference on acoustics, speech and signal processing (ICASSP). IEEE, 4779--4783.
  26. Vibha Tiwari. 2010. MFCC and its applications in speaker recognition. International journal on emerging technologies, Vol. 1, 1 (2010), 19--22.
  27. Satyam P Todkar et al. 2018. Speaker recognition techniques: A review. In 2018 3rd International Conference for Convergence in Technology (I2CT). IEEE, 1--5.
  28. Aäron van den Oord et al. 2016. WaveNet: A Generative Model for Raw Audio. In The 9th ISCA Speech Synthesis Workshop, September 2016. ISCA, 125.
  29. Tarun Wadhwa. 2015. Wells Fargo Wants To Let You Make Million-Dollar Wire Transactions With Your Face And Voice. https://www.forbes.com/sites/tarunwadhwa/2015/11/03/why-wells-fargo-wants-to-let-you-make-million-dollar-wire-transactions-with-your-face-and-voice/.
  30. Li Wan et al. 2018. Generalized End-to-End Loss for Speaker Verification. In 2018 IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP 2018, April 2018. IEEE, 4879--4883.
  31. Emily Wenger et al. 2021. Hello, It's Me: Deep Learning-based Speech Synthesis Attacks in the Real World. In Proceedings of the 2021 ACM SIGSAC Conference on Computer and Communications Security. 235--251.
  32. Zhiyuan Yu et al. 2023. {MACK}: Semantically Meaningful Adversarial Audio Attack. In 32nd USENIX Security Symposium (USENIX Security 23). 3799--3816.
  33. Xuejing Yuan et al. 2018. Commandersong: A systematic approach for practical adversarial voice recognition. In 27th USENIX Security Symposium (USENIX Security 18). 49--64.
  34. Linghan Zhang et al. 2017. Hearing your voice is not enough: An articulatory gesture based liveness detection for voice authentication. In Proceedings of the 2017 ACM SIGSAC Conference on Computer and Communications Security. 57--71.
  35. Xinhui Zhou et al. 2011. Linear versus mel frequency cepstral coefficients for speaker recognition. In 2011 IEEE workshop on automatic speech recognition & understanding. IEEE, 559--564.

Metadata

Authors
Yu, Z., Zhai, S., & Zhang, N.
Affiliations
Washington University in St. Louis (US)
Venue
Proceedings of the 2023 ACM SIGSAC Conference on Computer and Communications Security
Publisher
ACM
Published
2023-11-15
Pages
460-474
ISSN
1543-7221 (ISSN-L)
OpenAlex
W4388856757
Cited by
44
References
19
Citations by year
2026: 15 · 2025: 18 · 2024: 10 · 2023: 1
FWCI
7.79
Type
conference paper
Language
en
Open access
Locations
ACM SIGSAC Conference on Computer and Communications Security (CCS) (publishedVersion, cc-by)
Funders
  • Army Research Office (W911NF2010141)
  • National Science Foundation (CNS-1916926, CNS-2038995, CNS-2154930, CNS-2238635)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Speech Recognition and Synthesis
  • Physical Sciences › Computer Science › Artificial Intelligence › Adversarial Robustness in Machine Learning
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Digital Media Forensic Detection
Keywords
speech synthesis, deepfake detection, generative AI misuse, adversarial examples

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: AntiFake: Using Adversarial Audio to Prevent Unauthorized Speech Synthesis. https://app.cochat.ai/papers/10.1145/3576915.3623209
The paper
Yu, Z., Zhai, S., & Zhang, N. (2023). AntiFake: Using Adversarial Audio to Prevent Unauthorized Speech Synthesis. Proceedings of the 2023 ACM SIGSAC Conference on Computer and Communications Security. https://doi.org/10.1145/3576915.3623209

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.