CoChat

Collaborative Watermarking for Adversarial Speech Synthesis

Open access
Juvela, Lauri, Wang, Xin · 2024 · ICASSP 2024 - 2024 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)

The DOI matches its Crossref record; 31 of the 33 references it cites were found in a registry or an index.

Abstract

Advances in neural speech synthesis have brought us technology that is not only close to human naturalness, but is also capable of instant voice cloning with little data, and is highly accessible with pre-trained models available. Naturally, the potential flood of generated content raises the need for synthetic speech detection and watermarking. Recently, considerable research effort in synthetic speech detection has been related to the Automatic Speaker Verification and Spoofing Countermeasure Challenge (ASVspoof), which focuses on passive countermeasures. This paper takes a complementary view to generated speech detection: a synthesis system should make an active effort to watermark the generated speech in a way that aids detection by another machine, but remains transparent to a human listener. We propose a collaborative training scheme for synthetic speech watermarking and show that a HiFi-GAN neural vocoder collaborating with the ASVspoof 2021 baseline countermeasure models consistently improves detection performance over conventional classifier training. Furthermore, we demonstrate how collaborative training can be paired with augmentation strategies for added robustness against noise and time-stretching. Finally, listening tests demonstrate that collaborative training has little adverse effect on perceptual quality of vocoded speech.

Overview

Integrity signals

Registry

Crossref · 10.1109/icassp48485.2024.10448134

Cites

31 of 31 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

The text we found for this paper looks like another document, so its claims and self-check weren’t run. The registry and citation checks still apply.

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The text we found for this paper looks like another document, so the self-check wasn’t run.

Citations

Cites

Show all 31 references

Research works printed but not linked: 1

  1. Steinebach, 2004, Digitale Wasserzeichen fuer Audiodaten

Cited by

See all 18

Metadata

Authors
Juvela, L., & Wang, X.
Affiliations
  • Aalto University (FI)
  • National Institute of Informatics (JP)
Venue
ICASSP 2024 - 2024 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)
Publisher
IEEE
Published
2024-04-14
Pages
11231-11235
ISSN
1520-6149 (ISSN-L)
OpenAlex
W4392903621
Cited by
13
References
33
Citations by year
2026: 3 · 2025: 7 · 2024: 3
FWCI
3.82
Type
conference paper
Language
en
Open access
Locations
  • IEEE International Conference on Acoustics Speech and Signal Processing (publishedVersion)
  • arXiv (Cornell University) (submittedVersion)
  • Aaltodoc (Aalto University) (submittedVersion, other-oa)
  • arXiv (Cornell University)
Funders
  • Ministry of Education, Culture, Sports, Science and Technology (CREST)
  • Japan Society for the Promotion of Science (21H04906, JPMJCR18A6, CREST)
  • Core Research for Evolutional Science and Technology (JPMJCR18A6)
  • Precursory Research for Embryonic Science and Technology
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Speech Recognition and Synthesis
  • Physical Sciences › Computer Science › Signal Processing › Speech and Audio Processing
  • Physical Sciences › Computer Science › Artificial Intelligence › Adversarial Robustness in Machine Learning
Keywords
voice cloning, synthetic speech detection, collaborative training, HiFi-GAN, neural vocoder, ASVspoof, spoofing countermeasures, data augmentation, noise robustness, perceptual speech quality

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Collaborative Watermarking for Adversarial Speech Synthesis. https://app.cochat.ai/papers/10.1109/icassp48485.2024.10448134
The paper
Juvela, L., & Wang, X. (2024). Collaborative Watermarking for Adversarial Speech Synthesis. ICASSP 2024 - 2024 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). https://doi.org/10.1109/icassp48485.2024.10448134

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.