Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 40 of the 40 references it cites were found in a registry or an index; 12 of the 16 sources its claims cite were checked for support.

WavLM model ensemble for audio deepfake detection

Open access
Combei, David, Stan, Adriana, Oneata, Dan, Cucu, Horia · 2024 · The Automatic Speaker Verification Spoofing Countermeasures Workshop (ASVspoof 2024)

Abstract

Audio deepfake detection has become a pivotal task over the last couple of years, as many recent speech synthesis and voice cloning systems generate highly realistic speech samples, thus enabling their use in malicious activities. In this paper we address the issue of audio deepfake detection as it was set in the ASVspoof5 challenge. First, we benchmark ten types of pretrained representations and show that the self-supervised representations stemming from the wav2vec2 and wavLM families perform best. Of the two, wavLM is better when restricting the pretraining data to LibriSpeech, as required by the challenge rules. To further improve performance, we finetune the wavLM model for the deepfake detection task. We extend the ASVspoof5 dataset with samples from other deepfake detection datasets and apply data augmentation. Our final challenge submission consists of a late fusion combination of four models and achieves an equal error rate of 6.56% and 17.08% on the two evaluation sets.

Overview

CoChat Summary

TL;DR

The paper benchmarks pretrained audio representations for ASVspoof5 audio deepfake detection and finds wavLM-base best among challenge-compliant models, then finetunes it with external data and augmentation. A late-fusion ensemble of four wavLM-base variants achieves 6.56% EER on the progress phase and 17.08% EER on the final evaluation set.

Key findings

  • In linear probing on a 27k ASV5 development subset, wavLM-base achieved 9.93% EER, the best among challenge-compliant models; wav2vec2-base reached 13.33% and HuBERT 16.47%. Non-compliant models wavLM-large and wav2vec2-xls-r-2b reached 6.67% and 0.96% EER, respectively.
  • Finetuning improved wavLM-base: medium-27k gave 4.16% dev EER; augm-31k gave 0.61% dev and 9.02% progress EER; augm-114k gave 2.97% dev and 7.26% progress EER. Finetuned wav2vec2-base on medium-27k gave 5.85% dev and 11.91% progress EER.
  • The final late-fusion ensemble of four wavLM-base variants—pretrained plus finetuned on medium-27k, augm-31k, and augm-114k—achieved 6.56% EER on the progress phase and 17.08% EER on the final evaluation set.
  • On the development set, the best two-model combination was augm-31k plus augm-114k, with 0.56% EER; data augmentation was an important component for finetuning.

Methods

  • The work addressed the ASVspoof5 open deepfake detection track. Ten pretrained representations from self-supervised, speaker embedding, and learnable-frontend classes were benchmarked as frozen feature extractors with logistic regression over average-pooled representations, using two random 27k subsets from ASV5 train/dev with an 8:1 spoof-to-bonafide ratio.
  • wavLM-base and wav2vec2-base were finetuned with binary cross-entropy, Adam at learning rate 3·10⁻⁵, linear scheduler with 0.1 warmup, 5 epochs, batch size 8 or 16, on a single Tesla V100 16GB GPU. Training data included ASV5 plus ASV19, ASV21, FoR, and ITW, with white-noise and reverberation augmentation applied to half of bonafide samples; dataset variants were medium-27k, augm-31k, and augm-114k.
  • The final submission used late fusion: logistic regression over model output probabilities, with weights learned on the medium-27k train split, evaluated on development, progress phase, and final evaluation sets.

Limitations

  • Stated: limited computational resources prevented finetuning on the complete datasets; not all progress phase evaluation results could be presented because the phase was closed by submission time.
  • Evident: the final evaluation EER of 17.08% is much higher than the progress phase EER of 6.56%, indicating a substantial generalization gap to the final evaluation set.
  • Evident: the ASVspoof5 open-condition restrictions excluded top-performing models such as wav2vec2-xls-r-2b and wavLM-large, so the best challenge-compliant model was weaker than those non-compliant toplines.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.21437/asvspoof.2024-25

Cites

40 of 40 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Verification

Claims the paper makes

3 Valid · 1 Not valid · 0 Not checked · 16 Own results and interpretations

8 more claims

Create a free account to see all 20 claims and to verify the 1 reference still open.

See all claims — free account
  • Probably not a substantial claim. 1
  • It may state two separate claims as one. 4
  • The quote only partly states this claim. 4

Create a free account to see these claims.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Show all 37 references

Cited by

See all 15

Metadata

Authors
Combei, D., Stan, A., Oneata, D., & Cucu, H.
Venue
The Automatic Speaker Verification Spoofing Countermeasures Workshop (ASVspoof 2024)
Publisher
ISCA
Published
2024-08-31
Pages
170-175
OpenAlex
W4403956249
Cited by
15
References
37
Citations by year
2026: 7 · 2025: 7 · 2024: 1
FWCI
4.43
Type
conference paper
Language
en
Open access
Licence
public-domain
Locations
  • Automatic Speaker Verification Spoofing Countermeasures Workshop (ASVspoof) (publishedVersion)
  • arXiv (Cornell University) (submittedVersion, public-domain)
  • arXiv (Cornell University)
Funders
  • Unitatea Executiva pentru Finantarea Invatamantului Superior, a Cercetarii, Dezvoltarii si Inovarii
  • Colegiul Consultativ pentru Cercetare-Dezvoltare şi Inovare
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Speech Recognition and Synthesis
  • Physical Sciences › Computer Science › Signal Processing › Music and Audio Processing
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Digital Media Forensic Detection
Keywords
audio deepfake detection, WavLM, ensemble learning, audio classification, audio forensics

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-10-29, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-29 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (qwen3.8-omni-flash and gpt-6-sol).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: WavLM model ensemble for audio deepfake detection. https://app.cochat.ai/papers/10.21437/asvspoof.2024-25
The paper
Combei, D., Stan, A., Oneata, D., & Cucu, H. (2024). WavLM model ensemble for audio deepfake detection. The Automatic Speaker Verification Spoofing Countermeasures Workshop (ASVspoof 2024). https://doi.org/10.21437/asvspoof.2024-25

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.