CoChat

Attack Agnostic Dataset: Towards Generalization and Stabilization of Audio DeepFake Detection

Open access
Kawa, Piotr, Plata, Marcin, Syga, Piotr · 2022 · Interspeech 2022

The DOI matches its Crossref record; 30 of the 30 references it cites were found in a registry or an index; 7 of the 8 sources its claims cite were checked for support.

Abstract

Audio DeepFakes allow the creation of high-quality, convincing utterances and therefore pose a threat due to its potential applications such as impersonation or fake news. Methods for detecting these manipulations should be characterized by good generalization and stability leading to robustness against attacks conducted with techniques that are not explicitly included in the training. In this work, we introduce Attack Agnostic Dataset - a combination of two audio DeepFakes and one anti-spoofing datasets that, thanks to the disjoint use of attacks, can lead to better generalization of detection methods. We present a thorough analysis of current DeepFake detection methods and consider different audio features (front-ends). In addition, we propose a model based on LCNN with LFCC and mel-spectrogram front-end, which not only is characterized by a good generalization and stability results but also shows improvement over LFCC-based mode - we decrease standard deviation on all folds and EER in two folds by up to 5%.

Overview

CoChat Summary

## TL;DR

The paper proposes an “Attack Agnostic Dataset” that combines three audio DeepFake/spoofing datasets with disjoint attack splits to study and improve generalization and stability in audio DeepFake detection. Across benchmarks, LCNN with LFCC plus a mel-spectrogram front-end gave the best overall generalization/stability, with standard deviation below 0.64% on all folds and EER reduced by up to nearly 5% versus the LFCC baseline.

## Key findings

  • The proposed Attack Agnostic Dataset combines 31,083 real and 222,035 fake samples covering 27 methods.
  • In the main benchmark, LCNN achieved the best generalization, with EERs of 9.525%, 9.523%, and 2.370% across the three folds, and the paper says it also had the lowest standard deviation, indicating the best stability.
  • Compared with the LFCC baseline, LCNN + LFCC + spectrogram improved EER in 2 out of 3 folds and had std values of 0.321%, 0.639%, and 0.335%.
  • The conclusion states the proposed LCNN with LFCC and mel-spectrogram achieved a standard deviation that does not exceed 0.64% on all folds, and reduced baseline EER by nearly 5% by enhancing the input with a spectrogram.

## Methods

  • The paper introduces Attack Agnostic Dataset, combining FakeAVCeleb, WaveFake, and ASVspoof 2019 LA, with attacks disjointly divided across train/test/eval subsets in three different folds to probe generalization and stability.
  • Models evaluated include LCNN, MesoInception-4, XceptionNet, RawNet2, and GMM; training used Adam, binary cross-entropy, batch size 128, 5 epochs, and 3 fixed randomness seeds.
  • Inputs/front-ends compared include LFCC, MFCC, spectrogram, and their concatenations; the audio was resampled to 16 kHz mono, silences longer than 0.2 s were trimmed, and samples were padded or trimmed to 4 s.

## Limitations

  • The paper states that ASVspoof 2021 DF subset training information and LA attack types were not available at the time, so that dataset was not used; this limits coverage of the newest attacks.
  • The text makes evident that results can vary substantially by fold and attack split: it reports large fluctuations in test accuracy and says training stability is generally low; this is a limitation of the task and evaluation setup as discussed by the authors.
  • The paper also notes that some datasets contain only one or a few generation methods (for example, FakeAVCeleb uses one method), which can make fold results less informative about broader attack diversity.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.21437/interspeech.2022-10078

Cites

30 of 30 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Verification

Claims the paper makes

3 Valid · 1 Not valid · 0 Not checked · 41 Own results and interpretations

23 more claims

Create a free account to see all 45 claims and every source verdict.

See all claims — free account
  • It may state two separate claims as one. 12
  • The quote only partly states this claim. 1
  • Probably not a substantial claim. 5

Create a free account to see these claims.

Citations

Cites

Show all 30 references

Research works printed but not linked: 1

  1. [22][22] G. Yang, S. Yang, K. Liu, P. Fang, W. Chen, and L. Xie, 'Multiband melgan: Faster waveform generation for high-quality textto-speech,' in 2021 IEEE Spoken Language Technology Workshop (SLT) . IEEE, 2021, pp. 492-498. -

Cited by

See all 33

Metadata

Authors
Kawa, P., Plata, M., & Syga, P.
Affiliations
Wrocław University of Science and Technology (PL)
Venue
Interspeech 2022
Publisher
ISCA
Published
2022-09-18
Pages
4023-4027
ISSN
2308-457X (ISSN-L)
OpenAlex
W4296069136
Cited by
33
References
26
Citations by year
2026: 9 · 2025: 10 · 2024: 10 · 2023: 3 · 2022: 1
FWCI
3.32
Type
conference paper
Language
en
Open access
Locations
  • Interspeech (USB) (publishedVersion)
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Speech Recognition and Synthesis
  • Physical Sciences › Computer Science › Signal Processing › Speech and Audio Processing
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Digital Media Forensic Detection
Keywords
audio deepfake detection, generalization, detection stability, anti-spoofing, spoofing attacks, Mel spectrogram

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (gpt-6-sol and qwen3.8-omni-flash).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Attack Agnostic Dataset: Towards Generalization and Stabilization of Audio DeepFake Detection. https://app.cochat.ai/papers/10.21437/interspeech.2022-10078
The paper
Kawa, P., Plata, M., & Syga, P. (2022). Attack Agnostic Dataset: Towards Generalization and Stabilization of Audio DeepFake Detection. Interspeech 2022. https://doi.org/10.21437/interspeech.2022-10078

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.