Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 62 of the 62 references it cites were found in a registry or an index; 14 of the 19 sources its claims cite were checked for support.

Robust DeepFake Audio Detection via an Improved NeXt-TDNN with Multi-Fused Self-Supervised Learning Features

Open access
Tahaoglu, Gul · 2025 · Applied Sciences

Abstract

Deepfake audio refers to speech that has been synthetically generated or altered through advanced neural network techniques, often with a degree of realism sufficient to convincingly imitate genuine human voices. As these manipulations become increasingly indistinguishable from authentic recordings, they present significant threats to security, undermine media integrity, and challenge the reliability of digital authentication systems. In this study, a robust detection framework is proposed, which leverages the power of self-supervised learning (SSL) and attention-based modeling to identify deepfake audio samples. Specifically, audio features are extracted from input speech using two powerful pretrained SSL models: HuBERT-Large and WavLM-Large. These distinctive features are then integrated through an Attentional Multi-Feature Fusion (AMFF) mechanism. The fused features are subsequently classified using a NeXt-Time Delay Neural Network (NeXt-TDNN) model enhanced with Efficient Channel Attention (ECA), enabling improved temporal and channel-wise feature discrimination. Experimental results show that the proposed method achieves a 0.42% EER and 0.01 min-tDCF on ASVspoof 2019 LA, a 1.01% EER on ASVspoof 2019 PA, and a pooled 6.56% EER on the cross-channel ASVspoof 2021 LA evaluation, thus highlighting its effectiveness for real-world deepfake detection scenarios. Furthermore, on the ASVspoof 5 dataset, the method achieved a 7.23% EER, outperforming strong baselines and demonstrating strong generalization ability. Moreover, the macro-averaged F1-score of 96.01% and balanced accuracy of 99.06% were obtained on the ASVspoof 2019 LA dataset, while the proposed method achieved a macro-averaged F1-score of 98.70% and balanced accuracy of 98.90% on the ASVspoof 2019 PA dataset. On the highly challenging ASVspoof 5 dataset, which includes crowdsourced, non-studio-quality audio, and novel adversarial attacks, the proposed method achieves macro-averaged metrics exceeding 92%, with a precision of 92.07%, a recall of 92.63%, an F1-measure of 92.35%, and a balanced accuracy of 92.63%.

Overview

CoChat Summary

TL;DR

The paper proposes a deepfake audio detector that fuses 8th-layer HuBERT-Large and WavLM-Large embeddings via Attentional Multi-Feature Fusion and classifies them with an ECA-enhanced lightweight NeXt-TDNN. It reports state-of-the-art EER/min-tDCF on ASVspoof 2019 LA and competitive cross-dataset results on ASVspoof 2019 PA, 2021 LA, and ASVspoof 5.

Key findings

  • On ASVspoof 2019 LA, the proposed method achieves 0.42% EER and 0.01 min-tDCF, reported as outperforming the previous best AASIST family by roughly 49–50% relative; Table 12 lists the best prior system at 0.80% EER and 0.02 min-tDCF, with relative margins of 47% and 50%.
  • On ASVspoof 2019 PA, it achieves 1.01% EER and 0.03 min-tDCF pooled, with per-condition EER from 0.48% to 1.36% and min-tDCF from 0.0134 to 0.0397 across nine device-distance conditions.
  • On ASVspoof 2021 LA, it reaches a pooled 6.56% EER, reported as roughly 31% relative reduction over RawNet2 (9.50%) and almost 58% over CQCC-GMM (15.62%); on ASVspoof 5, it achieves 7.23% EER with precision 92.07%, recall 92.63%, F1 92.35%, and balanced accuracy 92.63%.
  • Ablation: AMFF fusion yields 0.42% EER and 0.012 min-tDCF, versus 0.89% for feature concatenation and 1.72% for mean score fusion; the ECA-enhanced NeXt-TDNN-l improves over NeXt-TDNN-l, e.g., WavLM 0.64% vs 0.74% EER and HuBERT 0.63% vs 0.86% EER.

Methods

  • Design: raw waveform is processed by pretrained HuBERT-Large and WavLM-Large, with 1024-dimensional embeddings extracted from the 8th Transformer layer; these are concatenated and fused by the AMFF Parallel-Supplementary Weighted Fusion strategy into a 1024-dimensional vector, then classified by an improved NeXt-TDNN-l with Efficient Channel Attention and AM-Softmax (scale 40, margin 0.3).
  • Data: ASVspoof 2019 LA and PA, ASVspoof 2021 LA (evaluation-only), and ASVspoof 5 Track 1. Training used PyTorch 1.8, Adam optimizer with learning rate 1 × 10⁻⁴, batch size 32, 100 epochs, and the checkpoint with lowest validation EER; experiments ran on an Intel i7 CPU, 64 GB RAM, and GeForce RTX 3060.
  • Metrics: EER and minimum tandem Detection Cost Function (min-tDCF), plus macro-averaged precision, recall, F1, and balanced accuracy because of class imbalance.

Limitations

  • Stated: future work is needed to extend robustness to emerging neural vocoders, streaming codecs, and adversarial manipulations, and to integrate the detector more tightly with speaker verification back-ends.
  • Evident: performance drops on ASVspoof 5 (7.23% EER) and ASVspoof 2021 LA (6.56% pooled EER) relative to ASVspoof 2019 LA (0.42% EER); the paper also notes degradation on vocoder-based attack A10 and lower precision/accuracy (0.5995) on attacks A13 and A17 despite perfect recall.
  • Evident: ASVspoof 2021 LA is evaluation-only, posing a cross-corpus generalization scenario, and ASVspoof 5 includes crowdsourced, non-studio-quality audio and novel adversarial attacks.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.3390/app15179685

Cites

62 of 62 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Verification

Claims the paper makes

12 Valid · 4 Not valid · 4 Not checked · 73 Own results and interpretations

36 more claims

Create a free account to see all 93 claims and every source verdict.

See all claims — free account
  • Probably not a substantial claim. 11
  • It may state two separate claims as one. 46

Create a free account to see these claims.

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

5 of 6 · the rest aren’t loaded

1 more finding

Create a free account to see every finding of this check.

See all findings — free account

Citations

Cites

Show all 43 references

Research works printed but not linked: 1

  1. Wang, Z., Cui, S., Kang, X., Sun, W., and Li, Z. (2020, January 7–10). Densely connected convolutional network for audio spoofing detection. Proceedings of the 2020 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC), Auckland, New Zealand.

Cited by

See all 11

Metadata

Authors
Tahaoglu, G.
Affiliations
Department of Computer Engineering, Karadeniz Technical University, Trabzon 61080, Türkiye
Venue
Applied Sciences
Publisher
MDPI AG
Published
2025-09-03
Volume
15
Issue
17
Pages
9685
ISSN
2076-3417 (ISSN-L)
OpenAlex
W4413991433
Cited by
11
References
43
Citations by year
2026: 8 · 2025: 3
FWCI
4.41
Type
journal article
Language
en
Open access
Locations
  • Applied Sciences (publishedVersion, cc-by)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Speech Recognition and Synthesis
  • Physical Sciences › Computer Science › Signal Processing › Speech and Audio Processing
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Digital Media Forensic Detection
Keywords
audio deepfake detection, speech spoofing detection, self-supervised learning, attention-based feature fusion, HuBERT, WavLM, efficient channel attention, ASVspoof, adversarial attacks

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-09-30, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-09-30 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (gpt-6-sol).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Robust DeepFake Audio Detection via an Improved NeXt-TDNN with Multi-Fused Self-Supervised Learning Features. https://app.cochat.ai/papers/10.3390/app15179685
The paper
Tahaoglu, G. (2025). Robust DeepFake Audio Detection via an Improved NeXt-TDNN with Multi-Fused Self-Supervised Learning Features. Applied Sciences. https://doi.org/10.3390/app15179685

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.