The DOI matches its Crossref record; 13 of the 13 references it cites were found in a registry or an index.
t-DCF: a Detection Cost Function for the Tandem Assessment of Spoofing Countermeasures and Automatic Speaker Verification
Open accessAbstract
The ASVspoof challenge series was born to spearhead research in anti-spoofing for automatic speaker verification (ASV). The two challenge editions in 2015 and 2017 involved the assessment of spoofing countermeasures (CMs) in isolation from ASV using an equal error rate (EER) metric. While a strategic approach to assessment at the time, it has certain shortcomings. First, the CM EER is not necessarily a reliable predictor of performance when ASV and CMs are combined. Second, the EER operating point is ill-suited to user authentication applications, e.g. telephone banking, characterised by a high target user prior but a low spoofing attack prior. We aim to migrate from CM- to ASV-centric assessment with the aid of a new tandem detection cost function (t-DCF) metric. It extends the conventional DCF used in ASV research to scenarios involving spoofing attacks. The t-DCF metric has 6 parameters: (i) false alarm and miss costs for both systems, and (ii) prior probabilities of target and spoof trials (with an implied third, nontarget prior). The study is intended to serve as a self-contained, tutorial-like presentation. We analyse with the t-DCF a selection of top-performing CM submissions to the 2015 and 2017 editions of ASVspoof, with a focus on the spoofing attack prior. Whereas there is little to choose between countermeasure systems for lower priors, system rankings derived with the EER and t-DCF show differences for higher priors. We observe some ranking changes. Findings support the adoption of the DCFbased metric into the roadmap for future ASVspoof challenges, and possibly for other biometric anti-spoofing evaluations.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Speaker Verification Using Adapted Gaussian Mixture Models
Reynolds, D. A., Quatieri, T. F., & Dunn, R. B. (2000) · Digital Signal Processing · doi:10.1006/dspr.1999.0361 · Cited by 4,282
Self-citationEnhancing security and privacy in biometrics-based authentication systems
Ratha, N., Connell, J. H., & Bolle, R. M. (2001) · IBM Systems Journal · doi:10.1147/sj.403.0614 · Cited by 1,688
The ASVspoof 2017 challenge: assessing the limits of replay spoofing attack detection
Kinnunen, T., Sahidullah, M., Delgado, H., Todisco, M., Evans, N., Yamagishi, J., & Lee, K. A. (2017) · Interspeech 2017 · doi:10.21437/interspeech.2017-1111 · Cited by 535
Self-citationASVspoof 2015: the first automatic speaker verification spoofing and countermeasures challenge
Wu, Z., Kinnunen, T., Evans, N., Yamagishi, J., Hanilçi, C., Sahidullah, M., & Sizov, A. (2015) · Interspeech 2015 · doi:10.21437/interspeech.2015-462 · Cited by 484
Self-citationThe NIST speaker recognition evaluation – Overview, methodology, systems, results, perspective
Doddington, G. R., Przybocki, M. A., Martín, A. F., & Reynolds, D. A. (2000) · Speech Communication · doi:10.1016/s0167-6393(99)00080-1 · Cited by 366
Self-citationSpoofing and Anti-Spoofing Measures
Schuckers, S. (2002) · Information Security Technical Report · doi:10.1016/s1363-4127(02)00407-7 · Cited by 281
Spoofing and countermeasures for automatic speaker verification
Evans, N., Kinnunen, T., & Yamagishi, J. (2013) · Interspeech (USB) · doi:10.21437/interspeech.2013-288 · Cited by 163
Self-citationCompetition on counter measures to 2-D facial spoofing attacks
Chakka, M. M., Anjos, A., Marcel, S., Tronci, R., Muntoni, D., Fadda, G., Pili, M., Sirena, N., Murgia, G., Ristori, M., et al. (2011) · IEEE International Joint Conference on Biometrics (IJCB) · doi:10.1109/ijcb.2011.6117509 · Cited by 146
Review of the Fingerprint Liveness Detection (LivDet) competition series: 2009 to 2015
Ghiani, L., Yambay, D. A., Mura, V., Marcialis, G. L., Roli, F., & Schuckers, S. (2016) · Image and Vision Computing · doi:10.1016/j.imavis.2016.07.002 · Cited by 123
Measuring, refining and calibrating speaker and language information extracted from speech
Brümmer, N. (2010) · SUNScholar (Stellenbosch University) · Cited by 94
Joint Speaker Verification and Antispoofing in the $i$ -Vector Space
Сизов, А. С., Khoury, E., Kinnunen, T., Wu, Z., & Marcel, S. (2015) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2015.2407362 · Cited by 74
Self-citationApplication-independent evaluation of speaker detection
Brümmer, N., & du Preez, J. (2006) · Computer Speech and Language · doi:10.1016/j.csl.2005.08.001 · Cited by 71
Sahidullah, M., Delgado, H., Todisco, M., Yu, H. T., Kinnunen, T., Evans, N., & Tan, Z. (2016) · Interspeech (USB) · doi:10.21437/interspeech.2016-1280 · Cited by 54
Self-citation
Cited by
Sorted by citations
ASVspoof 2019: Future Horizons in Spoofed and Fake Audio Detection
Todisco, M., Wang, X., Vestman, V., Sahidullah, M., Delgado, H., Nautsch, A., Yamagishi, J., Evans, N., Kinnunen, T. H., & Lee, K. A. (2019) · Interspeech 2019 · doi:10.21437/interspeech.2019-2249 · Cited by 687
Self-citationASVspoof 2019: A large-scale public database of synthesized, converted and replayed speech
Wang, X., Yamagishi, J., Todisco, M., Delgado, H., Nautsch, A., Evans, N., Sahidullah, M., Vestman, V., Kinnunen, T., Lee, K. A., et al. (2020) · Computer Speech & Language · doi:10.1016/j.csl.2020.101114 · Cited by 505
Self-citationEnd-to-End anti-spoofing with RawNet2
Tak, H., Patino, J., Todisco, M., Nautsch, A., Evans, N., & Larcher, A. (2021) · ICASSP 2021 - 2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp39728.2021.9414234 · Cited by 402
Self-citationAASIST: Audio Anti-Spoofing Using Integrated Spectro-Temporal Graph Attention Networks
Jung, J.-W., Heo, H.-S., Tak, H., Shim, H.-J., Chung, J. S., Lee, B.-J., Yu, H.-J., & Evans, N. (2022) · ICASSP 2022 - 2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp43922.2022.9747766 · Cited by 399
Self-citationASVspoof 2021: accelerating progress in spoofed and deepfake speech detection
Yamagishi, J., Wang, X., Todisco, M., Sahidullah, M., Patino, J., Nautsch, A., Liu, X., Lee, K. A., Kinnunen, T., Evans, N., et al. (2021) · 2021 Edition of the Automatic Speaker Verification and Spoofing Countermeasures Challenge · doi:10.21437/asvspoof.2021-8 · Cited by 380
Self-citation
Metadata
- Authors
- Kinnunen, T., Lee, K. A., Delgado, H., Evans, N., Todisco, M., Sahidullah, M., Yamagishi, J., & Reynolds, D. A.
- Affiliations
- University of Eastern Finland (FI)
- NEC (Japan) (JP)
- EURECOM (FR)
- Institut national de recherche en sciences et technologies du numérique (FR)
- National Institute of Informatics (JP)
- Massachusetts Institute of Technology (US)
- ORCID
- Venue
- The Speaker and Language Recognition Workshop (Odyssey 2018)
- Publisher
- ISCA
- Published
- 2018-06-26
- Pages
- 312-319
- OpenAlex
- W2799053639
- Cited by
- 198
- References
- 13
- Citations by year
- 2026: 10 · 2025: 24 · 2024: 20 · 2023: 25 · 2022: 27 · 2021: 33 · 2020: 34 · 2019: 23 · 2018: 2
- FWCI
- 9.35
- Type
- conference paper
- Language
- en
- Open access
- green
- inria.hal.science
- Licence
- other-oa
- Locations
- The Speaker and Language Recognition Workshop (Odyssey) (publishedVersion)
- HAL (submittedVersion, other-oa)
- Graduate School and Research Center in Digital Science (EURECOM) (submittedVersion)
- Edinburgh Research Explorer (University of Edinburgh) (submittedVersion, other-oa)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Speech Recognition and Synthesis
- Physical Sciences › Computer Science › Signal Processing › Biometric Identification and Security
- Physical Sciences › Computer Science › Signal Processing › Speech and Audio Processing
- Keywords
- spoofing countermeasures, speaker verification, spoofing attacks, speaker verification security
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
