The PartialSpoof Database and Countermeasures for the Detection of Short Fake Speech Segments Embedded in an Utterance
Open accessThe DOI matches its Crossref record; 41 of the 45 references it cites were found in a registry or an index.
Abstract
Automatic speaker verification is susceptible to various manipulations and spoofing, such as text-to-speech synthesis, voice conversion, replay, tampering, adversarial attacks, and so on. We consider a new spoofing scenario called "Partial Spoof" (PS) in which synthesized or transformed speech segments are embedded into a bona fide utterance. While existing countermeasures (CMs) can detect fully spoofed utterances, there is a need for their adaptation or extension to the PS scenario. We propose various improvements to construct a significantly more accurate CM that can detect and locate short-generated spoofed speech segments at finer temporal resolutions. First, we introduce newly developed self-supervised pre-trained models as enhanced feature extractors. Second, we extend our PartialSpoof database by adding segment labels for various temporal resolutions. Since the short spoofed speech segments to be embedded by attackers are of variable length, six different temporal resolutions are considered, ranging from as short as 20 ms to as large as 640 ms. Third, we propose a new CM that enables the simultaneous use of the segment-level labels at different temporal resolutions as well as utterance-level labels to execute utterance- and segment-level detection at the same time. We also show that the proposed CM is capable of detecting spoofing at the utterance level with low error rates in the PS scenario as well as in a related logical access (LA) scenario. The equal error rates of utterance-level detection on the PartialSpoof database and ASVspoof 2019 LA database were 0.77 and 0.90%, respectively.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The summary of the results indicate the fragility of synthesis detection model against lower quality and unseen fake audio, especially when partially-spoofed audio is presented.”
From ASVspoof 2021: Towards Spoofed and Deepfake Speech Detection in the Wild (2023) · cites this paper as [51]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Partial spoofs, where only a potentially short interval or perhaps a single word is substituted or manipulated, are known to pose a greater detection challenge [51].”
From ASVspoof 2021: Towards Spoofed and Deepfake Speech Detection in the Wild (2023) · cites this paper as [51]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404 · cited 6×
“encoder and cascade of Transformer blocks [29].”
InfluentialHochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318 · cited 2×
“For the scoring module in the back-end, we compared the following architectures: a single fully-connected (FC) layer; an FC layer after a bidirectional long short-term memory (BLSTM) [39] layer; an FC layer after two BLSTM layers; a single gated multilayer perceptron (gMLP) block [40]; five gMLP blocks.”
MethodExploiting Generative AI to Scale up Intelligent Tutoring Systems
Jakubův, J., Chvalovský, K., Goertzel, Z., Kaliszyk, C., Olšák, M., Piotrowski, B., Schulz, S., Suda, M., & Urban, J. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.itp.2023.19 · Cited by 76,658
Advances in Neural Information Processing Systems 19
(2007) · The MIT Press eBooks · doi:10.52202/085713 · Cited by 15,539
“Librispeech: an ASR corpus based on public domain audio books,”
Panayotov, V., Chen, G., Povey, D., & Khudanpur, S. (2015) · 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2015.7178964 · Cited by 6,072 · cited 1×
“0 Large LibriSpeech [34], CommonVoice [35], BABEL [36] 317.”
BackgroundKaldi Speech Recognition Toolkit
Povey, D. (2024) · Infoscience (Ecole Polytechnique Fédérale de Lausanne) · doi:10.57702/jb3fvbn9 · Cited by 4,609
HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Units
Hsu, W.-N., Bolte, B., Tsai, Y.-H. H., Lakhotia, K., Salakhutdinov, R., & Mohamed, A. (2021) · IEEE/ACM Transactions on Audio, Speech, and Language Processing · doi:10.1109/taslp.2021.3122291 · Cited by 2,983
wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representations
Baevski, A., Zhou, H., Mohamed, A., & Auli, M. (2020) · arXiv · doi:10.48550/arxiv.2006.11477 · Cited by 2,369 · cited 1×
“0 [7] and WavLM [8] as enhanced feature extractors.”
BackgroundSWITCHBOARD: telephone speech corpus for research and development
Godfrey, J. J., Holliman, E. C., & McDaniel, J. (1992) · [Proceedings] ICASSP-92: 1992 IEEE International Conference on Acoustics, Speech, and Signal Processing · doi:10.1109/icassp.1992.225858 · Cited by 2,134 · cited 1×
“0 Large CommonVoice, Switchboard [31], Libri-Light [32], Fisher [33] 317.”
WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processing
Chen, S., Wang, C., Chen, Z., Wu, Y., Liu, S., Chen, Z., Li, J., Kanda, N., Yoshioka, T., Xiao, X., et al. (2022) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2022.3188113 · Cited by 1,926 · cited 3×
“0 [7] and WavLM [8] as enhanced feature extractors.”
BackgroundInfluentialAn overview of text-independent speaker recognition: From features to supervectors
Kinnunen, T., & Li, H. (2010) · Speech Communication · doi:10.1016/j.specom.2009.08.009 · Cited by 1,434 · cited 1×
“variable-length candidate segments, three types of VAD [20], [21], [22] were used, and a majority vote was taken.”
BackgroundCommon Voice: A Massively-Multilingual Speech Corpus
Ardila, R., Branson, M., Davis, K., Henretty, M., Kohler, M., Meyer, J., Morais, R., Saunders, L., Tyers, F. M., & Weber, G. (2019) · arXiv · doi:10.48550/arxiv.1912.06670 · Cited by 905 · cited 1×
“0 Large LibriSpeech [34], CommonVoice [35], BABEL [36] 317.”
BackgroundSUPERB: Speech Processing Universal PERformance Benchmark
Yang, S.-W., Chi, P.-H., Chuang, Y.-S., Lai, C.-I. J., Lakhotia, K., Lin, Y. Y., Liu, A. T., Shi, J., Chang, X., Lin, G.-T., et al. (2021) · Interspeech 2021 · doi:10.21437/interspeech.2021-1775 · Cited by 681
The ASVspoof 2017 challenge: assessing the limits of replay spoofing attack detection
Kinnunen, T., Sahidullah, M., Delgado, H., Todisco, M., Evans, N., Yamagishi, J., & Lee, K. A. (2017) · Interspeech 2017 · doi:10.21437/interspeech.2017-1111 · Cited by 535 · cited 1×
“A number of initiatives and challenges such as ASVspoof [1], [2], [3], [4] have hence been organized to encourage research in countermeasure (CM) solutions, which are needed to protect speech applications and human listeners from spoofing attacks.”
BackgroundSelf-citationTaylor, P. (2009) · Cambridge University Press eBooks · doi:10.1017/cbo9780511816338 · Cited by 529
ASVspoof 2019: A large-scale public database of synthesized, converted and replayed speech
Wang, X., Yamagishi, J., Todisco, M., Delgado, H., Nautsch, A., Evans, N., Sahidullah, M., Vestman, V., Kinnunen, T., Lee, K. A., et al. (2020) · Computer Speech & Language · doi:10.1016/j.csl.2020.101114 · Cited by 505 · cited 2×
“Furthermore, we conducted a cross-scenario experiment using the ASVspoof 2019 LA database [18], the goal of which was to show that the proposed CM optimized for the PS scenario can also be applied to the LA scenario.”
BackgroundMethodSelf-citationASVspoof 2015: the first automatic speaker verification spoofing and countermeasures challenge
Wu, Z., Kinnunen, T., Evans, N., Yamagishi, J., Hanilçi, C., Sahidullah, M., & Sizov, A. (2015) · Interspeech 2015 · doi:10.21437/interspeech.2015-462 · Cited by 484 · cited 1×
“A number of initiatives and challenges such as ASVspoof [1], [2], [3], [4] have hence been organized to encourage research in countermeasure (CM) solutions, which are needed to protect speech applications and human listeners from spoofing attacks.”
BackgroundSelf-citationThe Fisher Corpus: a Resource for the Next Generations of Speech-to-Text
Cieri, C., Miller, D. A. B., & Walker, K. P. (2004) · Language Resources and Evaluation Conference (LREC) · doi:10.63317/5q862povzthr · Cited by 464
Libri-Light: A Benchmark for ASR with Limited or No Supervision
Kahn, J., Riviere, M., Zheng, W., Kharitonov, E., Xu, Q., Mazare, P. E., Karadayi, J., Liptchinsky, V., Collobert, R., Fuegen, C., et al. (2020) · ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp40776.2020.9052942 · Cited by 458 · cited 2×
“0 Large CommonVoice, Switchboard [31], Libri-Light [32], Fisher [33] 317.”
BackgroundConstant Q Cepstral Coefficients: A Spoofing Countermeasure for Automatic Speaker Verification
Todisco, M., Delgado, H., & Evans, N. (2017) · Computer Speech & Language · doi:10.1016/j.csl.2017.01.001 · Cited by 424 · cited 1×
“2 The original resolution in [16] was 8 ms, a value determined by the Constant Q Cepstral Coefficients (CQCC) extraction configuration [42].”
MethodSelf-citationEnd-to-End anti-spoofing with RawNet2
Tak, H., Patino, J., Todisco, M., Nautsch, A., Evans, N., & Larcher, A. (2021) · ICASSP 2021 - 2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp39728.2021.9414234 · Cited by 402 · cited 1×
“For the LA scenario and ASVspoof 2019 LA database, existing studies have measured the EER over fully spoofed trials from each spoofing system and found that a voice-conversion-based spoofing system called A17 significantly increased the CMs’ EERs on the evaluation set [3], [41].”
MethodSelf-citationASVspoof 2021: accelerating progress in spoofed and deepfake speech detection
Yamagishi, J., Wang, X., Todisco, M., Sahidullah, M., Patino, J., Nautsch, A., Liu, X., Lee, K. A., Kinnunen, T., Evans, N., et al. (2021) · 2021 Edition of the Automatic Speaker Verification and Spoofing Countermeasures Challenge · doi:10.21437/asvspoof.2021-8 · Cited by 380
Self-citationWang, C., Riviere, M., Lee, A., Wu, A., Talnikar, C., Haziza, D., Williamson, M., Pino, J., & Dupoux, E. (2021) · Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · doi:10.18653/v1/2021.acl-long.80 · Cited by 329
GigaSpeech: An Evolving, Multi-Domain ASR Corpus with 10,000 Hours of Transcribed Audio
Chen, G., Chai, S., Wang, G.-B., Du, J., Zhang, W.-Q., Weng, C., Su, D., Povey, D., Trmal, J., Zhang, J., et al. (2021) · Interspeech 2021 · doi:10.21437/interspeech.2021-1965 · Cited by 229 · cited 2×
“Available: https://www.iarpa. gov/research-programs/babel [37] G. Chen et al., “GigaSpeech: An evolving, multi-domain ASR corpus with 10,000 hours of transcribed audio,” in Proc.”
BackgroundNautsch, A., Wang, X., Evans, N., Kinnunen, T. H., Vestman, V., Todisco, M., Delgado, H., Sahidullah, M., Yamagishi, J., & Lee, K. A. (2021) · IEEE Transactions on Biometrics, Behavior, and Identity Science · doi:10.1109/tbiom.2021.3059479 · Cited by 185 · cited 2×
“For the LA scenario and ASVspoof 2019 LA database, existing studies have measured the EER over fully spoofed trials from each spoofing system and found that a voice-conversion-based spoofing system called A17 significantly increased the CMs’ EERs on the evaluation set [3], [41].”
BackgroundMethodSelf-citationA Statistical Significance Test for Person Authentication
Samy Bengio, A., & Mariéthoz, J. (2004) · Infoscience (Ecole Polytechnique Fédérale de Lausanne) · Cited by 182
ADD 2022: the first Audio Deep Synthesis Detection Challenge
Yi, J., Fu, R., Tao, J., Nie, S., Ma, H., Wang, C., Wang, T., Tian, Z., Bai, Y., Fan, C., et al. (2022) · ICASSP 2022 - 2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp43922.2022.9746939 · Cited by 165
Half-Truth: A Partially Fake Audio Detection Dataset
Yi, J., Bai, Y., Tao, J., Ma, H., Tian, Z., Wang, C., Wang, T., & Fu, R. (2021) · Interspeech (USB) · doi:10.21437/interspeech.2021-930 · Cited by 156
Investigating Self-Supervised Front Ends for Speech Spoofing Countermeasures
Wang, X., & Yamagishi, J. (2022) · The Speaker and Language Recognition Workshop (Odyssey 2022) · doi:10.21437/odyssey.2022-14 · Cited by 138
Self-citationA Comparative Study on Recent Neural Spoofing Countermeasures for Synthetic Speech Detection
Wang, X., & Yamagishi, J. (2021) · Interspeech 2021 · doi:10.21437/interspeech.2021-702 · Cited by 137
Self-citationThe Vicomtech Audio Deepfake Detection System Based on Wav2vec2 for the 2022 ADD Challenge
Martin-Donas, J. M., & Alvarez, A. (2022) · ICASSP 2022 - 2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp43922.2022.9747768 · Cited by 100
Digital multimedia audio forensics: past, present and future
Zakariah, M., Khan, M. K., & Malik, H. M. A. (2017) · Multimedia Tools and Applications · doi:10.1007/s11042-016-4277-2 · Cited by 83 · cited 1×
“The PS scenario is also closely related to copy-moves and splicing, which are scenarios well-studied for tampering forgery [9], [10].”
BackgroundUniversal Paralinguistic Speech Representations Using self-Supervised Conformers
Shor, J., Jansen, A., Han, W., Park, D., & Zhang, Y. (2022) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp43922.2022.9747197 · Cited by 61 · cited 1×
“prove CM performance for the LA scenario [25], [26], [27].”
BackgroundPartially Fake Audio Detection by Self-Attention-Based Fake Span Discovery
Wu, H., Kuo, H.-C., Zheng, N., Hung, K.-H., Lee, H.-Y., Tsao, Y., Wang, H., & Meng, H. M. L. (2022) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp43922.2022.9746162 · Cited by 59
End-to-End Domain-Adversarial Voice Activity Detection
Lavechin, M., Gill, M.-P., Bousbib, R., Bredin, H., & Garcia, L. P. (2020) · Interspeech (USB) · doi:10.21437/interspeech.2020-2285 · Cited by 52
An Initial Investigation for Detecting Partially Spoofed Audio
Zhang, L., Wang, X., Cooper, E., Yamagishi, J., Patino, J., & Evans, N. (2021) · Interspeech 2021 · doi:10.21437/interspeech.2021-738 · Cited by 43
Self-citationAudio Forgery Detection Techniques: Present and Past Review
Bevinamarad, P., & Shirldonkar, M. S. (2020) · International Conference on Trends in Electronics and Informatics (ICOEI) · doi:10.1109/icoei48184.2020.9143014 · Cited by 41
Context-Aware Prosody Correction for Text-Based Speech Editing
Morrison, M., Rencker, L., Jin, Z., Bryan, N. J., Cáceres, J.-P., & Pardo, B. (2021) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp39728.2021.9414633 · Cited by 37
EditSpeech: A Text Based Speech Editing System Using Partial Inference and Bidirectional Fusion
Tan, D., Deng, L., Yeung, Y. T., Jiang, X., Chen, X. D., & Lee, T. (2021) · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru51503.2021.9688051 · Cited by 31
Multi-task Learning in Utterance-level and Segmental-level Spoof Detection
Zhang, L., Wang, X., Cooper, E., & Yamagishi, J. (2021) · 2021 Edition of the Automatic Speaker Verification and Spoofing Countermeasures Challenge · doi:10.21437/asvspoof.2021-2 · Cited by 26
Self-citationInvestigating self-supervised front ends for speech spoofing countermeasuresPreprint
Wang, X., & Yamagishi, J. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2111.07725 · Cited by 10
Self-citation
Research works printed but not linked: 2
- Campbell, 1996, CHATR: A high-definition speech re-sequencing system, 1223
- Liu, 2021, Pay attention to MLPS, 34, 9204
Cited by
ASVspoof 2021: Towards Spoofed and Deepfake Speech Detection in the Wild
Liu, X., Wang, X., Sahidullah, M., Patino, J., Delgado, H., Kinnunen, T., Todisco, M., Yamagishi, J., Evans, N., Nautsch, A., et al. (2023) · IEEE/ACM Transactions on Audio, Speech, and Language Processing · doi:10.1109/taslp.2023.3285283 · Cited by 312
“Partial spoofs, where only a potentially short interval or perhaps a single word is substituted or manipulated, are known to pose a greater detection challenge [51].”
BackgroundSelf-citationA Survey on Speech Deepfake Detection
Li, M., Ahmadiadli, Y., & Zhang, X.-P. (2025) · ACM Computing Surveys · doi:10.1145/3714458 · Cited by 101
SpoofCeleb: Speech Deepfake Detection and SASV in the Wild
Jung, J.-W., Wu, Y., Wang, X., Kim, J.-H., Maiti, S., Matsunaga, Y., Shim, H.-J., Tian, J., Evans, N., Chung, J. S., et al. (2025) · IEEE Open Journal of Signal Processing · doi:10.1109/ojsp.2025.3529377 · Cited by 80
“To safeguard the authenticity of speech, several datasets have been published to support research in SDD [9]–[12], [18], [21], [23], [26].”
Self-citationMLAAD: The Multi-Language Audio Anti-Spoofing Dataset
Müller, N. M., Kawa, P., Choong, W. H., Casanova, E., Gölge, E., Müller, T., Syga, P., Sperl, P., & Böttinger, K. (2024) · 2024 International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn60899.2024.10650962 · Cited by 73
“Second, front-end-based models analyze transformed representations of audio signals, such as (mel-)spectrograms or cepstral coefficients [51], [52], and have recently been enhanced by Self-Supervised Learning or embedding-based approaches due to their high performance and good generalization…”
Human Perception of Audio Deepfakes
Müller, N. M., Pizzi, K., & Williams, J. (2022) · Proceedings of the 1st International Workshop on Deepfake Detection for Audio Multimedia · doi:10.1145/3552466.3556531 · Cited by 68
Metadata
- Authors
- Zhang, L., Wang, X., Cooper, E., Evans, N., & Yamagishi, J.
- Affiliations
- National Institute of Informatics (JP)
- EURECOM (FR)
- Venue
- IEEE/ACM Transactions on Audio, Speech, and Language Processing
- Published
- 2023
- Volume
- 31
- Pages
- 813-825
- ISSN
- 2329-9290 (ISSN-L)
- 2329-9304
- OpenAlex
- W4313306150
- Cited by
- 100
- References
- 45
- Citations by year
- 2026: 23 · 2025: 33 · 2024: 38 · 2023: 6
- FWCI
- 6.33
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Locations
- IEEE/ACM Transactions on Audio Speech and Language Processing (publishedVersion, cc-by)
- HAL (submittedVersion, public-domain)
- Zenodo (CERN European Organization for Nuclear Research) (submittedVersion, cc-by)
- arXiv (Cornell University) (cc-by)
- Funders
- JST CREST (JPMJCR18A6, JPMJCR20D3, JPMJFS2136)
- ANR (ANR-18-JSTS-0001)
- MEXT KAKENHI (21K17775, 21H04906, 21K11951, 18H04112)
- Google AI for Japan Program
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Speech Recognition and Synthesis
- Physical Sciences › Computer Science › Signal Processing › Biometric Identification and Security
- Physical Sciences › Computer Science › Signal Processing › Speech and Audio Processing
- Keywords
- anti-spoofing, speaker verification, spoofing countermeasures, temporal resolution, self-supervised feature extraction, ASVspoof 2019
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.