The DOI matches its Crossref record; 25 of the 25 references it cites were found in a registry or an index.
Speaker Recognition for Multi-speaker Conversations Using X-vectors
Abstract
Recently, deep neural networks that map utterances to fixed-dimensional embeddings have emerged as the state-of-the-art in speaker recognition. Our prior work introduced x-vectors, an embedding that is very effective for both speaker recognition and diarization. This paper combines our previous work and applies it to the problem of speaker recognition on multi-speaker conversations. We measure performance on Speakers in the Wild and report what we believe are the best published error rates on this dataset. Moreover, we find that diarization substantially reduces error rate when there are multiple speakers, while maintaining excellent performance on single-speaker recordings. Finally, we introduce an easily implemented method to remove the domain-sensitive threshold typically used in the clustering stage of a diarization system. The proposed method is more robust to domain shifts, and achieves similar results to those obtained using a well-tuned threshold.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Kaldi Speech Recognition Toolkit
Povey, D. (2024) · Infoscience (Ecole Polytechnique Fédérale de Lausanne) · doi:10.57702/jb3fvbn9 · Cited by 4,609
Self-citationFront-End Factor Analysis for Speaker Verification
Dehak, N., Kenny, P. J., Dehak, R., Dumouchel, P., & Ouellet, P. (2011) · IEEE Transactions on Audio, Speech, and Language Processing · doi:10.1109/tasl.2010.2064307 · Cited by 3,549
X-Vectors: Robust DNN Embeddings for Speaker Recognition
Snyder, D., Garcia-Romero, D., Sell, G., Povey, D., & Khudanpur, S. (2018) · 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2018.8461375 · Cited by 2,620
Self-citationVoxCeleb2: Deep Speaker Recognition
Chung, J. S., Nagrani, A., & Zisserman, A. (2018) · Interspeech 2018 · doi:10.21437/interspeech.2018-1929 · Cited by 2,256
VoxCeleb: A Large-Scale Speaker Identification Dataset
Nagrani, A., Chung, J. S., & Zisserman, A. (2017) · Interspeech 2017 · doi:10.21437/interspeech.2017-950 · Cited by 2,210
Deep Neural Network Embeddings for Text-Independent Speaker Verification
Snyder, D., Garcia-Romero, D., Povey, D., & Khudanpur, S. (2017) · Interspeech 2017 · doi:10.21437/interspeech.2017-620 · Cited by 739
Self-citationBayesian Speaker Verification with Heavy-Tailed Priors.
Kenny, P. J. (2010) · Odyssey · Cited by 722
End-to-end text-dependent speaker verification
Heigold, G., Moreno, I., Bengio, S., & Shazeer, N. (2016) · 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2016.7472652 · Cited by 514
Probabilistic Linear Discriminant Analysis
Ioffe, S. (2006) · Lecture Notes in Computer Science · doi:10.1007/11744085_41 · Cited by 473
Deep neural network-based speaker embeddings for end-to-end speaker verification
Snyder, D., Ghahremani, P., Povey, D., Garcia-Romero, D., Carmiel, Y., & Khudanpur, S. (2016) · 2016 IEEE Spoken Language Technology Workshop (SLT) · doi:10.1109/slt.2016.7846260 · Cited by 352
Self-citationWang, Q., Downey, C., Wan, L., Mansfield, P. A., & Moreno, I. L. (2018) · 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2018.8462628 · Cited by 309
Speaker diarization using deep neural network embeddings
Garcia-Romero, D., Snyder, D., Sell, G., Povey, D., & McCree, A. (2017) · 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2017.7953094 · Cited by 231
Self-citationSell, G., Snyder, D., McCree, A., Garcia-Romero, D., Villalba, J., Maciejewski, M., Manohar, V., Dehak, N., Povey, D., Watanabe, S., et al. (2018) · Interspeech 2018 · doi:10.21437/interspeech.2018-1893 · Cited by 209
Self-citationSpeaker diarization with plda i-vector scoring and unsupervised calibration
Sell, G., & Garcia-Romero, D. (2014) · 2014 IEEE Spoken Language Technology Workshop (SLT) · doi:10.1109/slt.2014.7078610 · Cited by 202
Self-citationThe NIST 2010 speaker recognition evaluation
Martín, A. F., & Greenberg, C. S. (2010) · Interspeech (USB) · doi:10.21437/interspeech.2010-722 · Cited by 174
A Study of the Cosine Distance-Based Mean Shift for Telephone Speech Diarization
Senoussaoui, M., Kenny, P., Stafylakis, T., & Dumouchel, P. (2014) · IEEE/ACM Transactions on Audio, Speech, and Language Processing · doi:10.1109/taslp.2013.2285474 · Cited by 172
The speaker partitioning problem
Brümmer, N., & de Villiers, E. (2010) · Odyssey · Cited by 131
Exploiting intra-conversation variability for speaker diarization
Shum, S. H., Dehak, N., Chuangsuwanich, E., Reynolds, D. A., & Glass, J. R. (2011) · Interspeech (USB) · doi:10.21437/interspeech.2011-383 · Cited by 116
Learning Speaker-Specific Characteristics With a Deep Neural Architecture
Chen, K., & Salman, A. (2011) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2011.2167240 · Cited by 113
Robustness to telephone handset distortion in speaker recognition by discriminative feature design
Heck, L. P., Konig, Y., Sönmez, K., & Weintraub, M. (2000) · Speech Communication · doi:10.1016/s0167-6393(99)00077-1 · Cited by 88
First Dihard Challenge Evaluation Plan
Ryant, N., Church, K., Cieri, C., Cristià, A., Du, J., Ganapathy, S., & Liberman, M. (2018) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.5281/zenodo.1199633 · Cited by 73
Speaker recognition in a multi-speaker environment
Martín, A. F., & Przybocki, M. A. (2001) · European Conference on Speech Communication and Technology (Eurospeech) · doi:10.21437/eurospeech.2001-246 · Cited by 55
Speaker Diarization based on Bayesian HMM with Eigenvoice Priors
Díez, M., Burget, L., & Matějka, P. (2018) · The Speaker and Language Recognition Workshop (Odyssey) · doi:10.21437/odyssey.2018-21 · Cited by 55
On the use of spectral and iterative methods for speaker diarization
Shum, S. H., Dehak, N., & Glass, J. R. (2012) · Interspeech (USB) · doi:10.21437/interspeech.2012-163 · Cited by 54
The 2016 Speakers in the Wild Speaker Recognition Evaluation
McLaren, M., Ferrer, L., Castán, D., & Lawson, A. (2016) · Interspeech (USB) · doi:10.21437/interspeech.2016-1137 · Cited by 42
Cited by
Desplanques, B., Thienpondt, J., & Demuynck, K. (2020) · Interspeech 2020 · doi:10.21437/interspeech.2020-2650 · Cited by 1,568
Speaker recognition based on deep learning: An overview
Bai, Z., & Zhang, X.-L. (2021) · Neural Networks · doi:10.1016/j.neunet.2021.03.004 · Cited by 386
In Defence of Metric Learning for Speaker Recognition
Chung, J. S., Huh, J., Mun, S., Lee, M., Heo, H.-S., Choe, S., Ham, C., Jung, S., Lee, B.-J., & Han, I. (2020) · Interspeech 2020 · doi:10.21437/interspeech.2020-1064 · Cited by 383
FluentNet: End-to-End Detection of Stuttered Speech Disfluencies With Deep Learning
Kourkounakis, T., Hajavi, A., & Etemad, A. (2021) · IEEE/ACM Transactions on Audio, Speech, and Language Processing · doi:10.1109/taslp.2021.3110146 · Cited by 109
Combining Automatic Speaker Verification and Prosody Analysis for Synthetic Speech Detection
Attorresi, L., Salvi, D., Borrelli, C., Bestagini, P., & Tubaro, S. (2023) · Lecture Notes in Computer Science · doi:10.1007/978-3-031-37742-6_21 · Cited by 30
Metadata
- Authors
- Snyder, D., Garcia-Romero, D., Sell, G., McCree, A., Povey, D., & Khudanpur, S.
- Venue
- ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)
- Publisher
- IEEE
- Published
- 2019-05
- Pages
- 5796-5800
- ISSN
- 1520-6149 (ISSN-L)
- OpenAlex
- W2938358845
- Cited by
- 294
- References
- 25
- FWCI
- 17.53
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.