The DOI matches its Crossref record; 22 of the 22 references it cites were found in a registry or an index.
Speaker Diarization with LSTM
Abstract
For many years, i-vector based audio embedding techniques were the dominant approach for speaker verification and speaker diarization applications. However, mirroring the rise of deep learning in various domains, neural network based audio embeddings, also known asd-vectors, have consistently demonstrated superior speaker verification performance. In this paper, we build on the success of d-vector based speaker verification systems to develop a new d-vector based approach to speaker diarization. Specifically, we combine LSTM-based d-vector audio embeddings with recent work in non-parametric clustering to obtain a state-of-the-art speaker diarization system. Our system is evaluated on three standard public datasets, suggesting that d-vector based diarization systems offer significant advantages over traditional i-vector based systems. We achieved a 12.0% diarization error rate on NIST SRE 2000 CALLHOME, while our model is trained with out-of-domain data from voice search logs.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
A tutorial on spectral clustering
von Luxburg, U. (2007) · Statistics and Computing · doi:10.1007/s11222-007-9033-z · Cited by 10,349
(2007) · doi:10.5555/1283383.1283494 · Cited by 7,364
Long short-term memory recurrent neural network architectures for large scale acoustic modeling
Sak, H., Senior, A., & Beaufays, F. (2014) · Interspeech 2014 · doi:10.21437/interspeech.2014-80 · Cited by 2,973
Coifman, R. R., & Lafon, S. (2006) · Applied and Computational Harmonic Analysis · doi:10.1016/j.acha.2006.04.006 · Cited by 2,342
Deep neural networks for small footprint text-dependent speaker verification
Variani, E., Lei, X., McDermott, E., Moreno, I. L., & Gonzalez-Dominguez, J. (2014) · 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2014.6854363 · Cited by 1,035
Self-citationGeneralized End-to-End Loss for Speaker Verification
Wan, L., Wang, Q., Papir, A., & Moreno, I. L. (2018) · 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2018.8462665 · Cited by 820
Self-citationSmall-footprint keyword spotting using deep neural networks
Chen, G., Parada, C., & Heigold, G. (2014) · 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2014.6854370 · Cited by 545
End-to-end text-dependent speaker verification
Heigold, G., Moreno, I., Bengio, S., & Shazeer, N. (2016) · 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2016.7472652 · Cited by 514
Self-citationSpeaker diarization using deep neural network embeddings
Garcia-Romero, D., Snyder, D., Sell, G., Povey, D., & McCree, A. (2017) · 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2017.7953094 · Cited by 231
Speaker diarization with plda i-vector scoring and unsupervised calibration
Sell, G., & Garcia-Romero, D. (2014) · 2014 IEEE Spoken Language Technology Workshop (SLT) · doi:10.1109/slt.2014.7078610 · Cited by 202
Unsupervised Methods for Speaker Diarization: An Integrated and Iterative Approach
Shum, S. H., Dehak, N., Dehak, R., & Glass, J. R. (2013) · IEEE Transactions on Audio, Speech, and Language Processing · doi:10.1109/tasl.2013.2264673 · Cited by 190
A Study of the Cosine Distance-Based Mean Shift for Telephone Speech Diarization
Senoussaoui, M., Kenny, P., Stafylakis, T., & Dumouchel, P. (2014) · IEEE/ACM Transactions on Audio, Speech, and Language Processing · doi:10.1109/taslp.2013.2285474 · Cited by 172
Attention-Based Models for Text-Dependent Speaker Verification
Rezaur rahman Chowdhury, F. A., Wang, Q., Moreno, I. L., & Wan, L. (2018) · 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2018.8461587 · Cited by 164
Self-citationFeature Learning with Raw-Waveform CLDNNs for Voice Activity Detection
Zazo, R., Sainath, T. N., Simko, G., & Parada, C. (2016) · Interspeech (USB) · doi:10.21437/interspeech.2016-268 · Cited by 112
Prabhavalkar, R., Álvarez, R., Parada, C., et al. (2015) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2015.7178863 · Cited by 97
Locally-connected and convolutional neural networks for small footprint speaker recognition
Chen, Y., Moreno, I. L., Sainath, T. N., Visontai, M., Álvarez, R., & Parada, C. (2015) · Interspeech (USB) · doi:10.21437/interspeech.2015-297 · Cited by 92
Self-citationStream-based speaker segmentation using speaker factors and eigenvoices
Castaldo, F., Colibro, D., Dalmasso, E., et al. (2008) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2008.4518564 · Cited by 87
Bredin, H. (2017) · Interspeech (USB) · doi:10.21437/interspeech.2017-411 · Cited by 85
Developing On-Line Speaker Diarization System
Dimitriadis, D., & Fousek, P. (2017) · Interspeech (USB) · doi:10.21437/interspeech.2017-166 · Cited by 79
Diarization resegmentation in the factor analysis subspace
Sell, G., & Garcia-Romero, D. (2015) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2015.7178881 · Cited by 47
Speaker Diarization Using Convolutional Neural Network for Statistics Accumulation Refinement
Zajíc, Z., Hrúz, M., & Müller, L. (2017) · Interspeech (USB) · doi:10.21437/interspeech.2017-51 · Cited by 25
Cited by
Multimodal intelligence: Representation learning, information fusion, and applications
Zhang, C., Yang, Z., He, X., & Deng, L. (2020) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2020.2987728 · Cited by 511
A review of deep learning techniques for speech processing
Mehrish, A., Majumder, N., Bharadwaj, R., Mihalcea, R., & Poria, S. (2023) · Information Fusion · doi:10.1016/j.inffus.2023.101869 · Cited by 389
Speaker recognition based on deep learning: An overview
Bai, Z., & Zhang, X.-L. (2021) · Neural Networks · doi:10.1016/j.neunet.2021.03.004 · Cited by 386
VoiceFilter: Targeted Voice Separation by Speaker-Conditioned Spectrogram Masking
Wang, Q., Muckenhirn, H., Wilson, K., Sridhar, P., Wu, Z., Hershey, J. R., Saurous, R. A., Weiss, R. J., Jia, Y., & Moreno, I. L. (2019) · Interspeech 2019 · doi:10.21437/interspeech.2019-1101 · Cited by 358
Self-citationA review of speaker diarization: Recent advances with deep learning
Park, T. J., Kanda, N., Dimitriadis, D., Han, K. J., Watanabe, S., & Narayanan, S. (2022) · Computer Speech & Language · doi:10.1016/j.csl.2021.101317 · Cited by 354
Metadata
- Authors
- Wang, Q., Downey, C., Wan, L., Mansfield, P. A., & Moreno, I. L.
- Venue
- 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)
- Publisher
- IEEE
- Published
- 2018-04
- Pages
- 5239-5243
- ISSN
- 1520-6149 (ISSN-L)
- OpenAlex
- W2963470929
- Cited by
- 309
- References
- 22
- FWCI
- 15.08
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.