Attentive Statistics Pooling for Deep Speaker Embedding
Open accessThe DOI matches its Crossref record; 21 of the 21 references it cites were found in a registry or an index.
Abstract
This paper proposes attentive statistics pooling for deep speaker embedding in text-independent speaker verification. In conventional speaker embedding, frame-level features are averaged over all the frames of a single utterance to form an utterance-level feature. Our method utilizes an attention mechanism to give different weights to different frames and generates not only weighted means but also weighted standard deviations. In this way, it can capture long-term variations in speaker characteristics more effectively. An evaluation on the NIST SRE 2012 and the VoxCeleb data sets shows that it reduces equal error rates (EERs) from the conventional method by 7.5% and 8.1%, respectively.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Attentive Statistics Pooling (ASP) [10] was originally used for extracting speaker embeddings and achieved excellent performance in speaker verification tasks [11].”
From Audio Deepfake Detection With Self-Supervised WavLM And Multi-Fusion Attentive Classifier (2024) · cites this paper as [10]
The cited source says what the claim attributes to it.
In the citing paper
“ASP is a pooling method that combines the advantages of both attention and statistic pooling.”
From Audio Deepfake Detection With Self-Supervised WavLM And Multi-Fusion Attentive Classifier (2024) · cites this paper as [10]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Kaldi Speech Recognition Toolkit
Povey, D. (2024) · Infoscience (Ecole Polytechnique Fédérale de Lausanne) · doi:10.57702/jb3fvbn9 · Cited by 4,609
Front-End Factor Analysis for Speaker Verification
Dehak, N., Kenny, P. J., Dehak, R., Dumouchel, P., & Ouellet, P. (2011) · IEEE Transactions on Audio, Speech, and Language Processing · doi:10.1109/tasl.2010.2064307 · Cited by 3,549 · cited 1×
“Speaker recognition has advanced considerably in the last decade with the i-vector paradigm [1], in which a speech utterance or a speaker is represented in the form of a fixed- lowdimensional feature vector.”
BackgroundX-Vectors: Robust DNN Embeddings for Speaker Recognition
Snyder, D., Garcia-Romero, D., Sell, G., Povey, D., & Khudanpur, S. (2018) · 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2018.8461375 · Cited by 2,620 · cited 1×
“The network structure, except for its input dimensions, was exactly the same as the one shown in the recipe 1 published in Kaldi’s official repository [18, 19].”
ResultVoxCeleb: A Large-Scale Speaker Identification Dataset
Nagrani, A., Chung, J. S., & Zisserman, A. (2017) · Interspeech 2017 · doi:10.21437/interspeech.2017-950 · Cited by 2,210 · cited 9×
“, a Time-Delay Neural Network (TDNN) [9], Convolutional Neural Network (CNN) [7, 8], LSTM [10, 11], or Gated Recurrent Unit (GRU) [8].”
BackgroundMethodResultInfluentialProbabilistic Linear Discriminant Analysis for Inferences About Identity
Prince, S. J. D., & Elder, J. H. (2007) · 2007 IEEE 11th International Conference on Computer Vision · doi:10.1109/iccv.2007.4409052 · Cited by 977 · cited 3×
“Mean subtraction, whitening, and length normalization [17] were applied to the i-vector as pre-processing steps before sending it to the PLDA, and similarity was then evaluated using a PLDA model with a speaker space of 400 dimensions.”
MethodAnalysis of i-vector length normalization in speaker recognition systems
Garcia-Romero, D., & Espy-Wilson, C. Y. (2011) · Interspeech 2011 · doi:10.21437/interspeech.2011-53 · Cited by 922 · cited 1×
“Mean subtraction, whitening, and length normalization [17] were applied to the i-vector as pre-processing steps before sending it to the PLDA, and similarity was then evaluated using a PLDA model with a speaker space of 400 dimensions.”
MethodDeep Neural Network Embeddings for Text-Independent Speaker Verification
Snyder, D., Garcia-Romero, D., Povey, D., & Khudanpur, S. (2017) · Interspeech 2017 · doi:10.21437/interspeech.2017-620 · Cited by 739 · cited 7×
“Probabilistic linear discriminant analysis (PLDA) [13, 14] can also be used for measuring the distance between two utterance-level features [9, 10].”
BackgroundMethodInfluentialEnd-to-end text-dependent speaker verification
Heigold, G., Moreno, I., Bengio, S., & Shazeer, N. (2016) · 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2016.7472652 · Cited by 514 · cited 1×
“In fixed-phrase textdependent speaker verification, an end-to-end neural networkbased method has been proposed [6] in which Long Short-Term Memory (LSTM) with a single output from the last frame is used to obtain utterance-level speaker features, and it has outperformed conventional i-vector extraction.”
MethodA novel scheme for speaker recognition using a phonetically-aware deep neural network
Lei, Y., Scheffer, N., Ferrer, L., & McLaren, M. (2014) · 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2014.6853887 · Cited by 496 · cited 1×
“In early studies [2, 3], deep neural networks (DNNs) derived from acoustic models for ASR have been employed as a universal background model (UBM) to provide phoneme posteriors as well as bottleneck features, which are used for, respectively, zeroth- and first-order statistics in i-vector extraction.”
MethodProbabilistic Linear Discriminant Analysis
Ioffe, S. (2006) · Lecture Notes in Computer Science · doi:10.1007/11744085_41 · Cited by 473 · cited 3×
“Mean subtraction, whitening, and length normalization [17] were applied to the i-vector as pre-processing steps before sending it to the PLDA, and similarity was then evaluated using a PLDA model with a speaker space of 400 dimensions.”
Method
Research works printed but not linked: 3
- [7][7] A. Nagrani, J. S. Chung, and A. Zisserman, 'VoxCeleb: A largescale speaker identification dataset,' in Proc. Interspeech , 2017, pp. 2616-2620. -
- [15][15] G. Bhattacharya, J. Alam, T. Stafylakis, and P. Kenny, 'Deep neural network based text-dependent speaker recognition: Preliminary results,' in Proc. Odyssey , 2016, pp. 9-15. -
- [20][20] L. Ferrer, H. Bratt, L. Burget, H. Cernocky, O. Glembek, M. Graciarena, A. Lawson, Y. Lei, P. Matejka, O. Plchot et al. , 'Promoting robustness for speaker modeling in the community: the PRISM evaluation set,' in Proceedings of NIST 2011 workshop , 2011. -
Cited by
Items 501–514 of 514
Beyond Binary: Multi-Class Classification of Audio Deepfakes by TTS and Vocoder Types
Schäfer, K., & Straßburger, T. (2026) · IEEE Annual International Computer Software and Applications Conference (COMPSAC) · doi:10.1109/compsac69091.2026.00355
Raven, T., Hallyburton, T., & Fink, G. A. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-36039-7_3
Optimization of the Embedding Linearity for Speaker Diarization under Overlapping Speech Conditions
Popov, D. N., & Maysuradze, A. I. (2026) · Pattern Recognition and Image Analysis · doi:10.1134/s1054661826700197
Adaptive Temporal Pooling for Environmental Sound Classification
Kim, S., Ju, J., Kim, E., Kim, J. S., & Im, S. (2026) · IEEE International Conference on Information Reuse and Integration (IRI) · doi:10.1109/iri69576.2026.00083
Investigating Transformers-Based Feature Representations for Audio-Visual Speaker Verification
Chowdhury, F. A., & Alam, J. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37870-5_8
Frame-Adaptive Layer Aggregation of Pre-Trained Speech Encoders for Speaker Verification
Kim, J. S., Park, H. J., Shin, W., & Han, S. W. (2026) · IEEE Signal Processing Letters · doi:10.1109/lsp.2026.3735272
ГІБРИДИЗАЦІЯ МЕТОДІВ ВИЛУЧЕННЯ ОЗНАК У СИСТЕМІ ГОЛОСОВОЇ ІДЕНТИФІКАЦІЇ КОРИСТУВАЧА
Bondarenko, M., & Іващенко, Г. С. (2026) · Системи управління навігації та зв’язку Збірник наукових праць · doi:10.26906/sunz.2026.3.068
Stojcheva, M. M., Petkovski, G., & Mishkovski, I. (2026) · Applied Sciences · doi:10.3390/app16199635
Kaphungkui, N. K. (2026) · JOURNAL OF MECHANICS OF CONTINUA AND MATHEMATICAL SCIENCES · doi:10.26782/jmcms.2026.08.00012
Chapariniya, M., Vuillecard, P., Odobez, J., et al. (2026) · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION · doi:10.1145/3776574.3831153
Nurlankyzy, A., Kulakayeva, A., Zhetpisbayeva, А., et al. (2026) · Engineering Technology & Applied Science Research · doi:10.48084/etasr.20511
Semantic-Aware Conformer With Multi-Scale Fusion for Speaker Verification
Chen, C., Li, D., Dong, S., Li, A., Yang, H., & Wang, L. (2026) · IEEE Signal Processing Letters · doi:10.1109/lsp.2026.3740632
SlimFusion: Lightweight Audio–Visual Emotion Recognition for Edge Inference
Nguyen, T. M., Duong, H. Q., Huỳnh, N. T., et al. (2026) · Lecture notes in computer science · doi:10.1007/978-981-92-6510-7_15
Metadata
- Authors
- Okabe, K., Koshinaka, T., & Shinoda, K.
- Affiliations
- NEC (Japan) (JP)
- Tokyo Institute of Technology (JP)
- Venue
- Interspeech 2018
- Publisher
- ISCA
- Published
- 2018-09-02
- Pages
- 2252-2256
- ISSN
- 2308-457X (ISSN-L)
- OpenAlex
- W2794506738
- Semantic Scholar
- 4a64008cd21488071ac418aad32ce7129408edb4
- Cited by
- 514
- References
- 20
- Citations by year
- 2026: 44 · 2025: 47 · 2024: 72 · 2023: 74 · 2022: 90 · 2021: 83 · 2020: 65 · 2019: 37 · 2018: 2
- FWCI
- 19.09
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- Interspeech (USB) (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- Institutional Repositories DataBase (IRDB) (submittedVersion)
- Tokyo Tech Research Repository (Tokyo Institute of Technology) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Speech Recognition and Synthesis
- Physical Sciences › Computer Science › Signal Processing › Speech and Audio Processing
- Physical Sciences › Computer Science › Signal Processing › Biometric Identification and Security
- Keywords
- speaker embedding, text-independent speaker verification, attention mechanism, utterance-level features, frame-level features, VoxCeleb
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.