VoxCeleb: A Large-Scale Speaker Identification Dataset
Open accessThe DOI matches its Crossref record; 10 of the 10 references it cites were found in a registry or an index; none of the 16 sources its claims cite is checked for support yet.
Abstract
Most existing datasets for speaker identification contain samples obtained under quite constrained conditions, and are usually hand-annotated, hence limited in size. The goal of this paper is to generate a large scale text-independent speaker identification dataset collected 'in the wild'. We make two contributions. First, we propose a fully automated pipeline based on computer vision techniques to create the dataset from open-source media. Our pipeline involves obtaining videos from YouTube; performing active speaker verification using a two-stream synchronization Convolutional Neural Network (CNN), and confirming the identity of the speaker using CNN based facial recognition. We use this pipeline to curate VoxCeleb which contains hundreds of thousands of 'real world' utterances for over 1,000 celebrities. Our second contribution is to apply and compare various state of the art speaker identification techniques on our dataset to establish baseline performance. We show that a CNN based architecture obtains the best performance for both identification and verification.
Overview
CoChat Summary
TL;DR
The paper introduces VoxCeleb, a fully automated, large-scale speaker identification dataset built from YouTube videos “in the wild,” with 1,251 celebrities and over 100,000 utterances. It also benchmarks speaker recognition methods and reports that a CNN performs best on both identification and verification.
Key findings
- VoxCeleb contains over 100,000 utterances for 1,251 celebrities; the dataset is gender balanced, with 55% male speakers.
- The automated collection pipeline uses active speaker verification and face verification and was tuned to be highly precise: precision = 1.000 for both stages, with recall = 0.613 for active speaker verification and 0.726 for face verification.
- For speaker identification, the CNN achieves 80.5% top-1 and 92.1% top-5 accuracy, compared with 49.0% / 56.6% for I-vectors + SVM and 60.8% / 75.6% for I-vectors + PLDA + SVM.
- For speaker verification, the best reported result is CNN + Embedding with C min det = 0.71 and EER = 7.8%, better than I-vectors + PLDA (0.73, 8.8%) and GMM-UBM (0.80, 15.0%).
Methods
- Built VoxCeleb from YouTube videos using a fully automated multi-stage pipeline: candidate POI list, video download, face tracking, active speaker verification via SyncNet, and face verification via VGG Face CNN.
- Dataset scale/statistics reported: 1,251 POIs, 690 male POIs, 36 / 18 / 8 videos per POI (max/avg/min), 250 / 123 / 45 utterances per POI (max/avg/min), and 145.0 / 8.2 / 4.0 s utterance length (max/avg/min).
- Trained and evaluated a CNN on spectrograms with minimal preprocessing; identification used a 1,251-way classification setup, while verification compared I-vectors/PLDA, GMM-UBM, and CNN embedding approaches.
Limitations
- The paper states that the pipeline is designed to be conservative, and that this means “a lot of the downloaded videos” are discarded to reduce label errors.
- The paper notes that the collection starts from a list of 2,622 identities from VGG Face and uses YouTube search with “interview” appended, which is an evident source of selection bias toward publicly available, interview-like media.
- The dataset is described as coming from open-source media / YouTube, so it is limited to speakers and contexts available there; this is evident from the text, though not stated as a formal limitation.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
0 Valid · 1 Not valid · 12 Not checked · 37 Own results and interpretations
In the paper
“| Face verification | [30] | 1.000 | 0.726 |”
What the sources say
- Not checked yetcites [30] [30] O. M. Parkhi, A. Vedaldi, and A. Zisserman, 'Deep face recognition,' in Proceedings of the British Machine Vision Conference , 2015. -
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper states — it cites no source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Unlike the SITW dataset, both audio and video for each speaker is released.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
In the paper
“| Active speaker verification | [31] | 1.000 | 0.613 |”
What the sources say
- Not checked yetcites [31] [31] P. Chakravarty and T. Tuytelaars, 'Cross-modal supervision for learning active speaker detection in video,' arXiv preprint arXiv:1603.08907 , 2016. -
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper states — it cites no source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“reduces the number of parameters from 319M in VGG-M to 67M in our network”
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“| # of videos per POI | 36 / 18 / 8 |”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
15 more claims
Create a free account to see all 50 claims and to verify the 16 references still open.
- Probably not a substantial claim. 9
- It may state two separate claims as one. 23
- The quote only partly states this claim. 5
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Meanwhile, the emergence of large-scale VSA datasets [28, 29, 30, 31, 32] promoted the further development of deep learning based VSA research.”
From Deep learning for visual speech analysis: A survey (2024) · cites this paper as [31]
In the citing paper
“Although it is mainly built for speaker identification, it also can be used for VSG.”
From Deep learning for visual speech analysis: A survey (2024) · cites this paper as [31]
In the citing paper
“It contains over 100k utterances from 1,251 celebrities.”
From Deep learning for visual speech analysis: A survey (2024) · cites this paper as [31]
In the citing paper
“VoxCeleb1 [31] is a large-scale text-independent audio-visual dataset collected from open-source YouTube media.”
From Deep learning for visual speech analysis: A survey (2024) · cites this paper as [31]
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S., & Szegedy, C. (2015) · arXiv · doi:10.48550/arxiv.1502.03167 · Cited by 27,818 · cited 1×
“The network is trained using batch normalisation [40] and all hyper-parameters (e.”
MethodBatch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S. (2024) · arXiv (Cornell University) · doi:10.57702/o9raffed · Cited by 14,214
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2015) · arXiv · doi:10.48550/arxiv.1512.03385 · Cited by 4,196
One millisecond face alignment with an ensemble of regression trees
Kazemi, V., & Sullivan, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.241 · Cited by 2,831 · cited 1×
“Facial landmark positions are detected for each face detection using the regression tree based method of [33].”
MethodCNN architectures for large-scale audio classification
Hershey, S., Chaudhuri, S., Ellis, D. P. W., Gemmeke, J. F., Jansen, A., Moore, R. C., Plakal, M., Platt, D., Saurous, R. A., Seybold, B., et al. (2017) · 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2017.7952132 · Cited by 2,023
MatConvNet - Convolutional Neural Networks for MATLAB
Vedaldi, A., & Lenc, K. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1412.4564 · Cited by 578 · cited 1×
“Our implementation is based on the deep learning toolbox MatConvNet [39] and trained on a NVIDIA TITAN X GPU.”
MethodCNN Architectures for Large-Scale Audio ClassificationPreprint
Hershey, S., Chaudhuri, S., Ellis, D. P. W., Gemmeke, J. F., Jansen, A., Moore, R. C., Plakal, M., Platt, D., Saurous, R. A., Seybold, B., et al. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1609.09430 · Cited by 217 · cited 1×
“This has led to a very recent shift from hand-crafted features to the domain of deep CNNs which can be applied to higher dimensional inputs [13, 14] and for speaker iden-tification [15].”
BackgroundCross-Modal Supervision for Learning Active Speaker Detection in Video
Chakravarty, P., & Tuytelaars, T. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-46454-1_18 · Cited by 70 · cited 2×
“Precision-recall curves for both tasks on their respective benchmark datasets [30, 31] are shown in Figure 1 right, and the values at the operating point are given in Table 3.”
BackgroundCross-modal Supervision for Learning Active Speaker Detection in VideoPreprint
Chakravarty, P., & Tuytelaars, T. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1603.08907 · Cited by 1 · cited 2×
“Precision-recall curves for both tasks on their respective benchmark datasets [30, 31] are shown in Figure 1 right, and the values at the operating point are given in Table 3.”
Background
Research works printed but not linked: 28
- [2][2] A. Krizhevsky, I. Sutskever, and G. E. Hinton, 'ImageNet classification with deep convolutional neural networks,' in Advances in Neural Information Processing Systems , pp. 1106-1114, 2012. -
- [5][5] M. McLaren, L. Ferrer, D. Castan, and A. Lawson, 'The speakers in the wild (SITW) speaker recognition database,' INTERSPEECH , vol. 2016, 2016. -
- [6][6] O. Russakovsky, J. Deng, H. Su, J. Krause, S. Satheesh, S. Ma, S. Huang, A. Karpathy, A. Khosla, M. Bernstein, A. Berg, and F. Li, 'Imagenet large scale visual recognition challenge,' International Journal of Computer Vision , 2015. -
- [7][7] D. A. Reynolds, T. F. Quatieri, and R. B. Dunn, 'Speaker verification using adapted gaussian mixture models,' Digital signal processing , vol. 10, no. 1-3, pp. 19-41, 2000. -
- [8][8] D. A. Reynolds and R. C. Rose, 'Robust text-independent speaker identification using gaussian mixture speaker models,' IEEE transactions on speech and audio processing , vol. 3, no. 1, pp. 7283, 1995. -
- [10][10] N. Dehak, P. J. Kenny, R. Dehak, P. Dumouchel, and P. Ouellet, 'Front-end factor analysis for speaker verification,' IEEE Transactions on Audio, Speech, and Language Processing , vol. 19, no. 4, pp. 788-798, 2011. -
- [11][11] U. H. Yapanel, X. Zhang, and J. H. Hansen, 'High performance digit recognition in real car environments.,' in INTERSPEECH , 2002. -
- [12][12] J. H. Hansen, R. Sarikaya, U. H. Yapanel, and B. L. Pellom, 'Robust speech recognition in noise: an evaluation using the spine corpus.,' in INTERSPEECH , pp. 905-908, 2001. -
- [13][13] T. N. Sainath, R. J. Weiss, A. W. Senior, K. W. Wilson, and O. Vinyals, 'Learning the speech front-end with raw waveform CLDNNs,' in INTERSPEECH , pp. 1-5, 2015. -
- [15][15] Y. Lukic, C. Vogt, O. D¨ urr, and T. Stadelmann, 'Speaker identification and clustering using convolutional neural networks,' in IEEE 26th International Workshop on Machine Learning for Signal Processing (MLSP) , pp. 1-6, IEEE, 2016. -
- [16][16] D. van der Vloed, J. Bouten, and D. A. van Leeuwen, 'NFIFRITS: a forensic speaker recognition database and some first experiments,' in The Speaker and Language Recognition Workshop , 2014. -
- [17][17] J. Hennebert, H. Melin, D. Petrovska, and D. Genoud, 'POLYCOST: a telephone-speech database for speaker recognition,' Speech communication , vol. 31, no. 2, pp. 265-270, 2000. -
- [18][18] J. B. Millar, J. P. Vonwiller, J. M. Harrington, and P. J. Dermody, 'The Australian national database of spoken language,' in Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing , vol. 1, pp. I-97, IEEE, 1994. -
- [19][19] J. S. Garofolo, L. F. Lamel, W. M. Fisher, J. G. Fiscus, and D. S. Pallett, 'DARPA TIMIT acoustic-phonetic continous speech corpus CD-ROM. NIST speech disc 1-1.1,' NASA STI/Recon technical report , vol. 93, 1993. -
- [21][21] R. Woo, A. Park, and T. J. Hazen, 'The MIT Mobile Device Speaker Verification Corpus: Data collection and preliminary experiments,' The Speaker and Language Recognition Workshop , 2006. -
- [23][23] A. Janin, D. Baron, J. Edwards, D. Ellis, D. Gelbart, N. Morgan, B. Peskin, T. Pfau, E. Shriberg, A. Stolcke, et al. , 'The ICSI meeting corpus,' in Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing , vol. 1, IEEE, 2003. -
- [24][24] I. McCowan, J. Carletta, W. Kraaij, S. Ashby, S. Bourban, M. Flynn, M. Guillemot, T. Hain, J. Kadlec, V. Karaiskos, et al. , 'The AMI meeting corpus,' in International Conference on Methods and Techniques in Behavioral Research , vol. 88, 2005. -
- [25][25] P. Bell, M. J. Gales, T. Hain, J. Kilgour, P. Lanchantin, X. Liu, A. McParland, S. Renals, O. Saz, M. Wester, et al. , 'The MGB challenge: Evaluating multi-genre broadcast media recognition,' in IEEE Workshop on Automatic Speech Recognition and Understanding , pp. 687-693, IEEE, 2015. -
- [27][27] J. J. Godfrey, E. C. Holliman, and J. McDaniel, 'Switchboard: Telephone speech corpus for research and development,' in Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing , vol. 1, pp. 517-520, IEEE, 1992. -
- [28][28] W. M. Fisher, G. R. Doddington, and K. M. Goudie-Marshall, 'The DARPA speech recognition research database: specifications and status,' in Proc. DARPA Workshop on speech recognition , pp. 93-99, 1986. -
- [30][30] O. M. Parkhi, A. Vedaldi, and A. Zisserman, 'Deep face recognition,' in Proceedings of the British Machine Vision Conference , 2015. -
- [32][32] D. E. King, 'Dlib-ml: A machine learning toolkit,' The Journal of Machine Learning Research , vol. 10, pp. 1755-1758, 2009. -
- [34][34] J. S. Chung and A. Zisserman, 'Lip reading in the wild,' in Proceedings of the Asian Conference on Computer Vision , 2016. -
- [35][35] M. Everingham, J. Sivic, and A. Zisserman, 'Taking the bite out of automatic naming of characters in TV video,' Image and Vision Computing , vol. 27, no. 5, 2009. -
- [36][36] J. S. Chung and A. Zisserman, 'Out of time: automated lip sync in the wild,' in Workshop on Multi-view Lip-reading, ACCV , 2016. -
- [37][37] K. Chatfield, K. Simonyan, A. Vedaldi, and A. Zisserman, 'Return of the devil in the details: Delving deep into convolutional nets,' in Proceedings of the British Machine Vision Conference , 2014. -
- [38][38] S. Chopra, R. Hadsell, and Y. LeCun, 'Learning a similarity metric discriminatively, with application to face verification,' in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition , vol. 1, pp. 539-546, IEEE, 2005. -
- [41][41] S. Ioffe, 'Probabilistic linear discriminant analysis,' in Proceedings of the European Conference on Computer Vision , pp. 531542, Springer, 2006.
Cited by
Items 101–200 of 1,008
Deepfake Generation and Detection: A Benchmark and Survey
Pei, G., Zhang, J., Hu, M., Zhang, Z., Wang, C., Wu, Y., Zhai, G., Yang, J. J., & Tao, D. (2026) · ACM Computing Surveys · doi:10.1145/3801962 · Cited by 208
Interpretable Convolutional Filters with SincNetPreprint
Ravanelli, M., & Bengio, Y. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1811.09725 · Cited by 161
“Most prior attempts exploit magnitude spectrogram features [22, 23, 24, 46, 47, 48].”
BackgroundJung, J.-W., Kim, S.-B., Shim, H.-J., Kim, J.-H., & Yu, H.-J. (2020) · Interspeech 2020 · doi:10.21437/interspeech.2020-1011 · Cited by 109
FluentNet: End-to-End Detection of Stuttered Speech Disfluencies With Deep Learning
Kourkounakis, T., Hajavi, A., & Etemad, A. (2021) · IEEE/ACM Transactions on Audio, Speech, and Language Processing · doi:10.1109/taslp.2021.3110146 · Cited by 109
Tandem Assessment of Spoofing Countermeasures and Automatic Speaker Verification: Fundamentals
Kinnunen, T., Delgado, H., Evans, N., Lee, K. A., Vestman, V., Nautsch, A., Todisco, M., Wang, X., Sahidullah, M., Yamagishi, J., et al. (2020) · IEEE/ACM Transactions on Audio, Speech, and Language Processing · doi:10.1109/taslp.2020.3009494 · Cited by 108
Introducing the VoicePrivacy Initiative
Tomashenko, N., Srivastava, B. M. L., Wang, X., Vincent, E., Nautsch, A., Yamagishi, J., Evans, N., Patiño, J. F., Bonastre, J.-F., Noé, .-G., et al. (2020) · Interspeech (USB) · doi:10.21437/interspeech.2020-1333 · Cited by 180
“The training set comprises the 2,800 h VoxCeleb-1,2 speaker verification corpus [24,25] and 600 h subsets of the LibriSpeech [26] and LibriTTS [27] corpora, which were initially designed for ASR and speech synthesis, respectively.”
MethodDeepfakes generation and detection: a short survey
Akhtar, Z. (2023) · Journal of Imaging · doi:10.3390/jimaging9010018 · Cited by 106
Classifying Alzheimer's Disease Using Audio and Text-Based Representations of Speech
Haulcy, R., & Glass, J. R. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2020.624137 · Cited by 130
“Audio Features: I-Vectors and X-Vectors VoxCeleb 1 and 2 (Nagrani et al., 2017) are datasets consisting of speech that was extracted from YouTube videos of interviews with celebrities.”
BackgroundZhao, Z., Li, Q., Zhang, Z., Cummins, N., Wang, H., Tao, J., & W. Schuller, B. (2021) · Neural Networks · doi:10.1016/j.neunet.2021.03.013 · Cited by 105
“…successfully applied to automatic speech recognition (ASR) (Abdel-Hamid, Mohamed, Jiang, Deng, Penn, & Yu, 2014) and speaker identification tasks (Nagrani, Chung, & Zisserman, 2017), CNNs have also achieved promising results compared with conventional approaches when applied to SER (Poria,…”
ECAPA-TDNN Embeddings for Speaker Diarization
Dawalatabad, N., Ravanelli, M., Grondin, F., Thienpondt, J., Desplanques, B., & Na, H. (2021) · Interspeech (USB) · doi:10.21437/interspeech.2021-941 · Cited by 169
“The ECAPA-TDNN model is trained with VoxCeleb1 and VoxCeleb2 data [24, 25].”
MethodThe VoicePrivacy 2020 Challenge: Results and findings
Tomashenko, N., Wang, X., Vincent, E., Patino, J., Srivastava, B. M. L., Noé, .-G., Nautsch, A., Evans, N., Yamagishi, J., O’Brien, B., et al. (2022) · Computer Speech & Language · doi:10.1016/j.csl.2022.101362 · Cited by 192
Fine-Tuning Wav2Vec2 for Speaker Recognition
Vaessen, N., & van Leeuwen, D. A. (2022) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp43922.2022.9746952 · Cited by 149
“All experiments are conducted on the VoxCeleb datasets [20, 21], which consist of interviews of celebrities extracted from YouTube.”
MethodSpeech-Driven Facial Animation Using Cascaded GANs for Learning of Motion and Texture
Das, D., Biswas, S., Sinha, S., & Bhowmick, B. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58577-8_25 · Cited by 141
“We use TCD-TIMIT[16], GRID [9], and Voxceleb [24] datasets for our experiments.”
MethodInfluentialPushing the limits of raw waveform speaker recognition
Jung, J.-W., Kim, Y., Heo, H.-S., Lee, B., Kwon, Y., & Chung, J. S. (2022) · Interspeech (USB) · doi:10.21437/interspeech.2022-126 · Cited by 162
Self-citationASVspoof 5: crowdsourced speech data, deepfakes, and adversarial attacks at scale
Wang, X., Delgado, H., Tak, H., Jung, J.-W., Shim, H.-J., Todisco, M., Kukanov, I., Liu, X., Sahidullah, M., Kinnunen, T. H., et al. (2024) · The Automatic Speaker Verification Spoofing Countermeasures Workshop (ASVspoof 2024) · doi:10.21437/asvspoof.2024-1 · Cited by 101
AI-Generated Content (AIGC) for Various Data Modalities: A Survey
Foo, L. G., Rahmani, H., & Liu, J. (2025) · ACM Computing Surveys · doi:10.1145/3728633 · Cited by 138
A Robust Approach to Multimodal Deepfake Detection
Salvi, D., Liu, H., Mandelli, S., Bestagini, P., Zhou, W., Zhang, W., & Tubaro, S. (2023) · Journal of Imaging · doi:10.3390/jimaging9060122 · Cited by 96
“In particular, FV was trained on FaceForensics++, while FA was trained on Voxceleb [57] and Voxceleb2 [50] datasets, considering audio data sampled at 16 kHz.”
AudioCaps: Generating Captions for Audios in The Wild
Kim, C. D., Kim, B., Lee, H., & Kim, G. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1011 · Cited by 96
“The task of localizing the sound source within the visual input have been actively explored (Nagrani et al., 2017; Chung et al., 2018; Senocak et al., 2018; Afouras et al., 2018; Gao et al., 2018; Arand-jelovic and Zisserman, 2018; Zhao et al., 2018), along with blind source separation aided by…”
BackgroundIsik, U., Giri, R., Phansalkar, N., Valin, J.-M., Helwani, K., & Krishnaswamy, A. (2020) · Interspeech (USB) · doi:10.21437/interspeech.2020-3027 · Cited by 94
Deep CNNs With Self-Attention for Speaker Identification
An, N. N., Thanh, N. Q., & Liu, Y. (2019) · IEEE Access · doi:10.1109/access.2019.2917470 · Cited by 101
“We use the VoxCeleb database to evaluate the effectiveness of the proposed system [5], which is a large-scale FIGURE 5.”
BackgroundMethodInfluentialFu, Y., Cheng, L., Lv, S., Jv, Y., Kong, Y., Chen, Z., Hu, Y., Xie, L., Wu, J., Bu, H., et al. (2021) · Interspeech (USB) · doi:10.21437/interspeech.2021-1397 · Cited by 134
Multimodal Emotion Recognition with High-Level Speech and Text Features
Makiuchi, M. R., Uto, K., & Shinoda, K. (2021) · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru51503.2021.9688036 · Cited by 116
Learning Speaker Representations with Mutual Information
Ravanelli, M., & Bengio, Y. (2019) · Interspeech (USB) · doi:10.21437/interspeech.2019-2380 · Cited by 97
Personal VAD: Speaker-Conditioned Voice Activity Detection
Ding, S., Wang, Q., Chang, S.-Y., Wan, L., & Moreno, I. L. (2020) · The Speaker and Language Recognition Workshop (Odyssey) · doi:10.21437/odyssey.2020-62 · Cited by 122
VFHQ: A High-Quality Dataset and Benchmark for Video Face Super-Resolution
Xie, L., Wang, X., Zhang, H., Dong, C., & Shan, Y. (2022) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw56347.2022.00081 · Cited by 210
“In contrast to the abundant face image datasets, the most commonly used datasets in VFSR are VoxCeleb1 [35] and VoxCeleb2 [7].”
BackgroundMethodResultInfluentialEmotional Speech-Driven Animation with Content-Emotion Disentanglement
Daněček, R., Chhatre, K., Tripathi, S., Wen, Y., Black, M. J., & Bolkart, T. (2023) · SIGGRAPH Asia Conference Papers · doi:10.1145/3610548.3618183 · Cited by 160
ICface: Interpretable and Controllable Face Reenactment Using GANs
Tripathy, S., Kannala, J., & Rahtu, E. (2020) · 2020 IEEE Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv45572.2020.9093474 · Cited by 88
A Good Image Generator Is What You Need for High-Resolution Video Synthesis
Tian, Y., Ren, J., Chai, M., Olszewski, K., Peng, X., Metaxas, D. N., & Tulyakov, S. (2021) · arXiv · doi:10.48550/arxiv.2104.15069 · Cited by 88
“As our image generator is pre-trained, we may use an image generator that is trained on a given domain, e.g. images of animal faces (Choi et al., 2020), and learn the motion generator parameters using videos from a different domain, such as videos of human facial expressions (Nagrani et al., 2017).”
MethodOn Learning Associations of Faces and Voices
Kim, C., Shin, H. V., Oh, T.-H., Kaspar, A., Elgharib, M. A., & Matusik, W. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-20873-8_18 · Cited by 99
Any-to-Many Voice Conversion With Location-Relative Sequence-to-Sequence Modeling
Liu, S., Cao, Y., Wang, D., Wu, X., Liu, X., & Meng, H. M. L. (2021) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2021.3076867 · Cited by 145
“For any-to-any voice conversion, we use LibriSpeech (trainother-500), VoxCeleb1 [41] and VoxCeleb2 [42] datasets to train the speaker encoder introduced in Section III-C and Seciton IVD.”
MethodWav2Pix: Speech-conditioned Face Generation Using Generative Adversarial Networks
Duarte, A., Roldan, F., Tubau, M., Escur, J., Pascual, S., Salvador, A., Mohedano, E., McGuinness, K., Torres, J., & Giró-i-Nieto, X. (2019) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2019.8682970 · Cited by 100
Shon, S., Tang, H., & Glass, J. R. (2018) · IEEE Spoken Language Technology Workshop (SLT) · doi:10.1109/slt.2018.8639622 · Cited by 91
Self-Attention Encoding and Pooling for Speaker Recognition
Safari, P., India, M., & Hernando, J. (2020) · Interspeech (USB) · doi:10.21437/interspeech.2020-1446 · Cited by 96
Raj, D., Denisov, P., Chen, Z., Erdoğan, H., Huang, Z., He, M., Watanabe, S., Du, J., Yoshioka, T., Luo, Y., et al. (2021) · IEEE Spoken Language Technology Workshop (SLT) · doi:10.1109/slt48900.2021.9383556 · Cited by 90
“The speech segments were divided into subsegments with a window size of 1.5s and a stride of 0.75s, and 128-dimensional embeddings were extracted using an x-vector extractor [25] trained on VoxCeleb data [26] with simulated room impulse response [27].”
A Near Real-Time Automatic Speaker Recognition Architecture for Voice-Based User Interface
Dhakal, P., Damacharla, P., Javaid, A. Y., & Devabhaktuni, V. (2019) · Machine Learning and Knowledge Extraction · doi:10.3390/make1010031 · Cited by 106
“This work primarily leverages the protocol proposed by authors of Voxceleb database [20].”
BackgroundMethodDilated Residual Network with Multi-head Self-attention for Speech Emotion Recognition
Li, R., Wu, Z., Jia, J., Zhao, S., & Meng, H. (2019) · ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2019.8682154 · Cited by 82
“Same as the successful employment in automatic speech recognition (ASR) [8] and speaker identification [9], the using of CNNs has also achieved significant improvement on SER task comparing to conventional approaches [4, 10, 11].”
MethodVoiceID Loss: Speech Enhancement for Speaker Verification
Shon, S., Tang, H., & Glass, J. R. (2019) · Interspeech (USB) · doi:10.21437/interspeech.2019-1496 · Cited by 88
Black-box Adversarial Attacks on Commercial Speech Platforms with Minimal Information
Zheng, B., Jiang, P., Wang, Q., Li, Q. L., Shen, C. Q., Wang, C., Ge, Y., Teng, Q., & Zhang, S. (2021) · ACM SIGSAC Conference on Computer and Communications Security (CCS) · doi:10.1145/3460120.3485383 · Cited by 103
“For Microsoft SI and Jingdong SV, we choose ten people from Voxceleb dataset [64] and enroll four utterances for each person.”
BackgroundMethodVoice Recognition and Voice Comparison using Machine Learning Techniques: A Survey
Tandel, N. H., Prajapati, H. B., & Dabhi, V. K. (2020) · International Conference on Advanced Computing and Communication Systems (ICACCS) · doi:10.1109/icaccs48705.2020.9074184 · Cited by 80
“(2017) [41] Voxceleb 1251 Spectrogram CNN NA SI AC: 80.”
BackgroundMeta-Learning for Short Utterance Speaker Recognition with Imbalance Length Pairs
Kye, S. M., Jung, Y., Lee, H., Hwang, S. J., & Kim, H. (2020) · Interspeech (USB) · doi:10.21437/interspeech.2020-1283 · Cited by 84
Gender and Age Estimation Methods Based on Speech Using Deep Neural Networks
Kwaśny, D., & Hemmerling, D. (2021) · Sensors · doi:10.3390/s21144785 · Cited by 87
“VoxCeleb1 [25] is a large-scale audio-visual dataset published in 2017.”
BackgroundInfluentialUTD-CRSS Systems for 2018 NIST Speaker Recognition Evaluation
Zhang, C., Bahmaninezhad, F., Ranjan, S., Dubey, H., Xia, W., & Hansen, J. H. L. (2019) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2019.8683097 · Cited by 79
Adversarial Attacks on GMM I-Vector Based Speaker Verification Systems
Li, X., Zhong, J., Wu, X., Yu, J., Liu, X., & Meng, H. M. L. (2020) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp40776.2020.9053076 · Cited by 100
“The dataset used in this experiment is Voxceleb1 [28], which consists of short clips of human speech.”
BackgroundMethodLiu, T., Das, R. K., Lee, K. A., & Li, H. (2022) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp43922.2022.9747021 · Cited by 104
A Deep Neural Network for Short-Segment Speaker Recognition
Hajavi, A., & Etemad, A. (2019) · Interspeech (USB) · doi:10.21437/interspeech.2019-2240 · Cited by 77
Advances in Online Audio-Visual Meeting Transcription
Yoshioka, T., Abramovski, I., Aksoylar, C., Chen, Z., David, M., Dimitriadis, D., Gong, Y., Gurvich, I., Huang, X., Huang, Y., et al. (2019) · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru46091.2019.9003827 · Cited by 79
“VoxCeleb corpus [48, 49] is used for training.”
Biometrics in the Era of COVID-19: Challenges and Opportunities
Gomez‐Barrero, M., Drozdowski, P., Rathgeb, C., Patino, J., Todisco, M., Nautsch, A., Damer, N., Priesnitz, J., Evans, N., & Busch, C. (2022) · IEEE Transactions on Technology and Society · doi:10.1109/tts.2022.3203571 · Cited by 92
“Progress in voice recognition has been rapid in recent years [64], [65], [66], [67], [68].”
BackgroundEmoNet: A Transfer Learning Framework for Multi-Corpus Speech Emotion Recognition
Gerczuk, M., Amiriparian, S., Ottl, S., & Schuller, B. W. (2021) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2021.3135152 · Cited by 104
“large scale speaker recognition dataset VoxCeleb [93] within EMONET and to experiment with the degree of influence each EMOSET corpus has on the shared model weights during training.”
X-Vectors: New Quantitative Biomarkers for Early Parkinson's Disease Detection From Speech
Jeancolas, L., Petrovska‐Delacrétaz, D., Mangone, G., Benkelfat, B.-E., Corvol, J., Vidailhet, M., Lehéricy, S., & Benali, H. (2021) · Frontiers in Neuroinformatics · doi:10.3389/fninf.2021.578369 · Cited by 94
“For the analysis of our high-quality microphone recordings, we used the voxceleb model, trained on the voxceleb database (Nagrani et al., 2017).”
MethodShang, L., Zhang, Z. M., Tang, F., Cao, Q., Pan, H. X., & Lin, Z. (2023) · Sensors · doi:10.3390/s23167059 · Cited by 77
Recent Advances in Speech Language Models: A Survey
Cui, W., Yu, D., Jiao, X., Meng, Z., Zhang, G., Wang, Q., Guo, S. Y., & King, I. (2025) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2025.acl-long.682 · Cited by 220
An Open-Source Speaker Gender Detection Framework for Monitoring Gender Equality
Doukhan, D., Carrive, J., Vallet, F., Larcher, A., & Meignier, S. (2018) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2018.8461471 · Cited by 76
“(see [14] for a recent review of speaker databases).”
BackgroundKhan, A., Malik, K. M., Ryan, J., & Saravanan, M. (2023) · Artificial Intelligence Review · doi:10.1007/s10462-023-10539-8 · Cited by 115
StyleSync: High-Fidelity Generalized and Personalized Lip Sync in Style-Based Generator
Guan, J., Zhang, Z., Zhou, H., Hu, T., Wang, K., He, D., Feng, H., Liu, J., Ding, E., Liu, Z., et al. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00151 · Cited by 148
Adversarial attack and defense strategies for deep speaker recognition systems
Jati, A., Hsu, C.-C., Pal, M., Peri, R., AbdAlmageed, W., & Narayanan, S. (2021) · Computer Speech & Language · doi:10.1016/j.csl.2021.101199 · Cited by 88
Kanda, N., Gaur, Y., Wang, X., Meng, Z., Chen, Z., Zhou, T., & Yoshioka, T. (2020) · Interspeech (USB) · doi:10.21437/interspeech.2020-1085 · Cited by 108
Basak, S., Agrawal, H., Jena, S., Gite, S., Bachute, M. R., Pradhan, B., & Assiri, M. E. (2022) · Computer Modeling in Engineering & Sciences · doi:10.32604/cmes.2022.021755 · Cited by 98
Speaker Normalization for Self-Supervised Speech Emotion Recognition
Gat, I., Aronowitz, H., Zhu, W., Morais, E. D. S., & Hoory, R. (2022) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp43922.2022.9747460 · Cited by 86
VoxSRC 2020: The Second VoxCeleb Speaker Recognition ChallengePreprint
Nagrani, A., Chung, J. S., Huh, J., Brown, A., Coto, E., Xie, W., McLaren, M., Reynolds, D. A., & Zisserman, A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2012.06867 · Cited by 95
“The VoxCeleb datasets [9–11] consist of speech segments from unconstrained YouTube videos for several thousand individuals, and were created using an automatic pipeline.”
MethodSelf-citationBYOL for Audio: Exploring Pre-Trained General-Purpose Audio Representations
Niizumi, D., Takeuchi, D., Ohishi, Y., Harada, N., & Kashino, K. (2022) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2022.3221007 · Cited by 120
“VoxCeleb1 [27] (VC1): a speaker identification task con-”
BackgroundSelfME: Self-Supervised Motion Learning for Micro-Expression Recognition
Fan, X., Chen, X., Jiang, M., Shahid, A. R., & Yan, H. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01329 · Cited by 90
Deep Learning Methods in Speaker Recognition: A Review
Sztahó, D., Szaszák, G., & Beke, A. (2021) · Periodica Polytechnica Electrical Engineering and Computer Science · doi:10.3311/ppee.17024 · Cited by 81
“Convolutional networks (namely VGG (Simonyan and Zisserman, 2014; Yadav and Rai, 2018)) (Nagrani et al., 2017) and ResNets (He et al., 2015; Chung et al., 2018) can be trained by this way to perform speaker verification tasks.”
BackgroundMethodInfluentialAlcázar, J. L., Caba, F., Mai, L., Perazzi, F., Lee, J., Arbeláez, P., & Ghanem, B. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.01248 · Cited by 88
“active-speakers-context Recently, rich alignment between audio and visual information has been re-explored with methods that leverage audio as supervision [3], or jointly train an audiovisual embedding [7, 9, 26], that enables more accurate active speaker detection.”
BackgroundDeep learning for visual speech analysis: A survey
Sheng, C., Kuang, G., Bai, L., Hou, C., Guo, Y., Xu, X., Pietikäinen, M., & Liu, L. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3376710 · Cited by 64
“VoxCeleb1 [30] is a large-scale text-independent audio-visual dataset collected from open-source YouTube media.”
BackgroundSpeaker Diarization with Region Proposal Network
Huang, Z., Watanabe, S., Fujita, Y., Garcia, L. P., Shao, Y., Povey, D., & Khudanpur, S. P. (2020) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp40776.2020.9053760 · Cited by 65
“Typical speaker embeddings include i-vector [9–12] and deep speaker embeddings [5, 13–22].”
BackgroundFilteraugment: An Acoustic Environmental Data Augmentation Method
Nam, H., Kim, S.-H., & Park, Y. (2022) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp43922.2022.9747680 · Cited by 97
Audio-Visual Deep Neural Network for Robust Person Verification
Qian, Y., Chen, Z., & Wang, S. (2021) · IEEE/ACM Transactions on Audio, Speech, and Language Processing · doi:10.1109/taslp.2021.3057230 · Cited by 63
“In our experiments, we use both audio and visual data from VoxCeleb 1 & 2 datasets [50], [51].”
MethodThienpondt, J., Desplanques, B., & Demuynck, K. (2021) · Interspeech (USB) · doi:10.21437/interspeech.2021-1570 · Cited by 102
HI-MIA: A Far-Field Text-Dependent Speaker Verification Database and the Baselines
Qin, X., Bu, H., & Li, M. (2020) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp40776.2020.9054423 · Cited by 64
“AISHELL2[1], Librispeech[2], Voxceleb1&2 [3, 4] ) are recorded in a close-talking environment without noise.”
BackgroundFrequency and Temporal Convolutional Attention for Text-Independent Speaker Recognition
Yadav, S., & Rai, A. (2020) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp40776.2020.9054440 · Cited by 62
“8 Nagrani et al.[2] VGG-M 1024 TAP VoxCeleb1 10.”
BackgroundMethodInfluentialAdversarial-Metric Learning for Audio-Visual Cross-Modal Matching
Zheng, A., Hu, M., Jiang, B., Huang, Y., Yan, Y., & Luo, B. (2021) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2021.3050089 · Cited by 74
“• Comprehensive experiments on three audio-visual learning tasks, including matching, verification and retrieval yield to a new state-of-the-art comparing to prevalent methods on the benchmark dataset constructed from the overlap of VoxCeleb [25] and VGGFace [26].”
BackgroundMethodInfluentialMeta-TTS: Meta-Learning for Few-Shot Speaker Adaptive Text-to-Speech
Huang, S.-F., Lin, C.-J., Liu, D.-R., Chen, Y.-C., & Lee, H.-Y. (2022) · IEEE/ACM Transactions on Audio, Speech, and Language Processing · doi:10.1109/taslp.2022.3167258 · Cited by 59
“The model was trained on a combination of subsets of the three datasets: Librispeech train-other-500 [24], VoxCeleb1 Dev A-D [25], and VoxCeleb2 Dev A-H [26], which is 3201 hours of utterances in total from 8371 speakers3.”
MethodHu, J., Huang, Y., Hu, X., & Xu, Y. (2022) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2022.3205919 · Cited by 75
“The other type, such as Voxceleb, collected the emotional utterances from subjects in natural situations [43], [44].”
BackgroundMethodA systematic literature review on deepfake detection techniques
Sharma, V. K., Garg, R. K., & Caudron, Q. (2024) · Multimedia Tools and Applications · doi:10.1007/s11042-024-19906-1 · Cited by 86
“• VoxCeleb1 [77]: This dataset contains 100,000 utterances from 1,251 celebrities which were extracted from YouTube videos.”
Thienpondt, J., Desplanques, B., & Demuynck, K. (2021) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp39728.2021.9414600 · Cited by 114
“Applying both techniques on an ECAPA-TDNN model resulted in state-of-the-art performance on all VoxCeleb1 test sets.”
MethodSelf-Supervised Speaker Recognition with Loss-Gated Learning
Tao, R., Lee, K. A., Das, R. K., Hautamäki, V., & Li, H. (2022) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp43922.2022.9747162 · Cited by 75
“Original, Extended and Hard VoxCeleb1 test sets (Vox O, Vox E and Vox H) [29, 30] are used for evaluation.”
MethodSimple Attention Module Based Speaker Verification with Iterative Noisy Label Detection
Qin, X., Li, N., Weng, C., Su, D., & Li, M. (2022) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp43922.2022.9746294 · Cited by 91
WEIRD FAccTs: How Western, Educated, Industrialized, Rich, and Democratic is FAccT?
Septiandri, A. A., Constantinides, M., Tahaei, M., & Quercia, D. (2023) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3593013.3593985 · Cited by 106
“multiple countries such as the drug consumption [10] and the VoxCeleb 1 [32].”
BackgroundMetaPortrait: Identity-Preserving Talking Head Generation with Fast Personalized Adaptation
Zhang, B., Qi, C., Zhang, P., Zhang, B., Wu, H., Chen, D., Chen, Q., Wang, Y., & Wen, F. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.02116 · Cited by 109
Su, J., Jin, Z., & Finkelstein, A. (2021) · IEEE Workshop on Applications of Signal Processing to Audio and Acoustics (WASPAA) · doi:10.1109/waspaa52581.2021.9632770 · Cited by 93
“Yet those methods learn from datasets like VoxCeleb [14], the Valentini dataset [15] and the DNS Challenge Dataset [16] that do not contain studio-quality target audio, thus limiting the capabilities of the learnt models.”
MethodWavLLM: Towards Robust and Adaptive Speech Large Language Model
Hu, S., Zhou, L., Liu, S., Chen, S., Meng, L., Hao, H., Pan, J. S., Liu, X., Li, J., Sivasankaran, S., et al. (2024) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2024.findings-emnlp.263 · Cited by 143
Defending Your Voice: Adversarial Attack on Voice Conversion
Huang, C., Lin, Y. Y., Lee, H.-Y., & Lee, L.-S. (2021) · IEEE Spoken Language Technology Workshop (SLT) · doi:10.1109/slt48900.2021.9383529 · Cited by 96
“AUTOVC utilized pre-trained d-vector [33] as speaker encoder, with 80-dim mel spectrogram as input and 256-dim speaker embedding as output, pre-trained on VoxCeleb1 [34] and LibriSpeech [35] but generalizable to unseen speakers.”
MethodTwo decades of speaker recognition evaluation at the national institute of standards and technology
Greenberg, C. S., Mason, L. P., Sadjadi, S. O., & Reynolds, D. A. (2019) · Computer Speech & Language · doi:10.1016/j.csl.2019.101032 · Cited by 56
DPE: Disentanglement of Pose and Expression for General Video Portrait Editing
Pang, Y., Zhang, Y., Quan, W., Fan, Y., Cun, X., Shan, Y., & Yan, D.-M. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00049 · Cited by 104
CNN with Phonetic Attention for Text-Independent Speaker Verification
Zhou, T., Zhao, Y. H., Li, J., Gong, Y., & Wu, J. (2019) · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru46091.2019.9003826 · Cited by 64
One-Shot High-Fidelity Talking-Head Synthesis with Deformable Neural Radiance Field
Li, W., Zhang, L., Wang, D., Zhao, B., Wang, Z., Chen, M., Zhang, B., Wang, Z., Bo, L., & Li, X. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01723 · Cited by 104
Design Choices for X-Vector Based Speaker Anonymization
Srivastava, B. M. L., Tomashenko, N., Wang, X., Vincent, E., Yamagishi, J., Maouche, M., Bellet, A., & Tommasi, M. (2020) · Interspeech (USB) · doi:10.21437/interspeech.2020-2692 · Cited by 87
Privacy-preserving Voice Analysis via Disentangled Representations
Aloufi, R., Haddadi, H., & Boyle, D. (2020) · Cloud Computing Security Workshop · doi:10.1145/3411495.3421355 · Cited by 78
Mesh Guided One-shot Face Reenactment Using Graph Convolutional Networks
Yao, G., Yuan, Y., Shao, T., & Zhou, K. (2020) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3394171.3413865 · Cited by 69
“Model VoxCeleb1 [30] Faceforensics++ [35]”
MethodTariq, S., Jeon, S., & Woo, S. S. (2022) · International World Wide Web Conference (WWW) · doi:10.1145/3485447.3512212 · Cited by 73
SLUE: New Benchmark Tasks For Spoken Language Understanding Evaluation on Natural Speech
Shon, S., Pasad, A., Wu, F., Brusco, P., Artzi, Y., Livescu, K., & Han, K. J. (2022) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp43922.2022.9746137 · Cited by 118
CelebV-Text: A Large-Scale Facial Text-Video Dataset
Yu, J., Zhu, H., Jiang, L., Loy, C. C., Cai, W., & Wu, W. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01422 · Cited by 148
“The quality and quantity of video samples largely determine the quality of generated videos [11, 45, 48, 60].”
BackgroundMethodInfluentialJati, A., & Georgiou, P. (2019) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2019.2921890 · Cited by 59
“The i-vector system (Kaldi VoxCeleb v1 recipe) was trained on the VoxCeleb dataset [59] (16 KHz audio).”
BackgroundMethodInfluentialAutoSpeech: Neural Architecture Search for Speaker Recognition
Ding, S., Chen, T., Gong, X., Zha, W., & Wang, Z. (2020) · Interspeech (USB) · doi:10.21437/interspeech.2020-1258 · Cited by 70
Favaro, A., Tsai, Y.-T., Butala, A., Thebaud, T., Villalba, J., Dehak, N., & Moro-Velázquez, L. (2023) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2023.107559 · Cited by 80
Using X-Vectors to Automatically Detect Parkinson’s Disease from Speech
Moro-Velázquez, L., Villalba, J., & Dehak, N. (2020) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp40776.2020.9053770 · Cited by 72
“To train one of the two x-Vector extractors used in this study we employed VoxCeleb 1 and 2 datasets [21, 22].”
MethodOpen Source MagicData-RAMC: A Rich Annotated Mandarin Conversational(RAMC) Speech Dataset
Yang, Z., Chen, Y., Luo, L., Yang, R., Ye, L., Cheng, G., Xu, J., Jin, Y., Zhang, Q., Zhang, P., et al. (2022) · Interspeech (USB) · doi:10.21437/interspeech.2022-729 · Cited by 92
AudioBench: A Universal Benchmark for Audio Large Language Models
Wang, B., Zou, X., Lin, G., Sun, S., Liu, Z., Zhang, W., Liu, Z., Aw, A. T., & Chen, N. F. (2025) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2025.naacl-long.218 · Cited by 282
Deep Speaker Embeddings for Far-Field Speaker Recognition on Short Utterances
Gusev, A., Volokhov, V., Andzhukaev, T., Novoselov, S., Lavrentyeva, G., Volkova, M., Gazizullina, A., Shulipa, A., Gorlanov, A., Avdeeva, A., et al. (2020) · The Speaker and Language Recognition Workshop (Odyssey) · doi:10.21437/odyssey.2020-26 · Cited by 51
Disentangled Representation Learning for Cross-Modal Biometric Matching
Ning, H., Zheng, X., Lu, X., & Yuan, Y. (2021) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2021.3071243 · Cited by 62
Metadata
- Authors
- Nagrani, A., Chung, J. S., & Zisserman, A.
- Venue
- Interspeech 2017
- Publisher
- ISCA
- Published
- 2017-08-20
- Pages
- 2616-2620
- ISSN
- 2308-457X (ISSN-L)
- OpenAlex
- W2726515241
- Cited by
- 2,210
- References
- 4
- Citations by year
- 2026: 144 · 2025: 280 · 2024: 313 · 2023: 361 · 2022: 330 · 2021: 319 · 2020: 265 · 2019: 151 · 2018: 47
- FWCI
- 56.51
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- Interspeech (USB) (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- Engineering and Physical Sciences Research Council (EP/M013774/1)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Speech Recognition and Synthesis
- Physical Sciences › Computer Science › Signal Processing › Speech and Audio Processing
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Face recognition and analysis
- Keywords
- speaker identification, speaker verification, VoxCeleb, text-independent speaker recognition, automated dataset generation, two-stream CNN, face recognition, YouTube videos
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-10-11, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-11 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.