VoxPopuli: A Large-Scale Multilingual Speech Corpus for Representation Learning, Semi-Supervised Learning and Interpretation
Open accessThe DOI matches its Crossref record; 43 of the 43 references it cites were found in a registry or an index.
Abstract
Changhan Wang, Morgane Riviere, Ann Lee, Anne Wu, Chaitanya Talnikar, Daniel Haziza, Mary Williamson, Juan Pino, Emmanuel Dupoux. Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers). 2021.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Exploiting Generative AI to Scale up Intelligent Tutoring Systems
Jakubův, J., Chvalovský, K., Goertzel, Z., Kaliszyk, C., Olšák, M., Piotrowski, B., Schulz, S., Suda, M., & Urban, J. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.itp.2023.19 · Cited by 76,658
Representation Learning with Contrastive Predictive Coding
Oord, A. V. D., Li, Y., & Vinyals, O. (2018) · arXiv · doi:10.48550/arxiv.1807.03748 · Cited by 6,242
“Librispeech: an ASR corpus based on public domain audio books,”
Panayotov, V., Chen, G., Povey, D., & Khudanpur, S. (2015) · 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2015.7178964 · Cited by 6,072
(2005) · Cited by 3,125
Kudo, T., & Richardson, J. (2018) · Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing: System Demonstrations · doi:10.18653/v1/d18-2012 · Cited by 2,869
wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representations
Baevski, A., Zhou, H., Mohamed, A., & Auli, M. (2020) · arXiv · doi:10.48550/arxiv.2006.11477 · Cited by 2,369
fairseq: A Fast, Extensible Toolkit for Sequence Modeling
Ott, M., Edunov, S., Baevski, A., Fan, A., Gross, S., Ng, N., Grangier, D., & Auli, M. (2019) · Proceedings of the 2019 Conference of the North · doi:10.18653/v1/n19-4009 · Cited by 2,344
wav2vec: Unsupervised Pre-Training for Speech Recognition
Schneider, S., Baevski, A., Collobert, R., & Auli, M. (2019) · Interspeech 2019 · doi:10.21437/interspeech.2019-1873 · Cited by 1,290
KenLM: Faster and Smaller Language Model Queries
Heafield, K. (2011) · Cited by 1,145
Common Voice: A Massively-Multilingual Speech Corpus
Ardila, R., Branson, M., Davis, K., Henretty, M., Kohler, M., Meyer, J., Morais, R., Saunders, L., Tyers, F. M., & Weber, G. (2019) · arXiv · doi:10.48550/arxiv.1912.06670 · Cited by 905 · cited 5×
“Out-of-domain pre-training We examine the out-of-domain pre-training setting using the Common Voice (CV) ASR corpus (Ardila et al., 2020).”
BackgroundMethodInfluentialMassively Multilingual Sentence Embeddings for Zero-Shot Cross-Lingual Transfer and Beyond
Artetxe, M., & Schwenk, H. (2019) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00288 · Cited by 791
Unsupervised Cross-Lingual Representation Learning for Speech Recognition
Conneau, A., Baevski, A., Collobert, R., Mohamed, A., & Auli, M. (2021) · Interspeech 2021 · doi:10.21437/interspeech.2021-329 · Cited by 637
Probability of error of some adaptive pattern-recognition machines
Scudder, H. (1965) · IEEE Transactions on Information Theory · doi:10.1109/tit.1965.1053799 · Cited by 518
Libri-Light: A Benchmark for ASR with Limited or No Supervision
Kahn, J., Riviere, M., Zheng, W., Kharitonov, E., Xu, Q., Mazare, P. E., Karadayi, J., Liptchinsky, V., Collobert, R., Fuegen, C., et al. (2020) · ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp40776.2020.9052942 · Cited by 458
Self-citationMLS: A Large-Scale Multilingual Dataset for Speech Research
Pratap, V., Xu, Q., Sriram, A., Synnaeve, G., & Collobert, R. (2020) · Interspeech 2020 · doi:10.21437/interspeech.2020-2826 · Cited by 361 · cited 1×
“…et al., 2018; Schneider et al., 2019; Baevski et al., 2020; Conneau et al., 2020; Wu et al., 2020; Nguyen et al., 2020), with semi-supervised learning (self-training) (Kahn et al., 2020a; Pino et al., 2020; Zhang et al., 2020b; Xu et al., 2020) or a combination of both methods (Xu et al., 2020).”
BackgroundPyannote.Audio: Neural Building Blocks for Speaker Diarization
Bredin, H., Yin, R., Coria, J. M., Gelly, G., Korshunov, P., Lavechin, M., Fustes, D., Titeux, H., Bouaziz, W., & Gill, M.-P. (2020) · ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp40776.2020.9052974 · Cited by 336
Europarl-ST: A Multilingual Corpus for Speech Translation of Parliamentary Debates
Iranzo-Sánchez, J., Silvestre-Cerdà, J. A., Jorge, J., Roselló, N., Giménez, A., Sanchís, A., Civera, J., & Juan, A. (2020) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp40776.2020.9054626 · Cited by 253
Fairseq S2T: Fast Speech-to-Text Modeling with Fairseq
Wang, C., Tang, Y., Ma, X., Wu, A., Okhonko, D., & Pino, J. (2020) · doi:10.18653/v1/2020.aacl-demo.6 · Cited by 248
Self-citationWav2Letter: an End-to-End ConvNet-based Speech Recognition System
Collobert, R., Puhrsch, C., & Synnaeve, G. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1609.03193 · Cited by 230
MuST-C: A multilingual corpus for end-to-end speech translation
Cattoni, R., Gangi, M. A. D., Bentivogli, L., Negri, M., & Turchi, M. (2020) · Computer Speech & Language · doi:10.1016/j.csl.2020.101155 · Cited by 223
CoVoST 2 and Massively Multilingual Speech-to-Text TranslationPreprint
Wang, C., Wu, A., & Pino, J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.10310 · Cited by 222
Self-citationMuST-C: a Multilingual Speech Translation Corpus
Gangi, M. A. D., Cattoni, R., Bentivogli, L., Negri, M., & Turchi, M. (2019) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n19-1202 · Cited by 220
Self-Training for End-to-End Speech Recognition
Kahn, J., Lee, A., & Hannun, A. (2020) · ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp40776.2020.9054295 · Cited by 196
Self-citationPushing the Limits of Semi-Supervised Learning for Automatic Speech Recognition
Zhang, Y., Qin, J., Park, D., Han, W., Chiu, C., Pang, R., Le, Q. V., & Wu, Y. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.10504 · Cited by 190
Unsupervised Pretraining Transfers Well Across Languages
Riviere, M., Joulin, A., Mazare, P.-E., & Dupoux, E. (2020) · ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp40776.2020.9054548 · Cited by 186 · cited 3×
“We present Mono-5K and Multi50Ks’ performance with the m-CPC (Rivière et al., 2020) and XLSR (Conneau et al.”
MethodInfluentialDirect Speech-to-Speech Translation with a Sequence-to-Sequence Model
Jia, Y., Weiss, R. J., Biadsy, F., Macherey, W., Johnson, M., Chen, Z., & Wu, Y. (2019) · Interspeech 2019 · doi:10.21437/interspeech.2019-1951 · Cited by 184
Wav2Letter++: A Fast Open-source Speech Recognition System
Pratap, V., Hannun, A., Xu, Q., Cai, J., Kahn, J., Synnaeve, G., Liptchinsky, V., & Collobert, R. (2019) · ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2019.8683535 · Cited by 174
fairseq S2T: Fast Speech-to-Text Modeling with fairseqPreprint
Wang, C., Tang, Y., Ma, X., Wu, A., Popuri, S., Okhonko, D., & Pino, J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.05171 · Cited by 174
Self-citationThe zero resource speech challenge 2017
Dunbar, E., Cao, X. N., Benjumea, J., Karadayi, J., Bernard, M., Besacier, L., Anguera, X., & Dupoux, E. (2017) · 2017 IEEE Automatic Speech Recognition and Understanding Workshop (ASRU) · doi:10.1109/asru.2017.8268953 · Cited by 169
Self-citationSchatz, T., Peddinti, V., Bach, F., Jansen, A., Heřmanský, H., & Emmanuel Dupoux, A. (2013) · Interspeech (USB) · doi:10.21437/interspeech.2013-441 · Cited by 150
Sequence-to-Sequence Speech Recognition with Time-Depth Separable Convolutions
Hannun, A., Lee, A., Xu, Q., & Collobert, R. (2019) · Interspeech (USB) · doi:10.21437/interspeech.2019-2460 · Cited by 120
Self-citationSelf-Training and Pre-Training are Complementary for Speech Recognition
Xu, Q., Baevski, A., Likhomanenko, T., Tomasello, P., Conneau, A., Collobert, R., Synnaeve, G., & Auli, M. (2021) · ICASSP 2021 - 2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp39728.2021.9414641 · Cited by 119
UWSpeech: Speech to Speech Translation for Unwritten Languages
Zhang, C., Tan, X., Ren, Y., Qin, T., Zhang, K., & Liu, T. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i16.17684 · Cited by 88
Speech-to-Speech Translation Between Untranscribed Unknown Languages
Tjandra, A., Sakti, S., & Nakamura, S. (2019) · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru46091.2019.9003853 · Cited by 72
CMU Wilderness Multilingual Speech Dataset
Black, A. W. (2019) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2019.8683536 · Cited by 67
Interpretese vs. Translationese: The Uniqueness of Human Strategies in Simultaneous Interpretation
He, H., Boyd-Graber, J., & Daumé III, H. (2016) · Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.18653/v1/n16-1111 · Cited by 59
Self-Supervised Representations Improve End-to-End Speech Translation
Wu, A., Wang, C., Pino, J., & Gu, J. (2020) · Interspeech (USB) · doi:10.21437/interspeech.2020-3094 · Cited by 52
Self-citationBoito, M. Z., Havard, W. N., Garnerin, M., Ferrand, É. L., & Besacier, L. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1907.12895 · Cited by 43
Investigating Self-Supervised Pre-Training for End-to-End Speech Translation
Nguyen, H., Bougares, F., Tomashenko, N., Estève, Y., & Besacier, L. (2020) · Interspeech (USB) · doi:10.21437/interspeech.2020-1835 · Cited by 41
Joint Masked CPC And CTC Training For ASR
Talnikar, C., Likhomanenko, T., Collobert, R., & Synnaeve, G. (2021) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp39728.2021.9414227 · Cited by 34
Self-citationTowards Unsupervised Learning of Speech Features in the Wild
Rivière, M., & Dupoux, E. (2021) · IEEE Spoken Language Technology Workshop (SLT) · doi:10.1109/slt48900.2021.9383461 · Cited by 27
Self-citationSelf-training and Pre-training are Complementary for Speech RecognitionPreprint
Xu, Q., Baevski, A., Likhomanenko, T., Tomasello, P., Conneau, A., Collobert, R., Synnaeve, G., & Auli, M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.11430 · Cited by 11
(2020) · neural information processing systems
Cited by
WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processing
Chen, S., Wang, C., Chen, Z., Wu, Y., Liu, S., Chen, Z., Li, J., Kanda, N., Yoshioka, T., Xiao, X., et al. (2022) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2022.3188113 · Cited by 1,926
Self-citationXLS-R: Self-supervised Cross-lingual Speech Representation Learning at Scale
Babu, A., Wang, C., Tjandra, A., Lakhotia, K., Xu, Q., Goyal, N., Singh, K., von Platen, P., Saraf, Y., Pino, J., et al. (2022) · Interspeech 2022 · doi:10.21437/interspeech.2022-143 · Cited by 586
Self-citationSpeechBrain: A General-Purpose Speech Toolkit
Ravanelli, M., Parcollet, T., Plantinga, P., Rouhe, A., Cornell, S., Lugosch, L., Subakan, C., Dawalatabad, N., Heba, A., Zhong, J., et al. (2021) · arXiv · doi:10.48550/arxiv.2106.04624 · Cited by 512
Dawn of the Transformer Era in Speech Emotion Recognition: Closing the Valence Gap
Wagner, J., Triantafyllopoulos, A., Wierstorf, H., Schmitt, M., Burkhardt, F., Eyben, F., & Schuller, B. W. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3263585 · Cited by 395
Self-supervised speech representation learning: A review
Mohamed, A., Lee, H.-Y., Borgholt, L., Havtorn, J. D., Edin, J., Igel, C., Kirchhoff, K., Li, S.-W., Livescu, K., Maaløe, L., et al. (2022) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2022.3207050 · Cited by 372
“(MLS) [215], VoxPopuli (VP) [216], and BABEL (BBL) [217].”
Metadata
- Authors
- Wang, C., Riviere, M., Lee, A., Wu, A., Talnikar, C., Haziza, D., Williamson, M., Pino, J., & Dupoux, E.
- Venue
- Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers)
- Published
- 2021
- Pages
- 993-1003
- OpenAlex
- W3119308075
- Cited by
- 329
- References
- 43
- FWCI
- 27.89
- Type
- conference paper
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.