SpecAugment: A Simple Data Augmentation Method for Automatic Speech Recognition
Open accessThe DOI matches its Crossref record; 51 of the 51 references it cites were found in a registry or an index.
Abstract
We present SpecAugment, a simple data augmentation method for speech recognition. SpecAugment is applied directly to the feature inputs of a neural network (i.e., filter bank coefficients). The augmentation policy consists of warping the features, masking blocks of frequency channels, and masking blocks of time steps. We apply SpecAugment on Listen, Attend and Spell networks for end-to-end speech recognition tasks. We achieve state-of-the-art performance on the LibriSpeech 960h and Swichboard 300h tasks, outperforming all prior work. On LibriSpeech, we achieve 6.8% WER on test-other without the use of a language model, and 5.8% WER with shallow fusion with a language model. This compares to the previous state-of-the-art hybrid system of 7.5% WER. For Switchboard, we achieve 7.2%/14.6% on the Switchboard/CallHome portion of the Hub5'00 test set without the use of a language model, and 6.8%/14.1% with shallow fusion, which compares to the previous state-of-the-art hybrid system at 8.3%/17.3% WER.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“SpecAugment is a spectrum augmentation method, which is only suitable for the audio deepfake model based on front-end feature extraction, and it is not easy to operate on the audio waveform.”
From Voice Deepfake Detection Using the Self-Supervised Pre-Training Model HuBERT (2023) · cites this paper as [19]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“In addition to balanced sampling, we also apply SpecAugment [23] and random time shift to alleviate the class-imbalance issue.”
From Vocalsound: A Dataset for Improving Human Vocal Sounds Recognition (2022) · cites this paper as [23]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Rethinking the Inception Architecture for Computer Vision
Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., & Wojna, Z. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.308 · Cited by 32,138
Speech recognition with deep recurrent neural networks
Graves, A., Mohamed, A.-R., & Hinton, G. (2013) · 2013 IEEE International Conference on Acoustics, Speech and Signal Processing · doi:10.1109/icassp.2013.6638947 · Cited by 8,893 · cited 1×
“Deep Learning has been applied successfully to Automatic Speech Recognition (ASR) [1], where the main focus of research has been designing better network architectures, for example, DNNs [2], CNNs [3], RNNs [4] and end-to-end models [5, 6, 7].”
Method“Librispeech: an ASR corpus based on public domain audio books,”
Panayotov, V., Chen, G., Povey, D., & Khudanpur, S. (2015) · 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2015.7178964 · Cited by 6,072
Kaldi Speech Recognition Toolkit
Povey, D. (2024) · Infoscience (Ecole Polytechnique Fédérale de Lausanne) · doi:10.57702/jb3fvbn9 · Cited by 4,609
Context-dependent pre-trained deep neural networks for large-vocabulary speech recognition
Dahl, G. E., Yu, D., Deng, L., & Acero, A. (2012) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/tasl.2011.2134090 · Cited by 3,011 · cited 1×
“Deep Learning has been applied successfully to Automatic Speech Recognition (ASR) [1], where the main focus of research has been designing better network architectures, for example, DNNs [2], CNNs [3], RNNs [4] and end-to-end models [5, 6, 7].”
MethodImproved regularization of convolutional neural networks with cutout
DeVries, T., & Taylor, G. W. (2017) · arXiv · doi:10.48550/arxiv.1708.04552 · Cited by 2,776
AutoAugment: Learning Augmentation Strategies From Data
Cubuk, E. D., Zoph, B., Mané, D., Vasudevan, V., & Le, Q. V. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00020 · Cited by 2,733
Self-citationTowards End-To-End Speech Recognition with Recurrent Neural Networks
Graves, A., & Jaitly, N. (2014) · Cited by 2,557
Listen, attend and spell: A neural network for large vocabulary conversational speech recognition
Chan, W., Jaitly, N., Le, Q., & Vinyals, O. (2016) · 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2016.7472621 · Cited by 2,226
Self-citationSWITCHBOARD: telephone speech corpus for research and development
Godfrey, J. J., Holliman, E. C., & McDaniel, J. (1992) · [Proceedings] ICASSP-92: 1992 IEEE International Conference on Acoustics, Speech, and Signal Processing · doi:10.1109/icassp.1992.225858 · Cited by 2,134 · cited 2×
“On Switchboard 300h (LDC97S62) [22], we obtain 7.2% WER on the Switchboard portion of the Hub5’00 (LDC2002S09, LDC2003T02) test set, and 14.6% on the Call-Home portion, without using an LM.”
BackgroundInfluential
Research works printed but not linked: 2
- [41][41] K. Vesely, A. Ghoshal, L. Burger, and D. Povey, 'Sequencediscriminative training of deep neural networks,' in INTERSPEECH , 2013. -
- [43][43] G. Zweig, C. Yu, J. Droppo, and A. Stolcke, 'Advances in AllNeural Speech Recognition,' in ICASSP , 2017. -
Cited by
Items 101–200 of 1,013
Stabilizing Transformer Training by Preventing Attention Entropy CollapsePreprint
Zhai, S., Likhomanenko, T., Littwin, E., Busbridge, D., Ramapuram, J., Zhang, Y., Gu, J., & Susskind, J. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2303.06296 · Cited by 182
Self-citationLeveraging Real Talking Faces via Self-Supervision for Robust Forgery Detection
Haliassos, A., Mira, R., Petridis, S., & Pantic, M. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01453 · Cited by 180
Chen, F., Han, M., Zhao, H., Zhang, Q., Shi, J., Xu, S. B., & Xu, B. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2305.04160 · Cited by 180
A Comparison on Data Augmentation Methods Based on Deep Learning for Audio Classification
Wei, S., Zou, S., Liao, F., & Lang, W. (2020) · Journal of Physics Conference Series · doi:10.1088/1742-6596/1453/1/012085 · Cited by 176
CIF: Continuous Integrate-And-Fire for End-To-End Speech Recognition
Dong, L., & Xu, B. (2020) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp40776.2020.9054250 · Cited by 174
Mask CTC: Non-Autoregressive End-to-End ASR with CTC and Mask Predict
Higuchi, Y., Watanabe, S., Chen, N., Ogawa, T., & Kobayashi, T. (2020) · Interspeech (USB) · doi:10.21437/interspeech.2020-2404 · Cited by 174
fairseq S2T: Fast Speech-to-Text Modeling with fairseqPreprint
Wang, C., Tang, Y., Ma, X., Wu, A., Popuri, S., Okhonko, D., & Pino, J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.05171 · Cited by 174
Speech Technology for Healthcare: Opportunities, Challenges, and State of the Art
Latif, S., Qadir, J., Qayyum, A., Usama, M., & Younis, S. (2021) · IEEE Reviews in Biomedical Engineering · doi:10.1109/rbme.2020.3006860 · Cited by 173
Shimada, K., Koyama, Y., Takahashi, N., Takahashi, S., & Mitsufuji, Y. (2021) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp39728.2021.9413609 · Cited by 172
Wang, Q., Du, J., Wu, H., Pan, J., Ma, F., & Lee, C. (2023) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2023.3256088 · Cited by 171
Zipformer: A faster and better encoder for automatic speech recognition
Yao, Z., Guo, L., Yang, X., Kang, W., Kuang, F., Yang, Y., Jin, Z., Lin, L., & Povey, D. (2023) · International Conference on Learning Representations · doi:10.48550/arxiv.2310.11230 · Cited by 171
Language Modeling with Deep Transformers
Irie, K., Zeyer, A., Schlüter, R., & Ney, H. (2019) · Interspeech 2019 · doi:10.21437/interspeech.2019-2225 · Cited by 170
FINDINGS OF THE IWSLT 2020 EVALUATION CAMPAIGN
Ansari, E., Axelrod, A. E., Bách, N., Bojar, O., Cattoni, R., Dalvi, F., Durrani, N., Federico, M., Federmann, C., Gu, J., et al. (2020) · International Conference on Spoken Language Translation (IWSLT) · doi:10.18653/v1/2020.iwslt-1.1 · Cited by 170
ECAPA-TDNN Embeddings for Speaker Diarization
Dawalatabad, N., Ravanelli, M., Grondin, F., Thienpondt, J., Desplanques, B., & Na, H. (2021) · Interspeech (USB) · doi:10.21437/interspeech.2021-941 · Cited by 170
Visual speech recognition for multiple languages in the wild
Ma, P., Petridis, S., & Pantic, M. (2022) · Nature Machine Intelligence · doi:10.1038/s42256-022-00550-z · Cited by 169
A Review of Deep Learning Based Methods for Acoustic Scene Classification
Abeßer, J. (2020) · Applied Sciences · doi:10.3390/app10062020 · Cited by 169
Transformer-Transducer: End-to-End Speech Recognition with Self-AttentionPreprint
Yeh, C.-F., Mahadeokar, J., Kalgaonkar, K., Wang, Y.-Q., Le, D., Jain, M., Schubert, K., Fuegen, C., & Seltzer, M. L. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1910.12977 · Cited by 169
Li, R., Zheng, S., Duan, C., Wang, L., & Zhang, C. (2022) · Geo-spatial Information Science · doi:10.1080/10095020.2021.2017237 · Cited by 167
Data Augmenting Contrastive Learning of Speech Representations in the Time Domain
Kharitonov, E., Rivière, M., Synnaeve, G., Wolf, L., Mazaré, P.-E., Douze, M., & Dupoux, E. (2021) · IEEE Spoken Language Technology Workshop (SLT) · doi:10.1109/slt48900.2021.9383605 · Cited by 166
Non-Autoregressive Transformer for Speech Recognition
Chen, N., Watanabe, S., Villalba, J., Żelasko, P., & Dehak, N. (2020) · IEEE Signal Processing Letters · doi:10.1109/lsp.2020.3044547 · Cited by 166
What Does it Mean for a Language Model to Preserve Privacy?
Brown, H., Lee, K., Mireshghallah, F., Shokri, R., & Tramèr, F. (2022) · 2022 ACM Conference on Fairness Accountability and Transparency · doi:10.1145/3531146.3534642 · Cited by 165
Towards Efficient Model Compression via Learned Global Ranking
Chin, T.-W., Ding, R., Zhang, C., & Marculescu, D. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00159 · Cited by 165
An ongoing review of speech emotion recognition
de Lope, J., & Graña, M. (2023) · Neurocomputing · doi:10.1016/j.neucom.2023.01.002 · Cited by 165
PSLA: Improving Audio Tagging With Pretraining, Sampling, Labeling, and Aggregation
Gong, Y., Chung, Y.-A., & Glass, J. (2021) · IEEE/ACM Transactions on Audio, Speech, and Language Processing · doi:10.1109/taslp.2021.3120633 · Cited by 164
“We first consider simple time and frequency masking for data augmentation, which has been found to be effective for audio tagging [5] and speech recognition [40].”
Data augmentation for learning predictive models on EEG: a systematic comparison
Rommel, C., Paillard, J., Moreau, T., & Gramfort, A. (2022) · Journal of Neural Engineering · doi:10.1088/1741-2552/aca220 · Cited by 163
WeNet 2.0: More Productive End-to-End Speech Recognition Toolkit
Zhang, B., Wu, D., Peng, Z., Song, X., Yao, Z., Lv, H., Xie, L., Yang, C., Pan, F., & Niu, J. (2022) · Interspeech (USB) · doi:10.21437/interspeech.2022-483 · Cited by 162
Zhang, Y., Park, D. S., Han, W., Qin, J., Gulati, A., Shor, J., Jansen, A., Xu, Y., Huang, Y., Wang, S., et al. (2022) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2022.3182537 · Cited by 161
“The pre-training method used in this work is based on wav2vec 2.0 [12], while the self-training method is based on noisy student training [41] using SpecAugment [42], [43].”
MethodSelf-citationStreaming Keyword Spotting on Mobile Devices
Rybakov, O., Kononenko, N., Subrahmanya, N., Visontai, M., & Laurenzo, S. (2020) · Interspeech (USB) · doi:10.21437/interspeech.2020-1003 · Cited by 161
Meghanani, A., Anoop, C. S., & Ramakrishnan, A. G. (2021) · IEEE Spoken Language Technology Workshop (SLT) · doi:10.1109/slt48900.2021.9383491 · Cited by 159
EAT: Self-Supervised Pre-Training with Efficient Audio Transformer
Chen, W., Liang, Y., Ma, Z., Zheng, Z., & Chen, X. (2024) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2024/421 · Cited by 158
On Compositions of Transformations in Contrastive Self-Supervised Learning
Patrick, M., Asano, Y. M., Kuznetsova, P., Fong, R., Henriques, J. F., Zweig, G., & Vedaldi, A. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00944 · Cited by 157
FINDINGS OF THE IWSLT 2023 EVALUATION CAMPAIGN
Agarwal, M., Agrawal, S., Anastasopoulos, A., Bentivogli, L., Bojar, O., Borg, C., Carpuat, M. J., Cattoni, R., Cettolo, M., Chen, M., et al. (2023) · International Conference on Spoken Language Translation (IWSLT) · doi:10.18653/v1/2023.iwslt-1.1 · Cited by 156
Le, D., Jain, M., Keren, G., Kim, S., Shi, Y., Mahadeokar, J., Chan, J., Shangguan, Y., Fuegen, C., Kalinli, O., et al. (2021) · Interspeech (USB) · doi:10.21437/interspeech.2021-1566 · Cited by 155
Recognizing Long-Form Speech Using Streaming End-to-End Models
Narayanan, A., Prabhavalkar, R., Chiu, C., Rybach, D., Sainath, T. N., & Strohman, T. (2019) · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru46091.2019.9003913 · Cited by 154
Self-citationFar-Field Automatic Speech Recognition
Haeb‐Umbach, R., Heymann, J., Drude, L., Watanabe, S., Delcroix, M., & Nakatani, T. (2020) · Proceedings of the IEEE · doi:10.1109/jproc.2020.3018668 · Cited by 152
Libriheavy: A 50,000 Hours ASR Corpus with Punctuation Casing and Context
Kang, W., Yang, X., Yao, Z., Kuang, F., Yang, Y., Guo, L., Lin, L., & Povey, D. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10447120 · Cited by 152
The NIST 2010 speaker recognition evaluation
Martin, A. F., & Greenberg, C. S. (2010) · Interspeech 2010 · doi:10.21437/interspeech.2010-722 · Cited by 151
Peng, X., Wang, H., Lang, J., Li, W., Xu, Q., Zhang, Z., Cai, T., Duan, S., Liu, F., & Li, C. (2020) · Energy · doi:10.1016/j.energy.2020.119692 · Cited by 151
End-to-end ASR: from Supervised to Semi-Supervised Learning with Modern Architectures
Synnaeve, G., Xu, Q., Kahn, J., Likhomanenko, T., Grave, É., Pratap, V., Sriram, A., Liptchinsky, V., & Collobert, R. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1911.08460 · Cited by 150
Fine-Tuning Wav2Vec2 for Speaker Recognition
Vaessen, N., & van Leeuwen, D. A. (2022) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp43922.2022.9746952 · Cited by 149
Multi-modal Self-Supervision from Generalized Data TransformationsPreprint
Patrick, M., Asano, Y. M., Кузнецова, П., Fong, R., Henriques, J. F., Zweig, G., & Vedaldi, A. (2021) · arXiv (Cornell University) · Cited by 149
VioLA: Conditional Language Models for Speech Recognition, Synthesis, and Translation
Wang, T., Zhou, L., Zhang, Z., Wu, Y., Liu, S., Gaur, Y., Chen, Z., Li, J., & Wei, F. (2024) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2024.3434425 · Cited by 148
Keyword Transformer: A Self-Attention Model for Keyword Spotting
Berg, A., O’Connor, M., & Cruz, M. T. (2021) · Interspeech 2021 · doi:10.21437/interspeech.2021-1286 · Cited by 147
A Review of Deep Learning Algorithms and Their Applications in Healthcare
Abdel-Jaber, H., Devassy, D., Al Salam, A., Hidaytallah, L., & EL-Amir, M. (2022) · Algorithms · doi:10.3390/a15020071 · Cited by 147
Shimada, K., Koyama, Y., Takahashi, S., Takahashi, N., Tsunoo, E., & Mitsufuji, Y. (2022) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp43922.2022.9746384 · Cited by 147
Deep Contextualized Acoustic Representations for Semi-Supervised Speech Recognition
Ling, S., Liu, Y., Salazar, J., & Kirchhoff, K. (2020) · ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp40776.2020.9053176 · Cited by 145
AutoML-Zero: Evolving Machine Learning Algorithms From Scratch
Real, E., Liang, C., So, D. R., & Le, Q. V. (2020) · arXiv · doi:10.48550/arxiv.2003.03384 · Cited by 143
“…as the learning rule used during backpropagation (Andrychowicz et al., 2016; Ravi & Larochelle, 2017), the data augmentation (Cubuk et al., 2019a; Park et al., 2019) or the intrinsic curiosity reward in reinforcement learning (Alet et al., 2019); in these works, all other algorithmic aspects…”
BackgroundMethodSelf-citationRizos, G., Baird, A., Elliott, M., & Schuller, B. W. (2020) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp40776.2020.9054579 · Cited by 143
Specaugment on Large Scale Datasets
Park, D. S., Zhang, Y., Chiu, C.-C., Chen, Y., Li, B., Chan, W., Le, Q. V., & Wu, Y. (2020) · ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp40776.2020.9053205 · Cited by 140
Self-citationMajumdar, S., & Ginsburg, B. (2020) · Interspeech (USB) · doi:10.21437/interspeech.2020-1058 · Cited by 140
Contrastive self-supervised learning: review, progress, challenges and future research directions
Kumar, P., Rawat, P., & Chauhan, S. (2022) · International Journal of Multimedia Information Retrieval · doi:10.1007/s13735-022-00245-6 · Cited by 140
Frequency Dynamic Convolution: Frequency-Adaptive Pattern Recognition for Sound Event Detection
Nam, H., Kim, S.-H., Ko, B.-Y., & Park, Y. (2022) · Interspeech (USB) · doi:10.21437/interspeech.2022-10127 · Cited by 136
Curriculum Pre-training for End-to-End Speech Translation
Wang, C., Wu, Y., Liu, S., Zhou, M., & Yang, Z. (2020) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2020.acl-main.344 · Cited by 135
Reproducing Whisper-Style Training Using An Open-Source Toolkit And Publicly Available Data
Peng, Y., Tian, J., Yan, B., Berrebbi, D., Chang, X., Li, X., Shi, J., Arora, S., Chen, W., Sharma, R., et al. (2023) · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru57964.2023.10389676 · Cited by 135
An Improved Event-Independent Network for Polyphonic Sound Event Localization and Detection
Cao, Y. P., Iqbal, T., Kong, Q., An, F., Wang, W., & Plumbley, M. D. (2021) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp39728.2021.9413473 · Cited by 134
Advancing RNN Transducer Technology for Speech Recognition
Saon, G., Tuske, Z., Bolaños, D., & Kingsbury, B. E. D. (2021) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp39728.2021.9414716 · Cited by 133
Contextual RNN-T for Open Domain ASR
Jain, M., Keren, G., Mahadeokar, J., Zweig, G., Metze, F., & Saraf, Y. (2020) · Interspeech (USB) · doi:10.21437/interspeech.2020-2986 · Cited by 132
Imputer: Sequence Modelling via Imputation and Dynamic ProgrammingPreprint
Chan, W., Saharia, C., Hinton, G. E., Norouzi, M., & Jaitly, N. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.08926 · Cited by 132
Self-citationBEATs: Audio Pre-Training with Acoustic Tokenizers
Chen, S., Wu, Y., Wang, C., Liu, S., Tompkins, D., Chen, Z., & Wei, F. (2022) · arXiv · doi:10.48550/arxiv.2212.09058 · Cited by 131
The 2016 NIST Speaker Recognition Evaluation
Sadjadi, S. O., Kheyrkhah, T., Tong, A. N., Greenberg, C. S., Reynolds, D. A., Singer, E., Mason, L. P., & Hernández-Cordero, J. (2017) · Interspeech (USB) · doi:10.21437/interspeech.2017-458 · Cited by 130
Raj, D., Denisov, P., Chen, Z., Erdoğan, H., Huang, Z., He, M., Watanabe, S., Du, J., Yoshioka, T., Luo, Y., et al. (2021) · IEEE Spoken Language Technology Workshop (SLT) · doi:10.1109/slt48900.2021.9383556 · Cited by 130
Cascade versus Direct Speech Translation: Do the Differences Still Make a Difference?
Bentivogli, L., Cettolo, M., Gaido, M., Karakanta, A., Martinelli, A., Negri, M., & Turchi, M. (2021) · doi:10.18653/v1/2021.acl-long.224 · Cited by 130
Cross-modal Contrastive Learning for Speech Translation
Ye, R., Wang, M., & Li, L. (2022) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2022.naacl-main.376 · Cited by 130
Open Source MagicData-RAMC: A Rich Annotated Mandarin Conversational(RAMC) Speech Dataset
Yang, Z., Chen, Y., Luo, L., Yang, R., Ye, L., Cheng, G., Xu, J., Jin, Y., Zhang, Q., Zhang, P., et al. (2022) · Interspeech (USB) · doi:10.21437/interspeech.2022-729 · Cited by 130
MulDA: A Multilingual Data Augmentation Framework for Low-Resource Cross-Lingual NER
Liu, L., Ding, B., Bing, L., Joty, S., Si, L., & Miao, C. (2021) · doi:10.18653/v1/2021.acl-long.453 · Cited by 128
LRSpeech: Extremely Low-Resource Speech Synthesis and Recognition
Xu, J., Tan, X., Ren, Y., Qin, T., Li, J., Zhao, S., & Liu, T. (2020) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3394486.3403331 · Cited by 127
MAESTRO: Matched Speech Text Representations through Modality Matching
Chen, Z., Zhang, Y., Rosenberg, A., Ramabhadran, B., Moreno, P. J., Bapna, A., & Zen, H. (2022) · Interspeech (USB) · doi:10.21437/interspeech.2022-10937 · Cited by 127
Self-citationKim, A. Y., Jang, E. H., Lee, S., Choi, K., Park, J. G., & Shin, H. (2022) · Journal of Medical Internet Research · doi:10.2196/34474 · Cited by 127
Zhao, J. S., & Zhang, W.-Q. (2022) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2022.3184480 · Cited by 126
Transformers in speech processing: Overcoming challenges and paving the future
Latif, S., Zaidi, S. A. M., Cuayáhuitl, H., Shamshad, F., Shoukat, M., Usama, M., & Qadir, J. (2025) · Computer Science Review · doi:10.1016/j.cosrev.2025.100768 · Cited by 126
FINDINGS OF THE IWSLT 2021 EVALUATION CAMPAIGN
Anastasopoulos, A., Bojar, O., Bremerman, J., Cattoni, R., Elbayad, M., Federico, M., Ma, X., Nakamura, S., Negri, M., Niehues, J., et al. (2021) · International Conference on Spoken Language Translation (IWSLT) · doi:10.18653/v1/2021.iwslt-1.1 · Cited by 125
AVES: Animal Vocalization Encoder Based on Self-Supervision
Hagiwara, M. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10095642 · Cited by 125
Yodas: Youtube-Oriented Dataset for Audio and Speech
Li, X., Takamichi, S., Saeki, T., Chen, W., Shiota, S., & Watanabe, S. (2023) · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru57964.2023.10389689 · Cited by 125
Generating Synthetic Audio Data for Attention-Based Speech Recognition Systems
Rossenbach, N., Zeyer, A., Schlüter, R., & Ney, H. (2020) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp40776.2020.9053008 · Cited by 123
Correction of Automatic Speech Recognition with Transformer Sequence-To-Sequence Model
Hrinchuk, O., Popova, M., & Ginsburg, B. (2020) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp40776.2020.9053051 · Cited by 122
Self-Training and Pre-Training are Complementary for Speech Recognition
Xu, Q., Baevski, A., Likhomanenko, T., Tomasello, P., Conneau, A., Collobert, R., Synnaeve, G., & Auli, M. (2021) · ICASSP 2021 - 2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp39728.2021.9414641 · Cited by 119
Sun, G., Zhang, Y., Weiss, R. J., Cao, Y. J., Zen, H., Rosenberg, A., Ramabhadran, B., & Wu, Y. (2020) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp40776.2020.9053436 · Cited by 119
Self-citationAudio-Visual Speech and Gesture Recognition by Sensors of Mobile Devices
Ryumin, D., Ivanko, D., & Рюмина, Е. В. (2023) · Sensors · doi:10.3390/s23042284 · Cited by 119
Massively Multilingual ASR: 50 Languages, 1 Model, 1 Billion Parameters
Pratap, V., Sriram, A., Tomasello, P., Hannun, A., Liptchinsky, V., Synnaeve, G., & Collobert, R. (2020) · Interspeech 2020 · doi:10.21437/interspeech.2020-2831 · Cited by 117
Efficient Large-Scale Audio Tagging Via Transformer-to-CNN Knowledge Distillation
Schmid, F. T., Koutini, K., & Widmer, G. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10096110 · Cited by 117
Hong, F., Liu, C., Guo, L., Chen, F., & Feng, H. (2021) · Applied Sciences · doi:10.3390/app11041442 · Cited by 116
ERANNs: Efficient residual audio neural networks for audio pattern recognition
Verbitskiy, S., Berikov, V., & Vyshegorodtsev, V. (2022) · Pattern Recognition Letters · doi:10.1016/j.patrec.2022.07.012 · Cited by 116
Learning Data Manipulation for Augmentation and WeightingPreprint
Hu, Z., Tan, B., Salakhutdinov, R., Mitchell, T. M., & Xing, E. P. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1910.12795 · Cited by 115
Thienpondt, J., Desplanques, B., & Demuynck, K. (2021) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp39728.2021.9414600 · Cited by 114
Bae, S., Kim, J.-W., Cho, W.-Y., Baek, H., Son, S., Lee, B., Ha, C., Tae, K., Kim, S., & Yun, S.-Y. (2023) · Interspeech (USB) · doi:10.21437/interspeech.2023-1426 · Cited by 114
ColloSSL: Collaborative Self-Supervised Learning for Human Activity Recognition
Jain, Y., Tang, C. I., Min, C., Kawsar, F., & Mathur, A. (2022) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3517246 · Cited by 113
MixSpeech: Data Augmentation for Low-Resource Automatic Speech Recognition
Meng, L., Xu, J., Tan, X., Wang, J., Qin, T., & Xu, B. (2021) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp39728.2021.9414483 · Cited by 113
FastEmit: Low-Latency Streaming ASR with Sequence-Level Emission Regularization
Yu, J., Chiu, C., Li, B., Chang, S.-Y., Sainath, T. N., He, Y., Narayanan, A., Han, W., Gulati, A., Wu, Y., et al. (2021) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp39728.2021.9413803 · Cited by 113
Self-citationLightweight Adapter Tuning for Multilingual Speech Translation
Le, H., Pino, J., Wang, C., Gu, J., Schwab, D., & Besacier, L. (2021) · doi:10.18653/v1/2021.acl-short.103 · Cited by 113
Jiang, D., Li, W., Cao, M. Y., Zou, W., & Li, X. (2021) · Interspeech (USB) · doi:10.21437/interspeech.2021-391 · Cited by 113
Iterative Pseudo-Labeling for Speech Recognition
Xu, Q., Likhomanenko, T., Kahn, J., Hannun, A., Synnaeve, G., & Collobert, R. (2020) · Interspeech 2020 · doi:10.21437/interspeech.2020-1800 · Cited by 112
Xu, K., Xie, F., Tang, X., & Hu, Y. B. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2501.14350 · Cited by 112
Gender in Danger? Evaluating Speech Translation Technology on the MuST-SHE Corpus
Bentivogli, L., Savoldi, B., Negri, M., Gangi, M. A. D., Cattoni, R., & Turchi, M. (2020) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2020.acl-main.619 · Cited by 111
Nozaki, J., & Komatsu, T. (2021) · Interspeech (USB) · doi:10.21437/interspeech.2021-911 · Cited by 111
HINT: High-Quality INpainting Transformer With Mask-Aware Encoding and Enhanced Attention
Chen, S., Atapour–Abarghouei, A., & Shum, H. P. H. (2024) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2024.3369897 · Cited by 110
Can Generative Large Language Models Perform ASR Error Correction?Preprint
Ma, R., Qian, M., Manakul, P., Gales, M., & Knill, K. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2307.04172 · Cited by 109
VoiceFilter-Lite: Streaming Targeted Voice Separation for On-Device Speech Recognition
Wang, Q., Moreno, I. L., Sağlam, M., Wilson, K., Chiao, A., Liu, R., He, Y., Li, W., Pelecanos, J. W., Nika, M., et al. (2020) · Interspeech (USB) · doi:10.21437/interspeech.2020-1193 · Cited by 108
Kanda, N., Gaur, Y., Wang, X., Meng, Z., Chen, Z., Zhou, T., & Yoshioka, T. (2020) · Interspeech (USB) · doi:10.21437/interspeech.2020-1085 · Cited by 108
Towards Building ASR Systems for the Next Billion Users
Javed, T., Doddapaneni, S., Raman, A., Bhogale, K. S., Ramesh, G., Kunchukuttan, A., Kumar, P., & Khapra, M. M. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i10.21327 · Cited by 108
Gated Recurrent Fusion With Joint Training Framework for Robust End-to-End Speech Recognition
Fan, C., Yi, J., Tao, J., Tian, Z., Liu, B., & Wen, Z. (2020) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2020.3039600 · Cited by 107
Metadata
- Authors
- Park, D. S., Chan, W., Zhang, Y., Chiu, C.-C., Zoph, B., Cubuk, E. D., & Le, Q. V.
- Affiliations
- Google (United States) (US)
- Venue
- Interspeech 2019
- Publisher
- ISCA
- Published
- 2019-09-15
- Pages
- 2613-2617
- ISSN
- 2308-457X (ISSN-L)
- OpenAlex
- W2936774411
- Cited by
- 3,558
- References
- 51
- Citations by year
- 2026: 239 · 2025: 415 · 2024: 450 · 2023: 649 · 2022: 603 · 2021: 738 · 2020: 391 · 2019: 69
- FWCI
- 172.29
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- Interspeech (USB) (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Speech Recognition and Synthesis
- Physical Sciences › Computer Science › Signal Processing › Speech and Audio Processing
- Physical Sciences › Computer Science › Signal Processing › Music and Audio Processing
- Keywords
- SpecAugment, data augmentation, speech recognition, frequency masking, feature warping, end-to-end speech recognition, LibriSpeech, switchboards, CALLHOME, word error rate
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.