SpecAugment: A Simple Data Augmentation Method for Automatic Speech Recognition
Open accessThe DOI matches its Crossref record; 51 of the 51 references it cites were found in a registry or an index.
Abstract
We present SpecAugment, a simple data augmentation method for speech recognition. SpecAugment is applied directly to the feature inputs of a neural network (i.e., filter bank coefficients). The augmentation policy consists of warping the features, masking blocks of frequency channels, and masking blocks of time steps. We apply SpecAugment on Listen, Attend and Spell networks for end-to-end speech recognition tasks. We achieve state-of-the-art performance on the LibriSpeech 960h and Swichboard 300h tasks, outperforming all prior work. On LibriSpeech, we achieve 6.8% WER on test-other without the use of a language model, and 5.8% WER with shallow fusion with a language model. This compares to the previous state-of-the-art hybrid system of 7.5% WER. For Switchboard, we achieve 7.2%/14.6% on the Switchboard/CallHome portion of the Hub5'00 test set without the use of a language model, and 6.8%/14.1% with shallow fusion, which compares to the previous state-of-the-art hybrid system at 8.3%/17.3% WER.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“SpecAugment is a spectrum augmentation method, which is only suitable for the audio deepfake model based on front-end feature extraction, and it is not easy to operate on the audio waveform.”
From Voice Deepfake Detection Using the Self-Supervised Pre-Training Model HuBERT (2023) · cites this paper as [19]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“In addition to balanced sampling, we also apply SpecAugment [23] and random time shift to alleviate the class-imbalance issue.”
From Vocalsound: A Dataset for Improving Human Vocal Sounds Recognition (2022) · cites this paper as [23]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Rethinking the Inception Architecture for Computer Vision
Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., & Wojna, Z. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.308 · Cited by 32,138
Speech recognition with deep recurrent neural networks
Graves, A., Mohamed, A.-R., & Hinton, G. (2013) · 2013 IEEE International Conference on Acoustics, Speech and Signal Processing · doi:10.1109/icassp.2013.6638947 · Cited by 8,893 · cited 1×
“Deep Learning has been applied successfully to Automatic Speech Recognition (ASR) [1], where the main focus of research has been designing better network architectures, for example, DNNs [2], CNNs [3], RNNs [4] and end-to-end models [5, 6, 7].”
Method“Librispeech: an ASR corpus based on public domain audio books,”
Panayotov, V., Chen, G., Povey, D., & Khudanpur, S. (2015) · 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2015.7178964 · Cited by 6,072
Kaldi Speech Recognition Toolkit
Povey, D. (2024) · Infoscience (Ecole Polytechnique Fédérale de Lausanne) · doi:10.57702/jb3fvbn9 · Cited by 4,609
Context-dependent pre-trained deep neural networks for large-vocabulary speech recognition
Dahl, G. E., Yu, D., Deng, L., & Acero, A. (2012) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/tasl.2011.2134090 · Cited by 3,011 · cited 1×
“Deep Learning has been applied successfully to Automatic Speech Recognition (ASR) [1], where the main focus of research has been designing better network architectures, for example, DNNs [2], CNNs [3], RNNs [4] and end-to-end models [5, 6, 7].”
MethodImproved regularization of convolutional neural networks with cutout
DeVries, T., & Taylor, G. W. (2017) · arXiv · doi:10.48550/arxiv.1708.04552 · Cited by 2,776
AutoAugment: Learning Augmentation Strategies From Data
Cubuk, E. D., Zoph, B., Mané, D., Vasudevan, V., & Le, Q. V. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00020 · Cited by 2,733
Self-citationTowards End-To-End Speech Recognition with Recurrent Neural Networks
Graves, A., & Jaitly, N. (2014) · Cited by 2,557
Listen, attend and spell: A neural network for large vocabulary conversational speech recognition
Chan, W., Jaitly, N., Le, Q., & Vinyals, O. (2016) · 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2016.7472621 · Cited by 2,226
Self-citationSWITCHBOARD: telephone speech corpus for research and development
Godfrey, J. J., Holliman, E. C., & McDaniel, J. (1992) · [Proceedings] ICASSP-92: 1992 IEEE International Conference on Acoustics, Speech, and Signal Processing · doi:10.1109/icassp.1992.225858 · Cited by 2,134 · cited 2×
“On Switchboard 300h (LDC97S62) [22], we obtain 7.2% WER on the Switchboard portion of the Hub5’00 (LDC2002S09, LDC2003T02) test set, and 14.6% on the Call-Home portion, without using an LM.”
BackgroundInfluential
Research works printed but not linked: 2
- [41][41] K. Vesely, A. Ghoshal, L. Burger, and D. Povey, 'Sequencediscriminative training of deep neural networks,' in INTERSPEECH , 2013. -
- [43][43] G. Zweig, C. Yu, J. Droppo, and A. Stolcke, 'Advances in AllNeural Speech Recognition,' in ICASSP , 2017. -
Cited by
Items 201–300 of 1,013
Earnings-21: A Practical Benchmark for ASR in the Wild
Rio, M. D., Delworth, N., Westerman, R., Huang, M., Bhandari, N., Palakapilly, J., McNamara, Q., Dong, J., Żelasko, P., & Jetté, M. (2021) · Interspeech (USB) · doi:10.21437/interspeech.2021-1915 · Cited by 107
Nguyen, T. N. T., Watcharasupat, K. N., Nguyen, N. K., Jones, D. L., & Gan, W. (2022) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2022.3173054 · Cited by 107
Unified Streaming and Non-streaming Two-pass End-to-end Model for Speech RecognitionPreprint
Zhang, B., Wu, D., Yao, Z., Wang, X., Yu, F., Yang, C., Guo, L., Hu, Y., Xie, L., & Lei, X. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2012.05481 · Cited by 107
EarBuddy: Enabling On-Face Interaction via Wireless Earbuds
Xu, X., Shi, H., Yi, X., Liu, W., Yan, Y., Shi, Y., Mariakakis, A. T., Mankoff, J. C., & Dey, A. K. (2020) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376836 · Cited by 106
Joint Representation Learning and Novel Category Discovery on Single- and Multi-modal Data
Jia, X., Han, K., Zhu, Y., & Green, B. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00065 · Cited by 104
Liu, T., Das, R. K., Lee, K. A., & Li, H. (2022) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp43922.2022.9747021 · Cited by 104
BigVGAN: A Universal Neural Vocoder with Large-Scale Training
Lee, S.-G., Ping, W., Ginsburg, B., Catanzaro, B., & Yoon, S. (2022) · arXiv · doi:10.48550/arxiv.2206.04658 · Cited by 103
A General Multi-Task Learning Framework to Leverage Text Data for Speech to Text Tasks
Tang, Y., Pino, J., Wang, C., Ma, X., & Genzel, D. (2021) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp39728.2021.9415058 · Cited by 103
Foundation Models for Natural Language Processing: Pre-trained Language Models Integrating Media
Paaß, G., & Giesselbach, S. (2023) · Artificial intelligence: foundations, theory, and algorithms/Artificial intelligence: Foundations, theory, and algorithms · doi:10.1007/978-3-031-23190-2 · Cited by 103
Thienpondt, J., Desplanques, B., & Demuynck, K. (2021) · Interspeech (USB) · doi:10.21437/interspeech.2021-1570 · Cited by 102
Unified Speech-Text Pre-training for Speech Translation and Recognition
Tang, Y., Gong, H., Dong, N., Wang, C., Hsu, W.-N., Gu, J., Baevski, A., Li, X., Mohamed, A., Auli, M., et al. (2022) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2022.acl-long.105 · Cited by 102
Automatic Speech Recognition Method Based on Deep Learning Approaches for Uzbek Language
Mukhamadiyev, A., Khujayorov, I., Djuraev, O., & Cho, J. (2022) · Sensors · doi:10.3390/s22103683 · Cited by 102
BEANS: The Benchmark of Animal Sounds
Hagiwara, M., Hoffman, B., Liu, J.-Y., Cusimano, M., Effenberger, F., & Zacarian, K. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10096686 · Cited by 102
i-Mix: A Domain-Agnostic Strategy for Contrastive Representation LearningPreprint
Lee, K., Zhu, Y., Sohn, K., Li, C., Shin, J., & Lee, H. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.08887 · Cited by 102
Speech Sentiment Analysis via Pre-Trained Features from End-to-End ASR Models
Lu, Z., Cao, L., Zhang, Y., Chiu, C., & Fan, J. (2020) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp40776.2020.9052937 · Cited by 101
Self-citationTraining Speech Recognition Models with Federated Learning: A Quality/Cost Framework
Guliani, D., Beaufays, F., & Motta, G. (2021) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp39728.2021.9413397 · Cited by 101
Understanding Test-Time Augmentation
Kimura, M. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-92185-9_46 · Cited by 101
An ensemble learning approach to digital corona virus preliminary screening from cough sounds
Mohammed, E. A., Keyhani, M., Sanati‐Nezhad, A., Hejazi, S. H., & Far, B. H. (2021) · Scientific Reports · doi:10.1038/s41598-021-95042-2 · Cited by 100
A Large-Scale Evaluation of Speech Foundation Models
Yang, S.-W., Chang, H.-J., Huang, Z., Liu, A. T., Lai, C.-I., Wu, H., Shi, J., Chang, X., Tsai, H.-S., Huang, W.-C., et al. (2024) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2024.3389631 · Cited by 100
CoVoST: A Diverse Multilingual Speech-To-Text Translation CorpusPreprint
Wang, C., Pino, J., Wu, A., & Gu, J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.01320 · Cited by 100
Affinity and Diversity: Quantifying Mechanisms of Data AugmentationPreprint
Gontijo-Lopes, R., Smullin, S., Cubuk, E. D., & Dyer, E. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.08973 · Cited by 100
Self-citationBenchmarking Neural Network Training AlgorithmsPreprint
Dahl, G. E., Schneider, F. W., Nado, Z., Agarwal, N., Sastry, C. S., Hennig, P., Medapati, S., Eschenhagen, R., Kasimbeg, P., Suo, D., et al. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2306.07179 · Cited by 102
Towards End-to-End Unsupervised Speech Recognition
Liu, A. H., Hsu, W.-N., Auli, M., & Baevski, A. (2023) · IEEE Spoken Language Technology Workshop (SLT) · doi:10.1109/slt54892.2023.10023187 · Cited by 99
Effectiveness of Self-Supervised Pre-Training for ASR
Baevski, A., & Mohamed, A. (2020) · ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp40776.2020.9054224 · Cited by 98
Xu, C., Hu, B., Li, Y., Zhang, Y., Huang, S., Ju, Q., Xiao, T., & Zhu, J. (2021) · doi:10.18653/v1/2021.acl-long.204 · Cited by 98
Self-citationBasak, S., Agrawal, H., Jena, S., Gite, S., Bachute, M. R., Pradhan, B., & Assiri, M. E. (2022) · Computer Modeling in Engineering & Sciences · doi:10.32604/cmes.2022.021755 · Cited by 98
Improving Speech Translation by Understanding and Learning from the Auxiliary Text Translation Task
Tang, Y., Pino, J., Li, X., Wang, C., & Genzel, D. (2021) · doi:10.18653/v1/2021.acl-long.328 · Cited by 97
Filteraugment: An Acoustic Environmental Data Augmentation Method
Nam, H., Kim, S.-H., & Park, Y. (2022) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp43922.2022.9747680 · Cited by 97
Investigating Multi-feature Selection and Ensembling for Audio Classification
Turab, M., Kumar, T., Bendechache, M., & Saber, T. (2022) · International Journal of Artificial Intelligence & Applications · doi:10.5121/ijaia.2022.13306 · Cited by 97
Recent Progress in the CUHK Dysarthric Speech Recognition System
Liu, S., Geng, M., Hu, S., Xie, X., Cui, M., Yu, J., Liu, X., & Meng, H. (2021) · IEEE/ACM Transactions on Audio, Speech, and Language Processing · doi:10.1109/taslp.2021.3091805 · Cited by 96
Speech Emotion Recognition with Multiscale Area Attention and Data Augmentation
Xu, M., Zhang, F., Cui, X., & Zhāng, W. (2021) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp39728.2021.9414635 · Cited by 96
Audio-based Toxic Language Classification using Self-attentive Convolutional Neural Network
Yousefi, M., & Emmanouilidou, D. (2021) · European Signal Processing Conference (EUSIPCO) · doi:10.23919/eusipco54536.2021.9616001 · Cited by 96
Majumdar, S., Balam, J., Hrinchuk, O., Lavrukhin, V., Noroozi, V., & Ginsburg, B. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2104.01721 · Cited by 95
Adaptive Knowledge Distillation Based on Entropy
Kwon, K., Na, H., Lee, H., & Kim, N. S. (2020) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp40776.2020.9054698 · Cited by 94
PlethAugment: GAN-Based PPG Augmentation for Medical Diagnosis in Low-Resource Settings
Kiyasseh, D., Tadesse, G. A., Nhan, L. N. T., Tan, L. V., Thwaites, L., Zhu, T., & Clifton, D. A. (2020) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2020.2979608 · Cited by 94
Saldanha, J., Chakraborty, S., Patil, S., Kotecha, K. V., Kumar, S., & Nayyar, A. (2022) · PLoS ONE · doi:10.1371/journal.pone.0266467 · Cited by 94
Effectiveness of self-supervised pre-training for speech recognition
Baevski, A., Auli, M., & Mohamed, A. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1911.03912 · Cited by 93
Automatic Speech Recognition Using Limited Vocabulary: A Survey
Fendji, J. L. E. K., Tala, D. C. M., Yenké, B. O., & Atemkeng, M. (2022) · Applied Artificial Intelligence · doi:10.1080/08839514.2022.2095039 · Cited by 93
Training Strategies for Improved Lip-Reading
Ma, P., Wang, Y., Petridis, S., Shen, J., & Pantić, M. (2022) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp43922.2022.9746706 · Cited by 93
Masked Modeling Duo: Towards a Universal Audio Pre-Training Framework
Niizumi, D., Takeuchi, D., Ohishi, Y., Harada, N., & Kashino, K. (2024) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2024.3389636 · Cited by 93
Translatotron 2: High-quality direct speech-to-speech translation with voice preservationPreprint
Ye, J., Ramanovich, M. T., Remez, T., & Pomerantz, R. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2107.08661 · Cited by 93
Direct speech-to-speech translation with discrete unitsPreprint
Lee, A., Chen, P., Wang, C., Gu, J., Popuri, S., Ma, X., Polyak, A., Adi, Y., He, Q., Tang, Y., et al. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2107.05604 · Cited by 93
KsponSpeech: Korean Spontaneous Speech Corpus for Automatic Speech Recognition
Bang, J., Yun, S., Kim, S., Choi, M.-Y., Lee, M., Kim, Y.-J., Kim, D.-H., Park, J., Lee, Y., & Kim, S. (2020) · Applied Sciences · doi:10.3390/app10196936 · Cited by 92
Xia, W., Zhang, C., Weng, C., Yu, M., & Yu, D. (2021) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp39728.2021.9414973 · Cited by 92
Cough Against COVID: Evidence of COVID-19 Signature in Cough Sounds
Bagad, P., Dalmia, A., Doshi, J., Nagrani, A., Bhamare, P., Mahale, A., Rane, S., Agarwal, N., & Panicker, R. (2020) · arXiv · doi:10.48550/arxiv.2009.08790 · Cited by 91
One Small Step for Generative AI, One Giant Leap for AGI: A Complete Survey on ChatGPT in AIGC Era
Zhang, C., Zhang, C., Li, C., Qiao, Y., Zheng, S., Dam, S. K., Zhang, M., Kim, J. U., Kim, S. T., Park, G., et al. (2023) · arXiv (Cornell University) · doi:10.13140/rg.2.2.24789.70883 · Cited by 91
Unsupervised Domain Adaptation for Speech Recognition via Uncertainty Driven Self-Training
Khurana, S., Moritz, N., Hori, T., & Roux, J. L. (2021) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp39728.2021.9414299 · Cited by 91
Shot Contrastive Self-Supervised Learning for Scene Boundary Detection
Chen, S., Nie, X., Fan, D., Zhang, D., Bhat, V., & Hamid, R. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00967 · Cited by 91
SpecMix : A Mixed Sample Data Augmentation Method for Training with Time-Frequency Domain Features
Kim, G., Han, D. K., & Ko, H. (2021) · Interspeech (USB) · doi:10.21437/interspeech.2021-103 · Cited by 91
Prompting Large Language Models for Zero-Shot Domain Adaptation in Speech Recognition
Li, Y., Wu, Y., Li, J., & Liu, S. (2023) · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru57964.2023.10389732 · Cited by 91
Bridging the Modality Gap for Speech-to-Text TranslationPreprint
Liu, Y., Zhu, J., Zhang, J., & Zong, C. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.14920 · Cited by 91
Improving Sequence-To-Sequence Speech Recognition Training with On-The-Fly Data Augmentation
Nguyen, T.-S., Stuker, S., Niehues, J., & Waibel, A. (2020) · ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp40776.2020.9054130 · Cited by 90
Dual-decoder Transformer for Joint Automatic Speech Recognition and Multilingual Speech Translation
Le, H., Pino, J., Wang, C., Gu, J., Schwab, D., & Besacier, L. (2020) · International Conference on Computational Linguistics · doi:10.18653/v1/2020.coling-main.314 · Cited by 89
Spatial–Temporal Feature Network for Speech-Based Depression Recognition
Han, Z., Shang, Y., Shao, Z., Liu, J., Guo, G., Liu, T., Ding, H., & Hu, Q. (2023) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2023.3273614 · Cited by 89
FastCorrect: Fast Error Correction with Edit Alignment for Automatic Speech RecognitionPreprint
Leng, Y., Tan, X., Zhu, L., Xu, J., Luo, R., Liu, L., Qin, T., Li, X., Lin, E., & Liu, T. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2105.03842 · Cited by 89
SPLAT: Speech-Language Joint Pre-Training for Spoken Language Understanding
Chung, Y.-A., Zhu, C., & Zeng, M. (2021) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2021.naacl-main.152 · Cited by 88
Padi, S., Sadjadi, S. O., Manocha, D., & Sriram, R. D. (2022) · The Speaker and Language Recognition Workshop (Odyssey) · doi:10.21437/odyssey.2022-57 · Cited by 88
Emotional Speech-Driven 3D Body Animation via Disentangled Latent Diffusion
Chhatre, K., Daněček, R., Athanasiou, N., Becherini, G., Peters, C., Black, M. J., & Bolkart, T. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00190 · Cited by 88
Laptev, A., Korostik, R., Svischev, A., Andrusenko, A., Medennikov, I., & Rybin, S. (2020) · International Congress on Image and Signal Processing (CISP) · doi:10.1109/cisp-bmei51763.2020.9263564 · Cited by 87
Cascaded Encoders for Unifying Streaming and Non-Streaming ASR
Narayanan, A., Sainath, T. N., Pang, R., Yu, J., Chiu, C., Prabhavalkar, R., Variani, E., & Strohman, T. (2021) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp39728.2021.9414607 · Cited by 87
Self-citationMarbleNet: Deep 1D Time-Channel Separable Convolutional Neural Network for Voice Activity Detection
Jia, F., Majumdar, S., & Ginsburg, B. (2021) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp39728.2021.9414470 · Cited by 87
The 2021 NIST Speaker Recognition Evaluation
Sadjadi, S. O., Greenberg, C. S., Singer, E., Mason, L., & Reynolds, D. A. (2022) · The Speaker and Language Recognition Workshop (Odyssey) · doi:10.21437/odyssey.2022-45 · Cited by 87
Learning Audio-Visual Source Localization via False Negative Aware Contrastive Learning
Sun, W., Zhang, J., Wang, J., Liu, Z., Zhong, Y., Feng, T., Guo, Y., Zhang, Y., & Barnes, N. M. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00621 · Cited by 87
Self-citationLearning Robust and Multilingual Speech Representations
Kawakami, K., Wang, L., Dyer, C., Blunsom, P., & van den Oord, A. (2020) · Findings of the Association for Computational Linguistics: EMNLP 2020 · doi:10.18653/v1/2020.findings-emnlp.106 · Cited by 86
Semantic Distance: A New Metric for ASR Performance Analysis Towards Spoken Language Understanding
Kim, S., Arora, A., Le, D., Yeh, C.-F., Fuegen, C., Kalinli, O., & Seltzer, M. L. (2021) · Interspeech (USB) · doi:10.21437/interspeech.2021-1929 · Cited by 86
ESPnet-SLU: Advancing Spoken Language Understanding Through ESPnet
Arora, S., Dalmia, S., Denisov, P., Chang, X., Ueda, Y., Peng, Y., Zhang, Y., Kumar, S., Ganesan, K., Yan, B., et al. (2022) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp43922.2022.9747674 · Cited by 86
Self-citationA survey on machine learning in ship radiated noise
Hummel, H. I., van der Mei, R., & Bhulai, S. (2024) · Ocean Engineering · doi:10.1016/j.oceaneng.2024.117252 · Cited by 86
Sound Source Detection, Localization and Classification using Consecutive Ensemble of CRNN Models
Kapka, S., & Lewandowski, M. (2019) · Detection and Classification of Acoustic Scenes and Events Workshop (DCASE) · doi:10.33682/9f2t-ab23 · Cited by 85
Espresso: A Fast End-to-End Neural Speech Recognition Toolkit
Wang, Y., Chen, T., Xu, H., Ding, S., Lv, H., Shao, Y., Peng, N., Xie, L., Watanabe, S., & Khudanpur, S. P. (2019) · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru46091.2019.9003968 · Cited by 85
Zuluaga-Gómez, J., Prasad, A., Nigmatulina, I., Sarfjoo, S. S., Motlíček, P., Kleinert, M., Helmke, H., Ohneiser, O., & Zhan, Q. (2023) · IEEE Spoken Language Technology Workshop (SLT) · doi:10.1109/slt54892.2023.10022724 · Cited by 85
Spoken Question Answering and Speech Continuation Using Spectrogram-Powered LLM
Nachmani, E., Levkovitch, A., Hirsch, R., Salazar, J., Asawaroengchai, C., Mariooryad, S., Rivlin, E., Skerry-Ryan, R., & Ramanovich, M. T. (2023) · International Conference on Learning Representations · doi:10.48550/arxiv.2305.15255 · Cited by 85
The IWSLT 2019 Evaluation Campaign
Niehues, J., Cattoni, R., Stüker, S., Negri, M., Turchi, M., Ha, T., Salesky, E., Sanabria, R., Barrault, L., Specia, L., et al. (2019) · Research Publications (Maastricht University) · doi:10.5281/zenodo.3525577 · Cited by 84
Unsupervised Contrastive Learning of Sound Event Representations
Fonseca, E., Ortego, D., McGuinness, K., O'Connor, N. E., & Serra, X. (2021) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp39728.2021.9415009 · Cited by 84
Slow-Fast Auditory Streams for Audio Recognition
Kazakos, E., Nagrani, A., Zisserman, A., & Damen, D. (2021) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp39728.2021.9413376 · Cited by 84
SynthASR: Unlocking Synthetic Data for Speech Recognition
Fazel, A., Yang, W., Liu, Y., Barra-Chicote, R., Meng, Y., Maas, R., & Droppo, J. (2021) · Interspeech (USB) · doi:10.21437/interspeech.2021-1882 · Cited by 84
Sound-Guided Semantic Image Manipulation
Lee, S. H., Roh, W., Byeon, W., Yoon, S. H., Kim, C. Y., Kim, J., & Kim, S. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.00337 · Cited by 84
Automated identification of chicken distress vocalizations using deep learning models
Mao, A., Giraudet, C., Liu, K., Nolasco, I., ZhiQin, X., ZhiXun, X., Gao, Y., Theobald, J., Bhatta, D., Stewart, R., et al. (2022) · Journal of The Royal Society Interface · doi:10.1098/rsif.2021.0921 · Cited by 84
SAMU-XLSR: Semantically-Aligned Multimodal Utterance-Level Cross-Lingual Speech Representation
Khurana, S., Laurent, A., & Glass, J. R. (2022) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2022.3192714 · Cited by 84
Elalem, Y. K., Maier, S., & Seifert, R. W. (2022) · International Journal of Forecasting · doi:10.1016/j.ijforecast.2022.09.005 · Cited by 84
A-JEPA: Joint-Embedding Predictive Architecture Can ListenPreprint
Fei, Z., Fan, M., & Huang, J. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2311.15830 · Cited by 84
Chang, X., Maekaku, T., Fujita, Y., & Watanabe, S. (2022) · Interspeech (USB) · doi:10.21437/interspeech.2022-10839 · Cited by 83
Pruned RNN-T for fast, memory-efficient ASR training
Kuang, F., Guo, L., Kang, W., Lin, L., Luo, M., Yao, Z., & Povey, D. (2022) · Interspeech (USB) · doi:10.21437/interspeech.2022-10340 · Cited by 83
Trends and developments in automatic speech recognition research
O’Shaughnessy, D. D. (2023) · Computer Speech & Language · doi:10.1016/j.csl.2023.101538 · Cited by 83
Mandel, M., Salamon, J., & Ellis, D. P. W. (2019) · Workshop on Detection and Classification of Acoustic Scenes and Events · doi:10.33682/1syg-dy60 · Cited by 83
Audio Captioning TransformerPreprint
Mei, X., Liu, X., Huang, Q., Plumbley, M. D., & Wang, W. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2107.09817 · Cited by 83
Bridging the Gap between Pre-Training and Fine-Tuning for End-to-End Speech Translation
Wang, C., Wu, Y., Liu, S., Yang, Z., & Zhou, M. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i05.6452 · Cited by 82
Arabic speech recognition by end-to-end, modular systems and human
Hussein, A., Watanabe, S., & Ali, A. M. A. (2021) · Computer Speech & Language · doi:10.1016/j.csl.2021.101272 · Cited by 82
Tradeoffs in Data Augmentation: An Empirical Study
Gontijo-Lopes, R., Smullin, S., Cubuk, E. D., & Dyer, E. (2021) · International Conference on Learning Representations · Cited by 82
Self-citationWhen Deep Learning Meets Polyhedral Theory: A Survey
Huchette, J., Muñoz, G., Serra, T., & Tsay, C. (2026) · INFORMS journal on computing · doi:10.1287/ijoc.2024.0902 · Cited by 82
Confidence Estimation for Attention-Based Sequence-to-Sequence Models for Speech Recognition
Li, Q., Qiu, D., Zhang, Y., Li, B., He, Y., Woodland, P. C., Cao, L., & Strohman, T. (2021) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp39728.2021.9414920 · Cited by 81
Self-citationData Augmentation for Audio-Visual Emotion Recognition with an Efficient Multimodal Conditional GAN
Ma, F., Li, Y., Ni, S., Huang, S., & Zhang, L. (2022) · Applied Sciences · doi:10.3390/app12010527 · Cited by 81
Chen, F., Yang, C., & Khishe, M. (2022) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2022.103688 · Cited by 81
Hwang, J., Hira, M., Chen, C., Zhang, X., Ni, Z., Sun, G., Ma, P., Huang, R., Pratap, V., Zhang, Y., et al. (2023) · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru57964.2023.10389648 · Cited by 81
Self-citationCTC-based Compression for Direct Speech Translation
Gaido, M., Cettolo, M., Negri, M., & Turchi, M. (2021) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.18653/v1/2021.eacl-main.57 · Cited by 80
Bai, Y., Yi, J., Tao, J., Tian, Z., Wen, Z., & Zhang, S. (2021) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2021.3082299 · Cited by 80
Jain, R., Barcovschi, A., Yiwere, M. Y., Bigioi, D., Corcoran, P., & Cucu, H. (2023) · IEEE Access · doi:10.1109/access.2023.3275106 · Cited by 80
Graph Attention Networks for Anti-Spoofing
Tak, H., Jung, J.-W., Patino, J., Todisco, M., & Evans, N. (2021) · Interspeech 2021 · doi:10.21437/interspeech.2021-993 · Cited by 79
SpeechStew: Simply Mix All Available Speech Recognition Data to Train One Large Neural Network
Chan, W., Park, D., Lee, C., Zhang, Y., Le, Q., & Norouzi, M. (2021) · arXiv · doi:10.48550/arxiv.2104.02133 · Cited by 79
“The same SpecAugment policy as the 100M model is used to train this model, while exponential moving averages are not used.”
InfluentialSelf-citationUnsupervised Pre-Training of Bidirectional Speech Encoders via Masked Reconstruction
Wang, W., Tang, Q., & Livescu, K. (2020) · ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp40776.2020.9053541 · Cited by 79
Neural Audio Fingerprint for High-Specific Audio Retrieval Based on Contrastive Learning
Chang, S., Lee, D., Park, J., Lim, H., Lee, K., Ko, K., & Han, Y. (2021) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp39728.2021.9414337 · Cited by 79
Metadata
- Authors
- Park, D. S., Chan, W., Zhang, Y., Chiu, C.-C., Zoph, B., Cubuk, E. D., & Le, Q. V.
- Affiliations
- Google (United States) (US)
- Venue
- Interspeech 2019
- Publisher
- ISCA
- Published
- 2019-09-15
- Pages
- 2613-2617
- ISSN
- 2308-457X (ISSN-L)
- OpenAlex
- W2936774411
- Cited by
- 3,558
- References
- 51
- Citations by year
- 2026: 239 · 2025: 415 · 2024: 450 · 2023: 649 · 2022: 603 · 2021: 738 · 2020: 391 · 2019: 69
- FWCI
- 172.29
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- Interspeech (USB) (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Speech Recognition and Synthesis
- Physical Sciences › Computer Science › Signal Processing › Speech and Audio Processing
- Physical Sciences › Computer Science › Signal Processing › Music and Audio Processing
- Keywords
- SpecAugment, data augmentation, speech recognition, frequency masking, feature warping, end-to-end speech recognition, LibriSpeech, switchboards, CALLHOME, word error rate
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.