SpecAugment: A Simple Data Augmentation Method for Automatic Speech Recognition
Open accessThe DOI matches its Crossref record; 51 of the 51 references it cites were found in a registry or an index.
Abstract
We present SpecAugment, a simple data augmentation method for speech recognition. SpecAugment is applied directly to the feature inputs of a neural network (i.e., filter bank coefficients). The augmentation policy consists of warping the features, masking blocks of frequency channels, and masking blocks of time steps. We apply SpecAugment on Listen, Attend and Spell networks for end-to-end speech recognition tasks. We achieve state-of-the-art performance on the LibriSpeech 960h and Swichboard 300h tasks, outperforming all prior work. On LibriSpeech, we achieve 6.8% WER on test-other without the use of a language model, and 5.8% WER with shallow fusion with a language model. This compares to the previous state-of-the-art hybrid system of 7.5% WER. For Switchboard, we achieve 7.2%/14.6% on the Switchboard/CallHome portion of the Hub5'00 test set without the use of a language model, and 6.8%/14.1% with shallow fusion, which compares to the previous state-of-the-art hybrid system at 8.3%/17.3% WER.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“SpecAugment is a spectrum augmentation method, which is only suitable for the audio deepfake model based on front-end feature extraction, and it is not easy to operate on the audio waveform.”
From Voice Deepfake Detection Using the Self-Supervised Pre-Training Model HuBERT (2023) · cites this paper as [19]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“In addition to balanced sampling, we also apply SpecAugment [23] and random time shift to alleviate the class-imbalance issue.”
From Vocalsound: A Dataset for Improving Human Vocal Sounds Recognition (2022) · cites this paper as [23]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Rethinking the Inception Architecture for Computer Vision
Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., & Wojna, Z. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.308 · Cited by 32,138
Speech recognition with deep recurrent neural networks
Graves, A., Mohamed, A.-R., & Hinton, G. (2013) · 2013 IEEE International Conference on Acoustics, Speech and Signal Processing · doi:10.1109/icassp.2013.6638947 · Cited by 8,893 · cited 1×
“Deep Learning has been applied successfully to Automatic Speech Recognition (ASR) [1], where the main focus of research has been designing better network architectures, for example, DNNs [2], CNNs [3], RNNs [4] and end-to-end models [5, 6, 7].”
Method“Librispeech: an ASR corpus based on public domain audio books,”
Panayotov, V., Chen, G., Povey, D., & Khudanpur, S. (2015) · 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2015.7178964 · Cited by 6,072
Kaldi Speech Recognition Toolkit
Povey, D. (2024) · Infoscience (Ecole Polytechnique Fédérale de Lausanne) · doi:10.57702/jb3fvbn9 · Cited by 4,609
Context-dependent pre-trained deep neural networks for large-vocabulary speech recognition
Dahl, G. E., Yu, D., Deng, L., & Acero, A. (2012) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/tasl.2011.2134090 · Cited by 3,011 · cited 1×
“Deep Learning has been applied successfully to Automatic Speech Recognition (ASR) [1], where the main focus of research has been designing better network architectures, for example, DNNs [2], CNNs [3], RNNs [4] and end-to-end models [5, 6, 7].”
MethodImproved regularization of convolutional neural networks with cutout
DeVries, T., & Taylor, G. W. (2017) · arXiv · doi:10.48550/arxiv.1708.04552 · Cited by 2,776
AutoAugment: Learning Augmentation Strategies From Data
Cubuk, E. D., Zoph, B., Mané, D., Vasudevan, V., & Le, Q. V. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00020 · Cited by 2,733
Self-citationTowards End-To-End Speech Recognition with Recurrent Neural Networks
Graves, A., & Jaitly, N. (2014) · Cited by 2,557
Listen, attend and spell: A neural network for large vocabulary conversational speech recognition
Chan, W., Jaitly, N., Le, Q., & Vinyals, O. (2016) · 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2016.7472621 · Cited by 2,226
Self-citationSWITCHBOARD: telephone speech corpus for research and development
Godfrey, J. J., Holliman, E. C., & McDaniel, J. (1992) · [Proceedings] ICASSP-92: 1992 IEEE International Conference on Acoustics, Speech, and Signal Processing · doi:10.1109/icassp.1992.225858 · Cited by 2,134 · cited 2×
“On Switchboard 300h (LDC97S62) [22], we obtain 7.2% WER on the Switchboard portion of the Hub5’00 (LDC2002S09, LDC2003T02) test set, and 14.6% on the Call-Home portion, without using an LM.”
BackgroundInfluential
Research works printed but not linked: 2
- [41][41] K. Vesely, A. Ghoshal, L. Burger, and D. Povey, 'Sequencediscriminative training of deep neural networks,' in INTERSPEECH , 2013. -
- [43][43] G. Zweig, C. Yu, J. Droppo, and A. Stolcke, 'Advances in AllNeural Speech Recognition,' in ICASSP , 2017. -
Cited by
Items 501–600 of 1,013
Preech: A System for Privacy-Preserving Speech TranscriptionPreprint
Ahmed, S., Chowdhury, A. R., Fawaz, K., & Ramanathan, P. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1909.04198 · Cited by 54
Foundation TransformersPreprint
Wang, H., Ma, S., Huang, S., Li, D., Wang, W., Peng, Z., Wu, Y., Bajaj, P., Singhal, S., Benhaim, A., et al. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2210.06423 · Cited by 54
Scaling End-to-End Models for Large-Scale Multilingual ASR
Li, B., Pang, R., Sainath, T. N., Gulati, A., Zhang, Y., Qin, J., Haghani, P., Huang, W. R., Ma, M., & Bai, J. (2021) · 2021 IEEE Automatic Speech Recognition and Understanding Workshop (ASRU) · doi:10.1109/asru51503.2021.9687871 · Cited by 53
Self-citationAI-Based Ripeness Grading for Oil Palm Fresh Fruit Bunch in Smart Crane Grabber
Harsawardana, Rahutomo, R., Mahesworo, B., Cenggoro, T. W., Budiarto, A., Suparyanto, T., Atmaja, D. B. S., Samoedro, B., & Pardamean, B. (2020) · IOP Conference Series Earth and Environmental Science · doi:10.1088/1755-1315/426/1/012147 · Cited by 53
End-to-End Multi-Modal Speech Recognition on an Air and Bone Conducted Speech Corpus
Wang, M., Chen, J., Zhang, X.-L., & Rahardja, S. (2022) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2022.3224305 · Cited by 53
Latif, S., Shahid, A., & Qadir, J. (2023) · Applied Acoustics · doi:10.1016/j.apacoust.2023.109425 · Cited by 53
Attention as a Guide for Simultaneous Speech Translation
Papi, S., Negri, M., & Turchi, M. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.745 · Cited by 53
Language-Routing Mixture of Experts for Multilingual and Code-Switching Speech Recognition
Wang, W., Ma, G., Li, Y., & Du, B. (2023) · Interspeech (USB) · doi:10.21437/interspeech.2023-2292 · Cited by 53
Advancing speaker embedding learning: Wespeaker toolkit for research and production
Wang, S., Chen, Z., Han, B., Wang, H., Liang, C., Zhang, B., Xiang, X., Ding, W., Rohdin, J., Silnova, A., et al. (2024) · Speech Communication · doi:10.1016/j.specom.2024.103104 · Cited by 53
On the Choice of Modeling Unit for Sequence-to-Sequence Speech Recognition
Irie, K., Prabhavalkar, R., Kannan, A., Bruguier, A., Rybach, D., & Nguyen, P. (2019) · Interspeech (USB) · doi:10.21437/interspeech.2019-2277 · Cited by 53
Transformer-Transducers for Code-Switched Speech Recognition
Dalmia, S., Liu, Y., Ronanki, S., & Kirchhoff, K. (2021) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp39728.2021.9413562 · Cited by 53
Data Augmentation and Spectral Structure Features for Limited Samples Hyperspectral Classification
Wang, W., Liu, X., & Mou, X. (2021) · Remote Sensing · doi:10.3390/rs13040547 · Cited by 53
GestOnHMD: Enabling Gesture-based Interaction on Low-cost VR Head-Mounted Display
Chen, T., Xu, L., Xu, X., & Zhu, K. (2021) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2021.3067689 · Cited by 53
End-to-End Neural Diarization: From Transformer to Conformer
Liu, Y. C., Han, E., Lee, C., & Stolcke, A. (2021) · Interspeech (USB) · doi:10.21437/interspeech.2021-1909 · Cited by 53
Personalized Automatic Speech Recognition Trained on Small Disordered Speech Datasets
Tobin, J., & Tomanek, K. (2022) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp43922.2022.9747516 · Cited by 53
Improving data augmentation for low resource speech-to-text translation with diverse paraphrasing
Mi, C., Xie, L., & Zhang, Y. (2022) · Neural Networks · doi:10.1016/j.neunet.2022.01.016 · Cited by 53
Self-citationNon-Autoregressive ASR Modeling Using Pre-Trained Language Models for Chinese Speech Recognition
Yu, F.-H., Chen, K.-Y., & Lu, K.-H. (2022) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2022.3166400 · Cited by 53
Liu, H., Xu, H., Garcia, L. P., Khong, A. W. H., He, Y., & Khudanpur, S. P. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10095878 · Cited by 53
Revisiting End-to-End Speech-to-Text Translation From ScratchPreprint
Zhang, B., Haddow, B., & Sennrich, R. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2206.04571 · Cited by 53
Conversational Agents: Theory and ApplicationsPreprint
Wahde, M., & Virgolin, M. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2202.03164 · Cited by 53
Automatic Voice Disorder Detection Using Self-Supervised Representations
Ribas, D., Pastor, M. A., Miguel, A., Martinez, D., Ortega, A., & Lleida, E. (2023) · IEEE Access · doi:10.1109/access.2023.3243986 · Cited by 52
The Influence of Dataset Partitioning on Dysfluency Detection Systems
Bayerl, S. P., Wagner, D., Nöth, E., Bocklet, T., & Riedhammer, K. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-16270-1_35 · Cited by 52
Contextualized End-to-End Speech Recognition with Contextual Phrase Prediction Network
Huang, K., Zhang, A., Yang, Z., Guo, P., Mu, B., Xu, T., & Xie, L. (2023) · Interspeech (USB) · doi:10.21437/interspeech.2023-767 · Cited by 52
Trading via image classification
Cohen, N., Balch, T. R., & Veloso, M. (2020) · ACM International Conference on AI in Finance (ICAIF) · doi:10.1145/3383455.3422544 · Cited by 52
Stochastic Frequency Masking to Improve Super-Resolution and Denoising Networks
Helou, M. E., Zhou, R., & Susstrunk, S. E. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58517-4_44 · Cited by 52
AlignNet: A Unifying Approach to Audio-Visual Alignment
Wang, J., Fang, Z., & Zhao, H. (2020) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv45572.2020.9093345 · Cited by 52
Transformer-Based End-to-End Speech Recognition with Local Dense Synthesizer Attention
Xu, M., Li, S., & Zhang, X.-L. (2021) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp39728.2021.9414353 · Cited by 52
Self-Supervised Representations Improve End-to-End Speech Translation
Wu, A., Wang, C., Pino, J., & Gu, J. (2020) · Interspeech (USB) · doi:10.21437/interspeech.2020-3094 · Cited by 52
BiQGEMM: Matrix Multiplication with Lookup Table for Binary-Coding-Based Quantized DNNs
Jeon, Y., Park, B., Kwon, S. J., Kim, B., Yun, J., & Lee, D. (2020) · International Conference for High Performance Computing, Networking, Storage and Analysis (SC) · doi:10.1109/sc41405.2020.00099 · Cited by 52
Improving RNN Transducer Based ASR with Auxiliary Tasks
Liu, C., Zhang, F., Le, D., Kim, S., Saraf, Y., & Zweig, G. (2021) · IEEE Spoken Language Technology Workshop (SLT) · doi:10.1109/slt48900.2021.9383548 · Cited by 52
SilentSpeller: Towards mobile, hands-free, silent speech text entry using electropalatography
Kimura, N., Gemicioglu, T., Womack, J., Li, R. Z., Zhao, Y., Bedri, A., Su, Z., Olwal, A., Rekimoto, J., & Starner, T. E. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3502015 · Cited by 52
Fan, R., & Alwan, A. A. (2022) · Interspeech (USB) · doi:10.21437/interspeech.2022-11128 · Cited by 52
Transformer Transducer: One Model Unifying Streaming and Non-streaming Speech RecognitionPreprint
Tripathi, A., Kim, J., Zhang, Q., Han, L., & Sak, H. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.03192 · Cited by 52
Hallucinations in Neural Automatic Speech Recognition: Identifying Errors and Hallucinatory ModelsPreprint
Frieske, R., & Shi, B. E. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2401.01572 · Cited by 52
Multitask Learning From Augmented Auxiliary Data for Improving Speech Emotion Recognition
Latif, S., Rana, R. K., Khalifa, S., Jurdak, R., & Schuller, B. W. (2022) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2022.3221749 · Cited by 51
Mixture of Informed Experts for Multilingual Speech Recognition
Gaur, N., Farris, B., Haghani, P., Leal, I., Moreno, P. J., Prasad, M., Ramabhadran, B., & Zhu, Y. (2021) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp39728.2021.9414379 · Cited by 51
He, M., Raj, D., Huang, Z., Du, J., Chen, Z., & Watanabe, S. (2021) · Interspeech (USB) · doi:10.21437/interspeech.2021-750 · Cited by 51
Multiclass Language Identification using Deep Learning on Spectral Images of Audio SignalsPreprint
Revay, S., & Teschke, M. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.04348 · Cited by 51
USC: An Open-Source Uzbek Speech Corpus and Initial Speech Recognition Experiments
Musaev, M., Mussakhojayeva, S., Khujayorov, I., Khassanov, Y., Ochilov, M., & Varol, H. A. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-87802-3_40 · Cited by 50
End-to-End Speech Summarization Using Restricted Self-Attention
Sharma, R., Palaskar, S., Black, A. W., & Metze, F. (2022) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp43922.2022.9747320 · Cited by 50
Hsu, W.-N., Remez, T., Shi, B., Donley, J., & Adi, Y. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01802 · Cited by 50
Coppock, H., Nicholson, G., Kiskin, I., Koutra, V., Baker, K., Budd, J., Payne, R., Karoune, E., Hurley, D., Titcomb, A., et al. (2024) · Nature Machine Intelligence · doi:10.1038/s42256-023-00773-8 · Cited by 50
Dynamic Convolutional Neural Networks as Efficient Pre-Trained Audio Models
Schmid, F. T., Koutini, K., & Widmer, G. (2024) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2024.3376984 · Cited by 50
ASiT: Local-Global Audio Spectrogram Vision Transformer for Event Classification
Ahmed, S. A. A., Awais, M., Wang, W., Plumbley, M. D., & Kittler, J. (2024) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2024.3428908 · Cited by 50
DEJA-VU: Double Feature Presentation and Iterated Loss in Deep Transformer Networks
Tjandra, A., Liu, C., Zhang, F., Zhang, X., Wang, Y.-Q., Synnaeve, G., Nakamura, S., & Zweig, G. (2020) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp40776.2020.9052964 · Cited by 50
Speaker Augmentation for Low Resource Speech Recognition
Du, C., & Yu, K. (2020) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp40776.2020.9053139 · Cited by 50
CASS-NAT: CTC Alignment-Based Single Step Non-Autoregressive Transformer for Speech Recognition
Fan, R., Chu, W., Chang, P., & Xiao, J. Z. (2021) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp39728.2021.9413429 · Cited by 50
A Unified Analysis of Mixed Sample Data Augmentation: A Loss Function Perspective
Park, C., Yun, S., & Yun, S. (2022) · neural information processing systems · doi:10.52202/068431-2573 · Cited by 50
Viewmaker Networks: Learning Views for Unsupervised Representation LearningPreprint
Tamkin, A., Wu, M., & Goodman, N. D. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.07432 · Cited by 50
Sun, Y., Midori Maeda, T., Solís-Lemus, C., Pimentel-Alarcón, D., & Buřivalová, Z. (2022) · Ecological Indicators · doi:10.1016/j.ecolind.2022.109621 · Cited by 49
Parameter Efficient Multimodal Transformers for Video Representation Learning
Lee, S., Yu, Y., Kim, G., Breuel, T., Kautz, J., & Song, Y. (2020) · arXiv · doi:10.48550/arxiv.2012.04124 · Cited by 49
A Survey on Artificial Intelligence-Based Acoustic Source Identification
Zaheer, R., Ahmad, I., Habibi, D., Islam, K. Y., & Phung, Q. V. (2023) · IEEE Access · doi:10.1109/access.2023.3283982 · Cited by 49
SAN-M: Memory Equipped Self-Attention for End-to-End Speech Recognition
Gao, Z., Zhang, S., Lei, M., & McLoughlin, I. V. (2020) · Interspeech (USB) · doi:10.21437/interspeech.2020-2471 · Cited by 49
Zeineldeen, M., Владимирович, Г. А., Michel, W., Zeyer, A., Schlüter, R., & Ney, H. (2021) · Interspeech (USB) · doi:10.21437/interspeech.2021-1255 · Cited by 49
Multistream CNN for Robust Acoustic Modeling
Han, K. J., Pan, J. S., Tadala, V. K. N., Ma, T., & Povey, D. (2021) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp39728.2021.9414639 · Cited by 49
Improving the Adversarial Robustness for Speaker Verification by Self-Supervised Learning
Wu, H., Xu, L., Liu, A. T., Wu, Z., Meng, H. M. L., & Lee, H.-Y. (2021) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2021.3133189 · Cited by 49
MERaLiON-AudioLLM: Bridging Audio and Language with Large Language ModelsPreprint
He, Y., Liu, Z., Sun, S., Wang, B., Zhang, W., Zou, X., Chen, N. F., & Aw, A. T. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2412.09818 · Cited by 49
Reza, S., Ferreira, M. C., Machado, J. J. M., & Tavares, J. M. R. S. (2022) · Expert Systems with Applications · doi:10.1016/j.eswa.2022.119293 · Cited by 48
Multilingual Speech Recognition for Turkic Languages
Mussakhojayeva, S., Dauletbek, K., Yeshpanov, R., & Varol, H. A. (2023) · Information · doi:10.3390/info14020074 · Cited by 48
Ma, H., Peng, Z., Xu, L., Shao, M., Wu, X., & Liu, J. (2024) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2024.3497586 · Cited by 48
End-to-End Speech-to-Text Translation: A Survey
Sethiya, N., & Maurya, C. K. (2024) · Computer Speech & Language · doi:10.1016/j.csl.2024.101751 · Cited by 48
AudioProtoPNet: An interpretable deep learning model for bird sound classification
Heinrich, R., Rauch, L., Sick, B., & Scholz, C. (2025) · Ecological Informatics · doi:10.1016/j.ecoinf.2025.103081 · Cited by 48
emg2qwerty: A Large Dataset with Baselines for Touch Typing using Surface Electromyography
Sivakumar, V., Seely, J., Du, A., Bittner, S. R., Berenzweig, A., Bolarinwa, A., Gramfort, A., & Mandel, M. (2024) · neural information processing systems · doi:10.52202/079017-2899 · Cited by 48
Investigation of Specaugment for Deep Speaker Embedding Learning
Wang, S., Rohdin, J., Plchot, O., Burget, L., Yu, K., & Černocký, J. (2020) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp40776.2020.9053481 · Cited by 48
Acoustic Modeling Based on Deep Learning for Low-Resource Speech Recognition: An Overview
Yu, C., Kang, M., Chen, Y., Wu, J., & Zhao, X. (2020) · IEEE Access · doi:10.1109/access.2020.3020421 · Cited by 48
Super-Human Performance in Online Low-Latency Recognition of Conversational Speech
Nguyen, T., Stüker, S., & Waibel, A. (2021) · Interspeech (USB) · doi:10.21437/interspeech.2021-1114 · Cited by 48
End-to-End Speech Translation with Pre-trained Models and Adapters: UPC at IWSLT 2021
Gállego, G. I., Tsiamas, I., Escolano, C., Fonollosa, J. A. R., & Costa‐jussà, M. R. (2021) · International Conference on Spoken Language Translation (IWSLT) · doi:10.18653/v1/2021.iwslt-1.11 · Cited by 48
Advanced Long-Context End-to-End Speech Recognition Using Context-Expanded Transformers
Hori, T., Moritz, N., Hori, C., & Roux, J. L. (2021) · Interspeech (USB) · doi:10.21437/interspeech.2021-1643 · Cited by 48
BAT: Block and token self-attention for speech emotion recognition
Lei, J., Zhu, X., & Wang, Y. (2022) · Neural Networks · doi:10.1016/j.neunet.2022.09.022 · Cited by 48
Sheikh, S. A., Sahidullah, M., Hirsch, F., & Ouni, S. (2023) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2023.3248281 · Cited by 48
Towards Universal Speech Discrete Tokens: A Case Study for ASR and TTS
Yang, Y., Shen, F., Du, C., Ma, Z., Yu, K., Povey, D., & Chen, X. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10447751 · Cited by 48
RNN-T For Latency Controlled ASR With Improved Beam SearchPreprint
Jain, M., Schubert, K., Mahadeokar, J., Yeh, C.-F., Kalgaonkar, K., Sriram, A., Fuegen, C., & Seltzer, M. L. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1911.01629 · Cited by 48
AcFormer: An Aligned and Compact Transformer for Multimodal Sentiment Analysis
Zong, D., Ding, C., Li, B., Li, J., Zheng, K., & Zhou, Q. (2023) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3581783.3611974 · Cited by 47
Ding, W., Liu, A., Guan, L., & Chen, X. (2024) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2024.3366930 · Cited by 47
Croitoru, F.-A., Ristea, N.-C., Ionescu, R. T., & Sebe, N. (2024) · International Journal of Computer Vision · doi:10.1007/s11263-024-02186-5 · Cited by 47
Kataria, S., Villalba, J., & Dehak, N. (2021) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp39728.2021.9413555 · Cited by 47
Adversarial Defense for Automatic Speaker Verification by Cascaded Self-Supervised Learning Models
Wu, H., Li, X., Liu, A. T., Wu, Z., Meng, H. M. L., & Lee, H.-Y. (2021) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp39728.2021.9413737 · Cited by 47
Robust Laughter Detection in Noisy Environments
Gillick, J., Deng, W., Ryokai, K., & Bamman, D. (2021) · Interspeech (USB) · doi:10.21437/interspeech.2021-353 · Cited by 47
Self-Supervised Speaker Verification with Simple Siamese Network and Self-Supervised Regularization
Sang, M., Li, H., Liu, F., Arnold, A. O., & Wan, L. (2022) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp43922.2022.9747526 · Cited by 47
CMKD: CNN/Transformer-Based Cross-Model Knowledge Distillation for Audio Classification
Gong, Y., Khurana, S., Rouditchenko, A., & Glass, J. R. (2025) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2025.3644853 · Cited by 47
Hong, J. H., Kim, M., Yoo, D., & Ro, Y. M. (2022) · Interspeech (USB) · doi:10.21437/interspeech.2022-11311 · Cited by 47
Bautista, J. L., Lee, Y. K., & Shin, H. S. (2022) · Electronics · doi:10.3390/electronics11233935 · Cited by 47
Lin, G.-T., Li, S.-W. D., & Lee, H.-Y. (2022) · Interspeech (USB) · doi:10.21437/interspeech.2022-600 · Cited by 46
Multidisciplinary Perspectives on Artificial Intelligence and the Law
Antunes, H. S., Freitas, P. M., Oliveira, A. L., Pereira, C. M., de Sequeira, E. V., & Xavier, L. B. (2023) · Law, governance and technology series · doi:10.1007/978-3-031-41264-6 · Cited by 46
Translatotron 3: Speech to Speech Translation with Monolingual Data
Nachmani, E., Levkovitch, A., Ding, Y., Asawaroengchai, C., Zen, H., & Ramanovich, M. T. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10448426 · Cited by 46
RFBoost: Understanding and Boosting Deep WiFi Sensing via Physical Data Augmentation
Hou, W., & Wu, C. (2024) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3659620 · Cited by 46
TIM: A Time Interval Machine for Audio-Visual Action Recognition
Chalk, J., Huh, J., Kazakos, E., Zisserman, A., & Damen, D. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01719 · Cited by 46
Acoustic Scene Classification Using Deep Learning-based Ensemble Averaging
Huang, J., Lu, H., Meyer, P. L., Cordourier-Maruri, H., & Ontiveros, J. A. D. H. (2019) · Detection and Classification of Acoustic Scenes and Events Workshop (DCASE) · doi:10.33682/8rd2-g787 · Cited by 46
TutorNet: Towards Flexible Knowledge Distillation for End-to-End Speech Recognition
Yoon, J. W., Lee, H., Kim, H. Y., Cho, W. I., & Kim, N. S. (2021) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2021.3071662 · Cited by 46
An Investigation of Phone-Based Subword Units for End-to-End Speech Recognition
Wang, W., Wang, G., Bhatnagar, A., Zhou, Y., Xiong, C., & Socher, R. (2020) · Interspeech (USB) · doi:10.21437/interspeech.2020-1873 · Cited by 46
Bai, Y., Yi, J., Tao, J., Tian, Z., Wen, Z., & Zhang, S. (2020) · Interspeech (USB) · doi:10.21437/interspeech.2020-1600 · Cited by 46
Effectively pretraining a speech translation decoder with Machine Translation data
Alinejad, A., & Sarkar, A. (2020) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.644 · Cited by 46
RNN-T Models Fail to Generalize to Out-of-Domain Audio: Causes and Solutions
Chiu, C., Narayanan, A., Han, W., Prabhavalkar, R., Zhang, Y., Jaitly, N., Pang, R., Sainath, T. N., Nguyen, P., Cao, L., et al. (2021) · IEEE Spoken Language Technology Workshop (SLT) · doi:10.1109/slt48900.2021.9383518 · Cited by 46
Self-citationNon-Autoregressive Transformer ASR with CTC-Enhanced Decoder Input
Song, X., Wu, Z., Huang, Y., Weng, C., Su, D., & Meng, H. M. L. (2021) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp39728.2021.9414694 · Cited by 46
SYNT++: Utilizing Imperfect Synthetic Data to Improve Speech Recognition
Hu, T.-Y., Armandpour, M., Shrivastava, A., Chang, J.-H. R., Koppula, H. S., & Tuzel, O. (2022) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp43922.2022.9746217 · Cited by 46
Counterfactually Fair Automatic Speech Recognition
Sar, L., Hasegawa‐Johnson, M., & Yoo, C. D. (2021) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2021.3126949 · Cited by 46
Tambe, T., Yang, E.-Y., Ko, G. G., Chai, Y., Hooper, C. R. C., Donato, M., Whatmough, P. N., Rush, A. M., Brooks, D. M., & Wei, G.-Y. (2022) · IEEE Journal of Solid-State Circuits · doi:10.1109/jssc.2022.3179303 · Cited by 46
A Survey on Text-Dependent and Text-Independent Speaker Verification
Tu, Y., Lin, W., & Mak, M. (2022) · IEEE Access · doi:10.1109/access.2022.3206541 · Cited by 46
Voice Interaction Recognition Design in Real-Life Scenario Mobile Robot Applications
Li, S., Liu, Y., Chen, Y.-C., Feng, H.-M., Shen, P.-K., & Wu, Y.-C. (2023) · Applied Sciences · doi:10.3390/app13053359 · Cited by 46
Automatic speech recognition of conversational speech in individuals with disordered speech
Tobin, J., Nelson, P., MacDonald, B., Heywood, R., Cave, R., Seaver, K., Desjardins, A., Jiang, P.-P., & Green, J. R. (2024) · Journal of Speech, Language, and Hearing Research · doi:10.1044/2024_jslhr-24-00045 · Cited by 45
Metadata
- Authors
- Park, D. S., Chan, W., Zhang, Y., Chiu, C.-C., Zoph, B., Cubuk, E. D., & Le, Q. V.
- Affiliations
- Google (United States) (US)
- Venue
- Interspeech 2019
- Publisher
- ISCA
- Published
- 2019-09-15
- Pages
- 2613-2617
- ISSN
- 2308-457X (ISSN-L)
- OpenAlex
- W2936774411
- Cited by
- 3,558
- References
- 51
- Citations by year
- 2026: 239 · 2025: 415 · 2024: 450 · 2023: 649 · 2022: 603 · 2021: 738 · 2020: 391 · 2019: 69
- FWCI
- 172.29
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- Interspeech (USB) (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Speech Recognition and Synthesis
- Physical Sciences › Computer Science › Signal Processing › Speech and Audio Processing
- Physical Sciences › Computer Science › Signal Processing › Music and Audio Processing
- Keywords
- SpecAugment, data augmentation, speech recognition, frequency masking, feature warping, end-to-end speech recognition, LibriSpeech, switchboards, CALLHOME, word error rate
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.