The DOI matches its Crossref record; 33 of the 33 references it cites were found in a registry or an index.
Conformer: Convolution-augmented Transformer for Speech Recognition
Open accessAbstract
Recently Transformer and Convolution neural network (CNN) based models have shown promising results in Automatic Speech Recognition (ASR), outperforming Recurrent neural networks (RNNs). Transformer models are good at capturing content-based global interactions, while CNNs exploit local features effectively. In this work, we achieve the best of both worlds by studying how to combine convolution neural networks and transformers to model both local and global dependencies of an audio sequence in a parameter-efficient way. To this regard, we propose the convolution-augmented transformer for speech recognition, named Conformer. Conformer significantly outperforms the previous Transformer and CNN based models achieving state-of-the-art accuracies. On the widely used LibriSpeech benchmark, our model achieves WER of 2.1%/4.3% without using a language model and 1.9%/3.9% with an external language model on test/testother. We also observe competitive performance of 2.7%/6.3% with a small model of only 10M parameters.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“In particular, transformer1 and recurrent neural-network transducer (RNNT)12,13,16 models containing up to one billion parameters2 have produced a marked decrease in word error rate (WER) (and therefore much better accuracy) for the automated transcription of spoken English-language sentences, as shown in Fig. 1a for two widely used datasets, Librispeech17 and SwitchBoard18.”
From An analog-AI chip for energy-efficient speech recognition and transcription (2023) · cites this paper as [16]
In the citing paper
“A range of acoustic models that give state-of-the-art performance on these tasks are chosen as the baseline speech recognition systems, including hybrid DNN [41], hybrid lattice-free maximum mutual information (LF-MMI) trained time delay neural network (TDNN) [3] and end-to-end (E2E) Conformer [6] models.”
From Speaker adaptation using spectro-temporal deep features for dysarthric and elderly speech recognition (2022) · cites this paper as [6]
Citations
Cites
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
Self-citationAdam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Squeeze-and-Excitation NetworksPreprint
Hu, J., Shen, L., & Sun, G. (2017) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.48550/arxiv.1709.01507 · Cited by 37,845
(2014) · Cited by 33,419
Squeeze-and-Excitation Networks
Hu, J., Shen, L., Albanie, S., Sun, G., & Wu, E. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2913372 · Cited by 12,157
“Librispeech: an ASR corpus based on public domain audio books,”
Panayotov, V., Chen, G., Povey, D., & Khudanpur, S. (2015) · 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2015.7178964 · Cited by 6,072
SpecAugment: A Simple Data Augmentation Method for Automatic Speech Recognition
Park, D. S., Chan, W., Zhang, Y., Chiu, C.-C., Zoph, B., Cubuk, E. D., & Le, Q. V. (2019) · Interspeech 2019 · doi:10.21437/interspeech.2019-2680 · Cited by 3,558
Self-citationTransformer-XL: Attentive language models beyond a fixed-length context
Dai, Z., Yang, Z., Yang, Y., Carbonell, J., Le, Q., & Salakhutdinov, R. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1285 · Cited by 3,169
Searching for activation functions
Ramachandran, P., Zoph, B., & Le, Q. V. (2017) · arXiv · doi:10.48550/arxiv.1710.05941 · Cited by 2,335
Convolutional Neural Networks for Speech Recognition
Abdel‐Hamid, O., Mohamed, A., Jiang, H., Deng, L., Penn, G., & Yu, D. (2014) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2014.2339736 · Cited by 2,325
Flagged first, then by citations
Cited by
Sorted by citations
Items 101–200 of 1,004
Shi, X. J., Yu, F., Lu, Y., Liang, Y., Feng, Q., Wang, D., Qian, Y., & Xie, L. (2021) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp39728.2021.9413386 · Cited by 74
MAESTRO: Matched Speech Text Representations through Modality Matching
Chen, Z., Zhang, Y., Rosenberg, A., Ramabhadran, B., Moreno, P. J., Bapna, A., & Zen, H. (2022) · Interspeech (USB) · doi:10.21437/interspeech.2022-10937 · Cited by 95
Self-citationShimizu, R., Yamamoto, R., Kawamura, M., Shirahata, Y., Doi, H., Komatsu, T., & Tachibana, K. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10448173 · Cited by 83
Xu, C., Hu, B., Li, Y., Zhang, Y., Huang, S., Ju, Q., Xiao, T., & Zhu, J. (2021) · doi:10.18653/v1/2021.acl-long.204 · Cited by 72
Self-citationKaneko, T., Tanaka, K., Kameoka, H., & Seki, S. (2022) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp43922.2022.9746713 · Cited by 78
A Time-Frequency Attention Module for Neural Speech Enhancement
Zhang, Q., Qian, X., Ni, Z., Nicolson, A., Eliathamby Ambikairajah, A., & Li, H. (2022) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2022.3225649 · Cited by 72
Le, D., Jain, M., Keren, G., Kim, S., Shi, Y., Mahadeokar, J., Chan, J., Shangguan, Y., Fuegen, C., Kalinli, O., et al. (2021) · Interspeech (USB) · doi:10.21437/interspeech.2021-1566 · Cited by 71
Liang, J., Yang, C., Zeng, M., & Wang, X. (2022) · Quantitative Imaging in Medicine and Surgery · doi:10.21037/qims-21-919 · Cited by 71
A GAN Guided Parallel CNN and Transformer Network for EEG Denoising
Jin, Y., Liu, A., Li, C., Qian, R., & Chen, X. (2023) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2023.3277596 · Cited by 71
Machine Learning for Cataract Classification/Grading on Ophthalmic Imaging Modalities: A Survey
Zhang, X.-Q., Hu, Y., Xiao, Z., Fang, J., Higashita, R., & Liu, J. (2022) · Machine Intelligence Research · doi:10.1007/s11633-022-1329-0 · Cited by 89
Nozaki, J., & Komatsu, T. (2021) · Interspeech (USB) · doi:10.21437/interspeech.2021-911 · Cited by 68
Zhi, S., Su, K., Yu, J., Li, X., & Shen, H. (2025) · Structural Health Monitoring · doi:10.1177/14759217251324671 · Cited by 79
Self-citationBao, G., Liu, X., Zou, B., Yang, K., Zhao, J., Zhang, L., Chen, M., Qiao, Y., Wang, W., Tan, R., et al. (2025) · Energy · doi:10.1016/j.energy.2025.135548 · Cited by 65
FastEmit: Low-Latency Streaming ASR with Sequence-Level Emission Regularization
Yu, J., Chiu, C., Li, B., Chang, S.-Y., Sainath, T. N., He, Y., Narayanan, A., Han, W., Gulati, A., Wu, Y., et al. (2021) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp39728.2021.9413803 · Cited by 65
Self-citationMANNER: Multi-View Attention Network For Noise Erasure
Park, H. J., Kang, B. H., Shin, W., Kim, J. S., & Han, S. W. (2022) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp43922.2022.9747120 · Cited by 65
Towards End-to-End Unsupervised Speech Recognition
Liu, A. H., Hsu, W.-N., Auli, M., & Baevski, A. (2023) · IEEE Spoken Language Technology Workshop (SLT) · doi:10.1109/slt54892.2023.10023187 · Cited by 85
SynergyX: a multi-modality mutual attention network for interpretable drug synergy prediction
Guo, Y., Hu, H., Chen, W., Yin, H., Wu, J., Hsieh, C., He, Q., & Cao, J. (2024) · Briefings in Bioinformatics · doi:10.1093/bib/bbae015 · Cited by 68
Transformer technology in molecular science
Jian, J., Ke, L., Chen, L., Dou, B., Zhu, Y., Liu, J., Zhang, B., Zhou, T., & Wei, G. (2024) · Wiley Interdisciplinary Reviews Computational Molecular Science · doi:10.1002/wcms.1725 · Cited by 73
FINDINGS OF THE IWSLT 2021 EVALUATION CAMPAIGN
Anastasopoulos, A., Bojar, O., Bremerman, J., Cattoni, R., Elbayad, M., Federico, M., Ma, X., Nakamura, S., Negri, M., Niehues, J., et al. (2021) · International Conference on Spoken Language Translation (IWSLT) · doi:10.18653/v1/2021.iwslt-1.1 · Cited by 72
Personalized speech enhancement: new models and Comprehensive evaluation
Eskimez, Ş. E., Yoshioka, T., Wang, H., Wang, X., Chen, Z., & Huang, X. (2022) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp43922.2022.9746962 · Cited by 64
Transformer Meets Remote Sensing Video Detection and Tracking: A Comprehensive Survey
Jiao, L., Zhang, X., Liu, X., Liu, F., Yang, S., Ma, W., Li, L., Chen, P., Feng, Z., Guo, Y., et al. (2023) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2023.3289293 · Cited by 68
FusionNet: A Convolution–Transformer Fusion Network for Hyperspectral Image Classification
Yang, L., Yang, Y., Yang, J., Zhao, N., Wu, L., Wang, L., & Wang, T. (2022) · Remote Sensing · doi:10.3390/rs14164066 · Cited by 66
MobileCLIP: Fast Image-Text Models through Multi-Modal Reinforced Training
Vasu, P. K. A., Pouransari, H., Faghri, F., Vemulapalli, R., & Tuzel, O. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01511 · Cited by 81
Microsoft Speaker Diarization System for the Voxceleb Speaker Recognition Challenge 2020
Xiao, X., Kanda, N., Chen, Z., Zhou, T., Yoshioka, T., Chen, S., Zhao, Y. H., Liu, G., Wu, Y., Wu, J., et al. (2021) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp39728.2021.9413832 · Cited by 61
Self-citationMasked Language Modeling for Proteins via Linearly Scalable Long-Context TransformersPreprint
Choromański, K., Likhosherstov, V., Dohan, D., Song, X., Gane, A., Sarlós, T., Hawkins, P., Davis, J. Q., Belanger, D., Colwell, L. J., et al. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.03555 · Cited by 108
VoxSRC 2020: The Second VoxCeleb Speaker Recognition ChallengePreprint
Nagrani, A., Chung, J. S., Huh, J., Brown, A., Coto, E., Xie, W., McLaren, M., Reynolds, D. A., & Zisserman, A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2012.06867 · Cited by 69
Cascaded Encoders for Unifying Streaming and Non-Streaming ASR
Narayanan, A., Sainath, T. N., Pang, R., Yu, J., Chiu, C., Prabhavalkar, R., Variani, E., & Strohman, T. (2021) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp39728.2021.9414607 · Cited by 59
Self-citationLocalTrans: A Multiscale Local Transformer Network for Cross-Resolution Homography Estimation
Shao, R., Wu, G., Zhou, Y., Fu, Y., Fang, L., & Liu, Y. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01462 · Cited by 59
Length-Adaptive Transformer: Train Once with Length Drop, Use Anytime with Search
Kim, G., & Cho, K. (2021) · Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · doi:10.18653/v1/2021.acl-long.508 · Cited by 59
NTIRE 2022 Challenge on Perceptual Image Quality Assessment
Gu, J., Cai, H., Dong, C., Ren, J., Timofte, R., Gong, Y., Lao, S., Shi, S., Wang, J., Yang, S., et al. (2022) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw56347.2022.00109 · Cited by 63
Self-citationYang, C.-H. H., Gu, Y., Liu, Y.-C., Ghosh, S., Bulyko, I., & Stolcke, A. (2023) · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru57964.2023.10389673 · Cited by 68
FINDINGS OF THE IWSLT 2023 EVALUATION CAMPAIGN
Agarwal, M., Agrawal, S., Anastasopoulos, A., Bentivogli, L., Bojar, O., Borg, C., Carpuat, M. J., Cattoni, R., Cettolo, M., Chen, M., et al. (2023) · International Conference on Spoken Language Translation (IWSLT) · doi:10.18653/v1/2023.iwslt-1.1 · Cited by 57
Scaling End-to-End Models for Large-Scale Multilingual ASR
Li, B., Pang, R., Sainath, T. N., Gulati, A., Zhang, Y., Qin, J., Haghani, P., Huang, W., Ma, M., & Bai, J. (2021) · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru51503.2021.9687871 · Cited by 69
Self-citationCross-lingual Self-Supervised Speech Representations for Improved Dysarthric Speech Recognition
Hernandez, A., Pérez-Toro, P. A., Nöth, E., Orozco‐Arroyave, J. R., Maier, A., & Yang, S. H. (2022) · Interspeech (USB) · doi:10.21437/interspeech.2022-10674 · Cited by 57
Swin-fusion: An adaptive multi-source information fusion framework for enhanced tool wear monitoring
Hou, K., Li, R., Liu, X., Yue, C., Wang, Y., Liu, X., & Xia, W. (2025) · Journal of Manufacturing Systems · doi:10.1016/j.jmsy.2025.02.003 · Cited by 59
Rethinking Evaluation in ASR: Are Our Models Robust Enough?
Likhomanenko, T., Xu, Q., Pratap, V., Tomasello, P., Kahn, J., Avidov, G., Collobert, R., & Synnaeve, G. (2021) · Interspeech (USB) · doi:10.21437/interspeech.2021-1758 · Cited by 56
Lessons on Parameter Sharing across Layers in Transformers
Takase, S., & Kiyono, S. (2023) · Workshop on Simple and Efficient Natural Language Processing (SustaiNLP) · doi:10.18653/v1/2023.sustainlp-1.5 · Cited by 106
Automatic Speech Recognition: A survey of deep learning techniques and approaches
Ahlawat, H., Aggarwal, N., & Gupta, D. (2025) · International Journal of Cognitive Computing in Engineering · doi:10.1016/j.ijcce.2024.12.007 · Cited by 86
An Exploration of Self-Supervised Pretrained Representations for End-to-End Speech Recognition
Chang, X., Maekaku, T., Guo, P., Shi, J. Y., Lu, Y.-J., Subramanian, A. S., Wang, T., Yang, S.-W., Tsao, Y., Lee, H.-Y., et al. (2021) · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru51503.2021.9688137 · Cited by 64
Overview of Voice Conversion Methods Based on Deep Learning
Walczyna, T., & Piotrowski, Z. (2023) · Applied Sciences · doi:10.3390/app13053100 · Cited by 54
A survey on state-of-the-art deep learning applications and challenges
Noor, M. H. M., & Ige, A. O. (2025) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2025.111225 · Cited by 103
SLAM: A Unified Encoder for Speech and Language Modeling via Speech-Text Joint Pre-TrainingPreprint
Bapna, A., Chung, Y.-A., Wu, N., Gulati, A., Ye, J., Clark, J. H., Johnson, M., Riesa, J., Conneau, A., & Zhang, Y. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.10329 · Cited by 95
Self-citationHow Much Temporal Long-Term Context is Needed for Action Segmentation?
Bahrami, E., Francesca, G., & Gall, J. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00950 · Cited by 57
Deep learning with multi-scale temporal hybrid structure for robust crop mapping
Tang, P., Chanussot, J., Guo, S., Zhang, W., Qie, L., Zhang, P., Fang, H., & Du, P. (2024) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2024.01.025 · Cited by 53
Fu, Y., Liu, Y., Li, J., Luo, D., Lv, S., Jv, Y., & Xie, L. (2022) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp43922.2022.9746020 · Cited by 52
He, S., Yang, H., Zhang, X., & Li, X. (2023) · Mathematics · doi:10.3390/math11030722 · Cited by 53
LiteFormer: A Lightweight and Efficient Transformer for Rotating Machine Fault Diagnosis
Sun, W., Yan, R., Jin, R., Xu, J., Yang, Y., & Chen, Z. (2023) · IEEE Transactions on Reliability · doi:10.1109/tr.2023.3322860 · Cited by 56
Zhu, J., Ma, J., & Wu, J. (2024) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2024.108161 · Cited by 53
Harnessing AI for solar energy: Emergence of transformer models
Hanif, M. F., & Mi, J. (2024) · Applied Energy · doi:10.1016/j.apenergy.2024.123541 · Cited by 58
Advances in smart food authentication for enhanced safety and quality
Bhat, M. A., Rather, M. Y., Singh, P., Hassan, S., & Hussain, N. (2024) · Trends in Food Science & Technology · doi:10.1016/j.tifs.2024.104800 · Cited by 57
Audio-Visual Efficient Conformer for Robust Speech Recognition
Burchi, M., & Timofte, R. (2023) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv56688.2023.00229 · Cited by 54
Fu, Y., Dong, S., Niu, M., Xue, L., Guo, H., Huang, Y., Xu, Y., Yu, T., Shi, K., Yang, Q., et al. (2023) · Medical Image Analysis · doi:10.1016/j.media.2023.102787 · Cited by 51
Trends and developments in automatic speech recognition research
O’Shaughnessy, D. D. (2023) · Computer Speech & Language · doi:10.1016/j.csl.2023.101538 · Cited by 72
Improved Mask-CTC for Non-Autoregressive End-to-End ASR
Higuchi, Y., Inaguma, H., Watanabe, S., Ogawa, T., & Kobayashi, T. (2021) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp39728.2021.9414198 · Cited by 54
Transformer-based map-matching model with limited labeled data using transfer-learning approach
Jin, Z., Kim, J., Yeo, H., & Choi, S. (2022) · Transportation Research Part C Emerging Technologies · doi:10.1016/j.trc.2022.103668 · Cited by 58
Multi Scale Graph Wavenet for Wind Speed Forecasting
Rathore, N., Rathore, P. K., Basak, A., Nistala, S. H., & Runkana, V. (2021) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata52589.2021.9671624 · Cited by 50
Zhang, C., Wang, X., Zhang, H., Zhang, H., & Han, P. (2021) · IEEE Transactions on Network and Service Management · doi:10.1109/tnsm.2021.3125967 · Cited by 49
ESPnet-SLU: Advancing Spoken Language Understanding Through ESPnet
Arora, S., Dalmia, S., Denisov, P., Chang, X., Ueda, Y., Peng, Y., Zhang, Y., Kumar, S., Ganesan, K., Yan, B., et al. (2022) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp43922.2022.9747674 · Cited by 51
Self-citationS2VC: A Framework for Any-to-Any Voice Conversion with Self-Supervised Pretrained Representations
Lin, J.-H., Lin, Y. Y., Chien, C.-M., & Lee, H.-Y. (2021) · Interspeech (USB) · doi:10.21437/interspeech.2021-1356 · Cited by 58
Contextual Adapters for Personalized Speech Recognition in Neural Transducers
Sathyendra, K. M., Muniyappa, T., Chang, F.-J., Liu, J., Su, J., Strimel, G. P., Mouchtaris, A., & Kunzmann, S. (2022) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp43922.2022.9746126 · Cited by 49
Exploring Self-Attention Mechanisms for Speech Separation
Subakan, C., Ravanelli, M., Cornell, S., Grondin, F., & Bronzi, M. (2023) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2023.3282097 · Cited by 58
Ochieng, P. J. (2023) · Artificial Intelligence Review · doi:10.1007/s10462-023-10612-2 · Cited by 61
GDALR: Global Dual Attention and Local Representations in transformer for surface defect detection
Zhou, X., Zhou, S., Zhang, Y., Ren, Z., Jiang, Z., & Luo, H. (2024) · Measurement · doi:10.1016/j.measurement.2024.114398 · Cited by 50
Self-citationChen, C., Gao, R., Calamia, P. T., & Grauman, K. L. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01829 · Cited by 48
Hformer: highly efficient vision transformer for low-dose CT denoising
Zhang, S., Wang, Z.-X., Yang, H., Chen, Y.-L., Li, Y., Pan, Q., Wang, H., & Zhao, C. (2023) · Nuclear Science and Techniques · doi:10.1007/s41365-023-01208-0 · Cited by 53
A survey of FPGA and ASIC designs for transformer inference acceleration and optimization
Kang, B. J., Lee, H. I., Yoon, S. K., Kim, Y. C., Jeong, S. B., Jeong, S. B., & Kim, H. (2024) · Journal of Systems Architecture · doi:10.1016/j.sysarc.2024.103247 · Cited by 54
Unified Streaming and Non-streaming Two-pass End-to-end Model for Speech RecognitionPreprint
Zhang, B., Wu, D., Yao, Z., Wang, X., Yu, F., Yang, C., Guo, L., Hu, Y., Xie, L., & Lei, X. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2012.05481 · Cited by 48
Dual-mode ASR: Unify and Improve Streaming ASR with Full-context ModelingPreprint
Yu, J., Han, W., Gulati, A., Chiu, C., Li, B., Sainath, T. N., Wu, Y., & Pang, R. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.06030 · Cited by 55
Self-citationA conformer-based classifier for variable-length utterance processing in anti-spoofing
Rosello, E., Gomez-Alanis, A., Gomez, A. M., & Peinado, A. (2023) · INTERSPEECH 2023 · doi:10.21437/interspeech.2023-1820 · Cited by 47
Geng, M., Xie, X., Ye, Z., Wang, T., Li, G., Hu, S., Liu, X., & Meng, H. (2022) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2022.3195113 · Cited by 48
Interactive Feature Fusion for End-to-End Noise-Robust Speech Recognition
Hu, Y., Hou, N., Chen, C., & Chng, E. S. (2022) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp43922.2022.9746314 · Cited by 48
Pruned RNN-T for fast, memory-efficient ASR training
Kuang, F., Guo, L., Kang, W., Lin, L., Luo, M., Yao, Z., & Povey, D. (2022) · Interspeech (USB) · doi:10.21437/interspeech.2022-10340 · Cited by 47
Transformer-based multi-attention hybrid networks for skin lesion segmentation
Dong, Z.-W., Li, J., & Hua, Z. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.123016 · Cited by 47
Weakly Supervised Object Localization via Transformer with Implicit Spatial Calibration
Bai, H., Zhang, R., Wang, J., & Wan, X. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-20077-9_36 · Cited by 46
Masked Spectrogram Prediction for Self-Supervised Audio Pre-Training
Chong, D., Wang, H., Zhou, P., & Zeng, Q. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10095691 · Cited by 67
Majumdar, S., Balam, J., Hrinchuk, O., Lavrukhin, V., Noroozi, V., & Ginsburg, B. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2104.01721 · Cited by 46
Automated audio captioning: an overview of recent progress and new challenges
Mei, X., Liu, X., Plumbley, M. D., & Wang, W. (2022) · EURASIP Journal on Audio Speech and Music Processing · doi:10.1186/s13636-022-00259-2 · Cited by 54
Personalized Adversarial Data Augmentation for Dysarthric and Elderly Speech Recognition
Jin, Z., Geng, M., Deng, J., Wang, T., Hu, S., Li, G., & Liu, X. (2023) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2023.3323888 · Cited by 52
Exploiting Multiple Sequence Lengths in Fast End to End Training for Image Captioning
Hu, J. C., Cavicchioli, R., & Capotondi, A. (2023) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata59044.2023.10386812 · Cited by 54
LiRA: Learning Visual Speech Representations from Audio Through Self-Supervision
Ma, P., Mira, R., Petridis, S., Schuller, B. W., & Pantić, M. (2021) · Interspeech (USB) · doi:10.21437/interspeech.2021-1360 · Cited by 50
Seamless: Multilingual Expressive and Streaming Speech Translation
Communication, S., Barrault, L., Chung, Y.-A., Meglioli, M. C., Dale, D., Dong, N., Duppenthaler, M., Duquenne, P.-A., Ellis, B., Elsahar, H., et al. (2023) · arXiv · doi:10.48550/arxiv.2312.05187 · Cited by 45
Self-citationTransformers Meet Small Datasets
Shao, R., & Bi, X. (2022) · IEEE Access · doi:10.1109/access.2022.3221138 · Cited by 46
CCFT: The Convolution and Cross-Fusion Transformer for Fault Diagnosis of Bearings
Lin, T., Zhu, Y., Ren, Z., Huang, K., & Gao, D. (2023) · IEEE/ASME Transactions on Mechatronics · doi:10.1109/tmech.2023.3312935 · Cited by 44
Streaming Transformer Asr With Blockwise Synchronous Beam Search
Tsunoo, E., Kashiwagi, Y., & Watanabe, S. (2021) · IEEE Spoken Language Technology Workshop (SLT) · doi:10.1109/slt48900.2021.9383517 · Cited by 44
Sainburg, T., & Gentner, T. Q. (2021) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2021.811737 · Cited by 48
A Survey on Physical Adversarial Attack in Computer VisionPreprint
Wang, D., Yao, W., Jiang, T., Tang, G., & Chen, X. (2023) · Research Square · doi:10.21203/rs.3.rs-2459893/v1 · Cited by 72
A generic noninvasive neuromotor interface for human-computer interactionPreprint
Labs, C.-L. A. R., Sussillo, D., Kaifosh, P., & Reardon, T. R. (2024) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2024.02.23.581779 · Cited by 44
JETS: Jointly Training FastSpeech2 and HiFi-GAN for End to End Text to Speech
Lim, D., Jung, S., & Kim, E. (2022) · Interspeech (USB) · doi:10.21437/interspeech.2022-10294 · Cited by 43
DeFT-AN: Dense Frequency-Time Attentive Network for Multichannel Speech Enhancement
Lee, D., & Choi, J. (2023) · IEEE Signal Processing Letters · doi:10.1109/lsp.2023.3244428 · Cited by 43
Jain, R., Barcovschi, A., Yiwere, M. Y., Bigioi, D., Corcoran, P., & Cucu, H. (2023) · IEEE Access · doi:10.1109/access.2023.3275106 · Cited by 43
Ryumin, D., Axyonov, A., Рюмина, Е. В., Ivanko, D., Kashevnik, A. M., & Karpov, A. A. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2024.124159 · Cited by 48
The Codecfake Dataset and Countermeasures for the Universally Detection of Deepfake Audio
Xie, Y., Lu, Y., Fu, R., Wen, Z., Wang, Z., Tao, J., Qi, X., Wang, X., Liu, Y., Cheng, H., et al. (2025) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/taslpro.2025.3525966 · Cited by 67
Transformer-Based End-to-End Speech Recognition with Local Dense Synthesizer Attention
Xu, M., Li, S., & Zhang, X.-L. (2021) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp39728.2021.9414353 · Cited by 43
Zhang, Q., Shi, L., Liu, P., Zhu, Z., & Xu, L. (2022) · Applied Intelligence · doi:10.1007/s10489-022-03343-4 · Cited by 43
RetractedOn the Limit of English Conversational Speech Recognition
Tüske, Z., Saon, G., & Kingsbury, B. (2021) · Interspeech 2021 · doi:10.21437/interspeech.2021-211 · Cited by 41
A Comparative Study on Non-Autoregressive Modelings for Speech-to-Text Generation
Higuchi, Y., Chen, N., Fujita, Y., Inaguma, H., Komatsu, T., Lee, J., Nozaki, J., Wang, T., & Watanabe, S. (2021) · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru51503.2021.9688157 · Cited by 43
VQTTS: High-Fidelity Text-to-Speech Synthesis with Self-Supervised VQ Acoustic Feature
Du, C., Guo, Y., Chen, X., & Yu, K. (2022) · Interspeech (USB) · doi:10.21437/interspeech.2022-489 · Cited by 56
BAT: Block and token self-attention for speech emotion recognition
Lei, J., Zhu, X., & Wang, Y. (2022) · Neural Networks · doi:10.1016/j.neunet.2022.09.022 · Cited by 44
Zhong, X., Gu, Y., Luo, Y., Zeng, X., & Liu, G. (2022) · Applied Intelligence · doi:10.1007/s10489-022-04228-2 · Cited by 43
End-to-End Multi-Modal Speech Recognition on an Air and Bone Conducted Speech Corpus
Wang, M., Chen, J., Zhang, X.-L., & Rahardja, S. (2022) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2022.3224305 · Cited by 42
Metadata
- Authors
- Gulati, A., Qin, J., Chiu, C.-C., Parmar, N., Zhang, Y., Yu, J., Han, W., Wang, S., Zhang, Z., Wu, Y., & Pang, R.
- Affiliations
- Google (United States) (US)
- ORCID
- Venue
- Interspeech 2020
- Publisher
- ISCA
- Published
- 2020-10-25
- Pages
- 5036-5040
- ISSN
- 2308-457X (ISSN-L)
- OpenAlex
- W3097777922
- Cited by
- 3,150
- References
- 33
- Citations by year
- 2026: 373 · 2025: 666 · 2024: 644 · 2023: 708 · 2022: 424 · 2021: 300 · 2020: 35
- FWCI
- 140.10
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- public-domain
- Locations
- Interspeech (USB) (publishedVersion)
- arXiv (Cornell University) (submittedVersion, public-domain)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Speech Recognition and Synthesis
- Physical Sciences › Computer Science › Signal Processing › Speech and Audio Processing
- Physical Sciences › Computer Science › Signal Processing › Music and Audio Processing
- Keywords
- conformational isomers, speech recognition, CNN-Transformer hybrid, parameter-efficient models, LibriSpeech, word error rate
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
