The DOI matches its Crossref record; 33 of the 33 references it cites were found in a registry or an index.
Conformer: Convolution-augmented Transformer for Speech Recognition
Open accessAbstract
Recently Transformer and Convolution neural network (CNN) based models have shown promising results in Automatic Speech Recognition (ASR), outperforming Recurrent neural networks (RNNs). Transformer models are good at capturing content-based global interactions, while CNNs exploit local features effectively. In this work, we achieve the best of both worlds by studying how to combine convolution neural networks and transformers to model both local and global dependencies of an audio sequence in a parameter-efficient way. To this regard, we propose the convolution-augmented transformer for speech recognition, named Conformer. Conformer significantly outperforms the previous Transformer and CNN based models achieving state-of-the-art accuracies. On the widely used LibriSpeech benchmark, our model achieves WER of 2.1%/4.3% without using a language model and 1.9%/3.9% with an external language model on test/testother. We also observe competitive performance of 2.7%/6.3% with a small model of only 10M parameters.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“In particular, transformer1 and recurrent neural-network transducer (RNNT)12,13,16 models containing up to one billion parameters2 have produced a marked decrease in word error rate (WER) (and therefore much better accuracy) for the automated transcription of spoken English-language sentences, as shown in Fig. 1a for two widely used datasets, Librispeech17 and SwitchBoard18.”
From An analog-AI chip for energy-efficient speech recognition and transcription (2023) · cites this paper as [16]
In the citing paper
“A range of acoustic models that give state-of-the-art performance on these tasks are chosen as the baseline speech recognition systems, including hybrid DNN [41], hybrid lattice-free maximum mutual information (LF-MMI) trained time delay neural network (TDNN) [3] and end-to-end (E2E) Conformer [6] models.”
From Speaker adaptation using spectro-temporal deep features for dysarthric and elderly speech recognition (2022) · cites this paper as [6]
Citations
Cites
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
Self-citationAdam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Squeeze-and-Excitation NetworksPreprint
Hu, J., Shen, L., & Sun, G. (2017) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.48550/arxiv.1709.01507 · Cited by 37,845
(2014) · Cited by 33,419
Squeeze-and-Excitation Networks
Hu, J., Shen, L., Albanie, S., Sun, G., & Wu, E. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2913372 · Cited by 12,157
“Librispeech: an ASR corpus based on public domain audio books,”
Panayotov, V., Chen, G., Povey, D., & Khudanpur, S. (2015) · 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2015.7178964 · Cited by 6,072
SpecAugment: A Simple Data Augmentation Method for Automatic Speech Recognition
Park, D. S., Chan, W., Zhang, Y., Chiu, C.-C., Zoph, B., Cubuk, E. D., & Le, Q. V. (2019) · Interspeech 2019 · doi:10.21437/interspeech.2019-2680 · Cited by 3,558
Self-citationTransformer-XL: Attentive language models beyond a fixed-length context
Dai, Z., Yang, Z., Yang, Y., Carbonell, J., Le, Q., & Salakhutdinov, R. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1285 · Cited by 3,169
Searching for activation functions
Ramachandran, P., Zoph, B., & Le, Q. V. (2017) · arXiv · doi:10.48550/arxiv.1710.05941 · Cited by 2,335
Convolutional Neural Networks for Speech Recognition
Abdel‐Hamid, O., Mohamed, A., Jiang, H., Deng, L., Penn, G., & Yu, D. (2014) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2014.2339736 · Cited by 2,325
Flagged first, then by citations
Cited by
Sorted by citations
Items 501–600 of 1,004
CAPE: Encoding Relative Positions with Continuous Augmented Positional EmbeddingsPreprint
Likhomanenko, T., Xu, Q., Synnaeve, G., Collobert, R., & Rogozhnikov, A. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.03143 · Cited by 20
A Survey of Reasoning with Foundation ModelsPreprint
Sun, J., Zheng, C., Xie, E., Liu, Z., Chu, R., Liu, J., Xu, J., Ding, M., Li, H., Geng, M., et al. (2023) · OSF Preprints (OSF Preprints) · doi:10.31219/osf.io/ac4sp · Cited by 143
Self-citationRIMformer: An End-to-End Transformer for FMCW Radar Interference Mitigation
Zhang, Z., Chen, G., Weng, Y., Yang, S., Jia, Z., & Chen, J. (2024) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2024.3487855 · Cited by 18
Self-citationZhang, K., Hua, Z., Zhang, Y., Guo, Y., & Xiang, T. (2024) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2024.3520001 · Cited by 17
Self-citationWang, Y., Zhang, P., Liu, X., Tu, Z., & Lu, H. (2025) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2024.3521974 · Cited by 21
Multichannel Speech Separation with Narrow-band Conformer
Quan, C., & Li, X. (2022) · Interspeech (USB) · doi:10.21437/interspeech.2022-10018 · Cited by 17
Chen, Z., Zhang, Y., Rosenberg, A., Ramabhadran, B., Moreno, P. J., & Wang, G. (2022) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp43922.2022.9746475 · Cited by 17
Self-citationMusic-to-Dance Generation with Multiple Conformer
Zhang, M., Liu, C., Chen, Y., Lei, Z., & Wang, M. (2022) · International Conference on Multimedia Retrieval · doi:10.1145/3512527.3531430 · Cited by 17
SVTS: Scalable Video-to-Speech Synthesis
Mira, R., Haliassos, A., Petridis, S., Schuller, B. W., & Pantić, M. (2022) · Interspeech (USB) · doi:10.21437/interspeech.2022-10770 · Cited by 23
Fu, C., Liu, C., Ishi, C. T., & Ishiguro, H. (2022) · Speech Communication · doi:10.1016/j.specom.2022.09.002 · Cited by 17
Adaptive multilingual speech recognition with pretrained models
Pham, N.-Q., Waibel, A. H., & Niehues, J. (2022) · Interspeech (USB) · doi:10.21437/interspeech.2022-872 · Cited by 24
A Hierarchical Attention-Based Method for Sleep Staging Using Movement and Cardiopulmonary Signals
Luo, Y., Li, J., He, K., & Cheuk, W. (2022) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2022.3228341 · Cited by 17
Automatic Speech Recognition for Uyghur, Kazakh, and Kyrgyz: An Overview
Du, W., Maimaitiyiming, Y., Nijat, M., Li, L., Hamdulla, A., & Wang, D. (2022) · Applied Sciences · doi:10.3390/app13010326 · Cited by 22
Transformers in Natural Language Processing
Yvon, F. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-24349-3_6 · Cited by 21
Khotimah, W. N., Bennamoun, M., Boussaïd, F., Xu, L., Edwards, D., & Sohel, F. A. (2023) · International Journal of Applied Earth Observation and Geoinformation · doi:10.1016/j.jag.2023.103286 · Cited by 17
Massively Multilingual Shallow Fusion with Large Language Models
Hu, K., Sainath, T. N., Li, B., Du, N., Huang, Y., Dai, A. M., Zhang, Y., Cabrera, R., Chen, Z., & Strohman, T. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10094796 · Cited by 19
Self-citationGradient Remedy for Multi-Task Learning in End-to-End Noise-Robust Speech Recognition
Hu, Y., Chen, C., Li, R., Zhu, Q., & Chng, E. S. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10096615 · Cited by 20
Analyzing lower half facial gestures for lip reading applications: Survey on vision techniques
Seegehalli, P. J., & Niranjana Krupa, B. (2023) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2023.103738 · Cited by 18
Multi-information interaction graph neural network for joint entity and relation extraction
Zhang, Y., Zhang, Y., Wang, Z., Peng, H., Yang, Y., & Li, Y. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.121211 · Cited by 17
Self-citationLocal Self-attention-based Hybrid Multiple Instance Learning for Partial Spoof Speech Detection
Zhu, Y., Chen, Y., Zhao, Z., Liu, X., & Guo, J. (2023) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3616540 · Cited by 18
Improving the crop classification performance by unlabeled remote sensing data
Wang, H., Ye, Z., Wang, Y., Liu, X., Zhang, X., Zhao, Y., Liu, Z., Liu, Z., & Zhang, X. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.121283 · Cited by 19
Unified Cross-Modal Attention: Robust Audio-Visual Speech Recognition and Beyond
Li, J., Li, C., Wu, Y., & Qian, Y. (2024) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2024.3375641 · Cited by 18
Self-citationYeo, J. H., Kim, M., Watanabe, S., & Ro, Y. M. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10446720 · Cited by 21
Forecasting Medium-Term F10.7 Using the Deep-Learning Informer Model
Zhang, K., Zuo, P., Zou, Z., Feng, X., Huang, Y., Wang, S., Wei, F., & Yang, H. (2024) · Solar Physics · doi:10.1007/s11207-024-02284-0 · Cited by 17
Self-citationBELT: Bootstrapped EEG-to-Language Training by Natural Language Supervision
Zhou, J., Duan, Y., Chang, Y., Wang, Y., & Lin, C. (2024) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2024.3450795 · Cited by 22
A Survey of Large Language Model for Drug Research and Development
Guo, H., Xing, X., Zhou, Y., Jiang, W., Chen, X., Wang, T., Jiang, Z., Wang, Y., Hou, J., Jiang, Y., et al. (2025) · IEEE Access · doi:10.1109/access.2025.3552256 · Cited by 18
Nedungadi, P., Dileep, G. K., Geetha, M. K., & Raghu Raman, R. (2025) · Scientific Reports · doi:10.1038/s41598-025-12667-3 · Cited by 16
A Survey on Speech Large Language Models for Understanding
Peng, J., Wang, Y., Li, B., Guo, Y., Wang, H., Fang, Y., Xi, Y., Li, H., Li, X., Zhang, K., et al. (2025) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2025.3640535 · Cited by 92
Self-citationRecent Advances in Discrete Speech Tokens: A Review
Guo, Y., Li, Z., Wang, H., Li, B., Shao, C., Zhang, H., Du, C., Xie, C., Liu, S., & Yu, K. (2025) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2025.3643619 · Cited by 58
Statistical Methods with Applications in Data Mining: A Review of the Most Recent Works
da Costa, J. P., & Cabral, M. M. P. V. P. (2022) · Mathematics · doi:10.3390/math10060993 · Cited by 24
Leveraging unsupervised and weakly-supervised data to improve direct speech-to-speech translation
Ye, J., Ding, Y., Bapna, A., Cherry, C., Zhang, Y., Conneau, A., & Morioka, N. (2022) · Interspeech (USB) · doi:10.21437/interspeech.2022-10938 · Cited by 22
Self-citationA novel hybrid transformer-CNN architecture for environmental microorganism classification
Shao, R., Bi, X.-M., & Chen, Z. (2022) · PLoS ONE · doi:10.1371/journal.pone.0277557 · Cited by 16
Doubly-Fused ViT: Fuse Information from Vision Transformer Doubly with Local Representation
Gao, L., Nie, D., Li, B., & Ren, X. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-20050-2_43 · Cited by 16
Peng, Y., Arora, S., Higuchi, Y., Ueda, Y., Kumar, S., Ganesan, K., Dalmia, S., Chang, X., & Watanabe, S. (2023) · IEEE Spoken Language Technology Workshop (SLT) · doi:10.1109/slt54892.2023.10022399 · Cited by 16
Towards Zero-Shot Code-Switched Speech Recognition
Yan, B., Wiesner, M., Klejch, O., Jyothi, P., & Watanabe, S. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10097151 · Cited by 18
A Sidecar Separator Can Convert A Single-Talker Speech Recognition System to A Multi-Talker One
Meng, L., Kang, J., Cui, M., Wang, Y., Wu, X., & Meng, H. M. L. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10095295 · Cited by 16
EMSAssist: An End-to-End Mobile Voice Assistant at the Edge for Emergency Medical Services
Jin, L., Liu, T., Haroon, A., Radu Stoleru, B., Middleton, M., Zhu, Z., & Chaspari, T. (2023) · International Conference on Mobile Systems, Applications, and Services · doi:10.1145/3581791.3596853 · Cited by 16
TencentPretrain: A Scalable and Flexible Toolkit for Pre-training Models of Different Modalities
Zhao, Z., Li, Y., Hou, C., Zhao, J., Tian, R., Liu, W., Chen, Y., Sun, N., Liu, H., Mao, W., et al. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-demo.20 · Cited by 16
Creating speech zones with self-distributing acoustic swarms
Itani, M., Chen, T., Yoshioka, T., & Gollakota, S. (2023) · Nature Communications · doi:10.1038/s41467-023-40869-8 · Cited by 16
Fusion of Audio and Visual Embeddings for Sound Event Localization and Detection
Berghi, D., Wu, P., Zhao, J., Wang, W., & Jackson, P. J. B. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10448050 · Cited by 16
SCNet: Sparse Compression Network for Music Source Separation
Tong, W., Zhu, J., Chen, J., Kang, S., Jiang, T., Li, Y., Wu, Z., & Meng, H. M. L. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10446651 · Cited by 16
Wang, M., Sun, Y., Xiang, J., Sun, R., & Zhong, Y. (2024) · Remote Sensing · doi:10.3390/rs16061080 · Cited by 16
Multi-view multi-label network traffic classification based on MLP-Mixer neural network
Zheng, Y., Dang, Z., Lian, X., Peng, C., & Gao, X. (2024) · Computer Networks · doi:10.1016/j.comnet.2024.110746 · Cited by 16
CITNet: Convolution Interaction Transformer Network for Hyperspectral and LiDAR Image Classification
Wang, M., Sun, Y., Xiang, J., & Zhong, Y. (2024) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2024.3477965 · Cited by 16
Müller, N., Reermann, J., & Meisen, T. (2024) · IEEE Access · doi:10.1109/access.2024.3480788 · Cited by 21
Predict-and-Update Network: Audio-Visual Speech Recognition Inspired by Human Speech Perception
Wang, J., Qian, X., & Li, H. (2024) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2024.3507575 · Cited by 19
Lin, Z., Wang, J., Li, R., Shen, F., & Xuan, X. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10890034 · Cited by 16
Aligning Speech to Languages to Enhance Code-Switching Speech Recognition
Liu, H., Zhang, X., Zhang, H., Garcia, L. P., Khong, A. W. H., Chng, E. S., & Watanabe, S. (2025) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/taslpro.2025.3629290 · Cited by 16
Pushing the Limits of Non-Autoregressive Speech Recognition
Ng, E. G., Chiu, C., Zhang, Y., & Chan, W. (2021) · Interspeech (USB) · doi:10.21437/interspeech.2021-337 · Cited by 24
Self-citationDoutre, T., Han, W., Ma, M., Lu, Z., Chiu, C., Pang, R., Narayanan, A., Misra, A., Zhang, Y., & Cao, L. (2021) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp39728.2021.9413692 · Cited by 16
Self-citationSoft-Sensing ConFormer: A Curriculum Learning-based Convolutional Transformer
Yella, J., Zhang, C., Петров, С. А., Huang, Y., Qian, X., Minai, A. A., & Bom, S. (2021) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata52589.2021.9671991 · Cited by 17
Silent speech command word recognition using stepped frequency continuous wave radar
Wagner, C., Schaffer, P., Digehsara, P. A., Bärhold, M., Plettemeier, D., & Birkholz, P. (2022) · Scientific Reports · doi:10.1038/s41598-022-07842-9 · Cited by 16
Keyword spotting in continuous speech using convolutional neural network
Rostami, A. M., Karimi, A. A., & Akhaee, M. A. (2022) · Speech Communication · doi:10.1016/j.specom.2022.06.001 · Cited by 16
Stable, Fast and Accurate: Kernelized Attention with Relative Positional EncodingPreprint
Luo, S., Li, S., Cai, T., He, D., Peng, D., Zheng, S., Ke, G., Wang, L., & Liu, T. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.12566 · Cited by 24
Sound Event Detection Transformer: An Event-based End-to-End Model for Sound Event DetectionPreprint
Ye, Z., Wang, X., Liu, H., Qian, Y., Tao, R., Yan, L., & Ouchi, K. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.02011 · Cited by 24
Audio-Driven Facial Animation with Deep Learning: A Survey
Jiang, D., Chang, J. M., You, L., Bian, S., Kosk, R., & Maguire, G. (2024) · Information · doi:10.3390/info15110675 · Cited by 23
All-Neural Beamformer for Continuous Speech Separation
Zhang, Z., Yoshioka, T., Kanda, N., Chen, Z., Wang, X., Wang, D., & Eskimez, Ş. E. (2022) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp43922.2022.9747261 · Cited by 15
Self-citationEfficient Training of Neural Transducer for Speech Recognition
Zhou, W. G., Michel, W., Schlüter, R., & Ney, H. (2022) · Interspeech (USB) · doi:10.21437/interspeech.2022-829 · Cited by 15
Modular Hybrid Autoregressive Transducer
Meng, Z., Chen, T., Prabhavalkar, R., Zhang, Y., Wang, G., Audhkhasi, K., Emond, J., Strohman, T., Ramabhadran, B., Huang, W., et al. (2023) · IEEE Spoken Language Technology Workshop (SLT) · doi:10.1109/slt54892.2023.10023194 · Cited by 15
Self-citationUniNeXt: Exploring A Unified Architecture for Vision Recognition
Lin, F., Yuan, J., Wu, S., Wang, F., & Wang, Z. (2023) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3581783.3612260 · Cited by 19
Dasformer: Deep Alternating Spectrogram Transformer For Multi/Single-Channel Speech Separation
Wang, S., Kong, X., Peng, X., Movassagh, H., Prakash, V., & Lu, Y. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10095037 · Cited by 15
Self-citationAccelerating RNN-T Training and Inference Using CTC Guidance
Wang, Y., Chen, Z., Zheng, C., Zhang, Y., Han, W., & Haghani, P. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10096065 · Cited by 15
Self-citationHajiakhondi-Meybodi, Z., Mohammadi, A., Hou, M., Abouei, J., & Plataniotis, K. N. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10097122 · Cited by 15
Multilingual Customized Keyword Spotting Using Similar-Pair Contrastive Learning
Lei, L., Yuan, G., Yu, H.-J., Kong, D., & He, Y.-H. (2023) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2023.3284523 · Cited by 15
Single Image Reflection Removal From Glass Surfaces via Multi-Scale Reflection Detection
Yan, T., Li, H., Gao, J., Wu, Z., & Lau, R. W. H. (2023) · IEEE Transactions on Consumer Electronics · doi:10.1109/tce.2023.3303475 · Cited by 15
HFT6D: Multimodal 6D object pose estimation based on hierarchical feature transformer
An, Y., Yang, D., & Song, M. (2023) · Measurement · doi:10.1016/j.measurement.2023.113848 · Cited by 16
Decoupling and Interacting Multi-Task Learning Network for Joint Speech and Accent Recognition
Shao, Q., Guo, P., Yan, J., Hu, P., & Xie, L. (2023) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2023.3332542 · Cited by 15
Improving Medical Speech-to-Text Accuracy using Vision-Language Pre-training Models
Huh, J., Park, S. J., Lee, J. E., & Ye, J. C. (2023) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2023.3345897 · Cited by 21
Wu, S.-L., Chang, X., Wichern, G., Jung, J.-W., Germain, F. G., Roux, J. L., & Watanabe, S. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10447215 · Cited by 18
Cai, T., Merz, G. W., Charton, F., Nolte, N. S., Wilhelm, M., Cranmer, K. S., & Dixon, L. J. (2024) · Machine Learning Science and Technology · doi:10.1088/2632-2153/ad743e · Cited by 31
Exploring Deep Learning Methods for Short-Term Tide Gauge Water Level Predictions
Vicens-Miquel, M., Tissot, P. E., & Medrano, F. A. (2024) · Water · doi:10.3390/w16202886 · Cited by 15
DeFTAN-II: Efficient Multichannel Speech Enhancement With Subgroup Processing
Lee, D., & Choi, J. (2024) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2024.3488564 · Cited by 16
ETTrack: enhanced temporal motion predictor for multi-object tracking
Han, X., Oishi, N., Tian, Y., Ucurum, E., Young, R. C. D., Chatwin, C. R., & Birch, P. M. (2024) · Applied Intelligence · doi:10.1007/s10489-024-05866-4 · Cited by 16
Speech-Mamba: Long-Context Speech Recognition with Selective State Spaces Models
Gao, X., & Chen, N. F. (2024) · IEEE Spoken Language Technology Workshop (SLT) · doi:10.1109/slt61566.2024.10832137 · Cited by 15
An FPGA-Based Reconfigurable Convolutional Neural Network Accelerator for Tiny YOLO-V3
Tsai, T., Tung, N.-C., & Chen, C. (2025) · Circuits Systems and Signal Processing · doi:10.1007/s00034-024-02968-9 · Cited by 15
SwinLip: An Efficient Visual Speech Encoder for Lip Reading Using Swin Transformer
Park, Y.-H., Park, R., & Park, H. (2025) · Neurocomputing · doi:10.1016/j.neucom.2025.130289 · Cited by 18
Multitask Learning and Joint Optimization for Transformer-RNN-Transducer Speech Recognition
Jeon, J.-J., & Kim, E. (2021) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp39728.2021.9414911 · Cited by 15
Dual Causal/Non-Causal Self-Attention for Streaming End-to-End Speech Recognition
Moritz, N., Hori, T., & Roux, J. L. (2021) · Interspeech (USB) · doi:10.21437/interspeech.2021-1693 · Cited by 15
Cloning One’s Voice Using Very Limited Data in the Wild
Dai, D., Chen, Y., Chen, L., Tu, M., Liu, L., Xia, R., Tian, Q., Wang, Y., & Wang, Y. (2022) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp43922.2022.9747319 · Cited by 15
Deliberation of Streaming RNN-Transducer by Non-Autoregressive Decoding
Wang, W., Hu, K., & Sainath, T. N. (2022) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp43922.2022.9746390 · Cited by 16
Improving Transformer-based Conversational ASR by Inter-Sentential Attention Mechanism
Wei, K., Guo, P., & Jiang, N. (2022) · Interspeech (USB) · doi:10.21437/interspeech.2022-10066 · Cited by 15
Combining hybrid DNN-HMM ASR systems with attention-based models using lattice rescoring
Li, Q., Zhang, C., & Woodland, P. C. (2022) · Speech Communication · doi:10.1016/j.specom.2022.12.002 · Cited by 15
Hussain, S., Neekhara, P., Huang, J., Li, J., & Ginsburg, B. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10094850 · Cited by 15
ASR Rescoring and Confidence Estimation with Electra
Futami, H., Inaguma, H., Mimura, M., Sakai, S., & Kawahara, T. (2021) · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru51503.2021.9688175 · Cited by 16
Translatotron 2: Robust direct speech-to-speech translation.Preprint
Ye, J., Ramanovich, M. T., Remez, T., & Pomerantz, R. (2021) · arXiv (Cornell University) · Cited by 15
AraSpell: A Deep Learning Approach for Arabic Spelling CorrectionPreprint
Salhab, M., & Abu-Khzam, F. N. (2023) · Research Square · doi:10.21203/rs.3.rs-2974359/v1 · Cited by 18
End-to-End Automated Speech Recognition Using a Character Based Small Scale Transformer Architecture
Loubser, A., de Villiers, P., & Freitas, A. D. (2022) · Expert Systems with Applications · doi:10.1016/j.eswa.2024.124119 · Cited by 21
Assessing advanced handwritten text recognition engines for digitizing historical documents
Romein, C. A., Rabus, A., Leifert, G., & Ströbel, P. (2025) · International Journal of Digital Humanities · doi:10.1007/s42803-025-00100-0 · Cited by 14
About Time: Advances, Challenges, and Outlooks of Action Understanding
Stergiou, A., & Poppe, R. W. (2025) · International Journal of Computer Vision · doi:10.1007/s11263-025-02478-4 · Cited by 17
Nair, L. S., Amarnath, K., & Nair, J. J. (2025) · IEEE Access · doi:10.1109/access.2025.3576825 · Cited by 14
Streaming Transformer Transducer based Speech Recognition Using Non-Causal Convolution
Shi, Y., Wu, C., Wang, D., Xiao, A., Mahadeokar, J., Zhang, X., Liu, C., Li, K., Shangguan, Y., Nagaraja, V., et al. (2022) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp43922.2022.9747706 · Cited by 14
A deep learning algorithm for joint direct tracking and classification of manoeuvring sources
Yu, W., Yu, H., Du, J., Zhang, M., & Wang, D. (2022) · IET Radar Sonar & Navigation · doi:10.1049/rsn2.12254 · Cited by 14
Li, S., Wang, J., & Liu, P. (2022) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2022.3182276 · Cited by 14
Efficient yet Competitive Speech Translation: FBK@IWSLT2022
Gaido, M., Papi, S., Fucci, D., Fiameni, G., Negri, M., & Turchi, M. (2022) · International Conference on Spoken Language Translation (IWSLT) · doi:10.18653/v1/2022.iwslt-1.13 · Cited by 14
NAM+: Towards Scalable End-to-End Contextual Biasing for Adaptive ASR
Munkhdalai, T., Wu, Z., Pundak, G., Sim, K. C., Li, J., Rondon, P., & Sainath, T. N. (2023) · IEEE Spoken Language Technology Workshop (SLT) · doi:10.1109/slt54892.2023.10023323 · Cited by 14
Multi-Stream Acoustic Modelling Using Raw Real and Imaginary Parts of the Fourier Transform
Loweimi, E., Yue, Z., Bell, P., Renals, S. J., & Cvetković, Z. (2023) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2023.3237167 · Cited by 15
Lyu, B., Fan, C., Ming, Y., Zhao, P., & Hu, N. (2023) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2023.3245407 · Cited by 14
Speech Enhancement With Integration of Neural Homomorphic Synthesis and Spectral Masking
Jiang, W., & Yu, K. (2023) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2023.3271151 · Cited by 14
Depth-First Neural Architecture With Attentive Feature Fusion for Efficient Speaker Verification
Liu, B., Chen, Z., & Qian, Y. (2023) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2023.3273417 · Cited by 14
Online Model Compression for Federated Learning with Large Models
Yang, T.-J., Xiao, Y., Motta, G., Beaufays, F., Mathews, R., & Chen, M. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10097124 · Cited by 14
Metadata
- Authors
- Gulati, A., Qin, J., Chiu, C.-C., Parmar, N., Zhang, Y., Yu, J., Han, W., Wang, S., Zhang, Z., Wu, Y., & Pang, R.
- Affiliations
- Google (United States) (US)
- ORCID
- Venue
- Interspeech 2020
- Publisher
- ISCA
- Published
- 2020-10-25
- Pages
- 5036-5040
- ISSN
- 2308-457X (ISSN-L)
- OpenAlex
- W3097777922
- Cited by
- 3,150
- References
- 33
- Citations by year
- 2026: 373 · 2025: 666 · 2024: 644 · 2023: 708 · 2022: 424 · 2021: 300 · 2020: 35
- FWCI
- 140.10
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- public-domain
- Locations
- Interspeech (USB) (publishedVersion)
- arXiv (Cornell University) (submittedVersion, public-domain)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Speech Recognition and Synthesis
- Physical Sciences › Computer Science › Signal Processing › Speech and Audio Processing
- Physical Sciences › Computer Science › Signal Processing › Music and Audio Processing
- Keywords
- conformational isomers, speech recognition, CNN-Transformer hybrid, parameter-efficient models, LibriSpeech, word error rate
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
