Cited by 3,150Speech Recognition and SynthesisSpeech and Audio ProcessingMusic and Audio Processing

The DOI matches its Crossref record; 33 of the 33 references it cites were found in a registry or an index.

Conformer: Convolution-augmented Transformer for Speech Recognition

Open access

Gulati, Anmol, Qin, James, Chiu, Chung-Cheng, Parmar, Niki, Zhang, Yu, Yu, Jiahui, Han, Wei, Wang, Shibo, Zhang, Zhengdong, Wu, Yonghui, Pang, Ruoming·2020·Interspeech 2020

DOI 10.21437/interspeech.2020-3015

Open this paper in CoChat — free account Open PDF

Abstract

Recently Transformer and Convolution neural network (CNN) based models have shown promising results in Automatic Speech Recognition (ASR), outperforming Recurrent neural networks (RNNs). Transformer models are good at capturing content-based global interactions, while CNNs exploit local features effectively. In this work, we achieve the best of both worlds by studying how to combine convolution neural networks and transformers to model both local and global dependencies of an audio sequence in a parameter-efficient way. To this regard, we propose the convolution-augmented transformer for speech recognition, named Conformer. Conformer significantly outperforms the previous Transformer and CNN based models achieving state-of-the-art accuracies. On the widely used LibriSpeech benchmark, our model achieves WER of 2.1%/4.3% without using a language model and 1.9%/3.9% with an external language model on test/testother. We also observe competitive performance of 2.7%/6.3% with a small model of only 10M parameters.

Integrity signals

Registry

Crossref · 10.21437/interspeech.2020-3015

Cites

33 of 33 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Attention Is All You Need
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
Self-citation
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Squeeze-and-Excitation NetworksPreprint
Hu, J., Shen, L., & Sun, G. (2017) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.48550/arxiv.1709.01507 · Cited by 37,845
Untitled work
(2014) · Cited by 33,419
Squeeze-and-Excitation Networks
Hu, J., Shen, L., Albanie, S., Sun, G., & Wu, E. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2913372 · Cited by 12,157
“Librispeech: an ASR corpus based on public domain audio books,”
Panayotov, V., Chen, G., Povey, D., & Khudanpur, S. (2015) · 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2015.7178964 · Cited by 6,072
SpecAugment: A Simple Data Augmentation Method for Automatic Speech Recognition
Park, D. S., Chan, W., Zhang, Y., Chiu, C.-C., Zoph, B., Cubuk, E. D., & Le, Q. V. (2019) · Interspeech 2019 · doi:10.21437/interspeech.2019-2680 · Cited by 3,558
Self-citation
Transformer-XL: Attentive language models beyond a fixed-length context
Dai, Z., Yang, Z., Yang, Y., Carbonell, J., Le, Q., & Salakhutdinov, R. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1285 · Cited by 3,169
Searching for activation functions
Ramachandran, P., Zoph, B., & Le, Q. V. (2017) · arXiv · doi:10.48550/arxiv.1710.05941 · Cited by 2,335
Convolutional Neural Networks for Speech Recognition
Abdel‐Hamid, O., Mohamed, A., Jiang, H., Deng, L., Penn, G., & Yu, D. (2014) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2014.2339736 · Cited by 2,325

Show all 33 references

Sorted by citations

Items 701–800 of 1,004

TALCS: An open-source Mandarin-English code-switching corpus and a speech recognition baseline
Li, C., Deng, S., Wang, Y.-P., Wang, G., Gong, Y., Chen, C., & Bai, J. (2022) · Interspeech (USB) · doi:10.21437/interspeech.2022-877 · Cited by 12
M-Adapter: Modality Adaptation for End-to-End Speech-to-Text Translation
Zhao, J., Yang, H., Haffari, G., & Shareghi, E. (2022) · Interspeech (USB) · doi:10.21437/interspeech.2022-592 · Cited by 12
Transfer Learning for Robust Low-Resource Children's Speech ASR with Transformers and Source-Filter Warping
Thienpondt, J., & Demuynck, K. (2022) · Interspeech (USB) · doi:10.21437/interspeech.2022-10964 · Cited by 17
Two-Stage Training Method for Japanese Electrolaryngeal Speech Enhancement Based on Sequence-to-Sequence Voice Conversion
Ma, D., Violeta, L. P., Kobayashi, K., & Toda, T. (2023) · IEEE Spoken Language Technology Workshop (SLT) · doi:10.1109/slt54892.2023.10023033 · Cited by 12
Robust Acoustic And Semantic Contextual Biasing In Neural Transducers For Speech Recognition
Fu, X., Sathyendra, K. M., Gandhe, A., Liu, J., Strimel, G. P., McGowan, R., & Mouchtaris, A. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10094808 · Cited by 12
BECTRA: Transducer-Based End-To-End ASR with Bert-Enhanced Encoder
Higuchi, Y., Ogawa, T., Kobayashi, T., & Watanabe, S. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10095186 · Cited by 12
Fast and Parallel Decoding for Transducer
Kang, W., Guo, L., Kuang, F., Lin, L., Luo, M., Yao, Z., Yang, X., Żelasko, P., & Povey, D. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10094567 · Cited by 12
A CNN-Based Method for Enhancing Boring Vibration with Time-Domain Convolution-Augmented Transformer
Zhang, H., Li, J., Cai, G., Chen, Z., & Zhang, H. (2023) · Insects · doi:10.3390/insects14070631 · Cited by 13
Text-only domain adaptation for end-to-end ASR using integrated text-to-mel-spectrogram generator
Bataev, V., Korostik, R., Shabalin, E., Lavrukhin, V., & Ginsburg, B. (2023) · Interspeech (USB) · doi:10.21437/interspeech.2023-906 · Cited by 12
Trajectory Prediction with Observations of Variable-Length for Motion Planning in Highway Merging Scenarios
Mozaffari, S., Sormoli, M. A., Koufos, K., Lee, G., & Dianati, M. (2023) · IEEE International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc57777.2023.10422360 · Cited by 12
Streaming Attention-Based Models with Augmented Memory for End-To-End Speech Recognition
Yeh, C.-F., Wang, Y., Shi, Y., Wu, C., Zhang, F., Chan, J., & Seltzer, M. L. (2021) · IEEE Spoken Language Technology Workshop (SLT) · doi:10.1109/slt48900.2021.9383504 · Cited by 10
Alignment Knowledge Distillation for Online Streaming Attention-Based Speech Recognition
Inaguma, H., & Kawahara, T. (2021) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2021.3133217 · Cited by 12
Speech Representation Learning Combining Conformer CPC with Deep Cluster for the ZeroSpeech Challenge 2021
Maekaku, T., Chang, X., Fujita, Y., Chen, L., Watanabe, S., & Rudnicky, A. I. (2021) · Interspeech (USB) · doi:10.21437/interspeech.2021-1503 · Cited by 13
Align-Denoise: Single-Pass Non-Autoregressive Speech Recognition
Chen, N., Żelasko, P., Moro-Velázquez, L., Villalba, J., & Dehak, N. (2021) · Interspeech (USB) · doi:10.21437/interspeech.2021-1906 · Cited by 12
Speech Recognition Based On Transformer Neural Networks
Mamatov, N., Niyozmatova, N. A., Abdullaev, S. S., Samijonov, A., & Kaymatdinovich, E. K. (2021) · International Conference on Information Science and Communications Technologies (ICISCT) · doi:10.1109/icisct52966.2021.9670093 · Cited by 12
End-To-End Multi-Modal Speech Recognition with Air and Bone Conducted Speech
Chen, J., Wang, M., Zhang, X.-L., Huang, Z., & Rahardja, S. (2022) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp43922.2022.9747306 · Cited by 12
Confidence Score Based Conformer Speaker Adaptation for Speech Recognition
Deng, J., Xie, X., Wang, T., Cui, M., Xue, B., Jin, Z., Geng, M., Li, G., Liu, X., & Meng, H. M. L. (2022) · Interspeech (USB) · doi:10.21437/interspeech.2022-680 · Cited by 12
Emformer: Efficient Memory Transformer Based Acoustic Model For Low Latency Streaming Speech RecognitionPreprint
Shi, Y., Wang, Y., Wu, C., Yeh, C.-F., Chan, J., Zhang, F., Le, D., & Seltzer, M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.10759 · Cited by 12
Exploiting Cross Domain Acoustic-to-Articulatory Inverted Features for Disordered Speech Recognition
Hu, S., Liu, S., Xie, X., Geng, M., Wang, T., Hu, S., Cui, M., Liu, X., & Meng, H. (2022) · ICASSP 2022 - 2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp43922.2022.9746989 · Cited by 14
Human Activity Recognition: A Review of RFID and Wearable Sensor Technologies Powered by AI
Kanjilal, R., Küçük, M. F., & Uysal, I. (2025) · IEEE Journal of Radio Frequency Identification · doi:10.1109/jrfid.2025.3561345 · Cited by 12
LongFNT: Long-Form Speech Recognition with Factorized Neural Transducer
Gong, X., Wu, Y., Li, J., Liu, S., Zhao, R., Chen, X., & Qian, Y. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10096900 · Cited by 11
Self-citation
Towards A Unified Conformer Structure: from ASR to ASV Task
Liao, D., Jiang, T., Wang, F., Li, L., & Hong, Q. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10095433 · Cited by 11
Variable Attention Masking for Configurable Transformer Transducer Speech Recognition
Świętojański, P., Braun, S., Can, D., da Silva, T. F., Ghoshal, A. K., Hori, T., Hsiao, R. W.-H., Mason, H., McDermott, E., Silovsky, H., et al. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10094588 · Cited by 11
DeepDIST: A Black-Box Anti-Collusion Framework for Secure Distribution of Deep Models
Cheng, H., Li, X., Wang, H., Zhang, X., Liu, X., Wang, M., & Li, F. (2023) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2023.3284914 · Cited by 11
Hearing Lips in Noise: Universal Viseme-Phoneme Mapping and Transfer for Robust Audio-Visual Speech Recognition
Hu, Y., Li, R., Chen, C., Qin, C., Zhu, Q., & Chng, E. S. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.848 · Cited by 11
End-to-End Zero-Shot Voice Conversion with Location-Variable Convolutions
Kang, W., Hasegawa‐Johnson, M., & Roy, D. K. (2023) · Interspeech (USB) · doi:10.21437/interspeech.2023-2298 · Cited by 13
Toward Joint Language Modeling for Speech Units and Text
Chou, J.-C., Chien, C.-M., Hsu, W.-N., Livescu, K., Babu, A., Conneau, A., Baevski, A., & Auli, M. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.438 · Cited by 22
Scale-aware dual-branch complex convolutional recurrent network for monaural speech enhancement
Li, Y., Sun, M., Zhang, X., & hamme, H. V. (2024) · Computer Speech & Language · doi:10.1016/j.csl.2024.101618 · Cited by 11
Transduce and Speak: Neural Transducer for Text-To-Speech with Semantic Token Prediction
Kim, M., Jeong, M., Choi, B. J., Lee, D., & Kim, N. S. (2023) · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru57964.2023.10389791 · Cited by 11
Preliminary Technical Validation of LittleBeats™: A Multimodal Sensing Platform to Capture Cardiac Physiology, Motion, and Vocalizations
Islam, B., McElwain, N. L., Li, J., Davila, M. I., Hu, Y., Hu, K., Bodway, J. M., Dhekne, A., Choudhury, R. R., & Hasegawa‐Johnson, M. (2024) · Sensors · doi:10.3390/s24030901 · Cited by 11
Exploring emergent syllables in end-to-end automatic speech recognizers through model explainability technique
Vitale, V. N., Cutugno, F., Origlia, A., & Coro, G. (2024) · Neural Computing and Applications · doi:10.1007/s00521-024-09435-1 · Cited by 16
Proformer: a hybrid macaron transformer model predicts expression values from promoter sequences
Kwak, I., Kim, B.-C., Lee, J., Kang, T., Garry, D. J., Zhang, J. J., & Gong, W. (2024) · BMC Bioinformatics · doi:10.1186/s12859-024-05645-5 · Cited by 10
Less Peaky and More Accurate CTC Forced Alignment by Label Priors
Huang, R., Zhang, X., Ni, Z., Sun, L., Hira, M., Hwang, J., Manohar, V., Pratap, V., Wiesner, M., Watanabe, S., et al. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10446111 · Cited by 11
Chunked Attention-Based Encoder-Decoder Model for Streaming Speech Recognition
Zeineldeen, M., Zeyer, A., Schlüter, R., & Ney, H. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10446035 · Cited by 14
Extending Multilingual Speech Synthesis to 100+ Languages without Transcribed Data
Saeki, T., Wang, G., Morioka, N., Elias, I., Kastner, K., Rosenberg, A., Ramabhadran, B., Zen, H., Beaufays, F., & Shemtov, H. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10448074 · Cited by 12
KNN-CTC: Enhancing ASR via Retrieval of CTC Pseudo Labels
Zhou, J., Zhao, S., Liu, Y., Zeng, W., Chen, Y., & Qin, Y. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10447075 · Cited by 11
SmartMem: Layout Transformation Elimination and Adaptation for Efficient DNN Execution on Mobile
Niu, W., Sanim, M. M. R., Shu, Z., Guan, J., Shen, X., Yin, M., Agrawal, G., & Ren, B. (2024) · International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS) · doi:10.1145/3620666.3651384 · Cited by 19
Transmission Line Fault Classification Using Conformer Convolution-Augmented Transformer Model
Lee, M.-Y., Huang, Y.-S., Chang, C.-J., Yang, J., Liu, C., Lin, T.-C., & Lin, Y.-B. (2024) · Applied Sciences · doi:10.3390/app14104031 · Cited by 11
PrCRS: a prediction model of severe CRS in CAR-T therapy based on transfer learning
Wei, Z., Zhao, C., Zhang, M., Xu, J., Xu, N., Wu, S., Xin, X., Yu, L., & Feng, W. (2024) · BMC Bioinformatics · doi:10.1186/s12859-024-05804-8 · Cited by 12
Distinctive and Natural Speaker Anonymization via Singular Value Transformation-Assisted Matrix
Yao, J., Wang, Q., Guo, P., Ning, Z., & Xie, L. (2024) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2024.3407600 · Cited by 11
Enhancing Conformer-Based Sound Event Detection Using Frequency Dynamic Convolutions and BEATs Audio Embeddings
Barahona, S., de Benito-Gorrón, D., Toledano, D. T., & Ramos, D. (2024) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2024.3444490 · Cited by 12
Faces that Speak: Jointly Synthesising Talking Face and Speech from Text
Jang, Y., Kim, J., Ahn, J., Kwak, D., Yang, H.-S., Ju, Y.-C., Kim, I.-H., Kim, B.-Y., & Chung, J. S. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00842 · Cited by 11
Learn2Talk: 3D Talking Face Learns From 2D Talking Face
Zhuang, Y., Cheng, B., Cheng, Y., Jin, Y., Liu, R., Li, C., Cheng, X., Liao, J., & Lin, J. (2024) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2024.3476275 · Cited by 17
Selective State Space Model for Monaural Speech Enhancement
Chen, M., Zhang, Q., Wang, M., Zhang, X., Liu, H., Eliathamby Ambikairajah, A., & Chen, D. (2025) · IEEE Transactions on Consumer Electronics · doi:10.1109/tce.2024.3523297 · Cited by 11
Modality Imbalance? Dynamic Multi-Modal Knowledge Distillation in Automatic Alzheimer's Disease Recognition
Dong, Z., Xu, W., Xu, X., & Zhang, Z. (2025) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2025.3546950 · Cited by 12
Self-citation
Transformers in speech processing: Overcoming challenges and paving the future
Latif, S., Zaidi, S. A. M., Cuayáhuitl, H., Shamshad, F., Shoukat, M., Usama, M., & Qadir, J. (2025) · Computer Science Review · doi:10.1016/j.cosrev.2025.100768 · Cited by 116
DiCoW: Diarization-conditioned Whisper for target speaker automatic speech recognition
Polok, A., Klement, D., Kocour, M., Han, J., Landini, F., Yusuf, B., Wiesner, M., Khudanpur, S. P., Černocký, J., & Burget, L. (2025) · Computer Speech & Language · doi:10.1016/j.csl.2025.101841 · Cited by 11
AlignFormer: Modality Matching Can Achieve Better Zero-Shot Instruction-Following Speech-LLM
Fan, R., Ren, B., Hu, Y., Zhao, R., Liu, S., & Li, J. (2025) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2025.3588378 · Cited by 11
Transformer optimization with meta learning on pathology images for breast cancer lymph node micrometastasis
Huang, J., Wang, J., Shi, J., Ni, H., Xu, S., Wu, P., Ren, Y., Bian, L., Su, C., Xu, Y., et al. (2025) · npj Digital Medicine · doi:10.1038/s41746-025-01833-6 · Cited by 12
SpectrumFM: A Foundation Model for Intelligent Spectrum Management
Zhou, F., Liu, C., Zhang, H., Wu, W. Q., Wu, Q., Quek, T. Q. S., & Chae, C. (2025) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2025.3644783 · Cited by 25
Scaling Sparsemax Based Channel Selection for Speech Recognition with ad-hoc Microphone Arrays
Chen, J., & Zhang, X.-L. (2021) · Interspeech (USB) · doi:10.21437/interspeech.2021-419 · Cited by 11
Data Augmentation Methods for End-to-End Speech Recognition on Distant-Talk Scenarios
Tsunoo, E., Shibata, K., Narisetty, C. P., Kashiwagi, Y., & Watanabe, S. (2021) · Interspeech (USB) · doi:10.21437/interspeech.2021-958 · Cited by 11
Leveraging Phone Mask Training for Phonetic-Reduction-Robust E2E Uyghur Speech Recognition
Ma, G., Hu, P., Kang, J., Huang, S., & Huang, H. (2021) · Interspeech (USB) · doi:10.21437/interspeech.2021-964 · Cited by 12
Spell My Name: Keyword Boosted Speech Recognition
Jung, N., Kim, G., & Chung, J. S. (2022) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp43922.2022.9747714 · Cited by 11
Minimum Word Error Training For Non-Autoregressive Transformer-Based Code-Switching ASR
Peng, Y., Zhang, J., Xu, H., Huang, H., & Chng, E. S. (2022) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp43922.2022.9746830 · Cited by 11
A Comparative Study of Modular and Joint Approaches for Speaker-Attributed ASR on Monaural Long-Form Audio
Kanda, N., Xiao, X., Wu, J., Zhou, T., Gaur, Y., Wang, X., Meng, Z., Chen, Z., & Yoshioka, T. (2021) · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru51503.2021.9687974 · Cited by 12
LAS-Transformer: An Enhanced Transformer Based on the Local Attention Mechanism for Speech Recognition
Fu, P., Liu, D., & Yang, H. (2022) · Information · doi:10.3390/info13050250 · Cited by 11
The HW-TSC’s Simultaneous Speech Translation System for IWSLT 2022 Evaluation
Wang, M., Guo, J., Li, Y., Qiao, X., Wang, Y., Li, Z., Su, C., Chen, Y., Zhang, M., Tao, S., et al. (2022) · International Conference on Spoken Language Translation (IWSLT) · doi:10.18653/v1/2022.iwslt-1.21 · Cited by 11
Integrating Lattice-Free MMI Into End-to-End Speech Recognition
Tian, J., Yu, J., Weng, C., Zou, Y., & Yu, D. (2022) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2022.3198555 · Cited by 11
Self-citation
Unsupervised Data Selection via Discrete Speech Representation for ASR
Lu, Z., Wang, Y., Zhang, Y., Han, W., Chen, Z., & Haghani, P. (2022) · Interspeech (USB) · doi:10.21437/interspeech.2022-399 · Cited by 11
Self-citation
Audio-Visual Fusion Network Based on Conformer for Multimodal Emotion Recognition
Guo, P., Chen, Z., Li, Y., & Liu, H. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-20500-2_26 · Cited by 11
Streaming End-to-End Target-Speaker Automatic Speech Recognition and Activity Detection
Moriya, T., Satō, H., Ochiai, T., Delcroix, M., & Shinozaki, T. (2023) · IEEE Access · doi:10.1109/access.2023.3243690 · Cited by 12
LFEformer: Local Feature Enhancement Using Sliding Window With Deformability for Automatic Speech Recognition
Wei, G., Duan, Z., Li, S., Yu, X., & Yang, G. (2023) · IEEE Signal Processing Letters · doi:10.1109/lsp.2023.3241558 · Cited by 11
Automatic Correction of Speech Recognized Mathematical Equations using Encoder-Decoder Attention Model
Mounika, Y., Tarakaram, Y., Prasanna, Y. L., Gupta, D., & Pati, P. B. (2022) · IEEE India Conference · doi:10.1109/indicon56171.2022.10039926 · Cited by 11
Improving Noisy Student Training on Non-Target Domain Data for Automatic Speech Recognition
Chen, Y., Ding, W., & Lai, J. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10095704 · Cited by 11
Robust Audio-Visual ASR with Unified Cross-Modal Attention
Li, J., Li, C., Wu, Y., & Qian, Y. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10096893 · Cited by 11
Self-citation
AVFormer: Injecting Vision into Frozen Speech Models for Zero-Shot AV-ASR
Seo, P. H., Nagrani, A., & Schmid, C. (2023) · Computer Vision and Pattern Recognition · doi:10.1109/cvpr52729.2023.02195 · Cited by 35
CAE-GReaT: Convolutional-Auxiliary Efficient Graph Reasoning Transformer for Dense Image Predictions
Zhang, D., Lin, Y., Tang, J., & Cheng, K.-T. T. (2023) · International Journal of Computer Vision · doi:10.1007/s11263-023-01928-1 · Cited by 12
MetDIT: Transforming and Analyzing Clinical Metabolomics Data with Convolutional Neural Networks
Sha, Y., Meng, W., Luo, G., Zhai, X., Tong, H. H. Y., Wang, Y., & Li, K. (2024) · Analytical Chemistry · doi:10.1021/acs.analchem.3c04607 · Cited by 11
Tree-constrained Pointer Generator with Graph Neural Network Encodings for Contextual Speech Recognition
Sun, G., Zhang, C., & Woodland, P. C. (2022) · Interspeech (USB) · doi:10.21437/interspeech.2022-461 · Cited by 11
Federated Pruning: Improving Neural Network Efficiency with Federated Learning
Lin, R., Xiao, Y., Yang, T.-J., Zhao, D. X., Xiong, L., Motta, G., & Beaufays, F. (2022) · Interspeech (USB) · doi:10.21437/interspeech.2022-10787 · Cited by 20
Learning ASR Pathways: A Sparse Multilingual ASR Model
Yang, M., Tjandra, A., Liu, C., Zhang, D., Le, D., & Kalinli, O. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10094300 · Cited by 13
Self-training and Pre-training are Complementary for Speech RecognitionPreprint
Xu, Q., Baevski, A., Likhomanenko, T., Tomasello, P., Conneau, A., Collobert, R., Synnaeve, G., & Auli, M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.11430 · Cited by 11
Data Augmentation For Children's Speech Recognition -- The "Ethiopian" System For The SLT 2021 Children Speech Recognition ChallengePreprint
Chen, G., Na, X., Wang, Y., Yan, Z., Zhang, J., Ma, S., & Wang, Y. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2011.04547 · Cited by 11
Attention-Free Keyword SpottingPreprint
Morshed, M. M., & Ahsan, A. O. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.07749 · Cited by 15
Leveraging Large Language Models for Real-Time UAV Control
Choutri, K., Fadloun, S., Khettabi, A., Lagha, M., Meshoul, S., & Fareh, R. (2025) · Electronics · doi:10.3390/electronics14214312 · Cited by 10
A comprehensive survey on recent advances and challenges in sign language recognition systems
Violet, I. M. M., & Sri, R. L. (2025) · Discover Artificial Intelligence · doi:10.1007/s44163-025-00629-7 · Cited by 10
ZipVoice: Fast and High-Quality Zero-Shot Text-to-Speech with Flow Matching
Zhu, H., Kang, W., Yao, Z., Guo, L., Kuang, F., Li, Z., Zhuang, W., Lin, L., & Povey, D. (2025) · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru65441.2025.11433841 · Cited by 10
Integrating Relational Knowledge With Text Sequences for Script Event Prediction
Wang, Z., Li, L., & Zeng, D. D. (2023) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3233371 · Cited by 10
Boosting Low-Resource Speech Recognition in Air Traffic Communication via Pretrained Feature Aggregation and Multi-Task Learning
Guo, D., Zhang, Z., Yang, B., Zhang, J., & Lin, Y. (2023) · IEEE Transactions on Circuits & Systems II Express Briefs · doi:10.1109/tcsii.2023.3269051 · Cited by 10
Self-citation
Multilingual Word Error Rate Estimation: E-Wer3
Chowdhury, S. A., & Ali, A. M. A. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10095888 · Cited by 13
The DKU Post-Challenge Audio-Visual Wake Word Spotting System for the 2021 MISP Challenge: Deep Analysis
Wang, H., Cheng, M., Fu, Q., & Li, M. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10095459 · Cited by 10
In Search of Strong Embedding Extractors for Speaker Diarisation
Jung, J.-W., Heo, H.-S., Lee, B., Huh, J., Brown, A., Kwon, Y., Watanabe, S., & Chung, J. S. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10096449 · Cited by 10
Multi-Feature and Multi-Modal Mispronunciation Detection and Diagnosis Method Based on the Squeezeformer Encoder
Guo, S., Kadeer, Z., Wumaier, A., Wang, L., & Fan, C. (2023) · IEEE Access · doi:10.1109/access.2023.3278837 · Cited by 10
FluentSpeech: Stutter-Oriented Automatic Speech Editing with Context-Aware Diffusion Models
Jiang, Z. K., Yang, Q., Zuo, J., Ye, Z., Huang, R., Ren, Y., & Zhao, Z. (2023) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2023.findings-acl.741 · Cited by 18
Exploring Data Augmentation in Bias Mitigation Against Non-Native-Accented Speech
Zhang, Y., Herygers, A., Patel, T. B., Yue, Z., & Scharenborg, O. (2023) · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru57964.2023.10389756 · Cited by 10
Self-citation
BA-MoE: Boundary-Aware Mixture-of-Experts Adapter for Code-Switching Speech Recognition
Chen, P., Yu, F., Liang, Y., Xue, H., Wan, X., Zheng, N., Zhou, H., & Xie, L. (2023) · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru57964.2023.10389798 · Cited by 10
Self-Supervised Adaptive AV Fusion Module for Pre-Trained ASR Models
Simic, C., & Bocklet, T. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10448047 · Cited by 10
Multichannel AV-wav2vec2: A Framework for Learning Multichannel Multi-Modal Speech Representation
Zhu, Q., Zhang, J., Gu, Y., Hu, Y., & Dai, L. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i17.29951 · Cited by 14
Improving Handwritten Mathematical Expression Recognition via Integrating Convolutional Neural Network With Transformer and Diffusion-Based Data Augmentation
Zhang, Y., & Li, G. (2024) · IEEE Access · doi:10.1109/access.2024.3399919 · Cited by 12
Self-citation
Social-STGMLP: A Social Spatio-Temporal Graph Multi-Layer Perceptron for Pedestrian Trajectory Prediction
Meng, D., Zhao, G., & Yan, F. (2024) · Information · doi:10.3390/info15060341 · Cited by 10
A perceptual similarity space for speech based on self-supervised speech representations
Chernyak, B. R., Bradlow, A. R., Keshet, J., & Goldrick, M. (2024) · The Journal of the Acoustical Society of America · doi:10.1121/10.0026358 · Cited by 10
Enhancing multilingual speech recognition in air traffic control by sentence-level language identification
Fan, P., Guo, D., Zhang, J., Yang, B., & Lin, Y. (2024) · Applied Acoustics · doi:10.1016/j.apacoust.2024.110123 · Cited by 10
Speech self-supervised representations benchmarking: A case for larger probing heads
Zaiem, S., Kemiche, Y., Parcollet, T., Essid, S., & Ravanelli, M. (2024) · Computer Speech & Language · doi:10.1016/j.csl.2024.101695 · Cited by 12
Diffusion-Based Graph Generative Methods
Chen, H., Xu, C., Zheng, L., Zhang, Q., & Lin, X. (2024) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2024.3466301 · Cited by 11
A Cross-Modal Autoencoder for Contactless Electrocardiography Monitoring Using Frequency-Modulated Continuous Wave Radar
Liu, K.-C., Peng, S.-Y., Tsao, Y., Liu, C.-Y., Chen, Z.-A., Han, Z., Chen, W.-C., Hsieh, P.-Q., Li, Y.-J., Hsu, Y.-J., et al. (2024) · IEEE Sensors Journal · doi:10.1109/jsen.2024.3486154 · Cited by 8
w2v-SELD: A Sound Event Localization and Detection Framework for Self-Supervised Spatial Audio Pre-Training
dos Santos, O. L., Rosero, K., Masiero, B. S., & Lotufo, R. (2024) · IEEE Access · doi:10.1109/access.2024.3510453 · Cited by 13
From global to local: A lightweight CNN approach for long-term time series forecasting
Mo, S., Yang, C., Mo, Y., Yao, Z., Li, B., Fan, S., & Wang, H. (2025) · Computers & Electrical Engineering · doi:10.1016/j.compeleceng.2025.110192 · Cited by 14
HDMoLE: Mixture of LoRA Experts with Hierarchical Routing and Dynamic Thresholds for Fine-Tuning LLM-based ASR Models
Mu, B., Wei, K., Shao, Q., Xu, Y., & Xie, L. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10888133 · Cited by 13
Deepfake Voice Detection: An Approach Using End-to-End Transformer with Acoustic Feature Fusion by Cross-Attention
Gong, L. Y., & Li, X. J. (2025) · Electronics · doi:10.3390/electronics14102040 · Cited by 13

Authors: Gulati, A., Qin, J., Chiu, C.-C., Parmar, N., Zhang, Y., Yu, J., Han, W., Wang, S., Zhang, Z., Wu, Y., & Pang, R.
Affiliations: Google (United States) (US)
ORCID: Gulati, Anmol
Chiu, Chung-Cheng
Zhang, Yu
Yu, Jiahui
Han, Wei
Wang, Shibo
Zhang, Zhengdong
Wu, Yonghui
Venue: Interspeech 2020
Publisher: ISCA
Published: 2020-10-25
Pages: 5036-5040
ISSN: 2308-457X (ISSN-L)
DOI: 10.21437/interspeech.2020-3015
OpenAlex: W3097777922
Cited by: 3,150
References: 33
Citations by year: 2026: 373 · 2025: 666 · 2024: 644 · 2023: 708 · 2022: 424 · 2021: 300 · 2020: 35
FWCI: 140.10
Type: conference paper
Language: en
Open access: green
arxiv.org
Licence: public-domain
Locations: Interspeech (USB) (publishedVersion)
arXiv (Cornell University) (submittedVersion, public-domain)
arXiv (Cornell University)
Topics: Physical Sciences › Computer Science › Artificial Intelligence › Speech Recognition and Synthesis
Physical Sciences › Computer Science › Signal Processing › Speech and Audio Processing
Physical Sciences › Computer Science › Signal Processing › Music and Audio Processing
Keywords: conformational isomers, speech recognition, CNN-Transformer hybrid, parameter-efficient models, LibriSpeech, word error rate

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Conformer: Convolution-augmented Transformer for Speech Recognition

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Citations

Cites

Cited by

Related

Metadata

Record

About these checks