Dysarthric Speech Recognition Using Convolutional LSTM Neural Network
The DOI matches its Crossref record; 17 of the 17 references it cites were found in a registry or an index.
Abstract
Dysarthria is a motor speech disorder that impedes the physical production of speech. Speech in patients with dysarthria is generally characterized by poor articulation, breathy voice, and monotonic intonation. Therefore, modeling the spectral and temporal characteristics of dysarthric speech is critical for better performance in dysarthric speech recognition. Convolutional long short-term memory recurrent neural networks (CLSTM-RNNs) have recently successfully been used in normal speech recognition, but have rarely been used in dysarthric speech recognition. We hypothesized CLSTM-RNNs have the potential to capture the distinct characteristics of dysarthric speech, taking advantage of convolutional neural networks (CNNs) for extracting effective local features and LSTM-RNNs for modeling temporal dependencies of the features. In this paper, we investigate the use of CLSTM-RNNs for dysarthric speech recognition. Experimental evaluation on a database collected from nine dysarthric patients showed that our approach provides substantial improvement over both standard CNN and LSTM-RNN based speech recognizers.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Motor Speech Disorders: Substrates, Differential Diagnosis, and Management
Duffy, J. R. (1995) · Cited by 1,892
Convolutional, Long Short-Term Memory, fully connected Deep Neural Networks
Sainath, T. N., Vinyals, O., Senior, A., & Sak, H. (2015) · 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2015.7178838 · Cited by 1,678
Improvements to Deep Convolutional Neural Networks for LVCSR
Sainath, T. N., Kingsbury, B., Mohamed, A.-R., Dahl, G. E., Saon, G., Soltau, H., Beran, T., Aravkin, A. Y., & Ramabhadran, B. (2013) · 2013 IEEE Workshop on Automatic Speech Recognition and Understanding · doi:10.1109/asru.2013.6707749 · Cited by 243
Articulatory Knowledge in the Recognition of Dysarthric Speech
Rudzicz, F. (2011) · IEEE Transactions on Audio, Speech, and Language Processing · doi:10.1109/tasl.2010.2072499 · Cited by 103
Tóth, L. (2014) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2014.6853584 · Cited by 90
Automatic Speech Recognition with Deep Neural Networks for Impaired Speech
España-Bonet, C., & Fonollosa, J. A. R. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-49169-1_10 · Cited by 79
Hmm-Based and Svm-Based Recognition of the Speech of Talkers With Spastic Dysarthria
Hasegawa-Johnson, M., Gunderson, J., Perlman, A., & Huang, T. (2006) · 2006 IEEE International Conference on Acoustics Speed and Signal Processing Proceedings · doi:10.1109/icassp.2006.1660840 · Cited by 77
Combining in-domain and out-of-domain speech data for automatic recognition of disordered speech
Christensen, H., Aniol, M. B., Bell, P., Green, P. D., Hain, T., King, S., & Swietojanski, P. (2013) · Interspeech 2013 · doi:10.21437/interspeech.2013-324 · Cited by 63
Regularized Speaker Adaptation of KL-HMM for Dysarthric Speech Recognition
Kim, M., Kim, Y., Yoo, J., Wang, J., & Kim, H. (2017) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2017.2681691 · Cited by 56
Self-citationDeep Autoencoder Based Speech Features for Improved Dysarthric Speech Recognition
Vachhani, B. B., Bhat, C. G., Das, B., & Kopparapu, S. K. (2017) · Interspeech (USB) · doi:10.21437/interspeech.2017-1318 · Cited by 47
Cited by
Gupta, S., Patil, A. T., Purohit, M., Parmar, M., Patel, M., Patil, H. A., & Guido, R. C. (2021) · Neural Networks · doi:10.1016/j.neunet.2021.02.008 · Cited by 85
Automated Dysarthria Severity Classification Using Deep Learning Frameworks
Joshy, A. A., & Rajan, R. (2020) · European Signal Processing Conference (EUSIPCO) · doi:10.23919/eusipco47968.2020.9287741 · Cited by 83
Spectro-Temporal Representation of Speech for Intelligibility Assessment of Dysarthria
M, C. H., Karjigi, V., & Sreedevi, N. (2019) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2019.2949912 · Cited by 75
Yakoub, M. S., Selouani, S., Zaidi, B.-F., & Bouchair, A. (2020) · EURASIP Journal on Audio Speech and Music Processing · doi:10.1186/s13636-019-0169-5 · Cited by 72
Personalized Adversarial Data Augmentation for Dysarthric and Elderly Speech Recognition
Jin, Z., Geng, M., Deng, J., Wang, T., Hu, S., Li, G., & Liu, X. (2023) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2023.3323888 · Cited by 62
A Survey of Automatic Speech Recognition for Dysarthric Speech
Qian, Z., & Xiao, K. (2023) · Electronics · doi:10.3390/electronics12204278 · Cited by 60
Self-Supervised ASR Models and Features for Dysarthric and Elderly Speech Recognition
Hu, S., Xie, X., Geng, M., Jin, Z., Deng, J., Li, G., Wang, Y., Cui, M., Wang, T., Meng, H. M. L., et al. (2024) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2024.3422839 · Cited by 60
Geng, M., Xie, X., Ye, Z., Wang, T., Li, G., Hu, S., Liu, X., & Meng, H. (2022) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2022.3195113 · Cited by 48
Spectro-Temporal Modeling for Human Activity Recognition Using a Radar Sensor Network
Luo, F., Bodanese, E., Khan, S., & Wu, K. (2023) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2023.3270365 · Cited by 47
Sharma, Y., & Singh, B. K. (2021) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2021.106487 · Cited by 46
Articulatory and bottleneck features for speaker-independent ASR of dysarthric speech
Yılmaz, E., Mitra, V., Sivaraman, G., & Franco, H. (2019) · Computer Speech & Language · doi:10.1016/j.csl.2019.05.002 · Cited by 45
Dysarthria severity assessment using squeeze-and-excitation networks
Joshy, A. A., & Rajan, R. (2023) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2023.104606 · Cited by 45
Acoustic Modelling From Raw Source and Filter Components for Dysarthric Speech Recognition
Yue, Z., Loweimi, E., Christensen, H., Barker, J., & Cvetković, Z. (2022) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2022.3205766 · Cited by 43
Multi-Stage Audio-Visual Fusion for Dysarthric Speech Recognition With Pre-Trained Models
Yu, C., Su, X., & Qian, Z. (2023) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2023.3262001 · Cited by 42
Speech Technology for Automatic Recognition and Assessment of Dysarthric Speech: An Overview
Bhat, C. G., & Strik, H. (2025) · Journal of Speech Language and Hearing Research · doi:10.1044/2024_jslhr-23-00740 · Cited by 39
Yue, Z., Christensen, H., & Barker, J. (2020) · Interspeech (USB) · doi:10.21437/interspeech.2020-2746 · Cited by 39
Cave, R., & Bloch, S. (2021) · Disability and Rehabilitation Assistive Technology · doi:10.1080/17483107.2021.1974961 · Cited by 39
Yue, Z., Xiong, F., Christensen, H., & Barker, J. (2020) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp40776.2020.9054343 · Cited by 36
Voice pathology detection by using the deep network architecture
Ankışhan, H., & İnam, S. Ç. (2021) · Applied Soft Computing · doi:10.1016/j.asoc.2021.107310 · Cited by 35
A Sequential Contrastive Learning Framework for Robust Dysarthric Speech Recognition
Wu, L., Zong, D., Sun, S., & Zhao, J. (2021) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp39728.2021.9415017 · Cited by 27
Speech Intelligibility Classifiers from 550k Disordered Speech Samples
Venugopalan, S., Tobin, J., Yang, S., Seaver, K., Cave, R., Jiang, P.-P., Zeghidour, N., Heywood, R., Green, J. R., & Brenner, M. P. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10095933 · Cited by 24
Mahum, R., El‐Sherbeeny, A. M., Alkhaledi, K. A., & Hassan, H. (2024) · Applied Acoustics · doi:10.1016/j.apacoust.2024.110019 · Cited by 24
Voice Disorder Detection Using Long Short Term Memory (LSTM) ModelPreprint
Gupta, V. (2018) · arXiv (Cornell University) · doi:10.13140/rg.2.2.17433.88165 · Cited by 22
A Review of Automated Intelligibility Assessment for Dysarthric Speakers
Huang, A., Hall, K., Watson, C. I., & Shahamiri, S. R. (2021) · International Conference on Speech Technology and Human-Computer Dialogue (SpeD) · doi:10.1109/sped53181.2021.9587400 · Cited by 21
Venugopalan, S., Shor, J., Plakal, M., Tobin, J., Tomanek, K., Green, J. R., & Brenner, M. P. (2021) · Interspeech (USB) · doi:10.21437/interspeech.2021-1913 · Cited by 21
Deep Learning-Based Acoustic Feature Representations for Dysarthric Speech Recognition
Latha, M., Shivakumar, M. R., Manjula, G., Hemakumar, M., & Kumar, M. K. (2023) · SN Computer Science · doi:10.1007/s42979-022-01623-x · Cited by 19
Automatic Assessment of Chinese Dysarthria Using Audio-visual Vowel Graph Attention Network
Liu, X., Du, X., Liu, J., Su, R., Ng, M. L., Zhang, Y., Yang, Y., Zhao, S., Wang, L., & Yan, N. (2025) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/taslpro.2025.3546562 · Cited by 18
A Novel Approach for Intelligibility Assessment in Dysarthric Subjects
Tripathi, A., Bhosale, S., & Kopparapu, S. K. (2020) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp40776.2020.9053339 · Cited by 17
Ditthapron, A., Lammert, A. C., & Agu, E. (2022) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2022.3158840 · Cited by 16
Multi-Task Transformer with Input Feature Reconstruction for Dysarthric Speech Recognition
Ding, C., Sun, S., & Zhao, J. (2021) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp39728.2021.9414614 · Cited by 15
Woisard, V., Balaguer, M., Fredouille, C., Farinas, J., Ghio, A., Lalain, M., Puech, M., Astésano, C., Pinquier, J., & Lepage, B. (2021) · Head & Neck · doi:10.1002/hed.26903 · Cited by 15
Fredouille, C., Ghio, A., Laaridh, I., Lalain, M., & Woisard, V. (2019) · HAL AMU · Cited by 14
Automatic Classification of Speech Dysarthric Intelligibility Levels Using Textual Feature
Alharbi, G., Alamri, N. K., & Sabbeh, S. F. (2025) · IEEE Access · doi:10.1109/access.2025.3547041 · Cited by 13
Disordered speech recognition considering low resources and abnormal articulation
Lin, Y., Dang, J., Wang, L., Li, S., & Ding, C. (2023) · Speech Communication · doi:10.1016/j.specom.2023.103002 · Cited by 13
Chen, S.-H. K., Saeli, C., & Hu, G. (2023) · Assistive Technology · doi:10.1080/10400435.2023.2260860 · Cited by 11
Geng, M., Xie, X., Deng, J., Jin, Z., Li, G., Wang, T., Hu, S., Li, Z., Meng, H. M. L., & Liu, X. (2025) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/taslpro.2025.3547217 · Cited by 10
Farhadipour, A., & Veisi, H. (2024) · Iran Journal of Computer Science · doi:10.1007/s42044-024-00175-y · Cited by 10
Dysarthric Speech Augmentation Using Prosodic Transformation and Masking for Subword End-to-end ASR
Soleymanpour, M., Johnson, M. T., & Berry, J. (2021) · International Conference on Speech Technology and Human-Computer Dialogue (SpeD) · doi:10.1109/sped53181.2021.9587372 · Cited by 9
Raw acoustic-articulatory multimodal dysarthric speech recognition
Yue, Z., Loweimi, E., Cvetković, Z., Barker, J., & Christensen, H. (2025) · Computer Speech & Language · doi:10.1016/j.csl.2025.101839 · Cited by 8
Aboeitta, A., Sharshar, A., Nafea, Y., & Shehata, S. (2025) · Interspeech (USB) · doi:10.21437/interspeech.2025-1994 · Cited by 8
Residual Convolutional Neural Network-Based Dysarthric Speech Recognition
Kumar, R., Tripathy, M., Anand, R. S., & Kumar, N. (2024) · Arabian Journal for Science and Engineering · doi:10.1007/s13369-024-08919-5 · Cited by 8
Dysarthric Speech Detection Using Hybrid Models
Fazil, S. H., & Sasikala, D. (2023) · International Conference on Computing, Communication and Networking Technologies (ICCCNT) · doi:10.1109/icccnt56998.2023.10308386 · Cited by 7
A comprehensive survey of automatic dysarthric speech recognition
Yadav, S., Yadav, D. M., & Desai, K. R. (2023) · International Journal of Informatics and Communication Technology (IJ-ICT) · doi:10.11591/ijict.v12i3.pp242-250 · Cited by 6
A Comprehensive Performance Evaluation of Whisper Models in Dysarthric Speech Recognition
Singh, S., Zhong, Z., Wang, Q., Mendes, C., Hasegawa‐Johnson, M., Abdulla, W. H., & Shahamiri, S. R. (2025) · Communications in computer and information science · doi:10.1007/978-981-96-6960-8_6 · Cited by 6
Sahu, L. P., & Pradhan, G. (2022) · Circuits Systems and Signal Processing · doi:10.1007/s00034-022-02047-x · Cited by 6
Sahu, L. P., Pradhan, G., & Singh, J. P. (2022) · International Journal of Interactive Multimedia and Artificial Intelligence · doi:10.9781/ijimai.2022.10.003 · Cited by 4
Constant Q Transform for Audio-Visual Dysarthria Severity Assessment
Sun, G., & Wang, L. (2024) · International Symposium on Chinese Spoken Language Processing (ISCSLP) · doi:10.1109/iscslp63861.2024.10800051 · Cited by 3
Liu, J., Yang, Y., Liu, X., Zuo, X., Li, J., Wang, L., & Yan, N. (2024) · International Symposium on Chinese Spoken Language Processing (ISCSLP) · doi:10.1109/iscslp63861.2024.10800436 · Cited by 3
Re-Talk: Automated Speech Assistance for People with Dysarthria
Ali, S. K., Hassan, A. M., Salah, A. M., Mohamed, D. W., Mustafa, M., & Mohamed, E. H. (2023) · النشرة المعلوماتية في الحاسبات والمعلومات · doi:10.21608/fcihib.2023.188592.1077 · Cited by 3
Recent Advances in Dysarthric Speech Recognition: Approaches and Datasets
Alrajhi, T., Ykhlef, M., & Alsanad, A. (2024) · Journal of King Abdulaziz University-Computing and Information Technology Sciences · doi:10.4197/comp.13-2.3 · Cited by 2
Revathi, A. A., Sasikaladevi, N., & Arunprasanth, D. (2022) · Research on Biomedical Engineering · doi:10.1007/s42600-022-00239-7 · Cited by 2
Towards Temporally Explainable Dysarthric Speech Clarity Assessment
Park, S., Gupta, C., Kwan, M. K. Y., Fung, X., Yip, A. W., & Nanayakkara, S. C. (2025) · Interspeech (USB) · doi:10.21437/interspeech.2025-777 · Cited by 2
Efficacy of Current Dysarthric Speech Recognition Techniques
Malik, M., & Khanam, R. (2023) · International Conference on Advanced Computing & Communication Technologies (ICACCTech) · doi:10.1109/icacctech61146.2023.00111 · Cited by 1
On the predictive power of acoustic features in the automatic assessment of dysarthria
Sardhaei, N. M. (2020) · UEF eRepo (University of Eastern Finland) · Cited by 1
A Comprehensive Performance Analysis on Artificial Neural Networks
Panigrahi, S., Subudhi, S., & Ninoria, S. Z. (2022) · International Conference on System Modeling & Advancement in Research Trends (SMART) · doi:10.1109/smart55829.2022.10047509
Farhadipour, A., & Veisi, H. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4505870
Survey of Automatic Dysarthric Speech Recognition
Kure, E. A. N. (2023) · International Journal on Recent and Innovation Trends in Computing and Communication · doi:10.17762/ijritcc.v11i10.8622
Usha, M. (2024) · Communications in computer and information science · doi:10.1007/978-3-031-61287-9_22
LSTM-Based Speech Analysis for Automatic Classification of Dysarthria Severity Levels
Santos, G., Camara, P., SILVA, D. H., Ribeiro, A., Fernandes, S. M. M., & Monteiro, R. D. P. (2025) · Congresso Brasileiro de Inteligência Computacional (CBIC) · doi:10.21528/cbic2025-1188154
Automatic Speech Recognition System for Dysarthria Leveraging Mel Spectrograms and Transfer Learning
Dhanalakshmi, M., Bharathipriya, S., Surya, E. V., & Raj, R. K. (2025) · IEEE International Conference on Intelligent Signal Processing and Effective Communication Technologies (INSPECT) · doi:10.1109/inspect67393.2025.11350691
Development of Hybrid Feature Based Models for Dysarthric Speech Recognition
Aryza, F. N., & Hidayat, S. (2026) · International Journal of Online and Biomedical Engineering (iJOE) · doi:10.3991/ijoe.v22i04.59849
Deep Scattering Spectrum for dysarthric speech recognition, detection and classification
Loweimi, E., Yue, Z., & Cvetković, Z. (2026) · Computer Speech & Language · doi:10.1016/j.csl.2026.102061
Metadata
- Authors
- Kim, M., Cao, B., An, K., & Wang, J.
- Venue
- Interspeech 2018
- Publisher
- ISCA
- Published
- 2018-09-02
- Pages
- 2948-2952
- ISSN
- 2308-457X (ISSN-L)
- OpenAlex
- W2889469831
- Cited by
- 55
- References
- 17
- Citations by year
- 2026: 2 · 2025: 7 · 2024: 7 · 2023: 14 · 2022: 7 · 2021: 10 · 2020: 5 · 2019: 3
- FWCI
- 1.83
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- Interspeech (USB) (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Speech Recognition and Synthesis
- Health Sciences › Health Professions › Speech and Hearing › Voice and Speech Disorders
- Physical Sciences › Computer Science › Signal Processing › Speech and Audio Processing
- Keywords
- dysarthria, speech recognition, convolutional LSTM, motor speech disorders, speech motor control
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.