Dysarthric Speech Recognition Using Convolutional LSTM Neural Network
The DOI matches its Crossref record; 17 of the 17 references it cites were found in a registry or an index.
Abstract
Dysarthria is a motor speech disorder that impedes the physical production of speech. Speech in patients with dysarthria is generally characterized by poor articulation, breathy voice, and monotonic intonation. Therefore, modeling the spectral and temporal characteristics of dysarthric speech is critical for better performance in dysarthric speech recognition. Convolutional long short-term memory recurrent neural networks (CLSTM-RNNs) have recently successfully been used in normal speech recognition, but have rarely been used in dysarthric speech recognition. We hypothesized CLSTM-RNNs have the potential to capture the distinct characteristics of dysarthric speech, taking advantage of convolutional neural networks (CNNs) for extracting effective local features and LSTM-RNNs for modeling temporal dependencies of the features. In this paper, we investigate the use of CLSTM-RNNs for dysarthric speech recognition. Experimental evaluation on a database collected from nine dysarthric patients showed that our approach provides substantial improvement over both standard CNN and LSTM-RNN based speech recognizers.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Motor Speech Disorders: Substrates, Differential Diagnosis, and Management
Duffy, J. R. (1995) · Cited by 1,892
Convolutional, Long Short-Term Memory, fully connected Deep Neural Networks
Sainath, T. N., Vinyals, O., Senior, A., & Sak, H. (2015) · 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2015.7178838 · Cited by 1,678
Improvements to Deep Convolutional Neural Networks for LVCSR
Sainath, T. N., Kingsbury, B., Mohamed, A.-R., Dahl, G. E., Saon, G., Soltau, H., Beran, T., Aravkin, A. Y., & Ramabhadran, B. (2013) · 2013 IEEE Workshop on Automatic Speech Recognition and Understanding · doi:10.1109/asru.2013.6707749 · Cited by 243
Articulatory Knowledge in the Recognition of Dysarthric Speech
Rudzicz, F. (2011) · IEEE Transactions on Audio, Speech, and Language Processing · doi:10.1109/tasl.2010.2072499 · Cited by 103
Tóth, L. (2014) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2014.6853584 · Cited by 90
Automatic Speech Recognition with Deep Neural Networks for Impaired Speech
España-Bonet, C., & Fonollosa, J. A. R. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-49169-1_10 · Cited by 79
Hmm-Based and Svm-Based Recognition of the Speech of Talkers With Spastic Dysarthria
Hasegawa-Johnson, M., Gunderson, J., Perlman, A., & Huang, T. (2006) · 2006 IEEE International Conference on Acoustics Speed and Signal Processing Proceedings · doi:10.1109/icassp.2006.1660840 · Cited by 77
Combining in-domain and out-of-domain speech data for automatic recognition of disordered speech
Christensen, H., Aniol, M. B., Bell, P., Green, P. D., Hain, T., King, S., & Swietojanski, P. (2013) · Interspeech 2013 · doi:10.21437/interspeech.2013-324 · Cited by 63
Regularized Speaker Adaptation of KL-HMM for Dysarthric Speech Recognition
Kim, M., Kim, Y., Yoo, J., Wang, J., & Kim, H. (2017) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2017.2681691 · Cited by 56
Self-citationDeep Autoencoder Based Speech Features for Improved Dysarthric Speech Recognition
Vachhani, B. B., Bhat, C. G., Das, B., & Kopparapu, S. K. (2017) · Interspeech (USB) · doi:10.21437/interspeech.2017-1318 · Cited by 47
Time-frequency convolutional networks for robust speech recognition
Mitra, V., & Franco, H. (2015) · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru.2015.7404811 · Cited by 38
Lee, J., Bell, M., & Simmons, Z. (2017) · American Journal of Speech-Language Pathology · doi:10.1044/2017_ajslp-16-0230 · Cited by 35
Modelling Errors in Automatic Speech Recognition for Dysarthric Speakers
Caballero Morales, S. O., & Cox, S. J. (2009) · EURASIP Journal on Advances in Signal Processing · doi:10.1155/2009/308340 · Cited by 23
Dysarthric speech recognition using a convolutive bottleneck network
Nakashika, T., Yoshioka, T., Takiguchi, T., Ariki, Y., Duffner, S., & García, C. (2014) · International Conference on Signal Processing · doi:10.1109/icosp.2014.7015056 · Cited by 19
Dysarthric Speech Recognition Using Kullback-Leibler Divergence-Based Hidden Markov Model
Kim, M., Wang, J., & Kim, H. (2016) · Interspeech (USB) · doi:10.21437/interspeech.2016-776 · Cited by 19
Self-citationHahm, S., Heitzman, D., & Wang, J. (2015) · Proceedings of SLPAT 2015: 6th Workshop on Speech and Language Processing for Assistive Technologies · doi:10.18653/v1/w15-5109 · Cited by 11
Self-citationKim, M., Cao, B., & Wang, J. (2018) · Advances in intelligent systems and computing · doi:10.1007/978-3-030-00214-5_133 · Cited by 6
Self-citation
Cited by
Gupta, S., Patil, A. T., Purohit, M., Parmar, M., Patel, M., Patil, H. A., & Guido, R. C. (2021) · Neural Networks · doi:10.1016/j.neunet.2021.02.008 · Cited by 85
Automated Dysarthria Severity Classification Using Deep Learning Frameworks
Joshy, A. A., & Rajan, R. (2020) · European Signal Processing Conference (EUSIPCO) · doi:10.23919/eusipco47968.2020.9287741 · Cited by 83
Spectro-Temporal Representation of Speech for Intelligibility Assessment of Dysarthria
M, C. H., Karjigi, V., & Sreedevi, N. (2019) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2019.2949912 · Cited by 75
Yakoub, M. S., Selouani, S., Zaidi, B.-F., & Bouchair, A. (2020) · EURASIP Journal on Audio Speech and Music Processing · doi:10.1186/s13636-019-0169-5 · Cited by 72
Personalized Adversarial Data Augmentation for Dysarthric and Elderly Speech Recognition
Jin, Z., Geng, M., Deng, J., Wang, T., Hu, S., Li, G., & Liu, X. (2023) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2023.3323888 · Cited by 62
Metadata
- Authors
- Kim, M., Cao, B., An, K., & Wang, J.
- Venue
- Interspeech 2018
- Publisher
- ISCA
- Published
- 2018-09-02
- Pages
- 2948-2952
- ISSN
- 2308-457X (ISSN-L)
- OpenAlex
- W2889469831
- Cited by
- 55
- References
- 17
- Citations by year
- 2026: 2 · 2025: 7 · 2024: 7 · 2023: 14 · 2022: 7 · 2021: 10 · 2020: 5 · 2019: 3
- FWCI
- 1.83
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- Interspeech (USB) (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Speech Recognition and Synthesis
- Health Sciences › Health Professions › Speech and Hearing › Voice and Speech Disorders
- Physical Sciences › Computer Science › Signal Processing › Speech and Audio Processing
- Keywords
- dysarthria, speech recognition, convolutional LSTM, motor speech disorders, speech motor control
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.