Deep Learning Bidirectional LSTM based Detection of Prolongation and Repetition in Stuttered Speech using Weighted MFCC
Open accessThe DOI matches its Crossref record; 46 of the 46 references it cites were found in a registry or an index.
Abstract
Stuttering is a neuro-development disorder during which normal speech flow is not fluent. Traditionally Speech-Language Pathologists used to assess the extent of stuttering by counting the speech disfluencies manually. Such sorts of stuttering assessments are arbitrary, incoherent, lengthy, and error-prone. The present study focused on objective assessment to speech disfluencies such as prolongation and syllable, word, and phrase repetition. The proposed method is based on the Weighted Mel Frequency Cepstral Coefficient feature extraction algorithm and deep-learning Bidirectional Long-Short term Memory neural network for classification of stuttered events. The work has utilized the UCLASS stuttering dataset for analysis. The speech samples of the database are initially pre-processed, manually segmented, and labeled as a type of disfluency. The labeled speech samples are parameterized to Weighted MFCC feature vectors. Then extracted features are inputted to the Bidirectional-LSTM network for training and testing of the model. The effect of different hyper-parameters on classification results is examined. The test results show that the proposed method reaches the best accuracy of 96.67%, as compared to the LSTM model. The promising recognition accuracy of 97.33%, 98.67%, 97.5%, 97.19%, and 97.67% was achieved for the detection of fluent, prolongation, syllable, word, and phrase repetition, respectively.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures




![Fig. 6 LSTM Cell [49] .](https://figures.cochat.ai/paper-figures/7228299858ad42fc8b230a647fcbe2d7/deep-learning-bidirectional-lstm-based-detection-of-prolongation-and-repetition-figure-6.png)
![Fig. 7 Structure of an unfolded Bi-LSTM Layer [52].](https://figures.cochat.ai/paper-figures/a0f4dedc88704e0eb42ffb0a36b2df64/deep-learning-bidirectional-lstm-based-detection-of-prolongation-and-repetition-figure-7.png)








Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Traditional assessment of stuttering depends on counting the speech disfluencies manually, such method of assessment is arbitrary, incoherent, lengthy, and error-prone. 22”
From The role of AI in the diagnosis of speech and language disorders: A systematic mapping study (2025) · cites this paper as [22]
The cited source says what the claim attributes to it.
In the citing paper
“Furthermore, an accuracy percentage of 97.19% was achieved to detect disfluent speech (word repetition), with a sensitivity of 87.5%, and a specificity of 99.37%.”
From The role of AI in the diagnosis of speech and language disorders: A systematic mapping study (2025) · cites this paper as [22]
The cited source says what the claim attributes to it.
In the citing paper
“Deep learning Bi-LSTM: Achieved in 22 study an accuracy percentage of 98.67% to detect disfluent speech (prolongation), with a sensitivity of 97.5%, and a specificity of 98.12%.”
From The role of AI in the diagnosis of speech and language disorders: A systematic mapping study (2025) · cites this paper as [22]
The cited source says what the claim attributes to it.
In the citing paper
“While detecting the disfluent speech (syllable repetition) has achieved an accuracy percentage of 97.5%, and a sensitivity of 92.5%, and a specificity of 98.12%.”
From The role of AI in the diagnosis of speech and language disorders: A systematic mapping study (2025) · cites this paper as [22]
The cited source says what the claim attributes to it.
In the citing paper
“Lastly, achieved an accuracy percentage of 97.33% to detect fluent speech, with a sensitivity of 90%, and a specificity 98.75%.”
From The role of AI in the diagnosis of speech and language disorders: A systematic mapping study (2025) · cites this paper as [22]
1 more claim about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318 · cited 1×
“1) Long-Short Term Memory: LSTM is a specialized Recurrent Neural Network (RNN) architecture, competent in learning long term dependencies [48].”
BackgroundBidirectional recurrent neural networks
Schuster, M., & Paliwal, K. K. (1997) · IEEE Transactions on Signal Processing · doi:10.1109/78.650093 · Cited by 10,172 · cited 8×
“RNN suffers from short-term memory, caused by vanishing gradient problem.”
BackgroundInfluentialLearning long-term dependencies with gradient descent is difficult
Bengio, Y., Simard, P., & Frasconi, P. (1994) · IEEE Transactions on Neural Networks · doi:10.1109/72.279181 · Cited by 8,542 · cited 1×
“However, the RNN is good at modeling the temporal data but suffers from the problem of short-term memory caused by vanishing gradient [33][34][35].”
BackgroundFundamentals of speech recognition
Rabiner, L. R., & Juang, B.-H. F. (1993) · Cited by 7,680
On the difficulty of training recurrent neural networks
Pascanu, R., Mikolov, T., & Bengio, Y. (2012) · arXiv · doi:10.48550/arxiv.1211.5063 · Cited by 4,310 · cited 1×
“However, the RNN is good at modeling the temporal data but suffers from the problem of short-term memory caused by vanishing gradient [33][34][35].”
BackgroundThe Vanishing Gradient Problem During Learning Recurrent Neural Nets and Problem Solutions
Hochreiter, S. (1998) · International Journal of Uncertainty, Fuzziness and Knowledge-Based Systems · doi:10.1142/s0218488598000094 · Cited by 2,939 · cited 1×
“They are capable of learning long term dependencies [37].”
BackgroundDigital Processing of Speech Signals
Ackroyd, M. H. (1979) · Electronics and Power · doi:10.1049/ep.1979.0173 · Cited by 2,391
Spoken Language Processing: A Guide to Theory, Algorithm, and System Development
Huang, X., Acero, A., Hon, H.-W., & Reddy, R. (2001) · Cited by 1,593
The Performance of LSTM and BiLSTM in Forecasting Time Series
Siami-Namini, S., Tavakoli, N., & Namin, A. S. (2019) · 2019 IEEE International Conference on Big Data (Big Data) · doi:10.1109/bigdata47090.2019.9005997 · Cited by 1,574 · cited 1×
“Hence gives better classification accuracy as compared to one-way LSTM [53].”
ResultGradient Flow in Recurrent Nets: The Difficulty of Learning LongTerm Dependencies
(2009) · A Field Guide to Dynamical Recurrent Networks · doi:10.1109/9780470544037.ch14 · Cited by 1,246
Speech Recognition Using Deep Neural Networks: A Systematic Review
Nassif, A. B., Shahin, I., Attili, I., Azzeh, M., & Shaalan, K. (2019) · IEEE Access · doi:10.1109/access.2019.2896880 · Cited by 1,152 · cited 1×
“Deep learning provides a more accurate representation of objects and can automatically obtain objects features from a vast amount of data [26].”
BackgroundStuttering: An Integrated Approach to Its Nature and Treatment
Guitar, B. E. (1991) · Medical Entomology and Zoology · Cited by 971
Gradient Flow in Recurrent Nets: the Difficulty of Learning Long-Term Dependencies
Hochreiter, S., Bengio, Y., Informatik, F. F., Bengio, Y., Frasconi, P., & Schmidhuber, J. (2001) · Cited by 863
Kernel Methods for Deep Learning
Cho, Y., & Saul, L. K. (2009) · eScholarship (California Digital Library) · Cited by 720
Framewise phoneme classification with bidirectional LSTM networks
Graves, A., & Schmidhuber, J. (2006) · Proceedings. 2005 IEEE International Joint Conference on Neural Networks, 2005. · doi:10.1109/ijcnn.2005.1556215 · Cited by 618 · cited 1×
“Based on the above considerations, this paper applies BiLSTM for the classification of a vast amount of speech data [38].”
MethodGrossberg, S. (2013) · Scholarpedia · doi:10.4249/scholarpedia.1888 · Cited by 602
Cui, Z., Ke, R., Pu, Z., & Wang, Y. (2020) · Transportation Research Part C: Emerging Technologies · doi:10.1016/j.trc.2020.102674 · Cited by 486
Johnson, W. (1961) · PubMed · Cited by 243
Classification of speech dysfluencies with MFCC and LPCC features
Chia Ai, O., Hariharan, M., Yaacob, S., & Sin Chee, L. (2012) · Expert Systems with Applications · doi:10.1016/j.eswa.2011.07.065 · Cited by 174 · cited 1×
“2012 [13] MFCC and LPCC KNN and LDA UCLASS database Repetition and Prolongation MFCC- 92.”
MethodThe social and communication impact of stuttering on adolescents and their families
Erickson, S., & Block, S. (2013) · Journal of Fluency Disorders · doi:10.1016/j.jfludis.2013.09.003 · Cited by 164 · cited 1×
“Furthermore, it ruins their self-confidence, relationship with others, employment opportunities, and opinions of others about them [3].”
BackgroundVoiced/Unvoiced Decision for Speech Signals Based on Zero-Crossing Rate and Energy
Bachu, R. G., Kopparthi, S., Adapa, B., & Barkana, B. D. (2010) · Advanced Techniques in Computing Sciences and Software Engineering · doi:10.1007/978-90-481-3660-5_47 · Cited by 162 · cited 1×
“2), has been used in this work [42][43].”
MethodZhong, G., Ling, X., & Wang, L. (2018) · Wiley Interdisciplinary Reviews Data Mining and Knowledge Discovery · doi:10.1002/widm.1255 · Cited by 119 · cited 1×
“These architectures are ideally suited for simple or constrained problems, since their limited capabilities can cause problems in complicated large-scale real-world problems [30].”
BackgroundMFCC based recognition of repetitions and prolongations in stuttered speech using k-NN and LDA
Chee, L. S., Ai, O. C., Hariharan, M., & Yaacob, S. (2009) · 2009 IEEE Student Conference on Research and Development (SCOReD) · doi:10.1109/scored.2009.5443210 · Cited by 75
Robust Softmax Regression for Multi-class Classification with Self-Paced Learning
Ren, Y., Zhao, P., Sheng, Y., Yao, D., & Xu, Z. (2017) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2017/368 · Cited by 63 · cited 1×
“The probability of classifying into class in the softmax regression [54] can be defined by (12).”
BackgroundAutomatic detection of prolongations and repetitions using LPCC
Chee, L. S., Ai, O. C., Hariharan, M., & Yaacob, S. (2009) · 2009 International Conference for Technical Postgraduates (TECHPOS) · doi:10.1109/techpos.2009.5412080 · Cited by 59 · cited 1×
“2010 [11] LPCC KNN and LDA 10 samples of 8 males and 2 females (11 to 20 years) from UCLASS Repetition and Prolongation 88.”
MethodSpoken Digits Recognition using Weighted MFCC and Improved Features for Dynamic Time Warping
Chapaneri, S. (2012) · International Journal of Computer Applications · doi:10.5120/5022-7167 · Cited by 59 · cited 2×
“The labeled speech samples are parameterized to Weighted MFCC feature vectors.”
MethodApplication of Malay speech technology in Malay Speech Therapy Assistance Tools
Tan, T.-S., Helbin-Liboh, Ariff, A. K., Ting, C.-M., & Salleh, S.-H. (2007) · 2007 International Conference on Intelligent and Advanced Systems · doi:10.1109/icias.2007.4658401 · Cited by 55
Voice activity detection based on short-time energy and noise spectrum adaptation
Enqing, D., Guizhong, L., Yatong, Z., & Cai, Y. (2003) · doi:10.1109/icosp.2002.1181092 · Cited by 47 · cited 1×
“2), has been used in this work [42][43].”
MethodSpeech recognition using artificial neural networks
Lim, C. P., Woo, S. C., Loh, A. S., & Osman, R. (2002) · International Conference on Web Information Systems Engineering (WISE) · doi:10.1109/wise.2000.882421 · Cited by 46 · cited 1×
“ANN does not have structured methodology as well as time-consuming for large networks [32].”
BackgroundComparison of speech parameterization techniques for the classification of speech disfluencies
Fook, C. Y., Hariharan, M., Chee, L. S., Adom, A. H., & Yaacob, S. (2013) · TURKISH JOURNAL OF ELECTRICAL ENGINEERING & COMPUTER SCIENCES · doi:10.3906/elk-1112-84 · Cited by 40 · cited 1×
“2013 [15] MFCC, PLP, and LPC KNN, LDA, and SVM UCLASS database Repetition and Prolongation Best average classification accuracy is given by SVM using the WLPCC, PLP, and MFCC features- 95%”
MethodEsmaili, I., Dabanloo, N. J., & Vali, M. (2016) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2015.08.006 · Cited by 39 · cited 1×
“2016 [22] MFCC and PLP Cross-correlation, Euclidean distance using Morphological Image Processing UCLASS database Prolongation, word repetition, and phrase repetition Prolongation- 99.”
MethodCui, Z., Ke, R., Pu, Z., et al. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2005.11627 · Cited by 37 · cited 2×
“Structure of an unfolded Bi-LSTM Layer [52].”
BackgroundDisfluency Detection using Auto-Correlational Neural Networks
Lou, P. J., Anderson, P., & Johnson, M. (2018) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d18-1490 · Cited by 36 · cited 2×
“The deep learning technique CNN performs very well on non-sequential data while fails in interpreting temporal information.”
BackgroundHierarchical ANN system for stuttering identification
Świetlicka, I., Kuniszyk–Jóźkowiak, W., & Smółka, E. (2012) · Computer Speech & Language · doi:10.1016/j.csl.2012.05.003 · Cited by 34 · cited 1×
“2013 [16] SOM Hierarchal ANN, MLP 153 recordings of 19 PWS Blocks, syllable repetition and syllable initial prolongation Blocks- 96% Syllable Repetition- 84% and Prolongation-99%”
MethodFacilities to assist people to research into stammered speech.
Howell, P. G., & Huckvale, M. A. (2004) · PubMed · Cited by 27
Artificial Neural Networks in the Disabled Speech Analysis
Świetlicka, I., Kuniszyk–Jóźkowiak, W., & Smółka, E. (2009) · Advances in intelligent and soft computing · doi:10.1007/978-3-540-93905-4_41 · Cited by 25 · cited 1×
“2009 [7] Kohonen Network Multi-layer Perceptron and RBF 59 800ms samples of 8 stuttering Polish speakers Repetition and Prolongation MLP- 92% RBF- 91%”
MethodSpeech stuttering assessment using sample entropy and Least Square Support Vector Machine
Hariharan, M., Vijean, V., Fook, C. Y., & Yaacob, S. (2012) · IEEE International Colloquium on Signal Processing & Its Applications (CSPA) · doi:10.1109/cspa.2012.6194726 · Cited by 24 · cited 1×
“2012 [14] Spectral Entropy using Bark, Mel and Erb Scale SVM UCLASS database Repetition and Prolongation Average accuracy- 96%.”
MethodIssues and Limitations of HMM in Speech Processing: A Survey
Chakraborty, C., & Talukdar, P. (2016) · International Journal of Computer Applications · doi:10.5120/ijca2016909693 · Cited by 23 · cited 1×
“It also requires a large number of parameters and data for building and training the model [31].”
BackgroundM, R. K. K., & Ganesan, S. (2011) · Cited by 19
Repetition Detection in Stuttered Speech
Ramteke, P. B., Koolagudi, S. G., & Afroz, F. (2015) · Smart innovation, systems and technologies · doi:10.1007/978-81-322-2538-6_63 · Cited by 16 · cited 1×
“2016 [20] MFCC, Formant and Shimmer DTW 50 repetition events Repetition 94%”
BackgroundRecognition of Repetition and Prolongation in Stuttered Speech Using ANN
Savin, P. S., Ramteke, P. B., & Koolagudi, S. G. (2015) · Smart innovation, systems and technologies · doi:10.1007/978-81-322-2538-6_8 · Cited by 13 · cited 2×
“[19] employed an ANN for classification.”
BackgroundAutomatic Segmentation and Classification of Dysfluencies in Stuttering Speech
Mahesha, P., & Vinod, D. S. (2016) · International Conference on Information and Communication Technology for Competitive Strategies (ICTCS) · doi:10.1145/2905055.2905245 · Cited by 10 · cited 1×
“2016 [21] MACV Thresholding 5 Stuttering person speech samples from UCLASS database Repetition and Prolongation 73.”
BackgroundClassification of Stuttering Events Using I-Vector
Ghonem, S., Abdou, S. M., Esmael, M., & Ghamry, N. A. (2017) · The Egyptian Journal of Language Engineering /The Egyptian Journal of Language Engineering · doi:10.21608/ejle.2017.59395 · Cited by 10 · cited 1×
“2017 [23] MFCC I-Vector 1380 segments of 18 PWS from UCLASS.”
BackgroundAutomatic Speech Recognition with Stuttering Speech Removal using Long Short-Term Memory (LSTM)
Girirajan, S., Sangeetha, R., Preethi, T., & Chinnappa, A. (2020) · International Journal of Recent Technology and Engineering (IJRTE) · doi:10.35940/ijrte.e6230.018520 · Cited by 10 · cited 2×
“2020 [25] MFCC LSTM UCLASS database Prolongation, Blocks, and Repetition 4% and 6% higher than ANN and SVM”
BackgroundMethodStutter Diagnosis and Therapy System Based on Deep LearningPreprint
Bhatia, G. S., Saha, B., Khamkar, M., Chandwani, A., & Khot, R. (2020) · arXiv.org · doi:10.48550/arxiv.2007.08003 · Cited by 8 · cited 2×
“Deep structured learning models based on these functional attributes include convolutional neural network (CNN) [27], recurrent neural network (RNN) [28][24], and long-short term memory (LSTM) [25].”
BackgroundMethodAnalysis of 0dB and 10dB babble noise on stuttered speech
Jabeen, S., & Ravikumar, K. M. (2015) · doi:10.1109/icsns.2015.7292422 · Cited by 5 · cited 1×
“2015 [18] MFCC KNN 80 speech samples for training and 20 for testing Repetition with 0db to 10db babble noise 60-95% depending on the sound used”
Method
Research works printed but not linked: 5
- [5][5] S. Gupta, R. S. Shukla, and R. K. Shukla, 'Literature survey and review of techniques used for automatic assessment of Stuttered Speech,' Int. J. Manag. Technol. Eng., vol. IX, no. X, pp. 229-240, 2019. -
- [8][8] K. M. Ravikumar, R. Rajagopal, and H. C. Nagaraj, 'An Approach for Objective Assessment of Stuttered Speech Using MFCC Features,' vol. 9, no. 1, pp. 19-24, 2009. -
- [17][17] J. Pálfy, 'Analysis of Dysfluencies by Computational Intelligence,' Information Sci. Technol. Bull. ACM Slovakia, vol. 6, no. 2, pp. 45-58, 2014. -
- [39][39] P. Howell, S. Davis, and J. Bartrip, 'Europe PMC Funders Group The UCLASS archive of stuttered speech,' vol. 52, no. 2, pp. 556-569, 2010. -
- [51][51] A. Graves, N. Jaitly, and A. Mohamed, 'Hybrid speech recognition with deep bidirectional LSTM Alex Graves , Navdeep Jaitly and Abdelrahman Mohamed University of Toronto Department of Computer Science 6 King ' s College Rd . Toronto , M5S 3G4 , Canada,' pp. 273278, 2013. -
Cited by
Mel Frequency Cepstral Coefficient and its Applications: A Review
Abdul, Z. K., & Al-Talabani, A. K. (2022) · IEEE Access · doi:10.1109/access.2022.3223444 · Cited by 527
Tang, Z. L., Bo, L., Liu, X., & Wei, D. (2021) · Applied Intelligence · doi:10.1007/s10489-021-02504-1 · Cited by 40
“Engineers extract the acoustic features (mel-frequency cepstral coefficients, log-filterbank energy) of speech and feed them into the LSTM network for natural language modeling [36].”
BackgroundSystematic Review of Machine Learning Approaches for Detecting Developmental Stuttering
Barrett, L., Hu, J., & Howell, P. (2022) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2022.3155295 · Cited by 49
Świetlicka, I., Kuniszyk–Jóźkowiak, W., & Świetlicki, M. (2022) · Sensors · doi:10.3390/s22010321 · Cited by 29
“Wavelet Transform (DWT) or Perceptual Linear Prediction (PLP), are sensitive to noise and achieve excellent results for clear speech [35,47,48].”
BackgroundComputational Intelligence-Based Stuttering Detection: A Systematic Review
Alnashwan, R., Alhakbani, N., Al-Nafjan, A., Almudhi, A., & Al-Nuwaiser, W. M. (2023) · Diagnostics · doi:10.3390/diagnostics13233537 · Cited by 29
“Moreover, Gupta et al. [21] employed the BLSTM model, achieving an impressive overall classification accuracy of 96.67% in detecting various types of stuttered events.”
BackgroundMethodInfluential
Metadata
- Authors
- Gupta, S., S., R., K., R., & Verma, R.
- Affiliations
- Invertis University (IN)
- King Khalid University (SA)
- Venue
- International Journal of Advanced Computer Science and Applications
- Published
- 2020
- Volume
- 11
- Issue
- 9
- ISSN
- 2156-5570 (ISSN-L)
- 2158-107X
- OpenAlex
- W3090973479
- Cited by
- 26
- References
- 45
- Citations by year
- 2026: 3 · 2025: 6 · 2024: 3 · 2023: 5 · 2022: 6 · 2021: 3
- FWCI
- 1.39
- Type
- journal article
- Language
- en
- Open access
- diamond
- doi.org
- Licence
- cc-by
- Locations
- International Journal of Advanced Computer Science and Applications (publishedVersion, cc-by)
- International Journal of Advanced Computer Science and Applications (submittedVersion, cc-by)
- Topics
- Social Sciences › Psychology › Clinical Psychology › Stuttering Research and Treatment
- Physical Sciences › Computer Science › Artificial Intelligence › Speech Recognition and Synthesis
- Health Sciences › Health Professions › Speech and Hearing › Voice and Speech Disorders
- Keywords
- stuttering detection, disfluency, prolongation, syllable repetition, word repetition, phrase repetition, bidirectional LSTM
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.