CoChat

Deep Learning Bidirectional LSTM based Detection of Prolongation and Repetition in Stuttered Speech using Weighted MFCC

Open access
Gupta, Sakshi, S., Ravi, K., Rajesh, Verma, Rajesh · 2020 · International Journal of Advanced Computer Science and Applications

The DOI matches its Crossref record; 46 of the 46 references it cites were found in a registry or an index.

Abstract

Stuttering is a neuro-development disorder during which normal speech flow is not fluent. Traditionally Speech-Language Pathologists used to assess the extent of stuttering by counting the speech disfluencies manually. Such sorts of stuttering assessments are arbitrary, incoherent, lengthy, and error-prone. The present study focused on objective assessment to speech disfluencies such as prolongation and syllable, word, and phrase repetition. The proposed method is based on the Weighted Mel Frequency Cepstral Coefficient feature extraction algorithm and deep-learning Bidirectional Long-Short term Memory neural network for classification of stuttered events. The work has utilized the UCLASS stuttering dataset for analysis. The speech samples of the database are initially pre-processed, manually segmented, and labeled as a type of disfluency. The labeled speech samples are parameterized to Weighted MFCC feature vectors. Then extracted features are inputted to the Bidirectional-LSTM network for training and testing of the model. The effect of different hyper-parameters on classification results is examined. The test results show that the proposed method reaches the best accuracy of 96.67%, as compared to the LSTM model. The promising recognition accuracy of 97.33%, 98.67%, 97.5%, 97.19%, and 97.67% was achieved for the detection of fluent, prolongation, syllable, word, and phrase repetition, respectively.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.14569/ijacsa.2020.0110941

Cites

46 of 46 references verified0 citation errors · 0 not checkable

Statistics

Figures

Fig. 2 Speech Pre-Processing by Silence Removal.
Fig. 2 Speech Pre-Processing by Silence Removal.CC-BY · From the PDF
Fig. 3 Silence Removal using STE-ZCR Method.
Fig. 3 Silence Removal using STE-ZCR Method.CC-BY · From the PDF
Fig. 4 Disfluent Speech Sample Segmentation and Labeling.
Fig. 4 Disfluent Speech Sample Segmentation and Labeling.CC-BY · From the PDF
Fig. 5 WMFCC Feature Extraction Process.
Fig. 5 WMFCC Feature Extraction Process.CC-BY · From the PDF
Fig. 6 LSTM Cell [49] .
Fig. 6 LSTM Cell [49] .CC-BY · From the PDF
Fig. 7 Structure of an unfolded Bi-LSTM Layer [52].
Fig. 7 Structure of an unfolded Bi-LSTM Layer [52].CC-BY · From the PDF
Fig. 8 Bi-LSTM Network.
Fig. 8 Bi-LSTM Network.CC-BY · From the PDF
Fig. 9 Bi-LSTM Training and Testing Process.
Fig. 9 Bi-LSTM Training and Testing Process.CC-BY · From the PDF
Image 9
CC-BY · From the PDF
Image 10
CC-BY · From the PDF
Fig. 12 Changes between Epochs and Accuracy.
Fig. 12 Changes between Epochs and Accuracy.CC-BY · From the PDF
Fig. 13 Changes between the Hidden units and Accuracy.
Fig. 13 Changes between the Hidden units and Accuracy.CC-BY · From the PDF
Fig. 14 Accuracy Comparison of LSTM and Bi-LSTM Models.
Fig. 14 Accuracy Comparison of LSTM and Bi-LSTM Models.CC-BY · From the PDF
Fig. 15 Loss Comparison of LSTM and Bi-LSTM Models.
Fig. 15 Loss Comparison of LSTM and Bi-LSTM Models.CC-BY · From the PDF

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

1 more claim about this paper

Create a free account to see every claim other papers make about this one.

See all claims — free account

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Research works printed but not linked: 5

  1. [5][5] S. Gupta, R. S. Shukla, and R. K. Shukla, 'Literature survey and review of techniques used for automatic assessment of Stuttered Speech,' Int. J. Manag. Technol. Eng., vol. IX, no. X, pp. 229-240, 2019. -
  2. [8][8] K. M. Ravikumar, R. Rajagopal, and H. C. Nagaraj, 'An Approach for Objective Assessment of Stuttered Speech Using MFCC Features,' vol. 9, no. 1, pp. 19-24, 2009. -
  3. [17][17] J. Pálfy, 'Analysis of Dysfluencies by Computational Intelligence,' Information Sci. Technol. Bull. ACM Slovakia, vol. 6, no. 2, pp. 45-58, 2014. -
  4. [39][39] P. Howell, S. Davis, and J. Bartrip, 'Europe PMC Funders Group The UCLASS archive of stuttered speech,' vol. 52, no. 2, pp. 556-569, 2010. -
  5. [51][51] A. Graves, N. Jaitly, and A. Mohamed, 'Hybrid speech recognition with deep bidirectional LSTM Alex Graves , Navdeep Jaitly and Abdelrahman Mohamed University of Toronto Department of Computer Science 6 King ' s College Rd . Toronto , M5S 3G4 , Canada,' pp. 273278, 2013. -

Cited by

See all 26

Metadata

Authors
Gupta, S., S., R., K., R., & Verma, R.
Affiliations
  • Invertis University (IN)
  • King Khalid University (SA)
Venue
International Journal of Advanced Computer Science and Applications
Published
2020
Volume
11
Issue
9
ISSN
  • 2156-5570 (ISSN-L)
  • 2158-107X
OpenAlex
W3090973479
Cited by
26
References
45
Citations by year
2026: 3 · 2025: 6 · 2024: 3 · 2023: 5 · 2022: 6 · 2021: 3
FWCI
1.39
Type
journal article
Language
en
Open access
Licence
cc-by
Locations
  • International Journal of Advanced Computer Science and Applications (publishedVersion, cc-by)
  • International Journal of Advanced Computer Science and Applications (submittedVersion, cc-by)
Topics
  • Social Sciences › Psychology › Clinical Psychology › Stuttering Research and Treatment
  • Physical Sciences › Computer Science › Artificial Intelligence › Speech Recognition and Synthesis
  • Health Sciences › Health Professions › Speech and Hearing › Voice and Speech Disorders
Keywords
stuttering detection, disfluency, prolongation, syllable repetition, word repetition, phrase repetition, bidirectional LSTM

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.