Automatic Assessment of Speech Intelligibility for Individuals With Aphasia
The DOI matches its Crossref record; 69 of the 71 references it cites were found in a registry or an index.
Abstract
Traditional in-person therapy may be difficult to access for individuals with aphasia due to the shortage of speech-language pathologists and high treatment cost. Computerized exercises offer a promising low-cost and constantly accessible supplement to in-person therapy. Unfortunately, the lack of feedback for verbal expression in existing programs hinders the applicability and effectiveness of this form of treatment. A prerequisite for producing meaningful feedback is speech intelligibility assessment. In this work, we investigate the feasibility of an automated system to assess three aspects of aphasic speech intelligibility: clarity, fluidity, and prosody. We introduce our aphasic speech corpus, which contains speech-based interaction between individuals with aphasia and a tablet-based application designed for therapeutic purposes. We present our method for eliciting reliable ground-truth labels for speech intelligibility based on the perceptual judgment of nonexpert human evaluators. We describe and analyze our feature set engineered for capturing pronunciation, rhythm, and intonation. We investigate the classification performance of our system under two conditions, one using human-labeled transcripts to drive feature extraction, and another using transcripts generated automatically. We show that some aspects of aphasic speech intelligibility can be estimated at human-level performance. Our results demonstrate the potential for the computerized treatment of aphasia and lay the groundwork for bridging the gap between human and automatic intelligibility assessment.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Generally, three types of training datasets are used for aphasia assessment tasks: (1) healthy subjects’ dataset, (2) aphasic patients’ dataset, or (3) a combination of healthy and aphasic dataset [10,12]”
From Performance Evaluation of Machine Learning Frameworks for Aphasia Assessment (2021) · cites this paper as [12]
In the citing paper
“Most research on automatic aphasia assessment [5,9,10,12,13,14,18] has focused on a single aphasia assessment task using automatic speech recognition techniques and a machine learning (ML) framework with a fixed dataset-type.”
From Performance Evaluation of Machine Learning Frameworks for Aphasia Assessment (2021) · cites this paper as [12]
In the citing paper
“The naming, repetition, and auditory verbal comprehension subtests can be automated using customized machine learning [8,11,12].”
From A Comparative Investigation of Automatic Speech Recognition Platforms for Aphasia Assessment Batteries (2023) · cites this paper as [12]
Citations
Cites
The WEKA data mining software: an update
Hall, M., Frank, E., Holmes, G., Pfahringer, B., Reutemann, P., & Witten, I. H. (2009) · ACM SIGKDD Explorations Newsletter · doi:10.1145/1656274.1656278 · Cited by 17,750 · cited 1×
“Since our dataset is relatively small (1,503 data points), we did not do model selection and instead used the default settings specified in the Weka toolkit [65].”
MethodPeng, H., Long, F., & Ding, C. (2005) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2005.159 · Cited by 10,544
(2001) · Cited by 1,932
Motor Speech Disorders: Substrates, Differential Diagnosis, and Management
Duffy, J. R. (1995) · Cited by 1,892
The Geneva Minimalistic Acoustic Parameter Set (GeMAPS) for Voice Research and Affective Computing
Eyben, F., Scherer, K. R., Schuller, B. W., Sundberg, J., Andre, E., Busso, C., Devillers, L. Y., Epps, J., Laukka, P., Narayanan, S. S., et al. (2016) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2015.2457417 · Cited by 1,818 · cited 1×
“Baseline classification results using the GeMAPS acoustic feature set [53] can be found in the SI.”
MethodAcoustic Modeling Using Deep Belief Networks
Mohamed, A.-R., Dahl, G. E., & Hinton, G. (2012) · IEEE Transactions on Audio, Speech, and Language Processing · doi:10.1109/tasl.2011.2109382 · Cited by 1,727
Western Aphasia Battery--Revised
Kertesz, A. (2012) · PsycTESTS Dataset · doi:10.1037/t15168-000 · Cited by 1,367
Correlates of linguistic rhythm in the speech signal
Ramus, F., Nespor, M., & Mehler, J. (1999) · Cognition · doi:10.1016/s0010-0277(99)00058-x · Cited by 1,270
TOBI: a standard for labeling English prosody
Silverman, K., Beckman, M., Pitrelli, J., Ostendorf, M., Wightman, C., Price, P., Pierrehumbert, J., & Hirschberg, J. (1992) · 2nd International Conference on Spoken Language Processing (ICSLP 1992) · doi:10.21437/icslp.1992-260 · Cited by 1,014
Intensity of Aphasia Therapy, Impact on Recovery
Bhogal, S. K., Teasell, R., & Speechley, M. (2003) · Stroke · doi:10.1161/01.str.0000062343.64383.d0 · Cited by 719
Research works printed but not linked: 2
- davis, 2006, Aphasiology Disorders and clinical practice
- wambaugh, 2006, Treatment guidelines for acquired apraxia of speech: A synthesis and evaluation of the evidence, J Med Speech-Lang Pathol, 14, 15
Cited by
Automatic quantitative analysis of spontaneous aphasic speech
Le, D., Licata, K., & Mower Provost, E. (2018) · Speech Communication · doi:10.1016/j.specom.2018.04.001 · Cited by 97
“Features 1–2 capture a PWA’s speech rate, which has been shown in previous work to be useful for assessing the quality of aphasic speech (Le et al., 2014; Le and Provost, 2014; Le et al., 2016) as well as distinguishing between subjects with PPA and healthy controls (Fraser et al.”
BackgroundMethodInfluentialSelf-citationGhasemzadeh, H., Hillman, R. E., & Mehta, D. D. (2024) · Journal of Speech, Language, and Hearing Research · doi:10.1044/2023_jslhr-23-00273 · Cited by 72
“…their cry (Matikolaie & Tadj, 2022), abnormal vocal folds from laryngoscopic images (Cho & Choi, 2020), intelligibility assessment of aphasic speech (Le et al., 2016), swallowing disorder from high-resolution manometry recordings (Mielens et al., 2012), screening for autism spectrum disorder…”
BackgroundLauraitis, A., Maskeliūnas, R., Damaševičius, R., & Krilavičius, T. (2020) · IEEE Access · doi:10.1109/access.2020.2995737 · Cited by 66
“Perez et al. [41] differentiate between healthy controls and HD patients) based on acoustic and lexical features (MFCC, GMM, pause, speech rate, goodness of Pronunciation (GoP) [42]).”
BackgroundClassification of Huntington Disease Using Acoustic and Lexical Features
Perez, M. C., Jin, W., Le, D., Carlozzi, N. E., Dayalu, P., Roberts, A., & Provost, E. M. (2018) · Interspeech (USB) · doi:10.21437/interspeech.2018-2029 · Cited by 60
“trained an ASR system on aphasic speech and used this system to extract speech features for the prediction of intelligibility, including: the number of fillers, phone rate, error rate, utterance length, and goodness of pronunciation [11].”
BackgroundMethodSelf-citationFernández-Díaz, M., & Gallardo-Antolín, A. (2020) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2020.103976 · Cited by 50
Metadata
- Authors
- Le, D., Licata, K., Persad, C., & Provost, E. M.
- Affiliations
- University of Michigan (US)
- Venue
- IEEE/ACM Transactions on Audio, Speech, and Language Processing
- Published
- 2016-11
- Volume
- 24
- Issue
- 11
- Pages
- 2187-2199
- ISSN
- 2329-9290 (ISSN-L)
- 2329-9304
- OpenAlex
- W2502847729
- Cited by
- 59
- References
- 71
- Citations by year
- 2026: 5 · 2025: 8 · 2024: 4 · 2023: 6 · 2022: 3 · 2021: 5 · 2020: 10 · 2019: 7 · 2018: 7 · 2017: 4
- FWCI
- 4.93
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- IEEE/ACM Transactions on Audio Speech and Language Processing (publishedVersion)
- Funders
- University of Michigan
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Speech Recognition and Synthesis
- Health Sciences › Health Professions › Speech and Hearing › Voice and Speech Disorders
- Physical Sciences › Computer Science › Signal Processing › Speech and Audio Processing
- Keywords
- aphasia, speech intelligibility assessment, speech clarity, prosody, intonation, rhythm, feature engineering, ground truth annotation, perceptual judgment
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Automatic Assessment of Speech Intelligibility for Individuals With Aphasia. https://app.cochat.ai/papers/10.1109/taslp.2016.2598428
- The paper
- Le, D., Licata, K., Persad, C., & Provost, E. M. (2016). Automatic Assessment of Speech Intelligibility for Individuals With Aphasia. IEEE/ACM Transactions on Audio, Speech, and Language Processing. https://doi.org/10.1109/taslp.2016.2598428
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.