The DOI matches its Crossref record; 47 of the 47 references it cites were found in a registry or an index.
An Efficient Deep Learning Based Method for Speech Assessment of Mandarin-Speaking Aphasic Patients
Abstract
Speech assessment is an important part of the rehabilitation process for patients with aphasia (PWA). Mandarin speech lucidity features such as articulation, fluency, and tone influence the meaning of the spoken utterance and overall speech clarity. Automatic assessment of these features is important for an efficient assessment of the aphasic speech. Hence, in this paper, a standardized automatic speech lucidity assessment method for Mandarin-speaking aphasic patients using a machine learning based technique is presented. The proposed assessment method adopts the Chinese Rehabilitation Research Center Aphasia Examination (CRRCAE) standard as a guideline. Quadrature based high-resolution time-frequency images with a convolutional neural network (CNN) are utilized to develop a method that can map the relationship between the severity level of aphasic patients' speech and the three speech lucidity features. The results show a linear relationship with statistically significant correlations between the normalized true-class output activations (TCOA) of the CNN model and patients' articulation, fluency, and tone scores, i.e., 0.71 (p < 0.001), 0.60 (p < 0.001) and 0.58 (p < 0.001), respectively. The linearity of the proposed Mandarin aphasic speech assessment method and its significant correlation with the speech severity levels show the efficacy of the method in predicting the severity of impaired Mandarin speech. The outcome of this research envisages assisting speech-language pathologists in Mandarin-speech impairment assessment and promoting early support discharge; hence could alleviate the stress that the healthcare system is currently experiencing in China nationwide. The framework of the proposed Mandarin aphasic speech assessment method can be readily extended to other languages.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“With a large dataset for each aphasia type, classifiers can create distinct boundaries in the features space, resulting in high classification accuracy. Similarly, the CNN model will perform better with a large labeled dataset since it has better generalization in terms of feature extraction from high-resolution images [10].”
From Performance Evaluation of Machine Learning Frameworks for Aphasia Assessment (2021) · cites this paper as [10]
In the citing paper
“Generally, three types of training datasets are used for aphasia assessment tasks: (1) healthy subjects’ dataset, (2) aphasic patients’ dataset, or (3) a combination of healthy and aphasic dataset [10,12]”
From Performance Evaluation of Machine Learning Frameworks for Aphasia Assessment (2021) · cites this paper as [10]
In the citing paper
“The degradation in the performance of this model is due to the diversity of the aphasic dataset [10]. The recruited patients have different speech impairment severity levels, as reported in [10], that resulted in complex and unresolvable common features. Also, the aphasic multi-types (i.e., Global aphasia, Broca’s aphasia, Wernicke’s aphasia and Amnesic aphasia) speech datasets are scarce and”
From Performance Evaluation of Machine Learning Frameworks for Aphasia Assessment (2021) · cites this paper as [10]
In the citing paper
“Furthermore, the speech data were manually inspected, and all outliers (4% of the total dataset) were removed [10].”
From Performance Evaluation of Machine Learning Frameworks for Aphasia Assessment (2021) · cites this paper as [10]
In the citing paper
“The data collection environment for the healthy subjects and patients was largely consistent [10].”
From Performance Evaluation of Machine Learning Frameworks for Aphasia Assessment (2021) · cites this paper as [10]
21 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474 · cited 3×
“Therefore, all TFD RGB color images were resized to 224 × 224 × 3 pixels and normalized as per ImageNet dataset characteristics, before feeding them to the pre-trained ResNet-34 CNN model [42].”
MethodInfluentialAdam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946 · cited 1×
“999 with a cross-entropy loss function [44].”
Cyclical Learning Rates for Training Neural Networks
Smith, L. N. (2017) · 2017 IEEE Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv.2017.58 · Cited by 2,670 · cited 2×
“03 [43].”
Method(1992) · Cited by 1,405
Understanding how image quality affects deep neural networks
Dodge, S., & Karam, L. (2016) · 2016 Eighth International Conference on Quality of Multimedia Experience (QoMEX) · doi:10.1109/qomex.2016.7498955 · Cited by 835 · cited 1×
“This will result in image distortion and resolution degradation and, consequently, a poor image classification performance [40], [41].”
BackgroundNovel Speech Signal Processing Algorithms for High-Accuracy Classification of Parkinson’s Disease
Tsanas, A., Little, M. A., McSharry, P. E., Spielman, J., & Ramig, L. O. (2012) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2012.2183367 · Cited by 732 · cited 3×
“For example, researchers in [24]–[26] used classical machine learning (CML) techniques such as support vector machines (SVM) and Gaussian Mixture Model (GMM) to assess speech disorder automatically.”
MethodIntensity of Aphasia Therapy, Impact on Recovery
Bhogal, S. K., Teasell, R., & Speechley, M. (2003) · Stroke · doi:10.1161/01.str.0000062343.64383.d0 · Cited by 719 · cited 1×
“Studiesindicated thatcommencinganintensiveguidedtreatmentattheacuteor sub-acutestageofaphasialeadstothehighestrecovery[17], [18] .”
Engelter, S. T., Gostynski, M., Papa, S., Frei, M., Born, C., Ajdacic-Gross, V., Gutzwiller, F., & Lyrer, P. A. (2006) · Stroke · doi:10.1161/01.str.0000221815.64093.8c · Cited by 688
Theory and Applications of Digital Speech Processing
Rabiner, L. R., & Schafer, R. W. (2010) · Medical Entomology and Zoology · Cited by 579
A meta-analysis of clinical outcomes in the treatment of aphasia
Robey, R. R. (1998) · Journal of Speech, Language, and Hearing Research · doi:10.1044/jslhr.4101.172 · Cited by 506 · cited 1×
“Studiesindicated thatcommencinganintensiveguidedtreatmentattheacuteor sub-acutestageofaphasialeadstothehighestrecovery[17], [18] .”
Research works printed but not linked: 9
- li, 2000, Hanyu biaozhun shiyuzheng jianchafa de bianzhi yu changmo [The establishment and normalization of the Chinese standard for aphasia examination], Zhongguo Kangfu Lilun Yu Shijian, 6, 162
- mahmoud, 2019, Automatic mandarin vowels recognition framework for aphasic patients rehabilitation, Proc 13th IEEE-EMBS Int Summer School Symp Med Dev Biosensors (MDBS2019)
- zhang, 2005, Zhongguo kangfu yanjiu Zhongxin hanyu biaozhun shiyuzheng jiancha liangbiao de xindu yu xiaodu fenxi [The Reliability and validity analysis for the Chinese standard for aphasia scale by China Rehabilitation Research Center], Zhongguo Kangfu Lilun Yu Shijian, 11, 703
- huang, 2007, Youce danao banqiu yuyan gongneng [The language function of right hemisphere], Zhongguo Shenjing Mianyixue He Shenjingbingxue Zazhi, 14, 310
- ding, 1995, Jisuanji fuzhu yanyu jiaozhi xitong [A computer aided speech correction system], Zhongguo Shengwu Yixue Gongcheng Xuebao, 14, 39
- 10.1002/(SICI)1097-0193(200005)10:1<16::AID-HBM30>3.3.CO;2-D · doi:10.1002/(sici)1097-0193(200005)10:1<16::aid-hbm30>3.3.co;2-d
- jiaoyanshi, 1993, Xian dai han yu [Modern Chinese]
- cheng, 2005, Xian dai han yu [Modern Chinese]
- davis, 2007, Aphasiology Disorders and clinical practice
Cited by
AI Applications in Adult Stroke Recovery and Rehabilitation: A Scoping Review Using AI
Senadheera, I., Hettiarachchi, P., Haslam, B. S., Nawaratne, R., Sheehan, J., Lockwood, K. J., Alahakoon, D., & Carey, L. M. (2024) · Sensors · doi:10.3390/s24206585 · Cited by 111
“Furthermore, ANNs have been used to evaluate tone production in Mandarin-speaking patients with post-stroke dysarthria, demonstrating comparable recognition rates compared to human listeners [82].”
BackgroundMahmoud, S. S. (2023) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2023.3284133 · Cited by 37
“In this article, all TFD grayscale images of intrusions and nuisances were resized to 224 × 224 × 1 pixels and normalized according to the characteristics of the ImageNet dataset [39], [40].”
MethodInfluentialSelf-citationPerformance Evaluation of Machine Learning Frameworks for Aphasia Assessment
Mahmoud, S. S., Kumar, A., Li, Y., Tang, Y., & Fang, Q. (2021) · Sensors · doi:10.3390/s21082582 · Cited by 27
“In [10], we collected Mandarin datasets from healthy subjects and aphasic patients.”
BackgroundMethodInfluentialSelf-citationMahmoud, S. S., Pallaud, R. F., Kumar, A., Faisal, S., Wang, Y., & Fang, Q. (2023) · Sensors · doi:10.3390/s23020857 · Cited by 25
“, 2020 [11] DNN: Convolutional Neural Network (CNN) • The aim was to assess the severity of impairment in Mandarin-speaking aphasic patients.”
InfluentialSelf-citationAI-assisted assessment and treatment of aphasia: a review
Zhong, X. (2024) · Frontiers in Public Health · doi:10.3389/fpubh.2024.1401240 · Cited by 25
Metadata
- Authors
- Mahmoud, S. S., Kumar, A., Tang, Y., Li, Y., Gu, X., Fu, J., & Fang, Q.
- Affiliations
- Shantou University (CN)
- RMIT University (AU)
- Venue
- IEEE Journal of Biomedical and Health Informatics
- Published
- 2020-11
- Volume
- 24
- Issue
- 11
- Pages
- 3191-3202
- ISSN
- 2168-2194 (ISSN-L)
- 2168-2208
- OpenAlex
- W3045355365
- Semantic Scholar
- bcd5c6802fae9aa65943983c62be20a7cdd78a24
- Cited by
- 36
- References
- 47
- Citations by year
- 2026: 3 · 2025: 4 · 2024: 10 · 2023: 7 · 2022: 8 · 2021: 2 · 2020: 2
- FWCI
- 2.85
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- Locations
- IEEE Journal of Biomedical and Health Informatics (publishedVersion)
- PubMed (publishedVersion)
- RMIT Research Repository (RMIT University Library) (submittedVersion)
- Figshare (submittedVersion)
- Funders
- Li Ka Shing Foundation Cross-Disciplinary Research (2020LKSFG04C)
- Topics
- Health Sciences › Health Professions › Speech and Hearing › Voice and Speech Disorders
- Physical Sciences › Computer Science › Artificial Intelligence › Speech Recognition and Synthesis
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neurobiology of Language and Bilingualism
- Keywords
- aphasia, Mandarin speech, speech assessment, articulation, fluency, tone, convolutional neural networks, time-frequency images, speech-language pathology
- MeSH terms
- Deep Learning, Aphasia, Humans, Language, Speech, Neural Networks, Computer
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: An Efficient Deep Learning Based Method for Speech Assessment of Mandarin-Speaking Aphasic Patients. https://app.cochat.ai/papers/10.1109/jbhi.2020.3011104
- The paper
- Mahmoud, S. S., Kumar, A., Tang, Y., Li, Y., Gu, X., Fu, J., & Fang, Q. (2020). An Efficient Deep Learning Based Method for Speech Assessment of Mandarin-Speaking Aphasic Patients. IEEE Journal of Biomedical and Health Informatics. https://doi.org/10.1109/jbhi.2020.3011104
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.