CoChat

Automatic Speech Assessment for People with Aphasia Using TDNN-BLSTM with Multi-Task Learning

Open access
Qin, Ying, Lee, Tan, Feng, Siyuan, Kong, Anthony Pak Hin · 2018 · Interspeech 2018

The DOI matches its Crossref record; 26 of the 26 references it cites were found in a registry or an index.

Abstract

This paper describes an investigation on automatic speech assessment for people with aphasia (PWA) using a DNN based automatic speech recognition (ASR) system. The main problems being addressed are the lack of training speech in the intended application domain and the relevant degradation of ASR performance for impaired speech of PWA. We adopt the TDNN-BLSTM structure for acoustic modeling and apply the technique of multi-task learning with large amount of domain-mismatched data. This leads to a significant improvement on the recognition accuracy, as compared with a conventional single-task learning DNN system. To facilitate the extraction of robust text features for quantifying language impairment in PWA speech, we propose to incorporate N-best hypotheses and confusion network representation of the ASR output. The severity of impairment is predicted from text features and supra-segmental duration features using different regression models. Experimental results show a high correlation of 0.842 between the predicted severity level and the subjective Aphasia Quotient score.

Overview

Integrity signals

Registry

Crossref · 10.21437/interspeech.2018-1630

Cites

26 of 26 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Citations

Cites

Cited by

See all 34

Metadata

Authors
Qin, Y., Lee, T., Feng, S., & Kong, A. P. H.
Venue
Interspeech 2018
Publisher
ISCA
Published
2018-09-02
Pages
3418-3422
ISSN
2308-457X (ISSN-L)
OpenAlex
W2889294685
Cited by
30
References
26
Citations by year
2025: 3 · 2024: 2 · 2023: 7 · 2022: 3 · 2021: 6 · 2020: 3 · 2019: 5 · 2018: 1
FWCI
1.52
Type
conference paper
Language
en
Open access
Locations
  • Interspeech (USB) (publishedVersion)
  • Journal of International Crisis and Risk Communication Research (submittedVersion)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Speech Recognition and Synthesis
  • Health Sciences › Health Professions › Speech and Hearing › Voice and Speech Disorders
  • Physical Sciences › Computer Science › Signal Processing › Speech and Audio Processing
Keywords
aphasia, multi-task learning, acoustic modeling, confusion networks, aphasia quotient

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.