CoChat

Improving the Intelligibility of Speech for Simulated Electric and Acoustic Stimulation Using Fully Convolutional Neural Networks

Open access
Wang, Natalie Yu-Hsien, Wang, Hsiao-Lan Sharon, Wang, Tao-Wei, Fu, Szu-Wei, Lu, Xugan, Wang, Hsin-Min, Tsao, Yu · 2021 · IEEE Transactions on Neural Systems and Rehabilitation Engineering

The DOI matches its Crossref record; 98 of the 98 references it cites were found in a registry or an index.

Abstract

Combined electric and acoustic stimulation (EAS) has demonstrated better speech recognition than conventional cochlear implant (CI) and yielded satisfactory performance under quiet conditions. However, when noise signals are involved, both the electric signal and the acoustic signal may be distorted, thereby resulting in poor recognition performance. To suppress noise effects, speech enhancement (SE) is a necessary unit in EAS devices. Recently, a time-domain speech enhancement algorithm based on the fully convolutional neural networks (FCN) with a short-time objective intelligibility (STOI)-based objective function (termed FCN(S) in short) has received increasing attention due to its simple structure and effectiveness of restoring clean speech signals from noisy counterparts. With evidence showing the benefits of FCN(S) for normal speech, this study sets out to assess its ability to improve the intelligibility of EAS simulated speech. Objective evaluations and listening tests were conducted to examine the performance of FCN(S) in improving the speech intelligibility of normal and vocoded speech in noisy environments. The experimental results show that, compared with the traditional minimum-mean square-error SE method and the deep denoising autoencoder SE method, FCN(S) can obtain better gain in the speech intelligibility for normal as well as vocoded speech. This study, being the first to evaluate deep learning SE approaches for EAS, confirms that FCN(S) is an effective SE approach that may potentially be integrated into an EAS processor to benefit users in noisy environments.

Overview

Integrity signals

Registry

Crossref · 10.1109/tnsre.2020.3042655

Cites

98 of 98 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Show all 98 references

Research works printed but not linked: 2

  1. 1997, American National Standard Methods for Calculation of the Speech Intelligibility Index
  2. hu, 2004, 100 nonspeech environmental sounds

Cited by

See all 24

Metadata

Authors
Wang, N. Y.-H., Wang, H.-L. S., Wang, T.-W., Fu, S.-W., Lu, X., Wang, H.-M., & Tsao, Y.
Affiliations
  • Asia University (TW)
  • National Taiwan Normal University (TW)
  • Research Center for Information Technology Innovation, Academia Sinica (TW)
  • National Institute of Information and Communications Technology (JP)
Venue
IEEE Transactions on Neural Systems and Rehabilitation Engineering
Published
2021
Volume
29
Pages
184-195
ISSN
  • 1534-4320 (ISSN-L)
  • 1558-0210
OpenAlex
W3110267079
Cited by
24
References
97
Citations by year
2026: 1 · 2025: 4 · 2024: 2 · 2023: 7 · 2022: 5 · 2021: 5
FWCI
2.30
Type
journal article
Language
en
Open access
Locations
  • IEEE Transactions on Neural Systems and Rehabilitation Engineering (publishedVersion, cc-by)
  • PubMed (publishedVersion)
Funders
Ministry of Science and Technology (MOST), Taiwan (108-2628-E-001-002-MY3, 109-2221-E-001-022, 109-2410-H-468-019-MY2)
Topics
  • Physical Sciences › Computer Science › Signal Processing › Speech and Audio Processing
  • Physical Sciences › Computer Science › Artificial Intelligence › Speech Recognition and Synthesis
  • Health Sciences › Health Professions › Speech and Hearing › Hearing Loss and Rehabilitation
Keywords
speech enhancement, fully convolutional network, speech intelligibility, STOI, vocoded speech, cochlear implants, noise reduction, deep denoising autoencoder, minimum mean square error
MeSH terms
Acoustic Stimulation, Cochlear Implants, Electric Stimulation, Humans, Speech Intelligibility, Speech Perception, Neural Networks, Computer

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Improving the Intelligibility of Speech for Simulated Electric and Acoustic Stimulation Using Fully Convolutional Neural Networks. https://app.cochat.ai/papers/10.1109/tnsre.2020.3042655
The paper
Wang, N. Y.-H., Wang, H.-L. S., Wang, T.-W., Fu, S.-W., Lu, X., Wang, H.-M., & Tsao, Y. (2021). Improving the Intelligibility of Speech for Simulated Electric and Acoustic Stimulation Using Fully Convolutional Neural Networks. IEEE Transactions on Neural Systems and Rehabilitation Engineering. https://doi.org/10.1109/tnsre.2020.3042655

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.