The DOI matches its Crossref record; 2 of the 2 references it cites were found in a registry or an index.
T-GSA: Transformer with Gaussian-Weighted Self-Attention for Speech Enhancement
Abstract
Transformer neural networks (TNN) demonstrated state-ofart performance on many natural language processing (NLP) tasks, replacing recurrent neural networks (RNNs), such as LSTMs or GRUs. However, TNNs did not perform well in speech enhancement, whose contextual nature is different than NLP tasks, like machine translation. Self-attention is a core building block of the Transformer, which not only enables parallelization of sequence computation, but also provides the constant path length between symbols that is essential to learning long-range dependencies. In this paper, we propose a Transformer with Gaussian-weighted self-attention (T-GSA), whose attention weights are attenuated according to the distance between target and context symbols. The experimental results show that the proposed T-GSA has significantly improved speech-enhancement performance, compared to the Transformer and RNNs.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling
Chung, J., Gulcehre, C., Cho, K., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1412.3555 · Cited by 11,008
Cited by
Lin, T., Wang, Y., Liu, X., & Qiu, X. (2022) · AI Open · doi:10.1016/j.aiopen.2022.10.001 · Cited by 1,422
Conditional DETR for Fast Training Convergence
Meng, D., Chen, X., Fan, Z., Zeng, G., Li, H., Yuan, Y., Sun, L., & Wang, J. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00363 · Cited by 1,055
Attention Is All You Need In Speech Separation
Subakan, C., Ravanelli, M., Cornell, S., Bronzi, M., & Zhong, J. (2021) · ICASSP 2021 - 2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp39728.2021.9413901 · Cited by 635
MetaFormer Baselines for Vision
Yu, W., Si, C., Zhou, P., Luo, M., Zhou, Y., Feng, J., Yan, S., & Wang, X. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3329173 · Cited by 331
SpeechNet: A Universal Modularized Model for Speech Processing Tasks
Chen, Y.-C., Chi, P.-H., Yang, S.-W., Chang, K.-W., Lin, J.-H., Huang, S.-F., Liu, D.-R., Liu, C.-L., Lee, C.-K., & Lee, H.-Y. (2021) · arXiv · doi:10.48550/arxiv.2105.03070 · Cited by 6
“…tasks in the speech domain started to use transformer-based models, such as ASR (Gulati et al., 2020; Dong et al., 2018; Karita et al., 2019), SE (Kim et al., 2020; Fu et al., 2020; Nicolson and Paliwal, 2020), SC (Katta et al., 2020; Safari and Hernando, 2020; Shi et al., 2020), TTS (Ren et…”
Method
Metadata
- Authors
- Kim, J., El-Khamy, M., & Lee, J.
- Venue
- ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)
- Publisher
- IEEE
- Published
- 2020-05
- Pages
- 6649-6653
- ISSN
- 1520-6149 (ISSN-L)
- OpenAlex
- W3016129867
- Cited by
- 181
- References
- 2
- FWCI
- 19.03
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: T-GSA: Transformer with Gaussian-Weighted Self-Attention for Speech Enhancement. https://app.cochat.ai/papers/10.1109/icassp40776.2020.9053591
- The paper
- Kim, J., El-Khamy, M., & Lee, J. (2020). T-GSA: Transformer with Gaussian-Weighted Self-Attention for Speech Enhancement. ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). https://doi.org/10.1109/icassp40776.2020.9053591
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.