The DOI matches its Crossref record; 42 of the 42 references it cites were found in a registry or an index.
Learning Complex Spectral Mapping With Gated Convolutional Recurrent Networks for Monaural Speech Enhancement
Open accessAbstract
Phase is important for perceptual quality of speech. However, it seems intractable to directly estimate phase spectra through supervised learning due to their lack of spectrotemporal structure in it. Complex spectral mapping aims to estimate the real and imaginary spectrograms of clean speech from those of noisy speech, which simultaneously enhances magnitude and phase responses of speech. Inspired by multi-task learning, we propose a gated convolutional recurrent network (GCRN) for complex spectral mapping, which amounts to a causal system for monaural speech enhancement. Our experimental results suggest that the proposed GCRN substantially outperforms an existing convolutional neural network (CNN) for complex spectral mapping in terms of both objective speech intelligibility and quality. Moreover, the proposed approach yields significantly higher STOI and PESQ than magnitude spectral mapping and complex ratio masking. We also find that complex spectral mapping with the proposed GCRN provides an effective phase estimate.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S., & Szegedy, C. (2015) · arXiv · doi:10.48550/arxiv.1502.03167 · Cited by 27,818 · cited 1×
“Each convolutional or deconvolutional GLU block is successively followed by a batch normalization [16] operation and an exponential linear unit (ELU) [3] activation function.”
MethodDelving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification
He, K., Zhang, X., Ren, S., & Sun, J. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.123 · Cited by 19,741
(2011) · Cited by 6,993
Fast and Accurate Deep Network Learning by Exponential Linear Units (ELUs)
Clevert, D.-A., Unterthiner, T., & Hochreiter, S. (2015) · arXiv · doi:10.48550/arxiv.1511.07289 · Cited by 4,513 · cited 2×
“[3] D.-A. Clevert, T. Unterthiner, and S. Hochreiter, “Fast and accurate deep network learning by exponential linear units (ELUS),” in Proc.”
MethodRix, A. W., Beerends, J. G., Hollier, M. P., & Hekstra, A. P. (2002) · 2001 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.01CH37221) · doi:10.1109/icassp.2001.941023 · Cited by 3,149
Convergence Results for Neural Networks via Electrodynamics
Panigrahy, R., Rahimi, A., Sachdeva, S., & Zhang, Q. (2018) · Leibniz international proceedings in informatics · doi:10.4230/lipics.itcs.2018.22 · Cited by 2,761
An Algorithm for Intelligibility Prediction of Time–Frequency Weighted Noisy Speech
Taal, C. H., Hendriks, R. C., Heusdens, R., & Jensen, J. (2011) · IEEE Transactions on Audio, Speech, and Language Processing · doi:10.1109/tasl.2011.2114881 · Cited by 2,254
Varga, A., & Steeneken, H. J. M. (1993) · Speech Communication · doi:10.1016/0167-6393(93)90095-3 · Cited by 2,105
Conditional Image Generation with PixelCNN Decoders
van den Oord, A., Kalchbrenner, N., Vinyals, O., Espeholt, L., Graves, A., & Kavukcuoglu, K. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1606.05328 · Cited by 1,833
On the Convergence of Adam and Beyond
Reddi, S. J., Kale, S., & Kumar, S. (2019) · arXiv · doi:10.48550/arxiv.1904.09237 · Cited by 1,771
An overview of multi-task learning
Zhang, Y., & Yang, Q. (2018) · National Science Review · doi:10.1093/nsr/nwx105 · Cited by 1,117
The design for the wall street journal-based CSR corpus
Paul, D. B., & Baker, J. M. (1992) · Proceedings of the workshop on Speech and Natural Language - HLT '91 · doi:10.3115/1075527.1075614 · Cited by 1,099
Language Modeling with Gated Convolutional Networks
Dauphin, Y., Fan, A., Auli, M., & Grangier, D. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1612.08083 · Cited by 1,080
On Training Targets for Supervised Speech Separation
Wang, Y., Narayanan, A., & Wang, D. (2014) · IEEE/ACM Transactions on Audio, Speech, and Language Processing · doi:10.1109/taslp.2014.2352935 · Cited by 1,067
Self-citationAn Experimental Study on Speech Enhancement Based on Deep Neural Networks
Xu, Y., Du, J., Dai, L.-R., & Lee, C.-H. (2014) · IEEE Signal Processing Letters · doi:10.1109/lsp.2013.2291240 · Cited by 924
Speech enhancement based on deep denoising autoencoder
Lu, X., Tsao, Y., Matsuda, S., & Hori, C. (2013) · Interspeech 2013 · doi:10.21437/interspeech.2013-130 · Cited by 834
Complex Ratio Masking for Monaural Speech Separation
Williamson, D. S., Wang, Y., & Wang, D. (2016) · IEEE/ACM Transactions on Audio, Speech, and Language Processing · doi:10.1109/taslp.2015.2512042 · Cited by 797
Self-citation(2017) · International Conference on Machine Learning · Cited by 758
Computational Auditory Scene Analysis: Principles, Algorithms and Applications
Darwin, C. (2008) · The Journal of the Acoustical Society of America · doi:10.1121/1.2920958 · Cited by 749
Phase-sensitive and recognition-boosted speech separation using deep recurrent neural networks
Erdogan, H., Hershey, J. R., Watanabe, S., & Le Roux, J. (2015) · 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2015.7178061 · Cited by 646
Speech Enhancement with LSTM Recurrent Neural Networks and its Application to Noise-Robust ASR
Weninger, F., Erdogan, H., Watanabe, S., Vincent, E., Le Roux, J., Hershey, J. R., & Schuller, B. (2015) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-22482-4_11 · Cited by 602
A Convolutional Recurrent Neural Network for Real-Time Speech Enhancement
Tan, K., & Wang, D. (2018) · Interspeech 2018 · doi:10.21437/interspeech.2018-1405 · Cited by 497
Self-citationDeep learning for monaural speech separation
Huang, P.-S., Kim, M., Hasegawa-Johnson, M., & Smaragdis, P. (2014) · 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2014.6853860 · Cited by 423
A Fully Convolutional Neural Network for Speech Enhancement
Park, S. R., & Lee, J. W. (2017) · Interspeech 2017 · doi:10.21437/interspeech.2017-1465 · Cited by 409
The importance of phase in speech enhancement
Paliwal, K., Wójcicki, K., & Shannon, B. (2011) · Speech Communication · doi:10.1016/j.specom.2010.12.003 · Cited by 405
Fu, S.-W., Wang, T.-W., Tsao, Y., Lu, X., & Kawai, H. (2018) · IEEE/ACM Transactions on Audio, Speech, and Language Processing · doi:10.1109/taslp.2018.2821903 · Cited by 314
Discriminatively trained recurrent neural networks for single-channel speech separation
Weninger, F., Hershey, J. R., Le Roux, J., & Schuller, B. (2014) · 2014 IEEE Global Conference on Signal and Information Processing (GlobalSIP) · doi:10.1109/globalsip.2014.7032183 · Cited by 283
Long short-term memory for speaker generalization in supervised speech separation
Chen, J., & Wang, D. (2017) · The Journal of the Acoustical Society of America · doi:10.1121/1.4986931 · Cited by 244
Self-citationLearning Task Grouping and Overlap in Multi-task Learning
Kumar, A., & Daumé, H. (2012) · arXiv (Cornell University) · doi:10.48550/arxiv.1206.6417 · Cited by 241
STFT Phase Reconstruction in Voiced Speech for an Improved Single-Channel Speech Enhancement
Krawczyk, M., & Gerkmann, T. (2014) · IEEE/ACM Transactions on Audio, Speech, and Language Processing · doi:10.1109/taslp.2014.2354236 · Cited by 210
Gated Residual Networks With Dilated Convolutions for Monaural Speech Enhancement
Tan, K., Chen, J., & Wang, D. (2019) · IEEE/ACM Transactions on Audio, Speech, and Language Processing · doi:10.1109/taslp.2018.2876171 · Cited by 195
Self-citationSNR-Aware Convolutional Neural Network Modeling for Speech Enhancement
Fu, S.-W., Tsao, Y., & Lu, X. (2016) · Interspeech 2016 · doi:10.21437/interspeech.2016-211 · Cited by 177
Complex spectrogram enhancement by convolutional neural network with multi-metrics learning
Fu, S.-W., Hu, T.-Y., Tsao, Y., & Lu, X. (2017) · 2017 IEEE 27th International Workshop on Machine Learning for Signal Processing (MLSP) · doi:10.1109/mlsp.2017.8168119 · Cited by 173
Complex Spectral Mapping with a Convolutional Recurrent Network for Monaural Speech Enhancement
Tan, K., & Wang, D. (2019) · ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2019.8682834 · Cited by 166
Self-citationTakahashi, N., Goswami, N., & Mitsufuji, Y. (2018) · 2018 16th International Workshop on Acoustic Signal Enhancement (IWAENC) · doi:10.1109/iwaenc.2018.8521383 · Cited by 161
Convolutional-Recurrent Neural Networks for Speech Enhancement
Zhao, H., Zarar, S., Tashev, I., & Lee, C.-H. (2018) · 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2018.8462155 · Cited by 159
Single-channel speech separation with memory-enhanced recurrent neural networks
Weninger, F. J., Eyben, F., & Schuller, B. W. (2014) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2014.6854294 · Cited by 136
Single channel audio source separation using convolutional denoising autoencoders
Grais, E. M., & Plumbley, M. D. (2017) · IEEE Global Conference on Signal and Information Processing · doi:10.1109/globalsip.2017.8309164 · Cited by 136
A deep neural network for time-domain signal reconstruction
Wang, Y., & Wang, D. (2015) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2015.7178800 · Cited by 100
Self-citationEfficient Sequence Learning with Group Recurrent Networks
Gao, F., Wu, L., Li, Z., Qin, T., Cheng, X., & Liu, T. (2018) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n18-1073 · Cited by 45
Low latency sound source separation using convolutional recurrent neural networks
Naithani, G., Barker, T., Parascandolo, G., Bramsløw, L., Pontoppidan, N. H., & Virtanen, T. I. (2017) · IEEE Workshop on Applications of Signal Processing to Audio and Acoustics (WASPAA) · doi:10.1109/waspaa.2017.8169997 · Cited by 32
Cited by
A review of deep learning techniques for speech processing
Mehrish, A., Majumder, N., Bharadwaj, R., Mihalcea, R., & Poria, S. (2023) · Information Fusion · doi:10.1016/j.inffus.2023.101869 · Cited by 389
Metadata
- Authors
- Tan, K., & Wang, D.
- Venue
- IEEE/ACM Transactions on Audio, Speech, and Language Processing
- Published
- 2020
- Volume
- 28
- Pages
- 380-390
- ISSN
- 2329-9290 (ISSN-L)
- 2329-9304
- OpenAlex
- W2991361823
- Cited by
- 348
- References
- 42
- FWCI
- 20.56
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.