The DOI matches its Crossref record; 23 of the 23 references it cites were found in a registry or an index.
PHASEN: A Phase-and-Harmonics-Aware Speech Enhancement Network
Open accessAbstract
Time-frequency (T-F) domain masking is a mainstream approach for single-channel speech enhancement. Recently, focuses have been put to phase prediction in addition to amplitude prediction. In this paper, we propose a phase-and-harmonics-aware deep neural network (DNN), named PHASEN, for this task. Unlike previous methods which directly use a complex ideal ratio mask to supervise the DNN learning, we design a two-stream network, where amplitude stream and phase stream are dedicated to amplitude and phase prediction. We discover that the two streams should communicate with each other, and this is crucial to phase prediction. In addition, we propose frequency transformation blocks to catch long-range correlations along the frequency axis. Visualization shows that the learned transformation matrix implicitly captures the harmonic correlation, which has been proven to be helpful for T-F spectrogram reconstruction. With these two innovations, PHASEN acquires the ability to handle detailed phase patterns and to utilize harmonic patterns, getting 1.76dB SDR improvement on AVSpeech + AudioSet dataset. It also achieves significant gains over Google's network on this dataset. On Voice Bank + DEMAND dataset, PHASEN outperforms previous methods by a large margin on four metrics.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Audio Set: An ontology and human-labeled dataset for audio events
Gemmeke, J. F., Ellis, D. P. W., Freedman, D., Jansen, A., Lawrence, W., Moore, R. C., Plakal, M., & Ritter, M. (2017) · 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2017.7952261 · Cited by 3,134
Performance measurement in blind audio source separation
Vincent, E., Gribonval, R., & Fevotte, C. (2006) · IEEE Transactions on Audio, Speech and Language Processing · doi:10.1109/tsa.2005.858005 · Cited by 2,889
Conv-TasNet: Surpassing Ideal Time–Frequency Magnitude Masking for Speech Separation
Luo, Y., & Mesgarani, N. (2019) · IEEE/ACM Transactions on Audio, Speech, and Language Processing · doi:10.1109/taslp.2019.2915167 · Cited by 2,042
Evaluation of Objective Quality Measures for Speech Enhancement
Hu, Y., & Loizou, P. C. (2008) · IEEE Transactions on Audio, Speech, and Language Processing · doi:10.1109/tasl.2007.911054 · Cited by 1,830
On Training Targets for Supervised Speech Separation
Wang, Y., Narayanan, A., & Wang, D. (2014) · IEEE/ACM Transactions on Audio, Speech, and Language Processing · doi:10.1109/taslp.2014.2352935 · Cited by 1,067
Complex Ratio Masking for Monaural Speech Separation
Williamson, D. S., Wang, Y., & Wang, D. (2016) · IEEE/ACM Transactions on Audio, Speech, and Language Processing · doi:10.1109/taslp.2015.2512042 · Cited by 797
Phase-sensitive and recognition-boosted speech separation using deep recurrent neural networks
Erdogan, H., Hershey, J. R., Watanabe, S., & Le Roux, J. (2015) · 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2015.7178061 · Cited by 646
Speech Enhancement with LSTM Recurrent Neural Networks and its Application to Noise-Robust ASR
Weninger, F., Erdogan, H., Watanabe, S., Vincent, E., Le Roux, J., Hershey, J. R., & Schuller, B. (2015) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-22482-4_11 · Cited by 602
Ideal ratio mask estimation using deep neural networks for robust speech recognition
Narayanan, A., & Wang, D. (2013) · 2013 IEEE International Conference on Acoustics, Speech and Signal Processing · doi:10.1109/icassp.2013.6639038 · Cited by 526
Investigating RNN-based speech enhancement methods for noise-robust Text-to-Speech
Valentini-Botinhao, C., Wang, X., Takaki, S., & Yamagishi, J. (2016) · 9th ISCA Workshop on Speech Synthesis Workshop (SSW 9) · doi:10.21437/ssw.2016-24 · Cited by 463
A Wavenet for Speech Denoising
Rethage, D., Pons, J., & Serra, X. (2018) · 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2018.8462417 · Cited by 457
The importance of phase in speech enhancement
Paliwal, K., Wójcicki, K., & Shannon, B. (2011) · Speech Communication · doi:10.1016/j.specom.2010.12.003 · Cited by 405
TCNN: Temporal Convolutional Neural Network for Real-time Speech Enhancement in the Time Domain
Pandey, A., & Wang, D. (2019) · ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2019.8683634 · Cited by 385
Thiemann, J., Ito, N., & Vincent, E. (2013) · The Journal of the Acoustical Society of America · doi:10.1121/1.4806631 · Cited by 346
Singing Voice Separation With Deep U-Net Convolutional Networks.
Jansson, A., Humphrey, E. J., Montecchio, N., Bittner, R., Kumar, A., & Weyde, T. (2017) · City Research Online (City University London) · doi:10.5281/zenodo.1414933 · Cited by 319
Binary and ratio time-frequency masks for robust speech recognition
Srinivasan, S., Roman, N., & Wang, D. (2006) · Speech Communication · doi:10.1016/j.specom.2006.09.003 · Cited by 234
Time-Frequency Masking-Based Speech Enhancement Using Generative Adversarial Network
Soni, M. H., Shah, N., & Patil, H. A. (2018) · 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2018.8462068 · Cited by 212
STFT Phase Reconstruction in Voiced Speech for an Improved Single-Channel Speech Enhancement
Krawczyk, M., & Gerkmann, T. (2014) · IEEE/ACM Transactions on Audio, Speech, and Language Processing · doi:10.1109/taslp.2014.2354236 · Cited by 210
Speech Denoising with Deep Feature Losses
Germain, F. G., Chen, Q., & Koltun, V. (2019) · Interspeech 2019 · doi:10.21437/interspeech.2019-1924 · Cited by 167
Masuyama, Y., Yatabe, K., Koizumi, Y., Oikawa, Y., & Harada, N. (2019) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2019.8682744 · Cited by 67
Mowlaee, P., & Kulmer, J. (2015) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2015.2439038 · Cited by 61
Phase Reconstruction from Amplitude Spectrograms Based on Von-Mises-Distribution Deep Neural Network
Takamichi, S., Saito, Y., Takamune, N., Kitamura, D., & Saruwatari, H. (2018) · International Workshop on Acoustic Signal Enhancement · doi:10.1109/iwaenc.2018.8521313 · Cited by 46
Multi-Domain Processing via Hybrid Denoising Networks for Speech EnhancementPreprint
Kim, J.-H., Yoo, J., Chun, S., Kim, A., & Ha, J.-W. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1812.08914 · Cited by 29
Cited by
DCCRN: Deep Complex Convolution Recurrent Network for Phase-Aware Speech Enhancement
Hu, Y., Liu, Y., Lv, S., Xing, M., Zhang, S., Fu, Y., Wu, J., Zhang, B., & Xie, L. (2020) · Interspeech 2020 · doi:10.21437/interspeech.2020-2537 · Cited by 737
Reddy, C. K. A., Gopal, V., Cutler, R., Beyrami, E., Cheng, R., Dubey, H., Matusevych, S., Aichner, R., Aazami, A., Braun, S., et al. (2020) · Interspeech 2020 · doi:10.21437/interspeech.2020-3038 · Cited by 363
An Overview of Deep-Learning-Based Audio-Visual Speech Enhancement and Separation
Michelsanti, D., Tan, Z.-H., Zhang, S.-X., Xu, Y., Yu, M., Yu, D., & Jensen, J. (2021) · IEEE/ACM Transactions on Audio, Speech, and Language Processing · doi:10.1109/taslp.2021.3066303 · Cited by 316
Metadata
- Authors
- Yin, D., Luo, C., Xiong, Z., & Zeng, W.
- Venue
- Proceedings of the AAAI Conference on Artificial Intelligence
- Published
- 2020-04-03
- Volume
- 34
- Issue
- 05
- Pages
- 9458-9465
- ISSN
- 2159-5399 (ISSN-L)
- 2374-3468
- OpenAlex
- W2998161426
- Cited by
- 323
- References
- 23
- FWCI
- 27.72
- Type
- conference paper
- Language
- en
- Open access
- diamond
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.