The DOI matches its Crossref record; 20 of the 20 references it cites were found in a registry or an index.
Discriminatively trained recurrent neural networks for single-channel speech separation
Abstract
This paper describes an in-depth investigation of training criteria, network architectures and feature representations for regression-based single-channel speech separation with deep neural networks (DNNs). We use a generic discriminative training criterion corresponding to optimal source reconstruction from time-frequency masks, and introduce its application to speech separation in a reduced feature space (Mel domain). A comparative evaluation of time-frequency mask estimation by DNNs, recurrent DNNs and non-negative matrix factorization on the 2nd CHiME Speech Separation and Recognition Challenge shows consistent improvements by discriminative training, whereas long short-term memory recurrent DNNs obtain the overall best results. Furthermore, our results confirm the importance of fine-tuning the feature representation for DNN training.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
Speech recognition with deep recurrent neural networks
Graves, A., Mohamed, A.-R., & Hinton, G. (2013) · 2013 IEEE International Conference on Acoustics, Speech and Signal Processing · doi:10.1109/icassp.2013.6638947 · Cited by 8,893 · cited 2×
“The combination of deep structures with temporal recurrence yields so-called deep recurrent neural networks (DRNNs) [13].”
BackgroundLearning long-term dependencies with gradient descent is difficult
Bengio, Y., Simard, P., & Frasconi, P. (1994) · IEEE Transactions on Neural Networks · doi:10.1109/72.279181 · Cited by 8,542 · cited 1×
“However, this approach (‘backpropagation through time’) suffers from a vanishing or exploding gradient for larger T , making the optimization difficult [16].”
BackgroundLearning to forget: Continual prediction with LSTM
Gers, F. A., Schmidhuber, J., & Cummins, F. (2000) · Neural Computation · doi:10.1162/089976600300015015 · Cited by 4,823
Performance measurement in blind audio source separation
Vincent, E., Gribonval, R., & Fevotte, C. (2006) · IEEE Transactions on Audio, Speech and Language Processing · doi:10.1109/tsa.2005.858005 · Cited by 2,889
Perceptual linear predictive (PLP) analysis of speech
Hermansky, H. (1990) · The Journal of the Acoustical Society of America · doi:10.1121/1.399423 · Cited by 2,536
Towards End-To-End Speech Recognition with Recurrent Neural Networks
Graves, A., & Jaitly, N. (2014) · Cited by 1,861
Ideal ratio mask estimation using deep neural networks for robust speech recognition
Narayanan, A., & Wang, D. (2013) · 2013 IEEE International Conference on Acoustics, Speech and Signal Processing · doi:10.1109/icassp.2013.6639038 · Cited by 526
Boulanger-Lewandowski, N., Bengio, Y., & Vincent, P. (2012) · arXiv (Cornell University) · doi:10.48550/arxiv.1206.6392 · Cited by 459
Deep learning for monaural speech separation
Huang, P.-S., Kim, M., Hasegawa-Johnson, M., & Smaragdis, P. (2014) · 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2014.6853860 · Cited by 423
Recurrent neural networks for noise reduction in robust ASR
Maas, A. L., Le, Q. V., O'Neil, T. M., Vinyals, O., Nguyen, P., & Ng, A. Y. (2012) · Interspeech 2012 · doi:10.21437/interspeech.2012-6 · Cited by 334
The second ‘chime’ speech separation and recognition challenge: Datasets, tasks and baselines
Vincent, E., Barker, J., Watanabe, S., Le Roux, J., Nesta, F., & Matassoni, M. (2013) · 2013 IEEE International Conference on Acoustics, Speech and Signal Processing · doi:10.1109/icassp.2013.6637622 · Cited by 306
Self-citationUnderstanding how Deep Belief Networks perform acoustic modelling
Mohamed, A.-R., Hinton, G., & Penn, G. (2012) · 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2012.6288863 · Cited by 265
Introducing CURRENNT: the Munich open-source CUDA recurrent neural network toolkit
Weninger, F. J., Bergmann, J. M., & Schuller, B. W. (2015) · Spiral (Imperial College London) · Cited by 154
Self-citationSingle-channel speech separation with memory-enhanced recurrent neural networks
Weninger, F. J., Eyben, F., & Schuller, B. W. (2014) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2014.6854294 · Cited by 136
Self-citationPolyphonic piano note transcription with recurrent neural networks
Böck, S., & Schedl, M. (2012) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2012.6287832 · Cited by 131
Recurrent deep neural networks for robust speech recognition
Weng, C., Yu, D., Watanabe, S., & Juang, B. H. (2014) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2014.6854661 · Cited by 129
Discriminative NMF and its application to single-channel source separation
Weninger, F., Roux, J. L., Hershey, J., & Watanabe, S. (2014) · Interspeech · doi:10.21437/interspeech.2014-218 · Cited by 120
Self-citationDiscovering Convolutive Speech Phones Using Sparseness and Non-negativity
O'Grady, P. D., & Pearlmutter, B. A. (2007) · International Conference on Agents · doi:10.1007/978-3-540-74494-8_65 · Cited by 34
Ensemble learning for speech enhancement
Roux, J. L., Watanabe, S., & Hershey, J. R. (2013) · IEEE Workshop on Applications of Signal Processing to Audio and Acoustics (WASPAA) · doi:10.1109/waspaa.2013.6701888 · Cited by 30
Self-citation
Cited by
Supervised Speech Separation Based on Deep Learning: An Overview
Wang, D., & Chen, J. (2018) · IEEE/ACM Transactions on Audio, Speech, and Language Processing · doi:10.1109/taslp.2018.2842159 · Cited by 1,524
SDR – Half-baked or Well Done?
Roux, J. L., Wisdom, S., Erdogan, H., & Hershey, J. R. (2019) · ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2019.8683855 · Cited by 1,146
Self-citationPhase-sensitive and recognition-boosted speech separation using deep recurrent neural networks
Erdogan, H., Hershey, J. R., Watanabe, S., & Le Roux, J. (2015) · 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2015.7178061 · Cited by 646
Self-citationSpeech Enhancement with LSTM Recurrent Neural Networks and its Application to Noise-Robust ASR
Weninger, F., Erdogan, H., Watanabe, S., Vincent, E., Le Roux, J., Hershey, J. R., & Schuller, B. (2015) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-22482-4_11 · Cited by 602
Self-citationReal Time Speech Enhancement in the Waveform Domain
Défossez, A., Synnaeve, G., & Adi, Y. (2020) · Interspeech 2020 · doi:10.21437/interspeech.2020-2409 · Cited by 537
Metadata
- Authors
- Weninger, F., Hershey, J. R., Le Roux, J., & Schuller, B.
- Venue
- 2014 IEEE Global Conference on Signal and Information Processing (GlobalSIP)
- Publisher
- IEEE
- Published
- 2014-12
- Pages
- 577-581
- ISSN
- 2376-4066 (ISSN-L)
- OpenAlex
- W2046869671
- Cited by
- 283
- References
- 20
- FWCI
- 19.86
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.