The DOI matches its Crossref record; 35 of the 35 references it cites were found in a registry or an index.
Joint Optimization of Masks and Deep Recurrent Neural Networks for Monaural Source Separation
Open accessAbstract
Monaural source separation is important for many real world applications. It is challenging because, with only a single channel of information available, without any constraints, an infinite number of solutions are possible. In this paper, we explore joint optimization of masking functions and deep recurrent neural networks for monaural source separation tasks, including speech separation, singing voice separation, and speech denoising. The joint optimization of the deep recurrent neural networks with an extra masking layer enforces a reconstruction constraint. Moreover, we explore a discriminative criterion for training neural networks to further enhance the separation performance. We evaluate the proposed system on the TSP, MIR-1K, and TIMIT datasets for speech separation, singing voice separation, and speech denoising tasks, respectively. Our approaches achieve 2.30-4.98 dB SDR gain compared to NMF models in the speech separation task, 2.30-2.48 dB GNSDR gain and 4.32-5.42 dB GSIR gain compared to existing models in the singing voice separation task, and outperform NMF and DNN baselines in the speech denoising task.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
Learning the parts of objects by non-negative matrix factorization
Lee, D. D., & Seung, H. S. (1999) · Nature · doi:10.1038/44565 · Cited by 13,868
(2011) · Cited by 6,993
A Limited Memory Algorithm for Bound Constrained Optimization
Byrd, R. H., Lu, P., Nocedal, J., & Zhu, C. (1995) · SIAM Journal on Scientific Computing · doi:10.1137/0916069 · Cited by 6,221
Backpropagation through time: what it does and how to do it
Werbos, P. J. (1990) · Proceedings of the IEEE · doi:10.1109/5.58337 · Cited by 4,879 · cited 1×
“During the back-propagation stage, DRNN uses back-propagation through time (BPTT) [29], [30] to update network parameters.”
MethodSuppression of acoustic noise in speech using spectral subtraction
Boll, S. (1979) · IEEE Transactions on Acoustics, Speech, and Signal Processing · doi:10.1109/tassp.1979.1163209 · Cited by 4,634
Probabilistic Latent Semantic Indexing
Hofmann, T. (2017) · ACM SIGIR Forum · doi:10.1145/3130348.3130370 · Cited by 3,988
Probabilistic latent semantic indexing
Hofmann, T. (1999) · Proceedings of the 22nd annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/312624.312649 · Cited by 3,976
Speech enhancement using a minimum mean-square error log-spectral amplitude estimator
Ephraim, Y., & Malah, D. (1985) · IEEE Transactions on Acoustics, Speech, and Signal Processing · doi:10.1109/tassp.1985.1164550 · Cited by 3,723
Performance measurement in blind audio source separation
Vincent, E., Gribonval, R., & Fevotte, C. (2006) · IEEE Transactions on Audio, Speech and Language Processing · doi:10.1109/tsa.2005.858005 · Cited by 2,889
Speech enhancement using a minimum-mean square error short-time spectral amplitude estimator
Ephraim, Y., & Malah, D. (1984) · IEEE Transactions on Acoustics, Speech, and Signal Processing · doi:10.1109/tassp.1984.1164453 · Cited by 2,863
TIMIT Acoustic-Phonetic Continuous Speech Corpus
Garofolo, J. S., Lamel, L. F., Fisher, W. M., Pallett, D. S., Dahlgren, N. L., Zue, V. W., & Fiscus, J. G. (2020) · Americanae (AECID Library) · doi:10.35111/17gk-bn40 · Cited by 2,508
An Algorithm for Intelligibility Prediction of Time–Frequency Weighted Noisy Speech
Taal, C. H., Hendriks, R. C., Heusdens, R., & Jensen, J. (2011) · IEEE Transactions on Audio, Speech, and Language Processing · doi:10.1109/tasl.2011.2114881 · Cited by 2,254
Deep Neural Networks for Acoustic Modeling in Speech Recognition
Hinton, G. E., Deng, L., Yu, D., Dahl, G. E., Mohamed, A., Jaitly, N., Senior, A., Vanhoucke, V., Nguyen, P., Sainath, T. N., et al. (2012) · IEEE Signal Processing Magazine · Cited by 2,115
Blind Separation of Speech Mixtures via Time-Frequency Masking
Yilmaz, O., & Rickard, S. (2004) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2004.828896 · Cited by 1,474
A Regression Approach to Speech Enhancement Based on Deep Neural Networks
Xu, Y., Du, J., Dai, L.-R., & Lee, C.-H. (2015) · IEEE/ACM Transactions on Audio, Speech, and Language Processing · doi:10.1109/taslp.2014.2364452 · Cited by 1,366
On Training Targets for Supervised Speech Separation
Wang, Y., Narayanan, A., & Wang, D. (2014) · IEEE/ACM Transactions on Audio, Speech, and Language Processing · doi:10.1109/taslp.2014.2352935 · Cited by 1,067
Darpa Timit Acoustic-Phonetic Continuous Speech Corpus CD-ROM {TIMIT} | NIST
Garofolo, J. S., Lamel, L. F., Fisher, W. M., Fiscus, J. G., Pallett, D. S., & Dahlgren, N. L. (1993) · Cited by 680
(2014) · International Conference on Learning Representations · Cited by 634
Training and Analysing Deep Recurrent Neural Networks
Hermans, M., & Schrauwen, B. (2013) · neural information processing systems · Cited by 631
Ideal ratio mask estimation using deep neural networks for robust speech recognition
Narayanan, A., & Wang, D. (2013) · 2013 IEEE International Conference on Acoustics, Speech and Signal Processing · doi:10.1109/icassp.2013.6639038 · Cited by 526
Towards Scaling Up Classification-Based Speech Separation
Wang, Y., & Wang, D. (2013) · IEEE Transactions on Audio, Speech, and Language Processing · doi:10.1109/tasl.2013.2250961 · Cited by 430
Gradient-based learning algorithms for recurrent networks and their computational complexity
Williams, R. J., & Zipser, D. (1995) · Cited by 424
Deep learning for monaural speech separation
Huang, P.-S., Kim, M., Hasegawa-Johnson, M., & Smaragdis, P. (2014) · 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2014.6853860 · Cited by 423
Self-citation(2013) · doi:10.4324/9780203763247 · Cited by 400
Recurrent neural networks for noise reduction in robust ASR
Maas, A. L., Le, Q. V., O'Neil, T. M., Vinyals, O., Nguyen, P., & Ng, A. Y. (2012) · Interspeech 2012 · doi:10.21437/interspeech.2012-6 · Cited by 334
Singing-voice separation from monaural recordings using robust principal component analysis
Huang, P.-S., Chen, S. D., Smaragdis, P., & Hasegawa-Johnson, M. (2012) · 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2012.6287816 · Cited by 325
Self-citationOn the Improvement of Singing Voice Separation for Monaural Recordings Using the MIR-1K Dataset
Hsu, C.-L., & Jang, J. R. (2009) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/tasl.2009.2026503 · Cited by 322
A limited-memory algorithm for bound-constrained optimization
Byrd, R. H., Peihuang, L., & Nocedal, J. (1996) · doi:10.2172/204262 · Cited by 313
Discriminatively trained recurrent neural networks for single-channel speech separation
Weninger, F., Hershey, J. R., Le Roux, J., & Schuller, B. (2014) · 2014 IEEE Global Conference on Signal and Information Processing (GlobalSIP) · doi:10.1109/globalsip.2014.7032183 · Cited by 283
Ozerov, A., Philippe, P., Bimbot, F., & Gribonval, R. (2007) · IEEE Transactions on Audio, Speech and Language Processing · doi:10.1109/tasl.2007.899291 · Cited by 166
Experiments on deep learning for speech denoising
Liu, D., Smaragdis, P., & Kim, M. (2014) · Interspeech (USB) · doi:10.21437/interspeech.2014-574 · Cited by 153
Self-citationSingle-channel speech separation with memory-enhanced recurrent neural networks
Weninger, F. J., Eyben, F., & Schuller, B. W. (2014) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2014.6854294 · Cited by 136
Deep neural networks for single channel source separation
Grais, E. M., Şen, M. U., & Erdoğan, H. (2014) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2014.6854299 · Cited by 129
Improving wideband speech recognition using mixed-bandwidth training data in CD-DNN-HMM
Li, J., Yu, D., Huang, J.-T., & Gong, Y. (2012) · IEEE Spoken Language Technology Workshop (SLT) · doi:10.1109/slt.2012.6424210 · Cited by 114
Cited by
Supervised Speech Separation Based on Deep Learning: An Overview
Wang, D., & Chen, J. (2018) · IEEE/ACM Transactions on Audio, Speech, and Language Processing · doi:10.1109/taslp.2018.2842159 · Cited by 1,524
Deep clustering: Discriminative embeddings for segmentation and separation
Hershey, J. R., Chen, Z., Le Roux, J., & Watanabe, S. (2016) · 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2016.7471631 · Cited by 1,354
Deep Learning for Audio Signal Processing
Purwins, H., Li, B., Virtanen, T., Schluter, J., Chang, S.-Y., & Sainath, T. (2019) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2019.2908700 · Cited by 855
Permutation invariant training of deep models for speaker-independent multi-talker speech separation
Yu, D., Kolbaek, M., Tan, Z.-H., & Jensen, J. (2017) · 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2017.7952154 · Cited by 839
Kolbaek, M., Yu, D., Tan, Z.-H., & Jensen, J. (2017) · IEEE/ACM Transactions on Audio, Speech, and Language Processing · doi:10.1109/taslp.2017.2726762 · Cited by 820
Metadata
- Authors
- Huang, P.-S., Kim, M., Hasegawa-Johnson, M., & Smaragdis, P.
- Venue
- IEEE/ACM Transactions on Audio, Speech, and Language Processing
- Published
- 2015-12
- Volume
- 23
- Issue
- 12
- Pages
- 2136-2147
- ISSN
- 2329-9290 (ISSN-L)
- 2329-9304
- OpenAlex
- W1790748249
- Cited by
- 461
- References
- 35
- FWCI
- 66.42
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.