The DOI matches its Crossref record; 48 of the 48 references it cites were found in a registry or an index.
Multichannel Audio Source Separation With Deep Neural Networks
Open accessAbstract
This article addresses the problem of multichannel audio source separation. We propose a framework where deep neural networks (DNNs) are used to model the source spectra and combined with the classical multichannel Gaussian model to exploit the spatial information. The parameters are estimated in an iterative expectation-maximization (EM) fashion and used to derive a multichannel Wiener filter. We present an extensive experimental study to show the impact of different design choices on the performance of the proposed technique. We consider different cost functions for the training of DNNs, namely the probabilistically motivated Itakura-Saito divergence, and also Kullback-Leibler, Cauchy, mean squared error, and phase-sensitive cost functions. We also study the number of EM iterations and the use of multiple DNNs, where each DNN aims to improve the spectra estimated by the preceding EM iteration. Finally, we present its application to a speech enhancement problem. The experimental results show the benefit of the proposed multichannel approach over a single-channel DNN-based approach and the conventional multichannel nonnegative matrix factorization-based iterative EM algorithm.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification
He, K., Zhang, X., Ren, S., & Sun, J. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.123 · Cited by 19,741
Hinton, G., Deng, L., Yu, D., Dahl, G., Mohamed, A.-R., Jaitly, N., Senior, A., Vanhoucke, V., Nguyen, P., Sainath, T., et al. (2012) · IEEE Signal Processing Magazine · doi:10.1109/msp.2012.2205597 · Cited by 10,260
Recurrent neural network based language model
Mikolov, T., Karafiát, M., Burget, L., Černocký, J., & Khudanpur, S. (2010) · Interspeech 2010 · doi:10.21437/interspeech.2010-343 · Cited by 5,390 · cited 2×
“Table IV shows the performance comparison using the DNN+sMBR back-end trained with enhanced multi-condition data followed by 5-gram KN smoothing and RNN-LM rescoring.”
MethodADADELTA: An Adaptive Learning Rate Method
Zeiler, M. D. (2012) · arXiv · doi:10.48550/arxiv.1212.5701 · Cited by 5,322
Greedy layer-wise training of deep networks
Bengio, Y., Lamblin, P., Popovici, D., & Larochelle, H. (2007) · Advances in Neural Information Processing Systems 19 · doi:10.7551/mitpress/7503.003.0024 · Cited by 4,841 · cited 1×
“Thus, the spectral parameters v j ( f, n ) are only initialized by the first DNN (as in Section III-B) and kept fixed during the iterative procedure.”
MethodKaldi Speech Recognition Toolkit
Povey, D. (2024) · Infoscience (Ecole Polytechnique Fédérale de Lausanne) · doi:10.57702/jb3fvbn9 · Cited by 4,609
Performance measurement in blind audio source separation
Vincent, E., Gribonval, R., & Fevotte, C. (2006) · IEEE Transactions on Audio, Speech and Language Processing · doi:10.1109/tsa.2005.858005 · Cited by 2,889
Self-citationPractical Recommendations for Gradient-Based Training of Deep Architectures
Bengio, Y. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-35289-8_26 · Cited by 2,259
Deep Learning: Methods and Applications
Deng, L. (2014) · now publishers, Inc. eBooks · doi:10.1561/9781601988157 · Cited by 1,759
Static Analysis of Shape in TensorFlow Programs
The Theano Development Team, Al‐Rfou, R., Alain, G., Almahairi, A., Angermueller, C., Bahdanau, D., Ballas, N., Bastien, F., Bayer, J., Belikov, A., et al. (2016) · arXiv (Cornell University) · doi:10.4230/lipics.ecoop.2020.15 · Cited by 1,589
Maximum likelihood linear transformations for HMM-based speech recognition
Gales, M. J. F. (1998) · Computer Speech & Language · doi:10.1006/csla.1998.0043 · Cited by 1,482
Improved backing-off for M-gram language modeling
Kneser, R., & Ney, H. (2002) · 1995 International Conference on Acoustics, Speech, and Signal Processing · doi:10.1109/icassp.1995.479394 · Cited by 1,473
Févotte, C., Bertin, N., & Durrieu, J.-L. (2009) · Neural Computation · doi:10.1162/neco.2008.04-08-771 · Cited by 1,119
An Experimental Study on Speech Enhancement Based on Deep Neural Networks
Xu, Y., Du, J., Dai, L.-R., & Lee, C.-H. (2014) · IEEE Signal Processing Letters · doi:10.1109/lsp.2013.2291240 · Cited by 924
Sequence-discriminative training of deep neural networks
Veselý, K., Ghoshal, A., Burget, L., & Povey, D. (2013) · Interspeech 2013 · doi:10.21437/interspeech.2013-548 · Cited by 657
Phase-sensitive and recognition-boosted speech separation using deep recurrent neural networks
Erdogan, H., Hershey, J. R., Watanabe, S., & Le Roux, J. (2015) · 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2015.7178061 · Cited by 646
The third ‘CHiME’ speech separation and recognition challenge: Dataset, task and baselines
Barker, J., Marxer, R., Vincent, E., & Watanabe, S. (2015) · 2015 IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru.2015.7404837 · Cited by 641
Self-citationSpeech Enhancement with LSTM Recurrent Neural Networks and its Application to Noise-Robust ASR
Weninger, F., Erdogan, H., Watanabe, S., Vincent, E., Le Roux, J., Hershey, J. R., & Schuller, B. (2015) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-22482-4_11 · Cited by 602
Self-citationIdeal ratio mask estimation using deep neural networks for robust speech recognition
Narayanan, A., & Wang, D. (2013) · 2013 IEEE International Conference on Acoustics, Speech and Signal Processing · doi:10.1109/icassp.2013.6639038 · Cited by 526
Joint Optimization of Masks and Deep Recurrent Neural Networks for Monaural Source Separation
Huang, P.-S., Kim, M., Hasegawa-Johnson, M., & Smaragdis, P. (2015) · IEEE/ACM Transactions on Audio, Speech, and Language Processing · doi:10.1109/taslp.2015.2468583 · Cited by 461
Towards Scaling Up Classification-Based Speech Separation
Wang, Y., & Wang, D. (2013) · IEEE Transactions on Audio, Speech, and Language Processing · doi:10.1109/tasl.2013.2250961 · Cited by 430
Under-Determined Reverberant Audio Source Separation Using a Full-Rank Spatial Covariance Model
Duong, N. Q. K., Vincent, E., & Gribonval, R. (2010) · IEEE Transactions on Audio, Speech, and Language Processing · doi:10.1109/tasl.2010.2050716 · Cited by 428
Self-citation(2007) · Signals and Communication Technology · doi:10.1007/978-1-4020-6479-1 · Cited by 427
Deep learning for monaural speech separation
Huang, P.-S., Kim, M., Hasegawa-Johnson, M., & Smaragdis, P. (2014) · 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2014.6853860 · Cited by 423
(2009) · Wiley eBooks · Cited by 321
A General Flexible Framework for the Handling of Prior Information in Audio Source Separation
Ozerov, A., Emmanuel Vincent, A., & Bimbot, F. (2011) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/tasl.2011.2172425 · Cited by 305
Discriminatively trained recurrent neural networks for single-channel speech separation
Weninger, F., Hershey, J. R., Le Roux, J., & Schuller, B. (2014) · 2014 IEEE Global Conference on Signal and Information Processing (GlobalSIP) · doi:10.1109/globalsip.2014.7032183 · Cited by 283
Wölfel, M., & McDonough, J. (2009) · Wiley eBooks · doi:10.1002/9780470714089 · Cited by 240
Multi-source TDOA estimation in reverberant audio using angular spectra and clustering
Blandin, C., Ozerov, A., & Vincent, E. (2012) · Signal Processing · doi:10.1016/j.sigpro.2011.09.032 · Cited by 207
Self-citationA Feature Study for Classification-Based Speech Separation at Low Signal-to-Noise Ratios
Chen, J., Wang, Y., & Wang, D. (2014) · IEEE/ACM Transactions on Audio, Speech, and Language Processing · doi:10.1109/taslp.2014.2359159 · Cited by 158
Zarzoso, V., & Nandi, A. K. (1999) · Springer eBooks · doi:10.1007/978-1-4757-2985-6_4 · Cited by 137
Experiments on deep learning for speech denoising
Liu, D., Smaragdis, P., & Kim, M. (2014) · Interspeech (USB) · doi:10.21437/interspeech.2014-574 · Cited by 136
Kumatani, K., McDonough, J. W., & Raj, B. (2012) · IEEE Signal Processing Magazine · doi:10.1109/msp.2012.2205285 · Cited by 123
Binaural Classification for Reverberant Speech Segregation Using Deep Neural Networks
Jiang, Y., Wang, D., Liu, R., & Feng, Z. (2014) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2014.2361023 · Cited by 118
Deep neural network based instrument extraction from music
Uhlich, S., Giron, F., & Mitsufuji, Y. (2015) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2015.7178348 · Cited by 112
Kernel Additive Models for Source Separation
Antoine Liutkus, A., Fitzgerald, D., Rafii, Z., Pardo, B., & Daudet, L. (2014) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2014.2332434 · Cited by 102
A deep neural network for time-domain signal reconstruction
Wang, Y., & Wang, D. (2015) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2015.7178800 · Cited by 100
Naik, G. R., & Wang, W. (2014) · Signals and communication technology · doi:10.1007/978-3-642-55016-4 · Cited by 96
Exploring multi-channel features for denoising-autoencoder-based speech enhancement
Araki, S., Hayashi, T., Delcroix, M., Fujimoto, M., Takeda, K., & Nakatani, T. (2015) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2015.7177943 · Cited by 94
Probabilistic Modeling Paradigms for Audio Source Separation
Emmanuel Vincent, A., Jafari, M. G., Abdallah, S., Plumbley, M. D., & Davies, M. E. (2010) · IGI Global eBooks · doi:10.4018/9781615209194.ch007 · Cited by 89
Foundations and Trends in Signal Processing: DEEP LEARNING – Methods and Applications
Deng, L., & Yu, D. (2014) · Cited by 81
Online algorithms for nonnegative matrix factorization with the Itakura-Saito divergence
Lefèvre, A., Bach, F., & Févotte, C. (2011) · IEEE Workshop on Applications of Signal Processing to Audio and Acoustics (WASPAA) · doi:10.1109/aspaa.2011.6082314 · Cited by 79
Narayanan, A., & Wang, D. (2014) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2014.2372314 · Cited by 67
Févotte, C., & Ozerov, A. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-23126-1_8 · Cited by 49
Robust ASR using neural network based speech enhancement and feature simulation
Sivasankaran, S., Nugraha, A. A., Emmanuel Vincent, A., Morales-Cordovilla, J. A., Dalmia, S., Illina, I., & Antoine Liutkus, A. (2015) · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru.2015.7404834 · Cited by 42
Self-citationFusion Methods for Speech Enhancement and Audio Source Separation
Jaureguiberry, X., Emmanuel Vincent, A., & Gaël Richard, A. (2016) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2016.2553441 · Cited by 27
Nugraha, A. A., Yamamoto, K., & Nakagawa, S. (2014) · EURASIP Journal on Audio Speech and Music Processing · doi:10.1186/1687-4722-2014-13 · Cited by 13
Self-citationMcDonough, J. W., & Kumatani, K. (2012) · doi:10.1002/9781118392683.ch6 · Cited by 8
Cited by
Supervised Speech Separation Based on Deep Learning: An Overview
Wang, D., & Chen, J. (2018) · IEEE/ACM Transactions on Audio, Speech, and Language Processing · doi:10.1109/taslp.2018.2842159 · Cited by 1,524
Deep Learning for Audio Signal Processing
Purwins, H., Li, B., Virtanen, T., Schluter, J., Chang, S.-Y., & Sainath, T. (2019) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2019.2908700 · Cited by 855
Machine learning in acoustics: Theory and applications
Bianco, M. J., Gerstoft, P., Traer, J., Ozanich, E., Roch, M. A., Gannot, S., & Deledalle, C.-A. (2019) · The Journal of the Acoustical Society of America · doi:10.1121/1.5133944 · Cited by 609
A Consolidated Perspective on Multimicrophone Speech Enhancement and Source Separation
Gannot, S., Vincent, E., Markovich-Golan, S., & Ozerov, A. (2017) · IEEE/ACM Transactions on Audio, Speech, and Language Processing · doi:10.1109/taslp.2016.2647702 · Cited by 563
Self-citationAn analysis of environment, microphone and data simulation mismatches in robust speech recognition
Vincent, E., Watanabe, S., Nugraha, A. A., Barker, J., & Marxer, R. (2017) · Computer Speech & Language · doi:10.1016/j.csl.2016.11.005 · Cited by 351
Self-citation
Metadata
- Authors
- Nugraha, A. A., Liutkus, A., & Vincent, E.
- Venue
- IEEE/ACM Transactions on Audio, Speech, and Language Processing
- Published
- 2016-09
- Volume
- 24
- Issue
- 9
- Pages
- 1652-1664
- ISSN
- 2329-9290 (ISSN-L)
- 2329-9304
- OpenAlex
- W2408744528
- Cited by
- 300
- References
- 48
- FWCI
- 50.32
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.