The DOI matches its Crossref record; 31 of the 31 references it cites were found in a registry or an index.
Multi-Speaker DOA Estimation Using Deep Convolutional Networks Trained With Noise Signals
Open accessAbstract
Supervised learning-based methods for source localization, being data driven, can be adapted to different acoustic conditions via training and have been shown to be robust to adverse acoustic environments. In this paper, a convolutional neural network (CNN) based supervised learning method for estimating the direction of arrival (DOA) of multiple speakers is proposed. Multi-speaker DOA estimation is formulated as a multi-class multi-label classification problem, where the assignment of each DOA label to the input feature is treated as a separate binary classification problem. The phase component of the short-time Fourier transform (STFT) coefficients of the received microphone signals are directly fed into the CNN, and the features for DOA estimation are learnt during training. Utilizing the assumption of disjoint speaker activity in the STFT domain, a novel method is proposed to train the CNN with synthesized noise signals. Through experimental evaluation with both simulated and measured acoustic impulse responses, the ability of the proposed DOA estimation approach to adapt to unseen acoustic conditions and its robustness to unseen noise type is demonstrated. Through additional empirical investigation, it is also shown that with an array of M microphone our proposed framework yields the best localization performance with M-1 convolution layers. The ability of the proposed method to accurately localize speakers in a dynamic acoustic scenario with varying number of sources is also shown.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
(2014) · Cited by 33,419
Adhi Harmoko, S., M.Komp, Jacquard, J. M., Zuse, K., & Eniac (2005) · Cited by 18,035
Multiple emitter location and signal parameter estimation
Schmidt, R. (1986) · IEEE Transactions on Antennas and Propagation · doi:10.1109/tap.1986.1143830 · Cited by 14,718
Hinton, G., Deng, L., Yu, D., Dahl, G., Mohamed, A.-R., Jaitly, N., Senior, A., Vanhoucke, V., Nguyen, P., Sainath, T., et al. (2012) · IEEE Signal Processing Magazine · doi:10.1109/msp.2012.2205597 · Cited by 10,260
Grossman, P. (2009) · Discrete Mathematics for Computing · doi:10.1007/978-0-230-37405-8_1 · Cited by 8,834
The generalized correlation method for estimation of time delay
Knapp, C., & Carter, G. (1976) · IEEE Transactions on Acoustics, Speech, and Signal Processing · doi:10.1109/tassp.1976.1162830 · Cited by 4,433 · cited 1×
“cross correlation (GCC) methods [3], iii) generalizations of the cross-correlation methods to microphone arrays with more than two channels such as steered response power (SRP), SRP with”
MethodIntroduction to Algorithms, third edition
Cormen, T. H., Leiserson, C. E., Rivest, R. L., & Stein, C. (2009) · Cited by 2,309
Classifier chains for multi-label classification
Read, J., Pfahringer, B., Holmes, G., & Frank, E. (2011) · Machine Learning · doi:10.1007/s10994-011-5256-5 · Cited by 2,289
Maximum likelihood methods for direction-of-arrival estimation
Stoica, P., & Sharman, K. C. (1990) · IEEE Transactions on Acoustics, Speech, and Signal Processing · doi:10.1109/29.57542 · Cited by 908
DiBiase, J. H. (2000) · Cited by 468
Real-time passive source localization: a practical linear-correction least-squares approach
Huang, Y., Benesty, J., Elko, G. W., & Mersereati, R. M. (2001) · IEEE Transactions on Speech and Audio Processing · doi:10.1109/89.966097 · Cited by 464
A robust method for speech signal time-delay estimation in reverberant rooms
Brandstein, M. S., & Silverman, H. F. (2002) · 1997 IEEE International Conference on Acoustics, Speech, and Signal Processing · doi:10.1109/icassp.1997.599651 · Cited by 383
A learning-based approach to direction of arrival estimation in noisy and reverberant environments
Xiao, X., Zhao, S., Zhong, X., Jones, D. L., Chng, E. S., & Li, H. (2015) · 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2015.7178484 · Cited by 289
Broadband doa estimation using convolutional neural networks trained with noise signals
Chakrabarty, S., & Habets, E. A. P. (2017) · 2017 IEEE Workshop on Applications of Signal Processing to Audio and Acoustics (WASPAA) · doi:10.1109/waspaa.2017.8170010 · Cited by 286
Self-citationAdavanne, S., Politis, A., & Virtanen, T. (2018) · 2018 26th European Signal Processing Conference (EUSIPCO) · doi:10.23919/eusipco.2018.8553182 · Cited by 277
Multichannel audio database in various acoustic environments
Hadad, E., Heese, F., Vary, P., & Gannot, S. (2014) · 2014 14th International Workshop on Acoustic Signal Enhancement (IWAENC) · doi:10.1109/iwaenc.2014.6954309 · Cited by 223
Multi-source TDOA estimation in reverberant audio using angular spectra and clustering
Blandin, C., Ozerov, A., & Vincent, E. (2012) · Signal Processing · doi:10.1016/j.sigpro.2011.09.032 · Cited by 207
Deep Neural Networks for Multiple Speaker Detection and Localization
He, W., Motlicek, P., & Odobez, J.-M. (2018) · 2018 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2018.8461267 · Cited by 198
Generating sensor signals in isotropic noise fields
Habets, E. A. P., & Gannot, S. (2007) · The Journal of the Acoustical Society of America · doi:10.1121/1.2799929 · Cited by 180
Self-citationThe Handbook of Brain Theory and Neural Networks
(1999) · Kybernetes · doi:10.1108/k.1999.28.9.1084.1 · Cited by 168
Sound Source Localization Using Deep Learning Models
Yalta, N., Nakadai, K., & Ogata, T. (2017) · Journal of Robotics and Mechatronics · doi:10.20965/jrm.2017.p0037 · Cited by 159
Takeda, R., & Komatani, K. (2016) · 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2016.7471706 · Cited by 158
The Handbook of Brain Theory and Neural Networks
Bourlard, H. A., & Samy Bengio, A. (2002) · Cited by 114
Takeda, R., & Komatani, K. (2016) · IEEE Spoken Language Technology Workshop (SLT) · doi:10.1109/slt.2016.7846325 · Cited by 114
Broadband Music: Opportunities and Challenges for Multiple Source Localization
Dmochowski, J., Benesty, J., & Affes, S. (2007) · IEEE Workshop on Applications of Signal Processing to Audio and Acoustics (WASPAA) · doi:10.1109/aspaa.2007.4392978 · Cited by 89
A neural network based algorithm for speaker localization in a multi-room environment
Vesperini, F., Vecchiotti, P., Principi, E., Squartini, S., & Piazza, F. (2016) · Machine learning for signal processing ... · doi:10.1109/mlsp.2016.7738817 · Cited by 80
Classification of Spatial Audio Location and Content Using Convolutional Neural Networks
Hirvonen, T. (2015) · Journal of the Audio Engineering Society · Cited by 72
Classification vs. Regression in Supervised Learning for Single Channel Speaker Count Estimation
Stöter, F.-R., Chakrabarty, S., Edler, B., & Habets, E. A. P. (2018) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2018.8462159 · Cited by 39
Self-citationMulti-Speaker Localization Using Convolutional Neural Network Trained with NoisePreprint
Chakrabarty, S., & Habets, E. A. P. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1712.04276 · Cited by 33
Self-citation
Cited by
Machine learning in acoustics: Theory and applications
Bianco, M. J., Gerstoft, P., Traer, J., Ozanich, E., Roch, M. A., Gannot, S., & Deledalle, C.-A. (2019) · The Journal of the Acoustical Society of America · doi:10.1121/1.5133944 · Cited by 609
Deep Networks for Direction-of-Arrival Estimation in Low SNR
Papageorgiou, G., Sellathurai, M., & Eldar, Y. (2021) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2021.3089927 · Cited by 400
A survey of sound source localization with deep learning methods
Grumiaux, P.-A., Kitić, S., Girin, L., & Guérin, A. (2022) · The Journal of the Acoustical Society of America · doi:10.1121/10.0011809 · Cited by 347
Two-Dimensional Direction-of-Arrival Estimation Using Stacked Intelligent Metasurfaces
An, J., Yuen, C., Guan, Y. L., Renzo, M. D., Debbah, M., Poor, H. V., & Hanzo, L. (2024) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2024.3414613 · Cited by 125
“Furthermore, the authors of [17] formulated the DOA estimation problem for multiple sources as a multi-label classification problem.”
Background
Metadata
- Authors
- Chakrabarty, S., & Habets, E. A. P.
- Venue
- IEEE Journal of Selected Topics in Signal Processing
- Published
- 2019-03
- Volume
- 13
- Issue
- 1
- Pages
- 8-21
- ISSN
- 1932-4553 (ISSN-L)
- 1941-0484
- OpenAlex
- W2885219692
- Cited by
- 326
- References
- 31
- FWCI
- 26.83
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.