The DOI matches its Crossref record; 15 of the 15 references it cites were found in a registry or an index.
Neural network based spectral mask estimation for acoustic beamforming
Abstract
We present a neural network based approach to acoustic beamforming. The network is used to estimate spectral masks from which the Cross-Power Spectral Density matrices of speech and noise are estimated, which in turn are used to compute the beamformer coefficients. The network training is independent of the number and the geometric configuration of the microphones. We further show that it is possible to train the network on clean speech only, avoiding the need for stereo data with separated speech and noise. Two types of networks are evaluated. One small feed-forward network with only one hidden layer and one more elaborated bi-directional Long Short-Term Memory network. We compare our system with different parametric approaches to mask estimation and using different beamforming algorithms. We show that our system yields superior results, both in terms of perceptual speech quality and with respect to speech recognition error rate. The results for the simple feed-forward network are especially encouraging considering its low computational requirements.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(2014) · Cited by 33,419
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S., & Szegedy, C. (2015) · arXiv · doi:10.48550/arxiv.1502.03167 · Cited by 27,818
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S. (2024) · arXiv (Cornell University) · doi:10.57702/o9raffed · Cited by 14,214
(2010) · Cited by 14,134
Backpropagation through time: what it does and how to do it
Werbos, P. J. (1990) · Proceedings of the IEEE · doi:10.1109/5.58337 · Cited by 4,879
The generalized correlation method for estimation of time delay
Knapp, C., & Carter, G. (1976) · IEEE Transactions on Acoustics, Speech, and Signal Processing · doi:10.1109/tassp.1976.1162830 · Cited by 4,433 · cited 1×
“BeamformIt! employs a Delay-and-Sum beamformer where the DoA estimate is obtained from GCC-PHAT [23] and post-processed to avoid instabilities.”
MethodRecurrent Neural Network Regularization
Zaremba, W., Sutskever, I., & Vinyals, O. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1409.2329 · Cited by 2,123
The third ‘CHiME’ speech separation and recognition challenge: Dataset, task and baselines
Barker, J., Marxer, R., Vincent, E., & Watanabe, S. (2015) · 2015 IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru.2015.7404837 · Cited by 641
Understanding the exploding gradient problemPreprint
Pascanu, R., Mikolov, T., & Bengio, Y. (2012) · arXiv (Cornell University) · Cited by 575
Acoustic Beamforming for Speaker Diarization of Meetings
Anguera, X., Wooters, C., & Hernando, J. (2007) · IEEE Transactions on Audio, Speech and Language Processing · doi:10.1109/tasl.2007.902460 · Cited by 397
Convolutional Neural Networks for Distant Speech Recognition
Swietojanski, P., Ghoshal, A., & Renals, S. (2014) · IEEE Signal Processing Letters · doi:10.1109/lsp.2014.2325781 · Cited by 253
Simmer, K. U., Bitzer, J., & Marro, C. (2001) · Digital Signal Processing · doi:10.1007/978-3-662-04619-7_3 · Cited by 232
Blind Acoustic Beamforming Based on Generalized Eigenvalue Decomposition
Warsitz, E., & Haeb-Umbach, R. (2007) · IEEE Transactions on Audio, Speech and Language Processing · doi:10.1109/tasl.2007.898454 · Cited by 227
Self-citationSpeech acoustic modeling from raw multichannel waveforms
Hoshen, Y., Weiss, R. J., & Wilson, K. W. (2015) · 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2015.7178847 · Cited by 226
BLSTM supported GEV beamformer front-end for the 3RD CHiME challenge
Heymann, J., Drude, L., Chinaev, A., & Haeb‐Umbach, R. (2015) · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru.2015.7404829 · Cited by 154
Self-citation
Cited by
Supervised Speech Separation Based on Deep Learning: An Overview
Wang, D., & Chen, J. (2018) · IEEE/ACM Transactions on Audio, Speech, and Language Processing · doi:10.1109/taslp.2018.2842159 · Cited by 1,524
SpeechBrain: A General-Purpose Speech Toolkit
Ravanelli, M., Parcollet, T., Plantinga, P., Rouhe, A., Cornell, S., Lugosch, L., Subakan, C., Dawalatabad, N., Heba, A., Zhong, J., et al. (2021) · arXiv · doi:10.48550/arxiv.2106.04624 · Cited by 512
Recent Advances in End-to-End Automatic Speech Recognition
Li, J. (2022) · APSIPA Transactions on Signal and Information Processing · doi:10.1561/116.00000050 · Cited by 395
A review of speaker diarization: Recent advances with deep learning
Park, T. J., Kanda, N., Dimitriadis, D., Han, K. J., Watanabe, S., & Narayanan, S. (2022) · Computer Speech & Language · doi:10.1016/j.csl.2021.101317 · Cited by 354
A survey of sound source localization with deep learning methods
Grumiaux, P.-A., Kitić, S., Girin, L., & Guérin, A. (2022) · The Journal of the Acoustical Society of America · doi:10.1121/10.0011809 · Cited by 347
Metadata
- Authors
- Heymann, J., Drude, L., & Haeb-Umbach, R.
- Venue
- 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)
- Publisher
- IEEE
- Published
- 2016-03
- Pages
- 196-200
- ISSN
- 1520-6149 (ISSN-L)
- OpenAlex
- W2398042854
- Cited by
- 480
- References
- 15
- FWCI
- 46.88
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.