The DOI matches its Crossref record; 50 of the 50 references it cites were found in a registry or an index.
Sound Event Localization and Detection of Overlapping Sources Using Convolutional Recurrent Neural Networks
Open accessAbstract
In this paper, we propose a convolutional recurrent neural network for joint sound event localization and detection (SELD) of multiple overlapping sound events in three-dimensional (3-D) space. The proposed network takes a sequence of consecutive spectrogram time frames as input and maps it to two outputs in parallel. As the first output, the sound event detection (SED) is performed as a multi-label classification task on each time frame producing temporal activity for all the sound event classes. As the second output, localization is performed by estimating the 3-D Cartesian coordinates of the direction-of-arrival (DOA) for each sound event class using multi-output regression. The proposed method is able to associate multiple DOAs with respective sound event labels and further track this association with respect to time. The proposed method uses separately the phase and magnitude component of the spectrogram calculated on each audio channel as the feature, thereby avoiding any method- and array-specific feature extraction. The method is evaluated on five Ambisonic and two circular array format datasets with different overlapping sound events in anechoic, reverberant, and real-life scenarios. The proposed method is compared with two SED, three DOA estimation, and one SELD baselines. The results show that the proposed method is generic and applicable to any array structures, robust to unseen DOA values, reverberation, and low SNR scenarios. The proposed method achieved a consistently higher recall of the estimated number of DOAs across datasets in comparison to the best baseline. Additionally, this recall was observed to be significantly better than the best baseline method for a higher number of overlapping sound events.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S., & Szegedy, C. (2015) · arXiv · doi:10.48550/arxiv.1502.03167 · Cited by 27,818
Multiple emitter location and signal parameter estimation
Schmidt, R. (1986) · IEEE Transactions on Antennas and Propagation · doi:10.1109/tap.1986.1143830 · Cited by 14,718
ESPRIT-estimation of signal parameters via rotational invariance techniques
Roy, R., & Kailath, T. (1989) · IEEE Transactions on Acoustics, Speech, and Signal Processing · doi:10.1109/29.32276 · Cited by 7,289
Image method for efficiently simulating small-room acoustics
Allen, J. B., & Berkley, D. A. (1979) · The Journal of the Acoustical Society of America · doi:10.1121/1.382599 · Cited by 3,742
A Dataset and Taxonomy for Urban Sound Research
Salamon, J., Jacoby, C., & Bello, J. P. (2014) · Proceedings of the 22nd ACM international conference on Multimedia · doi:10.1145/2647868.2655045 · Cited by 1,309
Estimating animal population density using passive acoustics
Marques, T. A., Thomas, L., Martin, S. W., Mellinger, D. K., Ward, J. A., Moretti, D. J., Harris, D., & Tyack, P. L. (2013) · Biological Reviews · doi:10.1111/brv.12001 · Cited by 746
Robust Localization in Reverberant Rooms
DiBiase, J. H., Silverman, H. F., & Brandstein, M. S. (2001) · Digital Signal Processing · doi:10.1007/978-3-662-04619-7_8 · Cited by 678
The third ‘CHiME’ speech separation and recognition challenge: Dataset, task and baselines
Barker, J., Marxer, R., Vincent, E., & Watanabe, S. (2015) · 2015 IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru.2015.7404837 · Cited by 641
Environmental Sound Recognition With Time–Frequency Audio Features
Chu, S., Narayanan, S., & Kuo, C.-C. J. (2009) · IEEE Transactions on Audio, Speech, and Language Processing · doi:10.1109/tasl.2009.2017438 · Cited by 639
Research works printed but not linked: 17
- lim, 0, Rare sound event detection using 1D convolutional recurrent neural networks, Proc Workshop Detection Classif Acoust Scenes Events
- 10.1109/ASPAA.2009.5346532 · doi:10.1109/aspaa.2009.5346532
- ottersten, 1993, Radar Array Processing (Springer Series in Information Sciences)
- 10.1121/1.4726012 · doi:10.1121/1.4726012
- yiwere, 2017, Distance estimation and localization of sound sources in reverberant conditions using deep neural networks, Int J Appl Eng Res, 12, 12384
- sun, 2017, Indoor sound source localization with probabilisitic neural network, IEEE Trans Ind Electron, 29, 6403
- roden, 0, On sound source localization of speech signals using deep neural networks, Proc Deutsche Jahrestagung für Akustik
- 10.1007/s11042-015-3105-4 · doi:10.1007/s11042-015-3105-4
- 10.1109/ICASSP.2014.6853670 · doi:10.1109/icassp.2014.6853670
- jeong, 0, Audio event detection using multiple-input convolutional neural network, Proc Workshop Detection Classif Acoust Scenes Events
- butko, 0, Two-source acoustic event detection and localization: Online implementation in a smart-room, Proc Euro Signal Process Conf, 1317
- 10.1121/1.4988711 · doi:10.1121/1.4988711
- teutsch, 2007, Modal Array Signal Processing Principles and Applications of Acoustic Wavefield Decomposition, 348
- dibiase, 2001, Microphone Arrays
- lu, 0, Bidirectional GRU for sound event detection, Proc Workshop Detection Classif Acoust Scenes Events
- zhou, 0, Sound event detection in multichannel audio LSTM network, Proc Workshop Detection Classif Acoust Scenes Events
- 10.1007/978-3-540-68585-2_34 · doi:10.1007/978-3-540-68585-2_34
Cited by
Machine learning in acoustics: Theory and applications
Bianco, M. J., Gerstoft, P., Traer, J., Ozanich, E., Roch, M. A., Gannot, S., & Deledalle, C.-A. (2019) · The Journal of the Acoustical Society of America · doi:10.1121/1.5133944 · Cited by 609
A survey of sound source localization with deep learning methods
Grumiaux, P.-A., Kitić, S., Girin, L., & Guérin, A. (2022) · The Journal of the Acoustical Society of America · doi:10.1121/10.0011809 · Cited by 347
Lenk, C., Hövel, P., Ved, K., Durstewitz, S., Meurer, T., Fritsch, T., Männchen, A., Küller, J., Beer, D., Ivanov, T., et al. (2023) · Nature Electronics · doi:10.1038/s41928-023-00957-5 · Cited by 70
Khalifa, Y., Donohue, C., Coyle, J. L., & Sejdic, E. (2021) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2020.3000057 · Cited by 49
Martin, K., Adam, O., Obin, N., & Dufour, V. (2022) · doi:10.1101/2022.02.19.481011 · Cited by 6
Metadata
- Authors
- Adavanne, S., Politis, A., Nikunen, J., & Virtanen, T.
- Venue
- IEEE Journal of Selected Topics in Signal Processing
- Published
- 2019-03
- Volume
- 13
- Issue
- 1
- Pages
- 34-48
- ISSN
- 1932-4553 (ISSN-L)
- 1941-0484
- OpenAlex
- W2810934215
- Cited by
- 534
- References
- 50
- FWCI
- 29.03
- Type
- journal article
- Language
- en
- Open access
- green
- Licence
- Funders
- H2020 European Research Council (637422)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Sound Event Localization and Detection of Overlapping Sources Using Convolutional Recurrent Neural Networks. https://app.cochat.ai/papers/10.1109/jstsp.2018.2885636
- The paper
- Adavanne, S., Politis, A., Nikunen, J., & Virtanen, T. (2019). Sound Event Localization and Detection of Overlapping Sources Using Convolutional Recurrent Neural Networks. IEEE Journal of Selected Topics in Signal Processing. https://doi.org/10.1109/jstsp.2018.2885636
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.