Student or educator? Sign up with your school email and get 6 months of Pro free.
Cited by 534

The DOI matches its Crossref record; 50 of the 50 references it cites were found in a registry or an index.

Sound Event Localization and Detection of Overlapping Sources Using Convolutional Recurrent Neural Networks

Open access
Adavanne, Sharath, Politis, Archontis, Nikunen, Joonas, Virtanen, Tuomas·2019·IEEE Journal of Selected Topics in Signal Processing

Abstract

In this paper, we propose a convolutional recurrent neural network for joint sound event localization and detection (SELD) of multiple overlapping sound events in three-dimensional (3-D) space. The proposed network takes a sequence of consecutive spectrogram time frames as input and maps it to two outputs in parallel. As the first output, the sound event detection (SED) is performed as a multi-label classification task on each time frame producing temporal activity for all the sound event classes. As the second output, localization is performed by estimating the 3-D Cartesian coordinates of the direction-of-arrival (DOA) for each sound event class using multi-output regression. The proposed method is able to associate multiple DOAs with respective sound event labels and further track this association with respect to time. The proposed method uses separately the phase and magnitude component of the spectrogram calculated on each audio channel as the feature, thereby avoiding any method- and array-specific feature extraction. The method is evaluated on five Ambisonic and two circular array format datasets with different overlapping sound events in anechoic, reverberant, and real-life scenarios. The proposed method is compared with two SED, three DOA estimation, and one SELD baselines. The results show that the proposed method is generic and applicable to any array structures, robust to unseen DOA values, reverberation, and low SNR scenarios. The proposed method achieved a consistently higher recall of the estimated number of DOAs across datasets in comparison to the best baseline. Additionally, this recall was observed to be significantly better than the best baseline method for a higher number of overlapping sound events.

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1109/jstsp.2018.2885636

Cites

50 of 50 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 50 references

Research works printed but not linked: 17

  1. lim, 0, Rare sound event detection using 1D convolutional recurrent neural networks, Proc Workshop Detection Classif Acoust Scenes Events
  2. 10.1109/ASPAA.2009.5346532 · doi:10.1109/aspaa.2009.5346532
  3. ottersten, 1993, Radar Array Processing (Springer Series in Information Sciences)
  4. 10.1121/1.4726012 · doi:10.1121/1.4726012
  5. yiwere, 2017, Distance estimation and localization of sound sources in reverberant conditions using deep neural networks, Int J Appl Eng Res, 12, 12384
  6. sun, 2017, Indoor sound source localization with probabilisitic neural network, IEEE Trans Ind Electron, 29, 6403
  7. roden, 0, On sound source localization of speech signals using deep neural networks, Proc Deutsche Jahrestagung für Akustik
  8. 10.1007/s11042-015-3105-4 · doi:10.1007/s11042-015-3105-4
  9. 10.1109/ICASSP.2014.6853670 · doi:10.1109/icassp.2014.6853670
  10. jeong, 0, Audio event detection using multiple-input convolutional neural network, Proc Workshop Detection Classif Acoust Scenes Events
  11. butko, 0, Two-source acoustic event detection and localization: Online implementation in a smart-room, Proc Euro Signal Process Conf, 1317
  12. 10.1121/1.4988711 · doi:10.1121/1.4988711
  13. teutsch, 2007, Modal Array Signal Processing Principles and Applications of Acoustic Wavefield Decomposition, 348
  14. dibiase, 2001, Microphone Arrays
  15. lu, 0, Bidirectional GRU for sound event detection, Proc Workshop Detection Classif Acoust Scenes Events
  16. zhou, 0, Sound event detection in multichannel audio LSTM network, Proc Workshop Detection Classif Acoust Scenes Events
  17. 10.1007/978-3-540-68585-2_34 · doi:10.1007/978-3-540-68585-2_34

Cited by

See all 534

Metadata

Authors
Adavanne, S., Politis, A., Nikunen, J., & Virtanen, T.
Venue
IEEE Journal of Selected Topics in Signal Processing
Published
2019-03
Volume
13
Issue
1
Pages
34-48
ISSN
  • 1932-4553 (ISSN-L)
  • 1941-0484
OpenAlex
W2810934215
Cited by
534
References
50
FWCI
29.03
Type
journal article
Language
en
Open access
green
Funders
H2020 European Research Council (637422)

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Sound Event Localization and Detection of Overlapping Sources Using Convolutional Recurrent Neural Networks. https://app.cochat.ai/papers/10.1109/jstsp.2018.2885636
The paper
Adavanne, S., Politis, A., Nikunen, J., & Virtanen, T. (2019). Sound Event Localization and Detection of Overlapping Sources Using Convolutional Recurrent Neural Networks. IEEE Journal of Selected Topics in Signal Processing. https://doi.org/10.1109/jstsp.2018.2885636

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.