The DOI matches its Crossref record; 19 of the 19 references it cites were found in a registry or an index.
Recurrent neural networks for polyphonic sound event detection in real life recordings
Open accessAbstract
In this paper we present an approach to polyphonic sound event detection in real life recordings based on bi-directional long short term memory (BLSTM) recurrent neural networks (RNNs). A single multilabel BLSTM RNN is trained to map acoustic features of a mixture signal consisting of sounds from multiple classes, to binary activity indicators of each event class. Our method is tested on a large database of real-life recordings, with 61 classes (e.g. music, car, speech) from 10 different everyday contexts. The proposed method outperforms previous approaches by a large margin, and the results are further improved using data augmentation techniques. Overall, our system reports an average F1-score of 65.5% on 1 second blocks and 64.7% on single frames, a relative improvement over previous state-of-the-art approach of 6.8% and 15.1% respectively.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
Bidirectional recurrent neural networks
Schuster, M., & Paliwal, K. K. (1997) · IEEE Transactions on Signal Processing · doi:10.1109/78.650093 · Cited by 10,172 · cited 3×
“A bidirectional long short-term memory (BLSTM) [14] network is obtained by substituting the simple recurrent neurons in a BRNN with LSTM units.”
MethodSpeech recognition with deep recurrent neural networks
Graves, A., Mohamed, A.-R., & Hinton, G. (2013) · 2013 IEEE International Conference on Acoustics, Speech and Signal Processing · doi:10.1109/icassp.2013.6638947 · Cited by 8,893 · cited 1×
“These networks have obtained excellent results on complex audio detection tasks, such as speech recognition [15] and onset detection [16] (multiclass), polyphonic”
BackgroundLearning long-term dependencies with gradient descent is difficult
Bengio, Y., Simard, P., & Frasconi, P. (1994) · IEEE Transactions on Neural Networks · doi:10.1109/72.279181 · Cited by 8,542 · cited 1×
“One of the main reasons is the phenomenon called vanishing gradient problem [19], which makes the influence of past inputs decay exponentially over time.”
BackgroundFramewise phoneme classification with bidirectional LSTM and other neural network architectures
Graves, A., & Schmidhuber, J. (2005) · Neural Networks · doi:10.1016/j.neunet.2005.06.042 · Cited by 5,839
Backpropagation through time: what it does and how to do it
Werbos, P. J. (1990) · Proceedings of the IEEE · doi:10.1109/5.58337 · Cited by 4,879 · cited 1×
“Training is done by back propagation through time (BPTT) [25].”
BackgroundA Novel Connectionist System for Unconstrained Handwriting Recognition
Graves, A., Liwicki, M., Fernandez, S., Bertolami, R., Bunke, H., & Schmidhuber, J. (2009) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2008.137 · Cited by 1,983
Environmental Sound Recognition With Time–Frequency Audio Features
Chu, S., Narayanan, S., & Kuo, C.-C. J. (2009) · IEEE Transactions on Audio, Speech, and Language Processing · doi:10.1109/tasl.2009.2017438 · Cited by 639
Polyphonic sound event detection using multi label deep neural networks
Cakir, E., Heittola, T., Huttunen, H., & Virtanen, T. (2015) · 2015 International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2015.7280624 · Cited by 256
Self-citationAcoustic event detection in real life recordings
Mesaros, A., Heittola, T., Eronen, A., & Virtanen, T. I. (2010) · Cited by 241
Self-citationContext-dependent sound event detection
Heittola, T., Mesaros, A., Eronen, A., & Virtanen, T. (2013) · EURASIP Journal on Audio, Speech, and Music Processing · doi:10.1186/1687-4722-2013-1 · Cited by 217
Self-citationAutomatic Surveillance of the Acoustic Activity in Our Living Environment
Härmä, A., McKinney, M. F., & Skowronek, J. (2005) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme.2005.1521503 · Cited by 188
Speech recognition using noise-adaptive prototypes
Nadas, A. J., Nahamoo, D., & Picheny, M. (1989) · IEEE Transactions on Acoustics Speech and Signal Processing · doi:10.1109/29.35387 · Cited by 175
Exploring Data Augmentation for Improved Singing Voice Detection with Neural Networks.
Schlüter, J., & Grill, T. (2015) · doi:10.5072/zenodo.243314 · Cited by 172
Introducing CURRENNT: the Munich open-source CUDA recurrent neural network toolkit
Weninger, F. J., Bergmann, J. M., & Schuller, B. W. (2015) · Spiral (Imperial College London) · Cited by 154
Polyphonic piano note transcription with recurrent neural networks
Böck, S., & Schedl, M. (2012) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2012.6287832 · Cited by 131
Universal Onset Detection With Bidirectional Long Short-Term Memory Neural Networks.
Eyben, F., Böck, S., Schuller, B. W., & Graves, A. (2010) · mediaTUM – the media and publications repository of the Technical University Munich (Technical University Munich) · doi:10.5281/zenodo.1417130 · Cited by 123
IEEE International Conference on Multimedia and Expo (ICME) 2013
(2012) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2012.2218722 · Cited by 97
Dennis, J. W., Tran, H. D., & Chng, E. S. (2013) · Pattern Recognition Letters · doi:10.1016/j.patrec.2013.02.015 · Cited by 69
Cited by
Deep Convolutional Neural Networks and Data Augmentation for Environmental Sound Classification
Salamon, J., & Bello, J. P. (2017) · IEEE Signal Processing Letters · doi:10.1109/lsp.2017.2657381 · Cited by 1,364
Deep Learning for Audio Signal Processing
Purwins, H., Li, B., Virtanen, T., Schluter, J., Chang, S.-Y., & Sainath, T. (2019) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2019.2908700 · Cited by 855
Self-citationConvolutional Recurrent Neural Networks for Polyphonic Sound Event Detection
Cakir, E., Parascandolo, G., Heittola, T., Huttunen, H., & Virtanen, T. (2017) · IEEE/ACM Transactions on Audio, Speech, and Language Processing · doi:10.1109/taslp.2017.2690575 · Cited by 604
Self-citationAdavanne, S., Politis, A., Nikunen, J., & Virtanen, T. (2019) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2018.2885636 · Cited by 534
Self-citationAudio-Visual Event Localization in Unconstrained Videos
Tian, Y., Shi, J., Li, B., Duan, Z., & Xu, C. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01216-8_16 · Cited by 493
Metadata
- Authors
- Parascandolo, G., Huttunen, H., & Virtanen, T.
- Venue
- 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)
- Publisher
- IEEE
- Published
- 2016-03
- Pages
- 6440-6444
- ISSN
- 1520-6149 (ISSN-L)
- OpenAlex
- W2341412280
- Cited by
- 319
- References
- 19
- FWCI
- 39.16
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.