The DOI matches its Crossref record; 49 of the 49 references it cites were found in a registry or an index.
Convolutional Recurrent Neural Networks for Polyphonic Sound Event Detection
Open accessAbstract
Sound events often occur in unstructured environments where they exhibit wide variations in their frequency content and temporal structure. Convolutional neural networks (CNNs) are able to extract higher level features that are invariant to local spectral and temporal variations. Recurrent neural networks (RNNs) are powerful in learning the longer term temporal context in the audio signals. CNNs and RNNs as classifiers have recently shown improved performances over established methods in various sound recognition tasks. We combine these two approaches in a convolutional recurrent neural network (CRNN) and apply it on a polyphonic sound event detection task. We compare the performance of the proposed CRNN method with CNN, RNN, and other established methods, and observe a considerable improvement for four different datasets consisting of everyday sound events.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
(2014) · Cited by 33,419
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S., & Szegedy, C. (2015) · arXiv · doi:10.48550/arxiv.1502.03167 · Cited by 27,818 · cited 1×
“To speed up the training phase we train our networks with batch normalization layers [36] after every convolutional or fully connected layer.”
Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation
Cho, K., van Merrienboer, B., Gulcehre, C., Bahdanau, D., Bougares, F., Schwenk, H., & Bengio, Y. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1179 · Cited by 25,545 · cited 1×
“Deep neural networks [17] have recently achieved remarkable success in several domains such as image recognition [18], [19], speech recognition [20], [21], machine translation [22], even integrating multiple data modalities such as image and text in image captioning [23].”
Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification
He, K., Zhang, X., Ren, S., & Sun, J. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.123 · Cited by 19,741
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S. (2024) · arXiv (Cornell University) · doi:10.57702/o9raffed · Cited by 14,214
Hinton, G., Deng, L., Yu, D., Dahl, G., Mohamed, A.-R., Jaitly, N., Senior, A., Vanhoucke, V., Nguyen, P., Sainath, T., et al. (2012) · IEEE Signal Processing Magazine · doi:10.1109/msp.2012.2205597 · Cited by 10,260
Speech recognition with deep recurrent neural networks
Graves, A., Mohamed, A.-R., & Hinton, G. (2013) · 2013 IEEE International Conference on Acoustics, Speech and Signal Processing · doi:10.1109/icassp.2013.6638947 · Cited by 8,893 · cited 3×
“Similar approaches combining CNNs and RNNs have been presented recently in ASR [21], [28], [29] and music classification [30].”
On the Properties of Neural Machine Translation: Encoder–Decoder Approaches
Cho, K., van Merrienboer, B., Bahdanau, D., & Bengio, Y. (2014) · Proceedings of SSST-8, Eighth Workshop on Syntax, Semantics and Structure in Statistical Translation · doi:10.3115/v1/w14-4012 · Cited by 7,099
How transferable are features in deep neural networks?
Yosinski, J., Clune, J., Bengio, Y., & Lipson, H. (2014) · arXiv · doi:10.48550/arxiv.1411.1792 · Cited by 6,061
Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Maps
Simonyan, K., Vedaldi, A., & Zisserman, A. (2013) · arXiv · doi:10.48550/arxiv.1312.6034 · Cited by 5,370
Deep visual-semantic alignments for generating image descriptions
Karpathy, A., & Fei-Fei, L. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298932 · Cited by 4,902
Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translation
Cho, K., van Merrienboer, B., Gulcehre, C., Bahdanau, D., Bougares, F., Schwenk, H., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1406.1078 · Cited by 3,317
librosa: Audio and Music Signal Analysis in Python
McFee, B., Raffel, C., Liang, D., Ellis, D., McVicar, M., Battenberg, E., & Nieto, O. (2015) · Proceedings of the Python in Science Conference · doi:10.25080/majora-7b98e3ed-003 · Cited by 3,033
Deep Speech 2: End-to-End Speech Recognition in English and Mandarin
Amodei, D., Anubhai, R., Battenberg, E., Case, C. T., Casper, J., Catanzaro, B., Chen, J., Chrzanowski, M., Coates, A., Diamos, G., et al. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1512.02595 · Cited by 2,110
Deep Learning of Representations for Unsupervised and Transfer Learning.
Bengio, Y. (2011) · Cited by 1,702
Convolutional, Long Short-Term Memory, fully connected Deep Neural Networks
Sainath, T. N., Vinyals, O., Senior, A., & Sak, H. (2015) · 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2015.7178838 · Cited by 1,678
Static Analysis of Shape in TensorFlow Programs
The Theano Development Team, Al‐Rfou, R., Alain, G., Almahairi, A., Angermueller, C., Bahdanau, D., Ballas, N., Bastien, F., Bayer, J., Belikov, A., et al. (2016) · arXiv (Cornell University) · doi:10.4230/lipics.ecoop.2020.15 · Cited by 1,589
A theoretically grounded application of dropout in recurrent neural networks
Gal, Y., & Ghahramani, Z. (2016) · Cambridge University Engineering Department Publications Database · Cited by 1,089
Environmental sound classification with convolutional neural networks
Piczak, K. J. (2015) · 2015 IEEE 25th International Workshop on Machine Learning for Signal Processing (MLSP) · doi:10.1109/mlsp.2015.7324337 · Cited by 931
A Theoretically Grounded Application of Dropout in Recurrent Neural Networks
Gal, Y., & Ghahramani, Z. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1512.05287 · Cited by 766
Metrics for Polyphonic Sound Event Detection
Mesaros, A., Heittola, T., & Virtanen, T. (2016) · Applied Sciences · doi:10.3390/app6060162 · Cited by 579
Self-citationTUT database for acoustic scene classification and sound event detection
Mesaros, A., Heittola, T., & Virtanen, T. (2016) · 2016 24th European Signal Processing Conference (EUSIPCO) · doi:10.1109/eusipco.2016.7760424 · Cited by 517
Self-citationConvolutional recurrent neural networks for music classification
Choi, K., Fazekas, G., Sandler, M., & Cho, K. (2017) · 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2017.7952585 · Cited by 517
Learning the speech front-end with raw waveform CLDNNs
Sainath, T. N., Weiss, R. J., Senior, A., Wilson, K. W., & Vinyals, O. (2015) · Interspeech 2015 · doi:10.21437/interspeech.2015-1 · Cited by 430
Apples-to-apples in cross-validation studies: pitfalls in classifier performance measurement
Forman, G., & Scholz, M. (2010) · ACM SIGKDD Explorations Newsletter · doi:10.1145/1882471.1882479 · Cited by 368
Recurrent neural networks for polyphonic sound event detection in real life recordings
Parascandolo, G., Huttunen, H., & Virtanen, T. (2016) · 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2016.7472917 · Cited by 319
Self-citationAn End-to-End Neural Network for Polyphonic Piano Music Transcription
Sigtia, S., Benetos, E., & Dixon, S. (2016) · IEEE/ACM Transactions on Audio, Speech, and Language Processing · doi:10.1109/taslp.2016.2533858 · Cited by 280
Robust sound event recognition using convolutional neural networks
Zhang, H. S., McLoughlin, I. V., & Song, Y. (2015) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2015.7178031 · Cited by 271
Polyphonic sound event detection using multi label deep neural networks
Cakir, E., Heittola, T., Huttunen, H., & Virtanen, T. (2015) · 2015 International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2015.7280624 · Cited by 256
Self-citationAcoustic event detection in real life recordings
Mesaros, A., Heittola, T., Eronen, A., & Virtanen, T. I. (2010) · Cited by 241
Self-citationContext-dependent sound event detection
Heittola, T., Mesaros, A., Eronen, A., & Virtanen, T. (2013) · EURASIP Journal on Audio, Speech, and Music Processing · doi:10.1186/1687-4722-2013-1 · Cited by 217
Self-citationReliable detection of audio events in highly noisy environments
Foggia, P., Petkov, N., Saggese, A., Strisciuglio, N., & Vento, M. (2015) · Pattern Recognition Letters · doi:10.1016/j.patrec.2015.06.026 · Cited by 172
A flexible framework for key audio effects detection and auditory context inference
Cai, R., Lu, L., Hanjalić, A., Zhang, H.-J., & Cai, L. (2006) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/tsa.2005.857575 · Cited by 149
Recognition Of Acoustic Events Using Deep Neural Networks
Gencoglu, O., Huttunen, H. J., & Virtanen, T. I. (2014) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.5281/zenodo.43987 · Cited by 121
Self-citationSemantic context detection based on hierarchical audio models
Cheng, W.-H., Chu, W.-T., & Wu, J. (2003) · Multimedia Information Retrieval · doi:10.1145/973264.973282 · Cited by 102
Feature learning with deep scattering for urban sound analysis
Salamon, J., & Bello, J. P. (2015) · European Signal Processing Conference (EUSIPCO) · doi:10.1109/eusipco.2015.7362478 · Cited by 96
Robust Audio Event Recognition with 1-Max Pooling Convolutional Neural Networks
Phan, H., Hertel, L., Maaß, M., & Mertins, A. (2016) · Interspeech (USB) · doi:10.21437/interspeech.2016-123 · Cited by 94
Chime-home: A dataset for sound source recognition in a domestic environment
Foster, P., Sigtia, S., Krstulović, S., Barker, J., & Plumbley, M. D. (2015) · IEEE Workshop on Applications of Signal Processing to Audio and Acoustics (WASPAA) · doi:10.1109/waspaa.2015.7336899 · Cited by 89
Audio-based multimedia event detection using deep recurrent neural networks
Wang, Y., Neves, L., & Metze, F. (2016) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2016.7472176 · Cited by 73
Sound event recognition in unstructured environments using spectrogram image processing
Dennis, J. W. (2014) · DR-NTU (Nanyang Technological University) · doi:10.32657/10356/59272 · Cited by 64
Acoustic Monitoring and Localization for Social Care
Goetze, S., Schröder, J., Gerlach, S., Hollosi, D., Appell, J.-E., & Wallhoff, F. (2012) · Journal of Computing Science and Engineering · doi:10.5626/jcse.2012.6.1.40 · Cited by 52
Filterbank learning for deep neural network based polyphonic sound event detection
Çakır, E., Ozan, E. C., & Virtanen, T. I. (2016) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2016.7727634 · Cited by 41
Self-citationAcoustic event detection for multiple overlapping similar sources
Stowell, D., & Clayton, D. F. (2015) · IEEE Workshop on Applications of Signal Processing to Audio and Acoustics (WASPAA) · doi:10.1109/waspaa.2015.7336885 · Cited by 40
Cited by
Machine learning in acoustics: Theory and applications
Bianco, M. J., Gerstoft, P., Traer, J., Ozanich, E., Roch, M. A., Gannot, S., & Deledalle, C.-A. (2019) · The Journal of the Acoustical Society of America · doi:10.1121/1.5133944 · Cited by 609
Adavanne, S., Politis, A., Nikunen, J., & Virtanen, T. (2019) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2018.2885636 · Cited by 534
Self-citationComputational bioacoustics with deep learning: a review and roadmap
Stowell, D. (2022) · PeerJ · doi:10.7717/peerj.13152 · Cited by 471
FSD50K: An Open Dataset of Human-Labeled Sound Events
Fonseca, E., Favory, X., Pons, J., Font, F., & Serra, X. (2020) · arXiv · doi:10.48550/arxiv.2010.00475 · Cited by 462
“h as in different types of speech (either spoken, sung, screamed, yelled or whispered). This is interesting as CRNNs were originally proposed for speech recognition [124] before being adapted for SER [20]. Other exceptions include some human sounds and animal vocalizations of marked temporal behaviour, e.g., types of…”
BackgroundInfluentialFSD50K: An Open Dataset of Human-Labeled Sound Events
Fonseca, E., Favory, X., Pons, J., Font, F., & Serra, X. (2022) · IEEE/ACM Transactions on Audio, Speech, and Language Processing · doi:10.1109/taslp.2021.3133208 · Cited by 449
Metadata
- Authors
- Cakir, E., Parascandolo, G., Heittola, T., Huttunen, H., & Virtanen, T.
- Venue
- IEEE/ACM Transactions on Audio, Speech, and Language Processing
- Published
- 2017-06
- Volume
- 25
- Issue
- 6
- Pages
- 1291-1303
- ISSN
- 2329-9290 (ISSN-L)
- 2329-9304
- OpenAlex
- W2591013610
- Cited by
- 604
- References
- 49
- FWCI
- 53.94
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.