CoChat
Sign Up
PreprintCited by 462Music and Audio ProcessingSpeech Recognition and SynthesisMusic Technology and Sound Studies

The DOI matches its DataCite record; 1 of the 1 references it cites were found in a registry or an index.

FSD50K: An Open Dataset of Human-Labeled Sound Events

Open access
Fonseca, Eduardo, Favory, Xavier, Pons, Jordi, Font, Frederic, Serra, Xavier·2020·arXiv
DOI 10.48550/arxiv.2010.00475arXiv 2010.00475
Open this paper in CoChat — free accountOpen PDF

Abstract

Most existing datasets for sound event recognition (SER) are relatively small and/or domain-specific, with the exception of AudioSet, based on over 2M tracks from YouTube videos and encompassing over 500 sound classes. However, AudioSet is not an open dataset as its official release consists of pre-computed audio features. Downloading the original audio tracks can be problematic due to YouTube videos gradually disappearing and usage rights issues. To provide an alternative benchmark dataset and thus foster SER research, we introduce FSD50K, an open dataset containing over 51k audio clips totalling over 100h of audio manually labeled using 200 classes drawn from the AudioSet Ontology. The audio clips are licensed under Creative Commons licenses, making the dataset freely distributable (including waveforms). We provide a detailed description of the FSD50K creation process, tailored to the particularities of Freesound data, including challenges encountered and solutions adopted. We include a comprehensive dataset characterization along with discussion of limitations and key factors to allow its audio-informed usage. Finally, we conduct sound event classification experiments to provide baseline systems as well as insight on the main factors to consider when splitting Freesound audio data for SER. Our goal is to develop a dataset to be widely adopted by the community as a new open benchmark for SER research.

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.2010.00475

Cites

1 of 1 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • FSD50K only contains 4 vocal sound classes.

    “Since FSD50K only contains 4 vocal sound classes”

    From Vocalsound: A Dataset for Improving Human Vocal Sounds Recognition (2022) · cites this paper as [8]

    The Baseline Systems section (p. 15) identifies more than four FSD50K classes involving human vocal sounds: it distinguishes spoken, sung, screamed, yelled, and whispered speech, and also names laughter, gasping, and crying classes. The paper therefore contradicts the claim that FSD50K contains only four vocal sound classes. (LLM, conf=0.85)

    Checked by a reasoning model — may be wrong.

    Experimental — accuracy not yet measured

  • Existing datasets for human vocal sounds have a relatively small number of vocal sound samples or noisy labels.

    “However, existing datasets have a relatively small number of vocal sound samples or noisy labels.”

    From Vocalsound: A Dataset for Improving Human Vocal Sounds Recognition (2022) · cites this paper as [8]

    The Design Criteria section (p. 3) describes a trade-off between small, exhaustively labeled sound-event datasets and larger datasets with less precise labels. The AudioSet discussion (p. 2) also reports substantial labeling error. These passages support the general dataset-size and label-noise point, but they do not establish that existing datasets specifically have few human vocal-sound samples. (LLM, conf=0.86)

    Experimental — accuracy not yet measured

  • AudioSet and FSD50K are class imbalanced and have a relatively small number of vocal sound samples.

    “While AudioSet and FSD50K consist of a large number of audio samples, they are class imbalanced and have a relatively small number of vocal sound samples”

    From Vocalsound: A Dataset for Improving Human Vocal Sounds Recognition (2022) · cites this paper as [8]

    The AudioSet discussion (p. 2) calls AudioSet highly imbalanced, and the FSD50K limitations (p. 12) describe class imbalance in FSD50K. The paper does not establish that either dataset has relatively few vocal-sound samples; indeed, it names Speech as a particularly common AudioSet class. (LLM, conf=0.88)

    Experimental — accuracy not yet measured

  • The FSD50K evaluation set has more accurate labels while AudioSet labels are relatively noisy.

    “The reason why we use FSD50K rather than AudioSet as the base dataset is because FSD50K, especially its evaluation set, has more accurate labels [8] while labels of AudioSet are relatively noisy [6, 9, 10].”

    From Vocalsound: A Dataset for Improving Human Vocal Sounds Recognition (2022) · cites this paper as [8]

  • FSD50K consists of 51K audio clips distributed in 200 sound classes.

    “The FSD50K consists of 51K audio clips distributed in 200 sound classes”

    From Vocalsound: A Dataset for Improving Human Vocal Sounds Recognition (2022) · cites this paper as [8]

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Part of this paper’s reference list could not be split into single entries.

Flagged first, then by citations

Research works printed but not linked: 121

  1. [1][1] T. Drugman, J. Urbain, N. Bauwens, R. Chessini, A.-S. Aubriot, P. Lebecque, and T. Dutoit, 'Audio and contact microphones for cough detection,' in Thirteenth Annual Conference of the International Speech Communication Association , 2012. -
  2. [2][2] A. H¨ uwel, K. Adilo˘ glu, and J.-H. Bach, 'Hearing aid research data set for acoustic environment recognition,' in 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) . IEEE, 2020, pp. 706-710. -
  3. [4][4] J. P. Bello, C. Silva, O. Nov, R. L. DuBois, A. Arora, J. Salamon, C. Mydlarz, and H. Doraiswamy, 'SONYC: A system for monitoring, analyzing, and mitigating urban noise pollution,' Communications of the ACM , vol. 62, no. 2, pp. 68-77, 2019. -
  4. [5][5] J. Cramer, V. Lostanlen, A. Farnsworth, J. Salamon, and J. P. Bello, 'Chirping up the right tree: Incorporating biological taxonomies into deep bioacoustic classifiers,' in 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) . IEEE, 2020, pp. 901-905. -
  5. [6][6] V. Lostanlen, J. Salamon, A. Farnsworth, S. Kelling, and J. P. Bello, 'Robust sound event detection in bioacoustic sensor networks,' PloS one , vol. 14, no. 10, p. e0214168, 2019. -
  6. [7][7] K. Xu, H. Cai, X. Liu, Z. Gao, and B. Zhang, 'North Atlantic Right Whale call detection with very deep convolutional neural networks,' The Journal of the Acoustical Society of America , vol. 141, no. 5, pp. 3944-3945, 2017. -
  7. [8][8] Y. Wang, L. Neves, and F. Metze, 'Audio-based multimedia event detection using deep recurrent neural networks,' in 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) . IEEE, 2016, pp. 2742-2746. -
  8. [9][9] A. Jansen, J. F. Gemmeke, D. P. W. Ellis, X. Liu, W. Lawrence, and D. Freedman, 'Large-scale audio event discovery in one million YouTube videos,' in 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) . IEEE, 2017, pp. 786-790. -
  9. [10][10] M. Crocco, M. Cristani, A. Trucco, and V. Murino, 'Audio surveillance: A systematic review,' ACM Computing Surveys (CSUR) , vol. 48, no. 4, pp. 1-46, 2016. -
  10. [11][11] H. A. S´ anchez-Hevia, D. Ayll´ on, R. Gil-Pita, and M. Rosa-Zurera, 'Maximum likelihood decision fusion for weapon classification in wireless acoustic sensor networks,' IEEE/ACM Transactions on Audio, Speech, and Language Processing , vol. 25, no. 6, pp. 1172-1182, 2017. -
  11. [12][12] M. Morrison and B. Pardo, 'OtoMechanic: Auditory automobile diagnostics via query-by-example,' in Proceedings of the Detection and Classification of Acoustic Scenes and Events 2019 Workshop (DCASE2019) , New York University, NY, USA, October 2019, pp. 169-173. -
  12. [13][13] A. Mesaros, T. Heittola, E. Benetos, P. Foster, M. Lagrange, T. Virtanen, and M. D. Plumbley, 'Detection and classification of acoustic scenes and events: Outcome of the DCASE 2016 challenge,' IEEE/ACM Transactions on Audio, Speech, and Language Processing , vol. 26, no. 2, pp. 379-393, 2017. -
  13. [14][14] P. Foggia, N. Petkov, A. Saggese, N. Strisciuglio, and M. Vento, 'Reliable detection of audio events in highly noisy environments,' Pattern Recognition Letters , vol. 65, pp. 22-28, 2015. -
  14. [15][15] A. Mesaros, T. Heittola, A. Eronen, and T. Virtanen, 'Acoustic event detection in real life recordings,' in 2010 18th European Signal Processing Conference . IEEE, 2010, pp. 1267-1271. -
  15. [16][16] C. V. Cotton and D. P. W. Ellis, 'Spectral vs. spectro-temporal features for acoustic event detection,' in 2011 IEEE Workshop on Applications of Signal Processing to Audio and Acoustics (WASPAA) . IEEE, 2011, pp. 69-72. -
  16. [17][17] E. Cakir, T. Heittola, H. Huttunen, and T. Virtanen, 'Polyphonic sound event detection using multi label deep neural networks,' in 2015 International Joint Conference on Neural Networks (IJCNN) . IEEE, 2015, pp. 1-7. -
  17. [18][18] K. J. Piczak, 'Environmental sound classification with convolutional neural networks,' in 2015 IEEE 25th International Workshop on Machine Learning for Signal Processing (MLSP) . IEEE, 2015, pp. 1-6. -
  18. [19][19] G. Parascandolo, H. Huttunen, and T. Virtanen, 'Recurrent neural networks for polyphonic sound event detection in real life recordings,' in 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) . IEEE, 2016, pp. 6440-6444. -
  19. [20][20] E. Cakır, G. Parascandolo, T. Heittola, H. Huttunen, and T. Virtanen, 'Convolutional recurrent neural networks for polyphonic sound event detection,' IEEE/ACM Transactions on Audio, Speech, and Language Processing , vol. 25, no. 6, pp. 1291-1303, 2017. -
  20. [21][21] P. Foster, S. Sigtia, S. Krstulovic, J. Barker, and M. D. Plumbley, 'CHiME-home: A dataset for sound source recognition in a domestic environment,' in 2015 IEEE Workshop on Applications of Signal Processing to Audio and Acoustics (WASPAA) . IEEE, 2015. -
  21. [22][22] K. J. Piczak, 'ESC: Dataset for environmental sound classification,' in Proceedings of the ACM International Conference on Multimedia . ACM, 2015, pp. 1015-1018. -
  22. [23][23] A. Mesaros, T. Heittola, and T. Virtanen, 'TUT database for acoustic scene classification and sound event detection,' in 24th European Signal Processing Conference 2016 (EUSIPCO 2016) , Budapest, Hungary, 2016. -
  23. [24][24] C. Sun, A. Shrivastava, S. Singh, and A. Gupta, 'Revisiting unreasonable effectiveness of data in deep learning era,' in Proceedings of the IEEE International Conference on Computer Vision , 2017, pp. 843852. -
  24. [25][25] O. Russakovsky, J. Deng, H. Su, J. Krause, S. Satheesh, S. Ma, Z. Huang, A. Karpathy, A. Khosla, M. Bernstein et al. , 'ImageNet large scale visual recognition challenge,' International Journal of Computer Vision , vol. 115, no. 3, pp. 211-252, 2015. -
  25. [26][26] J. F. Gemmeke, D. P. W. Ellis, D. Freedman, A. Jansen, W. Lawrence, R. C. Moore, M. Plakal, and M. Ritter, 'Audio Set: An ontology and human-labeled dataset for audio events,' in 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) , New Orleans, LA, 2017. -
  26. [27][27] M. Cartwright, A. E. M. Mendez, J. Cramer, V. Lostanlen, G. Dove, H.-H. Wu, J. Salamon, O. Nov, and J. Bello, 'SONYC urban sound tagging (SONYC-UST): A multilabel dataset from an urban acoustic sensor network,' in Proceedings of the Workshop on Detection and Classification of Acoustic Scenes and Events (DCASE) , October 2019, pp. 35-39. -
  27. [28][28] N. Turpault, R. Serizel, J. Salamon, and A. P. Shah, 'Sound event detection in domestic environments with weakly labeled data and soundscape synthesis,' in Proceedings of the Detection and Classification of Acoustic Scenes and Events 2019 Workshop (DCASE2019) , New York University, NY, USA, October 2019, pp. 253-257. -
  28. [29][29] S. Adavanne, A. Politis, and T. Virtanen, 'A multi-room reverberant dataset for sound event localization and detection,' in Proceedings of the Detection and Classification of Acoustic Scenes and Events 2019 Workshop (DCASE2019) , New York University, NY, USA, October 2019, pp. 10-14. -
  29. [30][30] S. Gharib, K. Drossos, E. Fagerlund, and T. Virtanen, 'VOICe: A sound event detection dataset for generalizable domain adaptation,' arXiv preprint arXiv:1911.07098 , 2019. - · arXiv
  30. [31][31] G. Dekkers, S. Lauwereins, B. Thoen, M. W. Adhana, H. Brouckxon, T. van Waterschoot, B. Vanrumste, M. Verhelst, and P. Karsmakers, 'The SINS database for detection of daily activities in a home environment using an acoustic sensor network,' in Proceedings of the Detection and Classification of Acoustic Scenes and Events 2017 Workshop (DCASE2017) , November 2017, pp. 32-36. -
  31. [32][32] E. Fonseca, M. Plakal, D. P. W. Ellis, F. Font, X. Favory, and X. Serra, 'Learning sound event classifiers from web audio with noisy labels,' in 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) , 2019. -
  32. [33][33] E. Fonseca, M. Plakal, F. Font, D. P. W. Ellis, and X. Serra, 'Audio tagging with noisy labels and minimal supervision,' in Proceedings of the Detection and Classification of Acoustic Scenes and Events 2019 Workshop (DCASE2019) , NY, USA, 2019. -
  33. [34][34] M. Cartwright, J. Cramer, A. E. Mendez Mendez, Y. Wang, H.-H. Wu, V. Lostanlen, M. Fuentes, G. Dove, C. Mydlarz, J. Salamon, O. Nov, and J. P. Bello, 'SONYC-UST-V2: An urban sound tagging dataset with spatiotemporal context,' in Proceedings of the Detection and Classification of Acoustic Scenes and Events 2020 Workshop (DCASE2020) , Tokyo, Japan, November 2020, pp. 16-20. -
  34. [35][35] T.-Y. Lin, M. Maire, S. Belongie, J. Hays, P. Perona, D. Ramanan, P. Doll´ ar, and C. L. Zitnick, 'Microsoft COCO: Common objects in context,' in European Conference on Computer Vision . Springer, 2014, pp. 740-755. -
  35. [36][36] W. Li, L. Wang, W. Li, E. Agustsson, and L. Van Gool, 'WebVision database: Visual learning and understanding from web data,' arXiv preprint arXiv:1708.02862 , 2017. - · arXiv
  36. [37][37] A. Kuznetsova, H. Rom, N. Alldrin, J. Uijlings, I. Krasin, J. PontTuset, S. Kamali, S. Popov, M. Malloci, A. Kolesnikov et al. , 'The Open Images dataset V4: Unified image classification, object detection, - and visual relationship detection at scale,' International Journal of Computer Vision , vol. 128, no. 7, pp. 1956-1981, 2020. -
  37. [38][38] B. McFee, J. W. Kim, M. Cartwright, J. Salamon, R. M. Bittner, and J. P. Bello, 'Open-source practices for music signal processing research: Recommendations for transparent, sustainable, and reproducible audio research,' IEEE Signal Processing Magazine , vol. 36, no. 1, pp. 128-137, 2018. -
  38. [39][39] J. Salamon, C. Jacoby, and J. P. Bello, 'A dataset and taxonomy for urban sound research,' in Proceedings of the ACM International Conference on Multimedia . ACM, 2014, pp. 1041-1044. -
  39. [40][40] S. Hershey, D. P. W. Ellis, E. Fonseca, A. Jansen, C. Liu, R. C. Moore, and M. Plakal, 'The benefit of temporally-strong labels in audio event classification,' in 2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) , 2021. -
  40. [41][41] H. Chen, W. Xie, A. Vedaldi, and A. Zisserman, 'VGGSound: A largescale audio-visual dataset,' in 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) . IEEE, 2020, pp. 721-725. -
  41. [42][42] E. Fonseca, S. Hershey, M. Plakal, D. P. W. Ellis, A. Jansen, and R. C. Moore, 'Addressing missing labels in large-scale sound event recognition using a teacher-student framework with loss masking,' IEEE Signal Processing Letters , vol. 27, pp. 1235-1239, 2020. -
  42. [43][43] B. McFee, J. Salamon, and J. P. Bello, 'Adaptive pooling operators for weakly labeled sound event detection,' IEEE/ACM Transactions on Audio, Speech, and Language Processing , vol. 26, no. 11, pp. 21802193, 2018. -
  43. [44][44] B. Barz and J. Denzler, 'Do we train on test data? purging CIFAR of near-duplicates,' Journal of Imaging , vol. 6, no. 6, p. 41, 2020. -
  44. [46][46] B. Recht, R. Roelofs, L. Schmidt, and V. Shankar, 'Do ImageNet classifiers generalize to ImageNet?' in International Conference on Machine Learning . PMLR, 2019, pp. 5389-5400. -
  45. [47][47] L. Beyer, O. J. H´ enaff, A. Kolesnikov, X. Zhai, and A. v. d. Oord, 'Are we done with ImageNet?' arXiv preprint arXiv:2006.07159 , 2020. - · arXiv
  46. [48][48] J. Deng, W. Dong, R. Socher, L.-J. Li, K. Li, and L. Fei-Fei, 'ImageNet: A large-scale hierarchical image database,' in 2009 IEEE Conference on Computer Vision and Pattern Recognition . IEEE, 2009, pp. 248-255. -
  47. [49][49] E. Fonseca, D. Ortego, K. McGuinness, N. E. O'Connor, and X. Serra, 'Unsupervised contrastive learning of sound event representations,' in 2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) , 2021. -
  48. [50][50] E. Fonseca, A. Jansen, D. P. W. Ellis, S. Wisdom, M. Tagliasacchi, J. R. Hershey, M. Plakal, S. Hershey, R. C. Moore, and X. Serra, 'Self-supervised learning from automatically separated sound scenes,' in IEEE Workshop on Applications of Signal Processing to Audio and Acoustics (WASPAA) , 2021. -
  49. [51][51] A. Jansen, M. Plakal, R. Pandya, D. P. W. Ellis, S. Hershey, J. Liu, R. C. Moore, and R. A. Saurous, 'Unsupervised learning of semantic audio representations,' in 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) . IEEE, 2018, pp. 126-130. -
  50. [52][52] W. Han, E. Coutinho, H. Ruan, H. Li, B. Schuller, X. Yu, and X. Zhu, 'Semi-supervised active learning for sound classification in hybrid learning environments,' PloS one , vol. 11, no. 9, p. e0162075, 2016. -
  51. [53][53] Y. Wang, A. E. M. Mendez, M. Cartwright, and J. P. Bello, 'Active learning for efficient audio annotation and classification with a large amount of unlabeled data,' in 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) . IEEE, 2019, pp. 880-884. -
  52. [54][54] Z. Shuyang, T. Heittola, and T. Virtanen, 'An active learning method using clustering and committee-based sample selection for sound event classification,' in 2018 16th International Workshop on Acoustic Signal Enhancement (IWAENC) . IEEE, 2018, pp. 116-120. -
  53. [55][55] --, 'Active learning for sound event detection,' IEEE/ACM Transactions on Audio, Speech, and Language Processing , vol. 28, pp. 28952905, 2020. -
  54. [56][56] F. Font, G. Roma, and X. Serra, 'Freesound technical demo,' in Proceedings of the 21st ACM International Conference on Multimedia . ACM, 2013, pp. 411-412. -
  55. [57][57] D. Stowell and M. Plumbley, 'An open dataset for research on audio field recording archives: freefield1010,' in Audio Engineering Society Conference: 53rd International Conference: Semantic Audio . Audio Engineering Society, 2014. -
  56. [58][58] E. Fonseca, M. Plakal, F. Font, D. P. W. Ellis, X. Favory, J. Pons, and X. Serra, 'General-purpose tagging of Freesound audio with AudioSet labels: task description, dataset, and baseline,' in Proceedings of the - Detection and Classification of Acoustic Scenes and Events 2018 Workshop (DCASE2018) , 2018. -
  57. [59][59] E. Fonseca, J. Pons, X. Favory, F. Font, D. Bogdanov, A. Ferraro, S. Oramas, A. Porter, and X. Serra, 'Freesound Datasets: a platform for the creation of open audio datasets,' in Proceedings of the 18th International Society for Music Information Retrieval Conference (ISMIR 2017) , Suzhou, China, 2017, pp. 486-493. -
  58. [61][61] R. Serizel, N. Turpault, A. Shah, and J. Salamon, 'Sound event detection in synthetic domestic environments,' in 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) . IEEE, 2020, pp. 86-90. -
  59. [62][62] D. Hendrycks, K. Zhao, S. Basart, J. Steinhardt, and D. Song, 'Natural adversarial examples,' in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , 2021, pp. 15 262-15 271. -
  60. [63][63] S. Wisdom, H. Erdogan, D. P. Ellis, R. Serizel, N. Turpault, E. Fonseca, J. Salamon, P. Seetharaman, and J. R. Hershey, 'What's all the FUSS about free universal sound separation data?' in 2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) . IEEE, 2021, pp. 186-190. -
  61. [64][64] M. Cartwright, A. Seals, J. Salamon, A. Williams, S. Mikloska, D. MacConnell, E. Law, J. P. Bello, and O. Nov, 'Seeing sound: Investigating the effects of visualizations and complexity on crowdsourced audio annotations,' Proceedings of the ACM on Human-Computer Interaction , vol. 1, no. CSCW, pp. 1-21, 2017. -
  62. [66][66] M. Sabou, K. Bontcheva, L. Derczynski, and A. Scharl, 'Corpus annotation through crowdsourcing: Towards best practice guidelines.' in LREC , 2014, pp. 859-866. -
  63. [67][67] M. Meire, P. Karsmakers, and L. Vuegen, 'The impact of missing labels and overlapping sound events on multi-label multi-instance learning for sound event classification,' in Proceedings of the Detection and Classification of Acoustic Scenes and Events 2019 Workshop (DCASE2019) , NY, USA, 2019. -
  64. [68][68] T. Virtanen, M. D. Plumbley, and D. P. W. Ellis, Computational Analysis of Sound Scenes and Events . Springer, 2018. -
  65. [69][69] B. Whitman, G. Flake, and S. Lawrence, 'Artist detection in music with minnowmatch,' in Neural Networks for Signal Processing XI: Proceedings of the 2001 IEEE Signal Processing Society Workshop (IEEE Cat. No. 01TH8584) . IEEE, 2001, pp. 559-568. -
  66. [70][70] M. I. Mandel and D. P. W. Ellis, 'Song-level features and support vector machines for music classification,' in Proceedings of the International Society for Music Information Retrieval Conference (ISMIR 2005) , 2005. -
  67. [71][71] A. Flexer and D. Schnitzer, 'Album and artist effects for audio similarity at the scale of the web,' Children , vol. 15, no. 15.95, pp. 4-07, 2009. -
  68. [72][72] K. Sechidis, G. Tsoumakas, and I. Vlahavas, 'On the stratification of multi-label data,' in Joint European Conference on Machine Learning and Knowledge Discovery in Databases . Springer, 2011, pp. 145-158. -
  69. [73][73] P. Toth and S. Martello, Knapsack Problems: Algorithms and Computer Implementations . Wiley, 1990. -
  70. [74][74] X. Favory, E. Fonseca, F. Font, and X. Serra, 'Facilitating the manual annotation of sounds when using large taxonomies,' in Proceedings of the 23rd Conference of Open Innovations Association, FRUCT , no. 23. FRUCT Oy, 2018, pp. 447-451. -
  71. [75][75] K.-H. Cheng, S.-Y. Chou, and Y.-H. Yang, 'Multi-label few-shot learning for sound event recognition,' in 2019 IEEE 21st International Workshop on Multimedia Signal Processing (MMSP) . IEEE, 2019, pp. 1-5. -
  72. [76][76] J. Salamon, D. MacConnell, M. Cartwright, P. Li, and J. P. Bello, 'Scaper: A library for soundscape synthesis and augmentation,' in 2017 IEEE Workshop on Applications of Signal Processing to Audio and Acoustics (WASPAA) . IEEE, 2017, pp. 344-348. -
  73. [77][77] A. Shah, A. Kumar, A. G. Hauptmann, and B. Raj, 'A closer look at weak label learning for audio events,' CoRR , vol. abs/1804.09288, 2018. - · arXiv
  74. [78][78] N. Turpault, R. Serizel, and E. Vincent, 'Limitations of weak labels for embedding and tagging,' in 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) . IEEE, 2020, pp. 131-135. -
  75. [79][79] V. Morfi and D. Stowell, 'Data-efficient weakly supervised learning for low-resource audio event detection using deep learning,' in Pro- - ceedings of the Detection and Classification of Acoustic Scenes and Events 2018 Workshop (DCASE2018) . -
  76. [80][80] G. Lafay, E. Benetos, and M. Lagrange, 'Sound event detection in synthetic audio: Analysis of the DCASE 2016 task results,' in 2017 IEEE Workshop on Applications of Signal Processing to Audio and Acoustics (WASPAA) , Oct 2017, pp. 11-15. -
  77. [81][81] A. Mesaros, T. Heittola, A. Diment, B. Elizalde, A. Shah, E. Vincent, B. Raj, and T. Virtanen, 'DCASE 2017 Challenge Setup: Tasks, datasets and baseline system,' in Proceedings of the Detection and Classification of Acoustic Scenes and Events 2017 Workshop (DCASE2017) , November 2017, pp. 85-92. -
  78. [82][82] L. Malfait, J. Berger, and M. Kastner, 'P.563-The ITU-T standard for single-ended speech quality assessment,' IEEE Transactions on Audio, Speech, and Language Processing , vol. 14, no. 6, pp. 1924-1934, 2006. -
  79. [83][83] J. Salamon and J. P. Bello, 'Deep convolutional neural networks and data augmentation for environmental sound classification,' IEEE Signal Processing Letters , vol. 24, no. 3, pp. 279-283, 2017. -
  80. [84][84] J. Li, M. L. Seltzer, X. Wang, R. Zhao, and Y. Gong, 'Largescale domain adaptation via teacher-student learning,' arXiv preprint arXiv:1708.05466 , 2017. - · arXiv
  81. [85][85] C. Northcutt, L. Jiang, and I. Chuang, 'Confident learning: Estimating uncertainty in dataset labels,' Journal of Artificial Intelligence Research , vol. 70, pp. 1373-1411, 2021. -
  82. [86][86] H. Lei, J. Choi, A. Janin, and G. Friedland, 'User verification: Matching the uploaders of videos across accounts,' in 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) . IEEE, 2011, pp. 2404-2407. -
  83. [87][87] E. Fonseca, A. Ferraro, and X. Serra, 'Improving sound event classification by increasing shift invariance in convolutional neural networks,' arXiv preprint arXiv:2107.00623 , 2021. - · arXiv
  84. [88][88] E. Cakir, E. C. Ozan, and T. Virtanen, 'Filterbank learning for deep neural network based polyphonic sound event detection,' in 2016 International Joint Conference on Neural Networks (IJCNN) . IEEE, 2016, pp. 3399-3406. -
  85. [89][89] H. Park and C. D. Yoo, 'CNN-based learnable gammatone filterbank and equal-loudness normalization for environmental sound classification,' IEEE Signal Processing Letters , vol. 27, pp. 411-415, 2020. -
  86. [90][90] E. Fonseca, F. Font, and X. Serra, 'Model-agnostic approaches to handling noisy labels when training sound event classifiers,' in 2019 IEEE Workshop on Applications of Signal Processing to Audio and Acoustics (WASPAA) . IEEE, 2019, pp. 16-20. -
  87. [91][91] B. Elizalde, S. Zarar, and B. Raj, 'Cross modal audio search and retrieval with joint embeddings based on text and audio,' in 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) . IEEE, 2019, pp. 4095-4099. -
  88. [92][92] X. Favory, K. Drossos, T. Virtanen, and X. Serra, 'COALA: CoAligned autoencoders for learning semantically enriched audio representations,' in Workshop on Self-supervision in Audio and Speech at the 37th International Conference on Machine Learning , 2020. -
  89. [93][93] H. Shrivaslava, Y. Yin, R. R. Shah, and R. Zimmermann, 'MtGcn for multi-label audio tagging with noisy labels,' in 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) . IEEE, 2020, pp. 136-140. -
  90. [94][94] A. Jati, N. Kumar, R. Chen, and P. Georgiou, 'Hierarchy-aware loss function on a tree structured label space for audio event detection,' in 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) . IEEE, 2019, pp. 6-10. -
  91. [95][95] A. Kumar and B. Raj, 'Audio event and scene recognition: A unified approach using strongly and weakly labeled data,' in 2017 International Joint Conference on Neural Networks (IJCNN) . IEEE, 2017, pp. 3475-3482. -
  92. [96][96] S. Gharib, K. Drossos, E. Cakir, D. Serdyuk, and T. Virtanen, 'Unsupervised adversarial domain adaptation for acoustic scene classification,' in Proceedings of the Detection and Classification of Acoustic Scenes and Events 2018 Workshop (DCASE2018) , November 2018, pp. 138-142. -
  93. [97][97] D. Bogdanov, A. Porter, H. Boyer, X. Serra et al. , 'Cross-collection evaluation for music classification tasks,' in Proceedings of the 17th International Society for Music Information Retrieval Conference (ISMIR) . ISMIR, 2016. -
  94. [98][98] X. Favory, F. Font, and X. Serra, 'Search result clustering in collaborative sound collections,' in Proceedings of the 2020 International Conference on Multimedia Retrieval , 2020, pp. 207-214. -
  95. [99][99] I. Kavalerov, S. Wisdom, H. Erdogan, B. Patton, K. Wilson, J. Le Roux, and J. R. Hershey, 'Universal sound separation,' in 2019 IEEE Workshop on Applications of Signal Processing to Audio and Acoustics (WASPAA) , October 2019, pp. 175-179. -
  96. [100][100] J. Abeßer, 'USM-SED: A dataset for polyphonic sound event detection in urban sound monitoring scenarios,' arXiv preprint arXiv:2105.02592 , 2021. - · arXiv
  97. [101][101] N. Turpault, S. Wisdom, H. Erdogan, J. R. Hershey, R. Serizel, E. Fonseca, P. Seetharaman, and J. Salamon, 'Improving sound event detection in domestic environments using sound separation,' in Proceedings of the Detection and Classification of Acoustic Scenes and Events 2020 Workshop (DCASE2020) , Tokyo, Japan, November 2020, pp. 205-209. -
  98. [102][102] D. A. Van Leeuwen and N. Br¨ ummer, 'An introduction to applicationindependent evaluation of speaker recognition systems,' in Speaker classification I . Springer, 2007, pp. 330-353. -
  99. [103][103] C ¸ . Bilen, G. Ferroni, F. Tuveri, J. Azcarreta, and S. Krstulovi´ c, 'A framework for the robust evaluation of sound event detection,' in 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) . IEEE, 2020, pp. 61-65. -
  100. [104][104] S. Hershey, S. Chaudhuri, D. P. Ellis, J. F. Gemmeke, A. Jansen, R. C. Moore, M. Plakal, D. Platt, R. A. Saurous, B. Seybold et al. , 'CNN architectures for large-scale audio classification,' in 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) . IEEE, 2017, pp. 131-135. -
  101. [108][108] D. M. Green, J. A. Swets et al. , Signal Detection Theory and Psychophysics . Wiley New York, 1966, vol. 1. -
  102. [110][110] D. P. Kingma and J. Ba, 'Adam: A method for stochastic optimization,' in 3rd International Conference on Learning Representations, ICLR , 2015. -
  103. [111][111] J. Davis and M. Goadrich, 'The relationship between Precision-Recall and ROC curves,' in Proceedings of the 23rd International Conference on Machine Learning , 2006, pp. 233-240. -
  104. [112][112] Q. Kong, Y. Cao, T. Iqbal, Y. Wang, W. Wang, and M. D. Plumbley, 'PANNs: Large-scale pretrained audio neural networks for audio pattern recognition,' IEEE/ACM Transactions on Audio, Speech, and Language Processing , vol. 28, pp. 2880-2894, 2020. -
  105. [113][113] E. Fonseca, R. Gong, D. Bogdanov, O. Slizovskaia, E. G´ omez, and X. Serra, 'Acoustic scene classification by ensembling gradient boosting machine and convolutional neural networks,' in Proceedings of the Detection and Classification of Acoustic Scenes and Events 2017 Workshop (DCASE2017) , November 2017, pp. 37-41. -
  106. [114][114] E. Fonseca, R. Gong, and X. Serra, 'A simple fusion of deep and shallow learning for acoustic scene classification,' in Proceedings of the 15th Sound and Music Computing Conference , Limassol, Cyprus, 2018. -
  107. [115][115] A. P´ erez-L´ opez, E. Fonseca, and X. Serra, 'A hybrid parametricdeep learning approach for sound event localization and detection,' in Proceedings of the Detection and Classification of Acoustic Scenes and Events 2019 Workshop (DCASE2019) , New York University, NY, USA, October 2019, pp. 189-193. -
  108. [116][116] J. Ebbers and R. H¨ ab-Umbach, 'Convolutional recurrent neural network and data augmentation for audio tagging with noisy labels and minimal supervision,' in Proceedings of the Detection and Classification of Acoustic Scenes and Events 2019 Workshop (DCASE2019) , New York University, NY, USA, October 2019, pp. 64-68. -
  109. [117][117] S. Ioffe and C. Szegedy, 'Batch normalization: Accelerating deep network training by reducing internal covariate shift,' in Proceedings of the 32nd International Conference on Machine Learning , 2015, pp. 448-456. -
  110. [118][118] M. Dorfer and G. Widmer, 'Training general-purpose audio tagging networks with noisy labels and iterative self-verification,' in Proceedings of the Detection and Classification of Acoustic Scenes and Events 2018 Workshop (DCASE2018) , 2018, pp. 178-182. -
  111. [119][119] B. Kim and B. Pardo, 'Sound event detection using point-labeled data,' in 2019 IEEE Workshop on Applications of Signal Processing to Audio and Acoustics (WASPAA) . IEEE, 2019. -
  112. [120][120] K. Simonyan and A. Zisserman, 'Very deep convolutional networks for large-scale image recognition,' in 3rd International Conference on Learning Representations, ICLR , 2015. -
  113. [121][121] K. He, X. Zhang, S. Ren, and J. Sun, 'Deep residual learning for image recognition,' in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition , 2016, pp. 770-778. -
  114. [122][122] G. Huang, Z. Liu, L. Van Der Maaten, and K. Q. Weinberger, 'Densely connected convolutional networks,' in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition , 2017, pp. 4700-4708. -
  115. [123][123] T. Iqbal, Y. Cao, Q. Kong, M. D. Plumbley, and W. Wang, 'Learning with out-of-distribution data for audio classification,' in 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) . IEEE, 2020, pp. 636-640. -
  116. [124][124] M. Won, A. Ferraro, D. Bogdanov, and X. Serra, 'Evaluation of CNNbased automatic music tagging models,' in Proceedings of the 17th Sound and Music Computing Conference , 2020. -
  117. [125][125] L. Ford, H. Tang, F. Grondin, and J. Glass, 'A deep residual network for large-scale acoustic scene analysis,' Proceedings of Interspeech 2019 , pp. 2568-2572, 2019. -
  118. [126][126] T. N. Sainath, O. Vinyals, A. Senior, and H. Sak, 'Convolutional, long short-term memory, fully connected deep neural networks,' in 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) . IEEE, 2015, pp. 4580-4584. -
  119. [127][127] H. Liu and H. Motoda, 'On issues of instance selection,' Data Mining and Knowledge Discovery , vol. 6, no. 2, p. 115, 2002. -
  120. [128][128] S. G. Jantzen, B. J. Sutherland, D. R. Minkley, and B. F. Koop, 'Go trimming: Systematically reducing redundancy in large gene ontology datasets,' BMC research notes , vol. 4, no. 1, p. 267, 2011. -
  121. [129][129] A. Mesaros, T. Heittola, and T. Virtanen, 'A multi-device dataset for urban acoustic scene classification,' in Proceedings of the Detection and Classification of Acoustic Scenes and Events 2018 Workshop (DCASE2018) , November 2018, pp. 9-13. -

Cited by

Sorted by citations

Metadata

Authors
Fonseca, E., Favory, X., Pons, J., Font, F., & Serra, X.
Affiliations
Universitat Pompeu Fabra (ES)
ORCID
Venue
arXiv
Publisher
arXiv
Published
2020
Volume
30
Pages
829-852
ISSN
2329-9290 (ISSN-L)
DOI
10.48550/arxiv.2010.00475
arXiv
2010.00475
OpenAlex
W3090388844
Cited by
462
References
1
Citations by year
2026: 74 · 2025: 118 · 2024: 92 · 2023: 84 · 2022: 53 · 2021: 37 · 2020: 4
FWCI
31.06
Type
journal article
Language
en
Open access
Licence
creativecommons.org/licenses/by/4.0/legalcode
Locations
  • IEEE/ACM Transactions on Audio Speech and Language Processing (publishedVersion)
  • arXiv (Cornell University) (acceptedVersion)
  • arXiv (Cornell University) (submittedVersion)
  • Repositori digital de la UPF (Universitat Pompeu Fabra) (submittedVersion)
  • arXiv (Cornell University) (cc-by)
Funders
  • Google
  • Nvidia
  • European Commission (688382)
  • Horizon 2020 Framework Programme (688382)
Topics
  • Physical Sciences › Computer Science › Signal Processing › Music and Audio Processing
  • Physical Sciences › Computer Science › Artificial Intelligence › Speech Recognition and Synthesis
  • Social Sciences › Arts and Humanities › Music › Music Technology and Sound Studies
Keywords
sound event recognition, Freesound, AudioSet, Creative Commons licenses, dataset construction

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review