The DOI matches its Crossref record; 22 of the 22 references it cites were found in a registry or an index.
Metrics for Polyphonic Sound Event Detection
Open accessAbstract
This paper presents and discusses various metrics proposed for evaluation of polyphonic sound event detection systems used in realistic situations where there are typically multiple sound sources active simultaneously. The system output in this case contains overlapping events, marked as multiple sounds detected as being active at the same time. The polyphonic system output requires a suitable procedure for evaluation against a reference. Metrics from neighboring fields such as speech recognition and speaker diarization can be used, but they need to be partially redefined to deal with the overlapping events. We present a review of the most common metrics in the field and the way they are adapted and interpreted in the polyphonic case. We discuss segment-based and event-based definitions of each metric and explain the consequences of instance-based and class-based averaging using a case study. In parallel, we provide a toolbox containing implementations of presented metrics.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Machine learning in automated text categorization
Sebastiani, F. (2002) · ACM Computing Surveys · doi:10.1145/505282.505283 · Cited by 7,926
Evaluating Learning Algorithms: A Classification Perspective
Japkowicz, N., & Shah, M. (2011) · doi:10.1017/cbo9780511921803 · Cited by 767
Environmental Sound Recognition With Time–Frequency Audio Features
Chu, S., Narayanan, S., & Kuo, C.-C. J. (2009) · IEEE Transactions on Audio, Speech, and Language Processing · doi:10.1109/tasl.2009.2017438 · Cited by 639
Detection and Classification of Acoustic Scenes and Events
Stowell, D., Giannoulis, D., Benetos, E., Lagrange, M., & Plumbley, M. D. (2015) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2015.2428998 · Cited by 600
On the Stratification of Multi-label Data
Sechidis, K., Tsoumakas, G., & Vlahavas, I. (2011) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-23808-6_10 · Cited by 432
Apples-to-apples in cross-validation studies: pitfalls in classifier performance measurement
Forman, G., & Scholz, M. (2010) · ACM SIGKDD Explorations Newsletter · doi:10.1145/1882471.1882479 · Cited by 368
Events Detection for an Audio-Based Surveillance System
Clavel, C., Ehrette, T., & Richard, G. (2005) · 2005 IEEE International Conference on Multimedia and Expo · doi:10.1109/icme.2005.1521669 · Cited by 314
Robust sound event recognition using convolutional neural networks
Zhang, H. S., McLoughlin, I. V., & Song, Y. (2015) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2015.7178031 · Cited by 271
A Discriminative Model for Polyphonic Piano Transcription
Poliner, G. E., & Ellis, D. P. W. (2006) · EURASIP Journal on Advances in Signal Processing · doi:10.1155/2007/48317 · Cited by 266
Polyphonic sound event detection using multi label deep neural networks
Cakir, E., Heittola, T., Huttunen, H., & Virtanen, T. (2015) · 2015 International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2015.7280624 · Cited by 256
Self-citation
Cited by
Deep Learning for Audio Signal Processing
Purwins, H., Li, B., Virtanen, T., Schluter, J., Chang, S.-Y., & Sainath, T. (2019) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2019.2908700 · Cited by 855
Self-citationTUT database for acoustic scene classification and sound event detection
Mesaros, A., Heittola, T., & Virtanen, T. (2016) · 2016 24th European Signal Processing Conference (EUSIPCO) · doi:10.1109/eusipco.2016.7760424 · Cited by 517
Self-citationComputational bioacoustics with deep learning: a review and roadmap
Stowell, D. (2022) · PeerJ · doi:10.7717/peerj.13152 · Cited by 471
Detection and Classification of Acoustic Scenes and Events: Outcome of the DCASE 2016 Challenge
Mesaros, A., Heittola, T., Benetos, E., Foster, P., Lagrange, M., Virtanen, T., & Plumbley, M. D. (2018) · IEEE/ACM Transactions on Audio, Speech, and Language Processing · doi:10.1109/taslp.2017.2778423 · Cited by 298
Self-citationOn-Bird Sound Recordings: Automatic Acoustic Recognition of Activities and Contexts
Stowell, D., Benetos, E., & Gill, L. F. (2017) · IEEE/ACM Transactions on Audio, Speech, and Language Processing · doi:10.1109/taslp.2017.2690565 · Cited by 60
Metadata
- Authors
- Mesaros, A., Heittola, T., & Virtanen, T.
- Venue
- Applied Sciences
- Publisher
- MDPI AG
- Published
- 2016-05-25
- Volume
- 6
- Issue
- 6
- Pages
- 162
- ISSN
- 2076-3417 (ISSN-L)
- OpenAlex
- W2408239454
- Cited by
- 579
- References
- 22
- FWCI
- 56.32
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Metrics for Polyphonic Sound Event Detection. https://app.cochat.ai/papers/10.3390/app6060162
- The paper
- Mesaros, A., Heittola, T., & Virtanen, T. (2016). Metrics for Polyphonic Sound Event Detection. Applied Sciences. https://doi.org/10.3390/app6060162
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.