The DOI matches its Crossref record; 15 of the 15 references it cites were found in a registry or an index.
Semantic Annotation and Retrieval of Music and Sound Effects
Abstract
We present a computer audition system that can both annotate novel audio tracks with semantically meaningful words and retrieve relevant tracks from a database of unlabeled audio content given a text-based query. We consider the related tasks of content-based audio annotation and retrieval as one supervised multiclass, multilabel problem in which we model the joint probability of acoustic features and words. We collect a data set of 1700 human-generated annotations that describe 500 Western popular music tracks. For each word in a vocabulary, we use this data to train a Gaussian mixture model (GMM) over an audio feature space. We estimate the parameters of the model using the weighted mixture hierarchies expectation maximization algorithm. This algorithm is more scalable to large data sets and produces better density estimates than standard parameter estimation techniques. The quality of the music annotations produced by our system is comparable with the performance of humans on the same task. Our ldquoquery-by-textrdquo system can retrieve appropriate songs for a large number of musically relevant words. We also show that our audition system is general by learning a model that can annotate and retrieve sound effects.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Fundamentals of speech recognition
Rabiner, L. R., & Juang, B.-H. F. (1993) · Cited by 7,680
Speaker Verification Using Adapted Gaussian Mixture Models
Reynolds, D. A., Quatieri, T. F., & Dunn, R. B. (2000) · Digital Signal Processing · doi:10.1006/dspr.1999.0361 · Cited by 4,268
Blei, D. M., & Jordan, M. I. (2003) · Proceedings of the 26th annual international ACM SIGIR conference on Research and development in informaion retrieval · doi:10.1145/860435.860460 · Cited by 1,054
Blei, D. M., & Jordan, M. I. (2003) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/860458.860460 · Cited by 359
A Large-Scale Evaluation of Acoustic and Subjective Music-Similarity Measures
Berenzweig, A., Logan, B., Ellis, D. P. W., & Whitman, B. (2004) · Computer Music Journal · doi:10.1162/014892604323112257 · Cited by 289
Forsyth, D. A., & Fleck, M. M. (2002) · Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.1997.609399 · Cited by 173
Towards musical query-by-semantic-description using the CAL500 data set
Turnbull, D., Barrington, L., Torres, D., & Lanckriet, G. R. G. (2007) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/1277741.1277817 · Cited by 133
Self-citationThe Music Information Retrieval Evaluation eXchange (MIREX)
Downie, J. S. (2006) · D-Lib Magazine · doi:10.1045/december2006-downie · Cited by 129
Slaney, M. (2002) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2002.5745561 · Cited by 100
Factors in automatic musical genre classification of audio signals
Li, T., & Tzanetakis, G. (2004) · IEEE Workshop on Applications of Signal Processing to Audio and Acoustics (WASPAA) · doi:10.1109/aspaa.2003.1285840 · Cited by 82
Cited by
A Tutorial on Multilabel Learning
Gibaja, E., & Ventura, S. (2015) · ACM Computing Surveys · doi:10.1145/2716262 · Cited by 527
A Survey of Audio-Based Music Classification and Annotation
Fu, Z., Lu, G., Ting, K. M., & Zhang, D. (2011) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2010.2098858 · Cited by 435
On the Role of Correlation and Abstraction in Cross-Modal Multimedia Retrieval
Costa Pereira, J., Coviello, E., Doyle, G., Rasiwasia, N., Lanckriet, G. R. G., Levy, R., & Vasconcelos, N. (2014) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.142 · Cited by 435
Self-citationMachine Recognition of Music Emotion: A Review
Yang, Y.-H., & Chen, H. H. (2012) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/2168752.2168754 · Cited by 378
A Bag-of-Features Framework to Classify Time Series
Baydogan, M. G., Runger, G., & Tuv, E. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.72 · Cited by 361
Metadata
- Authors
- Turnbull, D., Barrington, L., Torres, D., & Lanckriet, G.
- Venue
- IEEE Transactions on Audio, Speech, and Language Processing
- Published
- 2008-02
- Volume
- 16
- Issue
- 2
- Pages
- 467-476
- ISSN
- 1558-7916 (ISSN-L)
- OpenAlex
- W2116373735
- Cited by
- 483
- References
- 15
- FWCI
- 60.61
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Semantic Annotation and Retrieval of Music and Sound Effects. https://app.cochat.ai/papers/10.1109/tasl.2007.913750
- The paper
- Turnbull, D., Barrington, L., Torres, D., & Lanckriet, G. (2008). Semantic Annotation and Retrieval of Music and Sound Effects. IEEE Transactions on Audio, Speech, and Language Processing. https://doi.org/10.1109/tasl.2007.913750
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.