The DOI matches its Crossref record; 32 of the 32 references it cites were found in a registry or an index.
Automatic mood detection and tracking of music audio signals
Abstract
Music mood describes the inherent emotional expression of a music clip. It is helpful in music understanding, music retrieval, and some other music-related applications. In this paper, a hierarchical framework is presented to automate the task of mood detection from acoustic music data, by following some music psychological theories in western cultures. The hierarchical framework has the advantage of emphasizing the most suitable features in different detection tasks. Three feature sets, including intensity, timbre, and rhythm are extracted to represent the characteristics of a music clip. The intensity feature set is represented by the energy in each subband, the timbre feature set is composed of the spectral shape features and spectral contrast features, and the rhythm feature set indicates three aspects that are closely related with an individual's mood response, including rhythm strength, rhythm regularity, and tempo. Furthermore, since mood is usually changeable in an entire piece of classical music, the approach to mood detection is extended to mood tracking for a music piece, by dividing the music into several independent segments, each of which contains a homogeneous emotional expression. Preliminary evaluations indicate that the proposed algorithms produce satisfactory results. On our testing database composed of 800 representative music clips, the average accuracy of mood detection achieves up to 86.3%. We can also on average recall 84.1% of the mood boundaries from nine testing music pieces.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A Computational Approach to Edge Detection
Canny, J. (1986) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.1986.4767851 · Cited by 30,004
The Elements of Statistical Learning
Hastie, T., Tibshirani, R., & Friedman, J. (2009) · Springer Series in Statistics · doi:10.1007/978-0-387-84858-7 · Cited by 25,970
The Elements of Statistical Learning
Hastie, T., Friedman, J., & Tibshirani, R. (2001) · Springer Series in Statistics · doi:10.1007/978-0-387-21606-5 · Cited by 24,162
Russell, J. A. (1980) · Journal of Personality and Social Psychology · doi:10.1037/h0077714 · Cited by 16,334
The Elements of Statistical Learning: Data Mining, Inference, and Prediction
John Lu, Z. Q. (2010) · Journal of the Royal Statistical Society Series A: Statistics in Society · doi:10.1111/j.1467-985x.2010.00646_6.x · Cited by 12,390
Picard, R. W. (1997) · MIT Press · doi:10.7551/mitpress/1140.001.0001 · Cited by 7,382
Musical genre classification of audio signals
Tzanetakis, G., & Cook, P. (2002) · IEEE Transactions on Speech and Audio Processing · doi:10.1109/tsa.2002.800560 · Cited by 2,798
Toward machine emotional intelligence: analysis of affective physiological state
Picard, R. W., Vyzas, E., & Healey, J. (2001) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.954607 · Cited by 2,334
Speaker recognition: a tutorial
Campbell, J. P. (1997) · Proceedings of the IEEE · doi:10.1109/5.628714 · Cited by 1,629
Music and emotion: theory and research
(2002) · Choice Reviews Online · doi:10.5860/choice.40-0198 · Cited by 1,298
The biopsychology of mood and arousal
(1990) · Choice Reviews Online · doi:10.5860/choice.28-1830 · Cited by 1,240
Emotions and speech: some acoustical correlates.
Williams, C. E., & Stevens, K. N. (1972) · The Journal of the Acoustical Society of America · doi:10.1121/1.1913238 · Cited by 735 · cited 1×
“Some features used for speech emotion detection, such as pitch or [27], are not feasible for music mood representation.”
MethodThe Biopsychology of Mood and Arousal
Thayer, R. E. (1990) · doi:10.1093/oso/9780195068276.001.0001 · Cited by 620
Affective video content representation and modeling
Hanjalic, A., & Xu, L.-Q. (2005) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2004.840618 · Cited by 594
Music And Emotion: Theory and research
Juslin, P. N., & Sloboda, J. A. (2001) · doi:10.1093/oso/9780192631886.001.0001 · Cited by 559
The biopsychology of mood and arousal
Eysenck, H. J. (1990) · Personality and Individual Differences · doi:10.1016/0191-8869(90)90284-x · Cited by 515
(1989) · Journal of Psychophysiology · Cited by 489
The Influence Of Musical Structure On Emotional Expression
Gabrielsson, A., & Lindström, E. (2001) · Music And Emotion · doi:10.1093/oso/9780192631886.003.0010 · Cited by 476
Improving Text Classification by Shrinkage in a Hierarchy of Classes
McCallum, A., Rosenfeld, R., Mitchell, T., & Ng, A. Y. (2022) · doi:10.1184/r1/21708647 · Cited by 471
Juslin, P. N. (2000) · Journal of Experimental Psychology Human Perception & Performance · doi:10.1037//0096-1523.26.6.1797 · Cited by 463
Music type classification by spectral contrast feature
Jiang, D.-N., Lu, L., Zhang, H.-J., Tao, J.-H., & Cai, L.-H. (2003) · Proceedings. IEEE International Conference on Multimedia and Expo · doi:10.1109/icme.2002.1035731 · Cited by 339
Self-citationMusic: A Link Between Cognition and Emotion
Krumhansl, C. L. (2002) · Current Directions in Psychological Science · doi:10.1111/1467-8721.00165 · Cited by 274
Psychological Foundations of Musical Behavior
Jones, M. R., Radocy, R. E., & Boyle, J. D. (1990) · The American Journal of Psychology · doi:10.2307/1423149 · Cited by 273
Expression in music: a discussion of experimental studies and theories.
Hevner, K. (1935) · Psychological Review · doi:10.1037/h0054832 · Cited by 267
Content-based audio classification and segmentation by using support vector machines
Lu, L., Zhang, H.-J., & Li, S. Z. (2003) · Multimedia Systems · doi:10.1007/s00530-002-0065-0 · Cited by 244
Self-citationToward a computational model of expression in music performance: The GERM model
Juslin, P. N., Friberg, A., & Bresin, R. (2001) · Musicae Scientiae · doi:10.1177/10298649020050s104 · Cited by 188
Juslin, P. N. (1997) · Musicae Scientiae · doi:10.1177/102986499700100205 · Cited by 182
Lindström, E., Juslin, P. N., Bresin, R., & Williamon, A. (2003) · Research Studies in Music Education · doi:10.1177/1321103x030200010201 · Cited by 174
Emotional Coloring of Computer-Controlled Music Performances
Bresin, R., & Friberg, A. (2000) · Computer Music Journal · doi:10.1162/014892600559515 · Cited by 166
Automatic Mood Detection from Acoustic Music Data
Liu, D., Lu, L., & Zhang, H.-J. (2003) · Cited by 160
Self-citationThe Ramp Archetype and the Maintenance of Passive Auditory Attention
Huron, D. (1992) · Music Perception An Interdisciplinary Journal · doi:10.2307/40285540 · Cited by 47
The Effect of the Major and Minor Mode in Music as a Mood Induction Procedure
Hinn, D. M. (1996) · VTechWorks (Virginia Tech) · Cited by 4
Cited by
DEAP: A Database for Emotion Analysis ;Using Physiological Signals
Koelstra, S., Muhl, C., Soleymani, M., Lee, J.-S., Yazdani, A., Ebrahimi, T., Pun, T., Nijholt, A., & Patras, I. (2012) · IEEE Transactions on Affective Computing · doi:10.1109/t-affc.2011.15 · Cited by 5,093
Emotion recognition using multi-modal data and machine learning techniques: A tutorial and review
Zhang, J., Yin, Z., Chen, P., & Nichele, S. (2020) · Information Fusion · doi:10.1016/j.inffus.2020.01.011 · Cited by 806
Content-Based Music Information Retrieval: Current Directions and Future Challenges
Casey, M. A., Veltkamp, R., Goto, M., Leman, M., Rhodes, C., & Slaney, M. (2008) · Proceedings of the IEEE · doi:10.1109/jproc.2008.916370 · Cited by 651
How Big Data Will Change Accounting
Warren, J. D., Moffitt, K. C., & Byrnes, P. (2015) · Accounting Horizons · doi:10.2308/acch-51069 · Cited by 615
Multi-Label Classification Of Music Into Emotions.
Trohidis, K., Tsoumakas, G., Kalliris, G. M., & Vlahavas, I. P. (2008) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.5281/zenodo.1414899 · Cited by 607
Metadata
- Authors
- Lu, L., Liu, D., & Zhang, H.-J.
- Venue
- IEEE Transactions on Audio, Speech and Language Processing
- Published
- 2006-01
- Volume
- 14
- Issue
- 1
- Pages
- 5-18
- ISSN
- 1558-7916 (ISSN-L)
- OpenAlex
- W2148600927
- Cited by
- 518
- References
- 32
- FWCI
- 26.34
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.