The DOI matches its DataCite record.
MIRFLEX: Music Information Retrieval Feature Library for Extraction
Open accessAbstract
This paper introduces an extendable modular system that compiles a range of music feature extraction models to aid music information retrieval research. The features include musical elements like key, downbeats, and genre, as well as audio characteristics like instrument recognition, vocals/instrumental classification, and vocals gender detection. The integrated models are state-of-the-art or latest open-source. The features can be extracted as latent or post-processed labels, enabling integration into music applications such as generative music, recommendation, and playlist generation. The modular design allows easy integration of newly developed systems, making it a good benchmarking and comparison tool. This versatile toolkit supports the research community in developing innovative solutions by providing concrete musical features.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Using the MIRFLEX feature extractors rather than ground truth music features might introduce some noise and bias into the dataset.
“We note that using the MIRFLEX feature extractors rather than ground truth music features might introduce some noise and bias into the dataset.”
From SonicVerse: Multi-Task Learning for Music Feature-Informed Captioning (2025) · cites this paper as Chopra et al., 2024
The Introduction identifies MIRFLEX as a feature-extraction library, and the key-detection accuracy table reports performance below 100%, supporting the possibility of errors in extracted features. Our copy does not discuss bias or assess whether using MIRFLEX features instead of ground truth introduces bias into a dataset. (LLM, conf=0.78)
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
No references could be resolved yet.
Research works printed but not linked: 20
- S. A. Baumann, "Deeper convolutional neural net- works and broad augmentation policies improve per- formance in musical key estimation." in ISMIR, 2021, pp. 42-49.
- H. Schreiber and M. Müller, "Musical tempo and key estimation using convolutional neural networks with directional filters," in Proc of the Sound and Music Computing Conf (SMC), Málaga, Spain, 2019, pp. 47- 54.
- P. Knees, Á. Faraldo Pérez, H. Boyer, R. Vogl, S. Böck, F. Hörschläger, M. Le Goff et al., "Two data sets for tempo estimation and key detection in electronic dance music annotated from user corrections," in Proc of the 16th Int Society for Music Information Retrieval Conf (ISMIR); 2015 Oct 26-30; Málaga, Spain.[Málaga]: Int Society for Music Information Retrieval, 2015. p. 364-70. Int Society for Music Information Retrieval (ISMIR), 2015.
- J. Park, K. Choi, S. Jeon, D. Kim, and J. Park, "A bi- directional transformer for musical chord recognition," arXiv preprint arXiv:1907.02698, 2019. · arXiv
- F. Korzeniowski and G. Widmer, "A fully convolu- tional deep auditory model for musical chord recog- nition," in 2016 IEEE 26th Int Workshop on Machine Learning for Signal Processing (MLSP). IEEE, 2016, pp. 1-6.
- Y. Wu, T. Carsault, E. Nakamura, and K. Yoshii, "Semi-supervised neural chord estimation based on a variational autoencoder with latent chord labels and features," IEEE/ACM Trans on Audio, Speech, and Language Processing, vol. 28, pp. 2956-2966, 2020.
- H. Schreiber and M. Müller, "A single-step approach to musical tempo estimation using a convolutional neural network." in Ismir, 2018, pp. 98-105.
- M. Heydari, M. McCallum, A. Ehmann, and Z. Duan, "A novel 1d state space for efficient music rhythmic analysis," in ICASSP 2022-2022 IEEE Int Conf on Acoustics, Speech and Signal Processing (ICASSP). IEEE, 2022, pp. 421-425.
- M. Heydari, F. Cwitkowitz, and Z. Duan, "Beat- net: Crnn and particle filtering for online joint beat downbeat and meter tracking," arXiv preprint arXiv:2108.03576, 2021. · arXiv
- G. Tzanetakis and P. Cook, "Musical genre classifica- tion of audio signals," IEEE Trans on speech and audio processing, vol. 10, no. 5, pp. 293-302, 2002.
- P. Alonso-Jiménez, D. Bogdanov, J. Pons, and X. Serra, "Tensorflow audio models in Essentia," in Int Conf on Acoustics, Speech and Signal Processing (ICASSP), 2020.
- S. K. Mahanta, N. J. Basisth, E. Halder, A. F. U. R. Khilji, and P. Pakray, "Exploiting cepstral coefficients and cnn for efficient musical instrument classification," Evolving Systems, pp. 1-13, 2023.
- M. Blaszke and B. Kostek, "Musical instrument iden- tification using deep learning approach," Sensors, vol. 22, no. 8, p. 3033, 2022.
- K. Racharla, V. Kumar, C. B. Jayant, A. Khairkar, and P. Harish, "Predominant musical instrument classifica- tion based on spectral features," in 2020 7th Int Conf on Signal Processing and Integrated Networks (SPIN). IEEE, 2020, pp. 617-622.
- H.-H. Chen and A. Lerch, "Music instrument clas- sification reprogrammed," in Int Conf on Multimedia Modeling. Springer, 2023, pp. 345-357.
- S. Gururani, M. Sharma, and A. Lerch, "An attention mechanism for musical instrument recognition," arXiv preprint arXiv:1907.04294, 2019. · arXiv
- H. F. Garcia, A. Aguilar, E. Manilow, and B. Pardo, "Leveraging hierarchical structures for few-shot musical instrument recognition," arXiv preprint arXiv:2107.07029, 2021. · arXiv
- K. Koutini, S. Chowdhury, V. Haunschmid, H. Eghbal- Zadeh, and G. Widmer, "Emotion and theme recog- nition in music with frequency-aware rf-regularized cnns," arXiv preprint arXiv:1911.05833, 2019. · arXiv
- D. Bogdanov, M. Won, P. Tovstogan, A. Porter, and X. Serra, "The mtg-jamendo dataset for automatic mu- sic tagging." ICML, 2019.
- H. H. Tan, "Semi-supervised music emotion recogni- tion using noisy student training and harmonic pitch class profiles," arXiv preprint arXiv:2112.00702, 2021. · arXiv
Cited by
Sorted by citations
SonicVerse: Multi-Task Learning for Music Feature-Informed Captioning
Chopra, A., Roy, A., & Herremans, D. (2025) · arXiv · doi:10.48550/arxiv.2506.15154 · Cited by 3
“…captioning model on the Magna-Tag-A-Tune dataset (Law et al., 2009) with MosiacML (MosaicML NLP Team et al., 2023) captions and MIRFLEX-based (Chopra et al., 2024) features, and finetuning on the MusicBench (Melechovsky et al., 2024) dataset expanded with MIRFLEX-based features, we can…”
InfluentialSelf-citation
Metadata
- Authors
- Chopra, A., Roy, A., & Herremans, D.
- Affiliations
- Singapore University of Technology and Design (SG)
- ORCID
- Herremans, Dorien
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2024
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 2411.00469
- OpenAlex
- W4404345151
- Cited by
- 1
- References
- 0
- Citations by year
- 2025: 1
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- arXiv (Cornell University) (submittedVersion, cc-by)
- arXiv (Cornell University) (cc-by)
- Topics
- Physical Sciences › Computer Science › Signal Processing › Music and Audio Processing
- Social Sciences › Arts and Humanities › Music › Music Technology and Sound Studies
- Social Sciences › Arts and Humanities › Music › Musicology and Musical Analysis
- Keywords
- music information retrieval, music feature extraction, key detection, music genre classification, instrument identification, generative music, music recommendation, playlist generation, benchmarking
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
