Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat
Sign Up
PreprintCited by 1

The DOI matches its DataCite record.

Twenty-Five Years of MIR Research: Achievements, Practices, Evaluations, and Future Challenges

Peeters, Geoffroy, Rafii, Zafar, Fuentes, Magdalena, Duan, Zhiyao, Benetos, Emmanouil, Nam, Juhan, Mitsufuji, Yuki·2025·arXiv
DOI 10.48550/arxiv.2511.07205arXiv 2511.07205

Preprint — published as 10.1109/icassp49660.2025.10888947

Open this paper in CoChat — free account

Abstract

In this paper, we trace the evolution of Music Information Retrieval (MIR) over the past 25 years. While MIR gathers all kinds of research related to music informatics, a large part of it focuses on signal processing techniques for music data, fostering a close relationship with the IEEE Audio and Acoustic Signal Processing Technical Commitee. In this paper, we reflect the main research achievements of MIR along the three EDICS related to music analysis, processing and generation. We then review a set of successful practices that fuel the rapid development of MIR research. One practice is the annual research benchmark, the Music Information Retrieval Evaluation eXchange, where participants compete on a set of research tasks. Another practice is the pursuit of reproducible and open research. The active engagement with industry research and products is another key factor for achieving large societal impacts and motivating younger generations of students to join the field. Last but not the least, the commitment to diversity, equity and inclusion ensures MIR to be a vibrant and open community where various ideas, methodologies, and career pathways collide. We finish by providing future challenges MIR will have to face.

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.2511.07205

Cites

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

No references could be resolved yet.

Research works printed but not linked: 56

  1. M. Müller e al., "Signal processing for music analysis," IEEE J. Sel. Top. Signal Process., vol. 5, no. 6, pp. 1088-1110, 2011.
  2. M. Müller et al., "Recent advances in music signal processing," IEEE Signal Process. Mag., vol. 36, no. 1, pp. 17-19, 2019.
  3. G. Peeters, "The deep learning revolution in MIR: the pros and cons, the needs and the challenges," in Proc. of CMMR, 2019.
  4. M. Yinghao et al., "Foundation models for music: A survey," arXiv preprint arXiv:2408.14340, 2024. · arXiv
  5. J. H. Engel, L. Hantrakul, C. Gu, and A. Roberts, "DDSP: differentiable digital signal processing," in ICLR, 2020.
  6. M. Casey et al., "Content-based music information retrieval: Current directions and future challenges," Proceedings of the IEEE, vol. 96, no. 4, pp. 668-696, 2008.
  7. M. Schedl, E. Gómez, and J. Urbano, "Music information retrieval: Recent developments and applications," Foundations and Trends in Information Retrieval, vol. 8, no. 2-3, pp. 127-261, 2014.
  8. A. L.-C. Wang, "An industrial strength audio search algorithm," in Proc. of ISMIR, 2003.
  9. F. Yesiler, G. Doras, R. M. Bittner, C. Tralie, and J. Serrà, "Audio-based musical version identification: Elements and challenges," IEEE Signal Processing Magazine, vol. 38, pp. 115-136, 2021.
  10. E. Pampalk, A. Flexer, and G. Widmer, "Improvements of audio-based music similarity and genre classificaton," in Proc. of ISMIR, 2005.
  11. J. Nam, K. Choi, J. Lee, S.-Y. Chou, and Y.-H. Yang, "Deep learning for audio-based music classification and tagging," IEEE Signal Processing Magazine, vol. 36, pp. 41-51, 2018.
  12. S. Chang, D. Lee, J. Park, H. Lim, K. Lee, K. Ko, and Y. Han, "Neural audio fingerprint for high-specific audio retrieval based on contrastive learning," in IEEE ICASSP, 2021.
  13. J. Spijkervet and J. A. Burgoyne, "Contrastive learning of musical representations," in Proc. of ISMIR, 2021.
  14. J. W. Kim, J. Salamon, P. Li, and J. P. Bello, "CREPE: A convolutional representation for pitch estimation," in IEEE ICASSP, 2018.
  15. B. Gfeller, C. Frank, D. Roblek, M. Sharifi, M. Tagliasacchi, and M. Velimirović, "SPICE: Self-supervised pitch estimation," IEEE/ACM TASLP, vol. 28, pp. 1118-1128, 2020.
  16. A. Riou, S. Lattner, G. Hadjeres, and G. Peeters, "PESTO: Pitch estimation with self-supervised transposition-equivariant objective," in Proc. of ISMIR, 2023.
  17. E. Benetos, S. Dixon, Z. Duan, and S. Ewert, "Automatic music transcription: An overview," IEEE Signal Processing Magazine, vol. 36, no. 1, pp. 20-30, 2018.
  18. V. Emiya, R. Badeau, and B. David, "Multipitch estimation of piano sounds using a new probabilistic spectral smoothness principle," IEEE TASLP, vol. 18, no. 6, pp. 1643-1654, 2009.
  19. C. Hawthorne et al., "Enabling factorized piano music modeling and generation with the MAESTRO dataset," in ICLR, 2019.
  20. F. Krebs, S. Böck, and G. Widmer, "Rhythmic pattern modeling for beat and downbeat tracking in musical audio." in Proc. of ISMIR, 2013.
  21. S. Böck and M. Davies, "Deconstruct, analyse, reconstruct: How to improve tempo, beat, and downbeat estimation." in Proc. of ISMIR, 2020.
  22. L. S. Maia, M. Rocamora, L. W. Biscainho, and M. Fuentes, "Selective annotation of few data for beat tracking of latin american music using rhythmic features," TISMIR, vol. 7, no. 1, 2024.
  23. D. Desblancs, V. Lostanlen, and R. Hennequin, "Zero-note samba: Self- supervised beat tracking," IEEE/ACM TASLP, vol. 31, pp. 2922-2934, 2023.
  24. Y. Mitsufuji et al., "Music demixing challenge 2021," Frontiers in Signal Processing, vol. 1, 2022.
  25. C. J. Steinmetz, S. S. Vanka, M. A. Martínez Ramírez, and G. Bromham, "Deep learning for automatic mixing," in Proc. of ISMIR, 2022.
  26. K. Saito, N. Murata, T. Uesaka, C. Lai, Y. Takida, T. Fukui, and Y. Mitsufuji, "Unsupervised vocal dereverberation with diffusion-based generative models," in IEEE ICASSP, 2023.
  27. E. Moliner, F. Elvander, and V. Välimäki, "Blind audio band- width extension: A diffusion-based zero-shot approach," arXiv preprint arXiv:2306.01433, 2024. · arXiv
  28. C. Hernandez-Olivan, K. Saito, N. Murata, C. Lai, M. A. M. Ramírez, W. Liao, and Y. Mitsufuji, "VRDMG: vocal restoration via diffusion posterior sampling with multiple guidance," in IEEE ICASSP, 2024.
  29. M. A. M. Ramírez, W. Liao, C. Nagashima, G. Fabbro, S. Uhlich, and Y. Mitsufuji, "Automatic music mixing with deep learning and out-of- domain data," in Proc. of ISMIR, 2022.
  30. P. Dhariwal, H. Jun, C. Payne, J. W. Kim, A. Radford, and I. Sutskever, "Jukebox: A generative model for music," CoRR, vol. abs/2005.00341, 2020. [Online]. Available: https://arxiv.org/abs/2005.00341 · arXiv
  31. Z. Evans et al., "Stable audio open," CoRR, vol. abs/2407.14358, 2024. [Online]. Available: https://doi.org/10.48550/arXiv.2407.14358 · DOI
  32. J. S. Downie, "The music information retrieval evaluation exchange (2005-2007): A window into music information retrieval research," Acoustical Science and Technology, vol. 29, no. 4, pp. 247-255, 2008.
  33. M. Goto, "AIST annotation for the RWC music database," in Proc. of ISMIR, 2006.
  34. M. Mauch, C. Cannam, M. Davies, S. Dixon, C. Harte, S. Klozali, D. Tidhar, and M. Sandler, "OMRAS2 metadata project 2009," in Proc. of ISMIR, 2009.
  35. J. B. L. Smith, J. A. Burgoyne, I. Fujinaga, D. De Roure, and J. S. Downie, "Design and creation of a large-scale database of structural annotations," in Proc. of ISMIR, 2011.
  36. G. Peeters, J. Urbano, and G. Jones, "Notes from the ISMIR 2012 late- breaking session on evaluation in music information retrieval," in Proc. of ISMIR, 2012.
  37. S. Yang et al., "SUPERB: Speech processing universal performance benchmark," in Interspeech, 2021.
  38. J. Turian et al., "HEAR: Holistic evaluation of audio representations," in NeurIPS, 2021.
  39. R. Yuan et al., "MARBLE: Music audio representation benchmark for universal evaluation," in NeurIPS, 2023.
  40. O. Lartillot, P. Toiviainen, and T. Eerola, "A matlab toolbox for music information retrieval," in Data Analysis, Machine Learning and Appli- cations. Springer Berlin Heidelberg, 2008.
  41. D. Bogdanov et al., "Essentia: An audio analysis library for music information retrieval," in Proc. of ISMIR.
  42. B. McFee et al., "librosa: Audio and music signal analysis in python," in Python in science conference, 2015, pp. 18-25.
  43. R. Colin et al., "mir eval: A transparent implementation of common MIR metrics," in Proc. of ISMIR, 2014.
  44. R. M. Bittner, M. Fuentes, D. Rubinstein, A. Jansson, K. Choi, and T. Kell, "mirdata: Software for reproducible usage of datasets," in Proc. of ISMIR, 2019.
  45. C. McKay, J. Cumming, and I. Fujinaga, "JSYMBOLIC 2.2: Extracting features from symbolic music for use in musicological and mir research," in Proc. of ISMIR, 2018.
  46. M. S. Cuthbert and C. Ariza, "music21: A toolkit for computer-aided musicology and symbolic music data," in Proc. of ISMIR, 2010.
  47. B. McFee et al., "Open-source practices for music signal processing re- search: Recommendations for transparent, sustainable, and reproducible audio research," IEEE Signal Processing Magazine, vol. 36, no. 1, pp. 128-137, 2019.
  48. A. Lerch, An introduction to audio content analysis: Music Information Retrieval tasks and applications. John Wiley & Sons, 2022.
  49. M. Müller, Fundamentals of Music Processing. Springer Cham, 2015.
  50. M. Müller et al., "Introducing the TISMIR education track: What, why, how?" Trans. Int. Soc. Music. Inf. Retr., vol. 7, no. 1, pp. 85-98, 2024.
  51. J. Haitsma and T. Kalker, "A highly robust audio fingerprinting system," in Proc. of ISMIR, 2002.
  52. J. Joyce, "Pandora and the music genome project, song structure analysis tools facilitate new music discovery," Scientific Computing, vol. 23, no. 14, pp. 40-41, 2006.
  53. K. Jacobson, V. Murali, E. Newett, B. Whitman, and R. Yon, "Music personalization at Spotify," in ACM Conference on Recommender Sys- tems, Boston, MA, USA, September 15-19 2016.
  54. T. Bontempelli et al., "Flow Moods: Recommending music by moods on Deezer," in ACM Conference on Recommender Systems, Seattle, WA, USA, September 18-23 2022.
  55. X. Hu, K. Choi, J. H. Lee, A. Laplante, Y. Hao, S. J. Cunningham, and J. S. Downie, "WiMIR: An informetric study on women authors in ISMIR," in Proc. of ISMIR, 2016.
  56. T. Lidy et al., "On the suitability of state-of-the-art music information retrieval methods for analyzing, categorizing and accessing non-western and ethnic music collections," Signal Processing, vol. 90, no. 4, pp. 1032-1048, 2010.

Cited by

Metadata

Authors
Peeters, G., Rafii, Z., Fuentes, M., Duan, Z., Benetos, E., Nam, J., & Mitsufuji, Y.
Venue
arXiv
Publisher
arXiv
Published
2025
DOI
10.48550/arxiv.2511.07205
arXiv
2511.07205
References
0
Type
Preprint
Licence
creativecommons.org/licenses/by-nc-nd/4.0/legalcode

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.