CoChat
Sign Up
PreprintCited by 1

The DOI matches its DataCite record.

Music for All: Representational Bias and Cross-Cultural Adaptability of Music Generation Models

Mehta, Atharva, Chauhan, Shivam, Djanibekov, Amirbek, Kulkarni, Atharva, Xia, Gus, Choudhury, Monojit·2025·arXiv
DOI 10.48550/arxiv.2502.07328arXiv 2502.07328
Open this paper in CoChat — free account

Abstract

The advent of Music-Language Models has greatly enhanced the automatic music generation capability of AI systems, but they are also limited in their coverage of the musical genres and cultures of the world. We present a study of the datasets and research papers for music generation and quantify the bias and under-representation of genres. We find that only 5.7% of the total hours of existing music datasets come from non-Western genres, which naturally leads to disparate performance of the models across genres. We then investigate the efficacy of Parameter-Efficient Fine-Tuning (PEFT) techniques in mitigating this bias. Our experiments with two popular models -- MusicGen and Mustango, for two underrepresented non-Western music traditions -- Hindustani Classical and Turkish Makam music, highlight the promises as well as the non-triviality of cross-genre adaptation of music through small datasets, implying the need for more equitable baseline music-language models that are designed for cross-cultural transfer learning.

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.2502.07328

Cites

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

No references could be resolved yet.

Research works printed but not linked: 36

  1. Andrea Agostinelli, Timo I Denk, Zalán Borsos, Jesse Engel, Mauro Verzetti, Antoine Caillon, Qingqing Huang, Aren Jansen, Adam Roberts, Marco Tagliasacchi, et al. 2023. Musiclm: Generating mu- sic from text. arXiv preprint arXiv:2301.11325. · arXiv
  2. Ankur Bapna and Orhan Firat. 2019. Simple, scal- able adaptation for neural machine translation. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Lan- guage Processing (EMNLP-IJCNLP), pages 1538- 1548, Hong Kong, China. Association for Computa- tional Linguistics. · DOI
  3. Emily M. Bender and Batya Friedman. 2018. Data statements for natural language processing: Toward mitigating system bias and enabling better science. Transactions of the Association for Computational Linguistics, 6:587-604. · DOI · Paper page
  4. Emily M Bender, Timnit Gebru, Angelina McMillan- Major, and Shmargaret Shmitchell. 2021. On the dangers of stochastic parrots: Can language models be too big? In Proceedings of the 2021 ACM confer- ence on fairness, accountability, and transparency, pages 610-623.
  5. Wei-Lin Chiang, Lianmin Zheng, Ying Sheng, Anas- tasios N. Angelopoulos, Tianle Li, Dacheng Li, Banghua Zhu, Hao Zhang, Michael I. Jordan, Joseph E. Gonzalez, and Ion Stoica. 2024. Chat- bot arena: an open platform for evaluating llms by human preference. In Proceedings of the 41st Inter- national Conference on Machine Learning, ICML'24. JMLR.org.
  6. Hyung Won Chung, Le Hou, Shayne Longpre, Barret Zoph, Yi Tay, William Fedus, Yunxuan Li, Xuezhi Wang, Mostafa Dehghani, Siddhartha Brahma, Al- bert Webson, Shixiang Shane Gu, Zhuyun Dai, Mirac Suzgun, Xinyun Chen, Aakanksha Chowdh- ery, Alex Castro-Ros, Marie Pellat, Kevin Robinson, Dasha Valter, Sharan Narang, Gaurav Mishra, Adams Yu, Vincent Zhao, Yanping Huang, Andrew Dai, Hongkun Yu, Slav Petrov, Ed H. Chi, Jeff Dean, Ja- cob Devlin, Adam Roberts, Denny Zhou, Quoc V. Le, and Jason Wei. 2024. Scaling instruction-finetuned language models. Journal of Machine Learning Re- search, 25(70):1-53.
  7. Sheng-Kuan Chung. 2006. Digital storytelling in inte- grated arts education. The International Journal of Arts Education, 4(1):33-50.
  8. Jade Copet, Felix Kreuk, Itai Gat, Tal Remez, David Kant, Gabriel Synnaeve, Yossi Adi, and Alexandre Defossez. 2023. Simple and controllable music gen- eration. In Advances in Neural Information Process- ing Systems, volume 36, pages 47704-47720.
  9. Joe Davison. 2021. Compacter: Efficient low-rank hy- percomplex adapter layers. In Neural Information Processing Systems.
  10. Alexandre Défossez, Jade Copet, Gabriel Synnaeve, and Yossi Adi. 2023. High fidelity neural audio compres- sion. Transactions on Machine Learning Research. Featured Certification, Reproducibility Certification.
  11. Hao-Wen Dong, Wen-Yi Hsiao, Li-Chia Yang, and Yi- Hsuan Yang. 2018. Musegan: Multi-track sequential generative adversarial networks for symbolic music generation and accompaniment. In Proceedings of the AAAI Conference on Artificial Intelligence, vol- ume 32.
  12. Neil Houlsby, Andrei Giurgiu, Stanislaw Jastrzebski, Bruna Morrone, Quentin De Laroussilhe, Andrea Gesmundo, Mona Attariyan, and Sylvain Gelly. 2019. Parameter-efficient transfer learning for nlp. In In- ternational conference on machine learning, pages 2790-2799. PMLR.
  13. Edward J. Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu, Yuanzhi Li, Shean Wang, and Weizhu Chen. 2021. Lora: Low-rank adaptation of large language models. CoRR, abs/2106.09685. · arXiv
  14. Qingqing Huang, Daniel S. Park, Tao Wang, Timo I. Denk, Andy Ly, Nanxin Chen, Zhengdong Zhang, Zhishuai Zhang, Jiahui Yu, Christian Havnø Frank, Jesse Engel, Quoc V. Le, William Chan, and Wei Han. 2023. Noise2music: Text-conditioned music genera- tion with diffusion models. ArXiv, abs/2302.03917. · arXiv
  15. N.A. Jairazbhoy. 1971. The Rāgs of North Indian Music: Their Structure and Evolution. Wesleyan University Press.
  16. Pratik Joshi, Sebastin Santy, Amar Budhiraja, Kalika Bali, and Monojit Choudhury. 2020. The state and fate of linguistic diversity and inclusion in the NLP world. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pages 6282-6293, Online. Association for Computational Linguistics. · DOI · Paper page
  17. Qiuqiang Kong, Yin Cao, Turab Iqbal, Yuxuan Wang, Wenwu Wang, and Mark D. Plumbley. 2020. Panns: Large-scale pretrained audio neural networks for au- dio pattern recognition. IEEE Transactions on Audio, Speech, and Language Processing, 28:2880-2894. · DOI · Paper page
  18. Yun-Han Lan, Wen-Yi Hsiao, Hao-Chung Cheng, and Yi-Hsuan Yang. 2024. Musicongen: Rhythm and chord control for transformer-based text-to-music generation. In Proceedings of the International So- ciety for Music Information Retrieval Conference (ISMIR).
  19. Peike Patrick Li, Boyu Chen, Yao Yao, Yikai Wang, Allen Wang, and Alex Wang. 2024. Jen-1: Text- guided universal music generation with omnidirec- tional diffusion models. In 2024 IEEE Conference on Artificial Intelligence (CAI), pages 762-769. IEEE.
  20. Shuyu Li and Yunsick Sung. 2021. Inco-gan: variable- length music generation method based on incep- tion model-based conditional gan. Mathematics, 9(4):387.
  21. Liwei Lin, Gus Xia, Yixiao Zhang, and Junyan Jiang. 2024. Arrange, inpaint, and refine: Steerable long- term music audio generation and editing via content- based controls. In Proceedings of the Thirty-Third International Joint Conference on Artificial Intel- ligence, IJCAI-24, pages 7690-7698. International Joint Conferences on Artificial Intelligence Organi- zation. AI, Arts and Creativity. · DOI
  22. Haohe Liu, Zehua Chen, Yi Yuan, Xinhao Mei, Xubo Liu, Danilo Mandic, Wenwu Wang, and Mark D Plumbley. 2023. AudioLDM: Text-to-audio gener- ation with latent diffusion models. Proceedings of the International Conference on Machine Learning, pages 21450-21474.
  23. Holger Lund. 2019. Decolonizing pop music. https://norient.com/. · DOI
  24. Jan Melechovsky, Zixun Guo, Deepanway Ghosal, Navonil Majumder, Dorien Herremans, and Soujanya Poria. 2024. Mustango: Toward controllable text- to-music generation. In Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers), pages 8293-8316, Mexico City, Mexico. Association for Computational Linguistics. · DOI · Paper page
  25. Jonas Pfeiffer, Andreas Rücklé, Clifton Poth, Aishwarya Kamath, Ivan Vulić, Sebastian Ruder, Kyunghyun Cho, and Iryna Gurevych. 2020. AdapterHub: A framework for adapting transformers. In Proceedings of the 2020 Conference on Empirical Methods in Nat- ural Language Processing: System Demonstrations, pages 46-54, Online. Association for Computational Linguistics. · DOI
  26. Olaf Ronneberger, Philipp Fischer, and Thomas Brox. 2015. U-net: Convolutional networks for biomedical image segmentation. In Medical Image Computing and Computer-Assisted Intervention -MICCAI 2015, pages 234-241, Cham. Springer International Pub- lishing.
  27. Flavio Schneider, Ojasv Kamal, Zhijing Jin, and Bern- hard Schölkopf. 2024. Moûsai: Efficient text-to- music diffusion models. In Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 8050- 8068.
  28. Xavier Serra. 2014. Creating research corpora for the computational study of music: the case of the comp- music project. In AES 53rd International Conference: Semantic Audio; 2014 Jan 27-29; London, UK. New York: Audio Engineering Society; 2014. Article num- ber 1-1 [9 p.]. Audio Engineering Society.
  29. Ajay Srinivasamurthy, Sankalp Gulati, Rafael Caro Repetto, and Xavier Serra. 2021. Saraga: open datasets for research on indian art music. Empiri- cal Musicology Review, 16(1):85-98.
  30. Joseph P. Swain. 1995. The Concept of Musical Syntax. The Musical Quarterly, 79(2):281-308. · DOI
  31. Or Tal, Alon Ziv, Itai Gat, Felix Kreuk, and Yossi Adi. 2024. Joint audio and symbolic conditioning for tem- porally controlled text-to-music generation. Preprint, arXiv:2406.10970. · arXiv
  32. Shzr Ee Tan. 2021. Special issue: Decolonising music and music studies. Ethnomusicology Forum, 30(1):4- 8. · DOI
  33. Xiaodong Tan, Mathis Antony, and H Kong. 2020. Au- tomated music generation for visual art through emo- tion. In ICCC, pages 247-250.
  34. Yan Tao, Olga Viberg, Ryan S Baker, and René F Kizil- cec. 2024. Cultural bias and cultural alignment of large language models. PNAS Nexus, 3(9):pgae346. · DOI · Paper page
  35. Yixiao Zhang, Yukara Ikemiya, Woosung Choi, Naoki Murata, Marco A Martínez-Ramírez, Liwei Lin, Gus Xia, Wei-Hsiang Liao, Yuki Mitsufuji, and Simon Dixon. 2024. Instruct-musicgen: Unlocking text-to- music editing for music language models via instruc- tion tuning. arXiv preprint arXiv:2405.18386. · arXiv
  36. Alon Ziv, Itai Gat, Gael Le Lan, Tal Remez, Felix Kreuk, Jade Copet, Alexandre Défossez, Gabriel Synnaeve, and Yossi Adi. 2024. Masked audio generation using a single non-autoregressive transformer. In Inter- national Conference on Learning Representations (ICLR).

Cited by

Sorted by citations

Metadata

Authors
Mehta, A., Chauhan, S., Djanibekov, A., Kulkarni, A., Xia, G., & Choudhury, M.
Venue
arXiv
Publisher
arXiv
Published
2025
DOI
10.48550/arxiv.2502.07328
arXiv
2502.07328
References
0
Type
Preprint
Licence
creativecommons.org/licenses/by-nc-sa/4.0/legalcode

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review