A Functional Taxonomy of Music Generation Systems
Open accessThe DOI matches its Crossref record; 165 of the 179 references it cites were found in a registry or an index.
Abstract
Digital advances have transformed the face of automatic music generation since its beginnings at the dawn of computing. Despite the many breakthroughs, issues such as the musical tasks targeted by different machines and the degree to which they succeed remain open questions. We present a functional taxonomy for music generation systems with reference to existing systems. The taxonomy organizes systems according to the purposes for which they were designed. It also reveals the inter-relatedness amongst the systems. This design-centered approach contrasts with predominant methods-based surveys and facilitates the identification of grand challenges to set the stage for new breakthroughs.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“AI music research has focused more on modelling musical aspects such as melody or timbre [51,53], with most AI tools affording limited interactivity [12].”
From Reflection Across AI-based Music Composition (2024) · cites this paper as [51]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
Holland, J. H. (1992) · The MIT Press eBooks · doi:10.7551/mitpress/1090.001.0001 · Cited by 47,002
Optimization by Simulated Annealing
Kirkpatrick, S., Gelatt, C. D., & Vecchi, M. P. (1983) · Science · doi:10.1126/science.220.4598.671 · Cited by 45,134
Learning representations by back-propagating errors
Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1986) · Nature · doi:10.1038/323533a0 · Cited by 31,892
A logical calculus of the ideas immanent in nervous activity
McCulloch, W. S., & Pitts, W. (1943) · The Bulletin of Mathematical Biophysics · doi:10.1007/bf02478259 · Cited by 18,566
Learning Internal Representations by Error Propagation
Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1985) · doi:10.21236/ada164453 · Cited by 16,172
Learning long-term dependencies with gradient descent is difficult
Bengio, Y., Simard, P., & Frasconi, P. (1994) · IEEE Transactions on Neural Networks · doi:10.1109/72.279181 · Cited by 8,542 · cited 1×
“It remains a challenge, however, to efficiently train long term dependencies (Bengio et al. 1994).”
BackgroundAttitudinal Effects of Mere Exposure
Zajonc, R. B. (1968) · Journal of Personality and Social Psychology · doi:10.1037/h0025848 · Cited by 6,745
Proceedings of the 25th international conference on Machine learning - ICML '08
(2008) · doi:10.1145/1390156 · Cited by 6,680
Statistical Inference for Probabilistic Functions of Finite State Markov Chains
Baum, L. E., & Petrie, T. (1966) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177699147 · Cited by 2,775
Research works printed but not linked: 35
- G. Assayag , G. Bloch , and M. Chemillier . 2006 . OMax-ofon. Proceedings of the Conference on Sound and Music Computing (SMC’06) . G. Assayag, G. Bloch, and M. Chemillier. 2006. OMax-ofon. Proceedings of the Conference on Sound and Music Computing (SMC’06).
- J. A. Biles . 2001 . Autonomous GenJam: Eliminating the fitness bottleneck by eliminating fitness . In Proceedings of the GECCO-2001 Workshop on Non-routine Design with Evolutionary Systems. Morgan Kaufmann , San Francisco, CA. J. A. Biles. 2001. Autonomous GenJam: Eliminating the fitness bottleneck by eliminating fitness. In Proceedings of the GECCO-2001 Workshop on Non-routine Design with Evolutionary Systems. Morgan Kaufmann, San Francisco, CA.
- 10.5555/1533570.1533638 · doi:10.5555/1533570.1533638
- 10.5555/1434875 · doi:10.5555/1434875
- D. Conklin . 2003 . Music generation from statistical models . In Proceedings of the AISB Symposium on Artificial Intelligence and Creativity in the Arts and Sciences. Aberystwyth, Wales, 30--35 . D. Conklin. 2003. Music generation from statistical models. In Proceedings of the AISB Symposium on Artificial Intelligence and Creativity in the Arts and Sciences. Aberystwyth, Wales, 30--35.
- N. Cunha , A. Subramanian , and D. Herremans . 2016. Uma abordagem baseada em programação linear inteira para a geração de solos de guitarra . XLVIII Simpósio Brasileiro de Pesquisa Operacional (SBPO) (09/2016 2016 ). N. Cunha, A. Subramanian, and D. Herremans. 2016. Uma abordagem baseada em programação linear inteira para a geração de solos de guitarra. XLVIII Simpósio Brasileiro de Pesquisa Operacional (SBPO) (09/2016 2016).
- E. Deruty . 2016 . Goal-oriented mixing . In Proceedings of the 2nd AES Workshop on Intelligent Music Production , Vol. 13 . London. E. Deruty. 2016. Goal-oriented mixing. In Proceedings of the 2nd AES Workshop on Intelligent Music Production, Vol. 13. London.
- A. Eigenfeldt and P. Pasquier . 2009. A realtime generative music system using autonomous melody, harmony, and rhythm agents . In Proceedings of the 12th Generative Art Conference (GA’09) . A. Eigenfeldt and P. Pasquier. 2009. A realtime generative music system using autonomous melody, harmony, and rhythm agents. In Proceedings of the 12th Generative Art Conference (GA’09).
- M. Grachten , C. E. Cancino Chacón , and G. Widmer . 2014. Analysis and prediction of expressive dynamics using Bayesian linear models . In Proceedings of the 1st International Workshop on Computer and Robotic Systems for Automatic Music Performance. 545--552 . M. Grachten, C. E. Cancino Chacón, and G. Widmer. 2014. Analysis and prediction of expressive dynamics using Bayesian linear models. In Proceedings of the 1st International Workshop on Computer and Robotic Systems for Automatic Music Performance. 545--552.
- 10.1016/j.eswa.2015.05.043 · DOI
- L. Hiller . 1989 . Lejaren Hiller: Computer Music Retrospective (1957--1985). Wergo Schallplatten. 79 pages. L. Hiller. 1989. Lejaren Hiller: Computer Music Retrospective (1957--1985). Wergo Schallplatten. 79 pages.
- 10.1162/neco.1997.9.8.1735 · DOI · Paper page
- C. Z. A. Huang and E. Chew . 2005. Palestrina pal: A grammar checker for music compositions in the style of Palestrina . In Proceedings of the 5th Conference on Understanding and Creating Music. C. Z. A. Huang and E. Chew. 2005. Palestrina pal: A grammar checker for music compositions in the style of Palestrina. In Proceedings of the 5th Conference on Understanding and Creating Music.
- S. Johnson . 2006. The long zoom. New York Times Magazine ( 2006 ), 50--55. S. Johnson. 2006. The long zoom. New York Times Magazine (2006), 50--55.
- S. Kirkpatrick C. D. Gelatt and M. P. Vecchi. 1983. Optimization by simulated annealing. Science 220 4598 (1983) 671--680. S. Kirkpatrick C. D. Gelatt and M. P. Vecchi. 1983. Optimization by simulated annealing. Science 220 4598 (1983) 671--680. · DOI · Paper page
- 10.1007/978-3-319-20603-5_33 · DOI
- 10.1162/096112100570585 · DOI · Paper page
- 10.1073/pnas.0609152103 · DOI · Paper page
- 10.1145/1128923.1128986 · DOI
- A. Lovelace . 1843. Notes on L. Menabreas sketch of the analytical engine invented by Charles Babbage , Esq.Taylors Sci. Mem. 3 ( 1843 ). A. Lovelace. 1843. Notes on L. Menabreas sketch of the analytical engine invented by Charles Babbage, Esq.Taylors Sci. Mem. 3 (1843).
- 10.1109/icec.1994.349943 · DOI
- 10.1145/361254.361265 · DOI
- 10.1162/014892601750302561 · DOI
- 10.1007/978-3-211-75540-2 · DOI · Paper page
- 10.1076/jnmr.32.3.333.16861 · DOI · Paper page
- 10.1016/j.neuroimage.2009.12.019 · DOI · Paper page
- 10.3758/bf03201171 · DOI · Paper page
- R. C. Pinkerton . 1956 . Information theory and melody. Sci . Amer. 194 , 2 (1956), 77 -- 86 . R. C. Pinkerton. 1956. Information theory and melody. Sci. Amer. 194, 2 (1956), 77--86.
- J. Pritchett . 1994. The completion of John Cage’s freeman etudes. Perspectives of New Music ( 1994 ), 264--270. J. Pritchett. 1994. The completion of John Cage’s freeman etudes. Perspectives of New Music (1994), 264--270.
- 10.1016/j.knosys.2014.08.018 · DOI
- D. E. Rumelhart G. E. Hinton and R. J. Williams. 1985. Learning Internal Representations by Error Propagation. Technical Report. DTIC Document. D. E. Rumelhart G. E. Hinton and R. J. Williams. 1985. Learning Internal Representations by Error Propagation. Technical Report. DTIC Document. · DOI · Paper page
- S. I. Sayegh. 1989. Fingering for string instruments with the optimum path paradigm. Comput. Music J. (1989) 76--84. S. I. Sayegh. 1989. Fingering for string instruments with the optimum path paradigm. Comput. Music J. (1989) 76--84. · DOI
- I. Simon , D. Morris , and S. Basu . 2008. MySong: Automatic accompaniment generation for vocal melodies . In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 725--734 . I. Simon, D. Morris, and S. Basu. 2008. MySong: Automatic accompaniment generation for vocal melodies. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 725--734.
- P. Toiviainen . 1995. Modeling the target-note technique of bebop-style jazz improvisation: An artificial neural network approach. Music Perception ( 1995 ), 399--413. P. Toiviainen. 1995. Modeling the target-note technique of bebop-style jazz improvisation: An artificial neural network approach. Music Perception (1995), 399--413.
- 10.1162/comj.2006.30.4.28 · DOI
Cited by
Items 201–265 of 265
Modeling orchestration for computer assisted analysis and human-AI co-creativity
Maccarini, F. (2024) · theses.fr (ABES) · doi:10.70675/089f90ddzf129z4de4z8c05z7bee31138c92
The Role of Artificial Intelligence (AI) in Business Transformation: A Systematic Literature Review
Niroula, N. P., & Sharma, G. (2026) · East West journal of business and social studies. · doi:10.70527/ewjbss.v14i.209
A Tutorial on Generative Models for Music AudioPreprint
Modrzejewski, M., Kurkowska, J., & Herremans, D. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.38252
Self-citationQIU, S., Shaharom, M. S. N., & Cheah, K. S. L. (2025) · TPM Testing, psychometrics, methodology in applied psychology
Hauntography: Algorithmic Presence and the Out of Joint in Music AI
Privato, N. (2026) · Opin vísindi (Opin vísindi)
İmik, O. H. (2026) · The Turkish Online Journal of Design Art and Communication · doi:10.7456/tojdac.1858350
Taxonomy of interactive music systems according to a conceptualization of rhythm
Holmgren, D. L. (2023) · KTH Publication Database DiVA (KTH Royal Institute of Technology)
Elaborating Advanced Machine Learning Techniques in the Music Class
Smailis, D., & Heliades, G. P. (2023) · European Journal of Engineering and Technology Research · doi:10.24018/ejeng.2023.1.cie.3143
Mesterséges intelligencia a zenében • Artificial Intelligence and Music
Szekanecz, M., & Szekanecz, Z. (2023) · Magyar Tudomány · doi:10.1556/2065.184.2023.8.7
Huang, C., & Kim, H. (2026) · Asia-pacific Journal of Convergent Research Interchange · doi:10.47116/apjcri.2026.08.09
Tuning Immersion and Performance with Adaptive Generative Music in VR
Wen, J., Giunchi, D., Cascarano, P., Bovo, R., Ofek, E., & Steed, A. J. (2026) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2026.3679907
Demers, L.-C. (2024) · PolyPublie (École Polytechnique de Montréal)
Li, X., & Kim, H. (2026) · Journal of Computing & Biomedical Informatics · doi:10.56979/1002/2026/1279
Video geliştirme sürecinde yapay zeka ile üretilen müziklerin kullanımına ilişkin bir vaka çalışması
Nar, Ü. N. (2025) · Istanbul Technical University Academic Open Archive (Istanbul Technical University)
Human-centered machine learning for music emotion recognition
Gómez-Cañón, J. S. (2022) · Repositori digital de la UPF (Universitat Pompeu Fabra)
Rojas-Morales, N. (2025) · Lecture notes in computer science · doi:10.1007/978-3-031-90167-6_26
The Reconstruction of Artistic Subjectivity and Its Ethical Issues in AI-Based Music Composition
Ni, C. (2026) · Applied Science and Innovative Research · doi:10.22158/asir.v10n3p46
MusÆ: an Adversarial Autoencoder for Music
Valenti, A. (2019) · Electronic Theses and Dissertations Repository (University of Pisa)
Deep Graph Representations for Polyphonic Multitrack Music Generation
Cosenza, E. (2022) · Electronic Theses and Dissertations Repository (University of Pisa)
Bridging the Gap: Blending Classical Composition Techniques with Modern Music Tech
Duarte, E. (2025) · INTERNATIONAL JOURNAL OF CREATIVE RESEARCH THOUGHTS · doi:10.56975/ijcrt.v13i7.290516
Evo* 2025 -- Late-Breaking Abstracts VolumePreprint
Mora, A. M., Esparcia-Alcázar, A. I., & Cruz, M. S. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2511.17543
Harmonization and evaluation. Tweaking the parameters on human listeners
Carnovalini, F., Pelizzo, A., Rodà, A., & Canazza, S. (2022) · International Conference on Kansei Engineering and Emotion Research (KEER) · doi:10.5821/conference-9788419184849.36
The Theory and Analysis of Computer-Generated Music: A Case-Study of Colossus
Jan, S. (2018) · Huddersfield Research Portal (University of Huddersfield)
Carvalho, N. (2020) · Portuguese National Funding Agency for Science, Research and Technology (RCAAP Project by FCT) · doi:10.34626/vpmq-c334
Automatically calculating tonal tension
Marcos, G. R., Willis, A., & Laney, R. (2020) · Open Research Online (The Open University) · doi:10.5281/zenodo.4285393
AN INVESTIGATION INTO THE USES OF MACHINE LEARNING FOR ELECTRONIC SOUND SYNTHESIS
Metters, L. (2021) · PEARL (University of Plymouth) · doi:10.24382/1196
More Than an Instrument: Improvising with failing playback media
Higgins, J. (2021) · Organised Sound · doi:10.1017/s1355771821000108
Learned String Quartet Music with Variational Auto Encoder
Chen, Y.-L., Huang, H. I., & Yen, T.-T. (2023) · Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC) · doi:10.1109/apsipaasc58517.2023.10317246
Analysis of the Similarity Estimation Schemes for Music and Applications
Chen, Y., & Li, N. (2023) · International Journal of Education Culture and Society · doi:10.11648/j.ijecs.20230806.16
Kang, H. (2025) · Applied Mathematics and Nonlinear Sciences · doi:10.2478/amns-2025-0603
MUSİQİ SAHƏSİNDƏ SÜNİ İNTELLEKT TEXNOLOGİYALARI: İNQİLABİ DƏYİŞİKLİKLƏR VƏ YENİ ÇAĞIRIŞLAR
Elm və Təhsil Nazirliyi nəzdində İnformasiya Texnologiyaları İnstitutu Bakı, A., & Daşdəmirova, K. (2025) · Müasir incəsənət məkanında süni intellekt: problemlər və perspektivlər Beynəlxalq elmi-nəzəri konfransı · doi:10.25045/asucaai.2025.54
Deep Learning to Generate Pop Music Instrumentals Based on a Hybrid CNN-Transformer Model
Zhu, Q. (2025) · Applied and Computational Engineering · doi:10.54254/2755-2721/2025.tj23298
Music education in the age of AI: What educators and creators need to know
Duarte, E. (2025) · International Journal of Science and Research Archive · doi:10.30574/ijsra.2025.16.1.1979
Higgins, J. (2021) · City Research Online (City University London)
Beckert, A. (2021) · Cvut DSpace (Czech Technical University)
Fredriksson, T. (2024) · University Library of Skövde (University of Skövde)
El videoclip com a eina cultural : de l'anàlisi al resultat creatiu amb música generada per IA
López Encinas, E., & de la Comunicació, U. A. D. B. F. D. C. (2025) · Dipòsit Digital de Documents de la UAB (Universitat Autònoma de Barcelona)
compositor algorítmico de música con sistema de creación de reglas para la melodía
Molina, G. J. N. (2020) · LA Referencia (Red Federada de Repositorios Institucionales de Publicaciones Científicas)
Generatiiviset kieliopit algoritmisessa säveltämisessä
Vienamo, A. (2024) · Tampere University Institutional Repository (Tampere University)
Medina, J. M. (2025) · Revista de Derecho, Empresa y Sociedad (REDS) · doi:10.14679/48670
Eraslan, İ. (2026) · Journal of Intelligent Systems Theory and Applications · doi:10.38016/jista.1691406
Temps et durée : de la programmation réactive synchrone à la composition musicale
Petit, B. (2020) · theses.fr (ABES) · doi:10.70675/866d1bb9z78dbz428bzb71fza43b52fa8a3d
The integration of creative programming in experimental music and digital art
Pratt, M. (2023) · Open University of Cape Town (University of Cape Town)
Generation of Chord Progressions using Guided Markov Chains
Berger, S. (2026) · MusMat Brazilian Journal of Music and Mathematics · doi:10.46926/musmat.2026v10.13-53
MUSICAL TIME IN ALGORITHMIC AND AI-GENERATED MUSIC: FROM DETERMINISTIC TO EMERGENT TEMPORALITY
Cherevko, K. (2026) · Studia Universitatis Babeş-Bolyai Musica · doi:10.24193/subbmusica.2026.1.13
Reintegrating Wisdom: A Cultural-Sciences Framework for Linking Music, Faith, and STEM Education
Auh, Y., Cho, M., & Hwang, S.-E. (2026) · Index of Texas Archaeology Open Access Grey Literature from the Lone Star State
Examining the Use of Artificial Intelligence in Music Production Among Musicians in Zimbabwe
Sithokozile, S. (2026) · International Journal of Research and Innovation in Social Science · doi:10.47772/ijriss.2026.100601156
Landívar, M. B. N. (2026) · Prisma ODS Revista Multidisciplinaria sobre Desarrollo Sostenible · doi:10.65011/prismaods.v5.i3.298
Bhandari, S., & Soumya (2026) · International Journal of Innovative Research in Technology · doi:10.64643/ijirtv12i12-206820-459
La Inteligencia Artificial Generativa aplicada a proyectos musicales
Muñoz, Á. G. (2026) · UVaDOC UVaDOC University of Valladolid Documentary Repository (University of Valladolid)
Authenticity, Ethics, and Public Acceptance in AI-Generated Music: An Integrative Review
Sulistioyuwono, A. B., Narimawati, U., & Kurniawan, B. (2026) · Inkubis Jurnal Ekonomi dan Bisnis · doi:10.59261/inkubis.v8i2.356
Chen, Z. (2026) · IEEE International Conference on Electronics, Energy Systems and Power Engineering (EESPE) · doi:10.1109/eespe68405.2026.11648903
The Role of Artificial Intelligence in Transforming Music Education
Masaa, R., & Mochere, J. M. (2026) · Kabarak journal of research and innovation. · doi:10.58216/kjri.v16i2.624
Algorithms for evaluating creative player actions in game simulators
Вишнівська, В. В., & Коваленко, О. О. (2026) · Repository of Vinnytsia National Technical University (Vinnytsia National Technical University)
LSTM-Based Procedural Symbolic Music Generation Using Sequential MIDI Pitch Modeling
Karabacak, N. (2026) · International Conference on Industrial Engineering and Operations Management (IEOM) · doi:10.46254/an16.20260287
Akande, S. O., & Adeyeye, A. O. (2026) · City State Journal
AI IN CREATIVE INDUSTRIES: GENERATING ART AND MUSIC THROUGH COMPUTATIONAL CREATIVITY
Shah, A. (2025) · Computer Science Bulletin · doi:10.71465/csb147
Pavlíček, J., & Pelikán, M. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.22416
Interactive violin music generation using LSTM and transformer
Song, J., & Liang, C. (2026) · International Journal of Information and Communication Technology · doi:10.1504/ijict.2026.157488
Mahmood, T. (2025) · Journal of Zankoy Sulaimani Part (B - for Humanities) · doi:10.17656/jzsb.11724
Narrative Suspense as Musical Tension: Composing Film Music From Video
Braga, F., Correia, N. M. R., Bernardes, G., & Dannenberg, R. B. (2026) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3767308.3835878
Pavlíček, J., Pavlíčková, P., & Molhanec, M. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2611.20111
Wu, S., Wu, W., Li, S., Zhong, C., Huang, Z., & Zhang, K. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2611.19203
Metadata
- Authors
- Herremans, D., Chuan, C.-H., & Chew, E.
- Affiliations
- Agency for Science, Technology and Research (SG)
- University of North Florida (US)
- Queen Mary University of London (GB)
- Venue
- ACM Computing Surveys
- Published
- 2017-09-26
- Volume
- 50
- Issue
- 5
- Pages
- 1-30
- ISSN
- 0360-0300 (ISSN-L)
- 1557-7341
- OpenAlex
- W2758804652
- Cited by
- 160
- References
- 179
- Citations by year
- 2026: 21 · 2025: 22 · 2024: 20 · 2023: 18 · 2022: 18 · 2021: 20 · 2020: 14 · 2019: 7 · 2018: 18 · 2017: 2
- FWCI
- 4.59
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- ACM Computing Surveys (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- University of North Florida Digital Commons (University of North Florida) (submittedVersion)
- Queen Mary Research Online (Queen Mary University of London) (submittedVersion)
- arXiv (Cornell University)
- Funders
- EU (658914)
- Topics
- Social Sciences › Arts and Humanities › Music › Music Technology and Sound Studies
- Physical Sciences › Computer Science › Signal Processing › Music and Audio Processing
- Social Sciences › Arts and Humanities › Music › Musicology and Musical Analysis
- Keywords
- automatic music composition, functional classification, system classification, societal challenges
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.