A Functional Taxonomy of Music Generation Systems
Open accessThe DOI matches its Crossref record; 165 of the 179 references it cites were found in a registry or an index.
Abstract
Digital advances have transformed the face of automatic music generation since its beginnings at the dawn of computing. Despite the many breakthroughs, issues such as the musical tasks targeted by different machines and the degree to which they succeed remain open questions. We present a functional taxonomy for music generation systems with reference to existing systems. The taxonomy organizes systems according to the purposes for which they were designed. It also reveals the inter-relatedness amongst the systems. This design-centered approach contrasts with predominant methods-based surveys and facilitates the identification of grand challenges to set the stage for new breakthroughs.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“AI music research has focused more on modelling musical aspects such as melody or timbre [51,53], with most AI tools affording limited interactivity [12].”
From Reflection Across AI-based Music Composition (2024) · cites this paper as [51]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
Holland, J. H. (1992) · The MIT Press eBooks · doi:10.7551/mitpress/1090.001.0001 · Cited by 47,002
Optimization by Simulated Annealing
Kirkpatrick, S., Gelatt, C. D., & Vecchi, M. P. (1983) · Science · doi:10.1126/science.220.4598.671 · Cited by 45,134
Learning representations by back-propagating errors
Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1986) · Nature · doi:10.1038/323533a0 · Cited by 31,892
A logical calculus of the ideas immanent in nervous activity
McCulloch, W. S., & Pitts, W. (1943) · The Bulletin of Mathematical Biophysics · doi:10.1007/bf02478259 · Cited by 18,566
Learning Internal Representations by Error Propagation
Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1985) · doi:10.21236/ada164453 · Cited by 16,172
Learning long-term dependencies with gradient descent is difficult
Bengio, Y., Simard, P., & Frasconi, P. (1994) · IEEE Transactions on Neural Networks · doi:10.1109/72.279181 · Cited by 8,542 · cited 1×
“It remains a challenge, however, to efficiently train long term dependencies (Bengio et al. 1994).”
BackgroundAttitudinal Effects of Mere Exposure
Zajonc, R. B. (1968) · Journal of Personality and Social Psychology · doi:10.1037/h0025848 · Cited by 6,745
Proceedings of the 25th international conference on Machine learning - ICML '08
(2008) · doi:10.1145/1390156 · Cited by 6,680
Statistical Inference for Probabilistic Functions of Finite State Markov Chains
Baum, L. E., & Petrie, T. (1966) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177699147 · Cited by 2,775
Research works printed but not linked: 36
- G. Assayag , G. Bloch , and M. Chemillier . 2006 . OMax-ofon. Proceedings of the Conference on Sound and Music Computing (SMC’06) . G. Assayag, G. Bloch, and M. Chemillier. 2006. OMax-ofon. Proceedings of the Conference on Sound and Music Computing (SMC’06).
- J. A. Biles . 2001 . Autonomous GenJam: Eliminating the fitness bottleneck by eliminating fitness . In Proceedings of the GECCO-2001 Workshop on Non-routine Design with Evolutionary Systems. Morgan Kaufmann , San Francisco, CA. J. A. Biles. 2001. Autonomous GenJam: Eliminating the fitness bottleneck by eliminating fitness. In Proceedings of the GECCO-2001 Workshop on Non-routine Design with Evolutionary Systems. Morgan Kaufmann, San Francisco, CA.
- 10.5555/1533570.1533638 · doi:10.5555/1533570.1533638
- 10.5555/1434875 · doi:10.5555/1434875
- D. Conklin . 2003 . Music generation from statistical models . In Proceedings of the AISB Symposium on Artificial Intelligence and Creativity in the Arts and Sciences. Aberystwyth, Wales, 30--35 . D. Conklin. 2003. Music generation from statistical models. In Proceedings of the AISB Symposium on Artificial Intelligence and Creativity in the Arts and Sciences. Aberystwyth, Wales, 30--35.
- N. Cunha , A. Subramanian , and D. Herremans . 2016. Uma abordagem baseada em programação linear inteira para a geração de solos de guitarra . XLVIII Simpósio Brasileiro de Pesquisa Operacional (SBPO) (09/2016 2016 ). N. Cunha, A. Subramanian, and D. Herremans. 2016. Uma abordagem baseada em programação linear inteira para a geração de solos de guitarra. XLVIII Simpósio Brasileiro de Pesquisa Operacional (SBPO) (09/2016 2016).
- E. Deruty . 2016 . Goal-oriented mixing . In Proceedings of the 2nd AES Workshop on Intelligent Music Production , Vol. 13 . London. E. Deruty. 2016. Goal-oriented mixing. In Proceedings of the 2nd AES Workshop on Intelligent Music Production, Vol. 13. London.
- A. Eigenfeldt and P. Pasquier . 2009. A realtime generative music system using autonomous melody, harmony, and rhythm agents . In Proceedings of the 12th Generative Art Conference (GA’09) . A. Eigenfeldt and P. Pasquier. 2009. A realtime generative music system using autonomous melody, harmony, and rhythm agents. In Proceedings of the 12th Generative Art Conference (GA’09).
- 19. A.R.J. François, E. Chew, and D. Thurmond. 2007. Visual feedback in performermachine interaction for musical improvisation. In Proceedings of the 7 th international conference on New interfaces for musical expression . ACM, 277-280.
- M. Grachten , C. E. Cancino Chacón , and G. Widmer . 2014. Analysis and prediction of expressive dynamics using Bayesian linear models . In Proceedings of the 1st International Workshop on Computer and Robotic Systems for Automatic Music Performance. 545--552 . M. Grachten, C. E. Cancino Chacón, and G. Widmer. 2014. Analysis and prediction of expressive dynamics using Bayesian linear models. In Proceedings of the 1st International Workshop on Computer and Robotic Systems for Automatic Music Performance. 545--552.
- 10.1016/j.eswa.2015.05.043 · DOI
- L. Hiller . 1989 . Lejaren Hiller: Computer Music Retrospective (1957--1985). Wergo Schallplatten. 79 pages. L. Hiller. 1989. Lejaren Hiller: Computer Music Retrospective (1957--1985). Wergo Schallplatten. 79 pages.
- 10.1162/neco.1997.9.8.1735 · DOI · Paper page
- C. Z. A. Huang and E. Chew . 2005. Palestrina pal: A grammar checker for music compositions in the style of Palestrina . In Proceedings of the 5th Conference on Understanding and Creating Music. C. Z. A. Huang and E. Chew. 2005. Palestrina pal: A grammar checker for music compositions in the style of Palestrina. In Proceedings of the 5th Conference on Understanding and Creating Music.
- S. Johnson . 2006. The long zoom. New York Times Magazine ( 2006 ), 50--55. S. Johnson. 2006. The long zoom. New York Times Magazine (2006), 50--55.
- S. Kirkpatrick C. D. Gelatt and M. P. Vecchi. 1983. Optimization by simulated annealing. Science 220 4598 (1983) 671--680. S. Kirkpatrick C. D. Gelatt and M. P. Vecchi. 1983. Optimization by simulated annealing. Science 220 4598 (1983) 671--680. · DOI · Paper page
- 10.1007/978-3-319-20603-5_33 · DOI
- 10.1162/096112100570585 · DOI · Paper page
- 10.1073/pnas.0609152103 · DOI · Paper page
- 10.1145/1128923.1128986 · DOI
- A. Lovelace . 1843. Notes on L. Menabreas sketch of the analytical engine invented by Charles Babbage , Esq.Taylors Sci. Mem. 3 ( 1843 ). A. Lovelace. 1843. Notes on L. Menabreas sketch of the analytical engine invented by Charles Babbage, Esq.Taylors Sci. Mem. 3 (1843).
- 10.1109/icec.1994.349943 · DOI
- 10.1145/361254.361265 · DOI
- 10.1162/014892601750302561 · DOI
- 10.1007/978-3-211-75540-2 · DOI · Paper page
- 10.1076/jnmr.32.3.333.16861 · DOI · Paper page
- 10.1016/j.neuroimage.2009.12.019 · DOI · Paper page
- 10.3758/bf03201171 · DOI · Paper page
- R. C. Pinkerton . 1956 . Information theory and melody. Sci . Amer. 194 , 2 (1956), 77 -- 86 . R. C. Pinkerton. 1956. Information theory and melody. Sci. Amer. 194, 2 (1956), 77--86.
- J. Pritchett . 1994. The completion of John Cage’s freeman etudes. Perspectives of New Music ( 1994 ), 264--270. J. Pritchett. 1994. The completion of John Cage’s freeman etudes. Perspectives of New Music (1994), 264--270.
- 10.1016/j.knosys.2014.08.018 · DOI
- D. E. Rumelhart G. E. Hinton and R. J. Williams. 1985. Learning Internal Representations by Error Propagation. Technical Report. DTIC Document. D. E. Rumelhart G. E. Hinton and R. J. Williams. 1985. Learning Internal Representations by Error Propagation. Technical Report. DTIC Document. · DOI · Paper page
- S. I. Sayegh. 1989. Fingering for string instruments with the optimum path paradigm. Comput. Music J. (1989) 76--84. S. I. Sayegh. 1989. Fingering for string instruments with the optimum path paradigm. Comput. Music J. (1989) 76--84. · DOI
- I. Simon , D. Morris , and S. Basu . 2008. MySong: Automatic accompaniment generation for vocal melodies . In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 725--734 . I. Simon, D. Morris, and S. Basu. 2008. MySong: Automatic accompaniment generation for vocal melodies. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 725--734.
- P. Toiviainen . 1995. Modeling the target-note technique of bebop-style jazz improvisation: An artificial neural network approach. Music Perception ( 1995 ), 399--413. P. Toiviainen. 1995. Modeling the target-note technique of bebop-style jazz improvisation: An artificial neural network approach. Music Perception (1995), 399--413.
- 10.1162/comj.2006.30.4.28 · DOI
Cited by
Ji, S., Yang, X., & Luo, J. (2023) · ACM Computing Surveys · doi:10.1145/3597493 · Cited by 220
This time with feeling: learning expressive musical performance
Oore, S., Simon, I., Dieleman, S., Eck, D., & Simonyan, K. (2020) · Neural Computing and Applications · doi:10.1007/s00521-018-3758-9 · Cited by 212
Ji, S., Luo, J., & Yang, X. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2011.06801 · Cited by 203
Machine learning research that matters for music creation: A case study
Sturm, B. L. T., Ben‐Tal, O., Monaghan, Ú., Collins, N., Herremans, D., Chew, E., Hadjeres, G., Deruty, E., & Pachet, F. (2018) · Journal of New Music Research · doi:10.1080/09298215.2018.1515233 · Cited by 165
Self-citationAI-Based Affective Music Generation Systems: A Review of Methods and Challenges
Dash, A., & Agres, K. (2024) · ACM Computing Surveys · doi:10.1145/3672554 · Cited by 163
Metadata
- Authors
- Herremans, D., Chuan, C.-H., & Chew, E.
- Affiliations
- Agency for Science, Technology and Research (SG)
- University of North Florida (US)
- Queen Mary University of London (GB)
- Venue
- ACM Computing Surveys
- Published
- 2017-09-26
- Volume
- 50
- Issue
- 5
- Pages
- 1-30
- ISSN
- 0360-0300 (ISSN-L)
- 1557-7341
- OpenAlex
- W2758804652
- Cited by
- 160
- References
- 179
- Citations by year
- 2026: 21 · 2025: 22 · 2024: 20 · 2023: 18 · 2022: 18 · 2021: 20 · 2020: 14 · 2019: 7 · 2018: 18 · 2017: 2
- FWCI
- 4.59
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- ACM Computing Surveys (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- University of North Florida Digital Commons (University of North Florida) (submittedVersion)
- Queen Mary Research Online (Queen Mary University of London) (submittedVersion)
- arXiv (Cornell University)
- Funders
- EU (658914)
- Topics
- Social Sciences › Arts and Humanities › Music › Music Technology and Sound Studies
- Physical Sciences › Computer Science › Signal Processing › Music and Audio Processing
- Social Sciences › Arts and Humanities › Music › Musicology and Musical Analysis
- Keywords
- automatic music composition, functional classification, system classification, societal challenges
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.