CoChat
Sign Up
PreprintCited by 103Music Technology and Sound StudiesMusic and Audio ProcessingMusicology and Musical Analysis

Counterpoint by Convolution

Open access
Huang, Cheng-Zhi Anna, Cooijmans, Tim, Roberts, Adam, Courville, Aaron, Eck, Douglas·2019·arXiv
DOI 10.48550/arxiv.1903.07227arXiv 1903.07227
Open this paper in CoChat — free accountOpen PDF

Abstract

Machine learning models of music typically break up the task of composition into a chronological process, composing a piece of music in a single pass from beginning to end. On the contrary, human composers write music in a nonlinear fashion, scribbling motifs here and there, often revisiting choices previously made. In order to better approximate this process, we train a convolutional neural network to complete partial musical scores, and explore the use of blocked Gibbs sampling as an analogue to rewriting. Neither the model nor the generative procedure are tied to a particular causal direction of composition. Our model is an instance of orderless NADE (Uria et al., 2014), which allows more direct ancestral sampling. However, we find that Gibbs sampling greatly improves sample quality, which we demonstrate to be due to some conditional distributions being poorly modeled. Moreover, we show that even the cheap approximate blocked Gibbs procedure from Yao et al. (2014) yields better samples than ancestral sampling, based on both log-likelihood and human evaluation.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.1903.07227

Cites

10 of 10 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Individuals partly blame AI rather than attributing all responsibility to their conversation partners.

    “where research shows individuals partly blame AI rather than attributing all responsibility to their conversation partners [36].”

    From Exploring the Collaborative Co-Creation Process with AI: A Case Study in Novice Music Production (2025) · cites this paper as [34]

    The Human Evaluations section (p. 6) reports listeners’ judgments of how Bach-like generated music sounds, not judgments of responsibility. Searches for blame, responsibility attribution, and conversation partners found no passage addressing the claim. (LLM, conf=0.78)

    Experimental — accuracy not yet measured

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 27

  1. [1][1] Moray Allan and Christopher KI Williams. Harmonising chorales by probabilistic inference. Advances in neural information processing systems , 17:25-32, 2005. -
  2. [2][2] Leonard E Baum and Ted Petrie. Statistical inference for probabilistic functions of finite state markov chains. The annals of mathematical statistics , 37(6):15541563, 1966. -
  3. [5][5] Darrell Conklin. Music generation from statistical models. In Proceedings of the AISB 2003 Symposium on Artificial Intelligence and Creativity in the Arts and Sciences , pages 30-35. Citeseer, 2003. -
  4. [8][8] Jose D Fern´ andez and Francisco Vico. Ai methods in algorithmic composition: A comprehensive survey. Journal of Artificial Intelligence Research , 48:513582, 2013. -
  5. [10][10] Leon A Gatys, Alexander S Ecker, and Matthias Bethge. A neural algorithm of artistic style. arXiv preprint arXiv:1508.06576 , 2015. - · arXiv
  6. [12][12] Ian Goodfellow, Mehdi Mirza, Aaron Courville, and Yoshua Bengio. Multi-prediction deep boltzmann machines. In Advances in Neural Information Processing Systems , pages 548-556, 2013. -
  7. [13][13] Ga¨ etan Hadjeres and Franc ¸ois Pachet. Deepbach: a steerable model for bach chorales generation. arXiv preprint arXiv:1612.01010 , 2016. - · arXiv
  8. [14][14] Ga¨ etan Hadjeres, Jason Sakellariou, and Franc ¸ois Pachet. Style imitation and chord invention in polyphonic music with exponential families. arXiv preprint arXiv:1609.05152 , 2016. - · arXiv
  9. [15][15] Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. Deep residual learning for image recognition. arXiv preprint arXiv:1512.03385 , 2015. - · arXiv
  10. [16][16] Dorien Herremans and Kenneth S¨ orensen. Composing first species counterpoint with a variable neighbourhood search algorithm. Journal of Mathematics and the Arts , 6(4):169-189, 2012. -
  11. [17][17] Dorien Herremans and Kenneth S¨ orensen. Composing fifth species counterpoint music with a variable neighborhood search algorithm. Expert systems with applications , 40(16):6427-6437, 2013. -
  12. [19][19] Geoffrey E Hinton, Simon Osindero, and Yee-Whye Teh. A fast learning algorithm for deep belief nets. Neural computation , 18(7):1527-1554, 2006. -
  13. [20][20] Ferenc Husz´ ar. How (not) to train your generative model: Scheduled sampling, likelihood, adversary? arXiv preprint arXiv:1511.05101 , 2015. - · arXiv
  14. [21][21] Sergey Ioffe and Christian Szegedy. Batch normalization: Accelerating deep network training by reducing internal covariate shift. arXiv preprint arXiv:1502.03167 , 2015. - · arXiv
  15. [22][22] Diederik Kingma and Jimmy Ba. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980 , 2014. - · arXiv
  16. [23][23] Alex Krizhevsky, Ilya Sutskever, and Geoffrey E Hinton. Imagenet classification with deep convolutional neural networks. In Advances in neural information processing systems , pages 1097-1105, 2012. -
  17. [26][26] Stefan Lattner, Maarten Grachten, and Gerhard Widmer. Imposing higher-level structure in polyphonic music generation using convolutional restricted boltzmann machines and constraints. arXiv preprint arXiv:1612.04742 , 2016. - · arXiv
  18. [27][27] Feynman Liang. Bachbot: Automatic composition in the style of bach chorales. Masters thesis, University of Cambridge , 2016. -
  19. [30][30] Franc ¸ois Pachet and Pierre Roy. Musical harmonization with constraints: A survey. Constraints , 6(1):7-19, 2001. -
  20. [31][31] David E Rumelhart, Geoffrey E Hinton, and Ronald J Williams. Learning representations by backpropagating errors. Cognitive modeling , 5(3):1, 1988. -
  21. [33][33] Robert H Swendsen and Jian-Sheng Wang. Nonuniversal critical dynamics in monte carlo simulations. Physical review letters , 58(2):86, 1987. -
  22. [34][34] Lucas Theis, A¨ aron van den Oord, and Matthias Bethge. A note on the evaluation of generative models. arXiv preprint arXiv:1511.01844 , 2015. - · arXiv
  23. [35][35] Benigno Uria, Marc-Alexandre Cˆ ot´ e, Karol Gregor, Iain Murray, and Hugo Larochelle. Neural autoregressive distribution estimation. arXiv preprint arXiv:1605.02226 , 2016. - · arXiv
  24. [37][37] Aaron van den Oord, Sander Dieleman, Heiga Zen, Karen Simonyan, Oriol Vinyals, Alex Graves, Nal Kalchbrenner, Andrew Senior, and Koray Kavukcuoglu. Wavenet: A generative model for raw audio. arXiv preprint arXiv:1609.03499 , 2016. - · arXiv
  25. [38][38] Aaron van den Oord, Nal Kalchbrenner, and Koray Kavukcuoglu. Pixel recurrent neural networks. In Proceedings of The 33rd International Conference on Machine Learning , pages 1747-1756, 2016. -
  26. [39][39] Arun Venkatraman, Martial Hebert, and J Andrew Bagnell. Improving multi-step prediction of learned time series models. In AAAI , pages 3024-3030, 2015. -
  27. [40][40] Li Yao, Sherjil Ozair, Kyunghyun Cho, and Yoshua Bengio. On the equivalence between deep nade and generative stochastic networks. In Joint European Conference on Machine Learning and Knowledge Discovery in Databases , pages 322-336. Springer, 2014.

Cited by

Sorted by citations

Related

Authors
Huang, C.-Z. A., Cooijmans, T., Roberts, A., Courville, A., & Eck, D.
Affiliations
  • Harvard University (US)
  • European Organization for Nuclear Research (CH)
  • Google (United States) (US)
  • Université de Montréal (CA)
ORCID
Venue
arXiv
Publisher
arXiv
Published
2019
Pages
211-218
ISSN
2331-8422 (ISSN-L)
DOI
10.48550/arxiv.1903.07227
arXiv
1903.07227
OpenAlex
W2753868141
Cited by
100
References
10
Citations by year
2025: 1 · 2024: 8 · 2023: 11 · 2022: 10 · 2021: 19 · 2020: 21 · 2019: 14 · 2018: 15 · 2017: 1
Type
posted content
Language
en
Open access
Licence
arxiv.org/licenses/nonexclusive-distrib/1.0/
Locations
  • arXiv (Cornell University) (submittedVersion)
  • Zenodo (CERN European Organization for Nuclear Research) (submittedVersion, other-oa)
  • arXiv (Cornell University)
  • Zenodo (CERN European Organization for Nuclear Research) (cc-by)
Topics
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Music Technology and Sound Studies
  • Physical Sciences › Computer Science › Signal Processing › Music and Audio Processing
  • Social Sciences › Arts and Humanities › Music › Musicology and Musical Analysis
Keywords
music composition, counterpoint, convolutional neural networks, conditional distributions, music generation

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review