The DOI matches its Crossref record; 12 of the 12 references it cites were found in a registry or an index.
Pop Music Transformer: Beat-based Modeling and Generation of Expressive Pop Piano Compositions
Abstract
A great number of deep learning based models have been recently proposed for automatic music composition. Among these models, the Transformer stands out as a prominent approach for generating expressive classical piano performance with a coherent structure of up to one minute. The model is powerful in that it learns abstractions of data on its own, without much human-imposed domain knowledge or constraints. In contrast with this general approach, this paper shows that Transformers can do even better for music modeling, when we improve the way a musical score is converted into the data fed to a Transformer model. In particular, we seek to impose a metrical structure in the input data, so that Transformers can be more easily aware of the beat-bar-phrase hierarchical structure in music. The new data representation maintains the flexibility of local tempo changes, and provides hurdles to control the rhythmic and harmonic structure of music. With this approach, we build a Pop Music Transformer that composes Pop piano music with better rhythmic structure than existing Transformer models.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Transformer-XL: Attentive language models beyond a fixed-length context
Dai, Z., Yang, Z., Yang, Y., Carbonell, J., Le, Q., & Salakhutdinov, R. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1285 · Cited by 3,169
Self-citationSelf-Attention with Relative Position Representations
Shaw, P., Uszkoreit, J., & Vaswani, A. (2018) · Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 2 (Short Papers) · doi:10.18653/v1/n18-2074 · Cited by 2,505
Generating Long Sequences with Sparse Transformers
Child, R., Gray, S., Radford, A., & Sutskever, I. (2019) · arXiv · doi:10.48550/arxiv.1904.10509 · Cited by 1,063
Music emotion recognition: the role of individuality
Yang, Y.-H., Su, Y.-F., Lin, Y.-C., & Chen, H. H. (2007) · Proceedings of the international workshop on Human-centered multimedia · doi:10.1145/1290128.1290132 · Cited by 295
Self-citationDeep Learning Techniques for Music Generation
Briot, J.-P., Hadjeres, G., & Pachet, F.-D. (2020) · Computational Synthesis and Creative Systems · doi:10.1007/978-3-319-70163-9 · Cited by 252
This time with feeling: learning expressive musical performance
Oore, S., Simon, I., Dieleman, S., Eck, D., & Simonyan, K. (2020) · Neural Computing and Applications · doi:10.1007/s00521-018-3758-9 · Cited by 212
Bifurcations in the learning of recurrent neural networks
Doya, K. (2003) · IEEE International Symposium on Circuits and Systems proceedings · doi:10.1109/iscas.1992.230622 · Cited by 138
Tree Transformer: Integrating Tree Structures into Self-Attention
Wang, Y.-S., Lee, H.-Y., & Chen, Y.-N. (2019) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d19-1098 · Cited by 131
Computational Intelligence in Music Composition: A Survey
Liu, C., & Ting, C.-K. (2016) · IEEE Transactions on Emerging Topics in Computational Intelligence · doi:10.1109/tetci.2016.2642200 · Cited by 83
Frühauf, J., Kopiez, R., & Platz, F. (2013) · Musicae Scientiae · doi:10.1177/1029864913486793 · Cited by 81
Cited by
A comprehensive survey on pretrained foundation models: a history from BERT to ChatGPT
Zhou, C., Li, Q., Li, C., Yu, J., Liu, Y., Wang, G., Zhang, K., Ji, C., Yan, Q., He, L., et al. (2025) · International Journal of Machine Learning and Cybernetics · doi:10.1007/s13042-024-02443-6 · Cited by 557
MetaFormer Baselines for Vision
Yu, W., Si, C., Zhou, P., Luo, M., Zhou, Y., Feng, J., Yan, S., & Wang, X. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3329173 · Cited by 331
Sparks of Large Audio Models: A Survey and Outlook
Latif, S., Shoukat, M., Shamshad, F., Usama, M., Ren, Y., Cuayáhuitl, H., Wang, W., Zhang, X., Togneri, R., Cambria, E., et al. (2023) · arXiv · doi:10.48550/arxiv.2308.12792 · Cited by 17
“For the music generation phase, the REMI-like technique [234] was employed to convert MIDI into token sequences.”
Method
Metadata
- Authors
- Huang, Y.-S., & Yang, Y.-H.
- Venue
- Proceedings of the 28th ACM International Conference on Multimedia
- Publisher
- ACM
- Published
- 2020-10-12
- Pages
- 1180-1188
- OpenAlex
- W3092879656
- Cited by
- 261
- References
- 12
- FWCI
- 8.44
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Pop Music Transformer: Beat-based Modeling and Generation of Expressive Pop Piano Compositions. https://app.cochat.ai/papers/10.1145/3394171.3413671
- The paper
- Huang, Y.-S., & Yang, Y.-H. (2020). Pop Music Transformer: Beat-based Modeling and Generation of Expressive Pop Piano Compositions. Proceedings of the 28th ACM International Conference on Multimedia. https://doi.org/10.1145/3394171.3413671
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.