Novice-AI Music Co-Creation via AI-Steering Tools for Deep Generative Models
Open accessThe DOI matches its Crossref record; 36 of the 37 references it cites were found in a registry or an index.
Abstract
While generative deep neural networks (DNNs) have demonstrated their capacity for creating novel musical compositions, less attention has been paid to the challenges and potential of co-creating with these musical AIs, especially for novices. In a needfinding study with a widely used, interactive musical AI, we found that the AI can overwhelm users with the amount of musical content it generates, and frustrate them with its non-deterministic output. To better match co-creation needs, we developed AI-steering tools, consisting of Voice Lanes that restrict content generation to particular voices; Example-Based Sliders to control the similarity of generated content to an existing example; Semantic Sliders to nudge music generation in high-level directions (happy/sad, conventional/surprising); and Multiple Alternatives of generated content to audition and choose from. In a summative study (N=21), we discovered the tools not only increased users' trust, control, comprehension, and sense of collaboration with the AI, but also contributed to a greater sense of self-efficacy and ownership of the composition relative to the AI.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures




Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Creative industries employ vision-aligned proactive and semiproactive agency.”
From Exploring Collaboration Patterns and Strategies in Human-AI Co-creation through the Lens of Agency: A Scoping Review of the Top-tier HCI Literature (2025) · cites this paper as [109]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Mapping interaction flows reveals prevalent patterns and underexplored areas, such as the sparse use of 'Auditory Interaction' [84, 109, 164], signaling innovation opportunities in domains like assistive technology or music co-creation.”
From Exploring Collaboration Patterns and Strategies in Human-AI Co-creation through the Lens of Agency: A Scoping Review of the Top-tier HCI Literature (2025) · cites this paper as [109]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“AI agency patterns are typically co-operative or semi-active [66, 191], often involving a shared or dynamically negotiated locus of control [8, 47, 109].”
From Exploring Collaboration Patterns and Strategies in Human-AI Co-creation through the Lens of Agency: A Scoping Review of the Top-tier HCI Literature (2025) · cites this paper as [109]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The locus of control can be dynamic, shifting between human guidance and AI generation [8, 109], often operating at a fine granularity for detailed adjustments [208].”
From Exploring Collaboration Patterns and Strategies in Human-AI Co-creation through the Lens of Agency: A Scoping Review of the Top-tier HCI Literature (2025) · cites this paper as [109]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“In contrast to software engineering, other domains including Human-Computer Interaction (HCI), organization and business management, and cognitive science have explored the impact of LLMs on creativity.”
From The Impact of Generative AI on Creativity in Software Development: A Research Agenda (2025) · cites this paper as [77]
Experimental — accuracy not yet measured
1 more claim about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Using thematic analysis in psychology
Braun, V., & Clarke, V. (2006) · Qualitative Research in Psychology · doi:10.1191/1478088706qp063oa · Cited by 194,414
Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing
Benjamini, Y., & Hochberg, Y. (1995) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1995.tb02031.x · Cited by 109,482 · cited 1×
“To analyze the quantitative measures, we conducted paired t-tests using Benjamani-Hochberg correction [3] to account for the 15 planned-comparisons (using a false discovery rate Q = 0 .”
MethodDevelopment of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research
(1988) · Advances in Psychology · doi:10.1016/s0166-4115(08)62386-9 · Cited by 15,003 · cited 2×
“Effort: Users answered the effort question of the NASA-TLX [25], where 1=very low and 7=very high.”
Method(2016) · Cited by 11,679
An integrative model of organizational trust
Mayer, R. C., Davis, J. H., & Schoorman, F. D. (1995) · The Academy of Management Review · doi:10.2307/258792 · Cited by 10,736 · cited 1×
“Trust : Participants rated the system along Mayer’s dimensions of trust [35]: capability, benevolence, and integrity.”
BackgroundGuidelines for Human-AI Interaction
Amershi, S., Weld, D., Vorvoreanu, M., Fourney, A., Nushi, B., Collisson, P., Suh, J., Iqbal, S., Bennett, P. N., Inkpen, K., et al. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300233 · Cited by 2,439 · cited 3×
“Previous research suggests benefits of educating users about the AI and its capabilities [1], or providing onboarding materials and exercises [6].”
BackgroundCai, C. J., Winter, S., Steiner, D., Wilcox, L., & Terry, M. (2019) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3359206 · Cited by 594 · cited 1×
“Previous research suggests benefits of educating users about the AI and its capabilities [1], or providing onboarding materials and exercises [6].”
BackgroundSelf-citationEnabling Factorized Piano Music Modeling and Generation with the MAESTRO DatasetPreprint
Hawthorne, C., Stasyuk, A., Roberts, A., Simon, I., Huang, C.-Z. A., Dieleman, S., Elsen, E., Engel, J., & Eck, D. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1810.12247 · Cited by 471 · cited 1×
“Research has demonstrated the potential for modeling and synthesizing music, ranging from singlevoice sequences [13] and multi-part music [19, 34], to music with variable parts at each time step [4] and music with longterm structure over minutes [30, 37, 26].”
BackgroundSelf-citationBoulanger-Lewandowski, N., Bengio, Y., & Vincent, P. (2012) · arXiv (Cornell University) · doi:10.48550/arxiv.1206.6392 · Cited by 459 · cited 1×
“Research has demonstrated the potential for modeling and synthesizing music, ranging from singlevoice sequences [13] and multi-part music [19, 34], to music with variable parts at each time step [4] and music with longterm structure over minutes [30, 37, 26].”
BackgroundDeepBach: a Steerable Model for Bach Chorales GenerationPreprint
Hadjeres, G., Pachet, F., & Nielsen, F. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1612.01010 · Cited by 449 · cited 7×
“The conventional interface does include interactive control features via the infillmask feature (present in both conditions) which enables users to crop any region of music to be regenerated [11, 24].”
BackgroundMethodInfluential
Research works printed but not linked: 6
- 8. Kate Compton and Michael Mateas. 2015. Casual Creators. In Proceedings of the Sixth International Conference on Computational Creativity (ICCC 2015),
- 9. Hannu Toivonen, Simon Colton, Michael Cook, and Dan Ventura (Eds.). Brigham Young University, Park City, Utah, 228-235. http://computationalcreativity.net/ iccc2015/proceedings/10_2Compton.pdf
- 12. Monica Dinculescu and Cheng-Zhi Anna Huang. 2019. Coucou: An Expanded Interface for Interactive Composition with Coconet, through Flexible Inpainting. (2019). https://coconet.glitch.me/
- 33. Hannu Toivonen, Simon Colton, Michael Cook, and Dan Ventura (Eds.). Brigham Young University, Park City, Utah, 236-243. http://computationalcreativity.net/ iccc2015/proceedings/10_3Jacob.pdf
- 36. Feynman Liang. 2016. BachBot: Automatic Composition in the Style of Bach Chorales. Masters thesis, University of Cambridge (2016).
- 42. Ralf Schwarzer and Matthias Jerusalem. 1995. Generalized Self-efficacy Scale. Measures in Health Psychology: A User's Portfolio. Causal and Control Beliefs 1, 1 (1995), 35-37.
Cited by
Items 401–409 of 409
AI-tribution: Enabling Training Data Attribution for Users of Generative Music Models
Barnett, J., Pruyne, N., Diakopoulos, N., & Pardo, B. (2026) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1609/aies.v9i1.43144
“The bulk of creativity support tools within generative AI are geared towards providing a functional or efficient improvement (Zhang et al. 2023; Louie et al. 2020; Jin et al. 2024).”
Structural and Representational Agency in LLM-Driven Timbre Generation and InterpolationPreprint
Cameron, J. M., & Blackwell, A. F. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.12532
“Creativity support tools [3] and AI-steering interfaces for generative music [4] give users explicit handles and ask whether they report a sense of control; ecological work shows practising musicians value ownership of the process [5].”
Freeman, G., Toxtli, C., Panchanadikar, R., Hu, Y., Frommel, J., Mandryk, R. L., Guckelsberger, C., & Denisova, A. (2026) · Annual Symposium on Computer-Human Interaction in Play · doi:10.1145/3800965.3834572
Chang, H. (2026) · International Journal of Reasoning-based Intelligent Systems · doi:10.1504/ijris.2026.157573
Digital Musicianship: Evaluation of the Digital Score Research from the North American Tour 2023
Moroz, S., & Vear, C. (2024) · Repository@Nottingham (University of Nottingham)
Anh, P. T. N., & Holmquist, L. E. (2026) · Electronic workshops in computing · doi:10.14236/ewic/britchi26.56
Lin, L., Gao, M., Cheng, Y., 艾, D. 达. A., Shen, S., & Shadiev, R. (2026) · Thinking Skills and Creativity · doi:10.1016/j.tsc.2026.102419
Music You Can Point At: Addressable Representations for Iterative Human-AI Music Co-Creation
Yang, Q., & Weinberg, G. (2026) · doi:10.1145/3806096.3844880
How Do Human Creators Embrace Human-AI Co-Creation? A Perspective on Human Agency of Screenwriters
Tang, Y., Zhou, J., Li, H., Xie, X., Ma, X., & Qu, H. (2026) · arXiv · Cited by 5
“…decision-making:inmusiccomposition,“steering”toolshelped novicespartitioncomplextasksandstrengthenedtheirsenseof ownershipandcompetence[41,58];instoryauthoring,AItools enableddesignerstofocusonnarrativechoiceswhileretaining controlovertheoutput[29,52].”
Metadata
- Authors
- Louie, R., Coenen, A., Huang, C. Z., Terry, M., & Cai, C. J.
- Affiliations
- Northwestern University (US)
- Google (United States) (US)
- Independent Researcher, Mountain View, CA, USA
- Venue
- Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems
- Publisher
- ACM
- Published
- 2020-04-21
- Pages
- 1-13
- OpenAlex
- W3031000691
- Semantic Scholar
- 77a5e08f361b6f91cac8a24b380a14c12bb93383
- Cited by
- 271
- References
- 37
- Citations by year
- 2026: 40 · 2025: 75 · 2024: 65 · 2023: 40 · 2022: 34 · 2021: 14 · 2020: 3
- FWCI
- 7.02
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- CHI Conference on Human Factors in Computing Systems (publishedVersion, cc-by-sa)
- Topics
- Social Sciences › Arts and Humanities › Music › Music Technology and Sound Studies
- Physical Sciences › Computer Science › Human-Computer Interaction › Innovative Human-Technology Interaction
- Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
- Keywords
- novice users, generative music, user trust, self-efficacy, human-AI collaboration, music composition
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.