The DOI matches its Crossref record; 67 of the 67 references it cites were found in a registry or an index.
Sound Designer-Generative AI Interactions: Towards Designing Creative Support Tools for Professional Sound Designers
Open accessAbstract
The practice of sound design involves creating and manipulating environmental sounds for music, films, or games. Recently, an increasing number of studies have adopted generative AI to assist in sound design co-creation. Most of these studies focus on the needs of novices, and less on the pragmatic needs of sound design practitioners. In this paper, we aim to understand how generative AI models might support sound designers in their practice. We designed two interactive generative AI models as Creative Support Tools (CSTs) and invited nine professional sound design practitioners to apply the CSTs in their practice. We conducted semi-structured interviews and reflected on the challenges and opportunities of using generative AI in mixed-initiative interfaces for sound design. We provide insights into sound designers’ expectations of generative AI and highlight opportunities to situate generative AI-based tools within the design process. Finally, we discuss design considerations for human-AI interaction researchers working with audio.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Tool-mediated passive and semi-proactive agency dominate here.”
From Exploring Collaboration Patterns and Strategies in Human-AI Co-creation through the Lens of Agency: A Scoping Review of the Top-tier HCI Literature (2025) · cites this paper as [84]
In the citing paper
“Mapping interaction flows reveals prevalent patterns and underexplored areas, such as the sparse use of 'Auditory Interaction' [84, 109, 164], signaling innovation opportunities in domains like assistive technology or music co-creation.”
From Exploring Collaboration Patterns and Strategies in Human-AI Co-creation through the Lens of Agency: A Scoping Review of the Top-tier HCI Literature (2025) · cites this paper as [84]
In the citing paper
“This evolution may also profoundly alter human cognition and selfperception [55], risking deskilling [202] or over-reliance [84, 104, 107], yet simultaneously offering strong augmentation to human [45].”
From Exploring Collaboration Patterns and Strategies in Human-AI Co-creation through the Lens of Agency: A Scoping Review of the Top-tier HCI Literature (2025) · cites this paper as [84]
Citations
Cites
Reflecting on reflexive thematic analysis
Braun, V., & Clarke, V. (2019) · Qualitative Research in Sport, Exercise and Health · doi:10.1080/2159676x.2019.1628806 · Cited by 19,677
One size fits all? What counts as quality practice in (reflexive) thematic analysis?
Braun, V., & Clarke, V. (2021) · Qualitative Research in Psychology · doi:10.1080/14780887.2020.1769238 · Cited by 9,727
Analyzing and Improving the Image Quality of StyleGAN
Karras, T., Laine, S., Aittala, M., Hellsten, J., Lehtinen, J., & Aila, T. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00813 · Cited by 6,332
Braun, V., & Clarke, V. (2021) · Qualitative Research in Sport, Exercise and Health · doi:10.1080/2159676x.2019.1704846 · Cited by 4,776
Guidelines for Human-AI Interaction
Amershi, S., Weld, D., Vorvoreanu, M., Fourney, A., Nushi, B., Collisson, P., Suh, J., Iqbal, S., Bennett, P. N., Inkpen, K., et al. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300233 · Cited by 2,439 · cited 1×
“In the last few years, generative models for audio have been applied to creating music [1, 24, 60] and have moved from being exclusively a research endeavor to fnding practical applications [4, 8, 30].”
Background(1994) · Choice Reviews Online · doi:10.5860/choice.32-2038 · Cited by 1,584
Ambiguity as a resource for design
Gaver, W. W., Beaver, J., & Benford, S. (2003) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/642611.642653 · Cited by 1,474 · cited 2×
“Further, we captured the designer’s interpretations of AI by designing the interactivity with our CSTs using an element of ambiguity [37].”
Shneiderman, B. (2022) · doi:10.1093/oso/9780192845290.001.0001 · Cited by 955
Creativity support tools: accelerating discovery and innovation
Shneiderman, B. (2007) · Communications of the ACM · doi:10.1145/1323688.1323689 · Cited by 765
Audio Engineering Society Convention
(1985) · The Journal of the Acoustical Society of America · doi:10.1121/1.392015 · Cited by 610
Research works printed but not linked: 32
- Andrea Agostinelli, Timo I Denk, Zalán Borsos, Jesse Engel, Mauro Verzetti, Antoine Caillon, Qingqing Huang, Aren Jansen, Adam Roberts, Marco Tagliasacchi, 2023. Musiclm: Generating music from text. arXiv preprint arXiv:2301.11325 (2023). · arXiv
- Open AI. 2023. Dall.E 2. https://openai.com/dall-e-2 [Accessed: 29 August 2023].
- Aimi.Fm. 2023. Aimi.Fm. https://www.aimi.fm/ [Accessed: 15 November 2023].
- brain.fm. 2023. brain.fm. https://www.brain.fm/ [Accessed: 15 November 2023].
- Nick Bryan-Kinns, Berker Banar, Corey Ford, Courtney N. Reed, Yixiao Zhang, Simon Colton, and Jack Armitage. 2021. Exploring XAI for the Arts: Explaining Latent Space in Generative Music, In eXplainable AI approaches for debugging and diagnosis.XAI 4 Debugging Workshop at NEURIPS 2021. https://openreview.net/forum?id=GLhY_0xMLZr
- Linda Candy. 2006. Practice based research: A guide. CCS report 1, 2 (2006), 1–19.
- Keunwoo Choi, Jaekwon Im, Laurie Heller, Brian McFee, Keisuke Imoto, Yuki Okamoto, Mathieu Lagrange, and Shinosuke Takamichi. 2023. Foley sound synthesis at the dcase 2023 challenge. arXiv preprint arXiv:2304.12521 (2023). · arXiv
- Jade Copet, Felix Kreuk, Itai Gat, Tal Remez, David Kant, Gabriel Synnaeve, Yossi Adi, and Alexandre Défossez. 2023. Simple and Controllable Music Generation. In Thirty-seventh Conference on Neural Information Processing Systems. https://openreview.net/forum?id=jtiQ26sCJi
- Brecht De Man, Ryan Stables, and Joshua D Reiss. 2019. Intelligent Music Production. Routledge.
- Endel. 2023. Endel. https://endel.io/ [Accessed: 15 November 2023].
- Rebecca Fiebrink and Perry R Cook. 2010. The Wekinator: a system for real-time, interactive machine learning in music. In Proceedings of The Eleventh International Society for Music Information Retrieval Conference (ISMIR 2010)(Utrecht), Vol. 3. Citeseer, 2–1.
- Corey Ford and Nick Bryan-Kinns. 2022. Speculating on Reflection and People’s Music Co-Creation with AI. Workshop on Generative AI and HCI at the CHI Conference on Human Factors in Computing Systems 2022 (2022).
- Ian Goodfellow, Jean Pouget-Abadie, Mehdi Mirza, Bing Xu, David Warde-Farley, Sherjil Ozair, Aaron Courville, and Yoshua Bengio. 2014. Generative adversarial nets. Advances in neural information processing systems 27 (2014).
- Ian J. Goodfellow, Yoshua Bengio, and Aaron Courville. 2016. Deep Learning. MIT Press, Cambridge, MA, USA. http://www.deeplearningbook.org.
- Jonathan Ho, Ajay Jain, and Pieter Abbeel. 2020. Denoising Diffusion Probabilistic Models. In Advances in Neural Information Processing Systems, H. Larochelle, M. Ranzato, R. Hadsell, M.F. Balcan, and H. Lin (Eds.). Vol. 33. Curran Associates, Inc., 6840–6851. https://proceedings.neurips.cc/paper_files/paper/2020/file/4c5bcfec8584af0d967f1ab10179ca4b-Paper.pdf
- Pytorch Hub. 2023. Pytorch Hub. https://pytorch.org/hub/ [Accessed: 15 November 2023].
- Purnima Kamath Chitralekha Gupta Lonce Wyse and Suranga Nanayakkara. 2023. Example-Based Framework for Perceptually Guided Audio Texture Generation. arxiv:2308.11859 [eess.AS] · arXiv
- Zhifeng Kong, Wei Ping, Jiaji Huang, Kexin Zhao, and Bryan Catanzaro. 2021. DiffWave: A Versatile Diffusion Model for Audio Synthesis. In International Conference on Learning Representations. https://openreview.net/forum?id=a-xFK8Ymz5J
- Haohe Liu, Zehua Chen, Yi Yuan, Xinhao Mei, Xubo Liu, Danilo Mandic, Wenwu Wang, and Mark D Plumbley. 2023. AudioLDM: Text-to-Audio Generation with Latent Diffusion Models. In Proceedings of the 40th International Conference on Machine Learning(Proceedings of Machine Learning Research, Vol. 202), Andreas Krause, Emma Brunskill, Kyunghyun Cho, Barbara Engelhardt, Sivan Sabato, and Jonathan Scarlett (Eds.). PMLR, 21450–21474. https://proceedings.mlr.press/v202/liu23f.html
- Andrés Marafioti, Nathanaël Perraudin, Nicki Holighaus, and Piotr Majdak. 2019. Adversarial Generation of Time-Frequency Features with application in audio synthesis. In Proceedings of the 36th International Conference on Machine Learning(Proceedings of Machine Learning Research, Vol. 97), Kamalika Chaudhuri and Ruslan Salakhutdinov (Eds.). PMLR, 4352–4362. https://proceedings.mlr.press/v97/marafioti19a.html
- Sangshin Oh Minsung Kang Hyeongi Moon Keunwoo Choi and Ben Sangbae Chon. 2023. A Demand-Driven Perspective on Generative Audio AI. arxiv:2307.04292 [eess.AS] · arXiv
- Adam Paszke, Sam Gross, Francisco Massa, Adam Lerer, James Bradbury, Gregory Chanan, Trevor Killeen, Zeming Lin, Natalia Gimelshein, Luca Antiga, Alban Desmaison, Andreas Kopf, Edward Yang, Zachary DeVito, Martin Raison, Alykhan Tejani, Sasank Chilamkurthy, Benoit Steiner, Lu Fang, Junjie Bai, and Soumith Chintala. 2019. PyTorch: An Imperative Style, High-Performance Deep Learning Library. In Advances in Neural Information Processing Systems, H. Wallach, H. Larochelle, A. Beygelzimer, F. d'Alché-Buc, E. Fox, and R. Garnett (Eds.). Vol. 32. Curran Associates, Inc.https://proceedings.neurips.cc/paper_files/paper/2019/file/bdbca288fee7f92f2bfa9f7012727740-Paper.pdf
- Denis Smalley. 1997. Spectromorphology: explaining sound-shapes. Organised sound 2, 2 (1997), 107–126.
- 10.5555/3294996.3295163 · doi:10.5555/3294996.3295163
- Jiaming Song, Chenlin Meng, and Stefano Ermon. 2021. Denoising Diffusion Implicit Models. In International Conference on Learning Representations. https://openreview.net/forum?id=St1giarCHLP
- Yang Song, Conor Durkan, Iain Murray, and Stefano Ermon. 2021. Maximum Likelihood Training of Score-Based Diffusion Models. In Advances in Neural Information Processing Systems, M. Ranzato, A. Beygelzimer, Y. Dauphin, P.S. Liang, and J. Wortman Vaughan (Eds.). Vol. 34. Curran Associates, Inc., 1415–1428. https://proceedings.neurips.cc/paper_files/paper/2021/file/0a9fdbb17feb6ccb7ec405cfb85222c4-Paper.pdf
- Aäron van den Oord, Sander Dieleman, Heiga Zen, Karen Simonyan, Oriol Vinyals, Alex Graves, Nal Kalchbrenner, Andrew W. Senior, and Koray Kavukcuoglu. 2016. WaveNet: A Generative Model for Raw Audio. CoRR abs/1609.03499 (2016). arXiv:1609.03499http://arxiv.org/abs/1609.03499 · arXiv
- Graham Wallas. 1926. The art of thought. Vol. 10. Harcourt Brace.
- Justin D. Weisz, Michael J. Muller, Jessica He, and Stephanie Houde. 2023. Toward General Design Principles for Generative AI Applications 130-144. In IUI Workshops. https://api.semanticscholar.org/CorpusID:255825625
- Lonce Wyse. 2018. Real-valued parametric conditioning of an RNN for interactive sound synthesis. arXiv preprint arXiv:1805.10808 (2018). · arXiv
- Lonce Wyse, Purnima Kamath, and Chitralekha Gupta. 2022. Sound Model Factory: An Integrated System Architecture for Generative Audio Modelling. In Artificial Intelligence in Music, Sound, Art and Design, Tiago Martins, Nereida Rodríguez-Fernández, and Sérgio M. Rebelo (Eds.). Springer International Publishing, Cham, 308–322.
- Model Zoo. 2023. Model Zoo. https://modelzoo.co/ [Accessed: 15 November 2023].
Cited by
Zhang, S., Wang, H., & Yi, X. (2025) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3757594 · Cited by 36
(19448503), J. H., Hitchen, G., & Dogan, S. (2025) · Convergence The International Journal of Research into New Media Technologies · doi:10.1177/13548565251383409 · Cited by 31
Amuse: Human-AI Collaborative Songwriting with Multimodal Inspirations
Kim, Y., Lee, S.-J., & Donahue, C. (2025) · Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713818 · Cited by 23
“We hypothesize that the Chord Generator, by accepting non-musical inputs such as images and texts, offered the creative freedom necessary to compose songs based on songwriting prompts (e.g., “Write an 8-bar chorus about your favorite summer holiday memory.”)”
GenAICHI 2025: Generative AI and HCI at CHI 2025
Muller, M. J., Chilton, L. B., Maher, M. L., Martin, C. P., Choi, M., Walsh, G., & Kantosalo, A. (2025) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3706599.3707213 · Cited by 23
Exploring the Potential of Music Generative AI for Music-Making by Deaf and Hard of Hearing People
Choi, Y., Moon, J., Yoo, J., & Hong, J.-H. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3714298 · Cited by 19
Metadata
- Authors
- Kamath, P., Morreale, F., Bagaskara, P. L., Wei, Y., & Nanayakkara, S.
- Affiliations
- National University of Singapore (SG)
- University of Auckland (NZ)
- Venue
- Proceedings of the CHI Conference on Human Factors in Computing Systems
- Publisher
- ACM
- Published
- 2024-05-11
- Pages
- 1-17
- OpenAlex
- W4396833556
- Semantic Scholar
- d35a72f791f8cfe11b17961a33b3bd3bbcddb6b4
- Cited by
- 37
- References
- 64
- Citations by year
- 2026: 14 · 2025: 19 · 2024: 4
- FWCI
- 7.64
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- CHI Conference on Human Factors in Computing Systems (publishedVersion, cc-by-sa)
- Topics
- Social Sciences › Arts and Humanities › Music › Music Technology and Sound Studies
- Physical Sciences › Computer Science › Computer Graphics and Computer-Aided Design › Digital Media and Visual Art
- Physical Sciences › Computer Science › Human-Computer Interaction › Innovative Human-Technology Interaction
- Keywords
- sound design, generative AI, human-AI interaction, audio, design process
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Sound Designer-Generative AI Interactions: Towards Designing Creative Support Tools for Professional Sound Designers. https://app.cochat.ai/papers/10.1145/3613904.3642040
- The paper
- Kamath, P., Morreale, F., Bagaskara, P. L., Wei, Y., & Nanayakkara, S. (2024). Sound Designer-Generative AI Interactions: Towards Designing Creative Support Tools for Professional Sound Designers. Proceedings of the CHI Conference on Human Factors in Computing Systems. https://doi.org/10.1145/3613904.3642040
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.