In a Silent Way: Communication Between AI and Improvising Musicians Beyond Sound
The DOI matches its Crossref record; 51 of the 51 references it cites were found in a registry or an index.
Abstract
Collaboration is built on trust, and establishing trust with a creative Artificial Intelligence is difficult when the decision process or internal state driving its behaviour isn't exposed. When human musicians improvise together, a number of extra-musical cues are used to augment musical communication and expose mental or emotional states which affect musical decisions and the effectiveness of the collaboration. We developed a collaborative improvising AI drummer that communicates its confidence through an emoticon-based visualisation. The AI was trained on musical performance data, as well as real-time skin conductance, of musicians improvising with professional drummers, exposing both musical and extra-musical cues to inform its generative process. Uni- and bi-directional extra-musical communication with real and false values were tested by experienced improvising musicians. Each condition was evaluated using the FSS-2 questionnaire, as a proxy for musical engagement. The results show a positive correlation between extra-musical communication of machine internal state and human musical engagement.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Furthermore, well-designed communication protocols and interaction modalities [117, 140] are vital for balancing human directorial control [55] with productive AI initiative [71], facilitating synergistic outcomes [162, 191].”
From Exploring Collaboration Patterns and Strategies in Human-AI Co-creation through the Lens of Agency: A Scoping Review of the Top-tier HCI Literature (2025) · cites this paper as [117]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Five misunderstandings about case-study research
Flyvbjerg, B. (2006) · Qualitative Inquiry · doi:10.1177/1077800405284363 · Cited by 14,266 · cited 1×
“However, qualitative judgements regarding probable transferability of study results can often be argued from the diversity of the study participants [15].”
BackgroundThe role of deliberate practice in the acquisition of expert performance
Ericsson, K. A., Krampe, R. T., & Tesch-Römer, C. (1993) · Psychological Review · doi:10.1037/0033-295x.100.3.363 · Cited by 9,564 · cited 1×
“taken by humans. To do them successfully requires a great deal of proficiency and virtuosity which typically takes many years of practice and experience before one can claim anything close to mastery [14, 17, 35]. In musical improvisation the ability to communicate allows participants to be aware of and understand the…”
BackgroundTrust in Automation: Designing for Appropriate Reliance
Lee, J. D., & See, K. A. (2004) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/hfes.46.1.50_30392 · Cited by 6,605
Likert scales, levels of measurement, and the “laws” of statistics
Norman, G. (2010) · Advances in Health Sciences Education · doi:10.1007/s10459-010-9222-y · Cited by 4,850 · cited 1×
“Whilst some researchers promote non-parametric tests and much larger sample sizes for Likert scale analysis in HCI [39], Norman argues to the contrary that “parametric statistics can be used with Likert data, with small sample sizes, with unequal variances, and with non-normal distributions, with no fear of coming to…”
MethodAn Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modeling
Bai, S., Kolter, J. Z., & Koltun, V. (2018) · arXiv · doi:10.48550/arxiv.1803.01271 · Cited by 4,655 · cited 2×
“The TCNmodel [1] was trained to predict combinations of notes played in any givenmeasure of performance based on musical and biometric data from the three measures directly preceding it.”
BackgroundMethod2017 IEEE International Conference on Computer Vision (ICCV)
(2017) · doi:10.1109/iccv37128.2017 · Cited by 3,056
Temporal Convolutional Networks for Action Segmentation and Detection
Lea, C., Flynn, M. D., Vidal, R., Reiter, A., & Hager, G. D. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.113 · Cited by 2,238
(2011) · Cited by 2,025
Trust, self-confidence, and operators' adaptation to automation
Lee, J. D., & Moray, N. (1994) · International Journal of Human-Computer Studies · doi:10.1006/ijhc.1994.1007 · Cited by 932 · cited 1×
“Many different factors have been identified as significant to increasing trust in human-machine collaborations, including reliability, predictability, utility, provability, transparency and explainability [27, 28, 31].”
BackgroundUnderstanding The New Statistics: Effect Sizes, Confidence Intervals, and Meta-Analysis
Cumming, G. (2013) · Routledge eBooks · doi:10.4324/9780203807002 · Cited by 790
Research works printed but not linked: 7
- 10.5555/2017762.2017798 · doi:10.5555/2017762.2017798
- Mihaly Csikszentmihalyi. 1990. Flow: The psychology of optimal performance.
- Mihaly Csikszentmihalyi. 1996. Flow and the psychology of discovery and invention. New York: Harper Collins (1996).
- 10.5555/870511 · doi:10.5555/870511
- Toby Gifford, Shelly Knotts, Stefano Kalonaris, and Jon McCormack. 2017. Evaluating Improvisational Interfaces. In ICW2017: Proceedings of the Improvisational Creativity Worskshop, Toby Gifford, Shelly Knotts, and Jon McCormack (Eds.).
- 10.5555/510349.510364 · doi:10.5555/510349.510364
- François Pachet. 2006. 19 Enhancing individual creativity with interactive musical reflexive systems. Musical creativity (2006), 359.
Cited by
Rezwana, J., & Maher, M. L. (2023) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3519026 · Cited by 342
“1996 Improv [125] 1999 GeNotator [149] 2000 NEvAr [103] 2001 Metasynth [38] 2003 Facade [109], continuator [122] 2005 LOGTELL [30] 2008 CombinFormation[83], REQUEST [131], miCollage[159], BeatBender [91], WEVVA [116] 2009 Terrain Sketching [57], JNETIC [14], Synthetic Audience [120], The Poetry Machine [155] 2010 SKET…”
Chang, M., Druga, S., Fiannaca, A. J., Vergani, P., Kulkarni, C., Cai, C. J., & Terry, M. (2023) · Creativity and Cognition · doi:10.1145/3591196.3593515 · Cited by 108
A Review of Recent Deep Learning Approaches in Human-Centered Machine Learning
Kaluarachchi, T., Reis, A., & Nanayakkara, S. (2021) · Sensors · doi:10.3390/s21072514 · Cited by 124
“[102] developed an AI application that communicated with improvising musicians in collaborative environments.”
BackgroundMethodBiermann, O. C., Ma, N. F., & Yoon, D. (2022) · Designing Interactive Systems Conference · doi:10.1145/3532106.3533506 · Cited by 116
“Additionally, providing users explainability of the automated system’s output promises to create an increased sense of trust [31, 42, 65, 79].”
BackgroundLiu, H., Lai, V., & Tan, C. (2021) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3479552 · Cited by 111
“AI assistance has been shown to improve people’s efficiency in tasks such as transcription by enhancing their computational capacity [16, 35], support creativity in producing music [15, 41, 45], and even allow the visually impaired to “see” images [22, 68].”
Background
Metadata
- Authors
- McCormack, J., Gifford, T., Hutchings, P., Llano Rodriguez, M. T., Yee-King, M., & d'Inverno, M.
- Affiliations
- Monash University (AU)
- Goldsmiths, University of London, London, United Kingdom
- Goldsmiths University of London (GB)
- Venue
- Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems
- Publisher
- ACM
- Published
- 2019-05-02
- Pages
- 1-11
- OpenAlex
- W2909608214
- Semantic Scholar
- c2e472408df694914a599e303b433da0900f7399
- Cited by
- 64
- References
- 48
- Citations by year
- 2026: 8 · 2025: 13 · 2024: 9 · 2023: 9 · 2022: 8 · 2021: 6 · 2020: 8 · 2019: 3
- FWCI
- 2.04
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- CHI Conference on Human Factors in Computing Systems (publishedVersion)
- Funders
- Australian Research Council (DP160100166)
- Topics
- Social Sciences › Arts and Humanities › Music › Music Technology and Sound Studies
- Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neuroscience and Music Perception
- Keywords
- improvisation, trust in AI, skin conductance, music engagement, human-AI interaction
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: In a Silent Way: Communication Between AI and Improvising Musicians Beyond Sound. https://app.cochat.ai/papers/10.1145/3290605.3300268
- The paper
- McCormack, J., Gifford, T., Hutchings, P., Llano Rodriguez, M. T., Yee-King, M., & d'Inverno, M. (2019). In a Silent Way: Communication Between AI and Improvising Musicians Beyond Sound. Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. https://doi.org/10.1145/3290605.3300268
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.