Jess+: AI and robotics with inclusive music-making
Open accessThe DOI matches its Crossref record; 48 of the 48 references it cites were found in a registry or an index.
Abstract
This paper discusses the findings from a cross-sector research project investigating how a digital score created using AI and robotics might stimulate new creative opportunities and relationships within the practices of an inclusive music ensemble. Through the concept of a digital score [65], AI and a robotic arm were introduced into an ensemble’s musical practice to evaluate the impact and benefits of using autonomous systems to challenge barriers around a disabled musician’s access to creative music-making. Throughout the development process we placed an emphasis on involvement and togetherness of not only the AI and robots’ contribution to shared creativity amongst the ensemble, but also to the social aspects of the creative process across the team of musicians, developers, researchers and supporting organisations. The findings were surprising with many aspects of the project exceeding the expectations of the original aims. In short, all the musicians benefited from the introduction of these unfamiliar technologies with practices enhanced and relationships transformed.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The manifestation of AI agency can vary significantly, ranging from a passive resource provider to an active co-constructor [177], contingent upon the system's capabilities and the predefined collaborative workflow [206].”
From Exploring Collaboration Patterns and Strategies in Human-AI Co-creation through the Lens of Agency: A Scoping Review of the Top-tier HCI Literature (2025) · cites this paper as [177]
Citations
Cites
Research Design: Qualitative, Quantitative, and Mixed Methods Approaches
Sloane-Seale, A. (2009) · Canadian Journal of University Continuing Education · doi:10.21225/d54s3d · Cited by 14,328
(2014) · Medical Entomology and Zoology · Cited by 6,828
Musicking: the meanings of performing and listening
(1999) · Choice Reviews Online · doi:10.5860/choice.36-3838 · Cited by 1,526
Ambiguity as a resource for design
Gaver, W. W., Beaver, J., & Benford, S. (2003) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/642611.642653 · Cited by 1,474
Shneiderman, B. (2020) · ACM Transactions on Interactive Intelligent Systems · doi:10.1145/3419764 · Cited by 768
Proceedings of the International Conference on New Interfaces for Musical Expression
Jensenius, A. R., Skogstad, S. A. V. D., Nymoen, K., Tveit, A., Godøy, R. I., & Overholt, D. (2011) · NORA - Norwegian Open Research Archives · Cited by 445
Allen, J. E., Guinn, C. I., & Horvtz, E. (1999) · IEEE Intelligent Systems · doi:10.1109/5254.796083 · Cited by 442 · cited 1×
“One prominent topic in this feld concerns human-machine collaboration, which foregrounds a broad range of concerns such as the negotiation of roles, autonomy and control [1, 5, 32], co-creativity [15, 37, 66], sense making [34, 52], and transparency, accountability and trust [4, 59] amongst others.”
BackgroundCreating creativity: user interfaces for supporting innovation
Shneiderman, B. (2000) · ACM Transactions on Computer-Human Interaction · doi:10.1145/344949.345077 · Cited by 432
Next Steps for Human-Computer Integration
Mueller, F. F., Lopes, P., Strohmeier, P., Ju, W., Seim, C., Weigel, M., Nanayakkara, S., Obrist, M., Li, Z., Delfa, J., et al. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376242 · Cited by 260 · cited 1×
“For example, Mueller et al. [47] foreground Human-Computer Integration distinct from matters of interaction, with a focus on tight integration between technologies situated on, or in the human-body.”
BackgroundAccessible Digital Musical Instruments—A Review of Musical Interfaces in Inclusive Music Practice
Frid, E. (2019) · Multimodal Technologies and Interaction · doi:10.3390/mti3030057 · Cited by 177
Research works printed but not linked: 17
- Avron Barr, Edward A Feigenbaum, and Paul R Cohen. 1981. The handbook of artificial intelligence. Vol. 3. HeurisTech Press.
- Laura Bishop. 2018. Collaborative musical creativity: How ensembles coordinate spontaneity. Frontiers in psychology 9 (2018), 1285.
- Rodney A Brooks. 1991. Intelligence without representation. Artificial intelligence 47, 1-3 (1991), 139–159.
- Linda Candy, Ernest Edmonds, and Craig Vear. 2021. Practice-based research. In The Routledge International Handbook of Practice-Based Research. Routledge, 27–41.
- Kerstin Dautenhahn. 2007. Socially intelligent robots: dimensions of human–robot interaction. Philosophical transactions of the royal society B: Biological sciences 362, 1480 (2007), 679–704.
- Arne Dietrich. 2004. The cognitive neuroscience of creativity. Psychonomic bulletin & review 11 (2004), 1011–1026.
- Simone Gumtau, Paul Newland, Chris Creed, and Simon Kunath. 2005. MEDIATE–a responsive environment designed for children with autism. In Accessible Design in the Digital World Conference 2005. 1–8.
- Jacob Harrison. 2020. Supplementary Material for thesis ‘Instruments and access: The role of instruments in music and disability’. Ph. D. Dissertation. Queen Mary University of London.
- Todd Lubart, Dario Esposito, Alla Gubenko, and Claude Houssemand. 2021. Creativity in humans, robots, humbots. Creativity: Theories–Research–Applications 8, 1 (2021).
- Bahar Uddin Mahmud, Guan Yue Hong, and Bernard Fong. 2022. A Study of Human-AI Symbiosis for Creative Work: Recent Developments and Future Directions in Deep Learning. ACM Transactions on Multimidia Computing Communications and Applications (2022).
- P Russel Norvig and S Artificial Intelligence. 2002. A modern approach. Prentice Hall Upper Saddle River, NJ, USA: Rani, M., Nayak, R., & Vyas, OP (2015). An ontology-based adaptive personalized e-learning system, assisted by software agents on cloud storage. Knowledge-Based Systems 90 (2002), 33–48.
- Kirk N Olsen and Roger T Dean. 2016. Does perceived exertion influence perceived affect in response to music? Investigating the “FEELA” hypothesis.Psychomusicology: Music, Mind, and Brain 26, 3 (2016), 257.
- Jeba Rezwana and Mary Lou Maher. 2022. Designing creative AI partners with COFI: A framework for modeling interaction in human-AI co-creative systems. ACM Transactions on Computer-Human Interaction (2022).
- R Keith Sawyer. 1999. The emergence of creativity. Philosophical psychology 12, 4 (1999), 447–469.
- Tim Swingler. 1998. The invisible keyboard in the air: An overview of the educational, therapeutic and creative applications of the EMS Soundbeam. In 2nd European Conference for Disability, Virtual Reality & Associated Technology.
- Greg Turner, Alastair Weakley, Yun Zhang, and Ernest A Edmonds. 2005. Attuning: A Social and Technical Study of Artist-Programmer Collaborations.. In PPIG. 10.
- Aaron Williamon, Sam Thompson, Tânia Lisboa, and Charles Wiffen. 2006. Creativity, originality, and value in music performance. In Musical Creativity. Psychology Press, 177–196.
Cited by
Zhang, S., Wang, H., & Yi, X. (2025) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3757594 · Cited by 36
Togetherness in musical interaction
Bishop, L. (2024) · Routledge Open Research · doi:10.12688/routledgeopenres.18202.1 · Cited by 21
Morita, R., Watanabe, K., Zhou, J., Dengel, A. R., & Ishimaru, S. (2025) · Augmented Humans International Conference (AHs) · doi:10.1145/3745900.3746066 · Cited by 17
Towards Responsible AI Music: an Investigation of Trustworthy Features for Creative SystemsPreprint
de Berardinis, J., Porcaro, L., Meroño-Peñuela, A., Cangelosi, A., & Buckley, T. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2503.18814 · Cited by 17
Morita, R., Watanabe, K., Zhou, J., Dengel, A., & Ishimaru, S. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2503.07463 · Cited by 13
Metadata
- Authors
- Vear, C., Hazzard, A., Moroz, S., & Benerradi, J.
- Affiliations
- University of Nottingham (GB)
- Venue
- Proceedings of the CHI Conference on Human Factors in Computing Systems
- Publisher
- ACM
- Published
- 2024-05-11
- Pages
- 1-17
- OpenAlex
- W4396833450
- Semantic Scholar
- de6fe0b9dd78ba59b41c8e9a86364fad88bc2335
- Cited by
- 11
- References
- 48
- Citations by year
- 2026: 3 · 2025: 6 · 2024: 2
- FWCI
- 2.28
- Type
- conference paper
- Language
- en
- Open access
- Locations
- CHI Conference on Human Factors in Computing Systems (publishedVersion)
- Repository@Nottingham (University of Nottingham) (submittedVersion)
- Repository@Nottingham (University of Nottingham) (submittedVersion, cc-by)
- Funders
- Trustworthy Autonomous Systems Network
- European Research Council (ERC-2020-COG ? 101002086)
- Topics
- Social Sciences › Arts and Humanities › Music › Music Technology and Sound Studies
- Social Sciences › Education › Music Education and Analysis
- Social Sciences › Arts and Humanities › Visual Arts and Performing Arts › Art, Technology, and Culture
- Keywords
- inclusive music making, digital scores, AI in music, robot manipulators, ensemble performance
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Jess+: AI and robotics with inclusive music-making. https://app.cochat.ai/papers/10.1145/3613904.3642548
- The paper
- Vear, C., Hazzard, A., Moroz, S., & Benerradi, J. (2024). Jess+: AI and robotics with inclusive music-making. Proceedings of the CHI Conference on Human Factors in Computing Systems. https://doi.org/10.1145/3613904.3642548
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.