CoChat

Jess+: AI and robotics with inclusive music-making

Open access
Vear, Craig, Hazzard, Adrian, Moroz, Solomiya, Benerradi, Johann · 2024 · Proceedings of the CHI Conference on Human Factors in Computing Systems

The DOI matches its Crossref record; 48 of the 48 references it cites were found in a registry or an index.

Abstract

This paper discusses the findings from a cross-sector research project investigating how a digital score created using AI and robotics might stimulate new creative opportunities and relationships within the practices of an inclusive music ensemble. Through the concept of a digital score [65], AI and a robotic arm were introduced into an ensemble’s musical practice to evaluate the impact and benefits of using autonomous systems to challenge barriers around a disabled musician’s access to creative music-making. Throughout the development process we placed an emphasis on involvement and togetherness of not only the AI and robots’ contribution to shared creativity amongst the ensemble, but also to the social aspects of the creative process across the team of musicians, developers, researchers and supporting organisations. The findings were surprising with many aspects of the project exceeding the expectations of the original aims. In short, all the musicians benefited from the introduction of these unfamiliar technologies with practices enhanced and relationships transformed.

Overview

Integrity signals

Registry

Crossref · 10.1145/3613904.3642548

Cites

48 of 48 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Show all 48 references

Research works printed but not linked: 17

  1. Avron Barr, Edward A Feigenbaum, and Paul R Cohen. 1981. The handbook of artificial intelligence. Vol. 3. HeurisTech Press.
  2. Laura Bishop. 2018. Collaborative musical creativity: How ensembles coordinate spontaneity. Frontiers in psychology 9 (2018), 1285.
  3. Rodney A Brooks. 1991. Intelligence without representation. Artificial intelligence 47, 1-3 (1991), 139–159.
  4. Linda Candy, Ernest Edmonds, and Craig Vear. 2021. Practice-based research. In The Routledge International Handbook of Practice-Based Research. Routledge, 27–41.
  5. Kerstin Dautenhahn. 2007. Socially intelligent robots: dimensions of human–robot interaction. Philosophical transactions of the royal society B: Biological sciences 362, 1480 (2007), 679–704.
  6. Arne Dietrich. 2004. The cognitive neuroscience of creativity. Psychonomic bulletin & review 11 (2004), 1011–1026.
  7. Simone Gumtau, Paul Newland, Chris Creed, and Simon Kunath. 2005. MEDIATE–a responsive environment designed for children with autism. In Accessible Design in the Digital World Conference 2005. 1–8.
  8. Jacob Harrison. 2020. Supplementary Material for thesis ‘Instruments and access: The role of instruments in music and disability’. Ph. D. Dissertation. Queen Mary University of London.
  9. Todd Lubart, Dario Esposito, Alla Gubenko, and Claude Houssemand. 2021. Creativity in humans, robots, humbots. Creativity: Theories–Research–Applications 8, 1 (2021).
  10. Bahar Uddin Mahmud, Guan Yue Hong, and Bernard Fong. 2022. A Study of Human-AI Symbiosis for Creative Work: Recent Developments and Future Directions in Deep Learning. ACM Transactions on Multimidia Computing Communications and Applications (2022).
  11. P Russel Norvig and S Artificial Intelligence. 2002. A modern approach. Prentice Hall Upper Saddle River, NJ, USA: Rani, M., Nayak, R., & Vyas, OP (2015). An ontology-based adaptive personalized e-learning system, assisted by software agents on cloud storage. Knowledge-Based Systems 90 (2002), 33–48.
  12. Kirk N Olsen and Roger T Dean. 2016. Does perceived exertion influence perceived affect in response to music? Investigating the “FEELA” hypothesis.Psychomusicology: Music, Mind, and Brain 26, 3 (2016), 257.
  13. Jeba Rezwana and Mary Lou Maher. 2022. Designing creative AI partners with COFI: A framework for modeling interaction in human-AI co-creative systems. ACM Transactions on Computer-Human Interaction (2022).
  14. R Keith Sawyer. 1999. The emergence of creativity. Philosophical psychology 12, 4 (1999), 447–469.
  15. Tim Swingler. 1998. The invisible keyboard in the air: An overview of the educational, therapeutic and creative applications of the EMS Soundbeam. In 2nd European Conference for Disability, Virtual Reality & Associated Technology.
  16. Greg Turner, Alastair Weakley, Yun Zhang, and Ernest A Edmonds. 2005. Attuning: A Social and Technical Study of Artist-Programmer Collaborations.. In PPIG. 10.
  17. Aaron Williamon, Sam Thompson, Tânia Lisboa, and Charles Wiffen. 2006. Creativity, originality, and value in music performance. In Musical Creativity. Psychology Press, 177–196.

Cited by

See all 20

Metadata

Authors
Vear, C., Hazzard, A., Moroz, S., & Benerradi, J.
Affiliations
University of Nottingham (GB)
Venue
Proceedings of the CHI Conference on Human Factors in Computing Systems
Publisher
ACM
Published
2024-05-11
Pages
1-17
OpenAlex
W4396833450
Cited by
11
References
48
Citations by year
2026: 3 · 2025: 6 · 2024: 2
FWCI
2.28
Type
conference paper
Language
en
Locations
  • CHI Conference on Human Factors in Computing Systems (publishedVersion)
  • Repository@Nottingham (University of Nottingham) (submittedVersion)
  • Repository@Nottingham (University of Nottingham) (submittedVersion, cc-by)
Funders
  • Trustworthy Autonomous Systems Network
  • European Research Council (ERC-2020-COG ? 101002086)
Topics
  • Social Sciences › Arts and Humanities › Music › Music Technology and Sound Studies
  • Social Sciences › Education › Music Education and Analysis
  • Social Sciences › Arts and Humanities › Visual Arts and Performing Arts › Art, Technology, and Culture
Keywords
inclusive music making, digital scores, AI in music, robot manipulators, ensemble performance

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Jess+: AI and robotics with inclusive music-making. https://app.cochat.ai/papers/10.1145/3613904.3642548
The paper
Vear, C., Hazzard, A., Moroz, S., & Benerradi, J. (2024). Jess+: AI and robotics with inclusive music-making. Proceedings of the CHI Conference on Human Factors in Computing Systems. https://doi.org/10.1145/3613904.3642548

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.