A Framework for the Evaluation of Digital Musical Instruments
The DOI matches its Crossref record; 44 of the 46 references it cites were found in a registry or an index.
Abstract
At the outset of a discussion of evaluating digital musical instruments, that is to say instruments whose sound generators are digital and separable though not necessarily separate from their control interfaces (Malloch, 2006), it is reasonable to ask what the term evaluation in this context really means. After all, there may be many perspectives from which to view the effectiveness or otherwise of the instruments we build. For most performers, performance on an instrument becomes a means of evaluating how well it functions in the context of live music making, and their measure of success is the response of the audience to their performance. Audiences evaluate performances on the basis of how engaged they feel they have been by what they have seen and heard. When questioned, they are likely to describe good performances as “exciting,” “skillful,” “musical.” Bad performances are “boring,” and those which are marred by technical malfunction are often dismissed out of hand. If performance is considered to be a valid means of evaluating a musical instrument, then it follows that, for the field of DMI design, a much broader definition of the term “evaluation” than that typically used in human-computer interaction (HCI) is required to reflect the fact that there are a number of stakeholders involved in the design and evaluation of DMIs. In addition to players and audiences, there are also composers, instrument builders, component manufacturers, and perhaps even customers, each of whom will have a different concept of what is meant by “evaluation.”
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Norman, D. (2016) · Vahlen eBooks · doi:10.15358/9783800648108 · Cited by 6,374
Visual perception of biological motion and a model for its analysis
Johansson, G. (1973) · Perception & Psychophysics · doi:10.3758/bf03212378 · Cited by 4,462
Sweetser (2005) · doi:10.1145/1077246.1077253 · Cited by 2,124 · cited 2×
“Sweetser and Wyeth (2005) have developed a model for evaluating enjoyment of game play in terms of “game flow.””
BackgroundMethod(1986) · North-Holland eBooks · Cited by 1,883
A Practical Guide to Usability Testing
Dumas, J. F., & Redish, J. C. (1993) · Cited by 1,335
Dedre Gentner, C. (1983) · Cited by 1,329
Getting a grip on tangible interaction: a framework on physical space and social interaction
Hornecker, E., & Buur, J. (2006) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1124772.1124838 · Cited by 1,100
Information Processing and Human-Machine Interaction
Rasmussen, J. (1986) · Medical Entomology and Zoology · Cited by 907
Journal of Human Movement Studies
D., C. P. (1975) · The American Journal of Psychology · doi:10.2307/1421916 · Cited by 781
A taxonomy for and analysis of tangible interfaces
Fishkin, K. (2004) · Personal and Ubiquitous Computing · doi:10.1007/s00779-004-0297-4 · Cited by 422
Research works printed but not linked: 11
- Blaine T., 2003, Proceedings of the International Conference on New Interfaces for Musical Expression (NIME). Montreal, Canada: McGill University, 129
- Choi I., 1995, Proceedings of the International Computer Music Conference. San Francisco, California: International Computer Music Association, 181
- Coghlan N., 2008, Proceedings of the International Conference on New Interfaces for Musical Expression (NIME). Genova: Casa Paganini, 233
- Cook P., 2009, Proceedings of the International Conference on New Interfaces for Musical Expression (NIME). Pittsburgh, Pennsylvania: Carnegie Mellon University, 218
- Fyans A. C., 2009, Proceedings of the International Conference on New Interfaces for Musical Expression (NIME). Pittsburgh, Pennsylvania: Carnegie Mellon University, 172
- Gelineck S., 2009, Proceedings of the International Conference on New Interfaces for Musical Expression (NIME). Pittsburgh, Pennsylvania: Carnegie Mellon University, 13
- Jorda S., 2004, Proceedings of the International Computer Music Conference. San Francisco, California: International Computer Music Association, 706
- Kiefer C., 2008, Proceedings of the International Conference on New Interfaces for Musical Expression (NIME). Genova: Casa Paganini, 87
- Paine G., 2010, Proceedings of the International Conference on New Interfaces for Musical Expression (NIME). Sydney: University of Technology Sydney, 436
- Poepel C., 2005, Proceedings of the International Conference on New Interfaces for Musical Expression (NIME). Vancouver: University of British Columbia, 228
- Stowell D., 2008, Proceedings of the International Conference on New Interfaces for Musical Expression (NIME). Genova: Casa Paganini, 81
Cited by
Items 101–171 of 171
Evaluating the Usability of Software Synthesizers: An Analysis and First Approach
Rasmussen, C. (2018) · The Atrium (University of Guelph) · Cited by 3
da Silva, M. A. (2019) · Digital Library of Theses and Dissertations (Universidade de São Paulo) · doi:10.11606/d.27.2019.tde-11032019-114249 · Cited by 3
User Stories of Erkki Kurenniemi's Electronic Musical Instruments, 1961–1978
Ojanen, M. (2020) · Työväentutkimus Vuosikirja · doi:10.5281/zenodo.4018719 · Cited by 3
The creation of hardware systems for professional artistic productions
Hattwick, I. (2018) · doi:10.82308/10796 · Cited by 3
Giomi, A. (2017) · theses.fr (ABES) · doi:10.70675/cfc3ccd9z4561z41d7z908bz0abe4603a088 · Cited by 3
Toward Dmi Evaluation Using Crowd-Sourced Tagging Techniques
Everman, M., & Leider, C. (2013) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.5281/zenodo.1178509 · Cited by 2
Chaos Bells: Instrument Size and Entangled Music Performance
Mice, L., & McPherson, A. (2023) · Contemporary Music Review · doi:10.1080/07494467.2023.2277556 · Cited by 2
Rethinking Instrumental Interface Design: The MetaBow
Trillo, R. A., Nelson, P., & Michailidis, T. (2023) · Computer Music Journal · doi:10.1162/comj_a_00683 · Cited by 2
Interactive Technologies and Music Making
Redhead, T. (2024) · Focal Press eBooks · doi:10.4324/9781003273554 · Cited by 2
Beads Extended Actuated Digital Shaker
Williams, P. L., & Overholt, D. (2017) · VBN Forskningsportal (Aalborg Universitet) · doi:10.5281/zenodo.1176152 · Cited by 2
Augmenting human-human interaction in mobile group improvisation
Pugliese, R., Tahıroğlu, K., Goddard, C., & Nesfield, J. (2012) · New Interfaces for Musical Expression · doi:10.5072/zenodo.209017 · Cited by 2
Recontextualizing The Multi-Touch Surface
McGlynn, P., Lazzarini, V., Delap, G., & Chen, X. (2012) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.5281/zenodo.1178348 · Cited by 2
Chung, S.-M., & Wu, C.-T. (2017) · IEEE Global Engineering Education Conference (EDUCON) · doi:10.1109/educon.2017.7942885 · Cited by 2
Martín, S. C., Vallejo, C. P., & González, M. C. (2022) · ARTSEDUCA Revista electrónica de educación en las Artes · doi:10.6035/artseduca.6896 · Cited by 2
HandMonizer: a case study for personalized digital musical instrument design
Lionetti, D., Pappas, A., Comanducci, L., Bernardini, A., Zanoni, M., Sarti, A., Yee-King, M. J., & d’Inverno, M. (2023) · IEEE International Symposium on the Internet of Sounds (IS2) · doi:10.1109/ieeeconf59510.2023.10335445 · Cited by 2
Young, G. W. (2016) · Arrow@dit (Dublin Institute of Technology) · Cited by 2
Lindetorp, H. (2024) · DiVA (Digitala Vetenskapliga Arkivet) · Cited by 2
Performing with Sonic Tools. An approach to designing and analysing new instruments
Barlindhaug, G. (2023) · Journal for Artistic Research · doi:10.22501/jar.1282234 · Cited by 1
Shen, D., Weng, J., Xu, R., Wang, L., Zhou, J., Bao, D., Yu, Y., & Li, C. (2025) · Universal Access in the Information Society · doi:10.1007/s10209-025-01261-z · Cited by 1
Brown, D., Nash, C., & Mitchell, T. (2016) · UWE Research Repository (UWE Bristol) · doi:10.5281/zenodo.851192 · Cited by 1
Requirements on Kinaesthetic Interfaces for Spatially Interactive Sonic Art
Schlienger, D. (2016) · Audio Mostly Conference (AM) · doi:10.1145/2986416.2986441 · Cited by 1
Calegário, F. (2018) · Computational synthesis and creative systems · doi:10.1007/978-3-030-02892-3_2 · Cited by 1
NIMEcraft Workshop: Exploring the Subtleties of Digital Lutherie
McPherson, A., Armitage, J., Bin, S., Morreale, F., & Jack, R. (2017) · Queen Mary Research Online (Queen Mary University of London) · Cited by 1
Vallejo, C. P., Martín, S. C., & González, M. C. (2022) · Revista Electrónica Complutense de Investigación en Educación Musical - RECIEM · doi:10.5209/reciem.77242 · Cited by 1
Modes of Interaction with the Digital Environment in Music Composition; Lateral Thinking
Beldean, L., & Constantin, F. A. (2023) · Lecture notes in networks and systems · doi:10.1007/978-3-031-26190-9_106 · Cited by 1
Accessible Digital Music Instruments for Motor Disability
Ramírez, R. (2023) · Springer eBooks · doi:10.1007/978-3-031-48635-7_2 · Cited by 1
Voice Responsive Virtual Reality
van 't Klooster, A., & Collins, N. (2024) · e-space (Manchester Metropolitan University) · doi:10.5281/zenodo.13904875 · Cited by 1
Pugliese, R. (2015) · Aaltodoc (Aalto University) · Cited by 1
Deweppe, A. (2017) · Ghent University Academic Bibliography (Ghent University) · doi:10.13140/rg.2.2.20671.00163 · Cited by 1
Soft(ware) sculpture : spatial and temporal interventions in audio-visual media
Galea, M. (2018) · OAR@UM (University of Malta) · Cited by 1
Direct manipulation for musical interfaces based on visual software: design and evaluation
Costa, J. (2019) · eScholarship@McGill (McGill) · doi:10.82308/41625 · Cited by 1
Exploring Textile Controllers for Computer Music
Lindrupsen, N. (2021) · NORA - Norwegian Open Research Archives · Cited by 1
Instruments numériques et performances musicales : enjeux ontologiques et esthétiques
Bouteiller, M. L. (2020) · theses.fr (ABES) · doi:10.70675/1fbd5a44z9bbez4191zb65fzc118ab5d3005 · Cited by 1
Portfolio of compositions using causality as a musical parameter
Green, A. (2014) · University of Huddersfield Repository (University of Huddersfield)
Hughes, C., Wermelinger, M., & Holland, S. (2011) · Open Research Online - ORO (The Open University) · doi:10.5281/zenodo.849995
Ângelo, T. (2012) · Portuguese National Funding Agency for Science, Research and Technology (RCAAP Project by FCT) · doi:10.34626/8z6z-ed06
Armkeyboard: A Mobile Keyboard Instrument Based On Chord-Scale System And Tonal Hierarchy
Deng, J.-Q., Lau, F. C. M., & Kwok, Y. R. (2014) · The HKU Scholars Hub (University of Hong Kong) · doi:10.5281/zenodo.850624
Brown, D. (2016) · UWE Research Repository (UWE Bristol)
Sensori-motor Learning in Movement-Sound Interactive Systems: a Review
Boyer, E., Caramiaux, B., Hanneton, S., Roby-Brami, A., Houix, O., Susini, P., & Bevilacqua, F. P. (2014) · HAL
Map-making towards an onto-cartography of the digital audio workstation
Hope, C., & Terren, M. (2015) · Australasian Journal of Paramedicine
Navigating an intertwingularity : computational ambivalence in experimental music practice
Sherouse, B. (2019) · University of Huddersfield Repository (University of Huddersfield)
Who Wants a Trautonium Must Build One
Hope, C., & Travers, M. M. (2015) · Australasian Journal of Paramedicine
Experiencing Embodied Sonic Meditation Through Body, Voice, and Multimedia Arts
Wu, J. C. (2021) · Numanities - arts and humanities in progress · doi:10.1007/978-3-030-72507-5_8
Calegário, F. (2018) · Computational synthesis and creative systems · doi:10.1007/978-3-030-02892-3_4
Musical Gesture through the Human Computer Interface: An Investigation using Information Theory
Blandino, M. (2021) · Louisiana State University · doi:10.31390/gradschool_dissertations.5535
Carrasco, A. M. V. (2022) · ARTSEDUCA Revista electrónica de educación en las Artes · doi:10.6035/artseduca.6898
Digital music interfaces for motor rehabilitation: a motion capture and machine learning approach
Lucena, R. (2023) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.5281/zenodo.8381086
Experimentálne prístupy k práci so zvukom vo virtuálnej realite
Cihanská, A. M. (2021) · ArteActa · doi:10.62804/aa.2021.002
crossSampler – A Convolution Cross-Synthesis Musical InstrumentPreprint
Eadie, J. (2024) · Research Square · doi:10.21203/rs.3.rs-4251362/v1
User experience with digital musical instruments: a transferable method for longitudinal evaluation
Reimer, P. J. C., Gupta, A., Guastavino, C., & Wanderley, M. M. (2024) · Journal of New Music Research · doi:10.1080/09298215.2025.2540433
Interactive IoMusT-Based Concerts: Real-Time Pattern Recognition and Audience Experience
Silva, N., Boem, A., & Turchet, L. (2025) · Immersive and 3D Audio: from Architecture to Automotive (I3DA) · doi:10.1109/i3da65421.2025.11202042
Ronen, O., & Wanderley, M. M. (2025) · IEEE International Symposium on the Internet of Sounds (IS2) · doi:10.1109/is264627.2025.11284670
Crosssampler: A Digital Convolution Cross Synthesis Instrument
Eadie, J. (2024) · Trinity's Access to Research Output (TARA) (Trinity College Dublin)
Interactive Sound in Performance Ecologies: Studying Connections among Actors and Artifacts
Masu, R. (2022) · Portuguese National Funding Agency for Science, Research and Technology (RCAAP Project by FCT)
Pascual Vallejo, C. D. (2023) · Gredos (University of Salamanca)
Uma Abordagem de Design Sistémico para a Estética da Sonificação
de Carvalho, M. S. P. (2025) · Portuguese National Funding Agency for Science, Research and Technology (RCAAP Project by FCT)
Developing Maturity in DMIs and Mapping Tools
Boettcher, B. (2023) · eScholarship@McGill (McGill) · doi:10.82308/39164
Enhancing Music Interfaces with Soft Materials
Yañez-Laguna, D. (2024) · DSpace@MIT (Massachusetts Institute of Technology)
Modeling, recognition of finger gestures and upper-body movements for musical interaction design
Hemery, E. (2017) · theses.fr (ABES) · doi:10.70675/2fbd30c3z7714z4bd0za3e2z2eff99e4eb9b
Exploration in Movement-Sound Interactive Systems
Paredes, V. (2024) · theses.fr (ABES) · doi:10.70675/67f513aez98d0z418ezac9aze0945d3a7dcd
Kinsella, V., & McPherson, A. (2026) · British Journal of Music Education · doi:10.1017/s0265051726100801
Hui, W. H. C., & Hartono, P. (2026) · Goldsmiths Research Online · doi:10.5281/zenodo.20784438
McShane, N., McCreadie, K. A., Korik, A., & Coyle, D. (2026) · Ulster University Research Portal (Ulster University) · doi:10.5281/zenodo.20784294
Notes aren’t real: An anti-framework for entangled instrument design
McPherson, A. (2026) · Organised Sound · doi:10.1017/s1355771826101320
Didiot-Cook, T. (2026) · Organised Sound · doi:10.1017/s1355771826101411
MNT2: A Longitudinal Evaluation of an Open-Source Mapping Software
Sguiglia, F. (2025) · Simpósio Brasileiro de Computação Musical (SBCM) · doi:10.5753/sbcm.2025.13129
Partesotti, E. (2024) · Journal of Music Technology and Education · doi:10.1386/jmte_00083_1
DIRTY Dancing: Live Coding Infrastructure for Distributed Interactive Real-Time Yamming
Zannos, I., & Carle, M. (2026) · Open Journal of Animation Film and Interactive Media in Education and Culture [AFIMinEC] · doi:10.12681/afiinmec.43109
Designing instruments towards networked music practices
Makelberge, N. (2012) · Portuguese National Funding Agency for Science, Research and Technology (RCAAP Project by FCT)
Metadata
- Authors
- O'Modhrain, S.
- Affiliations
- Sonic Arts Research Centre, Queen's University Belfast, University Road, Belfast, BT7 1NN, Northern Ireland.
- Venue
- Computer Music Journal
- Publisher
- MIT Press - Journals
- Published
- 2011-03
- Volume
- 35
- Issue
- 1
- Pages
- 28-42
- ISSN
- 0148-9267 (ISSN-L)
- 1531-5169
- OpenAlex
- W2044170912
- Semantic Scholar
- 653292b4bad6e54bd5fecccd02bf6aa1b3a1f983
- Cited by
- 130
- References
- 46
- Citations by year
- 2026: 3 · 2025: 4 · 2024: 6 · 2023: 11 · 2022: 7 · 2021: 7 · 2020: 12 · 2019: 8 · 2018: 11 · 2017: 10 · 2016: 11 · 2015: 6 · 2014: 11 · 2013: 8 · 2012: 11
- FWCI
- 11.37
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Computer Music Journal (publishedVersion)
- Project Muse (Johns Hopkins University) (submittedVersion)
- Research Portal (Queen's University Belfast) (submittedVersion)
- Topics
- Social Sciences › Arts and Humanities › Music › Music Technology and Sound Studies
- Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
- Physical Sciences › Computer Science › Human-Computer Interaction › Innovative Human-Technology Interaction
- Keywords
- digital musical instruments, instrument evaluation, performance evaluation, stakeholder perspectives, audience engagement, human-computer interaction evaluation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.