A Bioelectric Controller for Computer Music Applications
The DOI matches its Crossref record.
Abstract
This article is a description of a special purpose signal processing computer designed to acquire lowlevel neuroelectric and myoelectric signals, perform feature extraction on these signals, and then map the desired features to MIDI commands-all in real-time. The computer-called the Biomusecan be used as a biocontroller to augment normal musical instrument performance or as a direct nervous system, computer interface for musical composition and performance. Additionally, it could be used for paralyzed and movement impaired individuals as a means to regain the pleasures of music making. The concept of making musical sound from biological phenomena is not new. In fact, one of the earliest references to the idea of transforming a biological feature into musical sound appeared in an essay by the poet Rainer Maria Rilke in 1919 entitled The Primal Sound. In this essay, Rilke proposes creating a special stylus that could track the coronal suture of the skull and transduce the wave form into the primal sound, just as a phonograph needle recreated sound from the wavy imprint in a wax roll. In the poet's words:
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The system underwent several implementations, all having at their core a HW/SW developed speci cally to collect EEG, EOG, and EMG signals, extract a set of relevant features, and map those to MIDI signals.”
From Hands-Free Accessible Digital Musical Instruments: Conceptual Framework, Challenges, and Perspectives (2020) · cites this paper as [123]
Citations
Cites
Still being checked.
Cited by
Accessible Digital Musical Instruments—A Review of Musical Interfaces in Inclusive Music Practice
Frid, E. (2019) · Multimodal Technologies and Interaction · doi:10.3390/mti3030057 · Cited by 177
A research agenda for physiological computing
Allanson, J., & Fairclough, S. H. (2004) · Interacting with Computers · doi:10.1016/j.intcom.2004.08.001 · Cited by 144
Musical Performance Practice on Sensor-based Instruments
Tanaka, A. (2000) · Cited by 99
Toward subtle intimate interfaces for mobile devices using an EMG controller
Costanza, E., Inverso, S. A., & Allen, R. (2005) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/1054972.1055039 · Cited by 107
Intimate interfaces in action: assessing the usability and subtlety of emg-based motionless gestures
Costanza, E., Inverso, S. A., Allen, R., & Maes, P. (2007) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/1240624.1240747 · Cited by 92
Brain-Computer Music Interfacing (BCMI): From Basic Research to the Real World of Special Needs
Miranda, E. R., Magee, W. L., Wilson, J. J., Eaton, J., & Palaniappan, R. (2011) · Music and Medicine · doi:10.1177/1943862111399290 · Cited by 69
2002: Multimodal Interaction in Music Using the Electromyogram and Relative Position Sensing
Tanaka, A., & Knapp, R. B. (2017) · Current research in systematic musicology · doi:10.1007/978-3-319-47214-0_4 · Cited by 71
Self-citationDigital Musical Interactions: Performer–system relationships and their perception by spectators
Gurevich, M., & Fyans, A. C. (2011) · Organised Sound · doi:10.1017/s1355771811000112 · Cited by 76
Physiological Signals and Their Use in Augmenting Emotion Recognition for Human–Machine Interaction
Knapp, R. B., Kim, J., & André, E. (2010) · Cognitive technologies · doi:10.1007/978-3-642-15184-2_9 · Cited by 68
Self-citationVirtual Musical Instruments: Accessing the Sound Synthesis Universe as a Performer
Mulder, A. G. E. (2007) · Cited by 52
Perspective and Evolution of Gesture Recognition for Sign Language: A Review
Galván-Ruiz, J., Travieso, C. M., Tejera-Fettmilch, A., Piñán-Roescher, A., Esteban-Hernández, L., & Domínguez-Quintana, L. (2020) · Sensors · doi:10.3390/s20123571 · Cited by 49
Bio-Sensing Systems And Bio-Feedback Systems For Interactive Media Arts
Nagashima, Y. (2003) · doi:10.5281/zenodo.1176538 · Cited by 47
Sound Actions: Conceptualizing Musical Instruments
Jensenius, A. R. (2022) · The MIT Press eBooks · doi:10.7551/mitpress/14220.001.0001 · Cited by 70
Artificial Intelligence in Music and Performance: A Subjective Art-Research Inquiry
Caramiaux, B., & Donnarumma, M. (2021) · Springer eBooks · doi:10.1007/978-3-030-72116-9_4 · Cited by 49
Design of virtual three-dimensional instruments for sound control
Mulder, A. G. E. (1998) · Library and Archives Canada (Government of Canada) · Cited by 34
Hit the Thumb Jack! Using Electromyography to Augment the Piano Keyboard
Karolus, J., Kilian, A., Kosch, T., Schmidt, A., & Woźniak, P. W. (2020) · Designing Interactive Systems Conference · doi:10.1145/3357236.3395500 · Cited by 32
EXTENDED MUSICAL INTERFACE WITH THE HUMAN NERVOUS SYSTEM
Rosenboom, D., & Beardsley, K. (2006) · Cited by 31
NeuralPMG: A Neural Polyphonic Music Generation System Based on Machine Learning Algorithms
Colafiglio, T., Ardito, C. A., Sorino, P., Lofù, D., Festa, F., Noia, T. D., & Sciascio, E. D. (2024) · Cognitive Computation · doi:10.1007/s12559-024-10280-6 · Cited by 35
BioTones: A wearable device for EMG auditory biofeedback
Tsubouchi, Y., & Suzuki, K. (2010) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/iembs.2010.5627097 · Cited by 29
Electronic Musical Instruments: Experiences of a New Luthier
Bongers, B. (2007) · Leonardo Music Journal · doi:10.1162/lmj.2007.17.9 · Cited by 29
Exploring Novel ways of interaction in musical performance
Bongers, B. (1999) · Creativity and Cognition · doi:10.1145/317561.317576 · Cited by 28
Real-time computer control using pattern recognition of the electromyogram
Putnam, W., & Knapp, R. B. (2005) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/iembs.1993.979112 · Cited by 26
Self-citationInteractions and systems for augmenting a live dance performance
Clay, A., Couture, N., Nigay, L., de la Rivière, J.-B., Martin, J., Courgeon, M., Desainte‐Catherine, M., Orvain, E., Girondel, V., & Domenger, G. (2012) · IEEE International Symposium on Mixed and Augmented Reality - Arts, Media, and Humanities (ISMAR-AMH) · doi:10.1109/ismar-amh.2012.6483986 · Cited by 25
Identifying music-induced emotions from EEG for use in brain-computer music interfacing
Daly, I. P., Malik, A., Weaver, J., Hwang, F., Nasuto, S. J., Williams, D. A. H., Kirke, A., & Miranda, E. R. (2015) · International Conference on Affective Computing and Intelligent Interaction and workshops · doi:10.1109/acii.2015.7344685 · Cited by 22
XTH SENSE: a study of muscle sounds for an experimental paradigm of musical performance.
Donnarumma, M. (2011) · University of Michigan Library Repository · Cited by 27
Creating new interfaces for musical expression: introduction to NIME
Fels, S., & Lyons, M. J. (2009) · ACM SIGGRAPH Courses · doi:10.1145/1667239.1667250 · Cited by 18
Knapp, R. B., & Cook, P. R. (2005) · University of Michigan Library Repository · Cited by 21
Self-citationDavanzo, N., & Avanzini, F. (2020) · IEEE Access · doi:10.1109/access.2020.3019978 · Cited by 16
“[124] E. Lyon, R. B. Knapp, and G. Ouzounian, ‘‘Compositional and performance mapping in computer chamber music: A case study,’’ Comput.”
MethodInfluentialPURWINS, H., Blankertz, B., & Obermayer, K. (2000) · Organised Sound · doi:10.1017/s1355771800005069 · Cited by 18
Music For Flesh Ii: Informing Interactive Music Performance With The Viscerality Of The Body System
Donnarumma, M. (2012) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.5281/zenodo.1178244 · Cited by 15
A Wireless, Network-based Biosensor Interface for Music
Dubost, G., & Tanaka, A. (2002) · University of Michigan Library Repository · Cited by 15
Real-Time Notation Using Brainwave Control
Eaton, J., & Miranda, E. R. (2013) · doi:10.5281/zenodo.850360 · Cited by 14
Exploring The Myo Controller For Sonic Microinteraction
Jensenius, A. R., Sánchez, V. G., Żelechowska, A., & Bjerkestrand, K. A. V. (2017) · NORA - Norwegian Open Research Archives · doi:10.5281/zenodo.1176307 · Cited by 13
Exploring relationships between effort, motion, and sound in new musical instruments
Erdem, Ç., Lan, Q., & Jensenius, A. R. (2020) · Jyväskylä University Digital Archive (University of Jyväskylä) · doi:10.17011/ht/urn.202011256767 · Cited by 15
Donnarumma, M. (2017) · Springer eBooks · doi:10.1007/978-3-319-49881-2_3 · Cited by 16
Nort, D. V. (2015) · International Conference on Movement and Computing (MOCO) · doi:10.1145/2790994.2791015 · Cited by 12
Creating new interfaces for musical expression
Lyons, M. J., & Fels, S. (2013) · SIGGRAPH Asia Courses · doi:10.1145/2542266.2542283 · Cited by 10
Musiplectics: computational assessment of the complexity of music scores
Holder, E., Tilevich, E., & Gillick, A. (2015) · ACM SIGPLAN International Symposium on New Ideas, New Paradigms, and Reflections on Programming and Software (Onward!) · doi:10.1145/2814228.2814243 · Cited by 10
Biosignal-driven Art: Beyond biofeedback
Pérez, M. A. O., Coghlan, N., Jaimovich, J., & Knapp, R. B. (2011) · STOR (Dundalk Institute of Technology) · Cited by 14
Self-citationFrom biological signals to music
Arslan, B., Brouse, A., Castet, J., Filatriau, J.-J., Lehembre, R., Noirhomme, Q., & Simon, C. (2005) · Open Repository and Bibliography (University of Liège) · Cited by 10
The Actuated Guitar: Implementation And User Test On Children With Hemiplegia
Larsen, J. V., Overholt, D., & Moeslund, T. B. (2014) · VBN Forskningsportal (Aalborg Universitet) · doi:10.5281/zenodo.1178844 · Cited by 9
Vásquez, J. C., Tahıroğlu, K., & Kildal, J. (2017) · Aaltodoc (Aalto University) · doi:10.5281/zenodo.1181423 · Cited by 9
Translation from Neurobiological Data to Music Parameters
Minciacchi, D. (2003) · Annals of the New York Academy of Sciences · doi:10.1196/annals.1284.039 · Cited by 9
Zappi, V., & Tatar, K. (2025) · Frontiers in Computer Science · doi:10.3389/fcomp.2025.1575168 · Cited by 9
Sleep Musicalization: Automatic Music Composition from Sleep Measurements
Tulilaulu, A., Paalasmaa, J., Waris, M., & Toivonen, H. T. T. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-34156-4_36 · Cited by 12
Suzuki, K. (2014) · Springer eBooks · doi:10.1007/978-4-431-54159-2_7 · Cited by 8
BioTools: A Biosignal Toolbox for Composers and Performers
Pérez, M. A. O., & Knapp, R. B. (2008) · Lecture notes in computer science · doi:10.1007/978-3-540-85035-9_30 · Cited by 8
Self-citationEmbodiment: The body in algorithmic sound generation
Kim, J. H., & Seifert, U. (2006) · Contemporary Music Review · doi:10.1080/07494460600647592 · Cited by 8
Creating a network of Integral Music Controllers
Knapp, R. B., & Cook, P. R. (2006) · Cited by 8
Self-citationCompositional and Performance Mapping in Computer Chamber Music: A Case Study
Lyon, E., Knapp, R. B., & Ouzounian, G. (2014) · Computer Music Journal · doi:10.1162/comj_a_00257 · Cited by 7
“The Biomuse (Knapp and Lusted 1990) falls into this category.”
BackgroundSelf-citationIMPLICIT PHYSIOLOGICAL INTERACTION FOR THE GENERATION OF AFFECTIVE MUSICAL SOUNDS
Groux, S. L., Väljamäe, A., Manzolli, J., & Verschure, P. F. M. J. (2009) · University of Michigan Library Repository · Cited by 7
Yuksel, B. F., Oleson, K. B., Chang, R., & Jacob, R. J. K. (2019) · Springer series on cultural computing · doi:10.1007/978-3-319-92069-6_11 · Cited by 8
A History Of Emerging Paradigms In Eeg For Music
Christopher, K. R., Kapur, A., Carnegie, D. A., & Grimshaw, G. M. (2014) · University of Michigan Library Repository · doi:10.5281/zenodo.850792 · Cited by 7
Visual and sound Generation Driven by brain, heart and respiration signals.
Filatriau, J.-J., & Kessous, L. (2009) · University of Michigan Library Repository · Cited by 7
Benovoy, M., Lehembre, R., Mühl, C., Pérez, M. A. O., Sayın, A., Soleymani, M., Tahıroğlu, K., Brouse, A., Corcoran, T. G., Drayson, H., et al. (2007) · Archive ouverte UNIGE (University of Geneva) · Cited by 7
Emovere: Designing Sound Interactions For Biosignals And Dancers
Jaimovich, J. (2016) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.5281/zenodo.1176035 · Cited by 6
On Mapping EEG Information into Music
Eaton, J., & Miranda, E. R. (2014) · Springer eBooks · doi:10.1007/978-1-4471-6584-2_10 · Cited by 6
Tanaka, A., Visi, F., Donato, B. D., Klang, M., & Zbyszyński, M. (2023) · Computer Music Journal · doi:10.1162/comj_a_00672 · Cited by 5
Creating Biosignal Algorithms For Musical Applications From An Extensive Physiological Database
Jaimovich, J., & Knapp, R. B. (2015) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.5281/zenodo.1179095 · Cited by 5
Self-citationJuggling Gestures Analysis for Music Control
Willier, A., & Marque, C. K. (2002) · Lecture notes in computer science · doi:10.1007/3-540-47873-6_31 · Cited by 5
AN INTERACTIVE BIO-MUSIC IMPROVISATION SYSTEM
Tahıroğlu, K., Drayson, H., & Erkut, C. (2009) · University of Michigan Library Repository · Cited by 5
Bioinformatic Feedback: Performer Bio-Data As A Driver For Real-Time Composition
Hamilton, R. (2006) · doi:10.5281/zenodo.1176918 · Cited by 5
Myoelectric Signal Processing for Prosthesis Control
Hofmann, D. (2015) · eDiss (Georg-August-Universität Göttingen) · doi:10.53846/goediss-4905 · Cited by 5
Data analysis through auditory display : applications in heart rate variability
Ballora, M. (2000) · eScholarship@McGill (McGill) · doi:10.82308/14442 · Cited by 7
Neural Musical Instruments through Brain-Computer Interface and Biofeedback
Colafiglio, T., Lofù, D., Sorino, P., Lombardi, A., Narducci, F., & Noia, T. D. (2025) · ACM Conference on User Modeling, Adaptation and Personalization (UMAP) · doi:10.1145/3708319.3733644 · Cited by 4
A Dimension Space for the Evaluation of Accessible Digital Musical Instruments
Davanzo, N., & Avanzini, F. (2020) · Archivio Istituzionale della Ricerca (Universita Degli Studi Di Milano) · doi:10.5281/zenodo.4813326 · Cited by 9
Giomi, A. (2023) · Organised Sound · doi:10.1017/s1355771823000286 · Cited by 5
Implementing 3D visualizations of EEG signals in artistic applications
Christopher, K. R., Kapur, A., Carnegie, D. A., & Grimshaw, G. M. (2013) · International Conference on Image and Vision Computing New Zealand (IVCNZ) · doi:10.1109/ivcnz.2013.6727042 · Cited by 4
Brain Musics: History, Precedents, and Commentary on Whalley, Mavros and Furniss
Ortiz, M., Grierson, M., & Tanaka, A. (2015) · Empirical Musicology Review · doi:10.18061/emr.v9i3-4.4532 · Cited by 4
Situated Interactive Music System: Connecting Mind and Body Through Musical Interaction
Groux, S. L., & Verschure, P. F. M. J. (2009) · Cited by 4
Clay, A., Couture, N., Desainte‐Catherine, M., Vulliard, P.-H., Larralde, J., & Decarsin, E. (2012) · HAL · doi:10.5281/zenodo.1178236 · Cited by 4
Real-Time Sonification of Physiological Data in an Artistic Performance Context
Kessous, L., Jacquemin, C., & Filatriau, J.-J. (2008) · Cited by 4
Brooks, A. L. (2013) · Lecture notes in computer science · doi:10.1007/978-3-642-39194-1_51 · Cited by 3
Analysis of Noisy Biosignals for Musical Performance
Paalasmaa, J., Murphy, D. J., & Holmqvist, O. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-34156-4_23 · Cited by 3
LIVeMotion: A Multi-Sensory System to Encourage the Awareness of Mindfulness
Briant, I., Gaisie, J., Morris, T., Robson, F., Moore, D., & Ng, K. (2015) · Electronic workshops in computing · doi:10.14236/ewic/eva2015.2 · Cited by 3
Regeneration-Type Peripheral Nerve Interfaces for Direct Man/Machine Communication
Gregory, T., & Joseph, M. (1993) · Springer eBooks · doi:10.1007/978-3-642-58069-7_35 · Cited by 3
Aubin, F., Slamani, M., Karninska, B., & Robert, J. M. (2005) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/iembs.1991.684785 · Cited by 3
Saha, D. P. (2013) · VTechWorks (Virginia Tech) · Cited by 3
Evaluating BCI for Musical Expression: Historical Approaches, Challenges and Benefits
Williams, D. A. H. (2019) · Springer eBooks · doi:10.1007/978-3-030-14323-7_5 · Cited by 2
How to design and build new musical interfaces
Lyons, M. J., & Fels, S. (2015) · SIGGRAPH Asia Courses · doi:10.1145/2818143.2818145 · Cited by 2
The Psycho-adaptive Listening Machine: An Application of Perceptual Control Theory to Computer Music
Gottesman, E. (1998) · University of Michigan Library Repository · Cited by 2
Subtle, intimate interfaces for mobile human computer interaction
Costanza, E. (2006) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 2
The EAVI EMG/EEG Board: Hybrid physiological sensingPreprint
Tanaka, A., Fierro, D., Maggio, F., Klang, M., & Whitmarsh, S. (2023) · arXiv (Cornell University) · doi:10.5281/zenodo.11189289 · Cited by 2
How to design and build musical interfaces
Lyons, M. J. (2014) · SIGGRAPH Asia Courses · doi:10.1145/2659467.2659470 · Cited by 1
How to design and build new musical interfaces
Fels, S., & Lyons, M. J. (2015) · ACM SIGGRAPH Courses · doi:10.1145/2776880.2792703 · Cited by 1
Advances in new interfaces for musical expression
Fels, S., & Lyons, M. J. (2011) · ACM SIGGRAPH Courses · doi:10.1145/2037636.2037638 · Cited by 1
Bodies as (Critical) Instruments: Biomusic and its Discontents
Ouzounian, G. (2009) · Research Portal (Queen's University Belfast) · Cited by 1
Advances in new interfaces for musical expression
Lyons, M. J., & Fels, S. (2012) · SIGGRAPH Asia Courses · doi:10.1145/2407783.2407784 · Cited by 1
Bioelectric input devices: an example: BIOLINK
Aubin, F., & Robert, J. (1992) · doi:10.1145/1125021.1125100 · Cited by 1
New Electronic Performance Instruments For Electroacoustic Music
Menzies, D. (1999) · Cited by 1
Filatriau, J.-J., Dubuisson, T., Reboursière, L., & Todoroff, T. (2008) · Cited by 1
Compositional approaches within new media paradigms
Oliveiro, M. (2016) · University of North Texas Digital Library (University of North Texas) · doi:10.12794/metadc849618 · Cited by 1
Una Visita al "Center for Computer Research in Music and Acoustics"
Farra, R. D. (1993) · Revista Música · doi:10.11606/rm.v4i1.55057
Noirhomme, Q. (2006) · DIAL (Catholic University of Leuven) · Cited by 2
Design Principles for Electronic Musical Instruments
Thompson, D. (2010)
2012: To Be Inside Someone Else’s Dream: Music for Sleeping and Waking Minds
Ouzounian, G., Knapp, R. B., Lyon, E., & DuBois, R. L. (2017) · Current research in systematic musicology · doi:10.1007/978-3-319-47214-0_26
Self-citationSonic Interaction Design with Physiological Interfaces in a Workshop Setting
Erkut, C., Filatriau, J.-J., Lehembre, R., & Ekman, I. (2008)
Lawrence, J. M., Albertini, E., Scarampi, A., Bombelli, P., Giron, L. B., Kuzmich, L., & Howe, C. J. (2024) · Applied Phycology · doi:10.1080/26388081.2024.2434476
Çetin, E., İlayda, K. A. Y. A., Erat, K., & Durdu, P. O. (2025) · Karadeniz Fen Bilimleri Dergisi · doi:10.31466/kfbd.1553565
Neurophone: A Brain-Computer Music Interface for Emotional Neurofeedback
Velasquez-Peña, M. L., Espinosa, G. R., Orjuela, D. A. G., & Alvarado‐Rojas, C. (2025) · IEEE International Symposium on the Internet of Sounds (IS2) · doi:10.1109/is264627.2025.11284624
Metadata
- Authors
- Knapp, R. B., & Lusted, H. S.
- ORCID
- Knapp, R. Benjamin
- Venue
- Computer Music Journal
- Publisher
- JSTOR
- Published
- 1990
- Volume
- 14
- Issue
- 1
- Pages
- 42
- ISSN
- 0148-9267 (ISSN-L)
- OpenAlex
- W1988082944
- Semantic Scholar
- 995a0cb58fe6b5e254f72ca57cd5c266580a6cfe
- Cited by
- 100
- References
- 0
- Citations by year
- 2025: 4 · 2024: 2 · 2023: 2 · 2022: 1 · 2021: 2 · 2020: 4 · 2019: 3 · 2017: 5 · 2016: 2 · 2015: 9 · 2014: 6 · 2013: 5 · 2012: 6
- FWCI
- 1.79
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Computer Music Journal (publishedVersion)
- Topics
- Social Sciences › Arts and Humanities › Music › Music Technology and Sound Studies
- Life Sciences › Neuroscience › Cognitive Neuroscience › EEG and Brain-Computer Interfaces
- Social Sciences › Arts and Humanities › Visual Arts and Performing Arts › Art, Technology, and Culture
- Keywords
- computer music, myoelectric signals, real-time signal processing, feature extraction, Rainer Maria Rilke
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.