CoChat

Virtual Reality Musical Instruments: State of the Art, Design Principles, and Future Directions

The DOI matches its Crossref record; 74 of the 74 references it cites were found in a registry or an index.

Abstract

The rapid development and availability of low-cost technologies have created a wide interest in virtual reality. In the field of computer music, the term “virtual musical instruments” has been used for a long time to describe software simulations, extensions of existing musical instruments, and ways to control them with new interfaces for musical expression. Virtual reality musical instruments (VRMIs) that include a simulated visual component delivered via a head-mounted display or other forms of immersive visualization have not yet received much attention. In this article, we present a field overview of VRMIs from the viewpoint of the performer. We propose nine design guidelines, describe evaluation methods, analyze case studies, and consider future challenges.

Overview

Integrity signals

Registry

Crossref · 10.1162/comj_a_00372

Cites

74 of 74 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Citations

Cites

Show all 74 references

Research works printed but not linked: 21

  1. Berthaut F., 2014, IEEE VR Workshop: Sonic Interaction in Virtual Environments, 19
  2. Cook P., 2001, Proceedings of the International Conference on New Interfaces for Musical Expression, 3
  3. Cook P. R., 2009, Proceedings of the International Conference on New Interfaces for Musical Expression, 9, 218
  4. Fernandes A. S., 2016, IEEE Symposium on 3D User Interfaces, 201
  5. Fillwalk J., 2015, IEEE Symposium on 3D User Interfaces, 201
  6. Hamilton R., 2009, Proceedings of the AES 35th International Conference: Audio for Games, 1
  7. Heilbrun A., 1989, Whole Earth Review (64):108-119.
  8. Johnston A., 2011, Proceedings of the International Conference on New Interfaces for Musical Expression, 280
  9. Kohlrausch A., 1999, International Society for Optics and Photonics (SPIE) Proceedings on Human Vision and Electronic Imaging, 34
  10. Maki-Patola T., 2004, Proceedings of the International Conference on Digital Audio Effects, 11
  11. Mäki-Patola T., 2005, Proceedings of the International Conference on New Interfaces for Musical Expression, 11
  12. Marshall M. T., 2011, Proceedings of the International Conference on New Interfaces for Musical Expression, 399
  13. Moore A. G., 2015, Proceedings of the IEEE Symposium on 3D User Interfaces, 205
  14. Morreale F., 2014, Proceedings of the International Conference on New Interfaces for Musical Expression, 467
  15. Poupyrev I., 1996, Proceedings of the ACM Symposium on User Interface Software and Technology, 79
  16. Rodet X., 2005, Proceedings of the International Conference on New Interfaces for Musical Expression, 109
  17. Serafin S., 2006, Proceedings of the International Conference on New Interfaces for Musical Expression, 240
  18. Serafin S., 2015, IEEE Symposium on 3D User Interfaces, 207
  19. Wang G., 2014, Proceedings of the Joint International Computer Music Conference and the Sound and Music Computing Conference, 391
  20. Xiao X., 2014, Proceedings of the International Conference on New Interfaces for Musical Expression, 629
  21. Zielasko D., 2015, IEEE Symposium on 3D User Interfaces, 209

Cited by

See all 143

Metadata

Authors
Serafin, S., Erkut, C., Kojs, J., Nilsson, N. C., & Nordahl, R.
Affiliations
  • Aalborg University (DK)
  • University of Miami (US)
Venue
Computer Music Journal
Publisher
MIT Press
Published
2016-09
Volume
40
Issue
3
Pages
22-40
ISSN
  • 0148-9267 (ISSN-L)
  • 1531-5169
OpenAlex
W2563502399
Cited by
139
References
74
Citations by year
2026: 11 · 2025: 13 · 2024: 14 · 2023: 17 · 2022: 25 · 2021: 16 · 2020: 15 · 2019: 10 · 2018: 13 · 2017: 4 · 2016: 1
FWCI
6.34
Type
journal article
Language
en
Open access
closed
Locations
  • Computer Music Journal (publishedVersion)
  • Project Muse (Johns Hopkins University) (submittedVersion)
  • VBN Forskningsportal (Aalborg Universitet) (submittedVersion)
Topics
  • Social Sciences › Arts and Humanities › Music › Music Technology and Sound Studies
  • Physical Sciences › Computer Science › Human-Computer Interaction › Interactive and Immersive Displays
  • Physical Sciences › Computer Science › Human-Computer Interaction › Virtual Reality Applications and Impacts
Keywords
virtual musical instruments, immersive visualization, head-mounted displays, musical instrument design, design guidelines, performer perspective, musical expression, assessment methods, computer music

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.