An enhanced musical experience for the deaf: design and evaluation of a music display and a haptic chair
The DOI matches its Crossref record; 16 of the 16 references it cites were found in a registry or an index.
Abstract
Music is a multi-dimensional experience informed by much more than hearing alone, and is thus accessible to people of all hearing abilities. In this paper we describe a prototype system designed to enrich the experience of music for the deaf by enhancing sensory input of information via channels other than in-air audio reception by the ear. The system has two main components-a vibrating 'Haptic Chair' and a computer display of informative visual effects that correspond to features of the music. The Haptic Chair provides sensory input of vibrations via touch. This system was developed based on an initial concept guided by information obtained from a background survey conducted with deaf people from multi-ethnic backgrounds and feedback received from two profoundly deaf musicians. A formal user study with 43 deaf participants suggested that the prototype system enhances the musical experience of a deaf person. All of the users preferred either the Haptic Chair alone (54%) or the Haptic Chair with the visual display (46%). The prototype system, especially the Haptic Chair was so enthusiastically received by our subjects that it is possible this system might significantly change the way the deaf community experiences music.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“For example, haptic (or visual) feedback has been shown to enhance musical experiences for persons with hearing impairment [25].”
Citations
Cites
Csíkszentmihályi, M. (1975) · Cited by 5,690
Development and Validation of a Scale to Measure Optimal Experience: The Flow State Scale
Jackson, S. A., & Marsh, H. W. (1996) · Journal of Sport and Exercise Psychology · doi:10.1123/jsep.18.1.17 · Cited by 1,557 · cited 1×
“The questions were designed based on the Flow State Scale (FSS) [11].”
MethodOn Associations of Light and Sound: The Mediation of Brightness, Pitch, and Loudness
Marks, L. E. (1974) · The American Journal of Psychology · doi:10.2307/1422011 · Cited by 280 · cited 1×
“This seems to be related to the fact that both amplitude and brightness are measures of intensity in the audio and visual domains respectively, a concept which has been experimentally explored [17].”
BackgroundHuman Ultrasonic Speech Perception
Lenhardt, M. L., Skellett, R. A., Wang, P., & Clarke, A. M. (1991) · Science · doi:10.1126/science.2063208 · Cited by 166 · cited 1×
“Bone conduction of sound is likely to be very significant for people with certain hearing impairments and a far greater range of frequencies is transmitted via bone conduction of sound compared with purely tactile stimulation [ 15 ].”
BackgroundScheirer, E. D., & Vercoe, B. L. (2000) · Cited by 118
Evans, B. (2005) · Computer Music Journal · doi:10.1162/014892605775179955 · Cited by 94 · cited 1×
“Evans [4] gives an excellent review of visual music.”
BackgroundCan you see what i hear?: the design and evaluation of a peripheral sound display for the deaf
Ho-Ching, F. W.-L., Mankoff, J., & Landay, J. A. (2003) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/642611.642641 · Cited by 73 · cited 1×
“Some previous work has been done on providing awareness of environmental sounds to deaf people [9, 19].”
BackgroundVisualizing non-speech sounds for the deaf
Matthews, T. L., Fong, J., & Mankoff, J. C. (2005) · International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS) · doi:10.1145/1090785.1090797 · Cited by 66 · cited 1×
“Some previous work has been done on providing awareness of environmental sounds to deaf people [9, 19].”
BackgroundCutaneous Grooves: Composing For The Sense Of Touch
Günther, E., Davenport, G., & O’Modhrain, S. (2002) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.5281/zenodo.1176417 · Cited by 62
Music as a Trigger for Peak Experiences Among a College Staff Population
Lowis, M. J. (2002) · Creativity Research Journal · doi:10.1207/s15326934crj1434_6 · Cited by 53 · cited 1×
“Although ‘flow theory’ has been widely used in interactive experiences such as plays, sports or gaming, among the passive activities that can result in flow is relaxing while listing to music [16].”
Background
Research works printed but not linked: 5
- Chew , E. Modelling tonality : Applications to music cognition . In Proc.of CogSci 2001 , 206 -- 211 . Chew, E. Modelling tonality: Applications to music cognition. In Proc.of CogSci 2001, 206--211.
- Fischinger , O. Ten films , Los Angeles , Center for Visual Music CVM ( 2006 ). Fischinger, O. Ten films, Los Angeles, Center for Visual Music CVM (2006).
- Matthes , O. Flashserver external for Max/MSP, version 1.1 , 2002 . http://www.nullmedium.de/dev/flashserver. Matthes, O. Flashserver external for Max/MSP, version 1.1, 2002. http://www.nullmedium.de/dev/flashserver.
- Shibata , D . Brains of deaf people 'hear' music . International Arts-Medicine Association Newsletter , 16 , 4 ( 2001 ). http://www.iamaonline.org/Dec01_IAMA_NL.PDF. Shibata, D. Brains of deaf people 'hear' music. International Arts-Medicine Association Newsletter, 16, 4 (2001). http://www.iamaonline.org/Dec01_IAMA_NL.PDF.
- Verillo , R. T . Vibration sensing in humans . Music Perception , 9 , 3 , ( 1991 ), 281--302. Verillo, R. T. Vibration sensing in humans. Music Perception, 9, 3, (1991), 281--302.
Cited by
Is Multimedia Multisensorial? - A Review of Mulsemedia Systems
Covaci, A., Zou, L., Tal, I., Muntean, G., & Ghinea, G. (2018) · ACM Computing Surveys · doi:10.1145/3233774 · Cited by 126
Enhancing Audiovisual Experience with Haptic Feedback: A Survey on HAV
Danieau, F., Lécuyer, A., Guillotel, P., Fleureau, J., Mollet, N., & Christie, M. (2013) · IEEE Transactions on Haptics · doi:10.1109/toh.2012.70 · Cited by 112
“[46] is even more direct and does not require any processing of the audio stream.”
BackgroundTurchet, L., West, T., & Wanderley, M. M. (2021) · Personal and Ubiquitous Computing · doi:10.1007/s00779-020-01395-2 · Cited by 104
“, [4, 19, 20, 33, 36, 40]), MHWAs have the capability of wirelessly exchanging information with external devices as well as being synchronized with them, which opens for the possibility of creating a new set of applications.”
BackgroundInfluentialEnhancing Musical Experience for the Hearing-Impaired Using Visual and Haptic Displays
Nanayakkara, S. C., Wyse, L. L., Ong, S. H., & Taylor, E. (2013) · Human-Computer Interaction · doi:10.1080/07370024.2012.697006 · Cited by 103
“We have discussed the findings in our previous publication ( Nanayakkara, Taylor, Wyse, & Ong, 2009 ).”
Self-citationMood Glove: A haptic wearable prototype system to enhance mood music in film
Mazzoni, A., & Bryan–Kinns, N. (2016) · Entertainment Computing · doi:10.1016/j.entcom.2016.06.002 · Cited by 96
“Haptic interfaces have proven to enhance the musical experience of users with hearing impairment, as the studies in [7,11], which presented the design of a vibrating haptic chair.”
Background
Metadata
- Authors
- Nanayakkara, S., Taylor, E., Wyse, L., & Ong, S. H.
- Affiliations
- National University of Singapore (SG)
- Venue
- Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
- Publisher
- ACM
- Published
- 2009-04-04
- Pages
- 337-346
- OpenAlex
- W2169432103
- Cited by
- 133
- References
- 16
- Citations by year
- 2026: 6 · 2025: 13 · 2024: 7 · 2023: 10 · 2022: 8 · 2021: 25 · 2020: 9 · 2019: 6 · 2018: 8 · 2017: 8 · 2016: 7 · 2015: 6 · 2014: 7 · 2013: 7 · 2012: 4
- FWCI
- 3.71
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- CHI Conference on Human Factors in Computing Systems (publishedVersion)
- National University of Singapore (submittedVersion)
- Funders
- University of Southern California
- National University of Singapore
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Tactile and Sensory Interactions
- Social Sciences › Arts and Humanities › Music › Music Technology and Sound Studies
- Health Sciences › Health Professions › Occupational Therapy › Assistive Technology in Communication and Mobility
- Keywords
- deaf people, music accessibility, haptic feedback, vibrotactile display, music perception, assistive technology, user study, deaf musicians
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: An enhanced musical experience for the deaf: design and evaluation of a music display and a haptic chair. https://app.cochat.ai/papers/10.1145/1518701.1518756
- The paper
- Nanayakkara, S., Taylor, E., Wyse, L., & Ong, S. H. (2009). An enhanced musical experience for the deaf: design and evaluation of a music display and a haptic chair. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. https://doi.org/10.1145/1518701.1518756
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.