Colorophone 2.0: A Wearable Color Sonification Device Generating Live Stereo-Soundscapes—Design, Implementation, and Usability Audit
Open accessThe DOI matches its Crossref record; 72 of the 73 references it cites were found in a registry or an index.
Abstract
The successful development of a system realizing color sonification would enable auditory representation of the visual environment. The primary beneficiary of such a system would be people that cannot directly access visual information—the visually impaired community. Despite the plethora of sensory substitution devices, developing systems that provide intuitive color sonification remains a challenge. This paper presents design considerations, development, and the usability audit of a sensory substitution device that converts spatial color information into soundscapes. The implemented wearable system uses a dedicated color space and continuously generates natural, spatialized sounds based on the information acquired from a camera. We developed two head-mounted prototype devices and two graphical user interface (GUI) versions. The first GUI is dedicated to researchers, and the second has been designed to be easily accessible for visually impaired persons. Finally, we ran fundamental usability tests to evaluate the new spatial color sonification algorithm and to compare the two prototypes. Furthermore, we propose recommendations for the development of the next iteration of the system.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures














Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Stevens, S. S. (1957) · Psychological Review · doi:10.1037/h0046162 · Cited by 3,361
Auditory Scene Analysis: The Perceptual Organization of Sound
Bregman, A. S., & McAdams, S. (1994) · The Journal of the Acoustical Society of America · doi:10.1121/1.408434 · Cited by 3,029
Crossmodal correspondences: A tutorial review
Spence, C. (2011) · Attention, Perception, & Psychophysics · doi:10.3758/s13414-010-0073-7 · Cited by 1,618 · cited 1×
“When selecting the number of color components to be represented by a sonification algorithm, we should bear in mind that if this number is too large, it will be difficult for a naïve user to remember and recognize all the color–sounds associations.”
MethodA Scale for the Measurement of the Psychological Magnitude Pitch
Stevens, S. S., Volkmann, J., & Newman, E. B. (1937) · The Journal of the Acoustical Society of America · doi:10.1121/1.1915893 · Cited by 1,107 · cited 2×
“Be pleasant for the user [25]; in amplitude corresponding to the maximal color intensity to avoid masking chosen cross-modal correspondences yellow—middle-high pitch,”
BackgroundMethodMills, A. W. (1958) · The Journal of the Acoustical Society of America · doi:10.1121/1.1909553 · Cited by 964
An experimental system for auditory image representations
Meijer, P. B. L. (1992) · IEEE Transactions on Biomedical Engineering · doi:10.1109/10.121642 · Cited by 900
Wearable Obstacle Avoidance Electronic Travel Aids for Blind: A Survey
Dakopoulos, D., & Bourbakis, N. G. (2010) · IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews) · doi:10.1109/tsmcc.2009.2021255 · Cited by 654
Fastl, H., & Zwicker, E. (2007) · Springer eBooks · doi:10.1007/978-3-540-68888-4 · Cited by 537
Foster, D. H. (2011) · Vision Research · doi:10.1016/j.visres.2010.09.006 · Cited by 505
Ebner, M. (2007) · Cited by 482
Research works printed but not linked: 4
- Starkiewicz, W., and Kuliszewski, T. (1963, January 1). The 80-Channel Elektroftalm. Proceedings of the International Congress on Technology and Blindness, New York, NY, USA.
- Capalbo, Z., and Glenney, B. (2009, January 1). Hearing Color: Radical Pluralistic Realism and SSDs. Proceedings of the AP-CAP, Tokyo, Japan.
- Fairchild, M.D. (2005). Color Appearance Models. Wiley-IS&T Series in Imaging Science and Technology, Wiley. [2nd ed.].
- Bologna, G., Deville, B., and Pun, T. (2010, January 9–15). Sonification of Color and Depth in a Mobility Aid for Blind People. Proceedings of the Proceedings of the 16th International Conference on Auditory Display (ICAD2010), Washington, DC, USA.
Cited by
TactualPlot: Spatializing Data as Sound Using Sensory Substitution for Touchscreen Accessibility
Chundury, P., Reyazuddin, Y., Jordan, J. B., Lazar, J. K., & Elmqvist, N. (2023) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2023.3326937 · Cited by 34
Deep Learning-Based Optimization of Visual–Auditory Sensory Substitution
Kim, M., Park, Y., Moon, K., & Jeong, C. Y. (2023) · IEEE Access · doi:10.1109/access.2023.3243641 · Cited by 12
“…could enable visually impaired and partially sighted people to recognize colors or The associate editor coordinating the review of this manuscript and approving it for publication was Felix Albu . objects [1], [2], navigate and avoid obstacles [3], [4], and even identify facial expressions [5].”
BackgroundŁukowska, M., Kałwak, W., Osiński, D., Janik, J., & Wierzchoń, M. (2022) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2022.102925 · Cited by 11
Self-citationDesign and Implementation of a Real-Time Color Recognition System for the Visually Impaired
Samara, M., Deriche, M. A., Al-Sadah, J., & Osais, Y. E. (2022) · Arabian Journal for Science and Engineering · doi:10.1007/s13369-022-07506-w · Cited by 8
Butorovа, A. S., & Sergeev, A. (2025) · The European Physical Journal Special Topics · doi:10.1140/epjs/s11734-025-01596-x · Cited by 3
Metadata
- Authors
- Osiński, D., Łukowska, M., Hjelme, D. R., & Wierzchoń, M.
- Affiliations
- Norwegian University of Science and Technology (NO)
- Jagiellonian University (PL)
- Corresponding author
- Osiński, Dominik
- Venue
- Sensors
- Publisher
- MDPI AG
- Published
- 2021-11-05
- Volume
- 21
- Issue
- 21
- Pages
- 7351
- ISSN
- 1424-8220 (ISSN-L)
- PMC
- PMC8587929
- OpenAlex
- W3213597375
- Cited by
- 11
- References
- 73
- Citations by year
- 2026: 1 · 2025: 1 · 2024: 1 · 2023: 3 · 2022: 5
- FWCI
- 1.18
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Sensors (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Homo Politicus (Academy of Humanities and Economics in Lodz) (submittedVersion, cc-by-nc-nd)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- NORA - Norwegian Open Research Archives (submittedVersion, cc-by)
- Funders
- National Science Center (2016/23/B/HS6/00275)
- Norwegian University of Science and Technology (Kompetanseløft)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Tactile and Sensory Interactions
- Health Sciences › Health Professions › Occupational Therapy › Assistive Technology in Communication and Mobility
- Social Sciences › Arts and Humanities › Music › Music Technology and Sound Studies
- Keywords
- sensory substitution, visually impaired users, wearable devices, head-mounted devices, spatial audio, color space, usability evaluation, graphical user interface design
- MeSH terms
- Wearable Electronic Devices, Algorithms, Humans, Sound, Persons with Visual Disabilities
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Colorophone 2.0: A Wearable Color Sonification Device Generating Live Stereo-Soundscapes—Design, Implementation, and Usability Audit. https://app.cochat.ai/papers/10.3390/s21217351
- The paper
- Osiński, D., Łukowska, M., Hjelme, D. R., & Wierzchoń, M. (2021). Colorophone 2.0: A Wearable Color Sonification Device Generating Live Stereo-Soundscapes—Design, Implementation, and Usability Audit. Sensors. https://doi.org/10.3390/s21217351
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.