CoChat

Colorophone 2.0: A Wearable Color Sonification Device Generating Live Stereo-Soundscapes—Design, Implementation, and Usability Audit

Open access

The DOI matches its Crossref record; 72 of the 73 references it cites were found in a registry or an index.

Abstract

The successful development of a system realizing color sonification would enable auditory representation of the visual environment. The primary beneficiary of such a system would be people that cannot directly access visual information—the visually impaired community. Despite the plethora of sensory substitution devices, developing systems that provide intuitive color sonification remains a challenge. This paper presents design considerations, development, and the usability audit of a sensory substitution device that converts spatial color information into soundscapes. The implemented wearable system uses a dedicated color space and continuously generates natural, spatialized sounds based on the information acquired from a camera. We developed two head-mounted prototype devices and two graphical user interface (GUI) versions. The first GUI is dedicated to researchers, and the second has been designed to be easily accessible for visually impaired persons. Finally, we ran fundamental usability tests to evaluate the new spatial color sonification algorithm and to compare the two prototypes. Furthermore, we propose recommendations for the development of the next iteration of the system.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.3390/s21217351

Cites

72 of 72 references verified0 citation errors · 0 not checkable

Statistics

Figures

Figure 1 Subsequent versions of the Colorophone system: (A) Colorophone 1.0 with a camera mounted on the headband and headphones; (B) Colorophone 2.0 with Bose Bluetooth audio sunglasses; (C) Colorophone 2.0 with Aftershokz bone-conducting headphones.
Figure 1 Subsequent versions of the Colorophone system: (A) Colorophone 1.0 with a camera mounted on the headband and headphones; (B) Colorophone 2.0 with Bose Bluetooth audio sunglasses; (C) Colorophone 2.0 with Aftershokz bone-conducting headphones.CC BY · PubMed Central
Figure 2 Transitions between chromatic color components in RYGBW color space.
Figure 2 Transitions between chromatic color components in RYGBW color space.CC BY · PubMed Central
Figure 3 Example of the color transition for a single-color component from black through red to white in RYGBW color space.
Figure 3 Example of the color transition for a single-color component from black through red to white in RYGBW color space.CC BY · PubMed Central
Figure 4 Example of the color transition for a single-color component from black through yellow to white in RYGBW color space.
Figure 4 Example of the color transition for a single-color component from black through yellow to white in RYGBW color space.CC BY · PubMed Central
Figure 5 Example of the color transition for a single-color component from black through green to white in RYGBW color space.
Figure 5 Example of the color transition for a single-color component from black through green to white in RYGBW color space.CC BY · PubMed Central
Figure 6 Example of the color transition for a single-color component from black through blue to white in RYGBW color space.
Figure 6 Example of the color transition for a single-color component from black through blue to white in RYGBW color space.CC BY · PubMed Central
Figure 7 Example of the color transition for a single-color component from black to white in RYGBW color space.
Figure 7 Example of the color transition for a single-color component from black to white in RYGBW color space.CC BY · PubMed Central
Figure 8 Two realizations of the Colorophone 2.0 system together with the processing unit in the form of a Windows tablet.
Figure 8 Two realizations of the Colorophone 2.0 system together with the processing unit in the form of a Windows tablet.CC BY · PubMed Central
Figure 9 Two realizations of a wearable camera-headphone prototype: (A) Bose Frames; (B) Aftershokz Aeropex.
Figure 9 Two realizations of a wearable camera-headphone prototype: (A) Bose Frames; (B) Aftershokz Aeropex.CC BY · PubMed Central
Figure 10 Functional block diagram of the sonification algorithm implemented in the Colorophone 2.0 system.
Figure 10 Functional block diagram of the sonification algorithm implemented in the Colorophone 2.0 system.CC BY · PubMed Central
Figure 11 The Colorophone interface for researchers—the main image tab of the GUI.
Figure 11 The Colorophone interface for researchers—the main image tab of the GUI.CC BY · PubMed Central
Figure 12 The Colorophone interface for researchers—settings tab of the GUI.
Figure 12 The Colorophone interface for researchers—settings tab of the GUI.CC BY · PubMed Central
Figure 13 The Colorophone high-contrast GUI.
Figure 13 The Colorophone high-contrast GUI.CC BY · PubMed Central
Figure 14 Setup used in the two tasks of the usability audit: (A) peripersonal space task (color recognition, object localization, pointing, and grasping); (B) extrapersonal space task (colorful object localization, route planning, locomotion, object’s shape recognition).
Figure 14 Setup used in the two tasks of the usability audit: (A) peripersonal space task (color recognition, object localization, pointing, and grasping); (B) extrapersonal space task (colorful object localization, route planning, locomotion, object’s shape recognition).CC BY · PubMed Central

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 72 references

Research works printed but not linked: 4

  1. Starkiewicz, W., and Kuliszewski, T. (1963, January 1). The 80-Channel Elektroftalm. Proceedings of the International Congress on Technology and Blindness, New York, NY, USA.
  2. Capalbo, Z., and Glenney, B. (2009, January 1). Hearing Color: Radical Pluralistic Realism and SSDs. Proceedings of the AP-CAP, Tokyo, Japan.
  3. Fairchild, M.D. (2005). Color Appearance Models. Wiley-IS&T Series in Imaging Science and Technology, Wiley. [2nd ed.].
  4. Bologna, G., Deville, B., and Pun, T. (2010, January 9–15). Sonification of Color and Depth in a Mobility Aid for Blind People. Proceedings of the Proceedings of the 16th International Conference on Auditory Display (ICAD2010), Washington, DC, USA.

Cited by

See all 15

Metadata

Authors
Osiński, D., Łukowska, M., Hjelme, D. R., & Wierzchoń, M.
Affiliations
  • Norwegian University of Science and Technology (NO)
  • Jagiellonian University (PL)
Corresponding author
Osiński, Dominik
Venue
Sensors
Publisher
MDPI AG
Published
2021-11-05
Volume
21
Issue
21
Pages
7351
ISSN
1424-8220 (ISSN-L)
OpenAlex
W3213597375
Cited by
11
References
73
Citations by year
2026: 1 · 2025: 1 · 2024: 1 · 2023: 3 · 2022: 5
FWCI
1.18
Type
journal article
Language
en
Open access
Locations
  • Sensors (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • Homo Politicus (Academy of Humanities and Economics in Lodz) (submittedVersion, cc-by-nc-nd)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
  • NORA - Norwegian Open Research Archives (submittedVersion, cc-by)
Funders
  • National Science Center (2016/23/B/HS6/00275)
  • Norwegian University of Science and Technology (Kompetanseløft)
Topics
  • Life Sciences › Neuroscience › Cognitive Neuroscience › Tactile and Sensory Interactions
  • Health Sciences › Health Professions › Occupational Therapy › Assistive Technology in Communication and Mobility
  • Social Sciences › Arts and Humanities › Music › Music Technology and Sound Studies
Keywords
sensory substitution, visually impaired users, wearable devices, head-mounted devices, spatial audio, color space, usability evaluation, graphical user interface design
MeSH terms
Wearable Electronic Devices, Algorithms, Humans, Sound, Persons with Visual Disabilities

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Colorophone 2.0: A Wearable Color Sonification Device Generating Live Stereo-Soundscapes—Design, Implementation, and Usability Audit. https://app.cochat.ai/papers/10.3390/s21217351
The paper
Osiński, D., Łukowska, M., Hjelme, D. R., & Wierzchoń, M. (2021). Colorophone 2.0: A Wearable Color Sonification Device Generating Live Stereo-Soundscapes—Design, Implementation, and Usability Audit. Sensors. https://doi.org/10.3390/s21217351

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.