Computer Vision for the Visually Impaired: the Sound of Vision System
The DOI matches its Crossref record; 3 of the 3 references it cites were found in a registry or an index.
Abstract
This paper presents a computer vision based sensory substitution device for the visually impaired. Its main objective is to provide the users with a 3D representation of the environment around them, conveyed by means of the hearing and tactile senses. One of the biggest challenges for this system is to ensure pervasiveness, i.e., to be usable in any indoor or outdoor environments and in any illumination conditions. This work reveals both the hardware (3D acquisition system) and software (3D processing pipeline) used for developing this sensory substitution device and provides insight on its exploitation in various scenarios. Preliminary experiments with blind users revealed good usability results and provided valuable feedback for system improvement.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Maidenbaum, S., Abboud, S., & Amedi, A. (2014) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2013.11.007 · Cited by 230
Abboud, S., Hanassy, S., Levy-Tzedek, S., Maidenbaum, S., & Amedi, A. (2014) · Restorative Neurology and Neuroscience · doi:10.3233/rnn-130338 · Cited by 199 · cited 2×
“Sensory substitution devices are designed to convey visual information to the visually impaired by substituting visual information into one of their intact senses [1, 3, 5, 6, 15, 30, 35, 42].”
BackgroundColor improves “visual†acuity via sound
Levy-Tzedek, S., Riemer, D., & Amedi, A. (2014) · Frontiers in Neuroscience · doi:10.3389/fnins.2014.00358 · Cited by 30
Cited by
A Comprehensive Survey of Indoor Localization Methods Based on Computer Vision
Morar, A., Moldoveanu, A., Mocanu, I., Moldoveanu, F., Radoi, I. E., Asavei, V., Gradinaru, A., & Butean, A. (2020) · Sensors · doi:10.3390/s20092641 · Cited by 185
“Sound of Vision [33,34] is such an example, which identifies the most important objects in the proximity of the user and sends information about their characteristics (weight, height, elevation, distance to the user, etc.) through headphones and a haptic belt.”
BackgroundInfluentialSelf-citationBrain-Machine Interfaces to Assist the Blind
Ptito, M., Bleau, M., Djerourou, I., Paré, S., Schneider, F. C., & Chebat, D.-R. (2021) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2021.638887 · Cited by 45
Audio description from image by modal translation network
Ning, H., Zheng, X., Yuan, Y., & Lu, X. (2021) · Neurocomputing · doi:10.1016/j.neucom.2020.10.053 · Cited by 23
Spatial navigation with horizontally spatialized sounds in early and late blind individuals
Paré, S., Bleau, M., Djerourou, I., Malotaux, V., Kupers, R., & Ptito, M. (2021) · PLOS ONE · doi:10.1371/journal.pone.0247448 · Cited by 20
“The SoV provides com- bined audio and tactile feedback by using multiple cameras and depth sensors that are worn on the forehead and which are connected to a laptop stowed in a backpack and worn by the user.”
BackgroundInfluential
Metadata
- Authors
- Caraiman, S., Morar, A., Owczarek, M., Burlacu, A., Rzeszotarski, D., Botezatu, N., Herghelegiu, P., Moldoveanu, F., Strumillo, P., & Moldoveanu, A.
- Venue
- 2017 IEEE International Conference on Computer Vision Workshops (ICCVW)
- Publisher
- IEEE
- Published
- 2017-10
- Pages
- 1480-1489
- ISSN
- 2473-9936 (ISSN-L)
- OpenAlex
- W2770941075
- Cited by
- 85
- References
- 3
- FWCI
- 16.73
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.