‘Visual’ Acuity of the Congenitally Blind Using Visual-to-Auditory Sensory Substitution
Open accessThe DOI matches its Crossref record; 42 of the 42 references it cites were found in a registry or an index.
Abstract
Sensory Substitution Devices (SSDs) convey visual information through sounds or touch, thus theoretically enabling a form of visual rehabilitation in the blind. However, for clinical use, these devices must provide fine-detailed visual information which was not yet shown for this or other means of visual restoration. To test the possible functional acuity conveyed by such devices, we used the Snellen acuity test conveyed through a high-resolution visual-to-auditory SSD (The vOICe). We show that congenitally fully blind adults can exceed the World Health Organization (WHO) blindness acuity threshold using SSDs, reaching the highest acuity reported yet with any visual rehabilitation approach. This demonstrates the potential capacity of SSDs as inexpensive, non-invasive visual rehabilitation aids, alone or when supplementing visual prostheses.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures

Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Previous psychophysical experiments demonstrated that SSDs could enable visually impaired and blind people to recognize colors or objects [1], [2], navigate and avoid obstacles [3], [4], and even identify facial expressions [5].”
From Deep Learning-Based Optimization of Visual–Auditory Sensory Substitution (2023) · cites this paper as [5]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
SINGLE-CELL RESPONSES IN STRIATE CORTEX OF KITTENS DEPRIVED OF VISION IN ONE EYE
Wiesel, T. N., & Hubel, D. H. (1963) · Journal of Neurophysiology · doi:10.1152/jn.1963.26.6.1003 · Cited by 2,628 · cited 1×
“Moreover, as critical developmental periods [12,13,14] for perception of natural vision in adulthood may limit the medical means of sight restoration (for example, several rare accounts of sight restoration in adulthood resulted in only partially functional vision, likely due to such limitations; [15,16,17,18,19,20]),…”
BackgroundWiesel, T. N., & Hubel, D. H. (1965) · Journal of Neurophysiology · doi:10.1152/jn.1965.28.6.1029 · Cited by 1,601 · cited 1×
“Moreover, as critical developmental periods [12,13,14] for perception of natural vision in adulthood may limit the medical means of sight restoration (for example, several rare accounts of sight restoration in adulthood resulted in only partially functional vision, likely due to such limitations; [15,16,17,18,19,20]),…”
BackgroundNew Design Principles for Visual Acuity Letter Charts
Bailey, I. L., & Lovie, J. E. (1976) · American journal of optometry and physiological optic · doi:10.1002/j.2330-9512.1976.tb02218.x · Cited by 1,407
An experimental system for auditory image representations
Meijer, P. B. L. (1992) · IEEE Transactions on Biomedical Engineering · doi:10.1109/10.121642 · Cited by 900 · cited 2×
“While one such device used in research and in an effort to rehabilitate the blind, the PSVA (Prosthesis Substituting Vision with Audition; [9]) has a maximal theoretical resolution of only 124 pixels (although this too has been shown to enable some functional sight; [10]), ‘‘The vOICe’’ SSD [11] can in principle gener…”
BackgroundMethodSensory substitution and the human-machine interface
Bach-y-Rita, P., & W. Kercel, S. (2003) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2003.10.013 · Cited by 858 · cited 1×
“Visual rehabilitation may alternatively be achieved using Sensory Substitution Devices (SSDs [5]) which enable the blind to ‘see’ using their other senses.”
BackgroundSubretinal electronic chips allow blind patients to read letters and combine them to words
Zrenner, E., Bartz-Schmidt, K. U., Benav, H., Besch, D., Bruckmann, A., Gabel, V.-P., Gekeler, F., Greppmaier, U., Harscher, A., Kibbel, S., et al. (2011) · Proceedings of the Royal Society B: Biological Sciences · doi:10.1098/rspb.2010.1747 · Cited by 819 · cited 5×
“eu/ee/benefits-of-argus-ii; and 1000–1500 electrodes and 11u visual field-of-view in development stages [4]; Retina Implant AG, Reutlingen, Germany).”
BackgroundInfluentialGenetic Reactivation of Cone Photoreceptors Restores Visual Responses in Retinitis Pigmentosa
Busskamp, V., Duebel, J., Balya, D., Fradot, M., Viney, T. J., Siegert, S., Groner, A. C., Cabuy, E., Forster, V., Seeliger, M., et al. (2010) · Science · doi:10.1126/science.1190897 · Cited by 642
Shape conveyed by visual-to-auditory sensory substitution activates the lateral occipital complex
Amedi, A., Stern, W. M., Camprodon, J. A., Bermpohl, F., Merabet, L., Rotman, S., Hemond, C., Meijer, P., & Pascual-Leone, A. (2007) · Nature Neuroscience · doi:10.1038/nn1912 · Cited by 451 · cited 2×
“SSDs may be used for instance before a retinal prosthesis implantation, to train the visual cortex to ‘see’ again after years or life-long blindness, by addressing and strengthening the preserved ‘‘visual’’ task selectivities of the occipital cortex of the blind; for instance we recently showed that SSD use activates…”
BackgroundSelf-citationMultiple sensitive periods in human visual development: Evidence from visually deprived children
Lewis, T. L., & Maurer, D. (2005) · Developmental Psychobiology · doi:10.1002/dev.20055 · Cited by 423 · cited 1×
“Moreover, as critical developmental periods [12,13,14] for perception of natural vision in adulthood may limit the medical means of sight restoration (for example, several rare accounts of sight restoration in adulthood resulted in only partially functional vision, likely due to such limitations; [15,16,17,18,19,20]),…”
BackgroundPitch discrimination in the early blind
Gougoux, F., Lepore, F., Lassonde, M., Voss, P., Zatorre, R. J., & Belin, P. (2004) · Nature · doi:10.1038/430309a · Cited by 422
Cited by
Items 101–123 of 123
Learning visual to auditory sensory substitution reveals flexibility in image to sound mapping
Kucinkas, A., Retsa, C., Meijer, P. B. L., Wallace, M. T., Gori, M., & Murray, M. M. (2025) · npj Science of Learning · doi:10.1038/s41539-025-00385-4 · Cited by 3
Moon, K.-D., Park, Y. K., Kim, M., & Jeong, C. Y. (2025) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2025.3548942 · Cited by 2
Can you hear the Colour? Towards a Synaesthetic and Multimodal Design Approach in Virtual Worlds
Wright, V. C., & Kefalidou, G. (2021) · Electronic workshops in computing · doi:10.14236/ewic/hci2021.4 · Cited by 2
Teng, S., Danforth, C., Paternoster, N., Ezeana, M., & Puri, A. (2024) · Frontiers in Neuroscience · doi:10.3389/fnins.2024.1288635 · Cited by 4
Kreimeier, J., Kappe, M., & Götzelmann, T. (2020) · International Conference on PErvasive Technologies Related to Assistive Environments (PETRA) · doi:10.1145/3389189.3393742 · Cited by 1
Graphic-to-Sound Sonification for Visual and Auditory Communication Design
Joo, W. (2022) · Audio Mostly Conference (AM) · doi:10.1145/3561212.3561214 · Cited by 1
Practical Sensory Substitution In Real And Virtual Worlds
Maidenbaum, S. (2015) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/2702613.2702626 · Cited by 1
Seeing with Your Ears: A Wondrous Journey Across the Senses
Levy‐Tzedek, S., Halimi, M., & Amedi, A. (2013) · Frontiers for Young Minds · doi:10.3389/frym.2013.00012 · Cited by 1
Self-citationThe Visual (dis)Function in Neurological Diseases
Costa, M. F. (2013) · Journal of Neurology & Neurophysiology · doi:10.4172/2155-9562.s4-004 · Cited by 1
“When we think about the underlining processes of visual rehabilitation, we found that the procedures are aligned with the visual measurements in the assessment and therefore only found visual rehabilitation activities in order to improve visual acuity and visual field [187-195].”
MethodWright, T. D. (2014) · Sussex Research Online (University of Sussex) · Cited by 1
Macular Dystrophies: Management and Interventions
Marazova, K., & Sahel, J. (2016) · Springer eBooks · doi:10.1007/978-3-319-26621-3_11
Gwiaździński, P. (n.d.) · Jagiellonian University Repository (Jagiellonian University)
Walking Assistance Stick For Visually Impaired Person Using GPS Tracking Based On IoT
Pranata, G. J., Permana, M. E., Latif, C., & Hafidz, I. (2025) · International Conference on Information and Communications Technology (ICOIACT) · doi:10.1109/icoiact67584.2025.11344878
Scalvini, F. (2024) · theses.fr (ABES) · doi:10.70675/124e9e0ez3d6fz4222zb982zae7427d8fe28
Reprogramming Perception: A Neuroplasticity-Focused Design Space for Sensory Substitution Devices
Maimon, A., Malaka, R., & Wald, I. Y. (2026) · Augmented Humans International Conference (AHs) · doi:10.1145/3795011.3795025
Park, S., Bak, S., & Lee, H. (2026) · British Journal of Visual Impairment · doi:10.1177/02646196261450976
Which Senses Can Substitute Olfaction?
Bensafi, M., Stanley, H. B., & Rouby, C. (2026) · Springer eBooks · doi:10.1007/978-3-032-21741-7_15
Gwiaździński, P., Reuter, M., Dubis, J., Osiński, D., & Wierzchoń, M. (2026) · Disability and Rehabilitation Assistive Technology · doi:10.1080/17483107.2026.2699832
Moon, K. D., Kyung, P. Y., Kim, M. S., & Jeong, C. Y. (2026) · Frontiers in Psychology · doi:10.3389/fpsyg.2026.1887888
de Klerk, J. C. (2020) · Nelson Mandela University Research Repository
Metadata
- Authors
- Striem-Amit, E., Guendelman, M., & Amedi, A.
- Affiliations
- Hebrew University of Jerusalem (IL)
- Corresponding author
- Amedi, Amir
- Venue
- PLoS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2012-03-16
- Volume
- 7
- Issue
- 3
- Pages
- e33136
- ISSN
- 1932-6203 (ISSN-L)
- PMC
- PMC3306374
- OpenAlex
- W2021082347
- Cited by
- 117
- References
- 42
- Citations by year
- 2026: 5 · 2025: 7 · 2024: 3 · 2023: 1 · 2022: 8 · 2021: 8 · 2020: 7 · 2019: 9 · 2018: 7 · 2017: 7 · 2016: 14 · 2015: 16 · 2014: 11 · 2013: 11 · 2012: 3
- FWCI
- 6.71
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- PLoS ONE (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Figshare (submittedVersion, cc-by)
- Funders
- European Commission (205357)
- Hebrew University of Jerusalem
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Tactile and Sensory Interactions
- Health Sciences › Health Professions › Occupational Therapy › Assistive Technology in Communication and Mobility
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Multisensory perception and integration
- Keywords
- sensory substitution devices, congenital blindness, visual acuity, visual rehabilitation, voice, retinal prosthesis
- MeSH terms
- Acoustic Stimulation, Adult, Blindness, Facial Expression, Female, Humans, Male, Middle Aged, Sensory Aids, Visual Acuity, Young Adult
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.