‘Visual’ Acuity of the Congenitally Blind Using Visual-to-Auditory Sensory Substitution
Open accessThe DOI matches its Crossref record; 42 of the 42 references it cites were found in a registry or an index.
Abstract
Sensory Substitution Devices (SSDs) convey visual information through sounds or touch, thus theoretically enabling a form of visual rehabilitation in the blind. However, for clinical use, these devices must provide fine-detailed visual information which was not yet shown for this or other means of visual restoration. To test the possible functional acuity conveyed by such devices, we used the Snellen acuity test conveyed through a high-resolution visual-to-auditory SSD (The vOICe). We show that congenitally fully blind adults can exceed the World Health Organization (WHO) blindness acuity threshold using SSDs, reaching the highest acuity reported yet with any visual rehabilitation approach. This demonstrates the potential capacity of SSDs as inexpensive, non-invasive visual rehabilitation aids, alone or when supplementing visual prostheses.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures

Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Previous psychophysical experiments demonstrated that SSDs could enable visually impaired and blind people to recognize colors or objects [1], [2], navigate and avoid obstacles [3], [4], and even identify facial expressions [5].”
From Deep Learning-Based Optimization of Visual–Auditory Sensory Substitution (2023) · cites this paper as [5]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
SINGLE-CELL RESPONSES IN STRIATE CORTEX OF KITTENS DEPRIVED OF VISION IN ONE EYE
Wiesel, T. N., & Hubel, D. H. (1963) · Journal of Neurophysiology · doi:10.1152/jn.1963.26.6.1003 · Cited by 2,628 · cited 1×
“Moreover, as critical developmental periods [12,13,14] for perception of natural vision in adulthood may limit the medical means of sight restoration (for example, several rare accounts of sight restoration in adulthood resulted in only partially functional vision, likely due to such limitations; [15,16,17,18,19,20]),…”
BackgroundWiesel, T. N., & Hubel, D. H. (1965) · Journal of Neurophysiology · doi:10.1152/jn.1965.28.6.1029 · Cited by 1,601 · cited 1×
“Moreover, as critical developmental periods [12,13,14] for perception of natural vision in adulthood may limit the medical means of sight restoration (for example, several rare accounts of sight restoration in adulthood resulted in only partially functional vision, likely due to such limitations; [15,16,17,18,19,20]),…”
BackgroundNew Design Principles for Visual Acuity Letter Charts
Bailey, I. L., & Lovie, J. E. (1976) · American journal of optometry and physiological optic · doi:10.1002/j.2330-9512.1976.tb02218.x · Cited by 1,407
An experimental system for auditory image representations
Meijer, P. B. L. (1992) · IEEE Transactions on Biomedical Engineering · doi:10.1109/10.121642 · Cited by 900 · cited 2×
“While one such device used in research and in an effort to rehabilitate the blind, the PSVA (Prosthesis Substituting Vision with Audition; [9]) has a maximal theoretical resolution of only 124 pixels (although this too has been shown to enable some functional sight; [10]), ‘‘The vOICe’’ SSD [11] can in principle gener…”
BackgroundMethodSensory substitution and the human-machine interface
Bach-y-Rita, P., & W. Kercel, S. (2003) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2003.10.013 · Cited by 858 · cited 1×
“Visual rehabilitation may alternatively be achieved using Sensory Substitution Devices (SSDs [5]) which enable the blind to ‘see’ using their other senses.”
BackgroundSubretinal electronic chips allow blind patients to read letters and combine them to words
Zrenner, E., Bartz-Schmidt, K. U., Benav, H., Besch, D., Bruckmann, A., Gabel, V.-P., Gekeler, F., Greppmaier, U., Harscher, A., Kibbel, S., et al. (2011) · Proceedings of the Royal Society B: Biological Sciences · doi:10.1098/rspb.2010.1747 · Cited by 819 · cited 5×
“eu/ee/benefits-of-argus-ii; and 1000–1500 electrodes and 11u visual field-of-view in development stages [4]; Retina Implant AG, Reutlingen, Germany).”
BackgroundInfluentialGenetic Reactivation of Cone Photoreceptors Restores Visual Responses in Retinitis Pigmentosa
Busskamp, V., Duebel, J., Balya, D., Fradot, M., Viney, T. J., Siegert, S., Groner, A. C., Cabuy, E., Forster, V., Seeliger, M., et al. (2010) · Science · doi:10.1126/science.1190897 · Cited by 642
Shape conveyed by visual-to-auditory sensory substitution activates the lateral occipital complex
Amedi, A., Stern, W. M., Camprodon, J. A., Bermpohl, F., Merabet, L., Rotman, S., Hemond, C., Meijer, P., & Pascual-Leone, A. (2007) · Nature Neuroscience · doi:10.1038/nn1912 · Cited by 451 · cited 2×
“SSDs may be used for instance before a retinal prosthesis implantation, to train the visual cortex to ‘see’ again after years or life-long blindness, by addressing and strengthening the preserved ‘‘visual’’ task selectivities of the occipital cortex of the blind; for instance we recently showed that SSD use activates…”
BackgroundSelf-citationMultiple sensitive periods in human visual development: Evidence from visually deprived children
Lewis, T. L., & Maurer, D. (2005) · Developmental Psychobiology · doi:10.1002/dev.20055 · Cited by 423 · cited 1×
“Moreover, as critical developmental periods [12,13,14] for perception of natural vision in adulthood may limit the medical means of sight restoration (for example, several rare accounts of sight restoration in adulthood resulted in only partially functional vision, likely due to such limitations; [15,16,17,18,19,20]),…”
BackgroundPitch discrimination in the early blind
Gougoux, F., Lepore, F., Lassonde, M., Voss, P., Zatorre, R. J., & Belin, P. (2004) · Nature · doi:10.1038/430309a · Cited by 422
Renier, L. A., Anurova, I., De Volder, A. G., Carlson, S., VanMeter, J., & Rauschecker, J. P. (2010) · Neuron · doi:10.1016/j.neuron.2010.09.021 · Cited by 356
Category-Specific Organization in the Human Brain Does Not Require Visual Experience
Mahon, B. Z., Anzellotti, S., Schwarzbach, J., Zampini, M., & Caramazza, A. (2009) · Neuron · doi:10.1016/j.neuron.2009.07.012 · Cited by 352 · cited 1×
“SSDs may be used for instance before a retinal prosthesis implantation, to train the visual cortex to ‘see’ again after years or life-long blindness, by addressing and strengthening the preserved ‘‘visual’’ task selectivities of the occipital cortex of the blind; for instance we recently showed that SSD use activates…”
Collignon, O., Vandewalle, G., Voss, P., Albouy, G., Charbonneau, G., Lassonde, M., & Lepore, F. (2011) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1013928108 · Cited by 322 · cited 1×
“SSDs may be used for instance before a retinal prosthesis implantation, to train the visual cortex to ‘see’ again after years or life-long blindness, by addressing and strengthening the preserved ‘‘visual’’ task selectivities of the occipital cortex of the blind; for instance we recently showed that SSD use activates…”
BackgroundLong-term deprivation affects visual perception and cortex
Fine, I., Wade, A. R., Brewer, A. A., May, M. G., Goodman, D. F., Boynton, G. M., Wandell, B. A., & MacLeod, D. I. A. (2003) · Nature Neuroscience · doi:10.1038/nn1102 · Cited by 309 · cited 2×
“Moreover, as critical developmental periods [12,13,14] for perception of natural vision in adulthood may limit the medical means of sight restoration (for example, several rare accounts of sight restoration in adulthood resulted in only partially functional vision, likely due to such limitations; [15,16,17,18,19,20]),…”
BackgroundA ventral visual stream reading center independent of visual experience
Reich, L., Szwed, M., Cohen, L., & Amedi, A. (2011) · Current Biology · doi:10.1016/j.cub.2011.01.040 · Cited by 295 · cited 1×
“SSDs may be used for instance before a retinal prosthesis implantation, to train the visual cortex to ‘see’ again after years or life-long blindness, by addressing and strengthening the preserved ‘‘visual’’ task selectivities of the occipital cortex of the blind; for instance we recently showed that SSD use activates…”
BackgroundSelf-citationCross-modal plasticity for the spatial processing of sounds in visually deprived subjects
Collignon, O., Voss, P., Lassonde, M., & Lepore, F. (2009) · Experimental Brain Research · doi:10.1007/s00221-008-1553-z · Cited by 286 · cited 1×
“Although our study did not inspect the SSD visual acuity of normally sighted or that of late-onset blind individuals, one may expect that they will show comparable performance, though possibly with some inferiority relative to early-onset blind, due to the latter’s compensatory advantage in auditory processing [26,27,…”
Auvray, M., Hanneton, S., & O'Regan, J. K. (2007) · Perception · doi:10.1068/p5631 · Cited by 268 · cited 1×
“Remarkably, proficient users are able to differentiate the shapes of different objects, identify the actual objects, and also locate them in space [21,22,23].”
BackgroundBrain Plasticity: ‘Visual’ Acuity of Blind Persons via the Tongue
Sampaio, E., Maris, S., & Bach-y-Rita, P. (2001) · Brain Research · doi:10.1016/s0006-8993(01)02667-1 · Cited by 258 · cited 2×
“20/1000 [4,7,8]), stressing the need to test for functional acuity beyond potential pixel resolution.”
BackgroundTactile Sensory Substitution Studies
BACH‐Y‐RITA, P. (2004) · Annals of the New York Academy of Sciences · doi:10.1196/annals.1305.006 · Cited by 213 · cited 1×
“Initially these focused on tactile-tovisual SSDs [6], and interestingly, although their maximal technical resolution was only 144 pixels at the time, they enabled better acuity than the highest 1500-electrode technical resolution retinal implant under development today (20/860 vs.”
BackgroundCapelle, C., Trullemans, C., Arno, P., & Veraart, C. (1998) · IEEE Transactions on Biomedical Engineering · doi:10.1109/10.720206 · Cited by 210 · cited 1×
“While one such device used in research and in an effort to rehabilitate the blind, the PSVA (Prosthesis Substituting Vision with Audition; [9]) has a maximal theoretical resolution of only 124 pixels (although this too has been shown to enable some functional sight; [10]), ‘‘The vOICe’’ SSD [11] can in principle gener…”
MethodRetinal Prostheses: Current Clinical Results and Future Needs
Weiland, J. D., Cho, A. K., & Humayun, M. S. (2011) · Ophthalmology · doi:10.1016/j.ophtha.2011.08.042 · Cited by 199 · cited 2×
“In fact, even in developed countries not all types of blindness will be treatable in the coming years using prostheses, as these implants currently depend upon the existence of intact retinal ganglion cells, which characterize only some (such as agerelated macular degeneration and retinitis pigmentosa) but not all bli…”
BackgroundRecovery from early blindness : a case study
Gregory, R. L., & Wallace, J. G. (1963) · Pergamon Press eBooks · Cited by 184
The large-Scale Organization of “Visual” Streams Emerges Without Visual Experience
Striem-Amit, E., Dakwar, O., Reich, L., & Amedi, A. (2012) · Cerebral Cortex · doi:10.1093/cercor/bhr253 · Cited by 181 · cited 2×
“SSDs may be used for instance before a retinal prosthesis implantation, to train the visual cortex to ‘see’ again after years or life-long blindness, by addressing and strengthening the preserved ‘‘visual’’ task selectivities of the occipital cortex of the blind; for instance we recently showed that SSD use activates…”
BackgroundSelf-citationVision Following Extended Congenital Blindness
Ostrovsky, Y., Andalman, A., & Sinha, P. (2006) · Psychological Science · doi:10.1111/j.1467-9280.2006.01827.x · Cited by 155 · cited 1×
“Moreover, as critical developmental periods [12,13,14] for perception of natural vision in adulthood may limit the medical means of sight restoration (for example, several rare accounts of sight restoration in adulthood resulted in only partially functional vision, likely due to such limitations; [15,16,17,18,19,20]),…”
BackgroundMatteau, I., Kupers, R. C., Ricciardi, E., Pietrini, P., & Ptito, M. (2010) · Brain Research Bulletin · doi:10.1016/j.brainresbull.2010.05.001 · Cited by 148 · cited 1×
“SSDs may be used for instance before a retinal prosthesis implantation, to train the visual cortex to ‘see’ again after years or life-long blindness, by addressing and strengthening the preserved ‘‘visual’’ task selectivities of the occipital cortex of the blind; for instance we recently showed that SSD use activates…”
BackgroundVisual Parsing After Recovery From Blindness
Ostrovsky, Y., Meyers, E., Ganesh, S., Mathur, U., & Sinha, P. (2009) · Psychological Science · doi:10.1111/j.1467-9280.2009.02471.x · Cited by 125 · cited 1×
“Moreover, as critical developmental periods [12,13,14] for perception of natural vision in adulthood may limit the medical means of sight restoration (for example, several rare accounts of sight restoration in adulthood resulted in only partially functional vision, likely due to such limitations; [15,16,17,18,19,20]),…”
BackgroundAuditory and auditory-tactile processing in congenitally blind humans
Hötting, K., & Röder, B. (2009) · Hearing Research · doi:10.1016/j.heares.2009.07.012 · Cited by 120 · cited 1×
“Although our study did not inspect the SSD visual acuity of normally sighted or that of late-onset blind individuals, one may expect that they will show comparable performance, though possibly with some inferiority relative to early-onset blind, due to the latter’s compensatory advantage in auditory processing [26,27,…”
Tactile-‘visual’ acuity of the tongue in early blind individuals
Chebat, D.-R., Rainville, C., Kupers, R., & Ptito, M. (2007) · Neuroreport · doi:10.1097/wnr.0b013e3282f2a63 · Cited by 88 · cited 3×
“To control for individual factors which could affect the performance of our participants other than pure perceptual acuity, we introduced the tumbling E stimuli of the Snellen acuity chart using static images of each differently oriented E separately (see in Figure 1B), similarly to previous testing of a visual-to-tac…”
BackgroundMethodThe Human Dorsal Action Control System Develops in the Absence of Vision
Fiehler, K., Burke, M., Bien, S., Roder, B., & Rosler, F. (2009) · Cerebral Cortex · doi:10.1093/cercor/bhn067 · Cited by 84 · cited 1×
“SSDs may be used for instance before a retinal prosthesis implantation, to train the visual cortex to ‘see’ again after years or life-long blindness, by addressing and strengthening the preserved ‘‘visual’’ task selectivities of the occipital cortex of the blind; for instance we recently showed that SSD use activates…”
BackgroundCurrent and future prospects for optoelectronic retinal prostheses
Dowling, J. (2008) · Eye · doi:10.1038/eye.2008.385 · Cited by 83 · cited 2×
“Moreover, SSDs may also be beneficially used as a complement to visual prostheses or other novel medical advances [2,4,29,30] in developed countries (and later in the rest of the world).”
BackgroundProulx, M. J., Stoerig, P., Ludowig, E., & Knoll, I. (2008) · PLoS ONE · doi:10.1371/journal.pone.0001840 · Cited by 81 · cited 1×
“Remarkably, proficient users are able to differentiate the shapes of different objects, identify the actual objects, and also locate them in space [21,22,23].”
BackgroundReich, L., Maidenbaum, S., & Amedi, A. (2012) · Current Opinion in Neurology · doi:10.1097/wco.0b013e32834ed723 · Cited by 78
Self-citationLasting Effects of Early Blindness a Case Study
Ackroyd, C., Humphrey, N. K., & Warrington, E. K. (1974) · Quarterly Journal of Experimental Psychology · doi:10.1080/14640747408400393 · Cited by 69 · cited 1×
“Moreover, as critical developmental periods [12,13,14] for perception of natural vision in adulthood may limit the medical means of sight restoration (for example, several rare accounts of sight restoration in adulthood resulted in only partially functional vision, likely due to such limitations; [15,16,17,18,19,20]),…”
BackgroundRecruitment of the middle temporal area by tactile motion in congenital blindness
Ptito, M., Matteau, I., Gjedde, A., & Kupers, R. (2009) · Neuroreport · doi:10.1097/wnr.0b013e3283279909 · Cited by 65
Stidwill, D., & Fletcher, R. H. (2010) · Wiley eBooks · doi:10.1002/9781118788684 · Cited by 56 · cited 1×
“Most of our participants could even pass the WHO blindness threshold (also demonstrated statistically for the whole group) when using a SSD with a relatively wide field-of-view, capturing more than half of the binocular horizontal visual field in humans [25] (66u; it is important to note that no use of ‘‘zoom-in’’ was…”
BackgroundRenier, L., & De Volder, A. G. (2010) · Disability and Rehabilitation: Assistive Technology · doi:10.3109/17483100903253936 · Cited by 51 · cited 2×
“SSDs may be used for instance before a retinal prosthesis implantation, to train the visual cortex to ‘see’ again after years or life-long blindness, by addressing and strengthening the preserved ‘‘visual’’ task selectivities of the occipital cortex of the blind; for instance we recently showed that SSD use activates…”
BackgroundMethodNormal Binocular Vision: Theory, Investigation and Practical Aspects
Stidwill, D., & Fletcher, R. (2010) · Cited by 43
Gregory, R. L. (2003) · Nature Neuroscience · doi:10.1038/nn0903-909 · Cited by 35 · cited 2×
“Moreover, as critical developmental periods [12,13,14] for perception of natural vision in adulthood may limit the medical means of sight restoration (for example, several rare accounts of sight restoration in adulthood resulted in only partially functional vision, likely due to such limitations; [15,16,17,18,19,20]),…”
BackgroundStemness or Not Stemness? Current Status and Perspectives of Adult Retinal Stem Cells
Locker, M., Borday, C., & Perron, M. (2009) · Current Stem Cell Research & Therapy · doi:10.2174/157488809788167382 · Cited by 30 · cited 1×
“Moreover, SSDs may also be beneficially used as a complement to visual prostheses or other novel medical advances [2,4,29,30] in developed countries (and later in the rest of the world).”
BackgroundStriem-Amit, E., Bubic, R., & Amedi, A. (2011) · Frontiers in neuroscience · doi:10.1201/b11092-27 · Cited by 26
Self-citationBrintnall-Peterson, M., Poehlmann, J., Morgan, K. M., & Shlafer, R. J. (2009) · The Gerontologist · doi:10.1093/geront/gnp028 · Cited by 20
Murray, M. M., & Mt, W. (2012) · Cited by 3
Cited by
Subretinal visual implant alpha IMS - clinical trial interim report
Stingl, K., Bartz-Schmidt, K. U., Besch, D., Chee, C. K., Cottriall, C. L., Gekeler, F., Groppe, M., Jackson, T. L., MacLaren, R. E., Koitschev, A., et al. (2015) · Vision Research · doi:10.1016/j.visres.2015.03.001 · Cited by 387
Striem-Amit, E., Cohen, L., Dehaene, S., & Amedi, A. (2012) · Neuron · doi:10.1016/j.neuron.2012.08.026 · Cited by 294
“Alternatively, SSDs may be used as ''sensory interpreters'' that provide high-resolution (Striem-Amit et al., 2012b) supportive synchronous input to the visual signal arriving from an external invasive device (Reich et al., 2012; Striem-Amit et al., 2011).”
BackgroundMethodInfluentialSelf-citationClinical Characteristics and Current Therapies for Inherited Retinal Degenerations
Sahel, J.-A., Marazova, K., & Audo, I. (2015) · Cold Spring Harbor Perspectives in Medicine · doi:10.1101/cshperspect.a017111 · Cited by 232
“As sensory substitution devices are noninvasive and cheap, although they require training in a scale of hours (Striem-Amit et al. 2012b), they represent an attractive alternative to other therapeutic approaches.”
BackgroundMaidenbaum, S., Abboud, S., & Amedi, A. (2014) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2013.11.007 · Cited by 230
Self-citationAbboud, S., Hanassy, S., Levy-Tzedek, S., Maidenbaum, S., & Amedi, A. (2014) · Restorative Neurology and Neuroscience · doi:10.3233/rnn-130338 · Cited by 199
“In contrast, tasks that require higher resolution such as assessing facial expressions (Striem-Amit et al., 2012b) could benefit from an SSD with a higher resolution, such as the vOICe, which will have the upper hand.”
Self-citation
Metadata
- Authors
- Striem-Amit, E., Guendelman, M., & Amedi, A.
- Affiliations
- Hebrew University of Jerusalem (IL)
- Corresponding author
- Amedi, Amir
- Venue
- PLoS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2012-03-16
- Volume
- 7
- Issue
- 3
- Pages
- e33136
- ISSN
- 1932-6203 (ISSN-L)
- PMC
- PMC3306374
- OpenAlex
- W2021082347
- Cited by
- 117
- References
- 42
- Citations by year
- 2026: 5 · 2025: 7 · 2024: 3 · 2023: 1 · 2022: 8 · 2021: 8 · 2020: 7 · 2019: 9 · 2018: 7 · 2017: 7 · 2016: 14 · 2015: 16 · 2014: 11 · 2013: 11 · 2012: 3
- FWCI
- 6.71
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- PLoS ONE (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Figshare (submittedVersion, cc-by)
- Funders
- European Commission (205357)
- Hebrew University of Jerusalem
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Tactile and Sensory Interactions
- Health Sciences › Health Professions › Occupational Therapy › Assistive Technology in Communication and Mobility
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Multisensory perception and integration
- Keywords
- sensory substitution devices, congenital blindness, visual acuity, visual rehabilitation, voice, retinal prosthesis
- MeSH terms
- Acoustic Stimulation, Adult, Blindness, Facial Expression, Female, Humans, Male, Middle Aged, Sensory Aids, Visual Acuity, Young Adult
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.