‘Visual’ Acuity of the Congenitally Blind Using Visual-to-Auditory Sensory Substitution
Open accessThe DOI matches its Crossref record; 42 of the 42 references it cites were found in a registry or an index.
Abstract
Sensory Substitution Devices (SSDs) convey visual information through sounds or touch, thus theoretically enabling a form of visual rehabilitation in the blind. However, for clinical use, these devices must provide fine-detailed visual information which was not yet shown for this or other means of visual restoration. To test the possible functional acuity conveyed by such devices, we used the Snellen acuity test conveyed through a high-resolution visual-to-auditory SSD (The vOICe). We show that congenitally fully blind adults can exceed the World Health Organization (WHO) blindness acuity threshold using SSDs, reaching the highest acuity reported yet with any visual rehabilitation approach. This demonstrates the potential capacity of SSDs as inexpensive, non-invasive visual rehabilitation aids, alone or when supplementing visual prostheses.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures

Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Previous psychophysical experiments demonstrated that SSDs could enable visually impaired and blind people to recognize colors or objects [1], [2], navigate and avoid obstacles [3], [4], and even identify facial expressions [5].”
From Deep Learning-Based Optimization of Visual–Auditory Sensory Substitution (2023) · cites this paper as [5]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
SINGLE-CELL RESPONSES IN STRIATE CORTEX OF KITTENS DEPRIVED OF VISION IN ONE EYE
Wiesel, T. N., & Hubel, D. H. (1963) · Journal of Neurophysiology · doi:10.1152/jn.1963.26.6.1003 · Cited by 2,628 · cited 1×
“Moreover, as critical developmental periods [12,13,14] for perception of natural vision in adulthood may limit the medical means of sight restoration (for example, several rare accounts of sight restoration in adulthood resulted in only partially functional vision, likely due to such limitations; [15,16,17,18,19,20]),…”
BackgroundWiesel, T. N., & Hubel, D. H. (1965) · Journal of Neurophysiology · doi:10.1152/jn.1965.28.6.1029 · Cited by 1,601 · cited 1×
“Moreover, as critical developmental periods [12,13,14] for perception of natural vision in adulthood may limit the medical means of sight restoration (for example, several rare accounts of sight restoration in adulthood resulted in only partially functional vision, likely due to such limitations; [15,16,17,18,19,20]),…”
BackgroundNew Design Principles for Visual Acuity Letter Charts
Bailey, I. L., & Lovie, J. E. (1976) · American journal of optometry and physiological optic · doi:10.1002/j.2330-9512.1976.tb02218.x · Cited by 1,407
An experimental system for auditory image representations
Meijer, P. B. L. (1992) · IEEE Transactions on Biomedical Engineering · doi:10.1109/10.121642 · Cited by 900 · cited 2×
“While one such device used in research and in an effort to rehabilitate the blind, the PSVA (Prosthesis Substituting Vision with Audition; [9]) has a maximal theoretical resolution of only 124 pixels (although this too has been shown to enable some functional sight; [10]), ‘‘The vOICe’’ SSD [11] can in principle gener…”
BackgroundMethodSensory substitution and the human-machine interface
Bach-y-Rita, P., & W. Kercel, S. (2003) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2003.10.013 · Cited by 858 · cited 1×
“Visual rehabilitation may alternatively be achieved using Sensory Substitution Devices (SSDs [5]) which enable the blind to ‘see’ using their other senses.”
BackgroundSubretinal electronic chips allow blind patients to read letters and combine them to words
Zrenner, E., Bartz-Schmidt, K. U., Benav, H., Besch, D., Bruckmann, A., Gabel, V.-P., Gekeler, F., Greppmaier, U., Harscher, A., Kibbel, S., et al. (2011) · Proceedings of the Royal Society B: Biological Sciences · doi:10.1098/rspb.2010.1747 · Cited by 819 · cited 5×
“eu/ee/benefits-of-argus-ii; and 1000–1500 electrodes and 11u visual field-of-view in development stages [4]; Retina Implant AG, Reutlingen, Germany).”
BackgroundInfluentialGenetic Reactivation of Cone Photoreceptors Restores Visual Responses in Retinitis Pigmentosa
Busskamp, V., Duebel, J., Balya, D., Fradot, M., Viney, T. J., Siegert, S., Groner, A. C., Cabuy, E., Forster, V., Seeliger, M., et al. (2010) · Science · doi:10.1126/science.1190897 · Cited by 642
Shape conveyed by visual-to-auditory sensory substitution activates the lateral occipital complex
Amedi, A., Stern, W. M., Camprodon, J. A., Bermpohl, F., Merabet, L., Rotman, S., Hemond, C., Meijer, P., & Pascual-Leone, A. (2007) · Nature Neuroscience · doi:10.1038/nn1912 · Cited by 451 · cited 2×
“SSDs may be used for instance before a retinal prosthesis implantation, to train the visual cortex to ‘see’ again after years or life-long blindness, by addressing and strengthening the preserved ‘‘visual’’ task selectivities of the occipital cortex of the blind; for instance we recently showed that SSD use activates…”
BackgroundSelf-citationMultiple sensitive periods in human visual development: Evidence from visually deprived children
Lewis, T. L., & Maurer, D. (2005) · Developmental Psychobiology · doi:10.1002/dev.20055 · Cited by 423 · cited 1×
“Moreover, as critical developmental periods [12,13,14] for perception of natural vision in adulthood may limit the medical means of sight restoration (for example, several rare accounts of sight restoration in adulthood resulted in only partially functional vision, likely due to such limitations; [15,16,17,18,19,20]),…”
BackgroundPitch discrimination in the early blind
Gougoux, F., Lepore, F., Lassonde, M., Voss, P., Zatorre, R. J., & Belin, P. (2004) · Nature · doi:10.1038/430309a · Cited by 422
Cited by
Subretinal visual implant alpha IMS - clinical trial interim report
Stingl, K., Bartz-Schmidt, K. U., Besch, D., Chee, C. K., Cottriall, C. L., Gekeler, F., Groppe, M., Jackson, T. L., MacLaren, R. E., Koitschev, A., et al. (2015) · Vision Research · doi:10.1016/j.visres.2015.03.001 · Cited by 387
Striem-Amit, E., Cohen, L., Dehaene, S., & Amedi, A. (2012) · Neuron · doi:10.1016/j.neuron.2012.08.026 · Cited by 294
“Alternatively, SSDs may be used as ''sensory interpreters'' that provide high-resolution (Striem-Amit et al., 2012b) supportive synchronous input to the visual signal arriving from an external invasive device (Reich et al., 2012; Striem-Amit et al., 2011).”
BackgroundMethodInfluentialSelf-citationClinical Characteristics and Current Therapies for Inherited Retinal Degenerations
Sahel, J.-A., Marazova, K., & Audo, I. (2015) · Cold Spring Harbor Perspectives in Medicine · doi:10.1101/cshperspect.a017111 · Cited by 232
“As sensory substitution devices are noninvasive and cheap, although they require training in a scale of hours (Striem-Amit et al. 2012b), they represent an attractive alternative to other therapeutic approaches.”
BackgroundMaidenbaum, S., Abboud, S., & Amedi, A. (2014) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2013.11.007 · Cited by 230
Self-citationAbboud, S., Hanassy, S., Levy-Tzedek, S., Maidenbaum, S., & Amedi, A. (2014) · Restorative Neurology and Neuroscience · doi:10.3233/rnn-130338 · Cited by 199
“In contrast, tasks that require higher resolution such as assessing facial expressions (Striem-Amit et al., 2012b) could benefit from an SSD with a higher resolution, such as the vOICe, which will have the upper hand.”
Self-citationStriem-Amit, E., & Amedi, A. (2014) · Current Biology · doi:10.1016/j.cub.2014.02.010 · Cited by 183
Self-citationRoska, B., & Sahel, J.-A. (2018) · Nature · doi:10.1038/s41586-018-0076-4 · Cited by 161
Designing sensory-substitution devices: Principles, pitfalls and potential1
Kristjánsson, Á., Moldoveanu, A., Jóhannesson, Ó. I., Balan, O., Spagnol, S., Valgeirsdóttir, V. V., & Unnthorsson, R. (2016) · Restorative Neurology and Neuroscience · doi:10.3233/rnn-160647 · Cited by 116
“Striem-Amit et al. (2012a) designed a visual-toauditory version of the Snellen visual acuity E-chart, testing it on eight congenitally and one early-onset blind subjects who received training with the vOICe system for 73 hours, in weekly training sessions.”
MethodA Depth-Based Head-Mounted Visual Display to Aid Navigation in Partially Sighted Individuals
Hicks, S. L., Wilson, I., Muhammed, L., Worsfold, J., Downes, S. M., & Kennard, C. (2013) · PLoS ONE · doi:10.1371/journal.pone.0067695 · Cited by 110
“Sensory substitution involves the use of tones or vibrations to convey the characteristics and position of nearby objects and obstacles [9,10,11,12,13,14,15].”
BackgroundThe experience of new sensorimotor contingencies by sensory augmentation
Kaspar, K., König, S., Schwandt, J., & König, P. (2014) · Consciousness and Cognition · doi:10.1016/j.concog.2014.06.006 · Cited by 84
Navigation using sensory substitution in real and virtual mazes
Chebat, D.-R., Maidenbaum, S., & Amedi, A. (2015) · PLOS ONE · doi:10.1371/journal.pone.0126307 · Cited by 99
“These devices have been used successfully for a wide range of tasks including object identification [33, 34] and acuity [35, 36], obstacle avoidance [37] and others [38].”
BackgroundMethodSelf-citationIs there a future for sensory substitution outside academic laboratories?
Elli, G. V., Benetti, S., & Collignon, O. (2014) · Multisensory Research · doi:10.1163/22134808-00002460 · Cited by 90
“…recognition (Poirier et al. , 2007), distinction of two-dimensional shapes (Arno et al. , 1999, 2001), and object discrimination and localization (Auvray et al. , 2007; Kim and Zatorre, 2008; Proulx et al. , 2008; with blind individuals: Renier and De Volder, 2010; Striem-Amit et al. , 2012c).”
InfluentialSensory Substitution and the Neural Correlates of Navigation in Blindness
Chebat, D., Harrar, V., Kupers, R. C., Maidenbaum, S., Amedi, A., & Ptito, M. (2017) · Springer eBooks · doi:10.1007/978-3-319-54446-5_6 · Cited by 101
Self-citationIllusory contours: a window onto the neurophysiology of constructing perception
Murray, M. M., & Herrmann, C. S. (2013) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2013.07.004 · Cited by 92
Fast, accurate reaching movements with a visual-to-auditory sensory substitution device
Levy-Tzedek, S., Hanassy, S., Abboud, S., Maidenbaum, S., & Amedi, A. (2012) · Restorative Neurology and Neuroscience · doi:10.3233/rnn-2012-110219 · Cited by 79
“A video demonstration of this is presented in Striem-Amit et al.’s recent article (Striem-Amit et al., 2012; supplementary materials).”
MethodSelf-citationWatchOut: Obstacle Sonification for People with Visual Impairment or Blindness
Presti, G., Ahmetovic, D., Ducci, M., Bernareggi, C., Ludovico, L. A., Baratè, A., Avanzini, F., & Mascetti, S. (2019) · International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS) · doi:10.1145/3308561.3353779 · Cited by 82
“This approach requires a long training; for example, a case study shows that about 8 months training is needed to fve blind persons to learn to walk along paths and properly avoid objects using “the vOICe” [34].”
MethodHow well do you see what you hear? The acuity of visual-to-auditory sensory substitution
Haigh, A., Brown, D. J., Meijer, P., & Proulx, M. J. (2013) · Frontiers in Psychology · doi:10.3389/fpsyg.2013.00330 · Cited by 72
Heimler, B., & Amedi, A. (2020) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2020.06.034 · Cited by 78
Self-citationAugmented reality powers a cognitive assistant for the blind
Liu, Y., Stiles, N. R. B., & Meister, M. (2018) · eLife · doi:10.7554/elife.37841 · Cited by 81
Low Vision and Plasticity: Implications for Rehabilitation
Legge, G. E., & Chung, S. T. L. (2016) · Annual Review of Vision Science · doi:10.1146/annurev-vision-111815-114344 · Cited by 63
“Striem-Amit et al. (2012) measured the acuity of nine early blind subjects who had extensive training on vOICe (averaging 73 hours over several months).”
New Vision for Visual Prostheses
Farnum, A., & Pelled, G. (2020) · Frontiers in Neuroscience · doi:10.3389/fnins.2020.00036 · Cited by 58
Landgraf, S., & Osterheider, M. (2013) · Frontiers in Psychology · doi:10.3389/fpsyg.2013.00352 · Cited by 53
“…us to postulate the following two assumptions: first, neurofunctional plasticity in congenitally blind individuals includes reorganization in non-visual cortical areas, which has been confirmed, for example, in lingual and posterior fusiform gyri (Smith and Gasser, 2005; Striem-Amit et al., 2012a).”
BackgroundInfluentialHearing colors: an example of brain plasticity
Alfaro, A., Bernabéu, Á., Mateo, C. M., Parra, J., & Fernández, E. (2015) · Frontiers in Systems Neuroscience · doi:10.3389/fnsys.2015.00056 · Cited by 58
“In particular, we found changes in functional neural patterns, structural connectivity and cortical topography at the visual and auditive cortex of the Eyeborg user in comparison with a control population.”
BackgroundCieśla, K., Wolak, T. P., Lorens, A., Mentzel, M., Skarżyńśki, H., & Amedi, A. (2022) · Scientific Reports · doi:10.1038/s41598-022-06855-8 · Cited by 59
Self-citationNau, A., Bach, M., & Fisher, C. (2013) · Translational Vision Science & Technology · doi:10.1167/tvst.2.3.1 · Cited by 53
“studied the visual acuity potential of an auditory based sensory substitution device called the VoICE.(30) Their results, based on eight subjects trained for this task for an average of 73 hours, showed Tumbling E’s could be resolved at the 20/200 level in some cases.”
BackgroundLevy-Tzedek, S., Novick, I., Arbel, R., Abboud, S., Maidenbaum, S., Vaadia, E., & Amedi, A. (2012) · Scientific Reports · doi:10.1038/srep00949 · Cited by 51
Self-citationDeciphering Sounds Through Patterns of Vibration on the Skin
Perrotta, M. V., Ásgeirsdóttir, T., & Eagleman, D. M. (2021) · Neuroscience · doi:10.1016/j.neuroscience.2021.01.008 · Cited by 57
Navigating from a Depth Image Converted into Sound
Stoll, C., Palluel-Germain, R., Fristot, V., Pellerin, D., Alleysson, D., & Graff, C. (2015) · Applied Bionics and Biomechanics · doi:10.1155/2015/543492 · Cited by 45
“More impressively, after only 70 hours of training, congenitally blind people passed the blindness acuity test of the World Health Organization [9].”
BackgroundBrain-Machine Interfaces to Assist the Blind
Ptito, M., Bleau, M., Djerourou, I., Paré, S., Schneider, F. C., & Chebat, D.-R. (2021) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2021.638887 · Cited by 45
Acquisition of Visual Perception in Blind Adults Using the BrainPort Artificial Vision Device
Nau, A. C., Pintar, C., Arnoldussen, A., & Fisher, C. (2015) · The American Journal of Occupational Therapy · doi:10.5014/ajot.2015.011809 · Cited by 42
"I Always Wanted to See the Night Sky": Blind User Preferences for Sensory Substitution Devices
Hamilton-Fletcher, G., Obrist, M., Watten, P., Mengucci, M., & Ward, J. (2016) · Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858241 · Cited by 36
Cieśla, K., Wolak, T. P., Lorens, A., Heimler, B., Skarżyńśki, H., & Amedi, A. (2019) · Restorative Neurology and Neuroscience · doi:10.3233/rnn-190898 · Cited by 48
“algorithms and the cognitive load required from new SSD users (Striem-Amit et al., 2012; Bubic et al., 2010; Maidenbaum et al., 2014; Kupers and Ptito. 2011; Yamanaka et al., 2009).”
BackgroundSelf-citationNavigation aid for blind persons by visual-to-auditory sensory substitution: A pilot study
Neugebauer, A., Rifai, K., Getzlaff, M., & Wahl, S. (2020) · PLOS ONE · doi:10.1371/journal.pone.0237344 · Cited by 41
Auditory feedback in error-based learning of motor regularity
van Vugt, F. T., & Tillmann, B. (2015) · Brain Research · doi:10.1016/j.brainres.2015.02.026 · Cited by 42
Bermejo, F. R., Paolo, E. A. D., Hüg, M. X., & Arias, C. J. (2015) · Frontiers in Psychology · doi:10.3389/fpsyg.2015.00679 · Cited by 43
“…with revealing neurophysiological substrates of sensory substitution (for example Renier et al., 2005; Amedi et al., 2007; Hertz and Amedi, 2014); whereas, behavioral studies are focused on the qualities of perception (e.g., Renier et al., 2006; Kim and Zatorre, 2008; Striem-Amit et al., 2012).”
BackgroundChen, L., Feng, Y., Chen, B., Wang, Q., & Wei, K. (2021) · Journal of NeuroEngineering and Rehabilitation · doi:10.1186/s12984-021-00952-x · Cited by 36
“Previous studies on substitution of vision with tactile feedback typically required several weeks of practice time [54, 55].”
BackgroundBrown, D. J., & Proulx, M. J. (2016) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2016.2543678 · Cited by 31
“dynamic range of the auditory nerve to provide a higher theoretical and functional acuity [21], [22].”
BackgroundA mobility device for the blind with improved vertical resolution using dynamic vision sensors
Everding, L., Walger, L., Ghaderi, V. S., & Conradt, J. (2016) · IEEE International Conference on e-Health Networking, Applications and Services (Healthcom) · doi:10.1109/healthcom.2016.7749459 · Cited by 33
“vOICe was tested with two different groups of subjects: the first test int Table I (I) was performed by sighted subjects and consisted of a Snellen-E test [5], the second test (II) by blind users with 50-100h training performing a Snellen-E test [10], the phosphene prothesis used a Landolt-C test with 8 orientations […”
MethodLee, V., Nau, A. C., Laymon, C. M., Chan, K. C., Rosario, B. L., & Fisher, C. (2014) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2014.00291 · Cited by 35
The role of visual deprivation and experience on the performance of sensory substitution devices
Stronks, H. C., Nau, A. C., Ibbotson, M. R., & Barnes, N. (2015) · Brain Research · doi:10.1016/j.brainres.2015.06.033 · Cited by 31
Representing Colour Through Hearing and Touch in Sensory Substitution Devices
Hamilton-Fletcher, G., & Ward, J. (2013) · Multisensory Research · doi:10.1163/22134808-00002434 · Cited by 32
Color improves “visual†acuity via sound
Levy-Tzedek, S., Riemer, D., & Amedi, A. (2014) · Frontiers in Neuroscience · doi:10.3389/fnins.2014.00358 · Cited by 30
“…that the same stimuli, delivered via the vOICe SSD, activated either the ventral or the dorsal stream within the occipital lobe, depending on whether the congenitally blind participants were asked to identify the object presented, or determine its location, respectively (Striem-Amit et al., 2012b).”
BackgroundMethodResultInfluentialSelf-citationThe Role of Visual Experience in Individual Differences of Brain Connectivity
Sen, S., Khalsa, N. N., Tong, N., Ovadia‐Caro, S., Wang, X., Bi, Y., & Striem-Amit, E. (2022) · Journal of Neuroscience · doi:10.1523/jneurosci.1700-21.2022 · Cited by 33
“For example, sensory substitution devices that convert visual images into sounds or touch (Bach-Y-Rita et al., 1969; Meijer, 1992; Capelle et al., 1998; Striem-Amit et al., 2012) could benefit from cross-modal plasticity of specific senses (Brown et al.”
BackgroundSelf-citationIndividual Differences in Sensory Substitution
Arnold, G., Lerousseau, J. P., & Auvray, M. (2017) · Multisensory Research · doi:10.1163/22134808-00002561 · Cited by 32
“In addition, early-blind people are better at using the device in orientation identification tasks (Stiles et al. , 2015) and in ‘visual’ acuity tasks (Striem-Amit et al. , 2012).”
Blind wayfinding with physically-based liquid sounds
Spagnol, S., Hoffmann, R., Martínez, M. H., & Unnþórsson, R. (2018) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2018.02.002 · Cited by 27
Visual objects in the auditory system in sensory substitution: How much information do we need?
Brown, D. J., Simpson, A. J. R., & Proulx, M. J. (2014) · Multisensory Research · doi:10.1163/22134808-00002462 · Cited by 23
Hertrich, I., Dietrich, S., & Ackermann, H. (2013) · Frontiers in Psychology · doi:10.3389/fpsyg.2013.00530 · Cited by 26
“Direct links between auditory and visual object representations have also been suggested to be activated by the use of sensory substitution devices “translating” optical signals into audible acoustic patterns (Striem-Amit et al., 2012).”
BackgroundRichardson, M., Thar, J., Alvarez, J., Borchers, J., Ward, J., & Hamilton-Fletcher, G. (2019) · Perception · doi:10.1177/0301006619873194 · Cited by 26
“…is the use of cross-modal correspondences, such as substituting height for pitch, which may create easier to discriminate signal changes for users (Striem-Amit et al., 2012; Haigh et al., 2013), however this can have similar limitations (Brown et al., 2014; 2015; Brown & Proulx, 2016), and while…”
BackgroundMethodInfluentialA System for Assisting the Visually Impaired in Localization and Grasp of Desired Objects
Thakoor, K. A., Mante, N. T., Zhang, C., Siagian, C., Weiland, J. D., Itti, L., & Medioni, G. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-16199-0_45 · Cited by 22
“Learning to use the vOICe SSD requires months of training before independent utility can be achieved [18].”
MethodHeimler, B., Pavani, F., & Amedi, A. (2018) · Oxford University Press eBooks · doi:10.1093/oso/9780190880545.003.0015 · Cited by 22
Self-citationde Paz, C., Travieso, D., Ibáñez-Gijón, J., Bravo, M., Lobo, L., & Jacobs, D. M. (2019) · PLoS ONE · doi:10.1371/journal.pone.0213342 · Cited by 21
Sigalov, N., Maidenbaum, S., & Amedi, A. (2015) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2015.11.009 · Cited by 24
Self-citationPresti, G., Ahmetovic, D., Ducci, M., Bernareggi, C., Ludovico, L. A., Baratè, A., Avanzini, F., & Mascetti, S. (2021) · ACM Transactions on Accessible Computing · doi:10.1145/3470649 · Cited by 21
“[73] Position, Other (brightness) Timbral, Temporal, Loudness-related Metsiritrakul et al.”
BackgroundNeuroplasticity: Unexpected Consequences of Early Blindness
Murray, M. M., Matusz, P. J., & Amedi, A. (2015) · Current Biology · doi:10.1016/j.cub.2015.08.054 · Cited by 21
“exhibit these skills, achieving acuity above the WHO thresholds for blindness [16].”
Self-citationPasqualotto, A., & Esenkaya, T. (2016) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2016.00079 · Cited by 21
“Therearemany studies using sensory substitution that are concerned with recognition tasks (i.e., ‘‘what’’ tasks; Ptito et al., 2005; Kim and Zatorre, 2008; Brown et al., 2011; Striem-Amit et al., 2012; Haigh et al., 2013).”
BackgroundOn the Evaluation of Novel Sonification Techniques for Non-Visual Shape Exploration
Mascetti, S., Gerino, A., Bernareggi, C., & Picinali, L. (2017) · ACM Transactions on Accessible Computing · doi:10.1145/3046789 · Cited by 16
Maimon, A., Yizhar, O., Buchs, G., Heimler, B., & Amedi, A. (2022) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2022.108305 · Cited by 20
“Recent research shows that, given appropriate training, the visual cortex of even sighted individuals responds to task-related information from other sensory modalities (Striem-Amit et al., 2012a,b,c).”
BackgroundMethodSelf-citationTactile recognition of visual stimuli: Specificity versus generalization of perceptual learning
Arnold, G., & Auvray, M. (2018) · Vision Research · doi:10.1016/j.visres.2017.11.007 · Cited by 19
“Generalization to new stimuli with even more complex objects such as facial expressions has also been reported to occur (Striem-Amit et al., 2012).”
Augmenting perception: How artificial intelligence transforms sensory substitution
Longin, L., & Deroy, O. D. (2022) · Consciousness and Cognition · doi:10.1016/j.concog.2022.103280 · Cited by 22
Brown, D. J., Simpson, A. J. R., & Proulx, M. J. (2015) · Frontiers in Psychology · doi:10.3389/fpsyg.2015.01522 · Cited by 18
Multisensory and spatial processes in sensory substitution
Auvray, M. (2019) · Restorative Neurology and Neuroscience · doi:10.3233/rnn-190950 · Cited by 17
Body-scaled affordances in sensory substitution
Travieso, D., Gómez-Jordana, L. I., Díaz, A., Lobo, L., & Jacobs, D. M. (2015) · Consciousness and Cognition · doi:10.1016/j.concog.2015.10.009 · Cited by 15
Echoic Sensory Substitution Information in a Single Obstacle Circumvention Task
Kolarik, A. J., Scarfe, A. C., Moore, B. C. J., & Pardhan, S. (2016) · PLoS ONE · doi:10.1371/journal.pone.0160872 · Cited by 16
Testing vision is not testing for vision
Peli, E. (2020) · Translational Vision Science & Technology · doi:10.1167/tvst.9.13.32 · Cited by 14
Buchs, G., Heimler, B., & Amedi, A. (2019) · Multisensory Research · doi:10.1163/22134808-20181327 · Cited by 15
Self-citationA self-training program for sensory substitution devices
Buchs, G., Haimler, B., Kerem, M., Maidenbaum, S., Braun, L., & Amedi, A. (2021) · PLoS ONE · doi:10.1371/journal.pone.0250281 · Cited by 14
“The training used here, in the self-training program, is the basic and most common method, namely using a series of static stimuli [36, 58, 59].”
MethodSelf-citationDoes Neuroplasticity Support the Hypothesis of Multiple Realizability?
Maimon, A., & Hemmo, M. (2022) · Philosophy of Science · doi:10.1017/psa.2021.16 · Cited by 16
“Under these circumstances, for all procedural purposes, when using the SSD, these users are de jure low vision sighted individuals as opposed to legally blind (Striem-Amit, Guendelman, and Amedi 2012).”
MethodLongitudinal stability of individual brain plasticity patterns in blindness
Amaral, L., Thomas, P., Amedi, A., & Striem-Amit, E. (2024) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2320251121 · Cited by 16
Self-citationDeep Learning-Based Optimization of Visual–Auditory Sensory Substitution
Kim, M., Park, Y., Moon, K., & Jeong, C. Y. (2023) · IEEE Access · doi:10.1109/access.2023.3243641 · Cited by 12
“…could enable visually impaired and partially sighted people to recognize colors or The associate editor coordinating the review of this manuscript and approving it for publication was Felix Albu . objects [1], [2], navigate and avoid obstacles [3], [4], and even identify facial expressions [5].”
BackgroundMultimodal Feedback to Support the Navigation of Visually Impaired People
Seßner, J., Dellert, F., & Franke, J. E. (2022) · IEEE/SICE International Symposium on System Integration (SII) · doi:10.1109/sii52469.2022.9708751 · Cited by 12
Thakoor, K. A., Marat, S., Nasiatka, P. J., McIntosh, B. P., Sahin, F. E., Tanguay, A. R., Weiland, J. D., & Itti, L. (2013) · IEEE International Conference on Multimedia and Expo workshops · doi:10.1109/icmew.2013.6618345 · Cited by 12
“Over the past decade, numerous Electronic Travel Aids have been developed that aid in scene interpretation with sound [2], navigation and object localization [3], and even object or text recognition [4–”
BackgroundImproving training for sensory augmentation using the science of expertise
Bertram, C., & Stafford, T. (2016) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2016.05.026 · Cited by 12
“A substantial number of SSADs focus on providing visual information, and SSADs have been presented as an alternative to retinal implants as a method for restoring visual function (Striem-Amit et al., 2012b).”
BackgroundMethodInfluential'Visual’ parsing can be taught quickly without visual experience during critical periods
Reich, L., & Amedi, A. (2015) · Scientific Reports · doi:10.1038/srep15359 · Cited by 12
Self-citationSpagnol, S., Baldan, S., & Unnþórsson, R. (2017) · IEEE International Workshop on Multimedia Signal Processing (MMSP) · doi:10.1109/mmsp.2017.8122220 · Cited by 13
Mobile Video-to-Audio Transducer and Motion Detection for Sensory Substitution
Ambard, M., Benezeth, Y., & Pfister, P. (2015) · Frontiers in ICT · doi:10.3389/fict.2015.00020 · Cited by 13
“, 2001), and orientation of letters can be recognized, allowing VASSDs users to exceed the threshold for the World Health Organization definition of blindness on an adapted Snellen’s acuity test (Striem-Amit et al., 2012).”
BackgroundBanf, M., Mikalay, R., Watzke, B., & Blanz, V. (2016) · Journal of Rehabilitation and Assistive Technologies Engineering · doi:10.1177/2055668316674582 · Cited by 11
“29,30 Reich et al. 14 infer that if the hypothesis of the highly flexible task-oriented and sensory-independent brain applies, the absence of visual experience should not limit proper task specialization of the visual system, despite its recruitment for various functions in the blind, and the visual…”
BackgroundPerception and Interactive Technology
Scheller, M., Petrini, K., & Proulx, M. J. (2018) · Wiley eBooks · doi:10.1002/9781119170174.epcn215 · Cited by 12
Torres, J. P., da Costa, C. S. L., & Lourenço, G. F. (2016) · Revista Brasileira de Educação Especial · doi:10.1590/s1413-65382216000400010 · Cited by 20
Hamilton-Fletcher, G., & Chan, K. C. (2021) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc46164.2021.9630296 · Cited by 11
“For auditory SSDs, congenitally blind users with ~70 hours of training have been able to reach a ‘visual’ acuity of up to 20/200 [6], matching the World Health Organization threshold for legal blindness.”
BackgroundA low-power neuromorphic system for retinal implants and sensory substitution
Gaspar, N., Sondhi, A., Evans, B. D., & Nikolić, K. (2016) · IEEE Biomedical Circuits and Systems Conference (BioCAS) · doi:10.1109/biocas.2016.7833729 · Cited by 9
“While users of an SSD system, such as the vOICe [4], can perform well using pixelised images, these systems transfer a lot of redundant information, as static images (e.”
BackgroundGraulty, C. J., Papaioannou, O., Bauer, P., Pitts, M. A., & Canseco-Gonzalez, E. (2017) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_01210 · Cited by 9
“…has led to subsequent fMRI studies investigating the neural mechanisms underlying this phenomenon (Hertz & Amedi, 2015; Campus et al., 2012; Striem-Amit et al., 2012; Kim & Zatorre, 2011; Ortiz et al., 2011; Amedi et al., 2007; Collignon, Lassonde, Lepore, Bastien, & Veraart, 2006;…”
BackgroundThe MAPS: Toward a Novel Mobility Assistance System for Visually Impaired People
Romeo, K., Pissaloux, E. E., Gay, S. L., Truong, N.-T., & Djoussouf, L. (2022) · Sensors · doi:10.3390/s22093316 · Cited by 11
“For visual-to-audio SSDs, two of the most popular devices are “the vOICe” [16–18] and “EyeMusic” [19].”
Neuroplasticity in the blind and sensory substitution for vision
Striem-Amit, E. (2014) · doi:10.13140/2.1.2640.2247 · Cited by 7
Self-citationSensory augmentation to aid training with retinal prostheses
Kvansakul, J. G. S., Hamilton, L. H. W., Ayton, L. N., McCarthy, C. D., & Petoe, M. A. (2020) · Journal of Neural Engineering · doi:10.1088/1741-2552/ab9e1d · Cited by 7
de Carvalho, L. V., de Melo, G. M., Aquino, P. D. S., Castro, R. C. M. B., Cardoso, M. V. L. M. L., & Pagliuca, L. M. F. (2017) · Rev Rene · doi:10.15253/2175-6783.2017000300018 · Cited by 7
“Studies evidenced the development of plans with the purpose of guaranteeing the viability and effectiveness of the technological application(8-13).”
BackgroundInfluentialHeimler, B., & Amedi, A. (2019) · Elsevier eBooks · doi:10.1016/b978-0-12-812492-5.00015-2 · Cited by 9
Self-citationSubstitution of human olfaction by the trigeminal system
Stanley, H. B., Lipp, C., Mignot, C., Weise, S., Garefis, K., Fieux, M., Tsakiropoulou, E., Genetzaki, S., Dubreuil, R., Ferdenzi, C., et al. (2025) · Science Advances · doi:10.1126/sciadv.adu7926 · Cited by 6
“It has been shown that it is possible to replace some visual perception via tactile ( 55 , 56 ) or auditory ( 38 , 41 , 42 , 57 ) channels and hearing via touch ( 58 , 59 ).”
Exploring Eye-Tracking-Driven Sonification for the Visually Impaired
Dietz, M., Elgarf, M., Damian, I., & André, E. (2016) · Augmented Human International Conference · doi:10.1145/2875194.2875208 · Cited by 6
“Common sonification applications for this user group aim at object recognition such as the vOICe [18]: an application for smart phones which enables users to recognize objects and to locate them in space.”
BackgroundLocalizing 3D motion through the fingertips: Following in the footsteps of elephants
Snir, A., Cieśla, K., Ozdemir, G., Vekslar, R., & Amedi, A. (2024) · iScience · doi:10.1016/j.isci.2024.109820 · Cited by 6
“This 71–73 Possibly,due tothe more‘‘natural’’trans-lation between the auditory and the tactile sensory inputs, as well as by using stimuli in motion, i.e., more closely resembling natural environments, the novel task used in the current experiment felt more intuitive.”
Self-citationPerfect Accuracy with Human-in-the-Loop Object Detection
Brenner, R., Priyadarshi, J., & Itti, L. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-48881-3_25 · Cited by 6
Standardizing Visual Rehabilitation using Simple Virtual Tests
Maidenbaum, S., & Amedi, A. (2019) · International Conference on Virtual Rehabilitation · doi:10.1109/icvr46560.2019.8994431 · Cited by 6
“Examples of current tests: Some examples of current tests for visual rehabilitation devices (A) Snellen visual acuity test using the vOICe [14].”
BackgroundMethodSelf-citationHanneton, S., Herquel, P., & Auvray, M. (2015) · International Journal of Adaptive Control and Signal Processing · doi:10.1002/acs.2549 · Cited by 5
“The results revealed that the mean NOH was significantly influenced by the Trial factor (F[9,117] D 2:776 , p 0:01 ), by the Gender factor (F[1,13] D 7:212 , p 0:02 ), but not by the Practice factor.”
BackgroundEars on the Hand: Reaching Three-Dimensional Targets With an Audio-Motor Device
Hanneton, S., Hoellinger, T., Forma, V., Roby-Brami, A., & Auvray, M. (2019) · Multisensory Research · doi:10.1163/22134808-20191436 · Cited by 6
“It is estimated that further time still would be required to achieve a high level of expertise, for instance to be able to recognize facial expressions with visual-to-auditory devices (Striem-Amit et al. , 2012).”
ThermalSense: A Sensory Substitution System for Enabling Perception of Thermal Information
Wald, I. Y., Bronstein, Y., Maimon, A., & Amedi, A. (2025) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3733048 · Cited by 4
“In previous research, sensory substitution systems and devices such as the vOICe and the EyeMusic have been used for conveying visual information through auditory signals [35, 59].”
Self-citationDepth-To-Audio Sensory Substitution for Increasing the Accessibility of Virtual Environments
Maidenbaum, S., Chebat, D., Levy‐Tzedek, S., & Amedi, A. (2014) · Lecture notes in computer science · doi:10.1007/978-3-319-07437-5_38 · Cited by 4
“SSDs such as the vOICe and Brainport have been used to obtain impressive results both in the real world (reviewed in [9]), and in laboratory settings (for example [10-12]).”
MethodSelf-citationWord recognition: re-thinking prosthetic vision evaluation
Han, S., Qiu, C., Lee, K. R., Jung, J., & Peli, E. (2018) · Journal of Neural Engineering · doi:10.1088/1741-2552/aac663 · Cited by 4
Can you Hear the Colour? Designing Virtual Worlds for Synaesthetic and Multimodal Experiences
Wright, V. C., & Kefalidou, G. (2021) · Interacting with Computers · doi:10.1093/iwc/iwac011 · Cited by 4
Comparison of tactile sensation among blind and sighted individuals
Vadapalli, K., Ravi, D., Krishna, D. B. V., Jyothirmai, V., & Devarakonda, B. V. (2020) · Indian Journal of Clinical Anatomy and Physiology · doi:10.18231/j.ijcap.2020.034 · Cited by 3
“/ Indian Journal of Clinical Anatomy and Physiology 2020;7(2):169–172 171”
BackgroundInfluentialThe brain dynamics of congenitally blind people seeing faces and letters via soundPreprint
Matusz, P. J., Reich, L., Stolz, L. A., Retsa, C., Tovar, D. A., Striem-Amit, E., Aggius-Vella, E., Amedi, A., & Murray, M. M. (2025) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2025.01.22.634358 · Cited by 4
Self-citationMulti-path sensory substitution device navigates the blind and visually impaired individuals
Han, Z., Li, S., Wang, X., Hu, X., Higashita, R., & Liu, J. (2025) · Displays · doi:10.1016/j.displa.2025.103200 · Cited by 3
Metadata
- Authors
- Striem-Amit, E., Guendelman, M., & Amedi, A.
- Affiliations
- Hebrew University of Jerusalem (IL)
- Corresponding author
- Amedi, Amir
- Venue
- PLoS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2012-03-16
- Volume
- 7
- Issue
- 3
- Pages
- e33136
- ISSN
- 1932-6203 (ISSN-L)
- PMC
- PMC3306374
- OpenAlex
- W2021082347
- Cited by
- 117
- References
- 42
- Citations by year
- 2026: 5 · 2025: 7 · 2024: 3 · 2023: 1 · 2022: 8 · 2021: 8 · 2020: 7 · 2019: 9 · 2018: 7 · 2017: 7 · 2016: 14 · 2015: 16 · 2014: 11 · 2013: 11 · 2012: 3
- FWCI
- 6.71
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- PLoS ONE (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Figshare (submittedVersion, cc-by)
- Funders
- European Commission (205357)
- Hebrew University of Jerusalem
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Tactile and Sensory Interactions
- Health Sciences › Health Professions › Occupational Therapy › Assistive Technology in Communication and Mobility
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Multisensory perception and integration
- Keywords
- sensory substitution devices, congenital blindness, visual acuity, visual rehabilitation, voice, retinal prosthesis
- MeSH terms
- Acoustic Stimulation, Adult, Blindness, Facial Expression, Female, Humans, Male, Middle Aged, Sensory Aids, Visual Acuity, Young Adult
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.