Fast, accurate reaching movements with a visual-to-auditory sensory substitution device
Open accessThe DOI matches its Crossref record; 49 of the 49 references it cites were found in a registry or an index.
Abstract
Purpose: Visual sensory substitution devices (SSDs) use sound or touch to convey information that is normally perceived by vision. The primary focus of prior research using SSDs was the perceptual components of learning to use SSDs and their neural correlates. However, sensorimotor integration is critical in the effort to make SSDs relevant for everyday tasks, like grabbing a cup of coffee efficiently. The purpose of this study was to test the use of a novel visual-to-auditory SSD to guide a fast reaching movement. Methods: Using sound, the SSD device relays location, shape and color information. Participants were asked to make fast reaching movements to targets presented by the SSD. Results: After only a short practice session, blindfolded sighted participants performed fast and accurate movements to presented targets, which did not differ significantly from movements performed with visual feedback in terms of movement time, peak speed, and path length. A small but significant difference was found between the endpoint accuracy of movements under the two feedback conditions; remarkably, in both cases the average error was smaller than 0.5 cm. Conclusions: Our findings combine with previous brain-imaging studies to support a theory of a modality-independent representation of spatial information. Task-specificity, rather than modality-specificity, of brain functions is crucially important for the rehabilitative use of SSDs in the blind and the visually impaired. We present the first direct comparison between movement trajectories performed with an SSD and ones performed under visual guidance. The accuracy level reached in this study demonstrates the potential applicability of using the visual-to-auditory SSD for performance of daily tasks which require fast, accurate reaching movements, and indicates a potential for rehabilitative use of the device.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures





Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“After a 25-minute familiarization session and brief training, participants were able to reach the targets (using the SSD) with high accuracy and efficiency, similar to that achieved during a visually-assisted task (see also Levy-Tzedek, Riemer & Amedi, 2014).”
From Designing sensory-substitution devices: Principles, pitfalls and potential1 (2016) · cites this paper as Levy-Tzedek et al. (2012)
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Behavioral studies on visual-auditory SSDs investigated the level of task performance to estimate the progress of visual perception in specific goal-related behaviors such as object recognition [2], localization [8], and navigation [9].”
From Deep Learning-Based Optimization of Visual–Auditory Sensory Substitution (2023) · cites this paper as [8]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The coordination of arm movements: an experimentally confirmed mathematical model
Flash, T., & Hogan, N. (1985) · The Journal of Neuroscience · doi:10.1523/jneurosci.05-07-01688.1985 · Cited by 4,395 · cited 1×
“Reaching movements have been shown to follow a straight trajectory (Flash and Hogan, 1985), and performance measures were developed based on this characterization.”
An internal model for sensorimotor integration
Wolpert, D. M., Ghahramani, Z., & Jordan, M. I. (1995) · Science · doi:10.1126/science.7569931 · Cited by 3,553 · cited 2×
“…the movements based on memory (e.g., from the VIS block), as movements in the absence of visual feedback have been shown to be miscalibrated, and not corrected based on proprioception alone (Soechting and Flanders, 1989; Wolpert et al., 1995; Levy-Tzedek et al., 2011b; Levy-Tzedek et al., 2011c).”
BackgroundSignal-dependent noise determines motor planning
Harris, C. M., & Wolpert, D. M. (1998) · Nature · doi:10.1038/29528 · Cited by 2,498 · cited 1×
“To test whether the latter is the result of signal-dependent noise (Harris and Wolpert, 1998), we compared the peak accelerations in both conditions, and found them to not differ significantly (p = 0.12, data not shown).”
ResultInfluentialVision substitution by tactile image projection
BACH-Y-RITA, P., COLLINS, C. C., SAUNDERS, F. A., WHITE, B., & SCADDEN, L. (1969) · Nature · doi:10.1038/221963a0 · Cited by 956 · cited 1×
“For example, images, usually perceived with the sense of vision, can be conveyed by touch (Bach-Y-Rita et al., 1969; Bach-y-Rita, 1970; Collins, 1970) or by sound (Meijer, 1992).”
BackgroundAn experimental system for auditory image representations
Meijer, P. B. L. (1992) · IEEE Transactions on Biomedical Engineering · doi:10.1109/10.121642 · Cited by 900 · cited 4×
“…an image are “sounded” sequentially from left to right, where the height of a pixel on the image is translated into sound frequency (higher frequency for higher pixels) and the amplitude of the sound corresponds to the brightness of the pixel (higher amplitude for brighter pixels) (Meijer, 1992).”
BackgroundInfluentialSensory substitution and the human-machine interface
Bach-y-Rita, P., & W. Kercel, S. (2003) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2003.10.013 · Cited by 858 · cited 1×
“The TVSS transforms image information into tactile stimulation (either vibration or electrical stimulation) on the skin (located on the abdomen, back, thigh, fingertip, or forehead) (Bach-y-Rita and Kercel, 2003).”
BackgroundBangert, M., Peschel, T., Schlaug, G., Rotte, M., Drescher, D., Hinrichs, H., Heinze, H.-J., & Altenmüller, E. (2006) · NeuroImage · doi:10.1016/j.neuroimage.2005.10.044 · Cited by 653 · cited 2×
“Well-trained musicians have been shown, using fMRI, to have strong audio-motor associations (Hasegawa et al., 2004; Haslinger et al., 2005; Bangert et al., 2006).”
BackgroundMethodWhy Don't We Move Faster? Parkinson's Disease, Movement Vigor, and Implicit Motivation
Mazzoni, P., Hristova, A., & Krakauer, J. W. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.0264-07.2007 · Cited by 557 · cited 2×
“Kinematic parameters such as movement time (Chen et al., 2007; Mazzoni et al., 2007), peak speed (Chen, et al.”
BackgroundSensorimotor representations for pointing to targets in three-dimensional space
Soechting, J. F., & Flanders, M. (1989) · Journal of Neurophysiology · doi:10.1152/jn.1989.62.2.582 · Cited by 476 · cited 2×
“…the movements based on memory (e.g., from the VIS block), as movements in the absence of visual feedback have been shown to be miscalibrated, and not corrected based on proprioception alone (Soechting and Flanders, 1989; Wolpert et al., 1995; Levy-Tzedek et al., 2011b; Levy-Tzedek et al., 2011c).”
BackgroundShape conveyed by visual-to-auditory sensory substitution activates the lateral occipital complex
Amedi, A., Stern, W. M., Camprodon, J. A., Bermpohl, F., Merabet, L., Rotman, S., Hemond, C., Meijer, P., & Pascual-Leone, A. (2007) · Nature Neuroscience · doi:10.1038/nn1912 · Cited by 451 · cited 1×
“Indeed, the main focus of studies using SSDs has been recognition of shapes and objects (e.g., Arno et al., 2001; Amedi et al., 2005; Renier et al., 2006; Amedi et al., 2007; Merabet et al., 2009), while relatively little attention was given to using the SSDs to guide movement.”
BackgroundSelf-citation
Research works printed but not linked: 1
- [31]31. Maidenbaum, S., Levy-Tzedek, S., Arbel, R., Hanassy, S. & Amedi, A. (2011). Shapes from the Depths -Shape Recognition Using Distance Information. Presented at the 7th Computational Motor Control Workshop, Israel.
Cited by
Maidenbaum, S., Abboud, S., & Amedi, A. (2014) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2013.11.007 · Cited by 230
Self-citationAbboud, S., Hanassy, S., Levy-Tzedek, S., Maidenbaum, S., & Amedi, A. (2014) · Restorative Neurology and Neuroscience · doi:10.3233/rnn-130338 · Cited by 199
“Users are expected to perform better in tasks such involving color-driven reaching (Levy-Tzedek et al., 2012a) and figure-ground segregation compared with veteran SSDs that do not provide color information.”
InfluentialSelf-citationThe “EyeCane”, a new electronic travel aid for the blind: Technology, behavior & swift learning
Maidenbaum, S., Hanassy, S., Abboud, S., Buchs, G., Chebat, D.-R., Levy-Tzedek, S., & Amedi, A. (2014) · Restorative Neurology and Neuroscience · doi:10.3233/rnn-130351 · Cited by 132
“For example, it can enhance the White Cane with further distance and angles, or synergistically combine with SSDs such as the vOICe or TDU for shape and location information or the “EyeMusic” for shape, location and color information as suggested in Reich, 2012.”
Self-citationDesigning sensory-substitution devices: Principles, pitfalls and potential1
Kristjánsson, Á., Moldoveanu, A., Jóhannesson, Ó. I., Balan, O., Spagnol, S., Valgeirsdóttir, V. V., & Unnthorsson, R. (2016) · Restorative Neurology and Neuroscience · doi:10.3233/rnn-160647 · Cited by 116
“In Levy-Tzedek et al. (2012), blindfolded participants were trained on EyeMusic in order to improve their ability to perform fast and accurate movements towards targets.”
Is there a future for sensory substitution outside academic laboratories?
Elli, G. V., Benetti, S., & Collignon, O. (2014) · Multisensory Research · doi:10.1163/22134808-00002460 · Cited by 90
“…blind volunteers to investigate a number of fundamental issues in cognitive neuroscience, such as perceptual learning (e.g. Kim and Zatorre, 2008; Levy-Tzedek et al. , 2012a), cross-modal plasticity (e.g. Amedi et al. , 2007; Collignon et al. , 2007, 2009a, 2011b; Ptito et al. , 2005) and the…”
Sensory Substitution and the Neural Correlates of Navigation in Blindness
Chebat, D., Harrar, V., Kupers, R. C., Maidenbaum, S., Amedi, A., & Ptito, M. (2017) · Springer eBooks · doi:10.1007/978-3-319-54446-5_6 · Cited by 101
Self-citationMaidenbaum, S., Levy-Tzedek, S., Chebat, D.-R., & Amedi, A. (2013) · PLoS ONE · doi:10.1371/journal.pone.0072555 · Cited by 84
“This problem could be potentially solved by using the Virtual-EyeCane in combination with other sensory substitution devices (SSDs) such as the vOICe [17], TDU [18,19] or the EyeMusic [20,21] which would offer additional information to the blind user such as shape and color.”
MethodSelf-citationKlatzky, R. L., Giudice, N. A., Bennett, C. R., & Loomis, J. M. (2014) · Multisensory Research · doi:10.1163/22134808-00002447 · Cited by 74
“Another variant on image-to-sound mapping, called EyeMusic, has been demonstrated to enable rapid reaching movements similar to those performed under visual guidance (Levy-Tzedek et al., 2012).”
MethodKönig, S. U., Schumann, F., Keyser, J., Goeke, C., Carina, K., Susan, W., Lytochkin, A., Manuel, E., Brunsch, V., Wahn, B., et al. (2016) · PLoS ONE · doi:10.1371/journal.pone.0166647 · Cited by 85
“Since then, these results were supported by numerous experiments using vision-to-tactile substitution [17], or other sensory substitution devices like vision-to-auditory substitution [18,19], and vestibular-to-tactile substitution [20].”
ResultCecchetti, L., Kupers, R., Ptito, M., Pietrini, P., & Ricciardi, E. (2016) · Frontiers in Systems Neuroscience · doi:10.3389/fnsys.2016.00089 · Cited by 70
Levy-Tzedek, S., Novick, I., Arbel, R., Abboud, S., Maidenbaum, S., Vaadia, E., & Amedi, A. (2012) · Scientific Reports · doi:10.1038/srep00949 · Cited by 51
Self-citationFunctional organization of the caudal part of the human superior parietal lobule
Sulpizio, V., Fattori, P., Pitzalis, S., & Galletti, C. (2023) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2023.105357 · Cited by 44
“Area V6A, instead, that occupies most of the anterior bank of POs dorsally to V6, shows a parietal cytoarchitectural pattern (Luppino et al., 2005).”
Eizicovits, D., Edan, Y., Tabak, I., & Levy‐Tzedek, S. (2018) · Restorative Neurology and Neuroscience · doi:10.3233/rnn-170802 · Cited by 43
“Path length was calculated as the integral of the entire hand path from initiation to termination of each trial (Levy-Tzedek et al., 2007; Levy-Tzedek et al., 2012).”
MethodSelf-citationProulx, M. J., Gwinnutt, J., Dell’Erba, S., Levy-Tzedek, S., de Sousa, A. A., & Brown, D. J. (2015) · Restorative Neurology and Neuroscience · doi:10.3233/rnn-150541 · Cited by 36
Self-citationSupramodal processing optimizes visual perceptual learning and plasticity
Zilber, N., Ciuciu, P., Gramfort, A., Azizi, L., & van Wassenhove, V. (2014) · NeuroImage · doi:10.1016/j.neuroimage.2014.02.017 · Cited by 35
“Note that sensory substittion devices (e.g., the vOICe (Meijer, 1992) and the EyeMusic (Levy-Tzedek et al., 2012a)) h ve also started capitalizing on such intuitive perceptual associations (Melara and O’Brien, 1987; Maeda et al., 2004)).”
BackgroundSonification: Review of Auditory Display Solutions in Electronic Travel Aids for the Blind
Bujacz, M., & Strumiłło, P. (2016) · Archives of Acoustics · doi:10.1515/aoa-2016-0040 · Cited by 33
Representing Colour Through Hearing and Touch in Sensory Substitution Devices
Hamilton-Fletcher, G., & Ward, J. (2013) · Multisensory Research · doi:10.1163/22134808-00002434 · Cited by 32
The role of visual deprivation and experience on the performance of sensory substitution devices
Stronks, H. C., Nau, A. C., Ibbotson, M. R., & Barnes, N. (2015) · Brain Research · doi:10.1016/j.brainres.2015.06.033 · Cited by 31
The process of distal attribution illuminated through studies of sensory substitution
Hartcher-O’Brien, J., & Auvray, M. (2014) · Multisensory Research · doi:10.1163/22134808-00002456 · Cited by 31
Color improves “visual†acuity via sound
Levy-Tzedek, S., Riemer, D., & Amedi, A. (2014) · Frontiers in Neuroscience · doi:10.3389/fnins.2014.00358 · Cited by 30
“We developed a visual-to-auditory SSD, named the EyeMusic (Levy-Tzedek et al., 2012a,b; Abboud et al., 2014), which transforms digital images into soundscapes, or auditory representations of images, in a manner similar to the vOICe SSD developed by Meijer (1992).”
BackgroundMethodSelf-citationMuSS-bits: sensor-display blocks for deaf people to explore musical sounds
Petry, B., Illandara, T., & Nanayakkara, S. C. (2016) · Australian Conference on Computer-Human Interaction (OzCHI) · doi:10.1145/3010915.3010939 · Cited by 40
“(Levy-Tzedek et al., 2012).”
Waist-up protection for blind individuals using the EyeCane as a primary and secondary mobility aid
Buchs, G., Simon, N., Maidenbaum, S., & Amedi, A. (2017) · Restorative Neurology and Neuroscience · doi:10.3233/rnn-160686 · Cited by 35
Self-citationAging and Sensory Substitution in a Virtual Navigation Task
Levy-Tzedek, S., Maidenbaum, S., Amedi, A., & Lackner, J. (2016) · PLOS ONE · doi:10.1371/journal.pone.0151593 · Cited by 22
Self-citationMaidenbaum, S., Arbel, R., Buchs, G., Shapira, S., & Amedi, A. (2014) · Mediterranean Conference on Control and Automation (MED) · doi:10.1109/med.2014.6961368 · Cited by 25
Self-citationBalan, O. C., Moldoveanu, A. D. B., Moldoveanu, F., & Dascălu, M.-I. (2014) · International Conference on System Theory, Control and Computing (ICSTCC) · doi:10.1109/icstcc.2014.6982496 · Cited by 22
“In a Student t-test, the paired average results from both experiments proved to be non-significant (p=0.3 at p 0.01).”
InfluentialStrumiłło, P., Bujacz, M., Barański, P., Skulimowski, P., Korbel, P., Owczarek, M., Tomalczyk, K., Moldoveanu, A. D. B., & Unnþórsson, R. (2017) · Springer eBooks · doi:10.1007/978-3-319-54446-5_15 · Cited by 23
Musical Vision: an interactive bio-inspired sonification tool to convert images into music
Polo, A., & Sevillano, X. (2018) · Journal on Multimodal User Interfaces · doi:10.1007/s12193-018-0280-4 · Cited by 21
Tactile recognition of visual stimuli: Specificity versus generalization of perceptual learning
Arnold, G., & Auvray, M. (2018) · Vision Research · doi:10.1016/j.visres.2017.11.007 · Cited by 19
Impact of a Vibrotactile Belt on Emotionally Challenging Everyday Situations of the Blind
Brandebusemeyer, C., Luther, A., König, S. U., König, P., & Kärcher, S. M. (2021) · Sensors · doi:10.3390/s21217384 · Cited by 33
Guidelines for quantitative and qualitative studies of sensory substitution experience
Kałwak, W., Reuter, M., Łukowska, M., Majchrowicz, B., & Wierzchoń, M. (2018) · Adaptive Behavior · doi:10.1177/1059712318771690 · Cited by 14
Ryan, S., Palermos, S. O., & Farina, M. (2023) · Social Epistemology · doi:10.1080/02691728.2023.2277230 · Cited by 13
Improving training for sensory augmentation using the science of expertise
Bertram, C., & Stafford, T. (2016) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2016.05.026 · Cited by 12
“…the participants with the device and the sensation before a simple task, before tracking how participants acclimatised to the device over a series of tasks (Daz et al., 2012; Levy-Tzedek et al., 2012), or when intentionally studying the effects of a minimal amount of training (Murphy et al., 2016).”
BackgroundBuchs, G., Heimler, B., & Amedi, A. (2019) · Multisensory Research · doi:10.1163/22134808-20181327 · Cited by 15
“The EyeMusic SSD The EyeMusic visual-to-auditory SSD transforms visual images into audio soundscapes (Abboud et al., 2014; Levy-Tzedek et al., 2012).”
BackgroundSelf-citationBordeau, C., Scalvini, F., Migniot, C., Dubois, J., & Ambard, M. (2023) · Frontiers in Psychology · doi:10.3389/fpsyg.2023.1079998 · Cited by 14
“Various types of tasks have already been used, for example discrimination tasks with forced choice (Proulx et al., 2008; Levy-Tzedek et al., 2012; Ambard et al., 2015; Mhaish et al., 2016; Richardson et al., 2019), grasping tasks (Proulx et al.”
MethodPerception of distance-to-obstacle through time-delayed tactile feedback
Hartcher-O’Brien, J., Auvray, M., & Hayward, V. (2015) · IEEE World Haptics Conference (WHC) · doi:10.1109/whc.2015.7177683 · Cited by 15
“Thus, uncountable examples of such behaviours are evident across species, suggesting codes that rely on mapping space into time and vice-versa through moving objects or propagating waves.”
Vergunov, E. G., Nikolaeva, E. I., Балиоз, Н. В., & Krivoshchekov, S. G. (2018) · Human Physiology · doi:10.1134/s0362119718030143 · Cited by 47
Perceptual Learning: Tactile Letter Recognition Transfers Across Body Surfaces
Arnold, G., & Auvray, M. (2014) · Multisensory Research · doi:10.1163/22134808-00002443 · Cited by 17
“In particular, studies have revealed that these devices allow their users to perform localization tasks (Jansson, 1983; Levy-Tzedek et al., 2012; Renier et al., 2005) and simple as well as complex shape recognition (Arno et al., 2001; Auvray et al., 2007; Pollok et al., 2005; Sampaio et al., 2001).”
BackgroundDeep Learning-Based Optimization of Visual–Auditory Sensory Substitution
Kim, M., Park, Y., Moon, K., & Jeong, C. Y. (2023) · IEEE Access · doi:10.1109/access.2023.3243641 · Cited by 12
“Behavioral studies on visual–auditory SSDs investigated the level of task performance to estimate the progress of visual perception in specific goal-related behaviors such as object recognition [2], localization [8], and navigation [9].”
BackgroundEmergence of β and γ networks following multisensory training
Rocca, D. L., Ciuciu, P., Engemann, D. A., & van Wassenhove, V. (2019) · NeuroImage · doi:10.1016/j.neuroimage.2019.116313 · Cited by 11
Effects of Auditory Feedback on Visually-Guided Movement in Real and Virtual Space
McAnally, K. I., & Wallis, G. M. (2023) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2023.2216091 · Cited by 11
“Ultimately, the utility of sensory substitution relies more on meeting the specific demands of the task at hand than on the modality of the resulting percept (Levy-Tzedek et al., 2012).”
Using an auditory sensory substitution device to augment vision: evidence from eye movements
Wright, T. D., Margolis, A., & Ward, J. (2014) · Experimental Brain Research · doi:10.1007/s00221-014-4160-1 · Cited by 11
Feingold-Polak, R., Yelkin, A., Edelman, S., Shapiro, A., & Levy‐Tzedek, S. (2021) · Scientific Reports · doi:10.1038/s41598-021-00036-9 · Cited by 11
Self-citationMobile Video-to-Audio Transducer and Motion Detection for Sensory Substitution
Ambard, M., Benezeth, Y., & Pfister, P. (2015) · Frontiers in ICT · doi:10.3389/fict.2015.00020 · Cited by 13
“EyeMusic (Levy-Tzedek et al., 2012, 2014; Abboud et al., 2014; Maidenbaum et al., 2014a) is based on periodic left-to-right horizontal scans of images in which the sounds of musical instruments are produced depending on the colors of the pixels.”
BackgroundA TRIZ-driven conceptualisation of finger grip enhancer designs for the elderly
Tan, D. W. H., Ng, P. K., & Noor, E. E. M. (2021) · F1000Research · doi:10.12688/f1000research.51705.1 · Cited by 9
Buchs, G., Maidenbaum, S., Levy-Tzedek, S., & Amedi, A. (2015) · Restorative Neurology and Neuroscience · doi:10.3233/rnn-150592 · Cited by 8
“…exploration of the meta-modal basis of number representation in the brain (Abboud, Maidenbaum, Dehaene, & Amedi, 2015), and swift cross-sensory transfer of spatial information between vision and SSDs even with minimal training in an implicit, unconscious manner (Shelly Levy-Tzedek et al., 2012).”
BackgroundSelf-citationPatrolling the Boundaries of Synaesthesia
Auvray, M., & Farina, M. (2017) · Oxford University Press eBooks · doi:10.1093/oso/9780199688289.003.0013 · Cited by 10
Scaffolding the Music Listening and Music Making Experience for the Deaf
Petry, B., Huber, J., & Nanayakkara, S. C. (2017) · Cognitive science and technology · doi:10.1007/978-981-10-6404-3_3 · Cited by 12
Łukowska, M., Kałwak, W., Osiński, D., Janik, J., & Wierzchoń, M. (2022) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2022.102925 · Cited by 11
Mixing up the Senses: Sensory Substitution Is Not a Form of Artificially Induced Synaesthesia
Kirsch, L. P., Job, X., & Auvray, M. (2020) · Multisensory Research · doi:10.1163/22134808-bja10010 · Cited by 9
“…al. , 2015; Brown et al. , 2011; Kim and Zatorre, 2008; Striem-Amit et al. , 2012), visual localisation and reaching tasks (Hanneton et al. , 2020; Levy-Tzedek et al. , 2012; Proulx et al. , 2008) navigation and obstacle avoidance tasks (Chebat et al. , 2011, 2015; Kupers et al. , 2010) and even,…”
Graulty, C. J., Papaioannou, O., Bauer, P., Pitts, M. A., & Canseco-Gonzalez, E. (2017) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_01210 · Cited by 9
Sensory augmentation to aid training with retinal prostheses
Kvansakul, J. G. S., Hamilton, L. H. W., Ayton, L. N., McCarthy, C. D., & Petoe, M. A. (2020) · Journal of Neural Engineering · doi:10.1088/1741-2552/ab9e1d · Cited by 7
Alvarez-Molina, K., Reinschluessel, A. V., Kratky, T., Scharpenberg, M., & Malaka, R. (2023) · Behaviour and Information Technology · doi:10.1080/0144929x.2023.2243525 · Cited by 11
Portnoy, S., Halaby, O., Dekel-Chen, D., & Dierick, F. (2015) · Applied Ergonomics · doi:10.1016/j.apergo.2015.04.008 · Cited by 8
“(Levy-Tzedek et al., 2012) who requested blindfolded sighted participants to reach quickly and accurately to targets on a screen using auditory feedback.”
BackgroundBrain restoration as an emerging field in neurology and neuroscience
Bola, M., Prilloff, S., Matzke, S., & Henrich‐Noack, P. (2013) · Restorative Neurology and Neuroscience · doi:10.3233/rnn-139020 · Cited by 6
“Another example of advanced technology use is a study on visual-to-auditory sensory substitution device used by blind subjects (Levy-Tzedek et al., 2012) which helps normal subjects to detect visual stimuli through auditory “music-like” stimulation.”
Ears on the Hand: Reaching Three-Dimensional Targets With an Audio-Motor Device
Hanneton, S., Hoellinger, T., Forma, V., Roby-Brami, A., & Auvray, M. (2019) · Multisensory Research · doi:10.1163/22134808-20191436 · Cited by 6
“In particular, users of these systems become able to perform localisation tasks (e.g., Levy-Tzedek et al. , 2012; Proulx et al. , 2008), recognition tasks (Arno et al. , 2001; Auvray et al. , 2007-a, 2007-b; Pollok et al. , 2005; Sampaio et al. , 2001), navigation tasks (Chebat et al. , 2011; 2015)…”
Auditory Coding of Reaching Space
Fehse, U., Schmitz, G. H., Hartwig, D., Ghai, S., Brock, H., & Effenberg, A. O. (2020) · Applied Sciences · doi:10.3390/app10020429 · Cited by 9
Improvement in upper-limb UPDRS motor scores following fast-paced arm exercise: A pilot study
Levy‐Tzedek, S., Arbelle, D., Forman, D., & Zlotnik, Y. (2018) · Restorative Neurology and Neuroscience · doi:10.3233/rnn-180818 · Cited by 5
“For each reaching movement, we calculated the time it took to complete the movement, the path length (Levy-Tzedek et al., 2012; Levy-Tzedek et al., 2007; Levy-Tzedek et al., 2016) of the hand, the average and the peak speed in the direction of the movement.”
MethodSelf-citationTan, D. W. H., Ng, P. K., Noor, E. E. M., Jee, K. S., & Kamat, S. R. (2021) · Cogent Engineering · doi:10.1080/23311916.2021.1891710 · Cited by 4
“Auditory feedback can be one of the possible substitutes to visual sensors (Levy-Tzedek et al., 2012; Portnoy et al., 2015).”
BackgroundSeeing the Movement through Sound: Giving Trajectory Information to Visually Impaired People
Salamon, N. Z., Jacques, J. C. S., & Musse, S. R. (2014) · Brazilian Symposium on Computer Games and Digital Entertainment (SBGames) · doi:10.1109/sbgames.2014.12 · Cited by 4
“As result, user hearing this sound can identify objects and features in the environment image, guided by the sound [12], [13], [14].”
BackgroundBordeau, C., Scalvini, F., Migniot, C., Dubois, J., & Ambard, M. (2025) · Attention Perception & Psychophysics · doi:10.3758/s13414-025-03065-y · Cited by 3
“…a single object (Ambard et al., 2015; Auvray et al., 2007; Bordeau et al., 2023; Brown et al., 2011; Commère et al., 2020; Hanneton et al., 2010; Levy-Tzedek et al., 2012; Mhaish et al., 2016; Pourghaemi et al., 2018; Proulx et al., 2008), although such scenarios rarely occur outside a…”
Software Design for Low-Latency Visuo-Auditory Sensory Substitution on Mobile Devices
Ambard, M. (2017) · Computer and Information Science · doi:10.5539/cis.v10n2p1 · Cited by 5
“It has been shown that users are capable of grabbing a distant object (Levy-Tzedek et al., 2012) and that visual shapes can be differentiated (Brown et al., 2014).”
BackgroundLancioni, G. E., Singh, N. N., O’Reilly, M. F., Green, V. A., Alberti, G., Boccasini, A., Smaldone, A., Oliva, D., & Bosco, A. (2013) · Developmental Neurorehabilitation · doi:10.3109/17518423.2012.749953 · Cited by 3
Can You Hear That Peak? Utilization of Auditory and Visual Feedback at Peak Limb Velocity
Loria, T. D., de Grosbois, J. P., & Tremblay, L. (2016) · Research Quarterly for Exercise and Sport · doi:10.1080/02701367.2016.1196810 · Cited by 6
“Although participants were more accurate when visual information was available, reaches performed using the SSD had endpoint errors of less than 0.5 cm on average (Levy-Tzedek et al., 2012).”
MethodInfluentialVision Substitution Experiments with See ColOr
Bologna, G., Gómez, J. D., & Pun, T. (2013) · Lecture notes in computer science · doi:10.1007/978-3-642-38637-4_9 · Cited by 2
“More recently, “EyeMusic” sonifies a 24x40 pixel coloured image over 2 seconds [10].”
BackgroundThe brain dynamics of congenitally blind people seeing faces and letters via soundPreprint
Matusz, P. J., Reich, L., Stolz, L. A., Retsa, C., Tovar, D. A., Striem-Amit, E., Aggius-Vella, E., Amedi, A., & Murray, M. M. (2025) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2025.01.22.634358 · Cited by 4
Self-citationKalуnychenko, І. O., & Kolesnyk, A. (2022) · CHERKASY UNIVERSITY BULLETIN BIOLOGICAL SCIENCES SERIES · doi:10.31651/2076-5835-2018-1-2022-1-12-21 · Cited by 1
Trant, K. C., Bolluk, Z., Mohamed, R. A., König, S. U., & König, P. (2025) · Scientific Reports · doi:10.1038/s41598-025-21720-0 · Cited by 2
Cécité et réhabilitation visuelle
Matonti, F., Roux, S., Denis, D., Picaud, S. A., & Chavane, F. (2015) · Journal Français d Ophtalmologie · doi:10.1016/j.jfo.2014.06.012 · Cited by 2
Sensory Substitution and Perceptual Learning
Connolly, K. (2018) · British Academy eBooks · doi:10.5871/bacad/9780197266441.003.0014 · Cited by 1
“The EyeMusic represents five colours with notes from five ordinary instruments like a piano (white) and a marimba (blue) (Levy-Tzedek et al. 2012b: 316).”
BackgroundMethodInfluentialSeeing with Your Ears: A Wondrous Journey Across the Senses
Levy‐Tzedek, S., Halimi, M., & Amedi, A. (2013) · Frontiers for Young Minds · doi:10.3389/frym.2013.00012 · Cited by 1
“When blind participants read words with the SSD, this area was also activated.”
BackgroundSelf-citationPushing the boundaries of consciousness and cognition
Pepper, K. (2014) · White Rose eTheses Online (University of Leeds, The University of Sheffield, University of York)
The action-perception loop examined across senses
Amedi, A., & Levy‐Tzedek, S. (2013) · Multisensory Research · doi:10.1163/22134808-000s0023
Self-citationMultisensory Integration at Peak Limb Velocity
Loria, T. D. (2015) · TSpace (University of Toronto)
Bezkopylna, S. V. (2020) · Notes in Current Biology · doi:10.29038/2617-4723-2020-1-389-94-101 · Cited by 2
“модальності в когнітивних підходах проводять за допомогою сенсомоторної хронометрії [2; 3; 4; 5; 6].”
Structure Waves in Biopolymers and Biological Evolution Paths
Maruani, J. (2021) · Progress in theoretical chemistry and physics · doi:10.1007/978-3-030-68314-6_16
Papaioannou, O., Bauer, P., Pitts, M., Canseco-Gonzalez, E., & Graulty, C. J. (2017) · OSF Preprints (OSF Preprints)
Brain-Computer Interfaces for Vision Recovery in Precortical Vision Loss
Yang, C., Guo, A., & Lin, K. (2026) · Eye and Brain · doi:10.2147/eb.s561691
Park, S., Bak, S., & Lee, H. (2026) · British Journal of Visual Impairment · doi:10.1177/02646196261450976
Metadata
- Authors
- Levy-Tzedek, S., Hanassy, S., Abboud, S., Maidenbaum, S., & Amedi, A.
- Affiliations
- The Institute for Medical Research Israel-Canada (IMRIC), Faculty of Medicine, Department of Medical Neurobiology, The Hebrew University of Jerusalem, Jerusalem, Israel
- Hebrew University of Jerusalem (IL)
- Corresponding author
- Amedi, A.
- Venue
- Restorative Neurology and Neuroscience
- Publisher
- SAGE Publications
- Published
- 2012-01-01
- Volume
- 30
- Issue
- 4
- Pages
- 313-323
- ISSN
- 0922-6028 (ISSN-L)
- 1878-3627
- OpenAlex
- W2110831185
- Cited by
- 79
- References
- 49
- Citations by year
- 2026: 2 · 2025: 3 · 2023: 6 · 2022: 2 · 2021: 5 · 2020: 4 · 2019: 3 · 2018: 7 · 2017: 8 · 2016: 8 · 2015: 8 · 2014: 13 · 2013: 9 · 2012: 1
- FWCI
- 5.07
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Restorative Neurology and Neuroscience (publishedVersion, cc-by-nc)
- PubMed (publishedVersion)
- Funders
- James S. McDonnell Foundation (220020284)
- Israel Science Foundation (ISF 1684/08, 1684/08)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Tactile and Sensory Interactions
- Life Sciences › Neuroscience › Cognitive Neuroscience › Motor Control and Adaptation
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Multisensory perception and integration
- Keywords
- sensory substitution devices, reaching movements, sensorimotor integration, auditory feedback, task specificity, movement accuracy, movement time
- MeSH terms
- Acoustic Stimulation, Adult, Feedback, Female, Humans, Male, Movement, Perception, Psychomotor Performance, Time Factors, Vision, Ocular, Persons with Visual Disabilities, Young Adult
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.