Fast, accurate reaching movements with a visual-to-auditory sensory substitution device
Open accessThe DOI matches its Crossref record; 49 of the 49 references it cites were found in a registry or an index.
Abstract
Purpose: Visual sensory substitution devices (SSDs) use sound or touch to convey information that is normally perceived by vision. The primary focus of prior research using SSDs was the perceptual components of learning to use SSDs and their neural correlates. However, sensorimotor integration is critical in the effort to make SSDs relevant for everyday tasks, like grabbing a cup of coffee efficiently. The purpose of this study was to test the use of a novel visual-to-auditory SSD to guide a fast reaching movement. Methods: Using sound, the SSD device relays location, shape and color information. Participants were asked to make fast reaching movements to targets presented by the SSD. Results: After only a short practice session, blindfolded sighted participants performed fast and accurate movements to presented targets, which did not differ significantly from movements performed with visual feedback in terms of movement time, peak speed, and path length. A small but significant difference was found between the endpoint accuracy of movements under the two feedback conditions; remarkably, in both cases the average error was smaller than 0.5 cm. Conclusions: Our findings combine with previous brain-imaging studies to support a theory of a modality-independent representation of spatial information. Task-specificity, rather than modality-specificity, of brain functions is crucially important for the rehabilitative use of SSDs in the blind and the visually impaired. We present the first direct comparison between movement trajectories performed with an SSD and ones performed under visual guidance. The accuracy level reached in this study demonstrates the potential applicability of using the visual-to-auditory SSD for performance of daily tasks which require fast, accurate reaching movements, and indicates a potential for rehabilitative use of the device.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“After a 25-minute familiarization session and brief training, participants were able to reach the targets (using the SSD) with high accuracy and efficiency, similar to that achieved during a visually-assisted task (see also Levy-Tzedek, Riemer & Amedi, 2014).”
From Designing sensory-substitution devices: Principles, pitfalls and potential1 (2016) · cites this paper as Levy-Tzedek et al. (2012)
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Behavioral studies on visual-auditory SSDs investigated the level of task performance to estimate the progress of visual perception in specific goal-related behaviors such as object recognition [2], localization [8], and navigation [9].”
From Deep Learning-Based Optimization of Visual–Auditory Sensory Substitution (2023) · cites this paper as [8]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The coordination of arm movements: an experimentally confirmed mathematical model
Flash, T., & Hogan, N. (1985) · The Journal of Neuroscience · doi:10.1523/jneurosci.05-07-01688.1985 · Cited by 4,395 · cited 1×
“Reaching movements have been shown to follow a straight trajectory (Flash and Hogan, 1985), and performance measures were developed based on this characterization.”
An internal model for sensorimotor integration
Wolpert, D. M., Ghahramani, Z., & Jordan, M. I. (1995) · Science · doi:10.1126/science.7569931 · Cited by 3,553
Signal-dependent noise determines motor planning
Harris, C. M., & Wolpert, D. M. (1998) · Nature · doi:10.1038/29528 · Cited by 2,498 · cited 1×
“To test whether the latter is the result of signal-dependent noise (Harris and Wolpert, 1998), we compared the peak accelerations in both conditions, and found them to not differ significantly (p = 0.12, data not shown).”
ResultInfluentialVision substitution by tactile image projection
BACH-Y-RITA, P., COLLINS, C. C., SAUNDERS, F. A., WHITE, B., & SCADDEN, L. (1969) · Nature · doi:10.1038/221963a0 · Cited by 956 · cited 1×
“For example, images, usually perceived with the sense of vision, can be conveyed by touch (Bach-Y-Rita et al., 1969; Bach-y-Rita, 1970; Collins, 1970) or by sound (Meijer, 1992).”
BackgroundAn experimental system for auditory image representations
Meijer, P. B. L. (1992) · IEEE Transactions on Biomedical Engineering · doi:10.1109/10.121642 · Cited by 900
Sensory substitution and the human-machine interface
Bach-y-Rita, P., & W. Kercel, S. (2003) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2003.10.013 · Cited by 858 · cited 1×
“The TVSS transforms image information into tactile stimulation (either vibration or electrical stimulation) on the skin (located on the abdomen, back, thigh, fingertip, or forehead) (Bach-y-Rita and Kercel, 2003).”
BackgroundBangert, M., Peschel, T., Schlaug, G., Rotte, M., Drescher, D., Hinrichs, H., Heinze, H.-J., & Altenmüller, E. (2006) · NeuroImage · doi:10.1016/j.neuroimage.2005.10.044 · Cited by 653
Why Don't We Move Faster? Parkinson's Disease, Movement Vigor, and Implicit Motivation
Mazzoni, P., Hristova, A., & Krakauer, J. W. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.0264-07.2007 · Cited by 557
Sensorimotor representations for pointing to targets in three-dimensional space
Soechting, J. F., & Flanders, M. (1989) · Journal of Neurophysiology · doi:10.1152/jn.1989.62.2.582 · Cited by 476
Shape conveyed by visual-to-auditory sensory substitution activates the lateral occipital complex
Amedi, A., Stern, W. M., Camprodon, J. A., Bermpohl, F., Merabet, L., Rotman, S., Hemond, C., Meijer, P., & Pascual-Leone, A. (2007) · Nature Neuroscience · doi:10.1038/nn1912 · Cited by 451 · cited 1×
“Indeed, the main focus of studies using SSDs has been recognition of shapes and objects (e.g., Arno et al., 2001; Amedi et al., 2005; Renier et al., 2006; Amedi et al., 2007; Merabet et al., 2009), while relatively little attention was given to using the SSDs to guide movement.”
BackgroundSelf-citation
Research works printed but not linked: 1
- [31]31. Maidenbaum, S., Levy-Tzedek, S., Arbel, R., Hanassy, S. & Amedi, A. (2011). Shapes from the Depths -Shape Recognition Using Distance Information. Presented at the 7th Computational Motor Control Workshop, Israel.
Cited by
Maidenbaum, S., Abboud, S., & Amedi, A. (2014) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2013.11.007 · Cited by 230
Self-citationAbboud, S., Hanassy, S., Levy-Tzedek, S., Maidenbaum, S., & Amedi, A. (2014) · Restorative Neurology and Neuroscience · doi:10.3233/rnn-130338 · Cited by 199
“Users are expected to perform better in tasks such involving color-driven reaching (Levy-Tzedek et al., 2012a) and figure-ground segregation compared with veteran SSDs that do not provide color information.”
InfluentialSelf-citationThe “EyeCane”, a new electronic travel aid for the blind: Technology, behavior & swift learning
Maidenbaum, S., Hanassy, S., Abboud, S., Buchs, G., Chebat, D.-R., Levy-Tzedek, S., & Amedi, A. (2014) · Restorative Neurology and Neuroscience · doi:10.3233/rnn-130351 · Cited by 132
Self-citationDesigning sensory-substitution devices: Principles, pitfalls and potential1
Kristjánsson, Á., Moldoveanu, A., Jóhannesson, Ó. I., Balan, O., Spagnol, S., Valgeirsdóttir, V. V., & Unnthorsson, R. (2016) · Restorative Neurology and Neuroscience · doi:10.3233/rnn-160647 · Cited by 116
“In Levy-Tzedek et al. (2012), blindfolded participants were trained on EyeMusic in order to improve their ability to perform fast and accurate movements towards targets.”
Is there a future for sensory substitution outside academic laboratories?
Elli, G. V., Benetti, S., & Collignon, O. (2014) · Multisensory Research · doi:10.1163/22134808-00002460 · Cited by 90
Metadata
- Authors
- Levy-Tzedek, S., Hanassy, S., Abboud, S., Maidenbaum, S., & Amedi, A.
- Affiliations
- The Institute for Medical Research Israel-Canada (IMRIC), Faculty of Medicine, Department of Medical Neurobiology, The Hebrew University of Jerusalem, Jerusalem, Israel
- Hebrew University of Jerusalem (IL)
- Corresponding author
- Amedi, A.
- Venue
- Restorative Neurology and Neuroscience
- Publisher
- SAGE Publications
- Published
- 2012-01-01
- Volume
- 30
- Issue
- 4
- Pages
- 313-323
- ISSN
- 0922-6028 (ISSN-L)
- 1878-3627
- OpenAlex
- W2110831185
- Cited by
- 79
- References
- 49
- Citations by year
- 2026: 2 · 2025: 3 · 2023: 6 · 2022: 2 · 2021: 5 · 2020: 4 · 2019: 3 · 2018: 7 · 2017: 8 · 2016: 8 · 2015: 8 · 2014: 13 · 2013: 9 · 2012: 1
- FWCI
- 5.07
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Restorative Neurology and Neuroscience (publishedVersion, cc-by-nc)
- PubMed (publishedVersion)
- Funders
- James S. McDonnell Foundation (220020284)
- Israel Science Foundation (ISF 1684/08, 1684/08)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Tactile and Sensory Interactions
- Life Sciences › Neuroscience › Cognitive Neuroscience › Motor Control and Adaptation
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Multisensory perception and integration
- Keywords
- sensory substitution devices, reaching movements, sensorimotor integration, auditory feedback, task specificity, movement accuracy, movement time
- MeSH terms
- Acoustic Stimulation, Adult, Feedback, Female, Humans, Male, Movement, Perception, Psychomotor Performance, Time Factors, Vision, Ocular, Persons with Visual Disabilities, Young Adult
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Fast, accurate reaching movements with a visual-to-auditory sensory substitution device. https://app.cochat.ai/papers/10.3233/rnn-2012-110219
- The paper
- Levy-Tzedek, S., Hanassy, S., Abboud, S., Maidenbaum, S., & Amedi, A. (2012). Fast, accurate reaching movements with a visual-to-auditory sensory substitution device. Restorative Neurology and Neuroscience. https://doi.org/10.3233/rnn-2012-110219
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.