Other ways of seeing: From behavior to neural mechanisms in the online “visual” control of action with sensory substitution
Open accessAbstract
Vision is the dominant sense for perception-for-action in humans and other higher primates. Advances in sight restoration now utilize the other intact senses to provide information that is normally sensed visually through sensory substitution to replace missing visual information. Sensory substitution devices translate visual information from a sensor, such as a camera or ultrasound device, into a format that the auditory or tactile systems can detect and process, so the visually impaired can see through hearing or touch. Online control of action is essential for many daily tasks such as pointing, grasping and navigating, and adapting to a sensory substitution device successfully requires extensive learning. Here we review the research on sensory substitution for vision restoration in the context of providing the means of online control for action in the blind or blindfolded. It appears that the use of sensory substitution devices utilizes the neural visual system; this suggests the hypothesis that sensory substitution draws on the same underlying mechanisms as unimpaired visual control of action. Here we review the current state of the art for sensory substitution approaches to object recognition, localization, and navigation, and the potential these approaches have for revealing a metamodal behavioral and neural basis for the online control of action.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
There is now good evidence that brain regions considered primarily devoted to a particular sense also respond to stimulation from other senses.
“There is now good evidence that brain regions considered primarily devoted to a particular sense also respond to stimulation from other senses (Proulx et al., 2016; Ricciardi et al., 2014a; see section 3).”
From Designing sensory-substitution devices: Principles, pitfalls and potential1 (2016) · cites this paper as Proulx et al., 2016
Available evidence suggests that there is great potential in sensory substitution methods.
“Notably, although the available evidence suggests that there is great potential in sensory substitution methods (see Bach-y-Rita & Kercel, 2003; Merabet & Pascual-Leone, 2010; Proulx et al., 2016; Shull & Damian, 2015; Nagel et al., 2005, for reviews)”
From Designing sensory-substitution devices: Principles, pitfalls and potential1 (2016) · cites this paper as Proulx et al., 2016
The information capacity of the human ear falls between that of vision and haptic perception.
“while the information capacity of the human ear falls between these two estimates (Bialek et al., 1993; Dudel, 1986; Proulx et al., 2016; Wurtz & Kandel, 2000).”
From Designing sensory-substitution devices: Principles, pitfalls and potential1 (2016) · cites this paper as Proulx et al., 2016
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
The fusiform face area: a module in human extrastriate cortex specialized for face perception
Kanwisher, N., McDermott, J., & Chun, M. M. (1997) · The Journal of Neuroscience · doi:10.1523/jneurosci.17-11-04302.1997 · Cited by 7,738 · see citing works
Marr, D. (1982) · Cumulative Index of Computer Aided Architectural Design · Cited by 5,733 · see citing works
An internal model for sensorimotor integration
Wolpert, D. M., Ghahramani, Z., & Jordan, M. I. (1995) · Science · doi:10.1126/science.7569931 · Cited by 3,553 · see citing works
Segregation of Form, Color, Movement, and Depth: Anatomy, Physiology, and Perception
Livingstone, M. S., & Hubel, D. H. (1988) · Science · doi:10.1126/science.3283936 · Cited by 3,358 · see citing works
A sensorimotor account of vision and visual consciousness
O'Regan, J. K., & Noë, A. (2001) · Behavioral and Brain Sciences · doi:10.1017/s0140525x01000115 · Cited by 3,126 · see citing works
A cortical representation of the local visual environment
Epstein, R. A., & Kanwisher, N. (1998) · Nature · doi:10.1038/33402 · Cited by 2,960 · see citing works
Milner, A. D., & Goodale, M. A. (2008) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2007.10.005 · Cited by 1,514 · see citing works
Is neocortex essentially multisensory?
GHAZANFAR, A., & SCHROEDER, C. (2006) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2006.04.008 · Cited by 1,463 · see citing works
Activation of Auditory Cortex During Silent Lipreading
Calvert, G. A., Bullmore, E. T., Brammer, M. J., Campbell, R., Williams, S., McGuire, P. K., Woodruff, P. W. R., Iversen, S. D., & David, A. S. (1997) · Science · doi:10.1126/science.276.5312.593 · Cited by 1,025 · see citing works
Goodale, M. A., Pélisson, D., & Prablanc, C. (1986) · Nature · doi:10.1038/320748a0 · Cited by 990 · see citing works
Vision substitution by tactile image projection
BACH-Y-RITA, P., COLLINS, C. C., SAUNDERS, F. A., WHITE, B., & SCADDEN, L. (1969) · Nature · doi:10.1038/221963a0 · Cited by 956 · see citing works
Driver, J., & Noesselt, T. (2008) · Neuron · doi:10.1016/j.neuron.2007.12.013 · Cited by 940 · see citing works
Functional relevance of cross-modal plasticity in blind humans
Cohen, L. G., Celnik, P., Pascual-Leone, A., Corwell, B., Faiz, L., Dambrosia, J., Honda, M., Sadato, N., Gerloff, C., Catala´, M. D., et al. (1997) · Nature · doi:10.1038/38278 · Cited by 911 · see citing works
An experimental system for auditory image representations
Meijer, P. B. L. (1992) · IEEE Transactions on Biomedical Engineering · doi:10.1109/10.121642 · Cited by 900 · see citing works
Anatomical evidence of multimodal integration in primate striate cortex
Falchier, A., Clavagnier, S., Barone, P., & Kennedy, H. (2002) · The Journal of Neuroscience · doi:10.1523/jneurosci.22-13-05749.2002 · Cited by 892 · see citing works
Learning of Visuomotor Transformations for Vectorial Planning of Reaching Trajectories
Krakauer, J. W., Pine, Z. M., Ghilardi, M. F., & Ghez, C. P. (2000) · Journal of Neuroscience · doi:10.1523/jneurosci.20-23-08916.2000 · Cited by 874 · see citing works
Sensory substitution and the human-machine interface
Bach-y-Rita, P., & W. Kercel, S. (2003) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2003.10.013 · Cited by 858 · see citing works
Role of the posterior parietal cortex in updating reaching movements to a visual target
Desmurget, M., Epstein, C. M., Turner, R. S., Prablanc, C., Alexander, G. E., & Grafton, S. T. (1999) · Nature Neuroscience · doi:10.1038/9219 · Cited by 817 · see citing works
Mishkin, M., & Ungerleider, L. G. (1982) · Behavioural Brain Research · doi:10.1016/0166-4328(82)90081-x · Cited by 810 · see citing works
Parietal cortex neurons of the monkey related to the visual guidance of hand movement
Taira, M., Mine, S., Georgopoulos, A. P., Murata, A., & Sakata, H. (1990) · Experimental Brain Research · doi:10.1007/bf00232190 · Cited by 655 · see citing works
Dynamics of Active Sensing and perceptual selection
Schroeder, C. E., Wilson, D. A., Radman, T., Scharfman, H. E., & Lakatos, P. (2010) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2010.02.010 · Cited by 635 · see citing works
Multisensory convergence in calcarine visual areas in macaque monkey
Rockland, K. S., & Ojima, H. (2003) · International Journal of Psychophysiology · doi:10.1016/s0167-8760(03)00121-1 · Cited by 564 · see citing works
Human anterior intraparietal area subserves prehension
Binkofski, F., Dohle, C., Posse, S., Stephan, K. M., Hefter, H., Seitz, R. J., & Freund, H. J. (1998) · Neurology · doi:10.1212/wnl.50.5.1253 · Cited by 550 · see citing works
Chapter 27 The metamodal organization of the brain
Pascual-Leone, A., & Hamilton, R. (2001) · Progress in Brain Research · doi:10.1016/s0079-6123(01)34028-1 · Cited by 540 · see citing works
Involvement of visual cortex in tactile discrimination of orientation
Zangaladze, A., Epstein, C. M., Grafton, S. T., & Sathian, K. (1999) · Nature · doi:10.1038/44139 · Cited by 508 · see citing works
Sensorimotor representations for pointing to targets in three-dimensional space
Soechting, J. F., & Flanders, M. (1989) · Journal of Neurophysiology · doi:10.1152/jn.1989.62.2.582 · Cited by 475 · see citing works
Multisensory integration: methodological approaches and emerging principles in the human brain.
Calvert, G. A., & Thesen, T. (2004) · Journal of Physiology-Paris · doi:10.1016/j.jphysparis.2004.03.018 · Cited by 425 · see citing works
Renier, L. A., Anurova, I., Volder, A. D., Carlson, S., VanMeter, J. W., & Rauschecker, J. P. (2010) · Neuron · doi:10.1016/j.neuron.2010.09.021 · Cited by 355 · see citing works
All in a Sniff: Olfaction as a Model for Active Sensing
Wachowiak, M. (2011) · Neuron · doi:10.1016/j.neuron.2011.08.030 · Cited by 353 · see citing works
Neural Correlates of Natural Human Echolocation in Early and Late Blind Echolocation Experts
Thaler, L., Arnott, S. R., & Goodale, M. A. (2011) · PLoS ONE · doi:10.1371/journal.pone.0020162 · Cited by 334 · see citing works
Ptito, M. (2005) · Brain · doi:10.1093/brain/awh380 · Cited by 310 · see citing works
Neural Plasticity and Consciousness
Hurley, S. L., & Noë, A. (2003) · Biology & Philosophy · doi:10.1023/a:1023308401356 · Cited by 305 · see citing works
A ventral visual stream reading center independent of visual experience
Reich, L., Szwed, M., Cohen, L., & Amedi, A. (2011) · Current Biology · doi:10.1016/j.cub.2011.01.040 · Cited by 295 · see citing works
Rapid and Reversible Recruitment of Early Visual Cortex for Touch
Merabet, L. B., Hamilton, R. H., Gottfried Schlaug, A., Swisher, J. D., Kiriakopoulos, E. T., Pitskel, N. B., Kauffman, T., & Pascual‐Leone, Á. (2008) · PLoS ONE · doi:10.1371/journal.pone.0003046 · Cited by 278 · see citing works
Auvray, M., Hanneton, S., & O'Regan, J. K. (2007) · Perception · doi:10.1068/p5631 · Cited by 268 · see citing works
Okada, K., Rong, F., Venezia, J., Matchin, W., Hsieh, I.-H., Saberi, K., Serences, J. T., & Hickok, G. (2010) · Cerebral Cortex · doi:10.1093/cercor/bhp318 · Cited by 262 · see citing works
Sensory acquisition in active sensing systems
Nelson, M. E., & MacIver, M. A. (2006) · Journal of Comparative Physiology A · doi:10.1007/s00359-006-0099-4 · Cited by 247 · see citing works
Visual experiences in the blind induced by an auditory sensory substitution device
Ward, J., & Meijer, P. (2010) · Consciousness and Cognition · doi:10.1016/j.concog.2009.10.006 · Cited by 247 · see citing works
Enhanced Excitability of the Human Visual Cortex Induced by Short-term Light Deprivation
Boroojerdi, B. (2000) · Cerebral Cortex · doi:10.1093/cercor/10.5.529 · Cited by 238 · see citing works
Capelle, C., Trullemans, C., Arno, P., & Veraart, C. (1998) · IEEE Transactions on Biomedical Engineering · doi:10.1109/10.720206 · Cited by 210 · see citing works
The role of visual experience for the neural basis of spatial cognition
Pasqualotto, A., & Proulx, M. J. (2012) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2012.01.008 · Cited by 192 · see citing works
Self-citationBidirectional plasticity of cortical pattern recognition and behavioral sensory acuity
Chapuis, J., & Wilson, D. A. (2011) · Nature Neuroscience · doi:10.1038/nn.2966 · Cited by 190 · see citing works
The large-Scale Organization of “Visual” Streams Emerges Without Visual Experience
Striem-Amit, E., Dakwar-Kawar, O., Reich, L., & Amedi, A. (2011) · Cerebral Cortex · doi:10.1093/cercor/bhr253 · Cited by 180 · see citing works
Do We Really Need Vision? How Blind People “See” the Actions of Others
Ricciardi, E., Bonino, D., Sani, L., Vecchi, T., Guazzelli, M., Haxby, J. V., Fadiga, L., & Pietrini, P. (2009) · Journal of Neuroscience · doi:10.1523/jneurosci.0274-09.2009 · Cited by 170 · see citing works
Developmental vision determines the reference frame for the multisensory control of action
Röder, B., Kusmierek, A., Spence, C. J., & Heed, T. (2007) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0607158104 · Cited by 162 · see citing works
Primary sensory cortices contain distinguishable spatial patterns of activity for each sense
Liang, M., Mouraux, A., Hu, L., & Iannetti, G. D. (2013) · Nature Communications · doi:10.1038/ncomms2979 · Cited by 161 · see citing works
Wayfinding in the blind: larger hippocampal volume and supranormal spatial navigation
Fortin, M., Voss, P., Lord, C., Lassonde, M. C., Pruessner, J. C., Saint‐Amour, D., Rainville, C. M., & Leporé, F. (2008) · Brain · doi:10.1093/brain/awn250 · Cited by 159 · see citing works
Vision Following Extended Congenital Blindness
Ostrovsky, Y., Andalman, A. S., & Sinha, P. (2006) · Psychological Science · doi:10.1111/j.1467-9280.2006.01827.x · Cited by 155 · see citing works
Ricciardi, E., Bonino, D., Pellegrini, S., & Pietrini, P. (2014) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2013.10.006 · Cited by 154 · see citing works
Perception With Compensatory Devices: From Sensory Substitution to Sensorimotor Extension
Auvray, M., & Myin, E. (2009) · Cognitive Science · doi:10.1111/j.1551-6709.2009.01040.x · Cited by 153 · see citing works
Multisensory perceptual learning and sensory substitution
Proulx, M. J., Brown, D. J., Pasqualotto, A., & Meijer, P. (2014) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2012.11.017 · Cited by 148 · see citing works
Self-citationFeeling with the mind's eye: contribution of visual cortex to tactile perception
Sathian, K., & Zangaladze, A. (2002) · Behavioural Brain Research · doi:10.1016/s0166-4328(02)00141-9 · Cited by 145 · see citing works
Gritsenko, V., Yakovenko, S., & Kalaska, J. (2009) · Journal of Neurophysiology · doi:10.1152/jn.91324.2008 · Cited by 145 · see citing works
The Nature of Consciousness in the Visually Deprived Brain
Kupers, R. C., Pietrini, P., Ricciardi, E., & Ptito, M. (2011) · Frontiers in Psychology · doi:10.3389/fpsyg.2011.00019 · Cited by 139 · see citing works
When is grasping affected by the Müller-Lyer illusion?
Bruno, N., & Franz, V. H. (2008) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2008.10.031 · Cited by 137 · see citing works
Braille character discrimination in blindfolded human subjects
Kauffman, T., Théoret, H., & Pascual‐Leone, Á. (2002) · Neuroreport · doi:10.1097/00001756-200204160-00007 · Cited by 137 · see citing works
Navigation with a sensory substitution device in congenitally blind individuals
Chebat, D.-R., Schneider, F. C., Kupers, R., & Ptito, M. (2011) · Neuroreport · doi:10.1097/wnr.0b013e3283462def · Cited by 132 · see citing works
The effect of viewing the static hand prior to movement onset on pointing kinematics and variability
Rossetti, Y., Stelmach, G. E., Desmurget, M., Prablanc, C., & Jeannerod, M. (1994) · Experimental Brain Research · doi:10.1007/bf00228753 · Cited by 132 · see citing works
Matteau, I., Kupers, R. C., Ricciardi, E., Pietrini, P., & Ptito, M. (2010) · Brain Research Bulletin · doi:10.1016/j.brainresbull.2010.05.001 · Cited by 128 · see citing works
RENIER, L., COLLIGNON, O., POIRIER, C., TRANDUY, D., VANLIERDE, A., BOL, A., VERAART, C., & DEVOLDER, A. (2005) · NeuroImage · doi:10.1016/j.neuroimage.2005.01.047 · Cited by 128 · see citing works
Kupers, R., Fumal, A., de Noordhout, A. M., Gjedde, A., Schoenen, J., & Ptito, M. (2006) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0602925103 · Cited by 122 · see citing works
Action without perception in human vision
Goodale, M. A. (2008) · Cognitive Neuropsychology · doi:10.1080/02643290801961984 · Cited by 118 · see citing works
The limits of visual resolution in natural scene viewing
Loschky, L. C., McConkie, G. W., Yang, J., & Miller, M. E. (2005) · Visual Cognition · doi:10.1080/13506280444000652 · Cited by 117 · see citing works
Is visual processing in the dorsal stream accessible to consciousness?
Milner, A. D. (2012) · Proceedings of the Royal Society B Biological Sciences · doi:10.1098/rspb.2011.2663 · Cited by 108 · see citing works
Visual experience facilitates allocentric spatial representation
Pasqualotto, A., Spiller, M. J., Jansari, A. S., & Proulx, M. J. (2012) · Behavioural Brain Research · doi:10.1016/j.bbr.2012.08.042 · Cited by 105 · see citing works
Self-citationSeeing via Miniature Eye Movements: A Dynamic Hypothesis for Vision
Ahissar, E., & Arieli, A. (2012) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2012.00089 · Cited by 101 · see citing works
Online control of the direction of rapid reaching movements
Sarlegna, F. R., Blouin, J., Vercher, J., Bresciani, J., Bourdin, C., & Gauthier, G. (2004) · Experimental Brain Research · doi:10.1007/s00221-004-1860-y · Cited by 100 · see citing works
Auditory activation of ‘visual’ cortical areas in the blind mole rat (Spalax ehrenbergi)
Bronchti, G., Heil, P. F., Sadka, R., Heß, A., Scheich, H., & Wollberg, Z. (2002) · European Journal of Neuroscience · doi:10.1046/j.1460-9568.2002.02063.x · Cited by 97 · see citing works
Visual illusions, delayed grasping, and memory: No shift from dorsal to ventral control
Franz, V. H., Hesse, C., & Kollath, S. (2008) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2008.08.029 · Cited by 96 · see citing works
Implicit online corrections of reaching movements.
Gomi, H. (2008) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2008.11.002 · Cited by 95 · see citing works
The Biological Basis of Audition
Recanzone, G. H., & Sutter, M. L. (2007) · Annual Review of Psychology · doi:10.1146/annurev.psych.59.103006.093544 · Cited by 95 · see citing works
Short term light deprivation increases tactile spatial acuity in humans
Facchini, S., & Aglioti, S. M. (2003) · Neurology · doi:10.1212/01.wnl.0000068026.15208.d0 · Cited by 91 · see citing works
Ricciardi, E., & Pietrini, P. (2011) · Current Opinion in Neurology · doi:10.1097/wco.0b013e328348bdbf · Cited by 91 · see citing works
The Ponzo Illusion with Auditory Substitution of Vision in Sighted and Early-Blind Subjects
Renier, L. A., Laloyaux, C., Collignon, O., Tranduy, D., Vanlierde, A., Bruyer, R., & Volder, A. D. (2005) · Perception · doi:10.1068/p5219 · Cited by 90 · see citing works
Maidenbaum, S., Levy‐Tzedek, S., Chebat, D., & Amedi, A. (2013) · PLoS ONE · doi:10.1371/journal.pone.0072555 · Cited by 84 · see citing works
Self-citationProulx, M. J., Stoerig, P., Ludowig, E., & Knoll, I. (2008) · PLoS ONE · doi:10.1371/journal.pone.0001840 · Cited by 81 · see citing works
Thaler, L., Milne, J. L., Arnott, S. R., Kish, D., & Goodale, M. A. (2014) · Journal of Neurophysiology · doi:10.1152/jn.00501.2013 · Cited by 81 · see citing works
Human Spatial Navigation via a Visuo-Tactile Sensory Substitution System
Segond, H., Weiss, D., & Sampaio, E. (2005) · Perception · doi:10.1068/p3409 · Cited by 79 · see citing works
Fast, accurate reaching movements with a visual-to-auditory sensory substitution device
Levy-Tzedek, S., Hanassy, S., Abboud, S., Maidenbaum, S., & Amedi, A. (2012) · Restorative Neurology and Neuroscience · doi:10.3233/rnn-2012-110219 · Cited by 79 · see citing works
Self-citationHow well do you see what you hear? The acuity of visual-to-auditory sensory substitution
Haigh, A., Brown, D. J., Meijer, P., & Proulx, M. J. (2013) · Frontiers in Psychology · doi:10.3389/fpsyg.2013.00330 · Cited by 72 · see citing works
More accurate sound localization induced by short-term light deprivation
Lewald, J. (2006) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2006.10.006 · Cited by 72 · see citing works
Brown, D. J., Macpherson, T., & Ward, J. (2011) · Perception · doi:10.1068/p6952 · Cited by 72 · see citing works
Self-citationIllusions as a tool to study the coding of pointing movements
de Grave, D. D. J., Brenner, E., & Smeets, J. B. J. (2003) · Experimental Brain Research · doi:10.1007/s00221-003-1708-x · Cited by 71 · see citing works
Sensory rehabilitation in the plastic brain
Collignon, O., Champoux, F., Voss, P., & Leporé, F. (2011) · Progress in brain research · doi:10.1016/b978-0-444-53752-2.00003-5 · Cited by 70 · see citing works
Dagnelie, G. (2011) · Current Opinion in Neurology · doi:10.1097/wco.0b013e32834f02c3 · Cited by 70 · see citing works
Tactile–Auditory Shape Learning Engages the Lateral Occipital Complex
Kim, J.-K., & Zatorre, R. J. (2011) · Journal of Neuroscience · doi:10.1523/jneurosci.3399-10.2011 · Cited by 68 · see citing works
Incorporating Cross-Modal Statistics in the Development and Maintenance of Multisensory Integration
Xu, J., Yu, L., Rowland, B. A., Stanford, T. R., & Stein, B. E. (2012) · Journal of Neuroscience · doi:10.1523/jneurosci.4304-11.2012 · Cited by 68 · see citing works
Transcranial Magnetic Stimulation Disrupts Eye-Hand Interactions in the Posterior Parietal Cortex
van Donkelaar, P., Lee, J.-H., & Drew, A. S. (2000) · Journal of Neurophysiology · doi:10.1152/jn.2000.84.3.1677 · Cited by 67 · see citing works
Mitchinson, B., & Prescott, T. (2013) · PLoS Comput. Biol. · doi:10.1371/journal.pcbi.1003236 · Cited by 66 · see citing works
Echolocation may have real-life advantages for blind people: an analysis of survey data
Thaler, L. (2013) · Frontiers in Physiology · doi:10.3389/fphys.2013.00098 · Cited by 64 · see citing works
Kinesthetic working memory and action control within the dorsal stream.
Fiehler, K., Burke, M., Engel, A., Bien, S., & Rösler, F. (2008) · Cerebral Cortex · doi:10.1093/cercor/bhm071 · Cited by 63 · see citing works
The Information Capacity of the Human Fingertip
Kokjer, K. (1987) · IEEE Transactions on Systems Man and Cybernetics · doi:10.1109/tsmc.1987.289337 · Cited by 61 · see citing works
Congenital blindness improves semantic and episodic memory
Pasqualotto, A., Lam, J. S. Y., & Proulx, M. J. (2013) · Behavioural Brain Research · doi:10.1016/j.bbr.2013.02.005 · Cited by 57 · see citing works
Self-citationFundamentals of Sensory Physiology
Schmidt, R. F. (1981) · Springer eBooks · doi:10.1007/978-3-662-01128-7 · Cited by 57 · see citing works
Time course of the effect of the Muller-Lyer illusion on saccades and perceptual judgments
de Brouwer, A. J., Brenner, E., Medendorp, W. P., et al. (2014) · Journal of Vision · doi:10.1167/14.1.4 · Cited by 55 · see citing works
Thaler, L., & Goodale, M. (2011) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2011.00092 · Cited by 54 · see citing works
Renier, L. A., & Volder, A. D. (2010) · Disability and Rehabilitation Assistive Technology · doi:10.3109/17483100903253936 · Cited by 51 · see citing works
Levy‐Tzedek, S., Novick, I., Arbel, R., Abboud, S., Maidenbaum, S., Vaadia, E., & Amedi, A. (2012) · Scientific Reports · doi:10.1038/srep00949 · Cited by 51 · see citing works
Self-citationFrom ear to hand: the role of the auditory-motor loop in pointing to an auditory source
Boyer, E., Babayan, B. M., Bevilacqua, F. P., et al. (2013) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2013.00026 · Cited by 51 · see citing works
Kupers, R. C., & Ptito, M. (2011) · Progress in brain research · doi:10.1016/b978-0-444-53355-5.00002-6 · Cited by 51 · see citing works
Recognition memory for Braille or spoken words: An fMRI study in early blind
Burton, H., Sinclair, R. J., & Agato, A. (2011) · Brain Research · doi:10.1016/j.brainres.2011.12.032 · Cited by 46 · see citing works
Synthetic synaesthesia and sensory substitution
Proulx, M. J. (2010) · Consciousness and Cognition · doi:10.1016/j.concog.2009.12.005 · Cited by 44 · see citing works
Self-citationMotor adaptation and proprioceptive recalibration
Cressman, E. K., & Henriques, D. Y. P. (2011) · Progress in brain research · doi:10.1016/b978-0-444-53752-2.00011-4 · Cited by 43 · see citing works
The effect of the Müller-Lyer illusion on the planning and control of manual aiming movements.
Mendoza, J., Elliott, D., Meegan, D. V., et al. (2006) · Journal of Experimental Psychology Human Perception & Performance · doi:10.1037/0096-1523.32.2.413 · Cited by 41 · see citing works
Bruno, N., Knox, P. C., & de Grave, D. D. J. (2010) · Vision Research · doi:10.1016/j.visres.2010.09.016 · Cited by 40 · see citing works
Neural Pathways Conveying Novisual Information to the Visual Cortex
Qin, W., & Yu, C. (2013) · Neural Plasticity · doi:10.1155/2013/864920 · Cited by 39 · see citing works
Renier, L. A., Bruyer, R., & Volder, A. D. (2006) · Perception & Psychophysics · doi:10.3758/bf03208756 · Cited by 35 · see citing works
Image-to-sound conversion: experience-induced plasticity in auditory cortex of blindfolded adults
Pollok, B., Schnitzler, I., Stoerig, P., Mierdorf, T., & Schnitzler, A. (2005) · Experimental Brain Research · doi:10.1007/s00221-005-0060-8 · Cited by 34 · see citing works
Active artificial echolocation and the nonvisual perception of aperture passability
Hughes, B. G. (2001) · Human Movement Science · doi:10.1016/s0167-9457(01)00059-8 · Cited by 33 · see citing works
Rhythmic movement in Parkinson’s disease: effects of visual feedback and medication state
Levy‐Tzedek, S., Krebs, H. I., Arle, J. E., Shils, J. L., & Howard Poizner, A. (2011) · Experimental Brain Research · doi:10.1007/s00221-011-2685-0 · Cited by 32 · see citing works
Self-citationDijkerman, H. C., Milner, A. D., & Carey, D. P. (1999) · Neuropsychologia · doi:10.1016/s0028-3932(99)00063-9 · Cited by 31 · see citing works
Basic Multisensory Functions Can Be Acquired After Congenital Visual Pattern Deprivation in Humans
Putzar, L., Gondan, M., & Röder, B. (2012) · Developmental Neuropsychology · doi:10.1080/87565641.2012.696756 · Cited by 30 · see citing works
Color improves “visual†acuity via sound
Levy-Tzedek, S., Riemer, D., & Amedi, A. (2014) · Frontiers in Neuroscience · doi:10.3389/fnins.2014.00358 · Cited by 30 · see citing works
Self-citationVisual objects in the auditory system in sensory substitution: How much information do we need?
Brown, D. J., Simpson, A. J. R., & Proulx, M. J. (2014) · Multisensory Research · doi:10.1163/22134808-00002462 · Cited by 23 · see citing works
Self-citationRhythmic movements are larger and faster but with the same frequency on removal of visual feedback
Levy‐Tzedek, S., Ben-Tov, M., & Karniel, A. (2011) · Journal of Neurophysiology · doi:10.1152/jn.00266.2011 · Cited by 21 · see citing works
Self-citationSensory substitution information informs locomotor adjustments when walking through apertures
Kolarik, A. J., Timmis, M. A., Cirstea, S., & Pardhan, S. (2014) · Experimental Brain Research · doi:10.1007/s00221-013-3809-5 · Cited by 21 · see citing works
Foster, R. M., Kleinholdermann, U., Leifheit, S., et al. (2012) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2012.09.026 · Cited by 16 · see citing works
Grasping the Müller–Lyer illusion: not a change in perceived length
Biegstraaten, M., de Grave, D. D. J., Brenner, E., et al. (2006) · Experimental Brain Research · doi:10.1007/s00221-006-0744-8 · Cited by 16 · see citing works
Segond, H., Weiss, D., Kawalec, M., & Sampaio, E. (2013) · Perception · doi:10.1068/p6339 · Cited by 15 · see citing works
Increased Signal Complexity Improves the Breadth of Generalization in Auditory Perceptual Learning
Brown, D. J., & Proulx, M. J. (2013) · Neural Plasticity · doi:10.1155/2013/879047 · Cited by 14 · see citing works
Self-citationSchmidt, R. F. (1981) · Fundamentals of Sensory Physiology · doi:10.1007/978-3-662-01128-7_3 · Cited by 13 · see citing works
What's primary about primary olfactory cortex?
Weiss, T., & Sobel, N. (2011) · Nature Neuroscience · doi:10.1038/nn.3009 · Cited by 12 · see citing works
Just Do It: Action-Dependent Learning Allows Sensory Prediction
Novick, I., & Vaadia, E. (2011) · PLoS ONE · doi:10.1371/journal.pone.0026020 · Cited by 10 · see citing works
Toward 3D scene understanding via audio-description
Gómez, J. D., Sinan, M., Bologna, G., & Pun, T. (2011) · International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS) · doi:10.1145/2049536.2049613 · Cited by 9 · see citing works
The study of blindness and technology can reveal the mechanisms of three-dimensional navigation
Pasqualotto, A., & Proulx, M. J. (2013) · Behavioral and Brain Sciences · doi:10.1017/s0140525x13000496 · Cited by 9 · see citing works
Self-citationThe Effects of Visual Control and Distance in Modulating Peripersonal Spatial Representation
Renzi, C., Ricciardi, E., Bonino, D., Handjaras, G., Vecchi, T., & Pietrini, P. (2013) · PLoS ONE · doi:10.1371/journal.pone.0059460 · Cited by 8 · see citing works
Cattaneo, Z., Bhatt, E., Merabet, L. B., et al. (2008) · Aging Neuropsychology and Cognition · doi:10.1080/13825580802036951 · Cited by 8 · see citing works
[An electronic sensory substitute for young blind children].
Sampaio, E., & Dufier, J. L. (1988) · PubMed · Cited by 7 · see citing works
Unwrapping the Ventral Stream: Figure 1.
Freeman, J., & Ziemba, C. M. (2011) · Journal of Neuroscience · doi:10.1523/jneurosci.6191-10.2011 · Cited by 6 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Designing sensory-substitution devices: Principles, pitfalls and potential1
Kristjánsson, Á., Moldoveanu, A., Jóhannesson, Ó. I., Balan, O., Spagnol, S., Valgeirsdóttir, V. V., & Unnthorsson, R. (2016) · Restorative Neurology and Neuroscience · doi:10.3233/rnn-160647 · Cited by 116 · see citing works
“…evidence suggests that there is great potential in sensory substitution methods (see Bach-y-Rita & Kercel, 2003; Merabet & Pascual-Leone, 2010; Proulx et al., 2016; Shull & Damian, 2015; Nagel et al., 2005, for reviews), such devices are still not in widespread use (Elli, Benetti & Collignon…”
BackgroundMethodInfluentialAging and Sensory Substitution in a Virtual Navigation Task
Levy-Tzedek, S., Maidenbaum, S., Amedi, A., & Lackner, J. (2016) · PLOS ONE · doi:10.1371/journal.pone.0151593 · Cited by 22 · see citing works
Self-citationSpatial navigation with horizontally spatialized sounds in early and late blind individuals
Paré, S., Bleau, M., Djerourou, I., Malotaux, V., Kupers, R., & Ptito, M. (2021) · PLOS ONE · doi:10.1371/journal.pone.0247448 · Cited by 20 · see citing works
Analysis and Validation of Cross-Modal Generative Adversarial Network for Sensory Substitution
Kim, M., Park, Y., Moon, K., & Jeong, C. Y. (2021) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph18126216 · Cited by 8 · see citing works
- Authors
- Proulx, M. J., Gwinnutt, J., Dell’Erba, S., Levy-Tzedek, S., de Sousa, A. A., & Brown, D. J.
- Affiliations
- University of Bath (GB)
- Cognition, Aging and Rehabilitation Lab, Recanati School for Community Health Professions, Department of Physical Therapy & Zlotowski Center for Neuroscience, Ben Gurion University of the Negev, Beer-Sheva, Israel
- Crossmodal Cognition Lab, Department of Psychology, University of Bath, Bath, UK
- Corresponding author
- Proulx, Michael J.
- Venue
- Restorative Neurology and Neuroscience
- Publisher
- SAGE Publications
- Published
- 2015-10-30
- Volume
- 34
- Issue
- 1
- Pages
- 29-44
- ISSN
- 0922-6028 (ISSN-L)
- 1878-3627
- PMC
- PMC4927905
- OpenAlex
- W2179471768
- Cited by
- 36
- References
- 129
- Citations by year
- 2026: 3 · 2023: 1 · 2022: 4 · 2021: 7 · 2020: 8 · 2019: 3 · 2018: 4 · 2017: 3 · 2016: 3
- FWCI
- 0.33
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Restorative Neurology and Neuroscience (publishedVersion, cc-by-nc)
- PubMed Central (publishedVersion, cc-by-nc)
- PubMed (publishedVersion)
- Research Space (acceptedVersion)
- The University of Bath Online Publications Store (The University of Bath) (submittedVersion, cc-by-nc)
- Research Explorer (The University of Manchester) (submittedVersion, cc-by-nc)
- Funders
- Leona M. and Harry B. Helmsley Charitable Trust
- Ben-Gurion University of the Negev
- Engineering and Physical Sciences Research Council (EP/J017205/1)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Tactile and Sensory Interactions
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Multisensory perception and integration
- Life Sciences › Neuroscience › Cognitive Neuroscience › Motor Control and Adaptation
- Keywords
- sensory substitution, visual impairment, object recognition, localization, navigation, vision restoration
- MeSH terms
- Blindness, Brain, Humans, Motor Activity, Visual Perception
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
