Multisensory perceptual learning and sensory substitution
Abstract
One of the most exciting recent findings in neuroscience has been the capacity for neural plasticity in adult humans and animals. Studies of perceptual learning have provided key insights into the mechanisms of neural plasticity and the changes in functional neuroanatomy that it affords. Key questions in this field of research concern how practice of a task leads to specific or general improvement. Although much of this work has been carried out with a focus on a single sensory modality, primarily visual, there is increasing interest in multisensory perceptual learning. Here we will examine how advances in perceptual learning research both inform and can be informed by the development and advancement of sensory substitution devices for blind persons. To allow 'sight' to occur in the absence of visual input through the eyes, visual information can be transformed by a sensory substitution device into a representation that can be processed as sound or touch, and thus give one the potential to 'see' through the ears or tongue. Investigations of auditory, visual and multisensory perceptual learning can have key benefits for the advancement of sensory substitution, and the study of sensory deprivation and sensory substitution likewise will further the understanding of perceptual learning in general and the reverse hierarchy theory in particular. It also has significant importance for the developing understanding of the brain in metamodal terms, where functional brain areas might be best defined by the computations they carry out rather than by their sensory-specific processing role.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Evidence of multisensory perceptual learning is encouraging for the idea of multisensory sensory substitution.
“For example, evidence of multisensory perceptual learning (Proulx et al., 2014) is encouraging for the idea of multisensory sensory substitution.”
From Designing sensory-substitution devices: Principles, pitfalls and potential1 (2016) · cites this paper as Proulx et al., 2014
Cites
The period of susceptibility to the physiological effects of unilateral eye closure in kittens
Hubel, D. H., & Wiesel, T. N. (1970) · The Journal of Physiology · doi:10.1113/jphysiol.1970.sp009022 · Cited by 3,030 · see citing works
Visual Contribution to Speech Intelligibility in Noise
Sumby, W. H., & Pollack, I. (1954) · The Journal of the Acoustical Society of America · doi:10.1121/1.1907309 · Cited by 2,583 · see citing works
An experimental system for auditory image representations
Meijer, P. B. L. (1992) · IEEE Transactions on Biomedical Engineering · doi:10.1109/10.121642 · Cited by 900 · see citing works
Self-citationAnatomical evidence of multimodal integration in primate striate cortex
Falchier, A., Clavagnier, S., Barone, P., & Kennedy, H. (2002) · The Journal of Neuroscience · doi:10.1523/jneurosci.22-13-05749.2002 · Cited by 892 · see citing works
Chapter 27 The metamodal organization of the brain
Pascual-Leone, A., & Hamilton, R. (2001) · Progress in Brain Research · doi:10.1016/s0079-6123(01)34028-1 · Cited by 540 · see citing works
Consolidation during sleep of perceptual learning of spoken language
Fenn, K. M., Nusbaum, H. C., & Margoliash, D. (2003) · Nature · doi:10.1038/nature01951 · Cited by 463 · see citing works
Shape conveyed by visual-to-auditory sensory substitution activates the lateral occipital complex
Amedi, A., Stern, W. M., Camprodon, J. A., Bermpohl, F., Merabet, L., Rotman, S., Hemond, C., Meijer, P., & Pascual-Leone, A. (2007) · Nature Neuroscience · doi:10.1038/nn1912 · Cited by 451 · see citing works
Self-citationA Specific and Enduring Improvement in Visual Motion Discrimination
Ball, K., & Sekuler, R. (1982) · Science · doi:10.1126/science.7134968 · Cited by 383 · see citing works
Multisensory integration: psychophysics, neurophysiology, and computation
Angelaki, D. E., Gu, Y., & DeAngelis, G. C. (2009) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2009.06.008 · Cited by 383 · see citing works
Sound Facilitates Visual Learning
Seitz, A. R., Kim, R., & Shams, L. (2006) · Current Biology · doi:10.1016/j.cub.2006.05.048 · Cited by 243 · see citing works
Bayesian multisensory integration and cross-modal spatial links.
Deneve, S., & Pouget, A. (2004) · Journal of Physiology-Paris · doi:10.1016/j.jphysparis.2004.03.011 · Cited by 230 · see citing works
What blindness can tell us about seeing again: merging neuroplasticity and neuroprostheses
Merabet, L. B., Rizzo, J. F., Amedi, A., Somers, D. C., & Pascual-Leone, A. (2005) · Nature reviews. Neuroscience · doi:10.1038/nrn1586 · Cited by 179 · see citing works
Kupers, R., Fumal, A., de Noordhout, A. M., Gjedde, A., Schoenen, J., & Ptito, M. (2006) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0602925103 · Cited by 122 · see citing works
Proulx, M. J., Stoerig, P., Ludowig, E., & Knoll, I. (2008) · PLoS ONE · doi:10.1371/journal.pone.0001840 · Cited by 81 · see citing works
Generalized Learning of Visual-to-Auditory Substitution in Sighted Individuals
Kim, J.-K., & Zatorre, R. J. (2008) · Brain Research · doi:10.1016/j.brainres.2008.06.038 · Cited by 62 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Ricciardi, E., Bonino, D., Pellegrini, S., & Pietrini, P. (2014) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2013.10.006 · Cited by 154 · see citing works
Designing sensory-substitution devices: Principles, pitfalls and potential1
Kristjánsson, Á., Moldoveanu, A., Jóhannesson, Ó. I., Balan, O., Spagnol, S., Valgeirsdóttir, V. V., & Unnthorsson, R. (2016) · Restorative Neurology and Neuroscience · doi:10.3233/rnn-160647 · Cited by 116 · see citing works
“For example, evidence of multisensory perceptual learning (Proulx et al., 2014) is encouraging for the idea of multisensory sensory substitution.”
BackgroundHow well do you see what you hear? The acuity of visual-to-auditory sensory substitution
Haigh, A., Brown, D. J., Meijer, P., & Proulx, M. J. (2013) · Frontiers in Psychology · doi:10.3389/fpsyg.2013.00330 · Cited by 72 · see citing works
Proulx, M. J., Gwinnutt, J., Dell’Erba, S., Levy-Tzedek, S., de Sousa, A. A., & Brown, D. J. (2015) · Restorative Neurology and Neuroscience · doi:10.3233/rnn-150541 · Cited by 36 · see citing works
Self-citationSpatial navigation with horizontally spatialized sounds in early and late blind individuals
Paré, S., Bleau, M., Djerourou, I., Malotaux, V., Kupers, R., & Ptito, M. (2021) · PLOS ONE · doi:10.1371/journal.pone.0247448 · Cited by 20 · see citing works
Guidelines for quantitative and qualitative studies of sensory substitution experience
Kałwak, W., Reuter, M., Łukowska, M., Majchrowicz, B., & Wierzchoń, M. (2018) · Adaptive Behavior · doi:10.1177/1059712318771690 · Cited by 14 · see citing works
Buchs, G., Maidenbaum, S., Levy-Tzedek, S., & Amedi, A. (2015) · Restorative Neurology and Neuroscience · doi:10.3233/rnn-150592 · Cited by 8 · see citing works
Autoencoding sensory substitution
Tóth, V., & Parkkonen, L. (2019) · Unpublished · doi:10.13140/rg.2.2.10576.87048 · Cited by 7 · see citing works
- Authors
- Proulx, M. J., Brown, D. J., Pasqualotto, A., & Meijer, P.
- Affiliations
- University of Bath (GB)
- Queen Mary University of London (GB)
- Corresponding author
- Proulx, Michael J.
- Venue
- Neuroscience & Biobehavioral Reviews
- Publisher
- Elsevier BV
- Published
- 2014-04
- Volume
- 41
- Pages
- 16-25
- ISSN
- 0149-7634 (ISSN-L)
- OpenAlex
- W2025256102
- Cited by
- 148
- References
- 15
- Citations by year
- 2026: 12 · 2025: 13 · 2024: 14 · 2023: 7 · 2022: 8 · 2021: 16 · 2020: 6 · 2019: 12 · 2018: 17 · 2017: 4 · 2016: 8 · 2015: 9 · 2014: 12 · 2013: 7
- FWCI
- 0.71
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Neuroscience & Biobehavioral Reviews (publishedVersion)
- PubMed (publishedVersion)
- Funders
- Great Britain Sasakawa Foundation
- Engineering and Physical Sciences Research Council (EP/J017205/1)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Tactile and Sensory Interactions
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Multisensory perception and integration
- Life Sciences › Neuroscience › Cognitive Neuroscience › Visual perception and processing mechanisms
- Keywords
- sensory substitution devices, neuroplasticity, visual impairment, auditory perceptual learning, visual perceptual learning, sensory deprivation
- MeSH terms
- Animals, Auditory Perception, Blindness, Brain, Humans, Learning, Models, Neurological, Neuronal Plasticity, Perception, Visual Perception
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
