Visual influences on auditory spatial learning
Open accessThe DOI matches its Crossref record; 13 of the 13 references it cites were found in a registry or an index.
Abstract
The visual and auditory systems frequently work together to facilitate the identification and localization of objects and events in the external world. Experience plays a critical role in establishing and maintaining congruent visual–auditory associations, so that the different sensory cues associated with targets that can be both seen and heard are synthesized appropriately. For stimulus location, visual information is normally more accurate and reliable and provides a reference for calibrating the perception of auditory space. During development, vision plays a key role in aligning neural representations of space in the brain, as revealed by the dramatic changes produced in auditory responses when visual inputs are altered, and is used throughout life to resolve short-term spatial conflicts between these modalities. However, accurate, and even supra-normal, auditory localization abilities can be achieved in the absence of vision, and the capacity of the mature brain to relearn to localize sound in the presence of substantially altered auditory spatial cues does not require visuomotor feedback. Thus, while vision is normally used to coordinate information across the senses, the neural circuits responsible for spatial hearing can be recalibrated in a vision-independent fashion. Nevertheless, early multisensory experience appears to be crucial for the emergence of an ability to match signals from different sensory modalities and therefore for the outcome of audiovisual-based rehabilitation of deaf patients in whom hearing has been restored by cochlear implantation.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hearing lips and seeing voices
MCGURK, H., & MACDONALD, J. (1976) · Nature · doi:10.1038/264746a0 · Cited by 6,183
Humans integrate visual and haptic information in a statistically optimal fashion
Ernst, M. O., & Banks, M. S. (2002) · Nature · doi:10.1038/415429a · Cited by 4,844
Visual Contribution to Speech Intelligibility in Noise
Sumby, W. H., & Pollack, I. (1954) · The Journal of the Acoustical Society of America · doi:10.1121/1.1907309 · Cited by 2,583 · cited 1×
“For instance, it is frequently the case when listening to someone’s voice that we also see their lips moving, which, particularly in noisy situations, can improve speech intelligibility (Sumby & Pollack 1954).”
The Ventriloquist Effect Results from Near-Optimal Bimodal Integration
Alais, D., & Burr, D. (2004) · Current Biology · doi:10.1016/j.cub.2004.01.029 · Cited by 1,936 · cited 1×
“However, if visual stimuli are blurred so that they become harder to localize, the illusion can work in reverse, with sound capturing vision (Alais & Burr 2004).”
Giard, M. H., & Peronnet, F. (1999) · Journal of Cognitive Neuroscience · doi:10.1162/089892999563544 · Cited by 1,072
Young Children Do Not Integrate Visual and Haptic Form Information
Gori, M., Del Viva, M., Sandini, G., & Burr, D. C. (2008) · Current Biology · doi:10.1016/j.cub.2008.04.036 · Cited by 547
Development of Cue Integration in Human Navigation
Nardini, M., Jones, P., Bedford, R., & Braddick, O. (2008) · Current Biology · doi:10.1016/j.cub.2008.04.021 · Cited by 431
Visual Instruction of the Neural Map of Auditory Space in the Developing Optic Tectum
Knudsen, E. I., & Brainard, M. S. (1991) · Science · doi:10.1126/science.2063209 · Cited by 231
Auditory-visual fusion in speech perception in children with cochlear implants
Schorr, E. A., Fox, N. A., van Wassenhove, V., & Knudsen, E. I. (2005) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0508862102 · Cited by 220 · cited 1×
“Thus, congenitally deaf children fitted with cochlear implants within the first two and a half years of life exhibit the McGurk effect, whereas, after this age, auditory and visual speech cues can no longer be fused (Schorr et al. 2005).”
Visual experience is necessary for the development of multisensory integration
Wallace, M. T., Perrault, T. J., Hairston, W. D., & Stein, B. E. (2004) · The Journal of Neuroscience · doi:10.1523/jneurosci.2535-04.2004 · Cited by 183 · cited 3×
“Early loss of vision has been reported to impair the ability of the central nervous system to combine and integrate multisensory cues (Wallace et al. 2004b; Putzar et al. 2007).”
Early visual deprivation impairs multisensory interactions in humans
Putzar, L., Goerendt, I., Lange, K., Rösler, F., & Röder, B. (2007) · Nature Neuroscience · doi:10.1038/nn1978 · Cited by 179 · cited 1×
“Early loss of vision has been reported to impair the ability of the central nervous system to combine and integrate multisensory cues (Wallace et al. 2004b; Putzar et al. 2007).”
Sensitive periods for visual calibration of the auditory space map in the barn owl optic tectum
Brainard, M. S., & Knudsen, E. I. (1998) · The Journal of Neuroscience · doi:10.1523/jneurosci.18-10-03929.1998 · Cited by 176 · cited 2×
“…in owls have shown that the capacity for prism experience to induce long-term modifications of both the auditory space map (Brainard & Knudsen 1998; Knudsen 1998; Bergan et al. 2005) and localization behaviour (Brainard & Knudsen 1998) can be extended to older animals under certain conditions.”
Benefits of Stimulus Congruency for Multisensory Facilitation of Visual Learning
Kim, R. S., Seitz, A. R., & Shams, L. (2008) · PLoS ONE · doi:10.1371/journal.pone.0001532 · Cited by 148 · cited 2×
“Although vision is not essential for the relearning of accurate sound localization by monaurally occluded ferrets, it is certainly possible that training with congruent multisensory cues might result in faster learning than that with auditory cues alone, as recently demonstrated in humans for a motion detection task (…”
Cited by
The emergence of multisensory systems through perceptual narrowing
Lewkowicz, D. J., & Ghazanfar, A. A. (2009) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2009.08.004 · Cited by 297
Impairment of auditory spatial localization in congenitally blind human subjects
Gori, M., Sandini, G., Martinoli, C., & Burr, D. C. (2014) · Brain · doi:10.1093/brain/awt311 · Cited by 252
The role of visual experience for the neural basis of spatial cognition
Pasqualotto, A., & Proulx, M. J. (2012) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2012.01.008 · Cited by 192
Multisensory perceptual learning and sensory substitution
Proulx, M. J., Brown, D. J., Pasqualotto, A., & Meijer, P. (2014) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2012.11.017 · Cited by 148
Navigation using sensory substitution in real and virtual mazes
Chebat, D.-R., Maidenbaum, S., & Amedi, A. (2015) · PLOS ONE · doi:10.1371/journal.pone.0126307 · Cited by 99
Metadata
- Authors
- King, A. J.
- Venue
- Philosophical Transactions of the Royal Society B: Biological Sciences
- Publisher
- The Royal Society
- Published
- 2008-11-04
- Volume
- 364
- Issue
- 1515
- Pages
- 331-339
- ISSN
- 0962-8436 (ISSN-L)
- 1471-2970
- OpenAlex
- W2140850178
- Cited by
- 146
- References
- 13
- FWCI
- 7.38
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.