Natural, Metaphoric, and Linguistic Auditory Direction Signals Have Distinct Influences on Visual Motion Processing
Open accessThe DOI matches its Crossref record; 12 of the 12 references it cites were found in a registry or an index.
Abstract
To interact with our dynamic environment, the brain merges motion information from auditory and visual senses. However, not only “natural” auditory MOTION, but also “metaphoric” de/ascending PITCH and SPEECH (e.g., “left/right”), influence the visual motion percept. Here, we systematically investigate whether these three classes of direction signals influence visual motion perception through shared or distinct neural mechanisms. In a visual-selective attention paradigm, subjects discriminated the direction of visual motion at several levels of reliability, with an irrelevant auditory stimulus being congruent, absent, or incongruent. Although the natural, metaphoric, and linguistic auditory signals were equally long and adjusted to induce a comparable directional bias on the motion percept, they influenced visual motion processing at different levels of the cortical hierarchy. A significant audiovisual interaction was revealed for MOTION in left human motion complex (hMT+/V5+) and for SPEECH in right intraparietal sulcus. In fact, the audiovisual interaction gradually decreased in left hMT+/V5+ for MOTION > PITCH > SPEECH and in right intraparietal sulcus for SPEECH > PITCH > MOTION. In conclusion, natural motion signals are integrated in audiovisual motion areas, whereas the influence of culturally learnt signals emerges primarily in higher-level convergence regions.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Rao, R. P. N., & Ballard, D. H. (1999) · Nature Neuroscience · doi:10.1038/4580 · Cited by 5,483 · cited 1×
“These incongruency effects may represent a prediction error signal (Rao and Ballard, 1999; Garrido et al., 2007) or an attempt to amplify the task-relevant visual signal to overcome the interfering auditory signal.”
BackgroundMacDonald, A. W., Cohen, J. D., Stenger, V. A., & Carter, C. S. (2000) · Science · doi:10.1126/science.288.5472.1835 · Cited by 3,666
The prefontral cortex and cognitive control
Miller, E. K. (2000) · Nature Reviews Neuroscience · doi:10.1038/35036228 · Cited by 2,016 · cited 1×
“These results are in line with numerous studies of cognitive control implicating the dorsolateral prefrontal cortex in dynamic selection of task-relevant information, by biasing processing in sensory areas, particularly in conflicting contexts (MacDonald et al., 2000; Miller 2000; Matsumoto and Tanaka, 2004; Noppeney…”
ResultKastner, S., Pinsk, M. A., De Weerd, P., Desimone, R., & Ungerleider, L. G. (1999) · Neuron · doi:10.1016/s0896-6273(00)80734-5 · Cited by 1,622 · cited 1×
“Furthermore, anterior to classical visuospatial attention areas (Corbetta and Shulman, 1998; Kastner et al., 1999; Corbetta and Shulman, 2002), these anterior parietal areas have also been implicated in crossmodal attention and top-down control (Macaluso et al.”
BackgroundIs neocortex essentially multisensory?
GHAZANFAR, A., & SCHROEDER, C. (2006) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2006.04.008 · Cited by 1,463 · cited 1×
“This suggests that auditory and visual information may become integrated through direct interactions between auditory and visual regions rather than convergence in parietal association areas [see related accounts of early multisensory integration (Schroeder and Foxe, 2002, 2005; Ghazanfar et al., 2005; Kayser et al.,…”
BackgroundPolymodal Motion Processing in Posterior Parietal and Premotor Cortex
Bremmer, F., Schlack, A., Shah, N. J., Zafiris, O., Kubischik, M., Hoffmann, K.-P., Zilles, K., & Fink, G. R. (2001) · Neuron · doi:10.1016/s0896-6273(01)00198-2 · Cited by 803 · cited 11×
“The ventral premotor–parietal system has been implicated previously in polymodal motion processing on the basis of conjunction analyses (Bremmer et al., 2001) and proposed as the putative human homolog of macaque VIP–ventral premotor circuitry (Cooke et al.”
BackgroundMethodInfluentialA human parietal face area contains aligned head-centered visual and tactile maps
Sereno, M. I., & Huang, R.-S. (2006) · Nature Neuroscience · doi:10.1038/nn1777 · Cited by 322 · cited 1×
“, 2001) and proposed as the putative human homolog of macaque VIP–ventral premotor circuitry (Cooke et al., 2003; Bremmer, 2005; Rushworth et al., 2006; Sereno and Huang, 2006) (but see Bartels et al.”
BackgroundEvoked brain responses are generated by feedback loops
Garrido, M. I., Kilner, J. M., Kiebel, S. J., & Friston, K. J. (2007) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0706274105 · Cited by 296 · cited 1×
“These incongruency effects may represent a prediction error signal (Rao and Ballard, 1999; Garrido et al., 2007) or an attempt to amplify the task-relevant visual signal to overcome the interfering auditory signal.”
BackgroundPerception of Sound-Source Motion by the Human Brain
Warren, J. D., Zielinski, B. A., Green, G. G. R., Rauschecker, J. P., & Griffiths, T. D. (2002) · Neuron · doi:10.1016/s0896-6273(02)00637-2 · Cited by 272
Distinct Mechanisms for Processing Spatial Sequences and Pitch Sequences in the Human Auditory Brain
Warren, J. D., & Griffiths, T. D. (2003) · The Journal of Neuroscience · doi:10.1523/jneurosci.23-13-05799.2003 · Cited by 247 · cited 1×
“Auditory MOTION influences emerged in auditory–visual motion areas encompassing both (1) “classical” visual motion area hMT /V5 and (2) the planum temporale and a middle temporal region that are both thought to be part of the posterior auditory stream of spatial (Rauschecker and Tian, 2000; Warren and Griffiths, 2003)…”
Background
Research works printed but not linked: 51
- 10.1016/j.cogbrainres.2003.11.011 · DOI
- 10.1523/JNEUROSCI.2980-07.2008 · DOI
- 10.1093/cercor/bhm107 · DOI · Paper page
- 10.1093/cercor/bhl055 · DOI · Paper page
- 10.1093/cercor/bhl128 · DOI · Paper page
- 10.1113/jphysiol.2005.082552 · DOI · Paper page
- 10.1073/pnas.1031751100 · DOI · Paper page
- 10.1098/rstb.1998.0289 · DOI · Paper page
- 10.1038/nrn755 · DOI · Paper page
- 10.1016/S0959-4388(00)00191-4 · DOI · Paper page
- 10.1038/39309 · DOI · Paper page
- 10.1038/nn1925 · DOI
- 10.1093/cercor/10.5.454 · DOI · Paper page
- Evans, 1992, An mri-based stereotactic atlas from 250 young normal subjects, Soc Neurosci Abstr, 18, 408
- 10.1002/hbm.460020402 · DOI · Paper page
- 10.1006/nimg.1999.0484 · DOI · Paper page
- 10.1016/S1053-8119(03)00224-6 · DOI · Paper page
- 10.1523/JNEUROSCI.0799-05.2005 · DOI · Paper page
- 10.1097/00001756-199912160-00019 · DOI · Paper page
- 10.1016/S0301-0082(03)00086-8 · DOI · Paper page
- 10.1126/science.287.5456.1269 · DOI · Paper page
- 10.1016/j.neuron.2005.09.018 · DOI · Paper page
- 10.1152/jn.00690.2005 · DOI · Paper page
- 10.1126/science.289.5482.1206 · DOI · Paper page
- 10.1007/s00221-002-1277-4 · DOI
- 10.1016/j.cub.2004.11.018 · DOI
- Marks L (2004) The handbook of multisensory processes, Cross-modal interactions in speeded classification (MIT, Cambridge, MA), pp 85–105. · DOI
- 10.1093/cercor/bhl077 · DOI · Paper page
- 10.1068/p140721 · DOI · Paper page
- 10.1126/science.1094733 · DOI · Paper page
- 10.1037/0096-3445.116.4.323 · doi:10.1037/0096-3445.116.4.323 · Paper page
- Meredith, 1996, Spatial determinants of multisensory integration in cat superior colliculus neurons, J Neurophysiol, 75, 1843, 10.1152/jn.1996.75.5.1843 · DOI · Paper page
- 10.1097/00001756-200108080-00053 · DOI
- 10.1007/s00221-005-2394-7 · DOI
- 10.1093/cercor/bhm091 · DOI · Paper page
- 10.1016/S0960-9822(02)01143-0 · DOI
- 10.1073/pnas.97.22.11800 · DOI · Paper page
- 10.1093/cercor/bhj079 · DOI · Paper page
- 10.1121/1.399984 · doi:10.1121/1.399984
- 10.1016/j.conb.2005.06.008 · DOI · Paper page
- 10.1016/S0926-6410(02)00073-3 · DOI · Paper page
- 10.1523/JNEUROSCI.2939-04.2004 · DOI · Paper page
- 10.1016/S0926-6410(02)00068-X · DOI · Paper page
- 10.1037/0096-1523.30.2.330 · DOI
- Ungerleider LG Mishkin M (1982) in Analysis of visual behavior, Two visual systems, eds Ingle DJ Goodale MA Mansfield RJW (MIT, Cambridge, MA), pp 549–586.
- 10.1016/j.neuron.2004.06.025 · DOI · Paper page
- 10.1523/JNEUROSCI.3669-04.2004 · DOI · Paper page
- 10.3758/BF03194544 · DOI · Paper page
- 10.3758/BF03194545 · DOI · Paper page
- Zatorre, 1994, Neural mechanisms underlying melodic perception and memory for pitch, J Neurosci, 14, 1908, 10.1523/JNEUROSCI.14-04-01908.1994 · DOI · Paper page
- Zeki, 1991, A direct demonstration of functional specialization in human visual cortex, J Neurosci, 11, 641, 10.1523/JNEUROSCI.11-03-00641.1991 · DOI · Paper page
Cited by
Functional Characterization of the Cingulo-Opercular Network in the Maintenance of Tonic Alertness
Sadaghiani, S., & D'Esposito, M. (2015) · Cerebral Cortex · doi:10.1093/cercor/bhu072 · Cited by 370
Self-citationNatural auditory scene statistics shapes human spatial hearing
Parise, C. V., Knorre, K., & Ernst, M. O. (2014) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1322705111 · Cited by 256
Bor, D., & Seth, A. K. (2012) · Frontiers in Psychology · doi:10.3389/fpsyg.2012.00063 · Cited by 143
Neural basis of multisensory looming signals
Tyll, S., Bonath, B., Schoenfeld, M. A., Heinze, H.-J., Ohl, F. W., & Noesselt, T. (2013) · NeuroImage · doi:10.1016/j.neuroimage.2012.09.056 · Cited by 75
On the shapes of flavours: A review of four hypotheses
Spence, C., & Deroy, O. (2014) · Theoria et Historia Scientiarum · doi:10.12775/ths-2013-0011 · Cited by 62
Metadata
- Authors
- Sadaghiani, S., Maier, J. X., & Noppeney, U.
- Venue
- The Journal of Neuroscience
- Publisher
- Society for Neuroscience
- Published
- 2009-05-20
- Volume
- 29
- Issue
- 20
- Pages
- 6490-6499
- ISSN
- 0270-6474 (ISSN-L)
- 1529-2401
- OpenAlex
- W1972754211
- Cited by
- 117
- References
- 12
- FWCI
- 13.66
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Natural, Metaphoric, and Linguistic Auditory Direction Signals Have Distinct Influences on Visual Motion Processing. https://app.cochat.ai/papers/10.1523/jneurosci.5437-08.2009
- The paper
- Sadaghiani, S., Maier, J. X., & Noppeney, U. (2009). Natural, Metaphoric, and Linguistic Auditory Direction Signals Have Distinct Influences on Visual Motion Processing. The Journal of Neuroscience. https://doi.org/10.1523/jneurosci.5437-08.2009
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.