The DOI matches its Crossref record; 69 of the 69 references it cites were found in a registry or an index.
Audiovisual Temporal Correspondence Modulates Human Multisensory Superior Temporal Sulcus Plus Primary Sensory Cortices
Open accessAbstract
The brain should integrate related but not unrelated information from different senses. Temporal patterning of inputs to different modalities may provide critical information about whether those inputs are related or not. We studied effects of temporal correspondence between auditory and visual streams on human brain activity with functional magnetic resonance imaging (fMRI). Streams of visual flashes with irregularly jittered, arrhythmic timing could appear on right or left, with or without a stream of auditory tones that coincided perfectly when present (highly unlikely by chance), were noncoincident with vision (different erratic, arrhythmic pattern with same temporal statistics), or an auditory stream appeared alone. fMRI revealed blood oxygenation level-dependent (BOLD) increases in multisensory superior temporal sulcus (mSTS), contralateral to a visual stream when coincident with an auditory stream, and BOLD decreases for noncoincidence relative to unisensory baselines. Contralateral primary visual cortex and auditory cortex were also affected by audiovisual temporal correspondence or noncorrespondence, as confirmed in individuals. Connectivity analyses indicated enhanced influence from mSTS on primary sensory areas, rather than vice versa, during audiovisual correspondence. Temporal correspondence between auditory and visual streams affects a network of both multisensory (mSTS) and sensory-specific areas in humans, including even primary visual and auditory cortex, with stronger responses for corresponding and thus related audiovisual inputs.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Control of goal-directed and stimulus-driven attention in the brain
Corbetta, M., & Shulman, G. L. (2002) · Nature Reviews Neuroscience · doi:10.1038/nrn755 · Cited by 12,881
Psychophysiological and Modulatory Interactions in Neuroimaging
Friston, K. J., Buechel, C., Fink, G. R., Morris, J., Rolls, E., & Dolan, R. J. (1997) · NeuroImage · doi:10.1006/nimg.1997.0291 · Cited by 3,097 · cited 6×
“Only clusters containing 20 voxels are described (see Materials and Methods).”
BackgroundMethodInfluentialDistracted and confused? Selective attention under load
Lavie, N. (2005) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2004.12.004 · Cited by 2,102
(1994) · Choice Reviews Online · doi:10.5860/choice.31-4365 · Cited by 1,882
Is neocortex essentially multisensory?
GHAZANFAR, A., & SCHROEDER, C. (2006) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2006.04.008 · Cited by 1,463
Lakatos, P., Shah, A. S., Knuth, K. H., Ulbert, I., Karmos, G., & Schroeder, C. E. (2005) · Journal of Neurophysiology · doi:10.1152/jn.00263.2005 · Cited by 1,237
Visual properties of neurons in a polysensory area in superior temporal sulcus of the macaque.
Bruce, C., Desimone, R., & Gross, C. G. (1981) · Journal of Neurophysiology · doi:10.1152/jn.1981.46.2.369 · Cited by 1,227
Giard, M. H., & Peronnet, F. (1999) · Journal of Cognitive Neuroscience · doi:10.1162/089892999563544 · Cited by 1,072
Activation of Auditory Cortex During Silent Lipreading
Calvert, G. A., Bullmore, E. T., Brammer, M. J., Campbell, R., Williams, S. C. R., McGuire, P. K., Woodruff, P. W. R., Iversen, S. D., & David, A. S. (1997) · Science · doi:10.1126/science.276.5312.593 · Cited by 1,025
(2004) · Medical Entomology and Zoology · Cited by 978
Neuronal oscillations and multisensory interaction in primary auditory cortex
Lakatos, P., Chen, C.-M., O'Connell, M. N., Mills, A., & Schroeder, C. E. (2007) · Neuron · doi:10.1016/j.neuron.2006.12.011 · Cited by 961
The Handbook of Multisensory Processes
(2004) · doi:10.7551/mitpress/3422.001.0001 · Cited by 948
Molholm, S., Ritter, W., Murray, M. M., Javitt, D. C., Schroeder, C. E., & Foxe, J. J. (2002) · Cognitive Brain Research · doi:10.1016/s0926-6410(02)00066-6 · Cited by 902
Anatomical evidence of multimodal integration in primate striate cortex
Falchier, A., Clavagnier, S., Barone, P., & Kennedy, H. (2002) · The Journal of Neuroscience · doi:10.1523/jneurosci.22-13-05749.2002 · Cited by 892 · cited 3×
“Visual stimuli were presented peripherally, which may maximize the opportunity for interplay between auditory and visual cortex (Falchier et al., 2002), and also allowed us to test for any contralaterality in effects for one visual field or the other.”
BackgroundResultInfluentialCrossmodal Space and Crossmodal Attention
(2004) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780198524861.001.0001 · Cited by 791
Integration of Auditory and Visual Information about Objects in Superior Temporal Sulcus
Beauchamp, M. S., Lee, K. E., Argall, B. D., & Martin, A. (2004) · Neuron · doi:10.1016/s0896-6273(04)00070-4 · Cited by 773
Determinants of multisensory integration in superior colliculus neurons. I. Temporal factors
Meredith, M., Nemitz, J., & Stein, B. (1987) · The Journal of Neuroscience · doi:10.1523/jneurosci.07-10-03215.1987 · Cited by 754
Modulation of Human Visual Cortex by Crossmodal Spatial Attention
Macaluso, E., Frith, C. D., & Driver, J. (2000) · Science · doi:10.1126/science.289.5482.1206 · Cited by 613
Self-citationMultisensory Integration of Dynamic Faces and Voices in Rhesus Monkey Auditory Cortex
Ghazanfar, A. A., Maier, J. X., Hoffman, K. L., & Logothetis, N. K. (2005) · The Journal of Neuroscience · doi:10.1523/jneurosci.0799-05.2005 · Cited by 544
Unraveling multisensory integration: patchy organization within human STS multisensory cortex
Beauchamp, M. S., Argall, B. D., Bodurka, J., Duyn, J. H., & Martin, A. (2004) · Nature Neuroscience · doi:10.1038/nn1333 · Cited by 513
Multisensory contributions to low-level, ‘unisensory’ processing
Schroeder, C. E., & Foxe, J. (2005) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2005.06.008 · Cited by 507
Viewpoint: the core and matrix of thalamic organization
Jones, E. G. (1998) · Neuroscience · doi:10.1016/s0306-4522(97)00581-2 · Cited by 504 · cited 2×
“, 2007) and the thalamus is increasingly regarded as a potentially major player in multisensory phenomena (Jones, 1998; Schroeder et al., 2003; Fu et al., 2004; Ghazanfar and Schroeder, 2006), we did not observe any BOLD effects in the thalaFigure 3.”
BackgroundReference frames for representing visual and tactile locations in parietal cortex
Avillac, M., Denève, S., Olivier, E., Pouget, A., & Duhamel, J.-R. (2005) · Nature Neuroscience · doi:10.1038/nn1480 · Cited by 464
Calvert, G. A., Hansen, P. C., Iversen, S. D., & Brammer, M. J. (2001) · NeuroImage · doi:10.1006/nimg.2001.0812 · Cited by 464
Involuntary orienting to sound improves visual perception
McDonald, J. J., Teder-Sälejärvi, W. A., & Hillyard, S. A. (2000) · Nature · doi:10.1038/35038085 · Cited by 457
Multisensory spatial interactions: a window onto functional integration in the human brain
Macaluso, E., & Driver, J. (2005) · Trends in Neurosciences · doi:10.1016/j.tins.2005.03.008 · Cited by 428
Self-citationThe timing and laminar profile of converging inputs to multisensory areas of the macaque neocortex
Schroeder, C. E., & Foxe, J. J. (2002) · Cognitive Brain Research · doi:10.1016/s0926-6410(02)00073-3 · Cited by 416
Murray, M. M., Molholm, S., Michel, C. M., Heslenfeld, D. J., Ritter, W., Javitt, D. C., Schroeder, C. E., & Foxe, J. J. (2005) · Cerebral Cortex · doi:10.1093/cercor/bhh197 · Cited by 413
Representation and integration of multiple sensory inputs in primate superior colliculus
Wallace, M. T., Wilkinson, L. K., & Stein, B. E. (1996) · Journal of Neurophysiology · doi:10.1152/jn.1996.76.2.1246 · Cited by 412
See me, hear me, touch me: multisensory integration in lateral occipital-temporal cortex
Beauchamp, M. S. (2005) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2005.03.011 · Cited by 401
Foxe, J. J., Morocz, I. A., Murray, M. M., Higgins, B. A., Javitt, D. C., & Schroeder, C. E. (2000) · Cognitive Brain Research · doi:10.1016/s0926-6410(00)00024-0 · Cited by 395
Multisensory Visual-Auditory Object Recognition in Humans: a High-density Electrical Mapping Study
Molholm, S. (2004) · Cerebral Cortex · doi:10.1093/cercor/bhh007 · Cited by 384
Neural Correlates of Auditory–Visual Stimulus Onset Asynchrony Detection
Bushara, K. O., Grafman, J., & Hallett, M. (2001) · The Journal of Neuroscience · doi:10.1523/jneurosci.21-01-00300.2001 · Cited by 361
Sound alters activity in human V1 in association with illusory visual perception
Watkins, S., Shams, L., Tanaka, S., Haynes, J.-D., & Rees, G. (2006) · NeuroImage · doi:10.1016/j.neuroimage.2006.01.016 · Cited by 343
Temporal and spatial dependency of the ventriloquism effect
Slutsky, D. A., & Recanzone, G. H. (2001) · Neuroreport · doi:10.1097/00001756-200101220-00009 · Cited by 341
Barraclough*, N. E., Xiao*, D., Baker, C. I., Oram, M. W., & Perrett, D. I. (2005) · Journal of Cognitive Neuroscience · doi:10.1162/0898929053279586 · Cited by 332
Teder-Sälejärvi, W. A., McDonald, J. J., Di Russo, F., & Hillyard, S. A. (2002) · Cognitive Brain Research · doi:10.1016/s0926-6410(02)00065-4 · Cited by 330
Perceptual Fusion and Stimulus Coincidence in the Cross-Modal Integration of Speech
Miller, L. M., & D'Esposito, M. (2005) · The Journal of Neuroscience · doi:10.1523/jneurosci.0896-05.2005 · Cited by 322
The case for feedforward multisensory convergence during early cortical processing
Foxe, J. J., & Schroeder, C. E. (2005) · NeuroReport · doi:10.1097/00001756-200504040-00001 · Cited by 316
Benevento, L. A., Fallon, J., Davis, B. J., & Rezak, M. (1977) · Experimental Neurology · doi:10.1016/0014-4886(77)90112-1 · Cited by 288
Nonauditory Events of a Behavioral Procedure Activate Auditory Cortex of Highly Trained Monkeys
Brosch, M., Selezneva, E., & Scheich, H. (2005) · The Journal of Neuroscience · doi:10.1523/jneurosci.1571-05.2005 · Cited by 279
Development of Multisensory Neurons and Multisensory Integration in Cat Superior Colliculus
Wallace, M. T., & Stein, B. E. (1997) · The Journal of Neuroscience · doi:10.1523/jneurosci.17-07-02429.1997 · Cited by 267
Wallace, M. T., Meredith, M. A., & Stein, B. E. (1993) · Journal of Neurophysiology · doi:10.1152/jn.1993.69.6.1797 · Cited by 259
Functional Imaging Reveals Visual Modulation of Specific Fields in Auditory Cortex
Kayser, C., Petkov, C. I., Augath, M., & Logothetis, N. K. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.4737-06.2007 · Cited by 240
Spatial and temporal factors during processing of audiovisual speech: a PET study
Macaluso, E., George, N., Dolan, R., Spence, C., & Driver, J. (2004) · NeuroImage · doi:10.1016/j.neuroimage.2003.09.049 · Cited by 237
Self-citationStatistical Criteria in fMRI Studies of Multisensory Integration
Beauchamp, M. S. (2005) · Neuroinformatics · doi:10.1385/ni:3:2:093 · Cited by 227
The Effect of Temporal Asynchrony on the Multisensory Integration of Letters and Speech Sounds
van Atteveldt, N. M., Formisano, E., Blomert, L., & Goebel, R. (2006) · Cerebral Cortex · doi:10.1093/cercor/bhl007 · Cited by 209
Schroeder, C. E., Smiley, J., Fu, K. G., McGinnis, T., O'Connell, M. N., & Hackett, T. A. (2003) · International Journal of Psychophysiology · doi:10.1016/s0167-8760(03)00120-x · Cited by 180
Chapter 8 The visually responsive neuron and beyond: multisensory integration in cat and monkey
Stein, B. E., Meredith, M. A., & Wallace, M. T. (1993) · Progress in Brain Research · doi:10.1016/s0079-6123(08)60359-3 · Cited by 179
Schneider, K. A., Richter, M. C., & Kastner, S. (2004) · The Journal of Neuroscience · doi:10.1523/jneurosci.2413-04.2004 · Cited by 177
Early auditory–visual interactions in human cortex during nonredundant target identification
Fort, A., Delpuech, C., Pernier, J., & Giard, M.-H. (2002) · Cognitive Brain Research · doi:10.1016/s0926-6410(02)00058-7 · Cited by 176
STEIN, B. E., & MEREDITH, M. A. (1990) · Annals of the New York Academy of Sciences · doi:10.1111/j.1749-6632.1990.tb48891.x · Cited by 164
Cross-modal synthesis in the midbrain depends on input from cortex
Wallace, M. T., & Stein, B. E. (1994) · Journal of Neurophysiology · doi:10.1152/jn.1994.71.1.429 · Cited by 161
Neural Substrates of Perceptual Enhancement by Cross-Modal Spatial Attention
McDonald, J. J., Teder-Sälejärvi, W. A., Russo, F. D., & Hillyard, S. A. (2003) · Journal of Cognitive Neuroscience · doi:10.1162/089892903321107783 · Cited by 160
Timing and Laminar Profile of Eye-Position Effects on Auditory Responses in Primate Auditory Cortex
Fu, K.-M. G., Shah, A. S., O’Connell, M. N., McGinnis, T., Eckholdt, H., Lakatos, P., Smiley, J. F., & Schroeder, C. E. (2004) · Journal of Neurophysiology · doi:10.1152/jn.01228.2003 · Cited by 110
Attention-Dependent Changes of Activation and Connectivity in Dichotic Listening
Lipschutz, B., Kolinsky, R., Damhaut, P., Wikler, D., & Goldman, S. (2002) · NeuroImage · doi:10.1006/nimg.2002.1184 · Cited by 99
Baier, B., Kleinschmidt, A. K., & Müller, N. G. (2006) · Journal of Neuroscience · doi:10.1523/jneurosci.1457-06.2006 · Cited by 98
Chapter 21 Sensory organization of the superior colliculus in cat and monkey
Wallace, M. T., & Stein, B. E. (1996) · Progress in brain research · doi:10.1016/s0079-6123(08)63337-3 · Cited by 89
Multisensory integration for timing engages different brain networks
Dhamala, M., Assisi, C. G., Jirsa, V., Steinberg, F. L., & Kelso, J. A. S. (2006) · NeuroImage · doi:10.1016/j.neuroimage.2006.07.044 · Cited by 85
Visual search for a target changing in synchrony with an auditory signal
Fujisaki, W., Koene, A. R., Arnold, D. H., Johnston, A., & Nishida, S. (2005) · Proceedings of the Royal Society B Biological Sciences · doi:10.1098/rspb.2005.3327 · Cited by 79
Crossmodal Spatial Interactions in Subcortical and Cortical Circuits
Stein, B. E., Stanford, T. R., Wallace, M. T., Vaughan, J. W., & Jiang, W. (2004) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780198524861.003.0002 · Cited by 74
Utilizing the ventriloquism-effect to investigate audio-visual binding
Bischoff, M., Walter, B., Blecker, C. R., Morgen, K., Vaitl, D., & Sammer, G. (2006) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2006.03.008 · Cited by 63
The Superior Temporal Polysensory Region in Monkeys
Cusick, C. G. (1997) · Cerebral cortex · doi:10.1007/978-1-4757-9625-4_10 · Cited by 58
Brain Mechanisms Mediating Auditory Attentional Capture in Humans
Watkins, S., Dalton, P., Lavie, N., & Rees, G. E. (2006) · Cerebral Cortex · doi:10.1093/cercor/bhl080 · Cited by 58
Endoscopic eye tracking system for fMRI
Kanowski, M., Rieger, J. W., Noesselt, T., Tempelmann, C., & Hinrichs, H. (2006) · Journal of Neuroscience Methods · doi:10.1016/j.jneumeth.2006.08.001 · Cited by 44
Self-citationPetrides, M., & Iversen, S. D. (1978) · Neuropsychologia · doi:10.1016/0028-3932(78)90080-5 · Cited by 40
The Resurrection of Multisensory Cortex in Primates: Connection Patterns That Integrate Modalities
Kaas, J. H., & Collins, C. E. (2004) · The MIT Press eBooks · doi:10.7551/mitpress/3422.003.0022 · Cited by 35
Development and organization of multimodal representation in cat superior colliculus.
Stein, B. E. (1978) · PubMed · Cited by 26
Closer in time when farther in space—Spatial factors in audiovisual temporal integration
Noesselt, T., Fendrich, R., Bonath, B., Tyll, S., & Heinze, H. (2005) · Cognitive Brain Research · doi:10.1016/j.cogbrainres.2005.07.005 · Cited by 17
Self-citation
Cited by
Driver, J., & Noesselt, T. (2008) · Neuron · doi:10.1016/j.neuron.2007.12.013 · Cited by 940
Self-citationOscillatory synchronization in large-scale cortical networks predicts perception
Hipp, J. F., Engel, A. K., & Siegel, M. (2011) · Neuron · doi:10.1016/j.neuron.2010.12.027 · Cited by 599
Cortical Hierarchies Perform Bayesian Causal Inference in Multisensory Perception
Rohe, T., & Noppeney, U. (2015) · PLOS Biology · doi:10.1371/journal.pbio.1002073 · Cited by 344
Perceptual Training Narrows the Temporal Window of Multisensory Binding
Powers, A. R., Hillock, A. R., & Wallace, M. T. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.3501-09.2009 · Cited by 333
A neural basis for interindividual differences in the McGurk effect, a multisensory speech illusion
Nath, A. R., & Beauchamp, M. S. (2012) · NeuroImage · doi:10.1016/j.neuroimage.2011.07.024 · Cited by 280
Metadata
- Authors
- Noesselt, T., Rieger, J. W., Schoenfeld, M. A., Kanowski, M., Hinrichs, H., Heinze, H.-J., & Driver, J.
- Venue
- The Journal of Neuroscience
- Publisher
- Society for Neuroscience
- Published
- 2007-10-17
- Volume
- 27
- Issue
- 42
- Pages
- 11431-11441
- ISSN
- 0270-6474 (ISSN-L)
- 1529-2401
- OpenAlex
- W1969824733
- Cited by
- 292
- References
- 69
- FWCI
- 23.78
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.