The DOI matches its Crossref record; 82 of the 82 references it cites were found in a registry or an index.
Grabbing Your Ear: Rapid Auditory–Somatosensory Multisensory Interactions in Low-level Sensory Cortices Are Not Constrained by Stimulus Alignment
Open accessAbstract
Multisensory interactions are observed in species from single-cell organisms to humans. Important early work was primarily carried out in the cat superior colliculus and a set of critical parameters for their occurrence were defined. Primary among these were temporal synchrony and spatial alignment of bisensory inputs. Here, we assessed whether spatial alignment was also a critical parameter for the temporally earliest multisensory interactions that are observed in lower-level sensory cortices of the human. While multisensory interactions in humans have been shown behaviorally for spatially disparate stimuli (e.g. the ventriloquist effect), it is not clear if such effects are due to early sensory level integration or later perceptual level processing. In the present study, we used psychophysical and electrophysiological indices to show that auditory-somatosensory interactions in humans occur via the same early sensory mechanism both when stimuli are in and out of spatial register. Subjects more rapidly detected multisensory than unisensory events. At just 50 ms post-stimulus, neural responses to the multisensory 'whole' were greater than the summed responses from the constituent unisensory 'parts'. For all spatial configurations, this effect followed from a modulation of the strength of brain responses, rather than the activation of regions specifically responsive to multisensory pairs. Using the local auto-regressive average source estimation, we localized the initial auditory-somatosensory interactions to auditory association areas contralateral to the side of somatosensory stimulation. Thus, multisensory interactions can occur across wide peripersonal spatial separations remarkably early in sensory processing and in cortical regions traditionally considered unisensory.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The assessment and analysis of handedness: The Edinburgh inventory
Oldfield, R. C. (1971) · Neuropsychologia · doi:10.1016/0028-3932(71)90067-4 · Cited by 35,900 · cited 1×
“Eleven were right-handed (Oldfield, 1971).”
Co-Planar Stereotaxic Atlas of the Human Brain
Talairach, J., & Tournoux, P. (1988) · Medical Entomology and Zoology · Cited by 11,798
Visual Contribution to Speech Intelligibility in Noise
Sumby, W. H., & Pollack, I. (1954) · The Journal of the Acoustical Society of America · doi:10.1121/1.1907309 · Cited by 2,583
(1994) · Choice Reviews Online · doi:10.5860/choice.31-4365 · Cited by 1,882
AN ANATOMICAL STUDY OF CONVERGING SENSORY PATHWAYS WITHIN THE CEREBRAL CORTEX OF THE MONKEY
JONES, E. G., & POWELL, T. P. S. (1970) · Brain · doi:10.1093/brain/93.4.793 · Cited by 1,711
Reference-free identification of components of checkerboard-evoked multichannel potential fields
Lehmann, D., & Skrandies, W. (1980) · Electroencephalography and Clinical Neurophysiology · doi:10.1016/0013-4694(80)90419-8 · Cited by 1,552
Intentional Maps in Posterior Parietal Cortex
Andersen, R. A., & Buneo, C. A. (2002) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.25.112701.142922 · Cited by 1,294 · cited 2×
“Indeed, evidence for dynamic shifts in auditory receptive fields have been documented in the primate superior colliculus (e.g. Jay and Sparks, 1987) and parietal cortex (see Andersen and Buneo, 2002).”
BackgroundShams, L., Kamitani, Y., & Shimojo, S. (2000) · Nature · doi:10.1038/35048669 · Cited by 1,262
Divided attention: Evidence for coactivation with redundant signals
Miller, J. (1982) · Cognitive Psychology · doi:10.1016/0010-0285(82)90010-x · Cited by 1,213
Giard, M. H., & Peronnet, F. (1999) · Journal of Cognitive Neuroscience · doi:10.1162/089892999563544 · Cited by 1,072
Crossmodal Processing in the Human Brain: Insights from Functional Neuroimaging Studies
Calvert, G. A. (2001) · Cerebral Cortex · doi:10.1093/cercor/11.12.1110 · Cited by 1,012
Segmentation of brain electrical activity into microstates: model estimation and validation
Pascual-Marqui, R. D., Michel, C. M., & Lehmann, D. (1995) · IEEE Transactions on Biomedical Engineering · doi:10.1109/10.391164 · Cited by 986
Self-citationMolholm, S., Ritter, W., Murray, M. M., Javitt, D. C., Schroeder, C. E., & Foxe, J. J. (2002) · Cognitive Brain Research · doi:10.1016/s0926-6410(02)00066-6 · Cited by 902
Self-citationAnatomical evidence of multimodal integration in primate striate cortex
Falchier, A., Clavagnier, S., Barone, P., & Kennedy, H. (2002) · The Journal of Neuroscience · doi:10.1523/jneurosci.22-13-05749.2002 · Cited by 892 · cited 2×
“Anatomical tracing studies have revealed direct projections to visual areas V1 and V2 from primary (Falchier et al., 2002) as well as association areas (Falchier et al., 2002; Rockland and Ojima, 2003) of macaque auditory cortex.”
BackgroundDeterminants of multisensory integration in superior colliculus neurons. I. Temporal factors
Meredith, M., Nemitz, J., & Stein, B. (1987) · The Journal of Neuroscience · doi:10.1523/jneurosci.07-10-03215.1987 · Cited by 754
Sound alters visual motion perception
Sekuler, R., Sekuler, A. B., & Lau, R. (1997) · Nature · doi:10.1038/385308a0 · Cited by 685
DIVISION OF PSYCHOLOGY : STATISTICAL FACILITATION OF SIMPLE REACTION TIMES*
Raab, D. H. (1962) · Transactions of the New York Academy of Sciences · doi:10.1111/j.2164-0947.1962.tb01433.x · Cited by 668
Mapping of scalp potentials by surface spline interpolation
Perrin, F., Pernier, J., Bertnard, O., Giard, M. H., & Echallier, J. F. (1987) · Electroencephalography and Clinical Neurophysiology · doi:10.1016/0013-4694(87)90141-6 · Cited by 623
Modulation of Human Visual Cortex by Crossmodal Spatial Attention
Macaluso, E., Frith, C. D., & Driver, J. (2000) · Science · doi:10.1126/science.289.5482.1206 · Cited by 613
Visual Capture of Touch: Out-of-the-Body Experiences With Rubber Gloves.
Pavani, F., Spence, C., & Driver, J. (2000) · Psychological Science · doi:10.1111/1467-9280.00270 · Cited by 608
Multisensory integration and the body schema: Close to hand and within reach
Maravita, A., Spence, C., & Driver, J. (2003) · Current Biology · doi:10.1016/s0960-9822(03)00449-4 · Cited by 578
Multisensory convergence in calcarine visual areas in macaque monkey
Rockland, K. S., & Ojima, H. (2003) · International Journal of Psychophysiology · doi:10.1016/s0167-8760(03)00121-1 · Cited by 564
Principles of spatial analysis
Lehmann, D. (1987) · Medical Entomology and Zoology · Cited by 507
Guldin, W. O., & Grüsser, O.-J. (1998) · Trends in Neurosciences · doi:10.1016/s0166-2236(97)01211-3 · Cited by 504
Somatosensory and auditory convergence in the lateral nucleus of the amygdala.
Romanski, L. M., Clugnet, M.-C., Bordi, F., & LeDoux, J. E. (1993) · Behavioral Neuroscience · doi:10.1037/0735-7044.107.3.444 · Cited by 446
Enhancement of visual perception by crossmodal visuo-auditory interaction
Frassinetti, F., Bolognini, N., & Làdavas, E. (2002) · Experimental Brain Research · doi:10.1007/s00221-002-1262-y · Cited by 444
Parchment-skin illusion: sound-biased touch
Jousmäki, V, & Hari, R. (1998) · Current Biology · doi:10.1016/s0960-9822(98)70120-4 · Cited by 442
Auditory-Somatosensory Multisensory Processing in Auditory Association Cortex: An fMRI Study
Foxe, J. J., Wylie, G. R., Martinez, A., Schroeder, C. E., Javitt, D. C., Guilfoyle, D., Ritter, W., & Murray, M. M. (2002) · Journal of Neurophysiology · doi:10.1152/jn.2002.88.1.540 · Cited by 426
Self-citationSensorimotor integration in the primate superior colliculus. II. Coordinates of auditory signals
Jay, M. F., & Sparks, D. L. (1987) · Journal of Neurophysiology · doi:10.1152/jn.1987.57.1.35 · Cited by 420
Somatosensory Input to Auditory Association Cortex in the Macaque Monkey
Schroeder, C. E., Lindsley, R. W., Specht, C., Marcovici, A., Smiley, J. F., & Javitt, D. C. (2001) · Journal of Neurophysiology · doi:10.1152/jn.2001.85.3.1322 · Cited by 419
Self-citationThe timing and laminar profile of converging inputs to multisensory areas of the macaque neocortex
Schroeder, C. E., & Foxe, J. J. (2002) · Cognitive Brain Research · doi:10.1016/s0926-6410(02)00073-3 · Cited by 416
Self-citationEnhancement of Perceived Visual Intensity by Auditory Stimuli: A Psychophysical Analysis
Stein, B. E., London, N., Wilkinson, L. K., & Price, D. D. (1996) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.1996.8.6.497 · Cited by 404
Foxe, J. J., Morocz, I. A., Murray, M. M., Higgins, B. A., Javitt, D. C., & Schroeder, C. E. (2000) · Cognitive Brain Research · doi:10.1016/s0926-6410(00)00024-0 · Cited by 395
Self-citationStein, B. E., Meredith, M. A., Huneycutt, W. S., & McDade, L. (1989) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.1989.1.1.12 · Cited by 394
Multisensory Visual-Auditory Object Recognition in Humans: a High-density Electrical Mapping Study
Molholm, S. (2004) · Cerebral Cortex · doi:10.1093/cercor/bhh007 · Cited by 384
Self-citationAuditory processing in primate cerebral cortex
Kaas, J. H., Hackett, T. A., & Tramo, M. J. (1999) · Current Opinion in Neurobiology · doi:10.1016/s0959-4388(99)80022-1 · Cited by 380
Electrical neuroimaging based on biophysical constraints
Grave de Peralta Menendez, R., Murray, M. M., Michel, C. M., Martuzzi, R., & Gonzalez Andino, S. L. (2004) · NeuroImage · doi:10.1016/j.neuroimage.2003.09.051 · Cited by 365
Self-citationMenendez, R. G. D. P., Andino, S. G., Lantz, G., Michel, C. M., & Landis, T. (2001) · Brain Topography · doi:10.1023/a:1012944913650 · Cited by 348
Self-citationTemporal and spatial dependency of the ventriloquism effect
Slutsky, D. A., & Recanzone, G. H. (2001) · Neuroreport · doi:10.1097/00001756-200101220-00009 · Cited by 341
Teder-Sälejärvi, W. A., McDonald, J. J., Di Russo, F., & Hillyard, S. A. (2002) · Cognitive Brain Research · doi:10.1016/s0926-6410(02)00065-4 · Cited by 330
Auditory Cortical Neurons Respond to Somatosensory Stimulation
Fu, K.-M. G., Johnston, T. A., Shah, A. S., Arnold, L., Smiley, J., Hackett, T. A., Garraghty, P. E., & Schroeder, C. E. (2003) · The Journal of Neuroscience · doi:10.1523/jneurosci.23-20-07510.2003 · Cited by 325
Self-citationRivier, F., & Clarke, S. (1997) · NeuroImage · doi:10.1006/nimg.1997.0304 · Cited by 311
Eye Movements Modulate Visual Receptive Fields of V4 Neurons
Tolias, A. S., Moore, T., Smirnakis, S. M., Tehovnik, E. J., Siapas, A. G., & Schiller, P. H. (2001) · Neuron · doi:10.1016/s0896-6273(01)00250-1 · Cited by 295
Ahissar, M., Ahissar, E., Bergman, H., & Vaadia, E. (1992) · Journal of Neurophysiology · doi:10.1152/jn.1992.67.1.203 · Cited by 265
Visual-auditory interactions in sensorimotor processing: Saccades versus manual responses.
Hughes, H. C., Reuter‐Lorenz, P. A., Nozawa, G., & Fendrich, R. (1994) · Journal of Experimental Psychology Human Perception & Performance · doi:10.1037//0096-1523.20.1.131 · Cited by 252
Rapid discrimination of visual and multisensory memories revealed by electrical neuroimaging
Murray, M. M., Michel, C. M., Grave de Peralta, R., Ortigue, S., Brunet, D., Gonzalez Andino, S., & Schnider, A. (2004) · NeuroImage · doi:10.1016/j.neuroimage.2003.09.035 · Cited by 246
Self-citationElectric source imaging of human brain functions
Michel, C. M., Thut, G., Morand, S., Khateb, A., Pegna, A. J., Grave de Peralta, R., Gonzalez, S., Seeck, M., & Landis, T. (2001) · Brain Research Reviews · doi:10.1016/s0165-0173(01)00086-8 · Cited by 243
Self-citationComplex movements evoked by microstimulation of the ventral intraparietal area
Cooke, D. F., Taylor, C. S. R., Moore, T., & Graziano, M. S. A. (2003) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1031751100 · Cited by 242
Functional properties of neurons in the temporo-parietal association cortex of awake monkey
Leinonen, L., Hyv�rinen, J., & Sovij�rvi, A. R. A. (1980) · Experimental Brain Research · doi:10.1007/bf00237551 · Cited by 226
Functional Brain Mapping of Monkey Tool Use
Obayashi, S., Suhara, T., Kawabe, K., Okauchi, T., Maeda, J., Akine, Y., Onoe, H., & Iriki, A. (2001) · NeuroImage · doi:10.1006/nimg.2001.0878 · Cited by 221
What and Where in human audition: selective deficits following focal hemispheric lesions
Clarke, S., Bellmann Thiran, A., Maeder, P., Adriani, M., Vernet, O., Regli, L., Cuisenaire, O., & Thiran, J.-P. (2002) · Experimental Brain Research · doi:10.1007/s00221-002-1203-9 · Cited by 210
Forster, B., Cavina-Pratesi, C., Aglioti, S. M., & Berlucchi, G. (2002) · Experimental Brain Research · doi:10.1007/s00221-002-1017-9 · Cited by 207 · cited 2×
“hemispace) for effects to occur either in the case of facilitating stimulus detection (Hughes et al., 1994; Harrington and Peck, 1998; Forster et al., 2002; Frassinetti et al., 2002) or in the case of influencing localization judgments (e.”
BackgroundWoldorff, M. G., Tempelmann, C., Fell, J., Tegeler, C., Gaschler‐Markefski, B., Hinrichs, H., Heinze, H., & Scheich, H. (1999) · Human Brain Mapping · doi:10.1002/(sici)1097-0193(1999)7:1<49::aid-hbm5>3.0.co;2-j · Cited by 193
Speeded responses to audiovisual signal changes result from bimodal integration
SCHRÖGER, E., & WIDMANN, A. (1998) · Psychophysiology · doi:10.1017/s0048577298980714 · Cited by 192
Warren, D. H., Welch, R. B., & McCarthy, T. J. (1981) · Perception & Psychophysics · doi:10.3758/bf03202010 · Cited by 191
Recanzone, G. H., Guard, D. C., Phan, M. L., & Su, T.-I. K. (2000) · Journal of Neurophysiology · doi:10.1152/jn.2000.83.5.2723 · Cited by 190
Schroeder, C. E., Smiley, J., Fu, K. G., McGinnis, T., O'Connell, M. N., & Hackett, T. A. (2003) · International Journal of Psychophysiology · doi:10.1016/s0167-8760(03)00120-x · Cited by 180
Self-citationEarly auditory–visual interactions in human cortex during nonredundant target identification
Fort, A., Delpuech, C., Pernier, J., & Giard, M.-H. (2002) · Cognitive Brain Research · doi:10.1016/s0926-6410(02)00058-7 · Cited by 176
Todd, J. W. (1912) · doi:10.1037/13053-000 · Cited by 175
Caclin, A., Soto-Faraco, S., Kingstone, A., & Spence, C. (2002) · Perception & Psychophysics · doi:10.3758/bf03194730 · Cited by 169
Visual Localization Ability Influences Cross-Modal Bias
Hairston, W. D., Wallace, M. T., Vaughan, J. W., Stein, B. E., Norris, J. L., & Schirillo, J. A. (2003) · Journal of Cognitive Neuroscience · doi:10.1162/089892903321107792 · Cited by 164
Spatial disparity affects visual-auditory interactions in human sensorimotor processing
Harrington, L. K., & Peck, C. K. (1998) · Experimental Brain Research · doi:10.1007/s002210050512 · Cited by 163
Murray, M. M., Foxe, J. J., Higgins, B. A., Javitt, D. C., & Schroeder, C. E. (2001) · Neuropsychologia · doi:10.1016/s0028-3932(01)00004-5 · Cited by 159
Self-citationAuditory Peripersonal Space in Humans
Farnè, A., & Làdavas, E. (2002) · Journal of Cognitive Neuroscience · doi:10.1162/089892902320474481 · Cited by 153
Experimental study of the influence of vision on sound localization.
Thomas, G. J. (1941) · Journal of Experimental Psychology · doi:10.1037/h0055183 · Cited by 126
Chapter 20 Comparisons of cross-modality integration in midbrain and cortex
Stein, B. E., & Wallace, M. T. (1996) · Progress in brain research · doi:10.1016/s0079-6123(08)63336-1 · Cited by 125
Cross-modal enhancement of perceived brightness: Sensory interaction versus response bias
Odgaard, E. C., Arieh, Y., & Marks, L. E. (2003) · Perception & Psychophysics · doi:10.3758/bf03194789 · Cited by 117
Segregated Processing of Auditory Motion and Auditory Location: An ERP Mapping Study
Ducommun, C. Y., Murray, M. M., Thut, G., Bellmann, A., Viaud‐Delmon, I., Clarke, S., & Michel, C. M. (2002) · NeuroImage · doi:10.1006/nimg.2002.1062 · Cited by 104
Self-citationGobbelé, R., Schürmann, M., Forss, N., Juottonen, K., Büchner, H., & Hari, R. (2003) · NeuroImage · doi:10.1016/s1053-8119(03)00312-4 · Cited by 100
Magnetoencephalographic Correlates of Audiotactile Interaction
Lütkenhöner, B., Lammertmann, C., Simões, C., & Hari, R. (2002) · NeuroImage · doi:10.1006/nimg.2001.0991 · Cited by 97
Macaluso, E., Frith, C., & Driver, J. (2002) · Neuron · doi:10.1016/s0896-6273(02)00678-5 · Cited by 96
Spence, C. J., & Driver, J. (2000) · Neuroreport · doi:10.1097/00001756-200006260-00049 · Cited by 95
Hötting, K., Rösler, F., & Röder, B. (2003) · Experimental Brain Research · doi:10.1007/s00221-002-1261-z · Cited by 88
Context, state and the receptive fields of striatal cortex cells
Wörgötter, F., & Eysel, U. T. (2000) · Trends in Neurosciences · doi:10.1016/s0166-2236(00)01632-5 · Cited by 77
Cortex Controls Multisensory Depression in Superior Colliculus
Jiang, W., & Stein, B. E. (2003) · Journal of Neurophysiology · doi:10.1152/jn.00369.2003 · Cited by 71
Human?simian correspondence in the early cortical processing of multisensory cues
Schroeder, C. E., Molhom, S., Lakatos, P., Ritter, W., & Foxe, J. J. (2004) · Cognitive Processing · doi:10.1007/s10339-004-0020-4 · Cited by 59
Self-citationSpeechreading: illusion or window into pattern recognition
Massaro, D. W. (1999) · Trends in Cognitive Sciences · doi:10.1016/s1364-6613(99)01360-1 · Cited by 53
Multisensory Convergence in Early Cortical Processing
Schroeder, C. E., & Foxe, J. J. (2004) · The MIT Press eBooks · doi:10.7551/mitpress/3422.003.0023 · Cited by 50
Self-citationBeyond the window: multisensory representation of peripersonal space across a transparent barrier
Farnè, A., Demattè, M. L., & Làdavas, E. (2003) · International Journal of Psychophysiology · doi:10.1016/s0167-8760(03)00124-7 · Cited by 45
Sarno, S., Erasmus, L.-P., Lipp, B., & Schlaegel, W. (2003) · Brain Injury · doi:10.1080/0269905031000070161 · Cited by 41
Spatial coincidence modulates interaction between visual and somatosensory evoked potentials
Schürmann, M., Kolev, V., Menzel, K., & Yordanova, J. (2002) · Neuroreport · doi:10.1097/00001756-200205070-00009 · Cited by 23
Evidence for somatosensory evoked responses in human temporal lobe
Tesche, C. D. (2000) · Neuroreport · doi:10.1097/00001756-200008210-00010 · Cited by 11
Cited by
Michel, C. M., Murray, M. M., Lantz, G., Gonzalez, S., Spinelli, L., & Grave de Peralta, R. (2004) · Clinical Neurophysiology · doi:10.1016/j.clinph.2004.06.001 · Cited by 1,655
Self-citationNeuronal oscillations and multisensory interaction in primary auditory cortex
Lakatos, P., Chen, C.-M., O'Connell, M. N., Mills, A., & Schroeder, C. E. (2007) · Neuron · doi:10.1016/j.neuron.2006.12.011 · Cited by 961
Self-citationDriver, J., & Noesselt, T. (2008) · Neuron · doi:10.1016/j.neuron.2007.12.013 · Cited by 940
Computational neuroanatomy of speech production
Hickok, G. (2012) · Nature Reviews Neuroscience · doi:10.1038/nrn3158 · Cited by 837
Ross, L. A., Saint-Amour, D., Leavitt, V. M., Javitt, D. C., & Foxe, J. J. (2006) · Cerebral Cortex · doi:10.1093/cercor/bhl024 · Cited by 650
Self-citation
Metadata
- Authors
- Murray, M. M., Molholm, S., Michel, C. M., Heslenfeld, D. J., Ritter, W., Javitt, D. C., Schroeder, C. E., & Foxe, J. J.
- Venue
- Cerebral Cortex
- Publisher
- Oxford University Press (OUP)
- Published
- 2004-11-10
- Volume
- 15
- Issue
- 7
- Pages
- 963-974
- ISSN
- 1047-3211 (ISSN-L)
- 1460-2199
- OpenAlex
- W2105698102
- Cited by
- 413
- References
- 82
- FWCI
- 32.51
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.