Auditory-Visual Integration during Multimodal Object Recognition in Humans: A Behavioral and Electrophysiological Study
The DOI matches its Crossref record; 87 of the 88 references it cites were found in a registry or an index.
Abstract
The aim of this study was (1) to provide behavioral evidence for multimodal feature integration in an object recognition task in humans and (2) to characterize the processing stages and the neural structures where multisensory interactions take place. Event-related potentials (ERPs) were recorded from 30 scalp electrodes while subjects performed a forced-choice reaction-time categorization task: At each trial, the subjects had to indicate which of two objects was presented by pressing one of two keys. The two objects were defined by auditory features alone, visual features alone, or the combination of auditory and visual features. Subjects were more accurate and rapid at identifying multimodal than unimodal objects. Spatiotemporal analysis of ERPs and scalp current densities revealed several auditory-visual interaction components temporally, spatially, and functionally distinct before 200 msec poststimulus. The effects observed were (1) in visual areas, new neural activities (as early as 40 msec poststimulus) and modulation (amplitude decrease) of the N185 wave to unimodal visual stimulus, (2) in the auditory cortex, modulation (amplitude increase) of subcomponents of the unimodal auditory N1 wave around 90 to 110 msec, and (3) new neural activity over the right fronto-temporal area (140 to 165 msec). Furthermore, when the subjects were separated into two groups according to their dominant modality to perform the task in unimodal conditions (shortest reaction time criteria), the integration effects were found to be similar for the two groups over the nonspecific fronto-temporal areas, but they clearly differed in the sensory-specific cortices, affecting predominantly the sensory areas of the nondominant modality. Taken together, the results indicate that multisensory integration is mediated by flexible, highly adaptive physiological processes that can take place very early in the sensory processing chain and operate in both sensory-specific and nonspecific cortical structures in different ways.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Multimodal stimuli are typically perceived more precisely and faster than unimodal stimuli (Doyle & Snowden, 2001;Forster, Cavina-Pratesi, Aglioti, & Berlucchi, 2002;Fort, Delpuech, Pernier, & Giard, 2002;G i a r d&P e r o n n e t , 1999).”
From Augmented visual, auditory, haptic, and multimodal feedback in motor learning: A review (2013) · cites this paper as Giard & Peronnet, 1999
Citations
Cites
Hearing lips and seeing voices
MCGURK, H., & MACDONALD, J. (1976) · Nature · doi:10.1038/264746a0 · Cited by 6,183
Ungerleider, L. G. (1982) · Medical Entomology and Zoology · Cited by 4,531
Speed of processing in the human visual system
Thorpe, S., Fize, D., & Marlot, C. (1996) · Nature · doi:10.1038/381520a0 · Cited by 3,538
Visual Feature Integration and the Temporal Correlation Hypothesis
Singer, W., & Gray, C. M. (1995) · Annual Review of Neuroscience · doi:10.1146/annurev.ne.18.030195.003011 · Cited by 3,123
Spherical splines for scalp potential and current density mapping
Perrin, F., Pernier, J., Bertrand, O., & Echallier, J. F. (1989) · Electroencephalography and Clinical Neurophysiology · doi:10.1016/0013-4694(89)90180-6 · Cited by 2,706 · cited 1×
“SCDs were estimated by computing the second derivative of the interpolated potential distributions ( Perrin, Pernier, Bertrand, & Echallier, 1989 ).”
MethodSociety for Neuroscience 2007 abstracts
Wishart, T. M., Paterson, J. M., Short, D. M., Meredith, S., Robertson, K., Sutherland, C. D., Cousin, M. A., Dutia, M. B., & Gillingwater, T. H. (2007) · Cited by 2,094
(1994) · Choice Reviews Online · doi:10.5860/choice.31-4365 · Cited by 1,882
AN ANATOMICAL STUDY OF CONVERGING SENSORY PATHWAYS WITHIN THE CEREBRAL CORTEX OF THE MONKEY
JONES, E. G., & POWELL, T. P. S. (1970) · Brain · doi:10.1093/brain/93.4.793 · Cited by 1,711
Journal of the Washington Academy of Sciences.
(1918) · The Journal of Geology · doi:10.1086/622567 · Cited by 1,707
Logothetis, N. K., & Sheinberg, D. L. (1996) · Annual Review of Neuroscience · doi:10.1146/annurev.ne.19.030196.003045 · Cited by 1,351
Research works printed but not linked: 6
- Bernstein I. H., 1970, Acta Physiologica Academiae Scientarum Hungaricae, 33, 21
- Costin D., 1991, Society for Neuroscience Abstracts, 17, 656
- Fisher B. D., 1994, Cahiers de Psychologie Cognitive, 13, 92
- 10.1037/0096-1523.20.1.131 · doi:10.1037/0096-1523.20.1.131 · Paper page
- 10.1037/0033-295X.83.2.157 · doi:10.1037/0033-295x.83.2.157 · Paper page
- Schroeder C. E., 1995, Society for Neuroscience Abstracts, 21, 694
Cited by
The mismatch negativity (MMN) in basic research of central auditory processing: A review
Näätänen, R., Paavilainen, P., Rinne, T., & Alho, K. (2007) · Clinical Neurophysiology · doi:10.1016/j.clinph.2007.04.026 · Cited by 2,644
“For possible neural mechanisms of multisensory convergence during the early cortical processing, see Foxe and Schroeder (2005; see also Besle et al. 2005; Molholm et al. 2002; Giard and Peronnet 1999; Bernstein et al., 2002).”
BackgroundMultisensory integration: current issues from the perspective of the single neuron
Stein, B. E., & Stanford, T. R. (2008) · Nature Reviews Neuroscience · doi:10.1038/nrn2331 · Cited by 1,598
Is neocortex essentially multisensory?
GHAZANFAR, A., & SCHROEDER, C. (2006) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2006.04.008 · Cited by 1,463
Augmented visual, auditory, haptic, and multimodal feedback in motor learning: A review
Sigrist, R., Rauter, G., Riener, R., & Wolf, P. (2013) · Psychonomic Bulletin & Review · doi:10.3758/s13423-012-0333-8 · Cited by 1,416
Crossmodal Processing in the Human Brain: Insights from Functional Neuroimaging Studies
Calvert, G. A. (2001) · Cerebral Cortex · doi:10.1093/cercor/11.12.1110 · Cited by 1,012
Calvert, G. A., Campbell, R., & Brammer, M. J. (2000) · Current Biology · doi:10.1016/s0960-9822(00)00513-3 · Cited by 954
Driver, J., & Noesselt, T. (2008) · Neuron · doi:10.1016/j.neuron.2007.12.013 · Cited by 940
Molholm, S., Ritter, W., Murray, M. M., Javitt, D. C., Schroeder, C. E., & Foxe, J. J. (2002) · Cognitive Brain Research · doi:10.1016/s0926-6410(02)00066-6 · Cited by 902
Anatomical evidence of multimodal integration in primate striate cortex
Falchier, A., Clavagnier, S., Barone, P., & Kennedy, H. (2002) · The Journal of Neuroscience · doi:10.1523/jneurosci.22-13-05749.2002 · Cited by 892
Visual speech speeds up the neural processing of auditory speech
van Wassenhove, V., Grant, K. W., & Poeppel, D. (2005) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0408949102 · Cited by 854
The multifaceted interplay between attention and multisensory integration.
Talsma, D., Senkowski, D., Soto-Faraco, S., & Woldorff, M. G. (2010) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2010.06.008 · Cited by 828
Odor/taste integration and the perception of flavor
Small, D. M., & Prescott, J. (2005) · Experimental Brain Research · doi:10.1007/s00221-005-2376-9 · Cited by 712
Multisensory contributions to low-level, ‘unisensory’ processing
Schroeder, C. E., & Foxe, J. (2005) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2005.06.008 · Cited by 507
Visual Modulation of Neurons in Auditory Cortex
Kayser, C., Petkov, C. I., & Logothetis, N. K. (2008) · Cerebral Cortex · doi:10.1093/cercor/bhm187 · Cited by 509
Pip and pop: Nonspatial auditory signals improve spatial visual search.
Van der Burg, E., Olivers, C. N. L., Bronkhorst, A. W., & Theeuwes, J. (2008) · Journal of Experimental Psychology: Human Perception and Performance · doi:10.1037/0096-1523.34.5.1053 · Cited by 485
“They are also consistent with neurological evidence that such integration occurs relatively early (Falchier, Clavagnier, Barone, & Kennedy, 2002; Giard & Peronnet, 1999; Molholm et al., 2002; Talsma, Doty, & Woldorff, 2007) and effortlessly (Vroomen & De Gelder, 2000).”
BackgroundMultisensory perception: Beyond modularity and convergence
Driver, J., & Spence, C. (2000) · Current Biology · doi:10.1016/s0960-9822(00)00740-5 · Cited by 465
Calvert, G. A., Hansen, P. C., Iversen, S. D., & Brammer, M. J. (2001) · NeuroImage · doi:10.1006/nimg.2001.0812 · Cited by 464
Enhanced multisensory integration in older adults
Laurienti, P. J., Burdette, J. H., Maldjian, J. A., & Wallace, M. T. (2006) · Neurobiology of Aging · doi:10.1016/j.neurobiolaging.2005.05.024 · Cited by 451
Talsma, D., Doty, T. J., & Woldorff, M. G. (2006) · Cerebral Cortex · doi:10.1093/cercor/bhk016 · Cited by 434
“Several recent ERP studies have utilized the temporal proximity property of multisensory objects by adapting a method that was first developed in animal single-cell recordings (Stein and Meredith 1993) and that was then adapted for use in human ERP studies (Giard and Peronnet 1999).”
BackgroundMethodResultInfluentialSound enhances visual perception: Cross-modal effects of auditory organization on vision.
Vroomen, J., & Gelder, B. D. (2000) · Journal of Experimental Psychology: Human Perception and Performance · doi:10.1037//0096-1523.26.5.1583 · Cited by 434
Multisensory spatial interactions: a window onto functional integration in the human brain
Macaluso, E., & Driver, J. (2005) · Trends in Neurosciences · doi:10.1016/j.tins.2005.03.008 · Cited by 428
“Giard and Peronnet reported modulation of ERP components arising over visual cortex for bimodal auditory–visual stimuli, as early as 40 ms post-stimulus [ 26 ].”
BackgroundMultisensory integration: methodological approaches and emerging principles in the human brain.
Calvert, G. A., & Thesen, T. (2004) · Journal of Physiology-Paris · doi:10.1016/j.jphysparis.2004.03.018 · Cited by 425
“In addition to these regions of heteromodal cortex, a number of recent studies now suggest that multisensory interactions also occur in early stages of the processing hierarchy, in areas of putative sensory-specific cortex [32,60].”
BackgroundAuditory-Somatosensory Multisensory Processing in Auditory Association Cortex: An fMRI Study
Foxe, J. J., Wylie, G. R., Martinez, A., Schroeder, C. E., Javitt, D. C., Guilfoyle, D., Ritter, W., & Murray, M. M. (2002) · Journal of Neurophysiology · doi:10.1152/jn.2002.88.1.540 · Cited by 426
Talsma, D., & Woldorff, M. G. (2005) · Journal of Cognitive Neuroscience · doi:10.1162/0898929054475172 · Cited by 419
The timing and laminar profile of converging inputs to multisensory areas of the macaque neocortex
Schroeder, C. E., & Foxe, J. J. (2002) · Cognitive Brain Research · doi:10.1016/s0926-6410(02)00073-3 · Cited by 416
Murray, M. M., Molholm, S., Michel, C. M., Heslenfeld, D. J., Ritter, W., Javitt, D. C., Schroeder, C. E., & Foxe, J. J. (2005) · Cerebral Cortex · doi:10.1093/cercor/bhh197 · Cited by 413
Foxe, J. J., Morocz, I. A., Murray, M. M., Higgins, B. A., Javitt, D. C., & Schroeder, C. E. (2000) · Cognitive Brain Research · doi:10.1016/s0926-6410(00)00024-0 · Cited by 395
Integration of Touch and Sound in Auditory Cortex
Kayser, C., Petkov, C. I., Augath, M., & Logothetis, N. K. (2005) · Neuron · doi:10.1016/j.neuron.2005.09.018 · Cited by 388
Sensory integration and the perceptual experience of persons with autism
Iarocci, G., & McDonald, J. (2006) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-005-0044-3 · Cited by 376
“This hypothesis is consistent with the fMRI and ERP data indicating multisensory interactions in spatial processing within modality-specific visual and auditory areas (e.g., Giard & Peronnet, 1999; Macaluso & Driver, 2005a).”
MethodResultInfluentialMultisensory Visual-Auditory Object Recognition in Humans: a High-density Electrical Mapping Study
Molholm, S. (2004) · Cerebral Cortex · doi:10.1093/cercor/bhh007 · Cited by 384
Deactivation of Sensory-Specific Cortex by Cross-Modal Stimuli
Laurienti, P. J., Burdette, J. H., Wallace, M. T., Yen, Y.-F., Field, A. S., & Stein, B. E. (2002) · Journal of Cognitive Neuroscience · doi:10.1162/089892902317361930 · Cited by 369
Cappe, C., & Barone, P. (2005) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2005.04462.x · Cited by 362
Functional connectivity in the brain—is it an elusive concept?
Fingelkurts, A. A., Fingelkurts, A. A., & Kähkönen, S. (2005) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2004.10.009 · Cited by 344
Physiological and Anatomical Evidence for Multisensory Interactions in Auditory Cortex
Bizley, J. K., Nodal, F. R., Bajo, V. M., Nelken, I., & King, A. J. (2007) · Cerebral Cortex · doi:10.1093/cercor/bhl128 · Cited by 354
Neural Correlates of Multisensory Integration of Ecologically Valid Audiovisual Events
Stekelenburg, J. J., & Vroomen, J. (2007) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2007.19.12.1964 · Cited by 336
Sound alters activity in human V1 in association with illusory visual perception
Watkins, S., Shams, L., Tanaka, S., Haynes, J.-D., & Rees, G. (2006) · NeuroImage · doi:10.1016/j.neuroimage.2006.01.016 · Cited by 343
A revised view of sensory cortical parcellation
Wallace, M. T., Ramachandran, R., & Stein, B. E. (2004) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0305697101 · Cited by 343
Teder-Sälejärvi, W. A., McDonald, J. J., Di Russo, F., & Hillyard, S. A. (2002) · Cognitive Brain Research · doi:10.1016/s0926-6410(02)00065-4 · Cited by 330
Barraclough*, N. E., Xiao*, D., Baker, C. I., Oram, M. W., & Perrett, D. I. (2005) · Journal of Cognitive Neuroscience · doi:10.1162/0898929053279586 · Cited by 332
Bimodal speech: early suppressive visual effects in human auditory cortex
Besle, J., Fort, A., Delpuech, C., & Giard, M. (2004) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2004.03670.x · Cited by 323
Self-citationPerceptual Fusion and Stimulus Coincidence in the Cross-Modal Integration of Speech
Miller, L. M., & D'Esposito, M. (2005) · The Journal of Neuroscience · doi:10.1523/jneurosci.0896-05.2005 · Cited by 322
Auditory Cortical Neurons Respond to Somatosensory Stimulation
Fu, K.-M. G., Johnston, T. A., Shah, A. S., Arnold, L., Smiley, J., Hackett, T. A., Garraghty, P. E., & Schroeder, C. E. (2003) · The Journal of Neuroscience · doi:10.1523/jneurosci.23-20-07510.2003 · Cited by 325
The case for feedforward multisensory convergence during early cortical processing
Foxe, J. J., & Schroeder, C. E. (2005) · NeuroReport · doi:10.1097/00001756-200504040-00001 · Cited by 316
Implicit multisensory associations influence voice recognition
von Kriegstein, K., & Giraud, A.-L. (2006) · PLoS Biology · doi:10.1371/journal.pbio.0040326 · Cited by 309
“These findings have a good physiological plausibility because audio-visual sensory binding has been observed in animals and humans, at even earlier sensory processing stages than voice and face specific processing (for review see [39]) and with latencies that are compatible with a direct influence of inputs in one mod…”
BackgroundAudiovisual integration of emotional signals in voice and face: An event-related fMRI study
Kreifelts, B., Ethofer, T., Grodd, W., Erb, M., & Wildgruber, D. (2007) · NeuroImage · doi:10.1016/j.neuroimage.2007.06.020 · Cited by 303
Cross-modal plasticity for the spatial processing of sounds in visually deprived subjects
Collignon, O., Voss, P., Lassonde, M., & Lepore, F. (2009) · Experimental Brain Research · doi:10.1007/s00221-008-1553-z · Cited by 286
Seeing to hear better: evidence for early audio-visual interactions in speech identification
SCHWARTZ, J. (2004) · Cognition · doi:10.1016/s0010-0277(04)00054-x · Cited by 279
Do early sensory cortices integrate cross-modal information?
Kayser, C., & Logothetis, N. K. (2007) · Brain Structure and Function · doi:10.1007/s00429-007-0154-0 · Cited by 293
Audiovisual Integration of Letters in the Human Brain
Raij, T., Uutela, K., & Hari, R. (2000) · Neuron · doi:10.1016/s0896-6273(00)00138-0 · Cited by 282
Noesselt, T., Rieger, J. W., Schoenfeld, M. A., Kanowski, M., Hinrichs, H., Heinze, H.-J., & Driver, J. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.2252-07.2007 · Cited by 292
Multisensory Integration in the Ventral Intraparietal Area of the Macaque Monkey.
Avillac, M., Ben Hamed, S., & Duhamel, J.-R. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.2646-06.2007 · Cited by 281
“Compatible with the behavioral effects of bimodality (Welch and Warren, 1986; Giard and Peronnet, 1999), multisensory integration is maximized by synchronous and spatially congruent bimodal stimulations.”
BackgroundInfluentialMultisensory Interactions within Human Primary Cortices Revealed by BOLD Dynamics
Martuzzi, R., Murray, M. M., Michel, C. M., Thiran, J.-P., Maeder, P. P., Clarke, S., & Meuli, R. A. (2007) · Cerebral Cortex · doi:10.1093/cercor/bhl077 · Cited by 285
Seeing to hear better: evidence for early audio-visual interactions in speech identification
Schwartz, J.-L., Berthommier, F., & Savariaux, C. (2004) · Cognition · doi:10.1016/j.cognition.2004.01.006 · Cited by 275
Budinger, E., Heil, P., Hess, A., & Scheich, H. (2006) · Neuroscience · doi:10.1016/j.neuroscience.2006.08.035 · Cited by 280
Multisensory Integration: Flexible Use of General Operations
van Atteveldt, N., Murray, M. M., Thut, G., & Schroeder, C. E. (2014) · Neuron · doi:10.1016/j.neuron.2014.02.044 · Cited by 272
Mishra, J., Martinez, A., Sejnowski, T. J., & Hillyard, S. A. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.4912-06.2007 · Cited by 260
CLAVAGNIER, S., FALCHIER, A., & KENNEDY, H. (2004) · Cognitive, Affective, & Behavioral Neuroscience · doi:10.3758/cabn.4.2.117 · Cited by 253
Rapid discrimination of visual and multisensory memories revealed by electrical neuroimaging
Murray, M. M., Michel, C. M., Grave de Peralta, R., Ortigue, S., Brunet, D., Gonzalez Andino, S., & Schnider, A. (2004) · NeuroImage · doi:10.1016/j.neuroimage.2003.09.035 · Cited by 246
Sound Facilitates Visual Learning
Seitz, A. R., Kim, R., & Shams, L. (2006) · Current Biology · doi:10.1016/j.cub.2006.05.048 · Cited by 243
Brandwein, A. B., Foxe, J. J., Butler, J. S., Russo, N. N., Altschuler, T. S., Gomes, H., & Molholm, S. (2013) · Cerebral Cortex · doi:10.1093/cercor/bhs109 · Cited by 236
“We and others have observed a similar period of early-stage AV MSI in adults (e.g., Giard and Peronnet 1999; Molholm et al. 2002), but had not specifically designed the current study to be sensitive to such early modulation (see Molholm et al. 2002) and had failed to observe the same in our recent…”
MethodResultFunctional Imaging Reveals Visual Modulation of Specific Fields in Auditory Cortex
Kayser, C., Petkov, C. I., Augath, M., & Logothetis, N. K. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.4737-06.2007 · Cited by 240
Effects of Spatial Congruity on Audio-Visual Multimodal Integration
Teder-Sälejärvi, W. A., Russo, F. D., McDonald, J. J., & Hillyard, S. A. (2005) · Journal of Cognitive Neuroscience · doi:10.1162/0898929054985383 · Cited by 232
Crossmodal influences on visual perception
Shams, L., & Kim, R. (2010) · Physics of Life Reviews · doi:10.1016/j.plrev.2010.04.006 · Cited by 227
Semantics and the multisensory brain: How meaning modulates processes of audio-visual integration
Doehrmann, O., & Naumer, M. J. (2008) · Brain Research · doi:10.1016/j.brainres.2008.03.071 · Cited by 228
Molholm, S., Sehatpour, P., Mehta, A. D., Shpaner, M., Gomez-Ramirez, M., Ortigue, S., Dyke, J. P., Schwartz, T. H., & Foxe, J. J. (2006) · Journal of Neurophysiology · doi:10.1152/jn.00285.2006 · Cited by 228
Luo, H., Liu, Z., & Poeppel, D. (2010) · PLoS Biology · doi:10.1371/journal.pbio.1000445 · Cited by 234
Cappe, C., Morel, A., Barone, P., & Rouiller, E. M. (2009) · Cerebral Cortex · doi:10.1093/cercor/bhn228 · Cited by 225
Predictive coding and multisensory integration: an attentional account of the multisensory mind
Talsma, D. (2015) · Frontiers in Integrative Neuroscience · doi:10.3389/fnint.2015.00019 · Cited by 222
“…differ from that of the tones paired with unattended visual stimuli, around 200 ms after stimulus onset, as expressed by a difference in the ERP waveforms, suggesting that attentional processes in the visual modality strongly affected the processing of irrelevant stimuli in the auditory modality.”
BackgroundResultInfluentialAttention Strongly Modulates Reliability of Neural Responses to Naturalistic Narrative Stimuli
Ki, J. J., Kelly, S. P., & Parra, L. C. (2016) · The Journal of Neuroscience · doi:10.1523/jneurosci.2942-15.2016 · Cited by 221
Chen, Y.-C., & Spence, C. (2010) · Cognition · doi:10.1016/j.cognition.2009.10.012 · Cited by 221
Are We Ready for Real-world Neuroscience?
Matusz, P. J., Dikker, S., Huth, A. G., & Perrodin, C. (2019) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_e_01276 · Cited by 225
The multisensory function of the human primary visual cortex
Murray, M. M., Thelen, A., Thut, G., Romei, V., Martuzzi, R., & Matusz, P. J. (2016) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2015.08.011 · Cited by 219
“…at individual electrodes onsetting 40–55 ms and visible as a parieto-occipital positivity in the difference map at the scalp (Fort et al., 2002a; Giard and Peronnet, 1999; Molholm et al., 2002; Vidal et al., 2008; Senkowski et al., 2011; Stekelenburg and Vroomen, 2012; Cappe et al., 2012;…”
BackgroundTop-down effects on early visual processing in humans: A predictive coding framework
Rauss, K., Schwartz, S., & Pourtois, G. (2011) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2010.12.011 · Cited by 219
The hierarchically mechanistic mind: A free-energy formulation of the human psyche
Badcock, P. B., Friston, K. J., & Ramstead, M. J. D. (2019) · Physics of Life Reviews · doi:10.1016/j.plrev.2018.10.002 · Cited by 217
Visual dominance and attention: The Colavita effect revisited
Sinnett, S., Spence, C., & Soto-Faraco, S. (2007) · Perception & Psychophysics · doi:10.3758/bf03193770 · Cited by 209
Multisensory anatomical pathways
Cappe, C., Rouiller, E. M., & Barone, P. (2009) · Hearing Research · doi:10.1016/j.heares.2009.04.017 · Cited by 212
Senkowski, D., Saint-Amour, D., Höfle, M., & Foxe, J. J. (2011) · NeuroImage · doi:10.1016/j.neuroimage.2011.03.075 · Cited by 203
Werner, S., & Noppeney, U. (2010) · The Journal of Neuroscience · doi:10.1523/jneurosci.5091-09.2010 · Cited by 202
Intersensory Redundancy Guides Early Perceptual and Cognitive Development
Bahrick, L. E., & Lickliter, R. (2003) · Advances in Child Development and Behavior · doi:10.1016/s0065-2407(02)80041-6 · Cited by 197
The time-course of intermodal binding between seeing and hearing affective information
Pourtois, G., de Gelder, B., Vroomen, J., Rossion, B., & Crommelinck, M. (2000) · NeuroReport · doi:10.1097/00001756-200004270-00036 · Cited by 197
The role of multisensory memories in unisensory object discrimination
Lehmann, S., & Murray, M. M. (2005) · Cognitive Brain Research · doi:10.1016/j.cogbrainres.2005.02.005 · Cited by 195
Sound alters visual evoked potentials in humans
Shams, L., Kamitani, Y., Thompson, S., & Shimojo, S. (2001) · Neuroreport · doi:10.1097/00001756-200112040-00049 · Cited by 193
The shape of words in the brain
Kovic, V., Plunkett, K., & Westermann, G. (2010) · Cognition · doi:10.1016/j.cognition.2009.08.016 · Cited by 186
Brandwein, A. B., Foxe, J. J., Butler, J. S., Frey, H.-P., Bates, J. C., Shulman, L. H., & Molholm, S. (2015) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-014-2212-9 · Cited by 187
Laurienti, P. J., Perrault, T. J., Stanford, T. R., Wallace, M. T., & Stein, B. E. (2005) · Experimental Brain Research · doi:10.1007/s00221-005-2370-2 · Cited by 189
Senkowski, D., Talsma, D., Grigutsch, M., Herrmann, C. S., & Woldorff, M. G. (2007) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2006.01.013 · Cited by 193
The representation of space near the body through touch and vision
Macaluso, E., & Maravita, A. (2010) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2009.10.010 · Cited by 181
Russo, N., Foxe, J. J., Brandwein, A. B., Altschuler, T., Gomes, H., & Molholm, S. (2010) · Autism Research · doi:10.1002/aur.152 · Cited by 180
Fort, A. (2002) · Cerebral Cortex · doi:10.1093/cercor/12.10.1031 · Cited by 181
Schroeder, C. E., Smiley, J., Fu, K. G., McGinnis, T., O'Connell, M. N., & Hackett, T. A. (2003) · International Journal of Psychophysiology · doi:10.1016/s0167-8760(03)00120-x · Cited by 180
Early auditory–visual interactions in human cortex during nonredundant target identification
Fort, A., Delpuech, C., Pernier, J., & Giard, M.-H. (2002) · Cognitive Brain Research · doi:10.1016/s0926-6410(02)00058-7 · Cited by 176
Self-citationBrandwein, A. B., Foxe, J. J., Russo, N. N., Altschuler, T. S., Gomes, H., & Molholm, S. (2011) · Cerebral Cortex · doi:10.1093/cercor/bhq170 · Cited by 176
Klucharev, V., Möttönen, R., & Sams, M. (2003) · Cognitive Brain Research · doi:10.1016/j.cogbrainres.2003.09.004 · Cited by 174
The interactions of multisensory integration with endogenous and exogenous attention
Tang, X., Wu, J., & Shen, Y. (2016) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2015.11.002 · Cited by 168
Romei, V., Murray, M. M., Merabet, L. B., & Thut, G. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.2827-07.2007 · Cited by 171
Badcock, P. B., Friston, K. J., Ramstead, M. J. D., Ploeger, A., & Hohwy, J. (2019) · Cognitive, Affective, & Behavioral Neuroscience · doi:10.3758/s13415-019-00721-3 · Cited by 167
Multisensory integration in the basal ganglia
Nagy, A., Eördegh, G., Paróczy, Z., Márkus, Z., & Benedek, G. (2006) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2006.04942.x · Cited by 166
“…a neuron as multisensory either when it reacted to two or three different sensory modalities to a statistically significant extent, or when it reacted to only one sensory modality to a significant extent, but at least one of the ineffective modalities induced a multisensory cross–modal interaction.”
BackgroundMultisensory Processing in Sensory-Specific Cortical Areas
Macaluso, E. (2006) · The Neuroscientist · doi:10.1177/1073858406287908 · Cited by 166
Eccentricity dependent auditory enhancement of visual stimulus detection but not discrimination
Gleiss, S., & Kayser, C. (2013) · Frontiers in Integrative Neuroscience · doi:10.3389/fnint.2013.00052 · Cited by 164
Visual Localization Ability Influences Cross-Modal Bias
Hairston, W. D., Wallace, M. T., Vaughan, J. W., Stein, B. E., Norris, J. L., & Schirillo, J. A. (2003) · Journal of Cognitive Neuroscience · doi:10.1162/089892903321107792 · Cited by 164
Metadata
- Authors
- Giard, M. H., & Peronnet, F.
- Affiliations
- Inserm (FR)
- Venue
- Journal of Cognitive Neuroscience
- Publisher
- MIT Press - Journals
- Published
- 1999-09-01
- Volume
- 11
- Issue
- 5
- Pages
- 473-490
- ISSN
- 0898-929X (ISSN-L)
- 1530-8898
- OpenAlex
- W2040510368
- Cited by
- 1,072
- References
- 88
- Citations by year
- 2026: 17 · 2025: 25 · 2024: 29 · 2023: 31 · 2022: 40 · 2021: 51 · 2020: 45 · 2019: 38 · 2018: 47 · 2017: 36 · 2016: 38 · 2015: 53 · 2014: 49 · 2013: 58 · 2012: 58
- FWCI
- 20.08
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Journal of Cognitive Neuroscience (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Multisensory perception and integration
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neuroscience and Music Perception
- Life Sciences › Neuroscience › Cognitive Neuroscience › Tactile and Sensory Interactions
- Keywords
- audiovisual integration, multisensory integration, object recognition, multimodal feature integration, event-related potentials, auditory N1, early sensory processing
- MeSH terms
- Acoustic Stimulation, Adaptation, Physiological, Adult, Auditory Cortex, Auditory Perception, Brain Mapping, Cognition, Electroencephalography, Electrophysiology, Evoked Potentials, Auditory, Evoked Potentials, Visual, Female, Frontal Lobe, Humans, Male, Pattern Recognition, Visual, Photic Stimulation, Reaction Time, Visual Cortex, Visual Perception
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.