Auditory-Visual Integration during Multimodal Object Recognition in Humans: A Behavioral and Electrophysiological Study
The DOI matches its Crossref record; 87 of the 88 references it cites were found in a registry or an index.
Abstract
The aim of this study was (1) to provide behavioral evidence for multimodal feature integration in an object recognition task in humans and (2) to characterize the processing stages and the neural structures where multisensory interactions take place. Event-related potentials (ERPs) were recorded from 30 scalp electrodes while subjects performed a forced-choice reaction-time categorization task: At each trial, the subjects had to indicate which of two objects was presented by pressing one of two keys. The two objects were defined by auditory features alone, visual features alone, or the combination of auditory and visual features. Subjects were more accurate and rapid at identifying multimodal than unimodal objects. Spatiotemporal analysis of ERPs and scalp current densities revealed several auditory-visual interaction components temporally, spatially, and functionally distinct before 200 msec poststimulus. The effects observed were (1) in visual areas, new neural activities (as early as 40 msec poststimulus) and modulation (amplitude decrease) of the N185 wave to unimodal visual stimulus, (2) in the auditory cortex, modulation (amplitude increase) of subcomponents of the unimodal auditory N1 wave around 90 to 110 msec, and (3) new neural activity over the right fronto-temporal area (140 to 165 msec). Furthermore, when the subjects were separated into two groups according to their dominant modality to perform the task in unimodal conditions (shortest reaction time criteria), the integration effects were found to be similar for the two groups over the nonspecific fronto-temporal areas, but they clearly differed in the sensory-specific cortices, affecting predominantly the sensory areas of the nondominant modality. Taken together, the results indicate that multisensory integration is mediated by flexible, highly adaptive physiological processes that can take place very early in the sensory processing chain and operate in both sensory-specific and nonspecific cortical structures in different ways.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Multimodal stimuli are typically perceived more precisely and faster than unimodal stimuli (Doyle & Snowden, 2001;Forster, Cavina-Pratesi, Aglioti, & Berlucchi, 2002;Fort, Delpuech, Pernier, & Giard, 2002;G i a r d&P e r o n n e t , 1999).”
From Augmented visual, auditory, haptic, and multimodal feedback in motor learning: A review (2013) · cites this paper as Giard & Peronnet, 1999
Citations
Cites
Hearing lips and seeing voices
MCGURK, H., & MACDONALD, J. (1976) · Nature · doi:10.1038/264746a0 · Cited by 6,183
Ungerleider, L. G. (1982) · Medical Entomology and Zoology · Cited by 4,531
Speed of processing in the human visual system
Thorpe, S., Fize, D., & Marlot, C. (1996) · Nature · doi:10.1038/381520a0 · Cited by 3,538
Visual Feature Integration and the Temporal Correlation Hypothesis
Singer, W., & Gray, C. M. (1995) · Annual Review of Neuroscience · doi:10.1146/annurev.ne.18.030195.003011 · Cited by 3,123
Spherical splines for scalp potential and current density mapping
Perrin, F., Pernier, J., Bertrand, O., & Echallier, J. F. (1989) · Electroencephalography and Clinical Neurophysiology · doi:10.1016/0013-4694(89)90180-6 · Cited by 2,706 · cited 1×
“SCDs were estimated by computing the second derivative of the interpolated potential distributions ( Perrin, Pernier, Bertrand, & Echallier, 1989 ).”
MethodSociety for Neuroscience 2007 abstracts
Wishart, T. M., Paterson, J. M., Short, D. M., Meredith, S., Robertson, K., Sutherland, C. D., Cousin, M. A., Dutia, M. B., & Gillingwater, T. H. (2007) · Cited by 2,094
(1994) · Choice Reviews Online · doi:10.5860/choice.31-4365 · Cited by 1,882
AN ANATOMICAL STUDY OF CONVERGING SENSORY PATHWAYS WITHIN THE CEREBRAL CORTEX OF THE MONKEY
JONES, E. G., & POWELL, T. P. S. (1970) · Brain · doi:10.1093/brain/93.4.793 · Cited by 1,711
Journal of the Washington Academy of Sciences.
(1918) · The Journal of Geology · doi:10.1086/622567 · Cited by 1,707
Logothetis, N. K., & Sheinberg, D. L. (1996) · Annual Review of Neuroscience · doi:10.1146/annurev.ne.19.030196.003045 · Cited by 1,351
Research works printed but not linked: 6
- Bernstein I. H., 1970, Acta Physiologica Academiae Scientarum Hungaricae, 33, 21
- Costin D., 1991, Society for Neuroscience Abstracts, 17, 656
- Fisher B. D., 1994, Cahiers de Psychologie Cognitive, 13, 92
- 10.1037/0096-1523.20.1.131 · doi:10.1037/0096-1523.20.1.131 · Paper page
- 10.1037/0033-295X.83.2.157 · doi:10.1037/0033-295x.83.2.157 · Paper page
- Schroeder C. E., 1995, Society for Neuroscience Abstracts, 21, 694
Cited by
Items 701–800 of 1,000
Transmitting Human Presence Through Portable Teleoperated Androids: A Minimal Design Approach
Ishiguro, H. (2016) · Springer eBooks · doi:10.1007/978-4-431-55867-5_2 · Cited by 9
Behavioral and Neural Foundations of Multisensory Face-Voice Perception in Infancy
Hyde, D. C., Flom, R. A., & Porter, C. L. (2016) · Developmental Neuropsychology · doi:10.1080/87565641.2016.1255744 · Cited by 9
Assessing the efficacy of tablet-based simulations for learning pseudo-surgical instrumentation
Kryklywy, J. H., Roach, V. A., & Todd, R. M. (2021) · PLoS ONE · doi:10.1371/journal.pone.0245330 · Cited by 9
Hand preference for the visual and auditory modalities in humans
Yang, Y., Weiss, P. H., Fink, G. R., & Chen, Q. (2021) · Scientific Reports · doi:10.1038/s41598-021-87396-4 · Cited by 8
Electrophysiology of auditory-visual speech integration.
van Wassenhove, V., Grant, K. W., & Poeppel, D. (2003) · AVSP · Cited by 8
Children and adults' understanding and use of sound-symbolism in novel words
Kantartzis, K. (2011) · University of Birmingham Institutional Research Archive (University of Birmingham) · Cited by 12
Distinct audio and visual accumulators co-activate motor preparation for multisensory detection
Egan, J. M., Gomez‐Ramirez, M., Foxe, J. J., O’Connell, R. G., & Kelly, S. P. (2025) · Nature Human Behaviour · doi:10.1038/s41562-025-02280-9 · Cited by 10
Multisensory Role of Human Auditory Cortex
van Wassenhove, V., & Schroeder, C. E. (2012) · Springer handbook of auditory research · doi:10.1007/978-1-4614-2314-0_11 · Cited by 8
Ju, Y. (2018) · Journal of Physical Therapy Science · doi:10.1589/jpts.30.92 · Cited by 7
Li, J., Hua, L., & Deng, S. W. (2024) · Frontiers in Psychology · doi:10.3389/fpsyg.2024.1380196 · Cited by 11
Theoretical Implications on Visual (Color) Representation and Cytochrome Oxidase Blobs
Bókkon, I., & Vimal, R. L. P. (2013) · Activitas Nervosa Superior · doi:10.1007/bf03379594 · Cited by 7
Meyerhoff, H. S., & Gehrer, N. A. (2017) · PLoS ONE · doi:10.1371/journal.pone.0183723 · Cited by 7
See what you hear – How the brain forms representations across the senses
Noppeney, U., Jones, S. A., Rohe, T., & Ferrari, A. (2018) · e-Neuroforum · doi:10.1515/nf-2017-a066 · Cited by 9
Neural correlates of subjective timing precision and confidence
Arnold, D. H., Hohaia, W., & Yarrow, K. (2020) · Scientific Reports · doi:10.1038/s41598-020-59322-7 · Cited by 7
Li, Q., Wu, Q., Yu, Y., Wu, F., Takahashi, S., Ejima, Y., Yang, J., & Wu, J. (2020) · i-Perception · doi:10.1177/2041669520981096 · Cited by 9
Visual consequent stimulus complexity affects performance in audiovisual associative learning
Tót, K., Eördegh, G., Kiss, Á., Kelemen, A., Braunitzer, G., Kéri, S., Bodosi, B., & Nagy, A. (2022) · Scientific Reports · doi:10.1038/s41598-022-22880-z · Cited by 9
Fiorini, L., Russo, F. D., Lucia, S., & Bianco, V. (2022) · Cortex · doi:10.1016/j.cortex.2022.12.008 · Cited by 7
EVENT-RELATED POTENTIALS TO VISUAL, AUDITORY, AND BIMODAL (COMBINED AUDITORY-VISUAL) STIMULI
İşoĝlu-Alkaç, Ü., Kedzior, K. K., Keskindemirci, G., Ermutlu, N., & Karamürsel, S. (2007) · International Journal of Neuroscience · doi:10.1080/00207450500534118 · Cited by 7
Temporal Sequence of Visuo-Auditory Interaction in Multiple Areas of the Guinea Pig Visual Cortex
Nishimura, M., & Song, W. (2012) · PLoS ONE · doi:10.1371/journal.pone.0046339 · Cited by 10
I can see what you are saying: Auditory labels reduce visual search times
Cho, K. W. (2016) · Acta Psychologica · doi:10.1016/j.actpsy.2016.06.003 · Cited by 7
Spatiotemporal brain dynamics underlying attentional bias modifications
Sallard, E., Hartmann, L., Ptak, R., & Spierer, L. (2018) · International Journal of Psychophysiology · doi:10.1016/j.ijpsycho.2018.06.001 · Cited by 8
Bednaya, E., Pavani, F., Ricciardi, E., Pietrini, P., & Bottari, D. (2021) · Cortex · doi:10.1016/j.cortex.2021.05.017 · Cited by 11
Budd, T. W., & Timora, J. R. (2013) · International Journal of Psychophysiology · doi:10.1016/j.ijpsycho.2013.06.001 · Cited by 11
Auditory features modelling reveals sound envelope representation in striate cortexPreprint
Martinelli, A., Handjaras, G., Betta, M., Leo, A., Cecchetti, L., Pietrini, P., Ricciardi, E., & Bottari, D. (2020) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2020.04.15.043174 · Cited by 10
Buhmann, Z., Robinson, A. K., Mattingley, J. B., & Rideaux, R. (2026) · eLife · doi:10.7554/elife.97230.3 · Cited by 11
Yang, W., Li, S., Li, Z., Ao, G. U. O., & Ren, Y. (2020) · Advances in Psychological Science · doi:10.3724/sp.j.1042.2020.00790 · Cited by 6
Auditory sEMG biofeedback for reducing muscle co‐contraction during pedaling
Kibushi, B., & Okada, J. (2022) · Physiological Reports · doi:10.14814/phy2.15288 · Cited by 6
No selective integration required: A race model explains responses to audiovisual motion-in-depth
Chua, S. F. A., Liu, Y., Harris, J. M., & Otto, T. U. (2022) · Cognition · doi:10.1016/j.cognition.2022.105204 · Cited by 8
Alterations of Audiovisual Integration in Alzheimer’s Disease
Liu, Y., Wang, Z., Wei, T., Zhou, S., Yin, Y., Mi, Y., Liu, X., & Tang, Y. (2023) · Neuroscience Bulletin · doi:10.1007/s12264-023-01125-7 · Cited by 8
Alwashmi, K., Rowe, F. J., & Meyer, G. F. (2024) · NeuroImage · doi:10.1016/j.neuroimage.2024.120983 · Cited by 6
The temporal reliability of sound modulates visual detection: An event-related potential study
Li, Q., Wu, Y. X., Yang, J., Wu, J., & Touge, T. (2014) · Neuroscience Letters · doi:10.1016/j.neulet.2014.10.030 · Cited by 8
Multisensory Information Facilitates the Categorization of Untrained Stimuli
Wu, J., Li, Q., Fu, Q., Rose, M., & Jing, L. (2021) · Multisensory Research · doi:10.1163/22134808-bja10061 · Cited by 8
Multisensory interactions on auditory and somatosensory information in expert pianists
Hirano, M., & Furuya, S. (2022) · Scientific Reports · doi:10.1038/s41598-022-16618-0 · Cited by 7
Rey, A. E., Roche, K., Versace, R., & Chainay, H. (2015) · Frontiers in Psychology · doi:10.3389/fpsyg.2015.01031 · Cited by 7
Ard, T. D., Carver, F. W., Holroyd, T., Horwitz, B., & Coppola, R. (2015) · Brain Connectivity · doi:10.1089/brain.2014.0296 · Cited by 6
Neural mechanisms for the effect of prior knowledge on audiovisual integration
Liu, Q., Zhang, Y., Campos, J. L., Zhang, Q., & Sun, H. (2011) · Biological Psychology · doi:10.1016/j.biopsycho.2011.02.006 · Cited by 8
Getzmann, S., & Lewald, J. (2014) · Journal of Psychophysiology · doi:10.1027/0269-8803/a000113 · Cited by 7
Multisensory Integration Reveals Temporal Coding across a Human Sensorimotor Network
Moore, B. D., Bartoli, E., Karunakaran, S., & Kim, K. (2015) · Journal of Neuroscience · doi:10.1523/jneurosci.2922-15.2015 · Cited by 6
Effect of face masks on speech perception in noise of individuals with hearing aids
Choi, J. H., Choi, H. J., Kim, D. H., Park, J. H., An, Y., & Shim, H. J. (2022) · Frontiers in Neuroscience · doi:10.3389/fnins.2022.1036767 · Cited by 6
Impact of Blur on Suprathreshold Scaling of Ocular Discomfort
Rao, S. B. S., & SIMPSON, T. L. (2015) · Investigative Ophthalmology & Visual Science · doi:10.1167/iovs.14-14931 · Cited by 7
Tae, W. (2015) · Investigative Magnetic Resonance Imaging · doi:10.13104/imri.2015.19.1.10 · Cited by 6
Impact of Audio-Visual Asynchrony on Lip-Reading Effects -Neuromagnetic and Psychophysical Study-
Kawase, T., Yahata, I., Kanno, A., Sakamoto, S., Takanashi, Y., Takata, S., Nakasato, N., Kawashima, R., & Katori, Y. (2016) · PLoS ONE · doi:10.1371/journal.pone.0168740 · Cited by 8
Binocular interactions in the guinea pig's visual-evoked potentials
Ateş, K., Demirtaş, S., & Göksoy, C. (2006) · Brain Research · doi:10.1016/j.brainres.2006.10.016 · Cited by 6
Response to Small: Crossmodal integration – insights from the chemical senses
Gottfried, J. A., & Dolan, R. J. (2004) · Trends in Neurosciences · doi:10.1016/j.tins.2004.01.003 · Cited by 8
Bernstein, L. E., Takayanagi, S., & Auer, E. T. (2003) · AVSP · Cited by 6
NEURAL INTEGRATION OF MULTIMODAL EVENTS
Vettel, J. M. (2009) · ProQuest Demo Repository · doi:10.7301/z0vq30zr · Cited by 9
Are auditory cues special? Evidence from cross-modal distractor-induced blindness
Kern, L., & Niedeggen, M. (2022) · Attention Perception & Psychophysics · doi:10.3758/s13414-022-02540-0 · Cited by 5
Zhao, S., Wang, C., Chen, M., Zhai, M., Leng, X., Zhao, F., Feng, C., & Feng, W. (2023) · Attention Perception & Psychophysics · doi:10.3758/s13414-023-02739-9 · Cited by 6
Wan, X., Luo, X., Su, P., Zhang, Y., & Wang, R. (2024) · Journal of Management in Engineering · doi:10.1061/jmenea.meeng-5647 · Cited by 5
Attentional demands in the visual field modulate audiovisual interactions in the temporal domain
Yilmaz, S. K., & Kafalıgönül, H. (2024) · Human Brain Mapping · doi:10.1002/hbm.70009 · Cited by 5
Laminar organization of visual responses in core and parabelt auditory cortex
Mackey, C. A., O’Connell, M. N., Hackett, T. A., Schroeder, C. E., & Kajikawa, Y. (2024) · Cerebral Cortex · doi:10.1093/cercor/bhae373 · Cited by 5
Li, X., Yang, Y., & Ren, G. (2009) · Neuroscience · doi:10.1016/j.neuroscience.2009.01.070 · Cited by 5
A satisficing and bricoleur approach to sensorimotor cognition
Vilarroya, Ó. (2012) · Biosystems · doi:10.1016/j.biosystems.2012.09.007 · Cited by 6
Proctor, B. J., & Meyer, G. F. (2011) · Experimental Brain Research · doi:10.1007/s00221-011-2724-x · Cited by 5
3D Time-Based Aural Data Representation Using D4 Library’s Layer Based Amplitude Panning Algorithm
Bukvic, I. I. (2016) · International Conference on Auditory Display (ICAD) · doi:10.21785/icad2016.010 · Cited by 8
Libesman, S., Mannion, D. J., & Whitford, T. J. (2019) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_01486 · Cited by 9
Causally linking neural dominance to perceptual dominance in a multisensory conflict
Yun, K., Bhattacharya, J., Sandkühler, S., Lin, Y.-J., Iwaki, S., & Shimojo, S. (2020) · Neuroreport · doi:10.1097/wnr.0000000000001505 · Cited by 5
Baker, J. M., Gillam, R. B., & Jordan, K. E. (2020) · Brain and Cognition · doi:10.1016/j.bandc.2020.105601 · Cited by 5
Menashe, S. (2020) · Dyslexia · doi:10.1002/dys.1674 · Cited by 6
Vaina, L. M., Calabro, F. J., Samal, A., Rana, K. D., Mamashli, F., Khan, S., Hämäläinen, M., Ahlfors, S. P., & Ahveninen, J. (2021) · Brain Research · doi:10.1016/j.brainres.2021.147489 · Cited by 5
In search of rules behind environmental framing; the case of head pitch
Wilson, G. I., Norman, B. M., Walker, J., Williams, H. J., Holton, M. D., Clarke, D., & Wilson, R. P. (2015) · Movement Ecology · doi:10.1186/s40462-015-0051-8 · Cited by 6
Joassin, F., Meert, G., Campanella, S., & Bruyer, R. (2007) · Biological Psychology · doi:10.1016/j.biopsycho.2007.04.002 · Cited by 6
Attenuated audiovisual integration in middle-aged adults in a discrimination task
Yang, W., & Ren, Y. (2017) · Cognitive Processing · doi:10.1007/s10339-017-0838-1 · Cited by 5
Motor (but not auditory) attention affects syntactic choice
Юрьевич, П. М., Scheepers, C., Юрьевич, Ш. Ю., & Myachykov, A. (2018) · PLoS ONE · doi:10.1371/journal.pone.0195547 · Cited by 6
Multisensory Integration Strategy for Modality-Specific Loss of Inhibition Control in Older Adults
Lee, A., Ryu, H. B., Kim, J., & Jeong, E. (2018) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph15040718 · Cited by 5
Wong, A. C. ‐., Ng, T., Lui, K. F. H., Yip, H. M. K., & Wong, Y. K. (2019) · Journal of Vision · doi:10.1167/19.7.8 · Cited by 5
Now, never, or coming soon? Prediction and efficient language processing
Rappe, S. (2019) · Pragmatics & Cognition · doi:10.1075/pc.19001.rap · Cited by 5
Evaluation of multisensory stimuli—Dimensions of meaning and electrical brain activity
Hiessl, A. K., & Skrandies, W. (2013) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2013.03.030 · Cited by 6
Audiovisual Integration in Nonhuman Primates: A Window into the Anatomy and Physiology of Cognition
Kajikawa, Y., Falchier, A., Musacchia, G., Lakatos, P., & Schroeder, C. E. (2011) · Frontiers in neuroscience · doi:10.1201/9781439812174-8 · Cited by 6
Li, Q., Yu, H., Wu, Y. X., & Gao, N. (2016) · Neuroscience Letters · doi:10.1016/j.neulet.2016.07.003 · Cited by 5
Visual adaptation enhances action sound discrimination
Barraclough, N. E., Page, S. A., & Keefe, B. D. (2016) · Attention Perception & Psychophysics · doi:10.3758/s13414-016-1199-z · Cited by 5
Yang, X. Q., Chen, Y., Lan, Z., & Wang, W. (2023) · Perception · doi:10.1177/03010066231208539 · Cited by 4
Visual modulation of auditory evoked potentials in the cat
Bao, X., & Lomber, S. G. (2024) · Scientific Reports · doi:10.1038/s41598-024-57075-1 · Cited by 4
Electroencephalography Decoding with Conditional Identification Generator
Sun, P., Winne, J. D., Zhang, M., Devos, P., & Botteldooren, D. B. (2025) · International Journal of Neural Systems · doi:10.1142/s0129065725500248 · Cited by 6
Audiovisual integration facilitates age-related perceptual decision making
Yang, X., Yang, W., Li, R., Lin, J., Yang, J., & Ren, Y. (2025) · The Journals of Gerontology Series B · doi:10.1093/geronb/gbaf037 · Cited by 7
The haptic and the visual flash-lag effect and the role of flash characteristics
Drewing, K., Hitzel, E., & Scocchia, L. (2018) · PLoS ONE · doi:10.1371/journal.pone.0189291 · Cited by 4
Kwak, Y., Nam, H., Kim, H.-W., & Kim, C.-Y. (2020) · Multisensory Research · doi:10.1163/22134808-20191330 · Cited by 5
Tones slow down visuomotor responses in a visual-spatial task
Robinson, C. W., & Parker, J. L. (2021) · Acta Psychologica · doi:10.1016/j.actpsy.2021.103336 · Cited by 5
The impact of temporal and spatial consistency of audiovisual stimuli on Pip-and-Pop effect
Xiaoyu, T., Xinzhong, C., Min, G., & Mengying, Y. (2022) · Acta Psychologica Sinica · doi:10.3724/sp.j.1041.2022.01310 · Cited by 4
Cross-modality modulation of auditory midbrain processing of intensity information
Cheng, L., Guo, Z., & Qu, Y.-L. (2020) · Hearing Research · doi:10.1016/j.heares.2020.108042 · Cited by 4
Enhancing performance with multisensory cues in a realistic target discrimination task
Cinel, C., Fernández-Vargas, J., Tremmel, C., Citi, L., & Poli, R. (2022) · PLoS ONE · doi:10.1371/journal.pone.0272320 · Cited by 8
Human Auditory Processing: Insights from Cortical Event-related Potentials
Key, A. P. F. (2016) · AIMS neuroscience · doi:10.3934/neuroscience.2016.2.141 · Cited by 7
Neuroscientific evidence for multisensory convergence and interaction
Tanaka, E., Kida, T., Kakigi, R., & Hoshiyama, M. (2017) · The Journal of Physical Fitness and Sports Medicine · doi:10.7600/jpfsm.6.301 · Cited by 4
Assessing visual modulation along the human subcortical auditory pathway
Caron-Desrochers, L., Schönwiesner, M., Focke, K., & Lehmann, A. (2018) · Neuroscience Letters · doi:10.1016/j.neulet.2018.07.020 · Cited by 6
Attention-Sharing Initiative of Multimodal Processing in Simultaneous Interpreting
Li, T., & Fan, B. (2020) · International Journal of Translation Interpretation and Applied Linguistics · doi:10.4018/ijtial.20200701.oa4 · Cited by 6
Inhibition of Return Decreases Early Audiovisual Integration: An Event-Related Potential Study
Peng, X., Tang, X., Jiang, H., Wang, A., Ming, Z., & Chang, R. (2021) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2021.712958 · Cited by 4
Musical training reduces the Colavita visual effect
Wang, L., Tang, X., Wang, A., & Zhang, M. (2022) · Psychology of Music · doi:10.1177/03057356221108763 · Cited by 4
Audiovisual congruency and incongruency effects on auditory intensity discrimination
Guo, X., Li, X., Ge, X., & Tong, S. (2014) · Neuroscience Letters · doi:10.1016/j.neulet.2014.10.043 · Cited by 4
Ferrier, L. P., Streff, A., Martin, S., Brouillet, D., Barkat-Defradas, M., & Jimenez, M. (2009) · L’Année psychologique · doi:10.4074/s0003503309003017 · Cited by 9
Effect of stimulus intensity on response time distribution in multisensory integration
Török, Á., Kolozsvári, O., Virágh, T., Honbolygó, F., & Csépe, V. (2013) · Journal on Multimodal User Interfaces · doi:10.1007/s12193-013-0135-y · Cited by 5
Integration of warning signals and signaled objects to a multimodal object: A pilot study
Török, Á., Toth, Z., Honbolygó, F., & Csépe, V. (2013) · IEEE International Conference on Cognitive Infocommunications · doi:10.1109/coginfocom.2013.6719183 · Cited by 4
Listen to Your Heart: Examining Modality Dominance Using Cross-Modal Oddball Tasks
Robinson, C. W., Chadwick, K. R., Parker, J. L., & Sinnett, S. (2020) · Frontiers in Psychology · doi:10.3389/fpsyg.2020.01643 · Cited by 4
Neurocognitive mechanisms of audiovisual speech perception
Ojanen, V. (2005) · Aaltodoc (Aalto University) · Cited by 10
Neural Correlates of Multisensory Integration of Ecologically Valid Audiovisual Events
Vroomen, J., & Stekelenburg, J. J. (2007) · PsycEXTRA Dataset · doi:10.1037/e527342012-225 · Cited by 4
M3D-GAN: Multi-Modal Multi-Domain Translation with Universal AttentionPreprint
Ma, S., McDuff, D., & Song, Y. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1907.04378 · Cited by 4
The development of attentional control mechanisms in multisensory environmentsPreprint
Turoman, N., Tivadar, R. I., Retsa, C., Maillard, A. M., Scerif, G., & Matusz, P. J. (2020) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2020.06.23.166975 · Cited by 4
Buhmann, Z., Robinson, A. K., Mattingley, J. B., & Rideaux, R. (2024) · eLife · doi:10.7554/elife.97230.1 · Cited by 5
Taffou, M. (2014) · theses.fr (ABES) · doi:10.70675/fa00368fz6279z418ez8f0az76c3b4493c9d · Cited by 6
Temporal Window of Integration XOR Temporal Window of Synchrony
Jertberg, R., Soto‐Faraco, S., van Wassenhove, V., & der Burg, E. V. (2025) · Multisensory Research · doi:10.1163/22134808-bja10171 · Cited by 5
The Effects of Bilateral and Ipsilateral Auditory Stimuli on the Subcomponents of Visual Attention
Fu, J., Guo, X., Tang, X., Wang, A., Zhang, M., Gao, Y., & Seno, T. (2021) · i-Perception · doi:10.1177/20416695211058222 · Cited by 5
Metadata
- Authors
- Giard, M. H., & Peronnet, F.
- Affiliations
- Inserm (FR)
- Venue
- Journal of Cognitive Neuroscience
- Publisher
- MIT Press - Journals
- Published
- 1999-09-01
- Volume
- 11
- Issue
- 5
- Pages
- 473-490
- ISSN
- 0898-929X (ISSN-L)
- 1530-8898
- OpenAlex
- W2040510368
- Cited by
- 1,072
- References
- 88
- Citations by year
- 2026: 17 · 2025: 25 · 2024: 29 · 2023: 31 · 2022: 40 · 2021: 51 · 2020: 45 · 2019: 38 · 2018: 47 · 2017: 36 · 2016: 38 · 2015: 53 · 2014: 49 · 2013: 58 · 2012: 58
- FWCI
- 20.08
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Journal of Cognitive Neuroscience (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Multisensory perception and integration
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neuroscience and Music Perception
- Life Sciences › Neuroscience › Cognitive Neuroscience › Tactile and Sensory Interactions
- Keywords
- audiovisual integration, multisensory integration, object recognition, multimodal feature integration, event-related potentials, auditory N1, early sensory processing
- MeSH terms
- Acoustic Stimulation, Adaptation, Physiological, Adult, Auditory Cortex, Auditory Perception, Brain Mapping, Cognition, Electroencephalography, Electrophysiology, Evoked Potentials, Auditory, Evoked Potentials, Visual, Female, Frontal Lobe, Humans, Male, Pattern Recognition, Visual, Photic Stimulation, Reaction Time, Visual Cortex, Visual Perception
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.