The DOI matches its Crossref record; 54 of the 56 references it cites were found in a registry or an index.
Selective Attention and Audiovisual Integration: Is Attending to Both Modalities a Prerequisite for Early Integration?
Open accessAbstract
Interactions between multisensory integration and attention were studied using a combined audiovisual streaming design and a rapid serial visual presentation paradigm. Event-related potentials (ERPs) following audiovisual objects (AV) were compared with the sum of the ERPs following auditory (A) and visual objects (V). Integration processes were expressed as the difference between these AV and (A + V) responses and were studied while attention was directed to one or both modalities or directed elsewhere. Results show that multisensory integration effects depend on the multisensory objects being fully attended--that is, when both the visual and auditory senses were attended. In this condition, a superadditive audiovisual integration effect was observed on the P50 component. When unattended, this effect was reversed; the P50 components of multisensory ERPs were smaller than the unisensory sum. Additionally, we found an enhanced late frontal negativity when subjects attended the visual component of a multisensory object. This effect, bearing a strong resemblance to the auditory processing negativity, appeared to reflect late attention-related processing that had spread to encompass the auditory component of the multisensory object. In conclusion, our results shed new light on how the brain processes multisensory auditory and visual information, including how attention modulates multisensory integration processes.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Previous work showed that the facilitation effects of the multisensory integration on attentional capture, that is the facilitation in the detection of target stimuli, seem to partially rely on the stimuli to be attended7.”
From The impact of multisensory integration and perceptual load in virtual reality settings on performance, workload and presence (2021) · cites this paper as [7]
In the citing paper
“Our result is consistent with previous studies reporting that a condition with the absence of sound elicits a lower sense of presence (e.g.,7,88,89).”
From The impact of multisensory integration and perceptual load in virtual reality settings on performance, workload and presence (2021) · cites this paper as [7]
Citations
Cites
Hearing lips and seeing voices
MCGURK, H., & MACDONALD, J. (1976) · Nature · doi:10.1038/264746a0 · Cited by 6,183
Näätänen, R., & Picton, T. (1987) · Psychophysiology · doi:10.1111/j.1469-8986.1987.tb00311.x · Cited by 3,321
(1994) · Choice Reviews Online · doi:10.5860/choice.31-4365 · Cited by 1,897
McCarthy, G., & Wood, C. C. (1985) · Electroencephalography and Clinical Neurophysiology/Evoked Potentials Section · doi:10.1016/0168-5597(85)90015-2 · Cited by 1,765
Hillyard, S. A., Vogel, E. K., & Luck, S. J. (1998) · Philosophical Transactions of the Royal Society of London. Series B: Biological Sciences · doi:10.1098/rstb.1998.0281 · Cited by 1,201
Giard, M. H., & Peronnet, F. (1999) · Journal of Cognitive Neuroscience · doi:10.1162/089892999563544 · Cited by 1,072
Motter, B. C. (1993) · Journal of Neurophysiology · doi:10.1152/jn.1993.70.3.909 · Cited by 1,055
Molholm, S., Ritter, W., Murray, M. M., Javitt, D., Schroeder, C., & Foxe, J. J. (2002) · Brain research. Cognitive brain research · doi:10.1016/s0926-6410(02)00066-6 · Cited by 980
Calvert, G. A., Campbell, R., & Brammer, M. J. (2000) · Current Biology · doi:10.1016/s0960-9822(00)00513-3 · Cited by 954
Event-related potentials : a methods handbook
Handy, T. C. (2005) · Medical Entomology and Zoology · Cited by 753
Visual illusion induced by sound
Shams, L. B., Kamitani, Y., & Shimojo, S. (2002) · Cognitive Brain Research · doi:10.1016/s0926-6410(02)00069-1 · Cited by 678
Modulation of early sensory processing in human auditory cortex during auditory selective attention.
Woldorff, M. G., Gallen, C. C., Hampson, S. R., Hillyard, S. A., Pantev, C., Sobel, D. F., & Bloom, F. E. (1993) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.90.18.8722 · Cited by 645
Self-citationHandbook of Cognitive Neuroscience
Gazzaniga, M. S. (1984) · Springer eBooks · doi:10.1007/978-1-4899-2177-2 · Cited by 460
van der Heijden, A. H. C. (2003) · Routledge eBooks · doi:10.4324/9780203359341 · Cited by 440
Talsma, D., & Woldorff, M. G. (2005) · Journal of Cognitive Neuroscience · doi:10.1162/0898929054475172 · Cited by 440
Self-citationEnhancement of Perceived Visual Intensity by Auditory Stimuli: A Psychophysical Analysis
Stein, B. E., London, N., Wilkinson, L. K., & Price, D. D. (1996) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.1996.8.6.497 · Cited by 426
Foxe, J. J., Mórocz, I. Á., Murray, M. M., Higgins, B. A., Javitt, D. C., & Schroeder, C. E. (2000) · Cognitive Brain Research · doi:10.1016/s0926-6410(00)00024-0 · Cited by 391
Distortion of ERP averages due to overlap from temporally adjacent ERPs: Analysis and correction
Woldorff, M. G. (1993) · Psychophysiology · doi:10.1111/j.1469-8986.1993.tb03209.x · Cited by 391
Self-citationDeactivation of Sensory-Specific Cortex by Cross-Modal Stimuli
Laurienti, P. J., Burdette, J. H., Wallace, M. T., Yen, Y., Field, A. S., & Stein, B. E. (2002) · Journal of Cognitive Neuroscience · doi:10.1162/089892902317361930 · Cited by 380
The Effects of Channel‐Selective Attention on the Mismatch Negativity Wave Elicited by Deviant Tones
Woldorff, M. G., Hackley, S. A., & Hillyard, S. A. (1991) · Psychophysiology · doi:10.1111/j.1469-8986.1991.tb03384.x · Cited by 377
Self-citationEnhancement of selective listening by illusory mislocation of speech sounds due to lip-reading
Driver, J. (1996) · Nature · doi:10.1038/381066a0 · Cited by 315
The spread of attention across modalities and space in a multisensory object
Busse, L., Roberts, K., Crist, R. E., Weissman, D. H., & Woldorff, M. G. (2005) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0507704102 · Cited by 289
Self-citationDevelopment of Multisensory Neurons and Multisensory Integration in Cat Superior Colliculus
Wallace, M. T., & Stein, B. E. (1997) · Journal of Neuroscience · doi:10.1523/jneurosci.17-07-02429.1997 · Cited by 267
The ventriloquist effect does not depend on the direction of deliberate visual attention
Bertelson, P., Vroomen, J., de Gelder, B., & Driver, J. (2000) · Perception & Psychophysics · doi:10.3758/bf03205552 · Cited by 262
Reflexive Attention Modulates Processing of Visual Stimuli in Human Extrastriate Cortex
Hopfinger, J. B., & Mangun, G. R. (1998) · Psychological Science · doi:10.1111/1467-9280.00083 · Cited by 253
Integration of multiple sensory modalities in cat cortex
Wallace, M. T., Meredith, M. A., & Stein, B. E. (1992) · Experimental Brain Research · doi:10.1007/bf00227844 · Cited by 239
Auditory distraction: event-related potential and behavioral indices
Schröger, E., Giard, M. H., & Wolff, C. (2000) · Clinical Neurophysiology · doi:10.1016/s1388-2457(00)00337-0 · Cited by 235
Effects of Spatial Congruity on Audio-Visual Multimodal Integration
Teder-Sälejärvi, W. A., Russo, F. D., McDonald, J. J., & Hillyard, S. A. (2005) · Journal of Cognitive Neuroscience · doi:10.1162/0898929054985383 · Cited by 229
Kenemans, J. L., de Kok, A., & Smulders, F. T. Y. (1993) · Electroencephalography and Clinical Neurophysiology/Evoked Potentials Section · doi:10.1016/0168-5597(93)90028-n · Cited by 228
Cross-modal perceptual integration of spatially and temporally disparate auditory and visual stimuli
Lewald, J., & Guski, R. (2003) · Cognitive Brain Research · doi:10.1016/s0926-6410(03)00074-0 · Cited by 218
Boutros, N. N., & Belger, A. (1999) · Biological Psychiatry · doi:10.1016/s0006-3223(98)00253-4 · Cited by 215
From retinotopy to recognition: fMRI in human visual cortex
Tootell, R. B. H., Hadjikhani, N. K., Mendola, J. D., Marrett, S., & Dale, A. M. (1998) · Trends in Cognitive Sciences · doi:10.1016/s1364-6613(98)01171-1 · Cited by 214
Hearing Lips and Seeing Voices
Boston, D. W. (1977) · British Journal of Audiology · doi:10.3109/03005367709078839 · Cited by 206
The ventriloquist effect does not depend on the direction of automatic visual attention
Vroomen, J., Bertelson, P., & de Gelder, B. (2001) · Perception & Psychophysics · doi:10.3758/bf03194427 · Cited by 204
Neural systems mediating selective attention.
Hillyard, S. A., Mangun, G. R., Woldorff, M. G., & Luck, S. J. (1995) · Cited by 193
Self-citationERP effects of intermodal attention and cross‐modal links in spatial attention
Eimer, M., & Schröger, E. (1998) · Psychophysiology · doi:10.1017/s004857729897086x · Cited by 192
Sound alters visual evoked potentials in humans
Shams, L. B., Kamitani, Y., Thompson, S., & Shinsuke Shimojo, A. (2001) · Neuroreport · doi:10.1097/00001756-200112040-00049 · Cited by 192
Theeuwes, J. (1993) · Acta Psychologica · doi:10.1016/0001-6918(93)90056-w · Cited by 190
Fort, A. (2002) · Cerebral Cortex · doi:10.1093/cercor/12.10.1031 · Cited by 179
Early auditory–visual interactions in human cortex during nonredundant target identification
Fort, A., Delpuech, C., Pernier, J., & Giard, M. (2002) · Cognitive Brain Research · doi:10.1016/s0926-6410(02)00058-7 · Cited by 176
Smid, H. G. O. M., Jakob, A., & Heinze, H. –. (1999) · Psychophysiology · doi:10.1017/s0048577299971135 · Cited by 164
Sensory and Multisensory Responses in the Newborn Monkey Superior Colliculus
Wallace, M. T., & Stein, B. E. (2001) · Journal of Neuroscience · doi:10.1523/jneurosci.21-22-08886.2001 · Cited by 133
Chapter 20 Comparisons of cross-modality integration in midbrain and cortex
Stein, B. E., & Wallace, M. T. (1996) · Progress in brain research · doi:10.1016/s0079-6123(08)63336-1 · Cited by 125
Multisensory processing and oscillatory gamma responses: effects of spatial selective attention
Senkowski, D., Talsma, D., Herrmann, C. S., & Woldorff, M. G. (2005) · Experimental Brain Research · doi:10.1007/s00221-005-2381-z · Cited by 119
Self-citationMacaluso, E., Eimer, M., Frith, C., & Driver, J. (2003) · Experimental Brain Research · doi:10.1007/s00221-002-1335-y · Cited by 102
Hillyard, S. A., Vogel, E. K., & Luck, S. J. (1999) · Attention, Space and Action · doi:10.1093/oso/9780198524694.003.0003 · Cited by 74
The role of position in object selection in vision
van der Heijden, A. H. C. (1993) · Psychological Research · doi:10.1007/bf00572132 · Cited by 72
McCarthy, G., & Wood, C. C. (1985) · Electroencephalography and Clinical Neurophysiology · doi:10.1016/0013-4694(85)90858-2 · Cited by 69
Cortex Controls Multisensory Depression in Superior Colliculus
Jiang, W., & Stein, B. E. (2003) · Journal of Neurophysiology · doi:10.1152/jn.00369.2003 · Cited by 69
Split-Second Sequential Selective Activation in Human Secondary Visual Cortex
Kenemans, J. L., Lijffijt, M., Camfferman, G., & Verbaten, M. N. (2002) · Journal of Cognitive Neuroscience · doi:10.1162/089892902317205311 · Cited by 60
Talsma, D., & Kok, A. (2001) · Psychophysiology · doi:10.1111/1469-8986.3850736 · Cited by 60
Self-citationTalsma, D., & Kok, A. (2002) · Psychophysiology · doi:10.1017/s004857720200152x · Cited by 55
Self-citationDirecting spatial attention towards the illusory location of a ventriloquized sound
Vroomen, J., Bertelson, P., & de Gelder, B. (2001) · Acta Psychologica · doi:10.1016/s0001-6918(00)00068-8 · Cited by 53
Event-related potentials and audiovisual stimuli: multimodal interactions
Czigler, I., & Balázs, L. (2001) · Neuroreport · doi:10.1097/00001756-200102120-00009 · Cited by 13
Flagged first, then by citations
2 of the 56 references couldn’t be matched to a known paper.
Cited by
Sorted by citations
Multisensory integration: current issues from the perspective of the single neuron
Stein, B. E., & Stanford, T. R. (2008) · Nature Reviews Neuroscience · doi:10.1038/nrn2331 · Cited by 1,598
Driver, J., & Noesselt, T. (2008) · Neuron · doi:10.1016/j.neuron.2007.12.013 · Cited by 940
The multifaceted interplay between attention and multisensory integration.
Talsma, D., Senkowski, D., Soto-Faraco, S., & Woldorff, M. G. (2010) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2010.06.008 · Cited by 828
Self-citationAuditory attention — focusing the searchlight on sound
Fritz, J. B., Elhilali, M., David, S. V., & Shamma, S. (2007) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2007.07.011 · Cited by 547
Visual Modulation of Neurons in Auditory Cortex
Kayser, C., Petkov, C. I., & Logothetis, N. K. (2008) · Cerebral Cortex · doi:10.1093/cercor/bhm187 · Cited by 528
Metadata
- Authors
- Talsma, D., Doty, T. J., & Woldorff, M. G.
- Affiliations
- Duke University (US)
- Venue
- Cerebral Cortex
- Publisher
- Oxford University Press (OUP)
- Published
- 2006-03-31
- Volume
- 17
- Issue
- 3
- Pages
- 679-690
- ISSN
- 1047-3211 (ISSN-L)
- 1460-2199
- OpenAlex
- W2156150357
- Cited by
- 434
- References
- 56
- Citations by year
- 2026: 13 · 2025: 20 · 2024: 15 · 2023: 25 · 2022: 32 · 2021: 31 · 2020: 24 · 2019: 20 · 2018: 20 · 2017: 22 · 2016: 17 · 2015: 25 · 2014: 22 · 2013: 25 · 2012: 20
- FWCI
- 24.38
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Cerebral Cortex (publishedVersion)
- PubMed (publishedVersion)
- Ghent University Academic Bibliography (Ghent University) (submittedVersion)
- University of Twente Research Information (submittedVersion)
- University of Twente Research Information (submittedVersion, other-oa)
- Funders
- National Institute of Mental Health (R01-MH64015)
- National Institute of Neurological Disorders and Stroke (R01NS051048)
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Multisensory perception and integration
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neuroscience and Music Perception
- Life Sciences › Neuroscience › Cognitive Neuroscience › Tactile and Sensory Interactions
- Keywords
- multisensory integration, audiovisual integration, selective attention, P50, rapid serial visual presentation, audiovisual streaming, event-related potentials
- MeSH terms
- Acoustic Stimulation, Adolescent, Adult, Attention, Brain Mapping, Cognition, Discrimination, Psychological, Evoked Potentials, Auditory, Evoked Potentials, Visual, Female, Humans, Male, Photic Stimulation, Reaction Time, Scalp
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
