The DOI matches its Crossref record; 36 of the 36 references it cites were found in a registry or an index.
Audiovisual Integration of Speech Falters under High Attention Demands
Open accessAbstract
One of the most commonly cited examples of human multisensory integration occurs during exposure to natural speech, when the vocal and the visual aspects of the signal are integrated in a unitary percept. Audiovisual association of facial gestures and vocal sounds has been demonstrated in nonhuman primates and in prelinguistic children, arguing for a general basis for this capacity. One critical question, however, concerns the role of attention in such multisensory integration. Although both behavioral and neurophysiological studies have converged on a preattentive conceptualization of audiovisual speech integration, this mechanism has rarely been measured under conditions of high attentional load, when the observers' attention resources are depleted. We tested the extent to which audiovisual integration was modulated by the amount of available attentional resources by measuring the observers' susceptibility to the classic McGurk illusion in a dual-task paradigm. The proportion of visually influenced responses was severely, and selectively, reduced if participants were concurrently performing an unrelated visual or auditory task. In contrast with the assumption that crossmodal speech integration is automatic, our results suggest that these multisensory binding processes are subject to attentional demands.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A feature-integration theory of attention.
Treisman, A. M., & Gelade, G. (1980) · Cognitive Psychology · doi:10.1016/0010-0285(80)90005-5 · Cited by 12,366
Hearing lips and seeing voices
MCGURK, H., & MACDONALD, J. (1976) · Nature · doi:10.1038/264746a0 · Cited by 6,183
Visual Contribution to Speech Intelligibility in Noise
Sumby, W. H., & Pollack, I. (1954) · The Journal of the Acoustical Society of America · doi:10.1121/1.1907309 · Cited by 2,583 · cited 2×
“The visual-only condition produced hardly any correct responses, confirming that information available from silent speech actions alone is usually insufficient to enable word identification under open-response set conditions [11, 12].”
BackgroundPerceptual load as a necessary condition for selective attention.
Nilli Lavie, C. (1995) · Journal of Experimental Psychology Human Perception & Performance · doi:10.1037//0096-1523.21.3.451 · Cited by 2,013
Activation of Auditory Cortex During Silent Lipreading
Calvert, G. A., Bullmore, E. T., Brammer, M. J., Campbell, R., Williams, S. C. R., McGuire, P. K., Woodruff, P. W. R., Iversen, S. D., & David, A. S. (1997) · Science · doi:10.1126/science.276.5312.593 · Cited by 1,025
Self-citationCalvert, G. A., Campbell, R., & Brammer, M. J. (2000) · Current Biology · doi:10.1016/s0960-9822(00)00513-3 · Cited by 954
Self-citationThe Handbook of Multisensory Processes
(2004) · doi:10.7551/mitpress/3422.001.0001 · Cited by 948
Crossmodal Space and Crossmodal Attention
(2004) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780198524861.001.0001 · Cited by 791
Perceiving talking faces: from speech perception to a behavioral principle
Massaro, D. W. (1997) · Medical Entomology and Zoology · Cited by 615
Modulating Irrelevant Motion Perception by Varying Attentional Load in an Unrelated Task
Rees, G., Frith, C. D., & Lavie, N. (1997) · Science · doi:10.1126/science.278.5343.1616 · Cited by 581
Cited by
The multifaceted interplay between attention and multisensory integration.
Talsma, D., Senkowski, D., Soto-Faraco, S., & Woldorff, M. G. (2010) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2010.06.008 · Cited by 828
Self-citationPip and pop: Nonspatial auditory signals improve spatial visual search.
Van der Burg, E., Olivers, C. N. L., Bronkhorst, A. W., & Theeuwes, J. (2008) · Journal of Experimental Psychology: Human Perception and Performance · doi:10.1037/0096-1523.34.5.1053 · Cited by 485
The Leading Sense: Supramodal Control of Neurophysiological Context by Attention
Lakatos, P., O'Connell, M. N., Barczak, A., Mills, A., Javitt, D. C., & Schroeder, C. E. (2009) · Neuron · doi:10.1016/j.neuron.2009.10.014 · Cited by 381
Multisensory Processing in Review: from Physiology to Behaviour
Alais, D., Newell, F., & Mamassian, P. (2010) · Seeing and Perceiving · doi:10.1163/187847510x488603 · Cited by 324
Crossmodal binding: Evaluating the “unity assumption” using audiovisual speech stimuli
Vatakis, A., & Spence, C. (2007) · Perception & Psychophysics · doi:10.3758/bf03193776 · Cited by 298
Speech segmentation by statistical learning depends on attention
Toro, J. M., Sinnett, S., & Soto-Faraco, S. (2005) · Cognition · doi:10.1016/j.cognition.2005.01.006 · Cited by 296
Self-citationThe processing of audio-visual speech: empirical and neural bases
Campbell, R. (2008) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2007.2155 · Cited by 282
Self-citationAging of human supraspinal locomotor and postural control in fMRI
Zwergal, A., Linn, J., Xiong, G., Brandt, T., Strupp, M., & Jahn, K. (2012) · Neurobiology of Aging · doi:10.1016/j.neurobiolaging.2010.09.022 · Cited by 254
Reduced multisensory facilitation in persons with autism
Collignon, O., Charbonneau, G., Peters, F., Nassim, M., Lassonde, M., Lepore, F., Mottron, L., & Bertone, A. (2013) · Cortex · doi:10.1016/j.cortex.2012.06.001 · Cited by 114
How prior expectations shape multisensory perception
Gau, R., & Noppeney, U. (2016) · NeuroImage · doi:10.1016/j.neuroimage.2015.09.045 · Cited by 109
“It is thought that the percentage ofMcGurk–MacDonald percepts is influenced predominantly by two factors: first, it depends on participants' resources or tendencies for top-down control in order to process sensory signals in a segregated fashion (Alsius et al., 2005).”
BackgroundOthers' Actions Reduce Crossmodal Integration in Peripersonal Space
Heed, T., Habets, B., Sebanz, N., & Knoblich, G. (2010) · Current Biology · doi:10.1016/j.cub.2010.05.068 · Cited by 104
Multisensory enhancement of attention depends on whether you are already paying attention
Lunn, J., Sjoblom, A., Ward, J., Soto-Faraco, S., & Forster, S. (2019) · Cognition · doi:10.1016/j.cognition.2019.02.008 · Cited by 62
Self-citationFlavor binding: Its nature and cause
Stevenson, R. J. (2014) · Psychological Bulletin · doi:10.1037/a0033473 · Cited by 52
Auditory Sensory Substitution is Intuitive and Automatic with Texture Stimuli
Stiles, N. R. B., & Shimojo, S. (2015) · Scientific Reports · doi:10.1038/srep15628 · Cited by 45
Fraser (2011) · doi:10.1044/1092-4388(2009/08-0140
Metadata
- Authors
- Alsius, A., Navarra, J., Campbell, R., & Soto-Faraco, S.
- Venue
- Current Biology
- Publisher
- Elsevier BV
- Published
- 2005-05
- Volume
- 15
- Issue
- 9
- Pages
- 839-843
- ISSN
- 0960-9822 (ISSN-L)
- OpenAlex
- W1993111589
- Cited by
- 380
- References
- 36
- FWCI
- 15.41
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.