The DOI matches its Crossref record; 36 of the 36 references it cites were found in a registry or an index.
Audiovisual Integration of Speech Falters under High Attention Demands
Open accessAbstract
One of the most commonly cited examples of human multisensory integration occurs during exposure to natural speech, when the vocal and the visual aspects of the signal are integrated in a unitary percept. Audiovisual association of facial gestures and vocal sounds has been demonstrated in nonhuman primates and in prelinguistic children, arguing for a general basis for this capacity. One critical question, however, concerns the role of attention in such multisensory integration. Although both behavioral and neurophysiological studies have converged on a preattentive conceptualization of audiovisual speech integration, this mechanism has rarely been measured under conditions of high attentional load, when the observers' attention resources are depleted. We tested the extent to which audiovisual integration was modulated by the amount of available attentional resources by measuring the observers' susceptibility to the classic McGurk illusion in a dual-task paradigm. The proportion of visually influenced responses was severely, and selectively, reduced if participants were concurrently performing an unrelated visual or auditory task. In contrast with the assumption that crossmodal speech integration is automatic, our results suggest that these multisensory binding processes are subject to attentional demands.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A feature-integration theory of attention.
Treisman, A. M., & Gelade, G. (1980) · Cognitive Psychology · doi:10.1016/0010-0285(80)90005-5 · Cited by 12,366
Hearing lips and seeing voices
MCGURK, H., & MACDONALD, J. (1976) · Nature · doi:10.1038/264746a0 · Cited by 6,183
Visual Contribution to Speech Intelligibility in Noise
Sumby, W. H., & Pollack, I. (1954) · The Journal of the Acoustical Society of America · doi:10.1121/1.1907309 · Cited by 2,583 · cited 2×
“The visual-only condition produced hardly any correct responses, confirming that information available from silent speech actions alone is usually insufficient to enable word identification under open-response set conditions [11, 12].”
BackgroundPerceptual load as a necessary condition for selective attention.
Nilli Lavie, C. (1995) · Journal of Experimental Psychology Human Perception & Performance · doi:10.1037//0096-1523.21.3.451 · Cited by 2,013
Activation of Auditory Cortex During Silent Lipreading
Calvert, G. A., Bullmore, E. T., Brammer, M. J., Campbell, R., Williams, S. C. R., McGuire, P. K., Woodruff, P. W. R., Iversen, S. D., & David, A. S. (1997) · Science · doi:10.1126/science.276.5312.593 · Cited by 1,025
Self-citationCalvert, G. A., Campbell, R., & Brammer, M. J. (2000) · Current Biology · doi:10.1016/s0960-9822(00)00513-3 · Cited by 954
Self-citationThe Handbook of Multisensory Processes
(2004) · doi:10.7551/mitpress/3422.001.0001 · Cited by 948
Crossmodal Space and Crossmodal Attention
(2004) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780198524861.001.0001 · Cited by 791
Perceiving talking faces: from speech perception to a behavioral principle
Massaro, D. W. (1997) · Medical Entomology and Zoology · Cited by 615
Modulating Irrelevant Motion Perception by Varying Attentional Load in an Unrelated Task
Rees, G., Frith, C. D., & Lavie, N. (1997) · Science · doi:10.1126/science.278.5343.1616 · Cited by 581
Multisensory perception: Beyond modularity and convergence
Driver, J., & Spence, C. (2000) · Current Biology · doi:10.1016/s0960-9822(00)00740-5 · Cited by 465
Attentional requirements in a ‘preattentive’ feature search task
Joseph, J. S., Chun, M. M., & Nakayama, K. (1997) · Nature · doi:10.1038/42940 · Cited by 406
Response amplification in sensory-specific cortices during crossmodal binding
Calvert, G. A., Brammer, M. J., Bullmore, E. T., Campbell, R., Iversen, S. D., & David, A. S. (1999) · NeuroReport · doi:10.1097/00001756-199908200-00033 · Cited by 331
Self-citationPerceiving Talking Faces: From Speech Perception to a Behavioral Principle
Plant, G. (1999) · Ear and Hearing · doi:10.1097/00003446-199904000-00011 · Cited by 326
Enhancement of selective listening by illusory mislocation of speech sounds due to lip-reading
Driver, J. (1996) · Nature · doi:10.1038/381066a0 · Cited by 315
Inattentional Blindness Versus Inattentional Amnesia for Fixated But Ignored Words
Rees, G., Russell, C., Frith, C. D., & Driver, J. (1999) · Science · doi:10.1126/science.286.5449.2504 · Cited by 254
The ventriloquist effect does not depend on the direction of deliberate visual attention
Bertelson, P., Vroomen, J., De Gelder, B., & Driver, J. (2000) · Perception & Psychophysics · doi:10.3758/bf03205552 · Cited by 252
Automatic visual bias of perceived auditory location
Bertelson, P., & Aschersleben, G. (1998) · Psychonomic Bulletin & Review · doi:10.3758/bf03208826 · Cited by 252
Auditory-visual speech perception examined by fMRI and PET
Sekiyama, K., Kanno, I., Miura, S., & Sugita, Y. (2003) · Neuroscience Research · doi:10.1016/s0168-0102(03)00214-1 · Cited by 249
Burnham, D., & Dodd, B. (2004) · Developmental Psychobiology · doi:10.1002/dev.20032 · Cited by 247
Facial expressions linked to monkey calls
Ghazanfar, A. A., & Logothetis, N. K. (2003) · Nature · doi:10.1038/423937a · Cited by 216
Colin, C. (2002) · Clinical Neurophysiology · doi:10.1016/s1388-2457(02)00024-x · Cited by 173
Caclin, A., Soto-Faraco, S., Kingstone, A., & Spence, C. (2002) · Perception & Psychophysics · doi:10.3758/bf03194730 · Cited by 169
Self-citationProcessing of irrelevant visual motion during performance of an auditory attention task
Rees, G., Frith, C., & Lavie, N. (2001) · Neuropsychologia · doi:10.1016/s0028-3932(01)00016-1 · Cited by 161
Is cross-modal integration of emotional expressions independent of attentional resources?
Vroomen, J., Driver, J., & de Gelder, B. (2001) · Cognitive Affective & Behavioral Neuroscience · doi:10.3758/cabn.1.4.382 · Cited by 155
Visual attention modulates audiovisual speech perception
Tiippana, K. M., Andersen, T., & Sams, M. E. (2004) · The European Journal of Cognitive Psychology · doi:10.1080/09541440340000268 · Cited by 154
Shifting baselines in attention research
Driver, J., & Frith, C. (2000) · Nature reviews. Neuroscience · doi:10.1038/35039083 · Cited by 119
Soto‐Faraco, S. (2004) · Cognition · doi:10.1016/j.cognition.2003.10.005 · Cited by 114
Self-citationSpeech Perception By Ear and Eye
Massaro, D. W., & Simpson, J. A. (2014) · Psychology Press eBooks · doi:10.4324/9781315808253 · Cited by 110
Bimodal Interactions in the Superior Colliculus of the Behaving Cat
Populin, L. C., & Yin, T. C. T. (2002) · Journal of Neuroscience · doi:10.1523/jneurosci.22-07-02826.2002 · Cited by 105
Secretion of hCG-α subunit and hCG by HeLa strains
Lieblich, J. M., Weintraub, B. D., Rosen, S. W., Ghosh, N. K., & Cox, R. P. (1977) · Nature · doi:10.1038/265746a0 · Cited by 101
Möttönen, R., Schürmann, M., & Sams, M. E. (2004) · Neuroscience Letters · doi:10.1016/j.neulet.2004.03.076 · Cited by 83
Crossmodal Spatial Interactions in Subcortical and Cortical Circuits
Stein, B. E., Stanford, T. R., Wallace, M. T., Vaughan, J. W., & Jiang, W. (2004) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780198524861.003.0002 · Cited by 74
Audiovisual integration in perception of real words
Dekle, D. J., Fowler, C. A., & Funnell, M. G. (1992) · Perception & Psychophysics · doi:10.3758/bf03211629 · Cited by 72
Audiovisual Speech Binding: Convergence or Association?
Bernstein, L. E., Auer, E. T., & Moore, J. K. (2004) · The MIT Press eBooks · doi:10.7551/mitpress/3422.003.0017 · Cited by 71
Ventriloquism in patients with unilateral visual neglect
Bertelson, P., Pavani, F., Làdavas, E., Vroomen, J., & de Gelder, B. (2000) · Neuropsychologia · doi:10.1016/s0028-3932(00)00067-1 · Cited by 52
Cited by
The multifaceted interplay between attention and multisensory integration.
Talsma, D., Senkowski, D., Soto-Faraco, S., & Woldorff, M. G. (2010) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2010.06.008 · Cited by 828
Self-citationPip and pop: Nonspatial auditory signals improve spatial visual search.
Van der Burg, E., Olivers, C. N. L., Bronkhorst, A. W., & Theeuwes, J. (2008) · Journal of Experimental Psychology: Human Perception and Performance · doi:10.1037/0096-1523.34.5.1053 · Cited by 485
The Leading Sense: Supramodal Control of Neurophysiological Context by Attention
Lakatos, P., O'Connell, M. N., Barczak, A., Mills, A., Javitt, D. C., & Schroeder, C. E. (2009) · Neuron · doi:10.1016/j.neuron.2009.10.014 · Cited by 381
Multisensory Processing in Review: from Physiology to Behaviour
Alais, D., Newell, F., & Mamassian, P. (2010) · Seeing and Perceiving · doi:10.1163/187847510x488603 · Cited by 324
Crossmodal binding: Evaluating the “unity assumption” using audiovisual speech stimuli
Vatakis, A., & Spence, C. (2007) · Perception & Psychophysics · doi:10.3758/bf03193776 · Cited by 298
Metadata
- Authors
- Alsius, A., Navarra, J., Campbell, R., & Soto-Faraco, S.
- Venue
- Current Biology
- Publisher
- Elsevier BV
- Published
- 2005-05
- Volume
- 15
- Issue
- 9
- Pages
- 839-843
- ISSN
- 0960-9822 (ISSN-L)
- OpenAlex
- W1993111589
- Cited by
- 380
- References
- 36
- FWCI
- 15.41
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.