Primary and multisensory cortical activity is correlated with audiovisual percepts
Open accessThe DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.
Abstract
Incongruent auditory and visual stimuli can elicit audiovisual illusions such as the McGurk effect where visual /ka/ and auditory /pa/ fuse into another percept such as/ta/. In the present study, human brain activity was measured with adaptation functional magnetic resonance imaging to investigate which brain areas support such audiovisual illusions. Subjects viewed trains of four movies beginning with three congruent /pa/ stimuli to induce adaptation. The fourth stimulus could be (i) another congruent /pa/, (ii) a congruent /ka/, (iii) an incongruent stimulus that evokes the McGurk effect in susceptible individuals (lips /ka/ voice /pa/), or (iv) the converse combination that does not cause the McGurk effect (lips /pa/ voice/ ka/). This paradigm was predicted to show increased release from adaptation (i.e. stronger brain activation) when the fourth movie and the related percept was increasingly different from the three previous movies. A stimulus change in either the auditory or the visual stimulus from /pa/ to /ka/ (iii, iv) produced within‐modality and cross‐modal responses in primary auditory and visual areas. A greater release from adaptation was observed for incongruent non‐McGurk (iv) compared to incongruent McGurk (iii) trials. A network including the primary auditory and visual cortices, nonprimary auditory cortex, and several multisensory areas (superior temporal sulcus, intraparietal sulcus, insula, and pre‐central cortex) showed a correlation between perceiving the McGurk effect and the fMRI signal, suggesting that these areas support the audiovisual illusion. Hum Brain Mapp, 2010. © 2009 Wiley‐Liss, Inc.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hearing lips and seeing voices
MCGURK, H., & MACDONALD, J. (1976) · Nature · doi:10.1038/264746a0 · Cited by 6,183
Searching for a baseline: Functional imaging and the resting human brain
Gusnard, D. A., & Raichle, M. E. (2001) · Nature Reviews Neuroscience · doi:10.1038/35094500 · Cited by 3,371
Visual Contribution to Speech Intelligibility in Noise
Sumby, W. H., & Pollack, I. (1954) · The Journal of the Acoustical Society of America · doi:10.1121/1.1907309 · Cited by 2,583 · cited 3×
“Integration effects are most noticeable when one sensory system is impaired or when a component of the audiovisual signal is degraded [Callan et al., 2003; Stein and Meredith, 1993; Sumby and Pollack, 1954].”
BackgroundRepetition and the brain: neural models of stimulus-specific effects
Grill-Spector, K., Henson, R., & Martin, A. (2006) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2005.11.006 · Cited by 2,256 · cited 2×
“In functional studies, adaptation could be responsible for the blood oxygen level dependent (BOLD) signal decreases, faster reaction times, and improved accuracy often noted in repetition priming experiments [Grill-Spector et al., 2006; Schacter and Buckner, 1998; Wiggs and Martin, 1998].”
BackgroundGiard, M. H., & Peronnet, F. (1999) · Journal of Cognitive Neuroscience · doi:10.1162/089892999563544 · Cited by 1,072
Crossmodal Processing in the Human Brain: Insights from Functional Neuroimaging Studies
Calvert, G. A. (2001) · Cerebral Cortex · doi:10.1093/cercor/11.12.1110 · Cited by 1,012
Calvert, G. A., Campbell, R., & Brammer, M. J. (2000) · Current Biology · doi:10.1016/s0960-9822(00)00513-3 · Cited by 954
Mazoyer, B., Zago, L., Mellet, E., Bricogne, S., Etard, O., Houdé, O., Crivello, F., Joliot, M., Petit, L., & Tzourio-Mazoyer, N. (2001) · Brain Research Bulletin · doi:10.1016/s0361-9230(00)00437-8 · Cited by 906
Anatomical evidence of multimodal integration in primate striate cortex
Falchier, A., Clavagnier, S., Barone, P., & Kennedy, H. (2002) · The Journal of Neuroscience · doi:10.1523/jneurosci.22-13-05749.2002 · Cited by 892 · cited 3×
“It is likely that the same anatomical projections from multisensory areas to V1 are present in normal individuals [Falchier et al., 2002]; however, this influence on the earliest visual processing centers has not previously been shown in healthy adults for language related stimuli.”
BackgroundNeural Correlates of Auditory–Visual Stimulus Onset Asynchrony Detection
Bushara, K. O., Grafman, J., & Hallett, M. (2001) · The Journal of Neuroscience · doi:10.1523/jneurosci.21-01-00300.2001 · Cited by 361
Temporal constraints on the McGurk effect
Munhall, K. G., Gribble, P., Sacco, L., & Ward, M. (1996) · Perception & Psychophysics · doi:10.3758/bf03206811 · Cited by 358 · cited 2×
“The McGurk effect has been extensively used in studies of multisensory speech processing as a measurable and behaviorally relevant index of audiovisual integration [Grant and Seitz, 1998; Grant et al., 1998; Jones and Callan, 2003; Jones and Jarick, 2006; Möttönen, 2002; Munhall et al., 1996; Sams et al., 1991].”
MethodResult
Cited by
Multisensory Processing in Review: from Physiology to Behaviour
Alais, D., Newell, F., & Mamassian, P. (2010) · Seeing and Perceiving · doi:10.1163/187847510x488603 · Cited by 324
A neural basis for interindividual differences in the McGurk effect, a multisensory speech illusion
Nath, A. R., & Beauchamp, M. S. (2012) · NeuroImage · doi:10.1016/j.neuroimage.2011.07.024 · Cited by 280
Anterior insula activations in perceptual paradigms: often observed but barely understood
Sterzer, P., & Kleinschmidt, A. (2010) · Brain Structure and Function · doi:10.1007/s00429-010-0252-2 · Cited by 183
“Again, AIC activations in cross-modal studies can be attributed to task demands (Bushara et al. 2001) or to perceived stimulus salience, which may be the key factor in mismatch-related responses (Bushara et al. 2001; Benoit et al. 2009 ).”
BackgroundResultInfluentialHow prior expectations shape multisensory perception
Gau, R., & Noppeney, U. (2016) · NeuroImage · doi:10.1016/j.neuroimage.2015.09.045 · Cited by 109
“While previous studies reported a large variability in the percentage of fusedMcGurk–MacDonald percepts across subjects (Benoit et al., 2010; Hasson et al., 2007; Nath and Beauchamp, 2012; Skipper et al., 2007), we selected and finetuned the McGurk–MacDonald stimuli individually to obtain a…”
MethodThe function of consciousness in multisensory integration
Palmer, T. D., & Ramsey, A. K. (2012) · Cognition · doi:10.1016/j.cognition.2012.08.003 · Cited by 91
Metadata
- Authors
- Benoit, M. M., Raij, T., Lin, F., Jääskeläinen, I. P., & Stufflebeam, S.
- Venue
- Human Brain Mapping
- Publisher
- Wiley
- Published
- 2010-03-10
- Volume
- 31
- Issue
- 4
- Pages
- 526-538
- ISSN
- 1065-9471 (ISSN-L)
- 1097-0193
- OpenAlex
- W2151633308
- Cited by
- 89
- References
- 11
- FWCI
- 7.23
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.