The DOI matches its Crossref record; 71 of the 71 references it cites were found in a registry or an index.
Integrating speech information across talkers, gender, and sensory modality: Female faces and male voices in the McGurk effect
Open accessAbstract
Studies of the McGurk effect have shown that when discrepant phonetic information is delivered to the auditory and visual modalities, the information is combined into a new percept not originally presented to either modality. In typical experiments, the auditory and visual speech signals are generated by the same talker. The present experiment examined whether a discrepancy in the gender of the talker between the auditory and visual signals would influence the magnitude of the McGurk effect. A male talker's voice was dubbed onto a videotape containing a female talker's face, and vice versa. The gender-incongruent videotapes were compared with gender-congruent videotapes, in which a male talker's voice was dubbed onto a male face and a female talker's voice was dubbed onto a female face. Even though there was a clear incompatibility in talker characteristics between the auditory and visual signals on the incongruent videotapes, the resulting magnitude of the McGurk effect was not significantly different for the incongruent as opposed to the congruent videotapes. The results indicate that the mechanism for integrating speech information from the auditory and the visual modalities is not disrupted by a gender incompatibility even when it is perceptually apparent. The findings are compatible with the theoretical notion that information about voice characteristics of the talker is extracted and used to normalize the speech signal at an early stage of phonetic processing, prior to the integration of the auditory and the visual information.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Also, integration can occurover auditory and visual signals generated by speakers of different gender”
From The McGurk effect in infants (1997) · cites this paper as Green, Kuhl, Meltzoff, & Stevens, 1991
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Experimental Design: Procedures for the Behavioral Sciences
Kirk, R. (2013) · doi:10.4135/9781483384733 · Cited by 8,539
Hearing lips and seeing voices
MCGURK, H., & MACDONALD, J. (1976) · Nature · doi:10.1038/264746a0 · Cited by 6,183
Experimental Design: Procedures for the Behavioral Sciences.
Addelman, S., & Kirk, R. E. (1969) · Journal of the American Statistical Association · doi:10.2307/2283497 · Cited by 5,233
The motor theory of speech perception revised
Liberman, A. M., & Mattingly, I. G. (1985) · Cognition · doi:10.1016/0010-0277(85)90021-6 · Cited by 2,970
Visual Contribution to Speech Intelligibility in Noise
Sumby, W. H., & Pollack, I. (1954) · The Journal of the Acoustical Society of America · doi:10.1121/1.1907309 · Cited by 2,583
Kuhl, P. K. (1991) · Perception & Psychophysics · doi:10.3758/bf03212211 · Cited by 1,331
Self-citationImmediate perceptual response to intersensory discrepancy.
Welch, R. B., & Warren, D. H. (1980) · Psychological Bulletin · doi:10.1037/0033-2909.88.3.638 · Cited by 1,176
The bimodal perception of speech in infancy
Kuhl, P. K., & Meltzoff, A. N. (1982) · Science · doi:10.1126/science.7146899 · Cited by 919
Self-citationMultivariate Procedures for the Behavioral Sciences.
Brillinger, D. R., Cooley, W. W., & Lohnes, P. R. (1964) · American Mathematical Monthly · doi:10.2307/2312239 · Cited by 829
An event approach to the study of speech perception from a direct–realist perspective
Fowler, C. A. (1986) · Journal of Phonetics · doi:10.1016/s0095-4470(19)30607-2 · Cited by 771
Research works printed but not linked: 3
- Binnie, C. A., Montgomery, A. A., &Jackson, P. L. (1974). Auditory and visual contributions to the perception of selected English consonants for normally hearing and hearing-impaired listeners. In H. Bir Nielsen & E. Kampp (Eds.),Visual and audio-visual perception of speech (Scandinavian Audiology Supplementum 4, pp. 181–209). Stockholm: Almquist & Wiksell.
- Cohen, M. M. (1984).Processing of visual and auditory information in speech perception. Unpublished doctoral dissertation, University of California, Santa Cruz.
- Kuhl, P. K. (1980). Perceptual constancy for speech-sound categories in early infancy. In G. H. Yeni-Komshian, J. F. Kavanaugh, & C. A. Ferguson (Eds.),Child phonology: Vol. 2. Perception (pp. 41–66). New York: Academic Press.
Cited by
Sorted by citations
Items 201–239 of 239
THE ROLE OF FACIAL GESTURAL INFORMATION IN SUPPORTING PERCEPTUAL LEARNING OF DEGRADED SPEECH
Wayne, R. V. (2011) · QSpace (Queen's University Library)
Cross-modal Repetition Priming in Spoken Word Recognition
Buchwald, A. B., Winters, S. J., & Pisoni, D. B. (2007)
Multisensory action perception
Thomas, J. P. (2013) · Rutgers University Community Repository (Rutgers University) · doi:10.7282/t3c53jg8
A two-dimensional lip model for Mandarin Chinese
Pan, X. (2015) · Journal of Chinese linguistics · doi:10.1353/jcl.2015.0034
Audiovisual speech perception in 4-month-old infants
Desjardins, R. N. (2009) · cIRcle (University of British Columbia) · doi:10.14288/1.0088069
Individual Differences Observed in McGurk Effect.
Shigeno, S. (1998) · The Japan Journal of Logopedics and Phoniatrics · doi:10.5112/jjlp.39.267
On the Representation of Speaker Information in Human Voices: An Adaptation Approach
Zäske, R. (2011) · Common Library Network (Der Gemeinsame Bibliotheksverbund)
Audio-Visual Perception of CV Syllable of the Standard Chinese.
Pan, X., & Kong, J. (2011) · ICPhS
Visual perceptual assimilation of non-native speech
Brodsky, I. (2017) · Minerva Access (University of Melbourne)
Changes in the McGurk Effect across Phonetic Contexts. I. Fusions
Hampson, M., Guenther, F. H., & Cohen, M. A. (1999) · OpenBU (Boston University)
Michaelis, K. (2019) · DigitalGeorgetown (Georgetown University Library)
The Role of Gender in the Perception of Lipreading
Richards, E. (2020) · Digital Commons @ Butler University (Butler University)
It's all the same to me: prosodic discrimination across speakers and face areas
Cvejic, E., Kim, J., & Davis, C. (2010) · Speech prosody · doi:10.21437/speechprosody.2010-256
The unity hypothesis revisited: can the gender incongruent McGurk effect be disrupted by priming?Preprint
Kennis, S. T., & Schnupp, J. W. H. (2021) · doi:10.31234/osf.io/y7uvk
ForthcomingPerception & Psychophysics articles
(1991) · Perception & Psychophysics · doi:10.3758/bf03212234
Becker‐Carus, C., & Wendt, M. (2017) · Springer eBooks · doi:10.1007/978-3-662-53006-1_9
Forthcomingperception & psychophysics articles
(1991) · Perception & Psychophysics · doi:10.3758/bf03206754
Parâmetros para comparação de locutor
de Aquino, N. M. M. (2022) · doi:10.47749/t/unicamp.2022.1260363
Viswanathan, N., Rinzler, A., & Kelty‐Stephen, D. G. (2024) · PLoS ONE · doi:10.1371/journal.pone.0291992
“Furthermore, apparent source-neutral effects on speech perception extend beyond compensation for coarticulation, inviting the similar interpretation that speech perception systems attend to signal regularities irrespective of (or prior to) speech-signal source [16, 17].”
BackgroundPrimitive audiovisual integration of speech
Remez, R. E., Dubowski, K. R., Ferro, D. F., & Thomas, E. F. (2025) · Attention Perception & Psychophysics · doi:10.3758/s13414-025-03038-1
“In one exemplary report, audiovisual blending of phonemic features was not diminished when audible speech was produced by a female talker but the visible face was a male talker (Green et al., 1991; see also, Derrick & Gick, 2013; cf. Schwippert & Benoît, 1997).”
Visual load does not modulate neural processing of audiovisual speech integration
Sato, M. (2025) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2025.109344
Öhrström, N. (2010) · KTH Publication Database DiVA (KTH Royal Institute of Technology)
Read my lips : Visuell talavläsning och buller
Holgersson, J. (2011) · DiVA (Linkoping University)
Influence of facial views on the mcgurk effect in auditory noise
Kanzaki, R., & Kato, T. (1998) · International Conference on Spoken Language Processing (ICSLP) · doi:10.21437/icslp.1998-265
Nordstrom, L. D. (2015) · ScholarsArchive (Brigham Young University)
Toward an ecologically valid theory of speech perception
McGowan, K. B. (2026) · doi:10.1093/9780191851544.003.0004
Hall‐Lew, L. (2026) · doi:10.1093/9780191851544.003.0006
Further interdisciplinary opportunities
Hall‐Lew, L., & Nycz, J. (2026) · doi:10.1093/9780191851544.003.0008
Nycz, J. (2026) · doi:10.1093/9780191851544.003.0002
The relationship between production and perception
Walker, A. J. (2026) · doi:10.1093/9780191851544.003.0005
Metadata
- Authors
- Green, K. P., Kuhl, P. K., Meltzoff, A. N., & Stevens, E. B.
- Affiliations
- University of Arizona (US)
- University of Washington (US)
- Venue
- Perception & Psychophysics
- Published
- 1991-11
- Volume
- 50
- Issue
- 6
- Pages
- 524-536
- ISSN
- 0031-5117 (ISSN-L)
- 1532-5962
- OpenAlex
- W1976571557
- Cited by
- 239
- References
- 71
- Citations by year
- 2026: 12 · 2025: 3 · 2024: 2 · 2023: 1 · 2022: 3 · 2021: 6 · 2020: 4 · 2019: 6 · 2018: 6 · 2017: 16 · 2016: 5 · 2015: 8 · 2014: 3 · 2013: 7 · 2012: 7
- FWCI
- 9.05
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Licence
- www.springer.com/tdm (tdm)
- Locations
- Perception & Psychophysics (publishedVersion)
- PubMed (publishedVersion)
- Funders
- National Institutes of Health (1r29ns026475-01, 5r01hd018286-12)
- National Institute of Neurological Disorders and Stroke (NS-26475)
- Eunice Kennedy Shriver National Institute of Child Health and Human Development (HD18286)
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Multisensory perception and integration
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Phonetics and Phonology Research
- Physical Sciences › Computer Science › Signal Processing › Speech and Audio Processing
- Keywords
- McGurk effect, speech perception, audiovisual speech integration, voice characteristics, multisensory integration, phonetic processing
- MeSH terms
- Adult, Arousal, Attention, Discrimination Learning, Face, Gender Identity, Humans, Phonetics, Psychoacoustics, Speech Perception, Visual Perception, Voice Quality
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
