The DOI matches its Crossref record; 71 of the 71 references it cites were found in a registry or an index.
Integrating speech information across talkers, gender, and sensory modality: Female faces and male voices in the McGurk effect
Open accessAbstract
Studies of the McGurk effect have shown that when discrepant phonetic information is delivered to the auditory and visual modalities, the information is combined into a new percept not originally presented to either modality. In typical experiments, the auditory and visual speech signals are generated by the same talker. The present experiment examined whether a discrepancy in the gender of the talker between the auditory and visual signals would influence the magnitude of the McGurk effect. A male talker's voice was dubbed onto a videotape containing a female talker's face, and vice versa. The gender-incongruent videotapes were compared with gender-congruent videotapes, in which a male talker's voice was dubbed onto a male face and a female talker's voice was dubbed onto a female face. Even though there was a clear incompatibility in talker characteristics between the auditory and visual signals on the incongruent videotapes, the resulting magnitude of the McGurk effect was not significantly different for the incongruent as opposed to the congruent videotapes. The results indicate that the mechanism for integrating speech information from the auditory and the visual modalities is not disrupted by a gender incompatibility even when it is perceptually apparent. The findings are compatible with the theoretical notion that information about voice characteristics of the talker is extracted and used to normalize the speech signal at an early stage of phonetic processing, prior to the integration of the auditory and the visual information.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Also, integration can occurover auditory and visual signals generated by speakers of different gender”
From The McGurk effect in infants (1997) · cites this paper as Green, Kuhl, Meltzoff, & Stevens, 1991
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Experimental Design: Procedures for the Behavioral Sciences
Kirk, R. (2013) · doi:10.4135/9781483384733 · Cited by 8,539
Hearing lips and seeing voices
MCGURK, H., & MACDONALD, J. (1976) · Nature · doi:10.1038/264746a0 · Cited by 6,183
Experimental Design: Procedures for the Behavioral Sciences.
Addelman, S., & Kirk, R. E. (1969) · Journal of the American Statistical Association · doi:10.2307/2283497 · Cited by 5,233
The motor theory of speech perception revised
Liberman, A. M., & Mattingly, I. G. (1985) · Cognition · doi:10.1016/0010-0277(85)90021-6 · Cited by 2,970
Visual Contribution to Speech Intelligibility in Noise
Sumby, W. H., & Pollack, I. (1954) · The Journal of the Acoustical Society of America · doi:10.1121/1.1907309 · Cited by 2,583
Kuhl, P. K. (1991) · Perception & Psychophysics · doi:10.3758/bf03212211 · Cited by 1,331
Self-citationImmediate perceptual response to intersensory discrepancy.
Welch, R. B., & Warren, D. H. (1980) · Psychological Bulletin · doi:10.1037/0033-2909.88.3.638 · Cited by 1,176
The bimodal perception of speech in infancy
Kuhl, P. K., & Meltzoff, A. N. (1982) · Science · doi:10.1126/science.7146899 · Cited by 919
Self-citationMultivariate Procedures for the Behavioral Sciences.
Brillinger, D. R., Cooley, W. W., & Lohnes, P. R. (1964) · American Mathematical Monthly · doi:10.2307/2312239 · Cited by 829
An event approach to the study of speech perception from a direct–realist perspective
Fowler, C. A. (1986) · Journal of Phonetics · doi:10.1016/s0095-4470(19)30607-2 · Cited by 771
Proceedings of the International Conference on Spoken Language Processing.
Lickley, R. J., & Bard, E. G. (1992) · Cited by 562
Some effects of talker variability on spoken word recognition
Mullennix, J. W., Pisoni, D. B., & Martin, C. S. (1989) · The Journal of the Acoustical Society of America · doi:10.1121/1.397688 · Cited by 540
A Specialization for Speech Perception
Liberman, A. M., & Mattingly, I. G. (1989) · Science · doi:10.1126/science.2643163 · Cited by 531
Syrdal, A. K., & Gopal, H. S. (1986) · The Journal of the Acoustical Society of America · doi:10.1121/1.393381 · Cited by 480
Visual influences on speech perception processes
Macdonald, J. B., & McGurk, H. (1978) · Perception & Psychophysics · doi:10.3758/bf03206096 · Cited by 465
Static, dynamic, and relational properties in vowel perception
Nearey, T. M. (1989) · The Journal of the Acoustical Society of America · doi:10.1121/1.397861 · Cited by 462
Some preliminaries to a comprehensive account of audio-visual speech perception.
Summerfield, Q. A. (1987) · Cited by 417
The Detection of Auditory Visual Desynchrony
Dixon, N. F., & Spitz, L. (1980) · Perception · doi:10.1068/p090719 · Cited by 404
Speech perception in early infancy: Perceptual constancy for spectrally dissimilar vowel categories
Kuhl, P. K. (1979) · The Journal of the Acoustical Society of America · doi:10.1121/1.383639 · Cited by 317
Self-citationThe Intermodal Representation of Speech in Infants
Kuhl, P. K., & Meltzoff, A. N. (1984) · Infant Behavior and Development · doi:10.1016/s0163-6383(84)80050-8 · Cited by 310
Self-citationStimulus variability and processing dependencies in speech perception
Mullennix, J. W., & Pisoni, D. B. (1990) · Perception & Psychophysics · doi:10.3758/bf03210878 · Cited by 294
Neonate cognition: Beyond the blooming buzzing confusion
Lipsitt, L. P. (1986) · Early Human Development · doi:10.1016/0378-3782(86)90110-6 · Cited by 287
Auditory-perceptual interpretation of the vowel
Miller, J. D. (1989) · The Journal of the Acoustical Society of America · doi:10.1121/1.397862 · Cited by 282
Lip reading in infants: Attention to speech presented in- and out-of-synchrony
Dodd, B. (1979) · Cognitive Psychology · doi:10.1016/0010-0285(79)90021-5 · Cited by 279
Perception of auditory equivalence classes for speech in early infancy
Kuhl, P. K. (1983) · Infant Behavior and Development · doi:10.1016/s0163-6383(83)80036-8 · Cited by 264
Self-citationModularity and the Motor Theory of Speech Perception
Fox, R. A. (1994) · Journal of Phonetics · doi:10.1016/s0095-4470(19)30270-0 · Cited by 249
Easy to hear but hard to understand: A lip-reading advantage with intact auditory stimuli.
Reisberg, D., McLean, J. P., & Goldfield, A. (1987) · Cited by 246
EFFECTS OF DEGREE OF VISUAL ASSOCIATION AND ANGLE OF DISPLACEMENT ON THE "VENTRILOQUISM" EFFECT
Jack, C. E., & Thurlow, W. R. (1973) · Perceptual and Motor Skills · doi:10.2466/pms.1973.37.3.967 · Cited by 240
Dorman, M. F., Studdert‐Kennedy, M., & Raphael, L. J. (1977) · Perception & Psychophysics · doi:10.3758/bf03198744 · Cited by 235
Visual Factors in Auditory Localization
Jackson, C. V. (1953) · Quarterly Journal of Experimental Psychology · doi:10.1080/17470215308416626 · Cited by 213
Evaluation and integration of visual and auditory information in speech perception.
Massaro, D. W., & Cohen, M. M. (1983) · Journal of Experimental Psychology Human Perception & Performance · doi:10.1037//0096-1523.9.5.753 · Cited by 208
Intermodal timing relations and audio-visual speech recognition by normal-hearing adults
McGrath, M., & Summerfield, Q. (1985) · The Journal of the Acoustical Society of America · doi:10.1121/1.392336 · Cited by 201
Warren, D. H., Welch, R. B., & McCarthy, T. J. (1981) · Perception & Psychophysics · doi:10.3758/bf03202010 · Cited by 195
Infant Intermodal Speech Perception Is a Left-Hemisphere Function
MacKain, K., Studdert-Kennedy, M., Spieker, S., & Stern, D. (1983) · Science · doi:10.1126/science.6828865 · Cited by 184
Evolving theories of vowel perception
Strange, W. (1989) · The Journal of the Acoustical Society of America · doi:10.1121/1.397860 · Cited by 177
Speech Perception Takes Precedence Over Nonspeech Perception
Whalen, D. H., & Liberman, A. M. (1987) · Science · doi:10.1126/science.3603014 · Cited by 176
Dichotic release from masking for speech
Rand, T. (1974) · The Journal of the Acoustical Society of America · doi:10.1121/1.1914584 · Cited by 164
Cutting, J. E. (1976) · Psychological Review · doi:10.1037/0033-295x.83.2.114 · Cited by 163
Samuel, A. G. (1982) · Perception & Psychophysics · doi:10.3758/bf03202653 · Cited by 157
The Role of Vision in the Perception of Speech
Dodd, B. J. (1977) · Perception · doi:10.1068/p060031 · Cited by 154
Detection and Resolution of Audio-Visual Incompatibility in the Perception of Vowels
Summerfield, A. Q., & McGrath, M. (1984) · The Quarterly Journal of Experimental Psychology Section A · doi:10.1080/14640748408401503 · Cited by 145
Some differences between phonetic and auditory modes of perception
Mann, V. A. (1983) · Cognition · doi:10.1016/0010-0277(83)90030-6 · Cited by 134
Roberts, M., & Summerfield, A. Q. (1981) · Perception & Psychophysics · doi:10.3758/bf03206144 · Cited by 129
Phoneme Perception in Lipreading
Woodward, M. F., & Barber, C. G. (1960) · Journal of Speech and Hearing Research · doi:10.1044/jshr.0303.212 · Cited by 117
Duplex perception of cues for stop consonants: Evidence for a phonetic mode
Liberman, A. M., Isenberg, D., & Rakerd, B. (1981) · Perception & Psychophysics · doi:10.3758/bf03204471 · Cited by 114
On the role of visual rate information in phonetic perception
Green, K. P., & Miller, J. L. (1985) · Perception & Psychophysics · doi:10.3758/bf03207154 · Cited by 92
Self-citationThe role of visual information in the processing of
Green, K. P., & Kuhl, P. K. (1989) · Perception & Psychophysics · doi:10.3758/bf03208030 · Cited by 92
Self-citationVowel categorization by very young infants.
Marean, G. C., Werner, L. A., & Kuhl, P. K. (1992) · Developmental Psychology · doi:10.1037/0012-1649.28.3.396 · Cited by 82
Self-citationIntegral processing of visual place and auditory voicing information during phonetic perception.
Green, K. P., & Kuhl, P. K. (1991) · Journal of Experimental Psychology Human Perception & Performance · doi:10.1037//0096-1523.17.1.278 · Cited by 81
Self-citationEffects of Degree of Visual Association and Angle of Displacement on the “Ventriloquism” Effect
Jack, C. E., & Thurlow, W. R. (1973) · Perceptual and Motor Skills · doi:10.1177/003151257303700360 · Cited by 79
Perceptual development in infancy: Minnesota Symposia on Child Psychology
Yonas, A. (1988) · Cited by 78
Speech as an Intermodal Object of Perception
(2013) · Psychology Press eBooks · doi:10.4324/9780203771143-10 · Cited by 77
Acoustic properties and perception of stop consonant release transients
Repp, B. H., & Lin, H.-B. (1989) · The Journal of the Acoustical Society of America · doi:10.1121/1.397689 · Cited by 73
Hearing by Eye: The Psychology of Lip-Reading
Taylor, D. (1988) · British Journal of Ophthalmology · doi:10.1136/bjo.72.6.479-b · Cited by 71
A possible auditory basis for internal structure of phonetic categories
Miller, J. L., Connine, C. M., Schermer, T. M., & Kluender, K. R. (1983) · The Journal of the Acoustical Society of America · doi:10.1121/1.389455 · Cited by 58
Coarticulation Effects in Lipreading
Benguerel, A.-P., & Pichora-Fuller, M. K. (1982) · Journal of Speech Language and Hearing Research · doi:10.1044/jshr.2504.600 · Cited by 55
The perception of phonetic gestures
Fowler, C. A. (1991) · Medical Entomology and Zoology · Cited by 53
Spatial Localization under Conflict Conditions: Is There a Single Explanation?
Warren, D. H. (1979) · Perception · doi:10.1068/p080323 · Cited by 52
The role of attention in speech perception by young infants
Jusczyk, P. W., Bertoncini, J., Bijeljac-Babic, R., Kennedy, L. J., & Mehler, J. (1990) · Cognitive Development · doi:10.1016/0885-2014(90)90018-o · Cited by 46
Manuel, S. Y., Repp, B. H., Studdert‐Kennedy, M., & Liberman, A. M. (1983) · The Journal of the Acoustical Society of America · doi:10.1121/1.2021085 · Cited by 32
Green, K. P., Kuhl, P. K., & Meltzoff, A. N. (1988) · The Journal of the Acoustical Society of America · doi:10.1121/1.2025888 · Cited by 31
Self-citationEffects of talker variability on speech perception: implications for current research and theory
Pisoni, D. B. (1990) · International Conference on Spoken Language Processing (ICSLP) · doi:10.21437/icslp.1990-348 · Cited by 30
Heat pain thresholds in the oral-facial region
Green, B. G. (1985) · Perception & Psychophysics · doi:10.3758/bf03198847 · Cited by 29
Bentin, S., & Mann, V. A. (1990) · The Journal of the Acoustical Society of America · doi:10.1121/1.399845 · Cited by 23
Effects of Distance on the Visual Reception of Speech
Erber, N. P. (1971) · Journal of Speech and Hearing Research · doi:10.1044/jshr.1404.848 · Cited by 23
Auditory-visual fusions and illusions in speech perception
Mills, A., & Thiem, R. (1980) · UvA-DARE (University of Amsterdam) · Cited by 19
A new version of duplex perception: Evidence for phonetic and nonphonetic fusion
Nygaard, L. C., & Eimas, P. D. (1990) · The Journal of the Acoustical Society of America · doi:10.1121/1.399846 · Cited by 18
Development of the Speech Perceptuomotor System
Studdert‐Kennedy, M. (1986) · Palgrave Macmillan UK eBooks · doi:10.1007/978-1-349-08023-6_15 · Cited by 15
Acoustic analysis of stop consonants
Fischer-Jorgensen, E. (1954) · Americanae (AECID Library) · Cited by 8
A comparison of speech perception and spatial localization
Welch, R. B. (1989) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00025826 · Cited by 4
The role of learning and attention in speech perception
Nusbaum, H. C. (1990) · International Conference on Spoken Language Processing (ICSLP) · doi:10.21437/icslp.1990-127 · Cited by 2
Research works printed but not linked: 3
- Binnie, C. A., Montgomery, A. A., &Jackson, P. L. (1974). Auditory and visual contributions to the perception of selected English consonants for normally hearing and hearing-impaired listeners. In H. Bir Nielsen & E. Kampp (Eds.),Visual and audio-visual perception of speech (Scandinavian Audiology Supplementum 4, pp. 181–209). Stockholm: Almquist & Wiksell.
- Cohen, M. M. (1984).Processing of visual and auditory information in speech perception. Unpublished doctoral dissertation, University of California, Santa Cruz.
- Kuhl, P. K. (1980). Perceptual constancy for speech-sound categories in early infancy. In G. H. Yeni-Komshian, J. F. Kavanaugh, & C. A. Ferguson (Eds.),Child phonology: Vol. 2. Perception (pp. 41–66). New York: Academic Press.
Cited by
Sorted by citations
Crossmodal correspondences: A tutorial review
Spence, C. (2011) · Attention, Perception, & Psychophysics · doi:10.3758/s13414-010-0073-7 · Cited by 1,618
Echoes of echoes? An episodic theory of lexical access.
Goldinger, S. D. (1998) · Psychological Review · doi:10.1037/0033-295x.105.2.251 · Cited by 1,587
“It is surely a coincidence that Hintzman (1986) chose the term echo for the key construct in his model.”
BackgroundWords and voices: Episodic traces in spoken word identification and recognition memory.
Goldinger, S. D. (1996) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037//0278-7393.22.5.1166 · Cited by 913
The perception of emotions by ear and by eye
de Gelder, B., & Vroomen, J. (2000) · Cognition & Emotion · doi:10.1080/026999300378824 · Cited by 657
“In the study by Green, Kuhl, and Meltzoff (1991) subjects were aware of the discrepancy of the gender of the face and the voice.”
BackgroundInfants' perception of expressive behaviors: Differentiation of multimodal information.
Walker‐Andrews, A. S. (1997) · Psychological Bulletin · doi:10.1037/0033-2909.121.3.437 · Cited by 530
“Further support for this conjecture is provided by Green et al. (1991), who paired a male face with a female voice and vice versa.”
Background
Metadata
- Authors
- Green, K. P., Kuhl, P. K., Meltzoff, A. N., & Stevens, E. B.
- Affiliations
- University of Arizona (US)
- University of Washington (US)
- Venue
- Perception & Psychophysics
- Published
- 1991-11
- Volume
- 50
- Issue
- 6
- Pages
- 524-536
- ISSN
- 0031-5117 (ISSN-L)
- 1532-5962
- OpenAlex
- W1976571557
- Cited by
- 239
- References
- 71
- Citations by year
- 2026: 12 · 2025: 3 · 2024: 2 · 2023: 1 · 2022: 3 · 2021: 6 · 2020: 4 · 2019: 6 · 2018: 6 · 2017: 16 · 2016: 5 · 2015: 8 · 2014: 3 · 2013: 7 · 2012: 7
- FWCI
- 9.05
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Licence
- www.springer.com/tdm (tdm)
- Locations
- Perception & Psychophysics (publishedVersion)
- PubMed (publishedVersion)
- Funders
- National Institutes of Health (1r29ns026475-01, 5r01hd018286-12)
- National Institute of Neurological Disorders and Stroke (NS-26475)
- Eunice Kennedy Shriver National Institute of Child Health and Human Development (HD18286)
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Multisensory perception and integration
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Phonetics and Phonology Research
- Physical Sciences › Computer Science › Signal Processing › Speech and Audio Processing
- Keywords
- McGurk effect, speech perception, audiovisual speech integration, voice characteristics, multisensory integration, phonetic processing
- MeSH terms
- Adult, Arousal, Attention, Discrimination Learning, Face, Gender Identity, Humans, Phonetics, Psychoacoustics, Speech Perception, Visual Perception, Voice Quality
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review