The DOI matches its Crossref record; 71 of the 71 references it cites were found in a registry or an index.
Integrating speech information across talkers, gender, and sensory modality: Female faces and male voices in the McGurk effect
Open accessAbstract
Studies of the McGurk effect have shown that when discrepant phonetic information is delivered to the auditory and visual modalities, the information is combined into a new percept not originally presented to either modality. In typical experiments, the auditory and visual speech signals are generated by the same talker. The present experiment examined whether a discrepancy in the gender of the talker between the auditory and visual signals would influence the magnitude of the McGurk effect. A male talker's voice was dubbed onto a videotape containing a female talker's face, and vice versa. The gender-incongruent videotapes were compared with gender-congruent videotapes, in which a male talker's voice was dubbed onto a male face and a female talker's voice was dubbed onto a female face. Even though there was a clear incompatibility in talker characteristics between the auditory and visual signals on the incongruent videotapes, the resulting magnitude of the McGurk effect was not significantly different for the incongruent as opposed to the congruent videotapes. The results indicate that the mechanism for integrating speech information from the auditory and the visual modalities is not disrupted by a gender incompatibility even when it is perceptually apparent. The findings are compatible with the theoretical notion that information about voice characteristics of the talker is extracted and used to normalize the speech signal at an early stage of phonetic processing, prior to the integration of the auditory and the visual information.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Also, integration can occurover auditory and visual signals generated by speakers of different gender”
From The McGurk effect in infants (1997) · cites this paper as Green, Kuhl, Meltzoff, & Stevens, 1991
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Experimental Design: Procedures for the Behavioral Sciences
Kirk, R. (2013) · doi:10.4135/9781483384733 · Cited by 8,539
Hearing lips and seeing voices
MCGURK, H., & MACDONALD, J. (1976) · Nature · doi:10.1038/264746a0 · Cited by 6,183
Experimental Design: Procedures for the Behavioral Sciences.
Addelman, S., & Kirk, R. E. (1969) · Journal of the American Statistical Association · doi:10.2307/2283497 · Cited by 5,233
The motor theory of speech perception revised
Liberman, A. M., & Mattingly, I. G. (1985) · Cognition · doi:10.1016/0010-0277(85)90021-6 · Cited by 2,970
Visual Contribution to Speech Intelligibility in Noise
Sumby, W. H., & Pollack, I. (1954) · The Journal of the Acoustical Society of America · doi:10.1121/1.1907309 · Cited by 2,583
Kuhl, P. K. (1991) · Perception & Psychophysics · doi:10.3758/bf03212211 · Cited by 1,331
Self-citationImmediate perceptual response to intersensory discrepancy.
Welch, R. B., & Warren, D. H. (1980) · Psychological Bulletin · doi:10.1037/0033-2909.88.3.638 · Cited by 1,176
The bimodal perception of speech in infancy
Kuhl, P. K., & Meltzoff, A. N. (1982) · Science · doi:10.1126/science.7146899 · Cited by 919
Self-citationMultivariate Procedures for the Behavioral Sciences.
Brillinger, D. R., Cooley, W. W., & Lohnes, P. R. (1964) · American Mathematical Monthly · doi:10.2307/2312239 · Cited by 829
An event approach to the study of speech perception from a direct–realist perspective
Fowler, C. A. (1986) · Journal of Phonetics · doi:10.1016/s0095-4470(19)30607-2 · Cited by 771
Research works printed but not linked: 3
- Binnie, C. A., Montgomery, A. A., &Jackson, P. L. (1974). Auditory and visual contributions to the perception of selected English consonants for normally hearing and hearing-impaired listeners. In H. Bir Nielsen & E. Kampp (Eds.),Visual and audio-visual perception of speech (Scandinavian Audiology Supplementum 4, pp. 181–209). Stockholm: Almquist & Wiksell.
- Cohen, M. M. (1984).Processing of visual and auditory information in speech perception. Unpublished doctoral dissertation, University of California, Santa Cruz.
- Kuhl, P. K. (1980). Perceptual constancy for speech-sound categories in early infancy. In G. H. Yeni-Komshian, J. F. Kavanaugh, & C. A. Ferguson (Eds.),Child phonology: Vol. 2. Perception (pp. 41–66). New York: Academic Press.
Cited by
Sorted by citations
Crossmodal correspondences: A tutorial review
Spence, C. (2011) · Attention, Perception, & Psychophysics · doi:10.3758/s13414-010-0073-7 · Cited by 1,618
Echoes of echoes? An episodic theory of lexical access.
Goldinger, S. D. (1998) · Psychological Review · doi:10.1037/0033-295x.105.2.251 · Cited by 1,587
“It is surely a coincidence that Hintzman (1986) chose the term echo for the key construct in his model.”
BackgroundWords and voices: Episodic traces in spoken word identification and recognition memory.
Goldinger, S. D. (1996) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037//0278-7393.22.5.1166 · Cited by 913
The perception of emotions by ear and by eye
de Gelder, B., & Vroomen, J. (2000) · Cognition & Emotion · doi:10.1080/026999300378824 · Cited by 657
“In the study by Green, Kuhl, and Meltzoff (1991) subjects were aware of the discrepancy of the gender of the face and the voice.”
BackgroundInfants' perception of expressive behaviors: Differentiation of multimodal information.
Walker‐Andrews, A. S. (1997) · Psychological Bulletin · doi:10.1037/0033-2909.121.3.437 · Cited by 530
“Further support for this conjecture is provided by Green et al. (1991), who paired a male face with a female voice and vice versa.”
BackgroundEpisodic encoding of voice attributes and recognition memory for spoken words.
Palmeri, T. J., Goldinger, S. D., & Pisoni, D. B. (1993) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037/0278-7393.19.2.309 · Cited by 450
How do humans process and recognize speech?
Allen, J. B. (1994) · IEEE Transactions on Speech and Audio Processing · doi:10.1109/89.326615 · Cited by 382
Temporal constraints on the McGurk effect
Munhall, K. G., Gribble, P., Sacco, L., & Ward, M. (1996) · Perception & Psychophysics · doi:10.3758/bf03206811 · Cited by 358
Rosenblum, L. D., Schmuckler, M. A., & Johnson, J. A. (1997) · Perception & Psychophysics · doi:10.3758/bf03211902 · Cited by 367
Lipreading and audio-visual speech perception
Summerfield, A. Q. (1992) · Philosophical Transactions of the Royal Society B Biological Sciences · doi:10.1098/rstb.1992.0009 · Cited by 371
Modulation of neural responses to speech by directing attention to voices or verbal content
von Kriegstein, K., Eger, E., Kleinschmidt, A. K., & Giraud, A. L. (2003) · Cognitive Brain Research · doi:10.1016/s0926-6410(03)00079-x · Cited by 347
Learning and representation in speech and language
Kuhl, P. K. (1994) · Current Opinion in Neurobiology · doi:10.1016/0959-4388(94)90128-7 · Cited by 329
Self-citationReading Speech from Still and Moving Faces: The Neural Substrates of Visible Speech
Calvert, G. A., & Campbell, R. (2003) · Journal of Cognitive Neuroscience · doi:10.1162/089892903321107828 · Cited by 337
“Only models of speech perception that go beyond auditory processing, and implicate ‘‘supramodal’’ or ‘‘amodal’’ procedures can accommodate such findings (see Green et al., 1991; Summerfield, 1987, 1992; Fowler & Rosenblum, 1991).”
BackgroundAuditory–visual integration of talker gender in vowel perception
Johnson, K. A., Strand, E. A., & D’Imperio, M. (1999) · Journal of Phonetics · doi:10.1006/jpho.1999.0100 · Cited by 312
“The radical invariance view seems to have been the one adopted by Green et al. (1991) in their account of the AV talker-mismatched McGurk e!ect, in which they posit that the acoustic signal is normalized prior to AV integration.”
BackgroundResultInfluentialCrossmodal binding: Evaluating the “unity assumption” using audiovisual speech stimuli
Vatakis, A., & Spence, C. J. (2007) · Perception & Psychophysics · doi:10.3758/bf03193776 · Cited by 320
“Moreover, the results of these previous studies of audiovisual speech perception are inconclusive as to whether the magnitude of the McGurk effect (i.e., the visual influence on the perception of audiovisual speech) is affected by whether or not the speaker’s face and voice are gender-matched (Easton & Basala, 1982; G…”
MethodResultInfluentialOn specification and the senses
Stoffregen, T. A., & Bardy, B. G. (2001) · Behavioral and Brain Sciences · doi:10.1017/s0140525x01003946 · Cited by 311
“Green et al. (1991) argued that the presumed audio-visual integration occurs relatively late in phonetic processing, after the extraction of information about the voice characteristics of the speaker.”
BackgroundThe processing of audio-visual speech: empirical and neural bases
Campbell, R. (2007) · Philosophical Transactions of the Royal Society B Biological Sciences · doi:10.1098/rstb.2007.2155 · Cited by 291
“The findings that phonetic context perceived by eye can shift phonemic category boundaries (Green et al. 1991), and that prelinguistic babies are sensitive to McGurk effects (Burnham & Dodd 2004), demonstrate that audio-visual integration can occur 'pre-phonemically'.”
BackgroundAudiovisual multisensory integration
Spence, C. J. (2007) · Nippon Onkyo Gakkaishi/Acoustical science and technology/Nihon Onkyo Gakkaishi · doi:10.1250/ast.28.61 · Cited by 252
“to identify speech stimuli, at least when the observers are familiar with the speakers in the video-clips (see [48,49]; though see also [50] for null results).”
BackgroundBurnham, D. K., & Dodd, B. J. (2004) · Developmental Psychobiology · doi:10.1002/dev.20032 · Cited by 267
“It is of passing interest to note that the majority of infants in the experimental group had a [da] preference, in contrast to adults whose fusion responses in an [a] vowel context are more often ‘‘tha’’ (85%) than ‘‘da’’ (15%) (Green, 1996; Green, Kuhl, & Meltzoff, 1988; Green et al., 1991) (see also Table 1).”
BackgroundResultInfluentialAsymmetric relationships among perceptions of facial identity, emotion, and facial speech.
Schweinberger, S. R., & Soukup, G. R. (1998) · Journal of Experimental Psychology Human Perception & Performance · doi:10.1037//0096-1523.24.6.1748 · Cited by 245
Perceptual learning of systematic variation in Spanish-accented speech
Sidaras, S. K., Alexander, J. E. D., & Nygaard, L. C. (2009) · The Journal of the Acoustical Society of America · doi:10.1121/1.3101452 · Cited by 227
“A number of studies have shown that listeners both attend to variation in talker’s voice Green et al., 1991; Magnuson and Nusbaum, 2007; Mullennix et al., 1989; Mullennix and Pisoni, 1990; Nusbaum and Magnuson, 1997 and retain talker-specific characteristics of speech in memory Bradlow et al.,…”
BackgroundFactors influencing audiovisual fission and fusion illusions
Andersen, T., Tiippana, K. M., & Sams, M. E. (2004) · Cognitive Brain Research · doi:10.1016/j.cogbrainres.2004.06.004 · Cited by 222
“This is seen in the McGurk effect [4,6,8,9] where viewing an incongruently articulating face categorically alters the auditory speech percept.”
BackgroundInter-language differences in the influence of visual cues in speech perception
Sekiyama, K., & Tohkura, Y. (1993) · Journal of Phonetics · doi:10.1016/s0095-4470(19)30229-3 · Cited by 202
Measures of auditory–visual integration in nonsense syllables and sentences
Grant, K. W., & Seitz, P. F. (1998) · The Journal of the Acoustical Society of America · doi:10.1121/1.423751 · Cited by 200
Assessing the Role of the ‘Unity Assumption’ on Multisensory Integration: A Review
Chen, Y., & Spence, C. J. (2017) · Frontiers in Psychology · doi:10.3389/fpsyg.2017.00445 · Cited by 216
“In addition, the congruency of stimulus identity modulates the extent to which people integrate multisensory speech stimuli (Easton and Basala, 1982; Munhall et al., 1996; though see Green et al., 1991).”
BackgroundInfants' Use of Synchronized Visual Information to Separate Streams of Speech
Hollich, G. J., Newman, R. S., & Jusczyk, P. W. (2005) · Child Development · doi:10.1111/j.1467-8624.2005.00866.x · Cited by 189
“…to use of visual information for segmentation , there is evidence that visual information and auditory information are integrated during perception (Gibson, 1969) and that visual information can alter the perceived phonemic representation of a signal (Green et al., 1991; McGurk & McDonald, 1976).”
BackgroundMethodSekiyama, K. (1997) · Perception & Psychophysics · doi:10.3758/bf03206849 · Cited by 177
Visual attention modulates audiovisual speech perception
Tiippana, K. M., Andersen, T., & Sams, M. E. (2004) · The European Journal of Cognitive Psychology · doi:10.1080/09541440340000268 · Cited by 154
“(e.g. Green, Kuhl, Meltzoff, & Stevens, 1991; McGurk & MacDonald, 1976).”
Mallick, D. B., Magnotti, J. F., & Beauchamp, M. S. (2015) · Psychonomic Bulletin & Review · doi:10.3758/s13423-015-0817-4 · Cited by 155
Kuhl, P. K. (1993) · Springer eBooks · doi:10.1007/978-94-015-8234-6_22 · Cited by 151
Self-citationAuditory-Visual Speech Perception and Aging
Cienkowski, K. M., & Carney, A. E. (2002) · Ear and Hearing · doi:10.1097/00003446-200210000-00006 · Cited by 146
“Similar differences between male and female talkers were reported but not discussed as differences by other investigators (Green et al., 1991; Green & Kuhl, 1991).”
BackgroundResultAuditory Adaptation in Voice Perception
Schweinberger, S. R., Casper, C., Hauthal, N., Kaufmann, J. M., Kawahara, H., Kloth, N., Robertson, D. M. C., Simpson, A. P., & Zäske, R. (2008) · Current Biology · doi:10.1016/j.cub.2008.04.015 · Cited by 137
Audio–visual speech perception is special
Tuomainen, J., Andersen, T., Tiippana, K. M., & Sams, M. E. (2004) · Cognition · doi:10.1016/j.cognition.2004.10.004 · Cited by 134
“loudness of the auditory stimuli (Rosenblum & Fowler, 1991; Grant & Seitz, 2000 ).”
BackgroundVatakis, A., & Spence, C. J. (2007) · Acta Psychologica · doi:10.1016/j.actpsy.2006.12.002 · Cited by 132
Is the integration of heard and seen speech mandatory for infants?
Desjardins, R. N., & Werker, J. F. (2004) · Developmental Psychobiology · doi:10.1002/dev.20033 · Cited by 131
Infants' Ability to Match Dynamic Phonetic and Gender Information in the Face and Voice
Patterson, M., & Werker, J. F. (2002) · Journal of Experimental Child Psychology · doi:10.1006/jecp.2001.2644 · Cited by 127
“These results, like those reported with adults ( Green & Kuhl, 1991 ), suggest that 4.5-month-old infants are able to ignore incongruent gender information in order to match on the basis of phonetic information in face and voice.”
BackgroundResultInfluentialFacial identity and facial speech processing: Familiar faces and voices in the McGurk effect
Walker, S., Bruce, V., & O’Malley, C. L. (1995) · Perception & Psychophysics · doi:10.3758/bf03208369 · Cited by 119
Deconstructing the McGurk–MacDonald illusion.
Soto‐Faraco, S., & Alsius, A. (2009) · Journal of Experimental Psychology Human Perception & Performance · doi:10.1037/a0013483 · Cited by 115
Forty Years After Hearing Lips and Seeing Voices: the McGurk Effect Revisited
Alsius, A., Paré, M., & Munhall, K. G. (2017) · Multisensory Research · doi:10.1163/22134808-00002565 · Cited by 114
“When considering the vowel contexts (i.e., /a/ and /i/), Green et al. (1991) found that A ibi + V igi stimuli produced more ‘d’ percepts, whereas the A aba + V aga produced more ‘th’ percepts.”
BackgroundSchweinberger, S. R., Robertson, D., & Kaufmann, J. M. (2007) · Quarterly Journal of Experimental Psychology · doi:10.1080/17470210601063589 · Cited by 102
Auditory-visual speech perception in normal-hearing and cochlear-implant listeners
Desai, S. B., Stickney, G. S., & Zeng, F. (2008) · The Journal of the Acoustical Society of America · doi:10.1121/1.2816573 · Cited by 103
Audiovisual integration in social evaluation.
Mileva, M., Tompkinson, J., Watt, D. J. L., & Burton, A. M. (2017) · Journal of Experimental Psychology Human Perception & Performance · doi:10.1037/xhp0000439 · Cited by 98
Lexical Influences in Audiovisual Speech Perception.
Brancazio, L. (2004) · Journal of Experimental Psychology Human Perception & Performance · doi:10.1037/0096-1523.30.3.445 · Cited by 97
Magnotti, J. F., & Beauchamp, M. S. (2017) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1005229 · Cited by 96
Paré, M., Richler, R. C., ten Hove, M., & Munhall, K. G. (2003) · Perception & Psychophysics · doi:10.3758/bf03194582 · Cited by 91
“This audiovisual illusion has been replicated numerous times, and some of the conditions influencing its perception have been identified (e.g., Green & Kuhl, 1989; Green, Kuhl, Meltzoff, & Stevens, 1991; MacDonald & McGurk, 1978; Massaro, 1987; Massaro & Cohen, 1993; Munhall, Gribble, Sacco, & Ward, 1996; Sekiyama & T…”
BackgroundEvaluating the independence of sex and expression in judgments of faces
Gal, P. M. L., & Bruce, V. (2002) · Perception & Psychophysics · doi:10.3758/bf03195789 · Cited by 82
“In an audiovisual study to investigate the independence of sex information and the analysis of facial speech, Green, Kuhl, Meltzoff, and Stevens (1991) found that mismatched male and female voices to female and male videotaped faces did not interfere with speech comprehension.”
BackgroundDissociating Face Processing Skills: Decisions about Lip read Speech, Expression, and Identity
Campbell, R., Brooks, B., de Haan, E. H. F., & Roberts, T. (1996) · The Quarterly Journal of Experimental Psychology Section A · doi:10.1080/027249896392649 · Cited by 77
Assessing the role of attention in the audiovisual integration of speech
Navarra, J., Alsius, A., Soto‐Faraco, S., & Spence, C. J. (2009) · Information Fusion · doi:10.1016/j.inffus.2009.04.001 · Cited by 85
Binding and unbinding the auditory and visual streams in the McGurk effect
Nahorna, O., Berthommier, F., & Schwartz, J. (2012) · The Journal of the Acoustical Society of America · doi:10.1121/1.4728187 · Cited by 80
Priming within and across Modalities: Exploring the Nature of rCBF Increases and Decreases
Badgaiyan, R. D., Schacter, D. L., & Alpert, N. M. (2001) · NeuroImage · doi:10.1006/nimg.2000.0693 · Cited by 75
“Perhaps when the priming ask requires identification of a target that had been tudied previously in a different voice, additional corical processing is required to “normalize” (cf., McCleland and Elman, 1986; Green et al., 1991) the stimulus o that the normalized test stimuli can be matched”
BackgroundSams, M. E., Manninen, P., Surakka, V., Helin, P., & Kättö, R. (1998) · Speech Communication · doi:10.1016/s0167-6393(98)00051-x · Cited by 76
The Distribution of Attention Across a Talker's Face
Thompson, L. A., Malmberg, J., Goodell, N. K., & Boring, R. L. (2004) · Discourse Processes · doi:10.1207/s15326950dp3801_6 · Cited by 74
Hearing facial identities: Brain correlates of face–voice integration in person identification
Schweinberger, S. R., Kloth, N., & Robertson, D. M. C. (2010) · Cortex · doi:10.1016/j.cortex.2010.11.011 · Cited by 74
Review of visual speech perception by hearing and hearing‐impaired people: clinical implications
Woodhouse, L., Hickson, L. M. H., & Dodd, B. J. (2008) · International Journal of Language & Communication Disorders · doi:10.1080/13682820802090281 · Cited by 78
Causality and cross-modal integration.
Schutz, M., & Kubovy, M. (2009) · Journal of Experimental Psychology Human Perception & Performance · doi:10.1037/a0016455 · Cited by 77
Meltzoff, A. N. (1993) · Advances in psychology · doi:10.1016/s0166-4115(08)60964-4 · Cited by 69
Self-citationMultisensory integration of speech signals: the relationship between space and time
Jones, J. A., & Jarick, M. (2006) · Experimental Brain Research · doi:10.1007/s00221-006-0634-0 · Cited by 71
“The McGurk eVect has been widely investigated (Green et al. 1991; Walker et al. 1995; Rosenblum et al. 1997; Sekiyama 1997; Hampson et al. 2003; Windmann 2004) and has served as a valuable tool for examining the integration of audiovisual speech signals.”
Audiovisual perception of openness and lip rounding in front vowels
Traunmüller, H., & Öhrström, N. (2006) · Journal of Phonetics · doi:10.1016/j.wocn.2006.03.002 · Cited by 72
Audio‐visual speech perception: a developmental ERP investigation
Knowland, V. C. P., Mercure, E., Karmiloff‐Smith, A., Dick, F., & Thomas, M. S. C. (2013) · Developmental Science · doi:10.1111/desc.12098 · Cited by 76
“Other illusions similarly involve visual cues altering the perceived content (Green, Kuhl, Meltzoff & Stevens, 1991) or location (Alais & Burr, 2004) of the auditory signal.”
Visual Influences on Auditory Behavioral, Neural, and Perceptual Processes: A Review
Opoku-Baah, C., Schoenhaut, A. M., Vassall, S. G., Tovar, D. A., Ramachandran, R., & Wallace, M. T. (2021) · Journal of the Association for Research in Otolaryngology · doi:10.1007/s10162-021-00789-0 · Cited by 86
“…this robustness, the McGurk illusion still occurs in comparable frequency when a point-light image is used to convey visual articulatory information instead of the facial features (Rosenblum and Saldaña 1996) and when the voice and the face of the speaker were gendermismatched (Green et al. 1991).”
BackgroundThe Recognition of Phonologically Assimilated Words Does Not Depend on Specific Language Experience
Holger Mitterer, A., Csépe, V., Honbolygó, F., & Blomert, L. (2006) · Cognitive Science · doi:10.1207/s15516709cog0000_57 · Cited by 64
Jordan, T. R., & Bevan, K. M. (1997) · Journal of Experimental Psychology Human Perception & Performance · doi:10.1037//0096-1523.23.2.388 · Cited by 63
Distinct cortical locations for integration of audiovisual speech and the McGurk effect
Erickson, L. C., Zielinski, B. A., Zielinski, J. E. V., Liu, G., Turkeltaub, P. E., Leaver, A. M., & Rauschecker, J. P. (2014) · Frontiers in Psychology · doi:10.3389/fpsyg.2014.00534 · Cited by 66
“…2010; Wiersinga-Post et al., 2010; Irwin et al., 2011; Nath et al., 2011; Nath and Beauchamp, 2012; Szycik et al., 2012) and behavioral studies (Green et al., 1991; Green and Norrix, 1997; Tiippana et al., 2004, 2011; Nahorna et al., 2012) of the McGurk effect have been published, as well as…”
BackgroundMethodPerceiving asynchronous bimodal speech in consonant-vowel and vowel syllables
Massaro, D. W., & Cohen, M. M. (1993) · Speech Communication · doi:10.1016/0167-6393(93)90064-r · Cited by 61
“Integration appears to occur when the two sources of auditory and visual information come from synthetic and/or natural speech (Massaro and Cohen, 1990, unpublished results), different spatial locations (Fisher, 1991) and different genders (Green et al., 1991).”
BackgroundVoice aftereffects of adaptation to speaker identity
Zäske, R., Schweinberger, S. R., & Kawahara, H. (2010) · Hearing Research · doi:10.1016/j.heares.2010.04.011 · Cited by 66
“This parallels reports from speech perception research according to which information about speaker gender is not integrated across modalities (Green et al., 1991; but see Smith et al., 2007).”
Kelly, S. D., & Lee, A. L. (2011) · Language and Cognitive Processes · doi:10.1080/01690965.2011.581125 · Cited by 58
“…of speech sounds, there will be exciting opportunities to link to the long-established literature on how speech is multimodally integrated with other prominent visual cues, such as the lips, mouth, and face (Green et al., 1991; Massaro & Cohen, 1983; Massaro & Jesse, 2007; Skipper et al., 2007).”
BackgroundEffects of Distance on Visual and Audiovisual Speech Recognition
Jordan, T. R., & Sergeant, P. (2000) · Language and Speech · doi:10.1177/00238309000430010401 · Cited by 58
“This finding is similar to those reported in previous studies of lip-read consonants (e.g., Binnie, Montgomery, & Jackson, 1974; Green et al., 1991; Jordan & Bevan, 1997; Jordan & Sergeant, 1998; Woodward & Barber, 1960).”
ResultStrand, J. F., Cooperman, A. W., Rowe, J., & Simenstad, A. (2014) · Journal of Speech Language and Hearing Research · doi:10.1044/2014_jslhr-h-14-0059 · Cited by 57
“…are of different genders, reduce the magnitude of, but do not eliminate, the illusion (Easton & Basala, 1982; Vatakis & Spence, 2007; but see also Green et al., 1991). trand et al.: Individual Differences in McGurk Susceptibility 2323 However, other work indicates that perception of the illusion…”
BackgroundGreen, K. P., & Gerdman, A. (1995) · Journal of Experimental Psychology Human Perception & Performance · doi:10.1037//0096-1523.21.6.1409 · Cited by 56
Self-citationAudiovisual gating and the time course of speech perception
Munhall, K. G., & Tohkura, Y. (1998) · The Journal of the Acoustical Society of America · doi:10.1121/1.423300 · Cited by 56
Hardison, D. M. (1996) · Language Learning · doi:10.1111/j.1467-1770.1996.tb00640.x · Cited by 59
Face and mouth inversion effects on visual and audiovisual speech perception.
Rosenblum, L. D., Yakel, D. A., & Green, K. P. (2000) · Journal of Experimental Psychology Human Perception & Performance · doi:10.1037//0096-1523.26.2.806 · Cited by 55
Self-citationPsychophysics of the McGurk and other audiovisual speech integration effects.
Jiang, J., & Bernstein, L. E. (2011) · Journal of Experimental Psychology Human Perception & Performance · doi:10.1037/a0023100 · Cited by 56
“" Although all of the metrics were viewed as problematic, the notion of a common metric or representation to explain AV speech perception has been extensively discussed in the literature (e.g., Bemstein, Auer, & Moore, 2004; Fowler, 2004; Green et al., 1991; Massaro, 1998; Rosenblum, 2008).”
Reading voices and hearing text: Talker-specific auditory imagery in reading.
Alexander, J. D., & Nygaard, L. C. (2008) · Journal of Experimental Psychology: Human Perception and Performance · doi:10.1037/0096-1523.34.2.446 · Cited by 101
Rapid, generalized adaptation to asynchronous audiovisual speech
der Burg, E. V., & Goodbourn, P. T. (2015) · Proceedings of the Royal Society B Biological Sciences · doi:10.1098/rspb.2014.3083 · Cited by 55
Auditory-Visual Integration for Speech by Children With and Without Specific Language Impairment
Norrix, L. W., Plante, E., Vance, R., & Boliek, C. A. (2007) · Journal of Speech Language and Hearing Research · doi:10.1044/1092-4388(2007/111 · Cited by 51
The noisy encoding of disparity model of the McGurk effect
Magnotti, J. F., & Beauchamp, M. S. (2014) · Psychonomic Bulletin & Review · doi:10.3758/s13423-014-0722-2 · Cited by 50
Perceiving speech from inverted faces
Massaro, D. W., & Cohen, M. M. (1996) · Perception & Psychophysics · doi:10.3758/bf03206832 · Cited by 50
Susceptibility to a multisensory speech illusion in older persons is driven by perceptual processes
Setti, A., Burke, K. E., Kenny, R. A., & Newell, F. N. (2013) · Frontiers in Psychology · doi:10.3389/fpsyg.2013.00575 · Cited by 49
“For example, susceptibility seems to be independent of facial identity, audio-visual co-location and synchrony (Green et al., 1991).”
BackgroundInfluentialA sex difference in visual influence on heard speech
Irwin, J., Whalen, D. H., & Fowler, C. (2006) · Perception & Psychophysics · doi:10.3758/bf03208760 · Cited by 54
Audiovisual speech perception: Moving beyond McGurk
Engen, K. J. V., Dey, A., Sommers, M. S., & Peelle, J. E. (2022) · The Journal of the Acoustical Society of America · doi:10.1121/10.0015262 · Cited by 45
Audiovisual integration as conflict resolution: The conflict of the McGurk illusion
Fernández, L. M., Macaluso, E., & Soto‐Faraco, S. (2017) · Human Brain Mapping · doi:10.1002/hbm.23758 · Cited by 46
“…AV integration process is considered to have happened) and MSI in general [e.g., Alsius et al., 2007; Andersen et al., 2009; Bernstein et al., 2008a; Green et al., 1991; Nahorna et al., 2012; Skipper et al., 2007; Soto-Faraco et al., 2005; Tiippana et al., 2004, 2011; van Wassenhove et al., 2007].”
BackgroundSekiyama, K. (1994) · Journal of the Acoustical Society of Japan (E) · doi:10.1250/ast.15.143 · Cited by 45
Speech Perception and Spoken Word Recognition: Research and Theory
Cleary, M., & Pisoni, D. B. (2008) · doi:10.1002/9780470753477.ch16 · Cited by 45
“---------------------------------------Insert Figure 6 about here ---------------------------------------The cohort model has been studied extensively using the gating paradigm introduced by Grosjean (1980). The gating paradigm asks listeners to identify a word given successively longer segments of the signal (usually…”
MethodWhat accounts for individual differences in susceptibility to the McGurk effect?
Brown, V. A., Hedayati, M., Zanger, A., Mayn, S., Ray, L., Dillman-Hasso, N. H., & Strand, J. F. (2018) · PLoS ONE · doi:10.1371/journal.pone.0207160 · Cited by 43
Interactions with Advanced Graphical Interfaces and the Deployment of Latent Human Knowledge
Barnard, P. J., & May, J. (1995) · Springer eBooks · doi:10.1007/978-3-642-87115-3_2 · Cited by 43
Faces and speech: Intermodal processing of biologically relevant signals in infants and adults.
Meltzoff, A. N., & Kuhl, P. K. (1994) · Cited by 44
Self-citationTop-down and bottom-up modulation of audiovisual integration in speech
Colin, C., Radeau, M., & Deltenre, P. (2005) · The European Journal of Cognitive Psychology · doi:10.1080/09541440440000168 · Cited by 41
Brancazio, L., & Miller, J. L. (2005) · Perception & Psychophysics · doi:10.3758/bf03193531 · Cited by 38
“The McGurk effect is phenomenally very compelling and has been replicated many times with different stimuli under a variety of manipulations (e.g., Green & Gerdeman, 1995; Green, Kuhl, Meltzoff, & Stevens, 1991; Jordan & Bevan, 1997; MacDonald & McGurk, 1978; Manuel, Repp, Liberman, & Studdert-Kennedy, 1983; Massaro &…”
BackgroundDiscrimination tests of visually influenced syllables
Rosenblum, L. D., & Saldaña, H. M. (1992) · Perception & Psychophysics · doi:10.3758/bf03206706 · Cited by 37
Acoustic Cues to Place of Articulation and the McGurk Effect
Green, K. P., & Norrix, L. W. (1997) · Journal of Speech Language and Hearing Research · doi:10.1044/jslhr.4003.646 · Cited by 37
Self-citationEffects of sentence context and expectation on the McGurk illusion
Windmann, S. (2003) · Journal of Memory and Language · doi:10.1016/j.jml.2003.10.001 · Cited by 39
“In summary, the McGurk illusion is widely considered to a highly autonomous phenomenon (Calvert et al., 1997; Dekle et al., 1992; Fowler & Dekle, 1991; Green et al., 1991; Langenmayr, 1997; Sams et al., 1998).”
BackgroundVisual speech primes open-set recognition of spoken words
Buchwald, A. B., Winters, S. J., & Pisoni, D. B. (2008) · Language and Cognitive Processes · doi:10.1080/01690960802536357 · Cited by 36
“It is also worth noting here that the McGurk effect (McGurk & MacDonald, 1976 ) is maintained even when there is a gender mismatch between the face producing the visual speech signal and the voice producing the auditory speech signal (Green, Kuhl, Meltzoff, & Stevens, 1991 ; also see Vatakis & Spence, 2007 for a detai…”
BackgroundHow do Humans Process and Recognize Speech?
Allen, J. B. (1995) · Springer eBooks · doi:10.1007/978-1-4615-2281-2_11 · Cited by 36
Nahorna, O., Berthommier, F., & Schwartz, J. (2015) · The Journal of the Acoustical Society of America · doi:10.1121/1.4904536 · Cited by 35
“, 2007), and even incoherence of 916 source identity, with a female face dubbed on a male voice (Green et al., 1991).”
BackgroundVisual and audiovisual speech perception with color and gray-scale facial images
Jordan, T. R., Mccotter, M. V., & Thomas, S. M. (2000) · Perception & Psychophysics · doi:10.3758/bf03212141 · Cited by 35
Surface form typicality and asymmetric transfer in episodic memory for spoken words.
Nygaard, L. C., Burt, S. A., & Queen, J. S. (2000) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037//0278-7393.26.5.1228 · Cited by 35
Cvejic, E., Kim, J., & Davis, C. (2011) · Cognition · doi:10.1016/j.cognition.2011.11.013 · Cited by 34
Audiovisual speech perception: A new approach and implications for clinical populations
IRWIN, J. R., & DiBlasi, L. (2017) · Language and Linguistics Compass · doi:10.1111/lnc3.12237 · Cited by 38
“Further, the original study by McGurk and MacDonald (1976) used CVCV clusters and many studies have used CVs (e.g., Burnham & Dodd, 1996; Green et al., 1991; Irwin, Tornatore, Brancazio, & Whalen, 2011) or VCVs (e.g. Jones & Callan, 2003; Munhall et al., 1996), all low‐level stimuli that carry little meaning for the a…”
MethodAuditory–visual speech integration by adults with and without language-learning disabilities
Norrix, L. W., Plante, E., & Vance, R. (2005) · Journal of Communication Disorders · doi:10.1016/j.jcomdis.2005.05.003 · Cited by 34
Metadata
- Authors
- Green, K. P., Kuhl, P. K., Meltzoff, A. N., & Stevens, E. B.
- Affiliations
- University of Arizona (US)
- University of Washington (US)
- Venue
- Perception & Psychophysics
- Published
- 1991-11
- Volume
- 50
- Issue
- 6
- Pages
- 524-536
- ISSN
- 0031-5117 (ISSN-L)
- 1532-5962
- OpenAlex
- W1976571557
- Cited by
- 239
- References
- 71
- Citations by year
- 2026: 12 · 2025: 3 · 2024: 2 · 2023: 1 · 2022: 3 · 2021: 6 · 2020: 4 · 2019: 6 · 2018: 6 · 2017: 16 · 2016: 5 · 2015: 8 · 2014: 3 · 2013: 7 · 2012: 7
- FWCI
- 9.05
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Licence
- www.springer.com/tdm (tdm)
- Locations
- Perception & Psychophysics (publishedVersion)
- PubMed (publishedVersion)
- Funders
- National Institutes of Health (1r29ns026475-01, 5r01hd018286-12)
- National Institute of Neurological Disorders and Stroke (NS-26475)
- Eunice Kennedy Shriver National Institute of Child Health and Human Development (HD18286)
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Multisensory perception and integration
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Phonetics and Phonology Research
- Physical Sciences › Computer Science › Signal Processing › Speech and Audio Processing
- Keywords
- McGurk effect, speech perception, audiovisual speech integration, voice characteristics, multisensory integration, phonetic processing
- MeSH terms
- Adult, Arousal, Attention, Discrimination Learning, Face, Gender Identity, Humans, Phonetics, Psychoacoustics, Speech Perception, Visual Perception, Voice Quality
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
