The DOI matches its Crossref record; 51 of the 51 references it cites were found in a registry or an index.
Temporal constraints on the McGurk effect
Open accessAbstract
Three experiments are reported on the influence of different timing relations on the McGurk effect. In the first experiment, it is shown that strict temporal synchrony between auditory and visual speech stimuli is not required for the McGurk effect. Subjects were strongly influenced by the visual stimuli when the auditory stimuli lagged the visual stimuli by as much as 180 msec. In addition, a stronger McGurk effect was found when the visual and auditory vowels matched. In the second experiment, we paired auditory and visual speech stimuli produced under different speaking conditions (fast, normal, clear). The results showed that the manipulations in both the visual and auditory speaking conditions independently influenced perception. In addition, there was a small but reliable tendency for the better matched stimuli to elicit more McGurk responses than unmatched conditions. In the third experiment, we combined auditory and visual stimuli produced under different speaking conditions (fast, clear) and delayed the acoustics with respect to the visual stimuli. The subjects showed the same pattern of results as in the second experiment. Finally, the delay did not cause different patterns of results for the different audiovisual speaking style combinations. The results suggest that perceivers may be sensitive to the concordance of the time-varying aspects of speech but they do not require temporal coincidence of that information.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“For example, seeing a person talking makes understanding easier, as compared with only hearing the person talking (Campbell, Dodd, & Burnham, 1998;Munhall, Gribble, Sacco, & Ward, 1996).”
From Augmented visual, auditory, haptic, and multimodal feedback in motor learning: A review (2013) · cites this paper as Munhall, Gribble, Sacco, & Ward, 1996
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hearing lips and seeing voices
MCGURK, H., & MACDONALD, J. (1976) · Nature · doi:10.1038/264746a0 · Cited by 6,183
A Multiple Comparison Procedure for Comparing Several Treatments with a Control
Dunnett, C. W. (1955) · Journal of the American Statistical Association · doi:10.1080/01621459.1955.10501294 · Cited by 6,097
Perception of the speech code.
Liberman, A. M., Cooper, F. S., Shankweiler, D. P., & Studdert-Kennedy, M. (1967) · Psychological Review · doi:10.1037/h0020279 · Cited by 3,722
Visual Contribution to Speech Intelligibility in Noise
Sumby, W. H., & Pollack, I. (1954) · The Journal of the Acoustical Society of America · doi:10.1121/1.1907309 · Cited by 2,583
Explaining Phonetic Variation: A Sketch of the H&H Theory
Lindblom, B. E. F. (1990) · Springer eBooks · doi:10.1007/978-94-009-2037-8_16 · Cited by 1,887
A Multiple Comparison Procedure for Comparing Several Treatments with a Control
Dunnett, C. W. (1955) · Journal of the American Statistical Association · doi:10.2307/2281208 · Cited by 1,430
Immediate perceptual response to intersensory discrepancy.
Welch, R. B., & Warren, D. H. (1980) · Psychological Bulletin · doi:10.1037/0033-2909.88.3.638 · Cited by 1,176
Progress in the psychology of language
Ellis, A. W. (1985) · Lawrence Erlbaum Associates eBooks · Cited by 1,079
Perceived order in different sense modalities.
Hirsh, I. J., & Sherrick, C. E. (1961) · Journal of Experimental Psychology · doi:10.1037/h0045283 · Cited by 700
Speaking Clearly for the Hard of Hearing I
Picheny, M., Durlach, N. I., & Braida, L. D. (1985) · Journal of Speech Language and Hearing Research · doi:10.1044/jshr.2801.96 · Cited by 466
Visual influences on speech perception processes
Macdonald, J. B., & McGurk, H. (1978) · Perception & Psychophysics · doi:10.3758/bf03206096 · Cited by 465
Some preliminaries to a comprehensive account of audio-visual speech perception.
Summerfield, Q. A. (1987) · Cited by 417
The Detection of Auditory Visual Desynchrony
Dixon, N. F., & Spitz, L. (1980) · Perception · doi:10.1068/p090719 · Cited by 404
Sensory conflict in judgments of spatial direction
Pick, H. L., Warren, D. H., & Hay, J. C. (1969) · Perception & Psychophysics · doi:10.3758/bf03207017 · Cited by 385
Lipreading and audio-visual speech perception
Summerfield, A. Q. (1992) · Philosophical Transactions of the Royal Society B Biological Sciences · doi:10.1098/rstb.1992.0009 · Cited by 371
Hearing by Eye: The Psychology of Lip-Reading
Repp, B. H., Dodd, B. J., & Campbell, R. (1988) · The American Journal of Psychology · doi:10.2307/1423237 · Cited by 320
Numerical Model of Coarticulation
Öhman, S. E. G. (1967) · The Journal of the Acoustical Society of America · doi:10.1121/1.1910340 · Cited by 299
Sekiyama, K., & Tohkura, Y. (1991) · The Journal of the Acoustical Society of America · doi:10.1121/1.401660 · Cited by 286
Hearing by eye—the psychology of lip reading
Montgomery, G. W. G. (1988) · Behaviour Research and Therapy · doi:10.1016/0005-7967(88)90161-1 · Cited by 272
Contributions of audition and vision to temporal rate perception
Welch, R. B., DutionHurt, L. D., & Warren, D. H. D. (1986) · Perception & Psychophysics · doi:10.3758/bf03204939 · Cited by 243
Green, K. P., Kuhl, P. K., Meltzoff, A. N., & Stevens, E. B. (1991) · Perception & Psychophysics · doi:10.3758/bf03207536 · Cited by 239
On the perceptual organization of speech.
Remez, R. E., Rubin, P. E., Berns, S. M., Pardo, J. S., & Lang, J. M. (1994) · Psychological Review · doi:10.1037/0033-295x.101.1.129 · Cited by 234
Intermodal timing relations and audio-visual speech recognition by normal-hearing adults
McGrath, M., & Summerfield, Q. (1985) · The Journal of the Acoustical Society of America · doi:10.1121/1.392336 · Cited by 201
Listening with eye and hand: Cross-modal contributions to speech perception.
Fowler, C. A., & Dekle, D. J. (1991) · Journal of Experimental Psychology: Human Perception and Performance · doi:10.1037/0096-1523.17.3.816 · Cited by 183
Effect of speaking rate on vowel formant movements
Gay, T. (1978) · The Journal of the Acoustical Society of America · doi:10.1121/1.381717 · Cited by 183
Crossmodal Integration in the Identification of Consonant Segments
Braida, L. D. (1991) · The Quarterly Journal of Experimental Psychology Section A · doi:10.1080/14640749108400991 · Cited by 172
Perception of asynchronous and conflicting visual and auditory speech
Massaro, D. W., Cohen, M. M., & Smeele, P. M. T. (1996) · The Journal of the Acoustical Society of America · doi:10.1121/1.417342 · Cited by 148
Detection and Resolution of Audio-Visual Incompatibility in the Perception of Vowels
Summerfield, A. Q., & McGrath, M. (1984) · The Quarterly Journal of Experimental Psychology Section A · doi:10.1080/14640748408401503 · Cited by 145
Variant and invariant characteristics of speech movements
Gracco, V. L., & Abbs, J. H. (1986) · Experimental Brain Research · doi:10.1007/bf00243838 · Cited by 126
Mechanisms in the Control of Speech Rate
Gay, T. (1981) · Phonetica · doi:10.1159/000260020 · Cited by 125
Some effects of speaking rate on the production of /b/ and /w/
Miller, J. L., & Baer, T. (1983) · The Journal of the Acoustical Society of America · doi:10.1121/1.389399 · Cited by 124
Speech Perception By Ear and Eye
Massaro, D. W., & Simpson, J. A. (2014) · Psychology Press eBooks · doi:10.4324/9781315808253 · Cited by 110
On the role of visual rate information in phonetic perception
Green, K. P., & Miller, J. L. (1985) · Perception & Psychophysics · doi:10.3758/bf03207154 · Cited by 92
The role of visual information in the processing of
Green, K. P., & Kuhl, P. K. (1989) · Perception & Psychophysics · doi:10.3758/bf03208030 · Cited by 92
Integral processing of visual place and auditory voicing information during phonetic perception.
Green, K. P., & Kuhl, P. K. (1991) · Journal of Experimental Psychology Human Perception & Performance · doi:10.1037//0096-1523.17.1.278 · Cited by 81
Abry, C., & Boë, L.-J. (1986) · Speech Communication · doi:10.1016/0167-6393(86)90032-4 · Cited by 64
Perceiving asynchronous bimodal speech in consonant-vowel and vowel syllables
Massaro, D. W., & Cohen, M. M. (1993) · Speech Communication · doi:10.1016/0167-6393(93)90064-r · Cited by 61
Green, K. P., & Gerdman, A. (1995) · Journal of Experimental Psychology Human Perception & Performance · doi:10.1037//0096-1523.21.6.1409 · Cited by 56
Disruptive effects of auditory signal delay on speech perception with lipreading.
Pc, P., Kunov, H., & Abel, S. M. (1986) · PubMed · Cited by 43
Manuel, S. Y., Repp, B. H., Studdert‐Kennedy, M., & Liberman, A. M. (1983) · The Journal of the Acoustical Society of America · doi:10.1121/1.2021085 · Cited by 32
Green, K. P., Kuhl, P. K., & Meltzoff, A. N. (1988) · The Journal of the Acoustical Society of America · doi:10.1121/1.2025888 · Cited by 31
Effect of Video Frame Rate on Subjects’ Ability to Shadow One of Two Competing Verbal Passages
Vitkovitch, M., & BARBER, P. J. (1994) · Journal of Speech Language and Hearing Research · doi:10.1044/jshr.3705.1204 · Cited by 30
Heat pain thresholds in the oral-facial region
Green, B. G. (1985) · Perception & Psychophysics · doi:10.3758/bf03198847 · Cited by 29
Green, K. P., & Gerdman, A. (1995) · Journal of Experimental Psychology Human Perception & Performance · doi:10.1037/0096-1523.21.6.1409 · Cited by 28
Talker continuity and the use of rate information during phonetic perception
Green, K. P., Stevens, E. B., & Kuhl, P. K. (1994) · Perception & Psychophysics · doi:10.3758/bf03207596 · Cited by 23
The perception of speaking rate using visual information from a talker’s face
Green, K. P. (1987) · Perception & Psychophysics · doi:10.3758/bf03207990 · Cited by 22
Motion measurement using the Peak Performance Technologies system
Scheirman, G. L., & Cheetham, P. J. (1990) · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · doi:10.1117/12.23895 · Cited by 12
Intelligibility of audio-visually desynchronised speech: asymmetrical effect of phoneme position
Smeele, P. M. T., Sittig, A. C., & van Heuven, V. J. (1992) · International Conference on Spoken Language Processing (ICSLP) · doi:10.21437/icslp.1992-19 · Cited by 10
Temporal organization of bimodal speech information
Smeele, P. M. T., Sittig, A. C., & van Heuven, V. J. (1994) · International Conference on Spoken Language Processing (ICSLP) · doi:10.21437/icslp.1994-372 · Cited by 3
Listener eye movement behavior during audiovisual speech perception
Vatikiotis‐Bateson, E., Eigsti, I., & Yano, S. (1994) · International Conference on Spoken Language Processing (ICSLP) · doi:10.21437/icslp.1994-134 · Cited by 3
Kashino, M., & Craig, C. H. (1994) · International Conference on Spoken Language Processing (ICSLP) · doi:10.21437/icslp.1994-514 · Cited by 3
Flagged first, then by citations
Research works printed but not linked: 7
- Bernstein, L. E., Coulter, D., O’Connell, M. P., Eberhardt, S., & Demorest, M. (1992, June).Vibrotactile and haptic speech codes. Paper presented at the Second International Conference on Tactile Aids, Hearing Aids, & Cochlear Implants, Stockholm.
- Cohen, M. M. (1984).Processing of visual and auditory information in speech perception. Unpublished doctoral dissertation, University of California, Santa Cruz.
- Gagne, J.-P., Masterson, V., Munhall, K. G., Bilida, N., &Querengesser, C. (1994). Across talker variability in speech intelligibility for conversational and clear speech: A crossmodal investigation.Journal of the Academy of Rehabilitative Audiology,27, 133–158.
- Gerdeman, A. (1994).Temporal incongruity and the McGurk effect. Unpublished master’s thesis, University of Arizona, Tucson.
- Remez, R. E., & Rubin, P. E. (in press). Acoustic shards, perceptual glue. In J. Charles-Luce, P. A. Luce, & J. R. Sawusch (Eds.),Theories in spoken language: Perception, production, and development. Norwood, NJ: Ablex.
- Tillmann, H. G., Pompino-Marschall, B., &Porzig, H. (1984). Zum Einfluß visuell dargeborener Sprachbewegungen auf die Wahrnehmung der akustisch kodierten Artikulation.Forschungsberichte des Instituts f ür Phonetik und Sprachliche Kommunikation der Universität München,19, 318–338.
- Ward, M. (1992).The effect of auditory-visual dysynchrony on the integration of auditory and visual information in speech perception. Unpublished bachelor’s thesis, Queen’s University, Kingston, Ontario.
Cited by
Sorted by citations
Augmented visual, auditory, haptic, and multimodal feedback in motor learning: A review
Sigrist, R., Rauter, G., Riener, R., & Wolf, P. (2013) · Psychonomic Bulletin & Review · doi:10.3758/s13423-012-0333-8 · Cited by 1,416
Causal Inference in Multisensory Perception
Körding, K. P., Beierholm, U., Ma, W. J., Quartz, S., Tenenbaum, J. B., & Shams, L. (2007) · PLoS ONE · doi:10.1371/journal.pone.0000943 · Cited by 1,069
Visual speech speeds up the neural processing of auditory speech
van Wassenhove, V., Grant, K. W., & Poeppel, D. (2005) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0408949102 · Cited by 882
The Natural Statistics of Audiovisual Speech
Chandrasekaran, C., Wieckowski, A. T., Stillittano, S., Caplier, A., & Ghazanfar, A. A. (2009) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1000436 · Cited by 648
Temporal window of integration in auditory-visual speech perception
van Wassenhove, V., Grant, K. W., & Poeppel, D. (2006) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2006.01.001 · Cited by 649
Metadata
- Authors
- Munhall, K. G., Gribble, P., Sacco, L., & Ward, M.
- Affiliations
- Queen's University (CA)
- McGill University (CA)
- Corresponding author
- Munhall, K. G.
- ORCID
- Gribble, P.
- Venue
- Perception & Psychophysics
- Published
- 1996-01
- Volume
- 58
- Issue
- 3
- Pages
- 351-362
- ISSN
- 0031-5117 (ISSN-L)
- 1532-5962
- OpenAlex
- W2061698928
- Cited by
- 358
- References
- 50
- Citations by year
- 2026: 3 · 2025: 6 · 2024: 9 · 2023: 9 · 2022: 8 · 2021: 7 · 2020: 21 · 2019: 14 · 2018: 21 · 2017: 13 · 2016: 18 · 2015: 11 · 2014: 14 · 2013: 10 · 2012: 18
- FWCI
- 8.72
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Licence
- www.springer.com/tdm (tdm)
- Locations
- Perception & Psychophysics (publishedVersion)
- PubMed (publishedVersion)
- Funders
- National Institute on Deafness and Other Communication Disorders (R01DC000594, DC-00594)
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Multisensory perception and integration
- Physical Sciences › Computer Science › Signal Processing › Speech and Audio Processing
- Life Sciences › Neuroscience › Cognitive Neuroscience › Tactile and Sensory Interactions
- Keywords
- McGurk effect, audiovisual speech perception, temporal synchronization, audiovisual integration, vowel perception, speech rate, speech style, multisensory integration
- MeSH terms
- Attention, Humans, Lipreading, Paired-Associate Learning, Phonetics, Psychoacoustics, Speech Intelligibility, Speech Perception, Time Perception
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review