The DOI matches its Crossref record; 51 of the 51 references it cites were found in a registry or an index.
Temporal constraints on the McGurk effect
Open accessAbstract
Three experiments are reported on the influence of different timing relations on the McGurk effect. In the first experiment, it is shown that strict temporal synchrony between auditory and visual speech stimuli is not required for the McGurk effect. Subjects were strongly influenced by the visual stimuli when the auditory stimuli lagged the visual stimuli by as much as 180 msec. In addition, a stronger McGurk effect was found when the visual and auditory vowels matched. In the second experiment, we paired auditory and visual speech stimuli produced under different speaking conditions (fast, normal, clear). The results showed that the manipulations in both the visual and auditory speaking conditions independently influenced perception. In addition, there was a small but reliable tendency for the better matched stimuli to elicit more McGurk responses than unmatched conditions. In the third experiment, we combined auditory and visual stimuli produced under different speaking conditions (fast, clear) and delayed the acoustics with respect to the visual stimuli. The subjects showed the same pattern of results as in the second experiment. Finally, the delay did not cause different patterns of results for the different audiovisual speaking style combinations. The results suggest that perceivers may be sensitive to the concordance of the time-varying aspects of speech but they do not require temporal coincidence of that information.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“For example, seeing a person talking makes understanding easier, as compared with only hearing the person talking (Campbell, Dodd, & Burnham, 1998;Munhall, Gribble, Sacco, & Ward, 1996).”
From Augmented visual, auditory, haptic, and multimodal feedback in motor learning: A review (2013) · cites this paper as Munhall, Gribble, Sacco, & Ward, 1996
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hearing lips and seeing voices
MCGURK, H., & MACDONALD, J. (1976) · Nature · doi:10.1038/264746a0 · Cited by 6,183
A Multiple Comparison Procedure for Comparing Several Treatments with a Control
Dunnett, C. W. (1955) · Journal of the American Statistical Association · doi:10.1080/01621459.1955.10501294 · Cited by 6,097
Perception of the speech code.
Liberman, A. M., Cooper, F. S., Shankweiler, D. P., & Studdert-Kennedy, M. (1967) · Psychological Review · doi:10.1037/h0020279 · Cited by 3,722
Visual Contribution to Speech Intelligibility in Noise
Sumby, W. H., & Pollack, I. (1954) · The Journal of the Acoustical Society of America · doi:10.1121/1.1907309 · Cited by 2,583
Explaining Phonetic Variation: A Sketch of the H&H Theory
Lindblom, B. E. F. (1990) · Springer eBooks · doi:10.1007/978-94-009-2037-8_16 · Cited by 1,887
A Multiple Comparison Procedure for Comparing Several Treatments with a Control
Dunnett, C. W. (1955) · Journal of the American Statistical Association · doi:10.2307/2281208 · Cited by 1,430
Immediate perceptual response to intersensory discrepancy.
Welch, R. B., & Warren, D. H. (1980) · Psychological Bulletin · doi:10.1037/0033-2909.88.3.638 · Cited by 1,176
Progress in the psychology of language
Ellis, A. W. (1985) · Lawrence Erlbaum Associates eBooks · Cited by 1,079
Perceived order in different sense modalities.
Hirsh, I. J., & Sherrick, C. E. (1961) · Journal of Experimental Psychology · doi:10.1037/h0045283 · Cited by 700
Speaking Clearly for the Hard of Hearing I
Picheny, M., Durlach, N. I., & Braida, L. D. (1985) · Journal of Speech Language and Hearing Research · doi:10.1044/jshr.2801.96 · Cited by 466
Flagged first, then by citations
Research works printed but not linked: 7
- Bernstein, L. E., Coulter, D., O’Connell, M. P., Eberhardt, S., & Demorest, M. (1992, June).Vibrotactile and haptic speech codes. Paper presented at the Second International Conference on Tactile Aids, Hearing Aids, & Cochlear Implants, Stockholm.
- Cohen, M. M. (1984).Processing of visual and auditory information in speech perception. Unpublished doctoral dissertation, University of California, Santa Cruz.
- Gagne, J.-P., Masterson, V., Munhall, K. G., Bilida, N., &Querengesser, C. (1994). Across talker variability in speech intelligibility for conversational and clear speech: A crossmodal investigation.Journal of the Academy of Rehabilitative Audiology,27, 133–158.
- Gerdeman, A. (1994).Temporal incongruity and the McGurk effect. Unpublished master’s thesis, University of Arizona, Tucson.
- Remez, R. E., & Rubin, P. E. (in press). Acoustic shards, perceptual glue. In J. Charles-Luce, P. A. Luce, & J. R. Sawusch (Eds.),Theories in spoken language: Perception, production, and development. Norwood, NJ: Ablex.
- Tillmann, H. G., Pompino-Marschall, B., &Porzig, H. (1984). Zum Einfluß visuell dargeborener Sprachbewegungen auf die Wahrnehmung der akustisch kodierten Artikulation.Forschungsberichte des Instituts f ür Phonetik und Sprachliche Kommunikation der Universität München,19, 318–338.
- Ward, M. (1992).The effect of auditory-visual dysynchrony on the integration of auditory and visual information in speech perception. Unpublished bachelor’s thesis, Queen’s University, Kingston, Ontario.
Cited by
Sorted by citations
Augmented visual, auditory, haptic, and multimodal feedback in motor learning: A review
Sigrist, R., Rauter, G., Riener, R., & Wolf, P. (2013) · Psychonomic Bulletin & Review · doi:10.3758/s13423-012-0333-8 · Cited by 1,416
Causal Inference in Multisensory Perception
Körding, K. P., Beierholm, U., Ma, W. J., Quartz, S., Tenenbaum, J. B., & Shams, L. (2007) · PLoS ONE · doi:10.1371/journal.pone.0000943 · Cited by 1,069
Visual speech speeds up the neural processing of auditory speech
van Wassenhove, V., Grant, K. W., & Poeppel, D. (2005) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0408949102 · Cited by 882
The Natural Statistics of Audiovisual Speech
Chandrasekaran, C., Wieckowski, A. T., Stillittano, S., Caplier, A., & Ghazanfar, A. A. (2009) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1000436 · Cited by 648
Temporal window of integration in auditory-visual speech perception
van Wassenhove, V., Grant, K. W., & Poeppel, D. (2006) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2006.01.001 · Cited by 649
Metadata
- Authors
- Munhall, K. G., Gribble, P., Sacco, L., & Ward, M.
- Affiliations
- Queen's University (CA)
- McGill University (CA)
- Corresponding author
- Munhall, K. G.
- ORCID
- Gribble, P.
- Venue
- Perception & Psychophysics
- Published
- 1996-01
- Volume
- 58
- Issue
- 3
- Pages
- 351-362
- ISSN
- 0031-5117 (ISSN-L)
- 1532-5962
- OpenAlex
- W2061698928
- Cited by
- 358
- References
- 50
- Citations by year
- 2026: 3 · 2025: 6 · 2024: 9 · 2023: 9 · 2022: 8 · 2021: 7 · 2020: 21 · 2019: 14 · 2018: 21 · 2017: 13 · 2016: 18 · 2015: 11 · 2014: 14 · 2013: 10 · 2012: 18
- FWCI
- 8.72
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Licence
- www.springer.com/tdm (tdm)
- Locations
- Perception & Psychophysics (publishedVersion)
- PubMed (publishedVersion)
- Funders
- National Institute on Deafness and Other Communication Disorders (R01DC000594, DC-00594)
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Multisensory perception and integration
- Physical Sciences › Computer Science › Signal Processing › Speech and Audio Processing
- Life Sciences › Neuroscience › Cognitive Neuroscience › Tactile and Sensory Interactions
- Keywords
- McGurk effect, audiovisual speech perception, temporal synchronization, audiovisual integration, vowel perception, speech rate, speech style, multisensory integration
- MeSH terms
- Attention, Humans, Lipreading, Paired-Associate Learning, Phonetics, Psychoacoustics, Speech Intelligibility, Speech Perception, Time Perception
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
