Cited by 183Multisensory perception and integrationPhonetics and Phonology ResearchTactile and Sensory Interactions

The DOI matches its Crossref record; 25 of the 25 references it cites were found in a registry or an index.

Listening with eye and hand: Cross-modal contributions to speech perception.

Fowler, Carol A., Dekle, Dawn J.·1991·Journal of Experimental Psychology: Human Perception and Performance

Open this paper in CoChat — free account

Abstract

Three experiments investigated the "McGurk effect" whereby optically specified syllables experienced synchronously with acoustically specified syllables integrate in perception to determine a listener's auditory perceptual experience. Experiments contrasted the cross-modal effect of orthographic on acoustic syllables presumed to be associated in experience and memory with that of haptically experienced and acoustic syllables presumed not to be associated. The latter pairing gave rise to cross-modal influences when Ss were informed that cross-modal syllables were paired independently. Mouthed syllables affected reports of simultaneously heard syllables (and vice versa). These effects were absent when syllables were simultaneously seen (spelled) and heard. The McGurk effect does not arise from association in memory but from conjoint near specification of the same causal source in the environment--in speech, the moving vocal tract producing phonetic gestures.

Integrity signals

Registry

Crossref · 10.1037/0096-1523.17.3.816

Cites

25 of 25 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

The Ecological Approach to Visual Perception
Bornstein, M. H., & Gibson, J. J. (1980) · The Journal of Aesthetics and Art Criticism · doi:10.2307/429816 · Cited by 22,935
The Senses Considered as Perceptual Systems
West, C. K., & Gibson, J. J. (1969) · Journal of Aesthetic Education · doi:10.2307/3331482 · Cited by 6,344
Hearing lips and seeing voices
MCGURK, H., & MACDONALD, J. (1976) · Nature · doi:10.1038/264746a0 · Cited by 6,183
Journal of Experimental Psychology: Human Learning and Memory
Bourne, L. E. (1977) · Cited by 4,328
Perception of the speech code.
Liberman, A. M., Cooper, F. S., Shankweiler, D. P., & Studdert-Kennedy, M. (1967) · Psychological Review · doi:10.1037/h0020279 · Cited by 3,722
The motor theory of speech perception revised
Liberman, A. M., & Mattingly, I. G. (1985) · Cognition · doi:10.1016/0010-0277(85)90021-6 · Cited by 2,970
Individual Choice Behavior
Luce, R. (1959) · Econometrica · doi:10.2307/1911299 · Cited by 2,603
Visual Contribution to Speech Intelligibility in Noise
Sumby, W. H., & Pollack, I. (1954) · The Journal of the Acoustical Society of America · doi:10.1121/1.1907309 · Cited by 2,583
An event approach to the study of speech perception from a direct–realist perspective
Fowler, C. A. (1986) · Journal of Phonetics · doi:10.1016/s0095-4470(19)30607-2 · Cited by 771
Self-citation
Speech perception by ear and eye a paradigm for psychological inquiry
Massaro, D. W. (1987) · Cited by 585

Show all 25 references

Sorted by citations

Items 101–183 of 183

Auditory-orthographic integration at the onset of L2 speech acquisition
Rafat, Y., & Stevenson, R. A. (2018) · Language and Speech · doi:10.1177/0023830918777537 · Cited by 14
Neuroimaging Studies of Cross-Modal Plasticity and Language Processing in Deaf People
Campbell, R., & MacSweeney, M. (2004) · The MIT Press eBooks · doi:10.7551/mitpress/3422.003.0057 · Cited by 13
Correlation versus causation in multisensory perception
Holger Mitterer, A., & Jesse, A. (2010) · Psychonomic Bulletin & Review · doi:10.3758/pbr.17.3.329 · Cited by 12
A universal bias in adult vowel perception – By ear or by eye
Masapollo, M., Polka, L., & Ménard, L. (2017) · Cognition · doi:10.1016/j.cognition.2017.06.001 · Cited by 12
Feel What You Say: An Auditory Effect on Somatosensory Perception
Champoux, F., Shiller, D. M., & Zatorre, R. J. (2011) · PLoS ONE · doi:10.1371/journal.pone.0022829 · Cited by 12
Speech Misperception: Speaking and Seeing Interfere Differently with Hearing
Mochida, T., Kimura, T., Hiroya, S., Kitagawa, N., Gomi, H., & Kondo, T. (2013) · PLoS ONE · doi:10.1371/journal.pone.0068619 · Cited by 11
Speech is not special… again
Carbonell, K. M., & Lotto, A. J. (2014) · Frontiers in Psychology · doi:10.3389/fpsyg.2014.00427 · Cited by 11
Speakers are able to categorize vowels based on tongue somatosensation
Patri, J.-F., Ostry, D. J., Diard, J., Schwartz, J., Trudeau-Fisette, P., Savariaux, C., & Perrier, P. (2020) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1911142117 · Cited by 12
Perception of /r/ and /l/ in a stop cluster: Evidence of cross-modal context effects.
Green, K. P., & Norrix, L. W. (2001) · Journal of Experimental Psychology Human Perception & Performance · doi:10.1037/0096-1523.27.1.166 · Cited by 11
Learning to use an artificial visual cue in speech identification
Stephens, J. D. W., & Holt, L. L. (2010) · The Journal of the Acoustical Society of America · doi:10.1121/1.3479537 · Cited by 10
Perceptual Integration of Visual Evidence of the Airstream from Aspirated Stops.
Mayer, C., Gick, B., Weigel, T., & Whalen, D. H. (2013) · Canadian acoustics · Cited by 9
Multisensory Interactions in Speech Perception
Navarra, J., Yeung, H. H., Werker, J. F., & Soto‐Faraco, S. (2012) · The MIT Press eBooks · doi:10.7551/mitpress/8466.003.0038 · Cited by 9
Visual speech influences speech perception immediately but not automatically
Holger Mitterer, A., & Reinisch, E. (2016) · Attention Perception & Psychophysics · doi:10.3758/s13414-016-1249-6 · Cited by 10
Speaker Variations Influence Speechreading Speed for Dynamic Faces
Kaufmann, J. M., & Schweinberger, S. R. (2005) · Perception · doi:10.1068/p5104 · Cited by 9
Examining the Interactivity of Lexical Orthographic and Phonological Processing.
Owen, W. J., & Borowsky, R. (2003) · Canadian Journal of Experimental Psychology/Revue canadienne de psychologie expérimentale · doi:10.1037/h0087432 · Cited by 9
Influences of selective adaptation on perception of audiovisual speech
Dias, J. W., Cook, T. C., & Rosenblum, L. D. (2016) · Journal of Phonetics · doi:10.1016/j.wocn.2016.02.004 · Cited by 9
Electrophysiological evidence for Audio-visuo-lingual speech integration
Treille, A., Vilain, C., Schwartz, J., Hueber, T., & Sato, M. (2017) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2017.12.024 · Cited by 9
A Model of Perceptual Change by Domain Integration
Westermann, G. (2001) · Cited by 9
Visual Speech Perception Cues Constrain Patterns of Articulatory Variation and Sound Change
Havenhill, J., & Do, Y. (2018) · Frontiers in Psychology · doi:10.3389/fpsyg.2018.00728 · Cited by 8
Compatible Dynamical Models of Environmental, Sensory, and Perceptual Systems
Iskarous, K. (2016) · Ecological Psychology · doi:10.1080/10407413.2016.1230377 · Cited by 8
O efeito dos estimulos auditivo e visual na percepção dos marcadores prosodicos lexicais e graficos usados na escrita do portugues brasileiro
Pacheco, V. (2006) · doi:10.47749/t/unicamp.2006.391098 · Cited by 8
Visual Facial Enhancements Can Significantly Improve Speech Perception in the Presence of Noise
Choudhary, Z. D., Bruder, G., & Welch, G. (2023) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2023.3320247 · Cited by 7
Why Early Tactile Speech Aids May Have Failed: No Perceptual Integration of Tactile and Auditory Signals
Rizza, A., Terekhov, A. V., Montone, G., Belardinelli, M. O., & O'Regan, J. K. (2018) · Frontiers in Psychology · doi:10.3389/fpsyg.2018.00767 · Cited by 6
Mechanisms of Semantic Ambiguity Resolution: Insights from Speech Perception
Mirman, D. (2008) · Research on Language and Computation · doi:10.1007/s11168-008-9055-5 · Cited by 6
Perceiving Articulatory Events
Rosenblum, L. D. (2004) · Elsevier eBooks · doi:10.1016/b978-012515851-0/50010-2 · Cited by 6
Primacy of Multimodal Speech Perception for the Brain and Science
Rosenblum, L. D., & Dorsi, J. (2021) · Wiley eBooks · doi:10.1002/9781119184096.ch2 · Cited by 6
Aero-tactile integration during speech perception: Effect of response and stimulus characteristics on syllable identification
Derrick, D., Madappallimattam, J., & Theys, C. (2019) · The Journal of the Acoustical Society of America · doi:10.1121/1.5125131 · Cited by 5
What you hear and see specifies the perception of a limb-respiratory-vocal act
Pouw, W. T. J. L., & Dixon, J. A. (2022) · Proceedings of the Royal Society B Biological Sciences · doi:10.1098/rspb.2022.1026 · Cited by 6
Speech Perception as a Perceptuo-Motor Skill
Fowler, C. A. (2015) · Elsevier eBooks · doi:10.1016/b978-0-12-407794-2.00015-8 · Cited by 4
Self-citation
Cross-modal noise compensation in audiovisual words
Baart, M., Armstrong, B. C., Martin, C. D., Frost, R., & Carreiras, M. (2017) · Scientific Reports · doi:10.1038/srep42055 · Cited by 4
The McGurk Effect and the Primacy of Multisensory Perception
Dias, J. W., Cook, T. C., & Rosenblum, L. D. (2017) · doi:10.1093/acprof:oso/9780199794607.003.0115 · Cited by 4
Some Theoretical Implications of Cross-Modal Research in Speech Perception
Studdert‐Kennedy, M. (1993) · Springer eBooks · doi:10.1007/978-94-015-8234-6_37 · Cited by 4
Condiciones de adquisición de la lectura en el niño sordo
Iscoa, J. A. (1999) · Revista de Logopedia Foniatría y Audiología · doi:10.1016/s0214-4603(99)75716-5 · Cited by 4
Do infants detect A→V articulator congruency for non-native click consonants?
Best, C. T., Kroos, C. H., & IRWIN, J. R. (2011) · eSpace (Curtin University) · Cited by 3
Aero-tactile influence on speech perception of voicing continua.
Goldenberg, D., Tiede, M., & Whalen, D. H. (2015) · ICPhS · Cited by 3
A Voice is a Face is a Voice: Cross-Modal Source Identification of Indexical Information in Speech
Lachs, L. (1999) · Cited by 3
Acoustic specification of upper limb movement in voicing: Exploratory data report and pre-registrationPreprint
Pouw, W. T. J. L., Paxton, A., Harrison, S. A., & Dixon, J. A. (2019) · doi:10.31234/osf.io/5rcdu · Cited by 3
Changes in the McGurk Effect Across Phonetic Contexts
Hampson, M., Guenther, F. H., Cohen, M. A., & Nieto-Castañón, A. (2003) · Cited by 2
Effects of Native Language on Compensation for Coarticulation
Kang, S., Johnson, K. A., & Finley, G. (2015) · UC Berkeley Phonology Lab Annual Reports · doi:10.5070/p71g9671sr · Cited by 2
Congruent aero-tactile stimuli bias perception of voicing continua
Goldenberg, D., Tiede, M., Bennett, R. T., & Whalen, D. H. (2022) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2022.879981 · Cited by 2
Multimodal Speech: Two or Three Senses are Better than One
Schwartz, J., Escudier, P., & Teissier, P. (2009) · doi:10.1002/9780470611180.ch11 · Cited by 2
Orofacial Cutaneous Function in Speech Motor Control and Learning
Ito, T. (2015) · Wiley eBooks · doi:10.1002/9781118584156.ch12 · Cited by 2
Audiovisual fusion in finnish syllables and words.
Sams, M. E., Surakka, V., Helin, P., & Kättö, R. (1997) · Cited by 2
Speech Production and Perception
Fowler, C. A., & Iskarous, K. (2012) · Wiley eBooks · doi:10.1002/9781118133880.hop204009 · Cited by 2
Self-citation
A Comparison of Models for Fusion of the Auditory and Visual Sensors in Speech Perception
Robert-Ribes, J., Schwartz, J., & Escudier, P. (1995) · Springer eBooks · doi:10.1007/978-94-009-1639-5_7 · Cited by 2
Perceptual Information Fusion in Humans and Machines
Salah, A. A. (2007) · Cited by 1
Peeling back the layers of time: integrating speech perception on the scales of stimulus time, experiential time, and developmental time
Best, C. T. (2003) · Journal of Phonetics · doi:10.1016/s0095-4470(03)00033-0 · Cited by 1
Some Effects of Feedback on the Perception of Point-Light and Full-Face Visual Displays of Speech: A Preliminary Report 1
Winters, S. J., & Pisoni, D. B. (2004) · Cited by 1
Applying the Double Factorial Paradigm to Detection and Categorization Tasks: An Example Using Audiovisual Speech Perception
Altieri, N. A. (2017) · Elsevier eBooks · doi:10.1016/b978-0-12-804315-8.00012-4 · Cited by 1
Acoustic compensation and articulo-motor reorganisation in perturbed speech
Brunner, J. (2009) · HAL · doi:10.18452/15891 · Cited by 1
The McGurk effect in infants
Johnson, J. A., Rosenblum, L. D., & Schmuckler, M. A. (1995) · The Journal of the Acoustical Society of America · doi:10.1121/1.411551 · Cited by 1
THEORETICAL AND REVIEW ARTICLES The motor theory of speech perception reviewed
Galantucci, B., Fowler, C. A., & Turvey, M. T. (2006) · Cited by 1
Self-citation
Is there a mcgurk effect for tongue reading
Engwall, O. (2010) · Cited by 1
Cross-Modal Integration In Music Perception
Maksimowski, M., & Russo, F. (2024) · doi:10.32920/25413091
Um debate sobre a natureza dos primitivos de percepção da fala
Nishida, G. (2015) · Revista Letras · doi:10.5380/rel.v91i0.37694
Towards the influence of vibration on evaluation of speech utterances in mobile devices
von Coler, H., Sundaram, S., Schleicher, R., & Curio, G. (2011) · IEEE Workshop on Applications of Signal Processing to Audio and Acoustics (WASPAA) · doi:10.1109/aspaa.2011.6082292
Articulatory influences on the categorization of speech sounds
Yeung, H. H., Gick, B., & Werker, J. F. (2005) · The Journal of the Acoustical Society of America · doi:10.1121/1.4788557
PERCEPTUAL CONSTANCY AND CONTEXTUAL ENHANCEMENT
Avelino, H. (2010) · RLA. Revista de lingüística teórica y aplicada · doi:10.4067/s0718-48832010000100002
Action and Instrument Specificity in Musicians
Logan, C. W. (2014) · OpenCommons - UConn (University of Connecticut)
UNIVERSIDADE FEDERAL DO PARANÁ SETOR DE EDUCAÇÃO PROGRAMA DE PÓS-GRADUAÇÃO EM EDUCAÇÃO
Fussek, S. (2009)
Audio-Visual Integrative Abilities of Prelingually Deafened Children with Cochlear Implants: A First Report
Lachs, L., Kirk, K. I., & Pisoni, D. B. (1999)
The touch of your lips: haptic information speeds up auditory speech processing
Treille, A., Cordeboeuf, C., Vilain, C., & Sato, M. (2013) · HAL
Development of phonologicall y speciied word forms
Mulak, K. E. (2012)
Perceptual Organization and Lawful Specification
Remez, R. E., & Rubin, P. E. (2016) · Ecological Psychology · doi:10.1080/10407413.2016.1195188
Delayed auditory feedback with static and dynamic visual feedback.
Stelle, E., Smith, C. L., & Vatikiotis‐Bateson, E. (2015) · AVSP
Message vs. messenger effects on cross-modal matching for spoken phrases
Best, C. T., Kroos, C. H., Mulak, K. E., Halovic, S., Fort, M., & Kitamura, C. (2015) · eSpace (Curtin University)
Visual perceptual assimilation of non-native speech
Brodsky, I. (2017) · Minerva Access (University of Melbourne)
Changes in the McGurk Effect across Phonetic Contexts. I. Fusions
Hampson, M., Guenther, F. H., & Cohen, M. A. (1999) · OpenBU (Boston University)
An Adaptation of an Auditory Perception Test
Gonzalez, D. (2018) · doi:10.25148/etd.fidc006863
Aero-tactile integration in Mandarin
Derrick, D., Heyne, M., O’Beirne, G. A., & Hay, J. (2019) · University of Canterbury Research Repository (University of Canterbury)
L'enfant sourd
(1996) · Questions de personne · doi:10.3917/dbu.lepot.1996.01.0579
Feel the music : crossmodal integration in music perception
Maksimowski, M. (2021) · doi:10.32920/ryerson.14664969.v1
Feel the music : crossmodal integration in music perception
Maksimowski, M. (2021) · doi:10.32920/ryerson.14664969
Lexical Tone and Perceptual Training: Implications for Children with Cochlear Implants
Smith, D. J. (2010)
Audiovisual enhancement of vowel contrast: Production and perception of the cot-caught contrast in Chicago
Havenhill, J. (2024) · Laboratory Phonology Journal of the Association for Laboratory Phonology · doi:10.16995/labphon.11002
The auditory and the visual percept evoked by the same audiovisual stimuli
Traunmüller, H., & Öhrström, N. (2007)
Speech: Biological Basis
Whalen, D. H., & Lindblom, B. E. F. (2006) · Elsevier eBooks · doi:10.1016/b0-08-044854-2/00027-4
The effect of mismatched acoustic-articulatory information on listener judgments: The case of Korean cluster /lp/*
Oh, S., & Kwon, H. (2025) · Phonetics and Speech Sciences · doi:10.13064/ksss.2025.17.4.045
L'interface oral-écrit dans l'apprentissage d'une langue étrangère : influence de l'input orthographique sur les représentations phonologiques : le cas des apprenants marocains
Solier, C. (2019) · doi:10.70675/994b74e9zaa24z4213zb6f6zafb224e7752c
Étude de la symétrie et de la sémantique combinatoire chez le babouin de Guinée (Papio papio)
Médam, T. (2019) · theses.fr (ABES) · doi:10.70675/63a6d07dz843fz4033z945fz6449df44fe1a
The role of orofacial somatosensory inputs in speech perception and production in individuals with hearing-impairment
Ashokumar, M. (2024) · theses.fr (ABES) · doi:10.70675/147c2119ze036z4735z8986z2e6da10eac6b
ERP Evidence for Cross-Modal Effects on Attractiveness Perception
Zhang, Q., Wang, L., & Li, W. (2026) · Brain Sciences · doi:10.3390/brainsci16040402
Contrasting Success in Neurotechnology: Sensory Substitution, Brain–Computer Interfaces, and the Limits of Dimensional Reduction
Mangalam, M., & Deligiannis, T. (2026) · Ecological Psychology · doi:10.1080/10407413.2026.2651681

Authors: Fowler, C. A., & Dekle, D. J.
Affiliations: Dartmouth College (US)
Venue: Journal of Experimental Psychology: Human Perception and Performance
Publisher: American Psychological Association (APA)
Published: 1991
Volume: 17
Issue: 3
Pages: 816-828
ISSN: 0096-1523 (ISSN-L)
1939-1277
DOI: 10.1037/0096-1523.17.3.816
OpenAlex: W1992638577
Cited by: 183
References: 25
Citations by year: 2026: 2 · 2025: 1 · 2024: 3 · 2023: 2 · 2022: 4 · 2021: 4 · 2020: 2 · 2019: 7 · 2018: 8 · 2017: 9 · 2016: 11 · 2015: 10 · 2014: 8 · 2013: 8 · 2012: 3
FWCI: 4.22
Type: journal article
Language: en
Open access: closed
Locations: Journal of Experimental Psychology Human Perception & Performance (publishedVersion)
PubMed (publishedVersion)
Funders: Eunice Kennedy Shriver National Institute of Child Health and Human Development (HD-01994, P01HD001994)
Topics: Social Sciences › Psychology › Experimental and Cognitive Psychology › Multisensory perception and integration
Social Sciences › Psychology › Experimental and Cognitive Psychology › Phonetics and Phonology Research
Life Sciences › Neuroscience › Cognitive Neuroscience › Tactile and Sensory Interactions
Keywords: McGurk effect, cross-modal perception, speech perception, visual speech, haptic perception, orthographic cues, multisensory integration, audiovisual integration, memory associations
MeSH terms: Adult, Attention, Humans, Lipreading, Phonetics, Speech Acoustics, Speech Perception, Touch

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Listening with eye and hand: Cross-modal contributions to speech perception.

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Citations

Cites

Cited by

Related

Metadata

Record

About these checks