The DOI matches its Crossref record.
Use of Visual Information for Phonetic Perception
Abstract
The accuracy with which naive listeners can report sentences presented 12 dB below a background of continuous prose was compared with accuracy in four audio visually supplemented conditions. With monochrome displays of the talker showing (i) the face, (ii) the lips and (iii) four points at the centres of the lips and the corners of the mouth, accuracy improved by 43, 31 and 8%, respectively. No improvement was produced by optical information on syllabic timing. The results suggest that optical concomitants of articulation specify linguistic information to normal listeners. This conclusion was reinforced in a second experiment in which identification functions were obtained for continua of synthetic syllables ranging between [aba], [ada] and [aga], presented both in isolation and in combination with video recordings. Audio-visually, [b] was only perceived when lip closure was specified optically and, if lip closure was specified optically, [b] was generally perceived. Perceivers appear to make use of articulatory constraints upon the combined audio-visual specification of phonetic events, suggesting that optical and acoustical displays are co-perceived in a common metric closely related to that of articulatory dynamics.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cited by
The bimodal perception of speech in infancy
Kuhl, P. K., & Meltzoff, A. N. (1982) · Science · doi:10.1126/science.7146899 · Cited by 919
Musicians have enhanced subcortical auditory and audiovisual processing of speech and music
Musacchia, G., Sams, M., Skoe, E., & Kraus, N. (2007) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0701498104 · Cited by 678
Infants deploy selective attention to the mouth of a talking face when learning speech
Lewkowicz, D. J., & Hansen-Tift, A. M. (2012) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1114783109 · Cited by 526
Infants' perception of expressive behaviors: Differentiation of multimodal information.
Walker‐Andrews, A. S. (1997) · Psychological Bulletin · doi:10.1037//0033-2909.121.3.437 · Cited by 514
Repp, B. H. (1982) · Psychological Bulletin · doi:10.1037//0033-2909.92.1.81 · Cited by 429
Categorical Perception: Issues, Methods, Findings
REPP, B. H. (1984) · Speech and Language · doi:10.1016/b978-0-12-608610-2.50012-1 · Cited by 406
The development of intersensory temporal perception: an epigenetic systems/limitations view
Lewkowicz, D. J. (2000) · Psychological Bulletin · doi:10.1037/0033-2909.126.2.281 · Cited by 403
“These values are in general agreement with previous findings from studies with adult participants (Dixon & Spitz, 1980; Summerfield, 1979).”
BackgroundResultInfluentialHearing what the body feels: Auditory encoding of rhythmic movement
Phillips-Silver, J., & Trainor, L. J. (2007) · Cognition · doi:10.1016/j.cognition.2006.11.006 · Cited by 394
Sueyoshi, A., & Hardison, D. M. (2005) · Language Learning · doi:10.1111/j.0023-8333.2005.00320.x · Cited by 368
Lipreading and audio-visual speech perception
Summerfield, Q. (1992) · Philosophical Transactions of the Royal Society of London. Series B: Biological Sciences · doi:10.1098/rstb.1992.0009 · Cited by 358
Self-citationThe Intermodal Representation of Speech in Infants
Kuhl, P. K., & Meltzoff, A. N. (1984) · Infant Behavior and Development · doi:10.1016/s0163-6383(84)80050-8 · Cited by 310
Auditory–visual integration of talker gender in vowel perception
Johnson, K., Strand, E. A., & D'Imperio, M. (1999) · Journal of Phonetics · doi:10.1006/jpho.1999.0100 · Cited by 305
Perceiving affect from the voice and the face
Massaro, D. W., & Egan, P. B. (1996) · Psychonomic Bulletin & Review · doi:10.3758/bf03212421 · Cited by 285
The processing of audio-visual speech: empirical and neural bases
Campbell, R. (2008) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2007.2155 · Cited by 282
Seeing to hear better: evidence for early audio-visual interactions in speech identification
SCHWARTZ, J. (2004) · Cognition · doi:10.1016/s0010-0277(04)00054-x · Cited by 279
Seeing to hear better: evidence for early audio-visual interactions in speech identification
Schwartz, J.-L., Berthommier, F., & Savariaux, C. (2004) · Cognition · doi:10.1016/j.cognition.2004.01.006 · Cited by 275
Sekiyama, K., & Tohkura, Y. (1991) · The Journal of the Acoustical Society of America · doi:10.1121/1.401660 · Cited by 263
Auditory-visual fusion in speech perception in children with cochlear implants
Schorr, E. A., Fox, N. A., van Wassenhove, V., & Knudsen, E. I. (2005) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0508862102 · Cited by 220
Integration of acoustic and visual speech signals using neural networks
Yuhas, B. P., Goldstein, M. H., & Sejnowski, T. J. (1989) · IEEE Communications Magazine · doi:10.1109/35.41402 · Cited by 209
An audiovisual test of kinematic primitives for visual speech perception.
Rosenblum, L. D., & Saldaña, H. M. (1996) · Journal of Experimental Psychology: Human Perception and Performance · doi:10.1037/0096-1523.22.2.318 · Cited by 204
Audiovisual processing in children with and without autism spectrum disorders
Mongillo, E. A., Irwin, J. R., Whalen, D. H., Klaiman, C., Carter, A. S., & Schultz, R. T. (2008) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-007-0521-y · Cited by 170
Infant perception of audio-visual speech synchrony
Lewkowicz, D. J. (2010) · Developmental Psychology · doi:10.1037/a0015579 · Cited by 168
“Studies comparing comprehension of auditory-only speech versus audiovisual speech have shown that comprehension of the latter is significantly better (Sumby & Pollack, 1954; Sum- merfield, 1979).”
BackgroundDevelopmental changes in visual and auditory contributions to speech perception
Massaro, D. W., Thompson, L. A., Barron, B., & Laren, E. (1986) · Journal of Experimental Child Psychology · doi:10.1016/0022-0965(86)90053-6 · Cited by 144
Bimodal speech perception: an examination across languages
Massaro, D. W., Cohen, M. M., Gesi, A., Heredia, R., & Tsuzaki, M. (1993) · Journal of Phonetics · doi:10.1016/s0095-4470(19)30230-x · Cited by 108
Adeel, A., Gogate, M., & Hussain, A. (2020) · Information Fusion · doi:10.1016/j.inffus.2019.08.008 · Cited by 96
Perception of Synthesized Audible and Visible Speech
Massaro, D. W., & Cohen, M. M. (1990) · Psychological Science · doi:10.1111/j.1467-9280.1990.tb00068.x · Cited by 94
Infants use multimodal information to imitate speech sounds
Legerstee, M. (1990) · Infant Behavior and Development · doi:10.1016/0163-6383(90)90039-b · Cited by 91
Kyle, F. E., Campbell, R., & MacSweeney, M. (2016) · Research in Developmental Disabilities · doi:10.1016/j.ridd.2015.10.004 · Cited by 74
Cross-modal speech perception in adults and infants using nonspeech auditory stimuli
Kuhl, P. K., Williams, K. A., & Meltzoff, A. N. (1991) · Journal of Experimental Psychology: Human Perception and Performance · doi:10.1037/0096-1523.17.3.829 · Cited by 96
Metadata
- Authors
- Summerfield, Q.
- Venue
- Phonetica
- Publisher
- Walter de Gruyter GmbH
- Published
- 1979-07-01
- Volume
- 36
- Issue
- 4-5
- Pages
- 314-331
- ISSN
- 0031-8388 (ISSN-L)
- 1423-0321
- OpenAlex
- W2091930743
- Cited by
- 319
- References
- 0
- FWCI
- 3.81
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.