The DOI matches its Crossref record; 26 of the 26 references it cites were found in a registry or an index.
Auditory-visual speech recognition by hearing-impaired subjects: Consonant recognition, sentence recognition, and auditory-visual integration
Abstract
Factors leading to variability in auditory-visual (AV) speech recognition include the subject’s ability to extract auditory (A) and visual (V) signal-related cues, the integration of A and V cues, and the use of phonological, syntactic, and semantic context. In this study, measures of A, V, and AV recognition of medial consonants in isolated nonsense syllables and of words in sentences were obtained in a group of 29 hearing-impaired subjects. The test materials were presented in a background of speech-shaped noise at 0-dB signal-to-noise ratio. Most subjects achieved substantial AV benefit for both sets of materials relative to A-alone recognition performance. However, there was considerable variability in AV speech recognition both in terms of the overall recognition score achieved and in the amount of audiovisual gain. To account for this variability, consonant confusions were analyzed in terms of phonetic features to determine the degree of redundancy between A and V sources of information. In addition, a measure of integration ability was derived for each subject using recently developed models of AV integration. The results indicated that (1) AV feature reception was determined primarily by visual place cues and auditory voicing+manner cues, (2) the ability to integrate A and V consonant cues varied significantly across subjects, with better integrators achieving more AV benefit, and (3) significant intra-modality correlations were found between consonant measures and sentence measures, with AV consonant scores accounting for approximately 54% of the variability observed for AV sentence recognition. Integration modeling results suggested that speechreading and AV integration training could be useful for some individuals, potentially providing as much as 26% improvement in AV consonant recognition.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Zadeh, L. A. (1996) · Cited by 46,844
(1966) · Medical Entomology and Zoology · Cited by 10,293
(1967) · Medical Entomology and Zoology · Cited by 7,532
Hearing lips and seeing voices
MCGURK, H., & MACDONALD, J. (1976) · Nature · doi:10.1038/264746a0 · Cited by 6,183
Perception of the speech code.
Liberman, A. M., Cooper, F. S., Shankweiler, D. P., & Studdert-Kennedy, M. (1967) · Psychological Review · doi:10.1037/h0020279 · Cited by 3,722
Visual Contribution to Speech Intelligibility in Noise
Sumby, W. H., & Pollack, I. (1954) · The Journal of the Acoustical Society of America · doi:10.1121/1.1907309 · Cited by 2,583
An Analysis of Perceptual Confusions Among Some English Consonants
Miller, G. A., & Nicely, P. E. (1955) · The Journal of the Acoustical Society of America · doi:10.1121/1.1907526 · Cited by 1,869
Laws of organization in perceptual forms.
Wertheimer, M. (1938) · A source book of Gestalt psychology. · doi:10.1037/11496-005 · Cited by 1,493
On the quantal nature of speech
Stevens, K. N. (1989) · Journal of Phonetics · doi:10.1016/s0095-4470(19)31520-7 · Cited by 777
Speech perception by ear and eye a paradigm for psychological inquiry
Massaro, D. W. (1987) · Cited by 693
Some preliminaries to a comprehensive account of audio-visual speech perception.
Summerfield, A. Q. (1987) · Cited by 421
Mathematical treatment of context effects in phoneme and word recognition
Boothroyd, A., & Nittrouer, S. (1988) · The Journal of the Acoustical Society of America · doi:10.1121/1.396976 · Cited by 385
On the Objects of Speech Perception
Diehl, R. L., & Kluender, K. R. (1989) · Ecological Psychology · doi:10.1207/s15326969eco0102_2 · Cited by 343
Speech waveform envelope cues for consonant recognition
Van Tasell, D. J., Soli, S. D., Kirby, V. M., & Widin, G. P. (1987) · The Journal of the Acoustical Society of America · doi:10.1121/1.395251 · Cited by 292
Miller, G. A. (2006) · Language and communication. · doi:10.1037/11135-003 · Cited by 250
Easy to hear but hard to understand: A lip-reading advantage with intact auditory stimuli.
Reisberg, D., McLean, J. P., & Goldfield, A. (1987) · Cited by 246
Models of integration given multiple sources of information.
Massaro, D. W., & Friedman, D. (1990) · Psychological Review · doi:10.1037//0033-295x.97.2.225 · Cited by 228
Effects of Training on the Visual Recognition of Consonants
Walden, B. E., Prosek, R. A., Montgomery, A. A., Scherr, C. K., & Jones, C. J. (1977) · Journal of Speech and Hearing Research · doi:10.1044/jshr.2001.130 · Cited by 218
Self-citationCrossmodal Integration in the Identification of Consonant Segments
Braida, L. D. (1991) · The Quarterly Journal of Experimental Psychology Section A · doi:10.1080/14640749108400991 · Cited by 171
Review of Selected Models of Speech Perception
Klatt, D. H. (1989) · The MIT Press eBooks · doi:10.7551/mitpress/4213.003.0010 · Cited by 160
Role of articulation in speech perception: Clues from production
Lindblom, B. E. F. (1996) · The Journal of the Acoustical Society of America · doi:10.1121/1.414691 · Cited by 151
Speech perception is hearing sounds, not tongues
Ohala, J. J. (1996) · The Journal of the Acoustical Society of America · doi:10.1121/1.414696 · Cited by 149
Resolution for speech sounds: Basic sensitivity and context memory on vowel and consonant continua
Macmillan, N. A., Goldberg, R. F., & Braida, L. D. (1988) · The Journal of the Acoustical Society of America · doi:10.1121/1.396626 · Cited by 133
Speech perception using combinations of auditory, visual, and tactile information.
Blamey, P. J., Cowan, R., Alcantara, J. I., Whitford, L. A., & Clark, G. M. (1989) · PubMed · Cited by 60
Spectral Distribution of Prosodic Information
Grant, K. W., & Walden, B. E. (1996) · Journal of Speech Language and Hearing Research · doi:10.1044/jshr.3902.228 · Cited by 57
Self-citationKnowledge of language and the sounds of speech
Halle, M., & Stevens, K. N. (1991) · doi:10.1007/978-1-349-12670-5_1 · Cited by 51
Cited by
Temporal window of integration in auditory-visual speech perception
van Wassenhove, V., Grant, K. W., & Poeppel, D. (2007) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2006.01.001 · Cited by 621
Self-citationThe use of visible speech cues for improving auditory detection of spoken sentences
Grant, K. W., & Seitz, P.-F. (2000) · The Journal of the Acoustical Society of America · doi:10.1121/1.1288668 · Cited by 521
Self-citationPerceptual Fusion and Stimulus Coincidence in the Cross-Modal Integration of Speech
Miller, L. M., & D'Esposito, M. (2005) · The Journal of Neuroscience · doi:10.1523/jneurosci.0896-05.2005 · Cited by 322
Wallace, M. T., & Stevenson, R. A. (2014) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2014.08.005 · Cited by 315
Auditory–visual integration of talker gender in vowel perception
Johnson, K., Strand, E. A., & D'Imperio, M. (1999) · Journal of Phonetics · doi:10.1006/jpho.1999.0100 · Cited by 305
Metadata
- Authors
- Grant, K. W., Walden, B. E., & Seitz, P. F.
- Venue
- The Journal of the Acoustical Society of America
- Publisher
- Acoustical Society of America (ASA)
- Published
- 1998-05-01
- Volume
- 103
- Issue
- 5
- Pages
- 2677-2690
- ISSN
- 0001-4966 (ISSN-L)
- 1520-8524
- OpenAlex
- W2020098907
- Cited by
- 342
- References
- 26
- FWCI
- 11.26
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.