Lipreading and audio-visual speech perception
The DOI matches its Crossref record; 51 of the 51 references it cites were found in a registry or an index.
Abstract
This paper reviews progress in understanding the psychology of lipreading and audio-visual speech perception. It considers four questions. What distinguishes better from poorer lipreaders? What are the effects of introducing a delay between the acoustical and optical speech signals? What have attempts to produce computer animations of talking faces contributed to our understanding of the visual cues that distinguish consonants and vowels? Finally, how should the process of audio-visual integration in speech perception be described; that is, how are the sights and sounds of talking faces represented at their conflux?
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Fodor, J. A. (1983) · doi:10.7551/mitpress/4737.001.0001 · Cited by 7,734
Hearing lips and seeing voices
MCGURK, H., & MACDONALD, J. (1976) · Nature · doi:10.1038/264746a0 · Cited by 6,183
Cummins, R., & Fodor, J. (1985) · The Philosophical Review · doi:10.2307/2184717 · Cited by 4,791
Processing interactions and lexical access during word recognition in continuous speech
Marslen-Wilson, W. D., & Welsh, A. (1978) · Cognitive Psychology · doi:10.1016/0010-0285(78)90018-x · Cited by 1,426
The bimodal perception of speech in infancy
Kuhl, P. K., & Meltzoff, A. N. (1982) · Science · doi:10.1126/science.7146899 · Cited by 919
Review of text-to-speech conversion for English
Klatt, D. H. (1987) · The Journal of the Acoustical Society of America · doi:10.1121/1.395275 · Cited by 802
Improving the Reliability of Testing the Speech Reception Threshold for Sentences
Plomp, R., & Mimpen, A. M. (1979) · International Journal of Audiology · doi:10.3109/00206097909072618 · Cited by 722
Perceived order in different sense modalities.
Hirsh, I. J., & Sherrick, C. E. (1961) · Journal of Experimental Psychology · doi:10.1037/h0045283 · Cited by 697
Speech perception: a model of acoustic–phonetic analysis and lexical access
Klatt, D. H. (1979) · Journal of Phonetics · doi:10.1016/s0095-4470(19)31059-9 · Cited by 486
Quantifying the contribution of vision to speech perception in noise
Macleod, A., & Summerfield, Q. (1987) · British Journal of Audiology · doi:10.3109/03005368709077786 · Cited by 426
Self-citation
Cited by
(2011) · Cited by 2,752
Calvert, G. A., Campbell, R., & Brammer, M. J. (2000) · Current Biology · doi:10.1016/s0960-9822(00)00513-3 · Cited by 954
The Natural Statistics of Audiovisual Speech
Chandrasekaran, C., Trubanova, A., Stillittano, S., Caplier, A., & Ghazanfar, A. A. (2009) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1000436 · Cited by 630
Audio-visual speech modeling for continuous speech recognition
Dupont, S., & Luettin, J. (2000) · IEEE Transactions on Multimedia · doi:10.1109/6046.865479 · Cited by 598
Oviatt, S. (2007) · Human Factors and Ergonomics · doi:10.1201/9781410615862.ch21 · Cited by 485
Temporal constraints on the McGurk effect
Munhall, K. G., Gribble, P., Sacco, L., & Ward, M. (1996) · Perception & Psychophysics · doi:10.3758/bf03206811 · Cited by 358
Reading Speech from Still and Moving Faces: The Neural Substrates of Visible Speech
Calvert, G. A., & Campbell, R. (2003) · Journal of Cognitive Neuroscience · doi:10.1162/089892903321107828 · Cited by 332
An Overview of Deep-Learning-Based Audio-Visual Speech Enhancement and Separation
Michelsanti, D., Tan, Z.-H., Zhang, S.-X., Xu, Y., Yu, M., Yu, D., & Jensen, J. (2021) · IEEE/ACM Transactions on Audio, Speech, and Language Processing · doi:10.1109/taslp.2021.3066303 · Cited by 316
State of the Art on Monocular 3D Face Reconstruction, Tracking, and Applications
Zollhöfer, M., Thies, J., Garrido, P., Bradley, D., Beeler, T., Pérez, P., Stamminger, M., Nießner, M., & Theobalt, C. (2018) · Computer Graphics Forum · doi:10.1111/cgf.13382 · Cited by 307
Evidence that cochlear-implanted deaf patients are better multisensory integrators
Rouger, J., Lagleyre, S., Fraysse, B., Deneve, S., Deguine, O., & Barone, P. (2007) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0609419104 · Cited by 301
Furhat: A Back-Projected Human-Like Robot Head for Multiparty Human-Machine Interaction
Al Moubayed, S., Beskow, J., Skantze, G., & Granström, B. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-34584-5_9 · Cited by 297
CUAVE: A new audio-visual database for multimodal human-computer interface research
Patterson, E. K., Gurbuz, S., Tufekci, Z., & Gowdy, J. N. (2002) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2002.5745028 · Cited by 286
An Internet-Based Real-Time Audiovisual Link for Dual MEG Recordings
Zhdanov, A., Nurminen, J., Baess, P., Hirvenkari, L., Jousmäki, V., Mäkelä, J. P., Mandel, A., Meronen, L., Hari, R., & Parkkonen, L. (2015) · PLOS ONE · doi:10.1371/journal.pone.0128485 · Cited by 47
“The 80-ms misalignment between the audio and video streams falls within the perceptual integration window of natural speech [28,29].”
BackgroundWhat the human face tells the human mind: some challenges for the robot-human interface
Bruce, V. (2003) · [1992] Proceedings IEEE International Workshop on Robot and Human Communication · doi:10.1109/roman.1992.253910 · Cited by 32
Metadata
- Authors
- Summerfield, Q.
- Venue
- Philosophical Transactions of the Royal Society of London. Series B: Biological Sciences
- Publisher
- The Royal Society
- Published
- 1992-01-29
- Volume
- 335
- Issue
- 1273
- Pages
- 71-78
- ISSN
- 0962-8436 (ISSN-L)
- 1471-2970
- OpenAlex
- W2021279213
- Cited by
- 358
- References
- 51
- FWCI
- 2.17
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.