The DOI matches its Crossref record; 12 of the 12 references it cites were found in a registry or an index.
CUAVE: A new audio-visual database for multimodal human-computer interface research
Abstract
Multimodal signal processing has become an important topic of research for overcoming certain problems of audio-only speech processing. Audio-visual speech recognition is one area with great potential. Difficulties due to background noise and multiple speakers are significantly reduced by the additional information provided by extra visual features. Despite a few efforts to create databases in this area, none has emerged as a standard for comparison for several possible reasons. This paper seeks to introduce a new audiovisual database that is flexible and fairly comprehensive, yet easily available to researchers on one DVD. The CUAVE database is a speaker-independent corpus of over 7,000 utterances of both connected and isolated digits. It is designed to meet several goals that are discussed in this paper. The most notable are availability of the database, flexibility for use of the audio-visual data, and realistic considerations in the recordings (such as speaker movement). Another important focus of the database is the inclusion of pairs of simultaneous speakers, the first documented database of this kind. The overall goal of this project is to facilitate more widespread audio-visual research through an easily available database. For information on obtaining CUAVE, please visit our webpage (http://ece.clemson.edu/speech).
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
XM2VTSDB: The Extended M2VTS Database
Messer, K., Matas, J., Kittler, J., Luettin, J., & Maître, G. (1999) · Cited by 1,158
Perceiving talking faces: from speech perception to a behavioral principle
Massaro, D. W. (1997) · Medical Entomology and Zoology · Cited by 615
Lipreading and audio-visual speech perception
Summerfield, Q. (1992) · Philosophical Transactions of the Royal Society of London. Series B: Biological Sciences · doi:10.1098/rstb.1992.0009 · Cited by 358
Audio-visual speech recognition
Neti, C., Potamianos, G., Luettin, J., Matthews, I. A., Glotin, H., Vergyri, D., Sison, J. A. G., & Mashari, A. (2000) · Infoscience (Ecole Polytechnique Fédérale de Lausanne) · Cited by 272
Massaro, D. W., & Cohen, M. M. (1995) · Current Directions in Psychological Science · doi:10.1111/1467-8721.ep10772401 · Cited by 225
An image transform approach for HMM based automatic lipreading
Potamianos, G., Graf, H. P., & Cosatto, E. (2002) · Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269) · doi:10.1109/icip.1998.999008 · Cited by 180
An improved automatic lipreading system to enhance speech recognition
Petajan, E., Bischoff, B., Bodoff, D., & Brooke, N. M. (1988) · Proceedings of the SIGCHI conference on Human factors in computing systems - CHI '88 · doi:10.1145/57167.57170 · Cited by 164
Visual Speech Recognition with Stochastic Networks
Movellan, J. R. (1994) · Cited by 147
Chiou, G. I., & Hwang, J. (1997) · IEEE Transactions on Image Processing · doi:10.1109/83.605417 · Cited by 142
Computer lipreading for improved accuracy in automatic speech recognition
Silsbee, P. L., & Bovik, A. C. (1996) · IEEE Transactions on Speech and Audio Processing · doi:10.1109/89.536928 · Cited by 121
Cited by
(2011) · Cited by 2,752
Recent advances in the automatic recognition of audiovisual speech
Pomianos, G., Neti, C., Gravier, G., Garg, A., & Senior, A. W. (2003) · Proceedings of the IEEE · doi:10.1109/jproc.2003.817150 · Cited by 752
Chung, J. S., & Zisserman, A. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-54184-6_6 · Cited by 537
Combining Residual Networks with LSTMs for Lipreading
Stafylakis, T., & Tzimiropoulos, G. (2017) · Interspeech 2017 · doi:10.21437/interspeech.2017-85 · Cited by 348
Deep Structured Energy Based Models for Anomaly Detection
Zhai, S., Cheng, Y., Lu, W., & Zhang, Z. (2016) · arXiv · doi:10.48550/arxiv.1605.07717 · Cited by 334
Metadata
- Authors
- Patterson, E. K., Gurbuz, S., Tufekci, Z., & Gowdy, J. N.
- Venue
- IEEE International Conference on Acoustics Speech and Signal Processing
- Publisher
- IEEE
- Published
- 2002-05
- Pages
- II-2017-II-2020
- ISSN
- 1520-6149 (ISSN-L)
- OpenAlex
- W2098923380
- Cited by
- 286
- References
- 12
- FWCI
- 5.03
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: CUAVE: A new audio-visual database for multimodal human-computer interface research. https://app.cochat.ai/papers/10.1109/icassp.2002.5745028
- The paper
- Patterson, E. K., Gurbuz, S., Tufekci, Z., & Gowdy, J. N. (2002). CUAVE: A new audio-visual database for multimodal human-computer interface research. IEEE International Conference on Acoustics Speech and Signal Processing. https://doi.org/10.1109/icassp.2002.5745028
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.