Characterizing and recognizing spoken corrections in human-computer dialogue
Open accessThe DOI matches its Crossref record; 3 of the 3 references it cites were found in a registry or an index.
Abstract
Miscommunication in speech recognition systems is unavoidable, but a detailed characterization of user corrections will enable speech systems to identify when a correction is taking place and to more accurately recognize the content of correction utterances.In this paper we investigate the adaptations of users when they encounter recognition errors in interactions with a voice-in/voice-out spoken language system.In analyzing more than 300 pairs of original and repeat correction utterances, matched on speaker and lexical content, we found overall increases in both utterance and pause duration from original to correction.Interestingly, corrections of misrecognition errors (CME) exhibited significantly heightened pitch variability, while corrections of rejection errors (CRE) showed only a small but significant decrease in pitch minimum.CME's demonstrated much greater increases in measures of duration and pitch variability than CRE's.These contrasts allow the development of decision trees which distinguish CME's from CRE's and from original inputs at 70-75% accuracy based on duration, pitch, and amplitude features.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Designing SpeechActs: issues in speech user interfaces
Yankelovich, N., Levow, G.-A., & Marx, M. (1995) · Proceedings of the SIGCHI conference on Human factors in computing systems - CHI '95 · doi:10.1145/223904.223952 · Cited by 250 · cited 2×
“System, Subjects, and Errors The utterances used in the design and analysis of the decision tree classifiers were drawn from approximately 60 hours of user interactions in a field trial of the Sun Microsystems SpeechActs system (Yankelovich et al., 1995).”
MethodSelf-citationPredicting hyperarticulate speech during human-computer error resolution
Oviatt, S., MacEachern, M., & Levow, G.-A. (1998) · Speech Communication · doi:10.1016/s0167-6393(98)00005-3 · Cited by 144
Self-citationOviatt, S. L., Cohen, P. R., & Wang, M. (1994) · Speech Communication · doi:10.1016/0167-6393(94)90079-5 · Cited by 76
Cited by
How to find trouble in communication
Batliner, A., Fischer, K., Huber, R., Spilker, J., & Nöth, E. (2003) · Speech Communication · doi:10.1016/s0167-6393(02)00079-1 · Cited by 280
Multimodal error correction for speech user interfaces
Suhm, B., Myers, B., & Waibel, A. (2001) · ACM Transactions on Computer-Human Interaction · doi:10.1145/371127.371166 · Cited by 198
Exploring human error recovery strategies: Implications for spoken dialogue systems
Skantze, G. (2005) · Speech Communication · doi:10.1016/j.specom.2004.11.005 · Cited by 137
Characterizing and Predicting Corrections in Spoken Dialogue Systems
Litman, D., Hirschberg, J., & Swerts, M. (2006) · Computational Linguistics · doi:10.1162/coli.2006.32.3.417 · Cited by 56
Analysis of user behavior under error conditions in spoken dialogs
Shin, J., Narayanan, S. S., Gerber, L., Kazemzadeh, A., & Byrd, D. (2002) · 7th International Conference on Spoken Language Processing (ICSLP 2002) · doi:10.21437/icslp.2002-567 · Cited by 54
Metadata
- Authors
- Levow, G.-A.
- Venue
- Proceedings of the 36th annual meeting on Association for Computational Linguistics -
- Published
- 1998
- Volume
- 1
- Pages
- 736
- OpenAlex
- W2132406985
- Cited by
- 80
- References
- 3
- FWCI
- 6.04
- Type
- conference paper
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.