Identifying user corrections automatically in spoken dialogue systems
Open accessThe DOI matches its Crossref record; 16 of the 16 references it cites were found in a registry or an index.
Abstract
We present results of machine learning experiments designed to identify user corrections of speech recognition errors in a corpus collected from a train information spoken dialogue system. We investigate the predictive power of features automatically computable from the prosody of the turn, the speech recognition process, experimental conditions, and the dialogue history. Our best performing features reduce classification error from baselines of 25.70-28.99% to 15.72%.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“with users frequently adopting clarification strategies, such as repetition [21, 66] and modulation strategies, such as changes in voice pitch or volume [24, 28, 46].”
From System and User Strategies to Repair Conversational Breakdowns of Spoken Dialogue Systems: A Scoping Review (2024) · cites this paper as [28]
Citations
Cites
Empirical methods for artificial intelligence
(1996) · Choice Reviews Online · doi:10.5860/choice.33-5144 · Cited by 625
Learning Trees an ules with Set-val ed Features
Cohen, W. W. (1996) · National Conference on Artificial Intelligence · Cited by 274
Towards developing general models of usability with PARADISE
WALKER, M., KAMM, C., & LITMAN, D. (2000) · Natural Language Engineering · doi:10.1017/s1351324900002503 · Cited by 262
Self-citationCorrections in spoken dialogue systems
Swerts, M., Litman, D., & Hirschberg, J. (2000) · 6th International Conference on Spoken Language Processing (ICSLP 2000) · doi:10.21437/icslp.2000-344 · Cited by 81
Self-citationCharacterizing and recognizing spoken corrections in human-computer dialogue
Levow, G.-A. (1998) · Proceedings of the 36th annual meeting on Association for Computational Linguistics - · doi:10.3115/980845.980969 · Cited by 80
Walker, M. A., Langkilde-Geary, I., Wright, J. H., Gorin, A. L., & Litman, D. J. (2000) · Cited by 78
Self-citationPredicting automatic speech recognition performance using prosodic cues
Litman, D. J., Hirschberg, J., & Swerts, M. G. J. (2000) · OLAC - Open Language Archives Community · Cited by 78
Self-citationEmpirically Evaluating an Adaptable Spoken Dialogue System
Litman, D. J., & Pan, S. (1999) · CISM International Centre for Mechanical Sciences · doi:10.1007/978-3-7091-2490-1_6 · Cited by 67
Self-citationAutomatic detection of poor speech recognition at the dialogue level
Litman, D. J., Walker, M. A., & Kearns, M. S. (1999) · Proceedings of the 37th annual meeting of the Association for Computational Linguistics on Computational Linguistics - · doi:10.3115/1034678.1034729 · Cited by 65
Self-citationModeling hyperarticulate speech during human-computer error resolution
Oviatt, S., Levow, G.-A., MacEachern, M., & Kuhn, K. (2002) · Proceeding of Fourth International Conference on Spoken Language Processing. ICSLP '96 · doi:10.1109/icslp.1996.607722 · Cited by 44
Bell, L., & Gustafson, J. (1999) · KTH Publication Database DiVA (KTH Royal Institute of Technology) · Cited by 36
Evaluating spoken dialog systems for telecommunication services
Kamm, C., Narayanan, S. S., Dutton, D., & Ritenour, R. (1997) · European Conference on Speech Communication and Technology (Eurospeech) · doi:10.21437/eurospeech.1997-581 · Cited by 32
Specialized acoustic models for hyperarticulated speech
Soltau, H., & Waibel, A. (2002) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2000.862098 · Cited by 30
Generalizing prosodic prediction of speech recognition errors
Hirschberg, J., Litman, D. J., & Swerts, M. G. J. (2000) · International Conference on Spoken Language Processing (ICSLP) · doi:10.21437/icslp.2000-63 · Cited by 18
Self-citationUser behaviors affecting speech recognition
Wade, E., Shriberg, E. E., & Price, P. J. (1992) · International Conference on Spoken Language Processing (ICSLP) · doi:10.21437/icslp.1992-290 · Cited by 15
Error spotting in human-machine interaction
Krahmer, E. E., Swerts, M. G. J., Theune, M., et al. (1999) · Cited by 13
Self-citation
Cited by
Error-correction detection and response generation in a spoken dialogue system
Bulyko, I., Kirchhoff, K., Ostendorf, M., & Goldberg, J. (2005) · Speech Communication · doi:10.1016/j.specom.2004.09.009 · Cited by 36
Alghamdi, E., Halvey, M., & Nicol, E. (2024) · ACM Conversational User Interfaces 2024 · doi:10.1145/3640794.3665558 · Cited by 36
Acoustic correlates of user response to error in human-computer dialogues
Kazemzadeh, A., Lee, S., & Narayanan, S. (2004) · 2003 IEEE Workshop on Automatic Speech Recognition and Understanding (IEEE Cat. No.03EX721) · doi:10.1109/asru.2003.1318443 · Cited by 10
“Also the increased percentage of voiced speech with the decreased percent silence gives evidence of increased speaking rate, which we confirmed by estimating the speech rate by dividing the number of words from the transcription by the duration (other studies have estimated speech rate using purely acoustic features b…”
Background
Metadata
- Authors
- Hirschberg, J., Litman, D., & Swerts, M.
- Affiliations
- AT&T (United States) (US)
- Venue
- Second meeting of the North American Chapter of the Association for Computational Linguistics on Language technologies 2001 - NAACL '01
- Published
- 2001
- Pages
- 1-8
- OpenAlex
- W2064094392
- Cited by
- 40
- References
- 16
- Citations by year
- 2024: 1 · 2022: 1 · 2018: 2 · 2017: 1 · 2015: 1 · 2012: 1
- FWCI
- 3.56
- Type
- conference paper
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Physical Sciences › Computer Science › Artificial Intelligence › Speech Recognition and Synthesis
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Keywords
- spoken dialogue systems, user corrections, speech recognition, dialogue management
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.