Linguistic Adaptations During Spoken and Multimodal Error Resolution
The DOI matches its Crossref record; 3 of the 3 references it cites were found in a registry or an index.
Abstract
Fragile error handling in recognition-based systems is a major problem that degrades their performance, frustrates users, and limits commercial potential. The aim of the present research was to analyze the types and magnitude of linguistic adaptation that occur during spoken and multimodal human-computer error resolution. A semiautomatic simulation method with a novel error-generation capability was used to collect samples of users' spoken and pen-based input immediately before and after recognition errors, and at different spiral depths in terms of the number of repetitions needed to resolve an error. When correcting persistent recognition errors, results revealed that users adapt their speech and language in three qualitatively different ways. First, they increase linguistic contrast through alternation of input modes and lexical content over repeated correction attempts. Second, when correcting with verbatim speech, they increase hyperarticulation by lengthening speech segments and pauses, and increasing the use of final falling contours. Third, when they hyperarticulate, users simultaneously suppress linguistic variability in their speech signal's amplitude and fundamental frequency. These findings are discussed from the perspective of enhancement of linguistic intelligibility. Implications are also discussed for corroboration and generalization of the Computer-elicited Hyperarticulate Adaptation Model (CHAM), and for improved error handling capabilities in next-generation spoken language and multimodal systems.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Effect of experimentally induced stress on vocal parameters.
Tolkmitt, F. J., & Scherer, K. R. (1986) · Journal of Experimental Psychology: Human Perception and Performance · doi:10.1037/0096-1523.12.3.302 · Cited by 184
Predicting hyperarticulate speech during human-computer error resolution
Oviatt, S., MacEachern, M., & Levow, G.-A. (1998) · Speech Communication · doi:10.1016/s0167-6393(98)00005-3 · Cited by 144
Self-citationModeling global and focal hyperarticulation during human–computer error resolution
Oviatt, S., Levow, G.-A., Moreton, E., & MacEachern, M. (1998) · The Journal of the Acoustical Society of America · doi:10.1121/1.423888 · Cited by 52
Self-citation
Cited by
Verbmobil: Foundations of Speech-to-Speech Translation
(2000) · Artificial Intelligence · doi:10.1007/978-3-662-04230-4 · Cited by 550
Oviatt, S. (2007) · Human Factors and Ergonomics · doi:10.1201/9781410615862.ch21 · Cited by 485
Self-citationOviatt, S., Cohen, P., Wu, L., Duncan, L., Suhm, B., Bers, J., Holzman, T., Winograd, T., Landay, J., Larson, J., et al. (2000) · Human–Computer Interaction · doi:10.1207/s15327051hci1504_1 · Cited by 375
Self-citation"What can i help you with?": infrequent users' experiences of intelligent personal assistants
Cowan, B. R., Pantidi, N., Coyle, D., Morrissey, K., Clarke, P., Al-Shehri, S., Earley, D., & Bandeira, N. (2017) · Proceedings of the 19th International Conference on Human-Computer Interaction with Mobile Devices and Services · doi:10.1145/3098279.3098539 · Cited by 351
Linguistic alignment between people and computers
Branigan, H. P., Pickering, M. J., Pearson, J., & McLean, J. F. (2010) · Journal of Pragmatics · doi:10.1016/j.pragma.2009.12.012 · Cited by 319
Mutual disambiguation of recognition errors in a multimodel architecture
Oviatt, S. (1999) · Proceedings of the SIGCHI conference on Human factors in computing systems the CHI is the limit - CHI '99 · doi:10.1145/302979.303163 · Cited by 315
Self-citationCommunication Breakdowns Between Families and Alexa
Beneteau, E., Richards, O. K., Zhang, M., Kientz, J. A., Yip, J., & Hiniker, A. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300473 · Cited by 313
How to find trouble in communication
Batliner, A., Fischer, K., Huber, R., Spilker, J., & Nöth, E. (2003) · Speech Communication · doi:10.1016/s0167-6393(02)00079-1 · Cited by 280
Predicting hyperarticulate speech during human-computer error resolution
Oviatt, S., MacEachern, M., & Levow, G.-A. (1998) · Speech Communication · doi:10.1016/s0167-6393(98)00005-3 · Cited by 144
Self-citationMapping Perceptions of Humanness in Intelligent Personal Assistant Interaction
Doyle, P. R., Edwards, J., Dumbleton, O., Clark, L., & Cowan, B. R. (2019) · Proceedings of the 21st International Conference on Human-Computer Interaction with Mobile Devices and Services · doi:10.1145/3338286.3340116 · Cited by 100
Modeling global and focal hyperarticulation during human–computer error resolution
Oviatt, S., Levow, G.-A., Moreton, E., & MacEachern, M. (1998) · The Journal of the Acoustical Society of America · doi:10.1121/1.423888 · Cited by 52
Self-citationShin, J. Y., & Huh-Yoo, J. (2020) · Proceedings of the 14th EAI International Conference on Pervasive Computing Technologies for Healthcare · doi:10.1145/3421937.3422024 · Cited by 18
Metadata
- Authors
- Oviatt, S., Bernard, J., & Levow, G.-A.
- Venue
- Language and Speech
- Publisher
- SAGE Publications
- Published
- 1998-07
- Volume
- 41
- Issue
- 3-4
- Pages
- 419-442
- ISSN
- 0023-8309 (ISSN-L)
- 1756-6053
- OpenAlex
- W1899604934
- Cited by
- 80
- References
- 3
- FWCI
- 7.71
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.