CoChat

Reviewing Speech Input with Audio: Differences between Blind and Sighted Users

Hong, Jonggi, Vaing, Christine, Kacorri, Hernisa, Findlater, Leah · 2020 · ACM Transactions on Accessible Computing

The DOI matches its Crossref record, with a small difference in title or year; 56 of the 56 references it cites were found in a registry or an index.

Abstract

Speech input is a primary method of interaction for blind mobile device users, yet the process of dictating and reviewing recognized text through audio only (i.e., without access to visual feedback) has received little attention. A recent study found that sighted users could identify only about half of automatic speech recognition (ASR) errors when listening to text-to-speech output of the ASR results. Blind screen reader users, in contrast, may be better able to identify ASR errors through audio due to their greater use of speech interaction and increased ability to comprehend synthesized speech. To compare the experiences of blind and sighted users with speech input and ASR errors, as well as to compare their ability to identify ASR errors through audio-only interaction, we conducted a lab study with 12 blind and 12 sighted participants. The study included a semi-structured interview portion to qualitatively understand experiences with ASR, followed by a controlled speech input task to quantitatively compare participants’ ability to identify ASR errors in their dictated text. Findings revealed differences between blind and sighted participants in terms of how they use speech input and their level of concern for ASR errors (e.g., blind users were more highly concerned). In the speech input task, blind participants were able to identify only 40% of ASR errors, which, counter to our hypothesis, was not significantly different from sighted participants’ performance. In depth analysis of speech input, ASR errors, and strategy of identifying ASR errors scrutinized how participants entered a text with speech input and reviewed it. Our findings indicate the need for future work on how to support blind users in confidently using speech input to generate accurate, error-free text.

Overview

Integrity signals

Registry

Crossref · 10.1145/3382039

Cites

56 of 56 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Citations

Cites

Research works printed but not linked: 9

  1. W. Feng . 1994 . Using handwriting and gesture recognition to correct speech recognition errors . Urbana 51 (1994), 61801 . W. Feng. 1994. Using handwriting and gesture recognition to correct speech recognition errors. Urbana 51 (1994), 61801.
  2. Sahar Ghannay , Nathalie Camelin , and Yannick Esteve . 2015 . Which ASR errors are hard to detect . In Proceedings of the Errors by Humans and Machines in Multimedia, Multimodal and Multilingual Data Processing (ERRARE’15) Workshop, 11--13. Sahar Ghannay, Nathalie Camelin, and Yannick Esteve. 2015. Which ASR errors are hard to detect. In Proceedings of the Errors by Humans and Machines in Multimedia, Multimodal and Multilingual Data Processing (ERRARE’15) Workshop, 11--13.
  3. Sharon Goldwater , Dan Jurafsky , and Christopher D. Manning . 2008. Which words are hard to recognize? Prosodic, lexical, and disfluency factors that increase ASR error rates . In Proceedings of the Conference of the Association for Computational Linguistics and Human Language Technologies (ACL’08/ HLT’08) . 380--388. Sharon Goldwater, Dan Jurafsky, and Christopher D. Manning. 2008. Which words are hard to recognize? Prosodic, lexical, and disfluency factors that increase ASR error rates. In Proceedings of the Conference of the Association for Computational Linguistics and Human Language Technologies (ACL’08/ HLT’08). 380--388.
  4. Michael Gonchar . 2016. 650 Prompts for narrative and personal writing. New York Times 20 ( 2016 ). Michael Gonchar. 2016. 650 Prompts for narrative and personal writing. New York Times 20 (2016).
  5. 10.5555/1564144.1564149 · doi:10.5555/1564144.1564149
  6. 10.5555/646814.708131 · doi:10.5555/646814.708131
  7. Anja Moos and Jürgen Trouvain . 2007 . Comprehension of ultra-fast speech–blind vs.“normally hearing” persons . In Proceedings of the 16th International Congress of Phonetic Sciences. 677--680 . Anja Moos and Jürgen Trouvain. 2007. Comprehension of ultra-fast speech–blind vs.“normally hearing” persons. In Proceedings of the 16th International Congress of Phonetic Sciences. 677--680.
  8. Konstantinos Papadopoulos and Eleni Koustriava . 2015 . Comprehension of synthetic and natural speech: Differences among sighted and visually impaired young adults . In Proceedings of the International Conference on Enabling Access for Persons with Visual Impairment (ICEAPVI'15) . 147--151. Konstantinos Papadopoulos and Eleni Koustriava. 2015. Comprehension of synthetic and natural speech: Differences among sighted and visually impaired young adults. In Proceedings of the International Conference on Enabling Access for Persons with Visual Impairment (ICEAPVI'15). 147--151.
  9. Bhagath Parabattina and Pradip Das . 2004 . Acoustic phonetic approach for speech recognition: A review . Language 77 (2004), 93 . Bhagath Parabattina and Pradip Das. 2004. Acoustic phonetic approach for speech recognition: A review. Language 77 (2004), 93.

Cited by

See all 11

Metadata

Authors
Hong, J., Vaing, C., Kacorri, H., & Findlater, L.
Affiliations
  • University of Maryland, College Park (US)
  • University of Washington (US)
Venue
ACM Transactions on Accessible Computing
Published
2020-03-31
Volume
13
Issue
1
Pages
1-28
ISSN
  • 1936-7228 (ISSN-L)
  • 1936-7236
OpenAlex
W3019547849
Cited by
11
References
56
Citations by year
2025: 5 · 2024: 3 · 2023: 2 · 2022: 1
FWCI
1.35
Type
journal article
Language
en
Open access
closed
Locations
ACM Transactions on Accessible Computing (publishedVersion)
Topics
  • Social Sciences › Human Factors and Ergonomics › Digital Accessibility for Disabilities
  • Life Sciences › Neuroscience › Cognitive Neuroscience › Tactile and Sensory Interactions
  • Health Sciences › Health Professions › Occupational Therapy › Assistive Technology in Communication and Mobility
Keywords
speech input, speech recognition errors, blind users, screen readers, text-to-speech, error identification, mobile accessibility, speech recognition accuracy, user experience

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.