Web Screen Reading Automation Assistance Using Semantic Abstraction
The DOI matches its Crossref record; 3 of the 3 references it cites were found in a registry or an index.
Abstract
A screen reader's sequential press-and-listen interface makes for an unsatisfactory and often times painful web-browsing experience for blind people. To help alleviate this situation, we introduce Web Screen Reading Automation Assistant (SRAA) for automating users' screen-reading actions (e.g., finding price of an item) on demand, thereby letting them focus on what they want to do rather than on how to get it done. The key idea is to elevate the interaction from operating on (syntactic) HTML elements, as is done now, to operating on web entities (which are semantically meaningful collections of related HTML elements, e.g., search results, menus, widgets, etc.). SRAA realizes this idea of semantic abstraction by constructing a Web Entity Model (WEM), which is a collection of web entities of the underlying webpage, using an extensive generic library of custom-designed descriptions of commonly occurring web entities across websites. The WEM brings blind users closer to how sighted people perceive and operate on web entities, and together with a natural-language user interface, SRAA relieves users from having to press numerous shortcuts to operate on low-level HTML elements - the principal source of tedium and frustration. This paper describes the design and implementation of SRAA. Evaluation with 18 blind subjects demonstrates its usability and effectiveness.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Fitts' Law as a Research and Design Tool in Human-Computer Interaction
MacKenzie, I. S. (1992) · Human–Computer Interaction · doi:10.1207/s15327051hci0701_3 · Cited by 1,637
What Frustrates Screen Reader Users on the Web: A Study of 100 Blind Users
Lazar, J., Allen, A., Kleinman, J., & Malarkey, C. (2007) · International Journal of Human-Computer Interaction · doi:10.1080/10447310709336964 · Cited by 354 · cited 1×
“…to move around the content with screen readers, the keyboard-centric press-and-listen interaction model of screen readers is inherently limiting [20], because: a) it can lead to excessive use of shortcuts for doing simple browsing tasks; b) one has to remember an assortment of shortcuts and…”
BackgroundCapti-speak: a speech-enabled web screen reader
Ashok, V., Borodin, Y., Puzis, Y., & Ramakrishnan, I. V. (2015) · Proceedings of the 12th International Web for All Conference · doi:10.1145/2745555.2746660 · Cited by 33 · cited 10×
“We used the following hypotheses as the measure: H : Web usability is significantly improved with SRAA compared to the current state-of-the-art assistive technologies, viz., screen readers, simple speech interfaces: Capti-Speak [5], JSAY [18], Dragon, etc. SRAA results in: o H1 : Higher efficiency in locating desire…”
BackgroundMethodResultInfluentialSelf-citation
Cited by
Das, M., Gergle, D., & Piper, A. M. (2019) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3359293 · Cited by 108
“, auditory [38, 73], speech-controlled [9, 86], haptic [16, 48] and spatial [44] interactions), personalized and opportunistic adaptations [8, 25, 37, 100], semantic web modeling [8, 9, 16], shared browsing [68], and collaborative [40, 78] and automated [35] evaluation techniques.”
BackgroundDas, M., Piper, A. M., & Gergle, D. (2022) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3480169 · Cited by 32
Baez, M., Daniel, F., & Casati, F. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-39540-7_7 · Cited by 31
“[6], where the goal is to free users from performing low level interactions with HTML elements by adding a layer of abstraction on higher level web entities (e.”
BackgroundBarbosa, N. M., Hayes, J., Kaushik, S., & Wang, Y. (2022) · ACM Transactions on Accessible Computing · doi:10.1145/3519032 · Cited by 28
“, [9, 44, 51, 66]), automating individual interactions with page elements such as “click search button,” via voice commands [8, 9], and re-narrating or re-structuring the content of web pages in ways suitable to assistive technology users [16, 21, 47, 52].”
BackgroundEnabling Uniform Computer Interaction Experience for Blind Users through Large Language Models
Kodandaram, S. R., Uckun, U., Bi, X., Ramakrishnan, IV, & Ashok, V. (2024) · The 26th International ACM SIGACCESS Conference on Computers and Accessibility · doi:10.1145/3663548.3675605 · Cited by 24
“For instance, quite a few natural language assistants and web automation techniques have been proposed in the literature for enabling convenient web interaction for blind users [4, 5].”
BackgroundSelf-citation
Metadata
- Authors
- Ashok, V., Puzis, Y., Borodin, Y., & Ramakrishnan, I. V.
- Venue
- Proceedings of the 22nd International Conference on Intelligent User Interfaces
- Publisher
- ACM
- Published
- 2017-03-07
- Pages
- 407-418
- OpenAlex
- W2594674417
- Cited by
- 44
- References
- 3
- FWCI
- 9.56
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Web Screen Reading Automation Assistance Using Semantic Abstraction. https://app.cochat.ai/papers/10.1145/3025171.3025229
- The paper
- Ashok, V., Puzis, Y., Borodin, Y., & Ramakrishnan, I. V. (2017). Web Screen Reading Automation Assistance Using Semantic Abstraction. Proceedings of the 22nd International Conference on Intelligent User Interfaces. https://doi.org/10.1145/3025171.3025229
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.