CoChat

Taming User-Interface Heterogeneity with Uniform Overlays for Blind Users

Uckun, Utku, Tumkur Suresh, Rohan, Ferdous, Md Javedul, Bi, Xiaojun, Ramakrishnan, I.V., Ashok, Vikas · 2022 · Proceedings of the 30th ACM Conference on User Modeling, Adaptation and Personalization

The DOI matches its Crossref record; 28 of the 28 references it cites were found in a registry or an index.

Abstract

For many blind users, interaction with computer applications using screen reader assistive technology is a frustrating and time-consuming affair, mostly due to the complexity and heterogeneity of applications’ user interfaces. An interview study revealed that many applications do not adequately convey their interface structure and controls to blind screen reader users, thereby placing additional burden on these users to acquire this knowledge on their own. This is often an arduous and tedious learning process given the one-dimensional navigation paradigm of screen readers. Moreover, blind users have to repeat this learning process multiple times, i.e., once for each application, since applications differ in their interface designs and implementations. In this paper, we propose a novel push-based approach to make non-visual computer interaction easy, efficient, and uniform across different applications. The key idea is to make screen reader interaction ‘structure-agnostic’, by automatically identifying and extracting all application controls and then instantly ‘pushing’ these controls on demand to the blind user via a custom overlay dashboard interface. Such a custom overlay facilitates uniform and efficient screen reader navigation across all applications. A user study showed significant improvement in user satisfaction and interaction efficiency with our approach compared to a state-of-the-art screen reader.

Overview

Integrity signals

Registry

Crossref · 10.1145/3503252.3531317

Cites

28 of 28 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Show all 28 references

Research works printed but not linked: 13

  1. Maria Claudia Buzzi, Marina Buzzi, Barbara Leporini, and Giulio Mori. 2012. Designing e-learning collaborative tools for blind people. E-Learning-Long-Distance and Lifelong Perspectives (2012), 125–144.
  2. Michael F Chiang, Roy G Cole, Suhit Gupta, Gail E Kaiser, and Justin B Starren. 2005. Computer and world wide web accessibility by visually disabled patients: Problems and solutions. Survey of ophthalmology 50, 4 (2005), 394–405.
  3. Sandra G Hart and Lowell E Staveland. 1988. Development of NASA-TLX (Task Load Index): Results of empirical and theoretical research. In Advances in psychology. Vol. 52. Elsevier, 139–183.
  4. 10.5555/1839214.1839217 · doi:10.5555/1839214.1839217
  5. Sri Hastuti Kurniawan Alistair G Sutcliffe and Paul Blenkhorn. 2003. How Blind Users’ Mental Models Affect Their Perceived Usability of an Unfamiliar Screen Reader.. In INTERACT Vol. 3. 631–638.
  6. Vladimir I Levenshtein. 1966. Binary codes capable of correcting deletions insertions and reversals. In Soviet physics doklady Vol. 10. 707–710.
  7. Giulio Mori, Maria Claudia Buzzi, Marina Buzzi, Barbara Leporini, and Victor MR Penichet. 2010. Making “Google Docs” user interface more accessible for blind people. In International Conference on Advances in New Technologies, Interactive Interfaces, and Communicability. Springer, 20–29.
  8. John Gerard Schoeberlein and Yuanqiong Wang. 2014. Usability Evaluation of an Accessible Collaborative Writing Prototype for Blind Users.Journal of Usability Studies 10, 1 (2014).
  9. Reeta Singh. 2012. Blind Handicapped Vs. Technology: How do Blind People use Computers?International Journal of Scientific & Engineering Research 3 4(2012) 1–7.
  10. Katie Wang, Laura G Barron, and Michelle R Hebl. 2010. Making those who cannot see look best: Effects of visual resume formatting on ratings of job applicants with blindness.Rehabilitation psychology 55, 1 (2010), 68.
  11. David Wicks. 2017. The coding manual for qualitative researchers. Qualitative research in organizations and management: an international journal (2017).
  12. Cheng Xu Ali Israr Ivan Poupyrev Olivier Bau and Chris Harrison. 2011. Tactile display for the visually impaired using TeslaTouch. In CHI’11 Extended Abstracts on Human Factors in Computing Systems. 317–322.
  13. Zoom. 2021. Zoom Meetings. https://explore.zoom.us/meetings.

Cited by

See all 8

Metadata

Authors
Uckun, U., Tumkur Suresh, R., Ferdous, M. J., Bi, X., Ramakrishnan, I. V., & Ashok, V.
Affiliations
  • Stony Brook University (US)
  • Stony Brook University, USA
  • Old Dominion University (US)
Venue
Proceedings of the 30th ACM Conference on User Modeling, Adaptation and Personalization
Publisher
ACM
Published
2022-07-04
Pages
212-222
OpenAlex
W4283777838
Cited by
7
References
28
Citations by year
2025: 4 · 2024: 3
FWCI
2.55
Type
conference paper
Language
en
Open access
closed
Locations
ACM Conference on User Modeling, Adaptation and Personalization (UMAP) (publishedVersion)
Funders
  • NIH (National Institutes of Health) (R01EY030085, R01HD097188)
  • National Science Foundation (1805076, 1815514, 1936027, 2113485, 2125147)
Topics
  • Social Sciences › Human Factors and Ergonomics › Digital Accessibility for Disabilities
  • Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
  • Life Sciences › Neuroscience › Cognitive Neuroscience › Tactile and Sensory Interactions
Keywords
blind users, screen readers, assistive technology, non-visual interaction

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Taming User-Interface Heterogeneity with Uniform Overlays for Blind Users. https://app.cochat.ai/papers/10.1145/3503252.3531317
The paper
Uckun, U., Tumkur Suresh, R., Ferdous, M. J., Bi, X., Ramakrishnan, I. V., & Ashok, V. (2022). Taming User-Interface Heterogeneity with Uniform Overlays for Blind Users. Proceedings of the 30th ACM Conference on User Modeling, Adaptation and Personalization. https://doi.org/10.1145/3503252.3531317

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.