InSupport: Proxy Interface for Enabling Efficient Non-Visual Interaction with Web Data Records
Open accessAbstract
Interaction with web data records typically involves accessing auxiliary webpage segments such as filters, sort options, search form, and multi-page links. As these segments are usually scattered all across the screen, it is arduous and tedious for blind users who rely on screen readers to access the segments, given that content navigation with screen readers is predominantly one-dimensional, despite the available support for skipping content via either special keyboard shortcuts or selective navigation. The extant techniques to overcome inefficient web screen reader interaction have mostly focused on general web content navigation, and as such they provide little to no support for data record-specific interaction activities such as filtering and sorting – activities that are equally important for enabling quick and easy access to the desired data records. To fill this void, we present InSupport, a browser extension that: (i) employs custom-built machine learning models to automatically extract auxiliary segments on any webpage containing data records, and (ii) provides an instantly accessible proxy one-stop interface for easily navigating the extracted segments using basic screen reader shortcuts. An evaluation study with 14 blind participants showed significant improvement in usability with InSupport, driven by increased reduction in interaction time and the number of key presses, compared to state-of-the-art solutions.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Assistive technology research for improving computer application usability has largely focused on web and mobile applications.
“However, these works have largely centered on the web [6, 12, 15, 16, 43] and mobile applications [11, 22, 27–29].”
From Enabling Uniform Computer Interaction Experience for Blind Users through Large Language Models (2024) · cites this paper as [15]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research
(1988) · Advances in Psychology · doi:10.1016/s0166-4115(08)62386-9 · Cited by 15,003 · see citing works
What Frustrates Screen Reader Users on the Web: A Study of 100 Blind Users
Lazar, J., Allen, A., Kleinman, J., & Malarkey, C. (2007) · International Journal of Human-Computer Interaction · doi:10.1080/10447310709336964 · Cited by 354 · see citing works
Complete Counterbalancing of Immediate Sequential Effects in a Latin Square Design
Bradley, J. V. (1958) · Journal of the American Statistical Association · doi:10.1080/01621459.1958.10501456 · Cited by 343 · see citing works
Guidelines are only half of the story: accessibility problems encountered by blind users on the web
Power, C., Freire, A., Petrie, H., & Swallow, D. (2012) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/2207676.2207736 · Cited by 327 · cited 2× · see citing works
“While bulk of these works have predominantly focused on the accessibility of web content for blind users [4, 5, 10, 12, 22– 24, 29, 32, 34, 37, 39], researchers have also explored the usability of web interaction for blind users [7–9, 11, 17, 20, 26, 30].”
BackgroundLeshed, G., Haber, E. M., Matthews, T. L., & Lau, T. A. (2008) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/1357054.1357323 · Cited by 312 · see citing works
(2017) · doi:10.1145/2998181.2998364 · Cited by 258 · see citing works
Automation and customization of rendered web pages
Bolin, M., Webber, M., Rha, P., Wilson, T., & Miller, R. C. (2005) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/1095034.1095062 · Cited by 223 · see citing works
More than meets the eye: a survey of screen-reader browsing strategies
Borodin, Y., Bigham, J. P., Dausch, G., & Ramakrishnan, I. V. (2010) · Proceedings of the 2010 International Cross Disciplinary Conference on Web Accessibility (W4A) · doi:10.1145/1805986.1806005 · Cited by 222 · see citing works
Abdolrahmani, A., Kuber, R., & Branham, S. M. (2018) · Proceedings of the 20th International ACM SIGACCESS Conference on Computers and Accessibility · doi:10.1145/3234695.3236344 · Cited by 172 · cited 1× · see citing works
“Although speech interfaces facilitate faster access to content, they have several limitations, notably speech recognition accuracy (in noisy environments) [1] and blind users’ social concerns (e.g., drawing undesired attention from others) and privacy [3].”
BackgroundCurrent and future mobile and wearable device use by people with visual impairments
Ye, H., Malu, M., Oh, U., & Findlater, L. (2014) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/2556288.2557085 · Cited by 148 · see citing works
Privacy Concerns and Behaviors of People with Visual Impairments
Ahmed, T., Hoyle, R., Connelly, K., Crandall, D., & Kapadia, A. C. (2015) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/2702123.2702334 · Cited by 130 · see citing works
Twitter A11y: A Browser Extension to Make Twitter Images Accessible
Gleason, C., Pavel, A., McCamey, E., Low, C., Carrington, P., Kitani, K., & Bigham, J. P. (2020) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376728 · Cited by 123 · see citing works
Caption Crawler: Enabling Reusable Alternative Text Descriptions using Reverse Image Search
Guinness, D., Cutrell, E., & Morris, M. R. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3174092 · Cited by 108 · see citing works
Annotation-based transcoding for nonvisual web access
Asakawa, C., & Takagi, H. (2000) · doi:10.1145/354324.354588 · Cited by 107 · see citing works
Bigham, J. P., & Ladner, R. E. (2007) · International Web for All Conference (W4A) · doi:10.1145/1243441.1243452 · Cited by 90 · see citing works
Li, I., Nichols, J. W., Lau, T. A., Drews, C., & Cypher, A. (2010) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/1753326.1753432 · Cited by 67 · see citing works
Bigham, J. P., Lau, T. A., & Nichols, J. W. (2009) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/1502650.1502677 · Cited by 60 · see citing works
Web Screen Reading Automation Assistance Using Semantic Abstraction
Ashok, V. G., Puzis, Y., Borodin, Y., & Ramakrishnan, I. V. (2017) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/3025171.3025229 · Cited by 44 · see citing works
Self-citationUbiquitous Accessibility for People with Visual Impairments: Are We There Yet?
Billah, S. M., Ashok, V., Porter, D. E., & Ramakrishnan, I. V. (2017) · Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3025453.3025731 · Cited by 43 · see citing works
Self-citationGleason, C., Pavel, A., Gururaj, H., Kitani, K., & Bigham, J. P. (2020) · International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS) · doi:10.1145/3373625.3417027 · Cited by 42 · see citing works
Accessibility by demonstration
Bigham, J. P., Brudvik, J. T., & Zhang, B. (2010) · International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS) · doi:10.1145/1878803.1878812 · Cited by 41 · see citing works
Auditory and tactile interfaces for representing the visual effects on the web
Asakawa, C., Takagi, H., Ino, S., & Ifukube, T. (2002) · International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS) · doi:10.1145/638249.638263 · Cited by 36 · see citing works
Capti-speak: a speech-enabled web screen reader
Ashok, V., Borodin, Y., Puzis, Y., & Ramakrishnan, I. V. (2015) · Proceedings of the 12th International Web for All Conference · doi:10.1145/2745555.2746660 · Cited by 33 · cited 2× · see citing works
“Accessibility assistants [7, 8, 21] on the other hand enable blind users to use speech input to interact with webpage content.”
BackgroundSelf-citationFrom screen reading to aural glancing: towards instant access to key page sections
Gadde, P., & Bolchini, D. (2014) · Proceedings of the 16th international ACM SIGACCESS conference on Computers & accessibility - ASSETS '14 · doi:10.1145/2661334.2661363 · Cited by 30 · see citing works
Predictive web automation assistant for people with vision impairments
Puzis, Y., Borodin, Y., Puzis, R., & Ramakrishnan, I. V. (2013) · International World Wide Web Conference (WWW) · doi:10.1145/2488388.2488478 · Cited by 28 · see citing works
Widget Classification with Applications to Web Accessibility
Melnyk, V., Ashok, V. G., Puzis, Y., Soviak, A., Borodin, Y., & Ramakrishnan, I. V. (2014) · Lecture notes in computer science · doi:10.1007/978-3-319-08245-5_20 · Cited by 27 · see citing works
Self-citationBillah, S. M., Ashok, V. G., Porter, D. E., & Ramakrishnan, I. V. (2017) · International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS) · doi:10.1145/3132525.3132531 · Cited by 26 · see citing works
Self-citationAutomating Navigation Sequences in AJAX Websites
Montoto, P., Pan-Bermudez, A., Raposo, J., Bellas, F., & López, J. (2009) · Lecture notes in computer science · doi:10.1007/978-3-642-02818-2_12 · Cited by 24 · see citing works
SADIe: Semantic Annotation for Accessibility
Bechhofer, S., Harper, S., & Lunn, D. (2006) · Lecture notes in computer science · doi:10.1007/11926078_8 · Cited by 23 · see citing works
Dynamic injection of WAI-ARIA into web content
Brown, A. J., & Harper, S. (2013) · International Cross-Disciplinary Conference on Web Accessibility (W4A) · doi:10.1145/2461121.2461141 · Cited by 20 · see citing works
Auto-Suggesting Browsing Actions for Personalized Web Screen Reading
Ashok, V. G., Billah, S. M., Borodin, Y., & Ramakrishnan, I. V. (2019) · ACM Conference on User Modeling, Adaptation and Personalization (UMAP) · doi:10.1145/3320435.3320460 · Cited by 19 · see citing works
Self-citationAydin, A. S., Feiz, S., Ashok, V. G., & Ramakrishnan, I. V. (2020) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/3377325.3377540 · Cited by 19 · see citing works
Self-citationPuzis, Y., Borodin, Y., Soviak, A., Melnyk, V., & Ramakrishnan, I. V. (2015) · International Web for All Conference (W4A) · doi:10.1145/2745555.2746657 · Cited by 6 · see citing works
Haptic Gloves Prototype for Audio-Tactile Web Browsing
Soviak, A. (2015) · International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS) · doi:10.1145/2700648.2811329 · Cited by 4 · see citing works
Flagged first, then by citations
Research works printed but not linked: 3
- [3]3. Tousif Ahmed, Patrick Shaffer, Kay Connelly, David Crandall, and Apu Kapadia. 2016. Addressing physical safety, security, and privacy for people with visual impairments. In Twelfth Symposium on Usable Privacy and Security ({SOUPS} 2016). 341-354.
- [9]9. Ali Selman Aydin, Shirin Feiz, Vikas Ashok, and IV Ramakrishnan. 2020. SaIL: saliency-driven injection of ARIA landmarks. In Proceedings of the 25th Interna- tional Conference on Intelligent User Interfaces. 111-115.
- [19]19. John Brooke et al. 1996. SUS-A quick and dirty usability scale. Usability evaluation in industry 189, 194 (1996), 4-7.
Cited by
Sorted by citations
Enabling Uniform Computer Interaction Experience for Blind Users through Large Language Models
Kodandaram, S. R., Uckun, U., Bi, X., Ramakrishnan, IV, & Ashok, V. (2024) · The 26th International ACM SIGACCESS Conference on Computers and Accessibility · doi:10.1145/3663548.3675605 · Cited by 24 · see citing works
Self-citationDetecting Deceptive Dark-Pattern Web Advertisements for Blind Screen-Reader Users
Kodandaram, S. R., Sunkara, M., Jayarathna, S., & Ashok, V. G. (2023) · Journal of Imaging · doi:10.3390/jimaging9110239 · Cited by 11 · see citing works
Self-citationMachine Learning for Adaptive Accessible User Interfaces: Overview and Applications
Kristić, M., Zakarija, I., Škopljanac-Mačina, F., & Car, Ž. (2025) · Applied Sciences · doi:10.3390/app152312538 · Cited by 9 · see citing works
Assessing the Accessibility and Usability of Web Archives for Blind Users
Sunkara, M., Nayak, A. K., Kalari, S., Kodandaram, S. R., Jayarathna, S., Lee, H.-N., & Ashok, V. (2024) · Lecture Notes in Computer Science · doi:10.1007/978-3-031-72437-4_12 · Cited by 8 · see citing works
“Third party user-side solutions can also be designed which provide uniform proxy interfaces on top of the original web pages (e.g., [25,41,47]).”
Self-citationFerdous, J., Lee, H.-N., Jayarathna, S., & Ashok, V. (2023) · ACM Transactions on Interactive Intelligent Systems · doi:10.1145/3579364 · Cited by 7 · see citing works
Self-citationAccessibility Design Issues beyond the Standards of Government e-Services for People with Low Vision
Sala, A., Arrue, M., Pérez, J. E., Espín-Tello, S. M., & Moreno, L. (2023) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2023.2241609 · Cited by 7 · see citing works
“In this sense, tools, such as the one described in (Ferdous et al., 2022) which facilitates the use of screen readers for accessing the fields in online forms will be considered.”
AccessMenu: Enhancing Usability of Online Restaurant Menus for Screen Reader Users
Venkatraman, N., Nayak, A. K., Dahal, S., Prakash, Y., Lee, H.-N., & Ashok, V. G. (2025) · International Web for All Conference (W4A) · doi:10.1145/3744257.3744275 · Cited by 3 · see citing works
Self-citationAdapting Online Customer Reviews for Blind Users: A Case Study of Restaurant Reviews
Sunkara, M., Nayak, A. K., Kalari, S., Prakash, Y., Jayarathna, S., Lee, H.-N., & Ashok, V. G. (2025) · International Web for All Conference (W4A) · doi:10.1145/3744257.3744276 · Cited by 2 · see citing works
Self-citationMicro-Behavioral Analysis of Online Shopping Patterns for Blind Users
Prakash, Y., Nayak, A. K., Venkatraman, N., Jayarathna, S., Lee, H.-N., & Ashok, V. G. (2026) · Conference on Human Information Interaction and Retrieval · doi:10.1145/3786304.3788841 · Cited by 2 · see citing works
Self-citationContext-Based Model for Browsing the Web Through Voice
Montiel, C. S. A., Rodríguez, J., Mendoza, S., & Decouchant, D. (2025) · Applied Sciences · doi:10.3390/app15063400 · Cited by 1 · see citing works
Voice-Based User Interface Development for Android Mobile Applications
Montiel, C. S. A., Rodríguez, J., Vergara, S. V. C., & Mendoza, S. (2024) · Communications in computer and information science · doi:10.1007/978-3-031-77290-0_14
- Authors
- Ferdous, J., Lee, H.-N., Jayarathna, S., & Ashok, V.
- Affiliations
- Department of Computer Science, Old Dominion University, United States
- Stony Brook University (US)
- Old Dominion University (US)
- Venue
- 27th International Conference on Intelligent User Interfaces
- Publisher
- ACM
- Published
- 2022-03-22
- Pages
- 49-62
- OpenAlex
- W4221080967
- Cited by
- 11
- References
- 35
- Citations by year
- 2026: 1 · 2025: 4 · 2024: 3 · 2023: 3
- FWCI
- 3.64
- Type
- conference paper
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- ACM International Conference on Intelligent User Interfaces (IUI) (publishedVersion)
- ODU Digital Commons (Old Dominion University) (submittedVersion)
- Funders
- National Science Foundation (1936027, 2113485, 1805076)
- National Institutes of Health (R01EY030085, R01HD097188)
- National Eye Institute (R01EY030085)
- Eunice Kennedy Shriver National Institute of Child Health and Human Development (R01HD097188)
- Topics
- Social Sciences › Human Factors and Ergonomics › Digital Accessibility for Disabilities
- Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
- Health Sciences › Health Professions › Occupational Therapy › Assistive Technology in Communication and Mobility
- Keywords
- screen readers, blind users, browser extension, content navigation, assistive technology, usability evaluation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
