Wizard-of-Oz evaluation of speech-driven web browsing interface for people with vision impairments
The DOI matches its Crossref record; 17 of the 17 references it cites were found in a registry or an index.
Abstract
People with visual impairments typically interact with the Web using screen readers that perform serial text-to-speech narration of the content. Although they rely on keyboard shortcuts to navigate through the content quickly, browsing fatigue caused by too many keyboard presses and clicks, increased cognitive load caused by having to remember many shortcuts, and information overload from having to listen to irrelevant content, are all too common. Speech-based interaction modality has the potential to address these shortcomings by allowing users to engage in a dialog with an intelligent agent capable of translating user commands/requests to system actions and generating appropriate responses to them.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
(2008) · Oxford University Press eBooks · doi:10.1093/acref/9780195306613.001.0001 · Cited by 502
What Frustrates Screen Reader Users on the Web: A Study of 100 Blind Users
Lazar, J., Allen, A., Kleinman, J., & Malarkey, C. (2007) · International Journal of Human-Computer Interaction · doi:10.1080/10447310709336964 · Cited by 354
CoScripter: automating & sharing how-to knowledge in the enterprise
Leshed, G., Haber, E. M., Matthews, T., & Lau, T. (2008) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1357054.1357323 · Cited by 311
More than meets the eye: a survey of screen-reader browsing strategies
Borodin, Y., Bigham, J. P., Dausch, G., & Ramakrishnan, I. V. (2010) · Proceedings of the 2010 International Cross Disciplinary Conference on Web Accessibility (W4A) · doi:10.1145/1805986.1806005 · Cited by 222
Self-citationAutomating Web navigation with the WebVCR
Anupam, V., Freire, J., Kumar, B., & Lieuwen, D. F. (2000) · Computer Networks · doi:10.1016/s1389-1286(00)00073-6 · Cited by 121
The AT&T spoken language understanding system
Gupta, N., Tür, G., Hakkani-Tür, D. Z., Bangalore, S., Riccardi, G., & Gilbert, M. (2005) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/tsa.2005.854085 · Cited by 113
National Center For Supercomputing Applications
(2014) · Chapman & Hall/CRC eBooks · doi:10.1201/b17572-13 · Cited by 107
Andreessen, M. (1993) · CTIT technical reports series · Cited by 91
No Code Required: Giving Users Tools to Transform the Web
Cypher, A., Dontcheva, M., Lau, T. A., & Nichols, J. W. (2010) · Cited by 68
Here's what i did: sharing and reusing web activity with ActionShot
Li, I., Nichols, J., Lau, T., Drews, C., & Cypher, A. (2010) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1753326.1753432 · Cited by 67
Research works printed but not linked: 3
- Brooke , J. , SUS-A quick and dirty usability scale. Usability evaluation in industry , 1996 . 189: p. 194. Brooke, J., SUS-A quick and dirty usability scale. Usability evaluation in industry, 1996. 189: p. 194.
- VoiceOver , Screen reader from Apple . 2010 . VoiceOver, Screen reader from Apple. 2010.
- Window-Eyes , Screen Reader GW Micro . 2010 . Window-Eyes, Screen Reader GW Micro. 2010.
Cited by
Pradhan, A., Mehta, K., & Findlater, L. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3174033 · Cited by 448
Açikgöz, F., & Perez‐Vega, R. (2021) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2021.1987677 · Cited by 126
Mapping natural language commands to web elements
Pasupat, P., Jiang, T.-S., Liu, E. Z., Guu, K., & Liang, P. (2018) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d18-1540 · Cited by 56
Understanding the Adoption of Voice Activated Personal Assistants
Coskun-Setirek, A., & Mardikyan, S. (2017) · International Journal of E-Services and Mobile Applications · doi:10.4018/ijesma.2017070101 · Cited by 44
Web Screen Reading Automation Assistance Using Semantic Abstraction
Ashok, V., Puzis, Y., Borodin, Y., & Ramakrishnan, I. V. (2017) · Proceedings of the 22nd International Conference on Intelligent User Interfaces · doi:10.1145/3025171.3025229 · Cited by 44
Self-citationVERSE: Bridging Screen Readers and Voice Assistants for Enhanced Eyes-Free Web Search
Vtyurina, A., Fourney, A., Morris, M. R., Findlater, L., & White, R. W. (2019) · Proceedings of the 21st International ACM SIGACCESS Conference on Computers and Accessibility · doi:10.1145/3308561.3353773 · Cited by 42
Capti-speak: a speech-enabled web screen reader
Ashok, V., Borodin, Y., Puzis, Y., & Ramakrishnan, I. V. (2015) · Proceedings of the 12th International Web for All Conference · doi:10.1145/2745555.2746660 · Cited by 33
“Note that there can only be one relative descriptor, if any, in utterances; this was confirmed in the earlier Wizard-of-Oz study [2].”
BackgroundMethodResultInfluentialSelf-citation"Hey Model!" – Natural User Interactions and Agency in Accessible Interactive 3D Models
Reinders, S., Butler, M., & Marriott, K. (2020) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376145 · Cited by 32
Barbosa, N. M., Hayes, J., Kaushik, S., & Wang, Y. (2022) · ACM Transactions on Accessible Computing · doi:10.1145/3519032 · Cited by 28
“, [9, 44, 51, 66]), automating individual interactions with page elements such as “click search button,” via voice commands [8, 9], and re-narrating or re-structuring the content of web pages in ways suitable to assistive technology users [16, 21, 47, 52].”
BackgroundEvaluating the accessibility of line graphs through textual summaries for visually impaired users
Moraes, P., Sina, G., McCoy, K., & Carberry, S. (2014) · Proceedings of the 16th international ACM SIGACCESS conference on Computers & accessibility - ASSETS '14 · doi:10.1145/2661334.2661368 · Cited by 28
Detecting Deceptive Dark-Pattern Web Advertisements for Blind Screen-Reader Users
Kodandaram, S. R., Sunkara, M., Jayarathna, S., & Ashok, V. G. (2023) · Journal of Imaging · doi:10.3390/jimaging9110239 · Cited by 21
Self-citationAuto-Suggesting Browsing Actions for Personalized Web Screen Reading
Ashok, V., Billah, S. M., Borodin, Y., & Ramakrishnan, IV (2019) · Proceedings of the 27th ACM Conference on User Modeling, Adaptation and Personalization · doi:10.1145/3320435.3320460 · Cited by 19
Self-citationNicolau, H., & Montague, K. (2019) · Human-computer interaction series · doi:10.1007/978-1-4471-7440-0_18 · Cited by 19
Enabling Customization of Discussion Forums for Blind Users
Sunkara, M., Prakash, Y., Lee, H.-N., Jayarathna, S., & Ashok, V. (2023) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3593228 · Cited by 13
Self-citationDesigning for Parental Control: Enriching Usability and Accessibility in the Context of Smart Toys
Salgado, A. D. L., do Amaral, L. A., Castro, P. C., & Fortes, R. P. D. M. (2017) · International series on computer entertainment and media technology · doi:10.1007/978-3-319-62072-5_7 · Cited by 11
Semi-aural Interfaces: Investigating Voice-controlled Aural Flows
Ghahari, R. R., George-Palilonis, J. A., Hossain, G., Kaser, L., & Bolchini, D. P. (2016) · Interacting with Computers · doi:10.1093/iwc/iww004 · Cited by 4
Exploring the Intersections of Web Science and Accessibility
Bostic, T., Stanley, J. C., Higgins, J. H., Chudnov, D., Montgomery, R. L. B., & Brunelle, J. F. (2019) · Advances in intelligent systems and computing · doi:10.1007/978-3-030-27928-8_73 · Cited by 4
Adapting Online Customer Reviews for Blind Users: A Case Study of Restaurant Reviews
Sunkara, M., Nayak, A. K., Kalari, S., Prakash, Y., Jayarathna, S., Lee, H.-N., & Ashok, V. G. (2025) · International Web for All Conference (W4A) · doi:10.1145/3744257.3744276 · Cited by 3
Self-citationAkter, T., Swaminathan, M., & Kapadia, A. C. (2024) · International Web for All Conference (W4A) · doi:10.1145/3677846.3677862 · Cited by 3
Giving the Wizard Voice: Testing Voice Interfaces with Blind Users Using Wizard of Oz Prototypes
Nazir, C., Biddulph, S., & Neher, A. (2025) · Communications in computer and information science · doi:10.1007/978-3-031-94156-6_16 · Cited by 3
EXPLORING THE ACCESSIBILITY OF HOME-BASED, VOICE-CONTROLLED INTELLIGENT PERSONAL ASSISTANTS
Pradhan, A. (2018) · University Libraries (University of Maryland) · doi:10.13016/m2mw28j0f · Cited by 2
Eyes on the Palm: Investigating a Ring-Shaped Camera for Seamless Accessible Tactile Exploration
Tsutsui, A., Wang, X., Takagi, H., Ochiai, Y., & Asakawa, C. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3791659 · Cited by 2
Kodandaram, S. R., Zhou, J., Bi, X., Ramakrishnan, I. V., & Ashok, V. G. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3790956 · Cited by 2
Self-citationFaisandaz, G. R. J. (2024) · theses.fr (ABES) · doi:10.70675/2f3f30caza9c4z4f38z9db2z7452d74c9887 · Cited by 1
Improving Youtube for the vision-impaired : a system for casual crowdsourced annotations
Westra, E. D., & 奥出, 直. (2014) · Institutional Repositories DataBase (IRDB)
Reliability-Aware Multi-Agent Sonification for Visually Impaired Indoor Navigation
Madalin, M. A., & Alboaie, L. (2026) · IEEE Annual International Computer Software and Applications Conference (COMPSAC) · doi:10.1109/compsac69091.2026.00076
Designing for Ring Camera Use: Spatial Interaction Strategies of Blind and Low Vision People
Tsutsui, A., Wang, X., Guerreiro, J., Takagi, H., Ochiai, Y., & Asakawa, C. (2026) · International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS) · doi:10.1145/3797867.3828989
Five-Factor Model as a Predictor for Spoken Dialog Systems
Carter, T. G. (2016) · NSUWorks (Nova Southeastern University)
Metadata
- Authors
- Ashok, V., Borodin, Y., Stoyanchev, S., Puzis, Y., & Ramakrishnan, I. V.
- Affiliations
- Stony Brook University (US)
- Charmtech Labs (United States) (US)
- AT&T (United States) (US)
- Venue
- Proceedings of the 11th Web for All Conference
- Publisher
- ACM
- Published
- 2014-04-07
- Pages
- 1-9
- OpenAlex
- W2072829913
- Cited by
- 28
- References
- 16
- Citations by year
- 2026: 4 · 2025: 2 · 2024: 2 · 2023: 2 · 2022: 1 · 2021: 1 · 2020: 1 · 2019: 4 · 2018: 3 · 2017: 3 · 2016: 2 · 2015: 1 · 2014: 2
- FWCI
- 3.20
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- International Web for All Conference (W4A) (publishedVersion)
- Funders
- National Eye Institute (1R43EY21962-1A1)
- Topics
- Social Sciences › Human Factors and Ergonomics › Digital Accessibility for Disabilities
- Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Keywords
- visual impairment, screen readers, Wizard of Oz evaluation, speech-based interaction, intelligent agents, cognitive load, information overload, assistive technology, web accessibility
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.