The DOI matches its Crossref record; 51 of the 52 references it cites were found in a registry or an index.
VERSE: Bridging Screen Readers and Voice Assistants for Enhanced Eyes-Free Web Search
Abstract
People with visual impairments often rely on screen readers when interacting with computer systems. Increasingly, these individuals also make extensive use of voice-based virtual assistants (VAs). We conducted a survey of 53 people who are legally blind to identify the strengths and weaknesses of both technologies, and the unmet opportunities at their intersection. We learned that virtual assistants are convenient and accessible, but lack the ability to deeply engage with content (e.g., read beyond the first few sentences of an article), and the ability to get a quick overview of the landscape (e.g., list alternative search results and suggestions). In contrast, screen readers allow for deep engagement with content (when content is accessible), and provide fine-grained navigation and control, but at the cost of reduced walk-up-and-use convenience. Based on these findings, we implemented VERSE (Voice Exploration, Retrieval, and SEarch), a prototype that extends a VA with screen-reader-inspired capabilities, and allows other devices (e.g., smartwatches) to serve as optional input accelerators. In a usability study with 12 blind screen reader users we found that VERSE meaningfully extended VA functionality. Participants especially valued having access to multiple search results and search verticals.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Participants preferred browsing websites themselves over using virtual assistants, which have been proposed as potential solutions [52].”
From From Cluttered to Clear: Improving the Web Accessibility Design for Screen Reader Users in E-commerce With Generative AI (2025) · cites this paper as [52]
In the citing paper
“Screen readers provide fine-grained information navigation and control, but at the cost of reduced walk-up-and-use convenience [34].”
From Revamp: Enhancing Accessible Information Seeking Experience of Online Shopping for Blind or Low Vision Users (2021) · cites this paper as [34]
In the citing paper
“Besides inadequate descriptions of images, the online shopping experience of BLV people is also hindered by the weaknesses of screen readers dealing with crowded websites.”
From Revamp: Enhancing Accessible Information Seeking Experience of Online Shopping for Blind or Low Vision Users (2021) · cites this paper as [34]
Citations
Cites
(2001) · Cited by 13,930
The critical incident technique.
Flanagan, J. C. (1954) · Psychological Bulletin · doi:10.1037/h0061470 · Cited by 8,191
(2007) · Encyclopedia of Industrial and Organizational Psychology · doi:10.4135/9781412952651.n55 · Cited by 5,287
Luger, E., & Sellen, A. (2016) · Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858288 · Cited by 1,176
(2017) · Research Methods in Human Computer Interaction · doi:10.1016/b978-0-12-805390-4.09991-x · Cited by 889
Exploratory Search: Beyond the Query-Response Paradigm
White, R. W., & Roth, R. A. (2009) · Synthesis lectures on information concepts, retrieval, and services · doi:10.2200/s00174ed1v01y200901icr003 · Cited by 632
Self-citationPradhan, A., Mehta, K., & Findlater, L. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3174033 · Cited by 448
Self-citationA Theoretical Framework for Conversational Search
Radlinski, F., & Craswell, N. (2017) · Proceedings of the 2017 Conference on Conference Human Information Interaction and Retrieval · doi:10.1145/3020165.3020183 · Cited by 439
Determining what individual SUS scores mean
(2009) · Journal of Usability Studies archive · doi:10.5555/2835587.2835589 · Cited by 412
What Frustrates Screen Reader Users on the Web: A Study of 100 Blind Users
Lazar, J., Allen, A., Kleinman, J., & Malarkey, C. (2007) · International Journal of Human-Computer Interaction · doi:10.1080/10447310709336964 · Cited by 354
"What can i help you with?": infrequent users' experiences of intelligent personal assistants
Cowan, B. R., Pantidi, N., Coyle, D., Morrissey, K., Clarke, P., Al-Shehri, S., Earley, D., & Bandeira, N. (2017) · Proceedings of the 19th International Conference on Human-Computer Interaction with Mobile Devices and Services · doi:10.1145/3098279.3098539 · Cited by 351
Talk to me: Exploring user interactions with the Amazon Alexa
Lopatovska, I., Rink, K., Knight, I., Raines, K., Cosenza, K., Williams, H., Sorsche, P., Hirsch, D., Li, Q., & Martinez, A. (2019) · Journal of Librarianship and Information Science · doi:10.1177/0961000618759414 · Cited by 298
The relationship between accessibility and usability of websites
Petrie, H., & Kheir, O. (2007) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1240624.1240688 · Cited by 297
Reducing legacy bias in gesture elicitation studies
Morris, M. R., Danielescu, A., Drucker, S., Fisher, D., Lee, B., schraefel, M. C., & Wobbrock, J. O. (2014) · Interactions · doi:10.1145/2591689 · Cited by 254
Self-citationPrivacy Concerns for Use of Voice Activated Personal Assistant in the Public Space
Easwara Moorthy, A., & Vu, K.-P. L. (2015) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2014.986642 · Cited by 250
More than meets the eye: a survey of screen-reader browsing strategies
Borodin, Y., Bigham, J. P., Dausch, G., & Ramakrishnan, I. V. (2010) · Proceedings of the 2010 International Cross Disciplinary Conference on Web Accessibility (W4A) · doi:10.1145/1805986.1806005 · Cited by 222
Exploratory Search: Beyond the Query—Response Paradigm
White, R. W., & Roth, R. A. (2009) · Synthesis Lectures on Information Concepts, Retrieval, and Services · doi:10.1007/978-3-031-02260-9 · Cited by 182
Self-citationAbdolrahmani, A., Kuber, R., & Branham, S. M. (2018) · Proceedings of the 20th International ACM SIGACCESS Conference on Computers and Accessibility · doi:10.1145/3234695.3236344 · Cited by 172
WebInSight: making web images accessible
Bigham, J. P., Kaminsky, R. S., Ladner, R. E., Danielsson, O. M., & Hempton, G. L. (2006) · Proceedings of the 8th international ACM SIGACCESS conference on Computers and accessibility · doi:10.1145/1168987.1169018 · Cited by 161
WebinSitu: a comparative analysis of blind and sighted browsing behavior
Bigham, J. P., Cavender, A. C., Brudvik, J. T., Wobbrock, J. O., & Ladner, R. E. (2007) · Proceedings of the 9th international ACM SIGACCESS conference on Computers and accessibility · doi:10.1145/1296843.1296854 · Cited by 153
Searching by Talking: Analysis of Voice Queries on Mobile Web Search
Guy, I. (2016) · Proceedings of the 39th International ACM SIGIR conference on Research and Development in Information Retrieval · doi:10.1145/2911451.2911525 · Cited by 140
How Do People Interact in Conversational Speech-Only Search Tasks: A Preliminary Analysis
Trippas, J. R., Spina, D., Cavedon, L., & Sanderson, M. (2017) · Conference on Human Information Interaction and Retrieval · doi:10.1145/3020165.3022144 · Cited by 117
Caption Crawler: Enabling Reusable Alternative Text Descriptions using Reverse Image Search
Guinness, D., Cutrell, E., & Morris, M. R. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3174092 · Cited by 108
Self-citationYarosh, S., Thompson, S., Watson, K., Chase, A., Senthilkumar, A., Yuan, Y., & Brush, A. J. B. (2018) · ACM International Conference on Interaction Design and Children (IDC) · doi:10.1145/3202185.3202207 · Cited by 91
Sahib, N. G., Tombros, A., & Stockman, T. (2012) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.21696 · Cited by 83 · cited 2×
“Even with these mitigation strategies, comparative analysis has shown that blind users require more time per visited web page compared to sighted users, signalling that more accessibility research is needed to to close this gap [40, 12].”
BackgroundUser Variability and IR System Evaluation
Bailey, P., Moffat, A., Scholer, F., & Thomas, P. (2015) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/2766462.2767728 · Cited by 77
The Effects of "Not Knowing What You Don't Know" on Web Accessibility for Blind Web Users
Bigham, J. P., Lin, I., & Savage, S. (2017) · Proceedings of the 19th International ACM SIGACCESS Conference on Computers and Accessibility · doi:10.1145/3132525.3132533 · Cited by 73
JustSpeak: enabling universal voice control on Android
Zhong, Y., Raman, T. V., Burkhardt, C., Biadsy, F., & Bigham, J. P. (2014) · Proceedings of the 11th Web for All Conference · doi:10.1145/2596695.2596720 · Cited by 70
Hands free - care free: elderly people taking advantage of speech-only interaction
Wulf, L., Garschall, M., Himmelsbach, J., & Tscheligi, M. (2014) · Proceedings of the 8th Nordic Conference on Human-Computer Interaction: Fun, Fast, Foundational · doi:10.1145/2639189.2639251 · Cited by 64
Retrieve-and-Read: Multi-task Learning of Information Retrieval and Reading Comprehension
Nishida, K., Saito, I., Otsuka, A., Asano, H., & Tomita, J. (2018) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3269206.3271702 · Cited by 64
Understanding the Needs of Searchers with Dyslexia
Morris, M. R., Fourney, A., Ali, A. X., & Vonessen, L. (2018) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3173609 · Cited by 56
Self-citationIvory, M. Y., Yu, S., & Gronemyer, K. (2004) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/985921.986088 · Cited by 50
Pyae, A., & Scifleet, P. (2018) · Australian Conference on Computer-Human Interaction (OzCHI) · doi:10.1145/3292147.3292236 · Cited by 46
Ahmed, F., Borodin, Y., Soviak, A., Islam, M. A., Ramakrishnan, I. V., & Hedgpeth, T. (2012) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/2380116.2380164 · Cited by 45
Trippas, J. R., Spina, D., Sanderson, M., & Cavedon, L. (2015) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/2766462.2767826 · Cited by 43
Nonvisual Interaction Techniques at the Keyboard Surface
Khurana, R., McIsaac, D., Lockerman, E., & Mankoff, J. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3173585 · Cited by 34
Capti-speak: a speech-enabled web screen reader
Ashok, V., Borodin, Y., Puzis, Y., & Ramakrishnan, I. V. (2015) · Proceedings of the 12th International Web for All Conference · doi:10.1145/2745555.2746660 · Cited by 33
From screen reading to aural glancing: towards instant access to key page sections
Gadde, P., & Bolchini, D. (2014) · Proceedings of the 16th international ACM SIGACCESS conference on Computers & accessibility - ASSETS '14 · doi:10.1145/2661334.2661363 · Cited by 30
Retrieve-and-Read: Multi-task Learning of Information Retrieval and Reading ComprehensionPreprint
Nishida, K., Saito, I., Otsuka, A., Asano, H., & Tomita, J. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1808.10628 · Cited by 27
Should I Trust It When I Cannot See It? Credibility Assessment for Blind Web Users
Abdolrahmani, A., & Kuber, R. (2016) · International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS) · doi:10.1145/2982142.2982173 · Cited by 25
Wizard-of-Oz evaluation of speech-driven web browsing interface for people with vision impairments
Ashok, V. G., Borodin, Y., Stoyanchev, S., Puzis, Y., & Ramakrishnan, I. V. (2014) · International Web for All Conference (W4A) · doi:10.1145/2596695.2596699 · Cited by 24
Trippas, J. R. (2015) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/2766462.2767850 · Cited by 24
Scanning for Digital Content: How Blind and Sighted People Perceive Concurrent Speech
Guerreiro, J., & Gonçalves, D. J. V. (2016) · ACM Transactions on Accessible Computing · doi:10.1145/2822910 · Cited by 22
Non-visual Web Browsing: Beyond Web Accessibility
Ramakrishnan, I. V., Ashok, V. G., & Billah, S. M. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-58703-5_24 · Cited by 21
Berry, J. (1999) · Information technology and disabilities · Cited by 20
An exploratory study understanding the appropriated use of voice-based Search and Assistants
Bhalla, A. (2018) · Proceedings of the 9th Indian Conference on Human-Computer Interaction · doi:10.1145/3297121.3297136 · Cited by 16 · cited 1×
“Furthermore, all our survey participants were based in the U.S. Understanding the voice search needs of people from other regions [11, 37] is a valuable area of future work.”
BackgroundThe Influence of Screen-Readers on Web Cognition
Stockman, T., & Metatla, O. (2008) · Bristol Research (University of Bristol) · Cited by 16
Sasayaki: an augmented voice-based web browsing experience
Zhu, S., Sato, D., Takagi, H., & Asakawa, C. (2010) · Proceedings of the 12th international ACM SIGACCESS conference on Computers and accessibility · doi:10.1145/1878803.1878870 · Cited by 14
Understanding accessibility problems of blind users on the web
Savva, A. G. (2017) · White Rose eTheses Online (University of Leeds, The University of Sheffield, University of York) · Cited by 10
Tightly coupling visual and linguistic features for enriching audio-based web browsing experience
Islam, M. A., Ahmed, F., Borodin, Y., & Ramakrishnan, I. V. (2011) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/2063576.2063896 · Cited by 8
Web Search Credibility Assessment for Individuals who are Blind
Abdolrahmani, A., Kuber, R., & Easley, W. (2015) · International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS) · doi:10.1145/2700648.2811349 · Cited by 2
Research works printed but not linked: 4
- John Brooke and others. 1996. SUS-A quick and dirty usability scale. Usability evaluation in industry 189, 194 (1996), 4--7.
- Jonathan Lazar, Jinjuan Heidi Feng, and Harry Hochheiser. 2017. Research methods in human-computer interaction. Morgan Kaufmann.
- Rishabh Mehrotra, A Hassan Awadallah, AE Kholy, and Imed Zitouni. 2017. Hey Cortana! Exploring the use cases of a Desktop based Digital Assistant. In SIGIR 1st International Workshop on Conversational Approaches to Information Retrieval (CAIR'17), Vol. 4.
- Janice Y. Tsai Tawfiq Ammari Abraham Wallin and Jofish Kaye. 2018. Alexa play some music: Categorization of Alexa Commands. In Voice-based Conversational UX Studies and Design Wokrshop at CHI. ACM.
Cited by
Voice Assistants and Smart Speakers in Everyday Life and in Education
TERZOPOULOS, G., & SATRATZEMI, M. (2020) · Informatics in Education · doi:10.15388/infedu.2020.21 · Cited by 161
Toward fairness in AI for people with disabilities SBG@a research roadmap
Guo, A., Kamar, E., Vaughan, J. W., Wallach, H., & Morris, M. R. (2020) · ACM SIGACCESS Accessibility and Computing · doi:10.1145/3386296.3386298 · Cited by 128
Self-citationAbdolrahmani, A., Storer, K. M., Roy, A. R. M., Kuber, R., & Branham, S. M. (2019) · ACM Transactions on Accessible Computing · doi:10.1145/3368426 · Cited by 68
VizAbility: Enhancing Chart Accessibility with LLM-based Conversational Interaction
Gorniak, J., Kim, Y., Wei, D., & Kim, N. W. (2024) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/3654777.3676414 · Cited by 66
Firefox Voice: An Open and Extensible Voice Assistant Built Upon the Web
Cambre, J., Williams, A. C., Razi, A., Bicking, I., Wallin, A., Tsai, J., Kulkarni, C., & Kaye, J. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445409 · Cited by 39
Metadata
- Authors
- Vtyurina, A., Fourney, A., Morris, M. R., Findlater, L., & White, R. W.
- Affiliations
- University of Waterloo (CA)
- Microsoft (United States) (US)
- University of Washington (US)
- Venue
- Proceedings of the 21st International ACM SIGACCESS Conference on Computers and Accessibility
- Publisher
- ACM
- Published
- 2019-10-24
- Pages
- 414-426
- OpenAlex
- W2981449230
- Cited by
- 42
- References
- 52
- Citations by year
- 2026: 2 · 2025: 10 · 2024: 5 · 2023: 6 · 2022: 4 · 2021: 8 · 2020: 7
- FWCI
- 9.13
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS) (publishedVersion)
- Topics
- Social Sciences › Human Factors and Ergonomics › Digital Accessibility for Disabilities
- Health Sciences › Health Professions › Occupational Therapy › Assistive Technology in Communication and Mobility
- Life Sciences › Neuroscience › Cognitive Neuroscience › Tactile and Sensory Interactions
- Keywords
- visual impairment, screen readers, voice assistants, blind users, accessible computing, poetry, smartwatches, assistive technology
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.