"Siri Talks at You": An Empirical Investigation of Voice-Activated Personal Assistant (VAPA) Usage by Individuals Who Are Blind
The DOI matches its Crossref record; 28 of the 28 references it cites were found in a registry or an index.
Abstract
Voice-activated personal assistants (VAPAs)--like Amazon Echo or Apple Siri--offer considerable promise to individuals who are blind due to widespread adoption of these non-visual interaction platforms. However, studies have yet to focus on the ways in which these technologies are used by individuals who are blind, along with whether barriers are encountered during the process of interaction. To address this gap, we interviewed fourteen legally-blind adults with experience of home and/or mobile-based VAPAs. While participants appreciated the access VAPAs provided to inaccessible applications and services, they faced challenges relating to the input, responses from VAPAs, and control of information presented. User behavior varied depending on the situation or context of the interaction. Implications for design are suggested to support inclusivity when interacting with VAPAs. These include accounting for privacy and situational factors in design, examining ways to support concerns over trust, and synchronizing presentation of visual and non-visual cues.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Recent research has shown how smart speakers such as Amazon's 'Echo' devices have been used to support older adults in their homes to live independently and support their own health and wellbeing [1,13,16].”
From Amazon Echo Show as a Multimodal Human-to-Human Care Support Tool within Self-Isolating Older UK Households (2022) · cites this paper as [1]
In the citing paper
“They prefer to customize speech, rate, clarity, and intensity of the voice output according to the task at hand [1].”
From Reading Between the Guidelines: How Commercial Voice Assistant Guidelines Hinder Accessibility for Blind Users (2019) · cites this paper as [1]
In the citing paper
“It can be challenging for blind users to recover from dictation errors made in such long messages, as fixing an error requires dictating the entire message again [1].”
From Reading Between the Guidelines: How Commercial Voice Assistant Guidelines Hinder Accessibility for Blind Users (2019) · cites this paper as [1]
In the citing paper
“For example, studies report that, unlike other groups, long messages and complex commands are often used by blind users [1,2].”
From Reading Between the Guidelines: How Commercial Voice Assistant Guidelines Hinder Accessibility for Blind Users (2019) · cites this paper as [1]
In the citing paper
“Blind users particularly desire the ability to perform complex tasks with finer control than is currently possible through commercial voice interfaces [1,37].”
From Reading Between the Guidelines: How Commercial Voice Assistant Guidelines Hinder Accessibility for Blind Users (2019) · cites this paper as [1]
10 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Luger, E., & Sellen, A. (2016) · Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858288 · Cited by 1,176
Pradhan, A., Mehta, K., & Findlater, L. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3174033 · Cited by 448 · cited 7×
“Notably, Pradhan, Mehta, and Findlater [21] have recently shown that a broad range of people with disabilities––and, prominently, people with Session 6: Advancing Communication ASSETS’18, October 22–24, 2018, Galway, Ireland”
BackgroundInfluentialPortet, F., Vacher, M., Golanski, C., Roux, C., & Meillon, B. (2013) · Personal and Ubiquitous Computing · doi:10.1007/s00779-011-0470-5 · Cited by 421
What Frustrates Screen Reader Users on the Web: A Study of 100 Blind Users
Lazar, J., Allen, A., Kleinman, J., & Malarkey, C. (2007) · International Journal of Human-Computer Interaction · doi:10.1080/10447310709336964 · Cited by 354 · cited 1×
“For years, assistive technology researchers have been studying the design of accessible voice-based interfaces for the blind community [2,14,18,19,21].”
Background"What can i help you with?": infrequent users' experiences of intelligent personal assistants
Cowan, B. R., Pantidi, N., Coyle, D., Morrissey, K., Clarke, P., Al-Shehri, S., Earley, D., & Bandeira, N. (2017) · Proceedings of the 19th International Conference on Human-Computer Interaction with Mobile Devices and Services · doi:10.1145/3098279.3098539 · Cited by 351
Talk to me: Exploring user interactions with the Amazon Alexa
Lopatovska, I., Rink, K., Knight, I., Raines, K., Cosenza, K., Williams, H., Sorsche, P., Hirsch, D., Li, Q., & Martinez, A. (2019) · Journal of Librarianship and Information Science · doi:10.1177/0961000618759414 · Cited by 298 · cited 3×
“queries such as determining environmental conditions [16], to listen to the news, for playing music, and controlling external devices [15].”
BackgroundDrishti: an integrated navigation system for visually impaired and disabled
Helal, A., Moore, S. E., & Ramachandran, B. (2002) · Proceedings Fifth International Symposium on Wearable Computers · doi:10.1109/iswc.2001.962119 · Cited by 290
Understanding adoption of intelligent personal assistants: A parasocial relationship perspective
Han, S., & Yang, H. (2018) · Industrial Management & Data Systems · doi:10.1108/imds-05-2017-0214 · Cited by 289
Privacy Concerns for Use of Voice Activated Personal Assistant in the Public Space
Easwara Moorthy, A., & Vu, K.-P. L. (2015) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2014.986642 · Cited by 250
Branham, S. M., & Kane, S. K. (2015) · Proceedings of the 17th International ACM SIGACCESS Conference on Computers & Accessibility - ASSETS '15 · doi:10.1145/2700648.2809864 · Cited by 169
Self-citationExploring the use of speech input by blind people on mobile devices
Azenkot, S., & Lee, N. B. (2013) · Proceedings of the 15th International ACM SIGACCESS Conference on Computers and Accessibility · doi:10.1145/2513383.2513440 · Cited by 151 · cited 7×
“While less is known about the experiences and barriers when accessing VAPAs, studies have examined issues associated with speech input for individuals who are blind, in terms of mobile device usage [2,26] for purposes of navigation [13] and supporting education [3,18,23,24].”
BackgroundInfluentialSearching by Talking: Analysis of Voice Queries on Mobile Web Search
Guy, I. (2016) · Proceedings of the 39th International ACM SIGIR conference on Research and Development in Information Retrieval · doi:10.1145/2911451.2911525 · Cited by 140
2015 Americas Conference on Information Systems, AMCIS 2015
Singh, K., Janz, B. D., Richardson, S. M., Agrawal, D., & Amis, J. (2015) · Americas Conference on Information Systems · Cited by 130
An empirical investigation into the difficulties experienced by visually impaired Internet users
Murphy, E., Kuber, R., McAllister, G., Strain, P., & Yu, W. (2008) · Universal Access in the Information Society · doi:10.1007/s10209-007-0098-4 · Cited by 99
Self-citationAssistive Technology for Students with Visual Impairments and Blindness
Mulloy, A. M., Gevarter, C., Hopkins, M., Sutherland, K. S., & Ramdoss, S. T. (2014) · Autism and child psychopathology series · doi:10.1007/978-1-4899-8029-8_5 · Cited by 86
JustSpeak: enabling universal voice control on Android
Zhong, Y., Raman, T. V., Burkhardt, C., Biadsy, F., & Bigham, J. P. (2014) · Proceedings of the 11th Web for All Conference · doi:10.1145/2596695.2596720 · Cited by 70
Abdolrahmani, A., Kuber, R., & Hurst, A. (2016) · Proceedings of the 13th International Web for All Conference · doi:10.1145/2899475.2899482 · Cited by 67
Self-citationHands free - care free: elderly people taking advantage of speech-only interaction
Wulf, L., Garschall, M., Himmelsbach, J., & Tscheligi, M. (2014) · Proceedings of the 8th Nordic Conference on Human-Computer Interaction: Fun, Fast, Foundational · doi:10.1145/2639189.2639251 · Cited by 64
Branham, S. M., Abdolrahmani, A., Easley, W., Scheuerman, M., Ronquillo, E., & Hurst, A. (2017) · Proceedings of the 19th International ACM SIGACCESS Conference on Computers and Accessibility · doi:10.1145/3132525.3132534 · Cited by 49
Self-citationUnderstanding the Adoption of Voice Activated Personal Assistants
Coskun-Setirek, A., & Mardikyan, S. (2017) · International Journal of E-Services and Mobile Applications · doi:10.4018/ijesma.2017070101 · Cited by 44 · cited 1×
“Research has examined VAPA technology adoption, including characteristics that change users’ adoption resistance, the preferred user interfaces to interact with different services provided in different contexts, and user perception and experience with technology [6,7,12].”
BackgroundSpeaking Math — A Voice Input, Speech Output Calculator for Students with Visual Impairments
Bouck, E. C., Flanagan, S., Joshi, G. S., Sheikh, W., & Schleppenbach, D. (2011) · Journal of Special Education Technology · doi:10.1177/016264341102600401 · Cited by 37
Evaluating the Social Acceptability of Voice Based Smartwatch Search
Efthymiou, C., & Halvey, M. J. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-48051-0_20 · Cited by 37
How Personal Experience and Technical Knowledge Affect Using Conversational Agents
Chen, M.-L., & Wang, H.-C. (2018) · Companion Proceedings of the 23rd International Conference on Intelligent User Interfaces · doi:10.1145/3180308.3180362 · Cited by 26 · cited 1×
“Research has examined VAPA technology adoption, including characteristics that change users’ adoption resistance, the preferred user interfaces to interact with different services provided in different contexts, and user perception and experience with technology [6,7,12].”
BackgroundProceedings Fifth International Symposium on Wearable Computers
(2001) · International Symposium on Wearable Computers · doi:10.1109/iswc.2001.962075 · Cited by 23
Assistive Technology for Students with Visual Impairments
Smith, D. W., & Kelly, S. M. (2014) · International review of research in developmental disabilities · doi:10.1016/b978-0-12-420039-5.00003-4 · Cited by 18
MathSpeak: a non-ambiguous language for audio rendering of MathML
Sheikh, W., Schleppenbach, D., & Leas, D. (2018) · International Journal of Learning Technology · doi:10.1504/ijlt.2018.091609 · Cited by 11
Voice Activated Personal Assistants – Consumer Use Contexts and Usage Behavior
Mallat, N., Tuunainen, V. K., & Wittkowski, K. (2017) · Journal of the Association for Information Systems · Cited by 9
Mobile multimodal interaction for older and younger users: exploring differences and similarities
Schiavo, G., Mich, O., Ferron, M., & Mana, N. (2017) · International Conference on Mobile and Ubiquitous Multimedia · doi:10.1145/3152832.3156615 · Cited by 7
Cited by
What Makes a Good Conversation?: Challenges in Designing Truly Conversational Agents
Clark, L., Pantidi, N., Cooney, O., Doyle, P., Garaialde, D., Edwards, J., Spillane, B., Gilmartin, E., Murad, C., Munteanu, C., et al. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300705 · Cited by 461
“discuss conversationally with agents may differ markedly in private and public settings. Current users are unlikely to engage with IPAs in public [20, 35], noting social embarrassment and awkwardness [1, 20]. Users have fewer concerns divulging private information when using VUIs in private compared to social spaces […”
BackgroundPradhan, A., Findlater, L., & Lazar, A. (2019) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3359316 · Cited by 223
“, children [16], multi-user households [54]), user with visual impairments [1]).”
BackgroundKim, S., & Choudhury, A. (2021) · Computers in Human Behavior · doi:10.1016/j.chb.2021.106914 · Cited by 200
“Lastly, research has explored the potential utility of voice assistants as assistive technology for people with disabilities (Abdolrahmani, Kuber, & Branham, 2018), specific health concerns (Maharjan et al., 2019), and the aging population.”
BackgroundVoice Assistants and Smart Speakers in Everyday Life and in Education
TERZOPOULOS, G., & SATRATZEMI, M. (2020) · Informatics in Education · doi:10.15388/infedu.2020.21 · Cited by 161
“Regarding blind people, Abdolrahmani et al. (2018) conclude that voice interaction is convenient for them and can play an important role in evoking feelings of independence and empowerment among them.”
Background"Alexa is a Toy": Exploring Older Adults' Reasons for Using, Limiting, and Abandoning Echo
Trajkova, M., & Martin-Hammond, A. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376760 · Cited by 154
“There has also been growing interest in how people with disabilities [1,39] use smart speakers and emerging interest in smart speaker use among older adults [8,40].”
BackgroundResultInfluential
Metadata
- Authors
- Abdolrahmani, A., Kuber, R., & Branham, S. M.
- Affiliations
- University of Maryland, Baltimore County (US)
- University of California, Irvine (US)
- Venue
- Proceedings of the 20th International ACM SIGACCESS Conference on Computers and Accessibility
- Publisher
- ACM
- Published
- 2018-10-08
- Pages
- 249-258
- OpenAlex
- W2896069216
- Cited by
- 172
- References
- 28
- Citations by year
- 2026: 20 · 2025: 29 · 2024: 24 · 2023: 26 · 2022: 19 · 2021: 24 · 2020: 20 · 2019: 10
- FWCI
- 23.27
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS) (publishedVersion)
- Funders
- Styrelsen för Internationellt Utvecklingssamarbete
- Topics
- Social Sciences › Human Factors and Ergonomics › Digital Accessibility for Disabilities
- Health Sciences › Health Professions › Occupational Therapy › Assistive Technology in Communication and Mobility
- Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
- Keywords
- blind users, legal blindness, assistive technology, non-visual interaction, accessibility, user experience, privacy, trust, inclusive design, Amazon Echo, Siri
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.