Use of voice activated interfaces by people with intellectual disability
The DOI matches its Crossref record; 27 of the 27 references it cites were found in a registry or an index.
Abstract
People with intellectual disability are keen users of information technology, but the need for spelling and typing skills often presents a barrier to information and media search and access. The paper presents a study to understand how people with intellectual disabilities can use Voice Activated Interfaces (VAIs) to access information and assist in daily activities. The study involves observations and video analysis of 18 adults with intellectual disability using VAIs and performing 4 tasks: calibrating the VAIs, using voice assistant (Siri or Google) to search images, using voice to query Youtube, and using the voice assistant to perform a daily task (managing calendar, finding directions, etc.). 72% of participants stated that this was their preferred form of input. 50% could perform all four tasks they attempted with successful outcomes, and 55% three of the tasks. We identify the main barriers and opportunities for existing VAIs and suggest future improvements mainly around audio feedback given to participants. Notably, we found that participants' mental model of the VAIs was that of a person, implications for which include the user having to speak in long polite sentences and expecting voice responses and feedback about the state of the device. We suggest ways that VAIs can be adjusted so that they are more inclusive.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Second, it facilitates input for users with low literacy or with visual [24], intellectual [25], motor, linguistic, and cognitive disabilities [26] and can support more natural health routine tasks when in-person health care is not possible [19,27].”
From Voice-Based Conversational Agents for the Prevention and Management of Chronic and Mental Health Conditions: Systematic Literature Review (2021) · cites this paper as [25]
In the citing paper
“Moreover, users must be able to correctly articulate words, especially multisyllable words (eg, temperature) or specific words that may require more effort to be articulated [24].”
From Investigating the Accessibility of Voice Assistants With Impaired Users: Mixed Methods Study (2020) · cites this paper as [24]
In the citing paper
“Prior work also finds that the timeout period for speech input is often inadequate for people with Alzheimer's [34] and intellectual disabilities [3].”
From Reading Between the Guidelines: How Commercial Voice Assistant Guidelines Hinder Accessibility for Blind Users (2019) · cites this paper as [3]
In the citing paper
“These studies primarily observe product reviews, user testimony, or in situ use of VAPAs.”
From Reading Between the Guidelines: How Commercial Voice Assistant Guidelines Hinder Accessibility for Blind Users (2019) · cites this paper as [3]
In the citing paper
“Yet, studies have shown that VAPA users who are blind or who have intellectual disabilities often run out of time to articulate such complex instructions within the limited session period [1,3].”
From Reading Between the Guidelines: How Commercial Voice Assistant Guidelines Hinder Accessibility for Blind Users (2019) · cites this paper as [3]
1 more claim about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Using thematic analysis in psychology
Braun, V., & Clarke, V. (2006) · Qualitative Research in Psychology · doi:10.1191/1478088706qp063oa · Cited by 194,414
Interaction Analysis: Foundations and Practice
Jordan, B., & Henderson, A. (1995) · Journal of the Learning Sciences · doi:10.1207/s15327809jls0401_2 · Cited by 2,726
Internet Access by People with Intellectual Disabilities: Inequalities and Opportunities
Chadwick, D., Wesson, C., & Fullwood, C. (2013) · Future Internet · doi:10.3390/fi5030376 · Cited by 300
Ayres, K. M., Mechling, L., & Sansosti, F. J. (2013) · Psychology in the Schools · doi:10.1002/pits.21673 · Cited by 212
Working Memory in Writing: Empirical Evidence From the Dual-Task Technique
Olive, T. (2004) · European Psychologist · doi:10.1027/1016-9040.9.1.32 · Cited by 186
Palmer, S. B., Wehmeyer, M. L., Davies, D. K., & Stock, S. E. (2012) · Journal of Intellectual Disability Research · doi:10.1111/j.1365-2788.2011.01489.x · Cited by 117
Keyword spotting for Google assistant using contextual speech recognition
Michaely, A. H., Zhang, X., Simko, G., Parada, C., & Aleksic, P. S. (2017) · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru.2017.8268946 · Cited by 116
Brereton, M., Sitbon, L., Abdullah, M. H. L., Vanderberg, M., & Koplick, S. (2015) · CoDesign · doi:10.1080/15710882.2015.1009471 · Cited by 107
Self-citationThistle, J. J., & Wilkinson, K. M. (2013) · Augmentative and Alternative Communication · doi:10.3109/07434618.2013.815800 · Cited by 98
How people with developmental disabilities navigate the Internet
Harrysson, B., Svensk, A., & Johansson, G. I. (2004) · British Journal of Special Education · doi:10.1111/j.0952-3383.2004.00344.x · Cited by 84
Computer usage by young individuals with down syndrome: an exploratory study
Feng, J. H., Lazar, J. K., Kumin, L., & Ozok, A. A. (2008) · International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS) · doi:10.1145/1414471.1414480 · Cited by 83
Competence of people with intellectual disabilities on using human–computer interface
Wong, A., Chan, C. C. H., Li‐Tsang, C. W. P., & LAM, C. (2008) · Research in Developmental Disabilities · doi:10.1016/j.ridd.2008.01.002 · Cited by 81
Lee, Y., Wehmeyer, M. L., Palmer, S. B., Williams-Diehm, K., Davies, D. K., & Stock, S. E. (2011) · The Journal of Special Education · doi:10.1177/0022466909358916 · Cited by 77
Coppens-Hofman, M. C., Terband, H., Snik, A. F. M., & Maassen, B. A. M. (2016) · Folia Phoniatrica et Logopaedica · doi:10.1159/000450548 · Cited by 48
'Put yourself in the picture': designing for futures with young adults with intellectual disability
Wilson, C., Sitbon, L., Brereton, M. F., Johnson, D. M., & Koplick, S. (2016) · Australian Conference on Computer-Human Interaction (OzCHI) · doi:10.1145/3010915.3010924 · Cited by 47
Self-citationBayor, A., Bircanin, F., Sitbon, L., Ploderer, B., Koplick, S., & Brereton, M. (2018) · Proceedings of the 30th Australian Conference on Computer-Human Interaction · doi:10.1145/3292147.3292167 · Cited by 43
Self-citationCollins, J. C., & Collet-Klingenberg, L. L. (2017) · Journal of Intellectual Disabilities · doi:10.1177/1744629516689336 · Cited by 40
Rocha, T., Bessa, M., Gonçalves, M., Cabral, L., Godinho, F., Peres, E. S., Reis, M. J. C. S., Magalhães, L., & Chalmers, A. G. (2012) · Journal of Applied Research in Intellectual Disabilities · doi:10.1111/j.1468-3148.2012.00700.x · Cited by 38
An Exploration of How People with Intellectual Disability Engage with Online Information Retrieval
Sitbon, L., Bayor, A. A., Birčanin, F., Koplick, S., & Brereton, M. F. (2018) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3170427.3188599 · Cited by 37
Self-citationCihak, D. F., Wright, R., Smith, C. C., Mcmahon, D., & Kraiss, K. (2015) · Education and Training in Autism and Developmental Disabilities · doi:10.1177/215416471505000204 · Cited by 36
Rocha, T., de Carvalho, D. C. M., Bessa, M., Reis, S., & Magalhães, L. (2016) · Universal Access in the Information Society · doi:10.1007/s10209-016-0489-5 · Cited by 31
Preprocessing for elderly speech recognition of smart devices
Kwon, S., Kim, S.-J., & Choeh, J. Y. (2015) · Computer Speech & Language · doi:10.1016/j.csl.2015.09.002 · Cited by 25
Design Artefacts to Support People with a Disability to Build Personal Infrastructures
Rajapakse, R., Brereton, M. F., & Sitbon, L. (2018) · Designing Interactive Systems Conference · doi:10.1145/3196709.3196749 · Cited by 25
Self-citationWeb searching by individuals with cognitive disabilities
Nour, R. (2015) · ACM SIGACCESS Accessibility and Computing · doi:10.1145/2809904.2809909 · Cited by 20
A non-clinical approach to describing participants with intellectual disability
Sitbon, L., Hoogstrate, M., Yule, J., Koplick, S., Birčanin, F., & Brereton, M. F. (2018) · Australian Conference on Computer-Human Interaction (OzCHI) · doi:10.1145/3292147.3292206 · Cited by 19
Self-citationA brain–computer interface for the Dasher alternative text entry system
Welton, T., Brown, D. J., Evett, L. J., & Sherkat, N. (2014) · Universal Access in the Information Society · doi:10.1007/s10209-014-0375-y · Cited by 18
Expanding job options: potential computer-related employment for adults with Down syndrome
Kumin, L., Lazar, J. K., & Feng, J. H. (2012) · ACM SIGACCESS Accessibility and Computing · doi:10.1145/2335867.2335869 · Cited by 8
Research works printed but not linked: 1
- Dixie McCollum , Steven Nation and Sharon Gunn . 2014 . The Effects of a Speech-to-Text Software Application on Written Expression for Students with Various Disabilities . National Forum Of Special Education Journal 25 , 1, 1 -- 13 . Dixie McCollum, Steven Nation and Sharon Gunn. 2014. The Effects of a Speech-to-Text Software Application on Written Expression for Students with Various Disabilities. National Forum Of Special Education Journal 25, 1, 1--13.
Cited by
Bérubé, C., Schachner, T., Keller, R., Fleisch, E., v Wangenheim, F., Barata, F., & Kowatsch, T. (2021) · Journal of Medical Internet Research · doi:10.2196/25933 · Cited by 133
“Second, it facilitates input for users with low literacy or with visual [24], intellectual [25], motor, linguistic, and cognitive disabilities [26] and can support more natural health routine tasks when in-person health care is not possible [19,27].”
Investigating the Accessibility of Voice Assistants With Impaired Users: Mixed Methods Study
Masina, F., Orso, V., Pluchino, P., Dainese, G., Volpato, S., Nelini, C., Mapelli, D., Spagnolli, A., & Gamberini, L. (2020) · Journal of Medical Internet Research · doi:10.2196/18431 · Cited by 105
“Moreover, users must be able to correctly articulate words, especially multisyllable words (eg, temperature) or specific words that may require more effort to be articulated [24].”
BackgroundThe AI Doctor Is In: A Survey of Task-Oriented Dialogue Systems for Healthcare Applications
Valizadeh, M., & Parde, N. (2022) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2022.acl-long.458 · Cited by 101
Cha, I., Kim, S. I., Hong, H., Yoo, H., & Lim, Y.-K. (2021) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445116 · Cited by 86
Conversational Information Seeking
Zamani, H., Trippas, J. R., Dalton, J., & Radlinski, F. (2023) · Foundations and Trends® in Information Retrieval · doi:10.1561/1500000081 · Cited by 79
Metadata
- Authors
- Balasuriya, S. S., Sitbon, L., Bayor, A. A., Hoogstrate, M., & Brereton, M.
- Affiliations
- Queensland University of Technology (AU)
- Venue
- Proceedings of the 30th Australian Conference on Computer-Human Interaction
- Publisher
- ACM
- Published
- 2018-12-04
- Pages
- 102-112
- OpenAlex
- W2910873072
- Cited by
- 63
- References
- 27
- Citations by year
- 2026: 3 · 2025: 6 · 2024: 8 · 2023: 14 · 2022: 12 · 2021: 9 · 2020: 9 · 2019: 2
- FWCI
- 8.62
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- Australian Conference on Computer-Human Interaction (OzCHI) (publishedVersion)
- QUT ePrints (Queensland University of Technology) (submittedVersion)
- Topics
- Social Sciences › Human Factors and Ergonomics › Digital Accessibility for Disabilities
- Health Sciences › Health Professions › Occupational Therapy › Assistive Technology in Communication and Mobility
- Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
- Keywords
- intellectual disability, voice assistants, accessibility, assistive technology, audio feedback, user mental models, inclusive design, access to information
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.