Cited by 26Digital Accessibility for DisabilitiesUsability and User Interface DesignSpeech and dialogue systems

Creating ‘a Simple Conversation’: Designing a Conversational User Interface to Improve the Experience of Accessing Support for Study

Open access
Iniesto, Francisco, Coughlan, Tim, Lister, Kate, Devine, Peter, Freear, Nick, Greenwood, Richard, Holmes, Wayne, Kenny, Ian +2 more·2023·ACM Transactions on Accessible Computing

Abstract

Administrative processes are ubiquitous in modern life and have been identified as a particular burden to those with accessibility needs. Students who have accessibility needs often have to understand guidance, fill in complex forms, and communicate with multiple parties to disclose disabilities and access appropriate support. Conversational user interfaces (CUIs) could allow us to reimagine such processes, yet there is currently limited understanding of how to design these to be accessible, or whether such an approach would be preferred. In the ADMINS (Assistants for the Disclosure and Management of Information about Needs and Support) project, we implemented a virtual assistant (VA) which is designed to enable students to disclose disabilities and to provide guidance and suggestions about appropriate support. ADMINS explores the potential of CUIs to reduce administrative burden and improve the experience of arranging support by replacing a static form with written or spoken dialogue. This article reports the results of two trials conducted during the project. A beta trial using an early version of the VA provided understanding of accessibility challenges and issues in user experience. The beta trial sample included 22 students who had already disclosed disabilities and 3 disability support advisors. After improvements to the design, a larger main trial was conducted with 134 students who disclosed their disabilities to the university using both the VA and the existing form-based process. The results show that the VA was preferred by most participants to completing the form (64.9% vs 23.9%). Qualitative and quantitative feedback from the trials also identified accessibility and user experience barriers for improving CUI design, and an understanding of benefits and preferences that can inform further development of accessible CUIs for this design space.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1145/3568166

Cites

36 of 36 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 9

  1. Carla Jessica Tin Gordon, Jeremy Brown, Elisabeth Fritzsch, and Shirley Gabber. 2016. Wochat chatbot user experi- ence summary. In Proc. WOCHAT.
  2. Jingya Guo, Da Tao, and Chen Yang. 2019. The effects of continuous conversation and task complexity on usability of an ai-based conversational agent in smart home environments. In Proceedings of the International Conference on Man-Machine-Environment System Engineering. Springer, Singapore, 695-703.
  3. James R. Lewis. 2016. Standardized questionnaires for voice interaction design. Voice Interaction Design 1 (2016), 1.
  4. Anton Lilleby, Steffen Marstein, and Guri Verne. 2021. They often avoid text. Chatbot for Young Adults with Dyslexia. Scandinavian Workshop on E-Government. ITU Copenhagen.
  5. Susan Moore. 2018. Gartner says 25 percent of customer service operations will use virtual customer assistants by 2020. Article on Gartner.Com. Available online at https://www.gartner.com/en/newsroom/press-releases/2018-02-19- gartner-says-25-percent-of-customer-service-operations-will-use-virtual-customer-assistants-by-2020.
  6. Ranci Ren. 2019. Experimental study of socio chatbot usability (Master's thesis).
  7. Julia Saenz, Walker Burgess, Elizabeth Gustitis, Andres Mena, and Farzan Sasan-Gohar. 2017. The usability analysis of chatbot technologies for internal personnel communications. In Proceedings of the IIE Annual Conference. Institute of Industrial and Systems Engineers (IISE), 1357-1362.
  8. Tuva Lunde Smestad. 2018. Personality matters! improving the user experience of chatbot interfaces-personality provides a stable pattern to guide the design and behaviour of conversational agents (master's thesis, NTNU).
  9. Jeff Stanley, Ronna ten Brink, Alexandra Valiton, Trevor Bostic, and Becca Scollan. 2022. Chatbot accessibility guid- ance: A review and way forward. In Proceedings of 6th International Congress on Information and Communication Technology. Springer, Singapore, 919-942.

Cited by

Sorted by citations

Authors
Iniesto, F., Coughlan, T., Lister, K., Devine, P., Freear, N., Greenwood, R., Holmes, W., Kenny, I., McLeod, K., & Tudor, R.
Affiliations
  • The Open University (GB)
  • Arden University (GB)
  • AbilityNet (United Kingdom) (GB)
  • University College London (GB)
Venue
ACM Transactions on Accessible Computing
Published
2023-03-28
Volume
16
Issue
1
Pages
1-29
ISSN
  • 1936-7228 (ISSN-L)
  • 1936-7236
OpenAlex
W4306174599
Cited by
25
References
36
Citations by year
2026: 2 · 2025: 6 · 2024: 16 · 2023: 1
FWCI
14.64
Type
journal article
Language
en
Open access
Locations
  • ACM Transactions on Accessible Computing (publishedVersion)
  • UCL Discovery (University College London) (submittedVersion)
  • Open Research Online (The Open University) (submittedVersion)
  • UNED repository (submittedVersion, other-oa)
Topics
  • Social Sciences › Human Factors and Ergonomics › Digital Accessibility for Disabilities
  • Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
  • Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
Keywords
conversational interfaces, virtual assistants, accessibility, disability disclosure, disability services, university students, administrative burden, accessibility needs, user experience, spoken dialogue

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review