Interacting with mobile devices via VoiceOver: usability and accessibility issues
The DOI matches its Crossref record; 14 of the 14 references it cites were found in a registry or an index.
Abstract
In this paper we analyze the interaction of blind users with Apple touchscreen devices iPad, iPhone and iPod touch, accessible to the visually-impaired thanks to their pre-installed VoiceOver screen reader or magnifier. Specifically, we focus on the gestures offered by VoiceOver to simplify interaction for blind users. A usability inspection of the devices' user interfaces has been performed and integrated with user feedback collected via an online survey taken by 55 totally blind users. Results confirm that VoiceOver makes the Apple devices basically accessible to blind users, but there are still some issues related to usability. Users normally believe that accessibility integrated with VoiceOver is an important innovation, but some operations, such as the writing of long text, take too long or are not comfortable. Results suggest that a multimodal approach on mobile touchscreen devices does not offer a simple and satisfactory interaction paradigm for all and it deserves further investigation. Three possible solutions for improving user interface interaction and offering a simpler and more comfortable experience for blind individuals were proposed to the survey participants, gathering their positive feedback.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Nevertheless, it is time-consuming and is considered to be of low usability [10].”
From Designing a text entry multimodal keypad for blind users of touchscreen mobile phones (2014) · cites this paper as [10]
In the citing paper
“the research on usability, i.e., the ease, efficiency, and satisfaction with which blind users can do their computer tasks, is still in its infancy, with very few efforts investigating the usability of select computer applications [7, 27, 50].”
From Enabling Uniform Computer Interaction Experience for Blind Users through Large Language Models (2024) · cites this paper as [27]
In the citing paper
“However, these works have largely centered on the web [6, 12, 15, 16, 43] and mobile applications [11, 22, 27–29].”
From Enabling Uniform Computer Interaction Experience for Blind Users through Large Language Models (2024) · cites this paper as [27]
In the citing paper
“Still, voice interaction has its complications: it is not always accurate, it is difficult to use in noisy environments [10], and can be undesirable due to privacy or etiquette concerns [7].”
From Designing a text entry multimodal keypad for blind users of touchscreen mobile phones (2014) · cites this paper as [10]
In the citing paper
“The main reason for the preference of iOS, as explained by the participants, is the considerable set of accessible features on the built-in screen reader VoiceOver, although significant issues have been identified regarding its usability [10].”
From Designing a text entry multimodal keypad for blind users of touchscreen mobile phones (2014) · cites this paper as [10]
1 more claim about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Tactons: structured tactile messages for non-visual information display
Brewster, S. A., & Brown, L. M. (2004) · Enlighten: Publications (University of Glasgow) · Cited by 697
Ability-Based Design: Concept, Principles and Examples
Wobbrock, J. O., Kane, S. K., Gajos, K. Z., Harada, S., & Froehlich, J. (2011) · ACM Transactions on Accessible Computing · doi:10.1145/1952383.1952384 · Cited by 567
Kane, S. K., Bigham, J. P., & Wobbrock, J. O. (2008) · Proceedings of the 10th International ACM SIGACCESS Conference on Computers and Accessibility · doi:10.1145/1414471.1414487 · Cited by 374
Usable gestures for blind people: understanding preference and performance
Kane, S. K., Wobbrock, J. O., & Ladner, R. E. (2011) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1978942.1979001 · Cited by 314
SemFeel: a user interface with semantic tactile feedback for mobile touch-screen devices
Yatani, K., & Truong, K. N. (2009) · Proceedings of the 22nd annual ACM symposium on User interface software and technology · doi:10.1145/1622176.1622198 · Cited by 164
No-Look Notes: Accessible Eyes-Free Multi-touch Text Entry
Bonner, M. N., Brudvik, J. T., Abowd, G. D., & Edwards, W. K. (2010) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-12654-3_24 · Cited by 154
Investigating touchscreen accessibility for people with visual impairments
McGookin, D., Brewster, S., & Jiang, W. (2008) · Proceedings of the 5th Nordic conference on Human-computer interaction: building bridges · doi:10.1145/1463160.1463193 · Cited by 151
Feel-good touch: finding the most pleasant tactile feedback for a mobile touch screen button
Koskinen, E., Kaaresoja, T., & Laitinen, P. (2008) · Proceedings of the 10th international conference on Multimodal interfaces · doi:10.1145/1452392.1452453 · Cited by 125
BrailleType: Unleashing Braille over Touch Screen Mobile Phones
Oliveira, J., Guerreiro, T., Nicolau, H., Jorge, J., & Gonçalves, D. (2011) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-23774-4_10 · Cited by 111
The travails of visually impaired web travellers
Goble, C., Harper, S., & Stevens, R. (2000) · Proceedings of the eleventh ACM on Hypertext and hypermedia · doi:10.1145/336296.336304 · Cited by 79
Towards identifying distinguishable tactons for use with mobile devices
Qian, H., Kuber, R., & Sears, A. (2009) · International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS) · doi:10.1145/1639642.1639703 · Cited by 24
Arroba, P., Vallejo, J. C., Araújo, Á., Fraga, D., & Moya, J. M. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-21303-8_29 · Cited by 12
Blind People and Mobile Keypads: Accounting for Individual Differences
Guerreiro, T., Oliveira, J., Benedito, J., Nicolau, H., Jorge, J. A., & Gonçalves, D. J. V. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-23774-4_8 · Cited by 7
The key role of touch in non-visual mobile interaction
Benedito, J., Guerreiro, T., Nicolau, H., & Gonçalves, D. J. V. (2010) · International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI) · doi:10.1145/1851600.1851674 · Cited by 4
Research works printed but not linked: 3
- Apple , iPad 2 User Guide (For iOS 4.3 Software) , March , 2011 . http://manuals.info.apple.com/en_US/ipad_2_user_guide.pdf Apple, iPad 2 User Guide (For iOS 4.3 Software), March, 2011. http://manuals.info.apple.com/en_US/ipad_2_user_guide.pdf
- 10.5555/2042053.2042064 · doi:10.5555/2042053.2042064
- Schulz , T. , Fuglerud , K. Universal Mobile Device (UMD)---Methods, Inventory, and Dissemination , Note DART/2010/01, January 29 ( 2010 ). Schulz, T., Fuglerud, K. Universal Mobile Device (UMD)---Methods, Inventory, and Dissemination, Note DART/2010/01, January 29 (2010).
Cited by
Khan, A., & Khusro, S. (2021) · Universal Access in the Information Society · doi:10.1007/s10209-020-00733-8 · Cited by 177
“The focus should be made in a clear and semantically consistent workflow of UIs and its controls [177].”
BackgroundThe Current Status of Accessibility in Mobile Apps
Yan, S., & Ramachandran, P. G. (2019) · ACM Transactions on Accessible Computing · doi:10.1145/3300176 · Cited by 165
“Previous studies on mobile accessibility have mostly focused either on mobile accessibility guidelines [4, 7, 14, 17, 21, 28], mobile web accessibility [33, 36], accessibility features integrated into a mobile operating system [15, 18, 19], or on apps that are specifically designed for disabled people [23].”
BackgroundAccessibility Evaluation of E-Government Mobile Applications in Brazil
Serra, L. C., Carvalho, L. P., Ferreira, L. P., Vaz, J. B. S., & Freire, A. P. (2015) · Procedia Computer Science · doi:10.1016/j.procs.2015.09.279 · Cited by 108
Accessible Touchscreen Technology for People with Visual Impairments: A Survey
Grussenmeyer, W., & Folmer, E. (2017) · ACM Transactions on Accessible Computing · doi:10.1145/3022701 · Cited by 86
Mobile device accessibility for the visually impaired: problems mapping and recommendations
Damaceno, R. J. P., Braga, J. C., & Mena-Chalco, J. P. (2018) · Universal Access in the Information Society · doi:10.1007/s10209-017-0540-1 · Cited by 73
“Problems such as the high cost of purchasing these devices [11], the lack of physical buttons on devices with touch screens [12], and the limitations of accessibility tools [10, 13] are some examples that illustrate the difficulty that visually impaired users experience when they utilize these devices.”
Background
Metadata
- Authors
- Leporini, B., Buzzi, M. C., & Buzzi, M.
- Affiliations
- Istituto di Scienza e Tecnologie dell'Informazione "Alessandro Faedo" (IT)
- Institute of Informatics and Telematics (IT)
- Venue
- Proceedings of the 24th Australian Computer-Human Interaction Conference
- Publisher
- ACM
- Published
- 2012-11-26
- Pages
- 339-348
- OpenAlex
- W1965463267
- Cited by
- 116
- References
- 14
- Citations by year
- 2026: 5 · 2025: 8 · 2024: 12 · 2023: 10 · 2022: 8 · 2021: 12 · 2020: 11 · 2019: 7 · 2018: 4 · 2017: 9 · 2016: 10 · 2015: 9 · 2014: 4 · 2013: 6 · 2012: 1
- FWCI
- 10.91
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- Australian Conference on Computer-Human Interaction (OzCHI) (publishedVersion)
- CINECA IRIS Institutial research information system (University of Pisa) (submittedVersion)
- ISTI Open Portal (submittedVersion)
- Topics
- Social Sciences › Human Factors and Ergonomics › Digital Accessibility for Disabilities
- Life Sciences › Neuroscience › Cognitive Neuroscience › Tactile and Sensory Interactions
- Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
- Keywords
- voice-over, screen readers, blind users, visual impairment, mobile accessibility, touchscreen devices, iPad, iPhone, iPod Touch, gesture, usability, multimodal interaction, text entry, user interface design
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.