Understanding the touchscreen-based nonvisual target acquisition task performance of screen reader users
The DOI matches its Crossref record; 25 of the 25 references it cites were found in a registry or an index.
Abstract
Understanding the users' performance for finding and selecting a target is important for designing an efficient user interface. However, little has been studied about the performance of screen reader users whose primary sense is audio. To better support touchscreen-based interaction for screen reader users, we conducted a user study on a smartphone with 12 participants with visual impairments where they were asked to perform a series of target acquisition tasks on a smartphone with screen reader on varying the screen size and the screen-target ratio. As a result, we found that the participants were faster at finding targets with shorter traces when the screen size is smaller with larger target size in general. However, we also found that the ratio of the target size concerning the screen size affects task efficiency. In addition, we examined traces of touch events and identified five screen exploration strategies: zigzag, border-first, pigtail, hybrid, and other. Based on the findings, we suggest implications for designing an efficient touchscreen-based user interface for screen reader users.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Fitts' Law as a Research and Design Tool in Human-Computer Interaction
MacKenzie, I. S. (1992) · Human–Computer Interaction · doi:10.1207/s15327051hci0701_3 · Cited by 1,637
International Journal of Human-Computer Studies
Sdol, E. (2009) · Cited by 1,095
Soukoreff, R. W., & MacKenzie, I. S. (2004) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2004.09.001 · Cited by 1,064
CARD, S. K., ENGLISH, W. K., & BURR, B. J. (1978) · Ergonomics · doi:10.1080/00140137808931762 · Cited by 887
Extending Fitts' law to two-dimensional tasks
MacKenzie, I. S., & Buxton, W. (1992) · Proceedings of the SIGCHI conference on Human factors in computing systems - CHI '92 · doi:10.1145/142750.142794 · Cited by 617
Kane, S. K., Bigham, J. P., & Wobbrock, J. O. (2008) · Proceedings of the 10th International ACM SIGACCESS Conference on Computers and Accessibility · doi:10.1145/1414471.1414487 · Cited by 374
Target size study for one-handed thumb use on small touchscreen devices
Parhi, P., Karlson, A. K., & Bederson, B. B. (2006) · Proceedings of the 8th conference on Human-computer interaction with mobile devices and services · doi:10.1145/1152215.1152260 · Cited by 352
FFitts law: modeling finger touch with fitts' law
Bi, X., Li, Y., & Zhai, S. (2013) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/2470654.2466180 · Cited by 235
The performance of touch screen soft buttons
Lee, S., & Zhai, S. (2009) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1518701.1518750 · Cited by 226
Extending Fitts' law to a three-dimensional pointing task
Murata, A., & Iwase, H. (2001) · Human Movement Science · doi:10.1016/s0167-9457(01)00058-6 · Cited by 201
Age-related differences in performance with touchscreens compared to traditional mouse input
Findlater, L., Froehlich, J. E., Fattal, K., Wobbrock, J. O., & Dastyar, T. (2013) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/2470654.2470703 · Cited by 172
Cockburn, A., Ahlström, D., & Gutwin, C. A. (2011) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2011.11.002 · Cited by 167
Rich Representations of Visual Content for Screen Reader Users
Morris, M. R., Johnson, J., Bennett, C. L., & Cutrell, E. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3173633 · Cited by 159 · cited 1×
“Meanwhile, reflecting the growing ratio of screen reader users for touchscreen devices [1], researchers have begun to study touchscreen-based interactions for blind people to explore different regions within an image, while preserving the spatial relationships [2, 17, 18, 20, 23].”
BackgroundInformation capacity of discrete motor responses under different cognitive sets.
Fitts, P. M., & Radford, B. K. (1966) · Journal of Experimental Psychology · doi:10.1037/h0022970 · Cited by 145
Analysis of cursor movements with a mouse
Whisenand, T. G., & Emurian, H. H. (1999) · Computers in Human Behavior · doi:10.1016/s0747-5632(98)00036-3 · Cited by 80
Comparing Aimed Movements in the Real World and in Virtual Reality
Liu, L., van Liere, R., Nieuwenhuizen, C., & Martens, J.-B. (2009) · 2009 IEEE Virtual Reality Conference · doi:10.1109/vr.2009.4811026 · Cited by 62
Guerreiro, T., Montague, K., Guerreiro, J., Nunes, R., Nicolau, H., & Gonçalves, D. J. V. (2015) · Proceedings of the 2015 International Conference on Interactive Tabletops & Surfaces - ITS '15 · doi:10.1145/2817721.2817743 · Cited by 43
(2008) · doi:10.1145/1386352.1386442 · Cited by 33
Touch Screen Exploration of Visual Artwork for Blind People
Ahmetovic, D., Kwon, N., Oh, U., Bernareggi, C., & Mascetti, S. (2021) · Proceedings of the Web Conference 2021 · doi:10.1145/3442381.3449871 · Cited by 30 · cited 2×
“Meanwhile, reflecting the growing ratio of screen reader users for touchscreen devices [1], researchers have begun to study touchscreenbased interactions for blind people to explore different regions within an image, while preserving the spatial relationships [2, 17, 18, 20, 23].”
BackgroundSelf-citationA Performance Comparison of On-Hand versus On-Phone Nonvisual Input by Blind and Sighted Users
Oh, U., & Findlater, L. (2015) · ACM Transactions on Accessible Computing · doi:10.1145/2820616 · Cited by 23
Self-citationRisk Effects of Surrounding Distractors Imposing Time Penalty in Touch-Pointing Tasks
Yamanaka, S. (2018) · ACM International Conference on Interactive Surfaces and Spaces (ISS) · doi:10.1145/3279778.3279781 · Cited by 15
EyeDescribe: Combining Eye Gaze and Speech to Automatically Create Accessible Touch Screen Artwork
Reinholt, K., Guinness, D., & Kane, S. K. (2019) · ACM International Conference on Interactive Surfaces and Spaces (ISS) · doi:10.1145/3343055.3359722 · Cited by 11
Effect of target size on non-visual text-entry
Rodrigues, A., Nicolau, H., Montague, K., Carriço, L. M., & Guerreiro, T. (2016) · International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI) · doi:10.1145/2935334.2935376 · Cited by 9
Effects of Touchscreen Device Size on Non-Visual Icon Search
YAMAZAKI, R., & WATANABE, T. (2017) · IEICE Transactions on Information and Systems · doi:10.1587/transinf.2017edl8062 · Cited by 4 · cited 2×
“Meanwhile, there are studies focused on the performance of target acquisition tasks without visual cues on touchscreen devices ( i.e., smartphones, tablets, tabletops) mostly in terms of screen size [3, 11, 29], target size [21, 24], and target location [3, 21].”
Background
Research works printed but not linked: 4
- 10.5555/3162110.3162125 · doi:10.5555/3162110.3162125
- James Boritz and Williarn B Cowan . 1991. Fitts's law studies of directional mouse movement. human performance 1 ( 1991 ), 6. James Boritz and Williarn B Cowan. 1991. Fitts's law studies of directional mouse movement. human performance 1 (1991), 6.
- Tiago Guerreiro , Joaquim Jorge , and Daniel Gonçalves . 2012 . Exploring the non-visual acquisition of targets on touch phones and tablets . In 2nd Workshop on Mobile Accessibility, MobileHCI. Tiago Guerreiro, Joaquim Jorge, and Daniel Gonçalves. 2012. Exploring the non-visual acquisition of targets on touch phones and tablets. In 2nd Workshop on Mobile Accessibility, MobileHCI.
- Uran Oh Nahyun Kwon Youngji Koh. 2019. Supporting Object-level Exploration of Artworks by Touch for People With Visual Impairments. In ASSETS 19. ACM. Uran Oh Nahyun Kwon Youngji Koh. 2019. Supporting Object-level Exploration of Artworks by Touch for People With Visual Impairments. In ASSETS 19. ACM.
Cited by
Improving the Accessibility of Screen-Shared Presentations by Enabling Concurrent Exploration
Fan, D., Junuzovic, S., Tang, J. C., & Jaeger, T. F. (2023) · International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS) · doi:10.1145/3597638.3608411 · Cited by 9
Metadata
- Authors
- Joh, H., Lee, Y. J., & Oh, U.
- Affiliations
- Ewha Womans University (KR)
- ORCID
- Venue
- Proceedings of the 19th International Web for All Conference
- Publisher
- ACM
- Published
- 2022-04-25
- Pages
- 1-10
- OpenAlex
- W4225005313
- Cited by
- 1
- References
- 22
- Citations by year
- 2023: 1
- FWCI
- 0.46
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- International Web for All Conference (W4A) (publishedVersion)
- Funders
- National Research Foundation of Korea(NRF) grant funded by the Korea government(MSIT) (NRF2021R1F1A105278611)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Tactile and Sensory Interactions
- Social Sciences › Human Factors and Ergonomics › Digital Accessibility for Disabilities
- Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
- Keywords
- screen readers, visual impairment, touchscreen interaction, target acquisition, screen size, target size, smartphone accessibility
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.