Modeling Gliding-based Target Selection for Blind Touchscreen Users
Open accessAbstract
Gliding a finger on touchscreen to reach a target, that is, touch exploration, is a common selection method of blind screen-reader users. This paper investigates their gliding behavior and presents a model for their motor performance. We discovered that the gliding trajectories of blind people are a mixture of two strategies: 1) ballistic movements with iterative corrections relying on non-visual feedback, and 2) multiple sub-movements separated by stops, and concatenated until the target is reached. Based on this finding, we propose the mixture pointing model, a model that relates movement time to distance and width of the target. The model outperforms extant models, improving R2 from 0.65 for Fitts’ law to 0.76, and is superior in cross-validation and information criteria. The model advances understanding of gliding-based target selection and serves as a tool for designing interface layouts for screen-reader based touch exploration.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Assistive technology research for improving computer application usability has largely focused on web and mobile applications.
“However, these works have largely centered on the web [6, 12, 15, 16, 43] and mobile applications [11, 22, 27–29].”
From Enabling Uniform Computer Interaction Experience for Blind Users through Large Language Models (2024) · cites this paper as [22]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Model selection and multimodel inference: a practical information-theoretic approach.
Guthery, F. S., Burnham, K. P., & Anderson, D. R. (2003) · The Journal of Wildlife Management · doi:10.2307/3802723 · Cited by 41,495 · see citing works
Hinton, G., Deng, L., Yu, D., Dahl, G., Mohamed, A.-R., Jaitly, N., Senior, A., Vanhoucke, V., Nguyen, P., Sainath, T., et al. (2012) · IEEE Signal Processing Magazine · doi:10.1109/msp.2012.2205597 · Cited by 10,260 · cited 1× · see citing works
“Voice input is becoming increasingly popular among blind people thanks to the advances in speech recognition technology [23].”
BackgroundThe information capacity of the human motor system in controlling the amplitude of movement.
Fitts, P. M. (1992) · Journal of Experimental Psychology General · doi:10.1037//0096-3445.121.3.262 · Cited by 6,291 · see citing works
WatanabeSumio (2010) · arXiv (Cornell University) · doi:10.48550/arxiv.1004.2316 · Cited by 2,264 · see citing works
Fitts' Law as a Research and Design Tool in Human-Computer Interaction
MacKenzie, I. S. (1992) · Human–Computer Interaction · doi:10.1207/s15327051hci0701_3 · Cited by 1,637 · see citing works
Information capacity of discrete motor responses.
Fitts, P. M., & Peterson, J. R. (1964) · Journal of Experimental Psychology · doi:10.1037/h0045689 · Cited by 1,534 · see citing works
Optimality in human motor performance: Ideal control of rapid aimed movements.
Meyer, D. E., Abrams, R. A., Kornblum, S., Wright, C. E., & Keith Smith, J. E. (1988) · Psychological Review · doi:10.1037/0033-295x.95.3.340 · Cited by 1,406 · see citing works
Movement control in skilled motor performance.
Keele, S. W. (1968) · Psychological Bulletin · doi:10.1037/h0026739 · Cited by 1,232 · see citing works
Vision substitution by tactile image projection
BACH-Y-RITA, P., COLLINS, C. C., SAUNDERS, F. A., WHITE, B., & SCADDEN, L. (1969) · Nature · doi:10.1038/221963a0 · Cited by 956 · see citing works
Adams, J. A., & Welford, A. T. (1970) · The American Journal of Psychology · doi:10.2307/1421343 · Cited by 862 · see citing works
Selected Papers of Hirotugu Akaike
Parzen, E., Tanabe, K., & Kitagawa, G. (1998) · Springer series in statistics · doi:10.1007/978-1-4612-1694-0 · Cited by 797 · see citing works
Feedback Control of Hand-Movement and Fitts' Law
Crossman, E. R. F. W., & Goodeve, P. J. (1983) · The Quarterly Journal of Experimental Psychology Section A · doi:10.1080/14640748308402133 · Cited by 597 · see citing works
Gajos, K. Z., & Weld, D. S. (2004) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/964442.964461 · Cited by 431 · see citing works
THE MEASUREMENT OF SENSORY-MOTOR PERFORMANCE : SURVEY AND REAPPRAISAL OF TWELVE YEARS' PROGRESS
Welford, A. T. (1960) · Ergonomics · doi:10.1080/00140136008930484 · Cited by 387 · see citing works
Kane, S. K., Bigham, J. P., & Wobbrock, J. O. (2008) · Proceedings of the 10th International ACM SIGACCESS Conference on Computers and Accessibility · doi:10.1145/1414471.1414487 · Cited by 374 · cited 2× · see citing works
“Slide rule [27, 28] is a well defined multi-touch action that allows users to access application such as web browsing by using auditory guidance.”
BackgroundMethodA Note on the Information-Theoretic Basis for Fitts’ Law
MacKenzie, I. S. (1989) · Journal of Motor Behavior · doi:10.1080/00222895.1989.10735486 · Cited by 316 · see citing works
Ptito, M. (2005) · Brain · doi:10.1093/brain/awh380 · Cited by 310 · see citing works
Holz, C., & Baudisch, P. (2011) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/1978942.1979308 · Cited by 278 · see citing works
Holz, C., & Baudisch, P. (2010) · ACM SIGCHI Conference on Human Factors in Computing Systems (CHI) · doi:10.1145/1753326.1753413 · Cited by 262 · see citing works
Speed—Accuracy Tradeoffs in Aimed Movements: Toward a Theory of Rapid Voluntary Action
Meyer, D. E., Smith, J. E. K., Kornblum, S., Abrams, R. A., & Wright, C. E. (2018) · Psychology Press eBooks · doi:10.4324/9780203772010-6 · Cited by 261 · see citing works
Bi, X., Li, Y., & Zhai, S. (2013) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/2470654.2466180 · Cited by 236 · see citing works
Self-citationGeometrical conditions for ballistic and visually controlled movements
GAN, K.-C., & Hoffmann, E. R. (1988) · Ergonomics · doi:10.1080/00140138808966724 · Cited by 218 · see citing works
Combinatorial Optimization of Graphical User Interface Designs
Oulasvirta, A., Dayama, N. R., Shiripour, M., John, M., & Karrenbauer, A. (2020) · Proceedings of the IEEE · doi:10.1109/jproc.2020.2969687 · Cited by 182 · see citing works
Self-citationDo We Really Need Vision? How Blind People “See” the Actions of Others
Ricciardi, E., Bonino, D., Sani, L., Vecchi, T., Guazzelli, M., Haxby, J. V., Fadiga, L., & Pietrini, P. (2009) · Journal of Neuroscience · doi:10.1523/jneurosci.0274-09.2009 · Cited by 170 · see citing works
Proceedings of Graphics Interface 2013
Samavati, F. F., & Hawkey, K. (2013) · Graphics Interface · Cited by 165 · see citing works
Access overlays: improving non-visual access to large touch screens for blind users
Kane, S. K., Morris, M. R., Perkins, A. Z., Wigdor, D., Ladner, R. E., & Wobbrock, J. O. (2011) · Proceedings of the 24th annual ACM symposium on User interface software and technology · doi:10.1145/2047196.2047232 · Cited by 127 · see citing works
(2012) · Graphics Interface · Cited by 103 · see citing works
Hong, J., Pradhan, A., Froehlich, J. E., & Findlater, L. (2017) · International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS) · doi:10.1145/3132525.3132538 · Cited by 77 · see citing works
Model of visual search and selection time in linear menus
Bailly, G., Oulasvirta, A., Brumby, D. P., & Howes, A. (2014) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/2556288.2557093 · Cited by 69 · see citing works
Self-citationControl Theoretic Models of Pointing
Müller, J., Oulasvirta, A., & Murray‐Smith, R. (2017) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3121431 · Cited by 68 · see citing works
Self-citationAbility-Based Optimization of Touchscreen Interactions
Sarcar, S., Jokinen, J., Oulasvirta, A., Wang, Z., Silpasuwanchai, C., & Ren, X. (2018) · IEEE Pervasive Computing · doi:10.1109/mprv.2018.011591058 · Cited by 60 · see citing works
Self-citationPredicting Finger-Touch Accuracy Based on the Dual Gaussian Distribution Model
Bi, X., & Zhai, S. (2016) · doi:10.1145/2984511.2984546 · Cited by 46 · see citing works
Self-citationGuerreiro, T., Montague, K., Guerreiro, J., Nunes, R., Nicolau, H., & Gonçalves, D. J. V. (2015) · Proceedings of the 2015 International Conference on Interactive Tabletops & Surfaces - ITS '15 · doi:10.1145/2817721.2817743 · Cited by 43 · see citing works
Benchmarking pointing techniques with distractors
Blanch, R., & Ortega, M. (2011) · ACM SIGCHI Conference on Human Factors in Computing Systems (CHI) · doi:10.1145/1978942.1979180 · Cited by 37 · see citing works
Automatically generating custom user interfaces for users with physical disabilities
Gajos, K. Z., Long, J. J., & Weld, D. S. (2006) · International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS) · doi:10.1145/1168987.1169036 · Cited by 32 · see citing works
Evaluating Fitts’ law on vibrating touch-screen to improve visual data accessibility for blind users
Lahib, M. E., Tekli, J., & Issa, Y. B. (2018) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2018.01.005 · Cited by 30 · see citing works
Modelling blind users' interactions with an auditory computer interface
Edwards, A. D. N. (1989) · International Journal of Man-Machine Studies · doi:10.1016/s0020-7373(89)80035-5 · Cited by 23 · see citing works
Accessible Gesture Typing for Non-Visual Text Entry on Smartphones
Billah, S. M., Ko, Y.-J., Ashok, V., Bi, X., & Ramakrishnan, IV (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300606 · Cited by 21 · cited 1× · see citing works
“In practice, both Android’s TalkBack [42] and Apple’s VoiceOver [2] screen readers support gliding for reaching a target (Figure 1), and many blind users rely on gliding to type on soft keyboards, as described in previous work such as [3, 8].”
Self-citationHe, L., Wang, R., & Xu, X. (2020) · Extended Abstracts of the CHI Conference on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3334480.3383095 · Cited by 18 · see citing works
Flagged first, then by citations
Research works printed but not linked: 2
- [28]Kane SK, Bigham JP, 2008. Slide rule: making mobile touch screens accessible to blind people using multi-touch interaction techniques In Proceedings of the 10th international ACM SIGACCESS conference on Computers and accessibility. ACM, 73– 80.
- [41]Savitzky A and Golay MJ. Smoothing and differentiation of data by simplified least squares procedures. Analytical chemistry 36, 8 (1964), 1627– 1639.
Cited by
Sorted by citations
Enabling Uniform Computer Interaction Experience for Blind Users through Large Language Models
Kodandaram, S. R., Uckun, U., Bi, X., Ramakrishnan, IV, & Ashok, V. (2024) · The 26th International ACM SIGACCESS Conference on Computers and Accessibility · doi:10.1145/3663548.3675605 · Cited by 24 · see citing works
Self-citationModeling Touch-based Menu Selection Performance of Blind Users via Reinforcement Learning
Li, Z., Ko, Y.-J., Putkonen, A., Feiz, S., Ashok, V., Ramakrishnan, IV, Oulasvirta, A., & Bi, X. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3580640 · Cited by 18 · see citing works
Self-citation
- Authors
- Ko, Y.-J., Putkonen, A., Aydin, A. S., Feiz, S., Wang, Y., Ashok, V., Ramakrishnan, IV, Oulasvirta, A., & Bi, X.
- Affiliations
- Stony Brook University (US)
- Aalto University (FI)
- Old Dominion University (US)
- ORCID
- Venue
- Proceedings of the 23rd International Conference on Mobile Human-Computer Interaction
- Publisher
- ACM
- Published
- 2021-09-27
- Volume
- 2021
- Pages
- 1-14
- PMC
- PMC10404023
- OpenAlex
- W3199783247
- Cited by
- 3
- References
- 39
- Citations by year
- 2025: 1 · 2024: 1 · 2023: 1
- FWCI
- 0.80
- Type
- conference paper
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI) (publishedVersion)
- PubMed (publishedVersion)
- PubMed Central (acceptedVersion)
- Aaltodoc (Aalto University) (submittedVersion, other-oa)
- Funders
- NSF (National Science Foundation) (1815514, 1805076, 1936027)
- Finnish Center for Artificial Intelligence FCAI
- NIH (National Institutes of Health) (R01EY030085, R01HD097188)
- The Academy of Finland projects Human Automata (328813)
- The Academy of Finland projects Human BAD (318559)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Tactile and Sensory Interactions
- Physical Sciences › Computer Science › Human-Computer Interaction › Interactive and Immersive Displays
- Life Sciences › Neuroscience › Cognitive Neuroscience › Motor Control and Adaptation
- Keywords
- blind users, gliding, target selection, Fitts' law, ballistic movements, movement time, screen readers, touchscreen interaction
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
