Access overlays: improving non-visual access to large touch screens for blind users
The DOI matches its Crossref record; 32 of the 32 references it cites were found in a registry or an index.
Abstract
Many touch screens remain inaccessible to blind users, and those approaches to providing access that do exist offer minimal support for interacting with large touch screens or spatial data. In this paper, we introduce a set of three software-based access overlays intended to improve the accessibility of large touch screen interfaces, specifically interactive tabletops. Our access overlays are called edge projection, neighborhood browsing, and touch-and-speak. In a user study, 14 blind users compared access overlays to an implementation of Apple's VoiceOver screen reader. Our results show that two of our techniques were faster than VoiceOver, that participants correctly answered more questions about the screen's layout using our techniques, and that participants overwhelmingly preferred our techniques. We developed several applications demonstrating the use of access overlays, including an accessible map kiosk and an accessible board game.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The design choices were based on the widespread adoption of sonification and speech-based UIs in assistive technology, facilitating enhanced access to tactile graphics as supported by relevant studies (9, 22, 34, 50, 61, 62).”
From SONOICE! a Sonar–Voice dynamic user interface for assisting individuals with blindness and visual impairment in pinpointing elements in 2D tactile readers (2024) · cites this paper as [34]
In the citing paper
“Another factor that could have contributed to this may stem from the fact that assistive technology typically relies on either voice or sonification approaches (9, 34, 50, 61, 84), making a combination of these two methods less common and potentially leading to unfamiliarity or hesitation among users.”
From SONOICE! a Sonar–Voice dynamic user interface for assisting individuals with blindness and visual impairment in pinpointing elements in 2D tactile readers (2024) · cites this paper as [34]
In the citing paper
“Prior investigation of tactile solutions for large touchscreens also may not address the challenges on mobile devices.”
From Interactiles: 3D Printed Tactile Interfaces to Enhance Mobile Touchscreen Accessibility (2018) · cites this paper as [19]
In the citing paper
“For example, Access Overlays [19] improves task completion times and spatial understanding through software overlays designed to help with target acquisition.”
From Interactiles: 3D Printed Tactile Interfaces to Enhance Mobile Touchscreen Accessibility (2018) · cites this paper as [19]
In the citing paper
“However, although Access Overlays showed accessibility improvements on large touchscreens, such an approach may not work on mobile devices due to the significantly smaller screen size.”
From Interactiles: 3D Printed Tactile Interfaces to Enhance Mobile Touchscreen Accessibility (2018) · cites this paper as [19]
Citations
Cites
A Simple Sequentially Rejective Multiple Test Procedure
(1979) · Scandinavian Journal of Statistics · doi:10.2307/4615733 · Cited by 21,526
A Formal Basis for the Heuristic Determination of Minimum Cost Paths
Hart, P., Nilsson, N., & Raphael, B. (1968) · IEEE Transactions on Systems Science and Cybernetics · doi:10.1109/tssc.1968.300136 · Cited by 12,738 · cited 1×
“If a physical object is present along the path, the system identifies its bounding box and uses A* [12] to route around the object.”
The aligned rank transform for nonparametric factorial analyses using only anova procedures
Wobbrock, J. O., Findlater, L., Gergle, D., & Higgins, J. J. (2011) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1978942.1978963 · Cited by 2,854
Self-citationUser-defined gestures for surface computing
Wobbrock, J. O., Morris, M. R., & Wilson, A. D. (2009) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1518701.1518866 · Cited by 1,317
Self-citationA sweepline algorithm for Voronoi diagrams
Fortune, S. (1987) · Algorithmica · doi:10.1007/bf01840357 · Cited by 1,134
TeslaTouch: electrovibration for touch surfaces
Bau, O., Poupyrev, I., Israr, A., & Harrison, C. (2010) · Proceedings of the 23nd annual ACM symposium on User interface software and technology · doi:10.1145/1866029.1866074 · Cited by 664
The bubble cursor: enhancing target acquisition by dynamic resizing of the cursor's activation area
Grossman, T., & Balakrishnan, R. (2005) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1054972.1055012 · Cited by 604
Kane, S. K., Jayant, C., Wobbrock, J. O., & Ladner, R. E. (2009) · Proceedings of the 11th international ACM SIGACCESS conference on Computers and accessibility · doi:10.1145/1639642.1639663 · Cited by 383 · cited 1×
“The inaccessibility of touch screens can have profound effects, preventing otherwise independent blind people from performing routine tasks without help, which can lead to feelings of embarrassment [17].”
BackgroundSelf-citationMaking computers easier for older adults to use: area cursors and sticky icons
Worden, A., Walker, N., Bharat, K., & Hudson, S. (1997) · Proceedings of the ACM SIGCHI Conference on Human factors in computing systems · doi:10.1145/258549.258724 · Cited by 376
Kane, S. K., Bigham, J. P., & Wobbrock, J. O. (2008) · Proceedings of the 10th International ACM SIGACCESS Conference on Computers and Accessibility · doi:10.1145/1414471.1414487 · Cited by 374 · cited 5×
“Prior approaches have often considered performance metrics such as speed and error rate ( e.g., [3,16]).”
BackgroundMethodInfluentialSelf-citation
Research works printed but not linked: 4
- Carew , S. Touch-screen gadgets alienate blind . Reuters ( 2009 ). http://reut.rs/gHji5. Carew, S. Touch-screen gadgets alienate blind. Reuters (2009). http://reut.rs/gHji5.
- Higgins , J.J. and Tashtoush , S . An aligned rank transform test for interaction . Nonlinear World 1 , 2 ( 1994 ), 201--211. Higgins, J.J. and Tashtoush, S. An aligned rank transform test for interaction. Nonlinear World 1, 2 (1994), 201--211.
- Landau , S. and Wells , L . Merging tactile sensory input and audio data by means of the Talking Tactile Tablet . Eurohaptics '03 , 414--418. Landau, S. and Wells, L. Merging tactile sensory input and audio data by means of the Talking Tactile Tablet. Eurohaptics '03, 414--418.
- Reisinger , D. Universities reject Kindle over inaccessibility for the blind. CNET ( 2009 ). http://cnet.co/gSjyv. Reisinger, D. Universities reject Kindle over inaccessibility for the blind. CNET (2009). http://cnet.co/gSjyv.
Cited by
Items 101–128 of 128
Ramôa, G., & Müller, K. (2025) · International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS) · doi:10.1145/3663547.3746398 · Cited by 4
“This approach aims to leverage the widespread adoption of combining audio-based interfaces with tactile feedback to improve graphic accessibility in assistive technologies [19, 27, 31, 42, 52, 74, 75].”
Designing Interfaces to Make Information More Tangible for Visually Impaired People
Yairi, I. E. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-58703-5_27 · Cited by 3
Nicht-visuelle Interaktion auf berührempfindlichen Displays
Bornschein, J., Prescher, D., Schmidt, M., & Weber, G. (2013) · Xpert.press · doi:10.1007/978-3-642-36113-5_15 · Cited by 2
Speech-based Mark for Data Sonification
Zhao, Y., Lu, J., & Nacenta, M. A. (2024) · International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS) · doi:10.1145/3663548.3688514 · Cited by 2
Touch Table Interfaces in Therapeutic Rehabilitation: A Systematic Review
Macé, M., Amghar, T., Richard, P., & Ménétrier, E. (2025) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2024.2422677 · Cited by 1
“Furthermore, accessibility on the interface can also involve studying the user experience by limiting the interaction spaces, especially for users with a limited field of vision (Kane et al., 2011).”
Exploring Auditory Hand Guidance for Eyes-free 3D Path Tracing
Abe, Y., Hara, K., Sakamoto, D., & Ono, T. (2025) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3706599.3719761 · Cited by 2
Understanding the Feasibility of Auditory Hand-Steering Guidance for Blind and Low-Vision People
Abe, Y., Lin, R. X., Hara, K., & Sakamoto, D. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3790782 · Cited by 2
“– Touchscreen selection [35, 37] – Map/graph pointing [36, 65] – Touchscreen gesture [35, 57] – Text line and graph line tracing [17, 32, 64, 78] – Handwriting [18, 20, 75] 3D – Kiosk touchscreen interaction [12, 49] – Camera aiming [5, 29, 52, 70] – AR/VR item selection [16, 46, 54] – Shelf/desk…”
SceneScout: Towards AI-Driven Access to Street Level Imagery for Blind Users
Jain, G., Findlater, L., & Gleason, C. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3790449 · Cited by 14
Many Fingers Make Light Work: Non-Visual Capacitive Surface Exploration
Halvey, M. J., & Crossan, A. (2014) · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION · doi:10.1145/2663204.2663253 · Cited by 1
Bringing haptic general-purpose controls to interactive tabletops
Weiss, M., & Borchers, J. (2012) · RWTH Publications (RWTH Aachen) · Cited by 2
SIG: NVI (non-visual interaction)
Brock, A. M., Kammoun, S., Nicolau, H., Guerreiro, T., Kane, S. K., & Jouffrais, C. (2013) · CHI Extended Abstracts · doi:10.1145/2468356.2468818 · Cited by 3
“Other challenges may arise when using specific modalities such as eyes-free gestural interaction on touch screens [11,12], which can be improved by haptic feedback [3].”
Self-citationImage hiding selection for large touch screen system
Jiang, Q., Cheng, L., Xu, R., Wu, J., & Xie, Y. (2016) · IEEE International Conference on Information and Automation (ICIA) · doi:10.1109/icinfa.2016.7831968
“There many existing researches [3-6] focus on using LTSS in various kinds of areas.”
BackgroundPrototype of Mobile Device to Contribute to Urban Mobility of Visually Impaired People
Amorim, F. R., & Santil, F. L. D. P. (2018) · Big Data and Cognitive Computing · doi:10.3390/bdcc2040038
Runtime Repair and Enhancement of Mobile App Accessibility
Zhang, X. (2019) · ResearchWorks at the University of Washington (University of Washington)
Using Games to Practice Screen Reader Gestures
Lobo, G., Gonçalves, D., Pais, P., Guerreiro, T., & Rodrigues, A. (2021) · International ACM SIGACCESS Conference on Computers and Accessibility · doi:10.1145/3441852.3476556 · Cited by 1
“However, for novice users, navigation and text-entry can be confusing and challenging to master [8–11, 15, 20], as it requires understanding the different gestures employed, often only overcome with the assistance of others [16].”
BackgroundCelik, S. (2013) · ScholarWorks@UMassAmherst (University of Massachusetts Amherst) · doi:10.7275/3540607
Sato, D., Takagi, H., & Asakawa, C. (2019) · Human-computer interaction series · doi:10.1007/978-1-4471-7440-0_34 · Cited by 1
Intelligent Interaction in Accessible Applications
Bahram, S., Chakraborty, A., Ravindran, S., & Amant, R. S. (2015) · Human-computer interaction series · doi:10.1007/978-1-4471-6708-2_6
Haptic Auditory Feedback for Enhanced Image Description: A Study of User Preferences and Performance
Alkhathlan, M., Tlachac, M., & Rundensteiner, E. A. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-42280-5_14 · Cited by 2
Putra, Z. P., & Setiawan, D. (2024) · PeerJ Computer Science · doi:10.7717/peerj-cs.2275
“Further, Kane et al. (2011) have proposed a new framework to facilitate access to mobile devices using gestures on mobile touch screen devices.”
BackgroundAugmenting the Spatial Perception Capabilities of Users Who Are Blind
Fiannaca, A. J. (2014)
Tabletop tangible maps and diagrams for visually impaired users
Ducasse, J. (2017) · theses.fr (ABES) · doi:10.70675/3c9498ddzfbdbz4ab7z8bafz7dda0a7a88a5 · Cited by 2
Towards Spatiability: Evaluating Spatial Thinking in Interactive Map ApplicationsPreprint
Neto, A. A. D. S., Melo, M. V. S., & Mota, M. P. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.6910507
Future Imperfect? Evaluating Whether AI-Powered Web Accessibility Overlays are Worth the Hype
Hartman, P., & Gorichanaz, T. (2026) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3805689.3812259
“Earlier versions of accessibility overlays were add-ons for public-use touchscreens, such as maps and kiosks, that otherwise presented barriers for blind people [29].”
A Semantic Multimodal Architecture for Accessible Navigation in Immersive Virtual Environments
Cintra, L. M. D. F., de Oliveira, E. A. M., Webster, G., Bastos, A. A., Neto, V. V. G., Paiva, S. L. C., Sousa, R. T., & Filho, A. R. G. (2026) · Journal on Interactive Systems · doi:10.5753/jis.2026.7402
Metadata
- Authors
- Kane, S. K., Morris, M. R., Perkins, A. Z., Wigdor, D., Ladner, R. E., & Wobbrock, J. O.
- Affiliations
- University of Maryland, Baltimore County (US)
- Microsoft (United States) (US)
- Microsoft, Redmond, WA, USA
- University of Toronto (CA)
- University of Washington (US)
- Venue
- Proceedings of the 24th annual ACM symposium on User interface software and technology
- Publisher
- ACM
- Published
- 2011-10-16
- Pages
- 273-282
- OpenAlex
- W2104779182
- Semantic Scholar
- f104d189417a0ff54e603e97e31422c757f24679
- Cited by
- 127
- References
- 32
- Citations by year
- 2026: 5 · 2025: 5 · 2024: 6 · 2023: 10 · 2022: 6 · 2021: 16 · 2020: 2 · 2019: 8 · 2018: 7 · 2017: 11 · 2016: 10 · 2015: 11 · 2014: 14 · 2013: 12 · 2012: 4
- FWCI
- 19.19
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- ACM Symposium on User Interface Software and Technology (UIST) (publishedVersion)
- Topics
- Social Sciences › Human Factors and Ergonomics › Digital Accessibility for Disabilities
- Life Sciences › Neuroscience › Cognitive Neuroscience › Tactile and Sensory Interactions
- Health Sciences › Health Professions › Occupational Therapy › Assistive Technology in Communication and Mobility
- Keywords
- accessibility, blind users, touch screen, interactive tabletops, screen readers, voice-over, geospatial data, accessible maps, assistive technology
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.