Access overlays: improving non-visual access to large touch screens for blind users
The DOI matches its Crossref record; 32 of the 32 references it cites were found in a registry or an index.
Abstract
Many touch screens remain inaccessible to blind users, and those approaches to providing access that do exist offer minimal support for interacting with large touch screens or spatial data. In this paper, we introduce a set of three software-based access overlays intended to improve the accessibility of large touch screen interfaces, specifically interactive tabletops. Our access overlays are called edge projection, neighborhood browsing, and touch-and-speak. In a user study, 14 blind users compared access overlays to an implementation of Apple's VoiceOver screen reader. Our results show that two of our techniques were faster than VoiceOver, that participants correctly answered more questions about the screen's layout using our techniques, and that participants overwhelmingly preferred our techniques. We developed several applications demonstrating the use of access overlays, including an accessible map kiosk and an accessible board game.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The design choices were based on the widespread adoption of sonification and speech-based UIs in assistive technology, facilitating enhanced access to tactile graphics as supported by relevant studies (9, 22, 34, 50, 61, 62).”
From SONOICE! a Sonar–Voice dynamic user interface for assisting individuals with blindness and visual impairment in pinpointing elements in 2D tactile readers (2024) · cites this paper as [34]
In the citing paper
“Another factor that could have contributed to this may stem from the fact that assistive technology typically relies on either voice or sonification approaches (9, 34, 50, 61, 84), making a combination of these two methods less common and potentially leading to unfamiliarity or hesitation among users.”
From SONOICE! a Sonar–Voice dynamic user interface for assisting individuals with blindness and visual impairment in pinpointing elements in 2D tactile readers (2024) · cites this paper as [34]
In the citing paper
“Prior investigation of tactile solutions for large touchscreens also may not address the challenges on mobile devices.”
From Interactiles: 3D Printed Tactile Interfaces to Enhance Mobile Touchscreen Accessibility (2018) · cites this paper as [19]
In the citing paper
“For example, Access Overlays [19] improves task completion times and spatial understanding through software overlays designed to help with target acquisition.”
From Interactiles: 3D Printed Tactile Interfaces to Enhance Mobile Touchscreen Accessibility (2018) · cites this paper as [19]
In the citing paper
“However, although Access Overlays showed accessibility improvements on large touchscreens, such an approach may not work on mobile devices due to the significantly smaller screen size.”
From Interactiles: 3D Printed Tactile Interfaces to Enhance Mobile Touchscreen Accessibility (2018) · cites this paper as [19]
Citations
Cites
A Simple Sequentially Rejective Multiple Test Procedure
(1979) · Scandinavian Journal of Statistics · doi:10.2307/4615733 · Cited by 21,526
A Formal Basis for the Heuristic Determination of Minimum Cost Paths
Hart, P., Nilsson, N., & Raphael, B. (1968) · IEEE Transactions on Systems Science and Cybernetics · doi:10.1109/tssc.1968.300136 · Cited by 12,738
The aligned rank transform for nonparametric factorial analyses using only anova procedures
Wobbrock, J. O., Findlater, L., Gergle, D., & Higgins, J. J. (2011) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1978942.1978963 · Cited by 2,854
Self-citationUser-defined gestures for surface computing
Wobbrock, J. O., Morris, M. R., & Wilson, A. D. (2009) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1518701.1518866 · Cited by 1,317
Self-citationA sweepline algorithm for Voronoi diagrams
Fortune, S. (1987) · Algorithmica · doi:10.1007/bf01840357 · Cited by 1,134
TeslaTouch: electrovibration for touch surfaces
Bau, O., Poupyrev, I., Israr, A., & Harrison, C. (2010) · Proceedings of the 23nd annual ACM symposium on User interface software and technology · doi:10.1145/1866029.1866074 · Cited by 664
The bubble cursor: enhancing target acquisition by dynamic resizing of the cursor's activation area
Grossman, T., & Balakrishnan, R. (2005) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1054972.1055012 · Cited by 604
Kane, S. K., Jayant, C., Wobbrock, J. O., & Ladner, R. E. (2009) · Proceedings of the 11th international ACM SIGACCESS conference on Computers and accessibility · doi:10.1145/1639642.1639663 · Cited by 383 · cited 1×
“The inaccessibility of touch screens can have profound effects, preventing otherwise independent blind people from performing routine tasks without help, which can lead to feelings of embarrassment [17].”
BackgroundSelf-citationMaking computers easier for older adults to use: area cursors and sticky icons
Worden, A., Walker, N., Bharat, K., & Hudson, S. (1997) · Proceedings of the ACM SIGCHI Conference on Human factors in computing systems · doi:10.1145/258549.258724 · Cited by 376
Kane, S. K., Bigham, J. P., & Wobbrock, J. O. (2008) · Proceedings of the 10th International ACM SIGACCESS Conference on Computers and Accessibility · doi:10.1145/1414471.1414487 · Cited by 374 · cited 5×
“Prior approaches have often considered performance metrics such as speed and error rate ( e.g., [3,16]).”
BackgroundMethodInfluentialSelf-citation
Research works printed but not linked: 4
- Carew , S. Touch-screen gadgets alienate blind . Reuters ( 2009 ). http://reut.rs/gHji5. Carew, S. Touch-screen gadgets alienate blind. Reuters (2009). http://reut.rs/gHji5.
- Higgins , J.J. and Tashtoush , S . An aligned rank transform test for interaction . Nonlinear World 1 , 2 ( 1994 ), 201--211. Higgins, J.J. and Tashtoush, S. An aligned rank transform test for interaction. Nonlinear World 1, 2 (1994), 201--211.
- Landau , S. and Wells , L . Merging tactile sensory input and audio data by means of the Talking Tactile Tablet . Eurohaptics '03 , 414--418. Landau, S. and Wells, L. Merging tactile sensory input and audio data by means of the Talking Tactile Tablet. Eurohaptics '03, 414--418.
- Reisinger , D. Universities reject Kindle over inaccessibility for the blind. CNET ( 2009 ). http://cnet.co/gSjyv. Reisinger, D. Universities reject Kindle over inaccessibility for the blind. CNET (2009). http://cnet.co/gSjyv.
Cited by
An Aligned Rank Transform Procedure for Multifactor Contrast Tests
Elkin, L. A., Kay, M., Higgins, J. J., & Wobbrock, J. O. (2021) · The 34th Annual ACM Symposium on User Interface Software and Technology · doi:10.1145/3472749.3474784 · Cited by 664
“, CHI [2, 14, 15], ASSETS [3], UIST [22, 39]).”
Self-citationInteractivity improves usability of geographic maps for visually impaired people
Brock, A. M., Truillet, P., Oriola, B., Picard, D., & Jouffrais, C. (2015) · Human–Computer Interaction · doi:10.1080/07370024.2014.924412 · Cited by 195
“…all systems relied on some form of audio, either verbal through a TTS (text-to-speech synthesis) or through recorded speech (see for instance Kane, Morris, et al., 2011; Miele et al., 2006), or non-verbal through ambient sound, earcons or music (see for instance Jacobson, 1998; Zhao,…”
BackgroundInfluentialMonnai, Y., Hasegawa, K., Fujiwara, M., Yoshino, K., Inoue, S., & Shinoda, H. (2014) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/2642918.2647407 · Cited by 152
“Although other modalities such as audio-visual effects can be employed to indicate touch events [6,1,12], they do not work directly on a fingertip.”
BackgroundInteraction with Large Displays: A Survey
Ardito, C. A., Buono, P., Costabile, M. F., & Desolda, G. (2015) · ACM Computing Surveys · doi:10.1145/2682623 · Cited by 159
“The model of the physical space around the display described in Ott and Koch [2012] addresses users’ behavior in four zones: (1) the Active Zone, immediately in front of the display, where people interact with the system; (2) the Communication Zone, in which users actively monitor other people and…”
BackgroundYatani (2012) · doi:10.1145/2207676.2207734 · Cited by 123
“Kane et al. [13] developed three techniques which allow visually impaired users to identify the target locations displayed on a touch-sensitive tabletop.”
BackgroundAccessible Interactive Maps for Visually Impaired Users
Ducasse, J., Brock, A. M., & Jouffrais, C. (2018) · Mobility of Visually Impaired People · doi:10.1007/978-3-319-54446-5_17 · Cited by 111
“Kane, Morris, et al. (2011) designed three interaction techniques for maps displayed on large touch-screens.”
BackgroundTouchplates: low-cost tactile overlays for visually impaired touch screen users
Kane, S. K., Morris, M. R., & Wobbrock, J. O. (2013) · Proceedings of the 15th International ACM SIGACCESS Conference on Computers and Accessibility · doi:10.1145/2513383.2513442 · Cited by 107
“Larger touch screens, such as those found on interactive tabletops or touch screen kiosks, may present additional interaction challenges [15].”
BackgroundMethodInfluentialSelf-citationAlbouys-Perrois, J., Laviole, J., Briant, C., & Brock, A. M. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3174203 · Cited by 107
“If the element is not in the right place according to the scenario, then the system provides corrective directions (left/right/top/down, similar as in [25]).”
BackgroundVirtual Navigation for Blind People: Building Sequential Representations of the Real-World
Guerreiro, J., Ahmetovic, D., Kitani, K. M., & Asakawa, C. (2017) · Proceedings of the 19th International ACM SIGACCESS Conference on Computers and Accessibility · doi:10.1145/3132525.3132545 · Cited by 96
“…solutions include the use of sonification to convey geometric information [31]; two-handed map exploration on tabletops with simultaneous audio feedback [10]; touchscreens with raised-line overlays [5]; and software overlays that ease the access to spatially structured elements in the map [12].”
BackgroundMilne, L. R., & Ladner, R. E. (2018) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3173643 · Cited by 117
“Blocks in the workspace are placed along the bottom of the screen to help with orientation, as it is easy for blind users to “drift off course” when tracing elements on a touchscreen [9,21].”
BackgroundInfluentialSelf-citationAccessible Touchscreen Technology for People with Visual Impairments: A Survey
Grussenmeyer, W., & Folmer, E. (2017) · ACM Transactions on Accessible Computing · doi:10.1145/3022701 · Cited by 86
“Access overlays are guidance techniques that help the user navigate the screen and understand spatial relationships in a faster way [Kane et al. 2011b].”
BackgroundXia, H., Glueck, M., Annett, M., Wang, M. S.-Y., & Wigdor, D. (2022) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3503537 · Cited by 90
Self-citationTangible Reels: Construction and Exploration of Tangible Maps by Visually Impaired Users
Ducasse, J., Macé, M. J. ‐., Serrano, M., & Jouffrais, C. (2016) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858058 · Cited by 82
Virtual navigation for blind people: Transferring route knowledge to the real-World
Guerreiro, J., Sato, D., Ahmetovic, D., Ohn-Bar, E., Kitani, K., & Asakawa, C. (2019) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2019.102369 · Cited by 85
“…al., 2017; Leo et al., 2016; Taylor et al., 2016), or to make use of touchscreen devices to enable interactive map exploration (Guerreiro et al., 2015; Kane et al., 2011; Su et al., 2010), often using screen overlays (Brock et al., 2015; Ducasse et al., 2018) or special devices (Zeng et al., 2014).”
BackgroundUncovering information needs for independent spatial learning for users who are visually impaired
Banović, N., Franz, R. L., Truong, K. N., Mankoff, J. C., & Dey, A. K. (2013) · International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS) · doi:10.1145/2513383.2513445 · Cited by 83
“physical tactile maps to enable users to access general information digitally through maps that present information using audio [14, 20, 28, 33], tactile [42], and a combination of tactile and audio feedback [8, 18, 24, 39].”
BackgroundRegionSpeak: Quick Comprehensive Spatial Descriptions of Complex Images for Blind Users
Zhong, Y., Lasecki, W. S., Brady, E. L., & Bigham, J. P. (2015) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/2702123.2702437 · Cited by 83
“This also reduces the search space that users have to process and preserves spatial information, which has the potential to reduce cognitive load [12].”
BackgroundOh, U., Kane, S. K., & Findlater, L. (2013) · ASSETS '13 · doi:10.1145/2513383.2513455 · Cited by 68
Self-citationAshraf, M. M., Hasan, N., Lewis, L., Hasan, M. R., & Ray, P. (2016) · International Journal of Disability Management · doi:10.1017/idm.2016.6 · Cited by 64
Access lens: a gesture-based screen reader for real-world documents
Kane, S. K., Frey, B., & Wobbrock, J. O. (2013) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/2470654.2470704 · Cited by 63
“Dwelling on a menu item causes AL to provide guided speech directions to the item’s actual location ( e.g., “Down, down, left, …”), as in Access Overlays [5].”
BackgroundMethodSelf-citationGiudice, N. A., Guenther, B. A., Jensen, N. A., & Haase, K. N. (2020) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2020.00087 · Cited by 60
“Although search performance was varied, Kane et al. (2011) showed that 14 BVI participants could learn the spatial relations of auditory targets via bimanual exploration of a large interactive table-top touchscreen.”
BackgroundInteraction Proxies for Runtime Repair and Enhancement of Mobile Application Accessibility
Zhang, X., Ross, A. S., Caspi, A., Fogarty, J., & Wobbrock, J. O. (2017) · Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3025453.3025846 · Cited by 59
“Other research has explored alternative pointing for physically large devices [36].”
BackgroundSelf-citationDesign Guidelines and Recommendations for Multimodal, Touchscreen-based Graphics
Gorlewicz, J. L., Tennison, J. L., Uesbeck, P. M., Richard, M. E., Palani, H. P., Stefik, A., Smith, D. W., & Giudice, N. A. (2020) · ACM Transactions on Accessible Computing · doi:10.1145/3403933 · Cited by 53
“There is a wealth of information available on using sonification techniques successfully in relaying graphical information, and we refer users to References [23, 48, 49, 59, 79–81] for more details.”
BackgroundInfluentialUnderstanding Blind Screen-Reader Users’ Experiences of Digital Artboards
Schaadhardt, A., Hiniker, A., & Wobbrock, J. O. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445242 · Cited by 44
“Similarly, Access Overlays [28] demonstrated multiple techniques for audio-based navigation of large touchscreens.”
BackgroundSelf-citationInteractive Audio-haptic Map Explorer on a Tactile Display
Zeng, L., Miao, M., & Weber, G. (2014) · Interacting with Computers · doi:10.1093/iwc/iwu006 · Cited by 53
“For example, Access Overlays (Kane et al., 2011) demonstrates how to locate or relocate landmarks on screens, including touching with two hands simultaneously.”
BackgroundGuideCopter - A Precise Drone-Based Haptic Guidance Interface for Blind or Visually Impaired People
Huppert, F., Hoelzl, G., & Kranz, M. (2021) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445676 · Cited by 58
“Kane et al. [22] presented in their research diferent audio interface options to enable BVI users to interact with touch screens more easily.”
BackgroundMethodInfluentialExamining Visual Semantic Understanding in Blind and Low-Vision Technology Users
Potluri, V., Grindeland, T. E., Froehlich, J. E., & Mankoff, J. C. (2021) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445040 · Cited by 52
“Their work [37] expands this knowledge to larger touchscreens and demonstrates three access overlays: edge projection, neighborhood browsing, and touch-and-speak.”
BackgroundInteractive audio-tactile maps for visually impaired people
Brock, A., & Jouffrais, C. (2015) · ACM SIGACCESS Accessibility and Computing · doi:10.1145/2850440.2850441 · Cited by 49
Exploration of Location-Aware You-Are-Here Maps on a Pin-Matrix Display
Zeng, L., & Weber, G. (2016) · IEEE Transactions on Human-Machine Systems · doi:10.1109/thms.2015.2477999 · Cited by 39
“Many map systems on touchscreen displays have been developed, like the TouchOver Map [28], the Access Overlays system [29], and the Timbremap system [30].”
MethodVatavu, R.-D. (2017) · International Journal of Human–Computer Interaction · doi:10.1080/10447318.2017.1279827 · Cited by 38
“Kane et al. (2011b) also examined di ff erences in touch gesture articulation performance between people with and without visual impairments for a large set of gesture types including taps, directional flicks, shapes, and symbols.”
BackgroundMethodInfluentialGuerreiro, T., Montague, K., Guerreiro, J., Nunes, R., Nicolau, H., & Gonçalves, D. J. V. (2015) · Proceedings of the 2015 International Conference on Interactive Tabletops & Surfaces - ITS '15 · doi:10.1145/2817721.2817743 · Cited by 43
“Unlike Kane et al’s count task [17], each of our target instances had the same name and required the user to maintain awareness of the visited targets.”
BackgroundMethodResultInfluentialNonvisual Interaction Techniques at the Keyboard Surface
Khurana, R., McIsaac, D., Lockerman, E., & Mankoff, J. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3173585 · Cited by 34
“Past work has shown that for nonvisual interaction, edge projection carries similar benefits [16].”
BackgroundRoboGraphics: Dynamic Tactile Graphics Powered by Mobile Robots
Guinness, D., Muehlbradt, A., Szafir, D. J., & Kane, S. K. (2019) · International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS) · doi:10.1145/3308561.3353804 · Cited by 36
“In this condition, the system provided spoken directions toward the nearest data point [12].”
BackgroundSelf-citationTouch-screens are not tangible
Elglaly, Y. N., Quek, F. K. H., Smith‐Jackson, T. L., & Dhillon, G. S. (2013) · International Conference on Tangible, Embedded, and Embodied Interaction (TEI) · doi:10.1145/2460625.2460665 · Cited by 32
Gorlewicz, J. L., Burgner, J., Withrow, T. J., & Webster, R. J. (2014) · Journal of Special Education Technology · doi:10.1177/016264341402900202 · Cited by 31
Zhang, X., Tran, T., Sun, Y., Culhane, I., Jain, S., Fogarty, J., & Mankoff, J. (2018) · ASSETS '18 · doi:10.1145/3234695.3236349 · Cited by 30
“For example, Access Overlays [19] improves task completion times and spatial understanding through software overlays designed to help with target acquisition.”
BackgroundImage Accessibility for Screen Reader Users: A Systematic Review and a Road Map
Oh, U., Joh, H., & Lee, Y. (2021) · Electronics · doi:10.3390/electronics10080953 · Cited by 37
Bardot, S., Serrano, M., Oriola, B., & Jouffrais, C. (2017) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3025453.3025582 · Cited by 32
“) to follow finger movement over a digital map, and render the content with auditory or vibrational feedback [2, 6, 5, 10, 25].”
BackgroundCamera-based mobile electronic travel aids support for cognitive mapping of unknown spaces
Zeng, L., Simros, M., & Weber, G. (2017) · International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI) · doi:10.1145/3098279.3098563 · Cited by 33
Touch the map!: designing interactive maps for visually impaired people
Brock, A. M. (2013) · ACM SIGACCESS Accessibility and Computing · doi:10.1145/2444800.2444802 · Cited by 29
Bardot, S., Serrano, M., & Jouffrais, C. (2016) · Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services · doi:10.1145/2935334.2935342 · Cited by 28
“We specifically focus on free map exploration as opposed to guided exploration where the user wants to reach a specific point, which involves other interaction techniques (see for instance [13]).”
BackgroundAssisting people with visual impairments in aiming at a target on a large wall-mounted display
Kim, K., Ren, X., Choi, S., & Tan, H. Z. (2015) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2015.10.002 · Cited by 31
“…that audio or haptic feedback can augment spatial search on a large display by guiding the hand actively toward the target, they were designed to support either sighted users on a vertical display (Lehtinen et al., 2012) or blind users on a horizontal display using touch input (Kane et al., 2011).”
InfluentialA11yBoard: Making Digital Artboards Accessible to Blind and Low-Vision Users
Zhang, Z., & Wobbrock, J. O. (2023) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3580655 · Cited by 37
Self-citationTADA: Making Node-link Diagrams Accessible to Blind and Low-Vision People
Zhao, Y., Nacenta, M. A., Sukhai, M. A., & Somanath, S. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642222 · Cited by 46
“…phones for blind users [63], Tennison and Gorlewicz [101] compare techniques and strategies to perceive and follow lines, Ramôa et al. [90] and Kane et al. [64] compare ways to direct users to elements on the 2D space, with the latter also covering browsing regions and retrieving localized detail.”
BackgroundInfluentialA Large-Scale Mixed-Methods Analysis of Blind and Low-vision Research in ACM and IEEE
Thoo, Y.-J., Medina, M. J., Froehlich, J. E., Ruffieux, N., & Lalanne, D. (2023) · International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS) · doi:10.1145/3597638.3608412 · Cited by 33
“, via a computer peripheral [4, 64, 107] or touchscreen [58, 59, 84]) was considered 32 times.”
BackgroundA Performance Comparison of On-Hand versus On-Phone Nonvisual Input by Blind and Sighted Users
Oh, U., & Findlater, L. (2015) · ACM Transactions on Accessible Computing · doi:10.1145/2820616 · Cited by 23
“For the circle, equilateral triangle, and square, we calculated this difference for aspect ratio , the ratio of width to height (ideally 1), and closure [Kane et al. 2011], the Euclidian distance between the start and end points of the gesture (ideally 0).”
BackgroundMethodHuang, H. (2018) · Universal Access in the Information Society · doi:10.1007/s10209-017-0550-z · Cited by 23
“For example, information presented on touchscreens does not offer corresponding tactile feedback, and no positioning support mechanisms are provided [16, 23, 24].”
BackgroundAutomated Repair of Size-Based Inaccessibility Issues in Mobile Applications
Alotaibi, A. S., Chiou, P., & Halfond, W. G. J. (2021) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1109/ase51524.2021.9678625 · Cited by 41
“Software-based approaches to improve touchscreen accessibility [21], [22], [23] are more robust, but they mostly focus on using audio-based interaction techniques to allow the visually impaired to access touchscreens.”
BackgroundGrussenmeyer, W., Garcia, J., & Jiang, F. (2016) · International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI) · doi:10.1145/2935334.2935367 · Cited by 25
“Access overlays was a system to help users who are blind and visually impaired to learn maps on large touchscreens through three different techniques: edge projection, touch and speak, and neighborhood browsing [5].”
BackgroundMobile accessibility tools for the visually impaired
Subramanian, L., & Paisios, N. (2012) · Cited by 22
Accessibility of Brainstorming Sessions for Blind People
Kunz, A. M., Miesenberger, K., Mühlhäuser, M., Alavi, A., Pölzer, S., Pöll, D., Heumader, P., & Schnelle-Walka, D. (2014) · Lecture notes in computer science · doi:10.1007/978-3-319-08596-8_38 · Cited by 24
“[24], a tree structure can be easily navigated, interpreted and manipulated by a blind user in a way she is already familiar with.”
BackgroundZhao, K., Bardot, S., Serrano, M., Simonnet, M., Oriola, B., & Jouffrais, C. (2021) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445578 · Cited by 25
“In addition to these studies in psychology, recent studies on interactive 3D printed maps [16] [24] and digital interactive graphics [2] [10] [17] [18] [26] studied exploration behaviors involving one or two hands.”
BackgroundBotMap: Non-Visual Panning and Zooming with an Actuated Tabletop Tangible Interface
Ducasse, J., Macé, M. J. ‐., Oriola, B., & Jouffrais, C. (2018) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3204460 · Cited by 25
“For example, Kane et al. [31] designed innovative interaction techniques called access overlays that enable VI users to locate a landmark on a map ( edge projection), retrieve the name of the nearest landmark ( neighborhood browsing ) or initiate guided directions to find a landmark.”
BackgroundKim, J., Bessho, M., Koshizuka, N., & Sakamura, K. (2014) · Urb-IoT - EAI International Conference IoT Urban Space · doi:10.4108/icst.urb-iot.2014.257263 · Cited by 20
Touchscreen Mobile Phones Virtual Keyboarding for People with Visual Disabilities
Façanha, A. R., Viana, W., Pequeno, M. C., Campos, M. D. B., & Sánchez, J. (2014) · Lecture notes in computer science · doi:10.1007/978-3-319-07227-2_14 · Cited by 20
Audio-Based Feedback Techniques for Teaching Touchscreen Gestures
Oh, U., Branham, S., Findlater, L., & Kane, S. K. (2015) · ACM Transactions on Accessible Computing · doi:10.1145/2764917 · Cited by 18
“Table I presents examples of accessible gestures currently used in mainstream operating systems; however, it is important to note that these gestures are only a subset of gestures that users with vision impairments may be able to perform [Kane et al. 2011b].”
BackgroundInfluentialSelf-citationSimphony: Enhancing Accessible Pattern Design Practices among Blind Weavers
Das, M., Gergle, D., & Piper, A. M. (2023) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581047 · Cited by 21
Dang, K., Korreshi, H., Iqbal, Y., & Lee, S. (2023) · ACM Symposium on Spatial User Interaction (SUI) · doi:10.1145/3607822.3614540 · Cited by 25
“Speech and non-speech modality as auditory feedback have been thoroughly investigated for tasks ranging from 2D surface exploration to complex activities like grocery shopping [13, 30, 34, 65, 66, 71, 82, 103, 104, 117, 125, 130, 131, 140, 152].”
BackgroundContactless touch interface supporting blind touch interaction by aerial tactile stimulation
Yoshino, K., & Shinoda, H. (2014) · IEEE Haptics Symposium · doi:10.1109/haptics.2014.6775479 · Cited by 19
“Index Terms: H.5.2 [Information Interfaces and Presentation]: User Interfaces—Haptic I/O; H.5.2 [Information Interfaces and Presentation]: User Interfaces —Input devices and strategies”
BackgroundInfluentialAlajarmeh, N. S. (2021) · Displays · doi:10.1016/j.displa.2021.102081 · Cited by 27
MotorEase: Automated Detection of Motor Impairment Accessibility Issues in Mobile App UIs
Vajjala, A. K., Mansur, S. M. H., Jose, J., & Moran, K. (2024) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/3597503.3639167 · Cited by 38
Collaborative Tabletops for Blind People: The Effect of Auditory Design on Workspace Awareness
Mendes, D., Reis, S., Guerreiro, J., & Nicolau, H. (2020) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3427325 · Cited by 19
The Haptic Video Player: Using Mobile Robots to Create Tangible Video Annotations
Guinness, D., Muehlbradt, A., Szafir, D. J., & Kane, S. K. (2018) · ACM International Conference on Interactive Surfaces and Spaces (ISS) · doi:10.1145/3279778.3279805 · Cited by 20
Self-citationComparing interaction techniques to help blind people explore maps on small tactile devices
Simonnet, M., Brock, A. M., Serpa, A., Oriola, B., & Jouffrais, C. (2019) · Multimodal Technologies and Interaction · doi:10.3390/mti3020027 · Cited by 16
“[19], we used different tasks for the online condition, however we modified the tasks proposed in their study to improve the measures of spatial cognition (direction, distances and mental rotations), as described above.”
BackgroundMethodResultInfluentialMap design for visually impaired people: past, present, and future research
Brock, A., Oriola, B., Truillet, P., Jouffrais, C., & Picard, D. (2013) · HAL · Cited by 26
AudioDraw: user preferences in non-visual diagram drawing for touchscreens
Grussenmeyer, W., & Folmer, E. (2016) · International Web for All Conference (W4A) · doi:10.1145/2899475.2899483 · Cited by 21
“…have been attempted over the years such as data sonification with stereo sound [17, 20] and mono sound [5, 24], navigational directions and descriptions called Access Overlays [11], tactile overlays with TTS descriptions as the finger moves over the touchscreen [13], and haptics [1, 6, 22, 23].”
BackgroundExternalizing cognitive maps via map reconstruction and verbal description
Miao, M., Zeng, L., & Weber, G. (2016) · Universal Access in the Information Society · doi:10.1007/s10209-016-0497-5 · Cited by 18
Cutter, M. P., & Manduchi, R. (2015) · ACM Symposium on Document Engineering (DocEng) · doi:10.1145/2682571.2797066 · Cited by 16
“One of their user interface contributions is an “edge menu”, inspired by the author’s previous work [10].”
BackgroundUser-Defined Foot Gestures for Eyes-Free Interaction in Smart Shower Rooms
Chen, Z., Tu, H., & Wu, H. (2022) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2022.2109260 · Cited by 15
“In recent ten years, software-based plug-ins (Kane et al., 2011) and tactile interfaces (Kane et al., 2013) have been developed for blind users to improve their ability to manipulate objects on tabletop screens rapidly and accurately.”
BackgroundLaserShoes: Low-Cost Ground Surface Detection Using Laser Speckle Imaging
Yan, Z., Lin, Y., Wang, G., Cai, Y., Cao, P., Mi, H., & Zhang, Y. (2023) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581344 · Cited by 18
“Previous research attempted to design physical tactile maps to enable users to access information with audio [22, 27, 44, 52], tactile [58], and a combination of tactile and audio feedback [18, 25, 39, 64].”
BackgroundDeveloping dynamic audio navigation uis to pinpoint elements in tactile graphics
Ramôa, G., Schmidt, V., & König, P. (2022) · Multimodal Technologies and Interaction · doi:10.3390/mti6120113 · Cited by 14
Guan, Z., Xiong, Z., & Fan, M. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642213 · Cited by 18
“Access Overlays focused on helping BLV people identify elements on large touchscreens [25].”
BackgroundAIGuide: Augmented Reality Hand Guidance in a Visual Prosthetic
Lee, S., Aldas, N. D. T., Lee, C., Rosson, M. B., Carroll, J. M., & Narayanan, V. (2022) · ACM Transactions on Accessible Computing · doi:10.1145/3508501 · Cited by 15
“The work of Kane et al. [37, 38], Stearns et al. [78], Oh et al. [59], and Shilkrot et al. [72] are examples.”
BackgroundMethodMultimodal eyes-free exploration of maps
Bahram, S. (2013) · ACM SIGACCESS Accessibility and Computing · doi:10.1145/2505401.2505402 · Cited by 12
“A recent approach due to Kane et al. [13] proposes access overlays as a solution.”
MethodEyeDescribe: Combining Eye Gaze and Speech to Automatically Create Accessible Touch Screen Artwork
Reinholt, K., Guinness, D., & Kane, S. K. (2019) · ACM International Conference on Interactive Surfaces and Spaces (ISS) · doi:10.1145/3343055.3359722 · Cited by 11
“We also provided an enhanced set of gestures partly inspired by the Access Overlays [20], with an emphasis on providing users more information about the image and its spatial layout.”
BackgroundMethodInfluentialSelf-citationInvestigating Feedback for Two-Handed Exploration of Digital Maps Without Vision
Bardot, S., Serrano, M., Perrault, S. T., Zhao, S., & Jouffrais, C. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-29381-9_19 · Cited by 8
Improving the Screen Exploration of Smartphones Using Haptic Icons for Visually Impaired Users
González-Cañete, F. J., Rodríguez, J. L. L., Galdón, P. M., & Estrella, A. D. (2021) · Sensors · doi:10.3390/s21155024 · Cited by 10
“With the aim of accelerating navigation tasks, logical partition techniques have been proposed to organize the UI elements in a predefined or customizable scheme [16,17], to use alphabetically ordered menus [18], to form adaptive UIs that change according to the context and user preferences [1] or to form guidance tec…”
MethodAudible rendering of text documents controlled by multi-touch interaction
Elglaly, Y. N., Quek, F. K. H., Smith‐Jackson, T. L., & Dhillon, G. S. (2012) · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION · doi:10.1145/2388676.2388767 · Cited by 10
Quantifying Touch: New Metrics for Characterizing What Happens During a Touch
Kong, J., Zhong, M., Fogarty, J. A., & Wobbrock, J. O. (2022) · International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS) · doi:10.1145/3517428.3544804 · Cited by 11
Self-citationBrushLens: Hardware Interaction Proxies for Accessible Touchscreen Interface Actuation
Liang, C., Iravantchi, Y., Krolikowski, T., Geng, R., Sample, A. P., & Guo, A. (2023) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/3586183.3606730 · Cited by 10
Smart Navigation Aids for Blind and Vision Impairment People
Saud, S. N., Raya, L. B., Abdullah, M. I., & Isa, M. Z. A. (2021) · Advances in intelligent systems and computing · doi:10.1007/978-3-030-68133-3_6 · Cited by 9
Accessible Block-Based Programming for K-12 Students Who Are Blind or Low Vision
Das, M., Marghitu, D., Mandala, M., & Howard, A. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-78095-1_5 · Cited by 8
Quick-glance and in-depth exploration of a tabletop map for visually impaired people
Bardot, S., Brock, A., Serrano, M., & Jouffrais, C. (2014) · Conference on l'Interaction Homme-Machine (IHM) · doi:10.1145/2670444.2670465 · Cited by 8
“These zones were arranged in a 3x4 grid, which was inspired by Kane’s Neighborhood Browsing [5] with the difference of the grid being rectangular in our case.”
BackgroundMethodInfluentialA11yBoard: Using Multimodal Input and Output to Make Digital Artboards Accessible to Blind Users
Zhang, Z., & Wobbrock, J. O. (2022) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/3526114.3558695 · Cited by 13
“information like by using audio [2, 6, 12, 14] and haptics [7–9, 13], and by supporting accessible drawing [1, 3, 4, 8], most creativity software tools still remain inaccessible, especially object-based 2-D”
Self-citationA Tactile Presentation Method of Mind Maps in Co-located Meetings.
Pölzer, S., & Miesenberger, K. (2014) · Cited by 7
Coping with Accessibility Challenges for Security - A User Study with Blind Smartphone Users
Lobo, S., Hirom, U., Shyama, V. S., Basumatori, M., & Doke, P. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-68059-0_1 · Cited by 7
“Researchers such as Kane, Leporini, Buzzi, Azenkot and Guerreiro have discussed novel approaches for usable and accessible interfaces on smartphones [46, 53–58].”
BackgroundElevating Haptics: An Accessible and Contactless Elevator Concept with Tactile Mid-Air Controls
Singhal, T., & Phutane, M. (2021) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3411763.3451574 · Cited by 6
“[9] provided a set of gestures for exploring large displays such as public interactive maps.”
BackgroundA study of touching behavior for authentication in touch screen smart devices
Alariki, A. A., Manaf, A. B. A., & Khan, S. (2016) · doi:10.1109/intelse.2016.7475123 · Cited by 6
Ramôa, G., Schmidt, V., Schwarz, T., Stiefelhagen, R., & König, P. (2024) · Frontiers in Rehabilitation Sciences · doi:10.3389/fresc.2024.1368983 · Cited by 5
µGeT: Multimodal eyes-free text selection technique combining touch interaction and microgestures
Faisandaz, G. R. J., Goguey, A., Jouffrais, C., & Nigay, L. (2023) · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION · doi:10.1145/3577190.3614131 · Cited by 6
“[24] explored multitouch and bimanuality to design techniques helping users to navigate the screen faster and understand spatial layout.”
BackgroundLearning with interactive tabletop displays
Niu, S., McCrickard, D. S., & Nguyen, S. M. (2016) · IEEE Frontiers in Education Conference (FIE) · doi:10.1109/fie.2016.7757601 · Cited by 4
“Applications of these devices can been seen in many area-specified scenarios such as museums [12-14], games [15, 16], data analysis [17, 18], and assistive technologies [19].”
BackgroundIntelligent Interaction in Accessible Applications
Bahram, S., Chakraborty, A., Ravindran, S., & Amant, R. S. (2013) · Human-computer interaction series · doi:10.1007/978-1-4471-5082-4_5 · Cited by 4
Using Audio Cues to Support Motion Gesture Interaction on Mobile Devices
Morrison-Smith, S., Hofmann, M. K., Li, Y., & Ruiz, J. R. (2016) · ACM Transactions on Applied Perception · doi:10.1145/2897516 · Cited by 4
A framework for bimanual inter-device interactions
Roudaki, A., Kong, J., Walia, G., & Huang, Z. (2014) · Journal of Visual Languages & Computing · doi:10.1016/j.jvlc.2014.10.002 · Cited by 4
“Researchers have investigated on improving the accessibility of a public interface for blind users [14].”
BackgroundThe efficacy of surface haptics and force feedback in education
Gorlewicz, J. L. (2013) · ProQuest LLC eBooks · Cited by 4
Kneitmix, M. J., & Wobbrock, J. O. (2025) · Proceedings of the 27th International ACM SIGACCESS Conference on Computers and Accessibility · doi:10.1145/3663547.3746364 · Cited by 5
Self-citationModeling Gliding-based Target Selection for Blind Touchscreen Users
Ko, Y.-J., Putkonen, A., Aydin, A. S., Feiz, S., Wang, Y., Ashok, V., Ramakrishnan, IV, Oulasvirta, A., & Bi, X. (2021) · Proceedings of the 23rd International Conference on Mobile Human-Computer Interaction · doi:10.1145/3447526.3472022 · Cited by 3
2D Presentation Techniques of Mind-maps for Blind Meeting Participants
Stephan, P., & Miesenberger, K. (2015) · Studies in health technology and informatics · doi:10.3233/978-1-61499-566-1-533 · Cited by 3
“In [1] different methods are presented to improve understanding of geographical layouts and to improve accessibility of touch based user interfaces.”
BackgroundMethodInfluentialLin, W., Li, T., Liu, L., & Zhu, Q. (2023) · Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544549.3585819 · Cited by 3
“Different ways to browse and explore UI elements on large touchscreens, such as screen edge positioning, nearest item browsing, and speech feedback at path, also were proposed[13].”
BackgroundMedina, M. J., Thoo, Y.-J., Baudet, C., Froehlich, J. E., Ruffieux, N., & Lalanne, D. (2025) · ACM Transactions on Accessible Computing · doi:10.1145/3726531 · Cited by 7
“The touch modality is facilitated through mainstream technologies, such as touchscreens [90, 91, 138], and assistive technologies like braille and wearable devices [141].”
Assisting Visually Impaired People to Acquire Targets on a Large Wall-Mounted Display
Kim, K., & Ren, X. (2014) · Journal of Computer Science and Technology · doi:10.1007/s11390-014-1471-4 · Cited by 3
“Many display systems use the robust auditory channel to augment visual information for VIPs([3]).”
Background
Metadata
- Authors
- Kane, S. K., Morris, M. R., Perkins, A. Z., Wigdor, D., Ladner, R. E., & Wobbrock, J. O.
- Affiliations
- University of Maryland, Baltimore County (US)
- Microsoft (United States) (US)
- Microsoft, Redmond, WA, USA
- University of Toronto (CA)
- University of Washington (US)
- Venue
- Proceedings of the 24th annual ACM symposium on User interface software and technology
- Publisher
- ACM
- Published
- 2011-10-16
- Pages
- 273-282
- OpenAlex
- W2104779182
- Semantic Scholar
- f104d189417a0ff54e603e97e31422c757f24679
- Cited by
- 127
- References
- 32
- Citations by year
- 2026: 5 · 2025: 5 · 2024: 6 · 2023: 10 · 2022: 6 · 2021: 16 · 2020: 2 · 2019: 8 · 2018: 7 · 2017: 11 · 2016: 10 · 2015: 11 · 2014: 14 · 2013: 12 · 2012: 4
- FWCI
- 19.19
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- ACM Symposium on User Interface Software and Technology (UIST) (publishedVersion)
- Topics
- Social Sciences › Human Factors and Ergonomics › Digital Accessibility for Disabilities
- Life Sciences › Neuroscience › Cognitive Neuroscience › Tactile and Sensory Interactions
- Health Sciences › Health Professions › Occupational Therapy › Assistive Technology in Communication and Mobility
- Keywords
- accessibility, blind users, touch screen, interactive tabletops, screen readers, voice-over, geospatial data, accessible maps, assistive technology
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.