Touchplates: low-cost tactile overlays for visually impaired touch screen users
Abstract
Adding tactile feedback to touch screens can improve their accessibility to blind users, but prior approaches to integrating tactile feedback with touch screens have either offered limited functionality or required extensive (and typically expensive) customization of the hardware. We introduce touchplates, carefully designed tactile guides that provide tactile feedback for touch screens in the form of physical guides that are overlaid on the screen and recognized by the underlying application. Unlike prior approaches to integrating tactile feedback with touch screens, touchplates are implemented with simple plastics and use standard touch screen software, making them versatile and inexpensive. Touchplates may be customized to suit individual users and applications, and may be produced on a laser cutter, 3D printer, or made by hand. We describe the design and implementation of touchplates, a "starter kit" of touchplates, and feedback from a formative evaluation with 9 people with visual impairments. Touchplates provide a low-cost, adaptable, and accessible method of adding tactile feedback to touch screen interfaces.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Some users would not want to be dependent on additional physical objects to use their cellphones.
“Even if costs were low, some users would not want to be dependent on additional physical objects in order to use their cellphones [8].”
From Designing a text entry multimodal keypad for blind users of touchscreen mobile phones (2014) · cites this paper as [8]
Hybrid solutions require users to carry different overlays, which can be impractical.
“Still, users would need to carry different overlays with them, which can be impractical.”
From Designing a text entry multimodal keypad for blind users of touchscreen mobile phones (2014) · cites this paper as [8]
Hardware-only approaches rely on physical tools between screen and user; smartphones are not aware of overlays and do not adapt to their presence or absence.
“Hardware-only approaches do not modify the underlying software; they rely on placing physical tools between the screen and the user. For instance, special plastic cases or screen overlays can delimit screen borders; however, smartphones are not aware of such overlays and do not adapt to their presence or absence [4, 8].”
From Designing a text entry multimodal keypad for blind users of touchscreen mobile phones (2014) · cites this paper as [8]
Prior approaches regarding touchscreen use by blind users can be classified into three general categories: software-only, hardware-only and hybrid.
“Prior approaches regarding the use of touchscreen by blind users can be classified into three general categories: software-only, hardwareonly and hybrid approaches [8].”
From Designing a text entry multimodal keypad for blind users of touchscreen mobile phones (2014) · cites this paper as [8]
Increasing tactile feedback and tangible interaction on touchscreens can improve their accessibility.
“Increasing tactile feedback and tangible interaction on touchscreens can improve their accessibility.”
From Interactiles: 3D Printed Tactile Interfaces to Enhance Mobile Touchscreen Accessibility (2018) · cites this paper as [20]
Prior tactile accessibility approaches were not focused on mobile systems.
“or not focused on mobile systems [4,20]”
From Interactiles: 3D Printed Tactile Interfaces to Enhance Mobile Touchscreen Accessibility (2018) · cites this paper as [20]
Prior research shows the positive impact of tangible interaction, but most such work has been designed for large touchscreens.
“Prior research [4,20] shows the positive impact of tangible interaction, but most such work has been designed for large touchscreens.”
From Interactiles: 3D Printed Tactile Interfaces to Enhance Mobile Touchscreen Accessibility (2018) · cites this paper as [20]
Qualitative studies consistently found problems with locating items within graphical interfaces that were designed to be seen rather than heard.
“These studies consistently found problems with locating items within graphical interfaces that were designed to be seen rather than heard.”
From Interactiles: 3D Printed Tactile Interfaces to Enhance Mobile Touchscreen Accessibility (2018) · cites this paper as [20]
Cites
Bier, E. A., Stone, M. C., Pier, K., Buxton, W. A. S., & DeRose, T. (1993) · ACM SIGGRAPH Conference (SIGGRAPH) · doi:10.1145/166117.166126 · Cited by 1,164 · see citing works
Asymmetric Division of Labor in Human Skilled Bimanual Action: The Kinematic Chain as a Model
Guiard, Y. (1987) · Journal of Motor Behavior · doi:10.1080/00222895.1987.10735426 · Cited by 1,134 · see citing works
A Simple, Low-Cost Conductive Composite Material for 3D Printing of Electronic Sensors
Leigh, S. J., Bradley, R. J., Purssell, C. P., et al. (2012) · PLoS ONE · doi:10.1371/journal.pone.0049365 · Cited by 786 · see citing works
TeslaTouch: electrovibration for touch surfaces
Bau, O., Poupyrev, I., Israr, A., & Harrison, C. (2010) · Proceedings of the 23nd annual ACM symposium on User interface software and technology · doi:10.1145/1866029.1866074 · Cited by 664 · see citing works
Ullmer, B., & Ishii, H. (1997) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/263407.263551 · Cited by 541 · see citing works
Kane, S. K., Jayant, C., Wobbrock, J. O., & Ladner, R. E. (2009) · Proceedings of the 11th international ACM SIGACCESS conference on Computers and accessibility · doi:10.1145/1639642.1639663 · Cited by 383 · cited 1× · see citing works
“While the emergence of mainstream touch screen computing has presented usability benefits for many computer users, people with visual impairments often experience significant challenges when interacting with touch screen user interfaces [13,14].”
BackgroundSelf-citationKane, S. K., Bigham, J. P., & Wobbrock, J. O. (2008) · Proceedings of the 10th International ACM SIGACCESS Conference on Computers and Accessibility · doi:10.1145/1414471.1414487 · Cited by 374 · cited 3× · see citing works
“Slide Rule [13] and NavTap [9] enabled access to uninstrumented touch screens through a combination of audio output and a set of input gestures that could be easily performed eyes-free.”
BackgroundSelf-citationIssues and techniques in touch-sensitive tablet input
Buxton, W. J., Hill, R. D., & Rowley, P. (1985) · ACM SIGGRAPH Computer Graphics · doi:10.1145/325165.325239 · Cited by 233 · see citing works
Tactile interfaces for small touch screens
Poupyrev, I., & Maruyama, S. (2003) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/964696.964721 · Cited by 212 · see citing works
Weiss, M., Wagner, J., Jansen, Y., Jennings, R., Khoshabeh, R., Hollan, J. D., & Borchers, J. (2009) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/1518701.1518779 · Cited by 198 · see citing works
Weiss, M., Schwarz, F., Jakubowski, S., & Borchers, J. (2010) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/1866029.1866075 · Cited by 162 · see citing works
No-Look Notes: Accessible Eyes-Free Multi-touch Text Entry
Bonner, M. N., Brudvik, J. T., Abowd, G. D., & Edwards, W. K. (2010) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-12654-3_24 · Cited by 154 · cited 1× · see citing works
“This technique was adapted for modern touch screens by Kincaid [16]; however, these researchers did not test this approach with blind or visually impaired users.”
MethodInvestigating touchscreen accessibility for people with visual impairments
McGookin, D., Brewster, S., & Jiang, W. (2008) · Proceedings of the 5th Nordic conference on Human-computer interaction: building bridges · doi:10.1145/1463160.1463193 · Cited by 151 · cited 1× · see citing works
“[20] created a prototype mobile music player which used a fixed touch screen overlay to create the sensation of physical buttons.”
BackgroundUsing transparent props for interaction with the virtual table
Schmalstieg, D., Encarnação, L. M., & Szalavári, Z. (1999) · ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games (I3D) · doi:10.1145/300523.300542 · Cited by 131 · see citing works
Access overlays: improving non-visual access to large touch screens for blind users
Kane, S. K., Morris, M. R., Perkins, A. Z., Wigdor, D., Ladner, R. E., & Wobbrock, J. O. (2011) · Proceedings of the 24th annual ACM symposium on User interface software and technology · doi:10.1145/2047196.2047232 · Cited by 127 · cited 4× · see citing works
“Larger touch screens, such as those found on interactive tabletops or touch screen kiosks, may present additional interaction challenges [15].”
BackgroundMethodInfluentialSelf-citationWeiss, M., Wacharamanotham, C., Voelker, S., & Borchers, J. (2011) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/2047196.2047277 · Cited by 122 · see citing works
Tactile display for the visually impaired using TeslaTouch
Cheng, X., Israr, A., Poupyrev, I., Bau, O., & Harrison, C. (2011) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/1979742.1979705 · Cited by 121 · see citing works
BrailleTouch: Mobile Texting for the Visually Impaired
Frey, B., Southern, C., & Romero, M. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-21666-4_3 · Cited by 114 · see citing works
Gravvitas: generic multi-touch presentation of accessible graphics
Goncu, C., & Marriott, K. (2011) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-23774-4_5 · Cited by 112 · see citing works
MudPad: tactile feedback and haptic texture overlay for touch surfaces
Jansen, Y., Karrer, T., & Borchers, J. (2010) · ACM International Conference on Interactive Tabletops and Surfaces · doi:10.1145/1936652.1936655 · Cited by 102 · see citing works
Touch screens now offer compelling uses
Shneiderman, B. (1991) · IEEE Software · doi:10.1109/52.73754 · Cited by 100 · see citing works
Issues and techniques in touch-sensitive tablet input
Buxton, W. A. S., Hill, R. D., & Rowley, P. (1985) · ACM SIGGRAPH Conference (SIGGRAPH) · doi:10.1145/325334.325239 · Cited by 92 · see citing works
From Tapping to Touching: Making Touch Screens Accessible to Blind Users
Guerreiro, T., Lagoá, P., Nicolau, H., Gonalves, D., & Jorge, J. A. (2008) · IEEE Multimedia · doi:10.1109/mmul.2008.88 · Cited by 89 · see citing works
Yu, N.-H., Tsai, S.-S., Hsiao, I.-C., et al. (2011) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/2047196.2047243 · Cited by 55 · see citing works
Use of Audio-Haptic Interface Techniques to Allow Nonvisual Access to Touchscreen Appliances
Vanderheiden, G. C. (1996) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/154193129604002430 · Cited by 47 · see citing works
Augmenting interactive tables with mice & keyboards
Hartmann, B., Morris, M. R., Benko, H., & Wilson, A. D. (2009) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/1622176.1622204 · Cited by 46 · see citing works
Self-citationHuman interface design and the handicapped user
Buxton, W. A. S., Foulds, R., Rosen, M., Scadden, L. A., & Shein, F. (1986) · ACM SIGCHI Bulletin · doi:10.1145/22339.22386 · Cited by 38 · see citing works
Tactile Guides for Touch Screen Controls
Kincaid, R. H. (2012) · Electronic workshops in computing · doi:10.14236/ewic/hci2012.48 · Cited by 10 · see citing works
Rethinking eye care: from exclusion to equity
Upadhyay, M. P. (1970) · Nepalese Journal of Ophthalmology · doi:10.3126/nepjoph.v2i1.3696 · Cited by 10 · see citing works
Arya, S., Kalia, A., der Pant, K. A. D.-V., et al. (1970) · Nepalese Journal of Ophthalmology · doi:10.3126/nepjoph.v2i1.3710 · Cited by 7 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Accessible Touchscreen Technology for People with Visual Impairments: A Survey
Grussenmeyer, W., & Folmer, E. (2017) · ACM Transactions on Accessible Computing · doi:10.1145/3022701 · Cited by 86 · see citing works
Giudice, N. A., Guenther, B. A., Jensen, N. A., & Haase, K. N. (2020) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2020.00087 · Cited by 60 · see citing works
Analyzing visually impaired people’s touch gestures on smartphones
Buzzi, M. C., Buzzi, M., Leporini, B., & Trujillo, A. (2017) · Multimedia Tools and Applications · doi:10.1007/s11042-016-3594-9 · Cited by 53 · see citing works
Nonvisual Interaction Techniques at the Keyboard Surface
Khurana, R., McIsaac, D., Lockerman, E., & Mankoff, J. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3173585 · Cited by 34 · see citing works
Zhang, X., Tran, T., Sun, Y., Culhane, I., Jain, S., Fogarty, J., & Mankoff, J. (2018) · ASSETS '18 · doi:10.1145/3234695.3236349 · Cited by 30 · see citing works
Designing a text entry multimodal keypad for blind users of touchscreen mobile phones
Buzzi, M. C., Buzzi, M., Leporini, B., & Trujillo, A. (2014) · Proceedings of the 16th international ACM SIGACCESS conference on Computers & accessibility - ASSETS '14 · doi:10.1145/2661334.2661354 · Cited by 28 · see citing works
Lang, F., & Machulla, T. (2021) · Proceedings of the 27th ACM Symposium on Virtual Reality Software and Technology · doi:10.1145/3489849.3489873 · Cited by 26 · see citing works
“ical overlays [14, 20] add tactile information about the position of interface components.”
BackgroundHe, L., Wan, Z., Findlater, L., & Froehlich, J. E. (2017) · Proceedings of the 19th International ACM SIGACCESS Conference on Computers and Accessibility · doi:10.1145/3132525.3134818 · Cited by 26 · see citing works
WATANABE, T., YAMAGUCHI, T., & MINATANI, K. (2015) · IEICE Transactions on Information and Systems · doi:10.1587/transinf.2014edp7317 · Cited by 24 · see citing works
A Performance Comparison of On-Hand versus On-Phone Nonvisual Input by Blind and Sighted Users
Oh, U., & Findlater, L. (2015) · ACM Transactions on Accessible Computing · doi:10.1145/2820616 · Cited by 23 · see citing works
Touchpen: rich interaction technique for audio-tactile charts by means of digital pens.
Engel, C., Konrad, N., & Weber, G. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58796-3_52 · Cited by 11 · see citing works
Götzelmann, T. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-41267-2_20 · Cited by 4 · see citing works
Lin, W., Li, T., Liu, L., & Zhu, Q. (2023) · Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544549.3585819 · Cited by 3 · see citing works
- Authors
- Kane, S. K., Morris, M. R., & Wobbrock, J. O.
- Affiliations
- University of Maryland, Baltimore County (US)
- Microsoft (United States) (US)
- University of Washington (US)
- Venue
- Proceedings of the 15th International ACM SIGACCESS Conference on Computers and Accessibility
- Publisher
- ACM
- Published
- 2013-10-21
- Pages
- 1-8
- OpenAlex
- W1977738030
- Cited by
- 107
- References
- 30
- Citations by year
- 2026: 3 · 2025: 5 · 2024: 7 · 2023: 10 · 2022: 9 · 2021: 8 · 2020: 11 · 2019: 10 · 2018: 14 · 2017: 8 · 2016: 8 · 2015: 11 · 2014: 3
- FWCI
- 11.64
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS) (publishedVersion)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Tactile and Sensory Interactions
- Social Sciences › Human Factors and Ergonomics › Digital Accessibility for Disabilities
- Health Sciences › Health Professions › Occupational Therapy › Assistive Technology in Communication and Mobility
- Keywords
- tactile feedback, touch screen, accessibility, visual impairment, blind users, haptic interface, low-cost assistive technology, personalization
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review