TacTILE: A Preliminary Toolchain for Creating Accessible Graphics with 3D-Printed Overlays and Auditory Annotations
The DOI matches its Crossref record; 6 of the 6 references it cites were found in a registry or an index.
Abstract
Tactile overlays with audio annotations can increase the accessibility of touchscreens for blind users; however, preparing these overlays is complex and labor intensive. We introduce TacTILE, a novel toolchain to more easily create tactile overlays with audio annotations for arbitrary touchscreen graphics (e.g., graphs, pictures, maps). The workflow includes: (i) an annotation tool to add audio to graphical elements, (ii) a fabrication process that generates 3D-printed tactile overlays, and (iii) a custom app for the user to explore graphics with these overlays. We close with a pilot study with one blind participant who explores three examples (floor plan, photo, and chart), and a discussion of future work.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“had limited compatibility across multiple apps [15,22,29]”
From Interactiles: 3D Printed Tactile Interfaces to Enhance Mobile Touchscreen Accessibility (2018) · cites this paper as [15]
In the citing paper
“However, prior research has limited each such overlay to a specific screen in a single app (e.g., [15,22,29]).”
From Interactiles: 3D Printed Tactile Interfaces to Enhance Mobile Touchscreen Accessibility (2018) · cites this paper as [15]
Citations
Cites
Investigating touchscreen accessibility for people with visual impairments
McGookin, D., Brewster, S., & Jiang, W. (2008) · Proceedings of the 5th Nordic conference on Human-computer interaction: building bridges · doi:10.1145/1463160.1463193 · Cited by 151 · cited 1×
“One solution is to employ physical overlays that are placed on top of the screen, providing tactile information and constraining input to only specific locations [1,4,6,7].”
BackgroundFacade: Auto-generating Tactile Interfaces to Appliances
Guo, A., Kim, J., Chen, X. '., Yeh, T., Hudson, S. E., Mankoff, J., & Bigham, J. P. (2017) · Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3025453.3025845 · Cited by 122 · cited 1×
“A related solution to this scalability problem—though not focused on touchscreen overlays—is Façade [3], which allows blind users to take a picture of a smooth appliance interface ( e.g., microwave keypad) and semi-Permission to make digital or hard copies of part or all of this work for personal…”
BackgroundTouchplates: low-cost tactile overlays for visually impaired touch screen users
Kane, S. K., Morris, M. R., & Wobbrock, J. O. (2013) · Proceedings of the 15th International ACM SIGACCESS Conference on Computers and Accessibility · doi:10.1145/2513383.2513442 · Cited by 107 · cited 4×
“One solution is to employ physical overlays that are placed on top of the screen, providing tactile information and constraining input to only specific locations [1,4,6,7].”
BackgroundResultInfluentialDesigning Haptic Assistive Technology for Individuals Who Are Blind or Visually Impaired
Pawluk, D. T. V., Adams, R. J., & Kitada, R. (2015) · IEEE Transactions on Haptics · doi:10.1109/toh.2015.2471300 · Cited by 102 · cited 1×
“One solution is to employ physical overlays that are placed on top of the screen, providing tactile information and constraining input to only specific locations [1,4,6,7].”
BackgroundLucentMaps: 3D Printed Audiovisual Tactile Maps for Blind and Visually Impaired People
Götzelmann, T. (2016) · Proceedings of the 18th International ACM SIGACCESS Conference on Computers and Accessibility · doi:10.1145/2982142.2982163 · Cited by 86 · cited 2×
“LucentMaps [2] uses 3D-printed tactile maps with embedded capacitive material that, when overlaid on a touchscreen device, can generate audio in response to touch.”
BackgroundMethodEl-Glaly, Y. N., Quek, F., Smith-Jackson, T., & Dhillon, G. (2013) · Proceedings of the 7th International Conference on Tangible, Embedded and Embodied Interaction · doi:10.1145/2460625.2460665 · Cited by 31 · cited 1×
“One solution is to employ physical overlays that are placed on top of the screen, providing tactile information and constraining input to only specific locations [1,4,6,7].”
Background
Research works printed but not linked: 1
- Landua , S. and Wells , L . 2003. Merging Tactile Sensory Input and Audio Data by Means of The Talking Tactile Tablet . In Proc. of Eurohaptics (vol.3). Landua, S. and Wells, L. 2003. Merging Tactile Sensory Input and Audio Data by Means of The Talking Tactile Tablet. In Proc. of Eurohaptics (vol.3).
Cited by
Editing spatial layouts through tactile templates for people with visual impairments.
Li, J., Kim, S., Miele, J. A., Agrawala, M., & Follmer, S. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300436 · Cited by 62
“To address this issue, researchers have created authoring tools that range from generating tactile overlays of graphics [17] and data visualizations [10], to picture books [22] and annotated 3D models [42].”
BackgroundLi, F. M., Dorst, J., Cederberg, P., & Carrington, P. (2021) · International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS) · doi:10.1145/3441852.3471215 · Cited by 61
“[1, 8], and 3D printed tactile marking [18, 22] to better support people with visual impairments interacting with different interfaces.”
BackgroundLi, F. M., Spektor, F., Xia, M., Huh, M., Cederberg, P., Gong, Y., Shinohara, K., & Carrington, P. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3517490 · Cited by 56
MAIDR: Making Statistical Visualizations Accessible with Multimodal Data Representation
Seo, J., Xia, Y., Lee, B., McCurry, S., & Yam, Y. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642730 · Cited by 52
“…some researchers pioneered static 3d-printed or embossed tactile graphics overlay to touchscreen device to produce audio-tactile graphics [22, 25], no study has yet addressed refreshable, interactive, and automatic tactile representation methods using blind users’ computer access technology…”
BackgroundMethodTADA: Making Node-link Diagrams Accessible to Blind and Low-Vision People
Zhao, Y., Nacenta, M. A., Sukhai, M. A., & Somanath, S. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642222 · Cited by 47
“PantoGuide enhances static tactile graphics like charts with audio and a hand-mounted sys-tem, providing extra tactile information, such as the direction of a search target based on finger location.”
BackgroundZhang, X., Tran, T., Sun, Y., Culhane, I., Jain, S., Fogarty, J., & Mankoff, J. (2018) · ASSETS '18 · doi:10.1145/3234695.3236349 · Cited by 30
“accessibility [4,13,20], but previous approaches have either required relatively expensive customization [6], had limited compatibility across multiple apps [15,22,29], consisted of many hardware components that were difficult to organize or carry [4], or not focused on mobile systems [4,20].”
BackgroundAutomated Repair of Size-Based Inaccessibility Issues in Mobile Applications
Alotaibi, A. S., Chiou, P., & Halfond, W. G. J. (2021) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1109/ase51524.2021.9678625 · Cited by 41
“Similar hardware overlay techniques [18], [19], [20] have been proposed in HCI research but they do not fix the underlying issues and require the hardware cutouts to be tailored to fit the devices.”
BackgroundNagassa, R. G., Butler, M., Holloway, L. M., Goncu, C., & Marriott, K. (2023) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581389 · Cited by 34
He, L., Wang, R., & Xu, X. (2020) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3334480.3383095 · Cited by 23
“…[8, 30, 31], as well as tactile and haptic feedback, such as physical and vibro-motor [14, 26], mechanical tactor [5, 13, 15,16], electrical muscle stimulation (EMS) [22, 23, 27], shape memory alloy (SMA) [12], pneumatic [3, 10, 32], 3D-printed tactile cues [18, 11], and thermal haptic [24].”
BackgroundSelf-citationA Recipe for Success? Exploring Strategies for Improving Non-Visual Access to Cooking Instructions
Li, F. M., Wang, A., Carrington, P., & Kane, S. K. (2024) · International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS) · doi:10.1145/3663548.3675662 · Cited by 18
TacNote: Tactile and Audio Note-Taking for Non-Visual Access
Lee, W.-C., Hung, C.-W., Ting, C.-H., Chi, P., & Chen, B. (2023) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/3586183.3606784 · Cited by 12
Clepper, G., McDonnell, E. J., Findlater, L., & Peek, N. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3714173 · Cited by 13
Self-citationAvila, M., Kiss, F., Rodríguez, I., Schmidt, A., & Machulla, T. (2018) · International Conference on PErvasive Technologies Related to Assistive Environments (PETRA) · doi:10.1145/3197768.3201530 · Cited by 8
Data Visualization Accessibility for Blind and Low Vision Audiences
Keilers, C., Tigwell, G. W., & Peiris, R. L. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-35681-0_26 · Cited by 10
More than One Step at a Time: Designing Procedural Feedback for Non-visual Makeup Routines
Li, F. M., Oharazawa, A., Zhu, C. Q., Fan, M., Sato, D., Asakawa, C., & Carrington, P. (2025) · International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS) · doi:10.1145/3663547.3746366 · Cited by 7
“Physical and tactile design strategies—including 3D-printed aug-mentations and tactile overlays for touchscreen devices—have also been developed to provide non-visual ways of interacting with tools and information [21, 22].”
Active PinScreen: Exploring Spatio-Temporal Tactile Feedbackfor Multi-Finger Interaction
Zhang, C., Sahoo, D. R., Pearson, J. S., Robinson, S., Holton, M. D., Hopkins, P., & Jones, M. (2020) · International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI) · doi:10.1145/3379503.3403531 · Cited by 10
“TacTILE [16], for example, proposed a novel tool for creating these overlays for arbitrary graphics (e.g., graphs, pictures, maps).”
MethodFabrication, 3D Printing, and Making
Hurst, A. K. (2019) · Human-computer interaction series · doi:10.1007/978-1-4471-7440-0_38 · Cited by 6
Ramôa, G., Schmidt, V., Schwarz, T., Stiefelhagen, R., & König, P. (2024) · Frontiers in Rehabilitation Sciences · doi:10.3389/fresc.2024.1368983 · Cited by 5
Penuela, R. E. G., Liu, F., MacIntyre, B., & Saffo, D. (2025) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3770654 · Cited by 5
“Researchers have explored several methods for augmenting touchscreen screen readers with physical feedback: embossed or removable overlays [3, 11, 18, 28, 34, 38], vibrotactile output [12, 22, 30, 50], and constrained interaction techniques that limit user actions to specific touch regions [7, 35,…”
A Multi-scale Embossed Map Authoring Tool for Indoor Environments
Trinh, V. Q., & Manduchi, R. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58796-3_53 · Cited by 4
“Regardless of different techniques in producing tactile graphics (i.e., embossing [4,27], audio-tactile pairing [3,6], or 3D printing [8,28]), it is impractical to design a one-size-fits-all tactile map because different users have different needs of tactile feedbacks.”
BackgroundDesigning 3D Printed Audio-Tactile Graphics: Recommendations from Prior Research
Sanches, E. C. P., Bueno, J., & Okimoto, M. L. L. R. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-78092-0_31 · Cited by 5
Haptics for Sensory Substitution
Fakhri, B., & Panchanathan, S. (2019) · Springer eBooks · doi:10.1007/978-3-030-34230-2_4 · Cited by 3
Self-Identifying Tactile Overlays
Avila, M., Voit, A., Hassan, A., Schmidt, A., & Machulla, T. (2018) · International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS) · doi:10.1145/3234695.3241021 · Cited by 2
“While tactile overlays for touch-screen devices have been explored in prior work [1, 2, 3, 6, 9], our main contribution is the self-identification to change the displayed content based on the applied overlay automatically.”
BackgroundEmpowering Autonomy and Agency: Exploring and Augmenting Accessible Cyber-Physical Systems
Li, F. M., & Carrington, P. (2023) · ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp) · doi:10.1145/3594739.3610770 · Cited by 1
“For example, prior research also explored using computer vision [9, 11, 23, 27], voice interactions [4, 8], and 3D printed tactile marking [12, 13] to better support people with visual impairments interacting with different physical interfaces.”
BackgroundRuntime Repair and Enhancement of Mobile App Accessibility
Zhang, X. (2019) · ResearchWorks at the University of Washington (University of Washington)
Tangible Web Layout Design For Blind And Visually Impaired People
Shetty, A. (2020) · University Libraries (University of Maryland) · doi:10.13016/hyhd-pfuk · Cited by 1
Designing Layout-Agnostic Stencils to Minimize Visual Distraction in In-Vehicle Touchscreens
Soomro, S., & Abro, A. (2025) · International Conference on Software and Computer Applications (ICSCA) · doi:10.1145/3731806.3731815
Py maidr: Bridging Visual and Non-Visual Data Experiences Through a Unified Python FrameworkPreprint
Seo, J., Venkatesh, S., Pokar, D., Kamath, S. S., & Ganesan, K. A. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2509.13532
“Previous attempts addressed this issue with non-visual data representations, such as alt text and verbal descriptions [6, 7, 20, 23], data sonification [3,13,16,17,31,34], audio-tactile graphs [8,11,12], and more recently with cross-modality approaches [28, 35].”
Hassan, S., Khalaila, A., Cashman, D., Sharif, A., & Faust, R. (2026) · International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS) · doi:10.1145/3797867.3829030
Metadata
- Authors
- He, L., Wan, Z., Findlater, L., & Froehlich, J. E.
- Affiliations
- University of Washington (US)
- University of Maryland, College Park (US)
- Venue
- Proceedings of the 19th International ACM SIGACCESS Conference on Computers and Accessibility
- Publisher
- ACM
- Published
- 2017-10-19
- Pages
- 397-398
- OpenAlex
- W2765155778
- Semantic Scholar
- a4e3fa4a1eb2de08bbb23d2574e23ec2bff3462a
- Cited by
- 26
- References
- 6
- Citations by year
- 2026: 1 · 2025: 3 · 2024: 4 · 2023: 4 · 2022: 1 · 2021: 3 · 2020: 3 · 2019: 4 · 2018: 3
- FWCI
- 4.47
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS) (publishedVersion)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Tactile and Sensory Interactions
- Social Sciences › Human Factors and Ergonomics › Digital Accessibility for Disabilities
- Health Sciences › Health Professions › Occupational Therapy › Assistive Technology in Communication and Mobility
- Keywords
- audio annotation, blind users, 3D printing, tactile graphics, annotation tools, assistive technology
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.