Pantoguide: a haptic and audio guidance system to support tactile graphics exploration.
The DOI matches its Crossref record; 28 of the 28 references it cites were found in a registry or an index.
Abstract
The ability to effectively read and interpret tactile graphics and charts is an essential part of a tactile learner’s path to literacy, but is a skill that requires instruction and training. Many teachers of the visual impaired (TVIs) report that blind and visually impaired students have trouble interpreting graphics independently without individual instruction. We present PantoGuide, a low-cost system that provides audio and haptic guidance, via skin-stretch feedback to the dorsum of a user’s hand while the user explores a tactile graphic overlaid on a touchscreen. This system allows programming of haptic guidance patterns and cues for tactile graphics that can be experienced by students learning remotely or that can be reviewed by a student independently. We propose two teaching scenarios (synchronous and asynchronous) and two guidance interactions (point-to-point and continuous) that the device can support – and demonstrate their use in a set of applications we co-design with one co-author who is blind and a tactile graphics user.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Design and Evaluation of a Wearable Skin Stretch Device for Haptic Guidance
Chinello, F., Pacchierotti, C., Bimbo, J., Tsagarakis, N. G., & Prattichizzo, D. (2017) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2017.2766244 · Cited by 101 · cited 1×
“While there are many types of haptic feedback, skin-stretch has been used in devices to provide precise directional guidance [5, 15, 24, 25].”
BackgroundThe Tactile Graphics Helper: Providing Audio Clarification for Tactile Graphics Using Machine Vision
Fusco, G., & Morash, V. S. (2015) · Proceedings of the 17th International ACM SIGACCESS Conference on Computers & Accessibility - ASSETS '15 · doi:10.1145/2700648.2809868 · Cited by 91
The Pantograph Mk-II: A Haptic Instrument
Campion, G. (2005) · Springer series on touch and haptic systems · doi:10.1007/978-0-85729-576-7_3 · Cited by 91
Comparing two haptic interfaces for multimodal graph rendering
Yu, W., & Brewster, S. (2003) · Proceedings 10th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. HAPTICS 2002 · doi:10.1109/haptic.2002.998934 · Cited by 83 · cited 1×
“While audio is an efective tool for communicating details on-demand and contextual annotations, it is less efective for guidance especially when trying to move a user’s attention to specifc areas of interest [26, 27].”
MethodA remote guidance system for blind and visually impaired people via vibrotactile haptic feedback
Scheggi, S., Talarico, A., & Prattichizzo, D. (2014) · 22nd Mediterranean Conference on Control and Automation · doi:10.1109/med.2014.6961320 · Cited by 73
Beal, C. R., & Rosenblum, L. P. (2018) · Journal of Visual Impairment & Blindness · doi:10.1177/0145482x1811200102 · Cited by 64
Melfi, G., Müller, K., Schwarz, T., Jaworek, G., & Stiefelhagen, R. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376508 · Cited by 63
Editing spatial layouts through tactile templates for people with visual impairments.
Li, J., Kim, S., Miele, J. A., Agrawala, M., & Follmer, S. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300436 · Cited by 62
Self-citationTactile graphics with a voice: using QR codes to access text in tactile graphics
Baker, C. M., Milne, L. R., Scofield, J., Bennett, C. L., & Ladner, R. E. (2014) · Proceedings of the 16th international ACM SIGACCESS conference on Computers & accessibility - ASSETS '14 · doi:10.1145/2661334.2661366 · Cited by 51 · cited 1×
“Prior work has explored methods for BVI users to obtain spatially relevant feedback about tactile graphics through audio augmented interfaces [2, 6, 9–11 , 21].”
MethodRosenblum, L. P., Cheng, L., & Beal, C. R. (2018) · Journal of Visual Impairment & Blindness · doi:10.1177/0145482x1811200505 · Cited by 49 · cited 2×
“This process requires one-on-one instruction to provide feedback by moving a student’s hand, tracing along paths, or ofering individualized verbal encouragement and guidance [6, 14, 17].”
BackgroundResultZebehazy, K. T., & Wilton, A. P. (2014) · Journal of Visual Impairment & Blindness · doi:10.1177/0145482x1410800102 · Cited by 44 · cited 2×
“TVIs need to help students develop interpretation competency [29].”
BackgroundFluxMarker: Enhancing Tactile Graphics with Dynamic Tactile Markers
Suzuki, R., Stangl, A., Gross, M. D., & Yeh, T. (2017) · Proceedings of the 19th International ACM SIGACCESS Conference on Computers and Accessibility · doi:10.1145/3132525.3132548 · Cited by 43
Spiers, A. J., & Dollar, A. M. (2016) · IEEE Haptics Symposium · doi:10.1109/haptics.2016.7463152 · Cited by 41
Rekimoto, J. (2014) · ACM SIGGRAPH Emerging Technologies · doi:10.1145/2614066.2614079 · Cited by 39
Abu Doush, I., Pontelli, E., Son, T. C., Simon, D., & Ma, O. (2010) · ACM Transactions on Accessible Computing · doi:10.1145/1857920.1857925 · Cited by 37
Supporting Elementary School Students with Visual Impairments in Science Classes
Rosenblum, L. P., Ristvey, J., & Hospitál, L. (2019) · Journal of Visual Impairment & Blindness · doi:10.1177/0145482x19833801 · Cited by 31 · cited 1×
“Teachers report an important aspect of tactile literacy is encouraging students to adopt a systematic approach to exploring and reading a graphic [19].”
BackgroundZebehazy, K. T., & Wilton, A. P. (2014) · Journal of Visual Impairment & Blindness · doi:10.1177/0145482x1410800402 · Cited by 29 · cited 1×
“Teachers of students with visual impairments (TVIs) have also noted that their students are not always able to use the graphics independently and rely on individualized instruction [28].”
BackgroundFingersight: Fingertip haptic sensing of the visual environment
Horvath, S., Galeotti, J., Wu, B., Klatzky, R., Siegel, M., & Stetten, G. (2014) · IEEE Journal of Translational Engineering in Health and Medicine · doi:10.1109/jtehm.2014.2309343 · Cited by 28
Shen, H., Edwards, O., Miele, J., & Coughlan, J. M. (2013) · Proceedings of the 15th International ACM SIGACCESS Conference on Computers and Accessibility · doi:10.1145/2513383.2513423 · Cited by 28
Planar Hand Motion Guidance Using Fingertip Skin-Stretch Feedback
Norman, S. L., Doxon, A. J., Gleeson, B. T., & Provancher, W. R. (2014) · IEEE Transactions on Haptics · doi:10.1109/toh.2013.2296306 · Cited by 28
Holdable haptic device for 4-dof motion guidance.
Walker, J. M., Zemiti, N., Poignet, P., & Okamura, A. M. (2019) · 2019 IEEE World Haptics Conference (WHC) · doi:10.1109/whc.2019.8816171 · Cited by 28 · cited 1×
“While there are many types of haptic feedback, skin-stretch has been used in devices to provide precise directional guidance [5, 15, 24, 25].”
BackgroundExploring computer-generated line graphs through virtual touch
Yu, W., Ramloll, R., Brewster, S., & Ridel, B. (2002) · Proceedings of the Sixth International Symposium on Signal Processing and its Applications (Cat.No.01EX467) · doi:10.1109/isspa.2001.949778 · Cited by 26 · cited 1×
“While audio is an efective tool for communicating details on-demand and contextual annotations, it is less efective for guidance especially when trying to move a user’s attention to specifc areas of interest [26, 27].”
MethodHaptic-Assisted Guidance System for Navigating Volumetric Data Sets
Mendez, E., Yoshida, S., Noma, H., Lindeman, R. W., YANAGIDA, Y., Masaki, S., & Hosaka, K. (2005) · IEEE World Haptics Conference (WHC) · doi:10.1109/whc.2005.70 · Cited by 16
Using the Talking Tactile Tablet as a Testing Accommodation
Landau, S., Russell, M., & Erin, J. N. (2007) · RE view Rehabilitation and Education for Blindness and Visual Impairment · doi:10.3200/revu.38.1.7-21 · Cited by 14 · cited 1×
“Prior work has explored methods for BVI users to obtain spatially relevant feedback about tactile graphics through audio augmented interfaces [2, 6, 9–11 , 21].”
MethodExploring the Design of Audio-Kinetic Graphics for Education
Muehlbradt, A., Atreya, M., Guinness, D., & Kane, S. K. (2018) · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION · doi:10.1145/3242969.3243004 · Cited by 10 · cited 2×
“This process requires one-on-one instruction to provide feedback by moving a student’s hand, tracing along paths, or ofering individualized verbal encouragement and guidance [6, 14, 17].”
BackgroundResultThe Synthesis of Three Dimensional Haptic Textures: Geometry, Control, and Psychophysics
Campion, G. (2011) · Springer series on touch and haptic systems · doi:10.1007/978-0-85729-576-7 · Cited by 9 · cited 2×
“The haptic device consists of a pantograph (a mechanism commonly used for providing two-dimensional haptic feedback [4]) with a rounded tactor (1.”
MethodRosenblum, L. P., Cheng, L., Zebehazy, K. T., Emerson, R. W., & Beal, C. R. (2020) · Journal of Visual Impairment & Blindness · doi:10.1177/0145482x20923442 · Cited by 9 · cited 1×
“Recent studies have found that BVI students struggle to work with tactile graphics [3, 13, 18].”
BackgroundThe Relationship between Tactile Graphics and Mathematics for Students with Visual Impairments
Morash, V. S. (2014) · Cited by 7
Research works printed but not linked: 1
- Vibol Yem, Mai Otsuki, and Hideaki Kuzuoka. 2015. Development of wearable outer-covering haptic display using ball effector for hand motion guidance. In Haptic Interaction. Springer, 85–89.
Cited by
Mukhiddinov, M., & Kim, S.-Y. (2021) · Processes · doi:10.3390/pr9101726 · Cited by 110
“Audio feedback support [21,51,52,61,64] [67,68,70,72–74]”
BackgroundInfluentialUnderstanding Visual Arts Experiences of Blind People
Li, F. M., Zhang, L., Bandukda, M., Stangl, A. J., Shinohara, K., Findlater, L., & Carrington, P. (2023) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3580941 · Cited by 92
“Past HCI and accessibility research has explored technology-based approaches to lower these access barriers, including museum navigation support [9, 44, 52], audio descriptions [17], tactile graphics [88], multimodal feedback [28], and virtual art tours through smart devices [2].”
BackgroundAdvancements in Smart Wearable Mobility Aids for Visual Impairments: A Bibliometric Narrative Review
Zhang, X., Huang, X., Ding, Y., Long, L., Li, W., & Xu, X. (2024) · Sensors · doi:10.3390/s24247986 · Cited by 59
“Sensors 2024 , 24 , 14 of 28 Sensors 2024 , 24 , 14 of 28 Sensors 2024 , 24 , 14 of 28 providing audio and haptic guidance for a user via skin stretch feedback, enabling them to explore haptic graphics on a touchscreen [36].”
Jain, G., Teng, Y., Cho, D. H., Xing, Y., Aziz, M., & Smith, B. A. (2023) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3579496 · Cited by 44
“In line with recent trends in accessibility research [12, 18, 27, 64, 95, 113], we found it crucial that VIPs are represented in research not only as study participants but also as co-interpreters of the data.”
BackgroundTADA: Making Node-link Diagrams Accessible to Blind and Low-Vision People
Zhao, Y., Nacenta, M. A., Sukhai, M. A., & Somanath, S. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642222 · Cited by 46
“Linespace [99] and PantoGuide [27] are hardware-intensive tactile technologies.”
Metadata
- Authors
- Chase, E. D. Z., Siu, A. F., Boadi-Agyemang, A., Kim, G. S.-H., Gonzalez, E. J., & Follmer, S.
- Affiliations
- Stanford University (US)
- ORCID
- Venue
- Proceedings of the 22nd International ACM SIGACCESS Conference on Computers and Accessibility
- Publisher
- ACM
- Published
- 2020-10-26
- Pages
- 1-4
- OpenAlex
- W3095603356
- Cited by
- 25
- References
- 28
- Citations by year
- 2026: 5 · 2025: 5 · 2024: 9 · 2023: 4 · 2022: 1 · 2021: 1
- FWCI
- 1.95
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS) (publishedVersion)
- Funders
- NSF GRFP (DGE-1656518)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Tactile and Sensory Interactions
- Social Sciences › Human Factors and Ergonomics › Digital Accessibility for Disabilities
- Health Sciences › Health Professions › Occupational Therapy › Assistive Technology in Communication and Mobility
- Keywords
- tactile graphics, haptic guidance, auditory guidance, blind and visually impaired students, distance education, low-cost assistive technology
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.