The Tactile Graphics Helper: Providing Audio Clarification for Tactile Graphics Using Machine Vision
The DOI matches its Crossref record, with a small difference in title or year; 32 of the 34 references it cites were found in a registry or an index.
Abstract
Tactile graphics use raised lines, textures, and elevations to provide individuals with visual impairments access to graphical materials through touch. Tactile graphics are particularly important for students in science, technology, engineering, and mathematics (STEM) fields, where educational content is often conveyed using diagrams and charts. However, providing a student who has a visual impairment with a tactile graphic does not automatically provide the student access to the graphic's educational content. Instead, the student may struggle to decipher subtle differences between textures or line styles, and must deal with cramped and confusing placement of lines and braille. These format-related issues prevent students with visual impairments from accessing educational content in graphics independently, because they necessitate the students ask for sighted clarification. We propose a machine-vision based "tactile graphics helper" (TGH), which tracks a student's fingers as he/she explores a tactile graphic, and allows the student to gain clarifying audio information about the tactile graphic without sighted assistance. Using an embedded mixed-methods case study with three STEM university students with visual impairments, we confirmed that format-related issues prevent these students from accessing some graphical content independently, and established that TGH provides a promising approach for overcoming tactile-graphic format issues.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“In fact, this method is implemented in other 2D tactile graphic readers (11–18, 20, 23), highlighting its significance in facilitating exploration and providing an overview.”
From SONOICE! a Sonar–Voice dynamic user interface for assisting individuals with blindness and visual impairment in pinpointing elements in 2D tactile readers (2024) · cites this paper as [13]
Citations
Cites
Using thematic analysis in psychology
Braun, V., & Clarke, V. (2006) · Qualitative Research in Psychology · doi:10.1191/1478088706qp063oa · Cited by 194,414
(1984) · Cited by 81,983
A Coefficient of Agreement for Nominal Scales
Cohen, J. (1960) · Educational and Psychological Measurement · doi:10.1177/001316446002000104 · Cited by 42,398 · cited 1×
“Excellent levels of reliability [9] were ob tained (κ = 0.”
BackgroundA Computational Approach to Edge Detection
Canny, J. (1986) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.1986.4767851 · Cited by 30,004 · cited 1×
“TGH locates the graphic by applying an edge de tector [8] to the camera input, and detecting closed convex contours that have lengths within a specified range (the ap proximate size of the graphic).”
MethodDesigning and Conducting Mixed Methods Research
Robinson, P. (2007) · Australian and New Zealand Journal of Public Health · doi:10.1111/j.1753-6405.2007.00096.x · Cited by 23,258
Case study research: Design and methods
McCorcle, M. D., & Bell, E. L. (1986) · Evaluation and Program Planning · doi:10.1016/0149-7189(86)90052-2 · Cited by 5,885
Integrating quantitative and qualitative research: How is it done
Bryman, A. (2006) · Qualitative Research · doi:10.1177/1468794106058877 · Cited by 3,354 · cited 1×
“The mixed-methods aspect of our approach allowed us to triangulate (corroborate) evi dence of format issues and possible uses of TGH, using both qualitative and quantitative data [7].”
MethodFunctions, Graphs, and Graphing: Tasks, Learning, and Teaching
Leinhardt, G., Zaslavsky, O., & Stein, M. K. (1990) · Review of Educational Research · doi:10.3102/00346543060001001 · Cited by 1,103 · cited 1×
“The ability to use graphics provides a “critical moment” in a child’s mathematics and science ed ucation, which accelerates further math and science learning [24].”
BackgroundDesigning and Conducting Mixed Methods Research
Čížek, T. (2009) · DOAJ (DOAJ: Directory of Open Access Journals) · Cited by 722
Science, Technology, Engineering, and Mathematics (STEM) Education: A Primer
Gonzalez, H. B., & Kuenzi, J. J. (2012) · University of North Texas Digital Library (University of North Texas) · Cited by 443
Mapping conceptual to spatial relations in visual reasoning.
Gattis, M., & Holyoak, K. J. (1996) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037//0278-7393.22.1.231 · Cited by 136 · cited 1×
“This is because graphics support reasoning about ab stract concepts that are difficult to grasp directly, such as slope and function [14, 11].”
BackgroundEfficient Background Subtraction and Shadow Removal for Monochromatic Video Sequences
Jung, C. R. (2009) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2009.2012924 · Cited by 131 · cited 1×
“Segmentation is accomplished with the back ground/foreground segmentation algorithm presented in [19], using 20 gray-scale training frames (collected right before the user begins exploring the tactile graphic) to build a dis tribution of the background’s intensity values at each pixel.”
MethodAdvancing participation of blind students in Science, Technology, Engineering, and Math
Beck‐Winchatz, B., & Riccobono, M. A. (2007) · Advances in Space Research · doi:10.1016/j.asr.2007.05.080 · Cited by 116 · cited 1×
“Therefore, lack of access to tactile graphics has been singled out as one of a handful of reasons, including low teacher expectations and lack of blind peers and role models, as a cause for low interest and pursuance of careers in STEM by blind students [4].”
BackgroundJones, M. G., Minogue, J., Oppewal, T., Cook, M., & Broadwell, B. (2006) · Journal of Science Education and Technology · doi:10.1007/s10956-006-9022-6 · Cited by 114 · cited 1×
“Many STEM concepts, such as direction, quan tity, and shape, are taught in ways that rely heavily on visual reference, which poses severe access issues for stu dents with visual impairments unless graphics are presented in tactile form [11, 18].”
BackgroundAutomated tactile graphics translation: in the field
Jayant, C., Renzelmann, M., Wen, D., Krisnandi, S., Ladner, R., & Comden, D. (2007) · Proceedings of the 9th international ACM SIGACCESS conference on Computers and accessibility · doi:10.1145/1296843.1296858 · Cited by 87
Issues and Aids for Teaching Mathematics to the Blind
Dick, T. P., & Kubiak-Becker, E. (1997) · Mathematics Teacher Learning and Teaching PK-12 · doi:10.5951/mt.90.5.0344 · Cited by 71 · cited 1×
“DOI: http://dx.doi.org/10.1145/2700648.2809868.”
InfluentialRegionSpeak: Quick Comprehensive Spatial Descriptions of Complex Images for Blind Users
Zhong, Y., Lasecki, W. S., Brady, E., & Bigham, J. P. (2015) · Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems · doi:10.1145/2702123.2702437 · Cited by 67 · cited 1×
“era, which can be difficult for blind users [31, 20, 37, 36],”
BackgroundAccess lens: a gesture-based screen reader for real-world documents
Kane, S. K., Frey, B., & Wobbrock, J. O. (2013) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/2470654.2470704 · Cited by 63 · cited 1×
“…operation or personaliza tion would allow teachers and students to decide the level of detail and type of information TGH provides, which may depend on the abilities of the student (e.g., low or high tac tile acuity), the educational goal of the graphic, and context (e.g., homework versus test).”
BackgroundStraight from the Source: Perceptions of Students with Visual Impairments about Graphic Use
Zebehazy, K. T., & Wilton, A. P. (2014) · Journal of Visual Impairment & Blindness · doi:10.1177/0145482x1410800403 · Cited by 58 · cited 3×
“bols, which necessitate help from a sighted person and pre vent students from using tactile graphics independently The lines, symbols, textures, and spacing on tactile graphics are not standardized, unlike the specific formatting rules associ content [2, 35].”
BackgroundMethodInfluentialNavigating maps with little or no sight: An audio-tactile approach
Jacobson, D. (1998) · Cited by 57
Tactile graphics with a voice: using QR codes to access text in tactile graphics
Baker, C. M., Milne, L. R., Scofield, J., Bennett, C. L., & Ladner, R. E. (2014) · Proceedings of the 16th international ACM SIGACCESS conference on Computers & accessibility - ASSETS '14 · doi:10.1145/2661334.2661366 · Cited by 51 · cited 1×
“In contrast to the require specialized hardware and/or connection to a com puter, Tactile Graphics with a Voice (TGV) runs on a smart phone and can read information from QR codes placed on tactile graphics [3].”
MethodScientific diagrams made easy with iveotm
Gardner, J. A., & Bulatov, V. (2006) · Lecture Notes in Computer Science · doi:10.1007/11788713_179 · Cited by 49 · cited 1×
“This is despite the inclusion of as much as 93.3% of print graphics in tactile form in braille tran scriptions of secondary (9-12 grade) science and math text books (6.7% of graphics were found to be omitted in the braille transcriptions) [29], and feelings from surveyed stu dents with visual…”
BackgroundInfluentialTactile graphics in school education: perspectives from pupils
Aldrich, F. K., & Sheppard, L. (2001) · British Journal of Visual Impairment · doi:10.1177/026461960101900204 · Cited by 48 · cited 2×
“bols, which necessitate help from a sighted person and pre vent students from using tactile graphics independently The lines, symbols, textures, and spacing on tactile graphics are not standardized, unlike the specific formatting rules associ content [2, 35].”
BackgroundMethodInfluential(2001) · Information technology and disabilities · Cited by 47
Effects of Using Multiple Hands and Fingers on Haptic Performance in Individuals Who are Blind
Morash, V. S., Pensky, A. E. C., Tseng, S. T. W., & Miele, J. A. (2014) · Perception · doi:10.1068/p7712 · Cited by 44
Self-citationReal time object scanning using a mobile phone and cloud-based visual search engine
Zhong, Y., Garrigues, P. J., & Bigham, J. P. (2013) · Proceedings of the 15th International ACM SIGACCESS Conference on Computers and Accessibility · doi:10.1145/2513383.2513443 · Cited by 42 · cited 1×
“era, which can be difficult for blind users [31, 20, 37, 36],”
BackgroundSmith, D. W., & Smothers, S. M. (2012) · Journal of Visual Impairment & Blindness · doi:10.1177/0145482x1210600905 · Cited by 38 · cited 2×
“7% of graphics were found to be omitted in the braille transcriptions) [29], and feelings from surveyed stu dents with visual impairments that tactile graphics are help ful, particularly in math and science [35].”
BackgroundMethodEasySnap: real-time audio feedback for blind photography
White, S., Ji, H., & Bigham, J. P. (2010) · Adjunct proceedings of the 23nd annual ACM symposium on User interface software and technology · doi:10.1145/1866218.1866244 · Cited by 34 · cited 1×
“However, this requires the user to aim a camera, which can be difficult for blind users [31, 20, 37, 36], and use one of their hands to hold the camera, preventing two-handed ex ploration of the tactile graphic, which can be necessary for good performance [26].”
BackgroundZebehazy, K. T., & Wilton, A. P. (2014) · Journal of Visual Impairment & Blindness · doi:10.1177/0145482x1410800402 · Cited by 29
Shen, H., Edwards, O., Miele, J., & Coughlan, J. M. (2013) · Proceedings of the 15th International ACM SIGACCESS Conference on Computers and Accessibility · doi:10.1145/2513383.2513423 · Cited by 28 · cited 1×
“The CamIO system [28] extends the idea of audio-tactile graphics to audio-tactile objects.”
BackgroundKoenig, A. J., & Holbrook, M. C. (2000) · Cited by 24
A Proposal for an Automated Method to Produce Embossed Graphics for Blind Persons
Minatani, K. (2014) · Lecture notes in computer science · doi:10.1007/978-3-319-07440-5_14 · Cited by 3 · cited 1×
“The GUI (Fig %YAML:1.”
Research works printed but not linked: 3
- P. Blenkhorn and D. Evans. A system for reading and producing talking tactile maps and diagrams. In Proceedings of the 9th International Conference on Tecnology and Persons with Disabilities (CSUN), volume 94, pages 16--19, 1994.
- S. Landau, G. Bourquin, J. Miele, and A. Van Schaack. Demonstration of a universally accessible audio-haptic transit map built on a digital pen-based platform. In Proceedings of the 3rd International Workshop on Haptic and Audio Interaction Design, pages 23--24, 2008.
- D. Parkes. Nomad: An audio-tactile tool for the acquisition, use and management of spatially distributed information by visually impaired people. In Proceedings of the 2nd International Symposium on Maps and Graphics for Visually Handicapped People, 1988.
Cited by
Accessible Visualization: Design Space, Opportunities, and Challenges
Kim, N. W., Joyner, S. C., Riegelhuth, A., & Kim, Y. (2021) · Computer Graphics Forum · doi:10.1111/cgf.14298 · Cited by 137
Accessible Interactive Maps for Visually Impaired Users
Ducasse, J., Brock, A. M., & Jouffrais, C. (2018) · Mobility of Visually Impaired People · doi:10.1007/978-3-319-54446-5_17 · Cited by 111
“The Tactile Graphic Helper aimed at allowing visually impaired students to discriminate tactile symbols (texture, Braille labels, etc.) without requiring the help of a sighted person.”
MethodAlbouys-Perrois, J., Laviole, J., Briant, C., & Brock, A. M. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3174203 · Cited by 107
“Some prototypes use a camera and image recognition algorithms to detect touch on raised-line maps [16, 45, 51], digital maps [28], regular visual paper documents [24], 3D printed maps [18] or tangible objects and tactile grids [43].”
BackgroundCho, J. (2021) · Electronics · doi:10.3390/electronics10040470 · Cited by 106
Mukhiddinov, M., & Kim, S.-Y. (2021) · Processes · doi:10.3390/pr9101726 · Cited by 110
Metadata
- Authors
- Fusco, G., & Morash, V. S.
- Affiliations
- Smith-Kettlewell Eye Research Institute (US)
- Venue
- Proceedings of the 17th International ACM SIGACCESS Conference on Computers & Accessibility - ASSETS '15
- Publisher
- ACM Press
- Published
- 2015
- Pages
- 97-106
- OpenAlex
- W2069820904
- Semantic Scholar
- 46ed45d23f5148f3de04228b52cdca4de1fa218a
- Cited by
- 91
- References
- 34
- Citations by year
- 2026: 5 · 2025: 12 · 2024: 13 · 2023: 7 · 2022: 10 · 2021: 10 · 2020: 9 · 2019: 8 · 2018: 3 · 2017: 10 · 2016: 4
- FWCI
- 9.45
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS) (publishedVersion)
- Funders
- The Administration for Community Living's National Institute on Disability, Independent Living and Rehabilitation Research (90RE5008-01-00)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Tactile and Sensory Interactions
- Social Sciences › Human Factors and Ergonomics › Digital Accessibility for Disabilities
- Health Sciences › Health Professions › Occupational Therapy › Assistive Technology in Communication and Mobility
- Keywords
- tactile graphics, visual impairment, finger tracking, machine vision, audio feedback, STEM education, assistive technology, university students
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.