Learning non-visual graphical information using a touch-based vibro-audio interface
The DOI matches its Crossref record; 26 of the 26 references it cites were found in a registry or an index.
Abstract
This paper evaluates an inexpensive and intuitive approach for providing non-visual access to graphic material, called a vibro-audio interface. The system works by allowing users to freely explore graphical information on the touchscreen of a commercially available tablet and synchronously triggering vibration patterns and auditory information whenever an on-screen visual element is touched. Three studies were conducted that assessed legibility and comprehension of the relative relations and global structure of a bar graph (Exp 1), Pattern recognition via a letter identification task (Exp 2), and orientation discrimination of geometric shapes (Exp 3). Performance with the touch-based device was compared to the same tasks performed using standard hardcopy tactile graphics. Results showed similar error performance between modes for all measures, indicating that the vibro-audio interface is a viable multimodal solution for providing access to dynamic visual information and supporting accurate spatial learning and the development of mental representations of graphical material.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“recent investigations have demonstrated that vibrations are effective in representing maps [59] and building floor plans [22], accurately perceiving and following lines and graphs [23,55,73], representing graphical shapes [24,72], and representing simple graphic entities [30].”
From Design Guidelines and Recommendations for Multimodal, Touchscreen-based Graphics (2020) · cites this paper as [23]
In the citing paper
“These vibrations provide robust focal stimulation to the finger, leading to the perception of feeling tactile points, lines, and regions on the touchscreen (Giudice et al., 2012).”
From Cognitive Mapping Without Vision: Comparing Wayfinding Performance After Learning From Digital Touchscreen-Based Multimodal Maps vs. Embossed Tactile Overlays (2020) · cites this paper as Giudice et al., 2012
In the citing paper
“As traditional tactile maps do not generally use (or need) additional cues to indicate vertices or intersections, as has been found for VAMs (Giudice et al., 2012), they were not included on the HTM-based HIM.”
From Cognitive Mapping Without Vision: Comparing Wayfinding Performance After Learning From Digital Touchscreen-Based Multimodal Maps vs. Embossed Tactile Overlays (2020) · cites this paper as Giudice et al., 2012
In the citing paper
“Use of pulsing to differentiate map/graphical elements and to draw the user’s attention to that location has been found to be important for information extraction and interpretation using vibrotactile stimuli in other studies using similar non-visual touchscreen interfaces (Giudice et al., 2012; Klatzky et al., 2014).”
From Cognitive Mapping Without Vision: Comparing Wayfinding Performance After Learning From Digital Touchscreen-Based Multimodal Maps vs. Embossed Tactile Overlays (2020) · cites this paper as Giudice et al., 2012
In the citing paper
“Thus, it is likely that the DIM requires increased learning time as compared to the HIM”
From Cognitive Mapping Without Vision: Comparing Wayfinding Performance After Learning From Digital Touchscreen-Based Multimodal Maps vs. Embossed Tactile Overlays (2020) · cites this paper as Giudice et al., 2012
Citations
Cites
Investigating the effectiveness of tactile feedback for mobile touchscreens
Hoggan, E., Brewster, S. A., & Johnston, J. (2008) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1357054.1357300 · Cited by 443 · cited 1×
“Much of the empirical research on accessible graphical displays, auditory or haptic, has focused on design guidelines and user preferences of the interface [12, 13], psychophysical factors characterizing optimal display properties to be implemented or the nature of the perceptual mapping employed [19], or interpretati…”
BackgroundOptical-to-Tactile Image Conversion for the Blind
Bliss, J., Katcher, M., Rogers, C., & Shepard, R. (1970) · IEEE Transactions on Man Machine Systems · doi:10.1109/tmms.1970.299963 · Cited by 306 · cited 1×
“letter recognition and limited reading [1].”
Blind Navigation and the Role of Technology
Giudice, N. A., & Legge, G. E. (2008) · The Engineering Handbook of Smart Technology for Aging, Disability, and Independence · doi:10.1002/9780470379424.ch25 · Cited by 232 · cited 1×
“, the optacon) which took well over 100 hours [6].”
BackgroundSelf-citationSemFeel: a user interface with semantic tactile feedback for mobile touch-screen devices
Yatani, K., & Truong, K. N. (2009) · Proceedings of the 22nd annual ACM symposium on User interface software and technology · doi:10.1145/1622176.1622198 · Cited by 164
Haptic Interaction Design for Everyday Interfaces
MacLean, K. E. (2008) · Reviews of Human Factors and Ergonomics · doi:10.1518/155723408x342826 · Cited by 145 · cited 1×
“Much of the empirical research on accessible graphical displays, auditory or haptic, has focused on design guidelines and user preferences of the interface [12, 13], psychophysical factors characterizing optimal display properties to be implemented or the nature of the perceptual mapping employed [19], or interpretati…”
BackgroundMagnitude estimation of conceptual data dimensions for use in sonification.
Walker, B. N. (2002) · Journal of Experimental Psychology: Applied · doi:10.1037//1076-898x.8.4.211 · Cited by 139 · cited 2×
“Much of the empirical research on accessible graphical displays, auditory or haptic, has focused on design guidelines and user preferences of the interface [12, 13], psychophysical factors characterizing optimal display properties to be implemented or the nature of the perceptual mapping employed [19], or interpretati…”
BackgroundEvaluation of multimodal graphs for blind people
Yu, W., & Brewster, S. (2003) · Universal Access in the Information Society · doi:10.1007/s10209-002-0042-6 · Cited by 120 · cited 1×
“These non-visual interfaces can be broadly classified into audiobased [20], haptic-based [24], language-based [4], or multimodal interfaces [25].”
BackgroundGravvitas: generic multi-touch presentation of accessible graphics
Goncu, C., & Marriott, K. (2011) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-23774-4_5 · Cited by 112 · cited 2×
“Similarly, the GraVVITAS project demonstrated that graphs, shapes, and maps could be understood by blind users when learned from a touch tablet with external vibrators affixed to the user’s fingers [7].”
BackgroundTimbremap: enabling the visually-impaired to use maps on touch-enabled devices
Su, J., Rosenzweig, A., Goel, A., de Lara, E., & Truong, K. N. (2010) · Proceedings of the 12th international conference on Human computer interaction with mobile devices and services · doi:10.1145/1851600.1851606 · Cited by 104 · cited 1×
“representing complex indoor layouts on a touchscreen equipped smartphone [18] and the PLUMB project, which uses sonification”
MethodPoppinga (2011) · doi:10.1145/2037373.2037458 · Cited by 102 · cited 2×
“An example of the former approach is TouchOver map, which showed that blindfolded-sighted participants could understand a road network through vibration and auditory labels when feeling a smartphone touchscreen, and then were able to accurately reproduce the map using vision while simultaneously exploring the now occl…”
Background
Research works printed but not linked: 6
- GIUDICE N.A., The Engineering Handbook of Smart Technology for Aging, Disability, and Independence, A. HELAL, M. MOKHTARI and B. ABDULRAZAK (Eds)
- 10.5555/2042053.2042060 · doi:10.5555/2042053.2042060
- LOOMIS J.M., Multisensory Imagery:Theory & Applications, S. LACEY and R. LAWSON (Eds)
- MACLEAN K.E., Reviews of Human Factors and Ergonomics, M. CARSWELL (Ed)
- NEES M.A., The Universal Access Handbook, C. STEPHANIDIS (Ed)
- 10.1037/1076-898x.8.4.211 · DOI
Cited by
Interactivity improves usability of geographic maps for visually impaired people
Brock, A. M., Truillet, P., Oriola, B., Picard, D., & Jouffrais, C. (2015) · Human–Computer Interaction · doi:10.1080/07370024.2014.924412 · Cited by 195
Accessible Visualization: Design Space, Opportunities, and Challenges
Kim, N. W., Joyner, S. C., Riegelhuth, A., & Kim, Y. (2021) · Computer Graphics Forum · doi:10.1111/cgf.14298 · Cited by 137
Accessible Interactive Maps for Visually Impaired Users
Ducasse, J., Brock, A. M., & Jouffrais, C. (2018) · Mobility of Visually Impaired People · doi:10.1007/978-3-319-54446-5_17 · Cited by 111
“Giudice et al. (2012) combined gestural input with audio and vibratory feedbacks.”
BackgroundO'Modhrain, S., Giudice, N. A., Gardner, J. A., & Legge, G. E. (2015) · IEEE Transactions on Haptics · doi:10.1109/toh.2015.2466231 · Cited by 100
“displays also add vibrotactile or electrostatic output, such as the vibro-audio interface for accessing graphs and maps ([28], [56]) or the electrostatic TeslaTouch display [30].”
BackgroundSelf-citationMilne, L. R., & Ladner, R. E. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3173643 · Cited by 87
“[4] used a vibro-audio interface on a tablet to help participants with visual impairments explore simple on-screen elements.”
Method
Metadata
- Authors
- Giudice, N. A., Palani, H. P., Brenner, E., & Kramer, K. M.
- Affiliations
- University of Maine (US)
- Advanced Medical Electronics (United States) (US)
- Venue
- Proceedings of the 14th international ACM SIGACCESS conference on Computers and accessibility
- Publisher
- ACM
- Published
- 2012-10-22
- Pages
- 103-110
- OpenAlex
- W2065710951
- Cited by
- 133
- References
- 26
- Citations by year
- 2026: 4 · 2025: 10 · 2024: 12 · 2023: 15 · 2022: 8 · 2021: 13 · 2020: 7 · 2019: 11 · 2018: 5 · 2017: 11 · 2016: 11 · 2015: 10 · 2014: 10 · 2013: 6
- FWCI
- 16.11
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS) (publishedVersion)
- Funders
- National Science Foundation
- National Institute on Disability and Rehabilitation Research
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Tactile and Sensory Interactions
- Social Sciences › Human Factors and Ergonomics › Digital Accessibility for Disabilities
- Physical Sciences › Computer Science › Computer Graphics and Computer-Aided Design › Data Visualization and Analytics
- Keywords
- tactile graphics, touch interaction, tablet computers, vibration feedback, auditory feedback, bar charts, pattern recognition, letter recognition, orientation discrimination, geometric figures, spatial learning, mental representation, accessibility for visually impaired users
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Learning non-visual graphical information using a touch-based vibro-audio interface. https://app.cochat.ai/papers/10.1145/2384916.2384935
- The paper
- Giudice, N. A., Palani, H. P., Brenner, E., & Kramer, K. M. (2012). Learning non-visual graphical information using a touch-based vibro-audio interface. Proceedings of the 14th international ACM SIGACCESS conference on Computers and accessibility. https://doi.org/10.1145/2384916.2384935
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.