CoChat

Developing Dynamic Audio Navigation UIs to Pinpoint Elements in Tactile Graphics

Open access
Ramôa, Gaspar, Schmidt, Vincent, König, Peter · 2022 · Multimodal Technologies and Interaction

The DOI matches its Crossref record; 39 of the 39 references it cites were found in a registry or an index.

Abstract

Access to complex graphical information is essential when connecting blind and visually impaired (BVI) people with the world. Tactile graphics readers enable access to graphical data through audio-tactile user interfaces (UIs), but these have yet to mature. A challenging task for blind people is locating specific elements–areas in detailed tactile graphics. To this end, we developed three audio navigation UIs that dynamically guide the user’s hand to a specific position using audio feedback. One is based on submarine sonar sounds, another relies on the target’s coordinate plan x and y-axis, and the last uses direct voice instructions. The UIs were implemented in the Tactonom Reader device, a new tactile graphic reader that enhances swell paper graphics with pinpointed audio explanations. To evaluate the effectiveness of the three different dynamic navigation UIs, we conducted a within-subject usability test that involved 13 BVI participants. Beyond comparing the effectiveness of the different UIs, we observed and recorded the interaction of the visually impaired participants with the different navigation UI to further investigate their behavioral patterns during the interaction. We observed that user interfaces that required the user to move their hand in a straight direction were more likely to provoke frustration and were often perceived as challenging for blind and visually impaired people. The analysis revealed that the voice-based navigation UI guides the participant the fastest to the target and does not require prior training. This suggests that a voice-based navigation strategy is a promising approach for designing an accessible user interface for the blind.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.3390/mti6120113

Cites

39 of 39 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

2 more claims about this paper

Create a free account to see every claim other papers make about this one.

See all claims — free account

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 39 references

Research works printed but not linked: 4

  1. 2022, Classification of 2D refreshable tactile user interfaces, Assist. Technol. Access. Incl. ICCHP AAATE, 1, 186
  2. Poppinga, B., Magnusson, C., Pielot, M., and Rassmus-Gröhn, K. (September, January 30). TouchOver Map: Audio-Tactile Exploration of Interactive Maps. Proceedings of the 13th International Conference on Human Computer Interaction with Mobile Devices and Services, Stockholm, Sweden.
  3. He, L., Wan, Z., Findlater, L., and Froehlich, J.E. (November, January 20). TacTILE: A Preliminary Toolchain for Creating Accessible Graphics with 3D-Printed Overlays and Auditory Annotations. Proceedings of the 19th International ACM SIGACCESS Conference on Computers and Accessibility, Baltimore, MD, USA.
  4. Yang, 2016, Graille: Design research of graphical tactile display for the visually impaired, Decorate, 1, 94

Cited by

See all 14

Metadata

Authors
Ramôa, G., Schmidt, V., & König, P.
Affiliations
  • Karlsruhe Institute of Technology (DE)
  • Osnabrück University (DE)
  • Institute of Cognitive Science, Osnabrück University, 49090 Osnabrück, Germany
Corresponding author
Ramôa, Gaspar
Venue
Multimodal Technologies and Interaction
Publisher
MDPI AG
Published
2022-12-18
Volume
6
Issue
12
Pages
113
ISSN
2414-4088 (ISSN-L)
OpenAlex
W4313405271
Cited by
14
References
39
Citations by year
2026: 4 · 2025: 3 · 2024: 3 · 2023: 4
FWCI
1.29
Type
journal article
Language
en
Open access
Locations
  • Multimodal Technologies and Interaction (publishedVersion, cc-by)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
Funders
European Union’s Horizon 2020 (861166)
Topics
  • Life Sciences › Neuroscience › Cognitive Neuroscience › Tactile and Sensory Interactions
  • Social Sciences › Human Factors and Ergonomics › Digital Accessibility for Disabilities
  • Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
Keywords
tactile graphics, audio navigation, blind and visually impaired users, assistive technology, voice-based navigation, accessibility, usability evaluation, user frustration

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Developing Dynamic Audio Navigation UIs to Pinpoint Elements in Tactile Graphics. https://app.cochat.ai/papers/10.3390/mti6120113
The paper
Ramôa, G., Schmidt, V., & König, P. (2022). Developing Dynamic Audio Navigation UIs to Pinpoint Elements in Tactile Graphics. Multimodal Technologies and Interaction. https://doi.org/10.3390/mti6120113

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.