Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 85 of the 85 references it cites were found in a registry or an index; 26 of the 49 sources its claims cite were checked for support.

SONOICE! a Sonar–Voice dynamic user interface for assisting individuals with blindness and visual impairment in pinpointing elements in 2D tactile readers

Open access
Ramôa, Gaspar, Schmidt, Vincent, Schwarz, Thorsten, Stiefelhagen, Rainer, König, Peter · 2024 · Frontiers in Rehabilitation Sciences

Abstract

Pinpointing elements on large tactile surfaces is challenging for individuals with blindness and visual impairment (BVI) seeking to access two-dimensional (2D) information. This is particularly evident when using 2D tactile readers, devices designed to provide 2D information using static tactile representations with audio explanations. Traditional pinpointing methods, such as sighted assistance and trial-and-error, are limited and inefficient, while alternative pinpointing user interfaces (UI) are still emerging and need advancement. To address these limitations, we develop three distinct navigation UIs using a user-centred design approach: Sonar (proximity-radar sonification), Voice (direct clock-system speech instructions), and Sonoice, a new method that combines elements of both. The navigation UIs were incorporated into the Tactonom Reader device to conduct a trial study with ten BVI participants. Our UIs exhibited superior performance and higher user satisfaction than the conventional trial-and-error approach, showcasing scalability to varied assistive technology and their effectiveness regardless of graphic complexity. The innovative Sonoice approach achieved the highest efficiency in pinpointing elements, but user satisfaction was highest with the Sonar approach. Surprisingly, participant preferences varied and did not always align with their most effective strategy, underscoring the importance of accommodating individual user preferences and contextual factors when choosing between the three UIs. While more extensive training may reveal further differences between these UIs, our results emphasise the significance of offering diverse options to meet user needs. Altogether, the results provide valuable insights for improving the functionality of 2D tactile readers, thereby contributing to the future development of accessible technology.

Overview

CoChat Summary

TL;DR

This study developed and tested three audio-based navigation UIs—Sonar, Voice, and Sonoice—on the Tactonom Reader to help blind and visually impaired users pinpoint elements in 2D tactile graphics. All three outperformed trial-and-error in efficiency and satisfaction, but the most efficient method, Sonoice, was not the most preferred; Sonar received the highest satisfaction ratings.

Key findings

  • Mean trial duration was 57.85±8.04 s for trial-and-error, 20.68±8.99 s for Sonar, 17.58±9.50 s for Voice, and 15.48±8.91 s for Sonoice; repeated-measures ANOVA showed a significant difference across strategies, F(3,27)=139.5827, p<0.001. Only 4 of 40 trial-and-error trials (10%) completed within the 60 s limit.
  • Pairwise tests showed trial-and-error was significantly slower than Sonar (t=−12.83, p<0.001), Voice (t=−18.00, p<0.001), and Sonoice (t=−22.78, p<0.001), but no significant differences were found among Sonar, Voice, and Sonoice.
  • NASA-TLX mean scores were 33.67±26.90 for trial-and-error, 5.50±5.95 for Sonar, 10.00±13.45 for Voice, and 8.75±9.21 for Sonoice; among the three UIs, no significant difference was found, F(2,18)=0.394, p=0.983. SUS mean scores were 59.75±36.39, 88.50±13.95, 84.00±17.96, and 83.25±14.67, respectively; among the three UIs, no significant difference was found, F(2,18)=0.780, p=0.473.
  • Sonar was the favourite strategy for 5/10 participants, Sonoice for 3/10, and Voice for 2/10; trial-and-error was least favourite for 7/10. Graphic complexity did not significantly affect mean trial duration: complex graphics 27.10±20.28 s vs simple graphics 28.69±18.86 s.

Methods

  • Within-subjects study with ten BVI participants (four females, six males; two congenitally blind, five late blind, three visually impaired) recruited in Osnabrück, Germany. Each participant tested all four strategies in a single 90-min session, with strategy order randomised.
  • Strategies were implemented on the Tactonom Reader using the MINIM audio library: trial-and-error, Sonar proximity-radar sonification, Voice clock-system speech instructions, and Sonoice combining sonification with voice. Testing used eight train station floor-plan graphics: four simple graphics averaging 14 spot elements and four complex graphics averaging 79 spot elements, with two target elements per graphic and a 60 s trial limit.
  • Mixed-methods analysis used total trial times as the dependent variable with parametric ANOVA, NASA-TLX and SUS questionnaires with normalised scores, and semi-structured interviews analysed descriptively with user quotes.

Limitations

  • The paper states the sample was relatively small and did not allow rigorous statistical analysis of visual impairment subgroups; it also notes that participants received only 5 min of training per strategy, which may have affected familiarity and overload with Sonoice.
  • The paper states the 60 s trial limit may have influenced trial-and-error results for simple vs complex graphics, and that subjective questionnaire measures may not capture all aspects of user satisfaction.
  • Evident from the text: although Sonoice had the lowest mean trial duration, statistical tests did not show significant differences among Sonar, Voice, and Sonoice, so the claim that Sonoice is most efficient is not statistically confirmed in this sample.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.3389/fresc.2024.1368983

Cites

85 of 85 references verified0 citation errors · 0 not checkable

Statistics

2 tests recomputed · 0 with the reported and recomputed p on opposite sides of .05

Figures

Figure 1 The Tactonom Reader 2.5.0v workflow.
Figure 1 The Tactonom Reader 2.5.0v workflow.CC BY · PubMed Central
Figure 2 Graphics used to assist participant learning (top) and evaluate the pinpoint navigation strategies (bottom) in this study. The red squares demarcate the target elements participants were required to locate on the evaluation graphics during the testing session. These squares were enlarged to three times their original size to facilitate ease of viewing. For clarity, the blue targets and QR code from the Problind database layout have been intentionally omitted from this figure.
Figure 2 Graphics used to assist participant learning (top) and evaluate the pinpoint navigation strategies (bottom) in this study. The red squares demarcate the target elements participants were required to locate on the evaluation graphics during the testing session. These squares were enlarged to three times their original size to facilitate ease of viewing. For clarity, the blue targets and QR code from the Problind database layout have been intentionally omitted from this figure.CC BY · PubMed Central
Figure 3 Pinpoint Navigation Strategies for Tactile Graphics (trial-and-error, Sonar, Voice, and Sonoice). The figure presents the workflow and key components of the four navigation strategies used in our study for element pinpointing in tactile graphics. Each strategy is illustrated with a diagram depicting the user’s interaction and associated audio cues.
Figure 3 Pinpoint Navigation Strategies for Tactile Graphics (trial-and-error, Sonar, Voice, and Sonoice). The figure presents the workflow and key components of the four navigation strategies used in our study for element pinpointing in tactile graphics. Each strategy is illustrated with a diagram depicting the user’s interaction and associated audio cues.CC BY · PubMed Central
Figure 4 Overview of the experimental procedure phases. After the preparation phase, participants could explore the Tactonom Reader functionalities. All four pinpoint strategies, trial-and-error, Sonar, Voice, and Sonoice, were learned in the training graphic and used to pinpoint targets in 8 train station graphics. The experiment ends with a usability phase, including NASA-TLX and SUS questionnaires and a semi-structured interview.
Figure 4 Overview of the experimental procedure phases. After the preparation phase, participants could explore the Tactonom Reader functionalities. All four pinpoint strategies, trial-and-error, Sonar, Voice, and Sonoice, were learned in the training graphic and used to pinpoint targets in 8 train station graphics. The experiment ends with a usability phase, including NASA-TLX and SUS questionnaires and a semi-structured interview.CC BY · PubMed Central
Figure 5 Comparison of Pinpoint Navigation Strategies based on trial duration. Boxplots show the distribution of trial durations for each strategy (in seconds), with medians represented as solid lines. Outliers are depicted as grey diamonds. The black markers denote the medians of each subgroup of visual impairment type for each boxplot distribution: circles for CB, squares for LB, and stars for VI.
Figure 5 Comparison of Pinpoint Navigation Strategies based on trial duration. Boxplots show the distribution of trial durations for each strategy (in seconds), with medians represented as solid lines. Outliers are depicted as grey diamonds. The black markers denote the medians of each subgroup of visual impairment type for each boxplot distribution: circles for CB, squares for LB, and stars for VI.CC BY · PubMed Central
Figure 6 Comparison of subjective workload and satisfaction ratings across pinpoint navigation strategies. The left plot shows the NASA-TLX scores, while the right plot shows the SUS scores for the trial, Sonar, Voice, and Sonoice strategies. The black markers represent the medians of each subgroup of visual impairment type for each boxplot distribution: circles for CB, squares for LB, and stars for VI.
Figure 6 Comparison of subjective workload and satisfaction ratings across pinpoint navigation strategies. The left plot shows the NASA-TLX scores, while the right plot shows the SUS scores for the trial, Sonar, Voice, and Sonoice strategies. The black markers represent the medians of each subgroup of visual impairment type for each boxplot distribution: circles for CB, squares for LB, and stars for VI.CC BY · PubMed Central
Figure 7 Distribution of favourite and worst pinpoint strategies reported by participants (10 in total) during semi-structured interviews. Each bar chart is segmented by the type of visual impairment, denoted by CB, LB, and VI votes.
Figure 7 Distribution of favourite and worst pinpoint strategies reported by participants (10 in total) during semi-structured interviews. Each bar chart is segmented by the type of visual impairment, denoted by CB, LB, and VI votes.CC BY · PubMed Central
Figure 8 Distribution of trial durations (s) per graphic type (Simplex and Complex). The boxplot displays the medians as solid lines. Black markers represent the medians of each subgroup of visual impairment type for each boxplot distribution: circles for CB, squares for LB, and stars for VI.
Figure 8 Distribution of trial durations (s) per graphic type (Simplex and Complex). The boxplot displays the medians as solid lines. Black markers represent the medians of each subgroup of visual impairment type for each boxplot distribution: circles for CB, squares for LB, and stars for VI.CC BY · PubMed Central
Figure 9 Distribution of trial durations (s) across graphic type (Simple and Complex) and pinpoint navigation strategy. The boxplot displays the medians as solid lines, while the dashed lines represent the means. Outliers are depicted as grey diamonds. Black markers represent the medians of each subgroup of type of Visual Impairment (VI) for each boxplot distribution: circles for CB, squares for LB, and stars for VI.
Figure 9 Distribution of trial durations (s) across graphic type (Simple and Complex) and pinpoint navigation strategy. The boxplot displays the medians as solid lines, while the dashed lines represent the means. Outliers are depicted as grey diamonds. Black markers represent the medians of each subgroup of type of Visual Impairment (VI) for each boxplot distribution: circles for CB, squares for LB, and stars for VI.CC BY · PubMed Central

Verification

Claims the paper makes

11 Valid · 4 Not valid · 4 Not checked · 80 Own results and interpretations

45 more claims · 4 with their cited sources checked

Create a free account to see all 99 claims and to verify the 5 references still open.

See all claims — free account
  • Probably not a substantial claim. 28
  • It may state two separate claims as one. 25
  • Borderline: one of the tests for a substantial claim is unclear. 1

Create a free account to see these claims.

Statistics that don’t add up

Each reported p-value recomputed from its test statistic and degrees of freedom.

1 of 1

Statistics recomputed

Every reported test result, recomputed from its test statistic and degrees of freedom. A result shows as not adding up only once an independent check has confirmed it.

  • Doesn’t add upF(2, 18) = 0.394reported p = .983 · recomputed p = .680

    “F(2,18)=0.394,p = .983”

  • ConsistentF(3, 27) = 139.5827reported p < .001 · recomputed p < .001

    “F(3,27)=139.5827,p < .001”

2 of 2

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

1 of 1

Citations

Cites

Show all 85 references

Research works printed but not linked: 10

  1. Bornschein, 2020, Multimodales Kollaboratives Zeichensystem für Blinde Benutzer
  2. 2024, BlindSquare iOS Application
  3. Yang, 2016, Graille: design research of graphical tactile display for the visually impaired, Decorate, 1, 94
  4. Dingler, 2008, Learnability of sound cues for environmental features: auditory icons, earcons, spearcons, and speech.
  5. 2022, Blindness and Vision Impairment
  6. 2020, About Blindness and Partial Sight
  7. 2024, Tactonom Reader (The Tactile Graphics Reader)
  8. 2024, ProBlind (Open-source tactile graphics dataset)
  9. 2024, PIAF Tactile Image Maker
  10. 2010, Minim Opensource Audio Processing Library

Cited by

See all 5

Metadata

Authors
Ramôa, G., Schmidt, V., Schwarz, T., Stiefelhagen, R., & König, P.
Affiliations
  • Osnabrück University (DE)
  • Karlsruhe Institute of Technology (DE)
Corresponding author
Ramôa, Gaspar
Venue
Frontiers in Rehabilitation Sciences
Published
2024-08-23
Volume
5
Pages
1368983-1368983
ISSN
2673-6861 (ISSN-L)
OpenAlex
W4401828026
Cited by
5
References
85
Citations by year
2026: 3 · 2025: 2
FWCI
1.21
Type
journal article
Language
en
Open access
Locations
  • Frontiers in Rehabilitation Sciences (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
Funders
European Commission (HORIZON2020, 861166)
Topics
  • Life Sciences › Neuroscience › Cognitive Neuroscience › Tactile and Sensory Interactions
  • Social Sciences › Human Factors and Ergonomics › Digital Accessibility for Disabilities
  • Health Sciences › Health Professions › Occupational Therapy › Assistive Technology in Communication and Mobility
Keywords
blindness and visual impairment, sonification, assistive technology, user preferences, accessible technology

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (gpt-6-sol).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: SONOICE! a Sonar–Voice dynamic user interface for assisting individuals with blindness and visual impairment in pinpointing elements in 2D tactile readers. https://app.cochat.ai/papers/10.3389/fresc.2024.1368983
The paper
Ramôa, G., Schmidt, V., Schwarz, T., Stiefelhagen, R., & König, P. (2024). SONOICE! a Sonar–Voice dynamic user interface for assisting individuals with blindness and visual impairment in pinpointing elements in 2D tactile readers. Frontiers in Rehabilitation Sciences. https://doi.org/10.3389/fresc.2024.1368983

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.