An audio-based 3d spatial guidance ar system for blind users.
Open accessAbstract
Augmented reality (AR) has great potential for blind users because it enables a range of applications that provide audio information about specific locations or directions in the user’s environment. For instance, the CamIO (“Camera Input-Output”) AR app makes physical objects (such as documents, maps, devices and 3D models) accessible to blind and visually impaired persons by providing real-time audio feedback in response to the location on an object that the user is touching (using an inexpensive stylus). An important feature needed by blind users of AR apps such as CamIO is a 3D spatial guidance feature that provides real-time audio feedback to help the user find a desired location on an object. We have devised a simple audio interface to provide verbal guidance towards a target of interest in 3D. The experiment we report with blind participants using this guidance interface demonstrates the feasibility of the approach and its benefit for helping users find locations of interest.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Users revealed dissatisfaction with the repetitive and potentially irritating nature of using voice-based feedback.
“However, users revealed dissatisfaction with the repetitive and potentially irritating nature of using voice-based feedback (22, 24, 35, 38, 39).”
From SONOICE! a Sonar–Voice dynamic user interface for assisting individuals with blindness and visual impairment in pinpointing elements in 2D tactile readers (2024) · cites this paper as [24]
In Results and Discussion, P3 reported frustration with lagging voice feedback and said the speed of repetitive speech made her feel rushed. The paper does not report that users generally found voice feedback irritating; the same section says all three interviewees acknowledged its benefits. Page numbers are not available in the supplied passages. (LLM, conf=0.84)
Experimental — accuracy not yet measuredPeople with blindness or visual impairment have highlighted the need for an assistive interface to pinpoint elements on tactile surfaces.
“People with BVI have highlighted the need for an assistive interface to pinpoint elements on tactile surfaces (9, 20–24).”
From SONOICE! a Sonar–Voice dynamic user interface for assisting individuals with blindness and visual impairment in pinpointing elements in 2D tactile readers (2024) · cites this paper as [24]
Voice guidance helps people with blindness or visual impairment pinpoint and target elements effectively.
“Previous research has shown that voice guidance helps BVI people pinpoint and target elements effectively.”
From SONOICE! a Sonar–Voice dynamic user interface for assisting individuals with blindness and visual impairment in pinpointing elements in 2D tactile readers (2024) · cites this paper as [24]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
SUS: A 'Quick and Dirty' Usability Scale
(1996) · Usability Evaluation In Industry · doi:10.1201/9781498710411-35 · Cited by 8,989 · see citing works
The Tactile Graphics Helper: Providing Audio Clarification for Tactile Graphics Using Machine Vision
Fusco, G., & Morash, V. S. (2015) · Proceedings of the 17th International ACM SIGACCESS Conference on Computers & Accessibility - ASSETS '15 · doi:10.1145/2700648.2809868 · Cited by 91 · see citing works
Shi, L., Zhao, Y., & Azenkot, S. (2017) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/3126594.3126650 · Cited by 72 · see citing works
Shen, H., Edwards, O., Miele, J. A., & Coughlan, J. M. (2013) · International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS) · doi:10.1145/2513383.2513423 · Cited by 28 · see citing works
Self-citationThévin, L., & Brock, A. (2018) · Lecture notes in computer science · doi:10.1007/978-3-319-94274-2_26 · Cited by 27 · see citing works
Computers Helping People with Special Needs
(2018) · Lecture notes in computer science · doi:10.1007/978-3-319-94274-2 · Cited by 25 · see citing works
Auditory Displays to Facilitate Object Targeting in 3D Space
May, K. R., Sobel, B., Wilson, J., & Walker, B. N. (2019) · Proceedings of the 25th International Conference on Auditory Display (ICAD 2019) · doi:10.21785/icad2019.008 · Cited by 24 · see citing works
An Augmented Reality Audio Device Helping Blind People Navigation
Ferrand, S., Alouges, F., & Aussal, M. (2018) · Lecture notes in computer science · doi:10.1007/978-3-319-94274-2_5 · Cited by 14 · see citing works
Towards Accessible Audio Labeling of 3D Objects.
Coughlan, J. M., Shen, H., & Biggs, B. (2020) · PubMed · Cited by 9 · see citing works
Self-citationPrototyping and Evaluating Sensory Substitution Devices by Spatial Immersion in Virtual Environments
Guezou‐Philippe, A., Huet, S., Pellerin, D., & Graff, C. (2018) · International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP) · doi:10.5220/0006637705960602 · Cited by 3 · see citing works
Evaluating Author and User Experience for an Audio-Haptic System for Annotation of Physical Models
Coughlan, J. M., & Miele, J. A. (2017) · International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS) · doi:10.1145/3132525.3134811 · Cited by 2 · see citing works
Self-citation
Flagged first, then by citations
Research works printed but not linked: 1
- [10]Miele J: Talking Tactile Apps for the Pulse Pen: STEM Binder. In: 25th Annual Int’l Technology & Persons with Disabilities Conference (CSUN) (2010)
Cited by
Sorted by citations
Non-visual access to an interactive 3d map.
Coughlan, J. M., Biggs, B., & Shen, H. (2022) · Lecture Notes in Computer Science · doi:10.1007/978-3-031-08648-9_29 · Cited by 8 · see citing works
Self-citationRamôa, G., Schmidt, V., Schwarz, T., Stiefelhagen, R., & König, P. (2024) · Frontiers in Rehabilitation Sciences · doi:10.3389/fresc.2024.1368983 · Cited by 5 · see citing works
- Authors
- Coughlan, J. M., Biggs, B., Rivière, M.-A., & Shen, H.
- Affiliations
- Smith-Kettlewell Eye Research Institute (US)
- Corresponding author
- Coughlan, James M.
- Venue
- Lecture Notes in Computer Science
- Publisher
- Springer International Publishing
- Published
- 2020
- Volume
- 12376
- Pages
- 475-484
- ISSN
- 0302-9743 (ISSN-L)
- 1611-3349
- PMC
- PMC7676634
- OpenAlex
- W3084702265
- Semantic Scholar
- 06fb3afa9e2b18b58286830dfd3d78ea829a4b3f
- Cited by
- 14
- References
- 11
- Citations by year
- 2026: 1 · 2025: 3 · 2024: 3 · 2023: 4 · 2022: 2 · 2021: 1
- FWCI
- 2.28
- Type
- conference paper
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- Lecture notes in computer science (publishedVersion)
- PubMed (publishedVersion)
- PubMed Central (acceptedVersion)
- Funders
- National Eye Institute (R01EY025332)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Tactile and Sensory Interactions
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Augmented Reality Applications
- Health Sciences › Health Professions › Occupational Therapy › Assistive Technology in Communication and Mobility
- Keywords
- augmented reality, blind users, visually impaired users, audio feedback, verbal guidance, audio interface, location finding, touch interaction, accessibility
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
