The DOI matches its Crossref record; 39 of the 44 references it cites were found in a registry or an index; 2 of the 14 sources its claims cite were checked for support.
StereoPilot: A Wearable Target Location System for Blind and Visually Impaired Using Spatial Audio Rendering
Open accessAbstract
Vision loss severely impacts object recognition and spatial cognition for limited vision individuals. It is a challenge to compensate for this using other sensory modalities, such as touch or hearing. This paper introduces StereoPilot, a wearable target location system to facilitate the spatial cognition of BVI. Through wearing a head-mounted RGB-D camera, the 3D spatial information of the environment is measured and processed into navigation cues. Leveraging spatial audio rendering (SAR) technology, it allows the navigation cues to be transmitted in a type of 3D sound from which the sound orientation can be distinguished by the sound localization instincts in humans. Three haptic and auditory display strategies were compared with SAR through experiments with three BVI and four sighted subjects. Compared with mainstream speech instructional feedback, the experimental results of the Fitts' law test showed that SAR increases the information transfer rate (ITR) by a factor of three for spatial navigation, while the positioning error is reduced by 40%. Furthermore, SAR has a lower learning effect than other sonification approaches such as vOICe. In desktop manipulation experiments, StereoPilot was able to obtain precise localization of desktop objects while reducing the completion time of target grasping tasks in half as compared to the voice instruction method. In summary, StereoPilot provides an innovative wearable target location solution that swiftly and intuitively transmits environmental information to BVI individuals in the real world.
Overview
CoChat Summary
TL;DR
StereoPilot is a wearable target-location system that uses a head-mounted RGB-D camera and spatial audio rendering (SAR) to convey object locations to blind and visually impaired users. In experiments with 3 BVI and 4 sighted participants, SAR improved information transfer rate and reduced positioning error and grasping time relative to voice, vibrotactile, and vOICe-style sonification feedback.
Key findings
- In the Fitts’ law test, BVI participants had SAR ITR of 0.764 bits/s versus VI 0.243, VB 0.256, and NS −0.596; completion time was 9.97 ± 5.71 s for SAR versus 22.46 ± 9.12 s for VI, 14.01 ± 7.42 s for VB, and 33.04 ± 19.57 s for NS.
- For BVI participants, SAR reduced positioning error by 28% compared with VI, 39% compared with VB, and 46% compared with NS; SAR positioning accuracy for BVI was 22% higher than for sighted subjects. The abstract reports SAR increased ITR by a factor of three and reduced positioning error by 40% compared with speech instruction.
- In desktop manipulation, the RGB-D camera’s average localization error was 0.43 ± 0.14 cm; the system ran at 15 fps with 43% CPU and 400 MB memory usage. SAR shortened target-grasping completion time, reported in the abstract as half that of the voice instruction method.
- Success rates were similar across SAR, VI, and VB but lower for NS: BVI SAR 96.61 ± 1.43%, VI 95.90 ± 1.06%, VB 96.24 ± 1.51%, NS 84.56 ± 3.54%; sighted SAR 97.11 ± 1.82%, VI 95.59 ± 1.93%, VB 95.60 ± 1.07%, NS 87.61 ± 4.60%.
Methods
- The wearable system used an Intel RealSense D435 RGB-D camera and MPU9250 on a head-mounted helmet, MediaPipe for object and hand recognition, and coordinate transformation from the camera coordinate system to the user coordinate system; stereo earphones provided audio feedback.
- SAR encoded target location using a sound cue with high- and low-frequency components, a CIPIC-based HRTF model, and Google Resonance Audio in a Unity virtual scene, with the virtual hand as listener and target object as sound source.
- Experiments included 4 sighted participants (25.5 ± 4.2 years) and 3 participants with congenital blindness (22.6 ± 1.5 years), all with normal hearing. The Fitts’ law test compared SAR, VI, VB, and NS with 30 repetitions per group; the desktop manipulation experiment used five same-material, same-mass, same-shape blocks differing in color, randomly positioned less than 5 cm apart, with 30 trials per feedback method.
Limitations
- Stated: some subjects reported that rendered spatial audio deviated from actual orientation, possibly due to the generalized HRTF model; the authors propose subject-specific HRTF and more realistic rendering.
- Stated: machine vision recognition errors during human-environment interaction, especially hand/object occlusion, can cause positioning errors and incorrect spatial information; robustness needs improvement.
- Stated: vOICe/NS had a 1 fps snapshot update rate, high learning cost, and target/cursor confusion; BVI success was lower than sighted partly because RGB-D recognition accuracy decreased when the hand blocked the object. Evident: the sample was small (3 BVI, 4 sighted), limiting generalizability.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures









Verification
Claims the paper makes
1 Valid · 5 Not valid · 8 Not checked · 53 Own results and interpretations
Every source the paper cites for this claim was checked and supports it.
In the paper
“May et al. [21] investigated the effectiveness of area cues and proximity feedback in facilitating object targeting based on virtual environment, but to our best knowledge there is rarely research on BVI's hand prehension task in real environment.”
§ StereoPilot: A Wearable Target Location System for Blind and Visually Impaired Using Spatial Audio Rendering > I. INTRODUCTION
What the sources say
- Supportedcites [21] 21. K. R. May, B. Sobel, J. Wilson, and B. N. Walker, "Auditory displays to facilitate object targeting in 3D space," in Proceedings of the 25th International Conference on Auditory Display (ICAD 2019). Newcastle upon Tyne, United Kingdom: Department of Computer and Information Sciences, Northumbria University, 6 2019, pp. 155-162. [Online]. Available: http://hdl.handle.net/1853/61542 source
Section 1.2 'Current Study' states verbatim the goal attributed to May et al.: investigating the effectiveness of area cues and proximity feedback in facilitating object targeting, with participants walking a virtual kitchen and physically reaching for targets; Section 2.2.1 confirms the setting was a Unity/SteamVR virtual environment. The trailing clause about the scarcity of real-environment hand-prehension research for BVI users is the citing authors' own 'to our best knowledge' assertion and is not attributed to this source (our copy does not make that claim, and its participants were sighted undergraduates, not BVI), so it falls outside what is judged here. (LLM, conf=0.88)
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources that could be checked couldn’t confirm or dispute this claim.
In the paper
“The slope of the linear regression curve represents the ITR and shows that SAR was nearly three times that of the VI and VB in the BVI group.”
- Also stated in: § A. Analysis of experimental results · boosted
“The experimental results show that SAR improves the ITR for BVI, which is consistent with the results demonstrated by Dunai et al. [37] and Frauenberger et al. [19].”
- Also stated in: § VI. CONCLUSION · plain
“The results of Fitts' law test show that SAR can effectively improve the ITR of location information for users.”
§ StereoPilot: A Wearable Target Location System for Blind and Visually Impaired Using Spatial Audio Rendering > A. Fitts' law test
What the sources say
- Could not verifycites Dunai et al. [37] 37. L. Dunai, I. Lengua, G. Peris-Fajarnés, and F. Brusola, "Virtual sound localization by blind people," Archives of Acoustics, vol. 40, no. 4, pp. 561-567, 12 2015. [Online]. Available: http://journals.pan.pl/dlibra/publication/116685/edition/101416/content sourceExperimental — accuracy not yet measured
Our copy of Dunai et al. (2015) reports localization times, distance/azimuth errors (±40 cm, ±10 cm), walking times and number of hits (Results and discussion, pp. of Sec. 4), but nowhere defines or reports an information transfer rate (ITR), a 'SAR' condition, or 'VI'/'VB'/'BVI' groups, and no linear-regression slope is used as a performance metric. Searches for 'ITR / information transfer rate', 'slope of linear regression', 'SAR VI VB', and 'three times' returned only HRTF/filter equations (Sec. 2.2), the sensory system (Sec. 2.1), and the four-participant description (Sec. 3). Since the copy is complete but does not address the claimed quantity, the attribution can be neither confirmed nor contradicted. (LLM, conf=0.72)
- Not matchedcites Frauenberger et al. [19] 19. C. Frauenberger and M. Noistering, "3D audio interfaces for the blind," in Proceedings of the 9th International Conference on Auditory Display. Boston, MA, USA: International Community for Auditory Display, 7 2003.
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
boostedstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § A. Analysis of experimental results · boosted
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“In desktop manipulation experiments, StereoPilot was able to obtain precise localization of desktop objects while reducing the completion time of target grasping tasks in half as compared to the voice instruction method.”
§ StereoPilot: A Wearable Target Location System for Blind and Visually Impaired Using Spatial Audio Rendering > Abstract
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Furthermore, SAR has a lower learning effect than other sonification approaches such as vOICe.”
§ StereoPilot: A Wearable Target Location System for Blind and Visually Impaired Using Spatial Audio Rendering > Abstract
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: unclear — It is unclear why the paper says it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“In desktop manipulation experiments, StereoPilot was able to obtain precise localization of desktop objects while reducing the completion time of target grasping tasks in half as compared to the voice instruction method.”
§ StereoPilot: A Wearable Target Location System for Blind and Visually Impaired Using Spatial Audio Rendering > Abstract
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
35 more claims
Create a free account to see all 67 claims and to verify the 3 references still open.
- Probably not a substantial claim. 16
- It may state two separate claims as one. 17
- The quote only partly states this claim. 1
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ StereoPilot: A Wearable Target Location System for Blind and Visually Impaired Using Spatial Audio Rendering > A. Fitts' law test
“while sighted subjects have a relatively stable perception in VI group (RMSE = 4.855).”
§ StereoPilot: A Wearable Target Location System for Blind and Visually Impaired Using Spatial Audio Rendering > D. Desktop Manipulation Experiment
“RMSE (a.u.) 5.970 6.828 6.484 19.240 4.995 3.238 4.855 19.470”
Citations
Cites
Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification
He, K., Zhang, X., Ren, S., & Sun, J. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.123 · Cited by 19,741
Spatial hearing: the psychophysics of human sound localization
(1997) · Choice Reviews Online · doi:10.5860/choice.35-0346 · Cited by 2,304
Bourne, R., Steinmetz, J. D., Flaxman, S., Briant, P. S., Taylor, H. R., Resnikoff, S., Casson, R. J., Abdoli, A., Abu-Gharbieh, E., Afshin, A., et al. (2021) · The Lancet Global Health · doi:10.1016/s2214-109x(20)30425-3 · Cited by 1,431
MediaPipe: A framework for building perception pipelines
Lugaresi, C., Tang, J., Nash, H., McClanahan, C., Uboweja, E., Hays, M., Zhang, F., Chang, C.-L., Yong, M. G., Lee, J., et al. (2019) · arXiv · doi:10.48550/arxiv.1906.08172 · Cited by 1,043
Algazi, V. R., Duda, R. O., Thompson, D. M., & Avendano, C. (2002) · Proceedings of the 2001 IEEE Workshop on the Applications of Signal Processing to Audio and Acoustics (Cat. No.01TH8575) · doi:10.1109/aspaa.2001.969552 · Cited by 926
An experimental system for auditory image representations
Meijer, P. B. L. (1992) · IEEE Transactions on Biomedical Engineering · doi:10.1109/10.121642 · Cited by 900
AlignedReID: Surpassing Human-Level Performance in Person Re-Identification
Zhang, X., Luo, H., Fan, X., Xiang, W., Sun, Y., Xiao, Q., Jiang, W., Zhang, C., & Sun, J. (2017) · arXiv · doi:10.48550/arxiv.1711.08184 · Cited by 419
The GuideCane-applying mobile robot technologies to assist the visually impaired
Ulrich, I., & Borenstein, J. (2001) · IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans · doi:10.1109/3468.911370 · Cited by 414
Sensory conflict in judgments of spatial direction
Pick, H. L., Warren, D. H., & Hay, J. C. (1969) · Perception & Psychophysics · doi:10.3758/bf03207017 · Cited by 386
The Argus® II Retinal Prosthesis System
Luo, Y. H.-L., & da Cruz, L. (2016) · Progress in Retinal and Eye Research · doi:10.1016/j.preteyeres.2015.09.003 · Cited by 351
Cited by
Lai, J., Song, A., Wang, J., Lu, Y., Wu, T., Li, H., Xu, B., & Wei, X. (2023) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2023.3302612 · Cited by 50
“in their rehabilitation process [4], [5].”
Self-citationJoshi, R. C., Singh, N. K., Sharma, A. K., Bürget, R., & Dutta, M. K. (2024) · IEEE Transactions on Human-Machine Systems · doi:10.1109/thms.2024.3375655 · Cited by 42
“Most of the applications are made for only limited tasks, such as drug pill recognition [22], target localization [23], object recognition [24], accident prevention [25], and obstacle detection [26].”
BackgroundChen, D., Zhang, Y., Hu, X., Chen, G., Fang, Y., Chen, X., Liu, J., & Song, A. (2024) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2024.3363495 · Cited by 42
“Due to severe vision impairment, BVI mainly rely on touch [2], [3], [4] and hearing [5] to gather information from their surroundings.”
BackgroundSelf-citationTechnological Advancements in Human Navigation for the Visually Impaired: A Systematic Review
Casanova, E., Guffanti, D., & Hidalgo, L. (2025) · Sensors · doi:10.3390/s25072213 · Cited by 35
A Systematic Review of Fitts' Law in 3D Extended Reality
Amini, M. M., Stuerzlinger, W., Teather, R. J., & Batmaz, A. U. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713623 · Cited by 40
“For example, Hu et al. [63] used Fitts’ law to evaluate their wearable target location system, designed for visually impaired or blind users.”
Metadata
- Authors
- Hu, X., Song, A., Wei, Z., & Zeng, H.
- Affiliations
- State Key Laboratory of Digital Medical Engineering (CN)
- Venue
- IEEE Transactions on Neural Systems and Rehabilitation Engineering
- Published
- 2022
- Volume
- 30
- Pages
- 1621-1630
- ISSN
- 1534-4320 (ISSN-L)
- 1558-0210
- OpenAlex
- W4282935978
- Cited by
- 50
- References
- 44
- Citations by year
- 2026: 11 · 2025: 20 · 2024: 11 · 2023: 7 · 2022: 1
- FWCI
- 5.03
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- IEEE Transactions on Neural Systems and Rehabilitation Engineering (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- Funders
- National Natural Science Foundation of China (92148205, 62173089)
- Basic Research Program of Jiangsu Province (BK201900240)
- Basic Research Funds for Universities (2242022K30056)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Tactile and Sensory Interactions
- Health Sciences › Health Professions › Occupational Therapy › Assistive Technology in Communication and Mobility
- Social Sciences › Human Factors and Ergonomics › Digital Accessibility for Disabilities
- Keywords
- blind and visually impaired, spatial audio rendering, sonification, haptic feedback, spatial cognition, Fitts' law, information transfer rate, object localization, assistive technology, sound localization
- MeSH terms
- Wearable Electronic Devices, Blindness, Humans, Vision, Ocular, Visual Perception, Persons with Visual Disabilities
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (qwen3.8-omni-flash).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: StereoPilot: A Wearable Target Location System for Blind and Visually Impaired Using Spatial Audio Rendering. https://app.cochat.ai/papers/10.1109/tnsre.2022.3182661
- The paper
- Hu, X., Song, A., Wei, Z., & Zeng, H. (2022). StereoPilot: A Wearable Target Location System for Blind and Visually Impaired Using Spatial Audio Rendering. IEEE Transactions on Neural Systems and Rehabilitation Engineering. https://doi.org/10.1109/tnsre.2022.3182661
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.