Head-Mounted Mobility Aid for Low Vision Using Scene Classification Techniques
Open accessThe DOI matches its Crossref record; 1 of the 1 references it cites were found in a registry or an index.
Abstract
This paper describes a new mobility aid for people with severe visual impairments which combines technology from the field of virtual reality with advanced computer vision techniques. A neural-network classifier is used to identify objects in images from a head mounted camera so that scene content specifically important for mobility may be made more visible. Enhanced images are displayed to the user on a head mounted display using a high saturation colour scheme where each type of object has a different colour, resulting in images which are highly visible and easy to interpret. The object classifier achieves a level of accuracy over 90%. Results from a pilot study conducted using people with a range of visual impairments are presented in which performance on a difficult mobility-related task was improved by over 100% using the system.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Unsupervised texture segmentation using Gabor filters
Jain, A. K., & Farrokhnia, F. (1991) · Pattern Recognition · doi:10.1016/0031-3203(91)90143-s · Cited by 2,182
Cited by
Recovering Surface Layout from an Image
Hoiem, D., Efros, A. A., & Hebert, M. (2007) · International Journal of Computer Vision · doi:10.1007/s11263-006-0031-y · Cited by 674
Geometric context from a single image
Hoiem, D., Efros, A. A., & Hebert, M. (2005) · Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1 · doi:10.1109/iccv.2005.107 · Cited by 662
Hoiem, D., Efros, A. A., & Hebert, M. (2005) · ACM Transactions on Graphics · doi:10.1145/1073204.1073232 · Cited by 616
SeeingVR: A Set of Tools to Make Virtual Reality More Accessible to People with Low Vision
Zhao, Y., Cutrell, E., Holz, C., Morris, M. R., Ofek, E., & Wilson, A. D. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300341 · Cited by 207
“[12] MR Everingham, BT Thomas, T Troscianko, et al.”
BackgroundMethodHoiem, D., Efros, A. A., & Hebert, M. (2005) · ACM SIGGRAPH 2005 Papers · doi:10.1145/1186822.1073232 · Cited by 180
“However, unlike most scene recognition approaches which aim to model semantic classes, such as cars, vegetation, roads, or buildings [Everingham et al. 1999; Konishi and Yuille 2000; Singhal et al. 2003], our goal is to model geometric classes that depend on the orientation of a physical object…”
BackgroundForeSee: A Customizable Head-Mounted Vision Enhancement System for People with Low Vision
Zhao, Y., Szpiro, S., & Azenkot, S. (2015) · Proceedings of the 17th International ACM SIGACCESS Conference on Computers & Accessibility - ASSETS '15 · doi:10.1145/2700648.2809865 · Cited by 115
“Prior work on low vision has tended to focus on specific vision abilities [50,52] or tasks [15,20].”
BackgroundFinding a store, searching for a product: a study of daily challenges of low vision people
Szpiro, S., Zhao, Y., & Azenkot, S. (2016) · Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing · doi:10.1145/2971648.2971723 · Cited by 88
Htike, H. M., Margrain, T. H., Lai, Y.-K., & Eslambolchilar, P. (2020) · Translational Vision Science & Technology · doi:10.1167/tvst.9.10.26 · Cited by 38
“46,65 However, although this color coding technique worked for object recognition in static photographs, 65 it caused a significant reduction in PPWS in eight participants with PFL and eight age-matched controls when evaluated using a mobility course compared to performance without HMDs. 46…”
MethodYang (2021) · doi:10.1145/3463524 · Cited by 13
“For example, several devices [56, 65, 66] adopted brightness and contrast enhancement, some studies [4, 15, 24, 29, 34, 53, 65] used high-contrast color to improve visibility, and other works [26, 67] relied on edge enhancement method.”
BackgroundResult
Metadata
- Authors
- Everingham, M. R., Thomas, B. T., & Troscianko, T.
- Venue
- International Journal of Virtual Reality
- Publisher
- Universite de Bordeaux
- Published
- 1998-01-01
- Volume
- 3
- Issue
- 4
- Pages
- 1-10
- ISSN
- 1081-1451 (ISSN-L)
- OpenAlex
- W1538001179
- Cited by
- 62
- References
- 1
- FWCI
- 0.00
- Type
- journal article
- Language
- en
- Open access
- diamond
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.