A Multitask Grocery Assist System for the Visually Impaired: Smart glasses, gloves, and shopping carts provide auditory and tactile feedback
The DOI matches its Crossref record; 14 of the 14 references it cites were found in a registry or an index.
Abstract
According to the World Health Organization, "285 million people are estimated to be visually impaired worldwide" [1]. Several technologies such as automatic text readers, Braille note makers, and navigation assistance canes have been developed to assist the visually impaired. Concurrent advances in computer vision and hardware technologies provide opportunities for a visual-assistance system that can be used in multiple contexts. As part of the Visual Cortex on Silicon program, we have been developing interfaces, algorithms, and hardware platforms to assist the visually impaired with a focus on grocery shopping. This article describes the various features that we have incorporated into this visual-assistance system so that it can be used in multiple contexts.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“PVI need to take many good quality photos that is hard for them”
From Making Shopping Easy for People with Visual Impairment Using Mobile Assistive Technologies (2019) · cites this paper as [83]
In the citing paper
“Inconsistent performance in real-world environments because of factors such as motion blur”
From Making Shopping Easy for People with Visual Impairment Using Mobile Assistive Technologies (2019) · cites this paper as [83]
In the citing paper
“Most of them can be installed easily on smartphones”
From Making Shopping Easy for People with Visual Impairment Using Mobile Assistive Technologies (2019) · cites this paper as [83]
In the citing paper
“Cost-effective as they need little or no infrastructure”
From Making Shopping Easy for People with Visual Impairment Using Mobile Assistive Technologies (2019) · cites this paper as [83]
In the citing paper
“Use extensive computation power”
From Making Shopping Easy for People with Visual Impairment Using Mobile Assistive Technologies (2019) · cites this paper as [83]
1 more claim about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
FaceNet: A unified embedding for face recognition and clustering
Schroff, F., Kalenichenko, D., & Philbin, J. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298682 · Cited by 15,267 · cited 1×
“Another important insight, recently unearthed by [5], is that the accuracies of CNNs can saturate after a few million images of training data.”
BackgroundLearning Deep Architectures for AI
Bengio, Y. (2009) · now publishers, Inc. eBooks · doi:10.1561/9781601982957 · Cited by 4,941
TrueNorth: Design and Tool Flow of a 65 mW 1 Million Neuron Programmable Neurosynaptic Chip
Akopyan, F., Sawada, J., Cassidy, A., Alvarez-Icaza, R., Arthur, J., Merolla, P., Imam, N., Nakamura, Y., Datta, P., Nam, G.-J., et al. (2015) · IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems · doi:10.1109/tcad.2015.2474396 · Cited by 1,687
The neural basis of multisensory integration in the midbrain: Its organization and maturation
Stein, B. E., Stanford, T. R., & Rowland, B. A. (2009) · Hearing Research · doi:10.1016/j.heares.2009.03.012 · Cited by 209
RedEye: analog ConvNet image sensor architecture for continuous mobile vision
LiKamWa, R., Hou, Y., Gao, J., Polansky, M., & Zhong, L. (2016) · ACM SIGARCH Computer Architecture News · doi:10.1145/3007787.3001164 · Cited by 189
CAPI: A Coherent Accelerator Processor Interface
Stuecheli, J., Blaner, B., Johns, C. R., & Siegel, M. S. (2015) · IBM Journal of Research and Development · doi:10.1147/jrd.2014.2380198 · Cited by 164
RedEye: Analog ConvNet Image Sensor Architecture for Continuous Mobile Vision
LiKamWa, R., Hou, Y., Gao, Y., Polansky, M., & Zhong, L. (2016) · 2016 ACM/IEEE 43rd Annual International Symposium on Computer Architecture (ISCA) · doi:10.1109/isca.2016.31 · Cited by 61
An Information Theoretic Model of Saliency and Visual Search
Bruce, N. D. B., & Tsotsos, J. K. (2007) · Lecture notes in computer science · doi:10.1007/978-3-540-77343-6_11 · Cited by 36
Enabling New Computation Paradigms with HyperFET - An Emerging Device
Tsai, W.-Y., Li, X., Jerry, M., Xie, B., Shukla, N., Liu, H., Chandramoorthy, N., Cotter, M. J., Raychowdhury, A., Chiarulli, D. M., et al. (2016) · IEEE Transactions on Multi-Scale Computing Systems · doi:10.1109/tmscs.2016.2519022 · Cited by 34
Self-citation
Research works printed but not linked: 3
- 0, Robust Multi-Person Tracking From Mobile Platforms
- 0, INRIA Person Dataset
- 2014, Visual Impairment and Blindness
Cited by
Deep Learning for IoT Big Data and Streaming Analytics: A Survey
Mohammadi, M., Al-Fuqaha, A., Sorour, S., & Guizani, M. (2018) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2018.2844341 · Cited by 1,471
Deep learning-based object detection in augmented reality: A systematic review
Ghasemi, Y., Jeong, H., Choi, S. H., Park, K.-B., & Lee, J. Y. (2022) · Computers in Industry · doi:10.1016/j.compind.2022.103661 · Cited by 188
A Review on Deep Learning Techniques for IoT Data
Lakshmanna, K., Kaluri, R., Gundluru, N., Alzamil, Z. S., Rajput, D. S., Khan, A. A., Haq, M. A., & Alhussen, A. (2022) · Electronics · doi:10.3390/electronics11101604 · Cited by 154
Santra, B., & Mukherjee, D. P. (2019) · Image and Vision Computing · doi:10.1016/j.imavis.2019.03.005 · Cited by 102
Budrionis, A., Plikynas, D., Daniušis, P., & Indriulionis, A. (2020) · Assistive Technology · doi:10.1080/10400435.2020.1743381 · Cited by 116
“Alternative mechanisms in the form of vibrating bracelets (Scheggi et al., 2014), gloves with micro-motors (Advani et al., 2017; Poggi & Mattoccia, 2016), vibrating belts (H.-C. Wang et al., 2017) and other means of tactile feedback (Peiris et al., 2016) have been reported, demonstrating the…”
Background
Metadata
- Authors
- Advani, S., Zientara, P., Shukla, N., Okafor, I., Irick, K., Sampson, J., Datta, S., & Narayanan, V.
- Affiliations
- Pennsylvania State University (US)
- University of Notre Dame (US)
- Venue
- IEEE Consumer Electronics Magazine
- Published
- 2017-01
- Volume
- 6
- Issue
- 1
- Pages
- 73-81
- ISSN
- 2162-2248 (ISSN-L)
- 2162-2256
- OpenAlex
- W2561304097
- Cited by
- 32
- References
- 14
- Citations by year
- 2026: 1 · 2025: 1 · 2024: 5 · 2023: 4 · 2022: 7 · 2021: 2 · 2020: 3 · 2019: 3 · 2018: 5 · 2017: 1
- FWCI
- 9.40
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- IEEE Consumer Electronics Magazine (publishedVersion)
- Funders
- National Science Foundation
- University of Notre Dame
- Pennsylvania State University
- University of South Florida
- Topics
- Health Sciences › Health Professions › Occupational Therapy › Assistive Technology in Communication and Mobility
- Life Sciences › Neuroscience › Cognitive Neuroscience › Tactile and Sensory Interactions
- Social Sciences › Human Factors and Ergonomics › Digital Accessibility for Disabilities
- Keywords
- visually impaired people, smart glasses, smart glove, shopping cart, auditory feedback, tactile feedback, assistive technology, multimodal interfaces
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: A Multitask Grocery Assist System for the Visually Impaired: Smart glasses, gloves, and shopping carts provide auditory and tactile feedback. https://app.cochat.ai/papers/10.1109/mce.2016.2614422
- The paper
- Advani, S., Zientara, P., Shukla, N., Okafor, I., Irick, K., Sampson, J., Datta, S., & Narayanan, V. (2017). A Multitask Grocery Assist System for the Visually Impaired: Smart glasses, gloves, and shopping carts provide auditory and tactile feedback. IEEE Consumer Electronics Magazine. https://doi.org/10.1109/mce.2016.2614422
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.