Portable Camera-Based Assistive Text and Product Label Reading From Hand-Held Objects for Blind Persons
The DOI matches its Crossref record; 30 of the 31 references it cites were found in a registry or an index.
Abstract
We propose a camera-based assistive text reading framework to help blind persons read text labels and product packaging from hand-held objects in their daily lives. To isolate the object from cluttered backgrounds or other surrounding objects in the camera view, we first propose an efficient and effective motion-based method to define a region of interest (ROI) in the video by asking the user to shake the object. This method extracts moving object region by a mixture-of-Gaussians-based background subtraction method. In the extracted ROI, text localization and recognition are conducted to acquire text information. To automatically localize the text regions from the object ROI, we propose a novel text localization algorithm by learning gradient features of stroke orientations and distributions of edge pixels in an Adaboost model. Text characters in the localized text regions are then binarized and recognized by off-the-shelf optical character recognition software. The recognized text codes are output to blind users in speech. Performance of the proposed text localization algorithm is quantitatively evaluated on ICDAR-2003 and ICDAR-2011 Robust Reading Datasets. Experimental results demonstrate that our algorithm achieves the state of the arts. The proof-of-concept prototype is also evaluated on a dataset collected using ten blind persons to evaluate the effectiveness of the system's hardware. We explore user interface issues and assess robustness of the algorithm in extracting and reading text from different objects with complex backgrounds.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“PVI need to take many good quality photos that is hard for them”
From Making Shopping Easy for People with Visual Impairment Using Mobile Assistive Technologies (2019) · cites this paper as [80]
In the citing paper
“Most of them can be installed easily on smartphones”
From Making Shopping Easy for People with Visual Impairment Using Mobile Assistive Technologies (2019) · cites this paper as [80]
In the citing paper
“Inconsistent performance in real-world environments because of factors such as motion blur”
From Making Shopping Easy for People with Visual Impairment Using Mobile Assistive Technologies (2019) · cites this paper as [80]
In the citing paper
“Use extensive computation power”
From Making Shopping Easy for People with Visual Impairment Using Mobile Assistive Technologies (2019) · cites this paper as [80]
In the citing paper
“Cost-effective as they need little or no infrastructure”
From Making Shopping Easy for People with Visual Impairment Using Mobile Assistive Technologies (2019) · cites this paper as [80]
1 more claim about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
A Threshold Selection Method from Gray-Level Histograms
Otsu, N. (1979) · IEEE Transactions on Systems, Man, and Cybernetics · doi:10.1109/tsmc.1979.4310076 · Cited by 43,398
Robust Real-Time Face Detection
Viola, P., & Jones, M. J. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000013087.49260.fb · Cited by 14,097
Adaptive background mixture models for real-time tracking
Stauffer, C., & Grimson, W. E. L. (2003) · Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149) · doi:10.1109/cvpr.1999.784637 · Cited by 6,923
Detecting text in natural scenes with stroke width transform
Epshtein, B., Ofek, E., & Wexler, Y. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5540041 · Cited by 1,492
Wearable Obstacle Avoidance Electronic Travel Aids for Blind: A Survey
Dakopoulos, D., & Bourbakis, N. G. (2010) · IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews) · doi:10.1109/tsmcc.2009.2021255 · Cited by 654
Detecting and reading text in natural scenes
Chen, X., & Yuille, A. L. (2004) · Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004. · doi:10.1109/cvpr.2004.1315187 · Cited by 625
Kim, K. I., Jung, K., & Kim, J. H. (2003) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2003.1251157 · Cited by 449
Drishti: an integrated indoor/outdoor blind navigation system and service
Ran, L., Helal, S., & Moore, S. (2004) · Second IEEE Annual Conference on Pervasive Computing and Communications, 2004. Proceedings of the · doi:10.1109/percom.2004.1276842 · Cited by 375
Text String Detection From Natural Scenes by Structure-Based Partition and Grouping
Yi, C., & Tian, Y. (2011) · IEEE Transactions on Image Processing · doi:10.1109/tip.2011.2126586 · Cited by 335
Self-citationICDAR 2005 text locating competition results
Lucas, S. M. (2005) · Eighth International Conference on Document Analysis and Recognition (ICDAR'05) · doi:10.1109/icdar.2005.231 · Cited by 284
Research works printed but not linked: 1
- shahab, 2011, ICDAR 2011 robust reading competition: ICDAR Robust Reading Competition Challenge 2: Reading text in scene images, Proc Int Conf Document Anal Recognit, 1491
Cited by
Recognizing Text-Based Traffic Guide Panels with Cascaded Localization Network
Rong, X., Yi, C., & Tian, Y. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-46604-0_8 · Cited by 63
Self-citationMaking Shopping Easy for People with Visual Impairment Using Mobile Assistive Technologies
Elgendy, M., Sik-Lanyi, C., & Kelemen, A. (2019) · Applied Sciences · doi:10.3390/app9061061 · Cited by 48
Smart Specs: Voice assisted text reading system for visually impaired persons using TTS method
Ani, R., Maria, E., Joyce, J. J., Sakkaravarthy, V., & Raja, M. A. (2017) · 2017 International Conference on Innovations in Green Energy and Healthcare Technologies (IGEHT) · doi:10.1109/igeht.2017.8094103 · Cited by 48
Real time text detection and recognition on hand held objects to assist blind people
Deshpande, S., & Shriram, R. (2016) · International Conference on Automatic Control and Dynamic Optimization Techniques · doi:10.1109/icacdot.2016.7877741 · Cited by 42
Text recognition and face detection aid for visually impaired person using Raspberry PI
Rajesh, M., Rajan, B. K., Roy, A., Thomas, K. A., Thomas, A., Tharakan, T. B., & Dinesh, C. (2017) · International Conference on Circuit, Power and Computing Technologies · doi:10.1109/iccpct.2017.8074355 · Cited by 41
Metadata
- Authors
- Yi, C., Tian, Y., & Arditi, A.
- Affiliations
- The Graduate Center, CUNY (US)
- City College of New York (US)
- Lighthouse Guild (US)
- Venue
- IEEE/ASME Transactions on Mechatronics
- Published
- 2014-06
- Volume
- 19
- Issue
- 3
- Pages
- 808-817
- ISSN
- 1083-4435 (ISSN-L)
- 1941-014X
- OpenAlex
- W2159807109
- Cited by
- 97
- References
- 31
- Citations by year
- 2026: 2 · 2025: 2 · 2024: 4 · 2023: 9 · 2022: 4 · 2021: 7 · 2020: 15 · 2019: 10 · 2018: 7 · 2017: 17 · 2016: 9 · 2015: 7 · 2014: 4
- FWCI
- 7.50
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- Locations
- IEEE/ASME Transactions on Mechatronics (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Handwritten Text Recognition Techniques
- Health Sciences › Health Professions › Occupational Therapy › Assistive Technology in Communication and Mobility
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Vehicle License Plate Recognition
- Keywords
- assistive technology for the blind, text localization, text recognition, AdaBoost, optical character recognition, speech output, hand-held objects, background clutter
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Portable Camera-Based Assistive Text and Product Label Reading From Hand-Held Objects for Blind Persons. https://app.cochat.ai/papers/10.1109/tmech.2013.2261083
- The paper
- Yi, C., Tian, Y., & Arditi, A. (2014). Portable Camera-Based Assistive Text and Product Label Reading From Hand-Held Objects for Blind Persons. IEEE/ASME Transactions on Mechatronics. https://doi.org/10.1109/tmech.2013.2261083
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.