The DOI matches its Crossref record; 23 of the 23 references it cites were found in a registry or an index.
Detecting and reading text in natural scenes
Abstract
This paper gives an algorithm for detecting and reading text in natural images. The algorithm is intended for use by blind and visually impaired subjects walking through city scenes. We first obtain a dataset of city images taken by blind and normally sighted subjects. From this dataset, we manually label and extract the text regions. Next we perform statistical analysis of the text regions to determine which image features are reliable indicators of text and have low entropy (i.e. feature response is similar for all text images). We obtain weak classifiers by using joint probabilities for feature responses on and off text. These weak classifiers are used as input to an AdaBoost machine learning algorithm to train a strong classifier. In practice, we trained a cascade with 4 strong classifiers containing 79 features. An adaptive binarization and extension algorithm is applied to those regions selected by the cascade classifier. Commercial OCR software is used to read the text or reject it as a non-text region. The overall algorithm has a success rate of over 90% (evaluated by complete detection and reading of the text) on the test set and the unread text is typically small and distant from the viewer.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Turk, M., & Pentland, A. (1991) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.1991.3.1.71 · Cited by 13,733
Friedman, J., Hastie, T., & Tibshirani, R. (2000) · The Annals of Statistics · doi:10.1214/aos/1016218223 · Cited by 6,884
Neural network-based face detection
Rowley, H. A., Baluja, S., & Kanade, T. (1998) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.655647 · Cited by 3,554
Detecting Pedestrians Using Patterns of Motion and Appearance
Viola, P., Jones, M. J., & Snow, D. (2005) · International Journal of Computer Vision · doi:10.1007/s11263-005-6644-8 · Cited by 2,079
An introduction to digital image processing
Niblack, W. (1986) · Medical Entomology and Zoology · Cited by 1,827
Contour and Texture Analysis for Image Segmentation
Malik, J., Belongie, S., Leung, T., & Shi, J. (2001) · International Journal of Computer Vision · doi:10.1023/a:1011174803800 · Cited by 1,089
A statistical method for 3D object detection applied to faces and cars
Schneiderman, H., & Kanade, T. (2002) · Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662) · doi:10.1109/cvpr.2000.855895 · Cited by 1,059
Structural Pattern Recognition
Pavlidis, T. (1977) · Springer eBooks · doi:10.1007/978-3-642-88304-0 · Cited by 1,055
Detecting pedestrians using patterns of motion and appearance
Viola, Jones, & Snow (2003) · Proceedings Ninth IEEE International Conference on Computer Vision · doi:10.1109/iccv.2003.1238422 · Cited by 1,002
New algorithms for 2D and 3D point matching
Gold, S., Rangarajan, A., Lu, C.-P., Pappu, S., & Mjolsness, E. (1998) · Pattern Recognition · doi:10.1016/s0031-3203(98)80010-1 · Cited by 580
Cited by
Detecting text in natural scenes with stroke width transform
Epshtein, B., Ofek, E., & Wexler, Y. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5540041 · Cited by 1,492
Reading text in the wild with convolutional neural networks
Jaderberg, M., Simonyan, K., Vedaldi, A., & Zisserman, A. (2016) · International Journal of Computer Vision · doi:10.1007/s11263-015-0823-z · Cited by 1,191
End-to-end scene text recognition
Wang, K., Babenko, B., & Belongie, S. (2011) · 2011 International Conference on Computer Vision · doi:10.1109/iccv.2011.6126402 · Cited by 1,060
TextBoxes++: A Single-Shot Oriented Scene Text Detector
Liao, M., Shi, B., & Bai, X. (2018) · IEEE Transactions on Image Processing · doi:10.1109/tip.2018.2825107 · Cited by 897
Scene Text Recognition using Higher Order Language Priors
Mishra, A., Alahari, K., & Jawahar, C. (2012) · Procedings of the British Machine Vision Conference 2012 · doi:10.5244/c.26.127 · Cited by 831
Real-time scene text localization and recognition
Neumann, L., & Matas, J. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6248097 · Cited by 827
Text Detection and Recognition in Imagery: A Survey
Ye, Q., & Doermann, D. (2015) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2014.2366765 · Cited by 780
Detecting texts of arbitrary orientations in natural images
Yao, C., Bai, X., Liu, W., Ma, Y., & Tu, Z. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6247787 · Cited by 765
Deep Features for Text Spotting
Jaderberg, M., Vedaldi, A., & Zisserman, A. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10593-2_34 · Cited by 653
Robust Text Detection in Natural Scene Images
Yin, X.-C., Yin, X., Huang, K., & Hao, H.-W. (2014) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.182 · Cited by 633
Multi-oriented Text Detection with Fully Convolutional Networks
Zhang, Z., Zhang, C., Shen, W., Yao, C., Liu, W., & Bai, X. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.451 · Cited by 596
FOTS: Fast Oriented Text Spotting with a Unified Network
Liu, X., Liang, D., Yan, S., Chen, D., Qiao, Y., & Yan, J. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00595 · Cited by 554
A robust arbitrary text detection system for natural scene images
Risnumawan, A., Shivakumara, P., Chan, C. S., & Tan, C. L. (2014) · Expert Systems with Applications · doi:10.1016/j.eswa.2014.07.008 · Cited by 531
Image Parsing: Unifying Segmentation, Detection, and Recognition
Tu, Z., Chen, X., Yuille, A. L., & Zhu, S.-C. (2005) · International Journal of Computer Vision · doi:10.1007/s11263-005-6642-x · Cited by 498
Self-citationA Method for Text Localization and Recognition in Real-World Images
Neumann, L., & Matas, J. (2011) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-19318-7_60 · Cited by 487
Recursive Recurrent Nets with Attention Modeling for OCR in the Wild
Lee, C.-Y., & Osindero, S. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.245 · Cited by 458
PhotoOCR: Reading Text in Uncontrolled Conditions
Bissacco, A., Cummins, M., Netzer, Y., & Neven, H. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.102 · Cited by 457
Wang, K., & Belongie, S. (2010) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-15549-9_43 · Cited by 449
Robust text detection in natural images with edge-enhanced Maximally Stable Extremal Regions
Chen, H., Tsai, S. S., Schroth, G., Chen, D. M., Grzeszczuk, R., & Girod, B. (2011) · 2011 18th IEEE International Conference on Image Processing · doi:10.1109/icip.2011.6116200 · Cited by 426
Scene text detection and recognition: recent advances and future trends
Zhu, Y., Yao, C., & Bai, X. (2016) · Frontiers of Computer Science · doi:10.1007/s11704-015-4488-0 · Cited by 402
ICDAR 2011 Robust Reading Competition Challenge 2: Reading Text in Scene Images
Shahab, A., Shafait, F., & Dengel, A. (2011) · 2011 International Conference on Document Analysis and Recognition · doi:10.1109/icdar.2011.296 · Cited by 394
Robust Scene Text Detection with Convolution Neural Network Induced MSER Trees
Huang, W., Qiao, Y., & Tang, X. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10593-2_33 · Cited by 381
Text Detection and Character Recognition in Scene Images with Unsupervised Feature Learning
Coates, A., Carpenter, B., Case, C., Satheesh, S., Suresh, B., Wang, T., Wu, D. J., & Ng, A. Y. (2011) · 2011 International Conference on Document Analysis and Recognition · doi:10.1109/icdar.2011.95 · Cited by 378
A Hybrid Approach to Detect and Localize Texts in Natural Scene Images
Pan, Y.-F., Hou, X., & Liu, C.-L. (2011) · IEEE Transactions on Image Processing · doi:10.1109/tip.2010.2070803 · Cited by 363
Deep Matching Prior Network: Toward Tighter Multi-oriented Text Detection
Liu, Y., & Jin, L. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.368 · Cited by 351
Text-Attentional Convolutional Neural Network for Scene Text Detection
He, T., Huang, W., Qiao, Y., & Yao, J. (2016) · IEEE Transactions on Image Processing · doi:10.1109/tip.2016.2547588 · Cited by 345
A Unified Framework for Multioriented Text Detection and Recognition
Yao, C., Bai, X., & Liu, W. (2014) · IEEE Transactions on Image Processing · doi:10.1109/tip.2014.2353813 · Cited by 343
Top-down and bottom-up cues for scene text recognition
Mishra, A., Alahari, K., & Jawahar, C. V. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6247990 · Cited by 335
Text String Detection From Natural Scenes by Structure-Based Partition and Grouping
Yi, C., & Tian, Y. (2011) · IEEE Transactions on Image Processing · doi:10.1109/tip.2011.2126586 · Cited by 335
Curved scene text detection via transverse and longitudinal sequence connection
Liu, Y., Jin, L., Zhang, S., Luo, C., & Zhang, S. (2019) · Pattern Recognition · doi:10.1016/j.patcog.2019.02.002 · Cited by 317
Text Localization in Natural Images Using Stroke Feature Transform and Text Covariance Descriptors
Huang, W., Lin, Z., Yang, J., & Wang, J. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.157 · Cited by 285
ICDAR 2005 text locating competition results
Lucas, S. M. (2005) · Eighth International Conference on Document Analysis and Recognition (ICDAR'05) · doi:10.1109/icdar.2005.231 · Cited by 284
Symmetry-based text line detection in natural scenes
Zhang, Z., Shen, W., Yao, C., & Bai, X. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298871 · Cited by 278
Multi-Orientation Scene Text Detection with Adaptive Clustering
Yin, X.-C., Pei, W.-Y., Zhang, J., & Hao, H.-W. (2015) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2014.2388210 · Cited by 259
Yi, C., Tian, Y., & Arditi, A. (2014) · IEEE/ASME Transactions on Mechatronics · doi:10.1109/tmech.2013.2261083 · Cited by 97
Recovering the sight to blind people in indoor environments with smart technologies
Mekhalfi, M. L., Melgani, F., Zeggada, A., De Natale, F. G. B., Salem, M. A.-M., & Khamis, A. (2016) · Expert Systems with Applications · doi:10.1016/j.eswa.2015.09.054 · Cited by 91
Stearns, L., Du, R., Oh, U., Wang, Y., Findlater, L., Chellappa, R., & Froehlich, J. E. (2015) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-16199-0_43 · Cited by 27
ASTS: A Unified Framework for Arbitrary Shape Text Spotting
Liu, J., Chen, Z., Du, B., & Tao, D. (2020) · IEEE Transactions on Image Processing · doi:10.1109/tip.2020.2984082 · Cited by 23
Reading visual braille with a retinal prosthesis
Lauritzen, T. Z., Harris, J., Mohand-Said, S., Sahel, J. A., Dorn, J. D., McClure, K., & Greenberg, R. J. (2012) · Frontiers in Neuroscience · doi:10.3389/fnins.2012.00168 · Cited by 22
Metadata
- Authors
- Chen, X., & Yuille, A. L.
- Venue
- Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004.
- Publisher
- IEEE
- Published
- 2004-11-12
- Volume
- 2
- Pages
- 366-373
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W2131673214
- Cited by
- 625
- References
- 23
- FWCI
- 11.77
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.