The DOI matches its Crossref record; 60 of the 60 references it cites were found in a registry or an index.
A Unified Framework for Multioriented Text Detection and Recognition
Abstract
High level semantics embodied in scene texts are both rich and clear and thus can serve as important cues for a wide range of vision applications, for instance, image understanding, image indexing, video search, geolocation, and automatic navigation. In this paper, we present a unified framework for text detection and recognition in natural images. The contributions of this paper are threefold: 1) text detection and recognition are accomplished concurrently using exactly the same features and classification scheme; 2) in contrast to methods in the literature, which mainly focus on horizontal or near-horizontal texts, the proposed system is capable of localizing and reading texts of varying orientations; and 3) a new dictionary search method is proposed, to correct the recognition errors usually caused by confusions among similar yet different characters. As an additional contribution, a novel image database with texts of different scales, colors, fonts, and orientations in diverse real-world scenarios, is generated and released. Extensive experiments on standard benchmarks as well as the proposed database demonstrate that the proposed system achieves highly competitive performance, especially on multioriented texts.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538
Binary Codes capable of currecting deletions, insertions, and reversals
Levenshtein, V. I. (1965) · Soviet physics. Doklady · Cited by 14,811
Contour Detection and Hierarchical Image Segmentation
Arbeláez, P., Maire, M., Fowlkes, C., & Malik, J. (2011) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2010.161 · Cited by 5,454
Object retrieval with large vocabularies and fast spatial matching
Philbin, J., Chum, O., Isard, M., Sivic, J., & Zisserman, A. (2007) · 2007 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2007.383172 · Cited by 2,929
The PASCAL visual object classes challenge 2006 (VOC2006) results
Everingham, M., Zisserman, A., Williams, C. K. I., & Gool, L. V. (2006) · Cited by 2,079
Detecting text in natural scenes with stroke width transform
Epshtein, B., Ofek, E., & Wexler, Y. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5540041 · Cited by 1,492
Vision for mobile robot navigation: a survey
Desouza, G. N., & Kak, A. C. (2002) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.982903 · Cited by 1,357
Robust Wide Baseline Stereo from Maximally Stable Extremal Regions
Matas, J., Chum, O., Urban, M., & Pajdla, T. (2002) · Procedings of the British Machine Vision Conference 2002 · doi:10.5244/c.16.36 · Cited by 1,350
Shape Quantization and Recognition with Randomized Trees
Amit, Y., & Geman, D. (1997) · Neural Computation · doi:10.1162/neco.1997.9.7.1545 · Cited by 1,275
Techniques for automatically correcting words in text
Kukich, K. (1992) · ACM Computing Surveys · doi:10.1145/146370.146380 · Cited by 1,257
End-to-end scene text recognition
Wang, K., Babenko, B., & Belongie, S. (2011) · 2011 International Conference on Computer Vision · doi:10.1109/iccv.2011.6126402 · Cited by 1,060
Semantic texton forests for image categorization and segmentation
Shotton, J., Johnson, M., & Cipolla, R. (2008) · 2008 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2008.4587503 · Cited by 1,014
A Normalized Levenshtein Distance Metric
Yujian, L., & Bo, L. (2007) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2007.1078 · Cited by 986
Text information extraction in images and video: a survey
Jung, K., In Kim, K., & K. Jain, A. (2004) · Pattern Recognition · doi:10.1016/j.patcog.2003.10.012 · Cited by 846
Real-time scene text localization and recognition
Neumann, L., & Matas, J. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6248097 · Cited by 827
Detecting texts of arbitrary orientations in natural images
Yao, C., Bai, X., Liu, W., Ma, Y., & Tu, Z. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6247787 · Cited by 765
Self-citationSharing Visual Features for Multiclass and Multiview Object Detection
Torralba, A., Murphy, K. P., & Freeman, W. T. (2007) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2007.1055 · Cited by 700
Robust Text Detection in Natural Scene Images
Yin, X.-C., Yin, X., Huang, K., & Hao, H.-W. (2014) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.182 · Cited by 633
Detecting and reading text in natural scenes
Chen, X., & Yuille, A. L. (2004) · Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004. · doi:10.1109/cvpr.2004.1315187 · Cited by 625
Sharing features: efficient boosting procedures for multiclass object detection
Torralba, A., Murphy, K. P., & Freeman, W. T. (2004) · Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004. · doi:10.1109/cvpr.2004.1315241 · Cited by 577
ICDAR 2003 robust reading competitions
Lucas, S. M., Panaretos, A., Sosa, L., et al. (2005) · Proceedings of the International Conference on Document Analysis and Recognition · doi:10.1109/icdar.2003.1227749 · Cited by 568
Automatic text detection and tracking in digital video
Li, H., Doermann, D., & Kia, O. (2000) · IEEE Transactions on Image Processing · doi:10.1109/83.817607 · Cited by 547
A Method for Text Localization and Recognition in Real-World Images
Neumann, L., & Matas, J. (2011) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-19318-7_60 · Cited by 487
Wang, K., & Belongie, S. (2010) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-15549-9_43 · Cited by 449
Kim, K. I., Jung, K., & Kim, J. H. (2003) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2003.1251157 · Cited by 449
CHARACTER RECOGNITION IN NATURAL IMAGES
de Campos, T. E., Babu, B. R., & Varma, M. (2009) · Cited by 448
Robust text detection in natural images with edge-enhanced Maximally Stable Extremal Regions
Chen, H., Tsai, S. S., Schroth, G., Chen, D. M., Grzeszczuk, R., & Girod, B. (2011) · 2011 18th IEEE International Conference on Image Processing · doi:10.1109/icip.2011.6116200 · Cited by 426
Camera-based analysis of text and documents: a survey
Liang, J., Doermann, D., & Li, H. (2005) · International Journal of Document Analysis and Recognition (IJDAR) · doi:10.1007/s10032-004-0138-z · Cited by 419
Randomized Trees for Real-Time Keypoint Recognition
Lepetit, V., Lagger, P., & Fua, P. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.288 · Cited by 415
ICDAR 2011 Robust Reading Competition Challenge 2: Reading Text in Scene Images
Shahab, A., Shafait, F., & Dengel, A. (2011) · 2011 International Conference on Document Analysis and Recognition · doi:10.1109/icdar.2011.296 · Cited by 394
Text Detection and Character Recognition in Scene Images with Unsupervised Feature Learning
Coates, A., Carpenter, B., Case, C., Satheesh, S., Suresh, B., Wang, T., Wu, D. J., & Ng, A. Y. (2011) · 2011 International Conference on Document Analysis and Recognition · doi:10.1109/icdar.2011.95 · Cited by 378
A Hybrid Approach to Detect and Localize Texts in Natural Scene Images
Pan, Y.-F., Hou, X., & Liu, C.-L. (2011) · IEEE Transactions on Image Processing · doi:10.1109/tip.2010.2070803 · Cited by 363
Object count/area graphs for the evaluation of object detection and segmentation algorithms
Wolf, C., & Jolion, J.-M. (2006) · International Journal on Document Analysis and Recognition (IJDAR) · doi:10.1007/s10032-006-0014-0 · Cited by 350
Top-down and bottom-up cues for scene text recognition
Mishra, A., Alahari, K., & Jawahar, C. V. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6247990 · Cited by 335
Text String Detection From Natural Scenes by Structure-Based Partition and Grouping
Yi, C., & Tian, Y. (2011) · IEEE Transactions on Image Processing · doi:10.1109/tip.2011.2126586 · Cited by 335
Automatic caption localization in compressed video
Zhong, Y., Zhang, H., & Jain, A. K. (2000) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.845381 · Cited by 333
Strokelets: A Learned Multi-scale Representation for Scene Text Recognition
Yao, C., Bai, X., Shi, B., & Liu, W. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.515 · Cited by 306
Self-citationRandomized Clustering Forests for Image Classification
Moosmann, F., Nowak, E., & Jurie, F. (2008) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2007.70822 · Cited by 287
ICDAR 2005 text locating competition results
Lucas, S. M. (2005) · Eighth International Conference on Document Analysis and Recognition (ICDAR'05) · doi:10.1109/icdar.2005.231 · Cited by 284
Text detection and recognition in images and video frames
Chen, D., Odobez, J.-M., & Bourlard, H. (2004) · Pattern Recognition · doi:10.1016/j.patcog.2003.06.001 · Cited by 277
CHARACTER RECOGNITION IN NATURAL IMAGES
(2009) · Proceedings of the Fourth International Conference on Computer Vision Theory and Applications · doi:10.5220/0001770102730280 · Cited by 274
Scene Text Detection via Connected Component Clustering and Nontext Filtering
Koo, H. I., & Kim, D. H. (2013) · IEEE Transactions on Image Processing · doi:10.1109/tip.2013.2249082 · Cited by 228
Scene Text Localization and Recognition with Oriented Stroke Detection
Neumann, L., & Matas, J. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.19 · Cited by 220
Scene text detection using graph model built upon maximally stable extremal regions
Shi, C., Wang, C., Xiao, B., Zhang, Y., & Gao, S. (2013) · Pattern Recognition Letters · doi:10.1016/j.patrec.2012.09.019 · Cited by 186
Randomized trees for human pose detection
Rogez, G., Rihan, J., Ramalingam, S., Orrite, C., & Torr, P. H. S. (2008) · 2008 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2008.4587617 · Cited by 173
Automatic text recognition in digital videos:
Lienhart, R. W., & Stuber, F. (1996) · SPIE Proceedings · doi:10.1117/12.234741 · Cited by 160
Large-Lexicon Attribute-Consistent Text Recognition in Natural Images
Novikova, T., Barinova, O., Kohli, P., et al. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-33783-3_54 · Cited by 116
Levenshtein Distance Technique in Dictionary Lookup Methods: An Improved ApproachPreprint
Haldar, R., & Mukhopadhyay, D. (2011) · arXiv (Cornell University) · doi:10.48550/arxiv.1101.1232 · Cited by 101
Streetscenes: towards scene understanding in still images
Poggio, T., & Bileschi, S. (2006) · Cited by 67
Robustly Extracting Captions in Videos Based on Stroke-Like Edges and Spatio-Temporal Analysis
Liu, X., & Wang, W.-Q. (2012) · IEEE transactions on multimedia · doi:10.1109/tmm.2011.2177646 · Cited by 62
Image Binarization for End-to-End Text Understanding in Natural Images
Milyaev, S., Barinova, O., Novikova, T., et al. (2013) · Proceedings of the International Conference on Document Analysis and Recognition · doi:10.1109/icdar.2013.33 · Cited by 60
NEOCR: A Configurable Dataset for Natural Image Text Recognition
Nagy, R., Dicker, A., & Meyer-Wegener, K. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-29364-1_12 · Cited by 56
Mobile visual search on printed documents using text and low bit-rate features
Tsai, S. S., Chen, H., Chen, D. M., Schroth, G., Grzeszczuk, R., & Girod, B. (2011) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2011.6116198 · Cited by 55
Text Detection in Natural Scene Images by Stroke Gabor Words
Yi, C., & Tian, Y. (2011) · Proceedings of the International Conference on Document Analysis and Recognition · doi:10.1109/icdar.2011.44 · Cited by 52
Shared Features for Scalable Appearance-Based Object Recognition
Murphy-Chutorian, E., & Triesch, J. (2005) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/acvmot.2005.109 · Cited by 46
Limits on the Application of Frequency-Based Language Models to OCR
Smith, R. W. (2011) · Proceedings of the International Conference on Document Analysis and Recognition · doi:10.1109/icdar.2011.114 · Cited by 39
Accurate and robust text detection
Yin, X.-C., Yin, X., Huang, K., & Hao, H. (2013) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/2484028.2484197 · Cited by 32
Rotation-Invariant Features for Multi-Oriented Text Detection in Natural Images
Yao, C., Zhang, X., Bai, X., Liu, W., Ma, Y., & Tu, Z. (2013) · PLoS ONE · doi:10.1371/journal.pone.0070173 · Cited by 28
Self-citationHuman Detection Using Learned Part Alphabet and Pose Dictionary
Yao, C., Bai, X., Liu, W., & Latecki, L. J. (2014) · Lecture notes in computer science · doi:10.1007/978-3-319-10602-1_17 · Cited by 24
Self-citationStreet Scenes : towards scene understanding in still images
Bileschi, S. (2006) · Cited by 17
Cited by
Shi, B., Bai, X., & Yao, C. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2646371 · Cited by 3,172
Self-citationEAST: An Efficient and Accurate Scene Text Detector
Zhou, X., Yao, C., Wen, H., Wang, Y., Zhou, S., He, W., & Liang, J. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.283 · Cited by 1,850
Self-citationArbitrary-Oriented Scene Text Detection via Rotation Proposals
Ma, J., Shao, W., Ye, H., Wang, L., Wang, H., Zheng, Y., & Xue, X. (2018) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2018.2818020 · Cited by 1,260
Detecting Text in Natural Image with Connectionist Text Proposal Network
Tian, Z., Huang, W., He, T., He, P., & Qiao, Y. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46484-8_4 · Cited by 1,053
Gliding Vertex on the Horizontal Bounding Box for Multi-Oriented Object Detection
Xu, Y., Fu, M., Wang, Q., Wang, Y., Chen, K., Xia, G.-S., & Bai, X. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.2974745 · Cited by 1,014
Self-citation
Metadata
- Authors
- Yao, C., Bai, X., & Liu, W.
- Venue
- IEEE Transactions on Image Processing
- Published
- 2014-11
- Volume
- 23
- Issue
- 11
- Pages
- 4737-4749
- ISSN
- 1057-7149 (ISSN-L)
- 1941-0042
- OpenAlex
- W1988461287
- Cited by
- 343
- References
- 60
- FWCI
- 22.25
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.