The DOI matches its Crossref record; 23 of the 23 references it cites were found in a registry or an index.
Real-time scene text localization and recognition
Abstract
An end-to-end real-time scene text localization and recognition method is presented. The real-time performance is achieved by posing the character detection problem as an efficient sequential selection from the set of Extremal Regions (ERs). The ER detector is robust to blur, illumination, color and texture variation and handles low-contrast text. In the first classification stage, the probability of each ER being a character is estimated using novel features calculated with O(1) complexity per region tested. Only ERs with locally maximal probability are selected for the second stage, where the classification is improved using more computationally expensive features. A highly efficient exhaustive search with feedback loops is then applied to group ERs into words and to select the most probable character segmentation. Finally, text is recognized in an OCR stage trained using synthetic fonts. The method was evaluated on two public datasets. On the ICDAR 2011 dataset, the method achieves state-of-the-art text localization results amongst published methods and it is the first one to report results for end-to-end text recognition. On the more challenging Street View Text dataset, the method achieves state-of-the-art recall. The robustness of the proposed method against noise and low contrast of characters is demonstrated by “false positives” caused by detected watermark text in the dataset.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A Computational Approach to Edge Detection
Canny, J. (1986) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.1986.4767851 · Cited by 30,004
Digital Image Processing: PIKS Inside
Pratt, W. K. (2002) · Wiley eBooks · doi:10.1002/0471221325 · Cited by 4,340
An Introduction to Support Vector Machines
Cristianini, N., & Shawe-Taylor, J. S. (2000) · ePrints Soton (University of Southampton) · Cited by 4,115
Robust wide-baseline stereo from maximally stable extremal regions
Matas, J., Chum, O., Urban, M., & Pajdla, T. (2004) · Image and Vision Computing · doi:10.1016/j.imavis.2004.02.006 · Cited by 3,686
Self-citationAn introduction to kernel-based learning algorithms
Muller, K.-R., Mika, S., Ratsch, G., Tsuda, K., & Scholkopf, B. (2001) · IEEE Transactions on Neural Networks · doi:10.1109/72.914517 · Cited by 3,473
Improved boosting algorithms using confidence-rated predictions
Schapire, R. E., & Singer, Y. (1998) · Proceedings of the eleventh annual conference on Computational learning theory · doi:10.1145/279943.279960 · Cited by 2,547
Improved Boosting Algorithms Using Confidence-rated Predictions
Schapire, R. E., & Singer, Y. (1999) · Machine Learning · doi:10.1023/a:1007614523901 · Cited by 1,971
Color image segmentation: advances and prospects
Cheng, H. D., Jiang, X. H., Sun, Y., & Wang, J. (2001) · Pattern Recognition · doi:10.1016/s0031-3203(00)00149-7 · Cited by 1,720
Detecting text in natural scenes with stroke width transform
Epshtein, B., Ofek, E., & Wexler, Y. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5540041 · Cited by 1,492
End-to-end scene text recognition
Wang, K., Babenko, B., & Belongie, S. (2011) · 2011 International Conference on Computer Vision · doi:10.1109/iccv.2011.6126402 · Cited by 1,060
Cited by
EAST: An Efficient and Accurate Scene Text Detector
Zhou, X., Yao, C., Wen, H., Wang, Y., Zhou, S., He, W., & Liang, J. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.283 · Cited by 1,850
Synthetic Data for Text Localisation in Natural Images
Gupta, A., Vedaldi, A., & Zisserman, A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.254 · Cited by 1,563
ICDAR 2015 competition on Robust Reading
Karatzas, D., Gomez-Bigorda, L., Nicolaou, A., Ghosh, S., Bagdanov, A., Iwamura, M., Matas, J., Neumann, L., Chandrasekhar, V. R., Lu, S., et al. (2015) · 2015 13th International Conference on Document Analysis and Recognition (ICDAR) · doi:10.1109/icdar.2015.7333942 · Cited by 1,547
Self-citationICDAR 2013 Robust Reading Competition
Karatzas, D., Shafait, F., Uchida, S., Iwamura, M., Bigorda, L. G. I., Mestre, S. R., Mas, J., Mota, D. F., Almazan, J. A., & de las Heras, L. P. (2013) · 2013 12th International Conference on Document Analysis and Recognition · doi:10.1109/icdar.2013.221 · Cited by 1,360
Reading text in the wild with convolutional neural networks
Jaderberg, M., Simonyan, K., Vedaldi, A., & Zisserman, A. (2016) · International Journal of Computer Vision · doi:10.1007/s11263-015-0823-z · Cited by 1,191
Speeding up Convolutional Neural Networks with Low Rank Expansions
Jaderberg, M., Vedaldi, A., & Zisserman, A. (2014) · Proceedings of the British Machine Vision Conference 2014 · doi:10.5244/c.28.88 · Cited by 1,164
TextBoxes: A Fast Text Detector with a Single Deep Neural Network
Liao, M., Shi, B., Bai, X., Wang, X., & Liu, W. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.11196 · Cited by 955
ASTER: An Attentional Scene Text Recognizer with Flexible Rectification
Shi, B., Yang, M., Wang, X., Lyu, P., Yao, C., & Bai, X. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2848939 · Cited by 906
TextBoxes++: A Single-Shot Oriented Scene Text Detector
Liao, M., Shi, B., & Bai, X. (2018) · IEEE Transactions on Image Processing · doi:10.1109/tip.2018.2825107 · Cited by 897
Scene Text Recognition using Higher Order Language Priors
Mishra, A., Alahari, K., & Jawahar, C. (2012) · Procedings of the British Machine Vision Conference 2012 · doi:10.5244/c.26.127 · Cited by 831
Text Detection and Recognition in Imagery: A Survey
Ye, Q., & Doermann, D. (2015) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2014.2366765 · Cited by 780
Synthetic Data and Artificial Neural Networks for Natural Scene Text Recognition
Jaderberg, M., Simonyan, K., Vedaldi, A., & Zisserman, A. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1406.2227 · Cited by 726
Robust Scene Text Recognition with Automatic Rectification
Shi, B., Wang, X., Lyu, P., Yao, C., & Bai, X. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.452 · Cited by 693
Deep Features for Text Spotting
Jaderberg, M., Vedaldi, A., & Zisserman, A. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10593-2_34 · Cited by 653
Robust Text Detection in Natural Scene Images
Yin, X.-C., Yin, X., Huang, K., & Hao, H.-W. (2014) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.182 · Cited by 633
Multi-oriented Text Detection with Fully Convolutional Networks
Zhang, Z., Zhang, C., Shen, W., Yao, C., Liu, W., & Bai, X. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.451 · Cited by 596
A robust arbitrary text detection system for natural scene images
Risnumawan, A., Shivakumara, P., Chan, C. S., & Tan, C. L. (2014) · Expert Systems with Applications · doi:10.1016/j.eswa.2014.07.008 · Cited by 531
Focusing Attention: Towards Accurate Text Recognition in Natural Images
Cheng, Z., Bai, F., Xu, Y., Zheng, G., Pu, S., & Zhou, S. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.543 · Cited by 528
Scene Text Detection and Recognition: The Deep Learning Era
Long, S., He, X., & Yao, C. (2021) · International Journal of Computer Vision · doi:10.1007/s11263-020-01369-0 · Cited by 527
Mask TextSpotter: An End-to-End Trainable Neural Network for Spotting Text with Arbitrary Shapes
Lyu, P., Liao, M., Yao, C., Wu, W., & Bai, X. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01264-9_5 · Cited by 522
Word Spotting and Recognition with Embedded Attributes
Almazan, J., Gordo, A., Fornes, A., & Valveny, E. (2014) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2014.2339814 · Cited by 517
MORAN: A Multi-Object Rectified Attention Network for scene text recognition
Luo, C., Jin, L., & Sun, Z. (2019) · Pattern Recognition · doi:10.1016/j.patcog.2019.01.020 · Cited by 510
Recognizing Text with Perspective Distortion in Natural Scenes
Phan, T. Q., Shivakumara, P., Tian, S., & Tan, C. L. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.76 · Cited by 473
Recursive Recurrent Nets with Attention Modeling for OCR in the Wild
Lee, C.-Y., & Osindero, S. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.245 · Cited by 458
Speeding up Convolutional Neural Networks with Low Rank Expansions
Jaderberg, M., Vedaldi, A., & Zisserman, A. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1405.3866 · Cited by 447
Real-Time Scene Text Detection With Differentiable Binarization and Adaptive Scale Fusion
Liao, M., Zou, Z., Wan, Z., Yao, C., & Bai, X. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3155612 · Cited by 431
Scene text detection and recognition: recent advances and future trends
Zhu, Y., Yao, C., & Bai, X. (2016) · Frontiers of Computer Science · doi:10.1007/s11704-015-4488-0 · Cited by 402
Robust Scene Text Detection with Convolution Neural Network Induced MSER Trees
Huang, W., Qiao, Y., & Tang, X. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10593-2_33 · Cited by 381
Deep Matching Prior Network: Toward Tighter Multi-oriented Text Detection
Liu, Y., & Jin, L. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.368 · Cited by 351
Toward End-to-End Car License Plate Detection and Recognition With Deep Neural Networks
Li, H., Wang, P., & Shen, C. (2019) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2018.2847291 · Cited by 346
Text-Attentional Convolutional Neural Network for Scene Text Detection
He, T., Huang, W., Qiao, Y., & Yao, J. (2016) · IEEE Transactions on Image Processing · doi:10.1109/tip.2016.2547588 · Cited by 345
TextField: Learning a Deep Direction Field for Irregular Scene Text Detection
Xu, Y., Wang, Y., Zhou, W., Wang, Y., Yang, Z., & Bai, X. (2019) · IEEE Transactions on Image Processing · doi:10.1109/tip.2019.2900589 · Cited by 345
Single Shot Text Detector with Regional Attention
He, P., Huang, W., He, T., Zhu, Q., Qiao, Y., & Li, X. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.331 · Cited by 344
A Unified Framework for Multioriented Text Detection and Recognition
Yao, C., Bai, X., & Liu, W. (2014) · IEEE Transactions on Image Processing · doi:10.1109/tip.2014.2353813 · Cited by 343
SEED: Semantics Enhanced Encoder-Decoder Framework for Scene Text Recognition
Qiao, Z., Zhou, Y., Yang, D., Zhou, Y., & Wang, W. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01354 · Cited by 311
Strokelets: A Learned Multi-scale Representation for Scene Text Recognition
Yao, C., Bai, X., Shi, B., & Liu, W. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.515 · Cited by 306
ESIR: End-To-End Scene Text Recognition via Iterative Image Rectification
Zhan, F., & Lu, S. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00216 · Cited by 296
Decoupled Attention Network for Text Recognition
Wang, T., Zhu, Y., Jin, L., Luo, C., Chen, X., Wu, Y., Wang, Q., & Cai, M. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i07.6903 · Cited by 294
AON: Towards Arbitrarily-Oriented Text Recognition
Cheng, Z., Xu, Y., Bai, F., Niu, Y., Pu, S., & Zhou, S. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00584 · Cited by 292
Text Localization in Natural Images Using Stroke Feature Transform and Text Covariance Descriptors
Huang, W., Lin, Z., Yang, J., & Wang, J. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.157 · Cited by 285
Symmetry-based text line detection in natural scenes
Zhang, Z., Shen, W., Yao, C., & Bai, X. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298871 · Cited by 278
Multi-Orientation Scene Text Detection with Adaptive Clustering
Yin, X.-C., Pei, W.-Y., Zhang, J., & Hao, H.-W. (2015) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2014.2388210 · Cited by 259
Text Recognition in the Wild: A Survey
Chen, X., Jin, L., Zhu, Y., Luo, C., & Wang, T. (2022) · ACM Computing Surveys · doi:10.1145/3440756 · Cited by 205
“Early research [196], [141], [218] mainly relied on hand-crafted features.”
BackgroundMethodInfluentialYan, C., Xie, H., Liu, S., Yin, J., Zhang, Y., & Dai, Q. (2018) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2017.2749977 · Cited by 176
ForeSee: A Customizable Head-Mounted Vision Enhancement System for People with Low Vision
Zhao, Y., Szpiro, S., & Azenkot, S. (2015) · Proceedings of the 17th International ACM SIGACCESS Conference on Computers & Accessibility - ASSETS '15 · doi:10.1145/2700648.2809865 · Cited by 115
An enhanced text detection technique for the visually impaired to read text
Joan, S. P. F., & Valli, S. (2017) · Information Systems Frontiers · doi:10.1007/s10796-016-9699-x · Cited by 17
Metadata
- Authors
- Neumann, L., & Matas, J.
- Venue
- 2012 IEEE Conference on Computer Vision and Pattern Recognition
- Publisher
- IEEE
- Published
- 2012-06
- Pages
- 3538-3545
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W2061802763
- Cited by
- 827
- References
- 23
- FWCI
- 48.32
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.