Scene Text Detection and Recognition: The Deep Learning Era
Open accessThe DOI matches its Crossref record; 155 of the 155 references it cites were found in a registry or an index.
Abstract
With the rise and development of deep learning, computer vision has been tremendously transformed and reshaped. As an important research area in computer vision, scene text detection and recognition has been inevitably influenced by this wave of revolution, consequentially entering the era of deep learning. In recent years, the community has witnessed substantial advancements in mindset, methodology and performance. This survey is aimed at summarizing and analyzing the major changes and significant progresses of scene text detection and recognition in the deep learning era. Through this article, we devote to: (1) introduce new insights and ideas; (2) highlight recent techniques and benchmarks; (3) look ahead into future trends. Specifically, we will emphasize the dramatic differences brought by deep learning and remaining grand challenges. We expect that this review paper would serve as a reference book for researchers in this field. Related resources are also collected in our Github repository (https://github.com/Jyouhou/SceneTextPapers).
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318 · cited 1×
“tion. Extending from quadrilateral bounding box, it’s natural to use bounding ’boxes’ with more that 4 vertexes. Bounding polygons [94] with as many as 14 vertexes are proposed, followed by a Bi-LSTM [53] layer to refine the coordinates of the predicted vertexes. In their framework, however, axis-aligned rectangles are…”
U-Net: Convolutional Networks for Biomedical Image Segmentation
Ronneberger, O., Fischer, P., & Brox, T. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24574-4_28 · Cited by 99,404
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2577031 · Cited by 73,472
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2015) · arXiv · doi:10.48550/arxiv.1506.01497 · Cited by 70,812
You Only Look Once: Unified, Real-Time Object Detection
Redmon, J., Divvala, S., Girshick, R., & Farhadi, A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.91 · Cited by 53,803
Densely Connected Convolutional Networks
Huang, G., Liu, Z., Van Der Maaten, L., & Weinberger, K. Q. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.243 · Cited by 48,566
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380 · cited 2×
“dually surpassed traditional methods and finally achieved better performance than human do [48], [57], [74], [141]. AlexNet [74] was the winner of the ImageNet Large Scale Visual Recognition Challenge [127] in 2012, achieving 10:8% less top-5 error rate than the runnerup. It uses a sequence of Convolutional Neural Netw…”
BackgroundMethodFully convolutional networks for semantic segmentation
Long, J., Shelhamer, E., & Darrell, T. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298965 · Cited by 38,834
Histograms of Oriented Gradients for Human Detection
Dalal, N., & Triggs, B. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.177 · Cited by 33,584
Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation
Girshick, R., Donahue, J., Darrell, T., & Malik, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.81 · Cited by 32,684
(2016) · Cited by 31,590
He, K., Gkioxari, G., Dollar, P., & Girshick, R. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.322 · Cited by 29,137
Girshick, R. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.169 · Cited by 28,105
SSD: Single Shot MultiBox Detector
Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S., Fu, C.-Y., & Berg, A. C. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46448-0_2 · Cited by 22,128
YOLO9000: Better, Faster, Stronger
Redmon, J., & Farhadi, A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.690 · Cited by 19,892
Sequence to Sequence Learning with Neural Networks
Sutskever, I., Vinyals, O., & Le, Q. V. (2014) · arXiv · doi:10.48550/arxiv.1409.3215 · Cited by 17,766
Neural Machine Translation by Jointly Learning to Align and Translate
Bahdanau, D., Cho, K., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1409.0473 · Cited by 16,213
Distilling the Knowledge in a Neural Network
Hinton, G., Vinyals, O., & Dean, J. (2015) · arXiv · doi:10.48550/arxiv.1503.02531 · Cited by 14,204
V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentation
Milletari, F., Navab, N., & Ahmadi, S.-A. (2016) · 2016 Fourth International Conference on 3D Vision (3DV) · doi:10.1109/3dv.2016.79 · Cited by 11,931
Show, Attend and Tell: Neural Image Caption Generation with Visual Attention
Xu, K., Ba, J., Kiros, R., Cho, K., Courville, A., Salakhutdinov, R., Zemel, R., & Bengio, Y. (2015) · arXiv · doi:10.48550/arxiv.1502.03044 · Cited by 8,248
The Pascal Visual Object Classes Challenge: A Retrospective
Everingham, M., Eslami, S. M. A., Van Gool, L., Williams, C. K. I., Winn, J., & Zisserman, A. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-014-0733-5 · Cited by 7,139 · cited 1×
“• PASCAL (Everingham et al., 2015): The basic idea is that, if the intersection-over-union value, i.”
BackgroundContour Detection and Hierarchical Image Segmentation
Arbeláez, P., Maire, M., Fowlkes, C., & Malik, J. (2011) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2010.161 · Cited by 5,454
Graves, A., Fernández, S., Gomez, F., & Schmidhuber, J. (2006) · Proceedings of the 23rd international conference on Machine learning - ICML '06 · doi:10.1145/1143844.1143891 · Cited by 5,370
Shi, B., Bai, X., & Yao, C. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2646371 · Cited by 3,172
Self-citationDeep Learning for Generic Object Detection: A Survey
Liu, L., Ouyang, W., Wang, X., Fieguth, P., Chen, J., Liu, X., & Pietikäinen, M. (2020) · International Journal of Computer Vision · doi:10.1007/s11263-019-01247-4 · Cited by 2,965
Deep Learning for Generic Object Detection: A Survey
Liu, L., Ouyang, W., Wang, X., Fieguth, P., Chen, J., Liu, X., & Pietikäinen, M. (2018) · arXiv · doi:10.48550/arxiv.1809.02165 · Cited by 2,965
Convolutional Sequence to Sequence Learning
Gehring, J., Auli, M., Grangier, D., Yarats, D., & Dauphin, Y. N. (2017) · arXiv · doi:10.48550/arxiv.1705.03122 · Cited by 2,850 · cited 1×
“decoder generates output sequence until it hits a stop symbol. We also refer readers to the following papers for recent advances in machine translation: Transformer [151], Convolutional Seq2Seq [31], [32], and the architecture evaluation survey [11]. These sequence modeling modules allow end-to-end gradient-based lear…”
BackgroundInfluentialEdge Boxes: Locating Object Proposals from Edges
Zitnick, C. L., & Dollár, P. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10602-1_26 · Cited by 2,656
Pictorial Structures for Object Recognition
Felzenszwalb, P. F., & Huttenlocher, D. P. (2005) · International Journal of Computer Vision · doi:10.1023/b:visi.0000042934.15159.49 · Cited by 2,180
A Novel Connectionist System for Unconstrained Handwriting Recognition
Graves, A., Liwicki, M., Fernandez, S., Bertolami, R., Bunke, H., & Schmidhuber, J. (2009) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2008.137 · Cited by 1,983
Fast Feature Pyramids for Object Detection
Dollar, P., Appel, R., Belongie, S., & Perona, P. (2014) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2014.2300479 · Cited by 1,955
EAST: An Efficient and Accurate Scene Text Detector
Zhou, X., Yao, C., Wen, H., Wang, Y., Zhou, S., He, W., & Liang, J. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.283 · Cited by 1,850
Self-citationDSSD : Deconvolutional Single Shot Detector
Fu, C.-Y., Liu, W., Ranga, A., Tyagi, A., & Berg, A. C. (2017) · arXiv · doi:10.48550/arxiv.1701.06659 · Cited by 1,624 · cited 1×
“These methods mainly draw inspiration from techniques in general object detection [27], [30], [31], [42], [76], [107], and benefit from the highly integrated neural network modules that can predict text instances directly.”
MethodSynthetic Data for Text Localisation in Natural Images
Gupta, A., Vedaldi, A., & Zisserman, A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.254 · Cited by 1,563
ICDAR 2015 competition on Robust Reading
Karatzas, D., Gomez-Bigorda, L., Nicolaou, A., Ghosh, S., Bagdanov, A., Iwamura, M., Matas, J., Neumann, L., Chandrasekhar, V. R., Lu, S., et al. (2015) · 2015 13th International Conference on Document Analysis and Recognition (ICDAR) · doi:10.1109/icdar.2015.7333942 · Cited by 1,547
Detecting text in natural scenes with stroke width transform
Epshtein, B., Ofek, E., & Wexler, Y. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5540041 · Cited by 1,492
ICDAR 2013 Robust Reading Competition
Karatzas, D., Shafait, F., Uchida, S., Iwamura, M., Bigorda, L. G. I., Mestre, S. R., Mas, J., Mota, D. F., Almazan, J. A., & de las Heras, L. P. (2013) · 2013 12th International Conference on Document Analysis and Recognition · doi:10.1109/icdar.2013.221 · Cited by 1,360
Vision for mobile robot navigation: a survey
Desouza, G. N., & Kak, A. C. (2002) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.982903 · Cited by 1,357
Arbitrary-Oriented Scene Text Detection via Rotation Proposals
Ma, J., Shao, W., Ye, H., Wang, L., Wang, H., Zheng, Y., & Xue, X. (2018) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2018.2818020 · Cited by 1,260
Reading text in the wild with convolutional neural networks
Jaderberg, M., Simonyan, K., Vedaldi, A., & Zisserman, A. (2016) · International Journal of Computer Vision · doi:10.1007/s11263-015-0823-z · Cited by 1,191
Character Region Awareness for Text Detection
Baek, Y., Lee, B., Han, D., Yun, S., & Lee, H. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00959 · Cited by 1,103
End-to-end scene text recognition
Wang, K., Babenko, B., & Belongie, S. (2011) · 2011 International Conference on Computer Vision · doi:10.1109/iccv.2011.6126402 · Cited by 1,060
Detecting Text in Natural Image with Connectionist Text Proposal Network
Tian, Z., Huang, W., He, T., He, P., & Qiao, Y. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46484-8_4 · Cited by 1,053
TextBoxes: A Fast Text Detector with a Single Deep Neural Network
Liao, M., Shi, B., Bai, X., Wang, X., & Liu, W. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.11196 · Cited by 955
ASTER: An Attentional Scene Text Recognizer with Flexible Rectification
Shi, B., Yang, M., Wang, X., Lyu, P., Yao, C., & Bai, X. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2848939 · Cited by 906
Self-citationTextBoxes++: A Single-Shot Oriented Scene Text Detector
Liao, M., Shi, B., & Bai, X. (2018) · IEEE Transactions on Image Processing · doi:10.1109/tip.2018.2825107 · Cited by 897
Deep convolutional neural fields for depth estimation from a single image
Liu, F., Shen, C., & Lin, G. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7299152 · Cited by 892
Shape Robust Text Detection With Progressive Scale Expansion Network
Wang, W., Xie, E., Li, X., Hou, W., Lu, T., Yu, G., & Shao, S. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00956 · Cited by 860
Text information extraction in images and video: a survey
Jung, K., In Kim, K., & K. Jain, A. (2004) · Pattern Recognition · doi:10.1016/j.patcog.2003.10.012 · Cited by 846
End-to-End Text Recognition with Convolutional Neural Networks
Wang, T., Wu, D. J., Coates, A., & Ng, A. Y. (2012) · Cited by 839
Scene Text Recognition using Higher Order Language Priors
Mishra, A., Alahari, K., & Jawahar, C. (2012) · Procedings of the British Machine Vision Conference 2012 · doi:10.5244/c.26.127 · Cited by 831
Real-time scene text localization and recognition
Neumann, L., & Matas, J. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6248097 · Cited by 827
Text Detection and Recognition in Imagery: A Survey
Ye, Q., & Doermann, D. (2015) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2014.2366765 · Cited by 780
Detecting Oriented Text in Natural Images by Linking Segments
Shi, B., Bai, X., & Belongie, S. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.371 · Cited by 775
Detecting texts of arbitrary orientations in natural images
Yao, C., Bai, X., Liu, W., Ma, Y., & Tu, Z. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6247787 · Cited by 765
Self-citationSynthetic Data and Artificial Neural Networks for Natural Scene Text Recognition
Jaderberg, M., Simonyan, K., Vedaldi, A., & Zisserman, A. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1406.2227 · Cited by 726
Robust Scene Text Recognition with Automatic Rectification
Shi, B., Wang, X., Lyu, P., Yao, C., & Bai, X. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.452 · Cited by 693
Self-citationDeep Features for Text Spotting
Jaderberg, M., Vedaldi, A., & Zisserman, A. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10593-2_34 · Cited by 653
TextSnake: A Flexible Representation for Detecting Text of Arbitrary Shapes
Long, S., Ruan, J., Zhang, W., He, X., Wu, W., & Yao, C. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01216-8_2 · Cited by 636
Self-citationRobust Text Detection in Natural Scene Images
Yin, X.-C., Yin, X., Huang, K., & Hao, H.-W. (2014) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.182 · Cited by 633
PixelLink: Detecting Scene Text via Instance Segmentation
Deng, D., Liu, H., Li, X., & Cai, D. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.12269 · Cited by 632
Advanced Deep-Learning Techniques for Salient and Category-Specific Object Detection: A Survey
Han, J., Zhang, D., Cheng, G., Liu, N., & Xu, D. (2018) · IEEE Signal Processing Magazine · doi:10.1109/msp.2017.2749125 · Cited by 621
What Is Wrong With Scene Text Recognition Model Comparisons? Dataset and Model Analysis
Baek, J., Kim, G., Lee, J., Park, S., Han, D., Yun, S., Oh, S. J., & Lee, H. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00481 · Cited by 617
Multi-oriented Text Detection with Fully Convolutional Networks
Zhang, Z., Zhang, C., Shen, W., Yao, C., Liu, W., & Bai, X. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.451 · Cited by 596
Self-citationTotal-Text: A Comprehensive Dataset for Scene Text Detection and Recognition
Ch'ng, C. K., & Chan, C. S. (2017) · 2017 14th IAPR International Conference on Document Analysis and Recognition (ICDAR) · doi:10.1109/icdar.2017.157 · Cited by 571
Rotation-Sensitive Regression for Oriented Scene Text Detection
Liao, M., Zhu, Z., Shi, B., Xia, G.-S., & Bai, X. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00619 · Cited by 563
FOTS: Fast Oriented Text Spotting with a Unified Network
Liu, X., Liang, D., Yan, S., Chen, D., Qiao, Y., & Yan, J. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00595 · Cited by 554
Focusing Attention: Towards Accurate Text Recognition in Natural Images
Cheng, Z., Bai, F., Xu, Y., Zheng, G., Pu, S., & Zhou, S. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.543 · Cited by 528
Mask TextSpotter: An End-to-End Trainable Neural Network for Spotting Text with Arbitrary Shapes
Lyu, P., Liao, M., Yao, C., Wu, W., & Bai, X. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01264-9_5 · Cited by 522
Self-citationWord Spotting and Recognition with Embedded Attributes
Almazan, J., Gordo, A., Fornes, A., & Valveny, E. (2014) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2014.2339814 · Cited by 517
A Method for Text Localization and Recognition in Real-World Images
Neumann, L., & Matas, J. (2011) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-19318-7_60 · Cited by 487
Recognizing Text with Perspective Distortion in Natural Scenes
Phan, T. Q., Shivakumara, P., Tian, S., & Tan, C. L. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.76 · Cited by 473
Recursive Recurrent Nets with Attention Modeling for OCR in the Wild
Lee, C.-Y., & Osindero, S. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.245 · Cited by 458
PhotoOCR: Reading Text in Uncontrolled Conditions
Bissacco, A., Cummins, M., Netzer, Y., & Neven, H. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.102 · Cited by 457
Automatic text location in images and video frames
Jain, A. K., & Yu, B. (2002) · Proceedings. Fourteenth International Conference on Pattern Recognition (Cat. No.98EX170) · doi:10.1109/icpr.1998.711990 · Cited by 450
R2CNN: Rotational Region CNN for Orientation Robust Scene Text Detection
Jiang, Y., Zhu, X., Wang, X., Yang, S., Li, W., Wang, H., Fu, P., & Luo, Z. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1706.09579 · Cited by 448
Deep Direct Regression for Multi-oriented Scene Text Detection
He, W., Zhang, X.-Y., Yin, F., & Liu, C.-L. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.87 · Cited by 432
Show, Attend and Read: A Simple and Strong Baseline for Irregular Text Recognition
Li, H., Wang, P., Shen, C., & Zhang, G. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33018610 · Cited by 432
Scene text detection and recognition: recent advances and future trends
Zhu, Y., Yao, C., & Bai, X. (2016) · Frontiers of Computer Science · doi:10.1007/s11704-015-4488-0 · Cited by 402
Self-citationMulti-oriented Scene Text Detection via Corner Localization and Region Segmentation
Lyu, P., Yao, C., Wu, W., Yan, S., & Bai, X. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00788 · Cited by 389
Self-citationTowards Accurate Scene Text Recognition With Semantic Reasoning Networks
Yu, D., Li, X., Zhang, C., Liu, T., Han, J., Liu, J., & Ding, E. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01213 · Cited by 385
An Efficient Implementation of a Scaling Minimum-Cost Flow Algorithm
Goldberg, A. V. (1997) · Journal of Algorithms · doi:10.1006/jagm.1995.0805 · Cited by 382
Robust Scene Text Detection with Convolution Neural Network Induced MSER Trees
Huang, W., Qiao, Y., & Tang, X. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10593-2_33 · Cited by 381
Text Detection and Character Recognition in Scene Images with Unsupervised Feature Learning
Coates, A., Carpenter, B., Case, C., Satheesh, S., Suresh, B., Wang, T., Wu, D. J., & Ng, A. Y. (2011) · 2011 International Conference on Document Analysis and Recognition · doi:10.1109/icdar.2011.95 · Cited by 378
Rosetta: Large Scale System for Text Detection and Recognition in Images
Borisyuk, F., Gordo, A., & Sivakumar, V. (2018) · Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3219819.3219861 · Cited by 353
Deep Matching Prior Network: Toward Tighter Multi-oriented Text Detection
Liu, Y., & Jin, L. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.368 · Cited by 351
Object count/area graphs for the evaluation of object detection and segmentation algorithms
Wolf, C., & Jolion, J.-M. (2006) · International Journal on Document Analysis and Recognition (IJDAR) · doi:10.1007/s10032-006-0014-0 · Cited by 350
Single Shot Text Detector with Regional Attention
He, P., Huang, W., He, T., Zhu, Q., Qiao, Y., & Li, X. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.331 · Cited by 344
Text String Detection From Natural Scenes by Structure-Based Partition and Grouping
Yi, C., & Tian, Y. (2011) · IEEE Transactions on Image Processing · doi:10.1109/tip.2011.2126586 · Cited by 335
Strokelets: A Learned Multi-scale Representation for Scene Text Recognition
Yao, C., Bai, X., Shi, B., & Liu, W. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.515 · Cited by 306
Self-citationLook More Than Once: An Accurate Detector for Text of Arbitrary Shapes
Zhang, C., Liang, B., Huang, Z., En, M., Han, J., Ding, E., & Ding, X. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.01080 · Cited by 302
Reading Scene Text in Deep Convolutional Sequences
He, P., Huang, W., Qiao, Y., Loy, C., & Tang, X. (2016) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v30i1.10465 · Cited by 300
ESIR: End-To-End Scene Text Recognition via Iterative Image Rectification
Zhan, F., & Lu, S. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00216 · Cited by 296
AON: Towards Arbitrarily-Oriented Text Recognition
Cheng, Z., Xu, Y., Bai, F., Niu, Y., Pu, S., & Zhou, S. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00584 · Cited by 292
R2CNN: Rotational Region CNN for Arbitrarily-Oriented Scene Text Detection
Jiang, Y., Zhu, X., Wang, X., Yang, S., Li, W., Wang, H., Fu, P., & Luo, Z. (2018) · 2018 24th International Conference on Pattern Recognition (ICPR) · doi:10.1109/icpr.2018.8545598 · Cited by 286
Text Localization in Natural Images Using Stroke Feature Transform and Text Covariance Descriptors
Huang, W., Lin, Z., Yang, J., & Wang, J. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.157 · Cited by 285
Automatic Detection and Recognition of Signs From Natural Scenes
Chen, X., Yang, J., Zhang, J., & Waibel, A. (2004) · IEEE Transactions on Image Processing · doi:10.1109/tip.2003.819223 · Cited by 279
STAR-Net: A SpaTial Attention Residue Network for Scene Text Recognition
Liu, W., Chen, C., Wong, K.-Y., Su, Z., & Han, J. (2016) · Procedings of the British Machine Vision Conference 2016 · doi:10.5244/c.30.43 · Cited by 273
Deep Relational Reasoning Graph Network for Arbitrary Shape Text Detection
Zhang, S.-X., Zhu, X., Hou, J.-B., Liu, C., Yang, C., Wang, H., & Yin, X.-C. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00972 · Cited by 254
Scene Text Recognition from Two-Dimensional Perspective
Liao, M., Zhang, J., Wan, Z., Xie, F., Liang, J., Lyu, P., Yao, C., & Bai, X. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33018714 · Cited by 251
Self-citationLearning Shape-Aware Embedding for Scene Text Detection
Tian, Z., Shu, M., Lyu, P., Li, R., Zhou, C., Shen, X., & Jia, J. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00436 · Cited by 248
Deep TextSpotter: An End-to-End Trainable Scene Text Localization and Recognition Framework
Busta, M., Neumann, L., & Matas, J. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.242 · Cited by 244
IEEE Transactions on Pattern Analysis and Machine Intelligence
(1978) · IEEE Transactions on Computers · doi:10.1109/tc.1978.1675004 · Cited by 241
An End-to-End TextSpotter with Explicit Alignment and Attention
He, T., Tian, Z., Huang, W., Shen, C., Qiao, Y., & Sun, C. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00527 · Cited by 234
Towards End-to-End Text Spotting with Convolutional Recurrent Neural Networks
Li, H., Wang, P., & Shen, C. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.560 · Cited by 230
Unconstrained On-line Handwriting Recognition with Recurrent Neural Networks
Graves, A., Liwicki, M., Horst Bunke, A., Schmidhuber, J., & Fernández, S. (2007) · Bern Open Repository and Information System (University of Bern) · Cited by 222
Accurate Scene Text Recognition Based on Recurrent Neural Network
Su, B., & Lu, S. (2015) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-16865-4_3 · Cited by 221
Text Flow: A Unified Text Detection System in Natural Scene Images
Tian, S., Pan, Y., Huang, C., Lu, S., Yu, K., & Tan, C. L. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.528 · Cited by 220
WordSup: Exploiting Word Annotations for Character Based Text Detection
Hu, H., Zhang, C., Luo, Y., Wang, Y., Han, J., & Ding, E. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.529 · Cited by 210
Arbitrary Shape Scene Text Detection With Adaptive Text Region Representation
Wang, X., Jiang, Y., Luo, Z., Liu, C.-L., Choi, H., & Kim, S. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00661 · Cited by 209
Deep Structured Output Learning for Unconstrained Text Recognition
Jaderberg, M., Simonyan, K., Vedaldi, A., & Zisserman, A. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1412.5903 · Cited by 200
AdaBoost for Text Detection in Natural Scene
Lee, J.-J., Lee, P.-H., Lee, S.-W., Yuille, A., & Koch, C. (2011) · 2011 International Conference on Document Analysis and Recognition · doi:10.1109/icdar.2011.93 · Cited by 199
Text Detection, Tracking and Recognition in Video: A Comprehensive Survey
Yin, X.-C., Zuo, Z.-Y., Tian, S., & Liu, C.-L. (2016) · IEEE Transactions on Image Processing · doi:10.1109/tip.2016.2554321 · Cited by 199
UnrealCV: Virtual Worlds for Computer Vision
Qiu, W., Zhong, F., Zhang, Y., Qiao, S., Xiao, Z., Kim, T. S., & Wang, Y. (2017) · Proceedings of the 25th ACM international conference on Multimedia · doi:10.1145/3123266.3129396 · Cited by 186
Learning to Read Irregular Text with Attention Mechanisms
Yang, X., He, D., Zhou, Z., Kifer, D., & Giles, C. L. (2017) · Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2017/458 · Cited by 183
Edit Probability for Scene Text Recognition
Bai, F., Cheng, Z., Niu, Y., Pu, S., & Zhou, S. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00163 · Cited by 182
Deliberation Networks: Sequence Generation Beyond One-Pass Decoding
Xia, Y., Tian, F., Wu, L., Lin, J., Qin, T., Yu, N., & Liu, T. (2017) · neural information processing systems · Cited by 181
Convolutional Character Networks
Xing, L., Tian, Z., Huang, W., & Scott, M. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00922 · Cited by 181
Symmetry-Constrained Rectification Network for Scene Text Recognition
Yang, M., Guan, Y., Liao, M., He, X. J., Bian, K., Bai, S., Yao, C., & Bai, X. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00924 · Cited by 176
Self-citationFused Text Segmentation Networks for Multi-oriented Scene Text Detection
Dai, Y., Huang, Z., Gao, Y., Xu, Y., Chen, K., Guo, J., & Qiu, W. (2018) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr.2018.8546066 · Cited by 169
A novel adaptive morphological approach for degraded character image segmentation
Nomura, S., Yamanaka, K., Katai, O., Kawakami, H., & Shiose, T. (2005) · Pattern Recognition · doi:10.1016/j.patcog.2005.01.026 · Cited by 168
Char-Net: A Character-Aware Neural Network for Distorted Scene Text Recognition
Liu, W., Chen, C., & Wong, K.-Y. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.12246 · Cited by 164
Scene Text Recognition Using Part-Based Tree-Structured Character Detection
Shi, C., Wang, C., Xiao, B., Zhang, Y., Gao, S., & Zhang, Z. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.381 · Cited by 160
FASText: Efficient Unconstrained Scene Text Detector
Buta, M., Neumann, L., & Matas, J. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.143 · Cited by 146
Accurate Scene Text Detection Through Border Semantics Awareness and Bootstrapping
Xue, C., Lu, S., & Zhan, F. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01270-0_22 · Cited by 143
Learning Markov Clustering Networks for Scene Text Detection
Liu, Z., Lin, G., Yang, S. C., Feng, J., Lin, W., & Goh, W. L. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00725 · Cited by 141
Towards Unconstrained End-to-End Text Spotting
Qin, S., Bissaco, A., Raptis, M., Fujii, Y., & Xiao, Y. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00480 · Cited by 133
Wu, L., Zhang, C., Liu, J., Han, J., Liu, J., Ding, E., & Bai, X. (2019) · Proceedings of the 27th ACM International Conference on Multimedia · doi:10.1145/3343031.3350929 · Cited by 130
Supervised mid-level features for word image representation
Gordo, A. (2015) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2015.7298914 · Cited by 115
Verisimilar Image Synthesis for Accurate Detection and Recognition of Texts in Scenes
Zhan, F., Lu, S., & Xue, C. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01237-3_16 · Cited by 114
SwapText: Image Based Texts Transfer in Scenes
Yang, Q., Huang, J., & Lin, W. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.01471 · Cited by 112
Label Embedding: A Frugal Baseline for Text Recognition
Rodríguez-Serrano, J. A., Gordo, A., & Perronnin, F. (2014) · International Journal of Computer Vision · doi:10.1007/s11263-014-0793-6 · Cited by 109
Self-Organized Text Detection with Minimal Post-processing via Border Learning
Wu, Y., & Natarajan, P. (2017) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.535 · Cited by 106
Geometry-Aware Scene Text Detection with Instance Transformation Network
Wang, F., Zhao, L.-M., Li, X., Wang, X., & Tao, D. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00150 · Cited by 105
SqueezedText: A Real-Time Scene Text Recognition by Binary Convolutional Encoder-Decoder Network
Liu, Z., Li, Y., Ren, F., Goh, W. L., & Yu, H. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.12252 · Cited by 97
WeText: Scene Text Detection under Weak Supervision
Tian, S., Lu, S., & Li, C. (2017) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.166 · Cited by 94
He, D., Yang, X., Liang, C., Zhou, Z., Ororbia, A. G., Kifer, D., & Giles, C. L. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.58 · Cited by 87
Chinese Street View Text: Large-Scale Chinese Text Reading With Partially Supervised Learning
Sun, Y., Liu, J., Liu, W., Han, J., Ding, E., & Liu, J. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00918 · Cited by 76
UnrealText: Synthesizing Realistic Scene Text Images from the Unreal WorldPreprint
Long, S., & Yao, C. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.10608 · Cited by 76
Self-citationFeature Enhancement Network: A Refined Scene Text Detector
Zhang, S., Liu, Y., Jin, L., & Luo, C. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11887 · Cited by 61
Mobile visual search on printed documents using text and low bit-rate features
Tsai, S. S., Chen, H., Chen, D. M., Schroth, G., Grzeszczuk, R., & Girod, B. (2011) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2011.6116198 · Cited by 55
A New Gradient Based Character Segmentation Method for Video Text Recognition
Shivakumara, P., Bhowmick, S., Su, B., Tan, C. L., & Pal, U. (2011) · IAPR International Conference on Document Analysis and Recognition (ICDAR) · doi:10.1109/icdar.2011.34 · Cited by 50
SynthText3D: synthesizing scene text images from 3D virtual worlds
Liao, M., Song, B., Long, S., He, M., Yao, C., & Bai, X. (2020) · Science China Information Sciences · doi:10.1007/s11432-019-2737-0 · Cited by 48
Self-citationTightness-Aware Evaluation Protocol for Scene Text Detection
Liu, Y., Jin, L., Xie, Z., Luo, C., Zhang, S., & Xie, L. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00984 · Cited by 34
Recognition of raised characters for automatic classification of rubber tires
Ham, Y. K., Kang, M. S., Chung, H. K., Park, R., & Park, G. T. (1995) · Optical Engineering · doi:10.1117/12.184094 · Cited by 33
Robot navigation using human cues: A robot navigation system for symbolic goal-directed exploration
Schulz, R., Talbot, B., Lam, O., Dayoub, F., Corke, P., Upcroft, B., & Wyeth, G. F. (2015) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2015.7139313 · Cited by 33
Exemplar Driven Character Recognition in the Wild
Sheshadri, K., & Divvala, S. (2012) · British Machine Vision Conference (BMVC) · doi:10.5244/c.26.13 · Cited by 32
Integrating multiple character proposals for robust scene text extraction
Lee, S., & Kim, J. H. (2013) · Image and Vision Computing · doi:10.1016/j.imavis.2013.08.007 · Cited by 29
Exploiting Text-Related Features for Content-based Image Retrieval
Schroth, G., Hilsenbeck, S., Huitl, R., Schweiger, F., & Steinbach, E. G. (2011) · IEEE International Symposium on Multimedia (ISM) · doi:10.1109/ism.2011.21 · Cited by 22
Road-Sign Text Recognition Architecture for Intelligent Transportation Systems
Mammeri, A., Khiari, E.-H., & Boukerche, A. (2014) · IEEE Vehicular Technology Conference · doi:10.1109/vtcfall.2014.6966161 · Cited by 22
Arbitrarily-Oriented Text Recognition.Preprint
Cheng, Z., Liu, X., Bai, F., Niu, Y., Pu, S., & Zhou, S. (2017) · arXiv (Cornell University) · Cited by 15
Long, S., Guan, Y., Bian, K., et al. (2020) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp40776.2020.9054135 · Cited by 15
Self-citationWeakly Supervised Text Attention Network for Generating Text Proposals in Scene Images
Li, R., En, M., Jian-qiang, L., & HaiBin, Z. (2017) · IAPR International Conference on Document Analysis and Recognition (ICDAR) · doi:10.1109/icdar.2017.61 · Cited by 11
MSER-based text detection and communication algorithm for autonomous vehicles
Mammeri, A., Boukerche, A., & Khiari, E.-H. (2016) · IEEE Symposium on Computers and Communications (ISCC) · doi:10.1109/iscc.2016.7543902 · Cited by 7
Cited by
Handwritten Optical Character Recognition (OCR): A Comprehensive Systematic Literature Review (SLR)
Memon, J., Sami, M., Khan, R. A., & Uddin, M. (2020) · IEEE Access · doi:10.1109/access.2020.3012542 · Cited by 556
Fang, S., Xie, H., Wang, Y., Mao, Z., & Zhang, Y. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00702 · Cited by 450
Real-Time Scene Text Detection With Differentiable Binarization and Adaptive Scale Fusion
Liao, M., Zou, Z., Wan, Z., Yao, C., & Bai, X. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3155612 · Cited by 431
Self-citationDecoupled Attention Network for Text Recognition
Wang, T., Zhu, Y., Jin, L., Luo, C., Chen, X., Wu, Y., Wang, Q., & Cai, M. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i07.6903 · Cited by 294
Scene Text Recognition with Permuted Autoregressive Sequence Models
Bautista, D., & Atienza, R. (2022) · Lecture Notes in Computer Science · doi:10.1007/978-3-031-19815-1_11 · Cited by 267
Metadata
- Authors
- Long, S., He, X., & Yao, C.
- Venue
- International Journal of Computer Vision
- Published
- 2020-08-27
- Volume
- 129
- Issue
- 1
- Pages
- 161-184
- ISSN
- 0920-5691 (ISSN-L)
- 1573-1405
- OpenAlex
- W3082397598
- Cited by
- 527
- References
- 155
- FWCI
- 29.59
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.