The DOI matches its Crossref record; 69 of the 69 references it cites were found in a registry or an index.
TextField: Learning a Deep Direction Field for Irregular Scene Text Detection
Open accessAbstract
Scene text detection is an important step in the scene text reading system. The main challenges lie in significantly varied sizes and aspect ratios, arbitrary orientations, and shapes. Driven by the recent progress in deep learning, impressive performances have been achieved for multi-oriented text detection. Yet, the performance drops dramatically in detecting the curved texts due to the limited text representation (e.g., horizontal bounding boxes, rotated rectangles, or quadrilaterals). It is of great interest to detect the curved texts, which are actually very common in natural scenes. In this paper, we present a novel text detector named TextField for detecting irregular scene texts. Specifically, we learn a direction field pointing away from the nearest text boundary to each text point. This direction field is represented by an image of 2D vectors and learned via a fully convolutional neural network. It encodes both binary text mask and direction information used to separate adjacent text instances, which is challenging for the classical segmentation-based approaches. Based on the learned direction field, we apply a simple yet effective morphological-based post-processing to achieve the final detection. The experimental results show that the proposed TextField outperforms the state-of-the-art methods by a large margin (28% and 8%) on two curved text datasets: Total-Text and SCUT-CTW1500, respectively; TextField also achieves very competitive performance on multi-oriented datasets: ICDAR 2015 and MSRA-TD500. Furthermore, TextField is robust in generalizing unseen datasets.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2577031 · Cited by 73,472
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
You Only Look Once: Unified, Real-Time Object Detection
Redmon, J., Divvala, S., Girshick, R., & Farhadi, A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.91 · Cited by 53,803
Fully convolutional networks for semantic segmentation
Long, J., Shelhamer, E., & Darrell, T. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298965 · Cited by 38,834
(2016) · Cited by 31,590
Caffe: Convolutional Architecture for Fast Feature Embedding
Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., & Darrell, T. (2014) · Proceedings of the 22nd ACM international conference on Multimedia · doi:10.1145/2647868.2654889 · Cited by 11,077
Learning Deconvolution Network for Semantic Segmentation
Noh, H., Hong, S., & Han, B. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.178 · Cited by 4,422
Caffe: Convolutional Architecture for Fast Feature Embedding
Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., & Darrell, T. J. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1408.5093 · Cited by 3,752
Robust wide-baseline stereo from maximally stable extremal regions
Matas, J., Chum, O., Urban, M., & Pajdla, T. (2004) · Image and Vision Computing · doi:10.1016/j.imavis.2004.02.006 · Cited by 3,686
Shi, B., Bai, X., & Yao, C. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2646371 · Cited by 3,172
Self-citationTraining Region-Based Object Detectors with Online Hard Example Mining
Shrivastava, A., Gupta, A., & Girshick, R. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.89 · Cited by 2,686
Fully Convolutional Networks for Semantic Segmentation
Long, J., Shelhamer, E., & Darrell, T. J. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1411.4038 · Cited by 2,489
EAST: An Efficient and Accurate Scene Text Detector
Zhou, X., Yao, C., Wen, H., Wang, Y., Zhou, S., He, W., & Liang, J. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.283 · Cited by 1,850
Self-citationSynthetic Data for Text Localisation in Natural Images
Gupta, A., Vedaldi, A., & Zisserman, A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.254 · Cited by 1,563
ICDAR 2015 competition on Robust Reading
Karatzas, D., Gomez-Bigorda, L., Nicolaou, A., Ghosh, S., Bagdanov, A., Iwamura, M., Matas, J., Neumann, L., Chandrasekhar, V. R., Lu, S., et al. (2015) · 2015 13th International Conference on Document Analysis and Recognition (ICDAR) · doi:10.1109/icdar.2015.7333942 · Cited by 1,547
Detecting text in natural scenes with stroke width transform
Epshtein, B., Ofek, E., & Wexler, Y. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5540041 · Cited by 1,492
Arbitrary-Oriented Scene Text Detection via Rotation Proposals
Ma, J., Shao, W., Ye, H., Wang, L., Wang, H., Zheng, Y., & Xue, X. (2018) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2018.2818020 · Cited by 1,260
Reading text in the wild with convolutional neural networks
Jaderberg, M., Simonyan, K., Vedaldi, A., & Zisserman, A. (2016) · International Journal of Computer Vision · doi:10.1007/s11263-015-0823-z · Cited by 1,191
Detecting Text in Natural Image with Connectionist Text Proposal Network
Tian, Z., Huang, W., He, T., He, P., & Qiao, Y. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46484-8_4 · Cited by 1,053
TextBoxes: A Fast Text Detector with a Single Deep Neural Network
Liao, M., Shi, B., Bai, X., Wang, X., & Liu, W. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.11196 · Cited by 955
Self-citationASTER: An Attentional Scene Text Recognizer with Flexible Rectification
Shi, B., Yang, M., Wang, X., Lyu, P., Yao, C., & Bai, X. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2848939 · Cited by 906
Self-citationTextBoxes++: A Single-Shot Oriented Scene Text Detector
Liao, M., Shi, B., & Bai, X. (2018) · IEEE Transactions on Image Processing · doi:10.1109/tip.2018.2825107 · Cited by 897
Self-citationReal-time scene text localization and recognition
Neumann, L., & Matas, J. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6248097 · Cited by 827
Text Detection and Recognition in Imagery: A Survey
Ye, Q., & Doermann, D. (2015) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2014.2366765 · Cited by 780
Detecting Oriented Text in Natural Images by Linking Segments
Shi, B., Bai, X., & Belongie, S. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.371 · Cited by 775
Self-citationDetecting texts of arbitrary orientations in natural images
Yao, C., Bai, X., Liu, W., Ma, Y., & Tu, Z. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6247787 · Cited by 765
Self-citationAntiextensive connected operators for image and sequence processing
Salembier, P., Oliveras, A., & Garrido, L. (1998) · IEEE Transactions on Image Processing · doi:10.1109/83.663500 · Cited by 635
Multi-oriented Text Detection with Fully Convolutional Networks
Zhang, Z., Zhang, C., Shen, W., Yao, C., Liu, W., & Bai, X. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.451 · Cited by 596
Self-citationTotal-Text: A Comprehensive Dataset for Scene Text Detection and Recognition
Ch'ng, C. K., & Chan, C. S. (2017) · 2017 14th IAPR International Conference on Document Analysis and Recognition (ICDAR) · doi:10.1109/icdar.2017.157 · Cited by 571
Rotation-Sensitive Regression for Oriented Scene Text Detection
Liao, M., Zhu, Z., Shi, B., Xia, G.-S., & Bai, X. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00619 · Cited by 563
Self-citationDeep Watershed Transform for Instance Segmentation
Bai, M., & Urtasun, R. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.305 · Cited by 539
Wang, K., & Belongie, S. (2010) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-15549-9_43 · Cited by 449
Deep Direct Regression for Multi-oriented Scene Text Detection
He, W., Zhang, X.-Y., Yin, F., & Liu, C.-L. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.87 · Cited by 432
Scene text detection and recognition: recent advances and future trends
Zhu, Y., Yao, C., & Bai, X. (2016) · Frontiers of Computer Science · doi:10.1007/s11704-015-4488-0 · Cited by 402
Self-citationMulti-oriented Scene Text Detection via Corner Localization and Region Segmentation
Lyu, P., Yao, C., Wu, W., Yan, S., & Bai, X. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00788 · Cited by 389
Self-citationRobust Scene Text Detection with Convolution Neural Network Induced MSER Trees
Huang, W., Qiao, Y., & Tang, X. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10593-2_33 · Cited by 381
MaskLab: Instance Segmentation by Refining Object Detection with Semantic and Direction Features
Chen, L.-C., Hermans, A., Papandreou, G., Schroff, F., Wang, P., & Adam, H. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00422 · Cited by 373
A Hybrid Approach to Detect and Localize Texts in Natural Scene Images
Pan, Y.-F., Hou, X., & Liu, C.-L. (2011) · IEEE Transactions on Image Processing · doi:10.1109/tip.2010.2070803 · Cited by 363
Deep Matching Prior Network: Toward Tighter Multi-oriented Text Detection
Liu, Y., & Jin, L. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.368 · Cited by 351
Text-Attentional Convolutional Neural Network for Scene Text Detection
He, T., Huang, W., Qiao, Y., & Yao, J. (2016) · IEEE Transactions on Image Processing · doi:10.1109/tip.2016.2547588 · Cited by 345
Single Shot Text Detector with Regional Attention
He, P., Huang, W., He, T., Zhu, Q., Qiao, Y., & Li, X. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.331 · Cited by 344
A Unified Framework for Multioriented Text Detection and Recognition
Yao, C., Bai, X., & Liu, W. (2014) · IEEE Transactions on Image Processing · doi:10.1109/tip.2014.2353813 · Cited by 343
Self-citationText Localization in Natural Images Using Stroke Feature Transform and Text Covariance Descriptors
Huang, W., Lin, Z., Yang, J., & Wang, J. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.157 · Cited by 285
Multi-Orientation Scene Text Detection with Adaptive Clustering
Yin, X.-C., Pei, W.-Y., Zhang, J., & Hao, H.-W. (2015) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2014.2388210 · Cited by 259
Scene Text Detection via Holistic, Multi-Channel PredictionPreprint
Yao, C., Bai, X., Sang, N., Zhou, X., Zhou, S., & Cao, Z. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1606.09002 · Cited by 254
Self-citationAn End-to-End TextSpotter with Explicit Alignment and Attention
He, T., Tian, Z., Huang, W., Shen, C., Qiao, Y., & Sun, C. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00527 · Cited by 234
Text Flow: A Unified Text Detection System in Natural Scene Images
Tian, S., Pan, Y., Huang, C., Lu, S., Yu, K., & Tan, C. L. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.528 · Cited by 220
WordSup: Exploiting Word Annotations for Character Based Text Detection
Hu, H., Zhang, C., Luo, Y., Wang, Y., Han, J., & Ding, E. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.529 · Cited by 210
Self-citationDetecting Curve Text in the Wild: New Dataset and New Solution
Yuliang, L., Jin, L., Zhang, S., & Zhang, S. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1712.02170 · Cited by 189
Accurate Scene Text Detection Through Border Semantics Awareness and Bootstrapping
Xue, C., Lu, S., & Zhan, F. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01270-0_22 · Cited by 143
Learning Markov Clustering Networks for Scene Text Detection
Liu, Z., Lin, G., Yang, S. C., Feng, J., Lin, W., & Goh, W. L. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00725 · Cited by 135
Self-Organized Text Detection with Minimal Post-processing via Border Learning
Wu, Y., & Natarajan, P. (2017) · IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.535 · Cited by 113
Cascaded Segmentation-Detection Networks for Text-Based Traffic Sign Detection
Zhu, Y., Liao, M., Yang, M., & Liu, W. (2017) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2017.2768827 · Cited by 112
Multi-script Text Extraction from Natural Scenes
Gómez, L., & Karatzas, D. (2013) · Proceedings of the International Conference on Document Analysis and Recognition · doi:10.1109/icdar.2013.100 · Cited by 110
Verisimilar Image Synthesis for Accurate Detection and Recognition of Texts in Scenes
Zhan, F., Lu, S., & Xue, C. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01237-3_16 · Cited by 110
Geometry-Aware Scene Text Detection with Instance Transformation Network
Wang, F., Zhao, L.-M., Li, X., Wang, X., & Tao, D. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00150 · Cited by 101
Scene text extraction based on edges and support vector regression
Lu, S., Chen, T., Tian, S., et al. (2015) · International Journal on Document Analysis and Recognition (IJDAR) · doi:10.1007/s10032-015-0237-z · Cited by 98
WeText: Scene Text Detection under Weak Supervision
Tian, S., Lu, S., & Li, C. (2017) · IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.166 · Cited by 94
Characterness: An Indicator of Text in the Wild
Li, Y., Jia, W., Shen, C., & van den Hengel, A. (2014) · IEEE Transactions on Image Processing · doi:10.1109/tip.2014.2302896 · Cited by 91
He, D., Yang, X., Liang, C., Zhou, Z., Ororbia, A. G., Kifer, D., & Giles, C. L. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.58 · Cited by 84
Scene Text Recognition in Mobile Applications by Character Descriptor and Structure Configuration
Yi, C., & Tian, Y. (2014) · IEEE Transactions on Image Processing · doi:10.1109/tip.2014.2317980 · Cited by 71
Recognizing Text-Based Traffic Guide Panels with Cascaded Localization Network
Rong, X., Yi, C., & Tian, Y. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-46604-0_8 · Cited by 61
DeepFlux for Skeletons in the Wild
Wang, Y., Xu, Y., Tsogkas, S., Bai, X., Dickinson, S., & Kaleem Siddiqi, A. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00543 · Cited by 56
Self-citationScene Text Localization Using Gradient Local Correlation
Bai, B., Yin, F., & Liu, C. L. (2013) · Proceedings of the International Conference on Document Analysis and Recognition · doi:10.1109/icdar.2013.279 · Cited by 32
TextCatcher: a method to detect curved and challenging text in natural scenes
Fabrizio, J., Robert-Seidowsky, M., Dubuisson, S., Calarasanu, S., & Boissel, R. (2016) · International Journal on Document Analysis and Recognition (IJDAR) · doi:10.1007/s10032-016-0264-4 · Cited by 31
Text detection in stores using a repetition prior
Xiong, B., & Grauman, K. L. (2016) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv.2016.7477575 · Cited by 20
Bai, X., Zhang, Z., Wang, H.-Y., & Shen, W. (2017) · Journal of Computer Science and Technology · doi:10.1007/s11390-017-1752-9 · Cited by 4
Self-citation
Cited by
Gliding Vertex on the Horizontal Bounding Box for Multi-Oriented Object Detection
Xu, Y., Fu, M., Wang, Q., Wang, Y., Chen, K., Xia, G.-S., & Bai, X. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.2974745 · Cited by 1,014
Self-citationReal-Time Scene Text Detection with Differentiable Binarization
Liao, M., Wan, Z., Yao, C., Chen, K., & Bai, X. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i07.6812 · Cited by 864
Self-citationABCNet: Real-Time Scene Text Spotting With Adaptive Bezier-Curve Network
Liu, Y., Chen, H., Shen, C., He, T., Jin, L., & Wang, L. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00983 · Cited by 457
Real-Time Scene Text Detection With Differentiable Binarization and Adaptive Scale Fusion
Liao, M., Zou, Z., Wan, Z., Yao, C., & Bai, X. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3155612 · Cited by 431
Self-citationFourier Contour Embedding for Arbitrary-Shaped Text Detection
Zhu, Y., Chen, J., Liang, L., Kuang, Z., Jin, L., & Zhang, W. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00314 · Cited by 311
Metadata
- Authors
- Xu, Y., Wang, Y., Zhou, W., Wang, Y., Yang, Z., & Bai, X.
- Venue
- IEEE Transactions on Image Processing
- Published
- 2019-11
- Volume
- 28
- Issue
- 11
- Pages
- 5566-5579
- ISSN
- 1057-7149 (ISSN-L)
- 1941-0042
- OpenAlex
- W2902494497
- Cited by
- 345
- References
- 69
- FWCI
- 24.69
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.