The DOI matches its Crossref record; 41 of the 41 references it cites were found in a registry or an index.
Real-Time Scene Text Detection with Differentiable Binarization
Open accessAbstract
Recently, segmentation-based methods are quite popular in scene text detection, as the segmentation results can more accurately describe scene text of various shapes such as curve text. However, the post-processing of binarization is essential for segmentation-based detection, which converts probability maps produced by a segmentation method into bounding boxes/regions of text. In this paper, we propose a module named Differentiable Binarization (DB), which can perform the binarization process in a segmentation network. Optimized along with a DB module, a segmentation network can adaptively set the thresholds for binarization, which not only simplifies the post-processing but also enhances the performance of text detection. Based on a simple segmentation network, we validate the performance improvements of DB on five benchmark datasets, which consistently achieves state-of-the-art results, in terms of both detection accuracy and speed. In particular, with a light-weight backbone, the performance improvements by DB are significant so that we can look for an ideal tradeoff between detection accuracy and efficiency. Specifically, with a backbone of ResNet-18, our detector achieves an F-measure of 82.8, running at 62 FPS, on the MSRA-TD500 dataset. Code is available at: https://github.com/MhLiao/DB.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
(2016) · Cited by 31,590
Deformable Convolutional Networks
Dai, J., Qi, H., Xiong, Y., Li, Y., Zhang, G., Hu, H., & Wei, Y. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.89 · Cited by 7,513
Deformable ConvNets V2: More Deformable, Better Results
Zhu, X., Hu, H., Lin, S., & Dai, J. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00953 · Cited by 2,943
EAST: An Efficient and Accurate Scene Text Detector
Zhou, X., Yao, C., Wen, H., Wang, Y., Zhou, S., He, W., & Liang, J. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.283 · Cited by 1,850
Self-citationSynthetic Data for Text Localisation in Natural Images
Gupta, A., Vedaldi, A., & Zisserman, A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.254 · Cited by 1,563
ICDAR 2015 competition on Robust Reading
Karatzas, D., Gomez-Bigorda, L., Nicolaou, A., Ghosh, S., Bagdanov, A., Iwamura, M., Matas, J., Neumann, L., Chandrasekhar, V. R., Lu, S., et al. (2015) · 2015 13th International Conference on Document Analysis and Recognition (ICDAR) · doi:10.1109/icdar.2015.7333942 · Cited by 1,547
Character Region Awareness for Text Detection
Baek, Y., Lee, B., Han, D., Yun, S., & Lee, H. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00959 · Cited by 1,103
Detecting Text in Natural Image with Connectionist Text Proposal Network
Tian, Z., Huang, W., He, T., He, P., & Qiao, Y. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46484-8_4 · Cited by 1,053
TextBoxes: A Fast Text Detector with a Single Deep Neural Network
Liao, M., Shi, B., Bai, X., Wang, X., & Liu, W. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.11196 · Cited by 955
Self-citationTextBoxes++: A Single-Shot Oriented Scene Text Detector
Liao, M., Shi, B., & Bai, X. (2018) · IEEE Transactions on Image Processing · doi:10.1109/tip.2018.2825107 · Cited by 897
Self-citationShape Robust Text Detection With Progressive Scale Expansion Network
Wang, W., Xie, E., Li, X., Hou, W., Lu, T., Yu, G., & Shao, S. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00956 · Cited by 860
Detecting Oriented Text in Natural Images by Linking Segments
Shi, B., Bai, X., & Belongie, S. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.371 · Cited by 775
Self-citationDetecting texts of arbitrary orientations in natural images
Yao, C., Bai, X., Liu, W., Ma, Y., & Tu, Z. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6247787 · Cited by 765
Self-citationTextSnake: A Flexible Representation for Detecting Text of Arbitrary Shapes
Long, S., Ruan, J., Zhang, W., He, X., Wu, W., & Yao, C. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01216-8_2 · Cited by 636
Self-citationPixelLink: Detecting Scene Text via Instance Segmentation
Deng, D., Liu, H., Li, X., & Cai, D. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.12269 · Cited by 632
Multi-oriented Text Detection with Fully Convolutional Networks
Zhang, Z., Zhang, C., Shen, W., Yao, C., Liu, W., & Bai, X. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.451 · Cited by 596
Self-citationTotal-Text: A Comprehensive Dataset for Scene Text Detection and Recognition
Ch'ng, C. K., & Chan, C. S. (2017) · 2017 14th IAPR International Conference on Document Analysis and Recognition (ICDAR) · doi:10.1109/icdar.2017.157 · Cited by 571
Rotation-Sensitive Regression for Oriented Scene Text Detection
Liao, M., Zhu, Z., Shi, B., Xia, G.-S., & Bai, X. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00619 · Cited by 563
Self-citationMask TextSpotter: An End-to-End Trainable Neural Network for Spotting Text with Arbitrary Shapes
Lyu, P., Liao, M., Yao, C., Wu, W., & Bai, X. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01264-9_5 · Cited by 522
Self-citationA generic solution to polygon clipping
Vatti, B. R. (1992) · Communications of the ACM · doi:10.1145/129902.129906 · Cited by 450
Deep Direct Regression for Multi-oriented Scene Text Detection
He, W., Zhang, X.-Y., Yin, F., & Liu, C.-L. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.87 · Cited by 432
Multi-oriented Scene Text Detection via Corner Localization and Region Segmentation
Lyu, P., Yao, C., Wu, W., Yan, S., & Bai, X. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00788 · Cited by 389
Self-citationDeep Matching Prior Network: Toward Tighter Multi-oriented Text Detection
Liu, Y., & Jin, L. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.368 · Cited by 351
Text-Attentional Convolutional Neural Network for Scene Text Detection
He, T., Huang, W., Qiao, Y., & Yao, J. (2016) · IEEE Transactions on Image Processing · doi:10.1109/tip.2016.2547588 · Cited by 345
TextField: Learning a Deep Direction Field for Irregular Scene Text Detection
Xu, Y., Wang, Y., Zhou, W., Wang, Y., Yang, Z., & Bai, X. (2019) · IEEE Transactions on Image Processing · doi:10.1109/tip.2019.2900589 · Cited by 345
Self-citationSingle Shot Text Detector with Regional Attention
He, P., Huang, W., He, T., Zhu, Q., Qiao, Y., & Li, X. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.331 · Cited by 344
A Unified Framework for Multioriented Text Detection and Recognition
Yao, C., Bai, X., & Liu, W. (2014) · IEEE Transactions on Image Processing · doi:10.1109/tip.2014.2353813 · Cited by 343
Self-citationCurved scene text detection via transverse and longitudinal sequence connection
Liu, Y., Jin, L., Zhang, S., Luo, C., & Zhang, S. (2019) · Pattern Recognition · doi:10.1016/j.patcog.2019.02.002 · Cited by 317
Look More Than Once: An Accurate Detector for Text of Arbitrary Shapes
Zhang, C., Liang, B., Huang, Z., En, M., Han, J., Ding, E., & Ding, X. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.01080 · Cited by 302
Learning Shape-Aware Embedding for Scene Text Detection
Tian, Z., Shu, M., Lyu, P., Li, R., Zhou, C., Shen, X., & Jia, J. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00436 · Cited by 248
Mask TextSpotter: An End-to-End Trainable Neural Network for Spotting Text with Arbitrary Shapes
Liao, M., Lyu, P., He, M., Yao, C., Wu, W., & Bai, X. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2937086 · Cited by 244
Self-citationScene Text Detection with Supervised Pyramid Context Network
Xie, E., Zang, Y., Shao, S., Yu, G., Yao, C., & Li, G. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33019038 · Cited by 236
Self-citationWordSup: Exploiting Word Annotations for Character Based Text Detection
Hu, H., Zhang, C., Luo, Y., Wang, Y., Han, J., & Ding, E. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.529 · Cited by 210
Arbitrary Shape Scene Text Detection With Adaptive Text Region Representation
Wang, X., Jiang, Y., Luo, Z., Liu, C.-L., Choi, H., & Kim, S. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00661 · Cited by 209
PVANET: Deep but Lightweight Neural Networks for Real-time Object Detection
Kim, K.-H., Hong, S., Roh, B., Cheon, Y., & Park, M. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1608.08021 · Cited by 183
MSR: Multi-Scale Shape Regression for Scene Text Detection
Xue, C., Lu, S., & Zhang, W. (2019) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2019/139 · Cited by 149
Accurate Scene Text Detection Through Border Semantics Awareness and Bootstrapping
Xue, C., Lu, S., & Zhan, F. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01270-0_22 · Cited by 143
Learning Markov Clustering Networks for Scene Text Detection
Liu, Z., Lin, G., Yang, S. C., Feng, J., Lin, W., & Goh, W. L. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00725 · Cited by 141
Towards Robust Curve Text Detection With Conditional Spatial Expansion
Liu, Z., Lin, G., Yang, S. C., Liu, F., Lin, W., & Goh, W. L. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00744 · Cited by 95
DeRPN: Taking a Further Step toward More General Object Detection
Xie, L., Liu, Y., Jin, L., & Xie, Z. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33019046 · Cited by 56
Cited by
TrOCR: Transformer-Based Optical Character Recognition with Pre-trained Models
Li, M., Lv, T., Chen, J., Cui, L., Lu, Y., Florencio, D., Zhang, C., Li, Z., & Wei, F. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i11.26538 · Cited by 573
Real-Time Scene Text Detection With Differentiable Binarization and Adaptive Scale Fusion
Liao, M., Zou, Z., Wan, Z., Yao, C., & Bai, X. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3155612 · Cited by 431
Self-citation(2022) · doi:10.1145/3503161.3548541 · Cited by 428
Dynamic Anchor Learning for Arbitrary-Oriented Object Detection
Ming, Q., Zhou, Z., Miao, L., Zhang, H., & Li, L. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i3.16336 · Cited by 373
Fourier Contour Embedding for Arbitrary-Shaped Text Detection
Zhu, Y., Chen, J., Liang, L., Kuang, Z., Jin, L., & Zhang, W. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00314 · Cited by 311
Metadata
- Authors
- Liao, M., Wan, Z., Yao, C., Chen, K., & Bai, X.
- Venue
- Proceedings of the AAAI Conference on Artificial Intelligence
- Published
- 2020-04-03
- Volume
- 34
- Issue
- 07
- Pages
- 11474-11481
- ISSN
- 2159-5399 (ISSN-L)
- 2374-3468
- OpenAlex
- W2998621280
- Cited by
- 864
- References
- 41
- FWCI
- 39.09
- Type
- conference paper
- Language
- en
- Open access
- diamond
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.