The DOI matches its Crossref record; 26 of the 26 references it cites were found in a registry or an index.
SVTR: Scene Text Recognition with a Single Visual Model
Open accessAbstract
Dominant scene text recognition models commonly contain two building blocks, a visual model for feature extraction and a sequence model for text transcription. This hybrid architecture, although accurate, is complex and less efficient. In this study, we propose a Single Visual model for Scene Text recognition within the patch-wise image tokenization framework, which dispenses with the sequential modeling entirely. The method, termed SVTR, firstly decomposes an image text into small patches named character components. Afterward, hierarchical stages are recurrently carried out by component-level mixing, merging and/or combining. Global and local mixing blocks are devised to perceive the inter-character and intra-character patterns, leading to a multi-grained character component perception. Thus, characters are recognized by a simple linear prediction. Experimental results on both English and Chinese scene text recognition tasks demonstrate the effectiveness of SVTR. SVTR-L (Large) achieves highly competitive accuracy in English and outperforms existing methods by a large margin in Chinese, while running faster. In addition, SVTR-T (Tiny) is an effective and much smaller model, which shows appealing speed at inference. The code is publicly available at https://github.com/PaddlePaddle/PaddleOCR.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale
Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., Gelly, S., et al. (2020) · arXiv · doi:10.48550/arxiv.2010.11929 · Cited by 47,472
Swin Transformer: Hierarchical Vision Transformer using Shifted Windows
Liu, Z., Lin, Y., Cao, Y., Hu, H., Wei, Y., Zhang, Z., Lin, S., & Guo, B. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00986 · Cited by 35,534
Shi, B., Bai, X., & Yao, C. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2646371 · Cited by 3,172
Synthetic Data for Text Localisation in Natural Images
Gupta, A., Vedaldi, A., & Zisserman, A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.254 · Cited by 1,563
ICDAR 2015 competition on Robust Reading
Karatzas, D., Gomez-Bigorda, L., Nicolaou, A., Ghosh, S., Bagdanov, A., Iwamura, M., Matas, J., Neumann, L., Chandrasekhar, V. R., Lu, S., et al. (2015) · 2015 13th International Conference on Document Analysis and Recognition (ICDAR) · doi:10.1109/icdar.2015.7333942 · Cited by 1,547
ICDAR 2013 Robust Reading Competition
Karatzas, D., Shafait, F., Uchida, S., Iwamura, M., Bigorda, L. G. I., Mestre, S. R., Mas, J., Mota, D. F., Almazan, J. A., & de las Heras, L. P. (2013) · 2013 12th International Conference on Document Analysis and Recognition · doi:10.1109/icdar.2013.221 · Cited by 1,360
Reading text in the wild with convolutional neural networks
Jaderberg, M., Simonyan, K., Vedaldi, A., & Zisserman, A. (2016) · International Journal of Computer Vision · doi:10.1007/s11263-015-0823-z · Cited by 1,191
End-to-end scene text recognition
Wang, K., Babenko, B., & Belongie, S. (2011) · 2011 International Conference on Computer Vision · doi:10.1109/iccv.2011.6126402 · Cited by 1,060
ASTER: An Attentional Scene Text Recognizer with Flexible Rectification
Shi, B., Yang, M., Wang, X., Lyu, P., Yao, C., & Bai, X. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2848939 · Cited by 906
Scene Text Recognition using Higher Order Language Priors
Mishra, A., Alahari, K., & Jawahar, C. (2012) · Procedings of the British Machine Vision Conference 2012 · doi:10.5244/c.26.127 · Cited by 831
Synthetic Data and Artificial Neural Networks for Natural Scene Text Recognition
Jaderberg, M., Simonyan, K., Vedaldi, A., & Zisserman, A. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1406.2227 · Cited by 726
What Is Wrong With Scene Text Recognition Model Comparisons? Dataset and Model Analysis
Baek, J., Kim, G., Lee, J., Park, S., Han, D., Yun, S., Oh, S. J., & Lee, H. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00481 · Cited by 617
A robust arbitrary text detection system for natural scene images
Risnumawan, A., Shivakumara, P., Chan, C. S., & Tan, C. L. (2014) · Expert Systems with Applications · doi:10.1016/j.eswa.2014.07.008 · Cited by 531
Recognizing Text with Perspective Distortion in Natural Scenes
Phan, T. Q., Shivakumara, P., Tian, S., & Tan, C. L. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.76 · Cited by 473
Fang, S., Xie, H., Wang, Y., Mao, Z., & Zhang, Y. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00702 · Cited by 450
Show, Attend and Read: A Simple and Strong Baseline for Irregular Text Recognition
Li, H., Wang, P., Shen, C., & Zhang, G. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33018610 · Cited by 432
Towards Accurate Scene Text Recognition With Semantic Reasoning Networks
Yu, D., Li, X., Zhang, C., Liu, T., Han, J., Liu, J., & Ding, E. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01213 · Cited by 385
Rosetta: Large Scale System for Text Detection and Recognition in Images
Borisyuk, F., Gordo, A., & Sivakumar, V. (2018) · Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3219819.3219861 · Cited by 353
Vision Transformer for Fast and Efficient Scene Text Recognition
Atienza, R. (2021) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-86549-8_21 · Cited by 211
NRTR: A No-Recurrence Sequence-to-Sequence Model for Scene Text Recognition
Sheng, F., Chen, Z., & Xu, B. (2019) · 2019 International Conference on Document Analysis and Recognition (ICDAR) · doi:10.1109/icdar.2019.00130 · Cited by 207
Self-citationGTC: Guided Training of CTC towards Efficient and Accurate Scene Text Recognition
Hu, W., Cai, X., Hou, J. Y., Yi, S., & Lin, Z. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i07.6735 · Cited by 185
From Two to One: A New Scene Text Recognizer with Visual Language Modeling Network
Wang, Y., Xie, H., Fang, S., Wang, J., Zhu, S., & Zhang, Y. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01393 · Cited by 183
CDistNet: Perceiving Multi-domain Character Distance for Robust Text Recognition
Zheng, T., Chen, Z., Fang, S., Xie, H., & Jiang, Y. (2023) · International Journal of Computer Vision · doi:10.1007/s11263-023-01880-0 · Cited by 142
Self-citationAutoSTR: Efficient Backbone Search for Scene Text Recognition
Zhang, H., Yao, Q., Yang, M., Xu, Y., & Bai, X. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58586-0_44 · Cited by 68
Visual-Semantic Transformer for Scene Text RecognitionPreprint
Tang, X., Lai, Y., Liu, Y., Fu, Y., & Fang, R. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2112.00948 · Cited by 20
A Multi-Object Rectified Attention Network for Scene Text RecognitionPreprint
Luo, C., Jin, L., & Sun, Z. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1901.03003 · Cited by 12
Cited by
TrOCR: Transformer-Based Optical Character Recognition with Pre-trained Models
Li, M., Lv, T., Chen, J., Cui, L., Lu, Y., Florencio, D., Zhang, C., Li, Z., & Wei, F. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i11.26538 · Cited by 573
Metadata
- Authors
- Du, Y., Chen, Z., Jia, C., Yin, X., Zheng, T., Li, C., Du, Y., & Jiang, Y.-G.
- Venue
- Proceedings of the Thirty-First International Joint Conference on Artificial Intelligence
- Published
- 2022-07
- Pages
- 884-890
- OpenAlex
- W4229030834
- Cited by
- 271
- References
- 26
- FWCI
- 21.44
- Type
- conference paper
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.