CoChat

Text Recognition in the Wild: A Survey

Chen, Xiaoxue, Jin, Lianwen, Zhu, Yuanzhi, Luo, Canjie, Wang, Tianwei · 2022 · ACM Computing Surveys

The DOI matches its Crossref record; 173 of the 173 references it cites were found in a registry or an index.

Abstract

The history of text can be traced back over thousands of years. Rich and precise semantic information carried by text is important in a wide range of vision-based application scenarios. Therefore, text recognition in natural scenes has been an active research topic in computer vision and pattern recognition. In recent years, with the rise and development of deep learning, numerous methods have shown promising results in terms of innovation, practicality, and efficiency. This article aims to (1) summarize the fundamental problems and the state-of-the-art associated with scene text recognition, (2) introduce new insights and ideas, (3) provide a comprehensive review of publicly available resources, and (4) point out directions for future work. In summary, this literature review attempts to present an entire picture of the field of scene text recognition. It provides a comprehensive reference for people entering this field and could be helpful in inspiring future research. Related resources are available at our GitHub repository: https://github.com/HCIILAB/Scene-Text-Recognition.

Overview

Integrity signals

Registry

Crossref · 10.1145/3440756

Cites

173 of 173 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Citations

Cites

  • Deep Residual Learning for Image Recognition

    He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474 · cited 1×

    “nition. stage, such as the VGGNet [183], [116], [178], [133], [71], [137], [162]. For more powerful feature representation, some complex neural networks were applied in STR algorithms, such as ResNet [184] [135], [145], [148], [73], [151], [166], [152], [154], [48], [155], [157], [158], [161], [163], [164] and DenseNe…”
    Method
  • Long Short-Term Memory

    Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318 · cited 2×

    “[57] for training RNNs [29], [72] to label unsegmented sequences directly.”
    Background
  • Gradient-based learning applied to document recognition

    Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805 · cited 1×

    “Later, inspired by the success of the deep convolutional neural network in visual understanding [90], Wang et al.”
    Background
  • Histograms of Oriented Gradients for Human Detection

    Dalal, N., & Triggs, B. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.177 · Cited by 33,584 · cited 1×

    “ile suppressing irrelevant features such as font, color, size, and background. Motivated by the successes of [180], [181], [68], Su et al. [131] used the histogram of oriented gradients (HOG) feature [182] in their STR system to construct sequential features of word images. Later, CNNs [138], [140], [141], [143], [72]…”
    Method
  • A Computational Approach to Edge Detection

    Canny, J. (1986) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.1986.4767851 · Cited by 30,004 · cited 1×

    “lization methods are based on low-level features, such as color [35], [36], gradient [37], [38], stroke width transform [39], [40], maximally stable extremal regions (MSER) [41], [42], canny detector [43], [44], and connected component analysis [45], [46]. Most of current methods are based on deep neural networks [47]…”
    Method
  • Mask R-CNN

    He, K., Gkioxari, G., Dollar, P., & Girshick, R. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.322 · Cited by 29,137

  • Fast R-CNN

    Girshick, R. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.169 · Cited by 28,105

  • Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation

    Cho, K., van Merrienboer, B., Gulcehre, C., Bahdanau, D., Bougares, F., Schwenk, H., & Bengio, Y. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1179 · Cited by 25,545 · cited 2×

    “m decoding step size. At the t-th step, the output prediction o tis given by: o t= Softmax(W os t+b o); (2) where s tis the hidden state of RNN at time step t. Typically, a gated recurrent unit (GRU) [191] is used to update s tand model the longterm dependencies. Hence, s tis computed as s t= GRU(o prev;g t;s t 1); (3…”
    BackgroundMethod
  • Image Super-Resolution Using Deep Convolutional Networks

    Dong, C., Loy, C. C., He, K., & Tang, X. (2016) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2015.2439281 · Cited by 10,105

  • Speech recognition with deep recurrent neural networks

    Graves, A., Mohamed, A.-R., & Hinton, G. (2013) · 2013 IEEE International Conference on Acoustics, Speech and Signal Processing · doi:10.1109/icassp.2013.6638947 · Cited by 8,893 · cited 1×

    “tion CTC was proposed by Graves et al. [115] for training RNNs [191], [189] to label unsegmented sequences directly. CTC has achieved significant improvements in many fields, such as speech recognition [192], [193] and online handwritten text recognition [188], [194]. CTC is typically used in STR as a prediction module,…”
    Method

Show all 173 references

Research works printed but not linked: 73

  1. Ouais Alsharif and Joelle Pineau . 2014 . End-to-end text recognition with hybrid HMM maxout models . In Proceedings of ICLR. Ouais Alsharif and Joelle Pineau. 2014. End-to-end text recognition with hybrid HMM maxout models. In Proceedings of ICLR.
  2. Dzmitry Bahdanau , Kyunghyun Cho , and Yoshua Bengio . 2015 . Neural machine translation by jointly learning to align and translate . In Proceedings of ICLR. Dzmitry Bahdanau, Kyunghyun Cho, and Yoshua Bengio. 2015. Neural machine translation by jointly learning to align and translate. In Proceedings of ICLR.
  3. Christian Bartz , Haojin Yang , and Christoph Meinel . 2018 . SEE: Towards semi-supervised end-to-end scene text recognition . In Proceedings of AAAI. 6674--6681 . Christian Bartz, Haojin Yang, and Christoph Meinel. 2018. SEE: Towards semi-supervised end-to-end scene text recognition. In Proceedings of AAAI. 6674--6681.
  4. Théodore Bluche . 2016 . Joint line segmentation and transcription for end-to-end handwritten paragraph recognition . In Proceedings of NIPS. 838--846 . Théodore Bluche. 2016. Joint line segmentation and transcription for end-to-end handwritten paragraph recognition. In Proceedings of NIPS. 838--846.
  5. Chee-Kheng Chng , Yuliang Liu , Yipeng Sun , Chun Chet Ng , Canjie Luo , Zihan Ni , ChuanMing Fang , Shuaitao Zhang , Junyu Han , Errui Ding , et al. 2019 . ICDAR2019 robust reading challenge on arbitrary-shaped text (RRC-ArT). In Proceedings of ICDAR. 1571--1576 . Chee-Kheng Chng, Yuliang Liu, Yipeng Sun, Chun Chet Ng, Canjie Luo, Zihan Ni, ChuanMing Fang, Shuaitao Zhang, Junyu Han, Errui Ding, et al. 2019. ICDAR2019 robust reading challenge on arbitrary-shaped text (RRC-ArT). In Proceedings of ICDAR. 1571--1576.
  6. Tuan Anh Nguyen Dang and Dat Nguyen Thanh . 2019 . End-to-end information extraction by character-level embedding and multi-stage attentional u-net . In Proceedings of BMVC. 96 . Tuan Anh Nguyen Dang and Dat Nguyen Thanh. 2019. End-to-end information extraction by character-level embedding and multi-stage attentional u-net. In Proceedings of BMVC. 96.
  7. Abhishek Das , Samyak Datta , Georgia Gkioxari , Stefan Lee , Devi Parikh , and Dhruv Batra . 2018 . Embodied question answering . In Proceedings of CVPR. 2054--2063 . Abhishek Das, Samyak Datta, Georgia Gkioxari, Stefan Lee, Devi Parikh, and Dhruv Batra. 2018. Embodied question answering. In Proceedings of CVPR. 2054--2063.
  8. Jeffrey Dean , Greg Corrado , Rajat Monga , Kai Chen , Matthieu Devin , Mark Mao , Marc’aurelio Ranzato , Andrew Senior , Paul Tucker , Ke Yang , et al. 2012 . Large scale distributed deep networks . In Proceedings of NIPS. 1223--1231 . Jeffrey Dean, Greg Corrado, Rajat Monga, Kai Chen, Matthieu Devin, Mark Mao, Marc’aurelio Ranzato, Andrew Senior, Paul Tucker, Ke Yang, et al. 2012. Large scale distributed deep networks. In Proceedings of NIPS. 1223--1231.
  9. Xinjie Feng , Hongxun Yao , and Shengping Zhang . 2019. Focal CTC loss for chinese optical character recognition on unbalanced datasets. Complexity 2019 ( 2019 ), 9345861:1--9345861:11. Xinjie Feng, Hongxun Yao, and Shengping Zhang. 2019. Focal CTC loss for chinese optical character recognition on unbalanced datasets. Complexity 2019 (2019), 9345861:1--9345861:11.
  10. Vibhor Goel , Anand Mishra , Karteek Alahari , and C. V. Jawahar . 2013. Whole is greater than sum of parts: Recognizing scene text words . In Proceedings of ICDAR. 398--402 . Vibhor Goel, Anand Mishra, Karteek Alahari, and C. V. Jawahar. 2013. Whole is greater than sum of parts: Recognizing scene text words. In Proceedings of ICDAR. 398--402.
  11. Ian Goodfellow , Jean Pouget-Abadie , Mehdi Mirza , Bing Xu , David Warde-Farley , Sherjil Ozair , Aaron Courville , and Yoshua Bengio . 2014 . Generative adversarial nets . In Proceedings of NIPS. 2672--2680 . Ian Goodfellow, Jean Pouget-Abadie, Mehdi Mirza, Bing Xu, David Warde-Farley, Sherjil Ozair, Aaron Courville, and Yoshua Bengio. 2014. Generative adversarial nets. In Proceedings of NIPS. 2672--2680.
  12. Ian J. Goodfellow , David Warde-Farley , Mehdi Mirza , Aaron Courville , and Yoshua Bengio . 2013 . Maxout networks . In Proceedings of ICML. 1319--1327 . Ian J. Goodfellow, David Warde-Farley, Mehdi Mirza, Aaron Courville, and Yoshua Bengio. 2013. Maxout networks. In Proceedings of ICML. 1319--1327.
  13. Alex Graves and Navdeep Jaitly . 2014 . Towards end-to-end speech recognition with recurrent neural networks . In Proceedings of ICML. 1764--1772 . Alex Graves and Navdeep Jaitly. 2014. Towards end-to-end speech recognition with recurrent neural networks. In Proceedings of ICML. 1764--1772.
  14. Dafang He , Xiao Yang , Chen Liang , Zihan Zhou , Alexander G. Ororbi , Daniel Kifer , and C. Lee Giles . 2017. Multi-scale FCN with cascaded instance aware segmentation for arbitrary oriented word spotting in the wild . In Proceedings of CVPR. 3519--3528 . Dafang He, Xiao Yang, Chen Liang, Zihan Zhou, Alexander G. Ororbi, Daniel Kifer, and C. Lee Giles. 2017. Multi-scale FCN with cascaded instance aware segmentation for arbitrary oriented word spotting in the wild. In Proceedings of CVPR. 3519--3528.
  15. Mengchao He , Yuliang Liu , Zhibo Yang , Sheng Zhang , Canjie Luo , Feiyu Gao , Qi Zheng , Yongpan Wang , Xin Zhang , and Lianwen Jin . 2018 . ICPR2018 Contest on robust reading for multi-type web images. In Proceedings of ICPR. 7--12 . Mengchao He, Yuliang Liu, Zhibo Yang, Sheng Zhang, Canjie Luo, Feiyu Gao, Qi Zheng, Yongpan Wang, Xin Zhang, and Lianwen Jin. 2018. ICPR2018 Contest on robust reading for multi-type web images. In Proceedings of ICPR. 7--12.
  16. Pan He , Weilin Huang , Yu Qiao , Chen Change Loy , and Xiaoou Tang . 2016 . Reading scene text in deep convolutional sequences . In Proceedings of AAAI. 3501--3508 . Pan He, Weilin Huang, Yu Qiao, Chen Change Loy, and Xiaoou Tang. 2016. Reading scene text in deep convolutional sequences. In Proceedings of AAAI. 3501--3508.
  17. Gao Huang , Zhuang Liu , Laurens Van Der Maaten, and Kilian Q. Weinberger . 2017 . Densely connected convolutional networks. In Proceedings of CVPR. 4700--4708. Gao Huang, Zhuang Liu, Laurens Van Der Maaten, and Kilian Q. Weinberger. 2017. Densely connected convolutional networks. In Proceedings of CVPR. 4700--4708.
  18. Max Jaderberg , Karen Simonyan , Andrea Vedaldi , and Andrew Zisserman . 2014 . Synthetic data and artificial neural networks for natural scene text recognition . In Proceedings of NIPS-W. Max Jaderberg, Karen Simonyan, Andrea Vedaldi, and Andrew Zisserman. 2014. Synthetic data and artificial neural networks for natural scene text recognition. In Proceedings of NIPS-W.
  19. Max Jaderberg , Karen Simonyan , and Andrew Zisserman . 2015 . Deep structured output learning for unconstrained text recognition . In Proceedings of ICLR. Max Jaderberg, Karen Simonyan, and Andrew Zisserman. 2015. Deep structured output learning for unconstrained text recognition. In Proceedings of ICLR.
  20. Max Jaderberg , Karen Simonyan , Andrew Zisserman et al . 2015 . Spatial transformer networks . In Proceedings of NIPS. 2017--2025 . Max Jaderberg, Karen Simonyan, Andrew Zisserman et al. 2015. Spatial transformer networks. In Proceedings of NIPS. 2017--2025.
  21. Dimosthenis Karatzas , Lluis Gomez-Bigorda , Anguelos Nicolaou , Suman Ghosh , Andrew Bagdanov , Masakazu Iwamura , Jiri Matas , Lukas Neumann , Vijay Ramaseshan Chandrasekhar , Shijian Lu , et al. 2015 . ICDAR 2015 competition on robust reading. In Proceedings of ICDAR. 1156--1160 . Dimosthenis Karatzas, Lluis Gomez-Bigorda, Anguelos Nicolaou, Suman Ghosh, Andrew Bagdanov, Masakazu Iwamura, Jiri Matas, Lukas Neumann, Vijay Ramaseshan Chandrasekhar, Shijian Lu, et al. 2015. ICDAR 2015 competition on robust reading. In Proceedings of ICDAR. 1156--1160.
  22. Dimosthenis Karatzas , Faisal Shafait , Seiichi Uchida , Masakazu Iwamura , Lluis Gomez i Bigorda , Sergi Robles Mestre , Joan Mas , David Fernandez Mota , Jon Almazan Almazan , and Lluis Pere De Las Heras . 2013 . ICDAR 2013 robust reading competition. In Proceedings of ICDAR. 1484--1493 . Dimosthenis Karatzas, Faisal Shafait, Seiichi Uchida, Masakazu Iwamura, Lluis Gomez i Bigorda, Sergi Robles Mestre, Joan Mas, David Fernandez Mota, Jon Almazan Almazan, and Lluis Pere De Las Heras. 2013. ICDAR 2013 robust reading competition. In Proceedings of ICDAR. 1484--1493.
  23. Thomas N. Kipf and Max Welling . 2017 . Semi-supervised classification with graph convolutional networks. In Proceedings of ICLR. Thomas N. Kipf and Max Welling. 2017. Semi-supervised classification with graph convolutional networks. In Proceedings of ICLR.
  24. John D. Lafferty , Andrew McCallum , and Fernando C. N . Pereira . 2001 . Conditional random fields: Probabilistic models for segmenting and labeling sequence data. In Proceedings of ICML. 282--289. John D. Lafferty, Andrew McCallum, and Fernando C. N. Pereira. 2001. Conditional random fields: Probabilistic models for segmenting and labeling sequence data. In Proceedings of ICML. 282--289.
  25. Minhua Li and Chunheng Wang . 2008 . An adaptive text detection approach in images and video frames . In Proceedings of IJCNN. 72--77 . Minhua Li and Chunheng Wang. 2008. An adaptive text detection approach in images and video frames. In Proceedings of IJCNN. 72--77.
  26. Minghui Liao , Pengyuan Lyu , Minghang He , Cong Yao , Wenhao Wu , and Xiang Bai . 2019. Mask textspotter: An end-to-end trainable neural network for spotting text with arbitrary shapes . IEEE Trans. Pattern Anal. Mach. Intell . ( 2019 ). Minghui Liao, Pengyuan Lyu, Minghang He, Cong Yao, Wenhao Wu, and Xiang Bai. 2019. Mask textspotter: An end-to-end trainable neural network for spotting text with arbitrary shapes. IEEE Trans. Pattern Anal. Mach. Intell. (2019).
  27. Minghui Liao , Baoguang Shi , Xiang Bai , Xinggang Wang , and Wenyu Liu . 2017 . Textboxes: A fast text detector with a single deep neural network . In Proceedings of AAAI. 4161--4167 . Minghui Liao, Baoguang Shi, Xiang Bai, Xinggang Wang, and Wenyu Liu. 2017. Textboxes: A fast text detector with a single deep neural network. In Proceedings of AAAI. 4161--4167.
  28. Ron Litman , Oron Anschel , Shahar Tsiper , Roee Litman , Shai Mazor , and R. Manmatha . 2020. SCATTER: Selective context attentional scene text recognizer . In Proceedings of CVPR. Ron Litman, Oron Anschel, Shahar Tsiper, Roee Litman, Shai Mazor, and R. Manmatha. 2020. SCATTER: Selective context attentional scene text recognizer. In Proceedings of CVPR.
  29. Fei Liu , Jeffrey Flanigan , Sam Thomson , Norman Sadeh , and Noah A . Smith . 2018 . Toward abstractive summarization using semantic representations. CoRR abs/1805.10399. Fei Liu, Jeffrey Flanigan, Sam Thomson, Norman Sadeh, and Noah A. Smith. 2018. Toward abstractive summarization using semantic representations. CoRR abs/1805.10399. · arXiv
  30. Hu Liu , Sheng Jin , and Changshui Zhang . 2018 . Connectionist temporal classification with maximum entropy regularization . In Proceedings of NIPS. 831--841 . Hu Liu, Sheng Jin, and Changshui Zhang. 2018. Connectionist temporal classification with maximum entropy regularization. In Proceedings of NIPS. 831--841.
  31. Wei Liu , Chaofeng Chen , and Kwan-Yee K. Wong . 2018. Char-Net: A character-aware neural network for distorted scene text recognition . In Proceedings of AAAI. 7154--7161 . Wei Liu, Chaofeng Chen, and Kwan-Yee K. Wong. 2018. Char-Net: A character-aware neural network for distorted scene text recognition. In Proceedings of AAAI. 7154--7161.
  32. Xi Liu , Rui Zhang , Yongsheng Zhou , Qianyi Jiang , Qi Song , Nan Li , Kai Zhou , Lei Wang , Dong Wang , Minghui Liao , et al. 2019 . ICDAR 2019 robust reading challenge on reading chinese text on signboard. In Proceedings of ICDAR. 1577--1581 . Xi Liu, Rui Zhang, Yongsheng Zhou, Qianyi Jiang, Qi Song, Nan Li, Kai Zhou, Lei Wang, Dong Wang, Minghui Liao, et al. 2019. ICDAR 2019 robust reading challenge on reading chinese text on signboard. In Proceedings of ICDAR. 1577--1581.
  33. Zichuan Liu , Yixing Li , Fengbo Ren , Wang Ling Goh , and Hao Yu . 2018 . Squeezedtext: A real-time scene text recognition by binary convolutional encoder-decoder network . In Proceedings of AAAI. 7194--7201 . Zichuan Liu, Yixing Li, Fengbo Ren, Wang Ling Goh, and Hao Yu. 2018. Squeezedtext: A real-time scene text recognition by binary convolutional encoder-decoder network. In Proceedings of AAAI. 7194--7201.
  34. Shangbang Long and Cong Yao . 2020 . UnrealText: Synthesizing realistic scene text images from the unreal world . In Proceedings of CVPR. Shangbang Long and Cong Yao. 2020. UnrealText: Synthesizing realistic scene text images from the unreal world. In Proceedings of CVPR.
  35. Fang Lu , Corey S. McCaffrey , and Elaine I. Kuo . 2011 . Foreign language abbreviation translation in an instant messaging system . U.S. Patent 7 , 890 ,525. Fang Lu, Corey S. McCaffrey, and Elaine I. Kuo. 2011. Foreign language abbreviation translation in an instant messaging system. U.S. Patent 7,890,525.
  36. Simon M. Lucas . 2005 . ICDAR 2005 text locating competition results. In Proceedings of ICDAR. 80--84 . Simon M. Lucas. 2005. ICDAR 2005 text locating competition results. In Proceedings of ICDAR. 80--84.
  37. Simon M. Lucas , Alex Panaretos , Luis Sosa , Anthony Tang , Shirley Wong , and Robert Young . 2003 . ICDAR 2003 robust reading competitions. In Proceedings of ICDAR. 682--687 . Simon M. Lucas, Alex Panaretos, Luis Sosa, Anthony Tang, Shirley Wong, and Robert Young. 2003. ICDAR 2003 robust reading competitions. In Proceedings of ICDAR. 682--687.
  38. Canjie Luo , Qingxiang Lin , Yuliang Liu , Jin Lianwen , and Shen Chunhua . 2020. Separating content from style using adversarial learning for recognizing text in the wild . Int. J. Comput. Vis ( 2020 ). Canjie Luo, Qingxiang Lin, Yuliang Liu, Jin Lianwen, and Shen Chunhua. 2020. Separating content from style using adversarial learning for recognizing text in the wild. Int. J. Comput. Vis (2020).
  39. Jieru Mei , Luo Dai , Baoguang Shi , and Xiang Bai . 2016 . Scene text script identification with convolutional recurrent neural networks . In Proceedings of ICPR. 4053--4058 . Jieru Mei, Luo Dai, Baoguang Shi, and Xiang Bai. 2016. Scene text script identification with convolutional recurrent neural networks. In Proceedings of ICPR. 4053--4058.
  40. Anand Mishra , Karteek Alahari , and C. V. Jawahar . 2012. Scene text recognition using higher order language priors . In Proceedings of BMVC. 1--11 . Anand Mishra, Karteek Alahari, and C. V. Jawahar. 2012. Scene text recognition using higher order language priors. In Proceedings of BMVC. 1--11.
  41. Anand Mishra , Karteek Alahari , and C. V. Jawahar . 2012. Top-down and bottom-up cues for scene text recognition . In Proceedings of CVPR. 2687--2694 . Anand Mishra, Karteek Alahari, and C. V. Jawahar. 2012. Top-down and bottom-up cues for scene text recognition. In Proceedings of CVPR. 2687--2694.
  42. Ali Mosleh , Nizar Bouguila , and A. Ben Hamza . 2012. Image text detection using a bandlet-based edge detector and stroke width transform . In Proceedings of BMVC. 1--12 . Ali Mosleh, Nizar Bouguila, and A. Ben Hamza. 2012. Image text detection using a bandlet-based edge detector and stroke width transform. In Proceedings of BMVC. 1--12.
  43. Yuval Netzer , Tao Wang , Adam Coates , Alessandro Bissacco , Bo Wu , and Andrew Y . Ng . 2011 . Reading digits in natural images with unsupervised feature learning. In Proceedings of NIPS. Yuval Netzer, Tao Wang, Adam Coates, Alessandro Bissacco, Bo Wu, and Andrew Y. Ng. 2011. Reading digits in natural images with unsupervised feature learning. In Proceedings of NIPS.
  44. Lukas Neumann and Jiri Matas . 2010 . A method for text localization and recognition in real-world images . In Proceedings of ACCV. 770--783 . Lukas Neumann and Jiri Matas. 2010. A method for text localization and recognition in real-world images. In Proceedings of ACCV. 770--783.
  45. Clément Peyrard , Moez Baccouche , Franck Mamalet , and Christophe Garcia . 2015 . ICDAR2015 competition on text image super-resolution. In Proceedings of ICDAR. 1201--1205 . Clément Peyrard, Moez Baccouche, Franck Mamalet, and Christophe Garcia. 2015. ICDAR2015 competition on text image super-resolution. In Proceedings of ICDAR. 1201--1205.
  46. Weichao Qiu and Alan L . Yuille . 2016 . UnrealCV: Connecting computer vision to unreal engine. In Proceedings of ECCV. 909--916. Weichao Qiu and Alan L. Yuille. 2016. UnrealCV: Connecting computer vision to unreal engine. In Proceedings of ECCV. 909--916.
  47. Alain Rouh and Jean Beaudet . 2019 . Method and a device for tracking characters that appear on a plurality of images of a video stream of a text . U.S. Patent App. 10/185 , 873 . Alain Rouh and Jean Beaudet. 2019. Method and a device for tracking characters that appear on a plurality of images of a video stream of a text. U.S. Patent App. 10/185,873.
  48. Joan Andreu Sanchez , Verónica Romero , Alejandro H. Toselli , Mauricio Villegas , and Enrique Vidal . 2017 . ICDAR2017 competition on handwritten text recognition on the read dataset. In Proceedings of ICDAR. 1383--1388 . Joan Andreu Sanchez, Verónica Romero, Alejandro H. Toselli, Mauricio Villegas, and Enrique Vidal. 2017. ICDAR2017 competition on handwritten text recognition on the read dataset. In Proceedings of ICDAR. 1383--1388.
  49. Pierre Sermanet , Soumith Chintala , and Yann LeCun . 2012 . Convolutional neural networks applied to house numbers digit classification . In Proceedings of ICPR. 3288--3291 . Pierre Sermanet, Soumith Chintala, and Yann LeCun. 2012. Convolutional neural networks applied to house numbers digit classification. In Proceedings of ICPR. 3288--3291.
  50. Asif Shahab , Faisal Shafait , and Andreas Dengel . 2011 . ICDAR 2011 robust reading competition challenge 2: Reading text in scene images. In Proceedings of ICDAR. 1491--1496 . Asif Shahab, Faisal Shafait, and Andreas Dengel. 2011. ICDAR 2011 robust reading competition challenge 2: Reading text in scene images. In Proceedings of ICDAR. 1491--1496.
  51. Baoguang Shi , Cong Yao , Minghui Liao , Mingkun Yang , Pei Xu , Linyan Cui , Serge Belongie , Shijian Lu , and Xiang Bai . 2017 . ICDAR2017 competition on reading Chinese text in the wild. In Proceedings of ICDAR. 1429--1434 . Baoguang Shi, Cong Yao, Minghui Liao, Mingkun Yang, Pei Xu, Linyan Cui, Serge Belongie, Shijian Lu, and Xiang Bai. 2017. ICDAR2017 competition on reading Chinese text in the wild. In Proceedings of ICDAR. 1429--1434.
  52. Karen Simonyan and Andrew Zisserman . 2015 . Very deep convolutional networks for large-scale image recognition . In Proceedings of ICLR. Karen Simonyan and Andrew Zisserman. 2015. Very deep convolutional networks for large-scale image recognition. In Proceedings of ICLR.
  53. Amanpreet Singh , Vivek Natarajan , Meet Shah, Yu Jiang, Xinlei Chen, Dhruv Batra, Devi Parikh, and Marcus Rohrbach. 2019. Towards VQA models that can read. In Proceedings of CVPR. 8317--8326 . Amanpreet Singh, Vivek Natarajan, Meet Shah, Yu Jiang, Xinlei Chen, Dhruv Batra, Devi Parikh, and Marcus Rohrbach. 2019. Towards VQA models that can read. In Proceedings of CVPR. 8317--8326.
  54. Ajeet Kumar Singh , Anand Mishra , Pranav Dabral , and C. V. Jawahar . 2016. A simple and effective solution for script identification in the wild . In Proceedings of IAPR DAS. 428--433 . Ajeet Kumar Singh, Anand Mishra, Pranav Dabral, and C. V. Jawahar. 2016. A simple and effective solution for script identification in the wild. In Proceedings of IAPR DAS. 428--433.
  55. Bolan Su and Shijian Lu . 2014 . Accurate scene text recognition based on recurrent neural network . In Proceedings of ACCV. 35--48 . Bolan Su and Shijian Lu. 2014. Accurate scene text recognition based on recurrent neural network. In Proceedings of ACCV. 35--48.
  56. Yipeng Sun , Zihan Ni , Chee-Kheng Chng , Yuliang Liu , Canjie Luo , Chun Chet Ng , Junyu Han , Errui Ding , Jingtuo Liu , Dimosthenis Karatzas et al . 2019 . ICDAR 2019 Competition on large-scale street view text with partial labeling--RRC-LSVT. In Proceedings of ICDAR. 1557--1562 . Yipeng Sun, Zihan Ni, Chee-Kheng Chng, Yuliang Liu, Canjie Luo, Chun Chet Ng, Junyu Han, Errui Ding, Jingtuo Liu, Dimosthenis Karatzas et al. 2019. ICDAR 2019 Competition on large-scale street view text with partial labeling--RRC-LSVT. In Proceedings of ICDAR. 1557--1562.
  57. Ashish Vaswani , Noam Shazeer , Niki Parmar , Jakob Uszkoreit , Llion Jones , Aidan N. Gomez , Łukasz Kaiser , and Illia Polosukhin . 2017 . Attention is all you need . In Proceedings of NIPS. 5998--6008 . Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Łukasz Kaiser, and Illia Polosukhin. 2017. Attention is all you need. In Proceedings of NIPS. 5998--6008.
  58. Andreas Veit , Tomas Matera , Lukas Neumann , Jiri Matas , and Serge Belongie . 2016 . Coco-text: Dataset and benchmark for text detection and recognition in natural images. CoRR abs/1601.07140. Andreas Veit, Tomas Matera, Lukas Neumann, Jiri Matas, and Serge Belongie. 2016. Coco-text: Dataset and benchmark for text detection and recognition in natural images. CoRR abs/1601.07140. · arXiv
  59. Luis Von Ahn , Benjamin Maurer , Colin McMillen , David Abraham , and Manuel Blum . 2008 . Recaptcha: Human-based character recognition via web security measures. Science 321, 5895 (2008), 1465--1468. Luis Von Ahn, Benjamin Maurer, Colin McMillen, David Abraham, and Manuel Blum. 2008. Recaptcha: Human-based character recognition via web security measures. Science 321, 5895 (2008), 1465--1468.
  60. Jianfeng Wang and Xiaolin Hu . 2017 . Gated recurrent convolution neural network for OCR . In Proceedings of NIPS. 335--344 . Jianfeng Wang and Xiaolin Hu. 2017. Gated recurrent convolution neural network for OCR. In Proceedings of NIPS. 335--344.
  61. Kai Wang , Boris Babenko , and Serge Belongie . 2011 . End-to-end scene text recognition . In Proceedings of ICCV. 1457--1464 . Kai Wang, Boris Babenko, and Serge Belongie. 2011. End-to-end scene text recognition. In Proceedings of ICCV. 1457--1464.
  62. Peng Wang Lu Yang Hui Li Yuyan Deng Chunhua Shen and Yanning Zhang. 2019. A simple and robust convolutional-attention network for irregular text recognition. CoRR abs/1904.01375. Peng Wang Lu Yang Hui Li Yuyan Deng Chunhua Shen and Yanning Zhang. 2019. A simple and robust convolutional-attention network for irregular text recognition. CoRR abs/1904.01375. · arXiv
  63. Tao Wang , David J. Wu , Adam Coates , and Andrew Y . Ng . 2012 . End-to-end text recognition with convolutional neural networks. In Proceedings of ICPR. 3304--3308. Tao Wang, David J. Wu, Adam Coates, and Andrew Y. Ng. 2012. End-to-end text recognition with convolutional neural networks. In Proceedings of ICPR. 3304--3308.
  64. Xinyu Wang , Yuliang Liu , Chunhua Shen , Chun Chet Ng , Canjie Luo, Lianwen Jin, Chee Seng Chan, Anton van den Hengel, and Liangwei Wang. 2020 . On the general value of evidence, and bilingual scene-text visual question answering. In Proceedings of CVPR. Xinyu Wang, Yuliang Liu, Chunhua Shen, Chun Chet Ng, Canjie Luo, Lianwen Jin, Chee Seng Chan, Anton van den Hengel, and Liangwei Wang. 2020. On the general value of evidence, and bilingual scene-text visual question answering. In Proceedings of CVPR.
  65. Fred L. Bookstein Principal Warps . 1989 . Thin-plate splines and the decompositions of deformations . IEEE Trans. Pattern Anal. Mach. Intell. 11 , 6 (1989). Fred L. Bookstein Principal Warps. 1989. Thin-plate splines and the decompositions of deformations. IEEE Trans. Pattern Anal. Mach. Intell. 11, 6 (1989).
  66. Linjie Xing , Zhi Tian , Weilin Huang , and Matthew R . Scott . 2019 . Convolutional character networks. In Proceedings of ICCV. 9125--9135. Linjie Xing, Zhi Tian, Weilin Huang, and Matthew R. Scott. 2019. Convolutional character networks. In Proceedings of ICCV. 9125--9135.
  67. Xiao Yang , Dafang He , Zihan Zhou , Daniel Kifer , and C. Lee Giles . 2017. Learning to read irregular text with attention mechanisms . In Proceedings of IJCAI. 3280--3286 . Xiao Yang, Dafang He, Zihan Zhou, Daniel Kifer, and C. Lee Giles. 2017. Learning to read irregular text with attention mechanisms. In Proceedings of IJCAI. 3280--3286.
  68. Cong Yao , Xiang Bai , Wenyu Liu , Yi Ma , and Zhuowen Tu . 2012 . Detecting texts of arbitrary orientations in natural images . In Proceedings of CVPR. 1083--1090 . Cong Yao, Xiang Bai, Wenyu Liu, Yi Ma, and Zhuowen Tu. 2012. Detecting texts of arbitrary orientations in natural images. In Proceedings of CVPR. 1083--1090.
  69. Qixiang Ye , Wen Gao , Weiqiang Wang , and Wei Zeng . 2003 . A robust text detection algorithm in images and video frames . In Proceedings of ICASSP. IEEE, 802--806 . Qixiang Ye, Wen Gao, Weiqiang Wang, and Wei Zeng. 2003. A robust text detection algorithm in images and video frames. In Proceedings of ICASSP. IEEE, 802--806.
  70. Fei Yin , Yi-Chao Wu , Xu-Yao Zhang , and Cheng-Lin Liu . 2017 . Scene text recognition with sliding convolutional character models . In Proceedings of ICCV. Fei Yin, Yi-Chao Wu, Xu-Yao Zhang, and Cheng-Lin Liu. 2017. Scene text recognition with sliding convolutional character models. In Proceedings of ICCV.
  71. Tai-Ling Yuan Zhe Zhu Kun Xu Cheng-Jun Li and Shi-Min Hu. 2018. Chinese text in the wild. CoRR abs/1803.00085. Tai-Ling Yuan Zhe Zhu Kun Xu Cheng-Jun Li and Shi-Min Hu. 2018. Chinese text in the wild. CoRR abs/1803.00085. · arXiv
  72. Sheng Zhang , Yuliang Liu , Lianwen Jin , and Canjie Luo . 2018 . Feature enhancement network: A refined scene text detector . In Proceedings of AAAI. 2612--2619 . Sheng Zhang, Yuliang Liu, Lianwen Jin, and Canjie Luo. 2018. Feature enhancement network: A refined scene text detector. In Proceedings of AAAI. 2612--2619.
  73. Yu Zhou , Shuang Liu , Yongzheng Zhang , Yipeng Wang , and Weiyao Lin . 2014 . Perspective scene text recognition with feature compression and ranking . In Proceedings of ACCV. 181--195 . Yu Zhou, Shuang Liu, Yongzheng Zhang, Yipeng Wang, and Weiyao Lin. 2014. Perspective scene text recognition with feature compression and ranking. In Proceedings of ACCV. 181--195.

Cited by

Metadata

Authors
Chen, X., Jin, L., Zhu, Y., Luo, C., & Wang, T.
Affiliations
South China University of Technology (CN)
Venue
ACM Computing Surveys
Published
2021-03-05
Volume
54
Issue
2
Pages
1-35
ISSN
  • 0360-0300 (ISSN-L)
  • 1557-7341
OpenAlex
W3134064484
Cited by
205
References
170
Citations by year
2026: 27 · 2025: 39 · 2024: 38 · 2023: 50 · 2022: 31 · 2021: 20
FWCI
12.51
Type
journal article
Language
en
Open access
closed
Locations
ACM Computing Surveys (publishedVersion)
Funders
  • Guangdong Intellectual Property Office Project (2018-10-1)
  • National Natural Science Foundation of China (61936003)
  • Natural Science Foundation of Guangdong Province (2017A030312006)
Topics
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Handwritten Text Recognition Techniques
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Vehicle License Plate Recognition
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
Keywords
scene text recognition, natural scene text, text detection, text localization, text recognition, benchmark dataset

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.