The DOI matches its Crossref record; 26 of the 26 references it cites were found in a registry or an index.
PhotoOCR: Reading Text in Uncontrolled Conditions
Abstract
We describe Photo OCR, a system for text extraction from images. Our particular focus is reliable text extraction from smartphone imagery, with the goal of text recognition as a user input modality similar to speech recognition. Commercially available OCR performs poorly on this task. Recent progress in machine learning has substantially improved isolated character classification, we build on this progress by demonstrating a complete OCR system using these techniques. We also incorporate modern data center-scale distributed language modelling. Our approach is capable of recognizing text in a variety of challenging imaging conditions where traditional OCR systems fail, notably in the presence of substantial blur, low resolution, low contrast, high image noise and other distortions. It also operates with low latency, mean processing time is 600 ms per image. We evaluate our system on public benchmark datasets for text extraction and outperform all previously reported results, more than halving the error rate on multiple benchmarks. The system is currently in use in many applications at Google, and is available as a user input modality in Google Translate for Android.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
Histograms of Oriented Gradients for Human Detection
Dalal, N., & Triggs, B. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.177 · Cited by 33,584
Artificial intelligence: a modern approach
(1995) · Choice Reviews Online · doi:10.5860/choice.33-1577 · Cited by 21,974
Rapid object detection using a boosted cascade of simple features
Viola, P., & Jones, M. (2005) · Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001 · doi:10.1109/cvpr.2001.990517 · Cited by 18,300
(2010) · International Conference on Machine Learning · Cited by 13,995
Artificial intelligence: A modern approach
Nilsson, N. J. (1996) · Artificial Intelligence · doi:10.1016/0004-3702(96)00007-0 · Cited by 10,583
(2010) · Cited by 8,261
Improving neural networks by preventing co-adaptation of feature detectors
Hinton, G. E., Srivastava, N., Krizhevsky, A., Sutskever, I., & Salakhutdinov, R. R. (2012) · arXiv · doi:10.48550/arxiv.1207.0580 · Cited by 6,382
Large Scale Distributed Deep Networks
Dean, J. B., Corrado, G. S., Monga, R., Chen, K., Devin, M., Mao, M., Ranzato, M., Senior, A., Tucker, P. A., Yang, K., et al. (2012) · neural information processing systems · Cited by 4,489
Reading digits in natural images with unsupervised feature learning
Netzer, Y. (2024) · doi:10.57702/e7wwo0zk · Cited by 4,149
Self-citation
Cited by
Shi, B., Bai, X., & Yao, C. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2646371 · Cited by 3,172
Arbitrary-Oriented Scene Text Detection via Rotation Proposals
Ma, J., Shao, W., Ye, H., Wang, L., Wang, H., Zheng, Y., & Xue, X. (2018) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2018.2818020 · Cited by 1,260
Reading text in the wild with convolutional neural networks
Jaderberg, M., Simonyan, K., Vedaldi, A., & Zisserman, A. (2016) · International Journal of Computer Vision · doi:10.1007/s11263-015-0823-z · Cited by 1,191
Speeding up Convolutional Neural Networks with Low Rank Expansions
Jaderberg, M., Vedaldi, A., & Zisserman, A. (2014) · Proceedings of the British Machine Vision Conference 2014 · doi:10.5244/c.28.88 · Cited by 1,164
ASTER: An Attentional Scene Text Recognizer with Flexible Rectification
Shi, B., Yang, M., Wang, X., Lyu, P., Yao, C., & Bai, X. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2848939 · Cited by 906
Text Detection and Recognition in Imagery: A Survey
Ye, Q., & Doermann, D. (2015) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2014.2366765 · Cited by 780
Detecting Oriented Text in Natural Images by Linking Segments
Shi, B., Bai, X., & Belongie, S. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.371 · Cited by 775
Synthetic Data and Artificial Neural Networks for Natural Scene Text Recognition
Jaderberg, M., Simonyan, K., Vedaldi, A., & Zisserman, A. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1406.2227 · Cited by 726
Robust Scene Text Recognition with Automatic Rectification
Shi, B., Wang, X., Lyu, P., Yao, C., & Bai, X. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.452 · Cited by 693
Deep Features for Text Spotting
Jaderberg, M., Vedaldi, A., & Zisserman, A. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10593-2_34 · Cited by 653
Multi-oriented Text Detection with Fully Convolutional Networks
Zhang, Z., Zhang, C., Shen, W., Yao, C., Liu, W., & Bai, X. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.451 · Cited by 596
Rotation-Sensitive Regression for Oriented Scene Text Detection
Liao, M., Zhu, Z., Shi, B., Xia, G.-S., & Bai, X. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00619 · Cited by 563
Focusing Attention: Towards Accurate Text Recognition in Natural Images
Cheng, Z., Bai, F., Xu, Y., Zheng, G., Pu, S., & Zhou, S. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.543 · Cited by 528
Scene Text Detection and Recognition: The Deep Learning Era
Long, S., He, X., & Yao, C. (2021) · International Journal of Computer Vision · doi:10.1007/s11263-020-01369-0 · Cited by 527
Mask TextSpotter: An End-to-End Trainable Neural Network for Spotting Text with Arbitrary Shapes
Lyu, P., Liao, M., Yao, C., Wu, W., & Bai, X. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01264-9_5 · Cited by 522
Word Spotting and Recognition with Embedded Attributes
Almazan, J., Gordo, A., Fornes, A., & Valveny, E. (2014) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2014.2339814 · Cited by 517
MORAN: A Multi-Object Rectified Attention Network for scene text recognition
Luo, C., Jin, L., & Sun, Z. (2019) · Pattern Recognition · doi:10.1016/j.patcog.2019.01.020 · Cited by 510
Recursive Recurrent Nets with Attention Modeling for OCR in the Wild
Lee, C.-Y., & Osindero, S. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.245 · Cited by 458
Speeding up Convolutional Neural Networks with Low Rank Expansions
Jaderberg, M., Vedaldi, A., & Zisserman, A. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1405.3866 · Cited by 447
Scene text detection and recognition: recent advances and future trends
Zhu, Y., Yao, C., & Bai, X. (2016) · Frontiers of Computer Science · doi:10.1007/s11704-015-4488-0 · Cited by 402
Multi-oriented Scene Text Detection via Corner Localization and Region Segmentation
Lyu, P., Yao, C., Wu, W., Yan, S., & Bai, X. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00788 · Cited by 389
Robust Scene Text Detection with Convolution Neural Network Induced MSER Trees
Huang, W., Qiao, Y., & Tang, X. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10593-2_33 · Cited by 381
Deep Matching Prior Network: Toward Tighter Multi-oriented Text Detection
Liu, Y., & Jin, L. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.368 · Cited by 351
Toward End-to-End Car License Plate Detection and Recognition With Deep Neural Networks
Li, H., Wang, P., & Shen, C. (2019) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2018.2847291 · Cited by 346
Text-Attentional Convolutional Neural Network for Scene Text Detection
He, T., Huang, W., Qiao, Y., & Yao, J. (2016) · IEEE Transactions on Image Processing · doi:10.1109/tip.2016.2547588 · Cited by 345
An Exploration of Parameter Redundancy in Deep Networks with Circulant Projections
Cheng, Y., Yu, F. X., Feris, R. S., Kumar, S., Choudhary, A., & Chang, S.-F. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.327 · Cited by 303
Reading Scene Text in Deep Convolutional Sequences
He, P., Huang, W., Qiao, Y., Loy, C., & Tang, X. (2016) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v30i1.10465 · Cited by 300
ESIR: End-To-End Scene Text Recognition via Iterative Image Rectification
Zhan, F., & Lu, S. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00216 · Cited by 296
Decoupled Attention Network for Text Recognition
Wang, T., Zhu, Y., Jin, L., Luo, C., Chen, X., Wu, Y., Wang, Q., & Cai, M. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i07.6903 · Cited by 294
AON: Towards Arbitrarily-Oriented Text Recognition
Cheng, Z., Xu, Y., Bai, F., Niu, Y., Pu, S., & Zhou, S. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00584 · Cited by 292
A generative vision model that trains with high data efficiency and breaks text-based CAPTCHAs
George, D., Lehrach, W., Kansky, K., Lázaro-Gredilla, M., Laan, C., Marthi, B., Lou, X., Meng, Z., Liu, Y., Wang, H., et al. (2017) · Science · doi:10.1126/science.aag2612 · Cited by 280
Symmetry-based text line detection in natural scenes
Zhang, Z., Shen, W., Yao, C., & Bai, X. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298871 · Cited by 278
Multi-Orientation Scene Text Detection with Adaptive Clustering
Yin, X.-C., Pei, W.-Y., Zhang, J., & Hao, H.-W. (2015) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2014.2388210 · Cited by 259
Towards End-to-End Text Spotting with Convolutional Recurrent Neural Networks
Li, H., Wang, P., & Shen, C. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.560 · Cited by 230
Text Recognition in the Wild: A Survey
Chen, X., Jin, L., Zhu, Y., Luo, C., & Wang, T. (2022) · ACM Computing Surveys · doi:10.1145/3440756 · Cited by 205
“vert all text regions into the target string sequences. It usually includes text detection, text recognition, and postprocessing. The construction of a real-time and efficient end-to-end systems [16], [70], [74] has become a new trend in recent years. Some researchers [68], [15], [75] interpret text detection and text…”
BackgroundMethodInfluentialPAN++: Towards Efficient and Accurate End-to-End Spotting of Arbitrarily-Shaped Text
Wang, W., Xie, E., Li, X., Liu, X., Liang, D., Zhibo, Y., Lu, T., & Shen, C. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3077555 · Cited by 140
ASTS: A Unified Framework for Arbitrary Shape Text Spotting
Liu, J., Chen, Z., Du, B., & Tao, D. (2020) · IEEE Transactions on Image Processing · doi:10.1109/tip.2020.2984082 · Cited by 23
“The character-based methods follow conventional OCR techniques, first segmenting and recognizing individual characters and then linking these characters into words [35], [36].”
MethodAn enhanced text detection technique for the visually impaired to read text
Joan, S. P. F., & Valli, S. (2017) · Information Systems Frontiers · doi:10.1007/s10796-016-9699-x · Cited by 17
Metadata
- Authors
- Bissacco, A., Cummins, M., Netzer, Y., & Neven, H.
- Venue
- 2013 IEEE International Conference on Computer Vision
- Publisher
- IEEE
- Published
- 2013-12
- Pages
- 785-792
- OpenAlex
- W2122221966
- Cited by
- 457
- References
- 26
- FWCI
- 24.32
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.