The DOI matches its Crossref record; 53 of the 53 references it cites were found in a registry or an index.
Word Spotting and Recognition with Embedded Attributes
Abstract
This paper addresses the problems of word spotting and word recognition on images. In word spotting, the goal is to find all instances of a query word in a dataset of images. In recognition, the goal is to recognize the content of the word image, usually aided by a dictionary or lexicon. We describe an approach in which both word images and text strings are embedded in a common vectorial subspace. This is achieved by a combination of label embedding and attributes learning, and a common subspace regression. In this subspace, images and strings that represent the same word are close together, allowing one to cast recognition and retrieval tasks as a nearest neighbor problem. Contrary to most other existing methods, our representation has a fixed length, is low dimensional, and is very fast to compute and, especially, to compare. We test our approach on four public datasets of both handwritten documents and natural images showing results comparable or better than the state-of-the-art on spotting and recognition tasks.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Histograms of Oriented Gradients for Human Detection
Dalal, N., & Triggs, B. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.177 · Cited by 33,584
Beyond Bags of Features: Spatial Pyramid Matching for Recognizing Natural Scene Categories
Lazebnik, S., Schmid, C., & Ponce, J. (2006) · 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 2 (CVPR'06) · doi:10.1109/cvpr.2006.68 · Cited by 7,916
RELATIONS BETWEEN TWO SETS OF VARIATES
HOTELLING, H. (1936) · Biometrika · doi:10.1093/biomet/28.3-4.321 · Cited by 5,263
Visual categorization with bags of keypoints
Csurka, G. (2004) · Cited by 4,379
Canonical Correlation Analysis: An Overview with Application to Learning Methods
Hardoon, D. R., Szedmak, S., & Shawe-Taylor, J. (2004) · Neural Computation · doi:10.1162/0899766042321814 · Cited by 3,202
Product Quantization for Nearest Neighbor Search
Jégou, H., Douze, M., & Schmid, C. (2011) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2010.57 · Cited by 2,956
Improving the Fisher Kernel for Large-Scale Image Classification
Perronnin, F., Sánchez, J., & Mensink, T. (2010) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-15561-1_11 · Cited by 2,588
Describing objects by their attributes
Farhadi, A., Endres, I., Hoiem, D., & Forsyth, D. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206772 · Cited by 1,917
Learning to detect unseen object classes by between-class attribute transfer
Lampert, C. H., Nickisch, H., & Harmeling, S. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206594 · Cited by 1,849
Gong, Y., Lazebnik, S., Gordo, A., & Perronnin, F. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2012.193 · Cited by 1,834
Self-citationImage Classification with the Fisher Vector: Theory and Practice
Sánchez, J., Perronnin, F., Mensink, T., & Verbeek, J. (2013) · International Journal of Computer Vision · doi:10.1007/s11263-013-0636-x · Cited by 1,498
The IAM-database: an English sentence database for offline handwriting recognition
Marti, U.-V., & Bunke, H. (2002) · International Journal on Document Analysis and Recognition · doi:10.1007/s100320200071 · Cited by 1,478
Exploiting Generative Models in Discriminative Classifiers
Jaakkola, T., & Haussler, D. H. (1998) · Cited by 1,271
End-to-end scene text recognition
Wang, K., Babenko, B., & Belongie, S. (2011) · 2011 International Conference on Computer Vision · doi:10.1109/iccv.2011.6126402 · Cited by 1,060
THE SPECTRUM KERNEL: A STRING KERNEL FOR SVM PROTEIN CLASSIFICATION
LESLIE, C., ESKIN, E., & NOBLE, W. S. (2001) · Biocomputing 2002 · doi:10.1142/9789812799623_0053 · Cited by 927
Ensemble of exemplar-SVMs for object detection and beyond
Malisiewicz, T., Gupta, A., & Efros, A. A. (2011) · 2011 International Conference on Computer Vision · doi:10.1109/iccv.2011.6126229 · Cited by 865
The devil is in the details: an evaluation of recent feature encoding methods
Chatfield, K., Lempitsky, V., Vedaldi, A., & Zisserman, A. (2011) · Procedings of the British Machine Vision Conference 2011 · doi:10.5244/c.25.76 · Cited by 834
Scene Text Recognition using Higher Order Language Priors
Mishra, A., Alahari, K., & Jawahar, C. (2012) · Procedings of the British Machine Vision Conference 2012 · doi:10.5244/c.26.127 · Cited by 831
Real-time scene text localization and recognition
Neumann, L., & Matas, J. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6248097 · Cited by 827
Label-Embedding for Attribute-Based Classification
Akata, Z., Perronnin, F., Harchaoui, Z., & Schmid, C. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.111 · Cited by 618
Text Classification using String Kernels
Lodhi, H. M., Shawe-Taylor, J. S., Cristianini, N., & Watkins, C. J. C. H. (2000) · Bristol Research (University of Bristol) · Cited by 575
PhotoOCR: Reading Text in Uncontrolled Conditions
Bissacco, A., Cummins, M., Netzer, Y., & Neven, H. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.102 · Cited by 457
CHARACTER RECOGNITION IN NATURAL IMAGES
de Campos, T. E., Babu, B. R., & Varma, M. (2009) · Cited by 448
Efficient Object Category Recognition Using Classemes
Torresani, L., Szummer, M., & Fitzgibbon, A. (2010) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-15549-9_56 · Cited by 409
Large scale image annotation: learning to rank with joint word-image embeddings
Weston, J., Bengio, S., & Usunier, N. (2010) · Machine Learning · doi:10.1007/s10994-010-5198-3 · Cited by 399
Negative Evidences and Co-occurences in Image Retrieval: The Benefit of PCA and Whitening
Jégou, H., & Chum, O. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-33709-3_55 · Cited by 392
Top-down and bottom-up cues for scene text recognition
Mishra, A., Alahari, K., & Jawahar, C. V. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6247990 · Cited by 335
Word spotting for historical documents
Rath, T. M., & Manmatha, R. (2007) · International Journal of Document Analysis and Recognition (IJDAR) · doi:10.1007/s10032-006-0035-8 · Cited by 325
Word spotting for historical documents
Rath, T. M., & Manmatha, R. (2007) · International Journal of Document Analysis and Recognition (IJDAR) · doi:10.1007/s10032-006-0027-8 · Cited by 324
Image ranking and retrieval based on multi-attribute queries
Siddiquie, B., Feris, R. S., & Davis, L. S. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995329 · Cited by 313
Improving Offline Handwritten Text Recognition with Hybrid HMM/ANN Models
España-Boquera, S., Castro-Bleda, M. J., Gorbe-Moya, J., & Zamora-Martinez, F. (2011) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2010.141 · Cited by 310
Evaluating knowledge transfer and zero-shot learning in a large-scale setting
Rohrbach, M., Stark, M., & Schiele, B. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995627 · Cited by 303
Lexicon-free handwritten word spotting using character HMMs
Fischer, A., Keller, A., Frinken, V., & Bunke, H. (2012) · Pattern Recognition Letters · doi:10.1016/j.patrec.2011.09.009 · Cited by 292
CHARACTER RECOGNITION IN NATURAL IMAGES
(2009) · Proceedings of the Fourth International Conference on Computer Vision Theory and Applications · doi:10.5220/0001770102730280 · Cited by 274
A Novel Word Spotting Method Based on Recurrent Neural Networks
Frinken, V., Fischer, A., Manmatha, R., & Bunke, H. (2012) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2011.113 · Cited by 263
Visual categorization with bags of keypoints
Duygulu, P. (2002) · European Conference on Computer Vision · Cited by 258
Word spotting: a new approach to indexing handwriting
Manmatha, R., Han, C., & Riseman, E. M. (1996) · Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.1996.517139 · Cited by 241
Correlational spectral clustering
Blaschko, M. B., & Lampert, C. H. (2008) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2008.4587353 · Cited by 236
Scene Text Localization and Recognition with Oriented Stroke Detection
Neumann, L., & Matas, J. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.19 · Cited by 220
A scale space approach for automatically segmenting words from historical handwritten documents
Manmatha, R., & Rothfeder, J. L. (2005) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2005.150 · Cited by 194
Multi-attribute spaces: Calibration for attribute fusion and similarity search
Scheirer, W. J., Kumar, N., Belhumeur, P. N., & Boult, T. E. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6248021 · Cited by 169
A search engine for historical manuscript images
Rath, T. M., Manmatha, R., & Lavrenko, V. P. (2004) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/1008992.1009056 · Cited by 147
Browsing Heterogeneous Document Collections by a Segmentation-Free Word Spotting Method
Rusiñol, M., Aldavert, D., Toledo, R., & Lladós, J. (2011) · IAPR International Conference on Document Analysis and Recognition (ICDAR) · doi:10.1109/icdar.2011.22 · Cited by 136
Modeling the spatial layout of images beyond spatial pyramids
Sánchez, J., Perronnin, F., & de Campos, T. E. (2012) · Pattern Recognition Letters · doi:10.1016/j.patrec.2012.07.019 · Cited by 107
Whole is Greater than Sum of Parts: Recognizing Scene Text Words
Goel, V., Mishra, A., Alahari, K., et al. (2013) · Proceedings of the International Conference on Document Analysis and Recognition · doi:10.1109/icdar.2013.87 · Cited by 106
HMM-based Word Spotting in Handwritten Documents Using Subword Models
Fischer, A., Keller, A., Frinken, V., et al. (2010) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr.2010.834 · Cited by 102
A Model-Based Sequence Similarity with Application to Handwritten Word Spotting
Rodríguez-Serrano, J. A., & Perronnin, F. (2012) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2012.25 · Cited by 96
Image Retrieval Using Textual Cues
Mishra, A., Alahari, K., & Jawahar, C. V. (2013) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2013.378 · Cited by 96
Efficient Exemplar Word Spotting
Almazán, J., Gordo, A., Fornés, A., & Valveny, E. (2012) · British Machine Vision Conference (BMVC) · doi:10.5244/c.26.67 · Cited by 63
Self-citationIntegrating Visual and Textual Cues for Query-by-String Word Spotting
Aldavert, D., Rusiñol, M., Toledo, R., & Lladós, J. (2013) · IAPR International Conference on Document Analysis and Recognition (ICDAR) · doi:10.1109/icdar.2013.108 · Cited by 60
Handwritten Word Spotting with Corrected Attributes
Almazán, J., Gordo, A., Fornés, A., & Valveny, E. (2013) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2013.130 · Cited by 59
Self-citationAn Efficient Framework for Searching Text in Noisy Document Images
Yalnız, İ. Z., & Manmatha, R. (2012) · IAPR International Workshop on Document Analysis Systems (DAS) · doi:10.1109/das.2012.18 · Cited by 44
Attribute-Based Detection of Unfamiliar Classes with Humans in the Loop
Wah, C., & Belongie, S. (2013) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2013.106 · Cited by 28
Cited by
Shi, B., Bai, X., & Yao, C. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2646371 · Cited by 3,172
Reading text in the wild with convolutional neural networks
Jaderberg, M., Simonyan, K., Vedaldi, A., & Zisserman, A. (2016) · International Journal of Computer Vision · doi:10.1007/s11263-015-0823-z · Cited by 1,191
ASTER: An Attentional Scene Text Recognizer with Flexible Rectification
Shi, B., Yang, M., Wang, X., Lyu, P., Yao, C., & Bai, X. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2848939 · Cited by 906
Focusing Attention: Towards Accurate Text Recognition in Natural Images
Cheng, Z., Bai, F., Xu, Y., Zheng, G., Pu, S., & Zhou, S. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.543 · Cited by 528
Scene Text Detection and Recognition: The Deep Learning Era
Long, S., He, X., & Yao, C. (2021) · International Journal of Computer Vision · doi:10.1007/s11263-020-01369-0 · Cited by 527
Metadata
- Authors
- Almazan, J., Gordo, A., Fornes, A., & Valveny, E.
- Venue
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- Published
- 2014-12-01
- Volume
- 36
- Issue
- 12
- Pages
- 2552-2566
- ISSN
- 0162-8828 (ISSN-L)
- 2160-9292
- OpenAlex
- W2053317383
- Cited by
- 517
- References
- 53
- FWCI
- 31.75
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.