The DOI matches its Crossref record; 40 of the 40 references it cites were found in a registry or an index.
A Novel Word Spotting Method Based on Recurrent Neural Networks
Abstract
Keyword spotting refers to the process of retrieving all instances of a given keyword from a document. In the present paper, a novel keyword spotting method for handwritten documents is described. It is derived from a neural network-based system for unconstrained handwriting recognition. As such it performs template-free spotting, i.e., it is not necessary for a keyword to appear in the training set. The keyword spotting is done using a modification of the CTC Token Passing algorithm in conjunction with a recurrent neural network. We demonstrate that the proposed systems outperform not only a classical dynamic time warping-based approach but also a modern keyword spotting system, based on hidden Markov models. Furthermore, we analyze the performance of the underlying neural networks when using them in a recognition task followed by keyword spotting on the produced transcription. We point out the advantages of keyword spotting when compared to classic text line recognition.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Dynamic Programming Algorithm Optimization for Spoken Word Recognition
Sakoe, H., & Chiba, S. (1978) · IEEE Transactions on Acoustics Speech and Signal Processing · doi:10.1109/tassp.1978.1163055 · Cited by 6,727
SRILM - an extensible language modeling toolkit
Stolcke, A. (2002) · 7th International Conference on Spoken Language Processing (ICSLP 2002) · doi:10.21437/icslp.2002-303 · Cited by 4,326
Online and off-line handwriting recognition: a comprehensive survey
Plamondon, R., & Srihari, S. N. (2000) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.824821 · Cited by 2,498
The SMART Retrieval System—Experiments in Automatic Document Processing
Salton, G. (1971) · CERN Document Server (European Organization for Nuclear Research) · Cited by 2,252
ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 16
Storkey, A. (2004) · neural information processing systems · Cited by 2,085
A Novel Connectionist System for Unconstrained Handwriting Recognition
Graves, A., Liwicki, M., Fernandez, S., Bertolami, R., Bunke, H., & Schmidhuber, J. (2009) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2008.137 · Cited by 1,983
Self-citationThe IAM-database: an English sentence database for offline handwriting recognition
Marti, U.-V., & Bunke, H. (2002) · International Journal on Document Analysis and Recognition · doi:10.1007/s100320200071 · Cited by 1,478
Self-citationA Markov random field model for term dependencies
Metzler, D., & Croft, W. B. (2005) · Proceedings of the 28th annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/1076034.1076115 · Cited by 843
Word image matching using dynamic time warping
Rath, T. M., & Manmatha, R. (2003) · 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings. · doi:10.1109/cvpr.2003.1211511 · Cited by 574
Self-citationMarti, U.-V., & Bunke, H. (2001) · International Journal of Pattern Recognition and Artificial Intelligence · doi:10.1142/s0218001401000848 · Cited by 408
Self-citationWord spotting for historical documents
Rath, T. M., & Manmatha, R. (2007) · International Journal of Document Analysis and Recognition (IJDAR) · doi:10.1007/s10032-006-0035-8 · Cited by 325
Self-citationWord spotting for historical documents
Rath, T. M., & Manmatha, R. (2007) · International Journal of Document Analysis and Recognition (IJDAR) · doi:10.1007/s10032-006-0027-8 · Cited by 324
Self-citationAn Application of Recurrent Neural Networks to Discriminative Keyword Spotting
Fernández, S., Graves, A., & Schmidhuber, J. (2007) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-74695-9_23 · Cited by 251
A survey on off-line Cursive Word Recognition
Vinciarelli, A. (2002) · Pattern Recognition · doi:10.1016/s0031-3203(01)00129-7 · Cited by 248
Word spotting: a new approach to indexing handwriting
Manmatha, R., Han, C., & Riseman, E. M. (1996) · Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.1996.517139 · Cited by 241
Self-citationKeyword spotting in poorly printed documents using pseudo 2-D hidden Markov models
Kuo, S.-S., & Agazzi, O. E. (1994) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.308482 · Cited by 229
Holistic word recognition for handwritten historical documents
Lavrenko, V., Rath, T. M., & Manmatha, R. (2004) · First International Workshop on Document Image Analysis for Libraries, 2004. Proceedings. · doi:10.1109/dial.2004.1263256 · Cited by 227
Self-citationMarkov models for offline handwriting recognition: a survey
Plötz, T., & Fink, G. A. (2009) · International Journal on Document Analysis and Recognition (IJDAR) · doi:10.1007/s10032-009-0098-4 · Cited by 220
Handwritten word-spotting using hidden Markov models and universal vocabularies
Rodríguez-Serrano, J. A., & Perronnin, F. (2009) · Pattern Recognition · doi:10.1016/j.patcog.2009.02.005 · Cited by 162
A search engine for historical manuscript images
Rath, T. M., Manmatha, R., & Lavrenko, V. P. (2004) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/1008992.1009056 · Cited by 147
Self-citationDiscriminative keyword spotting
Keshet, J., Grangier, D., & Samy Bengio, A. (2008) · Speech Communication · doi:10.1016/j.specom.2008.10.002 · Cited by 115
A Bit of Progress in Language Modeling Extended VersionPreprint
Goodman, J. (2001) · Cited by 113
HMM-based Word Spotting in Handwritten Documents Using Subword Models
Fischer, A., Keller, A., Frinken, V., et al. (2010) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr.2010.834 · Cited by 102
Self-citationA Line-Oriented Approach to Word Spotting in Handwritten Documents
Kołcz, A., Alspector, J., Augusteijn, M. F., Carlson, R., & Popescu, G. V. (2000) · Pattern Analysis and Applications · doi:10.1007/s100440070020 · Cited by 101
Automatic Transcription of Handwritten Medieval Documents
Fischer, A., Wüthrich, M., Liwicki, M., Frinken, V., Horst Bunke, A., Viehhauser, G., & Stolz, M. (2009) · International Conference on Virtual Systems and Multimedia (VSMM) · doi:10.1109/vsmm.2009.26 · Cited by 98
Self-citationWord matching using single closed contours for indexing handwritten historical documents
Adamek, T., O'Connor, N. E., & Smeaton, A. F. (2006) · International Journal on Document Analysis and Recognition (IJDAR) · doi:10.1007/s10032-006-0024-y · Cited by 95
Slit Style HOG Feature for Document Image Word Spotting
Terasawa, K., & Tanaka, Y. (2009) · Proceedings of the International Conference on Document Analysis and Recognition · doi:10.1109/icdar.2009.118 · Cited by 93
Using Corner Feature Correspondences to Rank Word Images by Similarity
Rothfeder, J. L., Feng, S., & Rath, T. M. (2003) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2003.10021 · Cited by 72
Wöllmer, M., Eyben, F., Keshet, J., Graves, A., Schuller, B. W., & Rigoll, G. (2009) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2009.4960492 · Cited by 69
Searching Off-line Arabic Documents
Chan, J., Ziftci, C., & Forsyth, D. A. (2006) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2006.269 · Cited by 55
Making Latin Manuscripts Searchable using gHMM's
Edwards, J., Teh, Y. W., Bock, R., Maire, M., Vesom, G., & Forsyth, D. A. (2004) · Cited by 55
Boosted decision trees for word recognition in handwritten document retrieval
Howe, N. R., Rath, T. M., & Manmatha, R. (2005) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/1076034.1076099 · Cited by 53
Self-citationIndexing of Handwritten Historical Documents - Recent Progress
Manmatha, R., & Rath, T. M. (2003) · ScholarWorks@UMassAmherst (University of Massachusetts Amherst) · Cited by 51
Self-citationEl‐Yacoubi, M. A., Gilloux, M., & Bertille, J.-M. (2002) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.982898 · Cited by 48
Template-Free Word Spotting in Low-Quality Manuscripts
Cao, H., & Govindaraju, V. (2006) · Advances in pattern recognition · doi:10.1142/9789812772381_0021 · Cited by 45
A probabilistic method for keyword retrieval in handwritten document images
Cao, H., Bhardwaj, A., & Govindaraju, V. (2009) · Pattern Recognition · doi:10.1016/j.patcog.2009.02.003 · Cited by 42
A Novel Word Spotting Algorithm Using Bidirectional Long Short-Term Memory Neural Networks
Frinken, V., Fischer, A., & Horst Bunke, A. (2010) · Lecture notes in computer science · doi:10.1007/978-3-642-12159-3_17 · Cited by 35
Self-citationFinding words in alphabet soup: Inference on freeform character recognition for historical scripts
Howe, N. R., Feng, S., & Manmatha, R. (2009) · Pattern Recognition · doi:10.1016/j.patcog.2009.01.012 · Cited by 22
Self-citationUnsupervised writer style adaptation for handwritten word spotting
Rodríguez, J. A. R., Perronnin, F., Sánchez, G., et al. (2008) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr.2008.4761144 · Cited by 9
Statistical models for text query-based image retrieval
Manmatha, R., & Feng, S. (2008) · Cited by 6
Self-citation
Cited by
Reading text in the wild with convolutional neural networks
Jaderberg, M., Simonyan, K., Vedaldi, A., & Zisserman, A. (2016) · International Journal of Computer Vision · doi:10.1007/s11263-015-0823-z · Cited by 1,191
Word Spotting and Recognition with Embedded Attributes
Almazan, J., Gordo, A., Fornes, A., & Valveny, E. (2014) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2014.2339814 · Cited by 517
Metadata
- Authors
- Frinken, V., Fischer, A., Manmatha, R., & Bunke, H.
- Venue
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- Published
- 2012-02
- Volume
- 34
- Issue
- 2
- Pages
- 211-224
- ISSN
- 0162-8828 (ISSN-L)
- 2160-9292
- OpenAlex
- W2062755747
- Cited by
- 263
- References
- 40
- FWCI
- 23.12
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.