The DOI matches its Crossref record; 50 of the 50 references it cites were found in a registry or an index.
Drawing and Recognizing Chinese Characters with Recurrent Neural Network
Open accessAbstract
Recent deep learning based approaches have achieved great success on handwriting recognition. Chinese characters are among the most widely adopted writing systems in the world. Previous research has mainly focused on recognizing handwritten Chinese characters. However, recognition is only one aspect for understanding a language, another challenging and interesting task is to teach a machine to automatically write (pictographic) Chinese characters. In this paper, we propose a framework by using the recurrent neural network (RNN) as both a discriminative model for recognizing Chinese characters and a generative model for drawing (generating) Chinese characters. To recognize Chinese characters, previous methods usually adopt the convolutional neural network (CNN) models which require transforming the online handwriting trajectory into image-like representations. Instead, our RNN based approach is an end-to-end system which directly deals with the sequential structure and does not require any domain-specific knowledge. With the RNN system (combining an LSTM and GRU), state-of-the-art performance can be achieved on the ICDAR-2013 competition database. Furthermore, under the RNN framework, a conditional generative model with character embedding is proposed for automatically drawing recognizable Chinese characters. The generated characters (in vector format) are human-readable and also can be recognized by the discriminative RNN model with high accuracy. Experimental results verify the effectiveness of using RNNs as both generative and discriminative models for the tasks of drawing and recognizing Chinese characters.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Self-citationGradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
Self-citation(2014) · Cited by 33,419
Learning representations by back-propagating errors
Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1986) · Nature · doi:10.1038/323533a0 · Cited by 31,892
Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation
Cho, K., van Merrienboer, B., Gulcehre, C., Bahdanau, D., Bougares, F., Schwenk, H., & Bengio, Y. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1179 · Cited by 25,545
Self-citationReducing the dimensionality of data with neural networks
Hinton, G. E., & Salakhutdinov, R. R. (2006) · Science · doi:10.1126/science.1127647 · Cited by 20,928
Auto-Encoding Variational Bayes
Kingma, D. P., & Welling, M. (2013) · arXiv · doi:10.48550/arxiv.1312.6114 · Cited by 20,067
Labaca-Castro, R. (2023) · Machine Learning under Malware Attack · doi:10.1007/978-3-658-40442-0_9 · Cited by 19,272
GAN(Generative Adversarial Nets)
(2017) · Journal of Japan Society for Fuzzy Theory and Intelligent Informatics · doi:10.3156/jsoft.29.5_177_2 · Cited by 19,270
Unsupervised representation learning with deep convolutional generative adversarial networks
Radford, A., Metz, L., & Chintala, S. (2015) · arXiv · doi:10.48550/arxiv.1511.06434 · Cited by 12,235
Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling
Chung, J., Gulcehre, C., Cho, K., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1412.3555 · Cited by 11,008
Self-citationBidirectional recurrent neural networks
Schuster, M., & Paliwal, K. K. (1997) · IEEE Transactions on Signal Processing · doi:10.1109/78.650093 · Cited by 10,172
Learning long-term dependencies with gradient descent is difficult
Bengio, Y., Simard, P., & Frasconi, P. (1994) · IEEE Transactions on Neural Networks · doi:10.1109/72.279181 · Cited by 8,542
Self-citationShow, Attend and Tell: Neural Image Caption Generation with Visual Attention
Xu, K., Ba, J., Kiros, R., Cho, K., Courville, A., Salakhutdinov, R., Zemel, R., & Bengio, Y. (2015) · arXiv · doi:10.48550/arxiv.1502.03044 · Cited by 8,248
Self-citationGraves, A., Fernández, S., Gomez, F., & Schmidhuber, J. (2006) · Proceedings of the 23rd international conference on Machine learning - ICML '06 · doi:10.1145/1143844.1143891 · Cited by 5,370
Learning to forget: Continual prediction with LSTM
Gers, F. A., Schmidhuber, J., & Cummins, F. (2000) · Neural Computation · doi:10.1162/089976600300015015 · Cited by 4,823
Generating Sequences With Recurrent Neural Networks
Graves, A. (2013) · arXiv · doi:10.48550/arxiv.1308.0850 · Cited by 2,894
Online and off-line handwriting recognition: a comprehensive survey
Plamondon, R., & Srihari, S. N. (2000) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.824821 · Cited by 2,498
A Novel Connectionist System for Unconstrained Handwriting Recognition
Graves, A., Liwicki, M., Fernandez, S., Bertolami, R., Bunke, H., & Schmidhuber, J. (2009) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2008.137 · Cited by 1,983
Deep Generative Image Models using a Laplacian Pyramid of Adversarial Networks
Denton, E., Chintala, S., Szlam, A. D., & Fergus, R. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1506.05751 · Cited by 1,541
An Empirical Exploration of Recurrent Network Architectures
Józefowicz, R., Zaremba, W., & Sutskever, I. (2015) · International Conference on Machine Learning · Cited by 1,459
Graves, A., Wayne, G., & Danihelka, I. (2014) · arXiv · doi:10.48550/arxiv.1410.5401 · Cited by 1,058
Theano: new features and speed improvements
Bastien, F., Lamblin, P., Pascanu, R., Bergstra, J., Goodfellow, I., Bergeron, A., Bouchard, N., Warde-Farley, D., & Bengio, Y. (2012) · arXiv · doi:10.48550/arxiv.1211.5590 · Cited by 1,005
Self-citationDRAW: A Recurrent Neural Network For Image Generation
Gregor, K., Danihelka, I., Graves, A., Rezende, D. J., & Wierstra, D. (2015) · International Conference on Machine Learning · Cited by 785
CASIA Online and Offline Chinese Handwriting Databases
Liu, C., Yin, F., Wang, D.-H., & Wang, Q. (2011) · Proceedings of the International Conference on Document Analysis and Recognition · doi:10.1109/icdar.2011.17 · Cited by 517
Self-citationThe Neural Autoregressive Distribution Estimator
Larochelle, H., & Murray, I. (2011) · Edinburgh Research Explorer (University of Edinburgh) · Cited by 410
Online recognition of chinese characters: the state-of-the-art
Liu, C.-L., Jaeger, S., & Nakagawa, M. (2004) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2004.1262182 · Cited by 351
Self-citationDescribing Multimedia Content Using Attention-Based Encoder-Decoder Networks
Cho, K., Courville, A., & Bengio, Y. (2015) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2015.2477044 · Cited by 338
Self-citationOnline and offline handwritten Chinese character recognition: Benchmarking on new databases
Liu, C.-L., Yin, F., Wang, D.-H., & Wang, Q.-F. (2013) · Pattern Recognition · doi:10.1016/j.patcog.2012.06.021 · Cited by 326
Self-citationICDAR 2013 Chinese Handwriting Recognition Competition
Yin, F., Wang, Q.-F., Zhang, X.-Y., & Liu, C.-L. (2013) · 2013 12th International Conference on Document Analysis and Recognition · doi:10.1109/icdar.2013.218 · Cited by 324
Self-citationZhong, Z., Jin, L., & Xie, Z. (2015) · 2015 13th International Conference on Document Analysis and Recognition (ICDAR) · doi:10.1109/icdar.2015.7333881 · Cited by 309
Zhang, X.-Y., Bengio, Y., & Liu, C.-L. (2017) · Pattern Recognition · doi:10.1016/j.patcog.2016.08.005 · Cited by 302
Self-citationAutomatic recognition of handprinted characters—The state of the art
Suen, C. Y., Berthod, M., & Mori, S. (1980) · Proceedings of the IEEE · doi:10.1109/proc.1980.11675 · Cited by 286
Multi-Column Deep Neural Networks for offline handwritten Chinese character classification
Ciresan, D., & Meier, U. (2015) · 2015 International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2015.7280516 · Cited by 203
Segmentation-free handwritten Chinese text recognition with LSTM-RNN
Messina, R., & Louradour, J. (2015) · 2015 13th International Conference on Document Analysis and Recognition (ICDAR) · doi:10.1109/icdar.2015.7333746 · Cited by 173
Beyond human recognition: A CNN-based framework for handwritten character recognition
Chen, L., Wang, S., Fan, W., Sun, J., & Naoi, S. (2015) · Asian Conference on Pattern Recognition · doi:10.1109/acpr.2015.7486592 · Cited by 158
Dropout as data augmentationPreprint
Bouthillier, X., Konda, K., Vincent, P., & Memisevic, R. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1506.08700 · Cited by 147
Yang, W., Jin, L., Tao, D., Xie, Z., & Feng, Z. (2016) · Pattern Recognition · doi:10.1016/j.patcog.2016.04.007 · Cited by 137
DeepWriterID: An End-to-End Online Text-Independent Writer Identification System
Yang, W., Jin, L., & Liu, M. (2016) · IEEE Intelligent Systems · doi:10.1109/mis.2016.22 · Cited by 131
Handwritten Character Recognition by Alternately Trained Relaxation Convolutional Neural Network
Wu, C., Fan, W., He, Y., Sun, J., & Naoi, S. (2014) · International Conference on Frontiers in Handwriting Recognition · doi:10.1109/icfhr.2014.56 · Cited by 120
Sparse arrays of signatures for online character recognitionPreprint
Graham, B. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1308.0371 · Cited by 120
Handwritten Chinese/Japanese Text Recognition Using Semi-Markov Conditional Random Fields
Zhou, X., Wang, D., Tian, F., Liu, C., & Nakagawa, M. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.49 · Cited by 86
Self-citationICDAR 2011 Chinese Handwriting Recognition Competition
Liu, C., Yin, F., Wang, Q., & Wang, D.-H. (2011) · IAPR International Conference on Document Analysis and Recognition (ICDAR) · doi:10.1109/icdar.2011.291 · Cited by 81
Self-citationChinese character-level writer identification using path signature feature, DropStroke and deep CNN
Yang, W., Jin, L., & Liu, M. (2015) · Proceedings of the International Conference on Document Analysis and Recognition · doi:10.1109/icdar.2015.7333821 · Cited by 73
Discriminative Regularization for Generative ModelsPreprint
Lamb, A., Dumoulin, V., & Courville, A. C. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1602.03220 · Cited by 61
Chinese Handwriting Recognition Contest 2010
Liu, C., Yin, F., Wang, D.-H., & Wang, Q. (2010) · Chinese Conference on Pattern Recognition · doi:10.1109/ccpr.2010.5659229 · Cited by 47
Self-citationImproving discrimination ability of convolutional neural networks by hybrid learning
Kim, I., Choi, C., & Lee, S. (2015) · International Journal on Document Analysis and Recognition (IJDAR) · doi:10.1007/s10032-015-0256-9 · Cited by 10
Character-level Chinese Writer Identification using Path Signature Feature, DropStroke and Deep CNNPreprint
Yang, W., Jin, L., & Liu, M. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1505.04922 · Cited by 8
Cited by
Object detection using YOLO: challenges, architectural successors, datasets and applications
Diwan, T., Anirudh, G., & Tembhurne, J. V. (2023) · Multimedia Tools and Applications · doi:10.1007/s11042-022-13644-y · Cited by 1,549
“The success stories of deep learning in various domains includes weather forecasting [80], stock market prediction [53], speech recognition [59], object detection [37], character recognition [83], intrusion detection [32], automatic landslide detection [48], time”
BackgroundApplications of artificial intelligence in transport: An overview
Abduljabbar, R., Dia, H., Liyanage, S., & Bagloee, S. A. (2019) · Sustainability · doi:10.3390/su11010189 · Cited by 769
Deep Learning for Classical Japanese Literature
Clanuwat, T., Bober-Irizar, M., Kitamoto, A., Lamb, A., Yamamoto, K., & Ha, D. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1812.01718 · Cited by 442
A review of state-of-the-art techniques for abnormal human activity recognition
Dhiman, C., & Vishwakarma, D. K. (2019) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2018.08.014 · Cited by 265
Deep Learning Intervention for Health Care Challenges: Some Biomedical Domain Considerations
Tobore, I., Li, J., Yuhang, L., Al-Handarish, Y., Kandwal, A., Nie, Z., & Wang, L. (2019) · JMIR mHealth and uHealth · doi:10.2196/11966 · Cited by 180
Metadata
- Authors
- Zhang, X.-Y., Yin, F., Zhang, Y.-M., Liu, C.-L., & Bengio, Y.
- Venue
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- Published
- 2018-04-01
- Volume
- 40
- Issue
- 4
- Pages
- 849-862
- ISSN
- 0162-8828 (ISSN-L)
- 2160-9292
- OpenAlex
- W2963047498
- Cited by
- 363
- References
- 50
- FWCI
- 16.96
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.