The DOI matches its Crossref record; 62 of the 62 references it cites were found in a registry or an index.
Improved Handwritten Digit Recognition Using Convolutional Neural Networks (CNN)
Open accessAbstract
Traditional systems of handwriting recognition have relied on handcrafted features and a large amount of prior knowledge. Training an Optical character recognition (OCR) system based on these prerequisites is a challenging task. Research in the handwriting recognition field is focused around deep learning techniques and has achieved breakthrough performance in the last few years. Still, the rapid growth in the amount of handwritten data and the availability of massive processing power demands improvement in recognition accuracy and deserves further investigation. Convolutional neural networks (CNNs) are very effective in perceiving the structure of handwritten characters/words in ways that help in automatic extraction of distinct features and make CNN the most suitable approach for solving handwriting recognition problems. Our aim in the proposed work is to explore the various design options like number of layers, stride size, receptive field, kernel size, padding and dilution for CNN-based handwritten digit recognition. In addition, we aim to evaluate various SGD optimization algorithms in improving the performance of handwritten digit recognition. A network’s recognition accuracy increases by incorporating ensemble architecture. Here, our objective is to achieve comparable accuracy by using a pure CNN architecture without ensemble architecture, as ensemble architectures introduce increased computational cost and high testing complexity. Thus, a CNN architecture is proposed in order to achieve accuracy even better than that of ensemble architectures, along with reduced operational complexity and cost. Moreover, we also present an appropriate combination of learning parameters in designing a CNN that leads us to reach a new absolute record in classifying MNIST handwritten digits. We carried out extensive experiments and achieved a recognition accuracy of 99.87% for a MNIST dataset.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Distinctive Image Features from Scale-Invariant Keypoints
Lowe, D. G. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000029664.99615.94 · Cited by 55,589
Fully convolutional networks for semantic segmentation
Long, J., Shelhamer, E., & Darrell, T. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298965 · Cited by 38,834
Histograms of Oriented Gradients for Human Detection
Dalal, N., & Triggs, B. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.177 · Cited by 33,584
Chen, L.-C., Papandreou, G., Kokkinos, I., Murphy, K., & Yuille, A. L. (2016) · arXiv · doi:10.48550/arxiv.1606.00915 · Cited by 22,392
Chen, L.-C., Papandreou, G., Kokkinos, I., Murphy, K., & Yuille, A. L. (2018) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2699184 · Cited by 22,392
Reducing the dimensionality of data with neural networks
Hinton, G. E., & Salakhutdinov, R. R. (2006) · Science · doi:10.1126/science.1127647 · Cited by 20,928
SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation
Badrinarayanan, V., Kendall, A., & Cipolla, R. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2644615 · Cited by 19,631
A fast learning algorithm for deep belief nets
Hinton, G. E., Osindero, S., & Teh, Y.-W. (2006) · Neural Computation · doi:10.1162/neco.2006.18.7.1527 · Cited by 16,336
Fully convolutional networks for semantic segmentation
Shelhamer, E., Long, J., & Darrell, T. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2572683 · Cited by 11,898
Backpropagation Applied to Handwritten Zip Code Recognition
LeCun, Y., Boser, B., Denker, J. S., Henderson, D., Howard, R. E., Hubbard, W., & Jackel, L. D. (1989) · Neural Computation · doi:10.1162/neco.1989.1.4.541 · Cited by 11,891
(2010) · Cited by 8,261
Fukushima, K. (1980) · Biological Cybernetics · doi:10.1007/bf00344251 · Cited by 5,759
ADADELTA: An Adaptive Learning Rate Method
Zeiler, M. D. (2012) · arXiv · doi:10.48550/arxiv.1212.5701 · Cited by 5,322
Learning Deconvolution Network for Semantic Segmentation
Noh, H., Hong, S., & Han, B. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.178 · Cited by 4,422
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2015) · arXiv · doi:10.48550/arxiv.1512.03385 · Cited by 4,196
Multi-column deep neural networks for image classification
Ciresan, D., Meier, U., & Schmidhuber, J. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6248110 · Cited by 3,720
Shi, B., Bai, X., & Yao, C. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2646371 · Cited by 3,172
Solving Multiclass Learning Problems via Error-Correcting Output Codes
Dietterich, T. G., & Bakiri, G. (1995) · Journal of Artificial Intelligence Research · doi:10.1613/jair.105 · Cited by 2,739
What is the best multi-stage architecture for object recognition?
Jarrett, K., Kavukcuoglu, K., Ranzato, M. A., & LeCun, Y. (2009) · 2009 IEEE 12th International Conference on Computer Vision · doi:10.1109/iccv.2009.5459469 · Cited by 2,153
Evaluation of Pooling Operations in Convolutional Architectures for Object Recognition
Scherer, D., Müller, A., & Behnke, S. (2010) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-15825-4_10 · Cited by 1,503
Parallelized Stochastic Gradient Descent
Zinkevich, M., Weimer, M., Li, L., & Smola, A. J. (2010) · Cited by 1,124
Multi-column deep neural network for traffic sign classification
Cireşan, D., Meier, U., Masci, J., & Schmidhuber, J. (2012) · Neural Networks · doi:10.1016/j.neunet.2012.02.023 · Cited by 1,057
Pegasos: Primal Estimated sub-GrAdient SOlver for SVM
Shalev-Shwartz, S., Singer, Y., & Srebro, N. (2007) · Proceedings of the 24th international conference on Machine learning · doi:10.1145/1273496.1273598 · Cited by 973
End-to-End Text Recognition with Convolutional Neural Networks
Wang, T., Wu, D. J., Coates, A., & Ng, A. Y. (2012) · Cited by 839
Machine Learning from Theory to Algorithms: An Overview
Alzubi, J., Nayyar, A., & Kumar, A. (2018) · Journal of Physics: Conference Series · doi:10.1088/1742-6596/1142/1/012012 · Cited by 766
Self-citationA novel hybrid CNN–SVM classifier for recognizing handwritten digits
Niu, X.-X., & Suen, C. Y. (2012) · Pattern Recognition · doi:10.1016/j.patcog.2011.09.021 · Cited by 671
Dropout improves Recurrent Neural Networks for Handwriting RecognitionPreprint
(2016) · Cited by 539
Seeing it all: Convolutional network layers map the function of the human visual system
Eickenberg, M., Gramfort, A., Varoquaux, G., & Thirion, B. (2017) · NeuroImage · doi:10.1016/j.neuroimage.2016.10.001 · Cited by 338
Online and offline handwritten Chinese character recognition: Benchmarking on new databases
Liu, C.-L., Yin, F., Wang, D.-H., & Wang, Q.-F. (2013) · Pattern Recognition · doi:10.1016/j.patcog.2012.06.021 · Cited by 326
Towards dropout training for convolutional neural networks
Wu, H., & Gu, X. (2015) · Neural Networks · doi:10.1016/j.neunet.2015.07.007 · Cited by 314
Wu, Y.-C., Yin, F., & Liu, C.-L. (2017) · Pattern Recognition · doi:10.1016/j.patcog.2016.12.026 · Cited by 193
Adaptive Online Gradient Descent
Hazan, E., Rakhlin, A., & Bartlett, P. L. (2007) · neural information processing systems · Cited by 182
Intelligent character recognition using fully convolutional neural networks
Ptucha, R., Petroski Such, F., Pillai, S., Brockler, F., Singh, V., & Hutkowski, P. (2019) · Pattern Recognition · doi:10.1016/j.patcog.2018.12.017 · Cited by 168
Offline continuous handwriting recognition using sequence to sequence neural networks
Sueiras, J., Ruiz-Parrado, V., Sánchez, Á., & Vélez, J. F. (2018) · Neurocomputing · doi:10.1016/j.neucom.2018.02.008 · Cited by 153
Investigation on deep learning for off-line handwritten Arabic character recognition
Boufenar, C., Kerboua, A., & Batouche, M. (2017) · Cognitive Systems Research · doi:10.1016/j.cogsys.2017.11.002 · Cited by 142
Convolutional neural network based early fire detection
Saeed, F., Paul, A., Karthigaikumar, P., & Nayyar, A. (2019) · Multimedia Tools and Applications · doi:10.1007/s11042-019-07785-w · Cited by 142
Self-citationBenchmarking on offline Handwritten Tamil Character Recognition using convolutional neural networks
Kavitha, B. R., & Srimathi, C. (2019) · Journal of King Saud University - Computer and Information Sciences · doi:10.1016/j.jksuci.2019.06.004 · Cited by 129
Kuang, F., Zhang, S., Jin, Z., & Xu, W. (2014) · Soft Computing · doi:10.1007/s00500-014-1332-7 · Cited by 128
Reversible Natural Language Watermarking Using Synonym Substitution and Arithmetic Coding
Hao, W., Xiang, L., Li, Y., Yang, P., & Shen, X. (2018) · DR-NTU (Nanyang Technological University) · doi:10.3970/cmc.2018.03510 · Cited by 124
A new hyperparameters optimization method for convolutional neural networks
Cui, H., & Bai, J. (2019) · Pattern Recognition Letters · doi:10.1016/j.patrec.2019.02.009 · Cited by 109
Sarkhel, R., Das, N., Das, A., Kundu, M., & Nasipuri, M. (2017) · Pattern Recognition · doi:10.1016/j.patcog.2017.05.022 · Cited by 108
Handwritten Urdu character recognition using one-dimensional BLSTM classifier
Ahmed, S. B., Naz, S., Swati, S., & Razzak, I. (2017) · Neural Computing and Applications · doi:10.1007/s00521-017-3146-x · Cited by 100
Image super-resolution using a dilated convolutional neural network
Lin, G., Wu, Q., Qiu, L., & Huang, X. (2017) · Neurocomputing · doi:10.1016/j.neucom.2017.09.062 · Cited by 99
Rank-based pooling for deep convolutional neural networks
Shi, Z., Ye, Y., & Wu, Y. (2016) · Neural Networks · doi:10.1016/j.neunet.2016.07.003 · Cited by 88
A New Approach for Stock Price Analysis and Prediction Based on SSA and SVM
Xiao, J., Zhu, X., Huang, C., Yang, X., Wen, F., & Zhong, M. (2018) · International Journal of Information Technology & Decision Making · doi:10.1142/s021962201841002x · Cited by 84
Recognition of Urdu Handwritten Characters Using Convolutional Neural Network
Husnain, M., Missen, M. M. S., Mumtaz, S., Jhanidr, M. Z., Coustaty, M., Luqman, M. M., Ogier, J.-M., & Choi, G. S. (2019) · Applied Sciences · doi:10.3390/app9132758 · Cited by 68
Qu, X., Wang, W., Lü, K., & Zhou, J. (2018) · Pattern Recognition Letters · doi:10.1016/j.patrec.2018.04.001 · Cited by 61
Fully convolutional recurrent network for handwritten Chinese text recognition
Xie, Z., Sun, Z., Jin, L., Feng, Z., & Zhang, S. (2016) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr.2016.7900261 · Cited by 55
PPNC: Privacy Preserving Scheme for Random Linear Network Coding in Smart Grid
He, S., Zeng, W., Xie, K., et al. (2017) · KSII Transactions on Internet and Information Systems · doi:10.3837/tiis.2017.03.015 · Cited by 53
On building ensembles of stacked denoising auto-encoding classifiers and their further improvement
Alvear-Sandoval, R. F., & Figueiras-Vidal, A. R. (2017) · Information Fusion · doi:10.1016/j.inffus.2017.03.008 · Cited by 49
Tabik, S., Alvear-Sandoval, R. F., Ruiz, M. M., Sancho‐Gómez, J., Figueiras-Vidal, A. R., & Herrera, F. (2020) · Information Fusion · doi:10.1016/j.inffus.2020.04.002 · Cited by 45
Proximal regularization for online and batch learning
Do, C. B., Le, Q. V., & Foo, C.-S. (2009) · International Conference on Machine Learning · doi:10.1145/1553374.1553407 · Cited by 44
Liang, T., Xu, X., & Xiao, P. (2017) · Pattern Recognition Letters · doi:10.1016/j.patrec.2017.05.019 · Cited by 40
Nguyen, C. T., Khuong, V. T. M., Nguyen, H. T., & Nakagawa, M. (2019) · Pattern Recognition Letters · doi:10.1016/j.patrec.2019.12.015 · Cited by 34
Multiobjective optimization for recognition of isolated handwritten Indic scripts
Gupta, A., Sarkhel, R., Das, N., et al. (2019) · Pattern Recognition Letters · doi:10.1016/j.patrec.2019.09.019 · Cited by 33
Soomro, M., Farooq, M. A., & Raza, R. H. (2017) · International Conference on Frontiers of Information Technology (FIT) · doi:10.1109/fit.2017.00071 · Cited by 23
Text alignment in early printed books combining deep learning and dynamic programming
Ziran, Z., Pic, X., Innocenti, S. U., et al. (2020) · Pattern Recognition Letters · doi:10.1016/j.patrec.2020.02.016 · Cited by 22
Choudhary, A., Ahlawat, S., & Rishi, R. (2014) · Studies in fuzziness and soft computing · doi:10.1007/978-3-319-12883-2_26 · Cited by 17
Self-citationA System for Offline Character Recognition Using Auto-encoder Networks
Dewan, S., & Chakravarthy, V. S. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-34478-7_12 · Cited by 15
Metadata
- Authors
- Ahlawat, S., Choudhary, A., Nayyar, A., Singh, S., & Yoon, B.
- Venue
- Sensors
- Publisher
- MDPI AG
- Published
- 2020-06-12
- Volume
- 20
- Issue
- 12
- Pages
- 3344
- ISSN
- 1424-8220 (ISSN-L)
- OpenAlex
- W3035558131
- Cited by
- 303
- References
- 62
- FWCI
- 18.01
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.