A Survey of Handwritten Character Recognition with MNIST and EMNIST
Open accessThe DOI matches its Crossref record; 84 of the 84 references it cites were found in a registry or an index.
Abstract
This paper summarizes the top state-of-the-art contributions reported on the MNIST dataset for handwritten digit recognition. This dataset has been extensively used to validate novel techniques in computer vision, and in recent years, many authors have explored the performance of convolutional neural networks (CNNs) and other deep learning techniques over this dataset. To the best of our knowledge, this paper is the first exhaustive and updated review of this dataset; there are some online rankings, but they are outdated, and most published papers survey only closely related works, omitting most of the literature. This paper makes a distinction between those works using some kind of data augmentation and works using the original dataset out-of-the-box. Also, works using CNNs are reported separately; as they are becoming the state-of-the-art approach for solving this problem. Nowadays, a significant amount of works have attained a test error rate smaller than 1% on this dataset; which is becoming non-challenging. By mid-2017, a new dataset was introduced: EMNIST, which involves both digits and letters, with a larger amount of data acquired from a database different than MNIST’s. In this paper, EMNIST is explained and some results are surveyed.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Although the images are not of a real-world environment, they can be an appropriate alternative considering that the main objective of this study was to explore the possibility of deep learning for the objective quantification of the visual perception of the substituted signal.”
From Deep Learning-Based Optimization of Visual–Auditory Sensory Substitution (2023) · cites this paper as [31]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805 · cited 7×
“For instance, Belongie et al. [5] achieved 0.63% and Keysers et al. [6] achieved 0.54% and 0.52% using K-NN, Kégl and Busa-Fekete [7] achieved 0.87% using boosted stumps on Haar features, LeCun et al. [4] achieved 0.8% and Decoste and Schölkopf [8] attained results from 0.56 to 0.68% using SVM.”
BackgroundMethodInfluentialExtreme learning machine: Theory and applications
Huang, G.-B., Zhu, Q.-Y., & Siew, C.-K. (2006) · Neurocomputing · doi:10.1016/j.neucom.2005.12.126 · Cited by 13,285 · cited 1×
“In 2015, McDonnell et al. [21] proposed an approach using the ‘extreme learning machine’ (ELM) [22] algorithm to train shallow non-convolutional neural networks, and they agree on the fact that data augmentation with distortions can reduce error rates even further.”
MethodShape matching and object recognition using shape contexts
Belongie, S., Malik, J., & Puzicha, J. (2002) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.993558 · Cited by 6,306 · cited 2×
“For instance, Belongie et al. [5] achieved 0.63% and Keysers et al. [6] achieved 0.54% and 0.52% using K-NN, Kégl and Busa-Fekete [7] achieved 0.87% using boosted stumps on Haar features, LeCun et al. [4] achieved 0.8% and Decoste and Schölkopf [8] attained results from 0.56 to 0.68% using SVM.”
MethodInfluentialDynamic Routing Between Capsules
Sabour, S., Frosst, N., & Hinton, G. E. (2017) · arXiv · doi:10.48550/arxiv.1710.09829 · Cited by 4,167 · cited 1×
“An interesting work using capsule layers (a concept recently introduced by Sabour et al. [76]) is TextCaps [77], a CNN with 3 convolutional layers and two capsule layers, which obtain accuracies of 95.36% in EMNIST Letters and 99.79% in EMNIST Digits.”
MethodInfluentialMulti-column deep neural networks for image classification
Ciresan, D., Meier, U., & Schmidhuber, J. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6248110 · Cited by 3,720
Best practices for convolutional neural networks applied to visual document analysis
Simard, P. Y., Steinkraus, D., & Platt, J. C. (2005) · Seventh International Conference on Document Analysis and Recognition, 2003. Proceedings. · doi:10.1109/icdar.2003.1227801 · Cited by 2,741 · cited 2×
“87% NN 2-layer 800 hidden units, MSE loss [9] 0.”
BackgroundSalakhutdinov, R., & Hinton, G. E. (2009) · International Conference on Artificial Intelligence and Statistics · Cited by 2,605
Lee, H., Grosse, R., Ranganath, R., & Ng, A. Y. (2009) · Proceedings of the 26th Annual International Conference on Machine Learning · doi:10.1145/1553374.1553453 · Cited by 2,412 · cited 2×
“Lee et al. [54] described convolutional deep belief networks with probabilistic max-pooling achieving an error rate of 0.82%.”
BackgroundInfluentialWhat is the best multi-stage architecture for object recognition?
Jarrett, K., Kavukcuoglu, K., Ranzato, M. A., & LeCun, Y. (2009) · 2009 IEEE 12th International Conference on Computer Vision · doi:10.1109/iccv.2009.5459469 · Cited by 2,153 · cited 3×
“…[39] 0.47% CNN (3 conv, 1 dense), stochastic pooling [25] 0.49% CNN (2 conv, 1 dense, relu) with dropout [24] 0.52% CNN, unsup pretraining [17] 0.53% CNN (2 conv, 1 dense, relu) with DropConnect [24] 0.57% SparseNet + SVM [15] 0.59% CNN (2 conv, 1 dense), unsup pretraining [16] 0.60%…”
MethodInfluential(2013) · Cited by 2,056
Research works printed but not linked: 5
- Kasun, 2013, Representational learning with extreme learning machine for big data, IEEE Intell. Syst., 28, 31
- Lin, M., Chen, Q., and Yan, S. (2014, January 14–16). Network In Network. Proceedings of the 2nd International Conference on Learning Representations, Banff, AB, Canada.
- Calderón, A., Roa-Valle, S., and Victorino, J. (2003, January 19–21). Handwritten digit recognition using convolutional neural networks and Gabor filters. Proceedings of the 2003 International Conference on Computational Intelligence, Cancun, Mexico.
- Yin, 2017, Markov Random Field Based Convolutional Neuralx Networks for Image Classification, IDEAL 2017: Intelligent Data Engineering and Automated Learning, Volume 10585, 387
- Mor, 2019, Handwritten text recognition: With deep learning and Android, Int. J. Eng. Adv. Technol., 8, 172
Cited by
Arabic handwriting recognition system using convolutional neural network
Altwaijry, N., & Al-Turaiki, I. (2021) · Neural Computing and Applications · doi:10.1007/s00521-020-05070-8 · Cited by 228
Sakai, A., Komatsu, M., Komatsu, R., Matsuoka, R., Yasutomi, S., Dozen, A., Shozu, K., Arakaki, T., Machino, H., Asada, K., et al. (2022) · Biomedicines · doi:10.3390/biomedicines10030551 · Cited by 68
“The splitting ratio of the data was standard for machine learning [47–49].”
MethodA Hybrid Sparrow Search Algorithm of the Hyperparameter Optimization in Deep Learning
Fan, Y., Zhang, Y., Guo, B., Luo, X., Peng, Q., & Jin, Z. (2022) · Mathematics · doi:10.3390/math10163019 · Cited by 59
Classifying Garments from Fashion-MNIST Dataset Through CNNs
Henrique, A. S., Fernandes, A. M. D. R., Lyra, R., Leithardt, V. R. Q., Correia, S. D., Crocker, P. A., & Dazzi, R. L. S. (2021) · Advances in Science Technology and Engineering Systems Journal · doi:10.25046/aj0601109 · Cited by 50
Startups and Consumer Purchase Behavior: Application of Support Vector Machine Algorithm
Ebrahimi, P., Salamzadeh, A., Soleimani, M., Khansari, S. M., Zarea, H., & Fekete‐Farkas, M. (2022) · Big Data and Cognitive Computing · doi:10.3390/bdcc6020034 · Cited by 49
“Unsupervised learning is the path to realizing “real” artificial intelligence [60].”
Background
Metadata
- Authors
- Baldominos, A., Saez, Y., & Isasi, P.
- Affiliations
- Universidad Carlos III de Madrid (ES)
- Computer Science Department, Universidad Carlos III of Madrid, 28911 Leganés, Madrid, Spain
- Corresponding author
- Baldominos, Alejandro
- Venue
- Applied Sciences
- Publisher
- MDPI AG
- Published
- 2019-08-04
- Volume
- 9
- Issue
- 15
- Pages
- 3169
- ISSN
- 2076-3417 (ISSN-L)
- OpenAlex
- W2966275995
- Cited by
- 279
- References
- 76
- Citations by year
- 2026: 20 · 2025: 39 · 2024: 64 · 2023: 54 · 2022: 41 · 2021: 36 · 2020: 24 · 2019: 1
- FWCI
- 11.41
- Type
- journal article
- Language
- en
- Open access
- gold
- dx.doi.org
- Licence
- Locations
- Applied Sciences (publishedVersion, cc-by)
- e-Archivo (Carlos III University of Madrid) (submittedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- Funders
- Ministerio de Educación, Cultura y Deporte (FPU13/03917)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Handwritten Text Recognition Techniques
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Vehicle License Plate Recognition
- Keywords
- handwritten character recognition, handwritten digit recognition, MNIST, EMNIST, convolutional neural networks, data augmentation, letter recognition
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: A Survey of Handwritten Character Recognition with MNIST and EMNIST. https://app.cochat.ai/papers/10.3390/app9153169
- The paper
- Baldominos, A., Saez, Y., & Isasi, P. (2019). A Survey of Handwritten Character Recognition with MNIST and EMNIST. Applied Sciences. https://doi.org/10.3390/app9153169
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.


