Race Recognition Using Deep Convolutional Neural Networks
Open accessThe DOI matches its Crossref record; 42 of the 42 references it cites were found in a registry or an index.
Abstract
Race recognition (RR), which has many applications such as in surveillance systems, image/video understanding, analysis, etc., is a difficult problem to solve completely. To contribute towards solving that problem, this article investigates using a deep learning model. An efficient Race Recognition Framework (RRF) is proposed that includes information collector (IC), face detection and preprocessing (FD&P), and RR modules. For the RR module, this study proposes two independent models. The first model is RR using a deep convolutional neural network (CNN) (the RR-CNN model). The second model (the RR-VGG model) is a fine-tuning model for RR based on VGG, the famous trained model for object recognition. In order to examine the performance of our proposed framework, we perform an experiment on our dataset named VNFaces, composed specifically of images collected from Facebook pages of Vietnamese people, to compare the accuracy between RR-CNN and RR-VGG. The experimental results show that for the VNFaces dataset, the RR-VGG model with augmented input images yields the best accuracy at 88.87% while RR-CNN, an independent and lightweight model, yields 88.64% accuracy. The extension experiments conducted prove that our proposed models could be applied to other race dataset problems such as Japanese, Chinese, or Brazilian with over 90% accuracy; the fine-tuning RR-VGG model achieved the best accuracy and is recommended for most scenarios.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Another dataset called VNFaces [6] was used to compare the accuracy of RR-CNN and RR-VGG methods, in which accuracy of 88.64 and 88.87 percent, respectively, was achieved.”
From Face Recognition Based on Deep Learning and FPGA for Ethnicity Identification (2022) · cites this paper as [6]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
Fully convolutional networks for semantic segmentation
Long, J., Shelhamer, E., & Darrell, T. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298965 · Cited by 38,834
Rapid object detection using a boosted cascade of simple features
Viola, P., & Jones, M. (2005) · Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001 · doi:10.1109/cvpr.2001.990517 · Cited by 18,300
He, H., & Garcia, E. A. (2009) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2008.239 · Cited by 10,359
Shin, H.-C., Roth, H. R., Gao, M., Lu, L., Xu, Z., Nogues, I., Yao, J., Mollura, D., & Summers, R. M. (2016) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2016.2528162 · Cited by 5,759
Efficient Processing of Deep Neural Networks: A Tutorial and Survey
Sze, V., Chen, Y.-H., Yang, T.-J., & Emer, J. S. (2017) · Proceedings of the IEEE · doi:10.1109/jproc.2017.2761740 · Cited by 4,215
A convolutional neural network cascade for face detection
Li, H., Lin, Z., Shen, X., Brandt, J., & Hua, G. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7299170 · Cited by 1,390
An improved deep learning architecture for person re-identification
Ahmed, E., Jones, M., & Marks, T. K. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7299016 · Cited by 1,248
Human activity recognition with smartphone sensors using deep learning neural networks
Ronao, C. A., & Cho, S.-B. (2016) · Expert Systems with Applications · doi:10.1016/j.eswa.2016.04.032 · Cited by 1,215
Face Photo-Sketch Synthesis and Recognition
Wang, X., & Tang, X. (2009) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2008.222 · Cited by 900
Aspect extraction for opinion mining with a deep convolutional neural network
Poria, S., Cambria, E., & Gelbukh, A. (2016) · Knowledge-Based Systems · doi:10.1016/j.knosys.2016.06.009 · Cited by 861
Human Pose Estimation with Iterative Error Feedback
Carreira, J., Agrawal, P., Fragkiadaki, K., & Malik, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.512 · Cited by 805
HCP: A Flexible CNN Framework for Multi-Label Image Classification
Wei, Y., Xia, W., Lin, M., Huang, J., Ni, B., Dong, J., Zhao, Y., & Yan, S. (2016) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2015.2491929 · Cited by 784
CNN: Single-label to Multi-label
Wei, Y., Xia, W., Huang, J., Ni, B., Dong, J., Zhao, Y., & Yan, S. (2014) · arXiv · doi:10.48550/arxiv.1406.5726 · Cited by 784
The CAS-PEAL large-scale chinese face database and baseline evaluations
Gao, W., Cao, B., Shan, S., Chen, X., Zhou, D., Zhang, X., & Zhao, D. (2008) · IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans · doi:10.1109/tsmca.2007.909557 · Cited by 773
Deep Learning-Based Document Modeling for Personality Detection from Text
Majumder, N., Poria, S., Gelbukh, A., & Cambria, E. (2017) · IEEE Intelligent Systems · doi:10.1109/mis.2017.23 · Cited by 675
A new ranking method for principal components analysis and its application to face image analysis
Thomaz, C. E., & Giraldi, G. A. (2010) · Image and Vision Computing · doi:10.1016/j.imavis.2009.11.005 · Cited by 558
DeepSaliency: Multi-Task Deep Neural Network Model for Salient Object Detection
Li, X., Zhao, L., Wei, L., Yang, M.-H., Wu, F., Zhuang, Y., Ling, H., & Wang, J. (2016) · IEEE Transactions on Image Processing · doi:10.1109/tip.2016.2579306 · Cited by 538
Yang, W., Ouyang, W., Li, H., & Wang, X. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.335 · Cited by 255
Computational personality recognition in social media
Farnadi, G., Sitaraman, G., Sushmita, S., Celli, F., Kosinski, M., Stillwell, D., Davalos, S., Moens, M.-F., & De Cock, M. (2016) · User Modeling and User-Adapted Interaction · doi:10.1007/s11257-016-9171-0 · Cited by 217
Toward Abnormal Trajectory and Event Detection in Video Surveillance
Cosar, S., Donatiello, G., Bogorny, V., Garate, C., Alvares, L. O., & Bremond, F. (2017) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2016.2589859 · Cited by 201
Paul, R., Hawkins, S., Balagurunathan, Y., Schabath, M., Gillies, R., Hall, L., & Goldgof, D. (2016) · Tomography · doi:10.18383/j.tom.2016.00211 · Cited by 181
Learning Race from Face: A Survey
Fu, S., He, H., & Hou, Z.-G. (2014) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2014.2321570 · Cited by 178
Respiration-based emotion recognition with deep learning
Zhang, Q., Chen, X., Zhan, Q., Yang, T., & Xia, S. (2017) · Computers in Industry · doi:10.1016/j.compind.2017.04.005 · Cited by 171
Words Matter: Scene Text for Image Classification and Retrieval
Karaoğlu, S., Ran, T., Gevers, T., & Smeulders, A. W. M. (2016) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2016.2638622 · Cited by 127
Deep neural network for halftone image classification based on sparse auto-encoder
Zhang, Y., Zhang, E., & Chen, W. (2016) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2016.01.032 · Cited by 108
Applications of Online Deep Learning for Crisis Response Using Social Media InformationPreprint
Nguyen, D. T., Joty, S., Imran, M., Sajjad, H., & Mitra, P. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1610.01030 · Cited by 107
Deep neural network framework and transformed MFCCs for speaker's age and gender classification
Qawaqneh, Z., Mallouh, A. A., & Barkana, B. D. (2016) · Knowledge-Based Systems · doi:10.1016/j.knosys.2016.10.008 · Cited by 91
Deep learning to frame objects for visual target tracking
Pang, S., del Coz, J. J., Yu, Z., Luaces, O., & Díez, J. (2017) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2017.08.010 · Cited by 64
Smile detection in the wild with deep convolutional neural networks
Chen, J., Ou, Q., Chi, Z., & Fu, H. C. (2016) · Machine Vision and Applications · doi:10.1007/s00138-016-0817-z · Cited by 62
Iranian Face Database with age, pose and expression
Bastanfard, A., Nik, M. A., & Dehshibi, M. M. (2007) · 2007 International Conference on Machine Vision · doi:10.1109/icmv.2007.4469272 · Cited by 59
A Powerful Generative Model Using Random Weights for the Deep Image Representation
He, K., Wang, Y., & Hopcroft, J. (2016) · arXiv · doi:10.48550/arxiv.1606.04801 · Cited by 59
MISNIS: An intelligent platform for twitter topic mining
Carvalho, J. P., Rosa, H., Brogueira, G., & Batista, F. (2017) · Expert Systems with Applications · doi:10.1016/j.eswa.2017.08.001 · Cited by 54
Efficient Processing of Deep Neural Networks: A Tutorial and SurveyPreprint
Sze, V., Chen, Y., Yang, T.-J., & Emer, J. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1703.09039 · Cited by 45
SVAS: Surveillance Video Analysis System
Kardas, K., & Cicekli, N. K. (2017) · Expert Systems with Applications · doi:10.1016/j.eswa.2017.07.051 · Cited by 40
Face alignment using a deep neural network with local feature learning and recurrent regression
Park, B.-H., Oh, S., & Kim, I.-J. (2017) · Expert Systems with Applications · doi:10.1016/j.eswa.2017.07.018 · Cited by 23
PERFORMANCE ANALYSIS OF FACE RECOGNITION ALGORITHMS ON KOREAN FACE DATABASE
Roh, M.-C., & Lee, S. (2007) · International Journal of Pattern Recognition and Artificial Intelligence · doi:10.1142/s0218001407005818 · Cited by 14
Recognition of college students from Weibo with deep neural networks
Xiao, Y., Yu, H. X., Tian, X., Yu, G., Li, X., Zhang, X., & Wang, J. (2016) · International Journal of Machine Learning and Cybernetics · doi:10.1007/s13042-016-0515-1 · Cited by 4
Face recognition using a permutation coding neural classifier
Baidyk, T., Kussul, E. M., Monterrosas, Z. C., Gallardo, A. J. I., Roldan-Serrato, L., Conde, C., Serrano, Á., de Diego, I. M., & Cabello, E. (2015) · Neural Computing and Applications · doi:10.1007/s00521-015-1913-0 · Cited by 3
Research works printed but not linked: 2
- Kingma, D.P., and Ba, J. (2014). Adam: A Method for Stochastic Optimization. arXiv, Available online: https://arxiv.org/abs/1412.6980. · arXiv
- Lyons, M., Akamatsu, S., Kamachi, M., and Gyoba, J. (1998, January 14–16). Coding facial expressions with Gabor wavelets. Proceedings of the Third IEEE International Conference on Automatic Face and Gesture Recognition, Nara, Japan.
Cited by
Structural crack detection using deep convolutional neural networks
Ali, R., Chuah, J. H., Talip, M. S. A., Mokhtar, N., & Shoaib, M. A. (2022) · Automation in Construction · doi:10.1016/j.autcon.2021.103989 · Cited by 369
A Novel Framework for Trash Classification Using Deep Transfer Learning
Vo, A. H., Hoang Son, L., Vo, M. T., & Le, T. (2019) · IEEE Access · doi:10.1109/access.2019.2959033 · Cited by 221
“[2] proposed a deep convolutional neural network namely RR-VGGwhich is a fine-tuning model based on VGG for race recognition from facial images.”
MethodLu, A., & Perkowski, M. A. (2021) · Brain Sciences · doi:10.3390/brainsci11111446 · Cited by 106
“In recent years, deep convolutional neural networks (CNNs) have been used extensively in computer vision, showing powerful discriminative capabilities while maintaining high performance levels [18].”
BackgroundLe, T., Vo, M. T., Kieu, T., Hwang, E., Rho, S., & Baik, S. W. (2020) · Sensors · doi:10.3390/s20092668 · Cited by 89
“…have been developed in various areas, such as business intelligence [1–4], intelligent systems in construction [5,6], medical and health care [7,8], trash classification [9], facial analysis [10–12], intelligent energy management system [13,14], and energy consumption forecasting [15,16].”
BackgroundIntelligent deep learning based ethnicity recognition and classification using facial images
Sunitha, G., Geetha, K., Neelakandan, S., Pundir, A. K. S., Hemalatha, S., & Kumar, V. (2022) · Image and Vision Computing · doi:10.1016/j.imavis.2022.104404 · Cited by 91
Metadata
- Authors
- Vo, T., Nguyen, T., & Le, C. T.
- Affiliations
- Vietnam National University Ho Chi Minh City (VN)
- Ho Chi Minh City Open University (VN)
- HUTECH University (VN)
- Corresponding author
- Le, C. T.
- Venue
- Symmetry
- Publisher
- MDPI AG
- Published
- 2018-11-01
- Volume
- 10
- Issue
- 11
- Pages
- 564
- ISSN
- 2073-8994 (ISSN-L)
- OpenAlex
- W2899292699
- Cited by
- 59
- References
- 39
- Citations by year
- 2025: 4 · 2024: 6 · 2023: 9 · 2022: 11 · 2021: 13 · 2020: 8 · 2019: 8
- FWCI
- 3.63
- Type
- journal article
- Language
- en
- Open access
- gold
- dx.doi.org
- Licence
- Locations
- Symmetry (publishedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Face recognition and analysis
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Face and Expression Recognition
- Keywords
- skin tone classification, deep convolutional neural networks, face detection, face preprocessing, image augmentation, ethnic classification, surveillance systems
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.