The DOI matches its Crossref record; 7 of the 7 references it cites were found in a registry or an index.
Facial Expression Recognition Using Weighted Mixture Deep Neural Network Based on Double-Channel Facial Images
Open accessAbstract
Facial expression recognition (FER) is a significant task for the machines to understand the emotional changes in human beings. However, accurate hand-crafted features that are highly related to changes in expression are difficult to extract because of the influences of individual difference and variations in emotional intensity. Therefore, features that can accurately describe the changes in facial expressions are urgently required. Method: A weighted mixture deep neural network (WMDNN) is proposed to automatically extract the features that are effective for FER tasks. Several pre-processing approaches, such as face detection, rotation rectification, and data augmentation, are implemented to restrict the regions for FER. Two channels of facial images, including facial grayscale images and their corresponding local binary pattern (LBP) facial images, are processed by WMDNN. Expression-related features of facial grayscale images are extracted by fine-tuning a partial VGG16 network, the parameters of which are initialized using VGG16 model trained on ImageNet database. Features of LBP facial images are extracted by a shallow convolutional neural network (CNN) built based on DeepID. The outputs of both channels are fused in a weighted manner. The result of final recognition is calculated using softmax classification. Results: Experimental results indicate that the proposed algorithm can recognize six basic facial expressions (happiness, sadness, anger, disgust, fear, and surprise) with high accuracy. The average recognition accuracies for benchmarking data sets “CK+,”“JAFFE,”and “Oulu-CASIA”are 0.970, 0.922, and 0.923, respectively. Conclusions: The proposed FER method outperforms the state-of-the-art FER methods based on the hand-crafted features or deep networks using one channel. Compared with the deep networks that use multiple channels, our proposed network can achieve comparable performance with easier procedures. Fine-tuning is effective to FER tasks with a well pre-trained model if sufficient samples cannot be collected.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Lucey, P., Cohn, J. F., Kanade, T., Saragih, J., Ambadar, Z., & Matthews, I. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops · doi:10.1109/cvprw.2010.5543262 · Cited by 4,303
A convolutional neural network cascade for face detection
Li, H., Lin, Z., Shen, X., Brandt, J., & Hua, G. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7299170 · Cited by 1,390
Lopes, A. T., de Aguiar, E., De Souza, A. F., & Oliveira-Santos, T. (2017) · Pattern Recognition · doi:10.1016/j.patcog.2016.07.026 · Cited by 799
Facial expression recognition via deep learning
Lv, Y., Feng, Z., & Xu, C. (2014) · 2014 International Conference on Smart Computing · doi:10.1109/smartcomp.2014.7043872 · Cited by 122
Multimodal learning for facial expression recognition
Zhang, W., Zhang, Y., Ma, L., Guan, J., & Gong, S. (2015) · Pattern Recognition · doi:10.1016/j.patcog.2015.04.012 · Cited by 109
Self-citationWalecki, R., Rudovic, O., Pavlovic, V., & Pantic, M. (2015) · 2015 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG) · doi:10.1109/fg.2015.7163137 · Cited by 65
Research works printed but not linked: 29
- 10.1109/AFGR.1998.670949 · DOI · Paper page
- srivastava, 2014, Dropout: A simple way to prevent neural networks from overfitting, J Mach Learn Res, 15, 1929
- simonyan, 2014, Very Deep Convolutional Networks for Large-scale Image Recognition
- 10.1109/TIP.2012.2235848 · DOI · Paper page
- 10.1109/WACV.2016.7477577 · DOI
- sun, 2015, DeepID3 Face Recognition with Very Deep Neural Networks
- 10.1016/j.jvcir.2014.03.006 · DOI
- liu, 2002, Gabor feature based classification using the enhanced Fisher linear discriminant model for face recognition, IEEE Trans Image Process, 11, 467, 10.1109/TIP.2002.999679 · DOI · Paper page
- 10.1016/j.imavis.2008.08.005 · DOI · Paper page
- 10.1109/T-AFFC.2013.4 · DOI · Paper page
- 10.1109/ICSMC.1997.633250 · DOI
- 10.1109/TCYB.2014.2354351 · DOI · Paper page
- mase, 1991, Recognition of facial expression from optical flow, IEICE Trans Inf Syst, e74 d, 3474
- 10.1109/TPAMI.2007.1110 · DOI · Paper page
- 10.1109/WACV.2016.7477450 · DOI · Paper page
- 10.1109/ICCVW.2011.6130446 · DOI
- 10.1016/j.neucom.2015.02.011 · DOI · Paper page
- demirkus, 2015, Multi-layer temporal graphical model for head pose estimation in real-world videos, Proc IEEE Int Conf Image Process, 3392
- 10.1109/ICSMC.2004.1398371 · DOI
- 10.1145/2557642.2579369 · DOI
- 10.1080/02564602.2014.944588 · DOI
- 10.1016/j.patcog.2017.06.017 · DOI · Paper page
- 10.5201/ipol.2014.104 · DOI · Paper page
- 10.1109/TVLSI.2010.2069575 · DOI
- 10.1016/j.neunet.2014.09.003 · DOI · Paper page
- 10.1145/2663204.2666275 · DOI · Paper page
- 10.1007/s11042-014-2322-6 · DOI
- 10.1007/s12193-015-0209-0 · DOI · Paper page
- 10.1145/2818346.2830595 · DOI · Paper page
Cited by
Kim, J.-H., Kim, B.-G., Roy, P. P., & Jeong, D.-M. (2019) · IEEE Access · doi:10.1109/access.2019.2907327 · Cited by 303
Recognizing Facial Expressions Using a Shallow Convolutional Neural Network
Miao, S., Xu, H., Han, Z., & Zhu, Y. (2019) · IEEE Access · doi:10.1109/access.2019.2921220 · Cited by 110
Efficient Facial Expression Recognition Through Lightweight CNN Technique on Public Datasets
Grover, R., & Bansal, S. (2024) · SN Computer Science · doi:10.1007/s42979-024-03557-y · Cited by 6
Metadata
- Authors
- Yang, B., Cao, J., Ni, R., & Zhang, Y.
- Venue
- IEEE Access
- Published
- 2018
- Volume
- 6
- Pages
- 4630-4640
- ISSN
- 2169-3536 (ISSN-L)
- OpenAlex
- W2774147932
- Cited by
- 204
- References
- 7
- FWCI
- 19.70
- Type
- journal article
- Language
- en
- Open access
- gold
- Funders
- National Natural Science Foundation of China (61501060, 61703381)
- Natural Science Foundation of Jiangsu Province (BK20150271)
- Key Laboratory for New Technology Application of Road Conveyance of Jiangsu Province (BM20082061708)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.