Facial expression recognition via deep learning
Abstract
This paper mainly studies facial expression recognition with the components by face parsing (FP). Considering the disadvantage that different parts of face contain different amount of information for facial expression and the weighted function are not the same for different faces, an idea is proposed to recognize facial expression using components which are active in expression disclosure. The face parsing detectors are trained via deep belief network and tuned by logistic regression. The detectors first detect face, and then detect nose, eyes and mouth hierarchically. A deep architecture pretrained with stacked autoencoder is applied to facial expression recognition with the concentrated features of detected components. The parsing components remove the redundant information in expression recognition, and images don't need to be aligned or any other artificial treatment. Experimental results on the Japanese Female Facial Expression database and extended Cohn-Kanade dataset outperform other methods and show the effectiveness and robustness of this algorithm.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Cites
Histograms of Oriented Gradients for Human Detection
Dalal, N., & Triggs, B. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.177 · Cited by 33,584 · see citing works
A fast learning algorithm for deep belief nets
Hinton, G. E., Osindero, S., & Teh, Y.-W. (2006) · Neural Computation · doi:10.1162/neco.2006.18.7.1527 · Cited by 16,336 · see citing works
Ekman, P., & Friesen, W. V. (2019) · PsycTESTS Dataset · doi:10.1037/t27734-000 · Cited by 6,019 · see citing works
Face recognition using eigenfaces
Turk, M., & Pentland, A. (2002) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.1991.139758 · Cited by 5,232 · see citing works
Greedy layer-wise training of deep networks
Bengio, Y., Lamblin, P., Popovici, D., & Larochelle, H. (2007) · Advances in Neural Information Processing Systems 19 · doi:10.7551/mitpress/7503.003.0024 · Cited by 4,841 · see citing works
Lucey, P., Cohn, J. F., Kanade, T., Saragih, J., Ambadar, Z., & Matthews, I. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops · doi:10.1109/cvprw.2010.5543262 · Cited by 4,303 · see citing works
Facial expression recognition based on Local Binary Patterns: A comprehensive study
Shan, C., Gong, S., & McOwan, P. W. (2009) · Image and Vision Computing · doi:10.1016/j.imavis.2008.08.005 · Cited by 2,300 · see citing works
Coding facial expressions with Gabor wavelets
Lyons, M. J., Akamatsu, S., Kamachi, M., & Gyoba, J. (2002) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/afgr.1998.670949 · Cited by 2,214 · see citing works
Face recognition by independent component analysis
Bartlett, M. S., Movellan, J. R., & B, T. J. S. A. (2002) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2002.804287 · Cited by 1,931 · see citing works
Automatic classification of single facial images
Lyons, M. J., Budynek, J., & Akamatsu, S. (1999) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.817413 · Cited by 1,075 · see citing works
Facial expression recognition from video sequences: temporal and static modeling
Cohen, I., Sebe, N., Garg, A., Chen, L. S., & Huang, T. S. (2003) · Computer Vision and Image Understanding · doi:10.1016/s1077-3142(03)00081-x · Cited by 874 · see citing works
Facial Expression Recognition via a Boosted Deep Belief Network
Liu, P., Han, S., Meng, Z., & Tong, Y. (2014) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2014.233 · Cited by 667 · see citing works
Classification using discriminative restricted Boltzmann machines
Larochelle, H., & Bengio, Y. (2008) · International Conference on Machine Learning · doi:10.1145/1390156.1390224 · Cited by 666 · see citing works
Recognizing Facial Expression: Machine Learning and Application to Spontaneous Behavior
Bartlett, M. S., Littlewort, G. C., Frank, M. G., Lainscsek, C. S. M., Fasel, I., & Movellan, J. R. (2005) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2005.297 · Cited by 632 · see citing works
Zhang, Z., Lyons, M., Schuster, M., & Akamatsu, S. (2002) · Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition · doi:10.1109/afgr.1998.670990 · Cited by 613 · see citing works
Pantic, M., & Patras, I. (2006) · IEEE Transactions on Systems, Man and Cybernetics, Part B (Cybernetics) · doi:10.1109/tsmcb.2005.859075 · Cited by 580 · see citing works
Expert system for automatic analysis of facial expressions
Pantic, M., & Rothkrantz, L. J. M. (2000) · Image and Vision Computing · doi:10.1016/s0262-8856(00)00034-2 · Cited by 415 · see citing works
Learning active facial patches for expression analysis
Zhong, L., Liu, Q., Yang, P., Liu, B., Huang, J., & Metaxas, D. (2012) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2012.6247974 · Cited by 380 · see citing works
Robust Facial Expression Recognition Based on Local Directional Pattern
Jabid, T. (2010) · ETRI Journal · doi:10.4218/etrij.10.1510.0132 · Cited by 360 · see citing works
On deep generative models with applications to recognition
Ranzato, M., Susskind, J., Mnih, V., & Hinton, G. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995710 · Cited by 237 · see citing works
An analysis of facial expression recognition under partial facial image occlusion
Kotsia, I., Buciu, I., & Pitas, I. (2007) · Image and Vision Computing · doi:10.1016/j.imavis.2007.11.004 · Cited by 223 · see citing works
Recognition of facial expressions using Gabor wavelets and learning vector quantization
Bashyal, S., & Venayagamoorthy, G. K. (2008) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2007.11.010 · Cited by 222 · see citing works
Evaluation of Face Resolution for Expression Analysis
Tian, Y. (2005) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvpr.2004.334 · Cited by 207 · see citing works
Hierarchical face parsing via deep learning
Luo, P., Wang, X., & Tang, X. (2012) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2012.6247963 · Cited by 190 · see citing works
Robust Boltzmann Machines for recognition and denoising
Tang, Y., Salakhutdinov, R., & Hinton, G. E. (2012) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2012.6247936 · Cited by 171 · see citing works
Representing Face Images for Emotion Classification
Padgett, C. W., & Cottrell, G. W. (1996) · neural information processing systems · Cited by 171 · see citing works
Valstar, M., Patras, I., & Pantić, M. (2006) · 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops · doi:10.1109/cvpr.2005.457 · Cited by 158 · see citing works
Capturing Complex Spatio-temporal Relations among Facial Muscles for Facial Expression Recognition
Wang, Z., Wang, S., & Ji, Q. (2013) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2013.439 · Cited by 154 · see citing works
Recognizing facial action units using independent component analysis and support vector machine
Chuang, C.-F., & Shih, F. Y. (2006) · Pattern Recognition · doi:10.1016/j.patcog.2006.03.017 · Cited by 84 · see citing works
Facial Expression Recognition Based on Fusion of Multiple Gabor Features
Liu, W., & Wang, Z. (2006) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr.2006.538 · Cited by 72 · see citing works
Facial Expression Classification using Gabor and Log-Gabor Filters
Rose, N. (2006) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/fgr.2006.49 · Cited by 59 · see citing works
Facial expression recognition – A real time approach
Geetha, A., Ramalingam, V., Palanivel, S., & Palaniappan, B. (2009) · Expert Systems with Applications · doi:10.1016/j.eswa.2007.09.002 · Cited by 57 · see citing works
Face expression recognition: A brief overview of the last decade
Căleanu, C. D. (2013) · IEEE International Symposium on Applied Computational Intelligence and Informatics (SACI) · doi:10.1109/saci.2013.6608958 · Cited by 40 · see citing works
Averaged Gabor Filter Features for Facial Expression Recognition
Lajevardi, S. M., & Lech, M. (2008) · International Conference on Digital Image Computing: Techniques and Applications (DICTA) · doi:10.1109/dicta.2008.12 · Cited by 39 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Deep learning for human affect recognition: Insights and new developments
Rouast, P. V., Adam, M. T. P., & Chiong, R. (2021) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2018.2890471 · Cited by 243 · see citing works
Facial Sentiment Analysis Using AI Techniques: State-of-the-Art, Taxonomies, and Challenges
Patel, K., Mehta, D., Mistry, C., Gupta, R., Tanwar, S., Kumar, N., & Alazab, M. (2020) · IEEE Access · doi:10.1109/access.2020.2993803 · Cited by 157 · see citing works
- Authors
- Lv, Y., Feng, Z., & Xu, C.
- Affiliations
- Tianjin University (CN)
- Venue
- 2014 International Conference on Smart Computing
- Publisher
- IEEE
- Published
- 2014-11
- Pages
- 303-308
- OpenAlex
- W2971794874
- Cited by
- 122
- References
- 34
- Citations by year
- 2026: 1 · 2025: 1 · 2024: 4 · 2023: 20 · 2022: 16 · 2021: 20 · 2020: 17 · 2019: 9 · 2018: 16 · 2017: 13 · 2016: 5
- FWCI
- 3.23
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- IEEE International Conference on Smart Computing (publishedVersion)
- Funders
- National Science Foundation
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Face recognition and analysis
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Emotion and Mood Recognition
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Face and Expression Recognition
- Keywords
- facial expression recognition, face parsing, deep belief network, stacked autoencoder, logistic regression, hierarchical detection, JAFFE, CK+ dataset
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
