A Deep Structure for Facial Expression Recognition under Partial Occlusion
Abstract
According to the complex manifestation of human facial expression in realistic environment, occlusion problem has become a new challenge and a hot spot in the field of expression recognition. To make facial expression recognition applied in broader way, the main work is to increase the accuracy under different partial occlusion with feasible robust, which is limited by the information missing and insufficient training with fewer samples. Therefore, an algorithm with a deep structure has been proposed in this paper dealing with four types of frequently occurred occlusion. As a classic method, the Gabor filter is used for feature extraction at first. Then, multi-layers network is used to pre-train the training data samples, with re-describing the input Gabor features in complex way and fine-tuning the weights to refine the learning model. The experimental results on JAFFE database show that the proposed method is valid to achieve better recognition rate especially for partial occlusion on eyes and mouth.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Cites
Reducing the dimensionality of data with neural networks
Hinton, G. E., & Salakhutdinov, R. R. (2006) · Science · doi:10.1126/science.1127647 · Cited by 20,928 · see citing works
Automatic facial expression analysis: a survey
Fasel, B., & Luettin, J. (2003) · Pattern Recognition · doi:10.1016/s0031-3203(02)00052-3 · Cited by 1,810 · see citing works
Image representation using 2D Gabor wavelets
Lee, T. S. (1996) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.541406 · Cited by 1,631 · see citing works
Zhang, W., Shan, S., Gao, W., Chen, X., & Zhang, H. (2005) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2005.147 · Cited by 1,037 · see citing works
Independent component analysis of gabor features for face recognition
Liu, C., & Wechsler, H. (2003) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2003.813829 · Cited by 466 · see citing works
Automatic extraction of head and face boundaries and facial features
Shih, F. Y. (2003) · Information Sciences · doi:10.1016/j.ins.2003.03.002 · Cited by 124 · see citing works
Salient feature and reliable classifier selection for facial expression classification
Kyperountas, M., Tefas, A., & Pitas, I. (2009) · Pattern Recognition · doi:10.1016/j.patcog.2009.07.007 · Cited by 66 · see citing works
Facial expression recognition in the presence of occlusion using local Gabor binary patterns
Azmi, R., & Yegane, S. (2012) · Iranian Conference on Electrical Engineering · doi:10.1109/iraniancee.2012.6292452 · Cited by 17 · see citing works
Liu, S.-S., Zhang, Y., Liu, K., & Li, Y. (2013) · International Conference on Intelligent Information Hiding and Multimedia Signal Processing (IIH-MSP) · doi:10.1109/iih-msp.2013.63 · Cited by 17 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Deep Facial Expression Recognition: A Survey
Li, S., & Deng, W. (2020) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2020.2981446 · Cited by 2,043 · see citing works
Facial Expression Analysis under Partial Occlusion
Zhang, L., Verma, B., Tjondronegoro, D., & Chandran, V. (2018) · ACM Computing Surveys · doi:10.1145/3158369 · Cited by 1,291 · see citing works
Deep learning for human affect recognition: Insights and new developments
Rouast, P. V., Adam, M. T. P., & Chiong, R. (2021) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2018.2890471 · Cited by 243 · see citing works
Ensemble of Deep Neural Networks with Probability-Based Fusion for Facial Expression Recognition
Wen, G., Hou, Z., Li, H., Li, D., Jiang, L., & Xun, E. (2017) · Cognitive Computation · doi:10.1007/s12559-017-9472-6 · Cited by 164 · see citing works
Yang, K., Wang, C., Sarsenbayeva, Z., Tag, B., Dingler, T., Wadley, G., & Gonçalves, J. (2020) · The Visual Computer · doi:10.1007/s00371-020-01881-x · Cited by 54 · see citing works
Fast and Efficient Facial Expression Recognition Using a Gabor Convolutional Network
Jiang, P., Wan, B., Wang, Q., & Wu, J. (2020) · IEEE Signal Processing Letters · doi:10.1109/lsp.2020.3031504 · Cited by 47 · see citing works
Survey on Facial Expression Recognition: History, Applications, and Challenges
Zhao, X., Zhu, J., Luo, B., & Gao, Y. (2021) · IEEE Multimedia · doi:10.1109/mmul.2021.3107862 · Cited by 28 · see citing works
Li, D., Zhao, X., Yuan, G., Liu, Y., & Liu, G. (2020) · Applied Intelligence · doi:10.1007/s10489-020-01895-x · Cited by 18 · see citing works
Classification of Facial Expressions Under Partial Occlusion for VR Games
Rodrigues, A. S., Lopes, J. C., Lopes, R. P., & Teixeira, L. F. (2022) · Communications in computer and information science · doi:10.1007/978-3-031-23236-7_55 · Cited by 17 · see citing works
Survey of Automated Methods for Nonverbal Behavior Analysis in Parent-Child Interactions
Karaca, B., Salah, A. A., Denissen, J. J. A., Poppe, R. W., & de Zwarte, S. M. C. (2024) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/fg59268.2024.10582009 · Cited by 14 · see citing works
Dong, J., Zhang, L., Chen, Y., & Jiang, W. (2019) · Signal Processing Image Communication · doi:10.1016/j.image.2019.04.006 · Cited by 12 · see citing works
Facial expression recognition of masked faces using deep learning
Hdioud, B., & Tirari, M. E. H. (2022) · IAES International Journal of Artificial Intelligence · doi:10.11591/ijai.v12.i2.pp921-930 · Cited by 8 · see citing works
Lightweight Mood Estimation Algorithm For Faces Under Partial Occlusion
Petrou, N., Christodoulou, G., Avgerinakis, K., & Kosmides, P. (2023) · International Conference on PErvasive Technologies Related to Assistive Environments (PETRA) · doi:10.1145/3594806.3596553 · Cited by 7 · see citing works
Deep Facial Emotion Recognition System Under Facial Mask Occlusion
Saxena, S., Tripathi, S., & Sudarshan, T. S. B. (2021) · Communications in computer and information science · doi:10.1007/978-981-16-1092-9_32 · Cited by 6 · see citing works
Multimodal emotion recognition using deep learning techniques
Nguyen, T. D. (2020) · Queensland University of Technology · doi:10.5204/thesis.eprints.180753 · Cited by 6 · see citing works
Exploring the Impact of Convolutional Neural Networks on Facial Emotion Detection and Recognition
Donatus, R. E., Donatus, I. H., & Ubadike, O. C. (2024) · Asian Journal of Electrical Sciences · doi:10.70112/ajes-2024.13.1.4241 · Cited by 5 · see citing works
Multi-Channel Expression Recognition Network Based on Channel Weighting
Lu, X., Zhang, H., Zhang, Q., & Xue, H. (2023) · Applied Sciences · doi:10.3390/app13031968 · Cited by 5 · see citing works
A Comprehensive Face Parsing Framework for Anxiety Detection Using Deep Learning
Panicker, S., & Gayathri, P. (2025) · IEEE Access · doi:10.1109/access.2025.3612325 · Cited by 3 · see citing works
Deep Partial Occlusion Facial Expression Recognition via Improved CNN
Chen, Y., & Liu, S. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-64556-4_35 · Cited by 3 · see citing works
Tribedi, S., & Barai, R. K. (2025) · Multimedia Tools and Applications · doi:10.1007/s11042-025-20809-y · Cited by 1 · see citing works
Saxena, S., Tripathi, S., & Sudarshan, T. S. B. (2022) · Intelligent Decision Technologies · doi:10.3233/idt-210249
Unet based Xception Model Approach for Facial Emotion RecognitionPreprint
Majumder, S., & Bhattacharya, A. (2024) · Research Square · doi:10.21203/rs.3.rs-5013447/v1
Partial Occlusion in Facial Expression Recognition: A Systematic Literature Review
Rodrigues, A. S., Lopes, J. C., Vieira, J., & Lopes, R. P. (2024) · IEEE International Conference on Intelligent Reality (ICIR) · doi:10.1109/icir64558.2024.10976805
- Authors
- Cheng, Y., Jiang, B., & Jia, K.
- Affiliations
- Beijing University of Technology (CN)
- Venue
- 2014 Tenth International Conference on Intelligent Information Hiding and Multimedia Signal Processing
- Publisher
- IEEE
- Published
- 2014-08
- Pages
- 211-214
- OpenAlex
- W2318934522
- Cited by
- 24
- References
- 9
- Citations by year
- 2025: 2 · 2024: 4 · 2023: 2 · 2022: 3 · 2021: 3 · 2020: 6 · 2019: 2 · 2018: 1 · 2017: 1
- FWCI
- 0.18
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- International Conference on Intelligent Information Hiding and Multimedia Signal Processing (IIH-MSP) (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Face and Expression Recognition
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Emotion and Mood Recognition
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Face recognition and analysis
- Keywords
- facial expression recognition, partial occlusion, deep structure, Gabor features, multilayer networks, pre-training and fine-tuning, JAFFE database
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review