Automatic Facial Expression Recognition Using Facial Animation Parameters and Multistream HMMs
Abstract
The performance of an automatic facial expression recognition system can be significantly improved by modeling the reliability of different streams of facial expression information utilizing multistream hidden Markov models (HMMs). In this paper, we present an automatic multistream HMM facial expression recognition system and analyze its performance. The proposed system utilizes facial animation parameters (FAPs), supported by the MPEG-4 standard, as features for facial expression classification. Specifically, the FAPs describing the movement of the outer-lip contours and eyebrows are used as observations. Experiments are first performed employing single-stream HMMs under several different scenarios, utilizing outer-lip and eyebrow FAPs individually and jointly. A multistream HMM approach is proposed for introducing facial expression and FAP group dependent stream reliability weights. The stream weights are determined based on the facial expression recognition results obtained when FAP streams are utilized individually. The proposed multistream HMM facial expression system, which utilizes stream reliability weights, achieves relative reduction of the facial expression recognition error of 44% compared to the single-stream HMM system.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
FAP is rarely used to parametrize FEs for recognition purposes.
“Is is rarely used to parametrize FEs for recognition purposes [136], [137].”
From Survey on RGB, 3D, Thermal, and Multimodal Approaches for Facial Expression Recognition: History, Trends, and Affect-Related Applications (2016) · cites this paper as [137]
Most early works used geometric representations, like vectors, active contours, or deformable 2D mesh models.
“Most of these early works used geometric representations, like vectors for describing the motion of the face [134], active contours for describing the shape of the mouth and eyebrows [137], or deformable 2D mesh models [116].”
From Survey on RGB, 3D, Thermal, and Multimodal Approaches for Facial Expression Recognition: History, Trends, and Affect-Related Applications (2016) · cites this paper as [137]
Cites
Kass, M., Witkin, A., & Terzopoulos, D. (1988) · International Journal of Computer Vision · doi:10.1007/bf00133570 · Cited by 17,165 · see citing works
Fundamentals of speech recognition
Rabiner, L. R., & Juang, B.-H. F. (1993) · Cited by 7,680 · see citing works
Ekman, P., & Friesen, W. V. (2019) · PsycTESTS Dataset · doi:10.1037/t27734-000 · Cited by 6,019 · see citing works
Neural network-based face detection
Rowley, H. A., Baluja, S., & Kanade, T. (1998) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.655647 · Cited by 3,554 · see citing works
Comprehensive database for facial expression analysis
Takeo Kanade, A., Cohn, J. F., & Tian, Y. (2002) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/afgr.2000.840611 · Cited by 2,612 · see citing works
Automatic facial expression analysis: a survey
Fasel, B., & Luettin, J. (2003) · Pattern Recognition · doi:10.1016/s0031-3203(02)00052-3 · Cited by 1,810 · see citing works
Example-based learning for view-based human face detection
Sung, K. K., & Poggio, T. (1998) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.655648 · Cited by 1,779 · see citing works
Automatic analysis of facial expressions: the state of the art
Pantie, M., & Rothkrantz, L. J. M. (2000) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.895976 · Cited by 1,778 · cited 1× · see citing works
“Several automatic facial expression and facial action recognition systems [29]–[ 33 ] utilize FACS as facial features.”
MethodFeature extraction from faces using deformable templates
Yuille, A., Hallinan, P. W., & Cohen, D. S. (1992) · International Journal of Computer Vision · doi:10.1007/bf00127169 · Cited by 1,373 · see citing works
Donato, G., Bartlett, M. S., Hager, J. C., Ekman, P., & B, T. J. S. A. (1999) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.799905 · Cited by 999 · see citing works
Zhang, Z., Lyons, M., Schuster, M., & Akamatsu, S. (2002) · Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition · doi:10.1109/afgr.1998.670990 · Cited by 613 · see citing works
Bartlett, M. S., Littlewort, G. C., Fasel, I., & Movellan, J. R. (2003) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2003.10057 · Cited by 579 · see citing works
Pakštas, A., Forchheimer, R., & Pandžić, I. S. (2002) · Wiley eBooks · doi:10.1002/0470854626 · Cited by 422 · see citing works
Recognition of Facial Expression from Optical Flow
Mase, K. (1991) · IEICE Transactions on Information and Systems · Cited by 404 · see citing works
Audio-visual speech recognition
Neti, C., Potamianos, G., Luettin, J., Matthews, I. A., Glotin, H., Vergyri, D., Sison, J. A. G., & Mashari, A. (2000) · Infoscience (Ecole Polytechnique Fédérale de Lausanne) · Cited by 272 · see citing works
A mew ASR approach based on independent processing and recombination of partial frequency bands
Bourlard, H., & Dupont, S. (2002) · International Conference on Spoken Language Processing (ICSLP) · doi:10.1109/icslp.1996.607145 · Cited by 250 · see citing works
EMPATH: Face, Emotion, and Gender Recognition Using Holons
Cottrell, G. W., & Metcalfe, J. (1990) · neural information processing systems · Cited by 233 · see citing works
Automated facial expression recognition based on FACS action units
Lien, J. J., Kanade, T., Cohn, J. F., & Li, C.-C. (2002) · Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition · doi:10.1109/afgr.1998.670980 · Cited by 226 · see citing works
Representing Face Images for Emotion Classification
Padgett, C. W., & Cottrell, G. W. (1996) · neural information processing systems · Cited by 171 · see citing works
LAFTER: a real-time face and lips tracker with facial expression recognition
Oliver, N., Pentland, A., & Bérard, F. (2000) · Pattern Recognition · doi:10.1016/s0031-3203(99)00113-2 · Cited by 136 · see citing works
Fully automatic upper facial action recognition
Kapoor, A., Qi, Y., & Picard, R. W. (2004) · IEEE International SOI Conference (SOI) · doi:10.1109/amfg.2003.1240843 · Cited by 135 · see citing works
Dynamics of Facial Expression Extracted Automatically from Video
Littlewort, G., Bartlett, M. S., Fasel, I., Susskind, J., & Movellan, J. (2005) · 2004 Conference on Computer Vision and Pattern Recognition Workshop · doi:10.1109/cvpr.2004.327 · Cited by 126 · see citing works
Facial animation parameters extraction and expression recognition using Hidden Markov Models
Pardàs, M., & Bonafonte, A. (2002) · Signal Processing: Image Communication · doi:10.1016/s0923-5965(02)00078-4 · Cited by 81 · see citing works
Emotion Recognition and Synthesis Based on MPEG‐4 FAPs
Tsapatsoulis, N., Raouzaiou, A. T., Kollias, S., Cowie, R., & Douglas‐Cowie, E. (2002) · doi:10.1002/0470854626.ch9 · Cited by 63 · see citing works
Real-time lip tracking and bimodal continuous speech recognition
Chan, M. T., Zhang, Y., & Huang, T. S. (2002) · IEEE Workshop on Multimedia Signal Processing (MMSP) · doi:10.1109/mmsp.1998.738914 · Cited by 60 · see citing works
Audio-Visual Speech Recognition Using MPEG-4 Compliant Visual Features
Aleksic, P. S., Williams, J. J., Wu, Z., & Katsaggelos, A. K. (2002) · EURASIP Journal on Advances in Signal Processing · doi:10.1155/s1110865702206162 · Cited by 57 · see citing works
Self-citationEmotion recognition based on MPEG-4 Facial Animation Parameters
Pardàs, M., Bonafonte, A., & Landabaso, J. L. (2002) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2002.5745440 · Cited by 34 · see citing works
Identifying Emotion in Static Face Images
Padgett, C. W., & Cottrell, G. W. (1995) · Cited by 22 · see citing works
A recombination strategy for multi-band speech recognition based on mutual information criterion
Okawa, S., Nakajima, T., & Shirai, K. (1999) · European Conference on Speech Communication and Technology (Eurospeech) · doi:10.21437/eurospeech.1999-155 · Cited by 17 · see citing works
Extracting Facial Motion Parameters by Tracking Feature Points
Otsuka, T., & Ohya, J. (1999) · Lecture notes in computer science · doi:10.1007/3-540-48962-2_30 · Cited by 16 · see citing works
Emotion recognition based on MPEG-4 facial animation parameters
Pardas, Bonafonte, A., & Landabaso (2002) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2002.1004701 · Cited by 14 · see citing works
HMM recognition of expressions in unrestrained video intervals
Landabaso, J. L., Pardis, M., & Bonafonte, A. (2003) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2003.1199141 · Cited by 7 · see citing works
Flagged first, then by citations
2 of the 34 references couldn’t be matched to a known paper.
Cited by
Sorted by citations
Dynamic Texture Recognition Using Local Binary Patterns with an Application to Facial Expressions
Zhao, G., & Pietikainen, M. (2007) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2007.1110 · Cited by 2,846 · see citing works
Corneanu, C. A., Simon, M. O., Cohn, J. F., & Guerrero, S. E. (2016) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2515606 · Cited by 527 · see citing works
Facial expression recognition using radial encoding of local Gabor features and classifier synthesis
Gu, W., Xiang, C., Venkatesh, Y. V., Huang, D., & Lin, H. T. (2011) · Pattern Recognition · doi:10.1016/j.patcog.2011.05.006 · Cited by 311 · see citing works
Face Expression Recognition and Analysis: The State of the Art
Bettadapura, V. (2012) · arXiv · doi:10.48550/arxiv.1203.6722
Facial Expression Recognition Using Facial Movement Features
Zhang, L., & Tjondronegoro, D. (2011) · IEEE Transactions on Affective Computing · doi:10.1109/t-affc.2011.13 · Cited by 253 · see citing works
Performance Analysis of Multi-Motion Sensor Behavior for Active Smartphone Authentication
Shen, C. Q., Li, Y., Chen, Y., Guan, X., & Maxion, R. A. (2017) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2017.2737969 · Cited by 203 · see citing works
Bilinear Models for 3-D Face and Facial Expression Recognition
Mpiperis, I., Malassiotis, S., & Strintzis, M. G. (2008) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2008.924598 · Cited by 185 · see citing works
Pyramid With Super Resolution for In-the-Wild Facial Expression Recognition
Vo, T.-H., Lee, G.-S., Yang, H.-J., & Kim, S.-H. (2020) · IEEE Access · doi:10.1109/access.2020.3010018 · Cited by 172 · see citing works
Robust Representation and Recognition of Facial Emotions Using Extreme Sparse Learning
Shojaeilangari, S., Yau, W., Nandakumar, K., Li, J., & Teoh, E. K. (2015) · IEEE Transactions on Image Processing · doi:10.1109/tip.2015.2416634 · Cited by 151 · see citing works
Uddin, M. Z., Hassan, M. M., Almogren, A., Alamri, A. M., Alrubaian, M., & Fortino, G. (2017) · IEEE Access · doi:10.1109/access.2017.2676238 · Cited by 131 · see citing works
Boosted multi-resolution spatiotemporal descriptors for facial expression recognition
Zhao, G., & Pietikäinen, M. (2009) · Pattern Recognition Letters · doi:10.1016/j.patrec.2009.03.018 · Cited by 129 · see citing works
Fusion of feature sets and classifiers for facial expression recognition
Zavaschi, T. H. H., Britto, A. S., Oliveira, L. S., & Koerich, A. L. (2012) · Expert Systems with Applications · doi:10.1016/j.eswa.2012.07.074 · Cited by 116 · see citing works
Texture and shape information fusion for facial expression and facial action unit recognition
Kotsia, I., Zafeiriou, S. P., & Pitas, I. (2007) · Pattern Recognition · doi:10.1016/j.patcog.2007.06.026 · Cited by 106 · see citing works
Uddin, M. Z., Hassan, M. M., Almogren, A., Zuair, M., Fortino, G., & Tørresen, J. (2017) · Computers & Electrical Engineering · doi:10.1016/j.compeleceng.2017.04.019 · Cited by 103 · see citing works
An enhanced independent component-based human facial expression recognition from video
Uddin, M. Z., Lee, J., & Kim, T.-S. (2009) · IEEE Transactions on Consumer Electronics · doi:10.1109/tce.2009.5373791 · Cited by 102 · see citing works
Poursaberi, A., Noubari, H. A., Gavrilova, M. L., & Yanushkevich, S. N. (2012) · EURASIP Journal on Image and Video Processing · doi:10.1186/1687-5281-2012-17 · Cited by 98 · see citing works
Dynamic Facial Expression Recognition Using Longitudinal Facial Expression Atlases
Guo, Y., Zhao, G., & Pietikäinen, M. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-33709-3_45 · Cited by 96 · see citing works
Facial expressions classification and false label reduction using LDA and threefold SVM
Shah, J. H., Sharif, M. I., Yasmin, M., & Fernandes, S. L. (2017) · Pattern Recognition Letters · doi:10.1016/j.patrec.2017.06.021 · Cited by 86 · see citing works
Semantic Audiovisual Data Fusion for Automatic Emotion Recognition
Datcu, D., & Rothkrantz, L. J. M. (2015) · Wiley eBooks · doi:10.1002/9781118910566.ch16 · Cited by 91 · see citing works
Facial Expression Recognition Method Based on Improved VGG Convolutional Neural Network
Cheng, S., & Zhou, G. (2019) · International Journal of Pattern Recognition and Artificial Intelligence · doi:10.1142/s0218001420560030 · Cited by 80 · see citing works
A Review on Facial Expression Recognition: Feature Extraction and Classification
Zhao, X., & Zhang, S. (2016) · IETE Technical Review · doi:10.1080/02564602.2015.1117403 · Cited by 75 · see citing works
Hybrid-Boost Learning for Multi-Pose Face Detection and Facial Expression Recognition
Chen, H.-Y., Huang, C.-L., & Fu, C.-M. (2007) · IEEE International Conference on Multimedia and Expo · doi:10.1016/j.patcog.2007.08.010 · Cited by 89 · see citing works
Facial-component-based bag of words and PHOG descriptor for facial expression recognition
Li, Z., Imai, J., & Kaneko, M. (2009) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/icsmc.2009.5346254 · Cited by 67 · see citing works
Salient feature and reliable classifier selection for facial expression classification
Kyperountas, M., Tefas, A., & Pitas, I. (2009) · Pattern Recognition · doi:10.1016/j.patcog.2009.07.007 · Cited by 66 · see citing works
Intelligent facial emotion recognition using a layered encoding cascade optimization model
Neoh, S. C., Zhang, L., Mistry, K., Hossain, M. A., Lim, C. P., Aslam, N., & Kinghorn, P. (2015) · Applied Soft Computing · doi:10.1016/j.asoc.2015.05.006 · Cited by 59 · see citing works
Agrawal, S., & Khatri, P. (2015) · doi:10.1109/acct.2015.32 · Cited by 58 · see citing works
Prototype-Based Modeling for Facial Expression Analysis
Dahmane, M., & Meunier, J. (2014) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2014.2321113 · Cited by 56 · see citing works
Methods for Facial Expression Recognition with Applications in Challenging Situations
Pise, A. A., Alqahtani, M. A., Verma, P., Purushothama, K., Karras, D. A., Prathibha, S., & Halifa, A. (2022) · Computational Intelligence and Neuroscience · doi:10.1155/2022/9261438 · Cited by 64 · see citing works
Extraction of informative regions of a face for facial expression recognition
Kumar, S., Bhuyan, M. K., & Chakraborty, B. K. (2016) · IET Computer Vision · doi:10.1049/iet-cvi.2015.0273 · Cited by 54 · see citing works
An effectual facial expression recognition using HMM
Ramkumar, G., & Logashanmugam, E. (2016) · IEEE International Conference on Advanced Communications, Control and Computing Technologies · doi:10.1109/icaccct.2016.7831590 · Cited by 55 · see citing works
New research advances of facial expression recognition
Liu, S.-S., Tian, Y., & Li, D. (2009) · International Conference on Machine Learning and Cybernetics · doi:10.1109/icmlc.2009.5212409 · Cited by 53 · see citing works
Discriminant Graph Structures for Facial Expression Recognition
Zafeiriou, S. P., & Pitas, I. (2008) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2008.2007292 · Cited by 51 · see citing works
Semantic-based facial expression recognition using analytical hierarchy process
Cheng, S., Chen, M.-Y., Chang, H., & Chou, T. (2006) · Expert Systems with Applications · doi:10.1016/j.eswa.2006.04.019 · Cited by 49 · see citing works
Depth Camera-Based Facial Expression Recognition System Using Multilayer Scheme
Siddiqi, M. H., Ali, R., Sattar, A., Khan, A., & Lee, S. (2014) · IETE Technical Review · doi:10.1080/02564602.2014.944588 · Cited by 48 · see citing works
Detection of Genuine and Posed Facial Expressions of Emotion: Databases and Methods
Jia, S., Wang, S., Hu, C., Webster, P. J., & Li, X. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2020.580287 · Cited by 53 · see citing works
A Study of Techniques for Facial Detection and Expression Classification
Hemalatha, G., & Sumathi, C. P. (2014) · International Journal of Computer Science & Engineering Survey · doi:10.5121/ijcses.2014.5203 · Cited by 46 · see citing works
Ouyang, Y., Sang, N., & Huang, R. (2014) · Neurocomputing · doi:10.1016/j.neucom.2014.03.073 · Cited by 45 · see citing works
Automatic Facial Feature Extraction and Expression Recognition based on Neural Network
P, S., Thool, R. C., & Khandait, P. D. (2011) · International Journal of Advanced Computer Science and Applications · doi:10.14569/ijacsa.2011.020117 · Cited by 44 · see citing works
Siddiqui, M. F. H., Dhakal, P., Yang, X., & Javaid, A. Y. (2022) · Multimodal Technologies and Interaction · doi:10.3390/mti6060047 · Cited by 46 · see citing works
Expression recognition using fuzzy spatio-temporal modeling
Xiang, T., Leung, M. K. H., & Cho, S.-U. (2007) · Pattern Recognition · doi:10.1016/j.patcog.2007.04.021 · Cited by 41 · see citing works
D-FES: Deep facial expression recognition system
Sharma, S., Kumar, K., & Singh, N. (2017) · IEEE Conference on Information and Communication Technology (CICT) · doi:10.1109/infocomtech.2017.8340635 · Cited by 41 · see citing works
Facial expression recognition with dynamic cascaded classifier
Ashir, A. M., Eleyan, A., & Akdemïr, B. (2019) · Neural Computing and Applications · doi:10.1007/s00521-019-04138-4 · Cited by 42 · see citing works
Fedorova, K. (2020) · The MIT Press eBooks · doi:10.7551/mitpress/12544.001.0001 · Cited by 40 · see citing works
Facial expression recognition based on anatomy
Eskil, M. T., & Benli, K. S. (2013) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2013.11.002 · Cited by 41 · see citing works
Kalita, J., & Das, K. (2013) · International Journal of Advanced Computer Science and Applications · doi:10.14569/ijacsa.2013.040229 · Cited by 39 · see citing works
E2‐capsule neural networks for facial expression recognition using AU‐aware attention
Cao, S., Yao, Y., & An, G. (2020) · IET Image Processing · doi:10.1049/iet-ipr.2020.0063 · Cited by 39 · see citing works
Jagadeesh, M., & Baranidharan, B. (2022) · Multimedia Systems · doi:10.1007/s00530-022-00957-z · Cited by 40 · see citing works
Hough Forest-Based Facial Expression Recognition from Video Sequences
Fanelli, G., Yao, A., Noel, P.-L., Gall, J., & Gool, L. V. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-35749-7_15 · Cited by 39 · see citing works
Lin, D.-T., & Pan, D.-C. (2009) · Integrated Computer-Aided Engineering · doi:10.3233/ica-2009-0304 · Cited by 38 · see citing works
Hierarchical Recognition Scheme for Human Facial Expression Recognition Systems
Siddiqi, M., Lee, S., Lee, Y.-K., Khan, A., & Truc, P. T. H. (2013) · Sensors · doi:10.3390/s131216682 · Cited by 38 · see citing works
Novel Multiclass Classifiers Based on the Minimization of the Within-Class Variance
Kotsia, I., Pitas, I., Zafeiriou, S., & Zafeiriou, S. (2008) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2008.2004376 · Cited by 36 · see citing works
A Local-Global Graph Approach for Facial Expression Recognition
Kakumanu, P., & Bourbakis, N. (2006) · IEEE International Conference on Tools with Artificial Intelligence (ICTAI) · doi:10.1109/ictai.2006.15 · Cited by 31 · see citing works
Facial Expression Recognition Based on SVM in E-learning
Chen, L., Zhou, C., & Shen, L. (2012) · IERI Procedia · doi:10.1016/j.ieri.2012.06.171 · Cited by 32 · see citing works
Analysis of Facial Emotion Recognition
Balasubramanian, B., Diwan, P., Nadar, R., & Bhatia, A. (2019) · International Conference on Trends in Electronics and Informatics (ICOEI) · doi:10.1109/icoei.2019.8862731 · Cited by 32 · see citing works
WiFace: Facial Expression Recognition Using Wi-Fi Signals
Chen, Y., Ou, R., Li, Z., & Wu, K. (2020) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2020.3001989 · Cited by 31 · see citing works
Study of Facial Micro-expressions in Psychology
Bhushan, B. (2014) · Springer eBooks · doi:10.1007/978-81-322-1934-7_13 · Cited by 31 · see citing works
Interface Framework to Drive an Intelligent Wheelchair Using Facial Expressions
Faria, P. M., Braga, R. A. M., Valgôde, E., & Reis, L. P. (2007) · IEEE International Symposium on Industrial Electronics (ISIE) · doi:10.1109/isie.2007.4374877 · Cited by 29 · see citing works
Facial expression recognition based on image pyramid and single-branch decision tree
Ashir, A. M., & Eleyan, A. (2017) · Signal Image and Video Processing · doi:10.1007/s11760-016-1052-9 · Cited by 27 · see citing works
Automatic facial feature extraction and expression recognition based on neural networkPreprint
Khandait, S. P., Thool, R. C., & Khandait, P. D. (2012) · arXiv (Cornell University) · doi:10.48550/arxiv.1204.2073 · Cited by 25 · see citing works
Facial Expression Recognition Using Facial-component-based Bag of Words and PHOG Descriptors
Li, Z., Imai, J., & Kaneko, M. (2010) · Journal of information processing · doi:10.11185/imt.5.1003 · Cited by 24 · see citing works
Experiments with Facial Expression Recognition using Spatiotemporal Local Binary Patterns
Zhao, G., & Pietikäinen, M. (2007) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme.2007.4284844 · Cited by 24 · see citing works
Personalized facial expression recognition in indoor environments
Chang, C., & Huang, Y. (2010) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2010.5596316 · Cited by 24 · see citing works
Multi-Layer Sparse Representation for Weighted LBP-Patches Based Facial Expression Recognition
Jia, Q., Gao, X., Guo, H., Luo, Z., & Wang, Y. (2015) · Sensors · doi:10.3390/s150306719 · Cited by 23 · see citing works
Liu, Z., Li, S., Cao, W., Li, D., Hao, M., & Ri, Z. (2019) · Journal of Advanced Computational Intelligence and Intelligent Informatics · doi:10.20965/jaciii.2019.p0444 · Cited by 23 · see citing works
Analysis on techniques used to recognize and identifying the Human emotions
Kulkarni, P., & Rajesh, T. M. (2020) · International Journal of Electrical and Computer Engineering (IJECE) · doi:10.11591/ijece.v10i3.pp3307-3314 · Cited by 20 · see citing works
Huang, X., Zhao, G., Pietikäinen, M., & Zheng, W. (2010) · Lecture notes in computer science · doi:10.1007/978-3-642-17691-3_29 · Cited by 18 · see citing works
Advances in facial expression recognition technologies for emotion analysis
Jayaswal, R., Ansari, M. A., Dixit, M., Singh, D. K., & Ahmad, S. (2025) · Discover Computing · doi:10.1007/s10791-025-09699-8 · Cited by 25 · see citing works
Facial Expression Recognition Using Facial-component-based Bag of Words and PHOG Descriptors
Li, Z., Imai, J., & Kaneko, M. (2010) · The Journal of The Institute of Image Information and Television Engineers · doi:10.3169/itej.64.230 · Cited by 18 · see citing works
Uddin, M. Z., & Hassan, M. M. (2013) · Multimedia Tools and Applications · doi:10.1007/s11042-013-1793-1 · Cited by 18 · see citing works
Facial expression recognition through adaptive learning of local motion descriptor
Agarwal, S., & Mukherjee, D. P. (2015) · Multimedia Tools and Applications · doi:10.1007/s11042-015-3103-6 · Cited by 18 · see citing works
Image Segmentation Based on Minimal Spanning Tree and Cycles
Janakiraman, T. N., & Mouli, C. (2007) · International Conference on Computational Intelligence and Multimedia Applications (ICCIMA) · doi:10.1109/iccima.2007.54 · Cited by 18 · see citing works
Montazeri, S., & Seyyedsalehi, S. A. (2018) · Neural Networks · doi:10.1016/j.neunet.2018.05.016 · Cited by 18 · see citing works
The Applications of Facial Expression Recognition in Human-computer Interaction
Wang, H., & Gu, J. (2018) · IEEE International Conference on Advanced Manufacturing (ICAM) · doi:10.1109/amcon.2018.8614755 · Cited by 18 · see citing works
A comprehensive study on Facial Expressions Recognition Techniques
Jameel, R., Singhal, A., & Bansal, A. (2016) · International Conference on Cloud Computing, Data Science & Engineering (Confluence) · doi:10.1109/confluence.2016.7508167 · Cited by 17 · see citing works
Video-Based Facial Expression Recognition using Deep Temporal–Spatial Networks
Pan, X., Zhang, S., Guo, W., Zhao, X., Chuang, Y., Chen, Y., & Zhang, H. (2019) · IETE Technical Review · doi:10.1080/02564602.2019.1645620 · Cited by 17 · see citing works
Affective Computing and Biometrics Based HCI Surveillance System
Wang, R., & Fang, B. (2008) · International Symposium on Information Science and Engineering · doi:10.1109/isise.2008.317 · Cited by 17 · see citing works
Coupled Dictionary Learning for the Detail-Enhanced Synthesis of 3-D Facial Expressions
Liang, H., Liang, R., Song, M., & He, X. (2015) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2015.2417211 · Cited by 16 · see citing works
Learning spatial weighting for facial expression analysis via constrained quadratic programming
Liao, C., Chuang, H.-J., Duan, C.-H., & Lai, S. (2013) · Pattern Recognition · doi:10.1016/j.patcog.2013.03.017 · Cited by 16 · see citing works
Roshanzamir, M., Jafari, M., Alizadehsani, R., Roshanzamir, M., Shoeibi, A., Górriz, J. M., Khosravi, A., Nahavandi, S., & Acharya, U. R. (2024) · Information Systems Frontiers · doi:10.1007/s10796-023-10466-7 · Cited by 17 · see citing works
Automatic Generation of Facial Expression Using Triangular Geometric Deformation
Sheu, J., Hsieh, T. S., & Shou, H.-N. (2014) · Journal of Applied Research and Technology · doi:10.1016/s1665-6423(14)71671-2 · Cited by 15 · see citing works
Physiological Sensing for Affective Computing
Peter, C., Ebert, E., & Beikirch, H. (2008) · Springer eBooks · doi:10.1007/978-1-84800-306-4_16 · Cited by 14 · see citing works
Facial Expression Recognition Based on Selective Feature Extraction
Zhou, G., Zhan, Y., & Zhang, J. (2006) · International Conference on Intelligent Systems Design and Applications (ISDA) · doi:10.1109/isda.2006.253872 · Cited by 15 · see citing works
Martínez‐Rodrigo, A., Zangróniz, R., Pastor, J. M., & Sokolova, M. V. (2016) · Pervasive and Mobile Computing · doi:10.1016/j.pmcj.2016.04.006 · Cited by 14 · see citing works
Analytical review of methods for emotion recognition by human face expressions
Рюмина, Е. В., & Karpov, A. A. (2020) · Scientific and technical journal of information technologies mechanics and optics · doi:10.17586/2226-1494-2020-20-2-163-176 · Cited by 14 · see citing works
Fast gesture recognition with Multiple Stream Discrete HMMs on 3D skeletons
Borghi, G., Vezzani, R., & Cucchiara, R. (2016) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr.2016.7899766 · Cited by 13 · see citing works
Uddin, M. Z. (2015) · Multimedia Tools and Applications · doi:10.1007/s11042-015-2614-5 · Cited by 12 · see citing works
Facial Emotion Detection Using Convolutional Neural Networks
Hosur, V., & Desai, A. (2022) · IEEE Mysore Sub Section International Conference (MysuruCon) · doi:10.1109/mysurucon55714.2022.9972510 · Cited by 12 · see citing works
Facial Expression Recognition Based on Hybrid Features and Fusing Discrete HMMs
Zhan, Y., & Zhou, G. (2007) · Lecture notes in computer science · doi:10.1007/978-3-540-73335-5_45 · Cited by 12 · see citing works
Dual-graph regularized discriminative transfer sparse coding for facial expression recognition
Chen, D., & Song, P. (2020) · Digital Signal Processing · doi:10.1016/j.dsp.2020.102906 · Cited by 12 · see citing works
The decadal perspective of facial emotion processing and Recognition: A survey
Rathour, N., Singh, R., Gehlot, A., Akram, S. V., Thakur, A. K., & Kumar, A. (2022) · Displays · doi:10.1016/j.displa.2022.102330 · Cited by 14 · see citing works
Research on the selection of kernel function in SVM based facial expression recognition
Wang, F., He, K., Liu, Y., Li, L., & Hu, X. (2013) · IEEE Conference on Industrial Electronics and Applications (ICIEA) · doi:10.1109/iciea.2013.6566586 · Cited by 11 · see citing works
Li, Z., Imai, J., & Kaneko, M. (2010) · International Symposium on Communications and Information Technologies · doi:10.1109/iscit.2010.5664923 · Cited by 11 · see citing works
Facial Expression Recognition System
Ren, Y. (2008) · UWSpace (University of Waterloo) · Cited by 11 · see citing works
Combining appearance and geometric features for facial expression recognition
Yu, H. L., & Liu, H. (2015) · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · doi:10.1117/12.2179066 · Cited by 10 · see citing works
Hidden Markov Model Decision Forest for Dynamic Facial Expression Recognition
Liang, J., Xu, C., Feng, Z., & Ma, X. (2015) · International Journal of Pattern Recognition and Artificial Intelligence · doi:10.1142/s0218001415560108 · Cited by 10 · see citing works
Zernike Moment-Based Facial Expression Recognition Using Two-Staged Hidden Markov Model
Rahul, M., Shukla, R., Yadav, D. K., & Yadav, V. (2019) · Advances in intelligent systems and computing · doi:10.1007/978-981-13-6861-5_56 · Cited by 10 · see citing works
Person-independent facial expression recognition via hierarchical classification
Xue, M., Liu, W., & Li, L. (2013) · International Conference on Intelligent Sensors, Sensor Networks and Information Processing · doi:10.1109/issnip.2013.6529832 · Cited by 9 · see citing works
Facial Signs and Psycho-physical Status Estimation for Well-being Assessment
Chiarugi, F., Iatraki, G., Christinaki, E., Manousos, D., Giannakakis, G. A., Pediaditis, M., Pampouchidou, A., Kostas Marias, A., & Tsiknakis, M. (2014) · International Conference on Health Informatics · doi:10.5220/0004934405550562 · Cited by 9 · see citing works
Hybrid-Boost Learning for Multi-Pose Face Detection and Facial Expression Recognition
Chen, H.-Y., Huang, C., & Fu, C.-M. (2007) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme.2007.4284739 · Cited by 9 · see citing works
Aleksic, P. S., Potamianos, G., & Katsaggelos, A. K. (2009) · Elsevier eBooks · doi:10.1016/b978-0-12-374456-2.00024-4 · Cited by 9 · see citing works
Self-citation
- Authors
- Aleksic, P. S., & Katsaggelos, A. K.
- Affiliations
- Northwestern University (US)
- ORCID
- Katsaggelos, A.K.
- Venue
- IEEE Transactions on Information Forensics and Security
- Published
- 2006-03
- Volume
- 1
- Issue
- 1
- Pages
- 3-11
- ISSN
- 1556-6013 (ISSN-L)
- OpenAlex
- W2098044144
- Cited by
- 235
- References
- 34
- Citations by year
- 2026: 1 · 2025: 4 · 2024: 4 · 2023: 3 · 2022: 11 · 2021: 1 · 2020: 14 · 2019: 8 · 2018: 7 · 2017: 15 · 2016: 11 · 2015: 20 · 2014: 19 · 2013: 19 · 2012: 12
- FWCI
- 24.02
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- IEEE Transactions on Information Forensics and Security (publishedVersion)
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Emotion and Mood Recognition
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Face recognition and analysis
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Face and Expression Recognition
- Keywords
- facial expression recognition, facial animation parameters, eyebrow movements, MPEG-4, error reduction
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
