The DOI matches its Crossref record; 60 of the 60 references it cites were found in a registry or an index.
Automatic facial expression recognition using features of salient facial patches
Open accessAbstract
Extraction of discriminative features from salient facial patches plays a vital role in effective facial expression recognition. The accurate detection of facial landmarks improves the localization of the salient patches on face images. This paper proposes a novel framework for expression recognition by using appearance features of selected facial patches. A few prominent facial patches, depending on the position of facial landmarks, are extracted which are active during emotion elicitation. These active patches are further processed to obtain the salient patches which contain discriminative features for classification of each pair of expressions, thereby selecting different facial patches as salient for different pair of expression classes. One-against-one classification method is adopted using these features. In addition, an automated learning-free facial landmark detection technique has been proposed, which achieves similar performances as that of other state-of-art landmark detection methods, yet requires significantly less execution time. The proposed method is found to perform well consistently in different resolutions, hence, providing a solution for expression recognition in low resolution images. Experiments on CK+ and JAFFE facial expression databases show the effectiveness of the proposed system.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Cortes, C., & Vapnik, V. (1995) · Machine Learning · doi:10.1007/bf00994018 · Cited by 59,421
A Threshold Selection Method from Gray-Level Histograms
Otsu, N. (1979) · IEEE Transactions on Systems, Man, and Cybernetics · doi:10.1109/tsmc.1979.4310076 · Cited by 43,398
Rapid object detection using a boosted cascade of simple features
Viola, P., & Jones, M. (2005) · Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001 · doi:10.1109/cvpr.2001.990517 · Cited by 18,300
Multiresolution gray-scale and rotation invariant texture classification with local binary patterns
Ojala, T., Pietikainen, M., & Maenpaa, T. (2002) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2002.1017623 · Cited by 15,398
Eigenfaces vs. Fisherfaces: recognition using class specific linear projection
Belhumeur, P. N., Hespanha, J. P., & Kriegman, D. J. (1997) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.598228 · Cited by 11,707
A systematic analysis of performance measures for classification tasks
Sokolova, M., & Lapalme, G. (2009) · Information Processing & Management · doi:10.1016/j.ipm.2009.03.002 · Cited by 7,515
A comparison of methods for multiclass support vector machines
Hsu, C.-W., & Lin, C.-J. (2002) · IEEE Transactions on Neural Networks · doi:10.1109/72.991427 · Cited by 6,838
Cootes, T. F., Edwards, G. J., & Taylor, C. J. (2001) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.927467 · Cited by 5,409
Dynamic Texture Recognition Using Local Binary Patterns with an Application to Facial Expressions
Zhao, G., & Pietikainen, M. (2007) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2007.1110 · Cited by 2,846
Gomarasca, M. A. (2009) · Basics of Geomatics · doi:10.1007/978-1-4020-9014-1_8 · Cited by 2,614
Facial expression recognition based on Local Binary Patterns: A comprehensive study
Shan, C., Gong, S., & McOwan, P. W. (2009) · Image and Vision Computing · doi:10.1016/j.imavis.2008.08.005 · Cited by 2,300
Coding facial expressions with Gabor wavelets
Lyons, M., Akamatsu, S., Kamachi, M., & Gyoba, J. (2002) · Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition · doi:10.1109/afgr.1998.670949 · Cited by 2,210
Affect Detection: An Interdisciplinary Review of Models, Methods, and Their Applications
Calvo, R. A., & D'Mello, S. (2010) · IEEE Transactions on Affective Computing · doi:10.1109/t-affc.2010.1 · Cited by 1,893 · cited 1×
“In addition, an automated learning-free facial landmark detection technique has been proposed, which achieves similar performances as that of other state-of-art landmark detection methods, yet requires significantly less execution time.”
MethodAutomatic classification of single facial images
Lyons, M. J., Budynek, J., & Akamatsu, S. (1999) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.817413 · Cited by 1,075
Eigenfaces vs. Fisherfaces: Recognition using class specific linear projection
Belhumeur, P. N., Hespanha, J. P., & Kriegman, D. J. (1996) · Lecture Notes in Computer Science · doi:10.1007/bfb0015522 · Cited by 978
Robust Face Detection Using the Hausdorff Distance
Jesorsky, O., Kirchberg, K. J., & Frischholz, R. W. (2001) · Lecture Notes in Computer Science · doi:10.1007/3-540-45344-x_14 · Cited by 894
Facial expression recognition from video sequences: temporal and static modeling
Cohen, I., Sebe, N., Garg, A., Chen, L. S., & Huang, T. S. (2003) · Computer Vision and Image Understanding · doi:10.1016/s1077-3142(03)00081-x · Cited by 874
Innate and universal facial expressions: Evidence from developmental and cross-cultural research.
Izard, C. E. (1994) · Psychological Bulletin · doi:10.1037//0033-2909.115.2.288 · Cited by 856
Deformable Model Fitting by Regularized Landmark Mean-Shift
Saragih, J. M., Lucey, S., & Cohn, J. F. (2011) · International Journal of Computer Vision · doi:10.1007/s11263-010-0380-4 · Cited by 787
Feature Detection and Tracking with Constrained Local Models
Cristinacce, D., & Cootes, T. F. (2006) · Procedings of the British Machine Vision Conference 2006 · doi:10.5244/c.20.95 · Cited by 718
Recognizing Facial Expression: Machine Learning and Application to Spontaneous Behavior
Bartlett, M. S., Littlewort, G., Frank, M., Lainscsek, C., Fasel, I., & Movellan, J. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.297 · Cited by 624
Pantic, M., & Patras, I. (2006) · IEEE Transactions on Systems, Man and Cybernetics, Part B (Cybernetics) · doi:10.1109/tsmcb.2005.859075 · Cited by 580
Robust Discriminative Response Map Fitting with Constrained Local Models
Asthana, A., Zafeiriou, S., Cheng, S., & Pantic, M. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.442 · Cited by 557
Face recognition using kernel principal component analysis
Kim, K. I., Jung, K., & Kim, H. J. (2002) · IEEE Signal Processing Letters · doi:10.1109/97.991133 · Cited by 515
A principal component analysis of facial expressions
Calder, A. J., Burton, A. M., Miller, P., Young, A. W., & Akamatsu, S. (2001) · Vision Research · doi:10.1016/s0042-6989(01)00002-5 · Cited by 471
Active and dynamic information fusion for facial expression understanding from image sequences
Zhang, Y., & Ji, Q. (2005) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2005.93 · Cited by 461
Facial Action Recognition for Facial Expression Analysis From Static Face Images
Pantic, M., & Rothkrantz, L. J. M. (2004) · IEEE Transactions on Systems, Man and Cybernetics, Part B (Cybernetics) · doi:10.1109/tsmcb.2004.825931 · Cited by 417
Robust facial expression recognition using local binary patterns
Shan, C., Gong, S., & McOwan, P. W. (2005) · IEEE International Conference on Image Processing 2005 · doi:10.1109/icip.2005.1530069 · Cited by 414
Learning active facial patches for expression analysis
Zhong, L., Liu, Q., Yang, P., Liu, B., Huang, J., & Metaxas, D. N. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6247974 · Cited by 369
Robust Facial Expression Recognition Based on Local Directional Pattern
Jabid, T. (2010) · ETRI Journal · doi:10.4218/etrij.10.1510.0132 · Cited by 356
The painful face – Pain expression recognition using active appearance models
Ashraf, A. B., Lucey, S., Cohn, J. F., Chen, T., Ambadar, Z., Prkachin, K. M., & Solomon, P. E. (2009) · Image and Vision Computing · doi:10.1016/j.imavis.2009.05.007 · Cited by 355
Local binary patterns for multi-view facial expression recognition
Moore, S., & Bowden, R. (2011) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2010.12.001 · Cited by 351
A discriminative feature space for detecting and recognizing faces
Hadid, A., Pietikainen, M., & Ahonen, T. (2004) · Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004. · doi:10.1109/cvpr.2004.1315246 · Cited by 283
Tian, Y., Kanade, T., & Cohn, J. F. (2011) · Handbook of Face Recognition · doi:10.1007/978-0-85729-932-1_19 · Cited by 255
Facial Expression Recognition Using Facial Movement Features
Zhang, L., & Tjondronegoro, D. (2011) · IEEE Transactions on Affective Computing · doi:10.1109/t-affc.2011.13 · Cited by 253
Emotion recognition using PHOG and LPQ features
Dhall, A., Asthana, A., Goecke, R., & Gedeon, T. (2011) · Face and Gesture 2011 · doi:10.1109/fg.2011.5771366 · Cited by 219
Facial Expression Recognition in the Encrypted Domain Based on Local Fisher Discriminant Analysis
Rahulamathavan, Y., Phan, R. C.-W., Chambers, J. A., & Parish, D. J. (2013) · IEEE Transactions on Affective Computing · doi:10.1109/t-affc.2012.33 · Cited by 191
Valstar, M., & Pantić, M. (2007) · Springer eBooks · doi:10.1007/978-3-540-75773-3_13 · Cited by 160
A real time facial expression classification system using Local Binary Patterns
Happy, S. L., George, A., & Routray, A. (2012) · Intelligent Human Computer Interaction · doi:10.1109/ihci.2012.6481802 · Cited by 145
Self-citationFacial expression recognition and synthesis based on an appearance model
Abboud, B., Davoine, F., & Dang, M. (2004) · Signal Processing Image Communication · doi:10.1016/j.image.2004.05.009 · Cited by 136
Chang, Y., Hu, C., & Turk, M. (2004) · IEEE International SOI Conference (SOI) · doi:10.1109/amfg.2003.1240820 · Cited by 127
Automatic facial expression recognition: feature extraction and selection
Lajevardi, S. M., & Hussain, Z. M. (2010) · Signal Image and Video Processing · doi:10.1007/s11760-010-0177-5 · Cited by 114
Image Ratio Features for Facial Expression Recognition Application
Song, M., Tao, D., Liu, Z., Li, X., & Zhou, M. (2009) · IEEE Transactions on Systems Man and Cybernetics Part B (Cybernetics) · doi:10.1109/tsmcb.2009.2029076 · Cited by 107
AAM Derived Face Representations for Robust Facial Action Recognition
Lucey, S., Matthews, I., Hu, C., Ambadar, Z., la Torre, F. D., & Cohn, J. F. (2006) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/fgr.2006.17 · Cited by 106
Learning Discriminative LBP-Histogram Bins for Facial Expression Recognition
Shan, C., & Gritti, T. (2008) · British Machine Vision Conference (BMVC) · doi:10.5244/c.22.27 · Cited by 105
An enhanced independent component-based human facial expression recognition from video
Uddin, M. Z., Lee, J., & Kim, T.-S. (2009) · IEEE Transactions on Consumer Electronics · doi:10.1109/tce.2009.5373791 · Cited by 102
Poursaberi, A., Noubari, H. A., Gavrilova, M. L., & Yanushkevich, S. N. (2012) · EURASIP Journal on Image and Video Processing · doi:10.1186/1687-5281-2012-17 · Cited by 98
Recognizing lower face action units for facial expression analysis
Tian, Y., Takeo Kanade, A., & Cohn, J. F. (2002) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/afgr.2000.840678 · Cited by 94
Real-time face detection and lip feature extraction using field-programmable gate arrays
Nguyen, D. D., Halupka, D., Aarabi, P., & Sheikholeslami, A. (2006) · IEEE Transactions on Systems Man and Cybernetics Part B (Cybernetics) · doi:10.1109/tsmcb.2005.862728 · Cited by 94
Real-time tone mapping on GPU and FPGA
Ureña, R., Martínez‐Cañada, P., Gomez-Lopez, J. M., Morillas, C. A., & Pelayo, F. J. (2012) · EURASIP Journal on Image and Video Processing · doi:10.1186/1687-5281-2012-1 · Cited by 86
Kabir, M. H., Jabid, T., & Chae, O. (2010) · IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS) · doi:10.1109/avss.2010.9 · Cited by 69
In the Pursuit of Effective Affective Computing: The Relationship Between Features and Registration
Chew, S. W., Lucey, P., Lucey, S., Saragih, J., Cohn, J. F., Matthews, I., & Sridharan, S. (2012) · IEEE Transactions on Systems Man and Cybernetics Part B (Cybernetics) · doi:10.1109/tsmcb.2012.2194485 · Cited by 64
Evaluating AAM fitting methods for facial expression recognition
Asthana, A., Saragih, J., Wagner, M., & Goecke, R. (2009) · International Conference on Affective Computing and Intelligent Interaction and workshops · doi:10.1109/acii.2009.5349489 · Cited by 62
A Comprehensive Empirical Study on Linear Subspace Methods for Facial Expression Analysis
Shan, C., Gong, S., & McOwan, P. W. (2006) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2006.13 · Cited by 52
Martin, C., Werner, U., & Groß, H. (2008) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/afgr.2008.4813412 · Cited by 48
Recognizing Facial Expressions Automatically from Video
Shan, C., & Braspenning, R. (2009) · Springer eBooks · doi:10.1007/978-0-387-93808-0_18 · Cited by 31
Automatic Facial Expression Recognition
Whitehill, J., Bartlett, M. S., & Movellan, J. R. (2013) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780195387643.003.0007 · Cited by 31
Kim, D., & Sung, J. (2011) · IGI Global eBooks · doi:10.4018/9781605662169.ch006 · Cited by 20
Discriminative filter based regression learning for facial expression recognition
Zhang, Z., Yan, Y., & Wang, H. (2013) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2013.6738246 · Cited by 9
Facial expression analysis across databases
Zhang, Z., Fang, C., & Ding, X. (2011) · International Conference on Multimedia Technology (ICMT) · doi:10.1109/icmt.2011.6001655 · Cited by 8
Cited by
Region Attention Networks for Pose and Occlusion Robust Facial Expression Recognition
Wang, K., Peng, X., Yang, J., Meng, D., & Qiao, Y. (2020) · IEEE Transactions on Image Processing · doi:10.1109/tip.2019.2956143 · Cited by 940
Detecting Affect States Using VGG16, ResNet50 and SE-ResNet50 Networks
Theckedath, D., & Sedamkar, R. R. (2020) · SN Computer Science · doi:10.1007/s42979-020-0114-9 · Cited by 634
Khare, S. K., Blanes-Vidal, V., Nadimi, E. S., & Acharya, U. R. (2024) · Information Fusion · doi:10.1016/j.inffus.2023.102019 · Cited by 469
Zhao, Z., Liu, Q., & Wang, S. (2021) · IEEE Transactions on Image Processing · doi:10.1109/tip.2021.3093397 · Cited by 375
A Micro-GA Embedded PSO Feature Selection Approach to Intelligent Facial Emotion Recognition
Mistry, K., Zhang, L., Neoh, S. C., Lim, C. P., & Fielding, B. (2017) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2016.2549639 · Cited by 354
Metadata
- Authors
- Happy, S. L., & Routray, A.
- Venue
- IEEE Transactions on Affective Computing
- Published
- 2015-01-01
- Volume
- 6
- Issue
- 1
- Pages
- 1-12
- ISSN
- 1949-3045 (ISSN-L)
- OpenAlex
- W2014185685
- Cited by
- 599
- References
- 60
- FWCI
- 43.02
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.