Local feature extraction based facial emotion recognition: a survey
Open accessThe DOI matches its Crossref record; 64 of the 66 references it cites were found in a registry or an index; none of the 13 sources its claims cite is checked for support yet.
Abstract
Notwithstanding the recent technological advancement, the identification of facial and emotional expressions is still one of the greatest challenges scientists have ever faced. Generally, the human face is identified as a composition made up of textures arranged in micro-patterns. Currently, there has been a tremendous increase in the use of local binary pattern based texture algorithms which have invariably been identified to being essential in the completion of a variety of tasks and in the extraction of essential attributes from an image. Over the years, lots of LBP variants have been literally reviewed. However, what is left is a thorough and comprehensive analysis of their independent performance. This research work aims at filling this gap by performing a large-scale performance evaluation of 46 recent state-of-the-art LBP variants for facial expression recognition. Extensive experimental results on the well-known challenging and benchmark KDEF, JAFFE, CK and MUG databases taken under different facial expression conditions, indicate that a number of evaluated state-of-the-art LBP-like methods achieve promising results, which are better or competitive than several recent state-of-the-art facial recognition systems. Recognition rates of 100%, 98.57%, 95.92% and 100% have been reached for CK, JAFFE, KDEF and MUG databases, respectively.
Overview
CoChat Summary
## TL;DR
This is a survey and experimental comparison of 46 recent local binary pattern (LBP)-like texture descriptors for facial emotion recognition. Across four benchmark datasets, several graph-based LBP variants performed very strongly, with reported recognition rates of 100% on CK and MUG, 98.57% on JAFFE, and 95.92% on KDEF for the best methods.
## Key findings
- The paper evaluates 46 state-of-the-art LBP variants on four facial expression datasets: CK, JAFFE, KDEF, and MUG.
- On CK, 27 LBP-methods (including RALBGC, BGC1, BGC2, BGC3, dLBPα, ELGS) achieved 100% average accuracy; all evaluated descriptors reached 100% for Happy and Surprise.
- On JAFFE, the best results were 98.57% from DSLGS, ELGS, and SLGS; on the class sadness, accuracies dropped to 50%–90% for the tested descriptors.
- On KDEF, LGS was best at 95.92%; on MUG, 8 descriptors (ELGS, LDTP, LDENP, LGCP, LNDP, LTP, LQPAT, SMEPOP) reached 100%, while LBP reached 98.73%, DBC 98.05%, XCS LBP 97.40%, and GTUC 97.08%.
## Methods
- The study uses a supervised image classification pipeline: face preprocessing/resizing, feature extraction with LBP variants, region-wise histogram formation over non-overlapping sub-regions, and SVM classification.
- Datasets and splits stated in the paper: CK subset of 10 sequences, with the four latest frames used and 2 training / 2 test images per emotion; JAFFE with 213 images; KDEF with 70 subjects, 980 images at 256×256; and MUG with 924 images at 256×256.
- The paper reports average per-class accuracies for the 7-expression problem and compares the best-performing descriptor on each dataset against recent state-of-the-art methods.
## Limitations
- The authors state that comparisons with other state-of-the-art methods are not directly comparable because of differences in dataset partitioning, number of classes, number of subjects, and features used.
- The paper notes that it used the half-half configuration on its own evaluation, while many existing systems use settings with more training than test images; this makes the comparison more difficult (stated in the paper).
- Evident from the text: the study is a survey/comparative experiment on handcrafted LBP-like features only, so it does not evaluate deep features or deep classifiers; the authors explicitly list these as future work.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
0 Valid · 0 Not valid · 7 Not checked · 39 Own results and interpretations
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Then, come the eight descriptors: BGC2, CSLBP, dLBPα, ILBP, LCCMSP, LDENP, LGCP and OS LTP which reached a recognition rate of 97.14%.”
§ Local feature extraction based facial emotion recognition: A survey > 4.3.2. Performance analysis on JAFFE Database
plainn = 70- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“We would also point out that although parametric methods like eCS LTP, ILTP, GTUC, AELTP are regarded as”
§ Local feature extraction based facial emotion recognition: A survey > 4.3.2. Performance analysis on JAFFE Database
hedgedstates an associationn = 70- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Then, come seven descriptors like BGC2, BGC3, CSLBP, dLBPα, ELGS, ILBP and LQPAT which allowed to achieve accuracies between [94.08% -94.90%].”
§ Local feature extraction based facial emotion recognition: A survey > 4.3.3. Performance analysis on KDEF database
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Recognition rates of 100%, 98.57%, 95.92% and 100% have been reached for CK, JAFFE, KDEF and MUG databases, respectively.”
§ Local feature extraction based facial emotion recognition: A survey > Abstract
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“that almost all the tested descriptors produce good results on CK dataset where their average accuracy is above 96%.”
§ Local feature extraction based facial emotion recognition: A survey > 4.3.1. Performance analysis on Cohn-Kanade (CK) Database
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
24 more claims
Create a free account to see all 46 claims and every source verdict.
- It may state two separate claims as one. 15
- The quote only partly states this claim. 1
- Probably not a substantial claim. 3
Citations
Cites
Multiresolution gray-scale and rotation invariant texture classification with local binary patterns
Ojala, T., Pietikainen, M., & Maenpaa, T. (2002) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2002.1017623 · Cited by 15,398 · cited 6×
“Although initially intended for texture analysis [4], the LBP descriptor has given excellent outcomes in different applications because of its invariance to monotonic global graylevel changes, furthermore, its better resistance against brightening changes property in real-world”
BackgroundMethodInfluentialEnhanced Local Texture Feature Sets for Face Recognition Under Difficult Lighting Conditions
Tan, X., & Triggs, B. (2010) · IEEE Transactions on Image Processing · doi:10.1109/tip.2010.2042645 · Cited by 2,842
Comprehensive database for facial expression analysis
Kanade, T., Cohn, J. F., & Tian, Y. (2002) · Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580) · doi:10.1109/afgr.2000.840611 · Cited by 2,591 · cited 1×
“(b) The CK database [51] includes 2105 digitized image sequences (video) from 182 adults ranging from 18 to 30 years old.”
Coding facial expressions with Gabor wavelets
Lyons, M., Akamatsu, S., Kamachi, M., & Gyoba, J. (2002) · Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition · doi:10.1109/afgr.1998.670949 · Cited by 2,210 · cited 1×
“(a) The JAFFE database [50] contains 213 facial expression images from 10 Japanese females where every subject expresses three times the seven facial expressions.”
BackgroundLocal Binary Patterns and Its Application to Facial Image Analysis: A Survey
Huang, D., Shan, C., Ardabilian, M., Wang, Y., & Chen, L. (2011) · IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews) · doi:10.1109/tsmcc.2011.2118750 · Cited by 905 · cited 1×
“(c) Huang et al. [44] displayed a survey of LBP variants in the application region of facial image processing.”
BackgroundLocal Directional Number Pattern for Face Analysis: Face and Expression Recognition
Ramirez Rivera, A., Rojas Castillo, J., & Oksam Chae, O. (2013) · IEEE Transactions on Image Processing · doi:10.1109/tip.2012.2235848 · Cited by 512 · cited 1×
“[4] 2002 Local Binary Pattern LBP Texture classification [9] 2003 Simplified Texture Unit + STU+ Texture classification [10] 2004 Gradient texture unit coding GTUC Texture classification [11] 2005 Difference Symmetric Local Graph Structure DSLGS Finger vein recognition [8] 2006 Center-Symmetric Local Binary Patterns C…”
Facial expressions of emotion (KDEF): Identification under different display-duration conditions
Calvo, M. G., & Lundqvist, D. (2008) · Behavior Research Methods · doi:10.3758/brm.40.1.109 · Cited by 487 · cited 1×
“(c) The KDEF dataset [52] contains two sessions of multi-view posed facial expression images from 70 amateur actors, with age ranging from 20 to 30 years old.”
BackgroundThe MUG facial expression database
Aifanti, N., Papachristou, C., & Delopoulos, A. N. (2010) · International Workshop on Image Analysis for Multimedia Interactive Services (WIAMIS) · Cited by 424
Local binary features for texture classification: Taxonomy and experimental study
Liu, L., Fieguth, P., Guo, Y., Wang, X., & Pietikäinen, M. (2017) · Pattern Recognition · doi:10.1016/j.patcog.2016.08.032 · Cited by 369 · cited 1×
“[48] provided a systematic review of LBP variants while regrouping them into different categories.”
BackgroundDescription of Interest Regions with Center-Symmetric Local Binary Patterns
Heikkilä, M., Pietikäinen, M., & Schmid, C. (2006) · Lecture Notes in Computer Science · doi:10.1007/11949619_6 · Cited by 348
Research works printed but not linked: 6
- [3]3. S. Bourekkadi, S. Khoulji et al., "The design of a psychotherapy remote intelligent system," Journal of Theoretical and Applied Information Technology, vol. 93, no. 1, p. 116, 2016.
- [22]22. M. Islam, "Local gray code pattern (lgcp): A robust feature descriptor for facial expression recognition," International Journal of Science and Research (IJSR), India Online ISSN, pp. 2319-7064, 2013.
- [30]30. S. Rajput and J. Bharti, "A face recognition using linear-diagonal binary graph pattern feature extraction Int J Elec & Comp Eng, Vol. 10, No. 4, August 2020 : 4080 -4092 Int J Elec & Comp Eng ISSN: 2088-8708 Ì 4091
- [31]31. method," International Journal in Foundations of Computer Science & Technology, vol. 6, no. 2, 2016.
- [56]56. pressions," in Proceedings of the Tenth Indian Conference on Computer Vision, Graphics and Image Processing. ACM, 2016, p. 25.
- [58]58. S. A. Shah, G. Ali et al., "Cross-cultural emotion analysis a clustering approach," International Journal of Computer Science and Network Security, vol. 17, no. 8, pp. 35-41, 2017.
Cited by
Kaklauskas, A., Abraham, A., Ubartė, I., Klıukas, R., Luksaite, V., Binkytė-Vėlienė, A., Vetloviene, I., & Kaklauskiene, L. (2022) · Sensors · doi:10.3390/s22207824 · Cited by 90
Ensemble-based face expression recognition approach for image sentiment analysis
Moung, E. G., Wooi, C. C., Sufian, M. M., On, C. K., & Dargham, J. A. (2022) · International Journal of Power Electronics and Drive Systems/International Journal of Electrical and Computer Engineering · doi:10.11591/ijece.v12i3.pp2588-2600 · Cited by 37
Gender recognition from unconstrained selfie images: a convolutional neural network approach
Bekhet, S., Alghamdi, A. M., & Taj-Eddin, I. (2022) · International Journal of Power Electronics and Drive Systems/International Journal of Electrical and Computer Engineering · doi:10.11591/ijece.v12i2.pp2066-2078 · Cited by 20
Brain stroke computed tomography images analysis using image processing: A Review
Ali, N. H., Abdullah, A. R., Saad, N. M., Muda, A. S., Sutikno, T., & Jopri, M. H. (2021) · IAES International Journal of Artificial Intelligence · doi:10.11591/ijai.v10.i4.pp1048-1059 · Cited by 23
Facial expression recognition of masked faces using deep learning
Hdioud, B., & Tirari, M. E. H. (2022) · IAES International Journal of Artificial Intelligence · doi:10.11591/ijai.v12.i2.pp921-930 · Cited by 14
Metadata
- Authors
- Slimani, K., Kas, M., El Merabet, Y., Ruichek, Y., & Messoussi, R.
- Affiliations
- Université Ibn-Tofail (MA)
- Université Bourgogne Franche-Comté (FR)
- Venue
- International Journal of Electrical and Computer Engineering (IJECE)
- Published
- 2020-08-01
- Volume
- 10
- Issue
- 4
- Pages
- 4080
- ISSN
- 2722-256X (ISSN-L)
- 2722-2578
- 2088-8708
- OpenAlex
- W3016519690
- Cited by
- 15
- References
- 66
- Citations by year
- 2026: 1 · 2025: 1 · 2024: 3 · 2022: 7 · 2021: 2 · 2020: 1
- FWCI
- 0.97
- Type
- journal article
- Language
- en
- Open access
- diamond
- doi.org
- Licence
- Locations
- International Journal of Power Electronics and Drive Systems/International Journal of Electrical and Computer Engineering (publishedVersion, cc-by-sa)
- Zenodo (CERN European Organization for Nuclear Research) (submittedVersion, cc-by)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Face and Expression Recognition
- Physical Sciences › Computer Science › Artificial Intelligence › Emotion and Mood Recognition
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Face recognition and analysis
- Keywords
- facial emotion recognition, local binary pattern, texture features, local feature extraction, facial expression recognition, JAFFE database, CK+ database
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-10-06, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-06 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Local feature extraction based facial emotion recognition: a survey. https://app.cochat.ai/papers/10.11591/ijece.v10i4.pp4080-4092
- The paper
- Slimani, K., Kas, M., El Merabet, Y., Ruichek, Y., & Messoussi, R. (2020). Local feature extraction based facial emotion recognition: a survey. International Journal of Electrical and Computer Engineering (IJECE). https://doi.org/10.11591/ijece.v10i4.pp4080-4092
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
