Facial expression recognition based on Local Binary Patterns: A comprehensive study
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Others focused on appearance representations like Gabor filters, optical flow and LBPs or combinations.
“Others focused on appearance representations like Gabor filters [99], optical flow and LBPs [97] or combinations between the two [139].”
From Survey on RGB, 3D, Thermal, and Multimodal Approaches for Facial Expression Recognition: History, Trends, and Affect-Related Applications (2016) · cites this paper as [97]
Cites
Wu, Y., & Vapnik, V. N. (1999) · Technometrics · doi:10.2307/1271368 · Cited by 27,236 · see citing works
A decision-theoretic generalization of on-line learning and an application to boosting
Freund, Y., & Schapire, R. E. (1997) · Journal of Computer and System Sciences · doi:10.1006/jcss.1997.1504 · Cited by 20,466 · see citing works
Rapid object detection using a boosted cascade of simple features
Viola, P., & Jones, M. (2005) · Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001 · doi:10.1109/cvpr.2001.990517 · Cited by 18,300 · see citing works
Multiresolution gray-scale and rotation invariant texture classification with local binary patterns
Ojala, T., Pietikainen, M., & Maenpaa, T. (2002) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2002.1017623 · Cited by 15,398 · see citing works
The expression of the emotions in man and animals.
Darwin, C. D. (1872) · J. Murray eBooks · doi:10.1037/10001-000 · Cited by 12,120 · see citing works
Eigenfaces vs. Fisherfaces: recognition using class specific linear projection
Belhumeur, P. N., Hespanha, J. P., & Kriegman, D. (1997) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.598228 · Cited by 11,776 · see citing works
A comparative study of texture measures with classification based on featured distributions
Ojala, T., Pietikäinen, M., & Harwood, D. (1996) · Pattern Recognition · doi:10.1016/0031-3203(95)00067-4 · Cited by 6,882 · see citing works
Face recognition using eigenfaces
Turk, M., & Pentland, A. (2002) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.1991.139758 · Cited by 5,232 · see citing works
A Practical Guide to Support Vector Classication
Hsu, C., Chang, C.-C., & Lin, C. (2008) · Cited by 5,070 · see citing works
Ekman, P. (1976) · Medical Entomology and Zoology · Cited by 4,345 · see citing works
Dynamic Texture Recognition Using Local Binary Patterns with an Application to Facial Expressions
Zhao, G., & Pietikainen, M. (2007) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2007.1110 · Cited by 2,846 · see citing works
Comprehensive database for facial expression analysis
Takeo Kanade, A., Cohn, J. F., & Tian, Y. (2002) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/afgr.2000.840611 · Cited by 2,612 · see citing works
Improved boosting algorithms using confidence-rated predictions
Schapire, R. E., & Singer, Y. (1998) · Conference on Learning Theory · doi:10.1145/279943.279960 · Cited by 2,549 · see citing works
Face Recognition with Local Binary Patterns
Ahonen, T., Hadid, A., & Pietikäinen, M. (2004) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-24670-1_36 · Cited by 2,462 · see citing works
Improved Boosting Algorithms Using Confidence-rated Predictions
Schapire, R. E., & Singer, Y. (1999) · Machine Learning · doi:10.1023/a:1007614523901 · Cited by 1,964 · see citing works
Face recognition by independent component analysis
Bartlett, M. S., Movellan, J. R., & B, T. J. S. A. (2002) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2002.804287 · Cited by 1,931 · see citing works
Li, S. Z., Jain, A. K., Deng, J., & service), S. (. (2011) · Springer eBooks · doi:10.1007/978-0-85729-932-1 · Cited by 1,849 · see citing works
Automatic facial expression analysis: a survey
Fasel, B., & Luettin, J. (2003) · Pattern Recognition · doi:10.1016/s0031-3203(02)00052-3 · Cited by 1,810 · see citing works
Automatic analysis of facial expressions: the state of the art
Pantie, M., & Rothkrantz, L. J. M. (2000) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.895976 · Cited by 1,778 · cited 1× · see citing works
“Much progress has been made in the last decade, and a thorough survey of the exiting work can be found in [ 1 ,2].”
BackgroundRecognizing action units for facial expression analysis
Tian, Y.-I., Kanade, T., & Cohn, J. F. (2001) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.908962 · Cited by 1,745 · see citing works
Web-Based Database for Facial Expression Analysis
Pantić, M., Valstar, M., Rademaker, R. M., & Maat, L. (2005) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme.2005.1521424 · Cited by 1,099 · see citing works
Automatic classification of single facial images
Lyons, M. J., Budynek, J., & Akamatsu, S. (1999) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.817413 · Cited by 1,075 · see citing works
Donato, G., Bartlett, M. S., Hager, J. C., Ekman, P., & B, T. J. S. A. (1999) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.799905 · Cited by 999 · see citing works
Coding, analysis, interpretation, and recognition of facial expressions
Essa, I. A., & Pentland, A. (1997) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.598232 · Cited by 906 · see citing works
Facial expression recognition from video sequences: temporal and static modeling
Cohen, I., Sebe, N., Garg, A., Chen, L. S., & Huang, T. S. (2003) · Computer Vision and Image Understanding · doi:10.1016/s1077-3142(03)00081-x · Cited by 874 · see citing works
Toward an affect-sensitive multimodal human-computer interaction
Pantic, M., & Rothkrantz, L. J. M. (2003) · Proceedings of the IEEE · doi:10.1109/jproc.2003.817122 · Cited by 791 · see citing works
Li, S. Z., & Jain, A. K. (2005) · Springer eBooks · doi:10.1007/b138828 · Cited by 791 · see citing works
Recognizing Facial Expression: Machine Learning and Application to Spontaneous Behavior
Bartlett, M. S., Littlewort, G. C., Frank, M. G., Lainscsek, C. S. M., Fasel, I., & Movellan, J. R. (2005) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2005.297 · Cited by 632 · see citing works
Zhang, Z., Lyons, M., Schuster, M., & Akamatsu, S. (2002) · Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition · doi:10.1109/afgr.1998.670990 · Cited by 613 · see citing works
Pantic, M., & Patras, I. (2006) · IEEE Transactions on Systems, Man and Cybernetics, Part B (Cybernetics) · doi:10.1109/tsmcb.2005.859075 · Cited by 580 · see citing works
Bartlett, M. S., Littlewort, G. C., Fasel, I., & Movellan, J. R. (2003) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2003.10057 · Cited by 579 · see citing works
Bassili, J. N. (1979) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.37.11.2049 · Cited by 531 · see citing works
Bassili, J. N. (1979) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.37.11.2049 · Cited by 466 · see citing works
Active and dynamic information fusion for facial expression understanding from image sequences
Zhang, Y., & Ji, Q. (2005) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2005.93 · Cited by 460 · see citing works
Recognizing human facial expressions from long image sequences using optical flow
Yacoob, Y., & Davis, L. S. (1996) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.506414 · Cited by 458 · see citing works
Facial Action Recognition for Facial Expression Analysis From Static Face Images
Pantić, M., & Rothkrantz, L. J. M. (2004) · IEEE Transactions on Systems Man and Cybernetics Part B (Cybernetics) · doi:10.1109/tsmcb.2004.825931 · Cited by 419 · see citing works
Robust facial expression recognition using local binary patterns
Shan, C., Gong, S., & McOwan, P. W. (2005) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2005.1530069 · Cited by 418 · see citing works
Self-citationExpert system for automatic analysis of facial expressions
Pantic, M., & Rothkrantz, L. J. M. (2000) · Image and Vision Computing · doi:10.1016/s0262-8856(00)00034-2 · Cited by 415 · see citing works
Dynamics of facial expression extracted automatically from video
Littlewort, G. C., Bartlett, M. S., Fasel, I., Susskind, J. M., & Movellan, J. R. (2006) · Image and Vision Computing · doi:10.1016/j.imavis.2005.09.011 · Cited by 356 · see citing works
Fully Automatic Facial Action Unit Detection and Temporal Analysis
Valstar, M., & Pantić, M. (2006) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2006.85 · Cited by 349 · see citing works
A discriminative feature space for detecting and recognizing faces
Hadid, A., Pietikäinen, M., & Ahonen, T. (2004) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2004.1315246 · Cited by 285 · see citing works
Real-Time Inference of Complex Mental States from Facial Expressions and Head Gestures
El Kaliouby, R., & Robinson, P. (2005) · 2004 Conference on Computer Vision and Pattern Recognition Workshop · doi:10.1109/cvpr.2004.427 · Cited by 282 · see citing works
Boosting Local Binary Pattern (LBP)-Based Face Recognition
Zhang, G., Huang, X., Li, S. Z., Wang, Y., & Wu, X. H. (2004) · Lecture notes in computer science · doi:10.1007/978-3-540-30548-4_21 · Cited by 275 · see citing works
The CSU Face Identification Evaluation System: Its Purpose, Features, and Structure
Bolme, D. S., Beveridge, J. R., Teixeira, M. A., et al. (2003) · Lecture notes in computer science · doi:10.1007/3-540-36592-3_29 · Cited by 262 · see citing works
Evaluation of Face Resolution for Expression Analysis
Tian, Y. (2005) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvpr.2004.334 · Cited by 207 · see citing works
Representing Face Images for Emotion Classification
Padgett, C. W., & Cottrell, G. W. (1996) · neural information processing systems · Cited by 171 · see citing works
Machine learning methods for fully automatic recognition of facial expressions and facial actions
Bartlett, M. S., Littlewort, G. C., Lainscsek, C. S. M., Fasel, I., & Movellan, J. R. (2005) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/icsmc.2004.1398364 · Cited by 168 · see citing works
Valstar, M., Patras, I., & Pantić, M. (2006) · 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops · doi:10.1109/cvpr.2005.457 · Cited by 158 · see citing works
Introduction of New Editor-in-Chief
Chellappa, R. (2004) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2005.13 · Cited by 137 · see citing works
Liao, S., Fan, W., Chung, A. C. S., & Yeung, D. (2006) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2006.312418 · Cited by 135 · see citing works
Real-Time Inference of Complex Mental States from Facial Expressions and Head Gestures
el Kaliouby, R., & Robinson, P. (2005) · Springer eBooks · doi:10.1007/0-387-27890-7_11 · Cited by 134 · see citing works
Probabilistic expression analysis on manifolds
Chang, Y. H., Hu, C., & Turk, M. (2004) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2004.1315208 · Cited by 123 · see citing works
1 Facial Expression Recognition with Local Binary Patterns and Linear Programming1
Feng, X., Pietikäinen, M., & Hadid, A. (2008) · Cited by 103 · see citing works
From facial expression to level of interest: a spatio-temporal approach
Yeasin, M., Bullot, B., & Sharma, R. K. (2004) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2004.1315264 · Cited by 100 · see citing works
Regression and Classification Approaches to Eye Localization in Face Images
Everingham, M., & Zisserman, A. (2006) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/fgr.2006.90 · Cited by 94 · see citing works
Appearance Manifold of Facial Expression
Shan, C., Gong, S., & McOwan, P. W. (2005) · Lecture notes in computer science · doi:10.1007/11573425_22 · Cited by 86 · see citing works
Self-citationGuo, G., & Dyer, C. R. (2003) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2003.1211374 · Cited by 75 · see citing works
Real World Real-time Automatic Recognition of Facial Expressions
Tian, Y., Brown, L. M., Hampapur, A., Pankanti, S., & Senior, A. (2003) · Cited by 60 · see citing works
A Coarse-to-Fine Classification Scheme for Facial Expression Recognition
Feng, X., Hadid, A., & Pietikäinen, M. (2004) · Lecture notes in computer science · doi:10.1007/978-3-540-30126-4_81 · Cited by 56 · see citing works
Conditional Mutual Infomation Based Boosting for Facial Expression Recognition
Shan, C., Gong, S., & McOwan, P. W. (2005) · British Machine Vision Conference (BMVC) · doi:10.5244/c.19.42 · Cited by 54 · see citing works
Self-citationFacial Expression Analysis Using Nonlinear Decomposable Generative Models
Lee, C.-S., & Elgammal, A. (2005) · Lecture notes in computer science · doi:10.1007/11564386_3 · Cited by 45 · see citing works
Simultaneous facial action tracking and expression recognition using a particle filter
Dornaika, F., & Davoine, F. (2005) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2005.225 · Cited by 45 · see citing works
Value directed learning of gestures and facial displays
Hoey, J., & Little, J. J. (2004) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2004.1315277 · Cited by 20 · see citing works
Yin, L., Loi, J., & Xiong, W. (2004) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/1027527.1027580 · Cited by 8 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Suppressing Uncertainties for Large-Scale Facial Expression Recognition
Wang, K., Peng, X., Yang, J., Lu, S., & Qiao, Y. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00693 · Cited by 772 · see citing works
Corneanu, C. A., Simon, M. O., Cohn, J. F., & Guerrero, S. E. (2016) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2515606 · Cited by 527 · see citing works
A review of verbal and non-verbal human–robot interactive communication
Mavridis, N. (2015) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2014.09.031 · Cited by 453 · see citing works
Ringeval, F., Schuller, B., Valstar, M., Cummins, N., Cowie, R., Tavabi, L., Schmitt, M., Alisamir, S., Amiriparian, S., Messner, E.-M., et al. (2019) · Proceedings of the 9th International on Audio/Visual Emotion Challenge and Workshop · doi:10.1145/3347320.3357688 · Cited by 409 · see citing works
Learning Affective Features With a Hybrid Deep Model for Audio–Visual Emotion Recognition
Zhang, S., Zhang, S., Huang, T., Gao, W., & Tian, Q. (2018) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2017.2719043 · Cited by 346 · see citing works
Emotion Recognition in the Wild via Convolutional Neural Networks and Mapped Binary Patterns
Levi, G., & Hassner, T. (2015) · Proceedings of the 2015 ACM on International Conference on Multimodal Interaction · doi:10.1145/2818346.2830587 · Cited by 336 · see citing works
LSTM-Modeling of continuous emotions in an audiovisual affect recognition framework
Wöllmer, M., Kaiser, M., Eyben, F., Schuller, B., & Rigoll, G. (2013) · Image and Vision Computing · doi:10.1016/j.imavis.2012.03.001 · Cited by 288 · see citing works
Do Deep Neural Networks Learn Facial Action Units When Doing Expression Recognition?
Khorrami, P., Paine, T. L., & Huang, T. S. (2015) · 2015 IEEE International Conference on Computer Vision Workshop (ICCVW) · doi:10.1109/iccvw.2015.12 · Cited by 285 · see citing works
Facial Expression Recognition Using Facial Movement Features
Zhang, L., & Tjondronegoro, D. (2011) · IEEE Transactions on Affective Computing · doi:10.1109/t-affc.2011.13 · Cited by 253 · see citing works
Continuous Pain Intensity Estimation from Facial Expressions
Kaltwang, S., Rudovic, O., & Pantic, M. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-33191-6_36 · Cited by 245 · see citing works
AFEW-VA database for valence and arousal estimation in-the-wild
Kossaifi, J., Tzimiropoulos, G., Todorovic, S., & Pantic, M. (2017) · Image and Vision Computing · doi:10.1016/j.imavis.2017.02.001 · Cited by 236 · see citing works
Meng, H., Huang, D., Wang, H., Yang, H., AI-Shuraifi, M., & Wang, Y. (2013) · Proceedings of the 3rd ACM international workshop on Audio/visual emotion challenge · doi:10.1145/2512530.2512532 · Cited by 225 · see citing works
Audio-visual emotion fusion (AVEF): A deep efficient weighted approach
Ma, Y., Hao, Y., Chen, M., Chen, J., Lu, P., & Košir, A. (2019) · Information Fusion · doi:10.1016/j.inffus.2018.06.003 · Cited by 155 · see citing works
Facial Expression Recognition with Identity and Emotion Joint Learning
Li, M., Xu, H., Huang, X., Song, Z., Liu, X., & Li, X. (2021) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2018.2880201 · Cited by 128 · see citing works
Facial expression recognition using Gabor motion energy filters
Wu, T., Bartlett, M. S., & Movellan, J. R. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops · doi:10.1109/cvprw.2010.5543267 · Cited by 126 · see citing works
HoloNet: towards robust emotion recognition in the wild
Yao, A., Cai, D., Hu, P., Wang, S., Sha, L., & Chen, Y. (2016) · Proceedings of the 18th ACM International Conference on Multimodal Interaction · doi:10.1145/2993148.2997639 · Cited by 115 · see citing works
Facial expression recognition via deep learning
Lv, Y., Feng, Z., & Xu, C. (2014) · 2014 International Conference on Smart Computing · doi:10.1109/smartcomp.2014.7043872 · Cited by 122 · see citing works
How deep neural networks can improve emotion recognition on video data
Khorrami, P., Le Paine, T., Brady, K., Dagli, C., & Huang, T. S. (2016) · 2016 IEEE International Conference on Image Processing (ICIP) · doi:10.1109/icip.2016.7532431 · Cited by 107 · see citing works
A Face Recognition Application for People with Visual Impairments: Understanding Use Beyond the Lab
Zhao, Y., Wu, S., Reynolds, L., & Azenkot, S. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3173789 · Cited by 84 · see citing works
Local normal binary patterns for 3D facial action unit detection
Sandbach, G., Zafeiriou, S., & Pantic, M. (2012) · 2012 19th IEEE International Conference on Image Processing · doi:10.1109/icip.2012.6467234 · Cited by 56 · see citing works
Caroppo, A., Leone, A., & Siciliano, P. (2020) · Journal of Computer Science and Technology · doi:10.1007/s11390-020-9665-4 · Cited by 60 · see citing works
Hierarchical fusion of visual and physiological signals for emotion recognition
Fang, Y., Rong, R., & Huang, J. (2021) · Multidimensional Systems and Signal Processing · doi:10.1007/s11045-021-00774-z · Cited by 17 · see citing works
- Authors
- Shan, C., Gong, S., & McOwan, P. W.
- Affiliations
- Philips (Netherlands) (NL)
- Queen Mary University of London (GB)
- Corresponding author
- Shan, Caifeng
- Venue
- Image and Vision Computing
- Publisher
- Elsevier BV
- Published
- 2009-05
- Volume
- 27
- Issue
- 6
- Pages
- 803-816
- ISSN
- 0262-8856 (ISSN-L)
- OpenAlex
- W2145310492
- Cited by
- 2,300
- References
- 64
- Citations by year
- 2026: 58 · 2025: 87 · 2024: 112 · 2023: 145 · 2022: 143 · 2021: 190 · 2020: 160 · 2019: 187 · 2018: 165 · 2017: 182 · 2016: 170 · 2015: 188 · 2014: 172 · 2013: 125 · 2012: 102
- FWCI
- 54.18
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Image and Vision Computing (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Face and Expression Recognition
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Face recognition and analysis
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Emotion and Mood Recognition
- Keywords
- facial expression recognition, local binary pattern, user-independent recognition, support vector machine, low-resolution face images, low-resolution video, face representation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review