The DOI matches its Crossref record; 43 of the 43 references it cites were found in a registry or an index.
Geometric Feature-Based Facial Expression Recognition in Image Sequences Using Multi-Class AdaBoost and Support Vector Machines
Open accessAbstract
Facial expressions are widely used in the behavioral interpretation of emotions, cognitive science, and social interactions. In this paper, we present a novel method for fully automatic facial expression recognition in facial image sequences. As the facial expression evolves over time facial landmarks are automatically tracked in consecutive video frames, using displacements based on elastic bunch graph matching displacement estimation. Feature vectors from individual landmarks, as well as pairs of landmarks tracking results are extracted, and normalized, with respect to the first frame in the sequence. The prototypical expression sequence for each class of facial expression is formed, by taking the median of the landmark tracking results from the training facial expression sequences. Multi-class AdaBoost with dynamic time warping similarity distance between the feature vector of input facial expression and prototypical facial expression, is used as a weak classifier to select the subset of discriminative feature vectors. Finally, two methods for facial expression recognition are presented, either by using multi-class AdaBoost with dynamic time warping, or by using support vector machine on the boosted feature vectors. The results on the Cohn-Kanade (CK+) facial expression database show a recognition accuracy of 95.17% and 97.35% using multi-class AdaBoost and support vector machines, respectively.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
LIBSVM: A library for support vector machines
Chang, C.-C., & Lin, C.-J. (2011) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/1961189.1961199 · Cited by 40,918
A decision-theoretic generalization of on-line learning and an application to boosting
Freund, Y., & Schapire, R. E. (1997) · Journal of Computer and System Sciences · doi:10.1006/jcss.1997.1504 · Cited by 20,466
Robust Real-Time Face Detection
Viola, P., & Jones, M. J. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000013087.49260.fb · Cited by 14,097
Dynamic Programming Algorithm Optimization for Spoken Word Recognition
Sakoe, H., & Chiba, S. (1978) · IEEE Transactions on Acoustics Speech and Signal Processing · doi:10.1109/tassp.1978.1163055 · Cited by 6,727
A Practical Guide to Support Vector Classication
Hsu, C., Chang, C.-C., & Lin, C. (2008) · Cited by 5,046
Lucey, P., Cohn, J. F., Kanade, T., Saragih, J., Ambadar, Z., & Matthews, I. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops · doi:10.1109/cvprw.2010.5543262 · Cited by 4,303
Face recognition by elastic bunch graph matching
Wiskott, L., Fellous, J.-M., Kuiger, N., & von der Malsburg, C. (1997) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.598235 · Cited by 2,883
Dynamic Texture Recognition Using Local Binary Patterns with an Application to Facial Expressions
Zhao, G., & Pietikainen, M. (2007) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2007.1110 · Cited by 2,846
Facial expression recognition based on Local Binary Patterns: A comprehensive study
Shan, C., Gong, S., & McOwan, P. W. (2009) · Image and Vision Computing · doi:10.1016/j.imavis.2008.08.005 · Cited by 2,300
Coding facial expressions with Gabor wavelets
Lyons, M., Akamatsu, S., Kamachi, M., & Gyoba, J. (2002) · Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition · doi:10.1109/afgr.1998.670949 · Cited by 2,210
Hastie, T., Rosset, S., Zhu, J., & Zou, H. (2009) · Statistics and Its Interface · doi:10.4310/sii.2009.v2.n3.a8 · Cited by 1,875
Automatic facial expression analysis: a survey
Fasel, B., & Luettin, J. (2003) · Pattern Recognition · doi:10.1016/s0031-3203(02)00052-3 · Cited by 1,810
Distortion invariant object recognition in the dynamic link architecture
Lades, M., Vorbruggen, J. C., Buhmann, J., Lange, J., von der Malsburg, C., Wurtz, R. P., & Konen, W. (1993) · IEEE Transactions on Computers · doi:10.1109/12.210173 · Cited by 1,805
Face Recognition by Elastic Bunch Graph Matching*†
Wiskott, L., Fellous, J.-M., Krüger, N., & von der Malsburg, C. (2022) · INTELLIGENT BIOMETRIC TECHNIQUES in FINGERPRINT and FACE RECOGNITION · doi:10.1201/9780203750520-11 · Cited by 1,781
Automatic analysis of facial expressions: the state of the art
Pantie, M., & Rothkrantz, L. J. M. (2000) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.895976 · Cited by 1,778 · cited 1×
“The first survey on the research made regarding facial expression recognition was published in 1992 [4], and has been followed up by several researchers [5,6].”
BackgroundStrong evidence for universals in facial expressions: A reply to Russell's mistaken critique.
Ekman, P. (1994) · Psychological Bulletin · doi:10.1037//0033-2909.115.2.268 · Cited by 1,130
Automatic recognition and analysis of human faces and facial expressions: a survey
Samal, A., & Iyengar, P. A. (1992) · Pattern Recognition · doi:10.1016/0031-3203(92)90007-6 · Cited by 910
Mehrabian, A. (2017) · communication theory · doi:10.4324/9781315080918-15 · Cited by 879
Facial expression recognition from near-infrared videos
Zhao, G., Huang, X., Taini, M., Li, S. Z., & Pietikäinen, M. (2011) · Image and Vision Computing · doi:10.1016/j.imavis.2011.07.002 · Cited by 778
Kotsia, I., & Pitas, I. (2007) · IEEE Transactions on Image Processing · doi:10.1109/tip.2006.884954 · Cited by 687
Zhang, Z., Lyons, M., Schuster, M., & Akamatsu, S. (2002) · Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition · doi:10.1109/afgr.1998.670990 · Cited by 613
Mechrabian, A. (1968) · Medical Entomology and Zoology · Cited by 459
Dynamics of facial expression extracted automatically from video
Littlewort, G., Bartlett, M. S., Fasel, I., Susskind, J., & Movellan, J. (2006) · Image and Vision Computing · doi:10.1016/j.imavis.2005.09.011 · Cited by 358
Robust Facial Expression Recognition Based on Local Directional Pattern
Jabid, T. (2010) · ETRI Journal · doi:10.4218/etrij.10.1510.0132 · Cited by 356
Local binary patterns for multi-view facial expression recognition
Moore, S., & Bowden, R. (2011) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2010.12.001 · Cited by 351
Meta-Analysis of the First Facial Expression Recognition Challenge
Valstar, M. F., Mehu, M., Jiang, B., Pantic, M., & Scherer, K. (2012) · IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics) · doi:10.1109/tsmcb.2012.2200675 · Cited by 297
Zhi, R., Flierl, M., Ruan, Q., & Kleijn, W. B. (2011) · IEEE Transactions on Systems Man and Cybernetics Part B (Cybernetics) · doi:10.1109/tsmcb.2010.2044788 · Cited by 260
Authentic facial expression analysis
Sebe, N., Lew, M. S., Sun, Y., Cohen, I., Gevers, T., & Huang, T. S. (2007) · Image and Vision Computing · doi:10.1016/j.imavis.2005.12.021 · Cited by 257
An analysis of facial expression recognition under partial facial image occlusion
Kotsia, I., Buciu, I., & Pitas, I. (2008) · Image and Vision Computing · doi:10.1016/j.imavis.2007.11.004 · Cited by 221
Emotion recognition using PHOG and LPQ features
Dhall, A., Asthana, A., Goecke, R., & Gedeon, T. (2011) · Face and Gesture 2011 · doi:10.1109/fg.2011.5771366 · Cited by 219
Manifold based analysis of facial expression
Chang, Y., Hu, C., Feris, R., & Turk, M. (2006) · Image and Vision Computing · doi:10.1016/j.imavis.2005.08.006 · Cited by 215
Faster retrieval with a two-pass dynamic-time-warping lower bound
Lemire, D. (2009) · Pattern Recognition · doi:10.1016/j.patcog.2008.11.030 · Cited by 184
Coupled Gaussian processes for pose-invariant facial expression recognition
Rudovic, O., Pantic, M., & Patras, I. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2012.233 · Cited by 159
Recognition of 3D facial expression dynamics
Sandbach, G., Zafeiriou, S. P., Pantić, M., & Rueckert, D. (2012) · Image and Vision Computing · doi:10.1016/j.imavis.2012.01.006 · Cited by 134
Facial Expression Recognition Based on Local Binary Patterns and Kernel Discriminant Isomap
Zhao, X., & Zhang, S. (2011) · Sensors · doi:10.3390/s111009573 · Cited by 111
Facial Expression Classification Using PCA and Hierarchical Radial Basis Function Network
Lin, D.-T. (2006) · doi:10.6688/jise.2006.22.5.3 · Cited by 79
Robust Facial Expression Recognition via Compressive Sensing
Zhang, S., Zhao, X., & Lei, B. (2012) · Sensors · doi:10.3390/s120303747 · Cited by 75
Evaluating AAM fitting methods for facial expression recognition
Asthana, A., Saragih, J., Wagner, M., & Goecke, R. (2009) · International Conference on Affective Computing and Intelligent Interaction and workshops · doi:10.1109/acii.2009.5349489 · Cited by 62
Feature Selection Using Adaboost for Face Expression Recognition
Silapachote, P., Karuppiah, D. R., & Hanson, A. R. (2005) · Defense Technical Information Center (DTIC) · doi:10.21236/ada438800 · Cited by 50
Discriminant Graph Structures for Facial Expression Recognition
Zafeiriou, S. P., & Pitas, I. (2008) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2008.2007292 · Cited by 49
Real-time facial expression recognition using STAAM and layered GDA classifier
Sung, J., & Kim, D. (2008) · Image and Vision Computing · doi:10.1016/j.imavis.2008.11.010 · Cited by 25
Facial expression recognition based orthogonal local fisher discriminant analysis
Wang, Z., & Ruan, Q. (2010) · International Conference on Signal Processing · doi:10.1109/icosp.2010.5656884 · Cited by 19
Huang, X., Zhao, G., Pietikäinen, M., & Zheng, W. (2010) · Lecture notes in computer science · doi:10.1007/978-3-642-17691-3_29 · Cited by 18
Cited by
Joint Fine-Tuning in Deep Neural Networks for Facial Expression Recognition
Jung, H., Lee, S., Yim, J., Park, S., & Kim, J. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.341 · Cited by 781
A Brief Review of Facial Emotion Recognition Based on Visual Information
Ko, B. (2018) · Sensors · doi:10.3390/s18020401 · Cited by 724
A systematic review on affective computing: emotion models, databases, and recent advances
Wang, Y., Song, W., Tao, W., Liotta, A., Yang, D., Li, X., Gao, S., Sun, Y., Ge, W., Zhang, W., et al. (2022) · Information Fusion · doi:10.1016/j.inffus.2022.03.009 · Cited by 615
Gesture recognition for human-robot collaboration: A review
Liu, H., & Wang, L. (2018) · International Journal of Industrial Ergonomics · doi:10.1016/j.ergon.2017.02.004 · Cited by 422
Emotion Recognition for Human-Robot Interaction: Recent Advances and Future Perspectives
Spezialetti, M., Placidi, G., & Rossi, S. (2020) · Frontiers in Robotics and AI · doi:10.3389/frobt.2020.532279 · Cited by 293
Metadata
- Authors
- Ghimire, D., & Lee, J.
- Venue
- Sensors
- Publisher
- MDPI AG
- Published
- 2013-06-14
- Volume
- 13
- Issue
- 6
- Pages
- 7714-7734
- ISSN
- 1424-8220 (ISSN-L)
- OpenAlex
- W1996958556
- Cited by
- 291
- References
- 43
- FWCI
- 13.01
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.