Real time facial expression recognition in video using support vector machines
The DOI matches its Crossref record; 28 of the 28 references it cites were found in a registry or an index.
Abstract
Enabling computer systems to recognize facial expressions and infer emotions from them in real time presents a challenging research topic. In this paper, we present a real time approach to emotion recognition through facial expression in live video. We employ an automatic facial feature tracker to perform face localization and feature extraction. The facial feature displacements in the video stream are used as input to a Support Vector Machine classifier. We evaluate our method in terms of recognition accuracy for a variety of interaction and classification scenarios. Our person-dependent and person-independent experiments demonstrate the effectiveness of a support vector machine and feature tracking approach to fully automatic, unobtrusive expression recognition in live video. We conclude by discussing the relevance of our work to affective and intelligent man-machine interfaces and exploring further improvements.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
LIBSVM: A library for support vector machines
Chang, C.-C., & Lin, C.-J. (2011) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/1961189.1961199 · Cited by 40,918
The Nature of Statistical Learning Theory
Vapnik, V. N. (1995) · doi:10.1007/978-1-4757-2440-0 · Cited by 39,138
Wu, Y. (1999) · Technometrics · doi:10.1080/00401706.1999.10485951 · Cited by 27,221
An Introduction to Support Vector Machines and Other Kernel-based Learning Methods
Cristianini, N., & Shawe-Taylor, J. (2000) · doi:10.1017/cbo9780511801389 · Cited by 13,855
Turk, M., & Pentland, A. (1991) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.1991.3.1.71 · Cited by 13,733
A training algorithm for optimal margin classifiers
Boser, B. E., Guyon, I. M., & Vapnik, V. N. (1992) · Proceedings of the fifth annual workshop on Computational learning theory · doi:10.1145/130385.130401 · Cited by 11,992
The expression of the emotions in man and animals.
Darwin, C. (1872) · J. Murray eBooks · doi:10.1037/10001-000 · Cited by 11,657
Libsvm : A library for support vector machines
Ferrari, V. (2008) · Medical Entomology and Zoology · Cited by 10,123
Text categorization with Support Vector Machines: Learning with many relevant features
Joachims, T. (1998) · Lecture Notes in Computer Science · doi:10.1007/bfb0026683 · Cited by 7,999
(1997) · Choice Reviews Online · doi:10.5860/choice.34-3702 · Cited by 4,887
Ekman, P. (1976) · Medical Entomology and Zoology · Cited by 4,345
Robust real-time object detection.
Viola, P. A. (2001) · IEEE/CVF International Conference on Computer Vision (ICCV) · Cited by 2,900
Comprehensive database for facial expression analysis
Kanade, T., Cohn, J. F., & Tian, Y. (2002) · Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580) · doi:10.1109/afgr.2000.840611 · Cited by 2,591
Training support vector machines: an application to face detection
Osuna, E., Freund, R., & Girosit, F. (2002) · Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.1997.609310 · Cited by 2,486
Distortion invariant object recognition in the dynamic link architecture
Lades, M., Vorbruggen, J. C., Buhmann, J., Lange, J., von der Malsburg, C., Wurtz, R. P., & Konen, W. (1993) · IEEE Transactions on Computers · doi:10.1109/12.210173 · Cited by 1,805
Automatic analysis of facial expressions: the state of the art
Pantie, M., & Rothkrantz, L. J. M. (2000) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.895976 · Cited by 1,778
Recognizing action units for facial expression analysis
Tian, Y.-I., Kanade, T., & Cohn, J. F. (2001) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.908962 · Cited by 1,745
(1972) · Elsevier eBooks · doi:10.1016/c2013-0-02458-9 · Cited by 1,446
Coding, analysis, interpretation, and recognition of facial expressions
Essa, I. A., & Pentland, A. P. (1997) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.598232 · Cited by 911
Mehrabian, A. (2017) · communication theory · doi:10.4324/9781315080918-15 · Cited by 879
Mechrabian, A. (1968) · Medical Entomology and Zoology · Cited by 463
Facial Action Coding System (FACS)
Ekman, P. (2002) · Medical Entomology and Zoology · Cited by 433
Engineering support vector machine kernels that recognize translation initiation sites
Zien, A., Rätsch, G., Mika, S., Schölkopf, B., Lengauer, T., & Müller, K.-R. (2000) · Bioinformatics · doi:10.1093/bioinformatics/16.9.799 · Cited by 420
Model Selection for Support Vector Machines
Chapelle, O., & Vapnik, V. N. (1999) · MPG.PuRe (Max Planck Society) · Cited by 386
Cohn, J. F., Zlochower, A. J., Lien, J., & Kanade, T. (1999) · Psychophysiology · doi:10.1017/s0048577299971184 · Cited by 287
Proceedings of the twenty-second annual conference of the cognitive science society
Gleitman, L. R., & Joshi, A. (2000) · University of Groningen research database (University of Groningen / Centre for Information Technology) · Cited by 213
Feature-point tracking by optical flow discriminates subtle differences in facial expression
Cohn, J. F., Zlochower, A. J., Lien, J. J., & Kanade, T. (2002) · Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition · doi:10.1109/afgr.1998.670981 · Cited by 181
PersonSpotter-fast and robust system for human detection, tracking and recognition
Steffens, J., Elagin, E., & Neven, H. (2002) · Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition · doi:10.1109/afgr.1998.671000 · Cited by 76
Cited by
Kotsia, I., & Pitas, I. (2007) · IEEE Transactions on Image Processing · doi:10.1109/tip.2006.884954 · Cited by 687
Applications of machine learning in animal behaviour studies
Valletta, J. J., Torney, C., Kings, M., Thornton, A., & Madden, J. (2017) · Animal Behaviour · doi:10.1016/j.anbehav.2016.12.005 · Cited by 505
Bailenson, J. N., Yee, N., Merget, D., & Schroeder, R. (2006) · Presence: Teleoperators and Virtual Environments · doi:10.1162/pres.15.4.359 · Cited by 397
Face Expression Recognition and Analysis: The State of the Art
Bettadapura, V. (2012) · arXiv · doi:10.48550/arxiv.1203.6722 · Cited by 336
“When it comes to the ease of recognition, it has been shown that, out of the six prototypic expressions, surprise and happiness are the easiest to recognize [37], [14].”
BackgroundResultReal-Time Inference of Complex Mental States from Facial Expressions and Head Gestures
El Kaliouby, R., & Robinson, P. (2005) · 2004 Conference on Computer Vision and Pattern Recognition Workshop · doi:10.1109/cvpr.2004.427 · Cited by 282
Metadata
- Authors
- Michel, P., & El Kaliouby, R.
- Venue
- Proceedings of the 5th international conference on Multimodal interfaces
- Publisher
- ACM
- Published
- 2003-11-05
- Pages
- 258-264
- OpenAlex
- W2093797275
- Cited by
- 308
- References
- 28
- FWCI
- 13.43
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.