The DOI matches its Crossref record; 28 of the 28 references it cites were found in a registry or an index.
Facial Action Recognition for Facial Expression Analysis From Static Face Images
Open accessAbstract
Automatic recognition of facial gestures (i.e., facial muscle activity) is rapidly becoming an area of intense interest in the research field of machine vision. In this paper, we present an automated system that we developed to recognize facial gestures in static, frontal- and/or profile-view color face images. A multidetector approach to facial feature localization is utilized to spatially sample the profile contour and the contours of the facial components such as the eyes and the mouth. From the extracted contours of the facial features, we extract ten profile-contour fiducial points and 19 fiducial points of the contours of the facial components. Based on these, 32 individual facial muscle actions (AUs) occurring alone or in combination are recognized using rule-based reasoning. With each scored AU, the utilized algorithm associates a factor denoting the certainty with which the pertinent AU has been scored. A recognition rate of 86% is achieved.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The expression of the emotions in man and animals.
Darwin, C. (1872) · J. Murray eBooks · doi:10.1037/10001-000 · Cited by 11,657
Ekman, P., & Friesen, W. V. (2019) · PsycTESTS Dataset · doi:10.1037/t27734-000 · Cited by 6,019
Watersheds in digital spaces: an efficient algorithm based on immersion simulations
Vincent, L., & Soille, P. (1991) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.87344 · Cited by 5,649
Detecting faces in images: a survey
Yang, M.-H., Kriegman, D. J., & Ahuja, N. (2002) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.982883 · Cited by 3,427
What's basic about basic emotions?
Ortony, A., & Turner, T. J. (1990) · Psychological Review · doi:10.1037/0033-295x.97.3.315 · Cited by 2,015
Automatic analysis of facial expressions: the state of the art
Pantie, M., & Rothkrantz, L. J. M. (2000) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.895976 · Cited by 1,778
Self-citationRecognizing action units for facial expression analysis
Tian, Y.-I., Kanade, T., & Cohn, J. F. (2001) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.908962 · Cited by 1,745
The Expression of the Emotions in Man and Animals
Darwin, C., & Lorenz, K. (1965) · University of Chicago Press eBooks · doi:10.7208/chicago/9780226220802.001.0001 · Cited by 1,271
Donato, G., Bartlett, M. S., Hager, J. C., Ekman, P., & Sejnowski, T. J. (1999) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.799905 · Cited by 999
Coding, analysis, interpretation, and recognition of facial expressions
Essa, I. A., & Pentland, A. P. (1997) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.598232 · Cited by 911
Toward an affect-sensitive multimodal human-computer interaction
Pantic, M., & Rothkrantz, L. J. M. (2003) · Proceedings of the IEEE · doi:10.1109/jproc.2003.817122 · Cited by 791
Self-citationThe Psychology of Facial Expression
Mandler, G. (1997) · Cambridge University Press eBooks · doi:10.1017/cbo9780511659911 · Cited by 655
Handbook of methods in nonverbal behavior research
Scherer, K. R., & Ekman, P. (1982) · Cited by 521
Yang, J., & Waibel, A. (2002) · Proceedings Third IEEE Workshop on Applications of Computer Vision. WACV'96 · doi:10.1109/acv.1996.572043 · Cited by 517
Recognizing Facial Expressions in Image Sequences Using Local Parameterized Models of Image Motion
Black, M. J., & Yacoob, Y. (1997) · International Journal of Computer Vision · doi:10.1023/a:1007977618277 · Cited by 514
Recognition of Facial Expression from Optical Flow
Mase, K. (1991) · IEICE Transactions on Information and Systems · Cited by 481
Measuring facial expressions by computer image analysis
Bartlett, M. S., Hager, J. C., Ekman, P., & Sejnowski, T. J. (1999) · Psychophysiology · doi:10.1017/s0048577299971664 · Cited by 424
Expert system for automatic analysis of facial expressions
Pantic, M., & Rothkrantz, L. J. M. (2000) · Image and Vision Computing · doi:10.1016/s0262-8856(00)00034-2 · Cited by 415
Self-citationLooking at people: sensing for ubiquitous and wearable computing
Pentland, A. (2000) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.824823 · Cited by 403
Automatic watershed segmentation of randomly textured color images
Shafarenko, L., Petrou, M., & Kittler, J. (1997) · IEEE Transactions on Image Processing · doi:10.1109/83.641413 · Cited by 308
A novel method for automatic face segmentation, facial feature extraction and tracking
Sobottka, K., & Pitas, I. (1998) · Signal Processing: Image Communication · doi:10.1016/s0923-5965(97)00042-8 · Cited by 306
Cohn, J. F., Zlochower, A. J., Lien, J., & Kanade, T. (1999) · Psychophysiology · doi:10.1017/s0048577299971184 · Cited by 287
Model-based face tracking for view-independent facial expression recognition
Gokturk, S. B., Bouguet, J.-Y., Tomasi, C., & Girod, B. (2003) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/afgr.2002.1004168 · Cited by 96
Kandel, H., & Schneider, M. (1996) · Medical Entomology and Zoology · Cited by 72
Facial action recognition in face profile image sequences
Pantić, M., Patras, I., & Rothkruntz, L. (2003) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme.2002.1035712 · Cited by 47
Tepandi, J. (1997) · Engineering Applications of Artificial Intelligence · doi:10.1016/s0952-1976(97)89066-5 · Cited by 41
A hybrid approach to mouth features detection
Pantić, M., Tomc, M., & Rothkrantz, L. J. M. (2002) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/icsmc.2001.973081 · Cited by 27
Self-citationImage Feature Location in Multi-Resolution Images Using a Hierarchy of Multilayer Perceptrons
Vincent, J. M., Myers, D. J., & Hutchinson, R. (1992) · Springer eBooks · doi:10.1007/978-94-011-2360-0_3 · Cited by 17
Cited by
A Survey of Affect Recognition Methods: Audio, Visual, and Spontaneous Expressions
Zeng, Z., Pantic, M., Roisman, G. I., & Huang, T. S. (2009) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2008.52 · Cited by 2,797
Facial expression recognition based on Local Binary Patterns: A comprehensive study
Shan, C., Gong, S., & McOwan, P. W. (2009) · Image and Vision Computing · doi:10.1016/j.imavis.2008.08.005 · Cited by 2,300
A 3D Facial Expression Database For Facial Behavior Research
Yin, L., Wei, X., Sun, Y., Wang, J., & Rosato, M. J. (2006) · 7th International Conference on Automatic Face and Gesture Recognition (FGR06) · doi:10.1109/fgr.2006.6 · Cited by 1,171
Web-Based Database for Facial Expression Analysis
Pantic, M., Valstar, M., Rademaker, R., & Maat, L. (2005) · 2005 IEEE International Conference on Multimedia and Expo · doi:10.1109/icme.2005.1521424 · Cited by 1,039
Self-citationRecognizing Facial Expression: Machine Learning and Application to Spontaneous Behavior
Bartlett, M. S., Littlewort, G., Frank, M., Lainscsek, C., Fasel, I., & Movellan, J. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.297 · Cited by 624
Metadata
- Authors
- Pantic, M., & Rothkrantz, L. J. M.
- Venue
- IEEE Transactions on Systems, Man and Cybernetics, Part B (Cybernetics)
- Published
- 2004-06
- Volume
- 34
- Issue
- 3
- Pages
- 1449-1461
- ISSN
- 1083-4419 (ISSN-L)
- OpenAlex
- W2140351517
- Cited by
- 417
- References
- 28
- FWCI
- 14.94
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.