The DOI matches its Crossref record; 57 of the 57 references it cites were found in a registry or an index.
Classifying facial actions
Open accessAbstract
The Facial Action Coding System (FACS) [23] is an objective method for quantifying facial movement in terms of component actions. This system is widely used in behavioral investigations of emotion, cognitive processes, and social interaction. The coding is presently performed by highly trained human experts. This paper explores and compares techniques for automatically recognizing facial actions in sequences of images. These techniques include analysis of facial motion through estimation of optical flow; holistic spatial analysis, such as principal component analysis, independent component analysis, local feature analysis, and linear discriminant analysis; and methods based on the outputs of local filters, such as Gabor wavelet representations and local principal components. Performance of these systems is compared to naive and expert human subjects. Best performances were obtained using the Gabor wavelet representation and the independent component representation, both of which achieved 96 percent accuracy for classifying 12 facial actions of the upper and lower face. The results provide converging evidence for the importance of using local filters, high spatial frequencies, and statistical independence for classifying facial actions.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
THE USE OF MULTIPLE MEASUREMENTS IN TAXONOMIC PROBLEMS
FISHER, R. A. (1936) · Annals of Eugenics · doi:10.1111/j.1469-1809.1936.tb02137.x · Cited by 15,227
Turk, M., & Pentland, A. (1991) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.1991.3.1.71 · Cited by 13,733
Eigenfaces vs. Fisherfaces: recognition using class specific linear projection
Belhumeur, P. N., Hespanha, J. P., & Kriegman, D. J. (1997) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.598228 · Cited by 11,707
An Information-Maximization Approach to Blind Separation and Blind Deconvolution
Bell, A. J., & Sejnowski, T. J. (1995) · Neural Computation · doi:10.1162/neco.1995.7.6.1129 · Cited by 8,986
Independent component analysis, A new concept?
Comon, P. (1994) · Signal Processing · doi:10.1016/0165-1684(94)90029-9 · Cited by 8,205
Face recognition: features versus templates
Brunelli, R., & Poggio, T. (1993) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.254061 · Cited by 2,436
The FERET database and evaluation procedure for face-recognition algorithms
Phillips, P. J., Wechsler, H., Huang, J., & Rauss, P. J. (1998) · Image and Vision Computing · doi:10.1016/s0262-8856(97)00070-x · Cited by 2,431
The “independent components” of natural scenes are edge filters
Bell, A. J., & Sejnowski, T. J. (1997) · Vision Research · doi:10.1016/s0042-6989(97)00121-1 · Cited by 2,201
Self-citationEkman, P., & Rosenberg, E. L. (2005) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780195179644.001.0001 · Cited by 1,941
Self-citationComplete discrete 2-D Gabor transforms by neural networks for image analysis and compression
Daugman, J. G. (1988) · IEEE Transactions on Acoustics, Speech, and Signal Processing · doi:10.1109/29.1644 · Cited by 1,810
Distortion invariant object recognition in the dynamic link architecture
Lades, M., Vorbruggen, J. C., Buhmann, J., Lange, J., von der Malsburg, C., Wurtz, R. P., & Konen, W. (1993) · IEEE Transactions on Computers · doi:10.1109/12.210173 · Cited by 1,805
Telling Lies: Clues to Deceit in the Marketplace, Politics, and Marriage
Ekman, P. (1985) · Cited by 1,716
Self-citationJones, J. P., & Palmer, L. A. (1987) · Journal of Neurophysiology · doi:10.1152/jn.1987.58.6.1233 · Cited by 1,658
A specific neural substrate for perceiving facial expressions of disgust
Phillips, M. L., Young, A. W., Senior, C., Brammer, M., Andrew, C., Calder, A. J., Bullmore, E. T., Perrett, D. I., Rowland, D., Williams, S. C. R., et al. (1997) · Nature · doi:10.1038/39051 · Cited by 1,609
(1978) · Computer Graphics and Image Processing · doi:10.1016/s0146-664x(78)80023-9 · Cited by 1,306
What Is the Goal of Sensory Coding?
Field, D. J. (1994) · Neural Computation · doi:10.1162/neco.1994.6.4.559 · Cited by 1,183
Coding, analysis, interpretation, and recognition of facial expressions
Essa, I. A., & Pentland, A. P. (1997) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.598232 · Cited by 911
What Does the Retina Know about Natural Scenes?
Atick, J. J., & Redlich, A. N. (1992) · Neural Computation · doi:10.1162/neco.1992.4.2.196 · Cited by 705
Bassili, J. N. (1979) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.37.11.2049 · Cited by 653
Local feature analysis: a general statistical theory for object representation
Penev, P. S., & Atick, J. J. (1996) · Network Computation in Neural Systems · doi:10.1088/0954-898x/7/3/002 · Cited by 627
Automatic interpretation and coding of face images using flexible models
Lanitis, A., Taylor, C. J., & Cootes, T. F. (1997) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.598231 · Cited by 625
Ekman, P., Friesen, W. V., & O'Sullivan, M. (1988) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.54.3.414 · Cited by 624
Self-citationAnalysis and synthesis of facial image sequences using physical and anatomical models
Terzopoulos, D., & Waters, K. (1993) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.216726 · Cited by 538
SEXNET: A Neural Network Identifies Sex From Human Faces
Golomb, B. A., Lawrence, D. T., & Sejnowski, T. J. (1990) · neural information processing systems · Cited by 483
Self-citationRecognition of Facial Expression from Optical Flow
Mase, K. (1991) · IEICE Transactions on Information and Systems · Cited by 481
Recognizing human facial expressions from long image sequences using optical flow
Yacoob, Y., & Davis, L. S. (1996) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.506414 · Cited by 458
Szajnberg, N. M. (2022) · Journal of the American Psychoanalytic Association · doi:10.1177/00030651221107681 · Cited by 425
Measuring facial expressions by computer image analysis
Bartlett, M. S., Hager, J. C., Ekman, P., & Sejnowski, T. J. (1999) · Psychophysiology · doi:10.1017/s0048577299971664 · Cited by 424
Self-citationLinear object classes and image synthesis from a single example image
Vetter, T., & Poggio, T. (1997) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.598230 · Cited by 409
Pace recognition: eigenface, elastic matching, and neural nets
Zhang, J., Yan, Y., & Lades, M. (1997) · Proceedings of the IEEE · doi:10.1109/5.628712 · Cited by 382
Phase Relationships Between Adjacent Simple Cells in the Visual Cortex
Pollen, D. A., & Ronner, S. F. (1981) · Science · doi:10.1126/science.7233231 · Cited by 361
3-D motion estimation in model-based facial image coding
Li, H., Roivainen, P., & Forchheimer, R. (1993) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.216724 · Cited by 335
Independent component representations for face recognition:
Stewart Bartlett, M., Lades, M. H., & Sejnowski, T. J. (1998) · SPIE Proceedings · doi:10.1117/12.320144 · Cited by 316
Self-citationCohn, J. F., Zlochower, A. J., Lien, J., & Kanade, T. (1999) · Psychophysiology · doi:10.1017/s0048577299971184 · Cited by 287
Human expression recognition from motion using a radial basis function network architecture
Rosenblum, M., Yacoob, Y., & Davis, L. S. (1996) · IEEE Transactions on Neural Networks · doi:10.1109/72.536309 · Cited by 284
Nonlinear neurons in the low-noise limit: a factorial code maximizes information transfer
Nadal, J., & Parga, N. (1994) · Network Computation in Neural Systems · doi:10.1088/0954-898x/5/4/008 · Cited by 282
Image Representations for Visual Learning
Beymer, D., & Poggio, T. (1996) · Science · doi:10.1126/science.272.5270.1905 · Cited by 271
Statistical models for images: compression, restoration and synthesis
Simoncelli, E. P. (2002) · Conference Record of the Thirty-First Asilomar Conference on Signals, Systems and Computers (Cat. No.97CB36136) · doi:10.1109/acssc.1997.680530 · Cited by 270
EMPATH: Face, Emotion, and Gender Recognition Using Holons
Cottrell, G. W., & Metcalfe, J. (1990) · neural information processing systems · Cited by 231
Emotional expression in upside‐down faces: Evidence for configurational and componential processing
McKelvie, S. J. (1995) · British Journal of Social Psychology · doi:10.1111/j.2044-8309.1995.tb01067.x · Cited by 198
Geometry and Photometry in 3D Visual Recognition
Shashua, A. (1992) · doi:10.21236/ada259443 · Cited by 194
Example Based Image Analysis and Synthesis
Beymer, D., Shashua, A., & Poggio, T. (1993) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 184
Genuine, suppressed and faked facial behavior during exacerbation of chronic low back pain
Craig, K. D., Hyde, S. A., & Patrick, C. J. (1991) · Pain · doi:10.1016/0304-3959(91)90071-5 · Cited by 183
Representing Face Images for Emotion Classification
Padgett, C. W., & Cottrell, G. W. (1996) · neural information processing systems · Cited by 171
Visual Speech Recognition with Stochastic Networks
Movellan, J. R. (1994) · Cited by 147
ZHANG, Z. (1999) · International Journal of Pattern Recognition and Artificial Intelligence · doi:10.1142/s0218001499000495 · Cited by 146
Nonlinear Model of Neural Responses in Cat Visual Cortex
Heeger, D. J. (1991) · The MIT Press eBooks · doi:10.7551/mitpress/2002.003.0014 · Cited by 130
What is the Goal of Sensory Coding?
Field, D. J. (1999) · The MIT Press eBooks · doi:10.7551/mitpress/7011.003.0008 · Cited by 130
Face image analysis by unsupervised learning and redundancy reduction
Bartlett, M. S., & MacLeod, D. I. A. (1998) · Cited by 103
Self-citationSubtly different facial expression recognition and expression intensity estimation
Lien, J. J.-J., Takeo Kanade, A., Cohn, J. F., & Li, C.-C. (2002) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.1998.698704 · Cited by 100
Bartlett, M. S., Viola, P. A., B, T. J. S. A., Golomb, B. A., Larsen, J. O., Hager, J. C., & Ekman, P. (1995) · Cited by 97
Self-citationViewpoint Invariant Face Recognition using Independent Component Analysis and Attractor Networks
Bartlett, M. S., & B, T. J. S. A. (1996) · Cited by 85
Self-citationSeparation of texture and shape in images of faces for image coding and synthesis
Vetter, T. R., & Troje, N. F. (1997) · Journal of the Optical Society of America A · doi:10.1364/josaa.14.002152 · Cited by 63
Automated coding of facial behavior in human-computer interactions with facs
Kaiser, S., & Wehrle, T. (1992) · Journal of Nonverbal Behavior · doi:10.1007/bf00990323 · Cited by 45
Inferring sparse, overcomplete image codes using an efficient coding framework
Lewicki, M. S., & Olshausen, B. A. (1998) · neural information processing systems · Cited by 42
Effects of distortion of spatial and temporal resolution of video stimuli on emotion attributions
Wallbott, H. G. (1992) · Journal of Nonverbal Behavior · doi:10.1007/bf00986876 · Cited by 36
Lien, J. J.-J., Cohn, J. F., & Takeo Kanade, A. (1998) · Cited by 20
Cited by
Face recognition: A literature survey
Zhao, W., Chellappa, R., Phillips, P. J., & Rosenfeld, A. (2003) · ACM Computing Surveys · doi:10.1145/954339.954342 · Cited by 6,163
Detecting faces in images: a survey
Yang, M.-H., Kriegman, D. J., & Ahuja, N. (2002) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.982883 · Cited by 3,427
Toward machine emotional intelligence: analysis of affective physiological state
Picard, R. W., Vyzas, E., & Healey, J. (2001) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.954607 · Cited by 2,334
“Recognizers have already been built for a handful of the facial actions [17], [18], [19], [ 20 ], and the automated recognizers have been shown to perform comparably to humans trained in recognizing facial actions [18].”
BackgroundFacial expression recognition based on Local Binary Patterns: A comprehensive study
Shan, C., Gong, S., & McOwan, P. W. (2009) · Image and Vision Computing · doi:10.1016/j.imavis.2008.08.005 · Cited by 2,300
Coding facial expressions with Gabor wavelets
Lyons, M., Akamatsu, S., Kamachi, M., & Gyoba, J. (2002) · Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition · doi:10.1109/afgr.1998.670949 · Cited by 2,210
Metadata
- Authors
- Donato, G., Bartlett, M. S., Hager, J. C., Ekman, P., & Sejnowski, T. J.
- Venue
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- Published
- 1999
- Volume
- 21
- Issue
- 10
- Pages
- 974-989
- ISSN
- 0162-8828 (ISSN-L)
- OpenAlex
- W2133180260
- Cited by
- 999
- References
- 57
- FWCI
- 31.23
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.