The DOI matches its Crossref record; 34 of the 34 references it cites were found in a registry or an index.
Coding, analysis, interpretation, and recognition of facial expressions
Abstract
We describe a computer vision system for observing facial motion by using an optimal estimation optical flow method coupled with geometric, physical and motion-based dynamic models describing the facial structure. Our method produces a reliable parametric representation of the face's independent muscle action groups, as well as an accurate estimate of facial motion. Previous efforts at analysis of facial expression have been based on the facial action coding system (FACS), a representation developed in order to allow human psychologists to code expression from static pictures. To avoid use of this heuristic coding scheme, we have used our computer vision system to probabilistically characterize facial motion and muscle activation in an experimental population, thus deriving a new, more accurate, representation of human facial expressions that we call FACS+. Finally, we show how this method can be used for coding, analysis, interpretation, and recognition of facial expressions.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The expression of the emotions in man and animals.
Darwin, C. (1872) · J. Murray eBooks · doi:10.1037/10001-000 · Cited by 11,657
Bathe, K. (1995) · CERN Document Server (European Organization for Nuclear Research) · Cited by 10,651
Ekman, P., & Friesen, W. V. (2019) · PsycTESTS Dataset · doi:10.1037/t27734-000 · Cited by 6,019
Finite Element Procedures in Engineering Analysis
Bathe, K. J., & Saunders, H. (1984) · Journal of Pressure Vessel Technology · doi:10.1115/1.3264375 · Cited by 5,223
(2012) · Encyclopedia of the Sciences of Learning · doi:10.1007/978-1-4419-1428-6_5794 · Cited by 2,562
View-based and modular eigenspaces for face recognition
Pentland, Moghaddam, & Starner (1994) · Proceedings of IEEE Conference on Computer Vision and Pattern Recognition CVPR-94 · doi:10.1109/cvpr.1994.323814 · Cited by 1,800
Mechanical Design in Organisms
Wainwright, S. A., Biggs, W. D., Currey, J. D., & Gosline, J. M. (2020) · Princeton University Press eBooks · doi:10.2307/j.ctv143mdjg · Cited by 1,263
Control System Design: An Introduction to State-Space Methods
Friedland, B., & Stephen, W. (1987) · Cited by 957
Mechanical Design in Organisms
Cromroy, H. L., Wainwright, S. A., Biggs, W. D., Currey, J. D., & Gosline, J. M. (1976) · The Florida Entomologist · doi:10.2307/3494271 · Cited by 899
Bassili, J. N. (1979) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.37.11.2049 · Cited by 653
Introduction to random signal analysis and Kalman filtering
Brown, R. G. (1983) · Medical Entomology and Zoology · Cited by 634
Analysis and synthesis of facial image sequences using physical and anatomical models
Terzopoulos, D., & Waters, K. (1993) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.216726 · Cited by 538
BRUNER, J. S., & TAGIURI, R. (1954) · doi:10.21236/ad0024982 · Cited by 538
Closed-form solutions for physically based shape modeling and recognition
Pentland, A., & Sclaroff, S. (1991) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.85660 · Cited by 466
Self-citationBlack, M. J., & Yacoob, Y. (2002) · Proceedings of IEEE International Conference on Computer Vision · doi:10.1109/iccv.1995.466915 · Cited by 457
Shape and nonrigid motion estimation through physics-based synthesis
Metaxas, D., & Terzopoulos, D. (1993) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.216727 · Cited by 408
Platt, S. M., & Badler, N. I. (1981) · Proceedings of the 8th annual conference on Computer graphics and interactive techniques - SIGGRAPH '81 · doi:10.1145/800224.806812 · Cited by 404
Facial expressions and the regulation of emotions.
Izard, C. E. (1990) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.58.3.487 · Cited by 370
Facial motion in the perception of faces and of emotional expression.
Bassili, J. N. (1978) · Journal of Experimental Psychology: Human Perception and Performance · doi:10.1037/0096-1523.4.3.373 · Cited by 369
3-D motion estimation in model-based facial image coding
Li, H., Roivainen, P., & Forchheimer, R. (1993) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.216724 · Cited by 335
The argument and evidence about universals in facial expressions of emotion.
Ekman, P. (1989) · Cited by 312
Platt, S. M., & Badler, N. I. (1981) · ACM SIGGRAPH Computer Graphics · doi:10.1145/965161.806812 · Cited by 279
Layered representation for motion analysis
Wang, J. Y. A., & Adelson, E. H. (2002) · Proceedings of IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.1993.341105 · Cited by 273
Facial expression recognition using a dynamic model and motion energy
Essa, I. A., & Pentland, A. P. (2002) · Proceedings of IEEE International Conference on Computer Vision · doi:10.1109/iccv.1995.466916 · Cited by 251
Self-citationAutomatic lipreading by optical‐flow analysis
Mase, K., & Pentland, A. (1991) · Systems and Computers in Japan · doi:10.1002/scj.4690220607 · Cited by 165
Self-citationComputing Spatio-Temporal Representations of Human Faces
Yacoob, Y., & Davis, L. S. (1994) · Cited by 156
Computing spatio-temporal representations of human faces
Yacoob, & Davis (1994) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.1994.323812 · Cited by 143
Modeling, tracking and interactive animation of faces and heads//using input from video
Essa, I. A., Basu, S., Darrell, T., & Pentland, A. (2002) · Computer Animation (CA) · doi:10.1109/ca.1996.540489 · Cited by 134
Self-citationDistributed representation and analysis of visual motion
Simoncelli, E. P. (1993) · Cited by 131
Human emotion recognition from motion using a radial basis function network architecture
Rosenblum, M., Yacoob, Y., & Davis, L. S. (2002) · IEEE Nonrigid and Articulated Motion Workshop · doi:10.1109/mnrao.1994.346256 · Cited by 87
Essa, I. A., Darrell, T., & Pentland, A. (2002) · IEEE Nonrigid and Articulated Motion Workshop · doi:10.1109/mnrao.1994.346257 · Cited by 79
Self-citationAnalysis, interpretation and synthesis of facial expressions
Essa, I. A., & Pentland, A. (1995) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 68
Self-citationA Unified Approach for Physical and Geometric Modeling for Graphics and Animation
Essa, I. A., Sclaroff, S., & Pentland, A. (1992) · Computer Graphics Forum · doi:10.1111/1467-8659.1130129 · Cited by 28
Self-citationFinal Report to NSF of the Standards for Facial Animation Workshop
Pélachaud, C., Badler, N. I., & Viaud, M.-L. (1994) · ScholarlyCommons (University of Pennsylvania) · Cited by 26
Research works printed but not linked: 8
- moghaddam, 1994, face recognition using view-based and modular eigenspaces, Automatic Systems for the Identification and Inspection of Humans, 2, 10.1117/12.191877 · doi:10.1117/12.191877
- 10.1145/147156.147180 · doi:10.1145/147156.147180
- 10.1057/palgrave.jibs.8490687 · doi:10.1057/palgrave.jibs.8490687
- bruce, 1988, Recognising Faces
- 10.1002/vis.4340020405 · doi:10.1002/vis.4340020405
- 10.1037/0022-3514.37.11.2049 · doi:10.1037/0022-3514.37.11.2049 · Paper page
- 1993, final report to nsf of the planning workshop on facial expression understanding
- mase, 1991, recognition of facial expressions for optical flow, IEICE Trans Special Issue on Computer Vision and Its Applications, 74
Cited by
The recognition of human movement using temporal templates
Bobick, A. F., & Davis, J. W. (2001) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.910878 · Cited by 2,811
Emotion recognition in human-computer interaction
Cowie, R., Douglas-Cowie, E., Tsapatsoulis, N., Votsis, G., Kollias, S., Fellenz, W., & Taylor, J. G. (2001) · IEEE Signal Processing Magazine · doi:10.1109/79.911197 · Cited by 2,603
Facial expression recognition based on Local Binary Patterns: A comprehensive study
Shan, C., Gong, S., & McOwan, P. W. (2009) · Image and Vision Computing · doi:10.1016/j.imavis.2008.08.005 · Cited by 2,300
Mitra, S., & Acharya, T. (2007) · IEEE Transactions on Systems, Man and Cybernetics, Part C (Applications and Reviews) · doi:10.1109/tsmcc.2007.893280 · Cited by 1,981
Automatic facial expression analysis: a survey
Fasel, B., & Luettin, J. (2003) · Pattern Recognition · doi:10.1016/s0031-3203(02)00052-3 · Cited by 1,810
Metadata
- Authors
- Essa, I. A., & Pentland, A. P.
- Venue
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- Published
- 1997-07
- Volume
- 19
- Issue
- 7
- Pages
- 757-763
- ISSN
- 0162-8828 (ISSN-L)
- OpenAlex
- W2160947254
- Cited by
- 911
- References
- 34
- FWCI
- 23.78
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.