The DOI matches its Crossref record; 30 of the 30 references it cites were found in a registry or an index.
A real-time automated system for the recognition of human facial expressions
Abstract
A fully automated, multistage system for real-time recognition of facial expression is presented. The system uses facial motion to characterize monochrome frontal views of facial expressions and is able to operate effectively in cluttered and dynamic scenes, recognizing the six emotions universally associated with unique facial expressions, namely happiness, sadness, disgust, surprise, fear, and anger. Faces are located using a spatial ratio template tracker algorithm. Optical flow of the face is subsequently determined using a real-time implementation of a robust gradient model. The expression recognition system then averages facial velocity information over identified regions of the face and cancels out rigid head motion by taking ratios of this averaged motion. The motion signatures produced are then classified using Support Vector Machines as either nonexpressive or as one of the six basic emotions. The completed system is demonstrated in two simple affective computing applications that respond in real-time to the facial expressions of the user, thereby providing the potential for improvements in the interaction between a computer user and technology.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A Tutorial on Support Vector Machines for Pattern Recognition
Burges, C. J. C. (1998) · Data Mining and Knowledge Discovery · doi:10.1023/a:1009715923555 · Cited by 16,429
Picard, R. W. (1997) · MIT Press · doi:10.7551/mitpress/1140.001.0001 · Cited by 7,382
A comparison of methods for multiclass support vector machines
Hsu, C.-W., & Lin, C.-J. (2002) · IEEE Transactions on Neural Networks · doi:10.1109/72.991427 · Cited by 6,838
Performance of optical flow techniques
Barron, J. L., Fleet, D. J., & Beauchemin, S. S. (1994) · International Journal of Computer Vision · doi:10.1007/bf01420984 · Cited by 4,305
Thermodynamical approach to the traveling salesman problem: An efficient simulation algorithm
Černý, V. (1985) · Journal of Optimization Theory and Applications · doi:10.1007/bf00940812 · Cited by 3,436
Automatic facial expression analysis: a survey
Fasel, B., & Luettin, J. (2003) · Pattern Recognition · doi:10.1016/s0031-3203(02)00052-3 · Cited by 1,810
Recognizing action units for facial expression analysis
Tian, Y.-I., Kanade, T., & Cohn, J. F. (2001) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.908962 · Cited by 1,745
Handbook of Cognition and Emotion
(1999) · Wiley eBooks · doi:10.1002/0470013494 · Cited by 1,670
(1990) · Discrete Applied Mathematics · doi:10.1016/0166-218x(90)90039-f · Cited by 1,440
Emotion and sociable humanoid robots
Breazeal, C. (2003) · International Journal of Human-Computer Studies · doi:10.1016/s1071-5819(03)00018-1 · Cited by 1,279
Coding, analysis, interpretation, and recognition of facial expressions
Essa, I. A., & Pentland, A. P. (1997) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.598232 · Cited by 911
Matsugu, M., Mori, K., Mitari, Y., & Kaneda, Y. (2003) · Neural Networks · doi:10.1016/s0893-6080(03)00115-1 · Cited by 715
Automatic interpretation and coding of face images using flexible models
Lanitis, A., Taylor, C. J., & Cootes, T. F. (1997) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.598231 · Cited by 625
Recognition of Facial Expression from Optical Flow
Mase, K. (1991) · IEICE Transactions on Information and Systems · Cited by 481
Measuring facial expressions by computer image analysis
Bartlett, M. S., Hager, J. C., Ekman, P., & Sejnowski, T. J. (1999) · Psychophysiology · doi:10.1017/s0048577299971664 · Cited by 424
Detection, tracking, and classification of action units in facial expression
Lien, J. J.-J., Kanade, T., Cohn, J. F., & Li, C.-C. (2000) · Robotics and Autonomous Systems · doi:10.1016/s0921-8890(99)00103-7 · Cited by 309
Cohn, J. F., Zlochower, A. J., Lien, J., & Kanade, T. (1999) · Psychophysiology · doi:10.1017/s0048577299971184 · Cited by 287
Categorizing sex and identity from the biological motion of faces
Hill, H., & Johnston, A. (2001) · Current Biology · doi:10.1016/s0960-9822(01)00243-3 · Cited by 247
Automated facial expression recognition based on FACS action units
Lien, J. J., Kanade, T., Cohn, J. F., & Li, C.-C. (2002) · Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition · doi:10.1109/afgr.1998.670980 · Cited by 226
Toward computers that recognize and respond to user emotion
Picard, R. W. (2000) · IBM Systems Journal · doi:10.1147/sj.393.0705 · Cited by 222
Eye Finding via Face Detection for a Foveated, Active Vision System
Scassellati, B. M. (1998) · Defense Technical Information Center (DTIC) · doi:10.21236/ada455661 · Cited by 90
Robust velocity computation from a biologically motivated model of motion perception
Johnston, A., McOwan, P. W., & Benton, C. P. (1999) · Proceedings of the Royal Society B Biological Sciences · doi:10.1098/rspb.1999.0666 · Cited by 87
Self-citationHuman emotion recognition from motion using a radial basis function network architecture
Rosenblum, M., Yacoob, Y., & Davis, L. S. (2002) · IEEE Nonrigid and Articulated Motion Workshop · doi:10.1109/mnrao.1994.346256 · Cited by 87
Recognition of asymmetric facial action unit activities and intensities
Fasel, B., & Luettin, J. (2000) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr.2000.905664 · Cited by 84
Face image analysis for expression measurement and detection of deceit
Bartlett, M. S., Donato, G., Movellan, J. R., Padova, U., Hager, J. C., Ekman, P., & B, T. J. S. A. (1999) · Cited by 34
Recognizing facial expressions by spatio-temporal analysis
Yaccob, Y., & Davis, L. (2002) · Proceedings of 12th International Conference on Pattern Recognition · doi:10.1109/icpr.1994.576429 · Cited by 34
Robust real-time face tracker for cluttered environments
Anderson, K., & McOwan, P. W. (2004) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2004.01.001 · Cited by 31
Self-citationFacial Expression Recognition Using Artificial Neural Networks
Deepthi, S. (2013) · IOSR Journal of Computer Engineering · doi:10.9790/0661-0840106 · Cited by 19
A Simple Neural Network Models Categorical Perception of Facial Expressions
Padgett, C. W., & Cottrell, G. W. (2022) · Routledge eBooks · doi:10.4324/9781315782416-147 · Cited by 18
CoArt: coarticulation region analysis for control of 2D characters
Fidaleo, D. A., & Neumann, U. (2003) · Computer Animation (CA) · doi:10.1109/ca.2002.1017502 · Cited by 17
Cited by
A Survey of Affect Recognition Methods: Audio, Visual, and Spontaneous Expressions
Zeng, Z., Pantic, M., Roisman, G. I., & Huang, T. S. (2009) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2008.52 · Cited by 2,797
EEG Emotion Recognition Using Dynamical Graph Convolutional Neural Networks
Song, T., Zheng, W., Song, P., & Cui, Z. (2020) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2018.2817622 · Cited by 1,597
Differential entropy feature for EEG-based emotion classification
Duan, R.-N., Zhu, J.-Y., & Lu, B.-L. (2013) · 2013 6th International IEEE/EMBS Conference on Neural Engineering (NER) · doi:10.1109/ner.2013.6695876 · Cited by 1,100
Emotion recognition using multi-modal data and machine learning techniques: A tutorial and review
Zhang, J., Yin, Z., Chen, P., & Nichele, S. (2020) · Information Fusion · doi:10.1016/j.inffus.2020.01.011 · Cited by 806
Emotional state classification from EEG data using machine learning approach
Wang, X.-W., Nie, D., & Lu, B.-L. (2014) · Neurocomputing · doi:10.1016/j.neucom.2013.06.046 · Cited by 755
Metadata
- Authors
- Anderson, K., & McOwan, P. W.
- Venue
- IEEE Transactions on Systems, Man and Cybernetics, Part B (Cybernetics)
- Published
- 2006-02
- Volume
- 36
- Issue
- 1
- Pages
- 96-105
- ISSN
- 1083-4419 (ISSN-L)
- OpenAlex
- W2162418306
- Cited by
- 355
- References
- 30
- FWCI
- 17.33
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.