Machine Analysis of Facial Expressions
Open accessAbstract
communicated by rapid facial signals include the following (Ekman & Friesen, 1969; Pantic et al., 2006): (a) affective / attitudinal states and moods,1 e.g., joy, fear, disbelief, interest, dislike, stress, (b) emblems, i.e., culture-specific communicators like wink, (c) manipulators, i.e., self-manipulative actions like lip biting and yawns, (d) illustrators, i.e., actions accompanying speech such as eyebrow flashes, (e) regulators, i.e., conversational mediators such as the exchange of a look, head nodes and smiles. Applications of Facial Expression Measurement TechnologyGiven the significant role of the face in our emotional and social lives, it is not surprising that the potential benefits from efforts to automate the analysis of facial signals, in particular rapid facial signals, are varied and numerous (Ekman et al., 1993), especially when it comes to computer science and technologies brought to bear on these issues (Pantic, 2006).As far as natural interfaces between humans and computers (PCs / robots / machines) are concerned, facial expressions provide a way to communicate basic information about needs and demands to the machine.In fact, automatic analysis of rapid facial signals seem to have a natural place in various vision sub-systems, including automated tools for tracking gaze and focus of attention, lip reading, bimodal speech processing, face / visual speech synthesis, and face-based command issuing.Where the user is looking (i.e., gaze tracking) can be effectively used to free computer users from the classic keyboard and mouse.Also, certain facial signals (e.g., a wink) can be associated with certain commands (e.g., a mouse click) offering an alternative to traditional keyboard and mouse commands.The human capability to "hear" in noisy environments by means of lip reading is the basis for bimodal (audiovisual) speech processing that can lead to the realization of robust speech-driven interfaces.To make a believable "talking head" (avatar) representing a real person, recognizing the person's facial signals and making the avatar respond to those using synthesized speech and facial expressions is important.Combining facial expression spotting with facial expression interpretation in terms of labels like "did not understand", "disagree", "inattentive", and "approves" could be employed as a tool for monitoring human reactions during videoconferences, web-based lectures, and automated tutoring sessions.Attendees' facial expressions will inform the speaker (teacher) of the need to adjust the (instructional) presentation.The focus of the relatively recently initiated research area of affective computing lies on sensing, detecting and interpreting human affective states and devising appropriate means for handling this affective information in order to enhance current HCI designs (Picard, 1997).The tacit assumption is that in many situations human-machine interaction could be improved by the introduction of machines that can adapt to their users (think about computer-based advisors, virtual information desks, on-board computers and navigation systems, pacemakers, etc.).The information about when the existing processing should be How to referenceIn order to correctly reference this scholarly work, feel free to copy and
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Based on the observation that some AU are better detected using geometrical features and others using appearance ones, it was suggested that a combination of both might increase recognition performance.
“Based on the observation that some AU are better detected using geometrical features and others using appearance ones, it was suggested that a combination of both might increase recognition performance [127], [139], [183].”
From Survey on RGB, 3D, Thermal, and Multimodal Approaches for Facial Expression Recognition: History, Trends, and Affect-Related Applications (2016) · cites this paper as [183]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
A New Approach to Linear Filtering and Prediction Problems
Kalman, R. E. (1960) · Journal of Basic Engineering · doi:10.1115/1.3662552 · Cited by 31,751 · see citing works
Robust Real-Time Face Detection
Viola, P., & Jones, M. J. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000013087.49260.fb · Cited by 14,097 · see citing works
The expression of the emotions in man and animals.
Darwin, C. D. (1872) · J. Murray eBooks · doi:10.1037/10001-000 · Cited by 12,120 · see citing works
(1981) · Cited by 11,963 · see citing works
Shi, J., & Tomasi (1994) · Proceedings of IEEE Conference on Computer Vision and Pattern Recognition CVPR-94 · doi:10.1109/cvpr.1994.323794 · Cited by 7,724 · see citing works
Lecture Notes in Artificial Intelligence
Brézillon, P., & Bouquet, P. (1999) · Cited by 7,436 · see citing works
Picard, R. W. (1997) · MIT Press · doi:10.7551/mitpress/1140.001.0001 · Cited by 7,382 · see citing works
Friedman, J., Hastie, T., & Tibshirani, R. (2000) · The Annals of Statistics · doi:10.1214/aos/1016218223 · Cited by 6,884 · see citing works
Zhao, W., Chellappa, R., Phillips, P. J., & Rosenfeld, A. (2003) · ACM Computing Surveys · doi:10.1145/954339.954342 · Cited by 6,174 · see citing works
Ekman, P., & Friesen, W. V. (2019) · PsycTESTS Dataset · doi:10.1037/t27734-000 · Cited by 6,019 · see citing works
CONDENSATION—Conditional Density Propagation for Visual Tracking
Isard, M., & Blake, A. (1998) · International Journal of Computer Vision · doi:10.1023/a:1008078328650 · Cited by 4,886 · see citing works
Performance of optical flow techniques
Barron, J. L., Fleet, D. J., & Beauchemin, S. S. (1994) · International Journal of Computer Vision · doi:10.1007/bf01420984 · Cited by 4,305 · see citing works
Neural network-based face detection
Rowley, H. A., Baluja, S., & Kanade, T. (1998) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.655647 · Cited by 3,554 · see citing works
Detecting faces in images: a survey
Yang, M.-H., Kriegman, D. J., & Ahuja, N. (2002) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.982883 · Cited by 3,430 · see citing works
Comprehensive database for facial expression analysis
Takeo Kanade, A., Cohn, J. F., & Tian, Y. (2002) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/afgr.2000.840611 · Cited by 2,612 · see citing works
Filtering via Simulation: Auxiliary Particle Filters
Pitt, M. K., & Shephard, N. (1999) · Journal of the American Statistical Association · doi:10.1080/01621459.1999.10474153 · Cited by 2,283 · see citing works
Ekman, P., & Rosenberg, E. L. (2005) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780195179644.001.0001 · Cited by 1,975 · see citing works
Thin slices of expressive behavior as predictors of interpersonal consequences: A meta-analysis.
Ambady, N., & Rosenthal, R. (1992) · Psychological Bulletin · doi:10.1037/0033-2909.111.2.256 · Cited by 1,925 · see citing works
Li, S. Z., Jain, A. K., Deng, J., & service), S. (. (2011) · Springer eBooks · doi:10.1007/978-0-85729-932-1 · Cited by 1,849 · see citing works
Complete discrete 2-D Gabor transforms by neural networks for image analysis and compression
Daugman, J. G. (1988) · IEEE Transactions on Acoustics Speech and Signal Processing · doi:10.1109/29.1644 · Cited by 1,811 · see citing works
View-based and modular eigenspaces for face recognition
Pentland, Moghaddam, & Starner (1994) · doi:10.1109/cvpr.1994.323814 · Cited by 1,806 · see citing works
Distortion invariant object recognition in the dynamic link architecture
Lades, M. H., Vorbrüggen, J. C., Buhmann, J. M., Lange, J., von der Malsburg, C., Würtz, R. P., & Konen, W. (1993) · IEEE Transactions on Computers · doi:10.1109/12.210173 · Cited by 1,801 · see citing works
Example-based learning for view-based human face detection
Sung, K. K., & Poggio, T. (1998) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.655648 · Cited by 1,779 · see citing works
Automatic analysis of facial expressions: the state of the art
Pantie, M., & Rothkrantz, L. J. M. (2000) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.895976 · Cited by 1,778 · cited 4× · see citing works
“Since motion of the facial skin produces optical flow in the image, a large number of researchers have studied optical flow tracking (Pantic & Rothkrantz, 2000; 2003; Tian et al., 2005).”
InfluentialRecognizing action units for facial expression analysis
Tian, Y.-I., Kanade, T., & Cohn, J. F. (2001) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.908962 · Cited by 1,745 · see citing works
Telling Lies: Clues to Deceit in the Marketplace, Politics, and Marriage
Ekman, P. (1985) · Cited by 1,736 · see citing works
Ekman, P. (1975) · Cited by 1,565 · see citing works
Probabilistic visual learning for object representation
Moghaddam, B., & Pentland, A. (1997) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.598227 · Cited by 1,444 · see citing works
Neurological Anatomy. In Relation to Clinical Medicine.
(1970) · Annals of Internal Medicine · doi:10.7326/0003-4819-72-3-449_1 · Cited by 1,264 · see citing works
A 3D Facial Expression Database For Facial Behavior Research
Yin, L., Wei, X., Sun, Y., Wang, J., & Rosato, M. J. (2006) · 7th International Conference on Automatic Face and Gesture Recognition (FGR06) · doi:10.1109/fgr.2006.6 · Cited by 1,171 · see citing works
Web-Based Database for Facial Expression Analysis
Pantić, M., Valstar, M., Rademaker, R. M., & Maat, L. (2005) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme.2005.1521424 · Cited by 1,099 · see citing works
Automatic classification of single facial images
Lyons, M. J., Budynek, J., & Akamatsu, S. (1999) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.817413 · Cited by 1,075 · see citing works
The Expression of Emotions in Man and Animals
D., C. P., Darwin, C. D., & Maudsley, H. (1981) · The American Journal of Psychology · doi:10.2307/1422356 · Cited by 1,072 · see citing works
A statistical method for 3D object detection applied to faces and cars
Schneiderman, H., & Takeo Kanade, A. (2002) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2000.855895 · Cited by 1,059 · see citing works
Neurological anatomy in relation to clinical medicine
Matthews, W. B. (1982) · Journal of the Neurological Sciences · doi:10.1016/0022-510x(82)90049-1 · Cited by 1,033 · see citing works
Donato, G., Bartlett, M. S., Hager, J. C., Ekman, P., & B, T. J. S. A. (1999) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.799905 · Cited by 999 · see citing works
Automatic recognition and analysis of human faces and facial expressions: a survey
Samal, A., & Iyengar, P. A. (1992) · Pattern Recognition · doi:10.1016/0031-3203(92)90007-6 · Cited by 910 · see citing works
Coding, analysis, interpretation, and recognition of facial expressions
Essa, I. A., & Pentland, A. (1997) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.598232 · Cited by 906 · see citing works
Facial expression recognition from video sequences: temporal and static modeling
Cohen, I., Sebe, N., Garg, A., Chen, L. S., & Huang, T. S. (2003) · Computer Vision and Image Understanding · doi:10.1016/s1077-3142(03)00081-x · Cited by 874 · see citing works
Face recognition: A literature survey
Arora, U. (2003) · ACM Computing Surveys · Cited by 794 · see citing works
Toward an affect-sensitive multimodal human-computer interaction
Pantic, M., & Rothkrantz, L. J. M. (2003) · Proceedings of the IEEE · doi:10.1109/jproc.2003.817122 · Cited by 791 · see citing works
Self-citationLi, S. Z., & Jain, A. K. (2005) · Springer eBooks · doi:10.1007/b138828 · Cited by 791 · see citing works
Rinn, W. E. (1984) · Psychological Bulletin · doi:10.1037/0033-2909.95.1.52 · Cited by 681 · see citing works
Deciphering the Enigmatic Face
Ambadar, Z., Schooler, J. W., & Cohn, J. F. (2005) · Psychological Science · doi:10.1111/j.0956-7976.2005.01548.x · Cited by 649 · see citing works
Recognizing Facial Expression: Machine Learning and Application to Spontaneous Behavior
Bartlett, M. S., Littlewort, G. C., Frank, M. G., Lainscsek, C. S. M., Fasel, I., & Movellan, J. R. (2005) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2005.297 · Cited by 632 · see citing works
Darwin, Deception, and Facial Expression
Ekman, P. (2003) · Annals of the New York Academy of Sciences · doi:10.1196/annals.1280.010 · Cited by 627 · see citing works
Zhang, Z., Lyons, M., Schuster, M., & Akamatsu, S. (2002) · Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition · doi:10.1109/afgr.1998.670990 · Cited by 613 · see citing works
Facial expression of pain: An evolutionary account
Williams, A. C. D. C. (2002) · Behavioral and Brain Sciences · doi:10.1017/s0140525x02000080 · Cited by 585 · see citing works
Pantic, M., & Patras, I. (2006) · IEEE Transactions on Systems, Man and Cybernetics, Part B (Cybernetics) · doi:10.1109/tsmcb.2005.859075 · Cited by 580 · see citing works
Self-citationBartlett, M. S., Littlewort, G. C., Fasel, I., & Movellan, J. R. (2003) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2003.10057 · Cited by 579 · see citing works
Keltner, D. J., Ekman, P., Gonzaga, G. C., & Beer, J. S. (2002) · doi:10.1093/oso/9780195126013.003.0022 · Cited by 555 · see citing works
Rinn, W. E. (1984) · Psychological Bulletin · doi:10.1037//0033-2909.95.1.52 · Cited by 538 · see citing works
Handbook of methods in nonverbal behavior research
Scherer, K. R., & Ekman, P. (1982) · Cited by 515 · see citing works
Recognizing Facial Expressions in Image Sequences Using Local Parameterized Models of Image Motion
Black, M. J., & Yacoob, Y. (1997) · International Journal of Computer Vision · doi:10.1023/a:1007977618277 · Cited by 514 · see citing works
Active and dynamic information fusion for facial expression understanding from image sequences
Zhang, Y., & Ji, Q. (2005) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2005.93 · Cited by 460 · see citing works
Measuring facial expressions by computer image analysis
Bartlett, M. S., Hager, J. C., Ekman, P., & Sejnowski, T. J. (1999) · Psychophysiology · doi:10.1017/s0048577299971664 · Cited by 424 · see citing works
Real-time combined 2D+3D active appearance models
Xiao, J., Baker, S. J., Matthews, I. A., et al. (2004) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2004.1315210 · Cited by 420 · see citing works
Facial Action Recognition for Facial Expression Analysis From Static Face Images
Pantić, M., & Rothkrantz, L. J. M. (2004) · IEEE Transactions on Systems Man and Cybernetics Part B (Cybernetics) · doi:10.1109/tsmcb.2004.825931 · Cited by 419 · see citing works
Face recognition using active appearance models
Edwards, G. J., Cootes, T. F., & Taylor, C. (1998) · Lecture notes in computer science · doi:10.1007/bfb0054766 · Cited by 408 · see citing works
Recognition of Facial Expression from Optical Flow
Mase, K. (1991) · IEICE Transactions on Information and Systems · Cited by 404 · see citing works
Facial motion in the perception of faces and of emotional expression.
Bassili, J. N. (1978) · Journal of Experimental Psychology Human Perception & Performance · doi:10.1037//0096-1523.4.3.373 · Cited by 369 · see citing works
Facial motion in the perception of faces and of emotional expression.
Bassili, J. N. (1978) · Journal of Experimental Psychology: Human Perception and Performance · doi:10.1037/0096-1523.4.3.373 · Cited by 369 · see citing works
Dynamics of facial expression extracted automatically from video
Littlewort, G. C., Bartlett, M. S., Fasel, I., Susskind, J. M., & Movellan, J. R. (2006) · Image and Vision Computing · doi:10.1016/j.imavis.2005.09.011 · Cited by 356 · see citing works
A real-time automated system for the recognition of human facial expressions
Anderson, K., & McOwan, P. W. (2006) · IEEE Transactions on Systems Man and Cybernetics Part B (Cybernetics) · doi:10.1109/tsmcb.2005.854502 · Cited by 351 · see citing works
Fully Automatic Facial Action Unit Detection and Temporal Analysis
Valstar, M., & Pantić, M. (2006) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2006.85 · Cited by 349 · see citing works
The Intensity of Emotional Facial Expressions and Decoding Accuracy
Hess, U. S., Blairy, S., & Kleck, R. E. (1997) · Journal of Nonverbal Behavior · doi:10.1023/a:1024952730333 · Cited by 338 · see citing works
The argument and evidence about universals in facial expressions of emotion.
Ekman, P. (1989) · Cited by 311 · see citing works
THE TIMING OF FACIAL MOTION IN POSED AND SPONTANEOUS SMILES
Cohn, J. F., & Schmidt, K. L. (2004) · International Journal of Wavelets Multiresolution and Information Processing · doi:10.1142/s021969130400041x · Cited by 301 · see citing works
Fully Automatic Facial Action Recognition in Spontaneous Behavior
Bartlett, M. S., Littlewort, G. C., Frank, M. G., Lainscsek, C. S. M., Fasel, I., & Movellan, J. R. (2006) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/fgr.2006.55 · Cited by 295 · see citing works
Real-Time Inference of Complex Mental States from Facial Expressions and Head Gestures
El Kaliouby, R., & Robinson, P. (2005) · 2004 Conference on Computer Vision and Pattern Recognition Workshop · doi:10.1109/cvpr.2004.427 · Cited by 282 · see citing works
Example Based Learning for View-Based Human Face Detection.
Sung, K. K., & Poggio, T. (1994) · doi:10.21236/ada295738 · Cited by 269 · see citing works
Face Recognition: A Literature Review
Tolba, A. S., El-Baz, A. H., & El-Harby, A. A. (2008) · doi:10.5281/zenodo.1334651 · Cited by 267 · see citing works
Fully Automatic Facial Feature Point Detection Using Gabor Feature Based Boosted Classifiers
Vukadinovic, D., & Pantić, M. (2006) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/icsmc.2005.1571392 · Cited by 264 · see citing works
Humphreys, G. W., Donnelly, N., & Riddoch, M. J. (1993) · Neuropsychologia · doi:10.1016/0028-3932(93)90045-2 · Cited by 263 · see citing works
Affective multimodal human-computer interaction
Pantic, M., Sebe, N., Cohn, J. F., & Huang, T. (2005) · Proceedings of the 13th annual ACM international conference on Multimedia · doi:10.1145/1101149.1101299 · Cited by 234 · see citing works
Manifold based analysis of facial expression
Chang, Y. H., Hu, C., Feris, R. S., & Turk, M. (2005) · Image and Vision Computing · doi:10.1016/j.imavis.2005.08.006 · Cited by 214 · see citing works
A video database of moving faces and people
O’Toole, A. J., Ha, J., Snow, S. L., Hurst, D. R., Pappas, M., Ayyad, J., & Abdi, H. (2005) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2005.90 · Cited by 212 · see citing works
A generative framework for real time object detection and classification
Fasel, I., Fortenberry, B., & Movellan, J. R. (2004) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2004.07.014 · Cited by 209 · see citing works
DeCarlo, D., & Metaxas, D. (1996) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.1996.517079 · Cited by 207 · see citing works
Face recognition technology: security versus privacy
Bowyer, K. W. (2004) · IEEE Technology and Society Magazine · doi:10.1109/mtas.2004.1273467 · Cited by 202 · see citing works
Learning From Examples in the Small Sample Case: Face Expression Recognition
Guo, G., & Dyer, C. R. (2005) · IEEE Transactions on Systems Man and Cybernetics Part B (Cybernetics) · doi:10.1109/tsmcb.2005.846658 · Cited by 194 · see citing works
Genuine, suppressed and faked facial behavior during exacerbation of chronic low back pain
Craig, K. D., Hyde, S. A., & Patrick, C. J. (1991) · Pain · doi:10.1016/0304-3959(91)90071-5 · Cited by 184 · see citing works
Robust full‐motion recovery of head by dynamic templates and re‐registration techniques
Xiao, J., Moriyama, T., Takeo Kanade, A., & Cohn, J. F. (2003) · International Journal of Imaging Systems and Technology · doi:10.1002/ima.10048 · Cited by 180 · see citing works
Haar Features for FACS AU Recognition
Whitehill, J., & Omlin, C. W. P. (2006) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/fgr.2006.61 · Cited by 174 · see citing works
Machine learning methods for fully automatic recognition of facial expressions and facial actions
Bartlett, M. S., Littlewort, G. C., Lainscsek, C. S. M., Fasel, I., & Movellan, J. R. (2005) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/icsmc.2004.1398364 · Cited by 168 · see citing works
Spontaneous vs. posed facial behavior: automatic analysis of brow actions
Valstar, M. F., Pantic, M., Ambadar, Z., & Cohn, J. F. (2006) · Proceedings of the 8th international conference on Multimodal interfaces · doi:10.1145/1180995.1181031 · Cited by 168 · see citing works
Human computing and machine understanding of human behavior
Pantić, M., Pentland, A., Nijholt, A., & Huang, T. S. (2006) · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION · doi:10.1145/1180995.1181044 · Cited by 153 · see citing works
Littlewort, G. C., Bartlett, M. S., & Lee, K. (2007) · International Conference on Multimodal Interfaces · doi:10.1145/1322192.1322198 · Cited by 152 · see citing works
Fully automatic upper facial action recognition
Kapoor, A., Qi, Y., & Picard, R. W. (2004) · IEEE International SOI Conference (SOI) · doi:10.1109/amfg.2003.1240843 · Cited by 135 · see citing works
Recognizing Action Units for Facial Expression Analysis
Tian, Y., Kanade, T., & Colin, J. F. (2002) · Series in machine perception and artificial intelligence · doi:10.1142/9789812778543_0002 · Cited by 135 · see citing works
Young, A. W. (1998) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780198524205.001.0001 · Cited by 134 · see citing works
Real-Time Inference of Complex Mental States from Facial Expressions and Head Gestures
el Kaliouby, R., & Robinson, P. (2005) · Springer eBooks · doi:10.1007/0-387-27890-7_11 · Cited by 134 · see citing works
Dynamics of Facial Expression Extracted Automatically from Video
Littlewort, G., Bartlett, M. S., Fasel, I., Susskind, J., & Movellan, J. (2005) · 2004 Conference on Computer Vision and Pattern Recognition Workshop · doi:10.1109/cvpr.2004.327 · Cited by 126 · see citing works
Miehlke, A., Fisch, U. P., & Eneroth, C. ‐. (1973) · Medical Entomology and Zoology · Cited by 125 · see citing works
Active appearance models with occlusion
Gross, R., Matthews, I. A., & Baker, S. J. (2005) · Image and Vision Computing · doi:10.1016/j.imavis.2005.08.001 · Cited by 120 · see citing works
Motion history for facial action detection in video
Valstar, M., Pantić, M., & Patras, I. (2005) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/icsmc.2004.1398371 · Cited by 111 · see citing works
Particle filtering with factorized likelihoods for tracking facial features
Patras, I., & Pantić, M. (2004) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/afgr.2004.1301515 · Cited by 102 · see citing works
Facial expression recognition and its degree estimation
Kimura, S., & Yachida, M. (2002) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.1997.609338 · Cited by 99 · see citing works
Bartlett, M. S., Viola, P. A., B, T. J. S. A., Golomb, B. A., Larsen, J. O., Hager, J. C., & Ekman, P. (1995) · Cited by 97 · see citing works
Appearing truthful generalizes across different deception situations.
Frank, M. G., & Ekman, P. (2004) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.86.3.486 · Cited by 94 · see citing works
Subtly different facial expression recognition and expression intensity estimation
Lien, J., Kanade, T., Cohn, J. F., et al. (2002) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.1998.698704 · Cited by 94 · see citing works
Detecting Facial Actions and their Temporal Segments in Nearly Frontal-View Face Image Sequences
Pantić, M., & Patras, I. (2006) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/icsmc.2005.1571665 · Cited by 92 · see citing works
Psychological and Neural Perspectives on the Role of Motion in Face Recognition
Roark, D. A., Barrett, S. E., Spence, M. J., Abdi, H., & O’Toole, A. J. (2003) · Behavioral and Cognitive Neuroscience Reviews · doi:10.1177/1534582303002001002 · Cited by 91 · see citing works
Automatic analysis and recognition of brow actions and head motion in spontaneous facial behavior
Cohn, J. F., Reed, L. I., Ambadar, Z., Xiao, J., & Moriyama, T. (2005) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/icsmc.2004.1398367 · Cited by 88 · see citing works
Model-based face tracking for view-independent facial expression recognition
Gokturk, S. B., Bouguet, J.-Y., Tomasi, C., & Girod, B. (2003) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/afgr.2002.1004168 · Cited by 88 · see citing works
Robust full-motion recovery of head by dynamic templates and re-registration techniques
Xiao, J., Takeo Kanade, A., & Cohn, J. F. (2003) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/afgr.2002.1004149 · Cited by 87 · see citing works
An automated face reader for fatigue detection
Gu, H., & Ji, Q. (2004) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/afgr.2004.1301517 · Cited by 87 · see citing works
Cohn, J. F., & Ekman, P. (2008) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780198529620.003.0002 · Cited by 82 · see citing works
Robust real-time detection, tracking, and pose estimation of faces in video streams
Huang, K. S., & Trivedi, M. M. (2004) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr.2004.1334689 · Cited by 75 · see citing works
Manifold Based Analysis of Facial Expression
Hu, C., Chang, Y. H., Feris, R. S., & Turk, M. (2005) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvpr.2004.390 · Cited by 74 · see citing works
The effect of alcohol on emotional response to a social stressor.
Sayette, M. A., Smith, D., Breiner, M. J., & Wilson, G. T. (1992) · Journal of Studies on Alcohol · doi:10.15288/jsa.1992.53.541 · Cited by 73 · see citing works
Special Issue on Sequential State Estimation
Haykin, S., & deFreitas, N. (2004) · Proceedings of the IEEE · doi:10.1109/jproc.2003.823140 · Cited by 73 · see citing works
A Prototype for Automatic Recognition of Spontaneous Facial Actions
Bartlett, Littlewort, G. C., B, T. J. S. A., & Movellan, J. R. (2002) · neural information processing systems · Cited by 73 · see citing works
Foundations of Human Computing: Facial Expression and Emotion
Cohn, J. F. (2007) · Springer eBooks · doi:10.1007/978-3-540-72348-6_1 · Cited by 73 · see citing works
Social Presence, Embarrassment, and Nonverbal Behavior
Costa, M., Dinsbach, W., Manstead, A. S. R., & Bitti, P. E. R. (2001) · Journal of Nonverbal Behavior · doi:10.1023/a:1012544204986 · Cited by 72 · see citing works
Space–Time Separation During Obstacle-Avoidance Learning in Monkeys
Torres, E. B., & Andersen, R. A. (2006) · Journal of Neurophysiology · doi:10.1152/jn.00188.2006 · Cited by 63 · see citing works
Matching expression variant faces
Martı́nez, A. M. (2003) · Vision Research · doi:10.1016/s0042-6989(03)00079-8 · Cited by 61 · see citing works
Subjective judgments of deception in pain expression: accuracy and errors
Hadjistavropoulos, H. D., Craig, K. D., Hadjistavropoulos, T., & Poole, G. D. (1996) · Pain · doi:10.1016/0304-3959(95)00218-9 · Cited by 59 · see citing works
Biologically vs. Logic Inspired Encoding of Facial Actions and Emotions in Video
Valstar, M., & Pantić, M. (2006) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme.2006.262464 · Cited by 56 · see citing works
Latent semantic analysis of facial action codes for automatic facial expression recognition
Fasel, B., Monay, F., & Gática-Pérez, D. (2004) · doi:10.1145/1026711.1026742 · Cited by 52 · see citing works
The components of conversational facial expressions
Cunningham, D. W., Kleiner, M., Bülthoff, H., & Wallraven, C. (2004) · Symposium on Applied Perception in Graphics and Visualization (APGV) · doi:10.1145/1012551.1012578 · Cited by 44 · see citing works
Gaze-X: Adaptive, Affective, Multimodal Interface for Single-User Office Scenarios
Maat, L., & Pantic, M. (2007) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-72348-6_13 · Cited by 44 · see citing works
Self-citationTHE TIMING OF FACIAL MOTION IN POSED AND SPONTANEOUS SMILES
Cohn, J. F., & Schmidt, K. L. (2003) · Active Media Technology · doi:10.1142/9789812704313_0005 · Cited by 39 · see citing works
Inferring Facial Action Units with Causal Relations
Tong, Y., Liao, W., & Ji, Q. (2006) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2006.154 · Cited by 38 · see citing works
Multi-View Face Detection under Complex Scene based on Combined SVMs
Wang, P., & Ji, Q. (2004) · Cited by 33 · see citing works
3D shape constraint for facial feature localization using probabilistic-like output
Chen, L., Zhang, L., Zhang, H., et al. (2004) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/afgr.2004.1301548 · Cited by 30 · see citing works
Information extraction from image sequences of real-world facial expressions
Gu, H., & Ji, Q. (2004) · Machine Vision and Applications · doi:10.1007/s00138-004-0161-6 · Cited by 28 · see citing works
Cohen, M. M. (2006) · doi:10.1093/oso/9780195300406.001.0001 · Cited by 27 · see citing works
Automatic Facial Point Detection
Holden, E., & Owens, R. A. (2002) · UWA Profiles and Research Repository (University of Western Australia) · Cited by 27 · see citing works
Multimodal processing by finding common cause
Nock, H. J., Iyengar, G., & Neti, C. (2004) · Communications of the ACM · doi:10.1145/962081.962105 · Cited by 23 · see citing works
Case-based reasoning for user-profiled recognition of emotions from face images
Pantić, M., & Rothkrantz, L. J. M. (2005) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme.2004.1394211 · Cited by 23 · see citing works
Pantić, M. (2006) · Lecture notes in computer science · doi:10.1007/11825890_2 · Cited by 20 · see citing works
Heller, M., & Haynal, V. (2005) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780195179644.003.0024 · Cited by 20 · see citing works
AUTOMATION OF NON-VERBAL COMMUNICATION OF FACIAL EXPRESSIONS
Pantić, M., Rothkrantz, L. J. M., & Koppelaar, H. (2007) · Cited by 15 · see citing works
Patras, I., & Pantić, M. (2006) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/icsmc.2005.1571287 · Cited by 14 · see citing works
Su, C., Zhuang, Y., Huang, L. P., et al. (2004) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/afgr.2004.1301571 · Cited by 7 · see citing works
Heller, M., & Haynal, V. (1998) · doi:10.1093/oso/9780195104462.003.0020 · Cited by 6 · see citing works
On the equivalence of common approaches to lighting insensitive recognition
Osadchy, M., Jacobs, D. W., & Lindenbaum, M. (2005) · doi:10.1109/iccv.2005.179 · Cited by 4 · see citing works
Learning real-time object detectors : probabilistic generative approaches
Fasel, I. R. (2006) · eScholarship (California Digital Library) · Cited by 4 · see citing works
Flagged first, then by citations
Research works printed but not linked: 10
- Daugman, J. (1988). Complete discrete 2D Gabor transform by neural networks for image analysis and compression. IEEE Trans. Acoustics, Speech, and Signal Processing, Vol. 36, pp. 1169-1179.
- Duchenne de Bologne, G.B. (1862/1990). Mechanisme de la Physionomie Humaine, Jules Renouard Libraire, Paris, France, 1862. (Translation: The Mechanism of Human Facial Expression, Cambridge University Press, New York, USA, 1990).
- Ekman, P. & Friesen, W.V. (1969). The repertoire of nonverbal behavior. Semiotica, Vol. 1, pp. 49-98.
- Ekman, P., Huang, T.S., Sejnowski, T.J. & Hager, J.C., (Eds.), (1993). NSF Understanding the Face, A Human Face eStore, Salt Lake City, USA, (see Library).
- Ekman, P. & Rosenberg, E.L., (Eds.), (2005). What the face reveals: Basic and applied studies of spontaneous expression using the FACS, Oxford University Press, Oxford, UK.
- Friedman, J., Hastie, T. & Tibshirani, R. (2000). Additive logistic regression: a statistical view of boosting. The Annals of Statistics, Vol. 28, No 2, pp. 337-374.
- Keltner, D. (1997). Signs of Appeasement: Evidence for distinct displays of embarrassment, amusement, and shame, In: What the Face Reveals, Ekman, P. & Rosenberg, E., (Eds.), pp. 133-160, Oxford University Press, New York, USA.
- Russell, J.A. & Fernandez-Dols, J.M., (Eds.), (1997). The Pshychology of Facial Expression, Cambridge University Press, New York, USA.
- Tao, H. & Huang, T.S. (1998). Connected vibrations -a model analysis approach to non- rigid motion tracking, Proc. IEEE Int'l Conf. Computer Vision and Pattern Recognition, pp. 735-740.
- Yacoob, Y., Davis, L., Black, M., Gavrila, D., Horprasert, T. & Morimoto, C. (1998). Looking at People in Action, In: Computer Vision for Human-Machine Interaction, Cipolla, R. & Pentland, A., (Eds.), pp. 171-187, Cambridge University Press, Cambridge, UK.
Cited by
Sorted by citations
Corneanu, C. A., Simon, M. O., Cohn, J. F., & Guerrero, S. E. (2016) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2515606 · Cited by 527 · see citing works
Detecting depression from facial actions and vocal prosody
Cohn, J. F., Kruez, T. S., Matthews, I., Yang, Y., Nguyen, M. H., Padilla, M. T., Zhou, F., & De la Torre, F. (2009) · 2009 3rd International Conference on Affective Computing and Intelligent Interaction and Workshops · doi:10.1109/acii.2009.5349358 · Cited by 494 · see citing works
MoodScope: building a mood sensor from smartphone usage patterns
LiKamWa, R., Liu, Y., Lane, N. D., & Zhong, L. (2013) · Proceeding of the 11th annual international conference on Mobile systems, applications, and services · doi:10.1145/2462456.2464449 · Cited by 444 · see citing works
Gunes, H., & Schuller, B. (2013) · Image and Vision Computing · doi:10.1016/j.imavis.2012.06.016 · Cited by 360 · see citing works
A survey of affect recognition methods: audio, visual and spontaneous expressions
Zeng, Z., Pantic, M., Roisman, G. I., & Huang, T. S. (2007) · Proceedings of the 9th international conference on Multimodal interfaces · doi:10.1145/1322192.1322216 · Cited by 144 · see citing works
- Authors
- Pantic, M., & Stewart, M.
- Affiliations
- University of California System (US)
- Venue
- Face Recognition
- Publisher
- I-Tech Education and Publishing
- Published
- 2007-07-01
- DOI
- 10.5772/4847
- OpenAlex
- W2166835339
- Cited by
- 248
- References
- 139
- Citations by year
- 2026: 1 · 2025: 2 · 2024: 4 · 2023: 6 · 2022: 3 · 2021: 6 · 2020: 7 · 2019: 12 · 2018: 14 · 2017: 12 · 2016: 17 · 2015: 11 · 2014: 18 · 2013: 23 · 2012: 24
- FWCI
- 68.43
- Type
- book chapter
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by-nc-sa
- Locations
- University of Twente Research Information (publishedVersion)
- BiblioBoard Library Catalog (Open Research Library) (submittedVersion, cc-by-sa)
- Contact-less Assessment of In-vivo Body Signals Using Microwave Doppler Radar (InTech) (submittedVersion, cc-by-nc-sa)
- University of Twente Research Information (submittedVersion, other-oa)
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Emotion and Mood Recognition
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Face recognition and analysis
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Face and Expression Recognition
- Keywords
- facial expressions, facial expression analysis, emotion recognition, gaze tracking, lip reading, affective computing, human-computer interaction, facial expression interpretation, avatars, natural user interfaces, nonverbal communication, Ekman's basic emotions
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
