The DOI matches its Crossref record; 16 of the 16 references it cites were found in a registry or an index.
Real Time Face Detection and Facial Expression Recognition: Development and Applications to Human Computer Interaction.
Abstract
Computer animated agents and robots bring a social dimension to human computer interaction and force us to think in new ways about how computers could be used in daily life. Face to face communication is a real-time process operating at a a time scale in the order of 40 milliseconds. The level of uncertainty at this time scale is considerable, making it necessary for humans and machines to rely on sensory rich perceptual primitives rather than slow symbolic inference processes. In this paper we present progress on one such perceptual primitive. The system automatically detects frontal faces in the video stream and codes them with respect to 7 dimensions in real time: neutral, anger, disgust, fear, joy, sadness, surprise. The face finder employs a cascade of feature detectors trained with boosting techniques [15, 2]. The expression recognizer receives image patches located by the face detector. A Gabor representation of the patch is formed and then processed by a bank of SVM classifiers. A novel combination of Adaboost and SVM's enhances performance. The system was tested on the Cohn-Kanade dataset of posed facial expressions [6]. The generalization performance to new subjects for a 7- way forced choice correct. Most interestingly the outputs of the classifier change smoothly as a function of time, providing a potentially valuable representation to code facial expression dynamics in a fully automatic and unobtrusive manner. The system has been deployed on a wide variety of platforms including Sony's Aibo pet robot, ATR's RoboVie, and CU animator, and is currently being evaluated for applications including automatic reading tutors, assessment of human-robot interaction.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Friedman, J., Hastie, T., & Tibshirani, R. (2000) · The Annals of Statistics · doi:10.1214/aos/1016218223 · Cited by 6,884
Neural network-based face detection
Rowley, H. A., Baluja, S., & Kanade, T. (1998) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.655647 · Cited by 3,554
Comprehensive database for facial expression analysis
Kanade, T., Cohn, J. F., & Tian, Y. (2002) · Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580) · doi:10.1109/afgr.2000.840611 · Cited by 2,591
Robust real-time object detection.
Viola, P. A. (2001) · Cited by 2,340
Distortion invariant object recognition in the dynamic link architecture
Lades, M., Vorbruggen, J. C., Buhmann, J., Lange, J., von der Malsburg, C., Wurtz, R. P., & Konen, W. (1993) · IEEE Transactions on Computers · doi:10.1109/12.210173 · Cited by 1,805
Automatic analysis of facial expressions: the state of the art
Pantie, M., & Rothkrantz, L. J. M. (2000) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.895976 · Cited by 1,778
Example-based learning for view-based human face detection
Sung, K.-K., & Poggio, T. (1998) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.655648 · Cited by 1,773
Probabilistic modeling of local appearance and spatial relationships for object recognition
Schneiderman, H., & Kanade, T. (2002) · Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231) · doi:10.1109/cvpr.1998.698586 · Cited by 358
Robovie: an interactive humanoid robot
Ishiguro, H., Ono, T., Imai, M., Maeda, T., Kanda, T., & Nakatsu, R. (2001) · Industrial Robot: An International Journal · doi:10.1108/01439910110410051 · Cited by 261
Representing Face Images for Emotion Classification
Padgett, C. W., & Cottrell, G. W. (1996) · neural information processing systems · Cited by 171
Cited by
Dynamic Texture Recognition Using Local Binary Patterns with an Application to Facial Expressions
Zhao, G., & Pietikainen, M. (2007) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2007.1110 · Cited by 2,846
Facial expression recognition based on Local Binary Patterns: A comprehensive study
Shan, C., Gong, S., & McOwan, P. W. (2009) · Image and Vision Computing · doi:10.1016/j.imavis.2008.08.005 · Cited by 2,300
OpenFace: An open source facial behavior analysis toolkit
Baltrusaitis, T., Robinson, P., & Morency, L.-P. (2016) · 2016 IEEE Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv.2016.7477553 · Cited by 1,747
Attribute and simile classifiers for face verification
Kumar, N., Berg, A. C., Belhumeur, P. N., & Nayar, S. K. (2009) · 2009 IEEE 12th International Conference on Computer Vision · doi:10.1109/iccv.2009.5459250 · Cited by 1,361
Kotsia, I., & Pitas, I. (2007) · IEEE Transactions on Image Processing · doi:10.1109/tip.2006.884954 · Cited by 687
The Faces of Engagement: Automatic Recognition of Student Engagementfrom Facial Expressions
Whitehill, J., Serpell, Z., Lin, Y.-C., Foster, A., & Movellan, J. R. (2014) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2014.2316163 · Cited by 677
Self-citationLocal Directional Number Pattern for Face Analysis: Face and Expression Recognition
Ramirez Rivera, A., Rojas Castillo, J., & Oksam Chae, O. (2013) · IEEE Transactions on Image Processing · doi:10.1109/tip.2012.2235848 · Cited by 512
Automatic Recognition of Facial Actions in Spontaneous Expressions
Bartlett, M. S., Littlewort, G. C., Frank, M. G., Lainscsek, C., Fasel, I. R., & Movellan, J. R. (2006) · Journal of Multimedia · doi:10.4304/jmm.1.6.22-35 · Cited by 468
Self-citationRobust facial expression recognition using local binary patterns
Shan, C., Gong, S., & McOwan, P. W. (2005) · IEEE International Conference on Image Processing 2005 · doi:10.1109/icip.2005.1530069 · Cited by 414
FaceTracer: A Search Engine for Large Collections of Images with Faces
Kumar, N., Belhumeur, P., & Nayar, S. (2008) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-88693-8_25 · Cited by 368
Face Expression Recognition and Analysis: The State of the Art
Bettadapura, V. (2012) · arXiv · doi:10.48550/arxiv.1203.6722 · Cited by 336
Dynamic Difficulty Adjustment in Computer Games Through Real-Time Anxiety-Based Affective Feedback
Liu, C., Agrawal, P., Sarkar, N., & Chen, S. (2009) · International Journal of Human-Computer Interaction · doi:10.1080/10447310902963944 · Cited by 259
Authentic facial expression analysis
Sebe, N., Lew, M. S., Sun, Y., Cohen, I., Gevers, T., & Huang, T. S. (2007) · Image and Vision Computing · doi:10.1016/j.imavis.2005.12.021 · Cited by 257
Facial Expression Recognition Using Facial Movement Features
Zhang, L., & Tjondronegoro, D. (2011) · IEEE Transactions on Affective Computing · doi:10.1109/t-affc.2011.13 · Cited by 253
Machine Analysis of Facial Expressions
Pantic, M., & Stewart, M. (2007) · Face Recognition · doi:10.5772/4847 · Cited by 248
Automatic Facial Expression Recognition Using Facial Animation Parameters and Multistream HMMs
Aleksic, P. S., & Katsaggelos, A. K. (2006) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2005.863510 · Cited by 235
Brain–Computer Interface Technologies in the Coming Decades
Lance, B. J., Kerick, S. E., Ries, A. J., Oie, K. S., & McDowell, K. (2012) · Proceedings of the IEEE · doi:10.1109/jproc.2012.2184830 · Cited by 231
Facial Expression Recognition: A Survey
Huang, Y., Chen, F., Lv, S., & Wang, X. (2019) · Symmetry · doi:10.3390/sym11101189 · Cited by 195
Audio-visual emotion fusion (AVEF): A deep efficient weighted approach
Ma, Y., Hao, Y., Chen, M., Chen, J., Lu, P., & Košir, A. (2019) · Information Fusion · doi:10.1016/j.inffus.2018.06.003 · Cited by 155
Face2Exp: Combating Data Biases for Facial Expression Recognition
Zeng, D., Lin, Z., Yan, X., Liu, Y., Wang, F., & Tang, B. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01965 · Cited by 141
Real-time 2D+3D facial action and expression recognition
Tsalakanidou, F., & Malassiotis, S. (2010) · Pattern Recognition · doi:10.1016/j.patcog.2009.12.009 · Cited by 125
A Robust GAN-Generated Face Detection Method Based on Dual-Color Spaces and an Improved Xception
Chen, B., Liu, X., Zheng, Y., Zhao, G., & Shi, Y.-Q. (2022) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2021.3116679 · Cited by 125
Multimodal learning for facial expression recognition
Zhang, W., Zhang, Y., Ma, L., Guan, J., & Gong, S. (2015) · Pattern Recognition · doi:10.1016/j.patcog.2015.04.012 · Cited by 100
A Face Recognition Application for People with Visual Impairments: Understanding Use Beyond the Lab
Zhao, Y., Wu, S., Reynolds, L., & Azenkot, S. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3173789 · Cited by 84
Chen, S., Tian, Y., Liu, Q., & Metaxas, D. N. (2013) · Image and Vision Computing · doi:10.1016/j.imavis.2012.06.014 · Cited by 72
Saffaryazdi, N., Wasim, S. T., Dileep, K., Nia, A. F., Nanayakkara, S., Broadbent, E., & Billinghurst, M. (2022) · Frontiers in Psychology · doi:10.3389/fpsyg.2022.864047 · Cited by 69
Walecki, R., Rudovic, O., Pavlovic, V., & Pantic, M. (2015) · 2015 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG) · doi:10.1109/fg.2015.7163137 · Cited by 65
Facial Expression Recognition using Encoded Dynamic Features
Yang, P., Liu, Q., & Metaxas, D. N. (2007) · Multimedia and Expo, 2007 IEEE International Conference on · doi:10.1109/icme.2007.4284848 · Cited by 33
Intention Inference for Human-Robot Collaboration in Assistive Robotics
Ravichandar, H. C., & Dani, A. (2017) · Human Modelling for Bio-Inspired Robotics · doi:10.1016/b978-0-12-803137-7.00007-0 · Cited by 5
Metadata
- Authors
- Bartlett, M. S., Littlewort, G., Fasel, I., & Movellan, J. R.
- Venue
- 2003 Conference on Computer Vision and Pattern Recognition Workshop
- Publisher
- IEEE
- Published
- 2003-06
- Pages
- 53-53
- OpenAlex
- W2115941714
- Cited by
- 573
- References
- 16
- FWCI
- 29.22
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.