The DOI matches its Crossref record; 23 of the 24 references it cites were found in a registry or an index.
Learning Bayesian network classifiers for facial expression recognition both labeled and unlabeled data
Abstract
Understanding human emotions is one of the necessary skills for the computer to interact intelligently with human users. The most expressive way humans display emotions is through facial expressions. In this paper, we report on several advances we have made in building a system for classification of facial expressions from continuous video input. We use Bayesian network classifiers for classifying expressions from video. One of the motivating factor in using the Bayesian network classifiers is their ability to handle missing data, both during inference and training. In particular, we are interested in the problem of learning with both labeled and unlabeled data. We show that when using unlabeled data to learn classifiers, using correct modeling assumptions is critical for achieving improved classification performance. Motivated by this, we introduce a classification driven stochastic structure search algorithm for learning the structure of Bayesian network classifiers. We show that with moderate size labeled training sets and large amount of unlabeled data, our method can utilize unlabeled data to improve classification performance. We also provide results using the Naive Bayes (NB) and the Tree-Augmented Naive Bayes (TAN) classifiers, showing that the two can achieve good performance with labeled training sets, but perform poorly when unlabeled data are added to the training set.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Maximum Likelihood from Incomplete Data Via the EM Algorithm
Dempster, A. P., Laird, N. M., & Rubin, D. B. (1977) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1977.tb01600.x · Cited by 50,444
Equation of State Calculations by Fast Computing Machines
Metropolis, N., Rosenbluth, A. W., Rosenbluth, M. N., Teller, A. H., & Teller, E. (1953) · The Journal of Chemical Physics · doi:10.1063/1.1699114 · Cited by 37,192
(1988) · Cited by 16,582
UCI Repository of machine learning databases
Blake, C. L. (1998) · Medical Entomology and Zoology · Cited by 10,582
Friedman, N., Geiger, D., & Goldszmidt, M. (1997) · Machine Learning · doi:10.1023/a:1007465528199 · Cited by 4,742
A Bayesian Method for the Induction of Probabilistic Networks from Data
Cooper, G. F., & Herskovits, E. H. (1992) · Machine Learning · doi:10.1023/a:1022649401552 · Cited by 4,241
Probabilistic Reasoning in Intelligent Systems
(1988) · Elsevier eBooks · doi:10.1016/c2009-0-27609-4 · Cited by 3,371
Text classification from labeled and unlabeled documents using EM
Nigam, K., Mccallum, A. K., Thrun, S., & Mitchell, T. (2000) · Machine Learning · doi:10.1023/a:1007692713085 · Cited by 2,736
Comprehensive database for facial expression analysis
Takeo Kanade, A., Cohn, J. F., & Tian, Y. (2002) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/afgr.2000.840611 · Cited by 2,644
Automatic analysis of facial expressions: the state of the art
Pantie, M., & Rothkrantz, L. J. M. (2000) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.895976 · Cited by 1,778 · cited 1×
“Recent work on facial expression analysis has used these “basic expressions” or a subset of them (see Pantic and Rothkrantz’s [19] detailed review of many of the research done in recent years).”
MethodCooling Schedules for Optimal Annealing
Hajek, B. (1988) · Mathematics of Operations Research · doi:10.1287/moor.13.2.311 · Cited by 1,258
Strong evidence for universals in facial expressions: A reply to Russell's mistaken critique.
Ekman, P. (1994) · Psychological Bulletin · doi:10.1037//0033-2909.115.2.268 · Cited by 1,130
Bayesian Graphical Models for Discrete Data
Madigan, D., York, J., & Allard, D. (1995) · International Statistical Review / Revue Internationale de Statistique · doi:10.2307/1403615 · Cited by 1,090
Facial expression recognition from video sequences: temporal and static modeling
Cohen, I., Sebe, N., Garg, A., Chen, L. S., & Huang, T. S. (2003) · Computer Vision and Image Understanding · doi:10.1016/s1077-3142(03)00081-x · Cited by 874
Self-citationLearning from Labeled and Unlabeled Data
Sammut, C., & Webb, G. I. (2017) · Encyclopedia of Machine Learning and Data Mining · doi:10.1007/978-1-4899-7687-1_100253 · Cited by 462
A probability analysis on the value of unlabeled data for classification problems
Zhang, T., & Oles, F. J. (2000) · Rare & Special e-Zone (The Hong Kong University of Science and Technology) · Cited by 203
Unlabeled Data Can Degrade Classification Performance of Generative Classifiers
Cozman, F. G., & Cohen, I. L. (2002) · Cited by 131
Self-citationHuang, T. S., & Chen, L. S.-H. (2000) · Cited by 108
Self-citationLearning with Labeled and Unlabeled Data
Seeger, M. (2001) · Cited by 108
Facial expression recognition from video sequences
Cohen, I., Sebe, N., Garg, A., Lew, M. S., & Huang, T. S. (2003) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme.2002.1035527 · Cited by 90
Self-citationProbabilistic Modeling for Face Orientation Discrimination: Learning from Labeled and Unlabeled Data
Baluja, S. (1998) · Cited by 88
Connected vibrations: a modal analysis approach for non-rigid motion tracking
Hai, T., & Huang, T. S. (2002) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.1998.698685 · Cited by 74
Self-citationThe relative value of labeled and unlabeled samples in pattern recognition
Castelli, V., & Cover, T. M. (2005) · IEEE International Symposium on Information Theory (ISIT) · doi:10.1109/isit.1993.748671 · Cited by 23
Flagged first, then by citations
1 of the 24 references couldn’t be matched to a known paper.
Research works printed but not linked: 4
- 10.1037/0033-2909.115.2.268 · DOI · Paper page
- ekman, 1978, Facial action coding system investigator's guide
- meila, 1999, Learning with mixtures of trees
- 10.1007/BF00994110 · DOI
Cited by
Sorted by citations
Chapelle, O., Schölkopf, B., & Zien, A. (2006) · The MIT Press eBooks · doi:10.7551/mitpress/9780262033589.001.0001 · Cited by 4,642
A review of affective computing: From unimodal analysis to multimodal fusion
Poria, S., Cambria, E., Bajpai, R., & Hussain, A. (2017) · Information Fusion · doi:10.1016/j.inffus.2017.02.003 · Cited by 1,644
Recognizing Facial Expression: Machine Learning and Application to Spontaneous Behavior
Bartlett, M. S., Littlewort, G. C., Frank, M. G., Lainscsek, C. S. M., Fasel, I., & Movellan, J. R. (2005) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2005.297 · Cited by 643
One-class classification: taxonomy of study and review of techniques
Khan, S. S., & Madden, M. G. (2014) · The Knowledge Engineering Review · doi:10.1017/s026988891300043x · Cited by 629
A survey of sentiment analysis in social media
Yue, L., Chen, W., Li, X., Zuo, W., & Yin, M. (2018) · Knowledge and Information Systems · doi:10.1007/s10115-018-1236-4 · Cited by 594
Metadata
- Authors
- Cohen, I., Sebe, N., Gozman, F. G., Cirelo, M. C., & Huang, T. S.
- Affiliations
- University of Illinois Urbana-Champaign (US)
- Leiden University (NL)
- Universidade de São Paulo (BR)
- ORCID
- Venue
- 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings.
- Publisher
- IEEE Comput. Soc
- Published
- 2003-11-21
- Pages
- I-595-I-601
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W2141522145
- Cited by
- 155
- References
- 24
- Citations by year
- 2026: 1 · 2024: 2 · 2023: 4 · 2022: 5 · 2021: 3 · 2020: 7 · 2019: 5 · 2018: 9 · 2017: 5 · 2016: 12 · 2015: 4 · 2014: 10 · 2013: 6 · 2012: 9
- FWCI
- 8.57
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings (publishedVersion)
- Funders
- National Science Foundation
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Bayesian Modeling and Causal Inference
- Physical Sciences › Computer Science › Artificial Intelligence › Emotion and Mood Recognition
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Face and Expression Recognition
- Keywords
- facial expression recognition, Bayesian network classifiers, semi-supervised learning, unlabeled data, structure learning, missing data, naive Bayes, tree augmented naive Bayes, emotion recognition
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review