The DOI matches its Crossref record; 23 of the 24 references it cites were found in a registry or an index.
Learning Bayesian network classifiers for facial expression recognition both labeled and unlabeled data
Abstract
Understanding human emotions is one of the necessary skills for the computer to interact intelligently with human users. The most expressive way humans display emotions is through facial expressions. In this paper, we report on several advances we have made in building a system for classification of facial expressions from continuous video input. We use Bayesian network classifiers for classifying expressions from video. One of the motivating factor in using the Bayesian network classifiers is their ability to handle missing data, both during inference and training. In particular, we are interested in the problem of learning with both labeled and unlabeled data. We show that when using unlabeled data to learn classifiers, using correct modeling assumptions is critical for achieving improved classification performance. Motivated by this, we introduce a classification driven stochastic structure search algorithm for learning the structure of Bayesian network classifiers. We show that with moderate size labeled training sets and large amount of unlabeled data, our method can utilize unlabeled data to improve classification performance. We also provide results using the Naive Bayes (NB) and the Tree-Augmented Naive Bayes (TAN) classifiers, showing that the two can achieve good performance with labeled training sets, but perform poorly when unlabeled data are added to the training set.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Maximum Likelihood from Incomplete Data Via the EM Algorithm
Dempster, A. P., Laird, N. M., & Rubin, D. B. (1977) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1977.tb01600.x · Cited by 50,444
Equation of State Calculations by Fast Computing Machines
Metropolis, N., Rosenbluth, A. W., Rosenbluth, M. N., Teller, A. H., & Teller, E. (1953) · The Journal of Chemical Physics · doi:10.1063/1.1699114 · Cited by 37,192
(1988) · Cited by 16,582
UCI Repository of machine learning databases
Blake, C. L. (1998) · Medical Entomology and Zoology · Cited by 10,582
Friedman, N., Geiger, D., & Goldszmidt, M. (1997) · Machine Learning · doi:10.1023/a:1007465528199 · Cited by 4,742
A Bayesian Method for the Induction of Probabilistic Networks from Data
Cooper, G. F., & Herskovits, E. H. (1992) · Machine Learning · doi:10.1023/a:1022649401552 · Cited by 4,241
Probabilistic Reasoning in Intelligent Systems
(1988) · Elsevier eBooks · doi:10.1016/c2009-0-27609-4 · Cited by 3,371
Text classification from labeled and unlabeled documents using EM
Nigam, K., Mccallum, A. K., Thrun, S., & Mitchell, T. (2000) · Machine Learning · doi:10.1023/a:1007692713085 · Cited by 2,736
Comprehensive database for facial expression analysis
Takeo Kanade, A., Cohn, J. F., & Tian, Y. (2002) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/afgr.2000.840611 · Cited by 2,644
Automatic analysis of facial expressions: the state of the art
Pantie, M., & Rothkrantz, L. J. M. (2000) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.895976 · Cited by 1,778 · cited 1×
“Recent work on facial expression analysis has used these “basic expressions” or a subset of them (see Pantic and Rothkrantz’s [19] detailed review of many of the research done in recent years).”
Method
Flagged first, then by citations
1 of the 24 references couldn’t be matched to a known paper.
Research works printed but not linked: 4
- 10.1037/0033-2909.115.2.268 · DOI · Paper page
- ekman, 1978, Facial action coding system investigator's guide
- meila, 1999, Learning with mixtures of trees
- 10.1007/BF00994110 · DOI
Cited by
Sorted by citations
Items 101–155 of 155
Automated Real Time Emotion Recognition Using Facial Expression Analysis
Fratesi, A. (2016) · Carleton University's Institutional Repository (MacOdrum Library, Carleton University) · doi:10.22215/etd/2016-11318 · Cited by 5
FACIAL EXPRESSION CLASSIFICATION WITH HAAR FEATURES, GEOMETRIC FEATURES AND CUBIC BÉZIER CURVES
Kandemir, R., & Özmen, G. (2013) · DergiPark (Istanbul University) · Cited by 4
Learning from essential facial parts and local features for automatic facial expression recognition
Ji, Y., & Idrissi, K. (2010) · International Workshop on Content-Based Multimedia Indexing (CBMI) · doi:10.1109/cbmi.2010.5529888 · Cited by 4
Ye, B., Shu, H., Cao, M., Zeng, F., Qiu, G., Dong, J., Zhang, W., & Shan, J. (2014) · Mathematical Problems in Engineering · doi:10.1155/2014/405707 · Cited by 4
VLSI Hardware Architecture of Real Time Pattern Classification using Naïve Bayes Classifier
Chaudhary, P., & Sharma, M. K. (2017) · International Conference on Multimedia Systems and Signal Processing (ICMSSP) · doi:10.1145/3145511.3145521 · Cited by 4
A Bayesian approach to recognise facial expressions using vector flows
Sun, X., Rothkrantz, L. J. M., Datcu, D., & Wiggers, P. (2009) · International Conference on Computer Systems and Technologies (CompSysTech) · doi:10.1145/1731740.1731772 · Cited by 4
An adaptive learning model based genetic for facial expression recognition
Jamshidnezhad, A. (2012) · International Journal of the Physical Sciences · doi:10.5897/ijps11.975 · Cited by 4
Learning based on kernel discriminant-EM algorithm for image classification
Tian, Q., Yu, J., Wu, Y., & Huang, T. S. (2004) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2004.1327147 · Cited by 4
Self-citationImproving Visual Awareness by Real-Time 2D Facial Animation for Ubiquitous Collaboration
Jiang, B., Bu, J., & Chen, C. (2007) · International Conference on Computer Supported Cooperative Work in Design (CSCWD) · doi:10.1109/cscwd.2007.4281426 · Cited by 4
Semi-supervised training of models for appearance-based statistical object detection methods
Rosenberg, C. J., Hebert, M., & Thrun, S. (2004) · Cited by 4
FAMOS: a framework for investigating the use of face features to identify spontaneous emotions
Costa‐Abreu, M. D., & Bezerra, G. S. (2017) · Pattern Analysis and Applications · doi:10.1007/s10044-017-0675-y · Cited by 3
Dynamic facial expression recognition with pseudo‐label guided multi‐modal pre‐training
Yin, B., Yin, S. N., Liu, C., Zhang, Y., Xi, C., Yin, B., & Ling, Z.-H. (2023) · IET Computer Vision · doi:10.1049/cvi2.12217 · Cited by 3
Sketch Based Facial Expression Recognition Using Graphics Hardware
Bu, J., Song, M., Wu, Q., Chen, C., & Jin, C. (2005) · Lecture notes in computer science · doi:10.1007/11573548_10 · Cited by 3
Quantitative intensity analysis of facial expressions using HMM and linear regression
Wu, J. B., & Xiao, S. (2014) · ACM SIGGRAPH International Conference on Virtual-Reality Continuum and its Applications in Industry (VRCAI) · doi:10.1145/2670473.2670501 · Cited by 3
Vision-based short range interaction between a personal service robot and a user
Siddiqui, M., Liao, W.-K., & Medioni, G. (2009) · Intelligent Service Robotics · doi:10.1007/s11370-009-0041-z · Cited by 3
Prioritizing Health Promotion Plans with k-Bayesian Network Classifier
Ueno, K., Hayashi, T., Iwata, K., Honda, N., Kitahara, Y., & Paul, T. K. (2008) · International Conference on Machine Learning and Applications · doi:10.1109/icmla.2008.117 · Cited by 3
Comparing Bayesian Networks to Classify Facial Expressions
Simplício, C., Prado, J., & Dias, J. M. M. (2010) · doi:10.2316/p.2010.706-065 · Cited by 3
Rázuri, J. G. (2015) · DiVA (Stockholm University) · Cited by 3
Facial expression recognition based on local directional number pattern and ANFIS classifier
Arivazhagan, S., Priyadharshini, R. A., & Sowmiya, S. (2014) · International Conference on Communication and Network Technologies (ICCNT) · doi:10.1109/cnt.2014.7062726 · Cited by 3
Hazra, S., Pratap, A. A., & Nandy, A. (2022) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2022.3222087 · Cited by 3
A Bayesian Network (BN) Based Probabilistic Solution to Enhance Emotional Ontology
Zhang, X., Cao, D., Moore, P. T., Chen, J., Zhou, L., Zhou, Y., & Ma, X. (2012) · Lecture notes in electrical engineering · doi:10.1007/978-94-007-5086-9_24 · Cited by 3
Bayesian Networks for Interpretable Cyberattack Detection
Yang, B., Hoffman, M., & Brown, N. (2023) · Hawaii International Conference on System Sciences (HICSS) · doi:10.24251/hicss.2023.154 · Cited by 2
Hammal, Z. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-24028-7_54 · Cited by 2
Linear Subspace Learning for Facial Expression Analysis
Shan, C. (2009) · BiblioBoard Library Catalog (Open Research Library) · doi:10.5772/6558 · Cited by 2
Semi‐supervised classification of facial expression using a mixture of multivariatetdistributions
Wang, H. (2010) · Expert Systems · doi:10.1111/j.1468-0394.2010.00539.x · Cited by 2
Review of Literature—Analysis and Detection of Stress Using Facial Images
Harbola, A., & Jaswal, R. A. (2019) · Algorithms for intelligent systems · doi:10.1007/978-981-15-0633-8_97 · Cited by 3
Dube, L., & Verster, T. (2024) · Orion/ORiON · doi:10.5784/40-1-767 · Cited by 2
Overview of Biomedical Image Understanding Methods
Xiong, W., Cheng, J., Gu, Y., Li, S., & Lim, J.-H. (2015) · doi:10.1002/9781118715321.ch1 · Cited by 2
EigenExpress Approach in Recognition of Facial Expression Using GPU
Wu, Q., Song, M., Bu, J., & Chen, C. (2006) · Lecture notes in computer science · doi:10.1007/11754336_2 · Cited by 1
Face recognition using facial expression: a novel approach
Singh, D. K., Gupta, P., & Tiwary, U. S. (2008) · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · doi:10.1117/12.777592 · Cited by 1
Generalized discriminant analysis in content-based image retrieval
Tian, Q., & Yu, J. (2007) · Cited by 1
Edge detection for facial expression recognition.
García-Ramírez, J., Olmos-Pineda, I., Olvera-López, J. A., & Ortiz, M. M. (2016) · Cited by 1
Bayesian Rationality Revisited: Integrating Order Effects
Uzan, P. (2022) · Foundations of Science · doi:10.1007/s10699-022-09838-0 · Cited by 1
Zhang, J., Shimonishi, K., Kondo, K., & Nakamura, Y. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-06053-3_40 · Cited by 1
Facial expression recognition via a jointly-learned dual-branch network
Bordjiba, Y., Merouani, H. F., & Azizi, N. (2022) · International journal of electrical and computer engineering systems · doi:10.32985/ijeces.13.6.4 · Cited by 1
RECOGNITION OF FACIAL EXPRESSION BY IMAGE PROCESSING AND RADIAL BASIS FUNCTION NETWORK
Capeli, O. M., Cabral, E. F., Isotani, S., & de Albuquerque, A. R. P. L. (2016) · Congresso Brasileiro de Redes Neurais (CBRN) · doi:10.21528/cbrn2009-009 · Cited by 1
Density-Based Geometric One-Class Classifier Combined with Genetic Algorithm
Kim, D. G., & Choi, J. Y. (2022) · Mathematical Problems in Engineering · doi:10.1155/2022/7852456 · Cited by 1
Hammal, Z., Arguin, M., & Gosselin, F. (2007) · Springer eBooks · doi:10.1007/978-3-540-76858-6_50 · Cited by 1
Deep Multi-Facial patches Aggregation Network for Expression Classification from Face ImagesPreprint
Djerghri, A., Hazourli, A. R., & Othmani, A. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1909.10305 · Cited by 1
An ensemble of Density based Geometric One-Class Classifier and Genetic AlgorithmPreprint
Kim, D. G., & Choi, J. Y. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2011.06388 · Cited by 1
Optical flow-based facial feature tracking to recognize AUs modeled by Bayesian networks
Sun, X. (2009) · Research Repository (Delft University of Technology)
Supporting Ubiquitous Collaboration with Real-Time Facial Animation
Jiang, B. (2008) · Lecture notes in computer science · doi:10.1007/978-3-540-92719-8_5
Weakly-Labeled Data and Identity-Normalization for Facial Image Analysis
Rim, D. (2013) · PolyPublie (École Polytechnique de Montréal)
A Learning Model for Fuzzy Classification System
Jamshidnezhad, A., Nordin, M. J., & Ehsan, S. D. (2011) · Journal of academic and applied studies
Real-time Facial Expression Recognition Based on Boosted Embedded Hidden
Zhou, X., Huang, X., & Wang, Y. (2004)
Thresholding Approach based on GPU for Facial Expression Recognition
García-Ramírez, J., Olvera-López, J. A., Olmos-Pineda, I., Becerra, G. F., & Rico, A. A. (2016) · Research in Computing Science · doi:10.13053/rcs-112-1-4
Semi-supervised Bayesian learning
Guo, Y. (2012)
Missing Data Analysis in Emotion Recognition for Smart Applications
Gorbulin, A., Dahanayake, A., & Zudilova, T. V. (2018) · Communications in computer and information science · doi:10.1007/978-3-030-00063-9_21
Literature Survey and Datasets
Poria, S., Hussain, A., & Cambria, E. (2018) · Socio-affective computing · doi:10.1007/978-3-319-95020-4_3
최형일 (2013) · International Conference on Cognitive Modelling
Kumar, J. C. R. (2021)
Xiao, Q., & Quan, C. (2026) · Machine Learning and Knowledge Extraction · doi:10.3390/make8070175
An adaptive heuristic model for optimizing the fuzzy expressions classification
Jamshidnezhad, A., & Nordin, J. M. (2010) · Systems Science
Metadata
- Authors
- Cohen, I., Sebe, N., Gozman, F. G., Cirelo, M. C., & Huang, T. S.
- Affiliations
- University of Illinois Urbana-Champaign (US)
- Leiden University (NL)
- Universidade de São Paulo (BR)
- ORCID
- Venue
- 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings.
- Publisher
- IEEE Comput. Soc
- Published
- 2003-11-21
- Pages
- I-595-I-601
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W2141522145
- Cited by
- 155
- References
- 24
- Citations by year
- 2026: 1 · 2024: 2 · 2023: 4 · 2022: 5 · 2021: 3 · 2020: 7 · 2019: 5 · 2018: 9 · 2017: 5 · 2016: 12 · 2015: 4 · 2014: 10 · 2013: 6 · 2012: 9
- FWCI
- 8.57
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings (publishedVersion)
- Funders
- National Science Foundation
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Bayesian Modeling and Causal Inference
- Physical Sciences › Computer Science › Artificial Intelligence › Emotion and Mood Recognition
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Face and Expression Recognition
- Keywords
- facial expression recognition, Bayesian network classifiers, semi-supervised learning, unlabeled data, structure learning, missing data, naive Bayes, tree augmented naive Bayes, emotion recognition
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review