The DOI matches its Crossref record; 50 of the 50 references it cites were found in a registry or an index.
Dive into Ambiguity: Latent Distribution Mining and Pairwise Uncertainty Estimation for Facial Expression Recognition
Abstract
Due to the subjective annotation and the inherent interclass similarity of facial expressions, one of key challenges in Facial Expression Recognition (FER) is the annotation ambiguity. In this paper, we proposes a solution, named DMUE, to address the problem of annotation ambiguity from two perspectives: the latent Distribution Mining and the pairwise Uncertainty Estimation. For the former, an auxiliary multi-branch learning framework is introduced to better mine and describe the latent distribution in the label space. For the latter, the pairwise relationship of semantic feature between instances are fully exploited to estimate the ambiguity extent in the instance space. The proposed method is independent to the backbone architectures, and brings no extra burden for inference. The experiments are conducted on the popular real-world benchmarks and the synthetic noisy datasets. Either way, the proposed DMUE stably achieves leading performance.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
MobileNetV2: Inverted Residuals and Linear Bottlenecks
Sandler, M., Howard, A., Zhu, M., Zhmoginov, A., & Chen, L.-C. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00474 · Cited by 28,755
ShuffleNet: An Extremely Efficient Convolutional Neural Network for Mobile Devices
Zhang, X., Zhou, X., Lin, M., & Sun, J. (2017) · arXiv · doi:10.48550/arxiv.1707.01083 · Cited by 9,982
SIFT: predicting amino acid changes that affect protein function
Ng, P. C. (2003) · Nucleic Acids Research · doi:10.1093/nar/gkg509 · Cited by 6,577
AffectNet: A Database for Facial Expression, Valence, and Arousal Computing in the Wild
Mollahosseini, A., Hasani, B., & Mahoor, M. H. (2019) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2017.2740923 · Cited by 2,338
Facial expression recognition based on Local Binary Patterns: A comprehensive study
Shan, C., Gong, S., & McOwan, P. W. (2009) · Image and Vision Computing · doi:10.1016/j.imavis.2008.08.005 · Cited by 2,300
SphereFace: Deep Hypersphere Embedding for Face Recognition
Liu, W., Wen, Y., Yu, Z., Li, M., Raj, B., & Song, L. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.713 · Cited by 2,280
Challenges in Representation Learning: A Report on Three Machine Learning Contests
Goodfellow, I. J., Erhan, D., Carrier, P. L., Courville, A., Mirza, M., Hamner, B., Cukierski, W., Tang, Y., Thaler, D., Lee, D.-H., et al. (2013) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-42051-1_16 · Cited by 1,719
Reliable Crowdsourcing and Deep Locality-Preserving Learning for Expression Recognition in the Wild
Li, S., Deng, W., & Du, J. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.277 · Cited by 1,470
Temporal Ensembling for Semi-Supervised Learning
Laine, S., & Aila, T. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1610.02242 · Cited by 1,395
Similarity-Preserving Knowledge Distillation
Tung, F., & Mori, G. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00145 · Cited by 1,079
Symmetric Cross Entropy for Robust Learning With Noisy Labels
Wang, Y., Ma, X., Chen, Z., Luo, Y., Yi, J., & Bailey, J. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00041 · Cited by 1,046
Region Attention Networks for Pose and Occlusion Robust Facial Expression Recognition
Wang, K., Peng, X., Yang, J., Meng, D., & Qiao, Y. (2020) · IEEE Transactions on Image Processing · doi:10.1109/tip.2019.2956143 · Cited by 940
Training deep networks for facial expression recognition with crowd-sourced label distribution
Barsoum, E., Zhang, C., Ferrer, C. C., & Zhang, Z. (2016) · Proceedings of the 18th ACM International Conference on Multimodal Interaction · doi:10.1145/2993148.2993165 · Cited by 926
Occlusion Aware Facial Expression Recognition Using CNN With Attention Mechanism
Li, Y., Zeng, J., Shan, S., & Chen, X. (2019) · IEEE Transactions on Image Processing · doi:10.1109/tip.2018.2886767 · Cited by 916
Confident Learning: Estimating Uncertainty in Dataset Labels
Northcutt, C., Jiang, L., & Chuang, I. (2021) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.12125 · Cited by 795
Suppressing Uncertainties for Large-Scale Facial Expression Recognition
Wang, K., Peng, X., Yang, J., Lu, S., & Qiao, Y. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00693 · Cited by 772
Benitez-Quiroz, C. F., Srinivasan, R., & Martinez, A. M. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.600 · Cited by 607
Image based Static Facial Expression Recognition with Multiple Deep Network Learning
Yu, Z., & Zhang, C. (2015) · Proceedings of the 2015 ACM on International Conference on Multimodal Interaction · doi:10.1145/2818346.2830595 · Cited by 598
Training deep neural-networks using a noise adaptation layer
Goldberger, J., & Ben-Reuven, E. (2017) · International Conference on Learning Representations · Cited by 579
Static facial expression analysis in tough conditions: Data, evaluation protocol and benchmark
Dhall, A., Goecke, R., Lucey, S., & Gedeon, T. (2011) · 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops) · doi:10.1109/iccvw.2011.6130508 · Cited by 541 · cited 2×
“SFEW [12] contains the images from movies with seven basic emotions, including 958 images for training and 436 images for testing.”
BackgroundMentorNet: Learning Data-Driven Curriculum for Very Deep Neural Networks on Corrupted Labels
Jiang, L., Zhou, Z., Leung, T., Li, L.-J., & Fei-Fei, L. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1712.05055 · Cited by 503
DivideMix: Learning with Noisy Labels as Semi-supervised Learning
Li, J., Socher, R., & Hoi, S. C. H. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.07394 · Cited by 500
Probabilistic End-To-End Noise Correction for Learning With Noisy Labels
Yi, K., & Wu, J. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00718 · Cited by 454
Facial Expression Recognition by De-expression Residue Learning
Yang, H., Ciftci, U., & Yin, L. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00231 · Cited by 439
Meta-Weight-Net: Learning an Explicit Mapping For Sample Weighting
Shu, J., Xie, Q., Yi, L., Zhao, Q., Zhou, S., Xu, Z., & Meng, D. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1902.07379 · Cited by 385
MentorNet: Learning Data-Driven Curriculum for Very Deep Neural Networks on Corrupted Labels
Jiang, L., Zhou, Z., Leung, T., Li, L.-J., & Fei-Fei, L. (2018) · International Conference on Machine Learning · Cited by 371
Facial Expression Recognition with Inconsistently Annotated Datasets
Zeng, J., Shan, S., & Chen, X. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01261-8_14 · Cited by 341
Knowledge Distillation by On-the-Fly Native Ensemble
Xu, L., Zhu, X., & Gong, S. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1806.04606 · Cited by 339
Image classification with deep learning in the presence of noisy labels: A survey
Algan, G., & Ulusoy, I. (2021) · Knowledge-Based Systems · doi:10.1016/j.knosys.2021.106771 · Cited by 337
Shi, Y., & Jain, A. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00700 · Cited by 335
Online Knowledge Distillation with Diverse Peers
Chen, D., Mei, J.-P., Wang, C., Feng, Y., & Chen, C. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i04.5746 · Cited by 324
Island Loss for Learning Discriminative Features in Facial Expression Recognition
Cai, J., Meng, Z., Khan, A. S., Li, Z., OReilly, J., & Tong, Y. (2018) · 2018 13th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2018) · doi:10.1109/fg.2018.00051 · Cited by 321
Data Uncertainty Learning in Face Recognition
Chang, J., Lan, Z., Cheng, C., & Wei, Y. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00575 · Cited by 320
Adaptive Wing Loss for Robust Face Alignment via Heatmap Regression
Wang, X., Bo, L., & Fuxin, L. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00707 · Cited by 313
Deep Self-Learning From Noisy Labels
Han, J., Luo, P., & Wang, X. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00524 · Cited by 313
Emotion Recognition in Speech using Cross-Modal Transfer in the Wild
Albanie, S., Nagrani, A., Vedaldi, A., & Zisserman, A. (2018) · Proceedings of the 26th ACM international conference on Multimedia · doi:10.1145/3240508.3240578 · Cited by 290
Label Distribution Learning on Auxiliary Label Space Graphs for Facial Expression Recognition
Chen, S., Wang, J., Chen, Y., Shi, Z., Geng, X., & Rui, Y. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01400 · Cited by 229
Self-citationUncertainty-Aware Score Distribution Learning for Action Quality Assessment
Tang, Y., Ni, Z., Zhou, J., Zhang, D., Lu, J., Wu, Y., & Zhou, J. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00986 · Cited by 209
Frame Attention Networks for Facial Expression Recognition in Videos
Meng, D., Peng, X., Wang, K., & Qiao, Y. (2019) · 2019 IEEE International Conference on Image Processing (ICIP) · doi:10.1109/icip.2019.8803603 · Cited by 196
Covariance Pooling for Facial Expression Recognition
Acharya, D., Huang, Z., Paudel, D. P., & Van Gool, L. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2018.00077 · Cited by 181
Peer Collaborative Learning for Online Knowledge Distillation
Wu, G., & Gong, S. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i12.17234 · Cited by 174
Noise-Tolerant Paradigm for Training Face Recognition CNNs
Hu, W., Huang, Y., Zhang, F., & Li, R. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.01216 · Cited by 90
Identity- and Pose-Robust Facial Expression Recognition through Adversarial Feature Learning
Wang, C., Wang, S., & Liang, G. (2019) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3343031.3350872 · Cited by 90
Recognizing facial actions using gabor wavelets with neutral face average difference
Bazzo, J. J., & Lamar, M. V. (2004) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/afgr.2004.1301583 · Cited by 77
Combining convolutional neural networks for emotion recognition
Huang, C. (2017) · IEEE MIT Undergraduate Research Technology Conference (URTC) · doi:10.1109/urtc.2017.8284175 · Cited by 65
Xu, N., Shu, J., Zheng, R., Geng, X., Meng, D., & Zhang, M.-L. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3203678 · Cited by 61
Hu, Y., Wu, X., & He, R. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58555-6_8 · Cited by 59
Self-citationLearning an Evolutionary Embedding via Massive Knowledge Distillation
Wu, X., He, R., Hu, Y., & Sun, Z. (2020) · International Journal of Computer Vision · doi:10.1007/s11263-019-01286-x · Cited by 37
Self-citationCAKE: Compact and Accurate K-dimensional representation of EmotionPreprint
Kervadec, C., Vielzeuf, V., Pateux, S., Lechervy, A., & Jurie, F. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1807.11215 · Cited by 32
Towards a General Model of Knowledge for Facial Analysis by Multi-Source Transfer LearningPreprint
Vielzeuf, V., Lechervy, A., Pateux, S., & Jurie, F. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1911.03222 · Cited by 5
Cited by
Face2Exp: Combating Data Biases for Facial Expression Recognition
Zeng, D., Lin, Z., Yan, X., Liu, Y., Wang, F., & Tang, B. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01965 · Cited by 141
“DMUE [26] introduces an auxiliary multi-branch learning for latent distri-”
BackgroundMethodInfluentialAdaptive Multilayer Perceptual Attention Network for Facial Expression Recognition
Liu, H., Cai, H., Lin, Q., Li, X., & Xiao, H. (2022) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2022.3165321 · Cited by 129
A Hybrid Explainable AI Framework Applied to Global and Local Facial Expression Recognition
Deramgozin, M., Jovanovic, S., Rabah, H., & Ramzan, N. (2021) · 2021 IEEE International Conference on Imaging Systems and Techniques (IST) · doi:10.1109/ist50367.2021.9651357 · Cited by 22
SAFER: Situation Aware Facial Emotion Recognition
Palash, M., & Bhargava, B. (2023) · arXiv · doi:10.48550/arxiv.2306.09372 · Cited by 2
“[23] used latent distribution mining and pairwise uncertainty estimation for facial emotion recognition.”
Method
Metadata
- Authors
- She, J., Hu, Y., Shi, H., Wang, J., Shen, Q., & Mei, T.
- Venue
- 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
- Publisher
- IEEE
- Published
- 2021-06
- Pages
- 6244-6253
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W3173787706
- Cited by
- 264
- References
- 50
- FWCI
- 51.98
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.