The DOI matches its Crossref record; 305 of the 305 references it cites were found in a registry or an index.
Deep Facial Expression Recognition: A Survey
Open accessAbstract
With the transition of facial expression recognition (FER) from laboratory-controlled to challenging in-the-wild conditions and the recent success of deep learning techniques in various fields, deep neural networks have increasingly been leveraged to learn discriminative representations for automatic FER. Recent deep FER systems generally focus on two important issues: overfitting caused by a lack of sufficient training data and expression-unrelated variations, such as illumination, head pose, and identity bias. In this survey, we provide a comprehensive review of deep FER, including datasets and algorithms that provide insights into these intrinsic problems. First, we introduce the available datasets that are widely used in the literature and provide accepted data selection and evaluation principles for these datasets. We then describe the standard pipeline of a deep FER system with the related background knowledge and suggestions for applicable implementations for each stage. For the state-of-the-art in deep FER, we introduce existing novel deep neural networks and related training strategies that are designed for FER based on both static images and dynamic image sequences and discuss their advantages and limitations. Competitive performances and experimental comparisons on widely used benchmarks are also summarized. We then extend our survey to additional related issues and application scenarios. Finally, we review the remaining challenges and corresponding opportunities in this field as well as future directions for the design of robust deep FER systems.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Items 201–305 of 305
Kim, B.-K., Lee, H., Roh, J., & Lee, S.-Y. (2015) · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION · doi:10.1145/2818346.2830590 · Cited by 145
ExpNet: Landmark-Free, Deep, 3D Facial Expressions
Chang, F.-J., Tran, A. T., Hassner, T., Masi, I., Nevatia, R., & Medioni, G. G. (2018) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/fg.2018.00027 · Cited by 143
Recognizing Action Units for Facial Expression Analysis
Tian, Y., Takeo Kanade, A., & Colin, J. F. (2002) · Series in machine perception and artificial intelligence · doi:10.1142/9789812778543_0002 · Cited by 140
A Compact Embedding for Facial Expression Similarity
Vemulapalli, R., & Agarwala, A. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00583 · Cited by 137
AVEC 2016 - Depression, Mood, and Emotion Recognition Workshop and ChallengePreprint
Valstar, M., Gratch, J. S., Schuller, B. W., Ringeval, F., Lalanne, D., Torres, M. T., Scherer, S. J., Stratou, G., Cowie, R., & Pantić, M. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1605.01600 · Cited by 133
Cost-Sensitive Local Binary Feature Learning for Facial Age Estimation
Lu, J., Liong, V. E., & Zhou, J. (2015) · IEEE Transactions on Image Processing · doi:10.1109/tip.2015.2481327 · Cited by 130
Yang, H., Zhang, Z., & Yin, L. (2018) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/fg.2018.00050 · Cited by 124
VGAN-Based Image Representation Learning for Privacy-Preserving Facial Expression Recognition
Chen, J., Konrad, J., & Ishwar, P. (2018) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2018.00207 · Cited by 124
Facial Expression Recognition with Faster R-CNN
Li, J., Zhang, D., Zhang, J., Zhang, J., Li, T., Xia, Y., Yan, Q. Y., & Xun, L. (2017) · Procedia Computer Science · doi:10.1016/j.procs.2017.03.069 · Cited by 122
Deep spatial-temporal feature fusion for facial expression recognition in static images
Sun, N., Li, Q., Huan, R., Liu, J., & Han, G. (2017) · Pattern Recognition Letters · doi:10.1016/j.patrec.2017.10.022 · Cited by 122
Facial expression recognition via deep learning
Lv, Y., Feng, Z., & Xu, C. (2014) · 2014 International Conference on Smart Computing · doi:10.1109/smartcomp.2014.7043872 · Cited by 122
Kim, B.-K., Dong, S.-Y., Roh, J., Kim, G., & Lee, S.-Y. (2016) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2016.187 · Cited by 121
4DFAB: A Large Scale 4D Database for Facial Expression Analysis and Biometric Applications
Cheng, S., Kotsia, I., Pantić, M., & Zafeiriou, S. P. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00537 · Cited by 117
HoloNet: towards robust emotion recognition in the wild
Yao, A., Cai, D., Hu, P., Wang, S., Sha, L., & Chen, Y. (2016) · Proceedings of the 18th ACM International Conference on Multimodal Interaction · doi:10.1145/2993148.2997639 · Cited by 115
Multi-task Learning of Facial Landmarks and Expression
DeVries, T., Biswaranjan, K., & Taylor, G. W. (2014) · Canadian Conference on Computer and Robot Vision · doi:10.1109/crv.2014.21 · Cited by 115
Cross-Database Facial Expression Recognition Based on Fine-Tuned Deep Convolutional Network
Zavarez, M. V., Berriel, R. F., & Oliveira-Santos, T. (2017) · SIBGRAPI Conference on Graphics, Patterns and Images (SIBGRAPI) · doi:10.1109/sibgrapi.2017.60 · Cited by 115
A visual attention based ROI detection method for facial expression recognition
Sun, W., Zhao, H., & Jin, Z. (2018) · Neurocomputing · doi:10.1016/j.neucom.2018.03.034 · Cited by 114
Challenges in Representation Learning: A report on three machine learning contestsPreprint
Goodfellow, I., Erhan, D., Carrier, P. L., Courville, A. C., Mirza, M., Hamner, B., Cukierski, W., Tang, Y., Thaler, D., Lee, D., et al. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1307.0414 · Cited by 114
Lai, Y.-H., & Lai, S. (2018) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/fg.2018.00046 · Cited by 113
Supervised Committee of Convolutional Neural Networks in Automated Facial Expression Analysis
Pons, G., & Masip, D. (2017) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2017.2753235 · Cited by 110
Robust face analysis using convolutional neural networks
Fasel, B. (2003) · doi:10.1109/icpr.2002.1048231 · Cited by 108
Hasani, B., & Mahoor, M. H. (2017) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/fg.2017.99 · Cited by 108
Uddin, M. Z., Hassan, M. M., Almogren, A., Zuair, M., Fortino, G., & Tørresen, J. (2017) · Computers & Electrical Engineering · doi:10.1016/j.compeleceng.2017.04.019 · Cited by 103
Multi angle optimal pattern-based deep learning for automatic facial expression recognition
Jain, D. K., Zhang, Z., & Huang, K. (2017) · Pattern Recognition Letters · doi:10.1016/j.patrec.2017.06.025 · Cited by 103
Deep learning for real-time robust facial expression recognition on a smartphone
Song, I., Kim, H., & Jeon, P. B. (2014) · International Conference on Consumer Electronics · doi:10.1109/icce.2014.6776135 · Cited by 102
Adaptive Feature Mapping for Customizing Deep Learning Based Facial Expression Recognition Model
Wu, B., & Lin, C.-H. (2018) · IEEE Access · doi:10.1109/access.2018.2805861 · Cited by 100
3D Guided Fine-Grained Face Manipulation
Geng, Z., Cao, C., & Tulyakov, S. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.01005 · Cited by 99
Finding Celebrities in Billions of Web Images
Zhang, X., Zhang, L., Wang, X., & Shum, H. (2012) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2012.2186121 · Cited by 98
Deep generative-contrastive networks for facial expression recognitionPreprint
Kim, Y., Yoo, B., Kwak, Y., Choi, C., & Kim, J. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1703.07140 · Cited by 97
Conditional convolution neural network enhanced random forest for facial expression recognition
Liu, Y., Yuan, X., Gong, X., Xie, Z., Fang, F., & Luo, Z. (2018) · Pattern Recognition · doi:10.1016/j.patcog.2018.07.016 · Cited by 97
Generating Facial Expressions with Deep Belief Nets
Joshua, M., Geoffrey, E., Javier, R. A. V., & Adam, K. (2008) · doi:10.5772/6167 · Cited by 95
Spatio-Temporal Convolutional Sparse Auto-Encoder for Sequence Classification
Baccouche, M., Mamalet, F., Wolf, C., García, C., & Baskurt, A. M. (2012) · British Machine Vision Conference (BMVC) · doi:10.5244/c.26.124 · Cited by 95
Baseline CNN structure analysis for facial expression recognition
Shin, M., Kim, M., & Kwon, D. (2016) · IEEE RO-MAN · doi:10.1109/roman.2016.7745199 · Cited by 95
Facial Expression Recognition Using Salient Features and Convolutional Neural Network
Uddin, M. Z., Khaksar, W., & Tørresen, J. (2017) · IEEE Access · doi:10.1109/access.2017.2777003 · Cited by 95
Hard negative generation for identity-disentangled facial expression recognition
Liu, X., Kumar, B. V. K. V., Jia, P., & You, J. (2018) · Pattern Recognition · doi:10.1016/j.patcog.2018.11.001 · Cited by 95
Deep Neural Networks with Relativity Learning for facial expression recognition
Guo, Y., Tao, D., Yu, J., Xiong, H., Li, Y., & Tao, D. (2016) · 2016 IEEE International Conference on Multimedia & Expo Workshops (ICMEW) · doi:10.1109/icmew.2016.7574736 · Cited by 93
A Deep Learning Perspective on the Origin of Facial Expressions
Breuer, R., & Kimmel, R. (2017) · arXiv · doi:10.48550/arxiv.1705.01842 · Cited by 92
Audio-visual emotion recognition using deep transfer learning and multiple temporal models
Ouyang, X., Kawaai, S., Goh, E. G. H., Shen, S., Ding, W., Ming, H., & Huang, D. (2017) · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION · doi:10.1145/3136755.3143012 · Cited by 92
Facial Expression Recognition Using Visual Saliency and Deep Learning
Mavani, V., Raman, S., & Miyapuram, K. P. (2017) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2017.327 · Cited by 87
Facial expression recognition based on transfer learning from deep convolutional networks
Xu, M., Cheng, W., Zhao, Q., Ma, L., & Xu, F. (2015) · International Conference on Natural Computation (ICNC) · doi:10.1109/icnc.2015.7378076 · Cited by 85
Deep Spatio-Temporal Features for Multimodal Emotion Recognition
Nguyen, D. H., Nguyen, K., Sridharan, S., Ghasemi, A., Dean, D., & Fookes, C. (2017) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv.2017.140 · Cited by 83
Developing crossmodal expression recognition based on a deep neural model
Barros, P. V. A., & Wermter, S. (2016) · Adaptive Behavior · doi:10.1177/1059712316664017 · Cited by 81
Photorealistic facial expression synthesis by the conditional difference adversarial autoencoder
Zhou, Y., & Shi, B. E. (2017) · International Conference on Affective Computing and Intelligent Interaction and workshops · doi:10.1109/acii.2017.8273626 · Cited by 81
Real-time emotion recognition for gaming using deep convolutional network featuresPreprint
Ouellet, S. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1408.3750 · Cited by 79
Facial expression recognition using deep neural networks
Li, J., & Lam, E. Y. M. (2015) · IEEE International Conference on Imaging Systems and Techniques (IST) · doi:10.1109/ist.2015.7294547 · Cited by 79
Deeper cascaded peak-piloted network for weak expression recognition
Yu, Z., Liu, Q., & Liu, G. (2017) · The Visual Computer · doi:10.1007/s00371-017-1443-0 · Cited by 79
Wan, J., Escalera, S., Anbarjafari, G., Escalante, H. J., Baró, X., Guyon, I., Madadi, M., Allïk, J., Gorbova, J., Lin, C., et al. (2017) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2017.377 · Cited by 79
Semantic Facial Expression Editing using Autoencoded FlowPreprint
Yeh, R. A., Liu, Z., Goldman, D. B., & Agarwala, A. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.09961 · Cited by 78
Automatic Recognition of Facial Displays of Unfelt Emotions
Kulkarni, K., Corneanu, C. A., Ofodile, I., Escalera, S., Baró, X., Hyniewska, S., Allïk, J., & Anbarjafari, G. (2018) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2018.2874996 · Cited by 78
Learning deep facial expression features from image and optical flow sequences using 3D CNN
Zhao, J., Mao, X., & Zhang, J. (2018) · The Visual Computer · doi:10.1007/s00371-018-1477-y · Cited by 76
Generating more realistic images using gated MRF's
Ranzato, M., Mnih, V., & Hinton, G. E. (2010) · neural information processing systems · Cited by 75
Using Synthetic Data to Improve Facial Expression Analysis with 3D Convolutional Networks
Abbasnejad, I., Sridharan, S., Nguyen, D., Denman, S., Fookes, C., & Lucey, S. (2017) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2017.189 · Cited by 75
Feature Selection Mechanism in CNNs for Facial Expression Recognition.
Zhao, S., Cai, H., Liu, H., Zhang, J., & Chen, S. (2018) · British Machine Vision Conference (BMVC) · Cited by 75
Facial expression recognition in the wild based on multimodal texture features
Sun, B., Li, L., Zhou, G., & He, J. (2016) · Journal of Electronic Imaging · doi:10.1117/1.jei.25.6.061407 · Cited by 74
Geometry-Contrastive GAN for Facial Expression TransferPreprint
Qiao, F., Yao, N., Jiao, Z., Li, Z., Chen, H., & Wang, H. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1802.01822 · Cited by 71
Deep Emotion Transfer Network for Cross-database Facial Expression Recognition
Li, S., & Deng, W. (2018) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr.2018.8545284 · Cited by 69
Self-citationModeling Natural Images Using Gated MRFs
Ranzato, M., Mnih, V., Susskind, J. M., & Hinton, G. E. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.29 · Cited by 68
Facial Expression Recognition via Joint Deep Learning of RGB-Depth Map Latent Representations
Oyedotun, O. K., Demisse, G., Shabayek, A. E. R., Aouada, D., & Ottersten, B. (2017) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2017.374 · Cited by 67
Hand-Crafted Feature Guided Deep Learning for Facial Expression Recognition
Zeng, G., Zhou, J., Jia, X., Xie, W., & Shen, L. (2018) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/fg.2018.00068 · Cited by 66
A deep-learning approach to facial expression recognition with candid images
Li, W., Li, M., Su, Z., & Zhu, Z. (2015) · Machine Vision Applications · doi:10.1109/mva.2015.7153185 · Cited by 62
Knyazev, B. A., Shvetsov, R., Efremova, N., & Kuharenko, A. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1711.04598 · Cited by 62
Facial Expression Recognition Based on Deep Learning: A Survey
Zhang, T. (2017) · Advances in intelligent systems and computing · doi:10.1007/978-3-319-69096-4_48 · Cited by 60
Accurate Facial Parts Localization and Deep Learning for 3D Facial Expression Recognition
Jan, A., Ding, H., Meng, H., Chen, L., & Li, H. (2018) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/fg.2018.00075 · Cited by 60
Facial Expression Recognition Using Kinect Depth Sensor and Convolutional Neural Networks
Ijjina, E. P., & Mohan, C. K. (2014) · International Conference on Machine Learning and Applications · doi:10.1109/icmla.2014.70 · Cited by 59
Head-pose invariant facial expression recognition using convolutional neural networks
Fasel, B. (2003) · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION · doi:10.1109/icmi.2002.1167051 · Cited by 59
Combining Multimodal Features within a Fusion Network for Emotion Recognition in the Wild
Sun, B., Li, L., Zhou, G., Wu, X., He, J. Y. D., Yu, L., Li, D., & Wei, Q. (2015) · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION · doi:10.1145/2818346.2830586 · Cited by 57
EmotioNet Challenge: Recognition of facial expressions of emotion in the wildPreprint
Benitez-Quiroz, C. F., Srinivasan, R., Feng, Q., Wang, Y., & Martı́nez, A. M. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1703.01210 · Cited by 57
Multi-Channel Pose-Aware Convolution Neural Networks for Multi-View Facial Expression Recognition
Liu, Y., Zeng, J., Shan, S., & Zheng, Z. (2018) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/fg.2018.00074 · Cited by 55
Video Emotion Recognition with Transferred Deep Feature Encodings
Xu, B., Fu, Y., Jiang, Y.-G., Li, B., & Sigal, L. (2016) · Proceedings of the 2016 ACM on International Conference on Multimedia Retrieval · doi:10.1145/2911996.2912006 · Cited by 53
Audio and face video emotion recognition in the wild using deep neural networks and small datasets
Ding, W., Xu, M., Huang, D., Lin, W., Dong, M., Yu, X., & Li, H. (2016) · Proceedings of the 18th ACM International Conference on Multimodal Interaction · doi:10.1145/2993148.2997637 · Cited by 51
Kim, D. H., Lee, M. K., Choi, D. Y., & Song, B. C. (2017) · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION · doi:10.1145/3136755.3143005 · Cited by 50
Wei, X., Li, H., Sun, J. Z., & Chen, L. (2018) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/fg.2018.00015 · Cited by 49
Deep Learning for Spatio-Temporal Modeling of Dynamic Spontaneous Emotions
Chanti, D. A., & Caplier, A. (2018) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2018.2873600 · Cited by 48
Facial Expression Recognition Using Deep Boltzmann Machine from Thermal Infrared Images
He, S., Wang, S., Lan, W., Fu, H., & Ji, Q. (2013) · International Conference on Affective Computing and Intelligent Interaction and workshops · doi:10.1109/acii.2013.46 · Cited by 45
Lüsi, I., Jacques, J. C. S., Gorbova, J., Baró, X., Escalera, S., Demirel, H., Allïk, J., Ozcinar, C., & Anbarjafari, G. (2017) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/fg.2017.102 · Cited by 45
Modeling multimodal cues in a deep learning-based framework for emotion recognition in the wild
Pini, S., Ahmed, O. B., Cornia, M., Baraldi, L., Cucchiara, R., & Huet, B. (2017) · Proceedings of the 19th ACM International Conference on Multimodal Interaction · doi:10.1145/3136755.3143006 · Cited by 44
Deep learning for facial expression recognition: A step closer to a smartphone that knows your moods
Bazrafkan, S., Nedelcu, T., Filipczuk, P., & Corcoran, P. (2017) · International Conference on Consumer Electronics · doi:10.1109/icce.2017.7889290 · Cited by 43
Multi-clue fusion for emotion recognition in the wild
Yan, J., Zheng, W., Cui, Z., Tang, C., Zhang, T., Zong, Y., & Sun, N. (2016) · Proceedings of the 18th ACM International Conference on Multimodal Interaction · doi:10.1145/2993148.2997630 · Cited by 42
Kumawat, S., Verma, M., & Raman, S. (2019) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2019.00030 · Cited by 42
Pons, G., & Masip, D. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1802.06664 · Cited by 41
Multi-modality Network with Visual and Geometrical Information for Micro Emotion Recognition
Guo, J., Zhou, S., Wu, J., Wan, J., Zhu, X., Lei, Z., & Li, S. Z. (2017) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/fg.2017.103 · Cited by 40
Self-citationDeep Covariance Descriptors for Facial Expression RecognitionPreprint
Otberdout, N., Kacem, A., Daoudi, M., Ballihi, L., & Berretti, S. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1805.03869 · Cited by 40
Fast and Light Manifold CNN based 3D Facial Expression Recognition across Pose Variations
Chen, Z., Huang, D., Wang, Y., & Chen, L. (2018) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3240508.3240568 · Cited by 40
Automatic 4D Facial Expression Recognition Using Dynamic Geometrical Image Network
Li, W., Huang, D., Li, H., & Wang, Y. (2018) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/fg.2018.00014 · Cited by 37
Facial Expression Recognition with Recurrent Neural Networks
Graves, A., Mayer, C., Wimmer, M., Schmidhuber, J., & Radig, B. (2008) · Cited by 36
Understanding how deep neural networks learn face expressions
Mousavi, N., Siqueira, H. L., Barros, P. V. A., Fernandes, B., & Wermter, S. (2016) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2016.7727203 · Cited by 35
Deep peak-neutral difference feature for facial expression recognition
Chen, J., Xu, R., & Liu, L. (2018) · Multimedia Tools and Applications · doi:10.1007/s11042-018-5909-5 · Cited by 34
A Deep Structure for Facial Expression Recognition under Partial Occlusion
Cheng, Y., Jiang, B., & Jia, K. (2014) · 2014 Tenth International Conference on Intelligent Information Hiding and Multimedia Signal Processing · doi:10.1109/iih-msp.2014.59 · Cited by 24
Affective facial computing: Generalizability across domains
Cohn, J. F., Ertuğrul, I. Ö., Chu, W.-S., Girard, J. M., Jeni, L. A., & Hammal, Z. (2018) · Elsevier eBooks · doi:10.1016/b978-0-12-814601-9.00026-2 · Cited by 23
A Novel Dynamic Model Capturing Spatial and Temporal Patterns for Facial Expression Analysis
Wang, S., Zheng, Z., Yin, S. W., Yang, J., & Ji, Q. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2911937 · Cited by 22
SmileNet: Registration-Free Smiling Face Detection In The Wild
Jang, Y., Güneş, H., & Patras, I. (2017) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2017.186 · Cited by 20
Kim, Y.-G., & Huynh, X.-P. (2017) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2017.362 · Cited by 19
Wu, Z., Chen, T., Chen, Y., Zhang, Z., & Liu, G. (2017) · Applied Sciences · doi:10.3390/app7111184 · Cited by 15
Investigating Deep Neural Forests for Facial Expression Recognition
Dapogny, A., & Bailly, K. (2018) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/fg.2018.00099 · Cited by 15
Synthesis of Facial Expressions in Photographs: Characteristics, Approaches, and Challenges
Testa, R. L., Corrêa, C. G., Machado‐Lima, A., & Nunes, F. L. S. (2019) · ACM Computing Surveys · doi:10.1145/3292652 · Cited by 15
Emotion recognition with multimodal features and temporal models
Wang, S., Wang, W., Zhao, J., Chen, S., Jin, Q., Zhang, S., & Qin, Y. (2017) · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION · doi:10.1145/3136755.3143016 · Cited by 14
Gu, G., Kim, S. T., Kim, K. H., Baddar, W. J., & Ro, Y. M. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1711.10267 · Cited by 14
Kaneko, T., Hiramatsu, K., & Kashino, K. (2016) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/2964284.2967236 · Cited by 12
Sabzevari, M., Toosizadeh, S., Rahati, S., & Abrishami, V. (2010) · International Conference on Electronics and Information Engineering · doi:10.1109/iceie.2010.5559797 · Cited by 11
Facial Expression Recognition with deep age
Luo, Z., Chen, J., Takiguchi, T., & Ariki, Y. (2017) · IEEE International Conference on Multimedia & Expo Workshops (ICMEW) · doi:10.1109/icmew.2017.8026251 · Cited by 10
Cui, Z., Xiao, S., Niu, Z., Yan, S., & Zheng, W. (2018) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2828424 · Cited by 10
Learning Spatio-Temporal Features With Partial Expression Sequences for On-the-Fly Prediction
Baddar, W. J., & Ro, Y. M. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.12332 · Cited by 9
Combining Sequential Geometry and Texture Features for Distinguishing Genuine and Deceptive Emotions
Li, L., Baltrušaitis, T., Sun, B., & Morency, L. (2017) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2017.372 · Cited by 8
Color channel-wise recurrent learning for facial expression recognition
Jang, J., Kim, D. H., Kim, H.-I., & Ro, Y. M. (2017) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2017.7952353 · Cited by 6
Relaxed Spatio-Temporal Deep Feature Aggregation for Real-Fake Expression Prediction
Özkan, S., & Akar, G. B. (2017) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2017.366 · Cited by 4
Research works printed but not linked: 6
- Valstar, Induced disgust, happiness and surprise: an addition to the mmi facial expression database
- Susskind, 2010, The toronto face database, Dept. Comput. Sci., Univ. Toronto, Toronto, ON, Canada, Tech. Rep, 3
- De la Torre, Intraface, 1
- 10.1109/ICCV.2015.441 · doi:10.1109/iccv.2015.441
- Shang, Understanding and improving convolutional neural networks via concatenated rectified linear units, 2217
- 10.1109/ICIP.2017.8296442 · doi:10.1109/icip.2017.8296442
Cited by
Region Attention Networks for Pose and Occlusion Robust Facial Expression Recognition
Wang, K., Peng, X., Yang, J., Meng, D., & Qiao, Y. (2020) · IEEE Transactions on Image Processing · doi:10.1109/tip.2019.2956143 · Cited by 940
A Survey of Deep Learning-Based Multimodal Emotion Recognition: Speech, Text, and Face
Lian, H., Lu, C., Li, S., Zhao, Y., Tang, C., & Zong, Y. (2023) · Entropy · doi:10.3390/e25101440 · Cited by 224
Self-citationFacial Sentiment Analysis Using AI Techniques: State-of-the-Art, Taxonomies, and Challenges
Patel, K., Mehta, D., Mistry, C., Gupta, R., Tanwar, S., Kumar, N., & Alazab, M. (2020) · IEEE Access · doi:10.1109/access.2020.2993803 · Cited by 157
Pan, B., Hirota, K., Jia, Z., & Dai, Y. (2023) · Neurocomputing · doi:10.1016/j.neucom.2023.126866 · Cited by 142
FERAtt: Facial Expression Recognition With Attention Net
Fernandez, P. D. M., Pena, F. A. G., Ren, T. I., & Cunha, A. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2019.00112 · Cited by 142
Metadata
- Authors
- Li, S., & Deng, W.
- Venue
- IEEE Transactions on Affective Computing
- Published
- 2022-07-01
- Volume
- 13
- Issue
- 3
- Pages
- 1195-1215
- ISSN
- 1949-3045 (ISSN-L)
- 2371-9850
- OpenAlex
- W2799041689
- Cited by
- 1,753
- References
- 305
- FWCI
- 195.01
- Type
- journal article
- Language
- en
- Open access
- green
- Licence
- Funders
- National Natural Science Foundation of China (61871052, 61573068)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.