The DOI matches its Crossref record; 56 of the 56 references it cites were found in a registry or an index.
Distract Your Attention: Multi-Head Cross Attention Network for Facial Expression Recognition
Open accessAbstract
This paper presents a novel facial expression recognition network, called Distract your Attention Network (DAN). Our method is based on two key observations in biological visual perception. Firstly, multiple facial expression classes share inherently similar underlying facial appearance, and their differences could be subtle. Secondly, facial expressions simultaneously exhibit themselves through multiple facial regions, and for recognition, a holistic approach by encoding high-order interactions among local features is required. To address these issues, this work proposes DAN with three key components: Feature Clustering Network (FCN), Multi-head Attention Network (MAN), and Attention Fusion Network (AFN). Specifically, FCN extracts robust features by adopting a large-margin learning objective to maximize class separability. In addition, MAN instantiates a number of attention heads to simultaneously attend to multiple facial areas and build attention maps on these regions. Further, AFN distracts these attentions to multiple locations before fusing the feature maps to a comprehensive one. Extensive experiments on three public datasets (including AffectNet, RAF-DB, and SFEW 2.0) verified that the proposed method consistently achieves state-of-the-art facial expression recognition performance. The DAN code is publicly available.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Squeeze-and-Excitation Networks
Hu, J., Shen, L., & Sun, G. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00745 · Cited by 35,667
Swin Transformer: Hierarchical Vision Transformer using Shifted Windows
Liu, Z., Lin, Y., Cao, Y., Hu, H., Wei, Y., Zhang, Z., Lin, S., & Guo, B. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00986 · Cited by 35,534
CBAM: Convolutional Block Attention Module
Woo, S., Park, J., Lee, J.-Y., & Kweon, I. S. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01234-2_1 · Cited by 25,853
Control of goal-directed and stimulus-driven attention in the brain
Corbetta, M., & Shulman, G. L. (2002) · Nature Reviews Neuroscience · doi:10.1038/nrn755 · Cited by 12,881
Squeeze-and-Excitation Networks
Hu, J., Shen, L., Albanie, S., Sun, G., & Wu, E. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2913372 · Cited by 12,157
ArcFace: Additive Angular Margin Loss for Deep Face Recognition
Deng, J., Guo, J., Xue, N., & Zafeiriou, S. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00482 · Cited by 7,781
Dual Attention Network for Scene Segmentation
Fu, J., Liu, J., Tian, H., Li, Y., Bao, Y., Fang, Z., & Lu, H. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00326 · Cited by 7,351
Coordinate Attention for Efficient Mobile Network Design
Hou, Q., Zhou, D., & Feng, J. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.01350 · Cited by 6,961
Constants across cultures in the face and emotion.
Ekman, P., & Friesen, W. V. (1971) · Journal of Personality and Social Psychology · doi:10.1037/h0030377 · Cited by 5,509
Dimensionality Reduction by Learning an Invariant Mapping
Hadsell, R., Chopra, S., & LeCun, Y. (2006) · 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 2 (CVPR'06) · doi:10.1109/cvpr.2006.100 · Cited by 5,336
A Discriminative Feature Learning Approach for Deep Face Recognition
Wen, Y., Zhang, K., Li, Z., & Qiao, Y. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46478-7_31 · Cited by 4,077
CosFace: Large Margin Cosine Loss for Deep Face Recognition
Wang, H., Wang, Y., Zhou, Z., Ji, X., Gong, D., Zhou, J., Li, Z., & Liu, W. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00552 · Cited by 3,034
SphereFace: Deep Hypersphere Embedding for Face Recognition
Liu, W., Wen, Y., Yu, Z., Li, M., Raj, B., & Song, L. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.713 · Cited by 2,280
Automatic facial expression analysis: a survey
Fasel, B., & Luettin, J. (2003) · Pattern Recognition · doi:10.1016/s0031-3203(02)00052-3 · Cited by 1,810
RetinaFace: Single-Shot Multi-Level Face Localisation in the Wild
Deng, J., Guo, J., Ververas, E., Kotsia, I., & Zafeiriou, S. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00525 · Cited by 1,681
FcaNet: Frequency Channel Attention Networks
Qin, Z., Zhang, P., Wu, F., & Li, X. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00082 · Cited by 1,367
Rotate to Attend: Convolutional Triplet Attention Module
Misra, D., Nalamada, T., Arasanipalai, A. U., & Hou, Q. (2021) · 2021 IEEE Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv48630.2021.00318 · Cited by 1,147
The Dynamic Representation of Scenes
Rensink, R. A. (2000) · Visual Cognition · doi:10.1080/135062800394667 · Cited by 1,078
Region Attention Networks for Pose and Occlusion Robust Facial Expression Recognition
Wang, K., Peng, X., Yang, J., Meng, D., & Qiao, Y. (2020) · IEEE Transactions on Image Processing · doi:10.1109/tip.2019.2956143 · Cited by 940
Suppressing Uncertainties for Large-Scale Facial Expression Recognition
Wang, K., Peng, X., Yang, J., Lu, S., & Qiao, Y. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00693 · Cited by 772
Collecting Large, Richly Annotated Facial-Expression Databases from Movies
Dhall, A., Goecke, R., Lucey, S., & Gedeon, T. (2012) · IEEE MultiMedia · doi:10.1109/mmul.2012.26 · Cited by 663
Li, S., & Deng, W. (2019) · IEEE Transactions on Image Processing · doi:10.1109/tip.2018.2868382 · Cited by 660
Static facial expression analysis in tough conditions: Data, evaluation protocol and benchmark
Dhall, A., Goecke, R., Lucey, S., & Gedeon, T. (2011) · 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops) · doi:10.1109/iccvw.2011.6130508 · Cited by 541 · cited 1×
“0 [44] is the newest version for SFEW dataset in which each facial emotion is extracted from the static frames of the AFEW video database.”
BackgroundRecognition of Facial Expression from Optical Flow
Mase, K. (1991) · IEICE Transactions on Information and Systems · Cited by 481
DaViT: Dual Attention Vision Transformers
Ding, M., Xiao, B., Codella, N., Luo, P., Wang, J., & Yuan, L. (2022) · Lecture Notes in Computer Science · doi:10.1007/978-3-031-20053-3_5 · Cited by 382
Attention mechanism-based CNN for facial expression recognition
Li, J., Jin, K., Zhou, D., Kubota, N., & Ju, Z. (2020) · Neurocomputing · doi:10.1016/j.neucom.2020.06.014 · Cited by 347
Facial Expression Recognition in the Wild via Deep Attentive Center Loss
Farzaneh, A. H., & Qi, X. (2021) · 2021 IEEE Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv48630.2021.00245 · Cited by 326
Island Loss for Learning Discriminative Features in Facial Expression Recognition
Cai, J., Meng, Z., Khan, A. S., Li, Z., OReilly, J., & Tong, Y. (2018) · 2018 13th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2018) · doi:10.1109/fg.2018.00051 · Cited by 321
Identity-Aware Convolutional Neural Network for Facial Expression Recognition
Meng, Z., Liu, P., Cai, J., Han, S., & Tong, Y. (2017) · 2017 12th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2017) · doi:10.1109/fg.2017.140 · Cited by 319
Robust Lightweight Facial Expression Recognition Network with Label Distribution Training
Zhao, Z., Liu, Q., & Zhou, F. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i4.16465 · Cited by 283
Image super-resolution reconstruction based on feature map attention mechanism
Chen, Y., Liu, L., Phonevilay, V., Gu, K., Xia, R., Xie, J., Zhang, Q., & Yang, K. (2021) · Applied Intelligence · doi:10.1007/s10489-020-02116-1 · Cited by 246
Label Distribution Learning on Auxiliary Label Space Graphs for Facial Expression Recognition
Chen, S., Wang, J., Chen, Y., Shi, Z., Geng, X., & Rui, Y. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01400 · Cited by 229
Xie, S., Hu, H., & Wu, Y. (2019) · Pattern Recognition · doi:10.1016/j.patcog.2019.03.019 · Cited by 209
Savchenko, A. V. (2021) · 2021 IEEE 19th International Symposium on Intelligent Systems and Informatics (SISY) · doi:10.1109/sisy52375.2021.9582508 · Cited by 172
Pyramid With Super Resolution for In-the-Wild Facial Expression Recognition
Vo, T.-H., Lee, G.-S., Yang, H.-J., & Kim, S.-H. (2020) · IEEE Access · doi:10.1109/access.2020.3010018 · Cited by 171
Wang, D., Zhang, Z., Jiang, Y., Mao, Z., Wang, D., Lin, H., & Xu, D. (2021) · Nucleic Acids Research · doi:10.1093/nar/gkab016 · Cited by 161
Efficient Facial Feature Learning with Wide Ensemble-Based Convolutional Neural Networks
Siqueira, H. L., Magg, S., & Wermter, S. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i04.6037 · Cited by 155
Deep Neural Network Augmentation: Generating Faces for Affect Analysis
Kollias, D., Cheng, S., Ververas, E., Kotsia, I., & Zafeiriou, S. P. (2020) · International Journal of Computer Vision · doi:10.1007/s11263-020-01304-3 · Cited by 149
FERAtt: Facial Expression Recognition With Attention Net
Fernandez, P. D. M., Pena, F. A. G., Ren, T. I., & Cunha, A. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2019.00112 · Cited by 142
JWSAA: Joint weak saliency and attention aware for person re-identification
Ning, X., Gong, K., Li, W., & Zhang, L. (2020) · Neurocomputing · doi:10.1016/j.neucom.2020.05.106 · Cited by 142
Occlusion-Adaptive Deep Network for Robust Facial Expression Recognition
Ding, H., Zhou, P., & Chellappa, R. (2020) · IEEE International Joint Conference on Biometrics (IJCB) · doi:10.1109/ijcb48548.2020.9304923 · Cited by 115
Vision Transformer With Quadrangle Attention
Zhang, Q., Zhang, J., Xu, Y., & Tao, D. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3347693 · Cited by 111
Facial Motion Prior Networks for Facial Expression Recognition
Chen, Y., Wang, J., Chen, S., Shi, Z., & Cai, J. (2019) · IEEE International Conference on Visual Communications and Image Processing (VCIP) · doi:10.1109/vcip47243.2019.8965826 · Cited by 109
Discriminant Distribution-Agnostic Loss for Facial Expression Recognition in the Wild
Farzaneh, A. H., & Qi, X. (2020) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw50498.2020.00211 · Cited by 81
Identity-Free Facial Expression Recognition Using Conditional Generative Adversarial Network
Cai, J., Meng, Z., Khan, A. S., O’Reilly, J. D., Li, Z., Han, S., & Tong, Y. (2021) · Proceedings - International Conference on Image Processing · doi:10.1109/icip42928.2021.9506593 · Cited by 61
Separate Loss for Basic and Compound Facial Expression Recognition in the Wild
Li, Y., Lu, Y., Li, J., & Lu, G. (2019) · Asian Conference on Machine Learning · Cited by 51
Survey of the Facial Expression Recognition Research
Wu, T., Fu, S., & Yang, G. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-31561-9_44 · Cited by 42
Discriminative Attention-based Convolutional Neural Network for 3D Facial Expression Recognition
Zhu, K., Du, Z., Li, W., Huang, D., Wang, Y., & Chen, L. (2019) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/fg.2019.8756524 · Cited by 41
Cross-Domain Facial Expression Recognition Based on Transductive Deep Transfer Learning
Yan, K., Zheng, W., Zhang, T., Zong, Y., Tang, C., Lu, C., & Cui, Z. (2019) · IEEE Access · doi:10.1109/access.2019.2930359 · Cited by 34
Facial Expression Recognition by Multi-Scale CNN with Regularized Center Loss
Li, Z., Wu, S., & Xiao, G. (2018) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr.2018.8545489 · Cited by 26
FaceCaps for facial expression recognition
Wu, F., Pang, C., & Zhang, B. (2021) · Computer Animation and Virtual Worlds · doi:10.1002/cav.2021 · Cited by 12
Ceccacci, S., Generosi, A., Giraldi, L., & Mengoni, M. (2023) · Sensors · doi:10.3390/s23052688 · Cited by 11
Emotional Health Detection in HAR: New Approach Using Ensemble SNN
Bibbò, L., Cotroneo, F., & Vellasco, M. M. B. R. (2023) · Applied Sciences · doi:10.3390/app13053259 · Cited by 11
A Recognizable Expression Line Portrait Synthesis Method in Portrait Rendering Robot
Dong, X., Ning, X., Xu, J., Yu, L., Li, W., & Zhang, L. (2023) · IEEE Transactions on Computational Social Systems · doi:10.1109/tcss.2023.3241003 · Cited by 10
Cited by
Savchenko, A. V., Savchenko, L. V., & Makarov, I. (2022) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2022.3188390 · Cited by 346
ResEmoteNet: Bridging Accuracy and Loss Reduction in Facial Emotion Recognition
(2024) · doi:10.1109/lsp.2024.3521321 · Cited by 56
Metadata
- Authors
- Wen, Z., Lin, W., Wang, T., & Xu, G.
- Venue
- Biomimetics
- Publisher
- MDPI AG
- Published
- 2023-05-11
- Volume
- 8
- Issue
- 2
- Pages
- 199
- ISSN
- 2313-7673 (ISSN-L)
- OpenAlex
- W4376278471
- Cited by
- 313
- References
- 56
- FWCI
- 67.34
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.