Student or educator? Sign up with your school email and get 6 months of Pro free.
Cited by 214

The DOI matches its Crossref record; 4 of the 4 references it cites were found in a registry or an index.

Facial Expression Recognition Using Hierarchical Features With Deep Comprehensive Multipatches Aggregation Convolutional Neural Networks

Xie, Siyue, Hu, Haifeng·2019·IEEE Transactions on Multimedia

Abstract

Facial expression recognition (FER) has long been a challenging task in computer vision. In this paper, we propose a novel method, named deep comprehensive multipatches aggregation convolutional neural networks (CNNs), to solve the FER problem. The proposed method is a deep-based framework, which mainly consists of two branches of the CNN. One branch extracts local features from image patches while the other extracts holistic features from the whole expressional image. In the model, local features depict expressional details and holistic features characterize the high-level semantic information of an expression. We aggregate both local and holistic features before making classification. These two types of hierarchical features represent expressions in different scales. Compared with most current methods with single type of feature, the model can represent expressions more comprehensively. Additionally, in the training stage, a novel pooling strategy named expressional transformation-invariant pooling is proposed for handling nuisance variations, such as rotations, noises, etc. Extensive experiments are conducted on the famous the Extended Cohn-Kanade (CK+) dataset and the Japanese Female Facial Expression (JAFFE) database expression datasets, where the recognition results obtained.

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1109/tmm.2018.2844085

Cites

4 of 4 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 4 references

Research works printed but not linked: 47

  1. babenko, 0, Aggregating deep convolutional features for image retrieval, Proc Int Conf Comput Vis, 1269
  2. xu, 0, Facial expression recognition based on transfer learning from deep convolutional networks, Proc 11th Int Conf Natural Comput, 702?708
  3. 10.1109/IST.2015.7294547 · DOI
  4. 10.1109/CVPR.2016.369 · DOI · Paper page
  5. 10.1109/ICAPR.2015.7050661 · DOI
  6. 10.1109/TCYB.2014.2354351 · DOI · Paper page
  7. 10.1109/IJCNN.2015.7280539 · DOI
  8. 10.1109/CVPR.2014.233 · DOI · Paper page
  9. 10.1109/WACV.2016.7477450 · DOI · Paper page
  10. 10.1109/TMM.2013.2266635 · DOI
  11. 10.1109/FG.2011.5771366 · DOI · Paper page
  12. 10.1109/TMM.2016.2598092 · DOI · Paper page
  13. 10.1109/CCST.2009.5335546 · DOI
  14. mehrabian, 2007, Nonverbal Communication
  15. 10.1109/ICSMC.1997.633250 · DOI
  16. 10.1016/j.patcog.2013.10.010 · DOI
  17. 10.1109/IIH-MSP.2015.33 · doi:10.1109/iih-msp.2015.33
  18. 10.1109/CISP.2010.5647898 · DOI
  19. 10.1109/TMM.2016.2629282 · DOI
  20. 10.1109/CVPR.2005.297 · DOI · Paper page
  21. 10.4218/etrij.10.1510.0132 · DOI · Paper page
  22. 10.1109/TAFFC.2014.2346515 · DOI
  23. 10.1109/ICIP.2012.6467434 · DOI
  24. 10.1117/1.JEI.24.2.023015 · DOI
  25. majumder, 2016, Automatic facial expression recognition system using deep network-based data fusion, IEEE Trans Cybern, 99, 1
  26. 10.1109/CVPR.2016.38 · DOI · Paper page
  27. 10.1109/ICCV.2015.119 · DOI · Paper page
  28. ekman, 1978, The Facial Action Coding System A Technique for The Measurement of Facial Movement
  29. tian, 0, Recognizing upper face action units for facial expression analysis, Proc Int Conf Comput Vis Pattern Recognit, 294
  30. 10.1109/TPAMI.2007.1094 · DOI · Paper page
  31. 10.1109/FGR.2006.55 · DOI · Paper page
  32. 10.1109/ICSMC.2004.1398367 · DOI
  33. 10.5244/C.26.119 · DOI
  34. 10.1016/j.imavis.2012.01.006 · DOI
  35. 10.1109/IIH-MSP.2015.54 · doi:10.1109/iih-msp.2015.54
  36. ekman, 1978, The Facial Action Coding System A Technique for The Measurement of Facial Movement
  37. vural, 0, Automated drowsiness detection for improved driversafety comprehensive databases for facial expression analysis, Proc Int Conf Autom Technol, 1, 96
  38. izard, 1971, The Face of Emotion, 1
  39. 0, Recognition of face expressions using local principal texture pattern, Proc 19th IEEE Int Conf Image Process
  40. 10.1109/TAFFC.2014.2386334 · DOI · Paper page
  41. liu, 0, Deeply learning deformable facial action parts model for dynamic expression analysis, Proc Computer Vision, 1749
  42. 10.1109/TIP.2014.2331141 · DOI
  43. 10.1109/IJCNN.2012.6252678 · DOI
  44. 10.1109/ICCVW.2015.12 · DOI · Paper page
  45. 10.1109/AFGR.1998.670949 · DOI · Paper page
  46. zhong, 0, Learning active facial patches for expression analysis, Proc IEEE Conf Comput Vis Pattern Recognit, 2562
  47. 10.1023/B:VISI.0000013087.49260.fb · DOI · Paper page

Cited by

See all 214

Metadata

Authors
Xie, S., & Hu, H.
Venue
IEEE Transactions on Multimedia
Published
2019-01
Volume
21
Issue
1
Pages
211-220
ISSN
  • 1520-9210 (ISSN-L)
  • 1941-0077
OpenAlex
W2805781993
Cited by
214
References
4
FWCI
25.30
Type
journal article
Language
en
Open access
closed
Funders
  • National Natural Science Foundation of China (61673402, 61273270, 60802069)
  • Natural Science Foundation of Guangdong (2017A030311029, 2016B010109002, 2015B090912001, 2016B010123005, 2017B090909005)
  • Science and Technology Program of Guangzhou (201704020180, 201604020024)
  • Fundamental Research Funds for the Central Universities of China

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Facial Expression Recognition Using Hierarchical Features With Deep Comprehensive Multipatches Aggregation Convolutional Neural Networks. https://app.cochat.ai/papers/10.1109/tmm.2018.2844085
The paper
Xie, S., & Hu, H. (2019). Facial Expression Recognition Using Hierarchical Features With Deep Comprehensive Multipatches Aggregation Convolutional Neural Networks. IEEE Transactions on Multimedia. https://doi.org/10.1109/tmm.2018.2844085

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.