The DOI matches its DataCite record; 2 of the 2 references it cites were found in a registry or an index.
Improving Facial Emotion Recognition Systems Using Gradient and Laplacian Images
Open accessAbstract
In this work, we have proposed several enhancements to improve the performance of any facial emotion recognition (FER) system. We believe that the changes in the positions of the fiducial points and the intensities capture the crucial information regarding the emotion of a face image. We propose the use of the gradient and the Laplacian of the input image together with the original input into a convolutional neural network (CNN). These modifications help the network learn additional information from the gradient and Laplacian of the images. However, the plain CNN is not able to extract this information from the raw images. We have performed a number of experiments on two well known datasets KDEF and FERplus. Our approach enhances the already high performance of state-of-the-art FER systems by 3 to 5%.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Compared to [17], the new method is 6.33 times smaller parameter size”
From A Resource Efficient Integer-Arithmetic-Only FPGA-Based CNN Accelerator for Real-Time Facial Emotion Recognition (2021) · cites this paper as [17]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“and 3.28% more accurate.”
From A Resource Efficient Integer-Arithmetic-Only FPGA-Based CNN Accelerator for Real-Time Facial Emotion Recognition (2021) · cites this paper as [17]
Experimental — accuracy not yet measuredThe check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“it is more efficient because it uses only integer-arithmetic.”
From A Resource Efficient Integer-Arithmetic-Only FPGA-Based CNN Accelerator for Real-Time Facial Emotion Recognition (2021) · cites this paper as [17]
Experimental — accuracy not yet measuredThe check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“Although its number of operations is 1.4 times larger”
From A Resource Efficient Integer-Arithmetic-Only FPGA-Based CNN Accelerator for Real-Time Facial Emotion Recognition (2021) · cites this paper as [17]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Joint Fine-Tuning in Deep Neural Networks for Facial Expression Recognition
Jung, H., Lee, S., Yim, J., Park, S., & Kim, J. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.341 · Cited by 781 · cited 1×
“Jung et al [21] proposed two different deep network models”
BackgroundEmotion Recognition in the Wild via Convolutional Neural Networks and Mapped Binary Patterns
Levi, G., & Hassner, T. (2015) · Proceedings of the 2015 ACM on International Conference on Multimodal Interaction · doi:10.1145/2818346.2830587 · Cited by 336
Flagged first, then by citations
Research works printed but not linked: 25
- [1][1] El Ayadi, M., Kamel, M.S. and Karray, F., 2011. Survey on speech emotion recognition: Features, classification schemes, and databases. Pattern Recognition, 44(3), pp.572-587. -
- [2][2] Davidson, Richard J., Clifford D. Saron, Paul Ekman, Joseph A. Senulis, and Wallace V. Friesen. 'Approach-withdrawal and cerebral asymmetry: Emotional expression and brain physiology: I.' Journal of personality and social psychology 58.2 (1990): 330. -
- [4][4] Greenwood, Donald D. 'A cochlear frequency-position function for several species-29 years later.' The Journal of the Acoustical Society of America, 87.6 (1990): 2592-2605. -
- [5][5] Lundqvist, Daniel, Anders Flykt, and Arne hman, 'The Karolinska directed emotional faces (KDEF),' CD ROM from Department of Clinical Neuroscience, Psychology section, Karolinska Institutet 91 (1998): 630. -
- [6][6] Barsoum, E., Zhang, C., Ferrer, C.C. and Zhang, Z., 'Training deep networks for facial expression recognition with crowd-sourced label distribution,' Proc. of the 18th ACM Int. Conf. on Multimodal Interaction. ACM, 2016. -
- [7][7] Darwin, Charles, and Phillip Prodger, 'The expression of the emotions in man and animals,' Oxford University Press, USA, 1998. -
- [8][8] Ekman, Paul, and Wallace V. Friesen, 'Nonverbal leakage and clues to deception,' Psychiatry 32.1 (1969): 88-106. -
- [9][9] Ekman, Paul, and Dacher Keltner, 'Universal facial expressions of emotion,' California mental health research digest 8.4 (1970): 151-158. -
- [11][11] Suk, Myunghoon, and Balakrishnan Prabhakaran, 'Real-time mobile facial expression recognition system-a case study,' Proc. IEEE Conference on Computer Vision and Pattern Recognition Workshops. 2014. -
- [12][12] Ghimire, Deepak, and Joonwhoan Lee, 'Geometric feature-based facial expression recognition in image sequences using multi-class adaboost and support vector machines.' Sensors 13.6 (2013): 7714-7734. -
- [13][13] Happy, S. L., Anjith George, and Aurobinda Routray, 'A real time facial expression classification system using local binary patterns,' Intelligent Human Computer Interaction (IHCI), 2012 4th International Conference on. IEEE, 2012. -
- [14][14] Zhao, Guoying, and Matti Pietikainen, 'Dynamic texture recognition using local binary patterns with an application to facial expressions,' IEEE Trans. on Pattern Analysis and Machine Intelligence 29.6 (2007): 915-928. -
- [15][15] Ghimire D, Jeong S, Lee J, Park SH, 'Facial expression recognition based on local region specific features and support vector machines,' Multimedia Tools and Applications 76.6 (2017): 7803-7821. -
- [18][18] Breuer, Ran, and Ron Kimmel, 'A deep learning perspective on the origin of facial expressions,' arXiv preprint arXiv:1705.01842 (2017). - · arXiv
- [19][19] Chollet, F, 'Xception: deep learning with separable convolutions.' arXiv Prepr. arXiv1610 2357 (2016). -
- [20][20] Arriaga, Octavio, Matias Valdenegro-Toro, and Paul Plger, 'Real-time Convolutional Neural Networks for Emotion and Gender Classification,' arXiv preprint arXiv:1710.07557 (2017). - · arXiv
- [23][23] E. Barsoum, C. Zhang, C. Ferrer, Z. Zhang, Training deep networks for facial expression recognition with crowd-sourced label distribution . Proceedings of the 18th ACM International Conference on Multimodal Interaction, 2016. -
- [25][25] K. Simonyan, A. Zisserman, Very deep convolutional networks for largescale image recognition . arXiv preprint arXiv:1409.1556, 2014. - · arXiv
- [26][26] S. Ouellet, Real-time emotion recognition for gaming using deep convolutional network features . CoRR, vol. abs/1408.3750, 2014. - · arXiv
- [27][27] P. Lucey, J. F. Cohn, T. Kanade, J. Saragih, Z. Ambadar and I. Matthews, The Extended Cohn-Kanade Dataset (CK+): A complete dataset for action unit and emotion-specified expression . 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition -Workshops, San Francisco, CA, 2010. -
- [29][29] Jaderberg, Max, Karen Simonyan, and Andrew Zisserman. 'Spatial transformer networks.' Advances in neural information processing systems. 2015. -
- [31][31] Haralick, Robert M., and Linda G. Shapiro. Computer and robot vision. Addison-wesley, 1992. -
- [32][32] Sandler, M., Howard, A., Zhu, M., Zhmoginov, A. and Chen, L.C., 'Mobilenetv2: Inverted residuals and linear bottlenecks,' 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition. IEEE, 2018. -
- [33][33] Kingma, D. P., and L. J. Ba. 'Adam: A method for stochastic optimization.' International Conference on Learning Representations (ICLR) (2015). -
- [34][34] Schomaker, Lambert, 'Anticipation in cybernetic systems: A case against mindless anti-representationalism,' Systems, Man and Cybernetics, Int. Conf. on. Vol. 2. IEEE, 2004.
Cited by
Sorted by citations
Kim, J., Kang, J.-K., & Kim, Y. (2021) · IEEE Access · doi:10.1109/access.2021.3099075 · Cited by 50
Wikanningrum, A., Rachmadi, R. F., & Ogata, K. (2019) · 2019 International Conference on Computer Engineering, Network, and Intelligent Multimedia (CENIM) · doi:10.1109/cenim48368.2019.8973312 · Cited by 17
Metadata
- Authors
- Pandey, R. K., Karmakar, S., Ramakrishnan, A. G., & Saha, N.
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2019
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1902.05411
- OpenAlex
- W2912204580
- Cited by
- 9
- References
- 2
- Citations by year
- 2024: 1 · 2023: 2 · 2022: 2 · 2021: 1 · 2020: 1 · 2019: 2
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Emotion and Mood Recognition
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Face recognition and analysis
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Face and Expression Recognition
- Keywords
- facial emotion recognition, gradient image, convolutional neural networks, fiducial points, feature enhancement, KDEF dataset
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
