CoChat
Cited by 183

The DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.

Automated emotion recognition based on higher order statistics and deep learning algorithm

Sharma, Rahul, Pachori, Ram Bilas, Sircar, Pradip · 2020 · Biomedical Signal Processing and Control

Abstract

The objective of this paper is online recognition of human emotions based on electroencephalogram (EEG) signals. The emotions are originated from the central and peripheral nervous systems. Hence, it can be adequately characterized by the EEG signal, as it directly reflects changes in the human emotional states. This paper describes an automated classification of emotions-labeled EEG signals using nonlinear higher order statistics and deep learning algorithm. The discrete wavelet transform is used to decompose the studied signal into sub-bands, known as rhythms of the EEG signal. The third-order cumulants (ToC) are used to explore the nonlinear dynamics of each sub-band signal in higher dimensional space. The data in the higher dimensional space contain repeated and redundant information due to presence of various symmetries in the ToC. Hence, an evolutionary data reduction technique, namely, the particle swarm optimization, is employed to get rid of irrelevant information. The long short-term memory based deep learning technique is used to retrieve the emotion variation from the optimized data corresponding to the labeled EEG signals. This study is carried out with the web-available DEAP dataset that yields 82.01% average classification accuracy with 10-fold cross-validation technique corresponding to four-labeled emotions classes. The achieved results have confirmed that the proposed algorithm has the potential for accurate and rapid recognition of human emotions.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1016/j.bspc.2020.101867

Cites

9 of 9 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 9 references

Research works printed but not linked: 37

  1. Knyazev, 2010, Gender differences in implicit and explicit processing of emotional facial expressions as revealed by event-related theta synchronization, Emotion, 10, 678, 10.1037/a0019175 · DOI
  2. Khalili, 2008, Emotion detection using brain and peripheral signals, 2008 Cairo International Biomedical Engineering Conference, 1
  3. Rozgić, 2013, Robust EEG emotion classification using segment level decision fusion, IEEE International Conference on Acoustics, Speech and Signal Processing, 1286
  4. Lee, 2014, Classifying different emotional states by means of EEG-based functional connectivity patterns, PLoS One, 9, e95415, 10.1371/journal.pone.0095415 · DOI · Paper page
  5. Yuen, 2009, Classification of human emotions from EEG signals using statistical features and neural network, Int. J. Integr. Eng., 1
  6. Li, 2009, Emotion classification based on gamma-band EEG, Annual International Conference of the IEEE Engineering in Medicine and Biology Society, 1223
  7. Liu, 2012, EEG-based dominance level recognition for emotion-enabled interaction, IEEE International Conference on Multimedia and Expo (ICME), 1039
  8. Hadjidimitriou, 2012, Toward an EEG-based recognition of music liking using time-frequency analysis, IEEE Trans. Biomed. Eng., 59, 3498, 10.1109/TBME.2012.2217495 · DOI · Paper page
  9. Ansari-Asl, 2007, A channel selection method for EEG classification in emotion assessment based on synchronization likelihood, 15th European Signal Processing Conference, 1241
  10. Horlings, 2008, Emotion recognition using brain activity, Proceedings of the 9th International Conference on Computer Systems and Technologies and Workshop for PhD students in Computing
  11. Thammasan, 2016, Continuous music-emotion recognition based on electroencephalogram, IEICE Trans. Inf. Syst., 99, 1234, 10.1587/transinf.2015EDP7251 · DOI
  12. Zheng, 2017, Identifying stable patterns over time for emotion recognition from EEG, IEEE Trans. Affect. Comput., 10, 417, 10.1109/TAFFC.2017.2712143 · DOI · Paper page
  13. Paul, 2015, EEG based emotion recognition system using mfdfa as feature extractor, International Conference on Robotics, Automation, Control and Embedded Systems (RACE), 1
  14. Zheng, 2015, Investigating critical frequency bands and channels for EEG-based emotion recognition with deep neural networks, IEEE Trans. Auton. Mental Dev., 7, 162, 10.1109/TAMD.2015.2431497 · DOI · Paper page
  15. Frantzidis, 2010, Toward emotion aware computing: an integrated approach using multichannel neurophysiological recordings and affective visual stimuli, IEEE Trans. Inf. Technol. Biomed., 14, 589, 10.1109/TITB.2010.2041553 · DOI · Paper page
  16. Nie, 2011, EEG-based emotion recognition during watching movies, 5th International IEEE/EMBS Conference on Neural Engineering (NER), 2011, 667, 10.1109/NER.2011.5910636 · DOI · Paper page
  17. Murugappan, 2010, Classification of human emotion from EEG using discrete wavelet transform, J. Biomed. Sci. Eng., 3, 390, 10.4236/jbise.2010.34054 · DOI · Paper page
  18. Murugappan, 2010, Inferring of human emotional states using multichannel EEG, Eur. J. Sci. Res., 48, 281
  19. Gupta, 2018, Cross-subject emotion recognition using flexible analytic wavelet transform from EEG signals, IEEE Sens. J., 19, 2266, 10.1109/JSEN.2018.2883497 · DOI · Paper page
  20. Petrantonakis, 2010, Emotion recognition from EEG using higher order crossings, IEEE Trans. Inf. Technol. Biomed., 14, 186, 10.1109/TITB.2009.2034649 · DOI · Paper page
  21. Xin, 2017, An improved multi-scale entropy algorithm in emotion EEG features extraction, J. Med. Imaging Health Inform., 7, 436
  22. Li, 2016, Emotion recognition from multi-channel EEG data through convolutional recurrent neural network, IEEE International Conference on Bioinformatics and Biomedicine (BIBM), 352
  23. Li, 2017, Human emotion recognition with electroencephalographic multidimensional features by hybrid deep neural networks, Appl. Sci., 7, 1060, 10.3390/app7101060 · DOI · Paper page
  24. Klem, 1999, The ten-twenty electrode system of the international federation, Electroencephalogr. Clin. Neurophysiol., 52, 3
  25. Zheng, 2015, Investigating critical frequency bands and channels for EEG-based emotion recognition with deep neural networks, IEEE Trans. Auton. Mental Dev., 7, 162, 10.1109/TAMD.2015.2431497 · DOI · Paper page
  26. Duan, 2013, Differential entropy feature for EEG-based emotion classification, 6th International IEEE/EMBS Conference on Neural Engineering (NER), 81
  27. Meurant, 2012, vol. 2
  28. Sharma, 2019, A new technique for classification of focal and nonfocal EEG signals using higher-order spectra, J. Mech. Med. Biol., 19, 1940010, 10.1142/S0219519419400104 · DOI
  29. Sharma, 2019, Automated glaucoma detection using center slice of higher order statistics, J. Mech. Med. Biol., 19, 1940011, 10.1142/S0219519419400116 · DOI
  30. Hosseini, 2010, Higher order spectra analysis of EEG signals in emotional stress states, Second International Conference on Information Technology and Computer Science (ITCS), 60
  31. Brillinger, 1965, An introduction to polyspectra, Ann. Math. Stat., 1351, 10.1214/aoms/1177699896 · DOI · Paper page
  32. Nikias, 1987, Bispectrum estimation: a digital signal processing framework, Proc. IEEE, 75, 869, 10.1109/PROC.1987.13824 · DOI · Paper page
  33. Fonoliosa, 1993, Wigner higher order moment spectra: definition, properties, computation and application to transient signal analysis, IEEE Trans. Signal Process., 41, 245, 10.1109/TSP.1993.193143 · DOI
  34. Nakisa, 2018, Evolutionary computation algorithms for feature selection of EEG-based emotion recognition using mobile sensors, Expert Syst. Appl., 93, 143, 10.1016/j.eswa.2017.09.062 · DOI · Paper page
  35. Kennedy, 1995, Particle swarm optimization, Proceedings of IEEE International Conference on Neural Networks (ICNN’95), 10.1109/ICNN.1995.488968 · DOI · Paper page
  36. Poli, 2008, Analysis of the publications on the applications of particle swarm optimisation, J. Artif. Evol. Appl.
  37. Gers, 2002, Learning precise timing with LSTM recurrent networks, J. Mach. Learn. Res., 3, 115

Cited by

Metadata

Authors
Sharma, R., Pachori, R. B., & Sircar, P.
Venue
Biomedical Signal Processing and Control
Publisher
Elsevier BV
Published
2020-04
Volume
58
Pages
101867
ISSN
1746-8094 (ISSN-L)
OpenAlex
W3004735003
Cited by
183
References
9
FWCI
27.07
Type
journal article
Language
en
Open access
closed
Licence
  • www.elsevier.com/tdm/userlicense/1.0/ (tdm)
  • www.elsevier.com/legal/tdmrep-license (tdm)

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.