The DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.
Automated emotion recognition based on higher order statistics and deep learning algorithm
Abstract
The objective of this paper is online recognition of human emotions based on electroencephalogram (EEG) signals. The emotions are originated from the central and peripheral nervous systems. Hence, it can be adequately characterized by the EEG signal, as it directly reflects changes in the human emotional states. This paper describes an automated classification of emotions-labeled EEG signals using nonlinear higher order statistics and deep learning algorithm. The discrete wavelet transform is used to decompose the studied signal into sub-bands, known as rhythms of the EEG signal. The third-order cumulants (ToC) are used to explore the nonlinear dynamics of each sub-band signal in higher dimensional space. The data in the higher dimensional space contain repeated and redundant information due to presence of various symmetries in the ToC. Hence, an evolutionary data reduction technique, namely, the particle swarm optimization, is employed to get rid of irrelevant information. The long short-term memory based deep learning technique is used to retrieve the emotion variation from the optimized data corresponding to the labeled EEG signals. This study is carried out with the web-available DEAP dataset that yields 82.01% average classification accuracy with 10-fold cross-validation technique corresponding to four-labeled emotions classes. The achieved results have confirmed that the proposed algorithm has the potential for accurate and rapid recognition of human emotions.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Learning long-term dependencies with gradient descent is difficult
Bengio, Y., Simard, P., & Frasconi, P. (1994) · IEEE Transactions on Neural Networks · doi:10.1109/72.279181 · Cited by 8,542
DEAP: A Database for Emotion Analysis ;Using Physiological Signals
Koelstra, S., Muhl, C., Soleymani, M., Lee, J.-S., Yazdani, A., Ebrahimi, T., Pun, T., Nijholt, A., & Patras, I. (2012) · IEEE Transactions on Affective Computing · doi:10.1109/t-affc.2011.15 · Cited by 5,093
Bassett, D. S., & Sporns, O. (2017) · Nature Neuroscience · doi:10.1038/nn.4502 · Cited by 2,398
Cabanac, M. (1971) · Science · doi:10.1126/science.173.4002.1103 · Cited by 1,521
Emotion, motivation, and anxiety: brain mechanisms and psychophysiology
Lang, P. J., Bradley, M. M., & Cuthbert, B. N. (1998) · Biological Psychiatry · doi:10.1016/s0006-3223(98)00275-3 · Cited by 1,043
Cabanac, M. (2002) · Behavioural Processes · doi:10.1016/s0376-6357(02)00078-5 · Cited by 652
Petrantonakis, P. C., & Hadjileontiadis, L. J. (2010) · IEEE Transactions on Affective Computing · doi:10.1109/t-affc.2010.7 · Cited by 260
Multimodal emotion recognition using EEG and eye tracking data
Zheng, W.-L., Dong, B.-N., & Lu, B.-L. (2014) · 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society · doi:10.1109/embc.2014.6944757 · Cited by 230
Yin, Z., Wang, Y., Liu, L., Zhang, W., & Zhang, J. (2017) · Frontiers in Neurorobotics · doi:10.3389/fnbot.2017.00019 · Cited by 155
Research works printed but not linked: 37
- Knyazev, 2010, Gender differences in implicit and explicit processing of emotional facial expressions as revealed by event-related theta synchronization, Emotion, 10, 678, 10.1037/a0019175 · DOI
- Khalili, 2008, Emotion detection using brain and peripheral signals, 2008 Cairo International Biomedical Engineering Conference, 1
- Rozgić, 2013, Robust EEG emotion classification using segment level decision fusion, IEEE International Conference on Acoustics, Speech and Signal Processing, 1286
- Lee, 2014, Classifying different emotional states by means of EEG-based functional connectivity patterns, PLoS One, 9, e95415, 10.1371/journal.pone.0095415 · DOI · Paper page
- Yuen, 2009, Classification of human emotions from EEG signals using statistical features and neural network, Int. J. Integr. Eng., 1
- Li, 2009, Emotion classification based on gamma-band EEG, Annual International Conference of the IEEE Engineering in Medicine and Biology Society, 1223
- Liu, 2012, EEG-based dominance level recognition for emotion-enabled interaction, IEEE International Conference on Multimedia and Expo (ICME), 1039
- Hadjidimitriou, 2012, Toward an EEG-based recognition of music liking using time-frequency analysis, IEEE Trans. Biomed. Eng., 59, 3498, 10.1109/TBME.2012.2217495 · DOI · Paper page
- Ansari-Asl, 2007, A channel selection method for EEG classification in emotion assessment based on synchronization likelihood, 15th European Signal Processing Conference, 1241
- Horlings, 2008, Emotion recognition using brain activity, Proceedings of the 9th International Conference on Computer Systems and Technologies and Workshop for PhD students in Computing
- Thammasan, 2016, Continuous music-emotion recognition based on electroencephalogram, IEICE Trans. Inf. Syst., 99, 1234, 10.1587/transinf.2015EDP7251 · DOI
- Zheng, 2017, Identifying stable patterns over time for emotion recognition from EEG, IEEE Trans. Affect. Comput., 10, 417, 10.1109/TAFFC.2017.2712143 · DOI · Paper page
- Paul, 2015, EEG based emotion recognition system using mfdfa as feature extractor, International Conference on Robotics, Automation, Control and Embedded Systems (RACE), 1
- Zheng, 2015, Investigating critical frequency bands and channels for EEG-based emotion recognition with deep neural networks, IEEE Trans. Auton. Mental Dev., 7, 162, 10.1109/TAMD.2015.2431497 · DOI · Paper page
- Frantzidis, 2010, Toward emotion aware computing: an integrated approach using multichannel neurophysiological recordings and affective visual stimuli, IEEE Trans. Inf. Technol. Biomed., 14, 589, 10.1109/TITB.2010.2041553 · DOI · Paper page
- Nie, 2011, EEG-based emotion recognition during watching movies, 5th International IEEE/EMBS Conference on Neural Engineering (NER), 2011, 667, 10.1109/NER.2011.5910636 · DOI · Paper page
- Murugappan, 2010, Classification of human emotion from EEG using discrete wavelet transform, J. Biomed. Sci. Eng., 3, 390, 10.4236/jbise.2010.34054 · DOI · Paper page
- Murugappan, 2010, Inferring of human emotional states using multichannel EEG, Eur. J. Sci. Res., 48, 281
- Gupta, 2018, Cross-subject emotion recognition using flexible analytic wavelet transform from EEG signals, IEEE Sens. J., 19, 2266, 10.1109/JSEN.2018.2883497 · DOI · Paper page
- Petrantonakis, 2010, Emotion recognition from EEG using higher order crossings, IEEE Trans. Inf. Technol. Biomed., 14, 186, 10.1109/TITB.2009.2034649 · DOI · Paper page
- Xin, 2017, An improved multi-scale entropy algorithm in emotion EEG features extraction, J. Med. Imaging Health Inform., 7, 436
- Li, 2016, Emotion recognition from multi-channel EEG data through convolutional recurrent neural network, IEEE International Conference on Bioinformatics and Biomedicine (BIBM), 352
- Li, 2017, Human emotion recognition with electroencephalographic multidimensional features by hybrid deep neural networks, Appl. Sci., 7, 1060, 10.3390/app7101060 · DOI · Paper page
- Klem, 1999, The ten-twenty electrode system of the international federation, Electroencephalogr. Clin. Neurophysiol., 52, 3
- Zheng, 2015, Investigating critical frequency bands and channels for EEG-based emotion recognition with deep neural networks, IEEE Trans. Auton. Mental Dev., 7, 162, 10.1109/TAMD.2015.2431497 · DOI · Paper page
- Duan, 2013, Differential entropy feature for EEG-based emotion classification, 6th International IEEE/EMBS Conference on Neural Engineering (NER), 81
- Meurant, 2012, vol. 2
- Sharma, 2019, A new technique for classification of focal and nonfocal EEG signals using higher-order spectra, J. Mech. Med. Biol., 19, 1940010, 10.1142/S0219519419400104 · DOI
- Sharma, 2019, Automated glaucoma detection using center slice of higher order statistics, J. Mech. Med. Biol., 19, 1940011, 10.1142/S0219519419400116 · DOI
- Hosseini, 2010, Higher order spectra analysis of EEG signals in emotional stress states, Second International Conference on Information Technology and Computer Science (ITCS), 60
- Brillinger, 1965, An introduction to polyspectra, Ann. Math. Stat., 1351, 10.1214/aoms/1177699896 · DOI · Paper page
- Nikias, 1987, Bispectrum estimation: a digital signal processing framework, Proc. IEEE, 75, 869, 10.1109/PROC.1987.13824 · DOI · Paper page
- Fonoliosa, 1993, Wigner higher order moment spectra: definition, properties, computation and application to transient signal analysis, IEEE Trans. Signal Process., 41, 245, 10.1109/TSP.1993.193143 · DOI
- Nakisa, 2018, Evolutionary computation algorithms for feature selection of EEG-based emotion recognition using mobile sensors, Expert Syst. Appl., 93, 143, 10.1016/j.eswa.2017.09.062 · DOI · Paper page
- Kennedy, 1995, Particle swarm optimization, Proceedings of IEEE International Conference on Neural Networks (ICNN’95), 10.1109/ICNN.1995.488968 · DOI · Paper page
- Poli, 2008, Analysis of the publications on the applications of particle swarm optimisation, J. Artif. Evol. Appl.
- Gers, 2002, Learning precise timing with LSTM recurrent networks, J. Mach. Learn. Res., 3, 115
Cited by
Houssein, E. H., Hammad, A., & Ali, A. A. (2022) · Neural Computing and Applications · doi:10.1007/s00521-022-07292-4 · Cited by 426
Emotion recognition in EEG signals using deep learning methods: A review
Jafari, M., Shoeibi, A., Khodatars, M., Bagherzadeh, S., Shalbaf, A., García, D. L., Gorriz, J. M., & Acharya, U. R. (2023) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2023.107450 · Cited by 240
Saffaryazdi, N., Wasim, S. T., Dileep, K., Nia, A. F., Nanayakkara, S., Broadbent, E., & Billinghurst, M. (2022) · Frontiers in Psychology · doi:10.3389/fpsyg.2022.864047 · Cited by 69
EEG-based emotion recognition with autoencoder feature fusion and MSC-TimesNet model
Yin, J., Qiao, Z., Han, L., & Zhang, X. (2026) · Computer Methods in Biomechanics and Biomedical Engineering · doi:10.1080/10255842.2025.2477801 · Cited by 41
Alam, M. S. B., Lameesa, A., Sharmin, S., Afrin, S., Ahmed, S. F., Nikoo, M. R., & Gandomi, A. H. (2025) · Digital Communications and Networks · doi:10.1016/j.dcan.2025.04.001 · Cited by 9
Metadata
- Authors
- Sharma, R., Pachori, R. B., & Sircar, P.
- Venue
- Biomedical Signal Processing and Control
- Publisher
- Elsevier BV
- Published
- 2020-04
- Volume
- 58
- Pages
- 101867
- ISSN
- 1746-8094 (ISSN-L)
- OpenAlex
- W3004735003
- Cited by
- 183
- References
- 9
- FWCI
- 27.07
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.elsevier.com/tdm/userlicense/1.0/ (tdm)
- www.elsevier.com/legal/tdmrep-license (tdm)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Automated emotion recognition based on higher order statistics and deep learning algorithm. https://app.cochat.ai/papers/10.1016/j.bspc.2020.101867
- The paper
- Sharma, R., Pachori, R. B., & Sircar, P. (2020). Automated emotion recognition based on higher order statistics and deep learning algorithm. Biomedical Signal Processing and Control. https://doi.org/10.1016/j.bspc.2020.101867
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.