The DOI matches its Crossref record; 38 of the 38 references it cites were found in a registry or an index.
Time–Frequency Representation and Convolutional Neural Network-Based Emotion Recognition
Abstract
Emotions composed of cognizant logical reactions toward various situations. Such mental responses stem from physiological, cognitive, and behavioral changes. Electroencephalogram (EEG) signals provide a noninvasive and nonradioactive solution for emotion identification. Accurate and automatic classification of emotions can boost the development of human-computer interface. This article proposes automatic extraction and classification of features through the use of different convolutional neural networks (CNNs). At first, the proposed method converts the filtered EEG signals into an image using a time-frequency representation. Smoothed pseudo-Wigner-Ville distribution is used to transform time-domain EEG signals into images. These images are fed to pretrained AlexNet, ResNet50, and VGG16 along with configurable CNN. The performance of four CNNs is evaluated by measuring the accuracy, precision, Mathew's correlation coefficient, F1-score, and false-positive rate. The results obtained by evaluating four CNNs show that configurable CNN requires very less learning parameters with better accuracy. Accuracy scores of 90.98%, 91.91%, 92.71%, and 93.01% obtained by AlexNet, ResNet50, VGG16, and configurable CNN show that the proposed method is best among other existing methods.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <0.5MB model size
Iandola, F. N., Han, S., Moskewicz, M. W., Ashraf, K., Dally, W. J., & Keutzer, K. (2016) · arXiv · doi:10.48550/arxiv.1602.07360 · Cited by 6,201
Han, S., Mao, H., & Dally, W. J. (2015) · arXiv · doi:10.48550/arxiv.1510.00149 · Cited by 4,662
The Lack of A Priori Distinctions Between Learning Algorithms
Wolpert, D. H. (1996) · Neural Computation · doi:10.1162/neco.1996.8.7.1341 · Cited by 1,647
EEG-Based Emotion Recognition in Music Listening
Lin, Y.-P., Wang, C.-H., Jung, T.-P., Wu, T.-L., Jeng, S.-K., Duann, J.-R., & Chen, J.-H. (2010) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2010.2048568 · Cited by 1,021
Coding, analysis, interpretation, and recognition of facial expressions
Essa, I. A., & Pentland, A. P. (1997) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.598232 · Cited by 911
Emotional state classification from EEG data using machine learning approach
Wang, X.-W., Nie, D., & Lu, B.-L. (2014) · Neurocomputing · doi:10.1016/j.neucom.2013.06.046 · Cited by 755
Emotion Recognition From EEG Using Higher Order Crossings
Petrantonakis, P. C., & Hadjileontiadis, L. J. (2010) · IEEE Transactions on Information Technology in Biomedicine · doi:10.1109/titb.2009.2034649 · Cited by 687
Improving BCI-based emotion recognition by combining EEG feature selection and kernel classifiers
Atkinson, J., & Campos, D. (2016) · Expert Systems with Applications · doi:10.1016/j.eswa.2015.10.049 · Cited by 506
Classification of human emotion from EEG using discrete wavelet transform
Murugappan, M., Ramachandran, N., & Sazali, Y. (2010) · Journal of Biomedical Science and Engineering · doi:10.4236/jbise.2010.34054 · Cited by 436
The History Began from AlexNet: A Comprehensive Survey on Deep Learning Approaches
Alom, M. Z., Taha, T. M., Yakopcic, C., Westberg, S. K. E., Sidike, P., Nasrin, M. S., Essen, B. C. V., Awwal, A. A. S., & Asari, V. K. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1803.01164 · Cited by 426
EEG-based emotion classification using deep belief networks
Zheng, W.-L., Zhu, J.-Y., Peng, Y., & Lu, B.-L. (2014) · 2014 IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme.2014.6890166 · Cited by 367
Wavelet-based emotion recognition system using EEG signal
Mohammadi, Z., Frounchi, J., & Amiri, M. (2017) · Neural Computing and Applications · doi:10.1007/s00521-015-2149-8 · Cited by 361
EEG-based emotion recognition during watching movies
Nie, D., Wang, X.-W., Shi, L.-C., & Lu, B.-L. (2011) · 2011 5th International IEEE/EMBS Conference on Neural Engineering · doi:10.1109/ner.2011.5910636 · Cited by 360
Real-Time Movie-Induced Discrete Emotion Recognition from EEG Signals
Liu, Y.-J., Yu, M., Zhao, G., Song, J., Ge, Y., & Shi, Y. (2018) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2017.2660485 · Cited by 356
Multichannel EEG-Based Emotion Recognition via Group Sparse Canonical Correlation Analysis
Zheng, W. (2017) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2016.2587290 · Cited by 303
Classifying Different Emotional States by Means of EEG-Based Functional Connectivity Patterns
Lee, Y.-Y., & Hsieh, S. (2014) · PLoS ONE · doi:10.1371/journal.pone.0095415 · Cited by 301
Cross-Subject Emotion Recognition Using Flexible Analytic Wavelet Transform From EEG Signals
Gupta, V., Chopda, M. D., & Pachori, R. B. (2019) · IEEE Sensors Journal · doi:10.1109/jsen.2018.2883497 · Cited by 293
Emotion Recognition from EEG Signals Using Multidimensional Information in EMD Domain
Zhuang, N., Zeng, Y., Tong, L., Zhang, C., Zhang, H., & Yan, B. (2017) · BioMed Research International · doi:10.1155/2017/8317357 · Cited by 283
Toward an EEG-Based Recognition of Music Liking Using Time-Frequency Analysis
Hadjidimitriou, S. K., & Hadjileontiadis, L. J. (2012) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2012.2217495 · Cited by 260
EEG-Based Emotion Recognition Using Frequency Domain Features and Support Vector Machines
Wang, X.-W., Nie, D., & Lu, B.-L. (2011) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-24955-6_87 · Cited by 259
Koelstra, S., Yazdani, A., Soleymani, M., Mühl, C., Lee, J.-S., Nijholt, A., Pun, T., Ebrahimi, T., & Patras, I. (2010) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-15314-3_9 · Cited by 186
Yin, Z., Wang, Y., Liu, L., Zhang, W., & Zhang, J. (2017) · Frontiers in Neurorobotics · doi:10.3389/fnbot.2017.00019 · Cited by 155
EEG-Based Emotion Recognition Using Quadratic Time-Frequency Distribution
Alazrai, R., Homoud, R., Alwanni, H., & Daoud, M. I. (2018) · Sensors · doi:10.3390/s18082739 · Cited by 140
Internal Emotion Classification Using EEG Signal With Sparse Discriminative Ensemble
Ullah, H., Uzair, M., Mahmood, A., Ullah, M., Khan, S. D., & Cheikh, F. A. (2019) · IEEE Access · doi:10.1109/access.2019.2904400 · Cited by 125
Emotion recognition based on EEG features in movie clips with channel selection
Özerdem, M. S., & Polat, H. (2017) · Brain Informatics · doi:10.1007/s40708-017-0069-3 · Cited by 119
EEG-based Emotion Recognition Using Self-Organizing Map for Boundary Detection
Khosrowabadi, R., Quek, C. H., Wahab, A., & Ang, K. K. (2010) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr.2010.1031 · Cited by 116
Asymmetric Spatial Pattern for EEG-based emotion detection
Huang, D., Guan, C., Ang, K. K., Zhang, H., & Pan, Y. (2012) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2012.6252390 · Cited by 113
Taran, S., & Bajaj, V. (2019) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2019.03.015 · Cited by 110
Self-citationHuman emotion classification using wavelet transform and KNN
Murugappan, M. (2011) · International Conference on Pattern Analysis and Intelligence Robotics (ICPAIR) · doi:10.1109/icpair.2011.5976886 · Cited by 90
Emotion classification using EEG signals based on tunable‐ Q wavelet transform
Krishna, A. H., Sri, A. B., Priyanka, K. Y. V. S., Taran, S., & Bajaj, V. (2018) · IET Science Measurement & Technology · doi:10.1049/iet-smt.2018.5237 · Cited by 67
Self-citationHuman Emotion Classification from EEG Signals Using Multiwavelet Transform
Bajaj, V., & Pachori, R. B. (2014) · International Conference on Medical Biometrics · doi:10.1109/icmb.2014.29 · Cited by 52
Self-citationEmotion classification using flexible analytic wavelet transform for electroencephalogram signals
Bajaj, V., Taran, S., & Şengür, A. (2018) · Health Information Science and Systems · doi:10.1007/s13755-018-0048-y · Cited by 51
Self-citationGuo, K., Chai, R., Candra, H., Guo, Y., Song, R., Nguyen, H. T., & Su, S. W. (2018) · International Journal of Fuzzy Systems · doi:10.1007/s40815-018-0567-3 · Cited by 48
Smoothed pseudo Wigner–Ville distribution as an alternative to Fourier transform in rats
Neto, E. P. D. S., Custaud, M., Frutoso, J., Somody, L., Gharib, C., & Fortrat, J. (2001) · Autonomic Neuroscience · doi:10.1016/s1566-0702(00)00211-3 · Cited by 41
A novel EEG-based approach to classify emotions through phase space dynamics
Soroush, M. Z., Maghooli, K., Setarehdan, S. K., & Nasrabadi, A. M. (2019) · Signal Image and Video Processing · doi:10.1007/s11760-019-01455-y · Cited by 30
Arousal‐valence recognition using CNN with STFT feature‐combined image
Lee, H.-J., & Lee, S.-G. (2017) · Electronics Letters · doi:10.1049/el.2017.3538 · Cited by 19
Speech Emotion Recognition and Intensity Estimation
Song, M., Chen, C., Bu, J., & You, M. (2004) · Lecture notes in computer science · doi:10.1007/978-3-540-24768-5_43 · Cited by 11
Cited by
Khare, S. K., Blanes-Vidal, V., Nadimi, E. S., & Acharya, U. R. (2024) · Information Fusion · doi:10.1016/j.inffus.2023.102019 · Cited by 469
Self-citationNour, M., Cömert, Z., & Polat, K. (2020) · Applied Soft Computing · doi:10.1016/j.asoc.2020.106580 · Cited by 316
Emotion recognition in EEG signals using deep learning methods: A review
Jafari, M., Shoeibi, A., Khodatars, M., Bagherzadeh, S., Shalbaf, A., García, D. L., Gorriz, J. M., & Acharya, U. R. (2023) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2023.107450 · Cited by 240
Pan, B., Hirota, K., Jia, Z., & Dai, Y. (2023) · Neurocomputing · doi:10.1016/j.neucom.2023.126866 · Cited by 142
Long Dialogue Emotion Detection Based on Commonsense Knowledge Graph Guidance
Nie, W., Bao, Y., Zhao, Y., & Liu, A. (2024) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2023.3267295 · Cited by 96
Metadata
- Authors
- Khare, S. K., & Bajaj, V.
- Venue
- IEEE Transactions on Neural Networks and Learning Systems
- Published
- 2021-07
- Volume
- 32
- Issue
- 7
- Pages
- 2901-2909
- ISSN
- 2162-237X (ISSN-L)
- 2162-2388
- OpenAlex
- W3046236234
- Cited by
- 299
- References
- 38
- FWCI
- 37.71
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.