Cross-Subject EEG Feature Selection for Emotion Recognition Using Transfer Recursive Feature Elimination
Open accessAbstract
Using machine-learning methodologies to analyze EEG signals becomes increasingly attractive for recognizing human emotions because of the objectivity of physiological data and the capability of the learning principles on modeling emotion classifiers from heterogeneous features. However, the conventional subject-specific classifiers may induce additional burdens to each subject for preparing multiple-session EEG data as training sets. To this end, we developed a new EEG feature selection approach, transfer recursive feature elimination (T-RFE), to determine a set of the most robust EEG indicators with stable geometrical distribution across a group of training subjects and a specific testing subject. A validating set is introduced to independently determine the optimal hyper-parameter and the feature ranking of the T-RFE model aiming at controlling the overfitting. The effectiveness of the T-RFE algorithm for such cross-subject emotion classification paradigm has been validated by DEAP database. With a linear least square support vector machine classifier implemented, the performance of the T-RFE is compared against several conventional feature selection schemes and the statistical significant improvement has been found. The classification rate and F-score achieve 0.7867, 0.7526, 0.7875, and 0.8077 for arousal and valence dimensions, respectively, and outperform several recent reported works on the same database. In the end, the T-RFE based classifier is compared against two subject-generic classifiers in the literature. The investigation of the computational time for all classifiers indicates the accuracy improvement of the T-RFE is at the cost of the longer training time.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Model personalising has been successfully applied in other fields such as mood recognition and seizure detection.
“Model personalising has been successfully applied in other fields, such as mood recognition117 and seizure detection118.”
From The future of sleep health: a data-driven revolution in sleep science and medicine (2020) · cites this paper as [117]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Recognition of emotions using multimodal physiological signals and an ensemble deep learning model
Yin, Z., Zhao, M., Wang, Y., Yang, J., & Zhang, J. (2017) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2016.12.005 · Cited by 416 · see citing works
Self-citation
Flagged first, then by citations
Research works printed but not linked: 34
- Anders S. Lotze M. Erb M. Grodd W. Birbaumer N. (2004). Brain activity underlying emotional valence and arousal: a response related fMRI study. Hum. Brain Mapp. 23, 200– 209. 10.1002/hbm.20048 15449355 PMC6871723 · DOI · Paper page
- Atkinson J. Campos D. (2016). Improving BCI-based emotion recognition by combining EEG feature selection and kernel classifiers, Expert. Syst. Appl. 47, 35– 41. 10.1016/j.eswa.2015.10.049 · DOI
- Balconi M. Mazza G. (2009). Brain oscillations and BIS/BAS (behavioral inhibition/activation system) effects on processing masked emotional cues: ERS/ERD and coherence measures of alpha band. Int. J. Psychophysiol. 74, 158– 165. 10.1016/j.ijpsycho.2009.08.006 19709636 · DOI · Paper page
- Baldwin C. Penaranda B. (2012). Adaptive training using an artificial neural network and EEG metrics for within and cross-task workload classification. Neuroimage 59, 48– 56. 10.1016/j.neuroimage.2011.07.047 21835243 · DOI
- Birbaumer N. (2006). Breaking the silence: brain-computer interfaces (BCI) for communication and motor control. Psychophysiology 43, 517– 532. 10.1111/j.1469-8986.2006.00456.x 17076808 · DOI · Paper page
- Bishop C. M. (2006). Pattern Recognition and Machine Learning. New York, NY: Springer.
- Brunner C. Vidaurre C. Billinger M. Neuper C. (2011). A comparison of univariate, vector, bilinear autoregressive, and band power features for brain-computer interfaces. Med. Biol. Eng. Comput. 49, 1337– 1346. 10.1007/s11517-011-0828-x 21947797 PMC3208819 · DOI
- Chen J. Hua B. Moore P. Zhang X. Ma X. (2015). Electroencephalogram-based emotion assessment system using ontology and data mining techniques. Appl. Soft. Comput. 30, 663– 674. 10.1016/j.asoc.2015.01.007 · DOI
- Christensen J. Estepp J. Wilson G. Russell C. (2012). The effects of day-to-day variability of physiological data on operator functional state classification. Neuroimage 59, 57– 63. 10.1016/j.neuroimage.2011.07.091 21840403 · DOI · Paper page
- Fanelli G. Gall J. Romsdorfer H. Weise T. Van Gool L. (2010). A 3-D audio-visual corpus of affective communication. IEEE Trans. Multimedia 12, 591– 598. 10.1109/TMM.2010.2052239 · DOI
- Guyon I. Weston J. Barnhill S. Vapnik V. (2002). Gene selection forcancer classification using support vector machines. Mach. Learn. 46, 389– 422. 10.1023/A:1012487302797 · DOI · Paper page
- Hanjalic A. Xu L.-Q. (2005). Affective video content representation and modeling. IEEE Trans. Multimedia 7, 143– 154. 10.1109/TMM.2004.840618 · DOI
- Khezri M. Firoozabadi M. Sharafat A. R. (2015). Reliable emotion recognition system based on dynamic adaptive fusion of forehead biopotentials and physiological signals. Comput. Methods Prog. Biomed. 122, 149– 164. 10.1016/j.cmpb.2015.07.006 26253158 · DOI · Paper page
- Kim J. Andre E. (2008). Emotion recognition based on physiological changes in music listening. IEEE Trans. Pattern Anal. Mach. Intell. 30, 2067– 2083. 10.1109/TPAMI.2008.26 18988943 · DOI
- Koelstra S. Muehl C. Soleymani M. Lee J.-S. Yazdani A. Ebrahimi T. E. (2012). DEAP: a database for emotion analysis using physiological signals. IEEE Trans. Affect. Comput. 3, 18– 31. 10.1109/T-AFFC.2011.15 · DOI · Paper page
- Konstantinidis E. I. Frantzidis C. A. Pappas C. Bamidis P. D. (2012). Real time emotion aware applications: a case study employing emotion evocative pictures and neuro-physiological sensing enhanced by graphic processor units. Comput. Methods Prog. Biomed. 107, 16– 27. 10.1016/j.cmpb.2012.03.008 22520825 · DOI
- Lang P. J. (1995). The emotion probe: studies of motivation and attention. Am. Psychol. 50, 372– 385. 10.1037/0003-066X.50.5.372 7762889 · DOI
- Li C. Xu C. Feng Z. (2016). Analysis of physiological for emotion recognition with the IRS model. Neurocomputing 178, 103– 111. 10.1016/j.neucom.2015.07.112 · DOI
- Li X. Zhang P. Song D. Yu G. Hou Y. Hu B. (2015). EEG based emotion identification using unsupervised deep feature learning, in SIGIR2015 Workshop on Neuro-Physiological Methods in IR Research (Santiago) (Accessed August 13, 2015).
- Liu Y. Sourina O. (2012). EEG-based valence level recognition for real-time applications. IEEE Int. Conf. Cyberworlds, 53– 60. 10.1109/CW.2012.15 · DOI
- Naseer N. Noori F. M. Qureshi N. K. Hong K.-S. (2016). Determining optimal feature-combination for LDA classification of functional near-infrared spectroscopy signals in brain-computer interface application. Front. Hum. Neurosci. 10: 237. 10.3389/fnhum.2016.00237 27252637 PMC4879140 · DOI
- Naser D. S. Saha G. (2013). Recognition of emotions induced by music videos using DT-CWPT, in Indian Conference on Medical Informatics and Telemedicine (ICMIT) (Kharagpur: IEEE), 53– 57.
- Russell J. A. (1980). A circumplex model of affect. J. Pers. Soc. Psychol. 39, 1161– 1178. 10.1037/h0077714 · DOI · Paper page
- Soleymani M. Lichtenauer J. Pun T. Pantic M. (2012). A multi-modal database for affect recognition and implicit tagging. IEEE Trans. Affect. Comput. 3, 42– 55. 10.1109/T-AFFC.2011.25 · DOI · Paper page
- Vapnik V. (2000). The Nature of Statistical Learning Theory. New York, NY: Springer.
- Verma G. K. Tiwary U. S. (2014). Multimodal fusion framework: a multiresolution approach for emotion classification and recognition from physiological signal. Neuroimage 102, 162– 172. 10.1016/j.neuroimage.2013.11.007 24269801 · DOI · Paper page
- Wang D. Shang Y. (2013). Modeling physiological data with deep belief networks. Int. J. Inf. Educ. Technol. 3, 505– 511. 10.7763/IJIET.2013.V3.326 25165501 PMC4142685 · DOI
- Wang Z. Hope R. M. Wang Z. Ji Q. Gray W. D. (2012). Cross-subject workload classification with a hierarchical Bayes model. Neuroimage 59, 64– 69. 10.1016/j.neuroimage.2011.07.094 21867763 · DOI
- Yin Z. Zhang J. (2014). Operator functional state classification using least-square support vector machine based recursive feature elimination technique. Comput. Methods Prog. Biomed. 113, 101– 115. 10.1016/j.cmpb.2013.09.007 24138846 · DOI
- Yoon H. J. Chung S. Y. (2013). EEG-based emotion estimation using Bayesian weighted-log-posterior function and perceptron convergence algorithm. Comput. Biol. Med. 43, 2230– 2237. 10.1016/j.compbiomed.2013.10.017 24290940 · DOI
- Zeng Z. Pantic M. Roisman G. I. Huang T. S. (2009). A survey of affect recognition methods: audio, visual, and spontaneous expressions. IEEE Trans. Pattern Anal. Mach. Intell. 31, 39– 58. 10.1109/TPAMI.2008.52 19029545 · DOI · Paper page
- Zhang J. Yin Z. Wang R. (2015). Recognition of mental workload levels under complex human-machine collaboration by using physiological features and adaptive support vector machines. IEEE Trans. Hum. Mach. Syst. 45, 200– 214. 10.1109/THMS.2014.2366914 · DOI
- Zhang Q. Lee M. (2013). Analyzing the dynamics of emotional scene sequence using recurrent neuro-fuzzy network. Cogn. Neurodyn. 7, 47– 57. 10.1007/s11571-012-9216-y 24427190 PMC3538097 · DOI
- Zhang Y. Ji X. Zhang S. (2016). An approach to EEG-based emotion recognition using combined feature extraction method. Neurosci. Lett. 633, 152– 157. 10.1016/j.neulet.2016.09.037 27666975 · DOI
Cited by
Sorted by citations
Emotion recognition using multi-modal data and machine learning techniques: A tutorial and review
Zhang, J., Yin, Z., Chen, P., & Nichele, S. (2020) · Information Fusion · doi:10.1016/j.inffus.2020.01.011 · Cited by 806 · see citing works
Self-citationThe future of sleep health: a data-driven revolution in sleep science and medicine
Perez-Pozuelo, I., Zhai, B., Palotti, J., Mall, R., Aupetit, M., Garcia-Gomez, J. M., Taheri, S., Guan, Y., & Fernandez-Luque, L. (2020) · npj Digital Medicine · doi:10.1038/s41746-020-0244-4 · Cited by 311 · see citing works
Emotion Recognition from Multiband EEG Signals Using CapsNet
Chao, H., Dong, L., Liu, Y., & Lu, B. (2019) · Sensors · doi:10.3390/s19092212 · Cited by 287 · see citing works
SAE+LSTM: A New Framework for Emotion Recognition From Multi-Channel EEG
Xing, X., Li, Z., Xu, T., Shu, L., Hu, B., & Xu, X. (2019) · Frontiers in Neurorobotics · doi:10.3389/fnbot.2019.00037 · Cited by 269 · see citing works
Automated emotion recognition: Current trends and future perspectives
Maithri, M., Raghavendra, U., Gudigar, A., Samanth, J., Barua, P. D., Murugappan, M., Chakole, Y., & Acharya, U. R. (2022) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2022.106646 · Cited by 172 · see citing works
- Authors
- Yin, Z., Wang, Y., Liu, L., Zhang, W., & Zhang, J.
- Affiliations
- University of Shanghai for Science and Technology (CN)
- East China University of Science and Technology (CN)
- Corresponding author
- Yin, Zhong
- Wang, Yongxiong
- Venue
- Frontiers in Neurorobotics
- Publisher
- Frontiers Media SA
- Published
- 2017-04-10
- Volume
- 11
- Pages
- 19-19
- ISSN
- 1662-5218 (ISSN-L)
- PMC
- PMC5385370
- OpenAlex
- W2604825588
- Cited by
- 155
- References
- 1
- Citations by year
- 2026: 5 · 2025: 10 · 2024: 18 · 2023: 16 · 2022: 25 · 2021: 25 · 2020: 24 · 2019: 19 · 2018: 8 · 2017: 5
- FWCI
- 19.94
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- Frontiers in Neurorobotics (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Funders
- National Natural Science Foundation of China (61673276, 11502145, 61603256)
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Emotion and Mood Recognition
- Life Sciences › Neuroscience › Cognitive Neuroscience › EEG and Brain-Computer Interfaces
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Face and Expression Recognition
- Keywords
- EEG feature selection, emotion recognition, cross-subject classification, DEAP database, valence and arousal, least squares support vector machine, overfitting reduction, EEG biomarkers
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review