The DOI matches its Crossref record; 40 of the 40 references it cites were found in a registry or an index.
Domain Adaptation for EEG Emotion Recognition Based on Latent Representation Similarity
Abstract
Emotion recognition has many potential applications in the real world. Among the many emotion recognition methods, electroencephalogram (EEG) shows advantage in reliability and accuracy. However, the individual differences of EEG limit the generalization of emotion classifiers across subjects. Moreover, due to the nonstationary characteristic of EEG, the signals of one subject change over time, which is a challenge to acquire models that could work across sessions. In this article, we propose a novel domain adaptation method to generalize the emotion recognition models across subjects and sessions. We use neural networks to implement the emotion recognition models, which are optimized by minimizing the classification error on the source while making the source and the target similar in their latent representations. Considering the functional differences of the network layers, we use adversarial training to adapt the marginal distributions in the early layers and perform association reinforcement to adapt the conditional distributions in the last layers. In this way, we approximately adapt the joint distributions by simultaneously adapting marginal distributions and conditional distributions. The method is compared with multiple representatives and recent domain adaptation algorithms on benchmark SEED and DEAP for recognizing three and four affective states, respectively. The experimental results show that the proposed method reaches and outperforms the state of the arts.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(2008) · Journal of Machine Learning Research · Cited by 33,051
Pan, S. J., & Yang, Q. (2010) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2009.191 · Cited by 23,387 · cited 1×
“Let P ( X ) be the marginal probability distribution of X , then D = { X , P ( X ) } is a domain [15].”
BackgroundLabaca-Castro, R. (2023) · Machine Learning under Malware Attack · doi:10.1007/978-3-658-40442-0_9 · Cited by 19,272
GAN(Generative Adversarial Nets)
(2017) · Journal of Japan Society for Fuzzy Theory and Intelligent Informatics · doi:10.3156/jsoft.29.5_177_2 · Cited by 19,270
Unsupervised representation learning with deep convolutional generative adversarial networks
Radford, A., Metz, L., & Chintala, S. (2015) · arXiv · doi:10.48550/arxiv.1511.06434 · Cited by 12,235
How transferable are features in deep neural networks?
Yosinski, J., Clune, J., Bengio, Y., & Lipson, H. (2014) · arXiv · doi:10.48550/arxiv.1411.1792 · Cited by 6,061 · cited 1×
“Considering that the shallower layers tend to generate task-invariant features, and the deeper layers are more likely to generate task-specific features [30], we use two distinct domain adaptation strategies on the whole network.”
MethodAdversarial Discriminative Domain Adaptation
Tzeng, E., Hoffman, J., Saenko, K., & Darrell, T. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.316 · Cited by 5,154 · cited 1×
“…adversarial networks (GANs) [24], the domain adversarial neural networks (DANNs) [25] and the adversarial discriminative domain adaptation (ADDA) [26] introduced adversarial training strategy to compel the shallow layers to learn domain-invariant representations and achieved the state of the art…”
BackgroundDEAP: A Database for Emotion Analysis ;Using Physiological Signals
Koelstra, S., Muhl, C., Soleymani, M., Lee, J.-S., Yazdani, A., Ebrahimi, T., Pun, T., Nijholt, A., & Patras, I. (2012) · IEEE Transactions on Affective Computing · doi:10.1109/t-affc.2011.15 · Cited by 5,093
Domain Adaptation via Transfer Component Analysis
Pan, S. J., Tsang, I. W., Kwok, J. T., & Yang, Q. (2011) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2010.2091281 · Cited by 4,753
Learning Transferable Features with Deep Adaptation Networks
Long, M., Cao, Y., Wang, J., & Jordan, M. I. (2015) · arXiv · doi:10.48550/arxiv.1502.02791 · Cited by 4,505
Emotion recognition in human-computer interaction
Cowie, R., Douglas-Cowie, E., Tsapatsoulis, N., Votsis, G., Kollias, S., Fellenz, W., & Taylor, J. G. (2001) · IEEE Signal Processing Magazine · doi:10.1109/79.911197 · Cited by 2,603
Zheng, W.-L., & Lu, B.-L. (2015) · IEEE Transactions on Autonomous Mental Development · doi:10.1109/tamd.2015.2431497 · Cited by 2,595
Deep domain confusion Maximizing for domain invariance
Tzeng, E., Hoffman, J., Zhang, N., Saenko, K., & Darrell, T. (2014) · arXiv · doi:10.48550/arxiv.1412.3474 · Cited by 2,285
Transfer Feature Learning with Joint Distribution Adaptation
Long, M., Wang, J., Ding, G., Sun, J., & Yu, P. S. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.274 · Cited by 2,071
Covariate Shift Adaptation by Importance Weighted Cross Validation
Sugiyama, M., Krauledat, M., & Müller, K. (2007) · Publikationsdatenbank der Fraunhofer-Gesellschaft (Fraunhofer-Gesellschaft) · doi:10.5555/1314498.1390324 · Cited by 1,227
Emotions Recognition Using EEG Signals: A Survey
Alarcao, S. M., & Fonseca, M. J. (2019) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2017.2714671 · Cited by 1,201 · cited 4×
“In recent years, researchers introduced deep neural networks (DNNs) to emotion recognition, which showed an advantage over shallow models due to the representational learning capacity [6], [8], [11].”
BackgroundMethodInfluentialDifferential entropy feature for EEG-based emotion classification
Duan, R.-N., Zhu, J.-Y., & Lu, B.-L. (2013) · 2013 6th International IEEE/EMBS Conference on Neural Engineering (NER) · doi:10.1109/ner.2013.6695876 · Cited by 1,100
Feature Extraction and Selection for Emotion Recognition from EEG
Jenke, R., Peer, A., & Buss, M. (2014) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2014.2339834 · Cited by 1,081
Identifying Stable Patterns over Time for Emotion Recognition from EEG
Zheng, W.-L., Zhu, J.-Y., & Lu, B.-L. (2019) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2017.2712143 · Cited by 990
Kernel PCA and De-Noising in Feature Spaces
Mika, S., Schölkopf, B., Smola, A. J., Müller, K., Scholz, M., & Rätsch, G. (1998) · Cited by 888
Jensen-Shannon divergence and Hilbert space embedding
Fuglede, B., & Topsoe, F. (2004) · International Symposium onInformation Theory, 2004. ISIT 2004. Proceedings. · doi:10.1109/isit.2004.1365067 · Cited by 612
Equivalence of distance-based and RKHS-based statistics in hypothesis testing
Sejdinovic, D., Sriperumbudur, B., Gretton, A., & Fukumizu, K. (2013) · The Annals of Statistics · doi:10.1214/13-aos1140 · Cited by 582 · cited 1×
“In recent years, the maximum mean discrepancy (MMD) [19] and the multikernel MMD (MK-MMD) [20] have shown an advantage in domain adaptation.”
BackgroundOptimal kernel choice for large-scale two-sample tests
Gretton, A., Sejdinović, D., Strathmann, H., Balakrishnan, S., Pontil, M., Fukumizu, K., & Sriperumbudur, B. K. (2012) · Cited by 563
Joyce, J. M. (2011) · International Encyclopedia of Statistical Science · doi:10.1007/978-3-642-04898-2_327 · Cited by 555
Jayaram, V., Alamgir, M., Altun, Y., Scholkopf, B., & Grosse-Wentrup, M. (2016) · IEEE Computational Intelligence Magazine · doi:10.1109/mci.2015.2501545 · Cited by 468
Collobert, R., Sinz, F. H., Weston, J., & Bottou, L. (2006) · doi:10.5555/1248547.1248609 · Cited by 466
Ahern, G. L., & Schwartz, G. E. (1985) · Neuropsychologia · doi:10.1016/0028-3932(85)90081-8 · Cited by 437
Differential entropy feature for EEG-based vigilance estimation
Shi, L.-C., Jiao, Y.-Y., & Lu, B.-L. (2013) · 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc.2013.6611075 · Cited by 396
Hierarchical Convolutional Neural Networks for EEG-Based Emotion Recognition
Li, J., Zhang, Z., & He, H. (2018) · Cognitive Computation · doi:10.1007/s12559-017-9533-x · Cited by 337
Self-citationEmotion representation, analysis and synthesis in continuous space: A survey
Gunes, H., Schuller, B., Pantic, M., & Cowie, R. (2011) · Face and Gesture 2011 · doi:10.1109/fg.2011.5771357 · Cited by 322
Emotion Recognition in Children and Adolescents with Autism Spectrum Disorders
Kuusikko, S., Haapsamo, H., Jansson-Verkasalo, E., Hurtig, T., Mattila, M.-L., Ebeling, H., Jussila, K., Bölte, S., & Moilanen, I. (2009) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-009-0700-0 · Cited by 267
Personalizing EEG-based affective models with transfer learning
Zheng, W., & Lu, B. (2016) · International Joint Conference on Artificial Intelligence · Cited by 265
Stratified Transfer Learning for Cross-domain Activity Recognition
Wang, J., Chen, Y., Hu, L., Peng, X., & Yu, P. S. (2018) · 2018 IEEE International Conference on Pervasive Computing and Communications (PerCom) · doi:10.1109/percom.2018.8444572 · Cited by 253
Towards Zero Training for Brain-Computer Interfacing
Krauledat, M., Tangermann, M., Blankertz, B., & Müller, K.-R. (2008) · PLoS ONE · doi:10.1371/journal.pone.0002967 · Cited by 249
Haeusser, P., Frerix, T., Mordvintsev, A., & Cremers, D. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.301 · Cited by 237
Multimodal assistive technologies for depression diagnosis and monitoring
Joshi, J., Goecke, R., Alghowinem, S., Dhall, A., Wagner, M., Epps, J., Parker, G., & Breakspear, M. (2013) · Journal on Multimodal User Interfaces · doi:10.1007/s12193-013-0123-2 · Cited by 179
Sangineto, E., Zen, G., Ricci, E., & Sebe, N. (2014) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/2647868.2654916 · Cited by 150
Learning by Association — A Versatile Semi-Supervised Training Method for Neural Networks
Haeusser, P., Mordvintsev, A., & Cremers, D. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.74 · Cited by 132
Learning a common dictionary for subject-transfer decoding with resting calibration
Morioka, H., Kanemura, A., Hirayama, J.-I., Shikauchi, M., Ogawa, T., Ikeda, S., Kawanabe, M., & Ishii, S. (2015) · NeuroImage · doi:10.1016/j.neuroimage.2015.02.015 · Cited by 127
Off-line and on-line vigilance estimation based on linear dynamical system and manifold learning
Shi, L.-C., & Lu, B. (2010) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/iembs.2010.5627125 · Cited by 93
Cited by
A review on transfer learning in EEG signal analysis
Wan, Z., Yang, R., Huang, M., Zeng, N., & Liu, X. (2021) · Neurocomputing · doi:10.1016/j.neucom.2020.09.017 · Cited by 468
Transfer Learning for EEG-Based Brain–Computer Interfaces: A Review of Progress Made Since 2016
Wu, D., Xu, Y., & Lu, B.-L. (2022) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2020.3007453 · Cited by 434
Contrastive Learning of Subject-Invariant EEG Representations for Cross-Subject Emotion Recognition
Shen, X., Liu, X., Hu, X., Zhang, D., & Song, S. (2023) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2022.3164516 · Cited by 296
EEG-Based BCI Emotion Recognition: A Survey
Torres, E. P., Torres, E. A., Hernández-Álvarez, M., & Yoo, S. G. (2020) · Sensors · doi:10.3390/s20185083 · Cited by 291
Multimodal Emotion Recognition Using a Hierarchical Fusion Convolutional Neural Network
Zhang, Y., Cheng, C., & Zhang, Y. (2021) · IEEE Access · doi:10.1109/access.2021.3049516 · Cited by 84
Metadata
- Authors
- Li, J., Qiu, S., Du, C., Wang, Y., & He, H.
- Venue
- IEEE Transactions on Cognitive and Developmental Systems
- Published
- 2020-06
- Volume
- 12
- Issue
- 2
- Pages
- 344-353
- ISSN
- 2379-8920 (ISSN-L)
- 2379-8939
- OpenAlex
- W2982126608
- Cited by
- 291
- References
- 40
- FWCI
- 25.74
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.