Transfer Learning: A Riemannian Geometry framework with applications to Brain-Computer Interfaces
Open accessThe DOI matches its Crossref record; 37 of the 38 references it cites were found in a registry or an index.
Abstract
Objective This paper tackles the problem of transfer learning in the context of electroencephalogram (EEG)-based brain-computer interface (BCI) classification. In particular, the problems of cross-session and cross-subject classification are considered. These problems concern the ability to use data from previous sessions or from a database of past users to calibrate and initialize the classifier, allowing a calibration-less BCI mode of operation. Methods Data are represented using spatial covariance matrices of the EEG signals, exploiting the recent successful techniques based on the Riemannian geometry of the manifold of symmetric positive definite (SPD) matrices. Cross-session and cross-subject classification can be difficult, due to the many changes intervening between sessions and between subjects, including physiological, environmental, as well as instrumental changes. Here, we propose to affine transform the covariance matrices of every session/subject in order to center them with respect to a reference covariance matrix, making data from different sessions/subjects comparable. Then, classification is performed both using a standard minimum distance to mean classifier, and through a probabilistic classifier recently developed in the literature, based on a density function (mixture of Riemannian Gaussian distributions) defined on the SPD manifold. Results The improvements in terms of classification performances achieved by introducing the affine transformation are docum…
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Experiments have shown that RA-MDRM outperformed MDRM in MI and ERP tasks [42], when compared in a TL setting.”
From Transfer Learning for Brain–Computer Interfaces: A Euclidean Space Data Alignment Approach (2020) · cites this paper as [42]
In the citing paper
“But as mentioned above, it still needs a small amount of labeled subject-specific calibration trials for ERP classification.”
From Transfer Learning for Brain–Computer Interfaces: A Euclidean Space Data Alignment Approach (2020) · cites this paper as [42]
In the citing paper
“Zanini et al. [42] proposed a novel TL approach in the Riemannian space, referred to in this paper as RA-MDRM, to improve the performance of the MDRM classifier by utilizing auxiliary data from other sessions and/or subjects when there are only a few labeled trials from a new subject.”
From Transfer Learning for Brain–Computer Interfaces: A Euclidean Space Data Alignment Approach (2020) · cites this paper as [42]
In the citing paper
“Although RA-MDRM has demonstrated promising performance in several BCI applications [42], it still has some limitations:”
From Transfer Learning for Brain–Computer Interfaces: A Euclidean Space Data Alignment Approach (2020) · cites this paper as [42]
In the citing paper
“[42] used the nontarget stimuli as the resting state in ERP, which requires that some labeled trials from the new subject must be known.”
From Transfer Learning for Brain–Computer Interfaces: A Euclidean Space Data Alignment Approach (2020) · cites this paper as [42]
2 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
(2008) · Journal of Machine Learning Research · Cited by 33,051
Pan, S. J., & Yang, Q. (2010) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2009.191 · Cited by 23,387 · cited 1×
“The second improvement relates to the problem of transfer learning [30].”
BackgroundOptimizing Spatial filters for Robust EEG Single-Trial Analysis
Blankertz, B., Tomioka, R., Lemm, S., Kawanabe, M., & Muller, K.-R. (2008) · IEEE Signal Processing Magazine · doi:10.1109/msp.2008.4408441 · Cited by 2,080 · cited 2×
“First, EEG signals of a training set are transformed through frequency and/or spatial filters in order to extract discriminant features [8], [16].”
BackgroundMethodA Riemannian Framework for Tensor Computing
Pennec, X., Fillard, P., & Ayache, N. (2006) · International Journal of Computer Vision · doi:10.1007/s11263-005-3222-z · Cited by 1,550 · cited 1×
“Some of them try to find the right value through numerical procedure like deterministic line search [17], [26], simple or stochastic gradient descent [10], [31].”
BackgroundSingle-trial analysis and classification of ERP components — A tutorial
Blankertz, B., Lemm, S., Treder, M., Haufe, S., & Müller, K.-R. (2011) · NeuroImage · doi:10.1016/j.neuroimage.2010.06.048 · Cited by 1,138 · cited 4×
“This is done by supervised techniques like, for instance, Linear Discriminant Analysis (LDA) [9].”
MethodInfluentialRegularizing Common Spatial Patterns to Improve BCI Designs: Unified Theory and New Algorithms
Lotte, F., & Guan, C. (2011) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2010.2082539 · Cited by 1,045 · cited 1×
“Some examples of transfer learning applied to BCI problem can be found in [15], [21], [27] and [36].”
BackgroundBhatia, R. (2009) · Princeton University Press eBooks · doi:10.1515/9781400827787 · Cited by 1,027
Multiclass Brain–Computer Interface Classification by Riemannian Geometry
Barachant, A., Bonnet, S., Congedo, M., & Jutten, C. (2012) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2011.2172210 · Cited by 878 · cited 7×
“In [2] the authors used a basic classifier, named Minimum Distance to Mean (MDM), which takes into account distances on the manifold between the observations and some reference points of the classes, known as centers of mass, means, or barycenters.”
MethodInfluentialSelf-citationA Differential Geometric Approach to the Geometric Mean of Symmetric Positive-Definite Matrices
Moakher, M. (2005) · SIAM Journal on Matrix Analysis and Applications · doi:10.1137/s0895479803436937 · Cited by 702 · cited 1×
“Since P (n) is a Riemannian manifold of non-positive curvature, existence and unicity of the Riemannian mean can be proved [1], [28].”
BackgroundBCI Competition 2008 { Graz data set B
Leeb, R., & Brunner, C. (2008) · Cited by 615
Stochastic Gradient Descent on Riemannian Manifolds
Bonnabel, S. (2013) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2013.2254619 · Cited by 540 · cited 1×
“Some of them try to find the right value through numerical procedure like deterministic line search [17], [26], simple or stochastic gradient descent [10], [31].”
BackgroundClassification of covariance matrices using a Riemannian-based kernel for BCI applications
Barachant, A., Bonnet, S., Congedo, M., & Jutten, C. (2013) · Neurocomputing · doi:10.1016/j.neucom.2012.12.039 · Cited by 493 · cited 1×
“In [3], instead, the authors introduce a way to solve the shift problem in a Riemannian framework, for the cross-session situation, however this approach depends”
BackgroundSelf-citationJayaram, V., Alamgir, M., Altun, Y., Scholkopf, B., & Grosse-Wentrup, M. (2016) · IEEE Computational Intelligence Magazine · doi:10.1109/mci.2015.2501545 · Cited by 468 · cited 1×
“Some examples of transfer learning applied to BCI problem can be found in [15], [21], [27] and [36].”
BackgroundRiemannian geometry for EEG-based brain-computer interfaces; a primer and a review
Congedo, M., Barachant, A., & Bhatia, R. (2017) · Brain-Computer Interfaces · doi:10.1080/2326263x.2017.1297192 · Cited by 456 · cited 2×
“In [2], [12], [15] a comparison of Riemannian techniques to other standard methods, like Common Spatial Pattern (CSP) and Linear Discriminant Analysis (LDA), is presented.”
BackgroundMethodSelf-citationBCILAB: a platform for brain–computer interface development
Kothe, C. A., & Makeig, S. (2013) · Journal of Neural Engineering · doi:10.1088/1741-2560/10/5/056014 · Cited by 412 · cited 1×
“2742541 the user through the analysis of neurophysiological signals [24], [32].”
BackgroundMulticlass Common Spatial Patterns and Information Theoretic Feature Extraction
Grosse-Wentrup, M., & Buss, M. (2008) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2008.921154 · Cited by 389 · cited 1×
“this stage is the Common Spatial Pattern (CSP) [18], [19].”
BackgroundThe Berlin brain-computer interface: EEG-based communication without subject training
Blankertz, B., Dornhege, G., Krauledat, M., Muller, K.-R., Kunzmann, V., Losch, F., & Curio, G. (2006) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2006.875557 · Cited by 332
Riemannian $L^{p}$ center of mass: Existence, uniqueness, and convexity
Afsari, B. (2011) · Proceedings of the American Mathematical Society · doi:10.1090/s0002-9939-2010-10541-5 · Cited by 282 · cited 1×
“Since P (n) is a Riemannian manifold of non-positive curvature, existence and unicity of the Riemannian mean can be proved [1], [28].”
BackgroundLenglet, C., Rousson, M., Deriche, R., & Faugeras, O. (2006) · Journal of Mathematical Imaging and Vision · doi:10.1007/s10851-006-6897-z · Cited by 253
EEG potentials predict upcoming emergency brakings during simulated driving
Haufe, S., Treder, M. S., Gugler, M. F., Sagebaum, M., Curio, G., & Blankertz, B. (2011) · Journal of Neural Engineering · doi:10.1088/1741-2560/8/5/056001 · Cited by 229 · cited 1×
“More recently, BCIs have been proposed also for healthy people, for instance in driving, forensics, or gaming applications [11], [20], [29].”
BackgroundBrain-Computer Interfacing: An Introduction
Rao, R. P. N. (2013) · Cambridge University Press eBooks · doi:10.1017/cbo9781139032803 · Cited by 195
Brain-Computer Interfacing: An Introduction
Rao, R. P. N. (2019) · Cited by 184
Computing the Karcher mean of symmetric positive definite matrices
Bini, D. A., & Iannazzo, B. (2011) · Linear Algebra and its Applications · doi:10.1016/j.laa.2011.08.052 · Cited by 123 · cited 3×
“Other faster and computational lighter approaches look for some suitable approximation of the center of mass, see for instance [6], [13], [14].”
BackgroundNonstationary Brain Source Separation for Multiclass Motor Imagery
Gouy‐Pailler, C., Congedo, M., Brunner, C., Jutten, C., & Pfurtscheller, G. (2009) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2009.2032162 · Cited by 118 · cited 5×
“The standard classification technique consists of two operational stages [9], [18].”
BackgroundMethodInfluentialSelf-citationA Plug&Play P300 BCI Using Information Geometry
Barachant, A., & Congedo, M. (2014) · arXiv · doi:10.48550/arxiv.1409.0107 · Cited by 102 · cited 1×
“Since temporal information are essential to detect ERP, we augmented the vector by integrating a component related to the temporal profile of the ERP event considered, following the procedure described in [4]”
MethodSelf-citationA survey and comparison of contemporary algorithms for computing the matrix geometric mean
Jeuris, B., Vandebril, R., & Vandereycken, B. (2012) · Infoscience (Ecole Polytechnique Fédérale de Lausanne) · Cited by 98
Wu, D., Lance, B. J., & Parsons, T. D. (2013) · PLoS ONE · doi:10.1371/journal.pone.0056624 · Cited by 75 · cited 1×
“Some examples of transfer learning applied to BCI problem can be found in [15], [21], [27] and [36].”
BackgroundA subject-independent brain-computer interface based on smoothed, second-order baselining
Reuderink, B., Farquhar, J. D. R., Poel, M., & Nijholt, A. (2011) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/iembs.2011.6091139 · Cited by 63 · cited 3×
“In this paper we develop an idea similar to the one presented in [33], but in a Riemannian framework.”
BackgroundMethodInfluentialCongedo, M., Goyat, M., Tarrin, N., Ionescu, G., Varnet, L., Rivet, B., Phlypo, R., Jrad, N., Acquadro, M., & Jutten, C. (2011) · HAL · Cited by 62
Self-citationApproximate Joint Diagonalization and Geometric Mean of Symmetric Positive Definite Matrices
Congedo, M., Afsari, B., Barachant, A., & Moakher, M. (2015) · PLoS ONE · doi:10.1371/journal.pone.0121423 · Cited by 44 · cited 1×
“Other faster and computational lighter approaches look for some suitable approximation of the center of mass, see for instance [6], [13], [14].”
BackgroundSelf-citationCongedo, M., & Sherlin, L. H. (2010) · Elsevier eBooks · doi:10.1016/b978-0-12-382235-2.00002-0 · Cited by 40
Self-citationA linear feature space for simultaneous learning of spatio-spectral filters in BCI
Farquhar, J. D. R. (2009) · Neural Networks · doi:10.1016/j.neunet.2009.06.035 · Cited by 38 · cited 1×
“First, EEG signals of a training set are transformed through frequency and/or spatial filters in order to extract discriminant features [8], [16].”
MethodKorczowski, L., Congedo, M., & Jutten, C. (2015) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc.2015.7318721 · Cited by 35 · cited 1×
“component related to the temporal profile of the ERP event considered, following the procedure described in [4] and [23].”
MethodSelf-citationFixed Point Algorithms for Estimating Power Means of Positive Definite Matrices
Congedo, M., Barachant, A., & Kharatikoopaei, E. (2017) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2017.2649483 · Cited by 33 · cited 1×
“Other faster and computational lighter approaches look for some suitable approximation of the center of mass, see for instance [6], [13], [14].”
BackgroundSelf-citationNewton Algorithms for Riemannian Distance Related Problems on Connected Locally Symmetric Manifolds
Ferreira, R. P. M., Xavier, J., Costeira, J. P., & Barroso, V. A. N. (2013) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2013.2261799 · Cited by 28 · cited 1×
“Some of them try to find the right value through numerical procedure like deterministic line search [17], [26], simple or stochastic gradient descent [10], [31].”
BackgroundParameters estimate of Riemannian Gaussian distribution in the manifold of covariance matrices
Zanini, P., Congedo, M., Christian Jutten, B., Said, S., & Berthoumieu, Y. (2016) · IEEE Sensor Array and Multichannel Signal Processing Workshop (SAM) · doi:10.1109/sam.2016.7569687 · Cited by 23 · cited 5×
“The comparison between the methods confirms what was observed in [37], with Bayesian classifiers displaying better performances for good subjects.”
BackgroundMethodResultInfluentialSelf-citationCriminal forensic: An application to EEG
Mohanchandra, K. (2015) · doi:10.1109/retcomp.2015.7090798 · Cited by 7 · cited 1×
“More recently, BCIs have been proposed also for healthy people, for instance in driving, forensics, or gaming applications [11], [20], [29].”
Background
Research works printed but not linked: 1
- said, 2015, Riemannian Gaussian distributions on the space of covariance matrices, arXiv 1507 01760v1
Cited by
A review of classification algorithms for EEG-based brain–computer interfaces: A 10 year update
Lotte, F., Bougrain, L., Cichocki, A., Clerc, M., Congedo, M., Rakotomamonjy, A., & Yger, F. (2018) · Journal of Neural Engineering · doi:10.1088/1741-2552/aab2f2 · Cited by 2,239
“These properties in part explain why Riemannian classification methods provide a good generalization capability [224, 238], which enabled researchers to set up calibration-free adaptive ERP-BCIs using simple subject-tosubject and session-to-session transfer learning strategies [6].”
BackgroundMethodSelf-citationTransfer Learning for Brain–Computer Interfaces: A Euclidean Space Data Alignment Approach
He, H., & Wu, D. (2020) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2019.2913914 · Cited by 569
“Experiments have shown that RA-MDRM outperformed MDRM in MI and ERP tasks [43], when compared in a TL setting.”
BackgroundMethodResultInfluentialEEG Based Emotion Recognition: A Tutorial and Review
Li, X., Zhang, Y., Tiwari, P., Song, D., Hu, B., Yang, M., Zhao, Z., Kumar, N., & Marttinen, P. (2023) · ACM Computing Surveys · doi:10.1145/3524499 · Cited by 508
“One novel knowledge distillation DL framework for Affective BCI based on LSTM-Capsule structure that compresses the large model without performance degradation [198]. while significantly reducing the number of parameters to transfer.”
BackgroundMethodInfluentialA review on transfer learning in EEG signal analysis
Wan, Z., Yang, R., Huang, M., Zeng, N., & Liu, X. (2021) · Neurocomputing · doi:10.1016/j.neucom.2020.09.017 · Cited by 468
Transfer Learning for EEG-Based Brain–Computer Interfaces: A Review of Progress Made Since 2016
Wu, D., Xu, Y., & Lu, B.-L. (2022) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2020.3007453 · Cited by 434
“[57] proposed a Riemannian alignment (RA) approach to centre the EEG covariance matrices {C k } Nk n=1 in the k-th domain with respect to a reference covariance matrix Rk specific to that domain.”
Metadata
- Authors
- Zanini, P., Congedo, M., Jutten, C., Said, S., & Berthoumieu, Y.
- Affiliations
- Centre National de la Recherche Scientifique (FR)
- Venue
- IEEE Transactions on Biomedical Engineering
- Published
- 2018-05
- Volume
- 65
- Issue
- 5
- Pages
- 1107-1116
- ISSN
- 0018-9294 (ISSN-L)
- 1558-2531
- OpenAlex
- W2746829572
- Cited by
- 412
- References
- 38
- Citations by year
- 2026: 48 · 2025: 53 · 2024: 78 · 2023: 53 · 2022: 62 · 2021: 37 · 2020: 49 · 2019: 25 · 2018: 7
- FWCI
- 12.72
- Type
- journal article
- Language
- en
- Open access
- green
- hal.science
- Locations
- IEEE Transactions on Biomedical Engineering (publishedVersion)
- PubMed (publishedVersion)
- HAL (submittedVersion)
- HAL (submittedVersion, other-oa)
- Funders
- ERC (2012-ERC-AdG-320684)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › EEG and Brain-Computer Interfaces
- Physical Sciences › Computer Science › Artificial Intelligence › Emotion and Mood Recognition
- Physical Sciences › Computer Science › Human-Computer Interaction › Gaze Tracking and Assistive Technology
- Keywords
- transfer learning, brain-computer interface, EEG classification, cross-subject classification, Riemannian geometry, symmetric positive definite matrices, covariance matrix, affine transformation, minimum distance classifier
- MeSH terms
- Machine Learning, Electroencephalography, Humans, Models, Theoretical, Databases, Factual, Brain-Computer Interfaces
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.