The DOI matches its Crossref record; 55 of the 55 references it cites were found in a registry or an index.
Inferring imagined speech using EEG signals: a new approach using Riemannian manifold features
Open accessAbstract
OBJECTIVE: In this paper, we investigate the suitability of imagined speech for brain-computer interface (BCI) applications. APPROACH: A novel method based on covariance matrix descriptors, which lie in Riemannian manifold, and the relevance vector machines classifier is proposed. The method is applied on electroencephalographic (EEG) signals and tested in multiple subjects. MAIN RESULTS: The method is shown to outperform other approaches in the field with respect to accuracy and robustness. The algorithm is validated on various categories of speech, such as imagined pronunciation of vowels, short words and long words. The classification accuracy of our methodology is in all cases significantly above chance level, reaching a maximum of 70% for cases where we classify three words and 95% for cases of two words. SIGNIFICANCE: The results reveal certain aspects that may affect the success of speech imagery classification from EEG signals, such as sound, meaning and word complexity. This can potentially extend the capability of utilizing speech imagery in future BCI applications. The dataset of speech imagery collected from total 15 subjects is also published.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Book Review: Pattern Recognition and Machine Learning
Nasrabadi, N. M. (2007) · Journal of Electronic Imaging · doi:10.1117/1.2819119 · Cited by 22,066
Kernel Methods for Pattern Analysis
Shawe-Taylor, J., & Cristianini, N. (2004) · Cambridge University Press eBooks · doi:10.1017/cbo9780511809682 · Cited by 6,587
The ten-twenty electrode system of the international federation
Jasper, H. H. (1958) · Electroencephalography and Clinical Neurophysiology · Cited by 6,567
Extreme Learning Machine for Regression and Multiclass Classification
Huang, G.-B., Zhou, H., Ding, X., & Zhang, R. (2012) · IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics) · doi:10.1109/tsmcb.2011.2168604 · Cited by 5,550
Pattern recognition and machine learning
(2007) · Choice Reviews Online · doi:10.5860/choice.44-5091 · Cited by 2,650
Klem, G. H., Lüders, H. O., Jasper, H. H., & Elger, C. E. (1999) · PubMed · Cited by 2,361
Optimizing Spatial filters for Robust EEG Single-Trial Analysis
Blankertz, B., Tomioka, R., Lemm, S., Kawanabe, M., & Muller, K.-R. (2008) · IEEE Signal Processing Magazine · doi:10.1109/msp.2008.4408441 · Cited by 2,080
Regularizing Common Spatial Patterns to Improve BCI Designs: Unified Theory and New Algorithms
Lotte, F., & Guan, C. (2011) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2010.2082539 · Cited by 1,045
Multiclass Brain–Computer Interface Classification by Riemannian Geometry
Barachant, A., Bonnet, S., Congedo, M., & Jutten, C. (2012) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2011.2172210 · Cited by 878
Classification of covariance matrices using a Riemannian-based kernel for BCI applications
Barachant, A., Bonnet, S., Congedo, M., & Jutten, C. (2013) · Neurocomputing · doi:10.1016/j.neucom.2012.12.039 · Cited by 493 · cited 1×
“Recently, Riemannian feature has been adopted to the BCI concept, as in the works conducted by Barachant et al [32, 51, 52], Congedo et al [53], Yger et al [54].”
MethodDenby, B., Schultz, T., Honda, K., Hueber, T., Gilbert, J. M., & Brumberg, J. S. (2010) · Speech Communication · doi:10.1016/j.specom.2009.08.002 · Cited by 487
Riemannian Approaches in Brain-Computer Interfaces: A Review
Yger, F., Berar, M., & Lotte, F. (2017) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2016.2627016 · Cited by 420
Multiclass Common Spatial Patterns and Information Theoretic Feature Extraction
Grosse-Wentrup, M., & Buss, M. (2008) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2008.921154 · Cited by 389
Spatial patterns underlying population differences in the background EEG
Koles, Z. J., Lazar, M. S., & Zhou, S. Z. (1990) · Brain Topography · doi:10.1007/bf01129656 · Cited by 364
Removal of ocular artifacts from electro-encephalogram by adaptive filtering
He, P., Wilson, G., & Russell, C. (2004) · Medical & Biological Engineering & Computing · doi:10.1007/bf02344717 · Cited by 364
Electroencephalogram-based control of an electric wheelchair
Tanaka, K., Matsunaga, K., & Wang, H. O. (2005) · IEEE Transactions on Robotics · doi:10.1109/tro.2004.842350 · Cited by 361
Controlling a Wheelchair Indoors Using Thought
Rebsamen, B., Burdet, E., Guan, C., Zhang, H., Teo, C. L., Zeng, Q., Laugier, C., & Ang, M. H. (2007) · IEEE Intelligent Systems · doi:10.1109/mis.2007.26 · Cited by 275
Single-trial classification of vowel speech imagery using common spatial patterns
DaSalla, C. S., Kambara, H., Sato, M., & Koike, Y. (2009) · Neural Networks · doi:10.1016/j.neunet.2009.05.008 · Cited by 274
(2008) · Universitext · doi:10.1007/978-0-387-48101-2 · Cited by 246
Dimensionality Reduction on SPD Manifolds: The Emergence of Geometry-Aware Methods
Harandi, M., Salzmann, M., & Hartley, R. (2018) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2655048 · Cited by 217
Decoding spectrotemporal features of overt and covert speech from the human cortex
Martin, S., Brunner, P., Holdgraf, C., Heinze, H.-J., Crone, N. E., Rieger, J., Schalk, G., Knight, R. T., & Pasley, B. N. (2014) · Frontiers in Neuroengineering · doi:10.3389/fneng.2014.00014 · Cited by 200 · cited 2×
“Here, only those patterns that increase the variance of speech imagery and reduce the one of resting are presented. in the related literature [12, 40, 41].”
BackgroundMethodDivergence-Based Framework for Common Spatial Patterns Algorithms
Samek, W., Kawanabe, M., & Muller, K.-R. (2014) · IEEE Reviews in Biomedical Engineering · doi:10.1109/rbme.2013.2290621 · Cited by 174
Word pair classification during imagined speech using direct brain recordings
Martin, S., Brunner, P., Iturrate, I., Millán, J. D. R., Schalk, G., Knight, R. T., & Pasley, B. N. (2016) · Scientific Reports · doi:10.1038/srep25803 · Cited by 171
Analysis and classification of speech imagery EEG for BCI
Wang, L., Zhang, X., Zhong, X., & Zhang, Y. (2013) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2013.07.011 · Cited by 170
A regularized discriminative framework for EEG analysis with application to brain–computer interface
Tomioka, R., & Müller, K.-R. (2010) · NeuroImage · doi:10.1016/j.neuroimage.2009.07.045 · Cited by 167
Brigham, K., & Kumar, B. V. K. V. (2010) · 2010 4th International Conference on Bioinformatics and Biomedical Engineering · doi:10.1109/icbbe.2010.5515807 · Cited by 163
Damoulas, T., & Girolami, M. A. (2008) · Bioinformatics · doi:10.1093/bioinformatics/btn112 · Cited by 163
Brain wave recognition of words
Suppes, P., Lu, Z., & Han, B. (1997) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.94.26.14965 · Cited by 161
Multiclass Relevance Vector Machines: Sparsity and Accuracy
Psorakis, I., Damoulas, T., & Girolami, M. (2010) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2010.2064787 · Cited by 150
Toward EEG Sensing of Imagined Speech
D’Zmura, M., Deng, S., Lappas, T., Thorpe, S., & Srinivasan, R. (2009) · Lecture notes in computer science · doi:10.1007/978-3-642-02574-7_5 · Cited by 140
Automatic Speech Recognition from Neural Signals: A Focused Review
Herff, C., & Schultz, T. (2016) · Frontiers in Neuroscience · doi:10.3389/fnins.2016.00429 · Cited by 138
Min, B., Kim, J., Park, H.-J., & Lee, B. (2016) · BioMed Research International · doi:10.1155/2016/2618265 · Cited by 136
A new metric on the manifold of kernel matrices with application to matrix geometric means
Sra, S. (2012) · MPG.PuRe (Max Planck Society) · Cited by 126
EEG classification of imagined syllable rhythm using Hilbert spectrum methods
Deng, S., Srinivasan, R., Lappas, T., & D’Zmura, M. (2010) · Journal of Neural Engineering · doi:10.1088/1741-2560/7/4/046006 · Cited by 122
Increase Information Transfer Rates in BCI by CSP Extension to Multi-class
Dornhege, G., Blankertz, B., Curio, G., & Müller, K. (2003) · Publikationsdatenbank der Fraunhofer-Gesellschaft (Fraunhofer-Gesellschaft) · Cited by 121
EEG-BASED SPEECH RECOGNITION - Impact of Temporal Effects
Porbadnigk, A. K., Wester, M., Calliess, J.-P., & Schultz, T. (2009) · International Conference on Bio-inspired Systems and Signal Processing · doi:10.5220/0001554303760381 · Cited by 108
Adaptive foraging for simulated and real robotic swarms: the dynamical response threshold approach
Ferrer, E. C., 山本, 知., Libera, F. D., Liu, W., Winfield, A. F. T., Nakamura, Y., & Ishiguro, H. (2016) · Swarm Intelligence · doi:10.1007/s11721-015-0117-7 · Cited by 106
Riemannian Dictionary Learning and Sparse Coding for Positive Definite Matrices
Cherian, A., & Sra, S. (2016) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2016.2601307 · Cited by 103
Neurofeedback Training for BCI Control
Neuper, C., & Pfurtscheller, G. (2009) · The Frontiers Collection · doi:10.1007/978-3-642-02091-9_4 · Cited by 102
Sonification and textification: Proposing methods for classifying unspoken words from EEG signals
González-Castañeda, E. F., Torres-García, A. A., Reyes-Garcia, C. A., & Villaseñor-Pineda, L. (2016) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2016.10.012 · Cited by 93
Classification of primitive shapes using brain–computer interfaces
Esfahani, E. T., & Sundararajan, V. (2011) · Computer-Aided Design · doi:10.1016/j.cad.2011.04.008 · Cited by 87
Common Spatial Pattern revisited by Riemannian geometry
Barachant, A., Bon, S., Congedo, M., & Jutten, C. (2010) · IEEE International Workshop on Multimedia Signal Processing (MMSP) · doi:10.1109/mmsp.2010.5662067 · Cited by 81
Sparse Coding on Symmetric Positive Definite Manifolds Using Bregman Divergences
Harandi, M. T., Hartley, R. I., Lovell, B. C., & Sanderson, C. (2015) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2014.2387383 · Cited by 76
A New Generation of Brain-Computer Interface Based on Riemannian Geometry
Congedo, M., Barachant, A., & Andreev, A. (2013) · arXiv · doi:10.48550/arxiv.1310.8115 · Cited by 69
Kim, J., Lee, S.-K., & Lee, B. (2014) · Journal of Neural Engineering · doi:10.1088/1741-2560/11/3/036010 · Cited by 60
Brain-wave recognition of sentences
Suppes, P., Han, B., & Lu, Z. (1998) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.95.26.15861 · Cited by 54
Log‐Euclidean bag of words for human action recognition
Faraki, M., Palhang, M., & Sanderson, C. (2014) · IET Computer Vision · doi:10.1049/iet-cvi.2014.0018 · Cited by 52
EEG feature descriptors and discriminant analysis under Riemannian Manifold perspective
Nguyen, C. H., & Artemiadis, P. (2017) · Neurocomputing · doi:10.1016/j.neucom.2017.10.013 · Cited by 49
Self-citationInter comparison of classification techniques for vowel speech imagery using EEG sensors
Riaz, A., Akhtar, S., Iftikhar, S., Khan, A. A., & Salman, A. (2014) · International Conference on Systems and Informatics (ICSAI) · doi:10.1109/icsai.2014.7009378 · Cited by 42
A Communication Paradigm Using Subvocalized Speech: Translating Brain Signals into Speech
Mohanchandra, K., & Saha, S. (2016) · Augmented Human Research · doi:10.1007/s41133-016-0001-z · Cited by 41
EEG-Based Discrimination of Imagined Speech Phonemes
Chi, X., Hagedorn, J. B., Schoonover, D., & D’Zmura, M. (2011) · Cited by 40
Unspoken Speech - Speech Recognition based on Electroencephalography
Wester, M. (2006) · Repository KITopen (Karlsruhe Institute of Technology) · doi:10.5445/ir/1000009171 · Cited by 39
Spatial filtering and single-trial classification of EEG during vowel speech imagery
DaSalla, C. S., Kambara, H., Koike, Y., & Sato, M. (2009) · International Convention on Rehabilitation Engineering & Assistive Technology · doi:10.1145/1592700.1592731 · Cited by 34
Mondada, L., Karim, M. E., & Mondada, F. (2016) · Swarm Intelligence · doi:10.1007/s11721-016-0127-0 · Cited by 16
ICCHP Keynote: Recognizing Silent and Weak Speech Based on Electromyography
Schultz, T. (2010) · Lecture notes in computer science · doi:10.1007/978-3-642-14097-6_96 · Cited by 10
Cited by
A review on transfer learning in EEG signal analysis
Wan, Z., Yang, R., Huang, M., Zeng, N., & Liu, X. (2021) · Neurocomputing · doi:10.1016/j.neucom.2020.09.017 · Cited by 468
Imagined speech can be decoded from low- and cross-frequency intracranial EEG features
Proix, T., Delgado Saa, J., Christen, A., Martin, S., Pasley, B. N., Knight, R. T., Tian, X., Poeppel, D., Doyle, W. K., Devinsky, O., et al. (2022) · Nature Communications · doi:10.1038/s41467-021-27725-3 · Cited by 212
Decoding Covert Speech From EEG-A Comprehensive Review
Panachakel, J. T., & Ramakrishnan, A. G. (2021) · Frontiers in Neuroscience · doi:10.3389/fnins.2021.642251 · Cited by 156
A State-of-the-Art Review of EEG-Based Imagined Speech Decoding
Lopez-Bernal, D., Balderas, D., Ponce, P., & Molina, A. (2022) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2022.867281 · Cited by 107
Decoding spoken English from intracortical electrode arrays in dorsal precentral gyrus
Wilson, G. H., Stavisky, S. D., Willett, F. R., Avansino, D. T., Kelemen, J. N., Hochberg, L. R., Henderson, J. M., Druckmann, S., & Shenoy, K. V. (2020) · Journal of Neural Engineering · doi:10.1088/1741-2552/abbfef · Cited by 103
Metadata
- Authors
- Nguyen, C. H., Karavas, G. K., & Artemiadis, P.
- Venue
- Journal of Neural Engineering
- Publisher
- IOP Publishing
- Published
- 2017-11-30
- Volume
- 15
- Issue
- 1
- Pages
- 016002
- ISSN
- 1741-2552 (ISSN-L)
- 1741-2560
- OpenAlex
- W2739095506
- Cited by
- 289
- References
- 55
- FWCI
- 6.30
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.