The DOI matches its Crossref record; 22 of the 22 references it cites were found in a registry or an index.
Deep learning for hybrid EEG-fNIRS brain–computer interface: application to motor imagery classification
Open accessAbstract
OBJECTIVE: Brain-computer interface (BCI) refers to procedures that link the central nervous system to a device. BCI was historically performed using electroencephalography (EEG). In the last years, encouraging results were obtained by combining EEG with other neuroimaging technologies, such as functional near infrared spectroscopy (fNIRS). A crucial step of BCI is brain state classification from recorded signal features. Deep artificial neural networks (DNNs) recently reached unprecedented complex classification outcomes. These performances were achieved through increased computational power, efficient learning algorithms, valuable activation functions, and restricted or back-fed neurons connections. By expecting significant overall BCI performances, we investigated the capabilities of combining EEG and fNIRS recordings with state-of-the-art deep learning procedures. APPROACH: We performed a guided left and right hand motor imagery task on 15 subjects with a fixed classification response time of 1 s and overall experiment length of 10 min. Left versus right classification accuracy of a DNN in the multi-modal recording modality was estimated and it was compared to standalone EEG and fNIRS and other classifiers. MAIN RESULTS: At a group level we obtained significant increase in performance when considering multi-modal recordings and DNN classifier with synergistic effect. SIGNIFICANCE: BCI performances can be significantly improved by employing multi-modal recordings that provide electrical and hemodynamic brain activity information, in combination with advanced non-linear deep learning classification procedures.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318 · cited 1×
“The DNN employed was not a CNN (encoding spatial or temporal information, Krizhevsky et al (2012) and Kalchbrenner et al (2014)) nor an RNN (encoding the sequential order of features (Hochreiter and Schmidhuber 1997, Mikolov et al 2010)).”
MethodU-Net: Convolutional Networks for Biomedical Image Segmentation
Ronneberger, O., Fischer, P., & Brox, T. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24574-4_28 · Cited by 99,404
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Cortes, C., & Vapnik, V. (1995) · Machine Learning · doi:10.1007/bf00994018 · Cited by 59,421
Deep learning in neural networks: an overview
Schmidhuber, J. (2015) · Neural Networks · doi:10.1016/j.neunet.2014.09.003 · Cited by 18,570
A Study of Cross-Validation and Bootstrap for Accuracy Estimation and Model Selection
Kohavi, R. (1995) · Zenodo · doi:10.5281/zenodo.19712698 · Cited by 10,909
Hinton, G., Deng, L., Yu, D., Dahl, G., Mohamed, A.-R., Jaitly, N., Senior, A., Vanhoucke, V., Nguyen, P., Sainath, T., et al. (2012) · IEEE Signal Processing Magazine · doi:10.1109/msp.2012.2205597 · Cited by 10,260
TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems
Abadi, M., Agarwal, A., Barham, P., Brevdo, E., Chen, Z., Citro, C., Corrado, G. S., Davis, A., Dean, J., Devin, M., et al. (2016) · arXiv · doi:10.48550/arxiv.1603.04467 · Cited by 9,408
Practical Bayesian Optimization of Machine Learning Algorithms
Snoek, J., Larochelle, H., & Adams, R. P. (2012) · arXiv · doi:10.48550/arxiv.1206.2944 · Cited by 6,691
Recurrent neural network based language model
Mikolov, T., Karafiát, M., Burget, L., Černocký, J., & Khudanpur, S. (2010) · Interspeech 2010 · doi:10.21437/interspeech.2010-343 · Cited by 5,390 · cited 1×
“The DNN employed was not a CNN (encoding spatial or temporal information, Krizhevsky et al (2012) and Kalchbrenner et al (2014)) nor an RNN (encoding the sequential order of features (Hochreiter and Schmidhuber 1997, Mikolov et al 2010)).”
MethodA unified architecture for natural language processing: deep neural networks with multitask learning
Collobert, R., & Weston, J. (2008) · Proceedings of the 25th international conference on Machine learning - ICML '08 · doi:10.1145/1390156.1390177 · Cited by 5,058
A Convolutional Neural Network for Modelling Sentences
Kalchbrenner, N., Grefenstette, E., & Blunsom, P. (2014) · Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.3115/v1/p14-1062 · Cited by 3,601
A review of classification algorithms for EEG-based brain–computer interfaces
Lotte, F., Congedo, M., Lécuyer, A., Lamarche, F., & Arnaldi, B. (2007) · Journal of Neural Engineering · doi:10.1088/1741-2560/4/2/r01 · Cited by 2,665
Ferrari, M., & Quaresima, V. (2012) · NeuroImage · doi:10.1016/j.neuroimage.2012.03.049 · Cited by 2,274
Improving deep neural networks for LVCSR using rectified linear units and dropout
Dahl, G. E., Sainath, T. N., & Hinton, G. E. (2013) · 2013 IEEE International Conference on Acoustics, Speech and Signal Processing · doi:10.1109/icassp.2013.6639346 · Cited by 1,310
fNIRS-based brain-computer interfaces: a review
Naseer, N., & Hong, K.-S. (2015) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2015.00003 · Cited by 988
Comment on the modified Beer–Lambert law for scattering media
Sassaroli, A., & Fantini, S. (2004) · Physics in Medicine and Biology · doi:10.1088/0031-9155/49/14/n07 · Cited by 352
Decoding of four movement directions using hybrid NIRS-EEG brain-computer interface
Khan, M. J., Hong, M. J., & Hong, K.-S. (2014) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2014.00244 · Cited by 280
Classification of prefrontal and motor cortex signals for three-class fNIRS-BCI
Hong, K.-S., Naseer, N., & Kim, Y.-H. (2015) · Neuroscience Letters · doi:10.1016/j.neulet.2014.12.029 · Cited by 276
Cecotti, H., & Ries, A. J. (2017) · International Journal of Psychophysiology · doi:10.1016/j.ijpsycho.2016.07.500 · Cited by 50
Cited by
Deep learning-based electroencephalography analysis: a systematic review
Roy, Y., Banville, H., Albuquerque, I., Gramfort, A., Falk, T. H., & Faubert, J. (2019) · Journal of Neural Engineering · doi:10.1088/1741-2552/ab260c · Cited by 1,532
A Review on Machine Learning for EEG Signal Processing in Bioengineering
Hosseini, M.-P., Hosseini, A., & Ahi, K. (2021) · IEEE Reviews in Biomedical Engineering · doi:10.1109/rbme.2020.2969915 · Cited by 468
Progress in Brain Computer Interface: Challenges and Opportunities
Saha, S., Mamun, K. A., Ahmed, K., Mostafa, R., Naik, G. R., Darvishi, S., Khandoker, A. H., & Baumert, M. (2021) · Frontiers in Systems Neuroscience · doi:10.3389/fnsys.2021.578875 · Cited by 365
Intra- and Inter-subject Variability in EEG-Based Sensorimotor Brain Computer Interface: A Review
Saha, S., & Baumert, M. (2020) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2019.00087 · Cited by 325
A survey on deep learning-based non-invasive brain signals: recent advances and new frontiers
Zhang, X., Yao, L., Wang, X., Monaghan, J., McAlpine, D., & Zhang, Y. (2021) · Journal of Neural Engineering · doi:10.1088/1741-2552/abc902 · Cited by 296
Metadata
- Authors
- Chiarelli, A. M., Croce, P., Merla, A., & Zappasodi, F.
- Venue
- Journal of Neural Engineering
- Publisher
- IOP Publishing
- Published
- 2018-04-16
- Volume
- 15
- Issue
- 3
- Pages
- 036028
- ISSN
- 1741-2552 (ISSN-L)
- 1741-2560
- OpenAlex
- W2792881371
- Cited by
- 197
- References
- 22
- FWCI
- 13.28
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.