CoChat

Toward a compact hybrid brain-computer interface (BCI): Performance evaluation of multi-class hybrid EEG-fNIRS BCIs with limited number of channels

Open access

The DOI matches its Crossref record; 40 of the 41 references it cites were found in a registry or an index.

Abstract

It has been demonstrated that the performance of typical unimodal brain-computer interfaces (BCIs) can be noticeably improved by combining two different BCI modalities. This so-called "hybrid BCI" technology has been studied for decades; however, hybrid BCIs that particularly combine electroencephalography (EEG) and functional near-infrared spectroscopy (fNIRS) (hereafter referred to as hBCIs) have not been widely used in practical settings. One of the main reasons why hBCI systems are so unpopular is that their hardware is generally too bulky and complex. Therefore, to make hBCIs more appealing, it is necessary to implement a lightweight and compact hBCI system with minimal performance degradation. In this study, we investigated the feasibility of implementing a compact hBCI system with significantly less EEG channels and fNIRS source-detector (SD) pairs, but that can achieve a classification accuracy high enough to be used in practical BCI applications. EEG and fNIRS data were acquired while participants performed three different mental tasks consisting of mental arithmetic, right-hand motor imagery, and an idle state. Our analysis results showed that the three mental states could be classified with a fairly high classification accuracy of 77.6 ± 12.1% using an hBCI system with only two EEG channels and two fNIRS SD pairs.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1371/journal.pone.0230491

Cites

40 of 40 references verified0 citation errors · 0 not checkable

Statistics

Figures

Fig 1 Arrangement of EEG channels (blue) and fNIRS optodes (red: Sources, green: Detectors) on the frontal (left) and motor (right) areas. Channels were numbered in the same manner as in a previous study [20].
Fig 1 Arrangement of EEG channels (blue) and fNIRS optodes (red: Sources, green: Detectors) on the frontal (left) and motor (right) areas. Channels were numbered in the same manner as in a previous study [20].CC BY · PubMed Central
Fig 2 Illustration of a single trial of the experiment. Each trial consisted of an introduction period of 2 s, a task period of 10 s, and an inter-trial rest period (stop and rest) of 16–18 s. During the introduction period, a random task (MA, MI, or IS) was displayed to the participant. After a short beep, the participant performed the task displayed in the introduction period while looking at a fixation cross. When a STOP sign was displayed with a second short beep, the participants stopped performing the task and relaxed during the random-length inter-trial rest period.
Fig 2 Illustration of a single trial of the experiment. Each trial consisted of an introduction period of 2 s, a task period of 10 s, and an inter-trial rest period (stop and rest) of 16–18 s. During the introduction period, a random task (MA, MI, or IS) was displayed to the participant. After a short beep, the participant performed the task displayed in the introduction period while looking at a fixation cross. When a STOP sign was displayed with a second short beep, the participants stopped performing the task and relaxed during the random-length inter-trial rest period.CC BY · PubMed Central
Fig 3 Data processing procedure. CSP and sLDA stand for common spatial pattern and shrinkage linear discriminant analysis, respectively. To perform meta-classification, we concatenated the outputs of individual EEG and fNIRS classifiers to construct feature vectors for the meta-classifier. The “one-versus-one” block represents the strategy used to solve the three-class classification problem by dividing it into three binary classification problems and employing majority voting (VOTE) based on the result of each binary classification to predict the class.
Fig 3 Data processing procedure. CSP and sLDA stand for common spatial pattern and shrinkage linear discriminant analysis, respectively. To perform meta-classification, we concatenated the outputs of individual EEG and fNIRS classifiers to construct feature vectors for the meta-classifier. The “one-versus-one” block represents the strategy used to solve the three-class classification problem by dividing it into three binary classification problems and employing majority voting (VOTE) based on the result of each binary classification to predict the class.CC BY · PubMed Central
Fig 4 (a) MI vs. IS EEG classification accuracies as a function of the number of EEG channels. Green bars indicate the grand average classification accuracies calculated using the sequential backward selection algorithm. The color map indicates the statistical significance between the differences in classification accuracy calculated according to the number of EEG channels (*p < 0.05). (b) MI vs. IS EEG classification accuracies calculated using the four optimal configurations with two EEG channel, which were (c) (Cz, CP3; the best), (d) (Cz, C3), (e) (CP3, CP4), and (f) (C3, C4; the fourth best). The red and green horizontal dashed lines indicate the threshold for an effective BCI (70%) and the value corresponding to the two EEG channels (x-axis) shown in (a), respectively. The error bars indicate standard deviation.
Fig 4 (a) MI vs. IS EEG classification accuracies as a function of the number of EEG channels. Green bars indicate the grand average classification accuracies calculated using the sequential backward selection algorithm. The color map indicates the statistical significance between the differences in classification accuracy calculated according to the number of EEG channels (*p < 0.05). (b) MI vs. IS EEG classification accuracies calculated using the four optimal configurations with two EEG channel, which were (c) (Cz, CP3; the best), (d) (Cz, C3), (e) (CP3, CP4), and (f) (C3, C4; the fourth best). The red and green horizontal dashed lines indicate the threshold for an effective BCI (70%) and the value corresponding to the two EEG channels (x-axis) shown in (a), respectively. The error bars indicate standard deviation.CC BY · PubMed Central
Fig 5 (a) Highest MA vs. IS fNIRS classification accuracies as a function of the number of SD pairs shown in (b). Statistical significance was calculated between the classification accuracies achieved using all the SD pairs and various numbers of SD pairs (*p < 0.05, **p < 0.01, ***p < 0.001). The error bars represent the standard deviation.
Fig 5 (a) Highest MA vs. IS fNIRS classification accuracies as a function of the number of SD pairs shown in (b). Statistical significance was calculated between the classification accuracies achieved using all the SD pairs and various numbers of SD pairs (*p < 0.05, **p < 0.01, ***p < 0.001). The error bars represent the standard deviation.CC BY · PubMed Central

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 40 references

Research works printed but not linked: 1

  1. M Tomczak, 2014, The need to report effect size estimates revisited. An overview of some recommended measures of effect size, Trends Sport Sci, 21

Cited by

See all 53

Metadata

Authors
Kwon, J., Shin, J., & Im, C.-H.
Affiliations
  • Hanyang University (KR)
  • Wonkwang University (KR)
Corresponding author
Im, Chang-Hwan
Venue
PLOS ONE
Published
2020-03-18
Volume
15
Issue
3
Pages
e0230491
ISSN
1932-6203 (ISSN-L)
OpenAlex
W3010955800
Cited by
53
References
41
Citations by year
2026: 3 · 2025: 8 · 2024: 11 · 2023: 7 · 2022: 5 · 2021: 15 · 2020: 4
FWCI
4.17
Type
journal article
Language
en
Open access
Locations
  • PLoS ONE (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
  • Figshare (submittedVersion, cc-by)
Funders
  • National Research Foundation
  • National Research Foundation of Korea (2017-0-00432, 2015M3C7A1031969, NRF‐2015M3C7A1031969, 2019M3C7A1031278, NRF-2019M3C7A1031278)
  • Ministry of Science and ICT, South Korea (NRF-2019M3C7A1031278, 2017-0-00432)
  • Institute for Information and Communications Technology Promotion (2017-0-00432)
Topics
  • Life Sciences › Neuroscience › Cognitive Neuroscience › EEG and Brain-Computer Interfaces
  • Health Sciences › Medicine › Radiology, Nuclear Medicine and Imaging › Optical Imaging and Spectroscopy Techniques
  • Physical Sciences › Computer Science › Human-Computer Interaction › Gaze Tracking and Assistive Technology
Keywords
hybrid brain-computer interface, functional near-infrared spectroscopy, EEG, multi-class classification, mental arithmetic, motor imagery, mental state classification
MeSH terms
Adult, Electroencephalography, Female, Humans, Male, Models, Theoretical, Motor Cortex, Psychomotor Performance, Spectroscopy, Near-Infrared, Young Adult, Brain-Computer Interfaces

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Toward a compact hybrid brain-computer interface (BCI): Performance evaluation of multi-class hybrid EEG-fNIRS BCIs with limited number of channels. https://app.cochat.ai/papers/10.1371/journal.pone.0230491
The paper
Kwon, J., Shin, J., & Im, C.-H. (2020). Toward a compact hybrid brain-computer interface (BCI): Performance evaluation of multi-class hybrid EEG-fNIRS BCIs with limited number of channels. PLOS ONE. https://doi.org/10.1371/journal.pone.0230491

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.