Multimodal BCIs: Target Detection, Multidimensional Control, and Awareness Evaluation in Patients With Disorder of Consciousness
The DOI matches its Crossref record; 81 of the 81 references it cites were found in a registry or an index.
Abstract
Despite rapid advances in the study of brain–computer interfaces (BCIs) in recent decades, two fundamental challenges, namely, improvement of target detection performance and multidimensional control, continue to be major barriers for further development and applications. In this paper, we review the recent progress in multimodal BCIs (also called hybrid BCIs), which may provide potential solutions for addressing these challenges. In particular, improved target detection can be achieved by developing multimodal BCIs that utilize multiple brain patterns, multimodal signals, or multisensory stimuli. Furthermore, multidimensional object control can be accomplished by generating multiple control signals from different brain patterns or signal modalities. Here, we highlight several representative multimodal BCI systems by analyzing their paradigm designs, detection/control methods, and experimental results. To demonstrate their practicality, we report several initial clinical applications of these multimodal BCI systems, including awareness evaluation/detection in patients with disorder of consciousness (DOC). As an evolving research area, the study of multimodal BCIs is increasingly requiring more synergetic efforts from multiple disciplines for the exploration of the underlying brain mechanisms, the design of new effective paradigms and means of neurofeedback, and the expansion of the clinical applications of these systems.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“It should be noted that SVM classifier was widely used in the EEG-based brain computer interface in practice [26–29].”
From Fusion of Facial Expressions and EEG for Multimodal Emotion Recognition (2017) · cites this paper as [27]
Citations
Cites
Brain–computer interfaces for communication and control
Wolpaw, J. R., Birbaumer, N., McFarland, D. J., Pfurtscheller, G., & Vaughan, T. M. (2002) · Clinical Neurophysiology · doi:10.1016/s1388-2457(02)00057-3 · Cited by 7,927 · cited 1×
“A brain–computer interface (BCI) system directly translates the signals produced by brain activities into control signals and uses these signals to control external devices without the participation of peripheral nerves and muscles [1].”
BackgroundEvent-related EEG/MEG synchronization and desynchronization: basic principles
Pfurtscheller, G., & Lopes da Silva, F. H. (1999) · Clinical Neurophysiology · doi:10.1016/s1388-2457(99)00141-8 · Cited by 7,328 · cited 1×
“The brain patterns that are utilized for EEG-based BCIs mainly include the P300 potential [5]; steady-state evoked potentials (SSEP), particularly steady-state visual evoked potentials (SSVEPs) [6]; and event-related desynchronization/synchronization (ERD/ERS) produced by motor imagery (MI) [7].”
BackgroundFarwell, L. A., & Donchin, E. (1988) · Electroencephalography and Clinical Neurophysiology · doi:10.1016/0013-4694(88)90149-6 · Cited by 3,228 · cited 1×
“The brain patterns that are utilized for EEG-based BCIs mainly include the P300 potential [5]; steady-state evoked potentials (SSEP), particularly steady-state visual evoked potentials (SSVEPs) [6]; and event-related desynchronization/synchronization (ERD/ERS) produced by motor imagery (MI) [7].”
BackgroundFeigenson, L., Dehaene, S., & Spelke, E. (2004) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2004.05.002 · Cited by 2,466
The minimally conscious state: Definition and diagnostic criteria
Giacino, J. T., Ashwal, S., Childs, N., Cranford, R., Jennett, B., Katz, D. I., Kelly, J. P., Rosenberg, J. H., Whyte, J., Zafonte, R. D., et al. (2002) · Neurology · doi:10.1212/wnl.58.3.349 · Cited by 2,422
A spelling device for the paralysed
Birbaumer, N., Ghanayim, N., Hinterberger, T., Iversen, I., Kotchoubey, B., Kübler, A., Perelmouter, J., Taub, E., & Flor, H. (1999) · Nature · doi:10.1038/18581 · Cited by 1,577 · cited 1×
“For instance, BCIs can offer augmented or repaired sensory-motor functions and may appeal to individuals with severe motor disabilities [2].”
BackgroundControl of a two-dimensional movement signal by a noninvasive brain-computer interface in humans
Wolpaw, J. R., & McFarland, D. J. (2004) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0403504101 · Cited by 1,512 · cited 3×
“Similar to the system presented in [18], the target in this system is also confined to one of eight candidates.”
BackgroundMethodResultWillful Modulation of Brain Activity in Disorders of Consciousness
Monti, M. M., Vanhaudenhuyse, A., Coleman, M. R., Boly, M., Pickard, J. D., Tshibanda, L., Owen, A. M., & Laureys, S. (2010) · New England Journal of Medicine · doi:10.1056/nejmoa0905370 · Cited by 1,461
Schnakers, C., Vanhaudenhuyse, A., Giacino, J., Ventura, M., Boly, M., Majerus, S., Moonen, G., & Laureys, S. (2009) · BMC Neurology · doi:10.1186/1471-2377-9-35 · Cited by 1,348 · cited 1×
“For instance, the misdiagnosis rates for VS/UWS and MCS patients are rather high, ranging from 37% to 43% [64].”
BackgroundPERSISTENT VEGETATIVE STATE AFTER BRAIN DAMAGE
Jennett, B., & Plum, F. (1972) · The Lancet · doi:10.1016/s0140-6736(72)90242-5 · Cited by 1,227 · cited 1×
“be awake but show no awareness of themselves or their environment [62].”
Background
Cited by
A Benchmark Dataset for SSVEP-Based Brain–Computer Interfaces
Wang, Y., Chen, X., Gao, X., & Gao, S. (2017) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2016.2627556 · Cited by 501
“, P300) have become more and more popular in recent studies [10]–[13].”
BackgroundEEG Based Emotion Recognition by Combining Functional Connectivity Network and Local Activations
Li, P., Liu, H., Si, Y., Li, C., Li, F., Zhu, X., Huang, X., Zeng, Y., Yao, D., Zhang, Y., et al. (2019) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2019.2897651 · Cited by 396
“tion methods may lead to some differences in optimal feature subsets because of their different design purposes [34], [38], [39], [46], [64], which may finally account for the different”
MethodMulti-kernel extreme learning machine for EEG classification in brain-computer interfaces
Zhang, Y., Wang, Y., Zhou, G., Jin, J., Wang, B., Wang, X., & Cichocki, A. (2018) · Expert Systems with Applications · doi:10.1016/j.eswa.2017.12.015 · Cited by 255
Advances in Multimodal Emotion Recognition Based on Brain–Computer Interfaces
He, Z., Li, Z., Yang, F., Wang, L., Li, J., Zhou, C., & Pan, J. (2020) · Brain Sciences · doi:10.3390/brainsci10100687 · Cited by 151
“[9] proposed that in addition to combining different input signals, emotion recognition should include a variety of heterogeneous sensory stimuli (such as audio-visual stimulation) to induce emotions.”
BackgroundSelf-citationLi, F., Wang, J., Liao, Y., Yi, C., Jiang, Y., Si, Y., Peng, W., Yao, D., Zhang, Y., Dong, W., et al. (2019) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2019.2900725 · Cited by 124
The Dynamic Brain Networks of Motor Imagery: Time-Varying Causality Analysis of Scalp EEG
Li, F., Peng, W., Jiang, Y., Song, L., Liao, Y., Yi, C., Zhang, L., Si, Y., Zhang, T., Wang, F., et al. (2019) · International Journal of Neural Systems · doi:10.1142/s0129065718500168 · Cited by 125
Self-citationFusion of Facial Expressions and EEG for Multimodal Emotion Recognition
Huang, Y., Yang, J., Liao, P., & Pan, J. (2017) · Computational Intelligence and Neuroscience · doi:10.1155/2017/2107451 · Cited by 115
Self-citationOn the Vulnerability of CNN Classifiers in EEG-Based BCIs
Zhang, X., & Wu, D. (2019) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2019.2908955 · Cited by 126
Correlated Component Analysis for Enhancing the Performance of SSVEP-Based Brain-Computer Interface
Zhang, Y., Guo, D., Li, F., Yin, E., Zhang, Y., Li, P., Zhao, Q., Tanaka, T., Yao, D., & Xu, P. (2018) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2018.2826541 · Cited by 116
“B RAIN-COMPUTER interface (BCI) provides an alternative communication channel to humans by using the brain activities, which has achieved unprecedented progress in the past decades [1]–[3].”
BackgroundZhu, X., Li, P., Li, C., Yao, D., Zhang, R., & Xu, P. (2018) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2018.12.027 · Cited by 113
Chen, D.-W., Miao, R., Yang, W.-Q., Liang, Y., Chen, H.-H., Huang, L., Deng, C.-J., & Han, N. (2019) · Sensors · doi:10.3390/s19071631 · Cited by 104
“The role of BCI is to establish communication between the human brain and external computers or other intelligent electronic devices [8,9].”
BackgroundTwo-Stage Frequency Recognition Method Based on Correlated Component Analysis for SSVEP-Based BCI
Zhang, Y., Yin, E., Li, F., Zhang, Y., Tanaka, T., Zhao, Q., Cui, Y., Xu, P., Yao, D., & Guo, D. (2018) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2018.2848222 · Cited by 91
“It can help severely paralyzed people communicate or interact with their environment [1], [2], and it assists healthy people, such as through autonomous driving [3].”
BackgroundA BCI-Based Environmental Control System for Patients With Severe Spinal Cord Injuries
Zhang, R., Wang, Q., Li, K., He, S., Qin, S., Feng, Z., Chen, Y., Song, P., Yang, T., Zhang, Y., et al. (2017) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2016.2628861 · Cited by 90
Self-citationZhang, R., He, S., Yang, X., Wang, X., Li, K., Huang, Q., Yu, Z., Zhang, X., Tang, D., & Li, Y. (2018) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2018.2834555 · Cited by 84
Self-citationOptimized Motor Imagery Paradigm Based on Imagining Chinese Characters Writing Movement
Qiu, Z., Allison, B. Z., Jin, J., Zhang, Y., Wang, X., Li, W., & Cichocki, A. S. (2017) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2017.2655542 · Cited by 85
An improved P300 pattern in BCI to catch user’s attention
Jin, J., Zhang, H., Daly, I. P., Wang, X., & Cichocki, A. S. (2017) · Journal of Neural Engineering · doi:10.1088/1741-2552/aa6213 · Cited by 76
Zhang, X., Wu, D., Ding, L., Luo, H., Lin, C.-T., Jung, T., & Chavarriaga, R. (2020) · National Science Review · doi:10.1093/nsr/nwaa233 · Cited by 85
“, diagnosis of patients with disorder of consciousness [58].”
BackgroundThe extension of multivariate synchronization index method for SSVEP-based BCI
Zhang, Y., Guo, D., Yao, D., & Xu, P. (2017) · Neurocomputing · doi:10.1016/j.neucom.2017.03.082 · Cited by 68
A Hybrid Speller Design Using Eye Tracking and SSVEP Brain–Computer Interface
Mannan, M. M. N., Kamran, M. A., Kang, S., Choi, H. S., & Jeong, M. Y. (2020) · Sensors · doi:10.3390/s20030891 · Cited by 68
“BCIs are designed mainly to provide an alternative means of communication for people with severe motor disabilities [6–9].”
BackgroundA Single-Channel EOG-Based Speller
He, S., & Li, Y. (2017) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2017.2716109 · Cited by 67
Self-citationEEG-Based Brain-Computer Interfaces
Wang, Y., Nakanishi, M., & Zhang, D. (2019) · Advances in experimental medicine and biology · doi:10.1007/978-981-13-2050-7_2 · Cited by 70
Li, F., Tao, Q., Peng, W., Zhang, T., Si, Y., Zhang, Y., Yi, C., Biswal, B. B., Yao, D., & Xu, P. (2019) · NeuroImage · doi:10.1016/j.neuroimage.2019.116285 · Cited by 67
Zhang, X. L., Wu, D., Ding, L., Luo, H., Lin, C.-T., Jung, T., & Chavarriaga, R. (2020) · Zürcher Hochschule für Angewandte Wissenschaften digital collection (Zurich University of Applied Sciences) · doi:10.21256/zhaw-20507 · Cited by 57
EEG Artifacts Handling in a Real Practical Brain–Computer Interface Controlled Vehicle
Jafarifarmand, A., & Badamchizadeh, M. A. (2019) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2019.2915801 · Cited by 57
“These strategies contain shared-control techniques that apply automatic control systems besides the mental control [16]–[18], and hybrid BCIs that use less artifact-influenced”
BackgroundQuadcopter Flight Control Using a Non-invasive Multi-Modal Brain Computer Interface
Duan, X., Xie, S., Xie, X., Meng, Y., & Xu, Z. (2019) · Frontiers in Neurorobotics · doi:10.3389/fnbot.2019.00023 · Cited by 58
Model Predictive-Based Shared Control for Brain-Controlled Driving
Lu, Y. P., Bi, L., & Li, H. (2019) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2019.2897356 · Cited by 57
“Researchers have made substantial efforts and achieved some promising advances in improving the performance of BCIs [1], [12], [30], [31].”
BackgroundLi, F., Yi, C., Song, L., Jiang, Y., Peng, W., Si, Y., Zhang, T., Zhang, R., Yao, D., Zhang, Y., et al. (2018) · Brain Topography · doi:10.1007/s10548-018-0688-x · Cited by 50
Galiotta, V., Quattrociocchi, I., D’Ippolito, M., Schettini, F., Aricò, P., Sdoia, S., Formisano, R., Cincotti, F., Mattia, D., & Riccio, A. (2022) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2022.1040816 · Cited by 51
“Althoughmany reviews have been published about BCI and DoC, these are mainly narrative and non-systematic overviews about the advances in the field of the neurophysiology of DoC, including the BCI as one of the neurophysiological tools available to support the assessment of consciousness (Kübler and Kotchoubey, 2007;…”
MethodOPTICAL+: a frequency-based deep learning scheme for recognizing brain wave signals
Kumar, S., Sharma, R., & Sharma, A. K. (2021) · PeerJ Computer Science · doi:10.7717/peerj-cs.375 · Cited by 48
“A human – computer interaction (HCI) system uses cutting-edge techniques for establishing direct communication between the human brain and a computer ( Li et al., 2016 ).”
BackgroundRecent Advances in Fatigue Detection Algorithm Based on EEG
Wang, F., Wan, Y., Li, M., Huang, H., Li, L., Hou, X., Pan, J., Wen, Z., & Li, J. (2022) · Intelligent Automation & Soft Computing · doi:10.32604/iasc.2023.029698 · Cited by 43
Self-citationAn Intention-Driven Semi-autonomous Intelligent Robotic System for Drinking
Zhang, Z., Huang, Y., Chen, S., Qu, J., Pan, X., Yu, T., & Li, Y. (2017) · Frontiers in Neurorobotics · doi:10.3389/fnbot.2017.00048 · Cited by 42
“As Onose et al. pointed out, EEG is the only realistically practical non-invasive BMI approach at present among the existing non-invasive BMI technologies, because it is relatively affordable and easy to set-up (Onose et al., 2012; Ferracuti et al., 2013; Li et al., 2013, 2016; Yu et al., 2013).”
BackgroundSelf-citationEEG-Based Brain–Computer Interfaces are Vulnerable to Backdoor Attacks
Meng, L., Jiang, X., Huang, J., Zeng, Z., Yu, S. P., Jung, T., Lin, C., Chavarriaga, R., & Wu, D. (2023) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2023.3273214 · Cited by 46
Hierarchical feature fusion framework for frequency recognition in SSVEP-based BCIs
Zhang, Y., Yin, E., Li, F., Zhang, Y., Guo, D., Yao, D., & Xu, P. (2019) · Neural Networks · doi:10.1016/j.neunet.2019.07.007 · Cited by 42
Advances in Hybrid Brain-Computer Interfaces: Principles, Design, and Applications
Li, Z., Zhang, S., & Pan, J. (2019) · Computational Intelligence and Neuroscience · doi:10.1155/2019/3807670 · Cited by 40
“It has been designed for a variety of applications, such as speller [13], idle state detection [14], orthotics [15], the wheelchair navigation, and control of computer components, which include two-dimensional (2D) cursor [16], mouse [17], or mail client [18]. in-dependence. improvement in…”
BackgroundSelf-citationRehabilitation of motor function in children with cerebral palsy based on motor imagery
Xie, J., Jiang, L., Li, Y., Chen, B., Li, F., Jiang, Y., Gao, D., Deng, L., Lv, X., Ma, X., et al. (2021) · Cognitive Neurodynamics · doi:10.1007/s11571-021-09672-3 · Cited by 38
“MI helps to extend the ability of normal people (Li et al. 2010), to provide compensative assistance to the disabled (Li et al. 2016), and to benefit the rehabilitation of motor function (Sharma et al. 2006).”
BackgroundSelf-citationRazzak, I., Blumenstein, M., & Xu, G. (2019) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2019.2913142 · Cited by 35
“Brain-Computer Interface (BCI) is an advanced approach to establish the direct communication between a human brain and machine [1], [2], [3].”
BackgroundAn ERP-based BCI with peripheral stimuli: validation with ALS patients
Miao, Y., Yin, E., Allison, B. Z., Zhang, Y., Chen, Y., Dong, Y., Wang, X., Hu, D., Chchocki, A., & Jin, J. (2019) · Cognitive Neurodynamics · doi:10.1007/s11571-019-09541-0 · Cited by 35
EEG-FM-Compass: progress, benchmarking and future directions for EEG foundation models
Liu, D., Chen, Y., Chen, Z., Cui, Z., Wen, Y., An, J., Luo, J., & Wu, D. (2026) · National Science Review · doi:10.1093/nsr/nwag466 · Cited by 35
User Identity Protection in EEG-Based Brain–Computer Interfaces
Meng, L., Jiang, X., Huang, J., Li, W., Luo, H., & Wu, D. (2023) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2023.3310883 · Cited by 41
“[6, 90]Hz band-pass filter and down-sampled the EEG data to 128Hz, and extracted EEG trials in [1, 5]s after each stimulus onset.”
BackgroundMethodA Support Vector Neural Network for P300 EEG Signal Classification
Zhang, Z., Chen, G., & Chen, S. (2021) · IEEE Transactions on Artificial Intelligence · doi:10.1109/tai.2021.3105493 · Cited by 29
Adversarial robustness benchmark for EEG-based brain–computer interfaces
Meng, L., Jiang, X., & Wu, D. (2023) · Future Generation Computer Systems · doi:10.1016/j.future.2023.01.028 · Cited by 37
Hong, J., & Qin, X. (2021) · Journal of Intelligent & Fuzzy Systems · doi:10.3233/jifs-201280 · Cited by 35
“Withthe developmentoftechnology,thistypeofBCIcontin-uestomakeprogress,andiscombinedwithother typestoformmultimodalBCI[79].”
Lin, C., & Chen, L.-T. (2023) · Heliyon · doi:10.1016/j.heliyon.2023.e13745 · Cited by 29
“…be adopted to develop a BCI system; the common indices are event-related potential (ERP), event-related desynchroni-sation (ERD), event-related synchronisation (ERS), and steady-state visually evoked potential (SSVEP), which are derived from the features extracted from the brain activity [3, 4, 5].”
BackgroundCai, X., & Pan, J. (2022) · Journal of Healthcare Engineering · doi:10.1155/2022/6894392 · Cited by 31
Self-citationChen, X., Wang, Z., & Wu, D. (2024) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2024.3391936 · Cited by 32
“In EEG-based awareness evaluation/detection for disorder of consciousness patients [14], adversarial attacks may disturb the true responses of the patients and lead to misdiagnosis.”
BackgroundReconfiguration of Brain Network Between Resting State and P300 Task
Li, F., Yi, C., Liao, Y., Jiang, Y., Si, Y., Song, L., Zhang, T., Yao, D., Zhang, Y., Cao, Z., et al. (2020) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2020.2965135 · Cited by 23
“Findings of our study indicated that the reconfigured network pattern could be potentially used for the selection of applicable users for P300-BCI, and also helpful to deepen our knowledge of the generations of P300.”
MethodEffects of Background Music on Objective and Subjective Performance Measures in an Auditory BCI
Zhou, S., Allison, B. Z., Kübler, A., Cichocki, A. S., Wang, X., & Jin, J. (2016) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2016.00105 · Cited by 21
“Tactile BCIs have been validated with patients with visual disabilities, including persons with a disorder of consciousness (DOC) (Kaufmann et al., 2014; Edlinger et al., 2015; Li et al., 2016).”
BackgroundTan, Y., Lin, Y., Zang, B., Gao, X., Yong, Y., Yang, J., & Li, S. (2021) · Journal of Neuroscience Methods · doi:10.1016/j.jneumeth.2021.109442 · Cited by 22
Adversarial filtering based evasion and backdoor attacks to EEG-based brain-computer interfaces
Meng, L., Jiang, X., Chen, X., Liu, W., Luo, H., & Wu, D. (2024) · Information Fusion · doi:10.1016/j.inffus.2024.102316 · Cited by 29
Stimuli and Feature Extraction Algorithms for Brain-Computer Interfaces: A Systematic Comparison
Bittencourt-Villalpando, M., & Maurits, N. M. (2018) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2018.2855801 · Cited by 19
“Recently, several groups [21] have been proposing hybrid tasks that combine multiple brain stimulation techniques in an attempt to minimize the number of illiterates and/or to enhance the performance of the system.”
BackgroundReconfiguration patterns of large-scale brain networks in motor imagery
Zhang, T., Wang, F., Li, M., Li, F., Tan, Y. H. V., Zhang, Y., Yang, H., Biswal, B. B., Yao, D., & Xu, P. (2018) · Brain Structure and Function · doi:10.1007/s00429-018-1786-y · Cited by 19
Self-citationGuo, M., Jin, J., Jiao, Y., Wang, X., & Cichockia, A. (2019) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2019.00024 · Cited by 18
“…(Pfurtscheller and Neuper, 2001; Wang et al., 2006; Hwang et al., 2009; Jiao et al., 2018), steady-state visual evoked potentials (SSVEP) BCI (Ortner et al., 2011; Jiao et al., 2016; Nakanishi et al., 2018; Zhang et al., 2018), hybrid BCI (Pfurtscheller et al., 2010; Li et al., 2016), and so on.”
BackgroundTransferable multi-modal fusion in knee angles and gait phases for their continuous prediction
Guo, Z., Zheng, H., Wu, H., Zhang, J., Zhou, G., & Long, J. (2023) · Journal of Neural Engineering · doi:10.1088/1741-2552/accd22 · Cited by 18
Self-citationSchmidt, B. K., Mussel, P., Osinsky, R., Rasch, B., Debener, S., & Hewig, J. S. (2017) · Biological Psychology · doi:10.1016/j.biopsycho.2017.04.010 · Cited by 18
Deep Unfolding With Weighted ℓ₂ Minimization for Compressive Sensing
Zhang, J., Li, Y., Yu, Z. L., Gu, Z., Cheng, Y., & Gong, H. (2020) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.3021724 · Cited by 18
“R ECONSTRUCTION of a sparse signal x o ∈ R n from a small number of measurements y ∈ R m , i.e., m n , is a fundamental problem in many engineering tasks, including biomedical engineering [1]–[4], pattern recognition [5], wireless communications [6], and Internet of Things [7]–[12].”
BackgroundSelf-citationXu, F., Wang, Y., Li, H., Yu, X., Wang, C., Liu, M., Jiang, L., Feng, C., Li, J., Wang, D., et al. (2022) · Frontiers in Aging Neuroscience · doi:10.3389/fnagi.2022.911513 · Cited by 17
“Including time-varying granger causality analysis (tv-GCA), time-varying partial directed coherence (tv-PDC), and adaptive directed transfer function (ADTF) can get different network connection structures in different cognitive procedures (Li et al., 2015; Manomaisaowapak et al., 2015).”
BackgroundEvaluation of the User Adaptation in a BCI Game Environment
Glavas, K., Prapas, G., Tzimourta, K. D., Γιαννακέας, Ν., & Tsipouras, M. G. (2022) · Applied Sciences · doi:10.3390/app122412722 · Cited by 17
Chen, D., Miao, R., Deng, Z., Lu, Y., Liang, Y. Q., & Huang, L. (2020) · Frontiers in Neuroinformatics · doi:10.3389/fninf.2020.00029 · Cited by 16
“The role of BCI is to establish communication between the human brain and external computers or other intelligent electronic devices (Jin et al., 2015; Li et al., 2016).”
BackgroundBrain–Computer Interfaces in Acute and Subacute Disorders of Consciousness
Xu, R., Spataro, R., Allison, B. Z., & Guger, C. (2021) · Journal of Clinical Neurophysiology · doi:10.1097/wnp.0000000000000810 · Cited by 18
Li, J., Huang, B., Wang, F., Xie, Q., Xu, C., Huang, H., & Pan, J. (2022) · Brain Sciences · doi:10.3390/brainsci12111556 · Cited by 17
Self-citationBaumert, M., Porta, A., & Cichocki, A. S. (2016) · Proceedings of the IEEE · doi:10.1109/jproc.2015.2511359 · Cited by 15
“[6] review multimodal approaches to improve target detection and control of these systems.”
BackgroundAn Active RBSE Framework to Generate Optimal Stimulus Sequences in a BCI for Spelling
Moghadamfalahi, M., Akçakaya, M., Nezamfar, H., Sourati, J., & Deniz Erdogmus, B. (2017) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2017.2728500 · Cited by 15
“Even though matrixbased presentation scheme is very commonly used and various paradigms for this scheme were developed to improve typing speed and accuracy [6], [7], [8], [9], [10], [11], [12], [13], it has been shown the matrix-based presentation paradigms are highly gaze dependent and they cannot operate well for th…”
An exploration of spatial auditory BCI paradigms with different sounds: music notes versus beeps
Huang, M., Daly, I. P., Jin, J., Zhang, Y., Wang, X., & Cichocki, A. S. (2016) · Cognitive Neurodynamics · doi:10.1007/s11571-016-9377-1 · Cited by 15
“Since then, many studies have been done to improve the performance of visual P300-based BCIs (Li et al. 2016; Yin et al. 2013).”
BackgroundPan, J., Xiao, J., Wang, J., Wang, F., Li, J., Qiu, L., Di, H., & Li, Y. (2022) · Seminars in Neurology · doi:10.1055/a-1900-7261 · Cited by 13
Self-citationMotor imagery EEG classification via Bayesian extreme learning machine
Zhang, Y., Jin, J., Wang, X., & Wang, Y. (2016) · International Conference on Information Science and Technology · doi:10.1109/icist.2016.7483380 · Cited by 13
“As a result, the severely disabled people are able to hopefully recover their environmental control abilities by using BCI systems [3].”
BackgroundSpatial fusion of maximum signal fraction analysis for frequency recognition in SSVEP-based BCI
Li, Z., Liu, K., Deng, X., & Wang, G. (2020) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2020.102042 · Cited by 13
EEG-Based Brain-Computer Interfaces Are Vulnerable to Backdoor AttacksPreprint
Meng, L., Huang, J., Zeng, Z., Jiang, X., Yu, S., Jung, T., Lin, C., Chavarriaga, R., & Wu, D. (2021) · doi:10.21203/rs.3.rs-108085/v1 · Cited by 13
EEG Based Aptitude Detection System for Stress Regulation in Health Care Workers
Khan, T., Javed, H., Amin, M., Usman, O. A., Hussain, S. I., Mehmoood, A., & Maple, C. R. (2021) · Scientific Programming · doi:10.1155/2021/4620487 · Cited by 12
Periodic Visual Stimulation Induces Resting-State Brain Network Reconfiguration
Guo, D., Guo, F., Zhang, Y., Li, F., Xia, Y., Xu, P., & Yao, D. (2018) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2018.00021 · Cited by 12
“, 2013), BCI spellers (Li et al., 2016), detecting number processing and mental calculation in patients (Li et al.”
BackgroundAdversarial artifact detection in EEG-based brain–computer interfaces
Chen, X., Meng, L., Xu, Y., & Wu, D. (2024) · Journal of Neural Engineering · doi:10.1088/1741-2552/ad8964 · Cited by 12
“In EEG-based awareness evaluation for disorder of consciousness patients [22], they can lead to misdiagnosis.”
MI brain-computer interfaces: A concise overview
Mandal, S. K., & Naskar, M. N. B. J. (2023) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2023.105293 · Cited by 11
Zhang, J., Zhang, Y., Zhang, X., Xu, B., Zhao, H., Sun, T., Wang, J., Lu, S., & Shen, X. (2024) · iScience · doi:10.1016/j.isci.2024.110164 · Cited by 9
Liu, S., Fu, W., Wei, C., Ma, F., Cui, N., Shan, X., & Zhang, Y. (2022) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2022.1011463 · Cited by 10
Hong, J. (2017) · Journal of Intelligent & Fuzzy Systems · doi:10.3233/jifs-162104 · Cited by 9
Support Recovery From Noisy Random Measurements via Weighted $\ell _1$ Minimization
Zhang, J., Mitra, U., Huang, K.-W., & Michelusi, N. (2018) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2018.2838553 · Cited by 9
“In brain-computer interfaces [8], electroencephalography (EEG) is a popular noninvasive technology to probe human brain activities with excellent spatial-temporal resolution.”
BackgroundMahmood, S., Shin, J., Farhana, I., Islam, M. R., & Molla, M. K. I. (2021) · IEEE Access · doi:10.1109/access.2021.3136774 · Cited by 9
“The BCI system shows its great potential for providing communication access to both people with severe motor disabilities and physically disabled persons [1]–[3].”
BackgroundA real-time ML-based asynchronous HCI speller system using EOG signals
Preetha, S., & Sasikala, M. (2025) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2024.107463 · Cited by 8
He, Z., Zhong, Y., & Pan, J. (2022) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/smc53654.2022.9945265 · Cited by 9
“Therefore, the challenge of behavioral assessment may lead to frequent misdiagnosis in DOC patients, as reported in previous studies [3, 7-9].”
BackgroundResultSelf-citationThe clinical applications of brain–computer interfaces
Jia, C., Huang, J., Hu, Y., Zhou, H., Liu, H., Liu, X., Zhang, H., Shen, Z., Li, W., Gao, S., et al. (2025) · Brain‐X · doi:10.1002/brx2.70033 · Cited by 7
Multi Modal Aptitude Detection System for Smart Office
Tehseen, M., Javed, H., Mehmood, A., Amin, M., Hussain, I., & Jan, B. (2019) · IEEE Access · doi:10.1109/access.2019.2893202 · Cited by 7
“These systems are emerging very rapidly as control and monitoring subsystems, for variety of applications such as Structural Monitoring [1], Industrial Process Control [3], Smart Offices [2], [3], Military or Border Surveillance [4], [5], Environmental Conditions Monitoring [6], Intelligent Agriculture [7], Health Car…”
BackgroundKlee, D., Memmott, T., Smedemark-Margulies, N., Celik, B., Erdogmus, D., & Oken, B. (2022) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2022.882557 · Cited by 7
Yi, H., Ming, Y., Liu, D., & Kong, W. (2024) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme57554.2024.10688012 · Cited by 13
“Through hijacking EEG signals, attackers can disrupt the operation of steady-state visually evoked potentials (SSVEP) based typewriters [11] or control wheelchairs [13], leading to unintended characters or dangerous movements, and endangering user safety.”
BackgroundResearch on mobile robot path planning in dynamic environment
Liang, X., Liu, C., Song, X., & Hao, C. (2017) · Chinese Automation Congress · doi:10.1109/cac.2017.8243459 · Cited by 7
“TRADITIONAL ARTIFICAL FIELD METHOD Khatib first proposed artificial field method in 1986 [8].”
MethodNoninvasive Brain–Computer Interfaces
Schalk, G., & Allison, B. Z. (2018) · Elsevier eBooks · doi:10.1016/b978-0-12-805353-9.00026-7 · Cited by 7
Bolaños, C. D. F., & Correa, H. L. (2018) · Revista Ingeniería Biomédica · doi:10.24050/19099762.n24.2018.1222 · Cited by 7
“En [65] se plantea la necesidad de crear BCI Multimodales para poder superar estas dos grandes limitaciones de las BCI.”
BackgroundQi, W., Zhang, Y., Su, Y., Hui, Z., Li, Y., Wang, H., Zhang, J., Shi, K., Wang, M., Zhou, L. F., et al. (2025) · Scientific Reports · doi:10.1038/s41598-025-96946-z · Cited by 9
“Meanwhile, MI relies on the mental simulation of actions, linking the brain’s motor representations with the actual physical movement, which aids in the rehabilitation of motor functions 15,16 .”
Self-citationData alignment based adversarial defense benchmark for EEG-based BCIs
Chen, X., Jia, T., & Wu, D. (2025) · Neural Networks · doi:10.1016/j.neunet.2025.107516 · Cited by 12
Using Fixation-Related Potentials for Inspecting Natural Interactions
Wobrock, D., Finke, A., Schack, T., & Ritter, H. J. (2020) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2020.579505 · Cited by 6
“To improve upon it, additional physiological signals have been used as information supplements in a variety of BCI studies (Li et al., 2016).”
BackgroundThe effects of semantic congruency: a research of audiovisual P300-speller
Cao, Y., An, X., Ke, Y., Jiang, J., Yang, H., Chen, Y., Jiao, X., Qi, H., & Ming, D. (2017) · BioMedical Engineering OnLine · doi:10.1186/s12938-017-0381-4 · Cited by 5
“Nowadays, hybrid BCI system slowly entered the vision of researchers [11, 12], especially multimodal stimuli paradigm combining auditory-and visual-based speller have attracted much attention from researchers [13–17].”
Intermodulation from Unisensory to Multisensory Perception: A Review
Shen, X., Zhou, X., & Chen, L. (2022) · Brain Sciences · doi:10.3390/brainsci12121617 · Cited by 5
“[49] introduced a new technique for disease diagnosis, namely multimodal/hybrid BCI, which combines EEG signals with other physiological signals (such as eye gaze, electrocardiography (ECG) or electromyography (EMG)) to solve the above problem.”
Yang, W., Wang, R., & Li, L. (2022) · Advances in Multimedia · doi:10.1155/2022/9917770 · Cited by 4
Analysis of SSVEP component acquisition from EEG signals for efficient target identification
Swetha, K. R., Krishnegowda, R. G., & Venkataramu, S. S. (2023) · Indonesian Journal of Electrical Engineering and Computer Science · doi:10.11591/ijeecs.v30.i2.pp838-845 · Cited by 4
Task-related component analysis based on time filter and similarity constraint for SSVEP-based BCI
Yin, X., Liang, J., Lin, M., & Bu, L. (2024) · Measurement · doi:10.1016/j.measurement.2024.114959 · Cited by 4
User-wise perturbations for user identity protection in EEG-based BCIs
Chen, X., Li, S., Tu, Y., Wang, Z., & Wu, D. (2024) · Journal of Neural Engineering · doi:10.1088/1741-2552/ad88a5 · Cited by 10
“It can be used in neurological rehabilitation [2], awareness evaluation [3], active tactile exploration [4], robotic device control [5], speech synthesis [6], etc.”
Support recovery from noisy random measurements via weighted ℓ 1 minimization
Zhang, J., Mitra, U., Huang, K.-W., & Michelusi, N. (2016) · IEEE International Symposium on Information Theory (ISIT) · doi:10.1109/isit.2016.7541534 · Cited by 4
Intelligent Target Detection and Tracking Algorithm for Martial Arts Applications
Tang, Z. (2022) · Wireless Communications and Mobile Computing · doi:10.1155/2022/7008467 · Cited by 4
“Therefore, the background pictures are linearly related to each other, thus, forming a low-rank matrix [9].”
BackgroundA Wearable Brain–Computer Interface for Mitigating Car Sickness via Attention Shifting
Zhu, J., Bao, X., Huang, Q., Wang, T., Huang, L., Han, Y., Huang, H., Zhu, J., Qu, J., Li, K., et al. (2026) · Advanced Science · doi:10.1002/advs.202513040 · Cited by 3
Self-citationDeep Learning Models with Time Delay Embedding for EEG-Based Attentive State Classification
Cai, H. J., Xia, M., Nie, L., Wu, Y., & Zhang, Y. (2021) · Communications in computer and information science · doi:10.1007/978-3-030-92310-5_36 · Cited by 3
Sparse Signal Reconstruction With Statistical Prior Information: A Data-Driven Method
Liao, Z., Zhang, J., Hu, D., Li, C., Zhu, L., & Li, Y. (2019) · IEEE Access · doi:10.1109/access.2019.2950003 · Cited by 3
“These applications include image super-resolution [1], electromagnetic imaging [2], brain-computer interface [3], distributed networked storage [4] and 5G communications [5], which all admit sparse or approximately sparse representations in time/transform domains.”
BackgroundSelf-citationdu Bois, N., Korik, A., Hodge, S., Hudson, L., Elahi, A. S., Bigirimana, A., Dayan, N., Sanchez-Bornot, J. M., McCann, A., Yelden, K., et al. (2026) · Communications Medicine · doi:10.1038/s43856-026-01574-x · Cited by 2
Metadata
- Authors
- Li, Y., Pan, J., Long, J., Yu, T., Wang, F., Yu, Z., & Wu, W.
- Affiliations
- South China Normal University (CN)
- Venue
- Proceedings of the IEEE
- Published
- 2016-02
- Volume
- 104
- Issue
- 2
- Pages
- 332-352
- ISSN
- 0018-9219 (ISSN-L)
- 1558-2256
- OpenAlex
- W2247338144
- Cited by
- 117
- References
- 81
- Citations by year
- 2026: 6 · 2025: 7 · 2024: 8 · 2023: 8 · 2022: 16 · 2021: 11 · 2020: 10 · 2019: 17 · 2018: 14 · 2017: 14 · 2016: 6
- FWCI
- 6.81
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Proceedings of the IEEE (publishedVersion)
- Funders
- National High-Tech R&D Program of China (2012AA011601)
- National Key Basic Research Program of China (2015CB351703)
- National Natural Science Foundation of China (91120305, 91420302, 61175114, 61503143)
- Guangdong Natural Science Foundation (2014A030312005, 2014A030310244)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › EEG and Brain-Computer Interfaces
- Physical Sciences › Computer Science › Human-Computer Interaction › Gaze Tracking and Assistive Technology
- Social Sciences › Arts and Humanities › Philosophy › Free Will and Agency
- Keywords
- hybrid BCI, target detection, multidimensional control, disorder of consciousness, multisensory stimuli, neurofeedback
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.