Transferring brain-computer interfaces beyond the laboratory: Successful application control for motor-disabled users
Open accessAbstract
Objectives Brain-computer interfaces (BCIs) are no longer only used by healthy participants under controlled conditions in laboratory environments, but also by patients and end-users, controlling applications in their homes or clinics, without the BCI experts around. But are the technology and the field mature enough for this? Especially the successful operation of applications - like text entry systems or assistive mobility devices such as tele-presence robots - requires a good level of BCI control. How much training is needed to achieve such a level? Is it possible to train naïve end-users in 10 days to successfully control such applications?Materials and methods In this work, we report our experiences of training 24 motor-disabled participants at rehabilitation clinics or at the end-users' homes, without BCI experts present. We also share the lessons that we have learned through transferring BCI technologies from the lab to the user's home or clinics.Results The most important outcome is that 50% of the participants achieved good BCI performance and could successfully control the applications (tele-presence robot and text-entry system). In the case of the tele-presence robot the participants achieved an average performance ratio of 0.87 (max. 0.97) and for the text entry application a mean of 0.93 (max. 1.0). The lessons learned and the gathered user feedback range from pure BCI problems (technical and handling), to common communication issues among the different people involved, and issues encountered while controlling the applications.Conclusion The points raised in this paper are very widely applicable and we anticipate that they might be faced similarly by other groups, if they move on to bringing the BCI technology to the end-user, to home environments and towards application prototype control.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Works where users acquired BCI control, in able-bodied and end-user populations, do not report any learning metric over time.
“Firstly, works where users acquired BCI control (able-bodied [3,25] and end-users [40,41,51,62,63]) do not report any learning metric over time.”
From The Cybathlon BCI race: Successful longitudinal mutual learning with two tetraplegic users (2018) · cites this paper as [51]
Other training studies claim learnability in BCIs only on the grounds of improved online classification accuracy or application performances.
“Secondly, other training studies claim learnability in BCIs only on the grounds of improved online classification accuracy [9,27,30,31,33,35,51] or application performances [36,37].”
From The Cybathlon BCI race: Successful longitudinal mutual learning with two tetraplegic users (2018) · cites this paper as [51]
The EEG-based MI BCI design previously developed in CNBI had already been shown to allow end-users to successfully operate a number of BCI prototypes.
“The Brain Tweakers participation in the Cybathlon BCI race relied on the EEG-based MI BCI design previously developed in CNBI, which had already been shown to allow end-users to successfully operate a number of BCI prototypes [51].”
From The Cybathlon BCI race: Successful longitudinal mutual learning with two tetraplegic users (2018) · cites this paper as [51]
The authors' training apparatus has been very similar to the one applied in their previous work.
“We denote that our training apparatus, which certainly falls under the category of “conventional” MI BCI training protocols relying on visual feedback training on top of initial machine calibration with spontaneous SMRs, has been very similar to the one we have applied in our previous work [51].”
From The Cybathlon BCI race: Successful longitudinal mutual learning with two tetraplegic users (2018) · cites this paper as [51]
Training with the BCI application rather than towards it had a profound impact for both application performances and subject learning.
“Second, training with the BCI application rather than towards it—like in [51] and most other studies—had a profound impact, as shown in Fig 6, for both application performances and subject learning.”
From The Cybathlon BCI race: Successful longitudinal mutual learning with two tetraplegic users (2018) · cites this paper as [51]
In the previous work, a considerable number of end-users failed to acquire BCI control, especially those without distinct spontaneous SMRs at training onset.
“There, a considerable number of end-users failed to acquire BCI control, especially those without distinct spontaneous SMRs at training onset.”
From The Cybathlon BCI race: Successful longitudinal mutual learning with two tetraplegic users (2018) · cites this paper as [51]
P1 had several years prior participated in MI BCI studies, while P2 was BCI naive at the onset of his Cybathlon training.
“P1 had several years prior participated in the MI BCI studies reported in [35,51,71], while P2 was BCI naive at the onset of his Cybathlon training.”
From The Cybathlon BCI race: Successful longitudinal mutual learning with two tetraplegic users (2018) · cites this paper as [51]
Cites
Brain–computer interfaces for communication and control
Wolpaw, J. R., Birbaumer, N., McFarland, D. J., Pfurtscheller, G., & Vaughan, T. M. (2002) · Clinical Neurophysiology · doi:10.1016/s1388-2457(02)00057-3 · Cited by 7,927 · see citing works
Event-related EEG/MEG synchronization and desynchronization: basic principles
Pfurtscheller, G., & Lopes da Silva, F. H. (1999) · Clinical Neurophysiology · doi:10.1016/s1388-2457(99)00141-8 · Cited by 7,328 · see citing works
Motor imagery and direct brain-computer communication
Pfurtscheller, G., & Neuper, C. (2001) · Proceedings of the IEEE · doi:10.1109/5.939829 · Cited by 1,990 · see citing works
A spelling device for the paralysed
Birbaumer, N., Ghanayim, N., Hinterberger, T., Iversen, I., Kotchoubey, B., Kübler, A., Perelmouter, J., Taub, E., & Flor, H. (1999) · Nature · doi:10.1038/18581 · Cited by 1,577 · see citing works
Proceedings of IEEE International Conference on Systems, Man and Cybernetics
(1994) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/icsmc.1994.399796 · Cited by 1,342 · see citing works
Combining brain-computer interfaces and assistive technologies: state-of-the-art and challenges
Millán, J. D. R. (2010) · Frontiers in Neuroscience · doi:10.3389/fnins.2010.00161 · Cited by 870 · see citing works
Self-citationThe neurophysiological basis of motor imagery
Jean Decety, A. (1996) · Behavioural Brain Research · doi:10.1016/0166-4328(95)00225-1 · Cited by 793 · see citing works
Noninvasive Brain-Actuated Control of a Mobile Robot by Human EEG
Millán, J. D. R., Frédéric Renkens, B., Mourino, J., & Gerstner, W. (2004) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2004.827086 · Cited by 740 · see citing works
Self-citationNeuper, C., Scherer, R., Reiner, M., & Pfurtscheller, G. (2005) · Cognitive Brain Research · doi:10.1016/j.cogbrainres.2005.08.014 · Cited by 716 · see citing works
Galán, F., Nuttin, M., Lew, E. Y. L., Ferrez, P. W., Vanacker, G., Philips, J., & Millán, J. D. R. (2008) · Clinical Neurophysiology · doi:10.1016/j.clinph.2008.06.001 · Cited by 660 · see citing works
Self-citationHow many people are able to control a P300-based brain-computer interface (BCI)?
Guger, C., Daban, S., Sellers, E., Holzner, C., Krausz, G., Carabalona, R., Gramatica, F., & Edlinger, G. (2009) · Neuroscience Letters · doi:10.1016/j.neulet.2009.06.045 · Cited by 652 · see citing works
Ehrsson, H. H., Geyer, S., & Naito, E. (2003) · Journal of Neurophysiology · doi:10.1152/jn.01113.2002 · Cited by 631 · see citing works
Mental imaging of motor activity in humans
Jeannerod, M., & Frak, V. (1999) · Current Opinion in Neurobiology · doi:10.1016/s0959-4388(99)00038-0 · Cited by 561 · see citing works
How many people are able to operate an EEG-based brain-computer interface (BCI)?
Guger, C., Edlinger, G., Harkam, W., Niedermayer, I., & Pfurtscheller, G. (2003) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2003.814481 · Cited by 526 · see citing works
Sellers, E. W., Krusienski, D. J., McFarland, D. J., Vaughan, T. M., & Wolpaw, J. R. (2006) · Biological Psychology · doi:10.1016/j.biopsycho.2006.04.007 · Cited by 504 · see citing works
Kübler, A., & Birbaumer, N. (2008) · Clinical Neurophysiology · doi:10.1016/j.clinph.2008.06.019 · Cited by 441 · see citing works
Brain-Controlled Wheelchairs: A Robotic Architecture
Carlson, T., & Millán, J. D. R. (2013) · IEEE Robotics & Automation Magazine · doi:10.1109/mra.2012.2229936 · Cited by 431 · see citing works
Self-citationSteady-State VEP-Based Brain-Computer Interface Control in an Immersive 3D Gaming Environment
Lalor, E. C., Kelly, S. P., Finucane, C., Burke, R., Smith, R. O., Reilly, R. B., & McDarby, G. (2005) · EURASIP Journal on Advances in Signal Processing · doi:10.1155/asp.2005.3156 · Cited by 421 · see citing works
Robot-aided neurorehabilitation of the upper extremities
Riener, R., Nef, T., & Colombo, G. (2005) · Medical & Biological Engineering & Computing · doi:10.1007/bf02345116 · Cited by 406 · see citing works
Clerc, M., Bougrain, L., & Lotte, F. (2010) · Human-computer interaction series · doi:10.1007/978-1-84996-272-8 · Cited by 391 · see citing works
Control of a humanoid robot by a noninvasive brain–computer interface in humans
Bell, C. J., Shenoy, P., Chalodhorn, R., & Rao, R. P. N. (2008) · Journal of Neural Engineering · doi:10.1088/1741-2560/5/2/012 · Cited by 387 · see citing works
Dynamics of behavior: Theory and applications for autonomous robot architectures
Schöner, G., Dose, M., & Engels, C. (1995) · Robotics and Autonomous Systems · doi:10.1016/0921-8890(95)00049-6 · Cited by 334 · see citing works
Toward Unsupervised Adaptation of LDA for Brain–Computer Interfaces
Vidaurre, C., Kawanabe, M., von Bünau, P., Blankertz, B., & Müller, K. R. (2010) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2010.2093133 · Cited by 296 · see citing works
Optimal Computer Search Trees and Variable-Length Alphabetical Codes
Hu, T. C., & Tucker, A. C. (1971) · SIAM Journal on Applied Mathematics · doi:10.1137/0121057 · Cited by 291 · see citing works
Design, Implementation and Clinical Tests of a Wire-Based Robot for Neurorehabilitation
Rosati, G., Gallina, P., & Masiero, S. (2007) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2007.908560 · Cited by 267 · see citing works
Leeb, R., Sagha, H., Chavarriaga, R., & Millán, J. D. R. (2011) · Journal of Neural Engineering · doi:10.1088/1741-2560/8/2/025011 · Cited by 245 · see citing works
Self-citationAutocalibration and recurrent adaptation: Towards a plug and play online ERD-BCI
Faller, J., Vidaurre, C., Solis-Escalante, T., Neuper, C., & Scherer, R. (2012) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2012.2189584 · Cited by 180 · see citing works
Tools for brain-computer interaction: a general concept for a hybrid BCI
Muller-Putz, G. R. (2011) · Frontiers in Neuroinformatics · doi:10.3389/fninf.2011.00030 · Cited by 144 · see citing works
Brain-controlled telepresence robot by motor-disabled people
Tonin, L., Carlson, T., Leeb, R., & Millán, J. D. R. (2011) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/iembs.2011.6091049 · Cited by 132 · see citing works
Self-citationThe role of shared-control in BCI-based telepresence
Tonin, L., Leeb, R., Tavella, M., Perdikis, S., & Millán, J. D. R. (2010) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/icsmc.2010.5642338 · Cited by 125 · see citing works
Self-citationNessi: An EEG-Controlled Web Browser for Severely Paralyzed Patients
Bensch, M., Karim, A. A., Mellinger, J., Hinterberger, T., Tangermann, M., Bogdan, M., Rosenstiel, W., & Birbaumer, N. (2007) · Computational Intelligence and Neuroscience · doi:10.1155/2007/71863 · Cited by 100 · see citing works
Walking by Thinking: The Brainwaves Are Crucial, Not the Muscles!
Leeb, R., Keinrath, C., Friedman, D. A., Guger, C., Scherer, R., Neuper, C., Garau, M., Antley, A., Steed, A. J., Slater, M., et al. (2006) · PRESENCE Virtual and Augmented Reality · doi:10.1162/pres.15.5.500 · Cited by 99 · see citing works
Self-citationDesigning for uncertain, asymmetric control: Interaction design for brain–computer interfaces
Williamson, J. H., Murray‐Smith, R., Blankertz, B., Krauledat, M., & Müller, K. R. (2009) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2009.05.009 · Cited by 98 · see citing works
Thinking Penguin: Multimodal Brain–Computer Interface Control of a VR Game
Leeb, R., Lancelle, M., Kaiser, V., Fellner, D. W., & Pfurtscheller, G. (2013) · IEEE Transactions on Computational Intelligence and AI in Games · doi:10.1109/tciaig.2013.2242072 · Cited by 91 · see citing works
Self-citationBrain-computer interfaces — the key for the conscious brain locked into a paralyzed body
Kübler, A., & Neumann, N. (2005) · Progress in brain research · doi:10.1016/s0079-6123(05)50035-9 · Cited by 90 · see citing works
Riccio, A., Leotta, F., Bianchi, L., Aloise, F., Zickler, C., Hoogerwerf, E.-J., Kübler, A., Donatella Mattia, A., & Febo Cincotti, A. (2011) · Journal of Neural Engineering · doi:10.1088/1741-2560/8/2/025028 · Cited by 89 · see citing works
Brain-computer interfaces for hci and games
Nijholt, A., Tan, D. S., Allison, B. Z., Millán, J. D. R., & Graimann, B. (2008) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/1358628.1358958 · Cited by 77 · see citing works
Self-citationFacing the challenge: Bringing brain–computer interfaces to end-users
Kübler, A., Donatella Mattia, A., Rupp, R., & Tangermann, M. (2013) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2013.08.002 · Cited by 71 · see citing works
Lotte, F., van Langhenhove, A., Lamarche, F., Ernest, T., Renard, Y., Arnaldi, B., & Lécuyer, A. (2010) · PRESENCE Virtual and Augmented Reality · doi:10.1162/pres.19.1.54 · Cited by 63 · see citing works
Feature Extraction for Multi-class BCI using Canonical Variates Analysis
Galán, F., Ferrez, P. W., Oliva, F., Guàrdia‐Olmos, J., & Millán, J. D. R. (2007) · IEEE International Symposium on Intelligent Signal Processing, · doi:10.1109/wisp.2007.4447615 · Cited by 63 · see citing works
Self-citationLearning discriminative patterns for self-paced EEG-based motor imagery detection
Ang, K. K. (2012) · Frontiers in Neuroscience · doi:10.3389/fnins.2012.00007 · Cited by 41 · see citing works
Implementation of a telemonitoring system for the control of an EEG-based brain-computer interface
Müller, G., Neuper, C., & Pfurtscheller, G. (2003) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2003.810423 · Cited by 40 · see citing works
Online modulation of the level of assistance in shared control systems
Carlson, T., Leeb, R., Chavarriaga, R., & Millán, J. D. R. (2012) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/icsmc.2012.6378307 · Cited by 27 · see citing works
Self-citationA supervised recalibration protocol for unbiased BCI
Perdikis, S., Tavella, M., Leeb, R., Chavarriaga, R., & Millán, J. D. R. (2011) · Infoscience (Ecole Polytechnique Fédérale de Lausanne) · Cited by 6 · see citing works
Self-citationToward online detection of BCI performance degradation
Sagha, H., Perdikis, S., Millán, J. D. R., & Chavarriaga, R. (2012) · Infoscience (Ecole Polytechnique Fédérale de Lausanne) · Cited by 1 · see citing works
Self-citation
Flagged first, then by citations
2 of the 49 references couldn’t be matched to a known paper.
Cited by
Sorted by citations
Brain-actuated functional electrical stimulation elicits lasting arm motor recovery after stroke
Biasiucci, A., Leeb, R., Iturrate, I., Perdikis, S., Al-Khodairy, A., Corbet, T., Schnider, A., Schmidlin, T., Zhang, H., Bassolino, M., et al. (2018) · Nature Communications · doi:10.1038/s41467-018-04673-z · Cited by 649 · see citing works
Self-citationNoninvasive Brain-Computer Interfaces Based on Sensorimotor Rhythms
He, B., Baxter, B., Edelman, B. J., Cline, C. C., & Ye, W. W. (2015) · Proceedings of the IEEE · doi:10.1109/jproc.2015.2407272 · Cited by 233 · see citing works
Towards Independence: A BCI Telepresence Robot for People With Severe Motor Disabilities
Leeb, R., Tonin, L., Rohm, M., Desideri, L., Carlson, T., & Millan, J. D. R. (2015) · Proceedings of the IEEE · doi:10.1109/jproc.2015.2419736 · Cited by 187 · see citing works
Self-citationThe Cybathlon BCI race: Successful longitudinal mutual learning with two tetraplegic users
Perdikis, S., Tonin, L., Saeedi, S., Schneider, C., & Millán, J. D. R. (2018) · PLOS Biology · doi:10.1371/journal.pbio.2003787 · Cited by 166 · see citing works
Self-citationBorton, D., Micera, S., Millán, J. D. R., & Courtine, G. (2013) · Science Translational Medicine · doi:10.1126/scitranslmed.3005968 · Cited by 171 · see citing works
Self-citationMuller-Putz, G. R., Leeb, R., Tangermann, M., Höhne, J., Kübler, A., Febo Cincotti, A., Donatella Mattia, A., Rupp, R., Müller, K., & Millán, J. D. R. (2015) · Proceedings of the IEEE · doi:10.1109/jproc.2015.2411333 · Cited by 158 · see citing works
Self-citationNon-invasive control interfaces for intention detection in active movement-assistive devices
Lobo-Prat, J., Kooren, P. N., Stienen, A. H. A., Herder, J. L., Koopman, H. F. J. M., & Veltink, P. H. (2014) · Journal of NeuroEngineering and Rehabilitation · doi:10.1186/1743-0003-11-168 · Cited by 150 · see citing works
A brain-controlled exoskeleton with cascaded event-related desynchronization classifiers
Lee, K., Liu, D., Perroud, L., Chavarriaga, R., & Millán, J. D. R. (2016) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2016.10.005 · Cited by 136 · see citing works
Self-citationBCI-Based Rehabilitation on the Stroke in Sequela Stage
Miao, Y., Chen, S., Zhang, X., Jin, J., Xu, R., Daly, I. P., Jia, J., Wang, X., Cichocki, A. S., & Jung, T. (2020) · Neural Plasticity · doi:10.1155/2020/8882764 · Cited by 121 · see citing works
Autonomy infused teleoperation with application to brain computer interface controlled manipulation
Muelling, K., Venkatraman, A., Valois, J., Downey, J. E., Weiss, J. M., Javdani, S., Hebert, M., Schwartz, A. B., Collinger, J. L., & Bagnell, J. A. (2017) · Autonomous Robots · doi:10.1007/s10514-017-9622-4 · Cited by 122 · see citing works
Chowdhury, A., Raza, H., Meena, Y. K., Dutta, A., & Prasad, G. (2018) · Journal of Neuroscience Methods · doi:10.1016/j.jneumeth.2018.11.010 · Cited by 99 · see citing works
Brain-Machine Interfaces: A Tale of Two Learners
Perdikis, S., & Millán, J. D. R. (2020) · IEEE Systems Man and Cybernetics Magazine · doi:10.1109/msmc.2019.2958200 · Cited by 87 · see citing works
Self-citationClinical evaluation of BrainTree, a motor imagery hybrid BCI speller
Perdikis, S., Leeb, R., Williamson, J., Ramsay, A., Tavella, M., Desideri, L., Hoogerwerf, E.-J., Al-Khodairy, A., Murray-Smith, R., & Millán, J. D. R. (2014) · Journal of Neural Engineering · doi:10.1088/1741-2560/11/3/036003 · Cited by 85 · see citing works
Self-citationHybrid Human-Machine Interface for Gait Decoding Through Bayesian Fusion of EEG and EMG Classifiers
Tortora, S., Tonin, L., Chisari, C., Micera, S., Menegatti, E., & Artoni, F. (2020) · Frontiers in Neurorobotics · doi:10.3389/fnbot.2020.582728 · Cited by 74 · see citing works
Self-citationDesign of a Multimodal EEG-based Hybrid BCI System with Visual Servo Module
Duan, F., Lin, D., Li, W., & Zhang, Z. (2015) · IEEE Transactions on Autonomous Mental Development · doi:10.1109/tamd.2015.2434951 · Cited by 75 · see citing works
An in-depth survey on Deep Learning-based Motor Imagery Electroencephalogram (EEG) classification
Wang, X., Liesaputra, V., Liu, Z., Wáng, Y., & Huang, Z. (2023) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2023.102738 · Cited by 74 · see citing works
Brain-computer interfaces in neurologic rehabilitation practice.
Pichiorri, F., & Mattia, D. (2020) · Handbook of Clinical Neurology · doi:10.1016/b978-0-444-63934-9.00009-3 · Cited by 56 · see citing works
Single trial prediction of self-paced reaching directions from EEG signals
Lew, E. Y. L., Chavarriaga, R., Silvoni, S., & Millán, J. D. R. (2014) · Frontiers in Neuroscience · doi:10.3389/fnins.2014.00222 · Cited by 74 · see citing works
Self-citationFacing the challenge: Bringing brain–computer interfaces to end-users
Kübler, A., Donatella Mattia, A., Rupp, R., & Tangermann, M. (2013) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2013.08.002 · Cited by 71 · see citing works
A brain-controlled lower-limb exoskeleton for human gait training
Liu, D., Chen, W., Pei, Z., & Wang, J. (2017) · Review of Scientific Instruments · doi:10.1063/1.5006461 · Cited by 70 · see citing works
Wireless Brain Computer Interface for Smart Home and Medical System
Jafri, S. R. A., Hamid, T., Mahmood, R., Alam, M. A., Rafi, T., Haque, M. Z. U., & Munir, M. W. (2018) · Wireless Personal Communications · doi:10.1007/s11277-018-5932-x · Cited by 71 · see citing works
An autonomous robotic assistant for drinking
Schroer, S., Killmann, I., Frank, B., Volker, M. A., Fiederer, L. D. J., Tonio Ball, A., & Burgard, W. (2015) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2015.7140110 · Cited by 68 · see citing works
Botrel, L., Holz, E. M., & Kübler, A. (2015) · Brain-Computer Interfaces · doi:10.1080/2326263x.2015.1100038 · Cited by 68 · see citing works
Noninvasive Brain–Machine Interfaces for Robotic Devices
Tonin, L., & Millán, J. D. R. (2020) · Annual Review of Control Robotics and Autonomous Systems · doi:10.1146/annurev-control-012720-093904 · Cited by 66 · see citing works
Self-citationTonin, L., Bauer, F. C., & Millán, J. D. R. (2019) · IEEE Transactions on Robotics · doi:10.1109/tro.2019.2943072 · Cited by 64 · see citing works
Self-citationThe effect of multimodal and enriched feedback on SMR-BCI performance
Sollfrank, T., Ramsay, A., Perdikis, S., Williamson, J. H., Murray‐Smith, R., Leeb, R., Millán, J. D. R., & Kübler, A. (2015) · Clinical Neurophysiology · doi:10.1016/j.clinph.2015.06.004 · Cited by 63 · see citing works
Self-citationTelepresence Robots for People with Special Needs: A Systematic Review
Zhang, G., & Hansen, J. P. (2022) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2021.2009673 · Cited by 63 · see citing works
Cajigas, I., Davis, K., Meschede-Krasa, B., Prins, N. W., Gallo, S., Naeem, J., Palermo, A. E., Wilson, A., Guerra, S., Parks, B. A., et al. (2021) · Brain Communications · doi:10.1093/braincomms/fcab248 · Cited by 64 · see citing works
A co-adaptive brain-computer interface for end users with severe motor impairment
Faller, J., Scherer, R., Costa, U., Opisso, E., Medina, J., & Müller-Putz, G. R. (2014) · PLoS ONE · doi:10.1371/journal.pone.0101168 · Cited by 55 · see citing works
Benefits of deep learning classification of continuous noninvasive brain–computer interface control
Stieger, J. R., Engel, S. A., Suma, D., & He, B. (2021) · Journal of Neural Engineering · doi:10.1088/1741-2552/ac0584 · Cited by 55 · see citing works
An Introductory Tutorial on Brain–Computer Interfaces and Their Applications
Bonci, A., Fiori, S., Higashi, H., Tanaka, T., & Verdini, F. (2021) · Electronics · doi:10.3390/electronics10050560 · Cited by 54 · see citing works
Al-Taleb, M., Purcell, M. A., Fraser, M., Petric-Gray, N., & Vučković, A. (2019) · Journal of NeuroEngineering and Rehabilitation · doi:10.1186/s12984-019-0588-7 · Cited by 56 · see citing works
EEG Artifacts Handling in a Real Practical Brain–Computer Interface Controlled Vehicle
Jafarifarmand, A., & Badamchizadeh, M. A. (2019) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2019.2915801 · Cited by 53 · see citing works
Neural signal recording and processing in somatic neuroprosthetic applications. A review
Raspopović, S., Cimolato, A., Panarese, A., Vallone, F., del Valle, J., Micera, S., & Navarro, X. (2020) · Journal of Neuroscience Methods · doi:10.1016/j.jneumeth.2020.108653 · Cited by 51 · see citing works
Liberati, G., Pizzimenti, A., Simione, L., Riccio, A., Schettini, F., Inghilleri, M., Donatella Mattia, A., & Febo Cincotti, A. (2015) · Applied Ergonomics · doi:10.1016/j.apergo.2015.03.012 · Cited by 51 · see citing works
Context-aware adaptive spelling in motor imagery BCI
Perdikis, S., Leeb, R., & Millán, J. D. R. (2016) · Journal of Neural Engineering · doi:10.1088/1741-2560/13/3/036018 · Cited by 49 · see citing works
Self-citationLearning to control a BMI-driven wheelchair for people with severe tetraplegia
Tonin, L., Perdikis, S., Kuzu, T. D., Pardo, J., Orset, B., Lee, K., Aach, M., Schildhauer, T. A., Martínez, R., & Millán, J. D. R. (2022) · iScience · doi:10.1016/j.isci.2022.105418 · Cited by 50 · see citing works
Self-citationGaggioli, A., Ferscha, A., Riva, G., Dunne, S., & Viaud‐Delmon, I. (2015) · doi:10.1515/9783110471137 · Cited by 51 · see citing works
Brain-computer interfaces and virtual reality for neurorehabilitation
Leeb, R., & Pérez-Marcos, D. (2020) · Handbook of clinical neurology · doi:10.1016/b978-0-444-63934-9.00014-7 · Cited by 48 · see citing works
Self-citationBrain-computer interface for workload estimation: Assessment of mental efforts in learning processes
Zammouri, A., Moussa, A. A., & Mebrouk, Y. (2018) · Expert Systems with Applications · doi:10.1016/j.eswa.2018.06.027 · Cited by 47 · see citing works
Transfer learning promotes acquisition of individual BCI skills
Kumar, S., Alawieh, H., Rácz, F. S., Fakhreddine, R., & Millán, J. D. R. (2024) · PNAS Nexus · doi:10.1093/pnasnexus/pgae076 · Cited by 45 · see citing works
Self-citationVecchiato, G., Borghini, G., Aricò, P., Graziani, I., Maglione, A. G., Cherubino, P., & Babiloni, F. (2015) · Medical & Biological Engineering & Computing · doi:10.1007/s11517-015-1420-6 · Cited by 46 · see citing works
Sousa, T., Amaral, C. P., Andrade, J., Pires, G., Nunes, U., & Castelo-Branco, M. S. (2017) · Journal of Neural Engineering · doi:10.1088/1741-2552/aa70ac · Cited by 44 · see citing works
Long-Term Stable Control of Motor-Imagery BCI by a Locked-In User Through Adaptive Assistance
Saeedi, S., Chavarriaga, R., & Millán, J. D. R. (2016) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2016.2645681 · Cited by 43 · see citing works
Self-citationCortical and subcortical mechanisms of brain‐machine interfaces
Marchesotti, S., Martuzzi, R., Schurger, A., Blefari, M. L., Millán, J. D. R., Bleuler, H., & Blanke, O. (2017) · Human Brain Mapping · doi:10.1002/hbm.23566 · Cited by 40 · see citing works
Self-citationThe brain-computer interface researcher’s questionnaire: from research to application
Vansteensel, M. J., Kristo, G., Aarnoutse, E. J., & Ramsey, N. F. (2017) · Brain-Computer Interfaces · doi:10.1080/2326263x.2017.1366237 · Cited by 41 · see citing works
The Riemannian Potato Field: A Tool for Online Signal Quality Index of EEG
Barthélemy, Q., Mayaud, L., Ojeda, D., & Congedo, M. (2019) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2019.2893113 · Cited by 39 · see citing works
Tidoni, E., Gergondet, P., Fusco, G., Kheddar, A., & Aglioti, S. M. (2016) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2016.2597863 · Cited by 39 · see citing works
Brain–Computer Interfaces and Assistive Technology
Rupp, R., Kleih, S. C., Leeb, R., Millán, J. D. R., Kübler, A., & Muller-Putz, G. R. (2014) · The International library of ethics, law and technology · doi:10.1007/978-94-017-8996-7_2 · Cited by 38 · see citing works
Self-citationNeural Speech Decoding During Audition, Imagination and Production
Sharon, R., Narayanan, S. S., Sur, M., & Murthy, A. H. (2020) · IEEE Access · doi:10.1109/access.2020.3016756 · Cited by 35 · see citing works
Pan, H., Ding, P., Wang, F., Li, T., Zhao, L., Nan, W., Fu, Y., & Gong, A. (2024) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2024.1429130 · Cited by 37 · see citing works
Interfacing brain with computer to improve communication and rehabilitation after brain damage
Riccio, A., Pichiorri, F., Schettini, F., Toppi, J., Risetti, M., Formisano, R., Molinari, M., Astolfi, L., Cincotti, F., & Mattia, D. (2016) · Progress in brain research · doi:10.1016/bs.pbr.2016.04.018 · Cited by 36 · see citing works
Semi-Autonomous Robotic Arm Reaching With Hybrid Gaze–Brain Machine Interface
Zeng, H., Shen, Y., Hu, X., Song, A., Xu, B., Li, H., Wang, Y., & Wen, P. (2020) · Frontiers in Neurorobotics · doi:10.3389/fnbot.2019.00111 · Cited by 35 · see citing works
Harnessing Prefrontal Cognitive Signals for Brain–Machine Interfaces
Min, B., Chavarriaga, R., & Millán, J. D. R. (2017) · Trends in biotechnology · doi:10.1016/j.tibtech.2017.03.008 · Cited by 34 · see citing works
Self-citationAdaptive Assistance for Brain-Computer Interfaces by Online Prediction of Command Reliability
Saeedi, S., Chavarriaga, R., Leeb, R., & Millán, J. D. R. (2016) · IEEE Computational Intelligence Magazine · doi:10.1109/mci.2015.2501550 · Cited by 32 · see citing works
Self-citationPerruchoud, D., Pisotta, I., Carda, S., Murray, M. M., & Ionta, S. (2016) · Journal of Neural Engineering · doi:10.1088/1741-2560/13/4/041001 · Cited by 32 · see citing works
Brain-actuated gait trainer with visual and proprioceptive feedback
Liu, D., Chen, W., Lee, K., Chavarriaga, R., Bouri, M., Pei, Z., & Millán, J. D. R. (2017) · Journal of Neural Engineering · doi:10.1088/1741-2552/aa7df9 · Cited by 30 · see citing works
Self-citationOn-scalp printing of personalized electroencephalography e-tattoos
de Vasconcelos, L. S., Yan, Y., Maharjan, P., Kumar, S., Zhang, M., Yao, B., Li, H., Duan, S., Li, E., Williams, E., et al. (2025) · Cell Biomaterials · doi:10.1016/j.celbio.2024.100004 · Cited by 31 · see citing works
Self-citationJochumsen, M., Knoche, H. O., Kidmose, P., Kjær, T. W., & Dinesen, B. (2020) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2020.00013 · Cited by 29 · see citing works
Shared Intelligence for Robot Teleoperation via BMI
Beraldo, G., Tonin, L., Millán, J. D. R., & Menegatti, E. (2022) · IEEE Transactions on Human-Machine Systems · doi:10.1109/thms.2021.3137035 · Cited by 29 · see citing works
Self-citationDecoding covert visual attention based on phase transfer entropy
Ahmadi, A., Davoudi, S., Behroozi, M., & Daliri, M. R. (2020) · Physiology & Behavior · doi:10.1016/j.physbeh.2020.112932 · Cited by 28 · see citing works
Davis, K., Meschede-Krasa, B., Cajigas, I., Prins, N. W., Alver, C. G., Gallo, S., Bhatia, S., Abel, J. H., Naeem, J., Fisher, L., et al. (2022) · Journal of NeuroEngineering and Rehabilitation · doi:10.1186/s12984-022-01026-2 · Cited by 29 · see citing works
Brain–computer interfacing under distraction: an evaluation study
Brandl, S., Frølich, L., Höhne, J., Müller, K., & Samek, W. (2016) · Journal of Neural Engineering · doi:10.1088/1741-2560/13/5/056012 · Cited by 26 · see citing works
ROS-Neuro: An Open-Source Platform for Neurorobotics
Tonin, L., Beraldo, G., Tortora, S., & Menegatti, E. (2022) · Frontiers in Neurorobotics · doi:10.3389/fnbot.2022.886050 · Cited by 26 · see citing works
Self-citationJeunet, C., Tonin, L., Albert, L., Chavarriaga, R., Bideau, B., Argelaguet, F., Millán, J. D. R., Lécuyer, A., & Kulpa, R. (2020) · Scientific Reports · doi:10.1038/s41598-020-58533-2 · Cited by 25 · see citing works
Self-citationHearing the needs of clinical users
Kübler, A., Nijboer, F., & Kleih, S. C. (2020) · Handbook of clinical neurology · doi:10.1016/b978-0-444-63934-9.00026-3 · Cited by 25 · see citing works
Noninvasive EEG-Based Intelligent Mobile Robots: A Systematic Review
Li, H., Li, X., & Millán, J. D. R. (2024) · IEEE Transactions on Automation Science and Engineering · doi:10.1109/tase.2024.3441055 · Cited by 24 · see citing works
Self-citationA hybrid three-class brain–computer interface system utilizing SSSEPs and transient ERPs
Breitwieser, C., Pokorny, C., & Muller-Putz, G. R. (2016) · Journal of Neural Engineering · doi:10.1088/1741-2560/13/6/066015 · Cited by 24 · see citing works
EEG-based Control of a 3D Game Using 14-channel Emotiv Epoc+
Malete, T. N., Moruti, K., Thapelo, T. S., & Jamisola, R. S. (2019) · IEEE Conference on Cybernetics and Intelligent Systems · doi:10.1109/cis-ram47153.2019.9095807 · Cited by 24 · see citing works
Jochumsen, M., Janjua, T. A. M., Arceo, J. C., Lauber, J., Simoneau-Buessinger, É., & Kæseler, R. L. (2021) · Sensors · doi:10.3390/s21020572 · Cited by 24 · see citing works
Feasibility of Reconstructing Source Functional Connectivity with Low-Density EEG
Nguyen-Danse, D. A., Singaravelu, S., Chauvigné, L. A. S., Mottaz, A., Allaman, L., & Guggisberg, A. G. (2021) · Brain Topography · doi:10.1007/s10548-021-00866-w · Cited by 24 · see citing works
Steyrl, D., Kobler, R. J., & Muller-Putz, G. R. (2016) · Journal of Biomedical Science and Engineering · doi:10.4236/jbise.2016.98034 · Cited by 23 · see citing works
An EEG-based brain-computer interface for gait training
Liu, D., Chen, W., Lee, K., Pei, Z., & Millán, J. D. R. (2017) · Chinese Control and Decision Conference (CCDC) · doi:10.1109/ccdc.2017.7978394 · Cited by 22 · see citing works
Self-citationOptimization of Tongue Gesture Processing Algorithm for Standalone Multimodal Tongue Drive System
Sahadat, M. N., Sebkhi, N., Anderson, D. V., & Ghovanloo, M. (2018) · IEEE Sensors Journal · doi:10.1109/jsen.2018.2887257 · Cited by 22 · see citing works
Self-Paced Online vs. Cue-Based Offline Brain–Computer Interfaces for Inducing Neural Plasticity
Jochumsen, M., Navid, M. S., Nedergaard, R. B., Signal, N., Rashid, U., Hassan, A., Haavik, H., Taylor, D., & Niazi, I. (2019) · Brain Science · doi:10.3390/brainsci9060127 · Cited by 17 · see citing works
Tidoni, E., Tieri, G., & Aglioti, S. M. (2015) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2015.06.029 · Cited by 20 · see citing works
Brain-Machine Interfaces: The Perception-Action Closed Loop: A Two-Learner System
Millan, J. D. R. (2015) · IEEE Systems, Man, and Cybernetics Magazine · doi:10.1109/msmc.2014.2386901 · Cited by 19 · see citing works
General principles of machine learning for brain-computer interfacing
Iturrate, I., Chavarriaga, R., & Millán, J. D. R. (2020) · Handbook of clinical neurology · doi:10.1016/b978-0-444-63934-9.00023-8 · Cited by 22 · see citing works
Self-citationUse of cognitive load measurements to design a new architecture of intelligent learning systems
Zammouri, A., Moussa, A. A., & Chevallier, S. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.121253 · Cited by 18 · see citing works
Cioffi, E., Hutber, A., Molloy, R., Murden, S., Yurkewich, A., Kirton, A., Lin, J., Gimeno, H., & McClelland, V. M. (2024) · Clinical Neurophysiology · doi:10.1016/j.clinph.2024.08.009 · Cited by 19 · see citing works
Workshops of the eighth international brain–computer interface meeting: BCIs: the next frontier
Huggins, J. E., Krusienski, D. J., Vansteensel, M. J., Valeriani, D., Thelen, A., Stavisky, S. D., Norton, J. J. S., Nijholt, A., Muller-Putz, G. R., Kosmyna, N., et al. (2022) · Brain-Computer Interfaces · doi:10.1080/2326263x.2021.2009654 · Cited by 17 · see citing works
An Independent Tongue-Operated Assistive System for Both Access and Mobility
Sahadat, M. N., Dighe, S., Islam, F. Z., & Ghovanloo, M. (2018) · IEEE Sensors Journal · doi:10.1109/jsen.2018.2870750 · Cited by 17 · see citing works
Deep Convolutional Neural Network for EEG-Based Motor Decoding
Zhang, J., Liu, D., Chen, W., Pei, Z., & Wang, J. (2022) · Micromachines · doi:10.3390/mi13091485 · Cited by 16 · see citing works
Post-Adaptation Effects in a Motor Imagery Brain-Computer Interface Online Coadaptive Paradigm
Cunha, J. D., Perdikis, S., Halder, S., & Scherer, R. (2021) · IEEE Access · doi:10.1109/access.2021.3064226 · Cited by 16 · see citing works
Self-citationHougaard, B. I., Rossau, I. G., Czapla, J. J., Mikó, M. A., Skammelsen, R. B., Knoche, H. O., & Jochumsen, M. (2021) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3474662 · Cited by 16 · see citing works
Subject-oriented training for motor imagery brain-computer interfaces
Perdikis, S., Leeb, R., & Millán, J. D. R. (2014) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc.2014.6943826 · Cited by 15 · see citing works
Self-citationROS-Neuro: A common middleware for BMI and robotics. The acquisition and recorder packages
Tonin, L., Beraldo, G., Tortora, S., Tagliapietra, L., Millán, J. D. R., & Menegatti, E. (2019) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/smc.2019.8914364 · Cited by 16 · see citing works
Self-citationPeople with Motor Disabilities Using Gaze to Control Telerobots
Zhang, G., & Hansen, J. P. (2020) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3334480.3382939 · Cited by 16 · see citing works
Grevet, E., Forge, K., Tadiello, S., Izac, M., Amadieu, F., Brunel, L. C., Pillette, L., Py, J., Gasq, D., & Jeunet, C. (2023) · Frontiers in Neuroergonomics · doi:10.3389/fnrgo.2022.1082901 · Cited by 15 · see citing works
Rácz, F. S., Kumar, S., Kaposzta, Z., Alawieh, H., Liu, D. H., Liu, R., Czoch, A., Mukli, P., & Millán, J. D. R. (2024) · Frontiers in Neuroscience · doi:10.3389/fnins.2024.1271831 · Cited by 14 · see citing works
Self-citationPlug&Play Brain–Computer Interfaces for effective Active and Assisted Living control
Mora, N., Munari, I. D., Ciampolini, P., & Millán, J. D. R. (2016) · Medical & Biological Engineering & Computing · doi:10.1007/s11517-016-1596-4 · Cited by 15 · see citing works
Self-citationCortical neuroprosthetics from a clinical perspective
Tsu, A., Burish, M. J., Godlove, J. M., & Ganguly, K. (2015) · Neurobiology of Disease · doi:10.1016/j.nbd.2015.07.015 · Cited by 15 · see citing works
Pignat, J., Jöhr, J., & Diserens, K. (2015) · Current Opinion in Neurology · doi:10.1097/wco.0000000000000264 · Cited by 15 · see citing works
Tabti, K., Elmchichi, L., Sbai, A., Maghat, H., Bouachrıne, M., & Lakhlifi, T. (2022) · Chemistry Africa · doi:10.1007/s42250-022-00484-4 · Cited by 14 · see citing works
Brain waves-based index for workload estimation and mental effort engagement recognition
Zammouri, A., Mesbahi, S. C., Moussa, A. A., Zerouali, S., Sahnoun, M., Tairi, H., & Mahraz, M. A. (2017) · Journal of Physics Conference Series · doi:10.1088/1742-6596/904/1/012008 · Cited by 14 · see citing works
EEG-Based Brain–Computer Interfaces
Pfurtscheller, G., Brunner, C., & Neuper, C. (2017) · Oxford University Press eBooks · doi:10.1093/med/9780190228484.003.0047 · Cited by 14 · see citing works
Leeb, R., Biasiucci, A., Schmidlin, T., Corbet, T., & Millán, J. D. R. (2020) · Infoscience (Ecole Polytechnique Fédérale de Lausanne) · doi:10.3217/978-3-85125-467-9-108 · Cited by 13 · see citing works
Self-citationDesign and Implementation of an Asynchronous BCI System With Alpha Rhythm and SSVEP
Zhang, L., Wu, X., Guo, X., Liu, J., & Zhou, B. (2019) · IEEE Access · doi:10.1109/access.2019.2946301 · Cited by 13 · see citing works
Quantifying Electrode Reliability During Brain–Computer Interface Operation
Sagha, H., Perdikis, S., Millán, J. D. R., & Chavarriaga, R. (2014) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2014.2366554 · Cited by 12 · see citing works
Self-citationExploitation of a compact, cost-effective EEG module for plug-and-play, SSVEP-based BCI
Mora, N., Munari, I. D., & Ciampolini, P. (2015) · International IEEE/EMBS Conference on Neural Engineering · doi:10.1109/ner.2015.7146580 · Cited by 11 · see citing works
- Authors
- Leeb, R., Perdikis, S., Tonin, L., Biasiucci, A., Tavella, M., Creatura, M., Molina, A., Al-Khodairy, A., Carlson, T., & Millán, J. D. R.
- Affiliations
- École Polytechnique Fédérale de Lausanne (CH)
- Clinique Romande de Réadaptation (CH)
- Corresponding author
- Leeb, Robert
- Venue
- Artificial Intelligence in Medicine
- Publisher
- Elsevier BV
- Published
- 2013-10
- Volume
- 59
- Issue
- 2
- Pages
- 121-132
- ISSN
- 0933-3657 (ISSN-L)
- OpenAlex
- W1999296691
- Cited by
- 166
- References
- 49
- Citations by year
- 2026: 5 · 2025: 9 · 2024: 12 · 2023: 7 · 2022: 14 · 2021: 9 · 2020: 20 · 2019: 11 · 2018: 11 · 2017: 12 · 2016: 17 · 2015: 21 · 2014: 14 · 2013: 4
- FWCI
- 10.20
- Type
- journal article
- Language
- en
- Open access
- green
- infoscience.epfl.ch
- Locations
- Artificial Intelligence in Medicine (publishedVersion)
- PubMed (publishedVersion)
- UCL Discovery (University College London) (submittedVersion)
- Infoscience (Ecole Polytechnique Fédérale de Lausanne) (submittedVersion)
- Infoscience (Ecole Polytechnique Fédérale de Lausanne) (submittedVersion, cc-by-nc-nd)
- Padua Research Archive (University of Padova) (submittedVersion)
- Funders
- European ICT programme project TOBI: Tools for Brain-Computer Interaction
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › EEG and Brain-Computer Interfaces
- Physical Sciences › Computer Science › Human-Computer Interaction › Gaze Tracking and Assistive Technology
- Health Sciences › Medicine › Rehabilitation › Stroke Rehabilitation and Recovery
- Keywords
- brain-computer interface, motor impairment, assistive technology, end-user training, technology transfer, rehabilitation centers, user feedback, BCI performance
- MeSH terms
- Adult, Electroencephalography, Female, Persons with Disabilities, Humans, Male, Middle Aged, Paralysis, Brain-Computer Interfaces
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
