The DOI matches its Crossref record; 50 of the 51 references it cites were found in a registry or an index.
Brain-computer interface controlled gaming: Evaluation of usability by severely motor restricted end-users
Open accessAbstract
Objective Connect-Four, a new sensorimotor rhythm (SMR) based brain-computer interface (BCI) gaming application, was evaluated by four severely motor restricted end-users; two were in the locked-in state and had unreliable eye-movement.Methods Following the user-centred approach, usability of the BCI prototype was evaluated in terms of effectiveness (accuracy), efficiency (information transfer rate (ITR) and subjective workload) and users' satisfaction.Results Online performance varied strongly across users and sessions (median accuracy (%) of end-users: A=.65; B=.60; C=.47; D=.77). Our results thus yielded low to medium effectiveness in three end-users and high effectiveness in one end-user. Consequently, ITR was low (0.05-1.44bits/min). Only two end-users were able to play the game in free-mode. Total workload was moderate but varied strongly across sessions. Main sources of workload were mental and temporal demand. Furthermore, frustration contributed to the subjective workload of two end-users. Nevertheless, most end-users accepted the BCI application well and rated satisfaction medium to high. Sources for dissatisfaction were (1) electrode gel and cap, (2) low effectiveness, (3) time-consuming adjustment and (4) not easy-to-use BCI equipment. All four end-users indicated ease of use as being one of the most important aspect of BCI.Conclusion Effectiveness and efficiency are lower as compared to applications using the event-related potential as input channel. Nevertheless, the SMR-BCI application was satisfactorily accepted by the end-users and two of four could imagine using the BCI application in their daily life. Thus, despite moderate effectiveness and efficiency BCIs might be an option when controlling an application for entertainment.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Indeed, mutual learning has been claimed mostly on the grounds of adequate and improved BCI classification accuracy [25,27,30–35] or application performances [36,37].”
From The Cybathlon BCI race: Successful longitudinal mutual learning with two tetraplegic users (2018) · cites this paper as [33]
In the citing paper
“Evidence that co-adaptive MI BCIs might also be able to promote and increase the ability of the users to voluntary modulate their brain signals (subject learning) is, in fact, scarce, most often indirect and rather inconclusive.”
From The Cybathlon BCI race: Successful longitudinal mutual learning with two tetraplegic users (2018) · cites this paper as [33]
In the citing paper
“Secondly, other training studies claim learnability in BCIs only on the grounds of improved online classification accuracy [9,27,30,31,33,35,51] or application performances [36,37].”
From The Cybathlon BCI race: Successful longitudinal mutual learning with two tetraplegic users (2018) · cites this paper as [33]
Citations
Cites
The CES-D Scale: A Self-Report Depression Scale for Research in the General Population
Radloff, L. S. (1977) · Applied Psychological Measurement · doi:10.1177/014662167700100306 · Cited by 53,267
Brain–computer interfaces for communication and control
Wolpaw, J. R., Birbaumer, N., McFarland, D. J., Pfurtscheller, G., & Vaughan, T. M. (2002) · Clinical Neurophysiology · doi:10.1016/s1388-2457(02)00057-3 · Cited by 7,927
Event-related EEG/MEG synchronization and desynchronization: basic principles
Pfurtscheller, G., & Lopes da Silva, F. H. (1999) · Clinical Neurophysiology · doi:10.1016/s1388-2457(99)00141-8 · Cited by 7,328
Optimizing Spatial filters for Robust EEG Single-Trial Analysis
Blankertz, B., Tomioka, R., Lemm, S., Kawanabe, M., & Muller, K.-R. (2008) · IEEE Signal Processing Magazine · doi:10.1109/msp.2008.4408441 · Cited by 2,080
Neuromorphic Silicon Neuron Circuits
Indiveri, G., Linares-Barranco, B., Hamilton, T. J., André, V. S., Etienne‐Cummings, R., Delbrück, T., Liu, S., Dudek, P., Hafliger, P. D., Renaud, S., et al. (2011) · Frontiers in Neuroscience · doi:10.3389/fnins.2011.00073 · Cited by 1,836
Single-trial analysis and classification of ERP components — A tutorial
Blankertz, B., Lemm, S., Treder, M., Haufe, S., & Müller, K.-R. (2011) · NeuroImage · doi:10.1016/j.neuroimage.2010.06.048 · Cited by 1,138
Brain–Computer InterfacesPrinciples and Practice
Wolpaw, J. R., & Wolpaw, E. W. (2012) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780195388855.001.0001 · Cited by 1,134
A comparison of classification techniques for the P300 Speller
Krusienski, D. J., Sellers, E. W., Cabestaing, F., Bayoudh, S., McFarland, D. J., Vaughan, T. M., & Wolpaw, J. R. (2006) · Journal of Neural Engineering · doi:10.1088/1741-2560/3/4/007 · Cited by 762
A P300-based brain–computer interface for people with amyotrophic lateral sclerosis
Nijboer, F., Sellers, E. W., Mellinger, J., Jordan, M. A., Matuz, T., Furdea, A., Halder, S., Mochty, U., Krusienski, D. J., Vaughan, T. M., et al. (2008) · Clinical Neurophysiology · doi:10.1016/j.clinph.2008.03.034 · Cited by 633
Self-citationBrain-computer communication: Unlocking the locked in.
Kübler, A., Kotchoubey, B., Kaiser, J., Wolpaw, J. R., & Birbaumer, N. (2001) · Psychological Bulletin · doi:10.1037/0033-2909.127.3.358 · Cited by 565
Self-citationPatients with ALS can use sensorimotor rhythms to operate a brain-computer interface
Kübler, A., Nijboer, F., Mellinger, J., Vaughan, T. M., Pawelzik, H., Schalk, G., McFarland, D. J., Birbaumer, N., & Wolpaw, J. R. (2005) · Neurology · doi:10.1212/01.wnl.0000158616.43002.6d · Cited by 539
Self-citationKübler, A., & Birbaumer, N. (2008) · Clinical Neurophysiology · doi:10.1016/j.clinph.2008.06.019 · Cited by 441
Self-citation(1993) · Beltz eBooks · Cited by 409
A brain-computer interface for long-term independent home use
Sellers, E. W., Vaughan, T. M., & Wolpaw, J. R. (2010) · Amyotrophic Lateral Sclerosis · doi:10.3109/17482961003777470 · Cited by 400
Brain-computer communication: Self-regulation of slow cortical potentials for verbal communication
Kübler, A., Neumann, N., Kaiser, J., Kotchoubey, B., Hinterberger, T., & Birbaumer, N. (2001) · Archives of Physical Medicine and Rehabilitation · doi:10.1053/apmr.2001.26621 · Cited by 359
Self-citationPiccione, F., Giorgi, F., Tonin, P., Priftis, K., Giove, S., Silvoni, S., Palmas, G., & Beverina, F. (2006) · Clinical Neurophysiology · doi:10.1016/j.clinph.2005.07.024 · Cited by 331
Nijboer (2010) · Frontiers in Neuroscience · doi:10.3389/fnins.2010.00055 · Cited by 323
Flashing characters with famous faces improves ERP-based brain–computer interface performance
Kaufmann, T., Schulz, S. M., Grünzinger, C., & Kübler, A. (2011) · Journal of Neural Engineering · doi:10.1088/1741-2560/8/5/056016 · Cited by 308
Self-citationAdaptation to changing health: Response shift in quality-of-life research.
(2000) · American Psychological Association eBooks · doi:10.1037/10382-000 · Cited by 301
Bruno, M., Bernheim, J., Ledoux, D., Pellas, F., Athena Demertzi, A., & Laureys, S. (2011) · BMJ Open · doi:10.1136/bmjopen-2010-000039 · Cited by 225
Machine-learning-based coadaptive calibration for brain-computer interfaces
Vidaurre, C., Sannelli, C., Müller, K.-R., & Blankertz, B. (2011) · Neural Computation · doi:10.1162/neco_a_00089 · Cited by 207
Brain–Computer Interfaces: Something New under the Sun
Wolpaw, J. R., & Wolpaw, E. W. (2012) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780195388855.003.0001 · Cited by 198
Mak, J. N., Arbel, Y., Minett, J. W., McCane, L. M., Yuksel, B. F., Ryan, D. B., Thompson, D. E., Bianchi, L., & Deniz Erdogmus, B. (2011) · Journal of Neural Engineering · doi:10.1088/1741-2560/8/2/025003 · Cited by 195
Mugler, E. M., Ruf, C. A., Halder, S., Bensch, M., & Kübler, A. (2010) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2010.2068059 · Cited by 181
Self-citationMuenssinger, J., Halder, S., Kleih, S. C., Furdea, A., Raco, V., Hösle, A., & Kübler, A. (2010) · Frontiers in Neuroscience · doi:10.3389/fnins.2010.00182 · Cited by 175
Self-citationBrain-Computer Interfacing and Games
Bos, D., Reuderink, B., van de Laar, B. V. D., Gürkök, H., Mühl, C., Poel, M., Nijholt, A., & Heylen, D. (2010) · Brain-Computer Interfaces · doi:10.1007/978-1-84996-272-8_10 · Cited by 175
A novel 9-class auditory ERP paradigm driving a predictive text entry system
Höhne, J. (2011) · Frontiers in Neuroscience · doi:10.3389/fnins.2011.00099 · Cited by 164
Self-citationTowards Practical Brain-Computer Interfaces
Allison, B. Z., Dunne, S., Leeb, R., Millán, J. D. R., Allison, B. Z., Dunne, S., Leeb, R., Millán, J. D. R., & Nijholt, A. (2012) · Biological and medical physics series · doi:10.1007/978-3-642-29746-5 · Cited by 163
A Brain-Computer Interface as Input Channel for a Standard Assistive Technology Software
Zickler, C., Riccio, A., Leotta, F., Hillian-Tress, S., Halder, S., Holz, E. M., Staiger-Sälzer, P., Hoogerwerf, E.-J., Desideri, L., Mattia, D., et al. (2011) · Clinical EEG and Neuroscience · doi:10.1177/155005941104200409 · Cited by 159
Self-citationKaufmann, T., Schulz, S. M., Köblitz, A., Renner, G., Wessig, C., & Kübler, A. (2012) · Clinical Neurophysiology · doi:10.1016/j.clinph.2012.11.006 · Cited by 154
Self-citationZickler, C., Halder, S., Kleih, S. C., Herbert, C., & Kübler, A. (2013) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2013.08.003 · Cited by 132
Self-citationPersonal Values and Individual Quality of Life in Palliative Care Patients
Fegg, M. J., Wasner, M., Neudert, C., & Borasio, G. D. (2005) · Journal of Pain and Symptom Management · doi:10.1016/j.jpainsymman.2005.02.012 · Cited by 106
Barriers to and mediators of brain–computer interface user acceptance: focus group findings
Blain‐Moraes, S., Schaff, R., Gruis, K. L., Huggins, J. E., & Wren, P. A. (2012) · Ergonomics · doi:10.1080/00140139.2012.661082 · Cited by 102
Jin, J., Allison, B. Z., Wang, X., & Neuper, C. (2012) · Journal of Neuroscience Methods · doi:10.1016/j.jneumeth.2012.01.004 · Cited by 94
Riccio, A., Leotta, F., Bianchi, L., Aloise, F., Zickler, C., Hoogerwerf, E.-J., Kübler, A., Donatella Mattia, A., & Febo Cincotti, A. (2011) · Journal of Neural Engineering · doi:10.1088/1741-2560/8/2/025028 · Cited by 89
Self-citationComparison of instruments addressing quality of life in patients with ALS and their caregivers
Bromberg, M. B., & Forshew, D. A. (2002) · Neurology · doi:10.1212/wnl.58.2.320 · Cited by 86
Silvoni, S. (2009) · Frontiers in Neuroscience · doi:10.3389/neuro.20.001.2009 · Cited by 85
Training locked-in patients: a challenge for the use of brain-computer interfaces
Neumann, N., & Kübler, A. (2003) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2003.814431 · Cited by 83
Self-citationBernheim, J., & Buyse, M. E. (1983) · Journal of Psychosocial Oncology · doi:10.1300/j077v01n04_03 · Cited by 77
Walking toward a convergence in aging research
Smith, M. A. (2009) · Frontiers in Neuroscience · doi:10.3389/neuro.01.012.2009 · Cited by 67
Natural stimuli improve auditory BCIs with respect to ergonomics and performance
Höhne, J., Krenzlin, K., Dähne, S., & Tangermann, M. (2012) · Journal of Neural Engineering · doi:10.1088/1741-2560/9/4/045003 · Cited by 61
Self-citationBCI Applications for People with Disabilities: Defining User Needs and User Requirements
Zickler, C., Donna, V. D., Kaiser, V., Al-Khodairy, A., Kleih, S. C., Andrea, K., Malavasi, M., Donatella Mattia, A., Mongardi, S., Neuper, C., et al. (2009) · IOS Press eBooks · doi:10.3233/978-1-60750-042-1-185 · Cited by 55
Weiss‐Lambrou, R. (2000) · Cited by 43
Optimized stimulation events for a visual ERP BCI
Tangermann, M., Schreuder, M., Dähne, J., Regler, S., Ramsay, A., Quek, M., Williamson, J. H., & Murray‐Smith, R. (2011) · Cited by 34
Self-citationEthical Issues in BCI Research
Schneider, M.-J., Fins, J. J., & Wolpaw, J. R. (2012) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780195388855.003.0024 · Cited by 31
Measuring response shift using the Schedule for Evaluation of Individual Quality of Life.
O’Boyle, C. A., McGee, H. M., & Browne, J. P. (2000) · American Psychological Association eBooks · doi:10.1037/10382-008 · Cited by 24
The SEIQoL and functional status: how do they relate?
Lhussier, M., Watson, B., Reed, J., & Clarke, C. L. (2005) · Scandinavian Journal of Caring Sciences · doi:10.1111/j.1471-6712.2005.00362.x · Cited by 23
Vision-Based Shared Control for a BCI Wheelchair
Carlson, T., Monnard, G., & Millán, J. D. R. (2011) · Infoscience (Ecole Polytechnique Fédérale de Lausanne) · Cited by 20
User Centred Design in BCI Development
Holz, E. M., Kaufmann, T., Desideri, L., Malavasi, M., Hoogerwerf, E.-J., & Kübler, A. (2012) · Biological and medical physics series · doi:10.1007/978-3-642-29746-5_8 · Cited by 19
Self-citationBrain-computer interfacing: science fiction has come true
Kübler, A. (2013) · Brain · doi:10.1093/brain/awt077 · Cited by 15
Self-citation
Cited by
Sorted by citations
Rashid, M., Sulaiman, N., Majeed, A. P. P. A., Musa, R. M., Nasir, A. F. A., Bari, B. S., & Khatun, S. (2020) · Frontiers in Neurorobotics · doi:10.3389/fnbot.2020.00025 · Cited by 545
Simon, N., Käthner, I., Ruf, C. A., Pasqualotto, E., Kübler, A., & Halder, S. (2015) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2014.01039 · Cited by 478
Self-citationLazarou, I., Nikolopoulos, S., Petrantonakis, P. C., Kompatsiaris, I. Y., & Tsolaki, M. (2018) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2018.00014 · Cited by 351
Käthner, I., Wriessnegger, S. C., Muller-Putz, G. R., Kübler, A., & Halder, S. (2014) · Biological Psychology · doi:10.1016/j.biopsycho.2014.07.014 · Cited by 332
Self-citationNoninvasive Brain-Computer Interfaces Based on Sensorimotor Rhythms
He, B., Baxter, B., Edelman, B. J., Cline, C. C., & Ye, W. W. (2015) · Proceedings of the IEEE · doi:10.1109/jproc.2015.2407272 · Cited by 233
Metadata
- Authors
- Holz, E. M., Höhne, J., Staiger-Sälzer, P., Tangermann, M., & Kübler, A.
- Affiliations
- University of Würzburg (DE)
- Technische Universität Berlin (DE)
- University of Freiburg (DE)
- Corresponding author
- Holz, Elisa Mira
- Venue
- Artificial Intelligence in Medicine
- Publisher
- Elsevier BV
- Published
- 2013-10
- Volume
- 59
- Issue
- 2
- Pages
- 111-120
- ISSN
- 0933-3657 (ISSN-L)
- OpenAlex
- W2077189121
- Cited by
- 111
- References
- 51
- Citations by year
- 2026: 2 · 2025: 3 · 2024: 9 · 2023: 12 · 2022: 5 · 2021: 10 · 2020: 9 · 2019: 5 · 2018: 5 · 2017: 6 · 2016: 8 · 2015: 23 · 2014: 12 · 2013: 2
- FWCI
- 8.23
- Type
- journal article
- Language
- en
- Open access
- green
- zenodo.org
- Licence
- Locations
- Artificial Intelligence in Medicine (publishedVersion)
- PubMed (publishedVersion)
- Zenodo (CERN European Organization for Nuclear Research) (submittedVersion, other-oa)
- Funders
- European ICT Programme (FP7-224631)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › EEG and Brain-Computer Interfaces
- Physical Sciences › Computer Science › Human-Computer Interaction › Gaze Tracking and Assistive Technology
- Health Sciences › Medicine › Rehabilitation › Stroke Rehabilitation and Recovery
- Keywords
- brain-computer interface, sensorimotor rhythm, usability evaluation, locked-in syndrome, information transfer rate, perceived workload, user satisfaction, Connect Four, event-related potentials, assistive technology
- MeSH terms
- Humans, Middle Aged, Paralysis, Severity of Illness Index, Patient Satisfaction, Brain-Computer Interfaces
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
