Recommendations for promoting user agency in the design of speech neuroprostheses
The DOI matches its Crossref record; 16 of the 16 references it cites were found in a registry or an index.
Abstract
Brain-computer interfaces (BCI) that directly decode speech from brain activity aim to restore communication in people with paralysis who cannot speak. Despite recent advances, neural inference of speech remains imperfect, limiting the ability for speech BCIs to enable experiences such as fluent conversation that promote agency – that is, the ability for users to author and transmit messages enacting their intentions. Here, we make recommendations for promoting agency based on existing and emerging strategies in neural engineering. The focus is on achieving fast, accurate, and reliable performance while ensuring volitional control over when a decoder is engaged, what exactly is decoded, and how messages are expressed. Additionally, alongside neuroscientific progress within controlled experimental settings, we argue that a parallel line of research must consider how to translate experimental successes into real-world environments. While such research will ultimately require input from prospective users, here we identify and describe design choices inspired by human-factors work conducted in existing fields of assistive technology, which address practical issues likely to emerge in future real-world speech BCI applications.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Natural speech reveals the semantic maps that tile human cerebral cortex
Huth, A. G., de Heer, W. A., Griffiths, T. L., Theunissen, F. E., & Gallant, J. L. (2016) · Nature · doi:10.1038/nature17637 · Cited by 1,504
High-performance brain-to-text communication via handwriting
Willett, F. R., Avansino, D. T., Hochberg, L. R., Henderson, J. M., & Shenoy, K. V. (2021) · Nature · doi:10.1038/s41586-021-03506-2 · Cited by 1,024
Speech synthesis from neural decoding of spoken sentences
Anumanchipalli, G. K., Chartier, J., & Chang, E. F. (2019) · Nature · doi:10.1038/s41586-019-1119-1 · Cited by 883
Self-citationComputational neuroanatomy of speech production
Hickok, G. (2012) · Nature Reviews Neuroscience · doi:10.1038/nrn3158 · Cited by 837
Neuroprosthesis for Decoding Speech in a Paralyzed Person with Anarthria
Moses, D. A., Metzger, S. L., Liu, J. R., Anumanchipalli, G. K., Makin, J. G., Sun, P. F., Chartier, J., Dougherty, M. E., Liu, P. M., Abrams, G. M., et al. (2021) · New England Journal of Medicine · doi:10.1056/nejmoa2027540 · Cited by 582
Self-citationA high-performance speech neuroprosthesis
Willett, F. R., Kunz, E. M., Fan, C., Avansino, D. T., Wilson, G. H., Choi, E. Y., Kamdar, F., Glasser, M. F., Hochberg, L. R., Druckmann, S., et al. (2023) · Nature · doi:10.1038/s41586-023-06377-x · Cited by 581
Semantic reconstruction of continuous language from non-invasive brain recordings
Tang, J., LeBel, A., Jain, S., & Huth, A. G. (2023) · Nature Neuroscience · doi:10.1038/s41593-023-01304-9 · Cited by 442
Brain-to-text: decoding spoken phrases from phone representations in the brain
Herff, C., Heger, D., de Pesters, A., Telaar, D., Brunner, P., Schalk, G., & Schultz, T. (2015) · Frontiers in Neuroscience · doi:10.3389/fnins.2015.00217 · Cited by 297 · cited 1×
“…the majority of speech-BCI research has focused on decoding low-level articulatory and phonological signals within sensorimotor and auditory regions of the cortex (Martin et al., 2014; Herff et al., 2015; Ramsey et al., 2018; Anumanchipalli et al., 2019; Moses et al., 2021; Proix et al., 2022).”
BackgroundHuggins, J. E., Wren, P. A., & Gruis, K. L. (2011) · Amyotrophic Lateral Sclerosis · doi:10.3109/17482968.2011.572978 · Cited by 215
Imagined speech can be decoded from low- and cross-frequency intracranial EEG features
Proix, T., Delgado Saa, J., Christen, A., Martin, S., Pasley, B. N., Knight, R. T., Tian, X., Poeppel, D., Doyle, W. K., Devinsky, O., et al. (2022) · Nature Communications · doi:10.1038/s41467-021-27725-3 · Cited by 212
Research works printed but not linked: 25
- Beukelman, 2007, AAC for adults with acquired neurological conditions: a review, Augment. Altern. Commun., 23, 230, 10.1080/07434610701553668 · DOI · Paper page
- Boy, 2017, The handbook of human-machine interaction: a human-centered design approach, 10.1201/9781315557380 · doi:10.1201/9781315557380
- Brumberg, 2016, Spatio-temporal progression of cortical activity related to continuous overt and covert speech production in a Reading task, PLoS One, 11, e0166872, 10.1371/journal.pone.0166872 · DOI
- Chandler, 2021, Building communication Neurotechnology for high stakes communications, Nat. Rev. Neurosci., 22, 587, 10.1038/s41583-021-00517-w · DOI
- Dash, 2020, NeuroVAD: real-time voice activity detection from non-invasive Neuromagnetic signals, Sensors, 20, 2248, 10.3390/s20082248 · DOI
- Goering, 2021, Neurotechnology ethics and relational agency, Philos Compass, 16, e12734, 10.1111/phc3.12734 · DOI
- Hill, 2021, Interprofessional practitioners’ opinions on features and services for an augmentative and alternative communication brain-computer interface device, PM R, 13, 1111, 10.1002/pmrj.12525 · DOI
- Hurtig, 2019, Improving patient safety and patient-provider communication, Perspect. ASHA Spec. Interest Groups, 4, 1017, 10.1044/2019_persp-19-00134 · DOI
- Johnson, 2006, Perspectives of speech language pathologists regarding success versus abandonment of AAC, Augment. Altern. Commun., 22, 85, 10.1080/07434610500483588 · DOI · Paper page
- Linse, 2018, Communication matters—pitfalls and promise of Hightech communication devices in palliative Care of Severely Physically Disabled Patients with Amyotrophic Lateral Sclerosis, Front. Neurol., 9, 603, 10.3389/fneur.2018.00603 · DOI
- Maslen, 2021, Control and ownership of neuroprosthetic speech, Philos. Technol., 34, 425, 10.1007/s13347-019-00389-0 · DOI
- Metzger, 2023, A high-performance neuroprosthesis for speech decoding and avatar control, Nature, 620, 1037, 10.1038/s41586-023-06443-4 · DOI · Paper page
- Metzger, 2022, Generalizable spelling using a speech neuroprosthesis in an individual with severe limb and vocal paralysis, Nat. Commun., 13, 6510, 10.1038/s41467-022-33611-3 · DOI · Paper page
- Moorcroft, 2019, A systematic review of the barriers and facilitators to the provision and use of low-tech and unaided AAC Systems for People with complex communication needs and their families, Disabil. Rehabil. Assist. Technol., 14, 710, 10.1080/17483107.2018.1499135 · DOI
- Moses, 2019, Real-time decoding of question-and-answer speech dialogue using human cortical activity, Nat. Commun., 10, 3096, 10.1038/s41467-019-10994-4 · DOI · Paper page
- Murphy, 1997, Cerebral areas associated with motor control of speech in humans, J. Appl. Physiol., 83, 1438, 10.1152/jappl.1997.83.5.1438 · DOI · Paper page
- Nijboer, 2014, Design requirements and potential target users for brain-computer interfaces – recommendations from rehabilitation professionals, BCI, 1, 50, 10.1080/2326263X.2013.877210 · DOI · Paper page
- Penfield, 1937, Somatic motor and sensory representation in the CEREBRAL cortex of man as studied by electrical stimulation, Brain J. Neurol., 60, 389, 10.1093/brain/60.4.389 · DOI · Paper page
- Peters, 2015, Brain-computer Interface users speak up: the virtual users’ forum at the 2013 international brain-computer Interface meeting, Arch. Phys. Med. Rehabil., 96, S33, 10.1016/j.apmr.2014.03.037 · DOI · Paper page
- Ramsey, 2018, Decoding spoken phonemes from sensorimotor cortex with high-density ECoG grids, NeuroImage, 180, 301, 10.1016/j.neuroimage.2017.10.011 · DOI · Paper page
- Shen, 2023, Translational opportunities and challenges of invasive electrodes for neural interfaces, Nat. Biomed. Eng., 7, 424, 10.1038/s41551-023-01021-5 · DOI
- Thompson, 2013, Performance assessment in brain-computer Interface-based augmentative and alternative communication, Biomed. Eng. Online, 12, 43, 10.1186/1475-925X-12-43 · DOI
- Vansteensel, 2022, Methodological recommendations for studies on the daily life implementation of implantable communication-brain-computer interfaces for individuals with locked-in syndrome, Neurorehabil. Neural Repair, 36, 666, 10.1177/15459683221125788 · DOI
- Weiss, 2019, Demonstration of a portable Intracortical brain-computer Interface, BCI, 6, 106, 10.1080/2326263X.2019.1709260 · DOI
- Zickler, 2009, BCI applications for people with disabilities: defining user needs and user requirements, Assist. Technol. Res. Ser., 25, 185, 10.3233/978.1.60750.042.1.185 · doi:10.3233/978.1.60750.042.1.185
Cited by
Silva, A. B., Littlejohn, K. T., Liu, J. R., Moses, D. A., & Chang, E. F. (2024) · Nature Reviews Neuroscience · doi:10.1038/s41583-024-00819-9 · Cited by 103
“A potential safeguard would be to chain any speech decoding to an initial speech-detection module, trained to identify volitional speech attempts 218 .”
Self-citationThe ethical significance of user-control in AI-driven speech-BCIs: a narrative review
van Stuijvenberg, O. C., Samlal, D. P. S., Vansteensel, M. J., Broekman, M. L. D., & Jongsma, K. R. (2024) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2024.1420334 · Cited by 13
Metadata
- Authors
- Sankaran, N., Moses, D., Chiong, W., & Chang, E. F.
- Venue
- Frontiers in Human Neuroscience
- Publisher
- Frontiers Media SA
- Published
- 2023-10-18
- Volume
- 17
- ISSN
- 1662-5161
- Cited by
- 14
- References
- 16
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Recommendations for promoting user agency in the design of speech neuroprostheses. https://app.cochat.ai/papers/10.3389/fnhum.2023.1298129
- The paper
- Sankaran, N., Moses, D., Chiong, W., & Chang, E. F. (2023). Recommendations for promoting user agency in the design of speech neuroprostheses. Frontiers in Human Neuroscience. https://doi.org/10.3389/fnhum.2023.1298129
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.