Online human training of a myoelectric prosthesis controller via actor-critic reinforcement learning
The DOI matches its Crossref record; 6 of the 6 references it cites were found in a registry or an index.
Abstract
As a contribution toward the goal of adaptable, intelligent artificial limbs, this work introduces a continuous actor-critic reinforcement learning method for optimizing the control of multi-function myoelectric devices. Using a simulated upper-arm robotic prosthesis, we demonstrate how it is possible to derive successful limb controllers from myoelectric data using only a sparse human-delivered training signal, without requiring detailed knowledge about the task domain. This reinforcement-based machine learning framework is well suited for use by both patients and clinical staff, and may be easily adapted to different application domains and the needs of individual amputees. To our knowledge, this is the first my-oelectric control approach that facilitates the online learning of new amputee-specific motions based only on a one-dimensional (scalar) feedback signal provided by the user of the prosthesis.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A new strategy for multifunction myoelectric control
Hudgins, B., Parker, P., & Scott, R. N. (1993) · IEEE Transactions on Biomedical Engineering · doi:10.1109/10.204774 · Cited by 2,149 · cited 1×
“ear discriminant analysis [2], EMG-based low-dimensional embeddings [3], artificial neural networks [4], and support vector machines [5].”
MethodA robust, real-time control scheme for multifunction myoelectric control
Englehart, K., & Hudgins, B. (2003) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2003.813539 · Cited by 1,743
Myoelectric control systems—A survey
Asghari Oskoei, M., & Hu, H. (2007) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2007.07.009 · Cited by 1,244
Targeted Muscle Reinnervation for Real-time Myoelectric Control of Multifunction Artificial Arms
Kuiken, T. A. (2009) · JAMA · doi:10.1001/jama.2009.116 · Cited by 1,089
Reinforcement learning of motor skills with policy gradients
Peters, J., & Schaal, S. (2008) · Neural Networks · doi:10.1016/j.neunet.2008.02.003 · Cited by 831
Peters, J., & Schaal, S. (2008) · Neurocomputing · doi:10.1016/j.neucom.2007.11.026 · Cited by 738
Cited by
Deep reinforcement learning from human preferences
Christiano, P., Leike, J., Brown, T. B., Martic, M., Legg, S., & Amodei, D. (2017) · arXiv · doi:10.48550/arxiv.1706.03741 · Cited by 1,058
“A long line of work studies reinforcement learning from human ratings or rankings, including Akrour et al. (2011), Pilarski et al. (2011), Akrour et al. (2012), Wilson et al. (2012), Sugiyama et al. (2012), Wirth and Fürnkranz (2013), Daniel et al. (2015), El Asri et al. (2016), Wang et al. (2016),…”
BackgroundReinforcement learning for intelligent healthcare applications: A survey
Coronato, A., Naeem, M., De Pietro, G., & Paragliola, G. (2020) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2020.101964 · Cited by 320
Günther, J., Pilarski, P. M., Helfrich, G., Shen, H., & Diepold, K. (2014) · Procedia Technology · doi:10.1016/j.protcy.2014.09.007 · Cited by 303
Self-citationModel-Free reinforcement learning with continuous action in practice
Degris, T., Pilarski, P. M., & Sutton, R. S. (2012) · 2012 American Control Conference (ACC) · doi:10.1109/acc.2012.6315022 · Cited by 239
Self-citationShared Autonomy via Deep Reinforcement Learning
Reddy, S., Dragan, A., & Levine, S. (2018) · Robotics: Science and Systems XIV · doi:10.15607/rss.2018.xiv.005 · Cited by 175
Metadata
- Authors
- Pilarski, P. M., Dawson, M. R., Degris, T., Fahimi, F., Carey, J. P., & Sutton, R. S.
- Venue
- 2011 IEEE International Conference on Rehabilitation Robotics
- Publisher
- IEEE
- Published
- 2011-06
- Volume
- 2011
- Pages
- 1-7
- ISSN
- 1945-7898 (ISSN-L)
- OpenAlex
- W2098584016
- Cited by
- 153
- References
- 6
- FWCI
- 20.34
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.