Offline accuracy: A potentially misleading metric in myoelectric pattern recognition for prosthetic control
The DOI matches its Crossref record; 2 of the 2 references it cites were found in a registry or an index.
Abstract
Offline accuracy has been the preferred performance measure in myoelectric pattern recognition (MPR) for the prediction of motion volition. In this study, different metrics relating the fundamental binary prediction outcomes were analyzed. Our results indicate that global accuracy is biased by 1) the unbalanced number of possible true positive and negative outcomes, and 2) the almost perfect specificity and negative predicted value, which were consistently found across algorithms, topologies, and movements (individual and simultaneous). Therefore, class-specific accuracy is advisable instead. Additionally, we propose the use of precision (positive predictive value) and sensitivity (recall) as a complement to accuracy to better describe the discrimination capabilities of MPR algorithms, as these consider the effect of false predictions. However, all the studied offline metrics failed to predict real-time decoding, and therefore real-time testing continue to be necessary to truly evaluate the clinical usability of MPR.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Assessing the accuracy of prediction algorithms for classification: an overview
Baldi, P., Brunak, S., Chauvin, Y., Andersen, C. A. F., & Nielsen, H. (2000) · Bioinformatics · doi:10.1093/bioinformatics/16.5.412 · Cited by 2,111
Quantifying Pattern Recognition—Based Myoelectric Control of Multifunctional Transradial Prostheses
Li, G., Schultz, A. E., & Kuiken, T. A. (2010) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2009.2039619 · Cited by 443
Research works printed but not linked: 18
- jiang, 2013, Is Accurate Mapping of EMG Signals on Kinematics Needed for Precise Online Myoelectric Control?, IEEE Trans Neural Syst Rehabil Eng
- 10.1109/TNSRE.2009.2039590 · DOI · Paper page
- 10.1093/bjaceaccp/mkn041 · DOI · Paper page
- 10.1111/j.1651-2227.2006.00180.x · DOI · Paper page
- 10.1109/TNSRE.2014.2305097 · DOI · Paper page
- krzanowski, 1988, Principles of Multivariate Analysis a User's Perspective
- haykin, 1999, Neural Networks A Comprehensive Foundation
- 10.1109/EMBC.2013.6611081 · DOI
- ortiz-catalan, 2013, Real-time classification of simultaneous hand and wrist motions using Artificial Neural Networks with variable threshold outputs, Proceedings of the XXXIV International Conference on Artificial Neural Networks (ICANN), 1159
- 10.1007/s10439-009-9737-7 · DOI
- 10.1682/JRRD.2010.09.0177 · DOI · Paper page
- lock, 0, Real-time myoelectric control in a virtual environment to relate usability vs. accuracy, Proc MyoElectric Controls/Powered Prosthetics Symposium 2005
- honest, 2002, Reporting of measures of accuracy in systematic reviews of diagnostic literature, BMC Health Serv Res, 2, 10.1186/1472-6963-2-4 · DOI · Paper page
- 10.1109/TBME.2011.2113182 · DOI · Paper page
- 10.1126/scitranslmed.3010453 · DOI · Paper page
- finley, 1967, Myocoder-computer study of electromyographic patterns, Arch Phys Med Rehabil, 48, 20
- 10.1186/1751-0473-8-11 · DOI · Paper page
- li, 2010, Selection of sampling rate for EMG pattern recognition based prosthesis control, 32nd Ann Int Conf IEEE EMBS, 2010, 5058
Cited by
Zhai, X., Jelfs, B., Chan, R. H. M., & Tin, C. (2017) · Frontiers in Neuroscience · doi:10.3389/fnins.2017.00379 · Cited by 357
Toward higher-performance bionic limbs for wider clinical use
Farina, D., Vujaklija, I., Brånemark, R., Bull, A. M. J., Dietl, H., Graimann, B., Hargrove, L. J., Hoffmann, K.-P., Huang, H., Ingvarsson, T., et al. (2021) · Nature Biomedical Engineering · doi:10.1038/s41551-021-00732-x · Cited by 263
Self-citationJaramillo-Yánez, A., Benalcázar, M. E., & Mena-Maldonado, E. (2020) · Sensors · doi:10.3390/s20092467 · Cited by 259
Betthauser, J. L., Krall, J. T., Bannowsky, S. G., Levay, G., Kaliki, R. R., Fifer, M. S., & Thakor, N. V. (2020) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2019.2943309 · Cited by 73
Mastinu, E., Ahlberg, J., Lendaro, E., Hermansson, L., Hakansson, B., & Ortiz-Catalan, M. (2018) · IEEE Journal of Translational Engineering in Health and Medicine · doi:10.1109/jtehm.2018.2811458 · Cited by 48
Self-citation
Metadata
- Authors
- Ortiz-Catalan, M., Rouhani, F., Branemark, R., & Hakansson, B.
- Venue
- 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC)
- Publisher
- IEEE
- Published
- 2015-08
- Volume
- 2015
- Pages
- 1140-1143
- OpenAlex
- W2295791941
- Cited by
- 89
- References
- 2
- FWCI
- 13.38
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Offline accuracy: A potentially misleading metric in myoelectric pattern recognition for prosthetic control. https://app.cochat.ai/papers/10.1109/embc.2015.7318567
- The paper
- Ortiz-Catalan, M., Rouhani, F., Branemark, R., & Hakansson, B. (2015). Offline accuracy: A potentially misleading metric in myoelectric pattern recognition for prosthetic control. 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC). https://doi.org/10.1109/embc.2015.7318567
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.