CoChat

Offline accuracy: A potentially misleading metric in myoelectric pattern recognition for prosthetic control

Ortiz-Catalan, Max, Rouhani, Faezeh, Branemark, Rickard, Hakansson, Bo · 2015 · 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC)
Cited by 89

The DOI matches its Crossref record; 2 of the 2 references it cites were found in a registry or an index.

Abstract

Offline accuracy has been the preferred performance measure in myoelectric pattern recognition (MPR) for the prediction of motion volition. In this study, different metrics relating the fundamental binary prediction outcomes were analyzed. Our results indicate that global accuracy is biased by 1) the unbalanced number of possible true positive and negative outcomes, and 2) the almost perfect specificity and negative predicted value, which were consistently found across algorithms, topologies, and movements (individual and simultaneous). Therefore, class-specific accuracy is advisable instead. Additionally, we propose the use of precision (positive predictive value) and sensitivity (recall) as a complement to accuracy to better describe the discrimination capabilities of MPR algorithms, as these consider the effect of false predictions. However, all the studied offline metrics failed to predict real-time decoding, and therefore real-time testing continue to be necessary to truly evaluate the clinical usability of MPR.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1109/embc.2015.7318567

Cites

2 of 2 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Research works printed but not linked: 18

  1. jiang, 2013, Is Accurate Mapping of EMG Signals on Kinematics Needed for Precise Online Myoelectric Control?, IEEE Trans Neural Syst Rehabil Eng
  2. 10.1109/TNSRE.2009.2039590 · DOI · Paper page
  3. 10.1093/bjaceaccp/mkn041 · DOI · Paper page
  4. 10.1111/j.1651-2227.2006.00180.x · DOI · Paper page
  5. 10.1109/TNSRE.2014.2305097 · DOI · Paper page
  6. krzanowski, 1988, Principles of Multivariate Analysis a User's Perspective
  7. haykin, 1999, Neural Networks A Comprehensive Foundation
  8. 10.1109/EMBC.2013.6611081 · DOI
  9. ortiz-catalan, 2013, Real-time classification of simultaneous hand and wrist motions using Artificial Neural Networks with variable threshold outputs, Proceedings of the XXXIV International Conference on Artificial Neural Networks (ICANN), 1159
  10. 10.1007/s10439-009-9737-7 · DOI
  11. 10.1682/JRRD.2010.09.0177 · DOI · Paper page
  12. lock, 0, Real-time myoelectric control in a virtual environment to relate usability vs. accuracy, Proc MyoElectric Controls/Powered Prosthetics Symposium 2005
  13. honest, 2002, Reporting of measures of accuracy in systematic reviews of diagnostic literature, BMC Health Serv Res, 2, 10.1186/1472-6963-2-4 · DOI · Paper page
  14. 10.1109/TBME.2011.2113182 · DOI · Paper page
  15. 10.1126/scitranslmed.3010453 · DOI · Paper page
  16. finley, 1967, Myocoder-computer study of electromyographic patterns, Arch Phys Med Rehabil, 48, 20
  17. 10.1186/1751-0473-8-11 · DOI · Paper page
  18. li, 2010, Selection of sampling rate for EMG pattern recognition based prosthesis control, 32nd Ann Int Conf IEEE EMBS, 2010, 5058

Cited by

See all 89

Metadata

Authors
Ortiz-Catalan, M., Rouhani, F., Branemark, R., & Hakansson, B.
Venue
2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC)
Publisher
IEEE
Published
2015-08
Volume
2015
Pages
1140-1143
OpenAlex
W2295791941
Cited by
89
References
2
FWCI
13.38
Type
conference paper
Language
en
Open access
closed

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.