CoChat

Explaining Machine Learning Models for Clinical Gait Analysis

Open access

The DOI matches its Crossref record; 75 of the 75 references it cites were found in a registry or an index.

Abstract

Machine Learning (ML) is increasingly used to support decision-making in the healthcare sector. While ML approaches provide promising results with regard to their classification performance, most share a central limitation, their black-box character. This article investigates the usefulness of Explainable Artificial Intelligence (XAI) methods to increase transparency in automated clinical gait classification based on time series. For this purpose, predictions of state-of-the-art classification methods are explained with a XAI method called Layer-wise Relevance Propagation (LRP). Our main contribution is an approach that explains class-specific characteristics learned by ML models that are trained for gait classification. We investigate several gait classification tasks and employ different classification methods, i.e., Convolutional Neural Network, Support Vector Machine, and Multi-layer Perceptron. We propose to evaluate the obtained explanations with two complementary approaches: a statistical analysis of the underlying data using Statistical Parametric Mapping and a qualitative evaluation by two clinical experts. A gait dataset comprising ground reaction force measurements from 132 patients with different lower-body gait disorders and 62 healthy controls is utilized. Our experiments show that explanations obtained by LRP exhibit promising statistical properties concerning inter-class discriminativity and are also in line with clinically relevant biomechanical gait characteristics.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1145/3474121

Cites

75 of 75 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 75 references

Research works printed but not linked: 10

  1. 10.5555/3327546.3327621 · doi:10.5555/3327546.3327621
  2. David Balduzzi, Marcus Frean, Lennox Leary, J. P. Lewis, Kurt Wan-Duo Ma, and Brian McWilliams. 2017. The shattered gradients problem: If resnets are the answer, then what is the question? In Proceedings of the International Conference on Machine Learning (ICML). PMLR, 342–350.
  3. 10.5555/3203489 · doi:10.5555/3203489
  4. European Union. 2016. Regulation (EU) 2016/679 of the European Parliament and of the Council of 27 April 2016 on the protection of natural persons with regard to the processing of personal data and on the free movement of such data, and repealing Directive 95/46/EC (General Data Protection Regulation). Offic. J. Eur. Union L 119 (2016), 1–88. Retrieved from https://eur-lex.europa.eu/eli/reg/2016/679/oj.
  5. Sebastian Lapuschkin, Alexander Binder, Grégoire Montavon, Klaus-Robert Müller, and Wojciech Samek. 2016. Analyzing classifiers: Fisher vectors and deep neural networks. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, (CVPR). IEEE Computer Society, 2912–2920.
  6. Scott M. Lundberg and Su-In Lee. 2017. A unified approach to interpreting model predictions. In Proceedings of the International Conference on Advances in Neural Information Processing Systems (NIPS). Curran Associates, Inc., 4765–4774. Retrieved from http://papers.nips.cc/paper/7062-a-unified-approach-to-interpreting-model-predictions.pdf.
  7. Marina Meila and Jianbo Shi. 2001. A random walks view of spectral segmentation. In Proceedings of the International Workshop on Artificial Intelligence and Statistics (AISTATS).
  8. Andrew Y. Ng, Michael I. Jordan, and Yair Weiss. 2002. On spectral clustering: Analysis and an algorithm. In Proceedings of the International Conference on Advances in Neural Information Processing Systems. 849–856.
  9. Anh Nguyen, Alexey Dosovitskiy, Jason Yosinski, Thomas Brox, and Jeff Clune. 2016. Synthesizing the preferred inputs for neurons in neural networks via deep generator networks. In Proceedings of the International Conference on Advances in Neural Information Processing Systems. Curran Associates, Inc., 3387–3395. Retrieved from http://papers.nips.cc/paper/6519-synthesizing-the-preferred-inputs-for-neurons-in-neural-networks-via-deep-generator-networks.pdf.
  10. Erik Strumbelj and Igor Kononenko. 2010. An efficient explanation of individual classifications using game theory. The Journal of Machine Learning Research 11 (2010) 1–18. JMLR. org.

Cited by

Metadata

Authors
Slijepcevic, D., Horst, F., Lapuschkin, S., Horsak, B., Raberger, A.-M., Kranzl, A., Samek, W., Breiteneder, C., Schöllhorn, W. I., & Zeppelzauer, M.
Affiliations
  • Institute of Creative Media Technologies, Department of Media & DigitalTechnologies, St. Pölten University of Applied Sciences, St. Pölten, Austria
  • Johannes Gutenberg University Mainz (DE)
  • Fraunhofer Institute for Telecommunications, Heinrich Hertz Institute (DE)
  • University of Applied Sciences St Pölten (AT)
  • Orthopaedic Hospital Speising (AT)
  • TU Wien (AT)
Venue
ACM Transactions on Computing for Healthcare
Published
2021-12-20
Volume
3
Issue
2
Pages
1-27
ISSN
  • 2637-8051 (ISSN-L)
  • 2691-1957
OpenAlex
W4200347914
Cited by
82
References
72
Citations by year
2026: 13 · 2025: 21 · 2024: 24 · 2023: 13 · 2022: 8 · 2021: 3
FWCI
4.20
Type
journal article
Language
en
Open access
Locations
  • ACM Transactions on Computing for Healthcare (publishedVersion, cc-by-nc-sa)
  • arXiv (Cornell University) (submittedVersion)
  • Fraunhofer-Publica (Fraunhofer-Gesellschaft) (submittedVersion)
  • arXiv (Cornell University) (cc-by)
Funders
  • Austrian Research Promotion Agency
  • Austrian Federal Ministry for Digital and Economic Affairs (ReMoCapLab – #866855 and BigDataAnalytics – #866880)
  • Lower Austrian Research and Education Company
  • Provincial Government of Lower Austria (IntelliGait3D – #FTI17-014)
  • German Ministry for Education and Research as BIFOLD (#01IS18025A and #01IS18037A)
  • TraMeExCo (#01IS18056A)
  • European Union’s Horizon 2020 (#965221)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
  • Physical Sciences › Engineering › Biomedical Engineering › Gait Recognition and Analysis
  • Health Sciences › Health Professions › Health Information Management › Artificial Intelligence in Healthcare
Keywords
explainable AI, layer-wise relevance propagation, gait classification, clinical gait analysis, black-box models, ground reaction force, statistical parametric mapping, convolutional neural networks, support vector machine, multilayer perceptron, time series classification

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.