Explaining Machine Learning Models for Clinical Gait Analysis
Open accessThe DOI matches its Crossref record; 75 of the 75 references it cites were found in a registry or an index.
Abstract
Machine Learning (ML) is increasingly used to support decision-making in the healthcare sector. While ML approaches provide promising results with regard to their classification performance, most share a central limitation, their black-box character. This article investigates the usefulness of Explainable Artificial Intelligence (XAI) methods to increase transparency in automated clinical gait classification based on time series. For this purpose, predictions of state-of-the-art classification methods are explained with a XAI method called Layer-wise Relevance Propagation (LRP). Our main contribution is an approach that explains class-specific characteristics learned by ML models that are trained for gait classification. We investigate several gait classification tasks and employ different classification methods, i.e., Convolutional Neural Network, Support Vector Machine, and Multi-layer Perceptron. We propose to evaluate the obtained explanations with two complementary approaches: a statistical analysis of the underlying data using Statistical Parametric Mapping and a qualitative evaluation by two clinical experts. A gait dataset comprising ground reaction force measurements from 132 patients with different lower-body gait disorders and 62 healthy controls is utilized. Our experiments show that explanations obtained by LRP exhibit promising statistical properties concerning inter-class discriminativity and are also in line with clinically relevant biomechanical gait characteristics.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Building on earlier efforts that compared different model outputs [70] or validated the intuitiveness of visual explanations (like those from LRP) [48,49], recent studies have begun to experimentally test the impact of different explanation strategies on user performance and reliance.”
From Explainable AI for Clinical Decision Support Systems: Literature Review, Key Gaps, and Research Synthesis (2025) · cites this paper as [49]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(2008) · Journal of Machine Learning Research · Cited by 33,051
A Simple Sequentially Rejective Multiple Test Procedure
(1979) · Scandinavian Journal of Statistics · doi:10.2307/4615733 · Cited by 21,526
Dermatologist-level classification of skin cancer with deep neural networks
Esteva, A., Kuprel, B., Novoa, R. A., Ko, J., Swetter, S. M., Blau, H. M., & Thrun, S. (2017) · Nature · doi:10.1038/nature21056 · Cited by 14,362
High-performance medicine: the convergence of human and artificial intelligence
Topol, E. J. (2019) · Nature Medicine · doi:10.1038/s41591-018-0300-7 · Cited by 10,450 · cited 1×
“Therefore, it is not surprising that ML approaches are currently becoming popular in the healthcare sector [73].”
BackgroundPeeking Inside the Black-Box: A Survey on Explainable Artificial Intelligence (XAI)
Adadi, A., & Berrada, M. (2018) · IEEE Access · doi:10.1109/access.2018.2870052 · Cited by 6,294 · cited 2×
“While ML approaches yield promising results regarding classification performance, most share a central limitation, which is their black-box character [1].”
BackgroundBiomechanics and Motor Control of Human Movement
Winter, D. A. (2009) · Wiley eBooks · doi:10.1002/9780470549148 · Cited by 6,066 · cited 3×
“The employed dataset contains bilateral three-dimensional ground reaction force (GRF) recordings of patients and healthy controls walking unassisted at self-selected walking speed on an approximately 10 m walkway with two centrally-embedded force plates (Kistler, Type 9281B12, Winterthur, CH).”
MethodDeep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Maps
Simonyan, K., Vedaldi, A., & Zisserman, A. (2013) · arXiv · doi:10.48550/arxiv.1312.6034 · Cited by 5,370 · cited 5×
“[51] proposed a method for generating a representative visualization for a specific class that was learned by a CNN.”
MethodInfluentialMeta-Analytic Procedures for Social Research
Rosenthal, R. (1991) · doi:10.4135/9781412984997 · Cited by 4,635 · cited 2×
“Additionally, we computed the effect size by transforming the resulting t-values to Pearson’s correlation coefficient r using the definition by Rosenthal [56].”
MethodOn Pixel-Wise Explanations for Non-Linear Classifier Decisions by Layer-Wise Relevance Propagation
Bach, S., Binder, A., Montavon, G., Klauschen, F., Müller, K.-R., & Samek, W. (2015) · PLOS ONE · doi:10.1371/journal.pone.0130140 · Cited by 4,524 · cited 4×
“For example, the LRPε rule [7] is defined as:”
BackgroundMethodInfluentialSelf-citationInternational evaluation of an AI system for breast cancer screening
McKinney, S. M., Sieniek, M., Godbole, V., Godwin, J., Antropova, N., Ashrafian, H., Back, T., Chesus, M., Corrado, G. S., Darzi, A., et al. (2020) · Nature · doi:10.1038/s41586-019-1799-6 · Cited by 3,287 · cited 2×
“Impressively, there are certain medical tasks, such as the detection of skin or breast cancer, that ML approaches have already been able to solve more efficiently and effectively than humans [16, 21, 42].”
BackgroundLearning Important Features Through Propagating Activation Differences
Shrikumar, A., Greenside, P., & Kundaje, A. (2017) · arXiv · doi:10.48550/arxiv.1704.02685 · Cited by 2,761 · cited 1×
“Layer-wise Relevance Propagation (LRP) [5, 34] and Deep Learning Important FeaTures (DeepLIFT) [50] are methods that propagate importance scores from the output layer back to the input, thereby enabling the identification of positive and negative evidences for a specific prediction.”
MethodMethods for interpreting and understanding deep neural networks
Montavon, G., Samek, W., & Müller, K.-R. (2018) · Digital Signal Processing · doi:10.1016/j.dsp.2017.10.011 · Cited by 2,665 · cited 1×
“Modern approaches to CNN explainability, such as LRP or DeepLift, do not have this problem and work well for a wider range of network architectures and models in general [32, 46].”
BackgroundSelf-citationA Survey on Explainable Artificial Intelligence (XAI): Toward Medical XAI
Tjoa, E., & Guan, C. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.3027314 · Cited by 2,524
Explaining prediction models and individual predictions with feature contributions
Štrumbelj, E., & Kononenko, I. (2014) · Knowledge and Information Systems · doi:10.1007/s10115-013-0679-x · Cited by 2,286 · cited 1×
“For this purpose, the effect of omitting an input feature is examined, taking into account all possible combinations of other input features, that can be included or excluded [55].”
BackgroundThe practical implementation of artificial intelligence technologies in medicine
He, J., Baxter, S. L., Xu, J., Xu, J., Zhou, X., & Zhang, K. (2019) · Nature Medicine · doi:10.1038/s41591-018-0307-0 · Cited by 2,246 · cited 1×
“This is, however, necessary for compliance with legislation such as the General Data Protection Regulation (GDPR, EU 2016/679) [1, 17, 23].”
BackgroundCausability and explainability of artificial intelligence in medicine
Holzinger, A., Langs, G., Denk, H., Zatloukal, K., & Müller, H. (2019) · WIREs Data Mining and Knowledge Discovery · doi:10.1002/widm.1312 · Cited by 1,885
Haenssle, H. A., Fink, C., Schneiderbauer, R., Toberer, F., Buhl, T., Blum, A., Kalloo, A., Hassen, A. B. H., Thomas, L., Enk, A., et al. (2018) · Annals of Oncology · doi:10.1093/annonc/mdy166 · Cited by 1,571 · cited 2×
“Impressively, there are certain medical tasks, such as the detection of skin or breast cancer, that ML approaches have already been able to solve more efficiently and effectively than humans [16, 21, 42].”
BackgroundExplaining Deep Neural Networks and Beyond: A Review of Methods and Applications
Samek, W., Montavon, G., Lapuschkin, S., Anders, C. J., & Muller, K.-R. (2021) · Proceedings of the IEEE · doi:10.1109/jproc.2021.3060483 · Cited by 1,477 · cited 2×
“In contrast to images, which are more frequently subject to explainability studies [2, 19, 58, 59], the evaluation of explanations becomes particularly challenging when the input signals are more abstract and thus not straightforward to interpret, as often is the case with biomedical signals.”
BackgroundSelf-citationExplaining nonlinear classification decisions with deep taylor decomposition
Montavon, G., Lapuschkin, S., Binder, A., Samek, W., & Müller, K.-R. (2017) · Pattern Recognition · doi:10.1016/j.patcog.2016.11.008 · Cited by 1,357 · cited 1×
“Given that the models investigated in this study are comparatively shallow and are largely unaffected by detrimental effects such as gradient shattering [10, 44, 45], we performed relevance decomposition according to LRPε with ε = 10−5 in all layers across the different models (except for the CNN for which we employed…”
MethodSelf-citationSanity Checks for Saliency Maps
Adebayo, J., Gilmer, J., Muelly, M., Goodfellow, I., Hardt, M., & Kim, B. (2018) · arXiv · doi:10.48550/arxiv.1810.03292 · Cited by 1,294 · cited 1×
“xplanations’ quality is, however, a challenge since no ground truth exists for automatically generated explanations. In contrast to images, which are more frequently subject to explainability studies [2, 17, 44, 46], the evaluation of explanations becomes particularly challenging when the input signals are more abstra…”
BackgroundLeCun, Y. A., Bottou, L., Orr, G. B., & Müller, K.-R. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-35289-8_3 · Cited by 1,264 · cited 2×
“and σ =m− 1 2 , where m is the number of inputs to each output neuron of the layer [37].”
BackgroundMethodEvaluating the Visualization of What a Deep Neural Network Has Learned
Samek, W., Binder, A., Montavon, G., Lapuschkin, S., & Muller, K.-R. (2017) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2016.2599820 · Cited by 1,164
Self-citationInterpretable Explanations of Black Boxes by Meaningful Perturbation
Fong, R. C., & Vedaldi, A. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.371 · Cited by 1,097 · cited 2×
“Perturbation-based methods, such as those introduced by Fong and Vedaldi [17] or Zintgraf et al.”
BackgroundMethodSamek, W., Wiegand, T., & Müller, K.-R. (2017) · arXiv · doi:10.48550/arxiv.1708.08296 · Cited by 1,080
Self-citationUnmasking Clever Hans predictors and assessing what machines really learn
Lapuschkin, S., Wäldchen, S., Binder, A., Montavon, G., Samek, W., & Müller, K.-R. (2019) · Nature Communications · doi:10.1038/s41467-019-08987-4 · Cited by 1,047 · cited 3×
“To perform a more detailed analysis that is able to identify different learning strategies of the ML models, we propose the use of SpRAy [35] as described in [5] for clinical gait data.”
BackgroundMethodSelf-citationGeneralized N-Dimensional Biomechanical Field Analysis Using Statistical Parametric Mapping
Pataky, T. C. (2010) · Journal of Biomechanics · doi:10.1016/j.jbiomech.2010.03.008 · Cited by 907
One-dimensional statistical parametric mapping in Python
Pataky, T. C. (2012) · Computer Methods in Biomechanics and Biomedical Engineering · doi:10.1080/10255842.2010.527837 · Cited by 883
Layer-Wise Relevance Propagation: An Overview
Montavon, G., Binder, A., Lapuschkin, S., Samek, W., & Müller, K.-R. (2019) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-28954-6_10 · Cited by 750 · cited 4×
“Other propagation rules, such as LRPγ [44], LRPα β , LRPzB , or LRP , are suitable for other application scenarios, layer types, or particularly deeper neural networks [32, 44, 58] and have been shown to work well in practice [57].”
BackgroundMethodInfluentialSelf-citationModel-Agnostic Interpretability of Machine Learning
Ribeiro, M. T., Singh, S., & Guestrin, C. (2016) · arXiv · doi:10.48550/arxiv.1606.05386 · Cited by 699
What do we need to build explainable AI systems for the medical domain?
Holzinger, A., Biemann, C., Pattichis, C. S., & Kell, D. B. (2017) · arXiv · doi:10.48550/arxiv.1712.09923 · Cited by 636
Generating Visual Explanations
Hendricks, L. A., Akata, Z., Rohrbach, M., Donahue, J., Schiele, B., & Darrell, T. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46493-0_1 · Cited by 534
Visualizing Deep Neural Network Decisions: Prediction Difference Analysis
Zintgraf, L. M., Cohen, T. S., Adel, T., & Welling, M. (2017) · arXiv · doi:10.48550/arxiv.1702.04595 · Cited by 487 · cited 1×
“Perturbation-based methods , such as those introduced by Fong and Vedaldi [17] or Zintgraf et al. [63], treat the model as a black box and estimate the importance of input features by (partially) occluding the input and measuring the effect on the model output.”
MethodDynamic Principles of Gait and Their Clinical Implications
Kuo, A. D., & Donelan, J. M. (2010) · Physical Therapy · doi:10.2522/ptj.20090125 · Cited by 485
Halilaj, E., Rajagopal, A., Fiterau, M., Hicks, J. L., Hastie, T. J., & Delp, S. L. (2018) · Journal of Biomechanics · doi:10.1016/j.jbiomech.2018.09.009 · Cited by 460
Proceedings of the International Joint Conference on Neural Networks (IJCNN) 2005
(2005) · Proceedings. 2005 IEEE International Joint Conference on Neural Networks, 2005. · doi:10.1109/ijcnn.2005.1555790 · Cited by 382
A review of analytical techniques for gait data. Part 1: fuzzy, statistical and fractal methods
Chau, T. (2001) · Gait & Posture · doi:10.1016/s0966-6362(00)00094-1 · Cited by 378 · cited 1×
“Thereby, CGA produces a vast amount of data [19, 41], which are difficult to comprehend due to their multi-dimensional and multi-correlated nature [12, 62].”
BackgroundAssessment of the kinematic variability among 12 motion analysis laboratories
Gorton, G. E., Hebert, D. A., & Gannotti, M. E. (2009) · Gait & Posture · doi:10.1016/j.gaitpost.2008.10.060 · Cited by 283 · cited 1×
“However, 3D kinematic data are prone to several difficulties such as inconsistencies due to inter-assessor and inter-laboratory differences [20, 60].”
BackgroundOne Explanation Does Not Fit All: A Toolkit and Taxonomy of AI Explainability Techniques
Arya, V., Bellamy, R. K. E., Chen, P.-Y., Dhurandhar, A., Hind, M., Hoffman, S. C., Houde, S., Liao, Q. V., Luss, R., Mojsilović, A., et al. (2019) · arXiv · doi:10.48550/arxiv.1909.03012 · Cited by 268
Explaining the unique nature of individual gait patterns with deep learning
Horst, F., Lapuschkin, S., Samek, W., Müller, K.-R., & Schöllhorn, W. I. (2019) · Scientific Reports · doi:10.1038/s41598-019-38748-8 · Cited by 256
Self-citationClassification of Parkinson's Disease Gait Using Spatial-Temporal Gait Features
Wahid, F., Begg, R. K., Hass, C. J., Halgamuge, S., & Ackland, D. C. (2015) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2015.2450232 · Cited by 236 · cited 1×
“l and multi-correlated nature [12, 62]. In the last years, ML methods have been successfully employed in CGA for the classification of patient groups [16, 48] such as stroke [29], Parkinson’s disease [60], cerebral palsy [58], multiple sclerosis [3], osteoarthritis [38], and patients suffering from different functiona…”
MethodSensitivity analysis for minimization of input data dimension for feedforward neural network
Zurada, J. M., Malinowski, A., & Cloete, I. (2002) · Proceedings of IEEE International Symposium on Circuits and Systems - ISCAS '94 · doi:10.1109/iscas.1994.409622 · Cited by 199
Vertical ground reaction forces: objective measures of gait following hip arthroplasty
McCrory, J. L., White, S. C., & Lifeso, R. M. (2001) · Gait & Posture · doi:10.1016/s0966-6362(01)00140-0 · Cited by 194
Finding and removing Clever Hans: Using explanation methods to debug and improve deep models
Anders, C. J., Weber, L., Neumann, D., Samek, W., Müller, K., & Lapuschkin, S. (2021) · Information Fusion · doi:10.1016/j.inffus.2021.07.015 · Cited by 190
Self-citationAnalysis of Big Data in Gait Biomechanics: Current Trends and Future Directions
Phinyomark, A., Petri, G., Ibáñez-Marcelo, E., Osis, S. T., & Ferber, R. (2018) · Journal of Medical and Biological Engineering · doi:10.1007/s40846-017-0297-2 · Cited by 175 · cited 1×
“Thereby, CGA produces a vast amount of data [22, 54], which are difficult to comprehend due to their multi-dimensional and multi-correlated nature [13, 80].”
BackgroundApplications of artificial neural nets in clinical biomechanics
Schöllhorn, W. I. (2004) · Clinical Biomechanics · doi:10.1016/j.clinbiomech.2004.04.005 · Cited by 172
Self-citationAutomatic recognition of gait patterns in human motor disorders using machine learning: A review
Figueiredo, J., Santos, C. P., & Moreno, J. C. (2018) · Medical Engineering & Physics · doi:10.1016/j.medengphy.2017.12.006 · Cited by 168
Measuring Walking: A Handbook of Clinical Gait Analysis
Martin, K. S. (2013) · Physical & Occupational Therapy In Pediatrics · doi:10.3109/01942638.2014.873638 · Cited by 151
Cook, T. M., Farrell, K. P., Carey, I. A., Gibbs, J. M., & Wiger, G. E. (1997) · Journal of Orthopaedic and Sports Physical Therapy · doi:10.2519/jospt.1997.25.4.236 · Cited by 126
Lau, H.-Y., Tong, K.-Y., & Zhu, H. (2009) · Human Movement Science · doi:10.1016/j.humov.2008.12.003 · Cited by 108
Gait Analysis, Normal and Pathological Function, 2nd ed
van der Linden, M. L. (2011) · Dialnet (Universidad de la Rioja) · Cited by 106
GaitRec, a large-scale ground reaction force dataset of healthy and impaired gait
Horsak, B., Slijepčević, D., Raberger, A.-M., Schwab, C., Worisch, M., & Zeppelzauer, M. (2020) · Scientific Data · doi:10.1038/s41597-020-0481-z · Cited by 99 · cited 4×
“For our analyses, we used a subset of the GaitRec dataset [28].”
MethodInfluentialSelf-citationAlaqtash, M., Sarkodie-Gyan, T., Yu, H., Fuentes, O., Brower, R. D., & Abdelgawad, A. H. K. (2011) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/iembs.2011.6090063 · Cited by 95 · cited 1×
“In the last years, ML methods have been successfully employed in CGA for the classification of patient groups [16, 48] such as stroke [29], Parkinson’s disease [60], cerebral palsy [58], multiple sclerosis [3], osteoarthritis [38], and patients suffering from different functional gait disorders [52].”
MethodHorst, F., Mildner, M., & Schöllhorn, W. I. (2017) · Gait & Posture · doi:10.1016/j.gaitpost.2017.09.003 · Cited by 80 · cited 1×
“From a biomechanical perspective, this is plausible because each individual person has unique gait patterns that differ from the gait patterns of other individuals [30].”
BackgroundSelf-citationAnders, C. J., Neumann, D., Samek, W., Müller, K., & Lapuschkin, S. (2026) · PLoS ONE · doi:10.1371/journal.pone.0336683 · Cited by 79 · cited 1×
“We implemented and evaluated SpRAy using the CoRelAy3 framework [4] for Python.”
MethodSelf-citationBurdack, J., Horst, F., Giesselbach, S., Hassan, I., Daffner, S., & Schöllhorn, W. I. (2020) · Frontiers in Bioengineering and Biotechnology · doi:10.3389/fbioe.2020.00260 · Cited by 78
Self-citationAltered Walking Neuromechanics in Patients With Chronic Ankle Instability
Son, S. J., Kim, H., Seeley, M. K., & Hopkins, J. T. (2019) · Journal of Athletic Training · doi:10.4085/1062-6050-478-17 · Cited by 77
Gait patterns of asymmetric ankle osteoarthritis patients
Nüesch, C., Valderrábano, V., Huber, C., von Tscharner, V., & Pagenstert, G. (2012) · Clinical Biomechanics · doi:10.1016/j.clinbiomech.2011.12.016 · Cited by 76 · cited 1×
“In the last years, ML methods have been successfully employed in CGA for the classification of patient groups [16, 48] such as stroke [29], Parkinson’s disease [60], cerebral palsy [58], multiple sclerosis [3], osteoarthritis [38], and patients suffering from different functional gait disorders [52].”
MethodA Survey of Human‐Centered Evaluations in Human‐Centered Machine Learning
Sperrle, F., El‐Assady, M., Guo, G., Borgo, R., Chau, D. H., Endert, A., & Keim, D. (2021) · Computer Graphics Forum · doi:10.1111/cgf.14329 · Cited by 75
Automatic Classification of Functional Gait Disorders
Slijepčević, D., Zeppelzauer, M., Gorgas, A., Schwab, C., Schuller, M., Baca, A., Breiteneder, C. J., & Horsak, B. (2017) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2017.2785682 · Cited by 74
Self-citationAutomated feature assessment in instrumented gait analysis
Wolf, S. I., Loose, T., Schablowski, M., Döderlein, L., Rupp, R., Gerner, H. J., Bretthauer, G., & Mikut, R. (2005) · Gait & Posture · doi:10.1016/j.gaitpost.2005.04.004 · Cited by 68 · cited 1×
“Thereby, CGA produces a vast amount of data [22, 54], which are difficult to comprehend due to their multi-dimensional and multi-correlated nature [13, 80].”
BackgroundKAVAGait: Knowledge-Assisted Visual Analytics for Clinical Gait Analysis
Wagner, M., Slijepčević, D., Horsak, B., Rind, A., Zeppelzauer, M., & Aigner, W. (2018) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2017.2785271 · Cited by 66
Self-citationSimmonds, M. J., Lee, C. E., Etnyre, B., & Morris, G. S. (2012) · Pain Research and Treatment · doi:10.1155/2012/214980 · Cited by 63 · cited 1×
“Both aspects are affected in case of gait impairments due to a diminished walking speed (requiring less absorption or push-off) as well as factors that go along with an injury, such as the presence of pain, a decreased range of motion, and/or lessened muscle strength [64, 78].”
BackgroundVisualization of neural networks using saliency maps
Morch, N. J. S., Kjems, U., Hansen, L. K., Svarer, C., Law, I., Lautrup, B., Strother, S., & Rehm, K. (2002) · Proceedings of ICNN'95 - International Conference on Neural Networks · doi:10.1109/icnn.1995.488997 · Cited by 58 · cited 7×
“Lapuschkin et al. [35] proposed the Spectral Relevance Analysis (SpRAy), which summarizes a model’s learned strategies by analyzing similarities and dissimilarities over large quantities of input relevance maps computed with respect to a category of interest.”
MethodInfluentialHow to Explain Individual Classification Decisions
(2010) · Journal of Machine Learning Research · doi:10.5555/1756006.1859912 · Cited by 54
Willén, C., Stibrant Sunnerhagen, K., Ekman, C., & Grimby, G. (2004) · Archives of Physical Medicine and Rehabilitation · doi:10.1016/j.apmr.2003.11.040 · Cited by 53
Probabilistic gait classification in children with cerebral palsy: A Bayesian approach
Gestel, L. V., Laet, T. D., Lello, E. D., Bruyninckx, H., Molenaers, G., Campenhout, A. V., Aertbeliën, E., Schwartz, M., Wambacq, H., Cock, P. D., et al. (2011) · Research in Developmental Disabilities · doi:10.1016/j.ridd.2011.07.004 · Cited by 42
Nieuwenhuys, A., Papageorgiou, E., Desloovere, K., Molenaers, G., & Laet, T. D. (2017) · PLoS ONE · doi:10.1371/journal.pone.0169834 · Cited by 38
Martínez-Ramírez, A., Weenk, D., Lecumberri, P., Verdonschot, N. J. J., Pakvis, D. F. M., & Veltink, P. H. (2014) · Journal of NeuroEngineering and Rehabilitation · doi:10.1186/1743-0003-11-20 · Cited by 25
Effect of dual task on gait asymmetry in patients after anterior cruciate ligament reconstruction
Shi, H., Huang, H., Yu, Y., Liang, Z., Zhang, S., Yu, B., Liu, H., & Ao, Y. (2018) · Scientific Reports · doi:10.1038/s41598-018-30459-w · Cited by 25
FuryExplorer: visual-interactive exploration of horse motion capture data
Wilhelm, N., Vögele, A., Zsoldos, R. R., Licka, T. F., Krüger, B., & Bernard, J. (2015) · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · doi:10.1117/12.2080001 · Cited by 24 · cited 1×
“re visual analytics approaches that employ advanced techniques for the interactive visualization of data to support data exploration, i.e., finding characteristic patterns or dependencies within data [59,61]. Prediction explanation aims at explaining the local behavior of a model, i.e., the prediction for a given inpu…”
MethodSTAPP: Spatiotemporal analysis of plantar pressure measurements using statistical parametric mapping
Booth, B. G., Keijsers, N. L. W., Sijbers, J., & Huysmans, T. (2018) · Gait & Posture · doi:10.1016/j.gaitpost.2018.04.029 · Cited by 23
Input representations and classification strategies for automated human gait analysis
Slijepčević, D., Zeppelzauer, M., Schwab, C., Raberger, A.-M., Breiteneder, C. J., & Horsak, B. (2019) · Gait & Posture · doi:10.1016/j.gaitpost.2019.10.021 · Cited by 23 · cited 2×
“In earlier studies [67, 68], we showed that the omission of the unaffected side during classification negatively affected classification accuracy.”
BackgroundResultSelf-citationScalona, E., Marco, R. D., Castelli, E., Desloovere, K., van der Krogt, M. M., Cappa, P., & Rossi, S. (2019) · International Biomechanics · doi:10.1080/23335432.2019.1621205 · Cited by 18
Visualization and Data Analysis 2015
Kao, D. L., Hao, M., Livingston, M. A., & Wischgoll, T. (2015) · CaltechAUTHORS (California Institute of Technology) · Cited by 15
Slijepčević, D., Zeppelzauer, M., Schwab, C., Raberger, A.-M., Dumphart, B., Baca, A., Breiteneder, C. J., & Horsak, B. (2018) · Gait & Posture · doi:10.1016/j.gaitpost.2018.06.155 · Cited by 3 · cited 4×
“This is also in line with our previous quantitative performance evaluations [53, 54].”
BackgroundMethodResultInfluentialSelf-citation
Research works printed but not linked: 10
- 10.5555/3327546.3327621 · doi:10.5555/3327546.3327621
- David Balduzzi, Marcus Frean, Lennox Leary, J. P. Lewis, Kurt Wan-Duo Ma, and Brian McWilliams. 2017. The shattered gradients problem: If resnets are the answer, then what is the question? In Proceedings of the International Conference on Machine Learning (ICML). PMLR, 342–350.
- 10.5555/3203489 · doi:10.5555/3203489
- European Union. 2016. Regulation (EU) 2016/679 of the European Parliament and of the Council of 27 April 2016 on the protection of natural persons with regard to the processing of personal data and on the free movement of such data, and repealing Directive 95/46/EC (General Data Protection Regulation). Offic. J. Eur. Union L 119 (2016), 1–88. Retrieved from https://eur-lex.europa.eu/eli/reg/2016/679/oj.
- Sebastian Lapuschkin, Alexander Binder, Grégoire Montavon, Klaus-Robert Müller, and Wojciech Samek. 2016. Analyzing classifiers: Fisher vectors and deep neural networks. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, (CVPR). IEEE Computer Society, 2912–2920.
- Scott M. Lundberg and Su-In Lee. 2017. A unified approach to interpreting model predictions. In Proceedings of the International Conference on Advances in Neural Information Processing Systems (NIPS). Curran Associates, Inc., 4765–4774. Retrieved from http://papers.nips.cc/paper/7062-a-unified-approach-to-interpreting-model-predictions.pdf.
- Marina Meila and Jianbo Shi. 2001. A random walks view of spectral segmentation. In Proceedings of the International Workshop on Artificial Intelligence and Statistics (AISTATS).
- Andrew Y. Ng, Michael I. Jordan, and Yair Weiss. 2002. On spectral clustering: Analysis and an algorithm. In Proceedings of the International Conference on Advances in Neural Information Processing Systems. 849–856.
- Anh Nguyen, Alexey Dosovitskiy, Jason Yosinski, Thomas Brox, and Jeff Clune. 2016. Synthesizing the preferred inputs for neurons in neural networks via deep generator networks. In Proceedings of the International Conference on Advances in Neural Information Processing Systems. Curran Associates, Inc., 3387–3395. Retrieved from http://papers.nips.cc/paper/6519-synthesizing-the-preferred-inputs-for-neurons-in-neural-networks-via-deep-generator-networks.pdf.
- Erik Strumbelj and Igor Kononenko. 2010. An efficient explanation of individual classifications using game theory. The Journal of Machine Learning Research 11 (2010) 1–18. JMLR. org.
Cited by
A., S., & R., S. (2023) · Decision Analytics Journal · doi:10.1016/j.dajour.2023.100230 · Cited by 432
Ali, S., Akhlaq, F., Imran, A. S., Kastrati, Z., Daudpota, S. M., & Moosa, M. (2023) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2023.107555 · Cited by 338
Explainable AI for clinical and remote health applications: A survey on tabular and time series data
Di Martino, F., & Delmastro, F. (2023) · Artificial Intelligence Review · doi:10.1007/s10462-022-10304-3 · Cited by 216
“Sun et al. (2021) proposed AttenSurv, an attention-based RNN for Heart Failure (HF) survival prediction of seriously ill patients from longitudinal and heterogeneous EHR.”
MethodExplainable artificial intelligence in Alzheimer’s disease classification: a systematic review
Viswan, V., Shaffi, N., Mahmud, M., Subramanian, K., & Hajamohideen, F. (2024) · Cognitive Computation · doi:10.1007/s12559-023-10192-x · Cited by 195
“One of the significant drawbacks of XAI-based AD diagnosis is the absence of ground truth data [176].”
A Large Comparison of Normalization Methods on Time Series
Lima, F. T., & Souza, V. M. A. (2023) · Big Data Research · doi:10.1016/j.bdr.2023.100407 · Cited by 202
Metadata
- Authors
- Slijepcevic, D., Horst, F., Lapuschkin, S., Horsak, B., Raberger, A.-M., Kranzl, A., Samek, W., Breiteneder, C., Schöllhorn, W. I., & Zeppelzauer, M.
- Affiliations
- Institute of Creative Media Technologies, Department of Media & DigitalTechnologies, St. Pölten University of Applied Sciences, St. Pölten, Austria
- Johannes Gutenberg University Mainz (DE)
- Fraunhofer Institute for Telecommunications, Heinrich Hertz Institute (DE)
- University of Applied Sciences St Pölten (AT)
- Orthopaedic Hospital Speising (AT)
- TU Wien (AT)
- ORCID
- Venue
- ACM Transactions on Computing for Healthcare
- Published
- 2021-12-20
- Volume
- 3
- Issue
- 2
- Pages
- 1-27
- ISSN
- 2637-8051 (ISSN-L)
- 2691-1957
- OpenAlex
- W4200347914
- Cited by
- 82
- References
- 72
- Citations by year
- 2026: 13 · 2025: 21 · 2024: 24 · 2023: 13 · 2022: 8 · 2021: 3
- FWCI
- 4.20
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- ACM Transactions on Computing for Healthcare (publishedVersion, cc-by-nc-sa)
- arXiv (Cornell University) (submittedVersion)
- Fraunhofer-Publica (Fraunhofer-Gesellschaft) (submittedVersion)
- arXiv (Cornell University) (cc-by)
- Funders
- Austrian Research Promotion Agency
- Austrian Federal Ministry for Digital and Economic Affairs (ReMoCapLab – #866855 and BigDataAnalytics – #866880)
- Lower Austrian Research and Education Company
- Provincial Government of Lower Austria (IntelliGait3D – #FTI17-014)
- German Ministry for Education and Research as BIFOLD (#01IS18025A and #01IS18037A)
- TraMeExCo (#01IS18056A)
- European Union’s Horizon 2020 (#965221)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Physical Sciences › Engineering › Biomedical Engineering › Gait Recognition and Analysis
- Health Sciences › Health Professions › Health Information Management › Artificial Intelligence in Healthcare
- Keywords
- explainable AI, layer-wise relevance propagation, gait classification, clinical gait analysis, black-box models, ground reaction force, statistical parametric mapping, convolutional neural networks, support vector machine, multilayer perceptron, time series classification
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.