The DOI matches its Crossref record; 51 of the 51 references it cites were found in a registry or an index.
Learning to assess the quality of stroke rehabilitation exercises
Open accessAbstract
Due to the limited number of therapists, task-oriented exercises are often prescribed for post-stroke survivors as in-home rehabilitation. During in-home rehabilitation, a patient may become unmotivated or confused to comply prescriptions without the feedback of a therapist. To address this challenge, this paper proposes an automated method that can achieve not only qualitative, but also quantitative assessment of stroke rehabilitation exercises. Specifically, we explored a threshold model that utilizes the outputs of binary classifiers to quantify the correctness of a movements into a performance score. We collected movements of 11 healthy subjects and 15 post-stroke survivors using a Kinect sensor and ground truth scores from primary and secondary therapists. The proposed method achieves the following agreement with the primary therapist: 0.8436, 0.8264, and 0.7976 F1-scores on three task-oriented exercises. Experimental results show that our approach performs equally well or better than multi-class classification, regression, or the evaluation of the secondary therapist. Furthermore, we found a strong correlation (R2 = 0.95) between the sum of computed exercise scores and the Fugl-Meyer Assessment scores, clinically validated motor impairment index of post-stroke survivors. Our results demonstrate a feasibility of automatically assessing stroke rehabilitation exercises with the decent agreement levels and clinical relevance.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Although previous research describes the potential of AI/ML systems to outperform human experts on prediction tasks [18, 32, 40]”
From Understanding the Effect of Counterfactual Explanations on Trust and Reliance on AI for Human-AI Collaborative Clinical Decision Making (2023) · cites this paper as [40]
Citations
Cites
Scikit-learn: Machine Learning in Python
Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., Blondel, M., Müller, A., Nothman, J., Louppe, G., et al. (2012) · arXiv · doi:10.48550/arxiv.1201.0490 · Cited by 71,016 · cited 2×
“We utilize ‘Scikit-learn’ [34] and ‘PyTorch’ [31] libraries to implement Decision Trees (DTs), Linear Regression (LR), Support Vector Machine (SVM), Neural Networks (NNs), and Long Short Term Memory (LSTM) Network.”
Method(2017) · Cited by 11,625
(2006) · Springer eBooks · Cited by 8,123
Billinger, S. A., Arena, R., Bernhardt, J., Eng, J. J., Franklin, B. A., Johnson, C. M., MacKay-Lyons, M., Macko, R. F., Mead, G. E., Roth, E. J., et al. (2014) · Stroke · doi:10.1161/str.0000000000000022 · Cited by 1,529
Technology probes: inspiring design for and with families
Hutchinson, H., Mackay, W., Westerlund, B., Bederson, B. B., Druin, A., Plaisant, C., Beaudouin-Lafon, M., Conversy, S., Evans, H., Hansen, H., et al. (2003) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/642611.642616 · Cited by 1,471 · cited 1×
“Instead, this paper focuses on presenting a method of assessing the quality of stroke rehabilitation to collect patient’s performance data and further demonstrating how well it can assess compare to therapists as a technology probe [17, 18].”
MethodEvidence for prescribing exercise as therapy in chronic disease
Pedersen, B. K., & Saltin, B. (2006) · Scandinavian Journal of Medicine & Science in Sports · doi:10.1111/j.1600-0838.2006.00520.x · Cited by 1,384 · cited 1×
“A therapist prescribes to repeat few exercises with major muscle groups during in-home rehabilitation [2, 33].”
BackgroundTransforming classifier scores into accurate multiclass probability estimates
Zadrozny, B., & Elkan, C. (2002) · Proceedings of the eighth ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/775047.775151 · Cited by 1,280 · cited 1×
“These binary classifiers can predict the correctness of performance components and generate a confidence score to estimate performance score [13, 14, 23, 48] as shown in Figure 4.”
MethodManagement of Adult Stroke Rehabilitation Care: A Clinical Practice Guideline
Duncan, P. W., Zorowitz, R., Bates, B., Choi, J. Y., Glasberg, J. J., Graham, G. D., Katz, R. C., Lamberty, K., & Reker, D. (2005) · Stroke · doi:10.1161/01.str.0000180861.54180.ff · Cited by 1,046 · cited 1×
“As a post-stroke survivor mainly interacts with a single therapist for the consistent assessment and guidance [11, 39], our study mainly explores how well our proposed method can be calibrated with the primary therapist’s assessment and applicable to multiple patients.”
MethodThe impact of physical therapy on functional outcomes after stroke: what's the evidence?
Van Peppen, R. P., Kwakkel, G., Wood-Dauphinee, S., Hendriks, H. J., Van der Wees, P. J., & Dekker, J. (2004) · Clinical Rehabilitation · doi:10.1191/0269215504cr843oa · Cited by 942 · cited 1×
“One of the effective stroke rehabilitation approaches is physical therapy intervention with task-oriented exercises [21, 39, 47].”
BackgroundAn Efficient Boosting Algorithm for Combining Preferences
Freund, Y., Iyer, R. D., Schapire, R. E., & Singer, Y. (1998) · Cited by 806
Research works printed but not linked: 2
- 10.5555/645328.649997 · doi:10.5555/645328.649997
- Edward Taub , David M Morris , Jean Crago , Danna Kay King , Mary Bowman, Camille Bryson, Staci Bishop, Sonya Pearson, and Sharon E Shaw. 2011 . Wolf motor function test (WMFT) manual. Birmingham : University of Alabama, CI Therapy Research Group ( 2011). Edward Taub, David M Morris, Jean Crago, Danna Kay King, Mary Bowman, Camille Bryson, Staci Bishop, Sonya Pearson, and Sharon E Shaw. 2011. Wolf motor function test (WMFT) manual. Birmingham: University of Alabama, CI Therapy Research Group (2011).
Cited by
A review of computational approaches for evaluation of rehabilitation exercises
Liao, Y., Vakanski, A., Xian, M., Paul, D. R., & Baker, R. T. (2020) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2020.103687 · Cited by 172
“…New rehabilitation exercises require different rules to be designed [33]–[36], [49], [50], [61], [62], [73], [126], [127], [156], [182], [191]–[195] Template-based approaches Avoid the process of making rules; Can reflect the level of motor ability Only give a overall score for exercise…”
BackgroundA Human-AI Collaborative Approach for Clinical Decision Making on Rehabilitation Assessment
Lee, M. H., Siewiorek, D. P., Smailagic, A., Bernardino, A., & Bermúdez i Badia, S. B. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445472 · Cited by 137
“…of rehabilitation monitoring systems that focuses on improving the performance of monitoring and understanding an activity with a complex deep learning model [19, 34, 46, 49], our work highlights the importance of creating a human-centered, interactive approach for better deployment in practice.”
BackgroundMethodInfluentialSelf-citationA Survey of Human Gait-Based Artificial Intelligence Applications
Harris, E., Khoo, I., & Demircan, E. (2022) · Frontiers in Robotics and AI · doi:10.3389/frobt.2021.749274 · Cited by 165
“, 2019), while an inhome rehabilitation system provides qualitative and quantitative feedback to post-stroke survivors (Lee et al., 2019).”
BackgroundA Review of Recent Deep Learning Approaches in Human-Centered Machine Learning
Kaluarachchi, T. I., Reis, A., & Nanayakkara, S. C. (2021) · Sensors · doi:10.3390/s21072514 · Cited by 159
“[124], [125], [128], [175], [217] [69], [112], [113], [118], [130], [131], [133], [135], [137], [140], [144], [152], [153], [155]”
MethodSardari, S., Sharifzadeh, S., Daneshkhah, A., Nakisa, B., Loke, S. W., Palade, V., & Duncan, M. J. (2023) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2023.106835 · Cited by 118
Metadata
- Authors
- Lee, M. H., Siewiorek, D. P., Smailagic, A., Bernardino, A., & Badia, S. B. I.
- Affiliations
- Carnegie Mellon University (US)
- Instituto Superior Técnico (PT)
- Madeira Interactive Technology Institute
- Venue
- Proceedings of the 24th International Conference on Intelligent User Interfaces
- Publisher
- ACM
- Published
- 2019-03-17
- Pages
- 218-228
- OpenAlex
- W2915322498
- Cited by
- 71
- References
- 51
- Citations by year
- 2026: 6 · 2025: 12 · 2024: 11 · 2023: 13 · 2022: 12 · 2021: 5 · 2020: 10 · 2019: 2
- FWCI
- 22.36
- Type
- conference paper
- Language
- en
- Open access
- Locations
- ACM International Conference on Intelligent User Interfaces (IUI) (publishedVersion)
- Singapore Management University Institutional Knowledge (InK) (Singapore Management University) (submittedVersion, other-oa)
- Funders
- Fundação para a Ciência e a Tecnologia
- Topics
- Health Sciences › Medicine › Rehabilitation › Stroke Rehabilitation and Recovery
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Context-Aware Activity Recognition Systems
- Life Sciences › Neuroscience › Cognitive Neuroscience › Motor Control and Adaptation
- Keywords
- stroke rehabilitation, exercise quality assessment, task-oriented training, home-based rehabilitation, Kinect sensor, threshold model, Fugl-Meyer Assessment, motor impairment
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Learning to assess the quality of stroke rehabilitation exercises. https://app.cochat.ai/papers/10.1145/3301275.3302273
- The paper
- Lee, M. H., Siewiorek, D. P., Smailagic, A., Bernardino, A., & Badia, S. B. I. (2019). Learning to assess the quality of stroke rehabilitation exercises. Proceedings of the 24th International Conference on Intelligent User Interfaces. https://doi.org/10.1145/3301275.3302273
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.