Measuring activities of daily living in stroke patients with motion machine learning algorithms: A pilot study
Open accessAbstract
Measuring activities of daily living (ADLs) using wearable technologies may offer higher precision and granularity than the current clinical assessments for patients after stroke. This study aimed to develop and determine the accuracy of detecting different ADLs using machine-learning (ML) algorithms and wearable sensors. Eleven post-stroke patients participated in this pilot study at an ADL Simulation Lab across two study visits. We collected blocks of repeated activity ("atomic" activity) performance data to train our ML algorithms during one visit. We evaluated our ML algorithms using independent semi-naturalistic activity data collected at a separate session. We tested Decision Tree, Random Forest, Support Vector Machine (SVM), and eXtreme Gradient Boosting (XGBoost) for model development. XGBoost was the best classification model. We achieved 82% accuracy based on ten ADL tasks. With a model including seven tasks, accuracy improved to 90%. ADL tasks included chopping food, vacuuming, sweeping, spreading jam or butter, folding laundry, eating, brushing teeth, taking off/putting on a shirt, wiping a cupboard, and buttoning a shirt. Results provide preliminary evidence that ADL functioning can be predicted with adequate accuracy using wearable sensors and ML. The use of external validation (independent training and testing data sets) and semi-naturalistic testing data is a major strength of the study and a step closer to the long-term goal of ADL monitoring in real-world settings. Further investigation is needed to improve the ADL prediction accuracy, increase the number of tasks monitored, and test the model outside of a laboratory setting.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In study [49], the best performance among the evaluated models was 82% accuracy.
“82%”
From Wearable sensors and machine learning in post-stroke rehabilitation assessment: A systematic review (2022) · cites this paper as [49]
The Results (§3.2) report 82% accuracy on the independent test set for the ten-task model, but 90% for the seven-task model. Thus 82% was a reported result, not the best accuracy reported in the paper. (LLM, conf=0.91)
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredData bias causing assessment algorithms not to generalise to new patients with different degrees of severity was very common among the reviewed papers, with researchers complaining about poor generalisation.
“In the same context, data bias which is another issue can cause the assessment algorithm to evolve in an unpredictable manner and not generalise to new patients that have different degrees of severity.This was very common among the reviewed papers, where researchers complained about their algorithms not generalising well.[41,49,52,58,60].”
From Wearable sensors and machine learning in post-stroke rehabilitation assessment: A systematic review (2022) · cites this paper as [49]
The Discussion says models trained on mild stroke patients may not generalise to patients with moderate or severe stroke, and calls generalisability a major concern. It does not establish that poor generalisation was very common among reviewed papers, that researchers reported their algorithms failing to generalise, or that data bias made algorithms evolve unpredictably. (LLM, conf=0.86)
Experimental — accuracy not yet measuredDesigning efficient ML-based assessment systems that generalise to new users requires a large number of participants with different and variant degrees of severity.
“In addition, in order to design efficient ML-based assessment systems that generalises to new users a large number of participants should take part with different and variant degrees of severity [43,48,49,69,70], which is not always available and taken into account.”
From Wearable sensors and machine learning in post-stroke rehabilitation assessment: A systematic review (2022) · cites this paper as [49]
The Discussion identifies the small sample as a limitation and calls for larger-scale data collection. It also warns that models trained on mild stroke patients may not generalize to moderate or severe cases. However, it does not establish that a large, severity-diverse participant group is required for a model that generalizes to new users; it leaves open whether one model or separate models would work across severity groups. (LLM, conf=0.82)
Experimental — accuracy not yet measuredIn activity recognition, researchers also covered kitchen tasks and routine activities such as making a drink, chopping food, making the bed, reading, lacing shoes, folding, sweeping, and brushing teeth.
“performing kitchen tasks like making a drink, chopping food [42] and other routine activities like making the bed, reading and lacing shoes [48], folding, sweeping and brushing teeth [46,48,49].”
From Wearable sensors and machine learning in post-stroke rehabilitation assessment: A systematic review (2022) · cites this paper as [49]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
XGBoost: A Scalable Tree Boosting System
Chen, T., & Guestrin, C. (2016) · Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2939672.2939785 · Cited by 54,569 · see citing works
The Elements of Statistical Learning
Hastie, T., Tibshirani, R., & Friedman, J. (2009) · Springer Series in Statistics · doi:10.1007/978-0-387-84858-7 · Cited by 25,970 · see citing works
A Unified Approach to Interpreting Model Predictions
Lundberg, S., & Lee, S.-I. (2017) · arXiv · doi:10.48550/arxiv.1705.07874 · Cited by 23,707 · see citing works
From local explanations to global understanding with explainable AI for trees
Lundberg, S. M., Erion, G., Chen, H., DeGrave, A., Prutkin, J. M., Nair, B., Katz, R., Himmelfarb, J., Bansal, N., & Lee, S.-I. (2020) · Nature Machine Intelligence · doi:10.1038/s42256-019-0138-9 · Cited by 10,551 · see citing works
‘Small Changes' to Diet and Physical Activity Behaviors for Weight Management
Hills, A. P., Byrne, N. M., Lindstrom, R. C., & Hill, J. O. (2013) · Obesity Facts · doi:10.1159/000345030 · Cited by 9,526 · see citing works
Heart Disease and Stroke Statistics—2020 Update: A Report From the American Heart Association
Virani, S. S., Alonso, A., Benjamin, E. J., Bittencourt, M. S., Callaway, C. W., Carson, A. P., Chamberlain, A. M., Chang, A. R., Cheng, S., Delling, F. N., et al. (2020) · Circulation · doi:10.1161/cir.0000000000000757 · Cited by 9,175 · see citing works
Physical Activity in the United States Measured by Accelerometer
TROIANO, R. P., BERRIGAN, D., DODD, K. W., MÂSSE, L. C., TILERT, T., & MCDOWELL, M. (2008) · Medicine & Science in Sports & Exercise · doi:10.1249/mss.0b013e31815a51b3 · Cited by 7,638 · see citing works
Activity Recognition from User-Annotated Acceleration Data
Bao, L., & Intille, S. S. (2004) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-24646-6_1 · Cited by 3,147 · see citing works
Deep learning for sensor-based activity recognition: A survey
Wang, J., Chen, Y., Hao, S., Peng, X., & Hu, L. (2019) · Pattern Recognition Letters · doi:10.1016/j.patrec.2018.02.010 · Cited by 2,014 · see citing works
Self-citationBergstra, J., Yamins, D. L. K., & Cox, D. (2013) · Digital Access to Scholarship at Harvard (DASH) (Harvard University) · Cited by 1,817 · see citing works
Learning from Imbalanced Data Sets
Fernández, A., García, S., Galar, M., Prati, R. C., Krawczyk, B., & Herrera, F. (2018) · doi:10.1007/978-3-319-98074-4 · Cited by 1,349 · see citing works
(2015) · neural information processing systems · Cited by 1,305 · see citing works
Activity, participation, and quality of life 6 months poststroke
Mayo, N. E., Wood-Dauphinée, S., Côté, R., Durcan, L., & Carlton, J. (2002) · Archives of Physical Medicine and Rehabilitation · doi:10.1053/apmr.2002.33984 · Cited by 839 · see citing works
Trull, T. J., & Ebner-Priemer, U. (2013) · Annual Review of Clinical Psychology · doi:10.1146/annurev-clinpsy-050212-185510 · Cited by 761 · see citing works
Human activity recognition from 3D data: A review
Aggarwal, J. K., & Xia, L. (2014) · Pattern Recognition Letters · doi:10.1016/j.patrec.2014.04.011 · Cited by 578 · see citing works
Functional Outcomes of Acute Medical Illness and Hospitalization in Older Persons
Sager, M. A. (1996) · Archives of Internal Medicine · doi:10.1001/archinte.1996.00440060067008 · Cited by 578 · see citing works
Sim, I. (2019) · New England Journal of Medicine · doi:10.1056/nejmra1806949 · Cited by 491 · see citing works
Nweke, H. F., Wah, T. Y., Mujtaba, G., & Al-Garadi, M. A. (2018) · Information Fusion · doi:10.1016/j.inffus.2018.06.002 · Cited by 400 · see citing works
Lang, C. E., Bland, M. D., Bailey, R. R., Schaefer, S. Y., & Birkenmeier, R. L. (2012) · Journal of Hand Therapy · doi:10.1016/j.jht.2012.06.005 · Cited by 388 · see citing works
Crichton, S. L., Bray, B., McKevitt, C., Rudd, A. G., & Wolfe, C. D. A. (2016) · Journal of Neurology Neurosurgery & Psychiatry · doi:10.1136/jnnp-2016-313361 · Cited by 361 · see citing works
Rubenstein, L. Z., Schairer, C., Wieland, G. D., & Kane, R. L. (1984) · Journal of Gerontology · doi:10.1093/geronj/39.6.686 · Cited by 346 · see citing works
Patient-proxy response comparability on measures of patient health and functional status
Magaziner, J., Simonsick, E. M., Kashner, T. M., & Hebel, J. R. (1988) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(88)90076-5 · Cited by 338 · see citing works
A Review on Human Activity Recognition Using Vision-Based Method
Zhang, S.-G., Wei, Z.-Q., Nie, J., Huang, L., Wang, S., & Li, Z. (2017) · Journal of Healthcare Engineering · doi:10.1155/2017/3090343 · Cited by 318 · see citing works
Alghamdi, M., Al-Mallah, M. H., Keteyian, S. J., Brawner, C. A., Ehrman, J. K., & Sakr, S. (2017) · PLoS ONE · doi:10.1371/journal.pone.0179805 · Cited by 303 · see citing works
A review on applications of activity recognition systems with regard to performance and evaluation
Ranasinghe, S., Machot, F. A., & Mayr, H. C. (2016) · International Journal of Distributed Sensor Networks · doi:10.1177/1550147716665520 · Cited by 215 · see citing works
Capela, N. A., Lemaire, E. D., & Baddour, N. (2015) · PLoS ONE · doi:10.1371/journal.pone.0124414 · Cited by 197 · see citing works
Wireless Sensor Networks Intrusion Detection Based on SMOTE and the Random Forest Algorithm
Tan, X., Su, S., Huang, Z., Guo, X., Zuo, Z., Sun, X., & Li, L. (2019) · Sensors · doi:10.3390/s19010203 · Cited by 189 · see citing works
Ecological momentary assessment in aging research: A critical review
Cain, A. E., Depp, C. A., & Jeste, D. V. (2009) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2009.01.014 · Cited by 164 · see citing works
An Accelerometry-Based Methodology for Assessment of Real-World Bilateral Upper Extremity Activity
Bailey, R. R., Klaesner, J. W., & Lang, C. E. (2014) · PLoS ONE · doi:10.1371/journal.pone.0103135 · Cited by 149 · see citing works
A Novel Ensemble Method for Imbalanced Data Learning: Bagging of Extrapolation-SMOTE SVM
Wang, Q., Luo, Z., Huang, J., Feng, Y., & Liu, Z. (2017) · Computational Intelligence and Neuroscience · doi:10.1155/2017/1827016 · Cited by 148 · see citing works
A Comprehensive Study of Activity Recognition Using Accelerometers
Twomey, N., Diethe, T., Fafoutis, X., Elsts, A., McConville, R., Flach, P., & Craddock, I. (2018) · Informatics · doi:10.3390/informatics5020027 · Cited by 143 · see citing works
A Comprehensive Study of Activity Recognition Using Accelerometers
Twomey, N., Diethe, T., Fafoutis, X., Elsts, A., McConville, R., Flach, P., & Craddock, I. (2018) · doi:10.20944/preprints201803.0147.v1 · Cited by 143 · see citing works
Capela, N. A., Lemaire, E. D., Baddour, N., Rudolf, M., Goljar, N., & Burger, H. (2016) · Journal of NeuroEngineering and Rehabilitation · doi:10.1186/s12984-016-0114-0 · Cited by 100 · see citing works
Automated daily human activity recognition for video surveillance using neural network
Babiker, M., Khalifa, O. O., Htike, K. K., et al. (2017) · 2017 IEEE 4th International Conference on Smart Instrumentation, Measurement and Application (ICSIMA) · doi:10.1109/icsima.2017.8312024 · Cited by 100 · see citing works
Galperin, I., Hillel, I., Din, S. D., Bekkers, E. M. J., Nieuwboer, A., Abbruzzese, G., Avanzino, L., Nieuwhof, F., Bloem, B. R., Rochester, L., et al. (2019) · Parkinsonism & Related Disorders · doi:10.1016/j.parkreldis.2019.01.022 · Cited by 96 · see citing works
Review of Accelerometry for Determining Daily Activity Among Elderly Patients
Cheung, V., Gray, L., & Karunanithi, M. (2011) · Archives of Physical Medicine and Rehabilitation · doi:10.1016/j.apmr.2010.12.040 · Cited by 87 · see citing works
Bailey, R. R., Birkenmeier, R. L., & Lang, C. E. (2015) · Topics in Stroke Rehabilitation · doi:10.1179/1074935714z.0000000040 · Cited by 58 · see citing works
Lehman, L.-W. H., Mark, R. G., & Nemati, S. (2016) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2016.2636808 · Cited by 21 · see citing works
Mast, B. T., Azar, A. R., MacNeill, S. E., & Lichtenberg, P. A. (2004) · Rehabilitation Psychology · doi:10.1037/0090-5550.49.3.219 · Cited by 20 · see citing works
Ng, S. S. M., William, T. W. N., Kwong, P. W.-H., et al. (2011) · South African Journal of Physiotherapy · doi:10.4102/sajp.v67i1.34 · Cited by 7 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Wearable sensors and machine learning in post-stroke rehabilitation assessment: A systematic review
Boukhennoufa, I., Zhai, X., Utti, V., Jackson, J., & McDonald-Maier, K. D. (2022) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2021.103197 · Cited by 180 · see citing works
- Authors
- Chen, P.-W., Baune, N. A., Zwir, I., Wang, J., Swamidass, V., & Wong, A. W. K.
- Affiliations
- Washington University in St. Louis (US)
- Universidad de Granada (ES)
- PlatformSTL, St. Louis, MO 63110, USA
- Shirley Ryan AbilityLab (US)
- Corresponding author
- Wong, Alex W.K.
- Venue
- International Journal of Environmental Research and Public Health
- Publisher
- MDPI AG
- Published
- 2021-02-09
- Volume
- 18
- Issue
- 4
- Pages
- 1634
- ISSN
- 1660-4601 (ISSN-L)
- PMC
- PMC7915561
- OpenAlex
- W3126701990
- Cited by
- 41
- References
- 40
- Citations by year
- 2026: 6 · 2025: 3 · 2024: 8 · 2023: 12 · 2022: 8 · 2021: 4
- FWCI
- 2.88
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- International Journal of Environmental Research and Public Health (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Digital Commons@Becker (Washington University School of Medicine) (submittedVersion)
- Institutional Repository of the University of Granada (University of Granada) (submittedVersion, cc-by-nc-nd)
- RePEc: Research Papers in Economics (submittedVersion)
- Institutional Repository of the University of Granada (University of Granada) (submittedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- Funders
- National Institute on Disability, Independent Living, and Rehabilitation Research (90BISA0015)
- National Center for Medical Rehabilitation Research (K01HD095388)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Context-Aware Activity Recognition Systems
- Health Sciences › Medicine › Rehabilitation › Stroke Rehabilitation and Recovery
- Health Sciences › Health Professions › Health Information Management › Artificial Intelligence in Healthcare
- Keywords
- activities of daily living, stroke, wearable sensors, motion sensing, machine learning classification, XGBoost, stroke rehabilitation, activity recognition, external validation
- MeSH terms
- Machine Learning, Activities of Daily Living, Algorithms, Humans, Pilot Projects, Stroke
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review