Developing and testing a telerehabilitation system for people following stroke: issues of usability
Abstract
This paper describes user testing of a technological system which enables stroke survivors to independently undertake rehabilitation exercises at home. The prototype is based on advanced movement sensors which are worn by the user when performing prescribed exercises. Sensor data are transmitted to a computer which displays the user's movements and progress. The number and type of sensors, methods of attaching them to the user's body in the correct locations, the type of computer screen and the input devices were changed and refined as the project progressed in response to feedback from people with stroke, their carers and physiotherapists. Home-based testing of the system highlighted usability issues concerned with the appropriateness and acceptability of the equipment in domestic settings, the sensors and methods of attachment, and use of, and interpretation of the screen presentation. Users required education as well as support throughout the testing period. Increasing sophistication of the technological aspects of the system over time resolved some usability issues but also created others, as did meeting the aims of improved clinical utility. The interplay between technology development, clinical utility and usability must be taken into account for devices to be successfully developed for practice.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Participants with stroke and Parkinson's disease described that wearables did not impact their daily activities.
“Participants with stroke and PD described that wearables did not impact their daily activities [64, 65, 68, 69].”
From Wearable sensors for clinical applications in epilepsy, Parkinson’s disease, and stroke: A mixed-methods systematic review (2018) · cites this paper as [68]
Some participants with stroke felt that extra help would be needed to put the wrist sensors on.
“The participants found that wrist-worn sensors were easy to put on and take off [64]; however, in other studies, some participants with stroke felt that extra help would be needed to put the wrist sensors on but the sensors were comfortable to wear during daily activities [65, 68, 69].”
From Wearable sensors for clinical applications in epilepsy, Parkinson’s disease, and stroke: A mixed-methods systematic review (2018) · cites this paper as [68]
The sensors were comfortable to wear during daily activities for some participants with stroke.
“The participants found that wrist-worn sensors were easy to put on and take off [64]; however, in other studies, some participants with stroke felt that extra help would be needed to put the wrist sensors on but the sensors were comfortable to wear during daily activities [65, 68, 69].”
From Wearable sensors for clinical applications in epilepsy, Parkinson’s disease, and stroke: A mixed-methods systematic review (2018) · cites this paper as [68]
Participants with stroke wanted repeated instructions, confirmation, supervised practice, and external support for technical problems in follow-up sessions to improve their confidence.
“They wanted repeated instructions, confirmation, supervised practice, and external support for technical problems in follow-up sessions to improve their confidence [68, 69].”
From Wearable sensors for clinical applications in epilepsy, Parkinson’s disease, and stroke: A mixed-methods systematic review (2018) · cites this paper as [68]
Participants with stroke felt a need for clear instructions on how to use the device, including how to wear and operate it.
“Participants with stroke felt a need for clear instructions on how to use the device, including both how to wear and how to operate it [68].”
From Wearable sensors for clinical applications in epilepsy, Parkinson’s disease, and stroke: A mixed-methods systematic review (2018) · cites this paper as [68]
Participants with Parkinson's disease and stroke experienced that keeping and placing the sensors at correct positions was difficult.
“They experienced that keeping and placing the sensors at correct positions were difficult [64, 68, 69]”
From Wearable sensors for clinical applications in epilepsy, Parkinson’s disease, and stroke: A mixed-methods systematic review (2018) · cites this paper as [68]
Participants with Parkinson's disease and stroke worried that unpredictable technical errors would lead to confusion about how to handle the wearables.
“They worried that unpredictable technical errors would lead to confusion about how to handle the wearables [68].”
From Wearable sensors for clinical applications in epilepsy, Parkinson’s disease, and stroke: A mixed-methods systematic review (2018) · cites this paper as [68]
Wearables need to be small and non-obtrusive according to participants.
“Wearables need to be small and non-obtrusive [64, 65, 68, 69]”
From Wearable sensors for clinical applications in epilepsy, Parkinson’s disease, and stroke: A mixed-methods systematic review (2018) · cites this paper as [68]
Participants with Parkinson's disease and stroke described that wearables should be easy to learn and use.
“Participants with PD and stroke described that wearables should be easy to learn and use [65, 66, 68, 69].”
From Wearable sensors for clinical applications in epilepsy, Parkinson’s disease, and stroke: A mixed-methods systematic review (2018) · cites this paper as [68]
Individuals with epilepsy, Parkinson's disease, and stroke reported a wide spectrum of expectations in terms of usability of wearables.
“Individuals with epilepsy, PD, and stroke reported a wide spectrum of expectations in terms of usability of wearables [65–69].”
From Wearable sensors for clinical applications in epilepsy, Parkinson’s disease, and stroke: A mixed-methods systematic review (2018) · cites this paper as [68]
Cites
The Atlas of Heart Disease and Stroke
Mackay, J., Mensah, G. A., & Mendis, S. (2004) · Medical Entomology and Zoology · Cited by 1,550 · see citing works
National Clinical Guidelines for Stroke.
Robinson, T. G. (2001) · Postgraduate Medical Journal · doi:10.1136/pmj.77.906.286h · Cited by 608 · see citing works
Holland, K. (2008) · Nurse Education in Practice · doi:10.1016/j.nepr.2008.07.004 · Cited by 589 · see citing works
Web-based telerehabilitation for the upper extremity after stroke
Reinkensmeyer, D. J., Pang, C. T., Nessler, J. A., & Painter, C. C. (2002) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2002.1031978 · Cited by 291 · see citing works
Position-sensing technologies for movement analysis in stroke rehabilitation
Zheng, H., Black, N. D., & Harris, N. D. (2005) · Medical & Biological Engineering & Computing · doi:10.1007/bf02344720 · Cited by 165 · see citing works
Self-citationIEEE Transactions on Rehabilitation Engineering
(2021) · IEEE Transactions on Rehabilitation Engineering · doi:10.1109/tre.86 · Cited by 98 · see citing works
Tousignant, M., Boissy, P., Corriveau, H., & Moffet, H. (2006) · Disability and Rehabilitation Assistive Technology · doi:10.1080/17483100600776965 · Cited by 91 · see citing works
Development of a teletechnology protocol for in-home rehabilitation
Hoenig, H., Sanford, J. A., Butterfield, T., Griffiths, P. C., Richardson, P., & Hargraves, K. (2006) · The Journal of Rehabilitation Research and Development · doi:10.1682/jrrd.2004.07.0089 · Cited by 90 · see citing works
Human factors in the development and implementation of telerehabilitation systems
Brennan, D., & Steege, L. M. B. (2008) · Journal of Telemedicine and Telecare · doi:10.1258/jtt.2007.007040 · Cited by 87 · see citing works
Home Stroke Rehabilitation for the Upper Limbs
Willmann, R. D., Lanfermann, G., Saini, P. K., Timmermans, A. A. A., Vrugt, J. T., & Winter, S. (2007) · Conference proceedings · doi:10.1109/iembs.2007.4353214 · Cited by 58 · see citing works
Zheng, H., Davies, R. J., Zhou, H., Hammerton, J., Mawson, S., Ware, P., Black, N. D., Eccleston, C., Hu, H., Stone, T., et al. (2006) · International Journal on Disability and Human Development · doi:10.1515/ijdhd.2006.5.3.271 · Cited by 36 · see citing works
Self-citationMountain, G. A., Ware, P., Hammerton, J., Mawson, S., Zheng, H., Davies, R. J., Black, N. D., Zhou, H., Hu, H., Harris, N. D., et al. (2006) · Springer eBooks · doi:10.1007/1-84628-365-5_14 · Cited by 18 · see citing works
Self-citationUsing the Evidence to Develop Quality Assistive Technology Services
Mountain, G. A. (2004) · Journal of Integrated Care · doi:10.1108/14769018200400005 · Cited by 18 · see citing works
Self-citationDeveloping a Telemonitoring System for Stroke Rehabilitation
Wilson, S. (2018) · Taylor & Francis eBooks · doi:10.1201/9781315106595-80 · Cited by 10 · see citing works
Self-citationDiamond, B. J. (2003) · Neurorehabilitation · doi:10.3233/nre-2003-18201 · Cited by 5 · see citing works
IEEE Engineering in Medicine and Biology Society
(1987) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.1987.326022 · Cited by 3 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Smart wearable systems: Current status and future challenges
Chan, M., Estève, D., Fourniols, J.-Y., Escriba, C., & Campo, E. (2012) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2012.09.003 · Cited by 953 · see citing works
Body-Worn Sensor Design: What Do Patients and Clinicians Want?
Bergmann, J., & McGregor, A. H. (2011) · Annals of Biomedical Engineering · doi:10.1007/s10439-011-0339-9 · Cited by 216 · see citing works
Johansson, D., Malmgren, K., & Alt Murphy, M. (2018) · Journal of Neurology · doi:10.1007/s00415-018-8786-y · Cited by 188 · see citing works
Usability in telemedicine systems—A literature survey
Klaassen, B., van Beijnum, B.-J. F., & Hermens, H. J. (2016) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2016.06.004 · Cited by 152 · see citing works
A Human-AI Collaborative Approach for Clinical Decision Making on Rehabilitation Assessment
Lee, M. H., Siewiorek, D. P., Smailagic, A., Bernardino, A., & Bermúdez i Badia, S. B. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445472 · Cited by 137 · see citing works
Wearables in epilepsy and Parkinson's disease—A focus group study
Ozanne, A., Johansson, D., Hällgren Graneheim, U., Malmgren, K., Bergquist, F., & Alt Murphy, M. (2018) · Acta Neurologica Scandinavica · doi:10.1111/ane.12798 · Cited by 87 · see citing works
Sequence Learning with Passive RFID Sensors for Real-Time Bed-Egress Recognition in Older People
Wickramasinghe, A., Ranasinghe, D. C., Fumeaux, C., Hill, K., & Visvanathan, R. (2016) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2016.2576285 · Cited by 72 · see citing works
Wishart, L. R., Ward, E. C., Cartmill, B., Hill, A. J., & Porceddu, S. V. (2015) · Journal of Telemedicine and Telecare · doi:10.1177/1357633x15617887 · Cited by 67 · see citing works
Mawson, S., Nasr, N., Parker, J. C., Zheng, H., Davies, R. J., & Mountain, G. A. (2013) · Disability and Rehabilitation Assistive Technology · doi:10.3109/17483107.2013.840863 · Cited by 63 · see citing works
Self-citationTelerehabilitation and emerging virtual reality approaches to stroke rehabilitation
Putrino, D. F. (2014) · Current Opinion in Neurology · doi:10.1097/wco.0000000000000152 · Cited by 63 · see citing works
Mawson, S., Nasr, N., Parker, J., Davies, R. J., Zheng, H., & Mountain, G. A. (2016) · JMIR Rehabilitation and Assistive Technologies · doi:10.2196/rehab.5079 · Cited by 51 · see citing works
Self-citationVirtual rehabilitation: What are the practical barriers for home-based research?
Threapleton, K., Drummond, A. E., & Standen, P. (2016) · Digital Health · doi:10.1177/2055207616641302 · Cited by 44 · see citing works
Khanna, M., Gowda, G. S., Bagevadi, V. I., Gupta, A., Kulkarni, K. R., Shyam, R. P. S., Basavaraju, V., Ramesh, M. B., Shashidhara, H. N., Manjunatha, N., et al. (2018) · Journal of Neurosciences in Rural Practice · doi:10.4103/jnrp.jnrp_104_18 · Cited by 41 · see citing works
Parker, J. C., Mountain, G. A., & Hammerton, J. (2011) · Disability and Rehabilitation Assistive Technology · doi:10.3109/17483107.2011.556209 · Cited by 41 · see citing works
Self-citationParker, J. C., Mawson, S., Mountain, G. A., Nasr, N., & Zheng, H. (2014) · BMC Medical Informatics and Decision Making · doi:10.1186/1472-6947-14-46 · Cited by 40 · see citing works
Self-citationMorse, H., Biggart, L., Pomeroy, V. M., & Rossit, S. (2020) · Neuropsychological Rehabilitation · doi:10.1080/09602011.2020.1819827 · Cited by 39 · see citing works
Modular Integration of a Passive RFID Sensor With Wearable Textile Antennas for Patient Monitoring
Dang, Q. H., Chen, S. J., Ranasinghe, D. C., & Fumeaux, C. (2020) · IEEE Transactions on Components Packaging and Manufacturing Technology · doi:10.1109/tcpmt.2020.3036045 · Cited by 37 · see citing works
Wentink, M. M., van Bodegom‐Vos, L., Brouns, B., Arwert, H. J., Houdijk, S., Kewalbansing, P., Boyce, L. W., Vlieland, T. P. M. V., de Kloet, A. J., & Meesters, J. J. L. (2019) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-019-0871-3 · Cited by 36 · see citing works
Literature review on wearable systems in upper extremity rehabilitation
Wang, Q., Chen, W., & Markopoulos, P. (2014) · IEEE-EMBS International Conference on Biomedical and Health Informatics (BHI ...) · doi:10.1109/bhi.2014.6864424 · Cited by 35 · see citing works
Wearables for Neurologic Conditions
Minen, M. T., & Stieglitz, E. J. (2020) · Neurology Clinical Practice · doi:10.1212/cpj.0000000000000971 · Cited by 28 · see citing works
Using Technology to Enhance the Aging Experience: A Market Analysis of Existing Technologies
Goldwater, J. C., & Harris, Y. (2010) · Ageing International · doi:10.1007/s12126-010-9071-2 · Cited by 27 · see citing works
Virtual reality applications in neurorehabilitation
Weiss, P. L., Kizony, R., Feintuch, U., Rand, D., & Katz, N. (2014) · Cambridge University Press eBooks · doi:10.1017/cbo9780511995590.021 · Cited by 27 · see citing works
Parker, J. C., Mawson, S., Mountain, G. A., Nasr, N., Davies, R. J., & Zheng, H. (2013) · Disability and Rehabilitation Assistive Technology · doi:10.3109/17483107.2013.845611 · Cited by 25 · see citing works
Self-citationEvaluation of a Tele-Health System for upper extremity stroke rehabilitation
Kizony, R., Weiss, P. L., Feldman, Y., Shani, M., Elion, O., Kizony, R., Weiss, P. L., Kizony, R., Harel, S., & Baum-Cohen, I. (2013) · International Conference on Virtual Rehabilitation · doi:10.1109/icvr.2013.6662096 · Cited by 23 · see citing works
Davies, R. J., Parker, J., McCullagh, P. J., Zheng, H., Nugent, C., Black, N. D., & Mawson, S. (2016) · JMIR Rehabilitation and Assistive Technologies · doi:10.2196/rehab.5449 · Cited by 23 · see citing works
Self-citationDevelopment and validation of tele-health system for stroke rehabilitation
Kizony, R., Weiss, P. L., Elion, O., Harel, S., Baum-Cohen, I., Krasovsky, T., Feldman, Y., & Shani, M. (2014) · International Journal on Disability and Human Development · doi:10.1515/ijdhd-2014-0329 · Cited by 21 · see citing works
Murphy, M. A., Bergquist, F., Hagström, B., Hernández, N., Johansson, D., Ohlsson, F., Sandsjö, L., Wipenmyr, J., & Malmgren, K. (2019) · BMC Biomedical Engineering · doi:10.1186/s42490-019-0002-3 · Cited by 21 · see citing works
Ward, E. C., Wishart, L. R., Burns, C. L., Cartmill, B., & Hill, A. J. (2017) · Current Opinion in Otolaryngology & Head & Neck Surgery · doi:10.1097/moo.0000000000000357 · Cited by 20 · see citing works
Feature rich, but user-friendly: speech pathologists' preferences for computer-based aphasia therapy
Swales, M. A., Hill, A. J., & Finch, E. (2016) · International Journal of Speech-Language Pathology · doi:10.3109/17549507.2015.1081283 · Cited by 18 · see citing works
Hassett, L. M., van den Berg, M., Weber, H., Chagpar, S., Wong, S., Rabie, A., McCluskey, A., Lindley, R. I., Crotty, M., & Sherrington, C. (2020) · Disability and Rehabilitation · doi:10.1080/09638288.2020.1790679 · Cited by 16 · see citing works
Gooch, H. J., Jarvis, K. A., & Stockley, R. (2023) · Journal of Medical Internet Research · doi:10.2196/48725 · Cited by 15 · see citing works
Ball, A. L., de Riesthal, M. R., & Steele, R. D. (2018) · American Journal of Speech-Language Pathology · doi:10.1044/2017_ajslp-16-0204 · Cited by 13 · see citing works
Selzer, M. E., Clarke, S., Cohen, L. G., Kwakkel, G., & Miller, R. H. (2014) · Cambridge University Press eBooks · doi:10.1017/cbo9780511995590.012 · Cited by 12 · see citing works
Bed occupancy monitoring: Data processing and clinician user interface design
Pouliot, M., Joshi, V., Goubran, R. A., & Knoefel, F. D. (2012) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc.2012.6347315 · Cited by 10 · see citing works
Narbutaitienė, J., Carlstedt, A. B., & Fischl, C. (2023) · Disability and Rehabilitation Assistive Technology · doi:10.1080/17483107.2023.2174605 · Cited by 9 · see citing works
Ouédraogo, F., Demers, M., Menezes, K. V. R. S., Labbé, D. R., Lebel, K., Brière, S., Levin, M. F., Tousignant, M., & Kairy, D. (2025) · Journal of NeuroEngineering and Rehabilitation · doi:10.1186/s12984-025-01861-z · Cited by 7 · see citing works
Galliers, J., & Wilson, S. (2013) · Electronic workshops in computing · doi:10.14236/ewic/hci2013.35 · Cited by 7 · see citing works
Self-citationDigital motion analysis system for rehabilitation using wearable sensors
Oarde, D. E., Libatique, N. J. C., Tangonan, G. L., Sotto, D. M., & Pacaldo, A. T. (2014) · International Conference on Humanoid, Nanotechnology, Information Technology,Communication and Control, Environment and Management · doi:10.1109/hnicem.2014.7016235 · Cited by 7 · see citing works
Ellis, H., Allsopp, L., Tourle, K., Moore, K., Potter, K.-J., & Dharm-Datta, S. (2022) · Future Healthcare Journal · doi:10.7861/fhj.2021-0053 · Cited by 5 · see citing works
Bellal, S. E., Mouss, L. H., Sahnoun, M., & Messaadia, M. (2020) · Disability and Rehabilitation Assistive Technology · doi:10.1080/17483107.2020.1791263 · Cited by 5 · see citing works
How Artificial Intelligence Challenges Tailorable Technology Design
Fechner, P., König, F., Lockl, J., & Röglinger, M. (2024) · Business & Information Systems Engineering · doi:10.1007/s12599-024-00872-9 · Cited by 4 · see citing works
Sgherri, G., Avola, M., Beani, E., Chisari, C., Cioni, G., & Sgandurra, G. (2019) · Cited by 4 · see citing works
An adaptive design approach for AIGC-based VR rehabilitation training systems
Bu, L., Qu, J., Ding, J., Wang, C., Li, X., & Shi, P. (2025) · Journal of Engineering Design · doi:10.1080/09544828.2025.2540239 · Cited by 2 · see citing works
Enhancing dialogues between rehabilitation patients and therapists using visualisation software
Loudon, D. W., & Macdonald, A. S. (2011) · International Conference on Pervasive Computing Technologies for Healthcare · doi:10.4108/icst.pervasivehealth.2011.246036 · Cited by 1 · see citing works
Ng, E. (2011) · TSpace (University of Toronto) · Cited by 1 · see citing works
Requirements and Conceptual Architecture
Krukowski, A., Vogiatzaki, E., & Ortmann, S. (2015) · Springer eBooks · doi:10.1007/978-3-319-21293-7_2
Changing Trends from Traditional to Technology Based Approach
Ali, N. (2018) · Linguistics and Literature Review · doi:10.32350/llr.v4i1.277
- Authors
- Mountain, G., Wilson, S., Eccleston, C., Mawson, S., Hammerton, J., Ware, T., Zheng, H., Davies, R., Black, N., Harris, N., Stone, T., & Hu, H.
- Affiliations
- University of Sheffield (GB)
- University of Bath (GB)
- d Centre for Health and Social Care Research , Sheffield Hallam University , Sheffield, UK
- Sheffield Hallam University (GB)
- University of Ulster (GB)
- g West Midlands Rehabilitation Centre , Birmingham, UK
- University of Essex (GB)
- Corresponding author
- Mountain, Gail
- ORCID
- Venue
- Journal of Engineering Design
- Publisher
- Informa UK Limited
- Published
- 2010-01-21
- Volume
- 21
- Issue
- 2-3
- Pages
- 223-236
- ISSN
- 0954-4828 (ISSN-L)
- 1466-1837
- OpenAlex
- W1969257430
- Cited by
- 48
- References
- 16
- Citations by year
- 2025: 2 · 2024: 1 · 2023: 2 · 2022: 1 · 2021: 1 · 2020: 5 · 2019: 3 · 2018: 4 · 2017: 2 · 2016: 5 · 2015: 3 · 2014: 8 · 2013: 4 · 2012: 2
- FWCI
- 3.65
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Journal of Engineering Design (publishedVersion)
- SHURA (Sheffield Hallam University Research Archive) (Sheffield Hallam University) (submittedVersion)
- Funders
- Royal Society
- Stroke Association
- Engineering and Physical Sciences Research Council (EP/F001916/1)
- Topics
- Health Sciences › Medicine › Rehabilitation › Stroke Rehabilitation and Recovery
- Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
- Social Sciences › Demography › Technology Use by Older Adults
- Keywords
- telerehabilitation, stroke rehabilitation, home-based rehabilitation, usability, user testing, stroke survivors, caregivers, physiotherapists, clinical utility, sensor attachment, library instruction
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
