The design of a real-time, multimodal biofeedback system for stroke patient rehabilitation
Abstract
This paper presents a novel real-time, multi-modal biofeedback system for stroke patient therapy. The problem is important as traditional mechanisms of rehabilitation are monotonous, and do not incorporate detailed quantitative assessment of recovery in addition to traditional clinical schemes. We have been working on developing an experiential media system that integrates task dependent physical therapy and cognitive stimuli within an interactive, multimodal environment. The environment provides a purposeful, engaging, visual and auditory scene in which patients can practice functional therapeutic reaching tasks, while receiving different types of simultaneous feedback indicating measures of both performance and results. There are three contributions of this paper - (a) identification of features and goals for the functional task (b) The development of sophisticated feedback (auditory and visual) mechanisms that match the semantics of action of the task. We additionally develop novel action-feedback coupling mechanisms. (c) New metrics to validate the ability of the system to promote learnability, stylization and engagement. We have validated the system for nine subjects with excellent results.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
An aesthetic audiovisual feedback design assisted subjects in reaching a movement goal in a reaching and grasping task.
“The audiovisual feedback assisted subjects in reaching the movement goal (Chen et al., 2006;Wallis et al., 2007).”
From Augmented visual, auditory, haptic, and multimodal feedback in motor learning: A review (2013) · cites this paper as Chen et al., 2006
A complex real-time sonification for arm movement mapped arm position to harmonics, smoothness to rhythm, and successful and compensatory movements to auditory alarms, with compensation severity mapped to loudness.
“Harmonics were used to represent arm position, rhythm represented the smoothness of the movement, and auditory alarms were used to indicate a successful movement, as well as a compensatory movement (the severity of the compensation was mapped to loudness) (Chen et al., 2006;Huang et al., 2005).”
From Augmented visual, auditory, haptic, and multimodal feedback in motor learning: A review (2013) · cites this paper as Chen et al., 2006
In a reaching task, representing kinematic variables each in a unimodal way, either visually or by sonification, produced an engaging multimodal feedback design that enhanced performance.
“Therewith, an engaging, multimodal feedback design was present that enhanced performance during the reaching task (Chen et al., 2006;Huang et al., 2005;Wallis et al., 2007).”
From Augmented visual, auditory, haptic, and multimodal feedback in motor learning: A review (2013) · cites this paper as Chen et al., 2006
Cited by
Sorted by citations
Augmented visual, auditory, haptic, and multimodal feedback in motor learning: A review
Sigrist, R., Rauter, G., Riener, R., & Wolf, P. (2013) · Psychonomic Bulletin & Review · doi:10.3758/s13423-012-0333-8 · Cited by 1,416 · see citing works
- Authors
- Chen, Y., Huang, H., Xu, W., Wallis, R. I., Sundaram, H., Rikakis, T., Ingalls, T., Olson, L., & He, J.
- Affiliations
- Arizona State University (US)
- Arizona State University
- Venue
- Proceedings of the 14th ACM international conference on Multimedia
- Publisher
- ACM
- Published
- 2006-10-23
- Pages
- 763-772
- OpenAlex
- W2141817033
- Cited by
- 56
- References
- 0
- Citations by year
- 2023: 2 · 2022: 2 · 2021: 2 · 2019: 3 · 2018: 2 · 2017: 2 · 2016: 1 · 2015: 4 · 2014: 3 · 2013: 5 · 2012: 5
- FWCI
- 8.78
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- ACM International Conference on Multimedia (ACM MM) (publishedVersion)
- Topics
- Health Sciences › Medicine › Rehabilitation › Stroke Rehabilitation and Recovery
- Life Sciences › Neuroscience › Cognitive Neuroscience › EEG and Brain-Computer Interfaces
- Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
- Keywords
- stroke rehabilitation, real-time feedback, auditory feedback, visual feedback, cognitive stimulation, patient engagement, learnability
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
