A Kinect-based system for cognitive rehabilitation exercises monitoring
Abstract
In this paper, a 3D computer vision system for cognitive assessment and rehabilitation based on the Kinect device is presented. It is intended for individuals with body scheme dysfunctions and left-right confusion. The system processes depth information to overcome the shortcomings of a previously presented 2D vision system for the same application. It achieves left and right-hand tracking, and face and facial feature detection (eye, nose, and ears) detection. The system is easily implemented with a consumer-grade computer and an affordable Kinect device and is robust to drastic background and illumination changes. The system was tested and achieved a successful monitoring percentage of 96.28%. The automation of the human body parts motion monitoring, its analysis in relation to the psychomotor exercise indicated to the patient, and the storage of the result of the realization of a set of exercises free the rehabilitation experts of doing such demanding tasks. The vision-based system is potentially applicable to other tasks with minor changes.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Cites
Differential geometry of curves and surfaces
(2011) · Choice Reviews Online · doi:10.5860/choice.48-3330 · Cited by 3,776 · see citing works
Empirical Analysis of Detection Cascades of Boosted Classifiers for Rapid Object Detection
Lienhart, R., Kuranov, A., & Pisarevsky, V. (2003) · DAGM-Symposium · doi:10.1007/978-3-540-45243-0_39 · Cited by 976 · see citing works
Differential Geometry of Curves and Surfaces
Banchoff, T., & Lovett, S. (2016) · Chapman & Hall/CRC eBooks · doi:10.1201/b18913 · Cited by 842 · see citing works
Human motion tracking for rehabilitation-A survey
Zhou, H., & Hu, H. (2008) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2007.09.001 · Cited by 813 · see citing works
Chang, Y., Chen, S.-F., & Huang, J.-D. (2011) · Research in Developmental Disabilities · doi:10.1016/j.ridd.2011.07.002 · Cited by 754 · see citing works
Effectiveness of Virtual Reality Using Wii Gaming Technology in Stroke Rehabilitation
Saposnik, G., Teasell, R. W., Mamdani, M., Hall, J., McIlroy, W. E., Cheung, D., Thorpe, K. E., Cohen, L. G., & Bayley, M. T. (2010) · Stroke · doi:10.1161/strokeaha.110.584979 · Cited by 722 · see citing works
An overview of the Internet of Things for people with disabilities
Domingo, M. C. (2012) · Journal of Network and Computer Applications · doi:10.1016/j.jnca.2011.10.015 · Cited by 638 · see citing works
Clinical Decision-Support Systems
Musen, M. A., Blackford Middleton, A., & Greenes, R. A. (2013) · Springer eBooks · doi:10.1007/978-1-4471-4474-8_22 · Cited by 577 · see citing works
Proceedings, 1989 International Conference on Robotics and Automation
(1989) · doi:10.1109/robot.1989 · Cited by 535 · see citing works
Betke, M., Gips, J., & Fleming, P. (2002) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2002.1021581 · Cited by 533 · see citing works
Invariant surface characteristics for 3D object recognition in range images
Besl, P. J., & Jain, R. (1986) · Computer Vision Graphics and Image Processing · doi:10.1016/0734-189x(86)90220-3 · Cited by 517 · see citing works
Evaluation of the Kinect™ sensor for 3-D kinematic measurement in the workplace
Dutta, T. (2011) · Applied Ergonomics · doi:10.1016/j.apergo.2011.09.011 · Cited by 437 · see citing works
Localization in Neuropsychology
Wyke, M. (1984) · Journal of Neurology Neurosurgery & Psychiatry · doi:10.1136/jnnp.47.4.433-b · Cited by 422 · see citing works
MULTIPLE REPRESENTATIONS CONTRIBUTE TO BODY KNOWLEDGE PROCESSING
Angela Sirigu, B., Grafman, J. H., BRESSLER, K., & Sunderland, T. (1991) · Brain · doi:10.1093/brain/114.1.629 · Cited by 301 · see citing works
Real-time identification and localization of body parts from depth images
Plagemann, C., Ganapathi, V., Koller, D., & Thrun, S. (2010) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/robot.2010.5509559 · Cited by 275 · see citing works
Towards Pervasive Physical Rehabilitation Using Microsoft Kinect
Chang, C., Lange, B. S., Zhang, M., Koenig, S. T., Requejo, P., Somboon, N., Sawchuk, A. A., & Rizzo, A. (2012) · International Conference on Pervasive Computing Technologies for Healthcare · doi:10.4108/icst.pervasivehealth.2012.248714 · Cited by 263 · see citing works
Localization in neuropsychology
KERTESZ, A. E. (1983) · Academic Press eBooks · Cited by 244 · see citing works
Effects of virtual reality training on gait biomechanics of individuals post-stroke
Mirelman, A., Patritti, B. L., Bonato, P., & Deutsch, J. E. (2010) · Gait & Posture · doi:10.1016/j.gaitpost.2010.01.016 · Cited by 210 · see citing works
Clinical Decision Support Systems
(2016) · Health informatics · doi:10.1007/978-3-319-31913-1 · Cited by 196 · see citing works
Human skeleton tracking from depth data using geodesic distances and optical flow
Schwarz, L., Mkhitaryan, A., Mateus, D., & Navab, N. (2011) · Image and Vision Computing · doi:10.1016/j.imavis.2011.12.001 · Cited by 185 · see citing works
Evidence for a Disturbance of the Body Schema in Neglect
Coslett, H. B. (1998) · Brain and Cognition · doi:10.1006/brcg.1998.1011 · Cited by 167 · see citing works
Development of virtual reality proprioceptive rehabilitation system for stroke patients
Cho, S., Ku, J. H., Cho, Y. K., et al. (2013) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2013.09.006 · Cited by 111 · see citing works
Higher‐order Motor Disorders: From Neuroanatomy and Neurobiology to Clinical Neurology
Jellinger, K. A. (2005) · European Journal of Neurology · doi:10.1111/j.1468-1331.2005.01244.x · Cited by 107 · see citing works
Virtual reality rehabilitation for all: Vivid GX versus Sony PlayStation II EyeToy
Rand, D., Kizony, R., & Weiss, P. L. (2004) · Cited by 105 · see citing works
da Costa, R. M. E. M., & de Carvalho, L. A. V. (2003) · Computer Methods and Programs in Biomedicine · doi:10.1016/s0169-2607(03)00066-x · Cited by 102 · see citing works
Robust real-time 3D head pose estimation from range data
Malassiotis, S., & Strintzis, M. G. (2005) · Pattern Recognition · doi:10.1016/j.patcog.2004.11.020 · Cited by 99 · see citing works
The Concept of the Body Schema: A Critical Review and Some Experimental Results
Poeck, K., & Orgass, B. (1971) · Cortex · doi:10.1016/s0010-9452(71)80005-9 · Cited by 85 · see citing works
Hands-free vision-based interface for computer accessibility
Varona, J., Manresa-Yee, C., & Perales, F. J. (2008) · Journal of Network and Computer Applications · doi:10.1016/j.jnca.2008.03.003 · Cited by 85 · see citing works
Elmezain, M., Al-Hamadi, A. K., & Michaelis, B. (2008) · Digital Library (University of West Bohemia) · Cited by 81 · see citing works
Vision-based motion detection, analysis and recognition of epileptic seizures—A systematic review
Pediaditis, M., Tsiknakis, M., & Leitgeb, N. (2012) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2012.08.005 · Cited by 76 · see citing works
Zannatha, J. M. I., Tamayo, A. J. M., Sánchez, Á. D. G., et al. (2013) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2013.04.021 · Cited by 72 · see citing works
Auto-adaptive robot-aided therapy using machine learning techniques
Badesa, F. J., Morales, R., García-Aracil, N., Sabater-Navarro, J. M., Casals, A., & Zollo, L. (2013) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2013.09.011 · Cited by 70 · see citing works
Higher-order motor disorders : from neuroanatomy and neurobiology to clinical neurology
Freund, H. ‐. (2005) · Cited by 69 · see citing works
Virtual rehabilitation after stroke.
Broeren, J., Björkdahl, A., Claesson, L., Goude, D., Lundgren‐Nilsson, Å., Samuelsson, H., Blomstrand, C., Sunnerhagen, K. S., & Rydmark, M. (2008) · PubMed · Cited by 61 · see citing works
Avola, D., Spezialetti, M., & Placidi, G. (2013) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2013.01.009 · Cited by 60 · see citing works
Design of a computer game using an eye-tracking device for eye's activity rehabilitation
Lin, C., Huan, C.-C., Chan, C.-N., et al. (2003) · Optics and Lasers in Engineering · doi:10.1016/s0143-8166(03)00075-7 · Cited by 59 · see citing works
Validity of a Virtual Environment for Stroke Rehabilitation
Edmans, J., Gladman, J. R. F., Cobb, S. V. G., Sunderland, A., Pridmore, T., Hilton, D., & Walker, M. F. (2006) · Stroke · doi:10.1161/01.str.0000245133.50935.65 · Cited by 58 · see citing works
A kinect-based vocational task prompting system for individuals with cognitive impairments
Chang, Y., Chou, L., Wang, T.-Y., et al. (2011) · Personal and Ubiquitous Computing · doi:10.1007/s00779-011-0498-6 · Cited by 57 · see citing works
Virtual Reality System for Multiple Sclerosis Rehabilitation using KINECT
Lozano-Quilis, J.-A., Albiol-Pérez, S., Gil-Gómez, H., Palacios-Navarro, G., Fardoun, H. M., Gil‐Gómez, J., & Mashat, A. S. (2013) · Proceedings of the ICTs for improving Patients Rehabilitation Research Techniques · doi:10.4108/icst.pervasivehealth.2013.252208 · Cited by 51 · see citing works
A category-specific deficit of spatial representation: the case of autotopagnosia
Denes, G., Cappelletti, J. Y., Zilli, T., Porta, F. D., & Gallana, A. (2000) · Neuropsychologia · doi:10.1016/s0028-3932(99)00101-3 · Cited by 45 · see citing works
3D Pose tracking of walker users' lower limb with a structured-light camera on a moving platform
Hu, R. Z.-L., Hartfiel, A., Tung, J. Y., et al. (2011) · doi:10.1109/cvprw.2011.5981732 · Cited by 42 · see citing works
A Paediatric Interactive Therapy System for arm and hand rehabilitation
Pyk, P., Rückriem, B., Pescatore, A. M., Meyer‐Heim, A., Kiper, D., Eng, K., Wille, D., Chevrier, E., Hauser, Y., Holper, L., et al. (2008) · International Conference on Virtual Rehabilitation · doi:10.1109/icvr.2008.4625148 · Cited by 31 · see citing works
Lebrun, Y. (2005) · Journal of Neurolinguistics · doi:10.1016/j.jneuroling.2004.11.010 · Cited by 29 · see citing works
Right‐1eft disorientation in dementia of the Alzheimer type
Fischer, P. A., Marterer, A., & Danielczyk, W. (1990) · Neurology · doi:10.1212/wnl.40.10.1619 · Cited by 28 · see citing works
A Web-based cost-effective training tool with possible application to brain injury rehabilitation
Wang, P., Kreutzer, I. A., Bjärnemo, R., et al. (2003) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2003.08.001 · Cited by 22 · see citing works
González‐Ortega, D., Pernas, F. J. D., Martínez‐Zarzuela, M., Antón‐Rodríguez, M., Díez-Higuera, J. F., & Boto-Giralda, D. (2010) · Journal of Network and Computer Applications · doi:10.1016/j.jnca.2010.02.001 · Cited by 20 · see citing works
Self-citationHigh dynamic range stereo vision for outdoor mobile robotics
Hrabar, S., Corke, P., & Bosse, M. (2009) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/robot.2009.5152819 · Cited by 20 · see citing works
Prescription Software for Recovery and Rehabilitation Using Microsoft Kinect
Simmons, S., McCrindle, R., Sperrin, M., et al. (2013) · Proceedings of the ICTs for improving Patients Rehabilitation Research Techniques · doi:10.4108/icst.pervasivehealth.2013.252249 · Cited by 16 · see citing works
SVMT: A MATLAB toolbox for stereo-vision motion tracking of motor reactivity
Vousdoukas, M. I., Perakakis, P., Idrissi, S., et al. (2012) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2012.01.006 · Cited by 11 · see citing works
A rehabilitation training system with double-CCD camera and automatic spatial positioning technique
Lin, C., Wei, T.-C., Lu, A., et al. (2010) · Optics and Lasers in Engineering · doi:10.1016/j.optlaseng.2010.11.019 · Cited by 10 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Zhang, J., & Tao, D. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.3039359 · Cited by 774 · see citing works
Impact of Wearable Measurement Properties and Data Quality on ADLs Classification Accuracy
Poli, A., Cosoli, G., Scalise, L., & Spinsante, S. (2021) · IEEE Sensors Journal · doi:10.1109/jsen.2020.3009368 · Cited by 33 · see citing works
- Authors
- González-Ortega, D., Díaz-Pernas, F. J., Martínez-Zarzuela, M., & Antón-Rodríguez, M.
- Venue
- Computer Methods and Programs in Biomedicine
- Publisher
- Elsevier BV
- Published
- 2014-02
- Volume
- 113
- Issue
- 2
- Pages
- 620-631
- ISSN
- 0169-2607 (ISSN-L)
- OpenAlex
- W2061151616
- Cited by
- 167
- References
- 51
- Citations by year
- 2026: 1 · 2025: 4 · 2024: 4 · 2023: 9 · 2022: 9 · 2021: 11 · 2020: 15 · 2019: 14 · 2018: 22 · 2017: 13 · 2016: 22 · 2015: 28 · 2014: 15
- FWCI
- 39.40
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Computer Methods and Programs in Biomedicine (publishedVersion)
- PubMed (publishedVersion)
- Funders
- Ministerio de Ciencia e Innovación
- Junta de Castilla y León
- Topics
- Physical Sciences › Computer Science › Human-Computer Interaction › Hand Gesture Recognition Systems
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Human Pose and Action Recognition
- Health Sciences › Medicine › Rehabilitation › Stroke Rehabilitation and Recovery
- Keywords
- cognitive rehabilitation, Kinect sensor, left-right confusion, depth sensing, hand tracking, face detection, facial feature detection, psychomotor exercises, exercise monitoring, 3D vision
- MeSH terms
- Artificial Intelligence, Cognition Disorders, Ear, Eye, Humans, Monitoring, Physiologic, Nose, Psychomotor Performance
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review