Fusion of Multi-Sensor-Based Biomechanical Gait Analysis Using Vision and Wearable Sensor
The DOI matches its Crossref record; 34 of the 34 references it cites were found in a registry or an index.
Abstract
The purpose of this research work is to investigate the biomechanics of pelvis, hip, knee, and ankle joint motion using a Kinect sensor & inertial measurement unit (IMU) sensor during the normal walk. In this paper, a very cost-effective gait analysis system based on Microsoft Kinect v2 and Inertial Measurement Unit (IMU) device is presented. Kinect sensor is used for acquiring 3D skeleton data (camera (x, y, z), depth (x, y) orientation (x, y, z, w), color (x, y)) with 25 human body joints. For this analysis, the lower extremities joints i.e. spinal cord joint, hip, knee, and ankle joints of both left and right legs are being considered. The main contribution of this research work is the joint angle calculation of lower extremities of human gait based on Microsoft Kinect sensor V2 and IMU sensor. From the law of cosine, the joint angle is calculated between the two joints and plotted for a single subject. We came with the observation that the characteristics of the human knee joint and ankle joint are inversely related to each other. There are two sharp humps for knee and ankle joints during the normal walk. During the swing phase, the knee joint is highly activated while during toe-off and heel strike it is least activated. This analysis of clinical data is very useful for prosthesis limb and exoskeleton design. The stability of calculated joints trajectories is validated using the limit cycle curve. A system is designed for real-time analysis of biomechanics of different lower limbs joints using gait.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“In [41], Bijalwan et al. presented a combination of wearable sensor-based and kinect sensor-based strategies for generating person stepping patterns, as well as constitutive models of the work.”
From Deep CNN-LSTM With Self-Attention Model for Human Activity Recognition Using Wearable Sensor (2022) · cites this paper as [41]
Citations
Cites
He, H., & Garcia, E. A. (2009) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2008.239 · Cited by 10,359
Design and Evaluation of the LOPES Exoskeleton Robot for Interactive Gait Rehabilitation
Veneman, J. F., Kruidhof, R., Hekman, E. E. G., Ekkelenkamp, R., Van Asseldonk, E. H. F., & van der Kooij, H. (2007) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2007.903919 · Cited by 1,280
Adaptive control of a variable-impedance ankle-foot orthosis to assist drop-foot gait
Blaya, J. A., & Herr, H. (2004) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2003.823266 · Cited by 741
Multi-input CNN-GRU based human activity recognition using wearable sensors
Dua, N., Singh, S. N., & Semwal, V. B. (2021) · Computing · doi:10.1007/s00607-021-00928-8 · Cited by 432
Self-citationLange, B., Chang, C.-Y., Suma, E., Newman, B., Rizzo, A. S., & Bolas, M. (2011) · 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society · doi:10.1109/iembs.2011.6090521 · Cited by 402
Full body gait analysis with Kinect
Gabel, M., Gilad-Bachrach, R., Renshaw, E., & Schuster, A. (2012) · 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society · doi:10.1109/embc.2012.6346340 · Cited by 331
Accuracy and robustness of Kinect pose estimation in the context of coaching of elderly population
Obdrzalek, S., Kurillo, G., Ofli, F., Bajcsy, R., Seto, E., Jimison, H., & Pavel, M. (2012) · 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society · doi:10.1109/embc.2012.6346149 · Cited by 319
Semwal, V. B., Gaud, N., Lalwani, P., Bijalwan, V., & Alok, A. K. (2022) · Artificial Intelligence Review · doi:10.1007/s10462-021-09979-x · Cited by 191
Self-citationOn the estimation of joint kinematics during gait
Ramakrishnan, H. K., & Kadaba, M. P. (1991) · Journal of Biomechanics · doi:10.1016/0021-9290(91)90175-m · Cited by 178
Lerner, Z. F., Damiano, D. L., Park, H., Gravunder, A. J., & Bulea, T. C. (2016) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2016.2595501 · Cited by 164
Semwal, V. B., Gupta, A., & Lalwani, P. (2021) · The Journal of Supercomputing · doi:10.1007/s11227-021-03768-7 · Cited by 151
Self-citationSemwal, V. B., Mondal, K., & Nandi, G. C. (2015) · Neural Computing and Applications · doi:10.1007/s00521-015-2089-3 · Cited by 139
Self-citationLatorre, J., Colomer, C., Alcañíz, M., & Lloréns, R. (2019) · Journal of NeuroEngineering and Rehabilitation · doi:10.1186/s12984-019-0568-y · Cited by 111
Clinical Human Gait Classification: Extreme Learning Machine Approach
Patil, P., Kumar, K. S., Gaud, N., & Semwal, V. B. (2019) · 2019 1st International Conference on Advances in Science, Engineering and Robotics Technology (ICASERT) · doi:10.1109/icasert.2019.8934463 · Cited by 97
Self-citationOubre, B., Daneault, J.-F., Jung, H.-T., Whritenour, K., Miranda, J. G. V., Park, J., Ryu, T., Kim, Y., & Lee, S. I. (2020) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2020.2966950 · Cited by 78
Human Gait State Prediction Using Cellular Automata and Classification Using ELM
Semwal, V. B., Gaud, N., & Nandi, G. C. (2018) · Advances in intelligent systems and computing · doi:10.1007/978-981-13-0923-6_12 · Cited by 70
Self-citationDesign of Vector Field for Different Subphases of Gait and Regeneration of Gait Pattern
Semwal, V. B., Kumar, C., Mishra, P. K., & Nandi, G. C. (2016) · IEEE Transactions on Automation Science and Engineering · doi:10.1109/tase.2016.2594191 · Cited by 66
Self-citationVirtual Activities of Daily Living for Recovery of Upper Extremity Motor Function
Adams, R. J., Lichter, M. D., Ellington, A. L., White, M., Armstead, K., Patrie, J. T., & Diamond, P. T. (2017) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2017.2771272 · Cited by 64
Generation of Joint Trajectories Using Hybrid Automate-Based Model: A Rocking Block-Based Approach
Semwal, V. B., & Nandi, G. C. (2016) · IEEE Sensors Journal · doi:10.1109/jsen.2016.2570281 · Cited by 63
Self-citationBiologically-inspired push recovery capable bipedal locomotion modeling through hybrid automata
Semwal, V. B., Katiyar, S. A., Chakraborty, R., & Nandi, G. C. (2015) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2015.02.009 · Cited by 60
Self-citationGait and Dynamic Balance Sensing Using Wearable Foot Sensors
Refai, M. I. M., van Beijnum, B.-J. F., Buurke, J. H., & Veltink, P. H. (2018) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2018.2885309 · Cited by 59
Toward Developing a Computational Model for Bipedal Push Recovery–A Brief
Semwal, V. B., & Nandi, G. C. (2015) · IEEE Sensors Journal · doi:10.1109/jsen.2015.2389525 · Cited by 57
Self-citationAutomated FES for Upper Limb Rehabilitation Following Stroke and Spinal Cord Injury
Hodkin, E. F., Lei, Y., Humby, J., Glover, I. S., Choudhury, S., Kumar, H., Pérez, M. A., Rodgers, H., & Andrew, J. O. (2018) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2018.2816238 · Cited by 57
Kinect sensor-based interaction monitoring system using the BLSTM neural network in healthcare
Saini, R., Kumar, P., Kaur, B., Roy, P. P., Dogra, D. P., & Santosh, K. (2018) · International Journal of Machine Learning and Cybernetics · doi:10.1007/s13042-018-0887-5 · Cited by 57
Human activity recognition with analysis of angles between skeletal joints using a RGB‐depth sensor
İnce, Ö. F., İnce, İ. F., Yıldırım, M. E., Park, J., Song, J.-K., & Yoon, B. (2019) · ETRI Journal · doi:10.4218/etrij.2018-0577 · Cited by 46
Study of humanoid Push recovery based on experiments
Semwal, V. B., Bhushan, A., & Nandi, G. C. (2013) · doi:10.1109/care.2013.6733741 · Cited by 43
Self-citationModeling bipedal locomotion trajectories using hybrid automata
Nandi, G. C., Semwal, V. B., Raj, M., & Jindal, A. (2016) · IEEE Region 10 Conference (TENCON) · doi:10.1109/tencon.2016.7848159 · Cited by 43
Self-citationBiped model based on human Gait pattern parameters for sagittal plane movement
Semwal, V. B., Katiyar, S. A., Chakraborty, P., & Nandi, G. C. (2013) · International Conference on Control, Automation, Robotics and Embedded Systems (CARE) · doi:10.1109/care.2013.6733750 · Cited by 38
Self-citationAnkle and Knee Joint Angle Measurements during Gait with Wearable Sensor System for Rehabilitation
Saito, H., Watanabe, T., & Arifin, A. (2009) · World Congress on Medical Physics and Biomedical Engineering, September 7 - 12, 2009, Munich, Germany · doi:10.1007/978-3-642-03889-1_134 · Cited by 32
Data Driven Computational Model for Bipedal Walking and Push RecoveryPreprint
Semwal, V. B., & Nandi, G. C. (2017) · arXiv (Cornell University) · doi:10.13140/rg.2.2.18651.26403 · Cited by 30
Self-citationOptimal Feedback Control of Pedestrian Flow in Heterogeneous Corridors
Zhu, Y., Zhao, D., & He, H. (2020) · IEEE Transactions on Automation Science and Engineering · doi:10.1109/tase.2020.2996018 · Cited by 16
A new paradigm of human gait analysis with Kinect
Nandy, A., & Chakraborty, P. (2015) · International Conference on Contemporary Computing · doi:10.1109/ic3.2015.7346722 · Cited by 11
An Unsupervised Approach For Gait Phase Detection
Chakraborty, S., & Nandy, A. (2020) · International Conference on Computational Intelligence and Networks (CINE) · doi:10.1109/cine48825.2020.234396 · Cited by 11
Moving Kinect-Based Gait Analysis with Increased Range
Pathegama, M., Marasinghe, D., Wijayasekara, K., Karunanayake, I., Edussooriya, C. U. S., Silva, P., & Rodrigo, R. P. (2018) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/smc.2018.00699 · Cited by 8
Cited by
Deep CNN-LSTM With Self-Attention Model for Human Activity Recognition Using Wearable Sensor
Khatun, M. A., Yousuf, M. A., Ahmed, S., Uddin, M. Z., Alyami, S. A., Al-Ashhab, S., Akhdar, H. F., Khan, A., Azad, A., & Moni, M. A. (2022) · IEEE Journal of Translational Engineering in Health and Medicine · doi:10.1109/jtehm.2022.3177710 · Cited by 288
“In [41], Bijalwan et al. presented a combination of wearable sensor-based and kinect sensor-based strategies for generating person stepping patterns, as well as constitutive models of the work.”
Deep ensemble learning approach for lower extremity activities recognition using wearable sensors
Jain, R., Semwal, V. B., & Kaushik, P. (2021) · Expert Systems · doi:10.1111/exsy.12743 · Cited by 106
“Broadly these activities can be classified as either lower extremity or upper extremity activities (Bijalwan, 2021).”
BackgroundSelf-citationBijalwan, V., Semwal, V. B., Singh, G., & Mandal, T. K. (2022) · Neural Processing Letters · doi:10.1007/s11063-022-10744-6 · Cited by 89
“Figure 1 shows the Microsoft Kinect v2 sensor being used for capturing the raw data that is provided to the system which pre-processes and classifies the exercise being performed by the patient [9].”
MethodSelf-citationWang, Y., Cheng, X., Jabban, L., Sui, X., & Zhang, D. (2022) · IEEE Sensors Journal · doi:10.1109/jsen.2022.3167686 · Cited by 70
Interactive Control of Lower Limb Exoskeleton Robots: A Review
Zhang, Y.-P., Cao, G.-Z., Li, L.-L., & Diao, D.-F. (2024) · IEEE Sensors Journal · doi:10.1109/jsen.2024.3352005 · Cited by 58
“2) Multisource Information Fusion: Many researchers have improved the accuracy of intention recognition by fusing diverse types of motion-related information [83], [84], [119], [120], [121], [122], [123], [124] and considering the correlation and complementarity between different information modes.”
Background
Metadata
- Authors
- Bijalwan, V., Semwal, V. B., & Mandal, T. K.
- Affiliations
- Maulana Azad National Institute of Technology (IN)
- ICFAI University, Dehradun (IN)
- Venue
- IEEE Sensors Journal
- Published
- 2021-07-01
- Volume
- 21
- Issue
- 13
- Pages
- 14213-14220
- ISSN
- 1530-437X (ISSN-L)
- 1558-1748
- 2379-9153
- OpenAlex
- W3165561310
- Cited by
- 122
- References
- 34
- Citations by year
- 2026: 10 · 2025: 24 · 2024: 27 · 2023: 27 · 2022: 25 · 2021: 9
- FWCI
- 6.69
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- Locations
- IEEE Sensors Journal (publishedVersion)
- Funders
- Collaborative Research Project through Uttarakhand Technical University, Dehradun
- Science and Engineering Research Board (SERB), Department of Science and Technology (DST), Govt. of India to Dr. Vijay Bhaskar Semwal under Early Career Award (ECR/2018/000203)
- Topics
- Physical Sciences › Engineering › Biomedical Engineering › Gait Recognition and Analysis
- Physical Sciences › Engineering › Biomedical Engineering › Prosthetics and Rehabilitation Robotics
- Physical Sciences › Engineering › Biomedical Engineering › Lower Extremity Biomechanics and Pathologies
- Keywords
- gait analysis, multimodal sensor fusion, Kinect sensor, inertial measurement unit, lower limb joint angles, knee joint, ankle joint, hip joint, swing phase, heel strike, prosthesis design, exoskeleton design, real-time gait analysis
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.