The DOI matches its Crossref record; 1 of the 1 references it cites were found in a registry or an index.
IMU-Based Gait Recognition Using Convolutional Neural Networks and Multi-Sensor Fusion
Open accessAbstract
The wide spread usage of wearable sensors such as in smart watches has provided continuous access to valuable user generated data such as human motion that could be used to identify an individual based on his/her motion patterns such as, gait. Several methods have been suggested to extract various heuristic and high-level features from gait motion data to identify discriminative gait signatures and distinguish the target individual from others. However, the manual and hand crafted feature extraction is error prone and subjective. Furthermore, the motion data collected from inertial sensors have complex structure and the detachment between manual feature extraction module and the predictive learning models might limit the generalization capabilities. In this paper, we propose a novel approach for human gait identification using time-frequency (TF) expansion of human gait cycles in order to capture joint 2 dimensional (2D) spectral and temporal patterns of gait cycles. Then, we design a deep convolutional neural network (DCNN) learning to extract discriminative features from the 2D expanded gait cycles and jointly optimize the identification model and the spectro-temporal features in a discriminative fashion. We collect raw motion data from five inertial sensors placed at the chest, lower-back, right hand wrist, right knee, and right ankle of each human subject synchronously in order to investigate the impact of sensor location on the gait identification performance. We then present two methods for early (input level) and late (decision score level) multi-sensor fusion to improve the gait identification generalization performance. We specifically propose the minimum error score fusion (MESF) method that discriminatively learns the linear fusion weights of individual DCNN scores at the decision level by minimizing the error rate on the training data in an iterative manner. 10 subjects participated in this study and hence, the problem is a 10-class identification task. Based on our experimental results, 91% subject identification accuracy was achieved using the best individual IMU and 2DTF-DCNN. We then investigated our proposed early and late sensor fusion approaches, which improved the gait identification accuracy of the system to 93.36% and 97.06%, respectively.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A survey of depth and inertial sensor fusion for human action recognition
Chen, C., Jafari, R., & Kehtarnavaz, N. (2017) · Multimedia Tools and Applications · doi:10.1007/s11042-015-3177-1 · Cited by 356 · cited 1×
“With the latest achievements in the field of pervasive computing, limitations of inertial sensors such as cost, storage, and computational power were overcome to a great extent [16].”
Background
Cited by
Zhang, Z., Wen, F., Sun, Z., Guo, X., He, T., & Lee, C. (2022) · Advanced Intelligent Systems · doi:10.1002/aisy.202100228 · Cited by 464
Deep learning-enabled triboelectric smart socks for IoT-based gait analysis and VR applications
Zhang, Z., He, T., Zhu, M., Sun, Z., Shi, Q., Zhu, J., Dong, B., Yuce, M. R., & Lee, C. (2020) · npj Flexible Electronics · doi:10.1038/s41528-020-00092-7 · Cited by 413
(2019) · ACM Computing Surveys · doi:10.1145/3230633 · Cited by 303
Deep Learning for Monitoring of Human Gait: A Review
Alharthi, A. S., Yunas, S. U., & Ozanyan, K. B. (2019) · IEEE Sensors Journal · doi:10.1109/jsen.2019.2928777 · Cited by 175
Multi-Model Long Short-Term Memory Network for Gait Recognition Using Window-Based Data Segment
Tran, L., Hoang, T., Nguyen, T., Kim, H., & Choi, D. (2021) · IEEE Access · doi:10.1109/access.2021.3056880 · Cited by 90
Metadata
- Authors
- Dehzangi, O., Taherisadr, M., & ChangalVala, R.
- Venue
- Sensors
- Publisher
- MDPI AG
- Published
- 2017-11-27
- Volume
- 17
- Issue
- 12
- Pages
- 2735
- ISSN
- 1424-8220 (ISSN-L)
- OpenAlex
- W2770546254
- Cited by
- 192
- References
- 1
- FWCI
- 7.57
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.