CoChat

Human Activity Recognition Based on Residual Network and BiLSTM

Open access
Li, Yong, Wang, Luping · 2022 · Sensors

The DOI matches its Crossref record; 40 of the 40 references it cites were found in a registry or an index.

Abstract

Due to the wide application of human activity recognition (HAR) in sports and health, a large number of HAR models based on deep learning have been proposed. However, many existing models ignore the effective extraction of spatial and temporal features of human activity data. This paper proposes a deep learning model based on residual block and bi-directional LSTM (BiLSTM). The model first extracts spatial features of multidimensional signals of MEMS inertial sensors automatically using the residual block, and then obtains the forward and backward dependencies of feature sequence using BiLSTM. Finally, the obtained features are fed into the Softmax layer to complete the human activity recognition. The optimal parameters of the model are obtained by experiments. A homemade dataset containing six common human activities of sitting, standing, walking, running, going upstairs and going downstairs is developed. The proposed model is evaluated on our dataset and two public datasets, WISDM and PAMAP2. The experimental results show that the proposed model achieves the accuracy of 96.95%, 97.32% and 97.15% on our dataset, WISDM and PAMAP2, respectively. Compared with some existing models, the proposed model has better performance and fewer parameters.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.3390/s22020635

Cites

40 of 40 references verified0 citation errors · 0 not checkable

Statistics

Figures

Figure 1 IMU signal of different people on running. a, b, c, d, e, f: the different moment of IMU signal when two people are running.
Figure 1 IMU signal of different people on running. a, b, c, d, e, f: the different moment of IMU signal when two people are running.CC BY · PubMed Central
Figure 2 Frame diagram of the proposed model.
Figure 2 Frame diagram of the proposed model.CC BY · PubMed Central
Figure 3 Long short-term memory cell [32].
Figure 3 Long short-term memory cell [32].CC BY · PubMed Central
Figure 4 Frame diagram of the BiLSTM.
Figure 4 Frame diagram of the BiLSTM.CC BY · PubMed Central
Figure 5 Fixed position of IMU module.
Figure 5 Fixed position of IMU module.CC BY · PubMed Central
Figure 6 Data collected by accelerometer and gyroscope on running.
Figure 6 Data collected by accelerometer and gyroscope on running.CC BY · PubMed Central
Figure 7 Data collected by accelerometer and gyroscope on sitting.
Figure 7 Data collected by accelerometer and gyroscope on sitting.CC BY · PubMed Central
Figure 8 Frame diagram of the sensor raw data processing flow.
Figure 8 Frame diagram of the sensor raw data processing flow.CC BY · PubMed Central
Figure 9 The effect of convolution kernel size on recognition accuracy.
Figure 9 The effect of convolution kernel size on recognition accuracy.CC BY · PubMed Central
Figure 10 The effect of the number of convolution kernels on recognition accuracy.
Figure 10 The effect of the number of convolution kernels on recognition accuracy.CC BY · PubMed Central
Figure 11 The effect of the number of LSTM units on recognition accuracy.
Figure 11 The effect of the number of LSTM units on recognition accuracy.CC BY · PubMed Central
Figure 12 The effect of the value of dropout rate on recognition accuracy.
Figure 12 The effect of the value of dropout rate on recognition accuracy.CC BY · PubMed Central
Figure 13 Experiment results on the homemade lower extremity activity dataset: (a) the training loss and validation loss, (b) the training accuracy and validation accuracy.
Figure 13 Experiment results on the homemade lower extremity activity dataset: (a) the training loss and validation loss, (b) the training accuracy and validation accuracy.CC BY · PubMed Central
Figure 14 Comparison between the proposed model and two baseline models on the homemade dataset.
Figure 14 Comparison between the proposed model and two baseline models on the homemade dataset.CC BY · PubMed Central
Figure 15 Results of the model on WISDM dataset: (a) training loss and validation loss, and (b) training accuracy and validation accuracy.
Figure 15 Results of the model on WISDM dataset: (a) training loss and validation loss, and (b) training accuracy and validation accuracy.CC BY · PubMed Central
Figure 16 Comparison of the signal of upstairs and downstairs.
Figure 16 Comparison of the signal of upstairs and downstairs.CC BY · PubMed Central
Figure 17 Results of the model on PAMAP2 dataset: (a) training loss and validation loss, and (b) training accuracy and validation accuracy.
Figure 17 Results of the model on PAMAP2 dataset: (a) training loss and validation loss, and (b) training accuracy and validation accuracy.CC BY · PubMed Central

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Research works printed but not linked: 1

  1. Mahmud, S., Tonmoy, M.T.H., Bhaumik, K.K., Rahman, A.K.M.M., Amin, M.A., Shoyaib, M., Khan, M.A.H., and Ali, A.A. (2020). Human Activity Recognition from Wearable Sensor Data Using Self-Attention. arXiv.

Cited by

See all 178

Metadata

Authors
Li, Y., & Wang, L.
Affiliations
Sun Yat-sen University (CN)
Corresponding author
Wang, Luping
Venue
Sensors
Publisher
MDPI AG
Published
2022-01-14
Volume
22
Issue
2
Pages
635
ISSN
1424-8220 (ISSN-L)
OpenAlex
W4206703604
Cited by
156
References
40
Citations by year
2026: 17 · 2025: 34 · 2024: 43 · 2023: 47 · 2022: 15
FWCI
11.37
Type
journal article
Language
en
Open access
Locations
  • Sensors (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
Topics
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Context-Aware Activity Recognition Systems
  • Physical Sciences › Engineering › Biomedical Engineering › Gait Recognition and Analysis
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Human Pose and Action Recognition
Keywords
human activity recognition, inertial sensors, MEMS sensors, residual blocks, bidirectional LSTM, spatial feature extraction, temporal feature extraction, wearable sensors, WISDM, PAMAP2
MeSH terms
Deep Learning, Humans, Human Activities, Running, Walking, Neural Networks, Computer

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.