LSTM-CNN Architecture for Human Activity Recognition
Open accessAbstract
In the past years, traditional pattern recognition methods have made great progress. However, these methods rely heavily on manual feature extraction, which may hinder the generalization model performance. With the increasing popularity and success of deep learning methods, using these techniques to recognize human actions in mobile and wearable computing scenarios has attracted widespread attention. In this paper, a deep neural network that combines convolutional layers with long short-term memory (LSTM) was proposed. This model could extract activity features automatically and classify them with a few model parameters. LSTM is a variant of the recurrent neural network (RNN), which is more suitable for processing temporal sequences. In the proposed architecture, the raw data collected by mobile sensors was fed into a two-layer LSTM followed by convolutional layers. In addition, a global average pooling layer (GAP) was applied to replace the fully connected layer after convolution for reducing model parameters. Moreover, a batch normalization layer (BN) was added after the GAP layer to speed up the convergence, and obvious results were achieved. The model performance was evaluated on three public datasets (UCI, WISDM, and OPPORTUNITY). Finally, the overall accuracy of the model in the UCI-HAR dataset is 95.78%, in the WISDM dataset is 95.85%, and in the OPPORTUNITY dataset is 92.63%. The results show that the proposed model has higher robustness and better activity detection capability than some of the reported results. It can not only adaptively extract activity features, but also has fewer parameters and higher accuracy.
AI snapshot
Written from the paper’s full text.
TL;DR
The paper proposes an LSTM-CNN architecture that feeds raw mobile sensor data into a two-layer LSTM followed by convolutional layers, with global average pooling and batch normalization to reduce parameters and speed convergence. It reports high accuracy/F1 on UCI-HAR, WISDM, and OPPORTUNITY and compares favorably with CNN and DeepConvLSTM baselines.
Key findings
- On three public datasets, reported overall accuracy/F1 is UCI-HAR 95.78% (abstract/conclusion; experimental section says 95.80% accuracy), WISDM 95.85% (abstract/conclusion; experimental section says 95.75% accuracy), and OPPORTUNITY 92.63%; without the Null class, OPPORTUNITY accuracy is 87.58%.
- Compared with the CNN of Yang et al. and DeepConvLSTM under the same scenario, LSTM-CNN increased about 7% on OPPORTUNITY and averaged 3% on UCI-HAR and WISDM by F1 score.
- Replacing the fully connected layer with GAP reduced parameters: model B has 27,462 parameters versus more than 502 thousand for model A, about 94% less, with almost the same performance; adding BN raised F1 to 93.35%, and adding LSTM layers raised UCI-HAR F1 to 95.78%.
- Hyperparameter tests on UCI-HAR found Adam was the best optimizer, batch size 192 gave the highest accuracy, and 192 filters in the second convolutional layer gave F1 96.38% (4% over 64 filters) but increased model parameters by more than 70%.
Methods
- Architecture: preprocessed sensor data passes through two LSTM layers (32 memory cells each, 64 total), then two convolutional layers (64 filters of size 1×5 with stride 2; 128 filters of size 1×3 with stride 1), with max-pooling between them, followed by GAP, BN, and a dense Softmax output layer.
- Data: UCI-HAR (30 subjects, 6 activities, 50 Hz, 748,406 samples), WISDM (36 subjects, 6 activities, 20 Hz, 1,098,209 samples, unbalanced), and OPPORTUNITY (4 subjects, 17 activities plus Null class, 30 Hz, 113 channels). Preprocessing used linear interpolation, 0–1 normalization, and sliding windows of length 128 for UCI/WISDM and 24 for OPPORTUNITY, with 50% overlap.
- Training/evaluation: Keras with TensorFlow backend, cross-entropy loss, Adam optimizer, batch size 192, 200 epochs, learning rate 0.001; evaluated with accuracy and F1 score, confusion matrices, and comparisons to CNN and DeepConvLSTM.
Limitations
- The paper states WISDM and OPPORTUNITY are imbalanced, so overall accuracy is not an appropriate measure and F1 is used; it also notes relatively poor discrimination between sitting and standing in UCI-HAR, with recall and precision in the range of 92%–93%.
- The paper states LSTM layers slow computation because each time step depends on the previous one and cannot be computed in parallel; LSTM-CNN took 9,416 ms per epoch versus 5,156 ms for model D, and GAP can shift training pressure to convolutional layers and slow convergence, which BN was added to address.
- Evident from the text: reported metrics are inconsistent across sections (e.g., UCI-HAR 95.78% vs 95.80%; WISDM 95.85% vs 95.75%), and OPPORTUNITY evaluation uses only four subjects, limiting generalization claims.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
0 of 10 cited sources checked · 0 supported · 0 flagged
- Findingown data
The LSTM-CNN model achieved an overall accuracy of 95.78% on the UCI-HAR dataset.
“Finally, the overall accuracy of the model in the UCI-HAR dataset is 95.78%, in the WISDM dataset is 95.85%, and in the OPPORTUNITY dataset is 92.63%.”
Quote in the paperSubstantial claim - Findingown data
The LSTM-CNN model achieved an overall accuracy of 92.63% on the OPPORTUNITY dataset.
“Finally, the overall accuracy of the model in the UCI-HAR dataset is 95.78%, in the WISDM dataset is 95.85%, and in the OPPORTUNITY dataset is 92.63%.”
Quote in the paperSubstantial claim - Findingown data
The LSTM-CNN model achieved an overall accuracy of 95.85% on the WISDM dataset.
“Finally, the overall accuracy of the model in the UCI-HAR dataset is 95.78%, in the WISDM dataset is 95.85%, and in the OPPORTUNITY dataset is 92.63%.”
Quote in the paperSubstantial claim - Findingown data
Model parameters increase by more than 70% when increasing the number of filters.
“However, the model parameters increase by more than 70%.”
Quote in the paperNot a substantial claim - Findingown data
On the OPPORTUNITY dataset, an overall accuracy of 92.63% was achieved.
“Finally, an overall accuracy of 92.63% was achieved.”
Quote in the paperSubstantial claim
- Findingown data
On the OPPORTUNITY dataset with the Null class removed, the method achieved an overall accuracy of 87.58% in the gesture recognition task.
“In addition, when the Null class is removed from the classification task (see Table 10), our method achieved an overall accuracy of 87.58% in the gesture recognition task.”
Quote in the paperNot a substantial claim - Findingown data
Accuracy reaches the highest when the batch size is selected as 192.
“It can be seen that the accuracy reaches the highest when the batch size is selected as 192.”
Quote in the paperNot a substantial claim - Findingown data
Model C's F1 score reaches 93.35%.
“Finally, the F 1 score of this model reaches 93.35%.”
Quote in the paperSubstantial claim - Findingnone given
Model D outperforms model C by 1% on average.
“Finally, it outperforms the model C by 1% on average.”
Quote in the paperNot a substantial claim - Findingreasoning
On the UCI-HAR dataset, discrimination between sitting and standing was relatively poor, with recall and precision in the range of 92%-93%.
“There was relatively poor discrimination between sitting and standing.The recall and precision were in the range of 92%∼93%.”
Quote in the paperNot a substantial claim - Findingown data
Model B's computation speed improved, averaging 1202 milliseconds per epoch.
“Accordingly, the computation speed has also been improved, with an average of 1202 milliseconds per epoch.”
Quote in the paperNot a substantial claim - Findingown data
On the WISDM dataset, the overall accuracy reached 95.75% on a test set containing approximately 3036 new instances.
“When the trained model was exposed to the test set that contains approximately 3036 new instances, the overall accuracy of the WISDM dataset (an unbalanced dataset) reached 95.75%.”
Quote in the paperSubstantial claim - Findingown data
With an increasing number of filters, the network parameters increase from 36614 to 62598.
“With an increasing number of filters, the network parameters increase from 36614 to 62598.”
Quote in the paperSubstantial claim - Findingown data
LSTM-CNN's F1 score on the test set reached 95.78%.
“Eventually, the F 1 score on the test set reached the expected 95.78%.”
Quote in the paperSubstantial claim - Findingown data
Model A's F1 score reaches 91.88% on the UCI-HAR test set.
“As can be seen that the F 1 score of model A reaches 91.88% when the trained model is exposed to the test set of the UCI-HAR.”
Quote in the paperSubstantial claim - Interpretationown data
The proposed LSTM-CNN model has higher robustness than some reported results.
“The results show that the proposed model has higher robustness and better activity detection capability than some of the reported results.”
Quote in the paperSubstantial claim - Interpretationown data
The proposed LSTM-CNN model has better activity detection capability than some reported results.
“The results show that the proposed model has higher robustness and better activity detection capability than some of the reported results.”
Quote in the paperSubstantial claim - Premisecitation
Human activity data collected in natural environments often have class imbalances.
“When collecting human activity data in natural environments, imbalances often occur [37].”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [37] source
Not checked in the free run.
- Study design and conductcitation
For the OPPORTUNITY dataset, the same subset employed in the OPPORTUNITY challenge [33] was used to train and test the models.
“For the OPPORTUNITY dataset, the same subset employed in the OPPORTUNITY challenge [33] was used to train and test our models.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [33] source
Not checked in the free run.
- Study design and conductreasoning
The test set was constructed as a subset of the dataset separated entirely from the training set to better evaluate model performance.
“To be specific, a subset of the dataset was used to construct the test set that is separated entirely from the training set to better evaluate the model performance.”
Quote in the paperSubstantial claim - Interpretationnone given
The use of the GAP layer focuses the training pressure of the model on the convolutional layers, which causes the model to converge slowly.
“However, the use of the GAP layer would focus the training pressure of the model on the convolutional layers, which would cause the model to converge slowly.”
Quote in the paperNot a substantial claim - Interpretationreasoning
The LSTM-CNN model has fast convergence speed.
“The results show that the proposed model not only has high accuracy but also has good generalization ability and fast convergence speed.”
Quote in the paperSubstantial claim - Interpretationreasoning
LSTM layers slow down computation because each time step depends on the output of the previous time step and cannot compute in parallel.
“When training LSTM layers, the calculation of each time step depends on the output of the previous time step.As a result, it could not compute in parallel, which slows down the computation speed of the model.”
Quote in the paperNot a substantial claim- Rests on an assumption: When training LSTM layers, the calculation of each time step depends on the output of the previous time step.
- Study design and conductown data
The LSTM-CNN model was evaluated on three public datasets: UCI-HAR, WISDM, and OPPORTUNITY.
“The model performance was evaluated on three public datasets (UCI, WISDM, and OPPORTUNITY).”
- Also stated in: § II. RELATED WORK · plain
“In addition, it was evaluated on three of the most widely used public datasets.”
Quote in the paperSubstantial claim - Also stated in: § II. RELATED WORK · plain
- Interpretationreasoning
Overall classification accuracy is not an appropriate measure of performance for imbalanced datasets because a classifier predicting the majority class could achieve high accuracy.
“If the classifier predicts each instance as a majority class and uses the overall classification accuracy to evaluate the model performance, the results could achieve high accuracy.Therefore the overall classification accuracy is not an appropriate measure of performance.”
Quote in the paperSubstantial claim- Rests on an assumption: The WISDM and OPPORTUNITY datasets are imbalanced.
- Interpretationnone given
The LSTM-CNN model can adaptively extract activity features.
“It can not only adaptively extract activity features, but also has fewer parameters and higher accuracy.”
- Also stated in: § II. RELATED WORK · hedged
“The model could extract activity features automatically and classify them with few parameters.”
Quote in the paperSubstantial claim- Rests on an assumption: LSTM has great advantages in feature extraction of sequence data than convolutional neural networks due to its special memory cells.
- Also stated in: § II. RELATED WORK · hedged
- Interpretationown data
These results confirm that using the GAP layer instead of a fully-connected layer brings significant advantages in HAR tasks.
“These results confirm our findings that supporting the use of the GAP layer instead of a fully-connected layer brings significant advantages in HAR tasks.”
Quote in the paperSubstantial claim- Rests on an assumption: The weight parameters of CNN mainly concentrate on the fully-connected layer.
- Interpretationown data
It is feasible to replace the fully-connected layer with the GAP layer.
“It proves the feasibility of replacing the fully-connected layer with the GAP layer.”
Quote in the paperSubstantial claim- Rests on an assumption: The weight parameters of CNN mainly concentrate on the fully-connected layer.
- Interpretationown data
The LSTM-CNN model has good generalization ability.
“The results show that the proposed model not only has high accuracy but also has good generalization ability and fast convergence speed.”
Quote in the paperSubstantial claim - Interpretationreasoning
The LSTM-CNN model has fewer parameters than some reported models.
“It can not only adaptively extract activity features, but also has fewer parameters and higher accuracy.”
- Also stated in: § II. RELATED WORK · hedged
“The model could extract activity features automatically and classify them with few parameters.”
Quote in the paperSubstantial claim - Also stated in: § II. RELATED WORK · hedged
- Interpretationreasoning
The F1 score is usually a more useful performance indicator than accuracy.
“Thus, the F 1 score is usually a more useful performance indicator than accuracy.”
Quote in the paperNot a substantial claim- Rests on an assumption: The WISDM and OPPORTUNITY datasets are imbalanced.
- Interpretationown data
The proposed method has superior performance on different public datasets.
“It also proves that the proposed method has superior performance on different public datasets.”
Quote in the paperSubstantial claim
- May combine two claims. 28
- Classified as probably not a substantial claim. 10
- The quote only partly states this claim. 1
May combine two claims.
Findingown dataModel A has more than 502 thousand model parameters, with the parameters of fully-connected layers occupying the most.
“Accordingly, there are more than 502 thousand model parameters, of which the parameters of fully-connected layers occupy the most.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataCompared with the CNN model of Yang et al., LSTM-CNN has a significant increase of about 7% for the OPPORTUNITY dataset and is superior to the DeepConvLSTM model.
“Compared with the CNN model of Yang et al., LSTM-CNN has a significant increase of about 7% for the OPPORTUNITY dataset and is superior to the DeepConvLSTM model.”
Quote in the paperSubstantial claim0 of 2 sources checkedMay combine two claims.
Findingown dataF1 score reaches 96.38% when the number of filters is 192, outperforming 64 filters by 4%.
“F 1 score reaches 96.38% when the number of filters is selected as 192, which outperforms when the number of filters is 64 by 4%.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Findingown dataModel A takes 1681 milliseconds per epoch in the training stage.
“And it takes 1681 milliseconds per epoch in the training stage.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataModel B has only 27462 parameters, about 94% less than model A, while performance remains almost the same.
“The parameters of the model B are only 27462, which is about 94% less than that of the model A while the performance remains almost the same.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S4 (based).
Findingnone givenThe model parameters were greatly reduced by adding the GAP layer to the network.
“It should be noted that the model parameters have been greatly reduced under adding the GAP layer to the network.”
Quote in the paperNot a substantial claimMay combine two claims.
FindingreasoningThe computation speed of model D and LSTM-CNN is 5156 milliseconds per epoch and 9416 milliseconds per epoch, respectively.
“They are 5156 milliseconds per epoch and 9416 milliseconds per epoch, respectively.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataThe model trained by Adam optimizer has the best fitting effect and the most stable fluctuation of gradient descent curve.
“It can be seen that the model trained by Adam optimizer has the best fitting effect and the fluctuation of gradient descent curve is the most stable.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataThe final F1 score reached 95.78%, 95.85% and 92.63% on the UCI-HAR, WISDM and OPPORTUNITY datasets, respectively.
“Eventually, the F 1 score reached 95.78%, 95.85% and 92.63% on the UCI-HAR, WISDM and OPPORTUNITY datasets, respectively.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataLSTM-CNN outperforms the other two models on the UCI-HAR and WISDM datasets, with the best-reported result increasing by an average of 3%.
“It can also be seen that LSTM-CNN outperforms the other two models on the UCI-HAR and WISDM datasets, with the best-reported result increasing by an average of 3%.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataOn the UCI-HAR dataset, 2940 instances were correctly classified and the overall accuracy reached 95.80%.
“For the UCI-HAR dataset, there were 2940 instances that have been correctly classified, and the overall accuracy reached 95.80%.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
InterpretationreasoningThe poor discrimination between sitting and standing may be because the two activities are similar from the perspective of motion sensors and it is difficult to mine deeper information only by acceleration and angular velocity data.
“The main reason may be that the two activities are similar from the perspective of motion sensors.It is difficult to mine deeper information only by acceleration and angular velocity data.”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim. May combine two claims.
PremisecitationDeep learning methods could automatically extract appropriate features from raw sensor data during the training phase and present low-level original temporal features with high-level abstract sequences.
“To address this problem, researchers have turned to deep learning methods that could automatically extract appropriate features from raw sensor data during the training phase and present the low-level original temporal features with high-level abstract sequences.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [24]- [27]
Not checked in the free run.
May combine two claims.
PremisereasoningExisting deep learning models for human activity recognition have relatively complex network structures and large numbers of parameters, resulting in high computational cost and difficulty for real-time performance.
“Although the above models could generally recognize human activities, the overall network structure is relatively complex.In addition, these models have a large number of parameters, which results in high computational cost.It is difficult to be used in occasions that require high real-time performance.”
Quote in the paperSubstantial claimMay combine two claims.
Interpretationown dataCompared with methods proposed in other literature, the LSTM-CNN model shows consistent superior performance and good generalization.
“To sum up, compared with the methods proposed in other literatures, the LSTM-CNN model shows consistent superior performance and has good generalization.”
Quote in the paperSubstantial claimMay combine two claims.
Interpretationown dataThe proposed model achieves high recognition accuracy while greatly simplifying the model structure.
“The model proposed in this paper not only could achieve high recognition accuracy but also greatly simplify the model structure.”
Quote in the paperSubstantial claimMay combine two claims.
Interpretationown dataAdding a BN layer after the GAP layer stabilizes the output of the upper layer, speeds up convergence, and improves accuracy.
“The model C adds a BN layer after the GAP layer to stabilize the output of the upper layer.It speeds up the convergence of the model and improves accuracy.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S4 (based). May combine two claims.
Premisenone givenGAP sums out the spatial information, so it is more robust to the spatial transformation of the input.
“Furthermore, GAP sums out the spatial information, so it is more robust to the spatial transformation of the input.”
Quote in the paperNot a substantial claimMay combine two claims.
PremisereasoningThe GAP layer has no parameter to optimize, thus it reduces global model parameters.
“There is no parameter to optimize in the GAP layer.Thus, it achieves the goal of reducing global model parameters.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Study design and conductown dataFor the UCI-HAR dataset, recordings of 22 subjects were used to build the training set and the remaining subjects were used to build the test set.
“Among them, the recordings of 22 subjects were used to build the training set, and the rest was used to build the test set.”
Quote in the paperNot a substantial claimMay combine two claims.
Study design and conductnone givenFor the WISDM dataset, the training set was composed of recordings of 30 subjects and the remaining 6 subjects' recordings were used to build the test set, with the two parts completely separate.
“The training set is composed of the recordings of 30 subjects and the remaining recordings of 6 subjects are used to build the test set.The two parts are completely separate.”
Quote in the paperSubstantial claimThe quote only partly states this claim.
Interpretationown dataThe LSTM-CNN model has higher accuracy than some reported results.
“It can not only adaptively extract activity features, but also has fewer parameters and higher accuracy.”
- Also stated in: § II. RELATED WORK · plain
“The results show that the proposed model not only has high accuracy but also has good generalization ability and fast convergence speed.”
Quote in the paperSubstantial claim- Also stated in: § II. RELATED WORK · plain
May combine two claims.
PremisereasoningAgarwal et al.'s model was only evaluated on one dataset with six activities, which does not prove that it has good generalization ability.
“Although the proposed model has high accuracy and brief architecture, it was only evaluated on one dataset which has just six activities, which does not prove that the proposed model has good generalization ability.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [28] source
Not checked in the free run.
May combine two claims.
PremisecitationMachine learning methods may rely heavily on heuristic manual feature extraction in most daily human activity recognition tasks, which is limited by human domain knowledge.
“Machine learning methods may rely heavily on heuristic manual feature extraction in most daily human activity recognition tasks.It is usually limited by human domain knowledge [23].”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [23] source
Not checked in the free run.
Classified as probably not a substantial claim. May combine two claims.
PremisereasoningThe BN layer normalizes and reconstructs the input data on each batch of training samples to ensure the stability of the output of the previous layer, so as to improve the training speed and accuracy.
“The BN layer normalizes and reconstructs the input data on each batch of training samples to ensure the stability of the output of the previous layer, so as to improve the training speed and accuracy.”
Quote in the paperSubstantial claimMay combine two claims.
PremisereasoningDuring training, the distribution of input data of each layer continuously changes due to weight updates, leading to difficulty in network training and slowing down convergence.
“During the training process, the distribution of input data of each layer would continuously change due to the weight parameters of the upper layer are constantly updated.Therefore, it is necessary to change the weight parameters to adapt to this new distribution, which leads to difficulty in network training and slows down the convergence speed.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationCNN has gained increasing popularity because of its ability to learn unique representations from images or speech.
“CNN has gained increasing popularity because of its ability to learn unique representations from images or speech [34].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [34] source
Not checked in the free run.
May combine two claims.
InterpretationreasoningUsing the global average pooling layer and batch normalization layer to replace the fully-connected layer is effective, and using LSTM to extract temporal information improves model performance.
“To sums up, the strategy of using the global average pooling layer and batch normalization layer to replace the fully-connected layer is effective.Moreover, the method of using LSTM to extract the temporal information to improve model performance is favorable.”
Quote in the paperSubstantial claim- Rests on an assumption: Recordings of activities based on mobile sensors are temporal sequences.
- Rests on an assumption: LSTM has the ability to capture temporal information from sequential data.
Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.
PremisereasoningThe fully-connected layer at the end of the model merges features extracted from the upper layer, making up for the shortcomings of the GAP layer.
“Each node of the fully-connected layer is connected to the nodes of the upper layer so that the features extracted from the upper layer could be merged.It makes up for the shortcomings of the GAP layer in this regard.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
PremisecitationThe InnoHAR model [29] achieved excellent results but converged hardly, causing a lot of time to be wasted in the training stage.
“The results showed an excellent effect, but the model converged hardly, causing a lot of time to be wasted in the training stage.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [29] source
Not checked in the free run.
May combine two claims.
PremisecitationIn the model Krizhevsky [35], the first fully-connected layer FC1 has 4096 nodes, and the output of the upper pooling layer Max-Pool3 has 9216 nodes, resulting in more than 37 million weight parameters between them, which consumes a lot of memory and computational cost.
“For instance, in the model Krizhevsky [35], the first fully-connected layer FC1 has 4096 nodes, and the output of the upper pooling layer Max-Pool3 has 9216 nodes.Thus, there would be more than 37 million weight parameters between the MaxPool3 layer and the FC1 layer, which would consume a lot of memory and computational cost.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [35]
Not checked in the free run.
May combine two claims.
Interpretationown dataThe model avoids complex feature extraction and has high recognition accuracy with few model parameters.
“It can not only avoid complex feature extraction but also has high recognition accuracy under the premise of a few model parameters.”
Quote in the paperSubstantial claim
The paper relies on this without support.
LSTM is a variant of RNN that is more suitable for processing temporal sequences.
“LSTM is a variant of the recurrent neural network (RNN), which is more suitable for processing temporal sequences.”
The paper relies on this without support.
LSTM can eliminate the gradient vanishing limitation of RNN.
“LSTM is a variety of RNN, which could eliminate this limitation.”
The paper relies on this without support.
LSTM has great advantages in feature extraction of sequence data than convolutional neural networks due to its special memory cells.
“LSTM has great advantages in feature extraction of sequence data than convolutional neural networks due to its special memory cells.”
The paper relies on this without support.
RNN can take advantage of the chronological relationship between sensor readings.
“RNN could take advantage of the chronological relationship between sensor readings.”
The paper relies on this without support.
RNN has the problem of gradient vanishing, which hinders the ability of the network to model between raw sensor data and human activities in a long context window.
“Although RNN has the ability to capture temporal information from sequential data, it has the problem of gradient vanishing, which hinders the ability of the network to model between raw sensor data and human activities in a long context window.”
The paper relies on this without support.
The more convolution kernels are used, the more hidden features could be mined in the input samples.
“Generally speaking, the more convolution kernels are used, the more hidden features could be mined in the input samples.”
The paper relies on this without support.
The max-pooling layer filters interference noise caused by the unconscious jitter of the human body.
“It serves two purposes.One is to reduce the parameters while maintaining dominant features, the other is to filter the interference noise caused by the unconscious jitter of the human body.”
The paper relies on this without support.
The WISDM and OPPORTUNITY datasets are imbalanced.
“The WISDM and OPPORTU-NITY mentioned above are both imbalanced datasets.”
The paper relies on this without support.
Hyper-parameters have a great impact on classification model performance.
“Hyper-parameters have a great impact on the classification model performance.”
The paper relies on this without support.
The weight parameters of CNN mainly concentrate on the fully-connected layer.
“The weight parameters of CNN mainly concentrate on the fully-connected layer.”
The paper relies on this without support.
Recordings of activities based on mobile sensors are temporal sequences.
“The recordings of activities based on mobile sensors are temporal sequences and LSTM has the ability to capture temporal information from sequential data.”
The paper relies on this without support.
LSTM has the ability to capture temporal information from sequential data.
“The recordings of activities based on mobile sensors are temporal sequences and LSTM has the ability to capture temporal information from sequential data.”
The paper relies on this without support.
When training LSTM layers, the calculation of each time step depends on the output of the previous time step.
“When training LSTM layers, the calculation of each time step depends on the output of the previous time step.”
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The more convolution kernels are used, the more hidden features of the input samples can be extracted.
“In general, it is examined that the more convolution kernels are used, the more hidden features of the input samples could be extracted [48].”
From Deep CNN-LSTM With Self-Attention Model for Human Activity Recognition Using Wearable Sensor (2022) · cites this paper as [48]
Our chosen model achieved the best testing result of 99.93% for H-Activity dataset and 98.76% and 93.11% for MHEALTH and UCI-HAR dataset respectively.
“In contrast to these three models, i.e.,sequential LSTM layers (LSTM-CNN) before Convolution layer [48], sequential Convolution and dropout layers (CNN-LSTM) before LSTM layer [59], parallel LSTM layers (Parrallel LSTM-CNN) with Convolution layer [60], our chosen model achieved the best testing result of 99.93% for H-Activity dataset and 98.76% and 93.11% for MHEALTH and UCI-HAR dataset respective”
From Deep CNN-LSTM With Self-Attention Model for Human Activity Recognition Using Wearable Sensor (2022) · cites this paper as [48]
All of the above-mentioned models [48], [59], [60] were implemented with exact parameters described in the respective literature except the input and output layer to match our dataset.
“Hence, all of the above-mentioned models [48], [59], [60] were implemented with exact parameters described in the respective literature except the input and output layer to match our dataset.”
From Deep CNN-LSTM With Self-Attention Model for Human Activity Recognition Using Wearable Sensor (2022) · cites this paper as [48]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
UCI-HAR overall accuracy has two reported values
MajorThe abstract reports 95.78% overall accuracy for UCI-HAR, whereas the results section reports 95.80% for the same measure.
“the overall accuracy of the model in the UCI-HAR dataset is 95.78%”
“For the UCI-HAR dataset, there were 2940 instances that have been correctly classified, and the overall accuracy reached 95.80%.”
WISDM waveform duration conflicts with its sampling rate
MinorAt the stated WISDM sampling rate of 20 Hz, 128 points span 6.4 seconds, not 2.56 seconds.
Reported 2.56 · recomputed 6.4
“Fig. 1 shows the acceleration waveform of 2.56 seconds (128 points in total) of each activity”
UCI-HAR is incorrectly described as having the most volunteers
MinorThe paper says UCI-HAR has the largest number of volunteers at 30, but states that WISDM has 36 subjects.
“The UCI-HAR dataset has the largest number of volunteers, which means that this dataset was constructed from the recordings of 30 subjects.”
“Its experimental object consists of 36 subjects.”
Adding an LSTM layer to model D leaves the stated total unchanged
MinorModel D is described as having two LSTM layers. The paper then says it added another layer to model D for a total of two layers.
“In model D, the data captured from mobile sensors are firstly fed into two layers of LSTMs and then transmitted to convolutional layers for feature extraction.”
“In our work, we added another layer of LSTM, in a total of 2 layers, on the basis of model D to further improve the model performance.”
WISDM overall accuracy has two reported values
MinorThe abstract reports 95.85% overall accuracy for WISDM, whereas the results section reports 95.75%.
“in the WISDM dataset is 95.85%”
“the overall accuracy of the WISDM dataset (an unbalanced dataset) reached 95.75%.”
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155 · see citing works
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946 · see citing works
Activity recognition using cell phone accelerometers
Kwapisz, J. R., Weiss, G. M., & Moore, S. A. (2011) · ACM SIGKDD Explorations Newsletter · doi:10.1145/1964897.1964918 · Cited by 2,912 · cited 1× · see citing works
“The WISDM dataset [31] has a total of 1098209 samples, and the percentage of the total samples associated with each activity was shown in Table 3.”
BackgroundDeep Convolutional and LSTM Recurrent Neural Networks for Multimodal Wearable Activity Recognition
Ordóñez, F., & Roggen, D. (2016) · Sensors · doi:10.3390/s16010115 · Cited by 2,761 · cited 2× · see citing works
“[25] proposed an activity recognition classi-fier, which combined deep CNN and LSTM to classify 27 hand gestures and five movements.”
BackgroundDeep learning for sensor-based activity recognition: A survey
Wang, J., Chen, Y., Hao, S., Peng, X., & Hu, L. (2019) · Pattern Recognition Letters · doi:10.1016/j.patrec.2018.02.010 · Cited by 2,014 · cited 1× · see citing works
“Human activity recognition (HAR) plays an important role in people’s daily lives because it has the ability to learn profound advanced knowledge about human activities from raw sensor data [1].”
BackgroundHuman activity recognition with smartphone sensors using deep learning neural networks
Ronao, C. A., & Cho, S.-B. (2016) · Expert Systems with Applications · doi:10.1016/j.eswa.2016.04.032 · Cited by 1,215 · see citing works
Sensor-Based Activity Recognition
Chen, L., Hoey, J., Nugent, C. D., Cook, D. J., & Yu, Z. (2012) · IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews) · doi:10.1109/tsmcc.2012.2198883 · Cited by 1,074 · see citing works
(2015) · Cited by 989 · see citing works
Collecting complex activity datasets in highly rich networked sensor environments
Roggen, D., Calatroni, A., Rossi, M., Holleczek, T., Forster, K., Troster, G., Lukowicz, P., Bannach, D., Pirkl, G., Ferscha, A., et al. (2010) · 2010 Seventh International Conference on Networked Sensing Systems (INSS) · doi:10.1109/inss.2010.5573462 · Cited by 788 · see citing works
The Opportunity challenge: A benchmark database for on-body sensor-based activity recognition
Chavarriaga, R., Sagha, H., Calatroni, A., Digumarti, S. T., Tröster, G., Millán, J. D. R., & Roggen, D. (2013) · Pattern Recognition Letters · doi:10.1016/j.patrec.2012.12.014 · Cited by 742 · cited 3× · see citing works
“In terms of the sensor setting, theOPPORTUNITY challenge guidelines [33] were adopted.”
MethodTransition-Aware Human Activity Recognition Using Smartphones
Reyes-Ortiz, J.-L., Oneto, L., Samà, A., Parra, X., & Anguita, D. (2016) · Neurocomputing · doi:10.1016/j.neucom.2015.07.085 · Cited by 740 · see citing works
Time Series Classification Using Multi-Channels Deep Convolutional Neural Networks
Zheng, Y., Liu, Q., Chen, E., Ge, Y., & Zhao, J. L. (2014) · Lecture notes in computer science · doi:10.1007/978-3-319-08010-9_33 · Cited by 689 · see citing works
Deep, Convolutional, and Recurrent Models for Human Activity Recognition Using Wearables
Hammerla, N. Y., Halloran, S., & Ploetz, T. (2016) · arXiv · doi:10.48550/arxiv.1604.08880 · Cited by 606 · see citing works
A Knowledge-Driven Approach to Activity Recognition in Smart Homes
Chen, L., Nugent, C., & Wang, H. (2011) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2011.51 · Cited by 591 · see citing works
Self-citationDeep Learning of Representations: Looking Forward
Bengio, Y. (2013) · Lecture notes in computer science · doi:10.1007/978-3-642-39593-2_1 · Cited by 558 · see citing works
Skeleton-Based Action Recognition Using Spatio-Temporal LSTM Network with Trust Gates
Liu, J., Shahroudy, A., Xu, D., Kot, A. C., & Wang, G. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2771306 · Cited by 535 · see citing works
A Survey on Activity Detection and Classification Using Wearable Sensors
Cornacchia, M., Ozcan, K., Zheng, Y., & Velipasalar, S. (2016) · IEEE Sensors Journal · doi:10.1109/jsen.2016.2628346 · Cited by 427 · see citing works
Hand Gesture Recognition Using Micro-Doppler Signatures With Convolutional Neural Network
Kim, Y., & Toomajian, B. (2016) · IEEE Access · doi:10.1109/access.2016.2617282 · Cited by 379 · see citing works
Feature Selection and Activity Recognition System Using a Single Triaxial Accelerometer
Gupta, P., & Dallas, T. (2014) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2014.2307069 · Cited by 335 · see citing works
InnoHAR: A Deep Neural Network for Complex Human Activity Recognition
Xu, C., Chai, D., He, J., Zhang, X., & Duan, S. (2019) · IEEE Access · doi:10.1109/access.2018.2890675 · Cited by 333 · see citing works
BodyScope: a wearable acoustic sensor for activity recognition
Yatani, K., & Truong, K. N. (2012) · Proceedings of the 2012 ACM Conference on Ubiquitous Computing · doi:10.1145/2370216.2370269 · Cited by 310 · see citing works
Wearable Inertial Sensors for Human Motion Analysis: A Review
Lopez-Nava, I. H., & Munoz-Melendez, A. (2016) · IEEE Sensors Journal · doi:10.1109/jsen.2016.2609392 · Cited by 263 · see citing works
Wearable Sensor-Based Hand Gesture and Daily Activity Recognition for Robot-Assisted Living
Zhu, C., & Sheng, W. (2011) · IEEE Transactions on Systems Man and Cybernetics - Part A Systems and Humans · doi:10.1109/tsmca.2010.2093883 · Cited by 234 · see citing works
Fast unsupervised ego-action learning for first-person sports videos
Kitani, K., Okabe, T., Sato, Y., & Sugimoto, A. (2011) · doi:10.1109/cvpr.2011.5995406 · Cited by 223 · see citing works
Human Activity Classification in Smartphones Using Accelerometer and Gyroscope Sensors
Jain, A., & Kanhangad, V. (2017) · IEEE Sensors Journal · doi:10.1109/jsen.2017.2782492 · Cited by 217 · see citing works
A Lightweight Deep Learning Model for Human Activity Recognition on Edge Devices
Agarwal, P., & Alam, M. (2020) · Procedia Computer Science · doi:10.1016/j.procs.2020.03.289 · Cited by 176 · see citing works
Super Normal Vector for Human Activity Recognition with Depth Cameras
Yang, X., & Tian, Y. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2565479 · Cited by 162 · see citing works
A-Wristocracy: Deep learning on wrist-worn sensing for recognition of user complex activities
Vepakomma, P., De, D., Das, S. K., & Bhansali, S. (2015) · 2015 IEEE 12th International Conference on Wearable and Implantable Body Sensor Networks (BSN) · doi:10.1109/bsn.2015.7299406 · Cited by 136 · see citing works
Margarito, J., Helaoui, R., Bianchi, A., Sartor, F., & Bonomi, A. (2015) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2015.2471094 · Cited by 118 · see citing works
Recognizing Human Activity in Free-Living Using Multiple Body-Worn Accelerometers
Fullerton, E., Heller, B., & Munoz-Organero, M. (2017) · IEEE Sensors Journal · doi:10.1109/jsen.2017.2722105 · Cited by 81 · see citing works
Lin, Y., Le Kernec, J., Yang, S., Fioranelli, F., Romain, O., & Zhao, Z. (2018) · IEEE Sensors Journal · doi:10.1109/jsen.2018.2872849 · Cited by 81 · see citing works
Sum Product Networks for Activity Recognition
Amer, M. R., & Todorović, S. (2015) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2015.2465955 · Cited by 78 · see citing works
Compressive Sequential Learning for Action Similarity Labeling
Qin, J., Liu, L., Zhang, Z., Wang, Y., & Shao, L. (2016) · IEEE Transactions on Image Processing · doi:10.1109/tip.2015.2508600 · Cited by 55 · see citing works
Muñoz-Organero, M. (2018) · IEEE Sensors Journal · doi:10.1109/jsen.2018.2882943 · Cited by 50 · see citing works
Ronaoo, C. A., & Cho, S. (2015) · 한국정보과학회 학술발표논문집 · Cited by 43 · see citing works
Activity Recognition Using Complex Network Analysis
Jalloul, N., Porée, F., Viardot, G., Hostis, P. L., & Carrault, G. (2017) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2017.2762404 · Cited by 32 · see citing works
Concurrent Recognition of Cross-Scale Activities via Sensorless Sensing
Wang, L., Su, X., Jing, N., Wenyuan, L., & Binbin, L. (2018) · IEEE Sensors Journal · doi:10.1109/jsen.2018.2874506 · Cited by 14 · see citing works
Human activity recognition using a low cost, COTS radar network
Çağlıyan, B., Karabacak, C., & Gürbüz, S. Z. (2014) · Proceedings of the IEEE National Radar Conference · doi:10.1109/radar.2014.6875784 · Cited by 13 · see citing works
A Lightweight Deep Learning Model for Human Activity Recognition on Edge Devices
Agarwal, P., & Alam, M. (2019) · arXiv · doi:10.48550/arxiv.1909.12917
Flagged first, then by citations
1 of the 40 references couldn’t be matched to a known paper.
Cited by
Sorted by citations
Deep Learning in Human Activity Recognition with Wearable Sensors: A Review on Advances
Zhang, S., Li, Y., Zhang, S., Shahabi, F., Xia, S., Deng, Y., & Alshurafa, N. (2022) · Sensors · doi:10.3390/s22041476 · Cited by 625 · see citing works
“Similarly, other researchers [8, 82, 94, 95, 197, 245, 301, 302], [238] have also developed the CNN-LSTM model in varios application scenarios by taking advantage of the feature extraction ability of CNN and the time-series data reasoning ability of LSTM.”
BackgroundRamanujam, E., Perumal, T., & Padmavathi, S. (2021) · IEEE Sensors Journal · doi:10.1109/jsen.2021.3069927 · Cited by 455 · see citing works
A review of machine learning in processing remote sensing data for mineral exploration
Shirmard, H., Farahbakhsh, E., Müller, R. D., & Chandra, R. (2021) · Remote Sensing of Environment · doi:10.1016/j.rse.2021.112750 · Cited by 434 · see citing works
Multi-input CNN-GRU based human activity recognition using wearable sensors
Dua, N., Singh, S. N., & Semwal, V. B. (2021) · Computing · doi:10.1007/s00607-021-00928-8 · Cited by 432 · see citing works
Materials-Driven Soft Wearable Bioelectronics for Connected Healthcare
Gong, S. P., Yan, L., Yin, J., Levin, A., & Cheng, W. (2024) · Chemical Reviews · doi:10.1021/acs.chemrev.3c00502 · Cited by 424 · see citing works
Human activity recognition in artificial intelligence framework: a narrative review
Gupta, N., Gupta, S. K., Pathak, R. K., Jain, V., Rashidi, P., & Suri, J. S. (2022) · Artificial Intelligence Review · doi:10.1007/s10462-021-10116-x · Cited by 348 · see citing works
A multibranch CNN-BiLSTM model for human activity recognition using wearable sensor data
Challa, S. K., Kumar, A., & Semwal, V. B. (2022) · The Visual Computer · doi:10.1007/s00371-021-02283-3 · Cited by 338 · see citing works
Deep CNN-LSTM With Self-Attention Model for Human Activity Recognition Using Wearable Sensor
Khatun, M. A., Yousuf, M. A., Ahmed, S., Uddin, M. Z., Alyami, S. A., Al-Ashhab, S., Akhdar, H. F., Khan, A., Azad, A., & Moni, M. A. (2022) · IEEE Journal of Translational Engineering in Health and Medicine · doi:10.1109/jtehm.2022.3177710 · Cited by 288 · see citing works
“…linear units (ReLU) are used by convolutional layers in the calculation of the feature maps, where the non-linear function is denoted like the following : In general, it is examined that the more convolution kernels are used, the more hidden features of the input samples could be extracted [48].”
Mekruksavanich, S., & Jitpattanakul, A. (2021) · Electronics · doi:10.3390/electronics10030308 · Cited by 229 · see citing works
Deep learning based human activity recognition (HAR) using wearable sensor data
Gupta, S. (2021) · International Journal of Information Management Data Insights · doi:10.1016/j.jjimei.2021.100046 · Cited by 225 · see citing works
Kumar, P., Chauhan, S., & Awasthi, L. K. (2023) · Archives of Computational Methods in Engineering · doi:10.1007/s11831-023-09986-x · Cited by 220 · see citing works
Amiri, Z., Heidari, A., Navimipour, N. J., Ünal, M., & Mousavi, A. (2023) · Multimedia Tools and Applications · doi:10.1007/s11042-023-16382-x · Cited by 210 · see citing works
The major human AP endonuclease (Ape1) is involved in the nucleotide incision repair pathway
Gros, L. (2004) · Nucleic Acids Research · doi:10.1093/nar/gkh165 · Cited by 209 · see citing works
Deep ConvLSTM With Self-Attention for Human Activity Decoding Using Wearable Sensors
SINGH, S. P., Sharma, M. K., Lay-Ekuakille, A., Gangwar, D., & Gupta, S. (2020) · IEEE Sensors Journal · doi:10.1109/jsen.2020.3045135 · Cited by 208 · see citing works
Attention induced multi-head convolutional neural network for human activity recognition
Khan, Z. N., & Ahmad, J. (2021) · Applied Soft Computing · doi:10.1016/j.asoc.2021.107671 · Cited by 187 · see citing works
GRU-INC: An inception-attention based approach using GRU for human activity recognition
Mim, T. R., Amatullah, M., Afreen, S., Yousuf, M., Uddin, S., Alyami, S. A., Hasan, K. F., & Moni, M. A. (2022) · Expert Systems with Applications · doi:10.1016/j.eswa.2022.119419 · Cited by 182 · see citing works
Sensor-Based Human Activity Recognition with Spatio-Temporal Deep Learning
Nafea, O., Abdul, W., Muhammad, G., & Alsulaiman, M. (2021) · Sensors · doi:10.3390/s21062141 · Cited by 164 · see citing works
A comprehensive study of deep learning for soil moisture prediction
Wang, Y., Shi, L., Hu, Y., Hu, X., Song, W., & Wang, L. (2024) · Hydrology and earth system sciences · doi:10.5194/hess-28-917-2024 · Cited by 164 · see citing works
Human Activity Recognition Based on Residual Network and BiLSTM
Li, Y., & Wang, L. (2022) · Sensors · doi:10.3390/s22020635 · Cited by 156 · see citing works
Inception inspired CNN-GRU hybrid network for human activity recognition
Dua, N., Singh, S. N., Semwal, V. B., & Challa, S. K. (2022) · Multimedia Tools and Applications · doi:10.1007/s11042-021-11885-x · Cited by 150 · see citing works
Mekruksavanich, S., & Jitpattanakul, A. (2021) · Electronics · doi:10.3390/electronics10141685 · Cited by 138 · see citing works
A review of machine learning-based human activity recognition for diverse applications
Kulsoom, F., Narejo, S., Mehmood, Z., Chaudhry, H. N., Butt, A., & Bashir, A. K. (2022) · Neural Computing and Applications · doi:10.1007/s00521-022-07665-9 · Cited by 138 · see citing works
ST-DeepHAR: Deep Learning Model for Human Activity Recognition in IoHT Applications
Abdel-Basset, M., Hawash, H., Chakrabortty, R. K., Ryan, M., Elhoseny, M., & Song, H. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.3033430 · Cited by 136 · see citing works
A Survey of Video Surveillance Systems in Smart City
Myagmar-Ochir, Y., & Kim, W. (2023) · Electronics · doi:10.3390/electronics12173567 · Cited by 134 · see citing works
“The accuracy of the recognition depends on the quality and quantity of data collected and the complexity of the machine learning model that is used for analysis [106–109].”
MethodBhattacharya, D., Sharma, D., Kim, W., Ijaz, M. F., & Singh, P. K. (2022) · Biosensors · doi:10.3390/bios12060393 · Cited by 126 · see citing works
A Novel Deep Learning Bi-GRU-I Model for Real-Time Human Activity Recognition Using Inertial Sensors
Tong, L., Ma, H., Lin, Q., He, J., & Peng, L. (2022) · IEEE Sensors Journal · doi:10.1109/jsen.2022.3148431 · Cited by 120 · see citing works
2D mapping of texture and lattice parameters of dental enamel
Al‐Jawad, M., Steuwer, A., Kilcoyne, S. H., Shore, R. C., Cywiński, R., & Wood, D. J. (2007) · Biomaterials · doi:10.1016/j.biomaterials.2007.02.019 · Cited by 116 · see citing works
A Multichannel CNN-GRU Model for Human Activity Recognition
Lu, L., Zhang, C., Cao, K., Deng, T., & Yang, Q. (2022) · IEEE Access · doi:10.1109/access.2022.3185112 · Cited by 110 · see citing works
Human activity recognition from sensor data using spatial attention-aided CNN with genetic algorithm
Sarkar, A., Hossain, S., & Sarkar, R. (2022) · Neural Computing and Applications · doi:10.1007/s00521-022-07911-0 · Cited by 107 · see citing works
Koşar, E., & Barshan, B. (2023) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2023.106529 · Cited by 106 · see citing works
Thakur, D., Biswas, S., Ho, E. S. L., & Chattopadhyay, S. (2022) · IEEE Access · doi:10.1109/access.2022.3140373 · Cited by 104 · see citing works
Dahou, A., Al‐qaness, M. A. A., Elaziz, M. A., & Helmi, A. M. (2022) · Measurement · doi:10.1016/j.measurement.2022.111445 · Cited by 104 · see citing works
Human Activity Recognition for Elderly People Using Machine and Deep Learning Approaches
Hayat, A., Morgado‐Dias, F., Bhuyan, B. P., & Tomar, R. (2022) · Information · doi:10.3390/info13060275 · Cited by 102 · see citing works
Yi, M.-K., Lee, W., & Hwang, S. O. (2023) · IEEE Transactions on Consumer Electronics · doi:10.1109/tce.2023.3266506 · Cited by 102 · see citing works
Machine Learning Methods in Smart Lighting Toward Achieving User Comfort: A Survey
Putrada, A. G., Abdurohman, M., Perdana, D., & Nuha, H. H. (2022) · IEEE Access · doi:10.1109/access.2022.3169765 · Cited by 101 · see citing works
“Xia et al. [332] compares three deep learning methods, namely LSTM, CNN, and a combination of LSTM and CNN. Predictions run on three different datasets with six movement classes.”
MethodJeong, D. U., & Lim, K. M. (2021) · Scientific Reports · doi:10.1038/s41598-021-92997-0 · Cited by 100 · see citing works
Xia, K., Li, Y., & Zhu, B. (2024) · IEEE Access · doi:10.1109/access.2024.3381345 · Cited by 97 · see citing works
Self-citationCNNs, RNNs and Transformers in human action recognition: a survey and a hybrid model
Alomar, K., Aysel, H. I., & Cai, X. (2025) · Artificial Intelligence Review · doi:10.1007/s10462-025-11388-3 · Cited by 96 · see citing works
Human Activity Recognition Using an Ensemble Learning Algorithm with Smartphone Sensor Data
Tan, T.-H., Wu, J., Liu, S.-H., & Gochoo, M. (2022) · Electronics · doi:10.3390/electronics11030322 · Cited by 94 · see citing works
Dilated causal convolution with multi-head self attention for sensor human activity recognition
Hamad, R. A., Kimura, M., Yang, L., Woo, W. L., & Wei, B. W. (2021) · Neural Computing and Applications · doi:10.1007/s00521-021-06007-5 · Cited by 92 · see citing works
Recognition of human activity using GRU deep learning algorithm
Mohsen, S. (2023) · Multimedia Tools and Applications · doi:10.1007/s11042-023-15571-y · Cited by 91 · see citing works
Machine Learning and AI Technologies for Smart Wearables
Seng, K. P., Ang, L.-M., Peter, E., & Mmonyi, A. (2023) · Electronics · doi:10.3390/electronics12071509 · Cited by 90 · see citing works
An improved human activity recognition technique based on convolutional neural network
Ravi Raj, K. G., & Kos, A. (2023) · Scientific Reports · doi:10.1038/s41598-023-49739-1 · Cited by 89 · see citing works
Helmi, A. M., Al‐qaness, M. A. A., Dahou, A., Damaševičius, R., Krilavičius, T., & Elaziz, M. A. (2021) · Entropy · doi:10.3390/e23081065 · Cited by 87 · see citing works
Mekruksavanich, S., Jitpattanakul, A., Sıtthıthakerngkıet, K., Youplao, P., & Yupapin, P. P. (2022) · IEEE Access · doi:10.1109/access.2022.3174124 · Cited by 85 · see citing works
A new framework for deep learning video based Human Action Recognition on the edge
Cob-Parro, A. C., Losada-Gutiérrez, C., Marrón-Romera, M., Gardel, A., & Bravo, I. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.122220 · Cited by 85 · see citing works
Visual Research Ethics at the Crossroads1
Wiles, R., Clark, A., & Prosser, J. (2011) · SAGE Publications Ltd eBooks · doi:10.4135/9781446268278.n36 · Cited by 85 · see citing works
Yen, C.-T., Liao, J.-X., & Huang, Y.-K. (2020) · IEEE Access · doi:10.1109/access.2020.3025938 · Cited by 84 · see citing works
Shuvo, M. M. H., Ahmed, N., Nouduri, K., & Palaniappan, K. (2020) · IEEE Applied Imagery Pattern Recognition Workshop · doi:10.1109/aipr50011.2020.9425332 · Cited by 84 · see citing works
Human Activity Recognition Using Attention-Mechanism-Based Deep Learning Feature Combination
Akter, M., Shafew, A., Khan, M. A.-M., & Kim, D. (2023) · Sensors · doi:10.3390/s23125715 · Cited by 84 · see citing works
Hassall, C., Hill, M., Gledhill, D., & Biggs, J. (2016) · Routledge eBooks · doi:10.4324/9781315713373 · Cited by 83 · see citing works
Miao, F., Huang, Y., Lu, Z., Ohtsuki, T. O., Gui, G., & Sari, H. (2024) · ACM Computing Surveys · doi:10.1145/3705893 · Cited by 82 · see citing works
Human activity recognition from multiple sensors data using deep CNNs
Kaya, Y., & Topuz, E. K. (2023) · Multimedia Tools and Applications · doi:10.1007/s11042-023-15830-y · Cited by 81 · see citing works
Industry 4.0-Oriented Deep Learning Models for Human Activity Recognition
Mohsen, S., Elkaseer, A., & Scholz, S. G. (2021) · IEEE Access · doi:10.1109/access.2021.3125733 · Cited by 80 · see citing works
Student Recognition and Activity Monitoring in E-Classes Using Deep Learning in Higher Education
Alruwais, N. M., & Zakariah, M. (2024) · IEEE Access · doi:10.1109/access.2024.3354981 · Cited by 78 · see citing works
An Efficient and Lightweight Deep Learning Model for Human Activity Recognition Using Smartphones
Ankita, Rani, S., Babbar, H., Coleman, S., Singh, A. D., & Aljahdali, H. M. (2021) · Sensors · doi:10.3390/s21113845 · Cited by 76 · see citing works
Mekruksavanich, S., & Jitpattanakul, A. (2023) · Scientific Reports · doi:10.1038/s41598-023-39080-y · Cited by 75 · see citing works
An image and text-based multimodal model for detecting fake news in OSN’s
Uppada, S. K., Patel, P. K., & Sivaselvan, B. (2022) · Journal of Intelligent Information Systems · doi:10.1007/s10844-022-00764-y · Cited by 75 · see citing works
Improving Deep Learning for HAR with Shallow LSTMs
Bock, M., Hölzemann, A., Moeller, M., & Van Laerhoven, K. (2021) · 2021 International Symposium on Wearable Computers · doi:10.1145/3460421.3480419 · Cited by 74 · see citing works
Enhancing human activity recognition using deep learning and time series augmented data
Alawneh, L. M., Alsarhan, T., Al-Zinati, M., Al‐Ayyoub, M., Jararweh, Y., & Lu, H. (2021) · Journal of Ambient Intelligence and Humanized Computing · doi:10.1007/s12652-020-02865-4 · Cited by 69 · see citing works
Alessandrini, M., Biagetti, G., Crippa, P., Falaschetti, L., & Turchetti, C. (2021) · Electronics · doi:10.3390/electronics10141715 · Cited by 69 · see citing works
Human activity recognition in cyber-physical systems using optimized machine learning techniques
Priyadarshini, I., Sharma, R., Bhatt, D., & Al-Numay, M. S. (2022) · Cluster Computing · doi:10.1007/s10586-022-03662-8 · Cited by 69 · see citing works
Multimodal spatiotemporal skeletal kinematic gait feature fusion for vision-based fall detection
Amsaprabhaa, M., Nancy Jane, Y., & Khanna Nehemiah, H. (2022) · Expert Systems with Applications · doi:10.1016/j.eswa.2022.118681 · Cited by 68 · see citing works
Novel Deep Learning Network for Gait Recognition Using Multimodal Inertial Sensors
Shi, L., Liu, Z.-Y., Zhou, K.-J., Shi, Y., & Xiao, J. (2023) · Sensors · doi:10.3390/s23020849 · Cited by 68 · see citing works
Al‐qaness, M. A. A., Dahou, A., Trouba, N. T., Elaziz, M. A., & Helmi, A. M. (2024) · Future Generation Computer Systems · doi:10.1016/j.future.2024.06.016 · Cited by 68 · see citing works
Deep CNN hyperparameter optimization algorithms for sensor-based human activity recognition
Raziani, S., & Azimbagirad, M. (2022) · Neuroscience Informatics · doi:10.1016/j.neuri.2022.100078 · Cited by 67 · see citing works
Saha, A., Rajak, S., Saha, J., & Chowdhury, C. (2022) · Journal of Ambient Intelligence and Humanized Computing · doi:10.1007/s12652-022-03870-5 · Cited by 67 · see citing works
Rani, G. J., Hashmi, M. F., & Gupta, A. D. (2023) · IEEE Access · doi:10.1109/access.2023.3316509 · Cited by 64 · see citing works
Dual-Branch Interactive Networks on Multichannel Time Series for Human Activity Recognition
Tang, Y., Zhang, L., Wu, H., He, J., & Song, A. (2022) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2022.3193148 · Cited by 63 · see citing works
Phukan, N., Mohine, S., Mondal, A., Manikandan, M. S., & Pachori, R. B. (2022) · IEEE Sensors Journal · doi:10.1109/jsen.2022.3206916 · Cited by 63 · see citing works
Two-stream transformer network for sensor-based human activity recognition
Xiao, S., Wang, S., Huang, Z., Wang, Y., & Jiang, H. (2022) · Neurocomputing · doi:10.1016/j.neucom.2022.09.099 · Cited by 63 · see citing works
Sánchez, P. M. S., Celdrán, A. H., Bovet, G., & Pérez, G. M. (2023) · Future Generation Computer Systems · doi:10.1016/j.future.2023.10.011 · Cited by 63 · see citing works
Khan, S., Khan, M. A., Alhaisoni, M. M., Tariq, U., Yong, H.-S., Armghan, A., & Alenezi, F. S. (2021) · Sensors · doi:10.3390/s21237941 · Cited by 60 · see citing works
Human Activity Recognition Using Wearable Sensors: Review, Challenges, Evaluation Benchmark
Abdel-Salam, R., Mostafa, R., & Hadhood, M. (2021) · Communications in Computer and Information Science · doi:10.1007/978-981-16-0575-8_1 · Cited by 60 · see citing works
Predictive Analytics for Sustainable E-Learning: Tracking Student Behaviors
Mudawi, N. A., Pervaiz, M., Alabduallah, B. I., Alazeb, A., Alshahrani, A. S., Alotaibi, S. S., & Jalal, A. (2023) · Sustainability · doi:10.3390/su152014780 · Cited by 57 · see citing works
Reliability of the Dynamic Strength Index in College Athletes
THOMAS, C. R., Jones, P. A., & Comfort, P. (2014) · International Journal of Sports Physiology and Performance · doi:10.1123/ijspp.2014-0255 · Cited by 57 · see citing works
Deep Residual Network for Smartwatch-Based User Identification through Complex Hand Movements
Mekruksavanich, S., & Jitpattanakul, A. (2022) · Sensors · doi:10.3390/s22083094 · Cited by 56 · see citing works
Mekruksavanich, S., & Jitpattanakul, A. (2022) · Mathematical Biosciences & Engineering · doi:10.3934/mbe.2022265 · Cited by 56 · see citing works
Dahou, A., Al‐qaness, M. A. A., Elaziz, M. A., & Helmi, A. M. (2023) · IEEE Internet of Things Journal · doi:10.1109/jiot.2023.3286378 · Cited by 56 · see citing works
Issa, M., Helmi, A. M., Al‐qaness, M. A. A., Dahou, A., Elaziz, M. A., & Damaševičius, R. (2022) · Healthcare · doi:10.3390/healthcare10061084 · Cited by 55 · see citing works
Hoai Thu, N. T., & Han, D. S. (2021) · IEEE Access · doi:10.1109/access.2021.3122298 · Cited by 54 · see citing works
Mekruksavanich, S., Hnoohom, N., & Jitpattanakul, A. (2022) · Applied Sciences · doi:10.3390/app12104988 · Cited by 54 · see citing works
HIT HAR: Human Image Threshing Machine for Human Activity Recognition Using Deep Learning Models
Poulose, A., Kim, J. H., & Han, D. S. (2022) · Computational Intelligence and Neuroscience · doi:10.1155/2022/1808990 · Cited by 54 · see citing works
DCapsNet: Deep capsule network for human activity and gait recognition with smartphone sensors
Sezavar, A., Atta, R., & Ghanbari, M. (2023) · Pattern Recognition · doi:10.1016/j.patcog.2023.110054 · Cited by 54 · see citing works
Comprehensive machine and deep learning analysis of sensor-based human activity recognition
Balaha, H. M., & Hassan, A. E.-S. (2023) · Neural Computing and Applications · doi:10.1007/s00521-023-08374-7 · Cited by 52 · see citing works
SoK: Model Inversion Attack Landscape: Taxonomy, Challenges, and Future Roadmap
Dibbo, S. V. (2023) · IEEE Computer Security Foundations Workshop (CSFW) · doi:10.1109/csf57540.2023.00027 · Cited by 52 · see citing works
An ensemble deep learning model for human activity analysis using wearable sensory data
Batool, S., Khan, M. H., & Farid, M. S. (2024) · Applied Soft Computing · doi:10.1016/j.asoc.2024.111599 · Cited by 52 · see citing works
Attention-Based Residual BiLSTM Networks for Human Activity Recognition
Zhang, J., Liu, Y., & Yuan, H. (2023) · IEEE Access · doi:10.1109/access.2023.3310269 · Cited by 51 · see citing works
An Efficient Human Activity Recognition Using Hybrid Features and Transformer Model
Saidani, O., Alsafyani, M., Alroobaea, R., Alturki, N. M., Jahangir, R., & Jamel, L. (2023) · IEEE Access · doi:10.1109/access.2023.3314492 · Cited by 51 · see citing works
Bhuiyan, R. A., Ahmed, N., Amiruzzaman, M., & Islam, M. R. (2020) · Sensors · doi:10.3390/s20236990 · Cited by 50 · see citing works
Human activity recognition: A comprehensive review
Kaur, H., Rani, V., & Kumar, M. (2024) · Expert Systems · doi:10.1111/exsy.13680 · Cited by 50 · see citing works
Xu, J., Pan, S., Sun, P. Z. H., Guo, K., Park, S. H., Yan, F., Gao, M., Wanyan, X., Cheng, H., & Wu, E. Q. (2025) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2025.3558085 · Cited by 49 · see citing works
Multi-Head CNN-LSTM with Prediction Error Analysis for Remaining Useful Life Prediction
Mo, H., Lucca, F., Malacarne, J., & Iacca, G. (2020) · Conference of Open Innovations Association (FRUCT) · doi:10.23919/fruct49677.2020.9211058 · Cited by 48 · see citing works
Thakur, D., Dangi, S., & Lalwani, P. (2024) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2024.106870 · Cited by 47 · see citing works
Cuperman, R., Jansen, K. M. B., & Ciszewski, M. G. (2022) · Sensors · doi:10.3390/s22041347 · Cited by 46 · see citing works
Al‐qaness, M. A. A., Helmi, A. M., Dahou, A., & Elaziz, M. A. (2022) · Biosensors · doi:10.3390/bios12100821 · Cited by 46 · see citing works
Knowledge discovery in temporal databases
Saraee, M. H. (1995) · doi:10.1049/ic:19950112 · Cited by 46 · see citing works
An approach to sport activities recognition based on an inertial sensor and deep learning
Pająk, G., Krutz, P., Patalas‐Maliszewska, J., Rehm, M., Pająk, I., & Dix, M. (2022) · Sensors and Actuators A Physical · doi:10.1016/j.sna.2022.113773 · Cited by 45 · see citing works
HAR-DeepConvLG: Hybrid deep learning-based model for human activity recognition in IoT applications
Ding, W., Abdel‐Basset, M., & Mohamed, R. (2023) · Information Sciences · doi:10.1016/j.ins.2023.119394 · Cited by 45 · see citing works
Smart-Wearable Sensors and CNN-BiGRU Model: A Powerful Combination for Human Activity Recognition
Imran, H. A., Riaz, Q., Hussain, M., Tahir, H., & Arshad, R. (2023) · IEEE Sensors Journal · doi:10.1109/jsen.2023.3338264 · Cited by 45 · see citing works
- Authors
- Xia, K., Huang, J., & Wang, H.
- Affiliations
- University of Shanghai for Science and Technology (CN)
- Venue
- IEEE Access
- Published
- 2020
- Volume
- 8
- Pages
- 56855-56866
- ISSN
- 2169-3536 (ISSN-L)
- OpenAlex
- W3011785450
- Cited by
- 851
- References
- 40
- Citations by year
- 2026: 68 · 2025: 169 · 2024: 169 · 2023: 185 · 2022: 136 · 2021: 83 · 2020: 14 · 2017: 2 · 2016: 2 · 2014: 3 · 2013: 1 · 2012: 1
- FWCI
- 40.64
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- IEEE Access (publishedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- National Natural Science Foundation of China (512070901, 51637001)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Context-Aware Activity Recognition Systems
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Human Pose and Action Recognition
- Physical Sciences › Engineering › Biomedical Engineering › Gait Recognition and Analysis
- Keywords
- human activity recognition, long short-term memory, convolutional neural networks, mobile sensor data, wearable computing, automatic feature extraction, global average pooling, batch normalization, UCI HAR dataset, WISDM dataset, Opportunity dataset
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-07.
Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-07.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review