InnoHAR: A Deep Neural Network for Complex Human Activity Recognition
Open accessAbstract
Human activity recognition (HAR) based on sensor networks is an important research direction in the fields of pervasive computing and body area network. Existing researches often use statistical machine learning methods to manually extract and construct features of different motions. However, in the face of extremely fast-growing waveform data with no obvious laws, the traditional feature engineering methods are becoming more and more incapable. With the development of deep learning technology, we do not need to manually extract features and can improve the performance in complex human activity recognition problems. By migrating deep neural network experience in image recognition, we propose a deep learning model (InnoHAR) based on the combination of inception neural network and recurrent neural network. The model inputs the waveform data of multi-channel sensors end-to-end. Multi-dimensional features are extracted by inception-like modules by using various kernel-based convolution layers. Combined with GRU, modeling for time series features is realized, making full use of data characteristics to complete classification tasks. Through experimental verification on three most widely used public HAR datasets, our proposed method shows consistent superior performance and has good generalization performance, when compared with the state-of-the-art.
AI snapshot
Written from the paper’s full text.
TL;DR
The paper proposes InnoHAR, a deep model combining Inception-like modules with GRU layers for wearable-sensor human activity recognition. It reports higher F-measure than CNN and DeepConvLSTM baselines on three public HAR datasets and demonstrates real-time prediction on an embedded board.
Key findings
- InnoHAR achieved the best F-measure on all three datasets: 0.946 on Opportunity, 0.935 on PAMAP2, and 0.945 on Smartphones, compared with CNN (0.851, 0.88, 0.915) and DeepConvLSTM (0.915, 0.905, 0.91).
- On Opportunity, the paper reports about a 9% increase over CNN and a 3% improvement over DeepConvLSTM; on PAMAP2, nearly a 5% gap between best and worst and a 3% advantage over DeepConvLSTM.
- Adding an extra CNN layer to DeepConvLSTM did not improve accuracy and caused a decline; replacing LSTM with bi-LSTM increased accuracy slightly but was difficult to parallelize and time-consuming.
- On a MinnowBoard Turbot Dual Core Board, the model took 152.02 s to predict all 9894 sliding windows, reaching 65.09 pieces/s, which the authors say easily supports real-time activity prediction for data recorded at 30 Hz.
Methods
- InnoHAR uses four Inception-like modules with 1×1, 1×3, and 1×5 convolution kernels plus pooling, followed by two GRU layers; ELU is used as the nonlinear activation, and multi-channel waveform data are input end-to-end.
- Experiments use three public datasets: Opportunity (113 on-body channels, 30 Hz, 18 classes including Null, 24-line sliding window sliding 12 lines, 9,984 test pieces), PAMAP2 (9 participants, 18 activities, 52 dimensions, accelerometer downsampled to 33.3 Hz, 5.12 s windows with 1 s stepping), and Smartphone (30 subjects, six activities, 50 Hz, 2.56 s windows with 50% overlap).
- Performance is evaluated by F1-score with class weighting; the model is compared with CNN and DeepConvLSTM, modified state-of-the-art variants, and tested for efficiency on an embedded MinnowBoard system.
Limitations
- The paper states future work will continue adjusting the network structure, including kernel size and connection method, and will further explore data imbalance in real-life human activity recognition.
- Evident from the text: evaluation is limited to three public datasets, with no statistical significance testing or broad ablation beyond modified DeepConvLSTM variants.
- Evident from the text: the reported test-window count differs between sections (9,984 pieces for testing vs. 9894 sliding windows in the efficiency analysis), and the PAMAP2 window description says “non-overlapping” while also stating 78% overlap.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
0 of 23 cited sources checked · 0 supported · 0 flagged
- Findingnone given§ B. COMPARED WITH IMPROVED STATE-OF-THE-ARTS · p. 8
Transforming DeepConvLSTM into a bidirectional LSTM increases accuracy slightly.
“In contrast, when DeepConvLSTM was transformed into a bidirectional LSTM, the accuracy did increase slightly.”
Quote in the paperNot a substantial claim - Findingnone given§ D. PERFORMANCE MEASURE · p. 6
The gestures of the OPPORTUNITY dataset are extremely imbalanced, with the Null class accounting for more than 70% of all the data.
“The gestures of OPPORTUNITY dataset are extremely imbalanced, the Null class accounts for more than 70% of all the data.”
Quote in the paperNot a substantial claim - Interpretationreasoning§ I. INTRODUCTION · p. 2
This concatenation greatly reduces interference and misidentification caused by no obvious segmentation.
“which greatly reduces the interference and misidenti cation caused by no obvious segmentation.”
Quote in the paperSubstantial claim - Premisecitation§ A. CONVOLUTIONAL NEURAL NETWORK · p. 3
Extracting more useful features from the original signal requires sufficient expert knowledge, which inevitably limits a systematic exploration of the feature space.
“Extracting more useful features from the original signal requires suf cient expert knowledge, which inevitably limits a systematic exploration of the feature space [17].”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [17] source
Not checked in the free run.
- Premisecitation§ B. TEMPORAL FEATURES EXTRACTION · p. 4
Vanilla RNN has a problem of gradient disappearance.
“Experience has shown that vanilla RNN has a problem of gradient disappearance [18]”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [18]
Not checked in the free run.
- Premisereasoning§ I. INTRODUCTION · p. 2
Applying time dependence to features obtained from original sensors is a key factor for the success of sequential human activity recognition.
“Applying the time dependence to the features obtained from the original sensors is a key factor for the success of sequential human activity recognition.”
Quote in the paperSubstantial claim - Premisereasoning§ B. LONG SHORT-TERM MEMORY · p. 3
Approaches that specifically incorporate temporal dependencies of sensor data streams are more appropriate for human activity recognition.
“Instead, approaches that speci cally incorporate temporal dependencies of sensor data streams seem more appropriate for human activity recognition.”
Quote in the paperSubstantial claim - Premisecitation§ I. INTRODUCTION · p. 2
Complex network frameworks for HAR suffered from low efficiency and can hardly meet real-time requirements in practical applications.
“However, these complex network framework suffered from low ef ciency and can hardly meet real-time requirements in practice applications.”
Quote in the paperSubstantial claim0 of 3 sources checked - Interpretationreasoning§ I. INTRODUCTION · p. 2
Concatenating different scales based convolution layers, pooling layers, and multiple nonlinear activations superimposes and enlarges their advantages, making high-dimensional features of a single human activity more easily extracted.
“With the concatenation of different scales based convolution layers, pooling layers, and multiple nonlinear activation, above mentioned advantages are superimposed and enlarged, so that the high-dimensional features of a single human activity are more easily extracted”
Quote in the paperNot a substantial claim - Interpretationreasoning§ B. COMPARED WITH IMPROVED STATE-OF-THE-ARTS · p. 8
LSTM's sequential computation makes GPU parallelization difficult.
“However, LSTM was used as a network layer for timing modeling. The calculation of the latter node must wait until that of the previous node completes. It is dif cult to parallelize the calculation by GPU.”
Quote in the paperSubstantial claim - Premisecitation§ D. PERFORMANCE MEASURE · p. 6
Human activity datasets collected in natural scenes are often imbalanced between classes.
“Human activity datasets collected in natural scenes are often imbalanced between classes [26].”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [26]
Not checked in the free run.
- Interpretationreasoning§ D. PERFORMANCE MEASURE · p. 6
The overall classification accuracy is not an appropriate index for performance evaluation on imbalanced human activity datasets.
“The overall classi cation accuracy is not an appropriate index for performance evaluation.”
Quote in the paperSubstantial claim - Interpretationown data§ VI. CONCLUSION · p. 9
InnoHAR has more potential in real-time applications, as shown by the practice test on the MinnowBoard Turbot Dual Core Board.
“In the experiment, we also proved that our innovative structure has more potential in realtime applications by practice test on MinnowBoard Turbot Dual Core Board.”
Quote in the paperSubstantial claim- Rests on an assumption: The MinnowBoard Turbot Dual Core Board is representative of embedded systems used in real-time human activity recognition applications.
- May combine two claims. 24
- Classified as probably not a substantial claim. 11
- The quote only partly states this claim. 2
May combine two claims.
Findingown data§ CHENG XU 1,2 , (Student Member, IEEE), DUO CHAI 1,2 , JIE HE 1,2 , XIAOTONG ZHANG 1,2 , (Senior Member, IEEE), AND SHIHONG DUAN 1,2 · p. 1The proposed InnoHAR method shows consistent superior performance and good generalization on three widely used public HAR datasets compared with state-of-the-art methods.
“Through experimental veri cation on three most widely used public HAR datasets, our proposed method shows consistent superior performance and has good generalization performance, when compared with the state-of-the-art.”
Quote in the paperSubstantial claim- Rests on an assumption: The three public HAR datasets used are the most widely used public HAR datasets.
May combine two claims.
Findingown data§ I. INTRODUCTION · p. 2Blindly superposing network layers and accumulating parameters multiplies training and verification time and reduces the efficiency of learning and prediction.
“By comparison experiments on three most widely used public datasets, it is proved that the blindly superposition of network layers and the accumulation of parameters, in addition to multiplying the training and veri cation time, reduces the ef ciency of learning and prediction.”
Quote in the paperSubstantial claimMay combine two claims.
Findingreasoning§ I. INTRODUCTION · p. 2Blindly superposing network layers and accumulating parameters cannot improve recognition accuracy and leads to a decline in prediction results.
“It cannot improve the accuracy of recognition, but lead to a decline in prediction results, perhaps because the network is too deep and insuf cient data volume makes the structure dif cult to be fully trained.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown data§ A. COMPARED WITH BASELINES AND STATE-OF-THE-ARTS · p. 8On the Smartphone dataset, InnoHAR is superior to both CNN and DeepConvLSTM.
“For smartphones dataset, InnoHAR is also superior to the other two methods and maintains good generalization performance.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown data§ A. COMPARED WITH BASELINES AND STATE-OF-THE-ARTS · p. 8On the Opportunity dataset, InnoHAR improves F1-score by about 9% over CNN and by 3% over DeepConvLSTM.
“For Opportunit dataset, our proposed model has a signi cant increase of about 9% compared with the CNN model of Yang et al. [25], as well as a 3% improvement compared with DeepConvLSTM.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [25] source
Not checked in the free run.
May combine two claims.
Findingown data§ A. COMPARED WITH BASELINES AND STATE-OF-THE-ARTS · p. 8On the PAMAP2 dataset, InnoHAR improves F1-score by nearly 5% over CNN and by 3% over DeepConvLSTM.
“For PAMAP2 dataset, we can also observe nearly a 5% gap between the best (proposed model) and worst (CNN [25]), and InnoHAR also has a 3% performance advantage over DeepConvLSTM.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [25] source
Not checked in the free run.
May combine two claims.
Findingcitation§ V. RESULTS AND ANALYSIS · p. 7DeepConvLSTM achieves an F1-score of 0.915 on the Opportunity dataset, 0.905 on the PAMAP2 dataset, and 0.91 on the Smartphone dataset.
“| DeepConvLSTM [19] | 0.915 | 0.905 | 0.91 |”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [19] source
Not checked in the free run.
May combine two claims.
Findingown data§ V. RESULTS AND ANALYSIS · p. 7InnoHAR achieves an F1-score of 0.946 on the Opportunity dataset, 0.935 on the PAMAP2 dataset, and 0.945 on the Smartphone dataset.
“| Proposed method (InnoHAR) | 0.946 | 0.935 | 0.945 |”
Quote in the paperSubstantial claimMay combine two claims.
Findingown data§ A. COMPARED WITH BASELINES AND STATE-OF-THE-ARTS · p. 8InnoHAR outperforms both CNN and DeepConvLSTM on the Opportunity, PAMAP2, and Smartphone datasets.
“In terms of overall performance, the experimental results show that our proposed InnoHAR model based on Inception-like module has better performance than both CNN [25] and DeepConvLSTM [19].”
Quote in the paperSubstantial claim0 of 2 sources checkedMay combine two claims.
Findingown data§ B. COMPARED WITH IMPROVED STATE-OF-THE-ARTS · p. 8Adding an additional CNN layer to DeepConvLSTM to increase depth does not improve recognition accuracy and causes a certain degree of decline.
“In Fig. 7, we can see that when an additional CNN layer is added to simply increase the depth of model, the recognition accuracy model is not improved as expected, but has a certain degree of decline.”
Quote in the paperSubstantial claimMay combine two claims.
Findingcitation§ V. RESULTS AND ANALYSIS · p. 7CNN achieves an F1-score of 0.851 on the Opportunity dataset, 0.88 on the PAMAP2 dataset, and 0.915 on the Smartphone dataset.
“| CNN [25] | 0.851 | 0.88 | 0.915 |”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [25] source
Not checked in the free run.
Probably not a substantial claim: may not pass S4 (based). May combine two claims.
Findingnone given§ B. TEMPORAL FEATURES EXTRACTION · p. 4The entire InnoHAR network structure delivers satisfactory results in both predictive performance and time efficiency.
“The entire network structure delivers satisfactory results in both predictive performance and time ef ciency.”
Quote in the paperNot a substantial claim- Rests on an assumption: GRU performs better than LSTM in terms of time efficiency.
- Rests on an assumption: GRU and LSTM show better performance in dealing with long sequences based problems.
May combine two claims. The quote only partly states this claim.
Findingown data§ C. EFFICIENCY ANALYSIS · p. 8InnoHAR took 152.02 s to predict all 9894 sliding windows on the MinnowBoard, reaching a predicted speed of 65.09 pieces/s.
“In the prediction of all previous test data, our model took 152.02 s and completed the prediction of all 9894 sliding windows. The predicted speed reached 65.09 pieces/s.”
Quote in the paperSubstantial claimMay combine two claims.
Interpretationown data§ A. COMPARED WITH BASELINES AND STATE-OF-THE-ARTS · p. 8InnoHAR maintains consistent superior performance and good generalization on different public datasets, including the three most widely used public datasets.
“To be more speci c, Fig. 6 shows the confusion matrix of proposed method and two state-of-the-arts in one test run, from which we can see that proposed method maintains consistent superior performance on different public datasets and has good generalization performance in the recognition of complex human activities.”
- Also stated in: § VI. CONCLUSION · p. 9 · plain
“Compared with baselines and state-of-the-arts, our proposed method shows consistent superior performance and has good generalization performance on three most widely used public datasets.”
Quote in the paperSubstantial claim- Rests on an assumption: The Opportunity, PAMAP2, and Smartphone datasets are representative of real-world complex human activity recognition, so performance on them generalizes to real-world HAR.
- Also stated in: § VI. CONCLUSION · p. 9 · plain
Probably not a substantial claim: may not pass S3 (load-bearing).
Premisenone given§ C. GOOGLENET AND INCEPTION MODULE · p. 4Blindly increasing network size causes an exponential increase in computing resource requirements.
“The other one is the exponential increase of computing resource requirements caused by blindly increase of the network size.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S4 (based). May combine two claims.
Interpretationnone given§ I. INTRODUCTION · p. 2Pooling layers filter the interference noise brought by unconscious jitter of the human body and decrease misjudgment.
“Pooling layers are applied to lter the interference noise brought by the unconscious jitter of human body, in order to decrease the misjudgment;”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S4 (based). May combine two claims.
Premisenone given§ I. INTRODUCTION · p. 2Above mentioned deep convolutional neural networks ignored temporal dependencies on features and were not suitable to recognize real-time sensor signals.
“Above mentioned deep convolutional neural networks ignored the temporal dependencies on the features, and was not suitable to recognize real-time sensor signals.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Premisereasoning§ C. GOOGLENET AND INCEPTION MODULE · p. 4Larger network sizes often mean more parameters, making the expanded network more prone to overfit, especially when labeled training samples are limited.
“One is that larger network sizes often mean more parameters, which makes the expanded network more prone to over t, especially when the labeled samples in the training set are limited.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Premisecitation§ C. GOOGLENET AND INCEPTION MODULE · p. 4Extensive application of the pooling layer is useful to achieve dimensionality reduction, key feature extraction, and filtering.
“Extensive application of the pooling layer is useful to achieve dimensionality reduction, key feature extraction, and ltering.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [9]
Not checked in the free run.
May combine two claims.
Premisecitation§ I. INTRODUCTION · p. 2Most existing deep learning studies for HAR have used deep learning as a black box and scratched the data.
“Most of these existing research have only used deep learning as a black box, and the data has been scratched. For example, Ronao and Cho [22] and Yang et al. [25] perform feature extraction of the sliding window using only shallow convolutional neural networks.”
Quote in the paperSubstantial claim0 of 2 sources checked- cites [22]
Not checked in the free run.
- cites [25] source
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Premisecitation§ C. GOOGLENET AND INCEPTION MODULE · p. 4A 1x1 convolution network implements dimensionality reduction of data and linear combination of multi-channel data.
“For example, a 1 1 convolution network implements dimensionality reduction of data and linear combination of multi-channel data.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [9]
Not checked in the free run.
Probably not a substantial claim: may not pass S4 (based).
Premisenone given§ B. LONG SHORT-TERM MEMORY · p. 3Ignoring temporal context beyond frame boundaries during modeling may limit recognition performance for more challenging tasks.
“However, ignoring the temporal context beyond frame boundaries during modeling may limit the recognition performance for more challenging tasks.”
Quote in the paperNot a substantial claimMay combine two claims.
Premisecitation§ I. INTRODUCTION · p. 2Feature extraction methods such as symbolic representation, statistics of raw data, and transform coding are heuristic and require expert knowledge to design features.
“The feature extraction methods such as symbolic representation [22], statistics of raw data [23] and transform coding [24] are widely applied in human activity recognition, but they are heuristic and require expert knowledge to design features [14].”
Quote in the paperSubstantial claim0 of 3 sources checkedMay combine two claims.
Premisecitation§ I. INTRODUCTION · p. 2Chavarriaga et al.'s Naive Bayes and K-Nearest Neighbor classifier relied on hand-crafted features and could not find discriminative features to accurately distinguish different activities.
“Chavarriaga et al. [21] used a Na ve Bayes(NB) and a K-Nearest Neighbor(KNN) classi er to recognize seven motions, such as walking, running and jumping. However, they relied on hand-crafted features and could not nd discriminative features to accurately distinguish different activities.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [21] source
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Premisecitation§ A. COMPARED WITH BASELINES AND STATE-OF-THE-ARTS · p. 7The Opportunity, PAMAP2, and Smartphone datasets are three of the most widely used public datasets for human activity recognition.
“Furthermore, we generalize and verify these three models to three most widely used public datasets, namely Opportunity dataset [21], PAMAP2 dataset [37] and smartphone dataset [38].”
Quote in the paperNot a substantial claim0 of 3 sources checked- cites [21] source
Not checked in the free run.
- cites [37]
Not checked in the free run.
- cites [38] [38] D. Anguita, A. Ghio, L. Oneto, X. Parra, and J. L. Reyes-Ortiz, ''A public domain dataset for human activity recognition using smartphones,'' in Proc. ESANN , 2013, pp. 1 6. <!-- image --> CHENG XU received the B.E. and M.S. degrees from the University of Science and Technology Beijing, China, in 2012 and 2015, respectively, where he is currently pursuing the Ph.D. degree with the Data and Cyber-Physical System Lab. His research interests include patter recognition and the Internet of Things. He is a Student Member of the IEEE and CCF. <!-- image --> <!-- image --> DUO CHAI received the d
Not checked in the free run.
May combine two claims.
Interpretationreasoning§ B. COMPARED WITH IMPROVED STATE-OF-THE-ARTS · p. 8In actual training, a large part of time is occupied in training LSTM, but the income is relatively little.
“Therefore, in actual training process, a large part of time is often occupied in trainging process, but the income is relatively little.”
Quote in the paperSubstantial claimClassified as probably not a substantial claim. May combine two claims.
Premisereasoning§ D. PERFORMANCE MEASURE · p. 6F-measure considers the correct classification of each class as equally important and can evaluate the model better than precision.
“F-measure ( F 1) considers the correct classi cation of each class as equally important. It takes into account both the precision and the recall of each class to compute the score and can evaluate the model better than the precision.”
Quote in the paperSubstantial claimClassified as probably not a substantial claim.
Interpretationreasoning§ A. COMPARED WITH BASELINES AND STATE-OF-THE-ARTS · p. 8InnoHAR's superior performance could be due to the multi-scaled and spatial-temporal feature extraction characteristics from the combination of inception and GRU.
“It could be because of the multi-scaled and spatial-temporal feature extraction characteristics, due to the combination of inception and GRU.”
Quote in the paperSubstantial claimMay combine two claims. The quote only partly states this claim.
Interpretationown data§ C. EFFICIENCY ANALYSIS · p. 8InnoHAR can easily predict real-time activity on the MinnowBoard because the original test data is recorded at 30 Hz and the prediction speed is 65.09 pieces/s.
“The original test data is recorded at 30 Hz, and our model can easily predict the real-time activity on this platform.”
Quote in the paperSubstantial claim
The paper relies on this without support.
Traditional feature engineering methods are becoming incapable in the face of extremely fast-growing waveform data with no obvious laws.
“However, in the face of extremely fast-growing waveform data with no obvious laws, the traditional feature engineering methods are becoming more and more incapable.”
The paper relies on this without support.
GRU performs better than LSTM in terms of time efficiency.
“while GRU performs better in terms of time ef ciency.”
The paper relies on this without support.
GRU and LSTM show better performance in dealing with long sequences based problems.
“while in many existing experiments, GRU and LSTM show better performance in dealing with long sequences based problems”
The paper relies on this without support.
Applying features extracted from the original signal to the neural network tends to improve performance.
“The input of neural network is generally the original signal, however, applying features extracted from the original signal to the neural network tends to improve performance.”
The paper relies on this without support.
The three public HAR datasets used are the most widely used public HAR datasets.
“Through experimental veri cation on three most widely used public HAR datasets”
The paper relies on this without support.
The MinnowBoard Turbot Dual Core Board is representative of embedded systems used in real-time human activity recognition applications.
“The embedded system we used in this experiment was the MinnowBoard Turbot Dual Core Board [27]. It is a small embedded platform released by Intel that is equipped with Intel Atom E3826 processor, with 1.46 GHz clock speed and 2GB DDR3L 1067MT/s DRAM. It is an outstanding embedded platform with both performance and price advantages.”
The paper relies on this without support.
The Opportunity, PAMAP2, and Smartphone datasets are representative of real-world complex human activity recognition, so performance on them generalizes to real-world HAR.
“Furthermore, we generalize and verify these three models to three most widely used public datasets, namely Opportunity dataset [21], PAMAP2 dataset [37] and smartphone dataset [38].”
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In [227], GoogLeNet's Inception module combined with a GRU layer was used to build a HAR model.
“In [227], the authors have used GoogLeNet’s Inception module combined with a GRU layer to build a HAR model.”
From Deep Learning in Human Activity Recognition with Wearable Sensors: A Review on Advances (2022) · cites this paper as [227]
The model in [227] showed performance improvements on Opportunity, PAMAP2, and Smartphones datasets.
“The proposed model was showed performance improvements on three public datasets (Opportunity, PAMAP2 and Smartphones datasets).”
From Deep Learning in Human Activity Recognition with Wearable Sensors: A Review on Advances (2022) · cites this paper as [227]
Compared with the CNN model of Yang et al., LSTM-CNN has a significant increase of about 7% for the OPPORTUNITY dataset and is superior to the DeepConvLSTM model.
“Compared with the CNN model of Yang et al., LSTM-CNN has a significant increase of about 7% for the OPPORTUNITY dataset and is superior to the DeepConvLSTM model.”
From LSTM-CNN Architecture for Human Activity Recognition (2020) · cites this paper as [25]
InnoHAR demonstrated significantly higher performance and strong generalisation performance than state-of-the-art and baselines on a sliding window dataset.
“On a sliding window dataset, InnoHAR demonstrated significantly higher performance and strong generalisation performance than state-of-the-art and baselines.”
From Review of Wearable Devices and Data Collection Considerations for Connected Health (2021) · cites this paper as [170]
InnoHAR was generalised and validated using three datasets: Opportunity, PAMAP2, and Smartphone, with F-scores of 0.946, 0.935 and 0.945, respectively.
“This model has been generalised and validated using three datasets: Opportunity, PAMAP2, and Smartphone, with F-scores of 0.946, 0.935 and 0.945, respectively [170].”
From Review of Wearable Devices and Data Collection Considerations for Connected Health (2021) · cites this paper as [170]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Temporal layers described as both LSTM and GRU
MinorThe temporal-feature section first says the model selects two LSTM layers, then says GRU is the implementation of those layers.
“select two layers of LSTM layers for the extraction of temporal features”
“we use GRU as the concrete implementation of the loop layer.”
Results section identified as Section IV instead of V
MinorThe organization paragraph places the results and analysis in Section IV, but the provided section heading places them in Section V.
“the results and analysis are discussed in Section IV”
“## V. RESULTS AND ANALYSIS”
PAMAP2 windows described as non-overlapping and overlapping
MinorThe same windowing procedure is called non-overlapping and assigned 78% overlap.
“non-overlapping sliding windows of 5.12 seconds duration with one second stepping between adjacent windows”
“(78% overlap)”
Two different Opportunity test-window counts
MinorThe preprocessing section reports 9,984 test windows, while the efficiency analysis says the model predicted all 9,894 test windows.
“A total of 9,984 pieces of data were obtained for testing.”
“our model took 152.02 s and completed the prediction of all 9894 sliding windows.”
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474 · see citing works
Self-citationHochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318 · see citing works
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562 · see citing works
Deep Convolutional and LSTM Recurrent Neural Networks for Multimodal Wearable Activity Recognition
Ordóñez, F., & Roggen, D. (2016) · Sensors · doi:10.3390/s16010115 · Cited by 2,761 · cited 9× · see citing works
“Ordóñez and Roggen [19] proposed deep convolutional network with utilizing of CNN and LSTM.”
BackgroundMethodInfluentialA Survey on Human Activity Recognition using Wearable Sensors
Lara, O. D., & Labrador, M. A. (2013) · IEEE Communications Surveys & Tutorials · doi:10.1109/surv.2012.110112.00192 · Cited by 2,662 · see citing works
(2013) · RECERCAT (Consorci de Serveis Universitaris de Catalunya) · Cited by 1,959 · see citing works
A tutorial on human activity recognition using body-worn inertial sensors
Bulling, A., Blanke, U., & Schiele, B. (2014) · ACM Computing Surveys · doi:10.1145/2499621 · Cited by 1,668 · see citing works
Introducing a New Benchmarked Dataset for Activity Monitoring
Reiss, A., & Stricker, D. (2012) · 2012 16th International Symposium on Wearable Computers · doi:10.1109/iswc.2012.13 · Cited by 1,456 · cited 3× · see citing works
“Furthermore, we generalize and verify these three models to three most widely used public datasets, namely Opportunity dataset [21], PAMAP2 dataset [37] and smartphone dataset [38].”
BackgroundMethodHuman activity recognition with smartphone sensors using deep learning neural networks
Ronao, C. A., & Cho, S.-B. (2016) · Expert Systems with Applications · doi:10.1016/j.eswa.2016.04.032 · Cited by 1,215 · see citing works
(2015) · Cited by 989 · see citing works
Multi-sensor fusion in body sensor networks: State-of-the-art and research challenges
Gravina, R., Alinia, P., Ghasemzadeh, H., & Fortino, G. (2017) · Information Fusion · doi:10.1016/j.inffus.2016.09.005 · Cited by 899 · see citing works
Convolutional Neural Networks for Human Activity Recognition using Mobile Sensors
Zeng, M., Nguyen, L. T., Yu, B., Mengshoel, O. J., Zhu, J., Wu, P., & Zhang, J. (2014) · Proceedings of the 6th International Conference on Mobile Computing, Applications and Services · doi:10.4108/icst.mobicase.2014.257786 · Cited by 876 · see citing works
Collecting complex activity datasets in highly rich networked sensor environments
Roggen, D., Calatroni, A., Rossi, M., Holleczek, T., Forster, K., Troster, G., Lukowicz, P., Bannach, D., Pirkl, G., Ferscha, A., et al. (2010) · 2010 Seventh International Conference on Networked Sensing Systems (INSS) · doi:10.1109/inss.2010.5573462 · Cited by 788 · see citing works
The Opportunity challenge: A benchmark database for on-body sensor-based activity recognition
Chavarriaga, R., Sagha, H., Calatroni, A., Digumarti, S. T., Tröster, G., Millán, J. D. R., & Roggen, D. (2013) · Pattern Recognition Letters · doi:10.1016/j.patrec.2012.12.014 · Cited by 742 · cited 6× · see citing works
“Taking Opportunity dataset [21] as an example, as shown in Fig.”
BackgroundMethodInfluentialPreprocessing techniques for context recognition from accelerometer data
Figo, D., Diniz, P. C., Ferreira, D. R., & Cardoso, J. M. P. (2010) · Personal and Ubiquitous Computing · doi:10.1007/s00779-010-0293-9 · Cited by 578 · see citing works
Avci, A., Bosch, S., Marin-Perianu, M., Marin-Perianu, R., & Havinga, P. (2010) · University of Twente Research Information · Cited by 443 · see citing works
A Review on Video-Based Human Activity Recognition
Ke, S.-R., Hoàng, T. L. U., Lee, Y.-J., Hwang, J.-N., Yoo, J.-H., & Choi, K.-H. (2013) · De Computis · doi:10.3390/computers2020088 · Cited by 441 · see citing works
Enabling Effective Programming and Flexible Management of Efficient Body Sensor Network Applications
Fortino, G., Giannantonio, R., Gravina, R., Kuryloski, P., & Jafari, R. (2013) · IEEE Transactions on Human-Machine Systems · doi:10.1109/tsmcc.2012.2215852 · Cited by 412 · see citing works
A framework for collaborative computing and multi-sensor data fusion in body sensor networks
Fortino, G., Galzarano, S., Gravina, R., & Li, W. (2014) · Information Fusion · doi:10.1016/j.inffus.2014.03.005 · Cited by 283 · see citing works
Bhattacharya, S., & Lane, N. D. (2016) · Proceedings of the 14th ACM Conference on Embedded Networked Sensor Systems CD-ROM · doi:10.1145/2994551.2994564 · Cited by 236 · see citing works
PD Disease State Assessment in Naturalistic Environments Using Deep Learning
Hammerla, N., Fisher, J., Andras, P., Rochester, L., Walker, R., & Ploetz, T. (2015) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v29i1.9484 · Cited by 179 · see citing works
Distilling the Knowledge From Handcrafted Features for Human Activity Recognition
Chen, Z., Zhang, L., Cao, Z., & Guo, J. (2018) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2018.2789925 · Cited by 160 · see citing works
A Novel Ensemble ELM for Human Activity Recognition Using Smartphone Sensors
Chen, Z., Jiang, C., & Xie, L. (2018) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2018.2869843 · Cited by 144 · see citing works
Margarito, J., Helaoui, R., Bianchi, A., Sartor, F., & Bonomi, A. (2015) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2015.2471094 · Cited by 118 · see citing works
Vision Based Human Activity Recognition: A Review
Bux, A., Angelov, P. P., & Habib, Z. (2016) · Advances in intelligent systems and computing · doi:10.1007/978-3-319-46562-3_23 · Cited by 104 · see citing works
Bächlin, M., Roggen, D., Tröster, G., Plotnik, M., Inbar, N., Meidan, I., Herman, T., Brozgol, M., Shaviv, E., Giladi, N., et al. (2009) · International Symposium on Wearable Computers · doi:10.1109/iswc.2009.14 · Cited by 100 · see citing works
Kernel fusion based extreme learning machine for cross-location activity recognition
Wang, Z., Wu, D., Gravina, R., Fortino, G., Jiang, Y., & Tang, K. W. (2017) · Information Fusion · doi:10.1016/j.inffus.2017.01.004 · Cited by 97 · see citing works
Geometrical kinematic modeling on human motion using method of multi-sensor fusion
Xu, C., He, J., Zhang, X., Yao, C., & Tseng, P.-H. (2018) · Information Fusion · doi:10.1016/j.inffus.2017.09.014 · Cited by 58 · see citing works
Self-citationLing, C. X., & Sheng, V. S. (2011) · Encyclopedia of Machine Learning · doi:10.1007/978-0-387-30164-8_110 · Cited by 54 · see citing works
Roy, P. C., Giroux, S., Bouchard, B., Bouzouane, A., Phua, C., Tolstikov, A. V., & Biswas, J. (2011) · Atlantis ambient and pervasive intelligence · doi:10.2991/978-94-91216-05-3_2 · Cited by 53 · see citing works
Ronaoo, C. A., & Cho, S. (2015) · 한국정보과학회 학술발표논문집 · Cited by 43 · see citing works
A Task-Oriented Framework for Networked Wearable Computing
Galzarano, S., Giannantonio, R., Liotta, A., & Fortino, G. (2014) · IEEE Transactions on Automation Science and Engineering · doi:10.1109/tase.2014.2365880 · Cited by 41 · see citing works
Convolutional Neural Network for Stereotypical Motor Movement Detection in AutismPreprint
Rad, N. M., Bizzego, A., Kia, S. M., Jurman, G., Venuti, P., & Furlanello, C. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1511.01865 · Cited by 26 · see citing works
Dynamic quality control in assembly systems
Zheng, S. (2000) · IIE Transactions · doi:10.1023/a:1007626824716 · Cited by 11 · see citing works
(2012) · SpringerReference · doi:10.1007/springerreference_178822 · Cited by 11 · see citing works
Movement Behavior Recognition Based on Statistical Mobility Sensing.
Liu, W., Yang, J. B., Wang, L., Wu, C., & Zhang, R. (2015) · Ad Hoc & Sensor Wireless Networks · Cited by 4 · see citing works
Flagged first, then by citations
2 of the 38 references couldn’t be matched to a known paper.
Research works printed but not linked: 4
- 2019, Minnowboardorg
- gers, 2003, Learning precise timing with LSTM recurrent networks, J Mach Learn Res, 3, 115
- hammerla, 2016, Deep convolutional and recurrent models for human activity recognition using wearables
- yang, 2015, Deep convolutional neural networks on multichannel time series for human activity recognition, Proc Int Conf Artif Intell, 3995
Cited by
Sorted by citations
LSTM-CNN Architecture for Human Activity Recognition
Xia, K., Huang, J., & Wang, H. (2020) · IEEE Access · doi:10.1109/access.2020.2982225 · Cited by 851 · see citing works
Sensor-based and vision-based human activity recognition: A comprehensive survey
Minh Dang, L., Min, K., Wang, H., Jalil Piran, M., Hee Lee, C., & Moon, H. (2020) · Pattern Recognition · doi:10.1016/j.patcog.2020.107561 · Cited by 730 · see citing works
Deep Learning in Human Activity Recognition with Wearable Sensors: A Review on Advances
Zhang, S., Li, Y., Zhang, S., Shahabi, F., Xia, S., Deng, Y., & Alshurafa, N. (2022) · Sensors · doi:10.3390/s22041476 · Cited by 625 · see citing works
“In [309], the authors have used GoogLeNet’s Inception module combined with a GRU layer to build a HAR model.”
MethodDeep Learning for Sensor-based Human Activity Recognition
Chen, K., Zhang, D., Yao, L., Guo, B., Yu, Z., & Liu, Y. (2022) · ACM Computing Surveys · doi:10.1145/3447744 · Cited by 690 · see citing works
“activity recognition community. In light of the advantages of CNN and RNN, Ordóñez and Roggen [106] proposed to combine CNNs and LSTMs for both local and global temporal feature extraction. Xu et al. [162] adopted the advanced Inception CNN structure for different scales of local temporal feature extraction and took t…”
MethodRamanujam, E., Perumal, T., & Padmavathi, S. (2021) · IEEE Sensors Journal · doi:10.1109/jsen.2021.3069927 · Cited by 455 · see citing works
Review of Wearable Devices and Data Collection Considerations for Connected Health
Vijayan, V., Connolly, J. P., Condell, J., McKelvey, N., & Gardiner, P. (2021) · Sensors · doi:10.3390/s21165589 · Cited by 435 · see citing works
Multi-input CNN-GRU based human activity recognition using wearable sensors
Dua, N., Singh, S. N., & Semwal, V. B. (2021) · Computing · doi:10.1007/s00607-021-00928-8 · Cited by 432 · see citing works
Demrozi, F., Pravadelli, G., Bihorac, A., & Rashidi, P. (2020) · IEEE Access · doi:10.1109/access.2020.3037715 · Cited by 368 · see citing works
Deep Learning for Sensor-based Human Activity Recognition: Overview, Challenges and Opportunities
Chen, K., Zhang, D., Yao, L., Guo, B., Yu, Z., & Liu, Y. (2020) · arXiv · doi:10.48550/arxiv.2001.07416 · Cited by 314 · see citing works
“activity recognition community. In light of the advantages of CNN and RNN, Ordóñez and Roggen [106] proposed to combine CNNs and LSTMs for both local and global temporal feature extraction. Xu et al. [162] adopted the advanced Inception CNN structure for different scales of local temporal feature extraction and took t…”
MethodDeep Learning for Time Series Classification and Extrinsic Regression: A Current Survey
Foumani, N. M., Miller, L., Tan, C. W., Webb, G. I., Forestier, G., & Salehi, M. (2024) · ACM Computing Surveys · doi:10.1145/3649448 · Cited by 296 · see citing works
iSPLInception: An Inception-ResNet Deep Learning Architecture for Human Activity Recognition
Mutegeki, R., Poulose, A., & Han, D. S. (2021) · IEEE Access · doi:10.1109/access.2021.3078184 · Cited by 219 · see citing works
Attention induced multi-head convolutional neural network for human activity recognition
Khan, Z. N., & Ahmad, J. (2021) · Applied Soft Computing · doi:10.1016/j.asoc.2021.107671 · Cited by 187 · see citing works
GRU-INC: An inception-attention based approach using GRU for human activity recognition
Mim, T. R., Amatullah, M., Afreen, S., Yousuf, M., Uddin, S., Alyami, S. A., Hasan, K. F., & Moni, M. A. (2022) · Expert Systems with Applications · doi:10.1016/j.eswa.2022.119419 · Cited by 182 · see citing works
Deep Learning-Based Anomaly Detection in Video Surveillance: A Survey
Duong, H.-T., Le, V.-T., & Hoang, V. T. (2023) · Sensors · doi:10.3390/s23115024 · Cited by 178 · see citing works
Sensors and Systems for Physical Rehabilitation and Health Monitoring—A Review
do Nascimento, L. M. S., Bonfati, L. V., Freitas, M. L. B., Mendes, J. J. A., Siqueira, H. V., & Stevan, S. L. (2020) · Sensors · doi:10.3390/s20154063 · Cited by 158 · see citing works
Human Activity Recognition Based on Gramian Angular Field and Deep Convolutional Neural Network
Xu, H., Li, J., Yuan, H., Liu, Q., Fan, S., Li, T., & Sun, X. (2020) · IEEE Access · doi:10.1109/access.2020.3032699 · Cited by 154 · see citing works
Mekruksavanich, S., & Jitpattanakul, A. (2021) · Electronics · doi:10.3390/electronics10141685 · Cited by 138 · see citing works
ST-DeepHAR: Deep Learning Model for Human Activity Recognition in IoHT Applications
Abdel-Basset, M., Hawash, H., Chakrabortty, R. K., Ryan, M., Elhoseny, M., & Song, H. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.3033430 · Cited by 136 · see citing works
Human Action Recognition Systems: A Review of the Trends and State-of-the-Art
Karim, M. F. A., Khalid, S., Aleryani, A., Khan, J., Ullah, I., & Ali, Z. (2024) · IEEE Access · doi:10.1109/access.2024.3373199 · Cited by 117 · see citing works
Thakur, D., Biswas, S., Ho, E. S. L., & Chattopadhyay, S. (2022) · IEEE Access · doi:10.1109/access.2022.3140373 · Cited by 104 · see citing works
Dahou, A., Al‐qaness, M. A. A., Elaziz, M. A., & Helmi, A. M. (2022) · Measurement · doi:10.1016/j.measurement.2022.111445 · Cited by 104 · see citing works
Human activity recognition from sensor data using spatial attention-aided CNN with genetic algorithm
Sarkar, A., Hossain, S., & Sarkar, R. (2022) · Neural Computing and Applications · doi:10.1007/s00521-022-07911-0 · Cited by 107 · see citing works
Zhao, T., Xie, Y., Wang, Y., Cheng, J., Guo, X., Hu, B., & Chen, Y. J. (2022) · Proceedings of the IEEE · doi:10.1109/jproc.2022.3153408 · Cited by 99 · see citing works
Mekruksavanich, S., Jitpattanakul, A., Sıtthıthakerngkıet, K., Youplao, P., & Yupapin, P. P. (2022) · IEEE Access · doi:10.1109/access.2022.3174124 · Cited by 85 · see citing works
An improved human activity recognition technique based on convolutional neural network
Ravi Raj, K. G., & Kos, A. (2023) · Scientific Reports · doi:10.1038/s41598-023-49739-1 · Cited by 89 · see citing works
On-Device Deep Learning for Mobile and Wearable Sensing Applications: A Review
İncel, Ö. D., & Bursa, S. Ö. (2023) · IEEE Sensors Journal · doi:10.1109/jsen.2023.3240854 · Cited by 75 · see citing works
Improving Deep Learning for HAR with Shallow LSTMs
Bock, M., Hölzemann, A., Moeller, M., & Van Laerhoven, K. (2021) · 2021 International Symposium on Wearable Computers · doi:10.1145/3460421.3480419 · Cited by 74 · see citing works
Wearable Assistive Robotics: A Perspective on Current Challenges and Future Trends
Martínez-Hernández, U., Metcalfe, B., Assaf, T., Jabban, L., Male, J., & Zhang, D. (2021) · Sensors · doi:10.3390/s21206751 · Cited by 74 · see citing works
Sensor-Based Human Activity Recognition Using Deep Stacked Multilayered Perceptron Model
Rustam, F., Reshi, A. A., Ashraf, I., Mehmood, A., Ullah, S., Khan, D. M., & Choi, G. S. (2020) · IEEE Access · doi:10.1109/access.2020.3041822 · Cited by 72 · see citing works
A New Deep-Learning Method for Human Activity Recognition
Hlavata, R., Kamencay, P., Hudec, R., & Sýkora, P. (2023) · Sensors · doi:10.3390/s23052816 · Cited by 72 · see citing works
Saha, A., Rajak, S., Saha, J., & Chowdhury, C. (2022) · Journal of Ambient Intelligence and Humanized Computing · doi:10.1007/s12652-022-03870-5 · Cited by 67 · see citing works
Garcia-Gonzalez, D., Rivero, D., Fernández-Blanco, E., & Luaces, M. R. (2023) · Knowledge-Based Systems · doi:10.1016/j.knosys.2023.110260 · Cited by 66 · see citing works
Al‐qaness, M. A. A., Dahou, A., Trouba, N. T., Elaziz, M. A., & Helmi, A. M. (2024) · Future Generation Computer Systems · doi:10.1016/j.future.2024.06.016 · Cited by 68 · see citing works
Phukan, N., Mohine, S., Mondal, A., Manikandan, M. S., & Pachori, R. B. (2022) · IEEE Sensors Journal · doi:10.1109/jsen.2022.3206916 · Cited by 63 · see citing works
Meng, Z., Zhang, M., Guo, C., Fan, Q., Zhang, H., Gao, N., & Zhang, Z. (2020) · Electronics · doi:10.3390/electronics9091357 · Cited by 58 · see citing works
Multi-modal recognition of worker activity for human-centered intelligent manufacturing
Tao, W., Leu, M. C., & Yin, Z. (2020) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2020.103868 · Cited by 58 · see citing works
WEAR: An Outdoor Sports Dataset for Wearable and Egocentric Activity Recognition
Bock, M., Kuehne, H., Laerhoven, K. V., & Moeller, M. (2024) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3699776 · Cited by 67 · see citing works
Deep Residual Network for Smartwatch-Based User Identification through Complex Hand Movements
Mekruksavanich, S., & Jitpattanakul, A. (2022) · Sensors · doi:10.3390/s22083094 · Cited by 56 · see citing works
Hoai Thu, N. T., & Han, D. S. (2021) · IEEE Access · doi:10.1109/access.2021.3122298 · Cited by 54 · see citing works
Mekruksavanich, S., & Jitpattanakul, A. (2022) · Mathematical Biosciences & Engineering · doi:10.3934/mbe.2022265 · Cited by 56 · see citing works
HIT HAR: Human Image Threshing Machine for Human Activity Recognition Using Deep Learning Models
Poulose, A., Kim, J. H., & Han, D. S. (2022) · Computational Intelligence and Neuroscience · doi:10.1155/2022/1808990 · Cited by 54 · see citing works
Remote Health Monitoring Systems for Elderly People: A Survey
Ahmed, S., Irfan, S., Kiran, N., Masood, N., Anjum, N., & Ramzan, N. (2023) · Sensors · doi:10.3390/s23167095 · Cited by 52 · see citing works
Mekruksavanich, S., Hnoohom, N., & Jitpattanakul, A. (2022) · Applied Sciences · doi:10.3390/app12104988 · Cited by 54 · see citing works
Zhang, L., Yu, J., Gao, Z., & Ni, Q. (2024) · Alexandria Engineering Journal · doi:10.1016/j.aej.2024.01.030 · Cited by 52 · see citing works
Transfer Learning Approach for Human Activity Recognition Based on Continuous Wavelet Transform
Pavliuk, O., Mishchuk, M., & Strauß, C. (2023) · Algorithms · doi:10.3390/a16020077 · Cited by 56 · see citing works
DCapsNet: Deep capsule network for human activity and gait recognition with smartphone sensors
Sezavar, A., Atta, R., & Ghanbari, M. (2023) · Pattern Recognition · doi:10.1016/j.patcog.2023.110054 · Cited by 54 · see citing works
Comprehensive machine and deep learning analysis of sensor-based human activity recognition
Balaha, H. M., & Hassan, A. E.-S. (2023) · Neural Computing and Applications · doi:10.1007/s00521-023-08374-7 · Cited by 52 · see citing works
An Efficient Human Activity Recognition Using Hybrid Features and Transformer Model
Saidani, O., Alsafyani, M., Alroobaea, R., Alturki, N. M., Jahangir, R., & Jamel, L. (2023) · IEEE Access · doi:10.1109/access.2023.3314492 · Cited by 51 · see citing works
Ascioglu, G., & Şenol, Y. (2020) · IEEE Access · doi:10.1109/access.2020.3024003 · Cited by 50 · see citing works
Mekruksavanich, S., & Jitpattanakul, A. (2022) · Lecture notes on data engineering and communications technologies · doi:10.1007/978-981-19-0898-9_42 · Cited by 48 · see citing works
A DCNN-LSTM based human activity recognition by mobile and wearable sensor networks
Jameer, S., & Syed, H. (2023) · Alexandria Engineering Journal · doi:10.1016/j.aej.2023.09.013 · Cited by 47 · see citing works
Smartphone-Based Human Activities Recognition System using Random Forest Algorithm
Radhika, V., Prasad, C. R., & Adupa, C. (2022) · International Conference for Advancement in Technology (ICONAT) · doi:10.1109/iconat53423.2022.9726006 · Cited by 46 · see citing works
Zhang, Y., Wang, L., Chen, H., Tian, A., Zhou, S., & Guo, Y. (2022) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3534584 · Cited by 47 · see citing works
Human activity recognition: A comprehensive review
Kaur, H., Rani, V., & Kumar, M. (2024) · Expert Systems · doi:10.1111/exsy.13680 · Cited by 50 · see citing works
Cuperman, R., Jansen, K. M. B., & Ciszewski, M. G. (2022) · Sensors · doi:10.3390/s22041347 · Cited by 46 · see citing works
HAR-DeepConvLG: Hybrid deep learning-based model for human activity recognition in IoT applications
Ding, W., Abdel‐Basset, M., & Mohamed, R. (2023) · Information Sciences · doi:10.1016/j.ins.2023.119394 · Cited by 45 · see citing works
An optimized deep learning model for human activity recognition using inertial measurement units
Challa, S. K., Kumar, A. A., Semwal, V. B., & Dua, N. (2023) · Expert Systems · doi:10.1111/exsy.13457 · Cited by 44 · see citing works
Multi-STMT: Multi-Level Network for Human Activity Recognition Based on Wearable Sensors
Zhang, H., & Xu, L. (2024) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2024.3365155 · Cited by 44 · see citing works
Deep Triplet Networks with Attention for Sensor-based Human Activity Recognition
Khaertdinov, B., Ghaleb, E., & Asteriadis, S. (2021) · IEEE International Conference on Pervasive Computing and Communications · doi:10.1109/percom50583.2021.9439116 · Cited by 43 · see citing works
Thakur, D., Guzzo, A., & Fortino, G. (2023) · IEEE Internet of Things Journal · doi:10.1109/jiot.2023.3277592 · Cited by 40 · see citing works
Convolutional Neural Network With Multihead Attention for Human Activity Recognition
Tan, T.-H., Chang, Y.-L., Wu, J.-R., Chen, Y.-F., & Alkhaleefah, M. (2023) · IEEE Internet of Things Journal · doi:10.1109/jiot.2023.3294421 · Cited by 37 · see citing works
Mekruksavanich, S., & Jitpattanakul, A. (2024) · Applied Sciences · doi:10.3390/app14052107 · Cited by 39 · see citing works
Flame Detection Using Appearance-Based Pre-Processing and Convolutional Neural Network
Ryu, J.-K., & Kwak, D.-K. (2021) · Applied Sciences · doi:10.3390/app11115138 · Cited by 37 · see citing works
Educational Innovation Faced with COVID-19: Deep Learning for Online Exam Cheating Detection
Yulita, I. N., Hariz, F. A., Suryana, I., & Prabuwono, A. S. (2023) · Education Sciences · doi:10.3390/educsci13020194 · Cited by 36 · see citing works
kNN Prototyping Schemes for Embedded Human Activity Recognition with Online Learning
Ferreira, P., Cardoso, J. M. P., & Mendes‐Moreira, J. (2020) · Computers · doi:10.3390/computers9040096 · Cited by 34 · see citing works
Bento, N., Rebelo, J., Barandas, M., Carreiro, A. V., Campagner, A., Cabitza, F., & Gamboa, H. F. S. (2022) · Sensors · doi:10.3390/s22197324 · Cited by 36 · see citing works
Yatbaz, H. Y., Ever, E., & Yazıcı, A. (2021) · IEEE Sensors Journal · doi:10.1109/jsen.2021.3061458 · Cited by 32 · see citing works
A multi-scale feature extraction fusion model for human activity recognition
Zhang, C., Cao, K., Lu, L., & Deng, T. (2022) · Scientific Reports · doi:10.1038/s41598-022-24887-y · Cited by 34 · see citing works
Sekaran, S. R., Pang, Y. H., & Yin, O. S. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.120132 · Cited by 34 · see citing works
A deep local-temporal architecture with attention for lightweight human activity recognition
Ige, A. O., & Noor, M. H. M. (2023) · Applied Soft Computing · doi:10.1016/j.asoc.2023.110954 · Cited by 30 · see citing works
Ullah, S., Pirahandeh, M., & Kim, D. (2023) · Neurocomputing · doi:10.1016/j.neucom.2023.127157 · Cited by 34 · see citing works
Vita, A. D., Russo, A., Pau, D. P., Benedetto, L. D., Rubino, A., & Licciardo, G. D. (2020) · IEEE Transactions on Circuits and Systems I Regular Papers · doi:10.1109/tcsi.2020.3011984 · Cited by 31 · see citing works
Human Activity Recognition: From Sensors to Applications
Fereidoonian, F., Firouzi, F., & Farahani, B. (2020) · IEEE International Conference on Omni-layer Intelligent Systems (COINS) · doi:10.1109/coins49042.2020.9191417 · Cited by 31 · see citing works
Smartphone Sensor-Based Human Activity Recognition Robust to Different Sampling Rates
Hasegawa, T. (2020) · IEEE Sensors Journal · doi:10.1109/jsen.2020.3038281 · Cited by 30 · see citing works
Zhongkai, Z., Kobayashi, S., Kondo, K., Hasegawa, T., & Koshino, M. (2022) · IEEE Access · doi:10.1109/access.2022.3152530 · Cited by 32 · see citing works
Do we need early exit networks in human activity recognition?
Lattanzi, E., Contoli, C., & Freschi, V. (2023) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2023.106035 · Cited by 30 · see citing works
Cross-Attention Enhanced Pyramid Multi-Scale Networks for Sensor-Based Human Activity Recognition
Pang, H., Li, Z., & Fang, H. (2024) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2024.3377353 · Cited by 31 · see citing works
A Novel Hybrid Deep Learning Model for Human Activity Recognition Based on Transitional Activities
Irfan, S., Anjum, N., Masood, N., Khattak, A. S., & Ramzan, N. (2021) · Sensors · doi:10.3390/s21248227 · Cited by 28 · see citing works
Contrastive Learning with Cross-Modal Knowledge Mining for Multimodal Human Activity Recognition
Brinzea, R., Khaertdinov, B., & Asteriadis, S. (2022) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn55064.2022.9892522 · Cited by 27 · see citing works
Wang, Y., Xu, H., Zheng, L., Zhao, G., Liu, Z., Zhou, S., Wang, M., & Xu, J. (2023) · IEEE Internet of Things Journal · doi:10.1109/jiot.2023.3265937 · Cited by 27 · see citing works
Mehmood, K., Imran, H. A., & Latif, U. (2020) · IEEE International Multitopic Conference (INMIC) · doi:10.1109/inmic50486.2020.9318067 · Cited by 26 · see citing works
Real-Time Human Activity Recognition System Based on Capsule and LoRa
Shi, L., Xu, H., Ji, W., Zhang, B., Sun, X., & Li, J. (2020) · IEEE Sensors Journal · doi:10.1109/jsen.2020.3004411 · Cited by 25 · see citing works
Easy Ensemble: Simple Deep Ensemble Learning for Sensor-Based Human Activity Recognition
Hasegawa, T., & Kondo, K. (2022) · IEEE Internet of Things Journal · doi:10.1109/jiot.2022.3222221 · Cited by 27 · see citing works
Wan, J., Xu, S., Lin, J., Ji, L., Cheng, J., Li, Z., Qu, X., & Li, C. (2025) · Small · doi:10.1002/smll.202504078 · Cited by 26 · see citing works
Park, J., Lim, W.-S., Kim, D., & Lee, J. (2023) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2023.106543 · Cited by 24 · see citing works
An Efficient Diverse-Branch Convolution Scheme for Sensor-Based Human Activity Recognition
Han, C., Zhang, L., Xu, S., Wang, X., Wu, H., & Song, A. (2023) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2023.3265128 · Cited by 24 · see citing works
Inertial Measurement Unit Sensors in Assistive Technologies for Visually Impaired People, a Review
Leiva, K. M. R., Jaén-Vargas, M., Codina, B., & Olmedo, J. J. S. (2021) · Sensors · doi:10.3390/s21144767 · Cited by 24 · see citing works
Li, J., Wang, Z., Zhao, Z., Jin, Y., Yin, J., Huang, S., & Wang, J. (2021) · ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp) · doi:10.1145/3460418.3480410 · Cited by 23 · see citing works
Human Activity Recognition Based on Acceleration Data From Smartphones Using HMMs
Iloga, S., Bordat, A., Kernec, J. L., & Romain, O. (2021) · IEEE Access · doi:10.1109/access.2021.3117336 · Cited by 24 · see citing works
Chen, L., Yan, X. S., & Hu, D. (2023) · IEEE Sensors Journal · doi:10.1109/jsen.2023.3264252 · Cited by 24 · see citing works
Chaurasia, S. K., & Reddy, S. R. N. (2021) · Multimedia Tools and Applications · doi:10.1007/s11042-021-11410-0 · Cited by 22 · see citing works
MarNASNets: Toward CNN Model Architectures Specific to Sensor-Based Human Activity Recognition
Kobayashi, S., Hasegawa, T., Miyoshi, T., & Koshino, M. (2023) · IEEE Sensors Journal · doi:10.1109/jsen.2023.3292380 · Cited by 22 · see citing works
Lim, X. Y., Gan, K. B., & Aziz, N. A. A. (2021) · Applied Sciences · doi:10.3390/app11083543 · Cited by 23 · see citing works
Basketball technique action recognition using 3D convolutional neural networks
Wang, J., Zuo, L., & Martínez, C. C. (2024) · Scientific Reports · doi:10.1038/s41598-024-63621-8 · Cited by 21 · see citing works
Error Constraint Enhanced Particle Filter Using Quantum Particle Swarm Optimization
Wan, J., Xu, C., Qiao, Y., & Zhang, X. (2021) · IEEE Sensors Journal · doi:10.1109/jsen.2021.3113364 · Cited by 21 · see citing works
Self-citationResource-Efficient Continual Learning for Sensor-Based Human Activity Recognition
Leite, C. F. S., & Xiao, Y. (2022) · ACM Transactions on Embedded Computing Systems · doi:10.1145/3530910 · Cited by 21 · see citing works
Human Activity Recognition Based on Two-Channel Residual–GRU–ECA Module with Two Types of Sensors
Wang, X., & Shang, J. (2023) · Electronics · doi:10.3390/electronics12071622 · Cited by 21 · see citing works
Imran, H. A., & Latif, U. (2020) · IEEE International Conference on Smart Communities: Improving Quality of Life using AI, Robotics and IoT (HONET) · doi:10.1109/honet50430.2020.9322655 · Cited by 21 · see citing works
Uncovering Human Multimodal Activity Recognition with a Deep Learning Approach
Ranieri, C. M., Vargas, P. A., & Romero, R. A. F. (2020) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn48605.2020.9207255 · Cited by 19 · see citing works
Human Activity Recognition Using Convolutional Neural Networks
Doğan, G., Ertas, S. S., & Cay, I. (2021) · IEEE Conference on Computational Intelligence in Bioinformatics and Computational Biology (CIBCB) · doi:10.1109/cibcb49929.2021.9562906 · Cited by 19 · see citing works
- Authors
- Xu, C., Chai, D., He, J., Zhang, X., & Duan, S.
- Affiliations
- China Building Materials Academy (CN)
- Venue
- IEEE Access
- Published
- 2019
- Volume
- 7
- Pages
- 9893-9902
- ISSN
- 2169-3536 (ISSN-L)
- OpenAlex
- W2907255073
- Cited by
- 333
- References
- 38
- Citations by year
- 2026: 18 · 2025: 39 · 2024: 62 · 2023: 71 · 2022: 53 · 2021: 53 · 2020: 30 · 2019: 7
- FWCI
- 16.01
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- IEEE Access (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- National Basic Research Program of China (2016YFC0901303)
- National Natural Science Foundation of China (61671056, 61302065, 61304257, 61402033)
- Natural Science Foundation of Beijing Municipality (4152036)
- Tianjin Special Program for Science and Technology (16ZXCXSF00150)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Context-Aware Activity Recognition Systems
- Physical Sciences › Engineering › Biomedical Engineering › Gait Recognition and Analysis
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Human Pose and Action Recognition
- Keywords
- human activity recognition, sensor networks, body area networks, Inception module, recurrent neural networks, GRU, end-to-end learning, time series classification, feature extraction
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-07.
Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-07.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review