Deep Convolutional Neural Network with RNNs for Complex Activity Recognition Using Wrist-Worn Wearable Sensor Data
Open accessThe DOI matches its Crossref record; 77 of the 77 references it cites were found in a registry or an index.
Abstract
Sensor-based human activity recognition (S-HAR) has become an important and high-impact topic of research within human-centered computing. In the last decade, successful applications of S-HAR have been presented through fruitful academic research and industrial applications, including for healthcare monitoring, smart home controlling, and daily sport tracking. However, the growing requirements of many current applications for recognizing complex human activities (CHA) have begun to attract the attention of the HAR research field when compared with simple human activities (SHA). S-HAR has shown that deep learning (DL), a type of machine learning based on complicated artificial neural networks, has a significant degree of recognition efficiency. Convolutional neural networks (CNNs) and recurrent neural networks (RNNs) are two different types of DL methods that have been successfully applied to the S-HAR challenge in recent years. In this paper, we focused on four RNN-based DL models (LSTMs, BiLSTMs, GRUs, and BiGRUs) that performed complex activity recognition tasks. The efficiency of four hybrid DL models that combine convolutional layers with the efficient RNN-based models was also studied. Experimental studies on the UTwente dataset demonstrated that the suggested hybrid RNN-based models achieved a high level of recognition performance along with a variety of performance indicators, including accuracy, F1-score, and confusion matrix. The experimental results show that the hybrid DL model called CNN-BiGRU outperformed the other DL models with a high accuracy of 98.89% when using only complex activity data. Moreover, the CNN-BiGRU model also achieved the highest recognition performance in other scenarios (99.44% by using only simple activity data and 98.78% with a combination of simple and complex activities).
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Previous studies, including [10, 18, 23, 24], have amalgamated convolutional neural networks (CNN), recurrent neural networks (RNN), and attention mechanisms;”
From Adaptive temporal attention mechanism and hybrid deep CNN model for wearable sensor-based human activity recognition (2025) · cites this paper as [10]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“This leads to more reduced error rates in the confusion matrix (Fig. 8) when compared to CNN-BiGRU [10] and CNN-LSTM [24].”
From Adaptive temporal attention mechanism and hybrid deep CNN model for wearable sensor-based human activity recognition (2025) · cites this paper as [10]
In the citing paper
“Furthermore, employing data standardization or normalization methods can enhance input quality and expedite model training [10, 31].”
From Adaptive temporal attention mechanism and hybrid deep CNN model for wearable sensor-based human activity recognition (2025) · cites this paper as [10]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318 · cited 2×
“However, the RNNs suffered from the vanishing gradient problem [45] that made them hard to train with acceptable performance.”
BackgroundThe Elements of Statistical Learning
Hastie, T., Tibshirani, R., & Friedman, J. (2009) · Springer Series in Statistics · doi:10.1007/978-0-387-84858-7 · Cited by 25,970
Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling
Chung, J., Gulcehre, C., Cho, K., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1412.3555 · Cited by 11,008 · cited 2×
“The GRU is a basic version of the LSTM that does not have a separate memory cell in its structure [52].”
BackgroundBidirectional recurrent neural networks
Schuster, M., & Paliwal, K. K. (1997) · IEEE Transactions on Signal Processing · doi:10.1109/78.650093 · Cited by 10,172 · cited 1×
“The BiLSTM was introduced in 1997 by Schuster and Paliwal to increase the amount of knowledge available in the LSTM network [49].”
MethodOn the Properties of Neural Machine Translation: Encoder–Decoder Approaches
Cho, K., van Merrienboer, B., Bahdanau, D., & Bengio, Y. (2014) · Proceedings of SSST-8, Eighth Workshop on Syntax, Semantics and Structure in Statistical Translation · doi:10.3115/v1/w14-4012 · Cited by 7,099 · cited 1×
“[51] introduced the gate recurrent unit (GRU) network, a novel RNN-based model, in 2014.”
BackgroundA survey of cross-validation procedures for model selection
Arlot, S., & Célisse, A. (2010) · LillOA (Université de Lille (University Of Lille)) · Cited by 3,669
A survey of cross-validation procedures for model selection
Arlot, S., & Celisse, A. (2010) · Statistics Surveys · doi:10.1214/09-ss054 · Cited by 3,522 · cited 1×
“To split the data for training and testing, several techniques can be utilized, such as k-fold cross validation [68].”
MethodThe Vanishing Gradient Problem During Learning Recurrent Neural Nets and Problem Solutions
Hochreiter, S. (1998) · International Journal of Uncertainty, Fuzziness and Knowledge-Based Systems · doi:10.1142/s0218488598000094 · Cited by 2,939 · cited 1×
“LSTMs are very popular in the natural language processing domain where they are used for word prediction, language translation, etc., including in the HAR domain [46,47].”
BackgroundDeep Convolutional and LSTM Recurrent Neural Networks for Multimodal Wearable Activity Recognition
Ordóñez, F., & Roggen, D. (2016) · Sensors · doi:10.3390/s16010115 · Cited by 2,761
Factorizing personalized Markov chains for next-basket recommendation
Rendle, S., Freudenthaler, C., & Schmidt-Thieme, L. (2010) · Proceedings of the 19th international conference on World wide web · doi:10.1145/1772690.1772773 · Cited by 2,692
Cited by
A Comprehensive Overview and Comparative Analysis on Deep Learning Models
Perumal, T., Mustapha, N., Mohamed, R., & Shiri, F. M. (2024) · Journal on artificial intelligence · doi:10.32604/jai.2024.054314 · Cited by 667
“Unlike traditional methods, CNNs automatically learn and recognize features from the data without the need for manual feature extraction by humans [13].”
MethodDeep Learning for Time Series Classification and Extrinsic Regression: A Current Survey
Mohammadi Foumani, N., Miller, L., Tan, C. W., Webb, G. I., Forestier, G., & Salehi, M. (2024) · ACM Computing Surveys · doi:10.1145/3649448 · Cited by 268
“In addition to the subsequence-based methods, other models employ instance-based sampling [21, 143, 147–150], treating each sample individually to generate positive and negative”
BackgroundMethodHuman Activity Recognition via Hybrid Deep Learning Based Model
Khan, I. U., Afzal, S., & Lee, J. W. (2022) · Sensors · doi:10.3390/s22010323 · Cited by 256
“…recognition [39,40], person re-identification [41], Energy forecasting [42–45], machine translation [46], and activity recognition from sensor data [47] used a special kind of neural network called Recurrent Neural Network (RNN) specifically designed for sequential data analysis having the ability…”
MethodHuman Activity Recognition Based on Residual Network and BiLSTM
Li, Y., & Wang, L. (2022) · Sensors · doi:10.3390/s22020635 · Cited by 156
“In [27], four deep learning hybrid models composed of CNN and RNN were studied to recognize complex activities.”
MethodMekruksavanich, S., & Jitpattanakul, A. (2021) · Sensors · doi:10.3390/s21227519 · Cited by 109
“The human gait is passively visible, inconspicuous, implicit, continuous, and concurrent and can be readily assessed while users are carrying their phones [21].”
BackgroundSelf-citation
Metadata
- Authors
- Mekruksavanich, S., & Jitpattanakul, A.
- Affiliations
- University of Phayao (TH)
- King Mongkut's University of Technology North Bangkok (TH)
- Corresponding author
- Jitpattanakul, Anuchit
- Venue
- Electronics
- Publisher
- MDPI AG
- Published
- 2021-07-14
- Volume
- 10
- Issue
- 14
- Pages
- 1685
- ISSN
- 2079-9292 (ISSN-L)
- OpenAlex
- W3182319652
- Cited by
- 138
- References
- 76
- Citations by year
- 2026: 12 · 2025: 27 · 2024: 36 · 2023: 22 · 2022: 30 · 2021: 10
- FWCI
- 8.78
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Electronics (publishedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- University of Phayao (FF64-UoE008)
- King Mongkut's University of Technology North Bangkok (KMUTNB-BasicR-64-33-2)
- Thailand Science Research and Innovation Fund (-)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Context-Aware Activity Recognition Systems
- Physical Sciences › Engineering › Biomedical Engineering › Gait Recognition and Analysis
- Physical Sciences › Computer Science › Human-Computer Interaction › Hand Gesture Recognition Systems
- Keywords
- wearable sensors, wrist-worn sensors, recurrent neural networks, long short-term memory, bidirectional LSTM, gated recurrent unit, bidirectional GRU, hybrid CNN-RNN model, CNN-BiGRU
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.