Deep Convolutional Neural Network with RNNs for Complex Activity Recognition Using Wrist-Worn Wearable Sensor Data
Open accessThe DOI matches its Crossref record; 77 of the 77 references it cites were found in a registry or an index.
Abstract
Sensor-based human activity recognition (S-HAR) has become an important and high-impact topic of research within human-centered computing. In the last decade, successful applications of S-HAR have been presented through fruitful academic research and industrial applications, including for healthcare monitoring, smart home controlling, and daily sport tracking. However, the growing requirements of many current applications for recognizing complex human activities (CHA) have begun to attract the attention of the HAR research field when compared with simple human activities (SHA). S-HAR has shown that deep learning (DL), a type of machine learning based on complicated artificial neural networks, has a significant degree of recognition efficiency. Convolutional neural networks (CNNs) and recurrent neural networks (RNNs) are two different types of DL methods that have been successfully applied to the S-HAR challenge in recent years. In this paper, we focused on four RNN-based DL models (LSTMs, BiLSTMs, GRUs, and BiGRUs) that performed complex activity recognition tasks. The efficiency of four hybrid DL models that combine convolutional layers with the efficient RNN-based models was also studied. Experimental studies on the UTwente dataset demonstrated that the suggested hybrid RNN-based models achieved a high level of recognition performance along with a variety of performance indicators, including accuracy, F1-score, and confusion matrix. The experimental results show that the hybrid DL model called CNN-BiGRU outperformed the other DL models with a high accuracy of 98.89% when using only complex activity data. Moreover, the CNN-BiGRU model also achieved the highest recognition performance in other scenarios (99.44% by using only simple activity data and 98.78% with a combination of simple and complex activities).
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Previous studies, including [10, 18, 23, 24], have amalgamated convolutional neural networks (CNN), recurrent neural networks (RNN), and attention mechanisms;”
From Adaptive temporal attention mechanism and hybrid deep CNN model for wearable sensor-based human activity recognition (2025) · cites this paper as [10]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“This leads to more reduced error rates in the confusion matrix (Fig. 8) when compared to CNN-BiGRU [10] and CNN-LSTM [24].”
From Adaptive temporal attention mechanism and hybrid deep CNN model for wearable sensor-based human activity recognition (2025) · cites this paper as [10]
In the citing paper
“Furthermore, employing data standardization or normalization methods can enhance input quality and expedite model training [10, 31].”
From Adaptive temporal attention mechanism and hybrid deep CNN model for wearable sensor-based human activity recognition (2025) · cites this paper as [10]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318 · cited 2×
“However, the RNNs suffered from the vanishing gradient problem [45] that made them hard to train with acceptable performance.”
BackgroundThe Elements of Statistical Learning
Hastie, T., Tibshirani, R., & Friedman, J. (2009) · Springer Series in Statistics · doi:10.1007/978-0-387-84858-7 · Cited by 25,970
Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling
Chung, J., Gulcehre, C., Cho, K., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1412.3555 · Cited by 11,008 · cited 2×
“The GRU is a basic version of the LSTM that does not have a separate memory cell in its structure [52].”
BackgroundBidirectional recurrent neural networks
Schuster, M., & Paliwal, K. K. (1997) · IEEE Transactions on Signal Processing · doi:10.1109/78.650093 · Cited by 10,172 · cited 1×
“The BiLSTM was introduced in 1997 by Schuster and Paliwal to increase the amount of knowledge available in the LSTM network [49].”
MethodOn the Properties of Neural Machine Translation: Encoder–Decoder Approaches
Cho, K., van Merrienboer, B., Bahdanau, D., & Bengio, Y. (2014) · Proceedings of SSST-8, Eighth Workshop on Syntax, Semantics and Structure in Statistical Translation · doi:10.3115/v1/w14-4012 · Cited by 7,099 · cited 1×
“[51] introduced the gate recurrent unit (GRU) network, a novel RNN-based model, in 2014.”
BackgroundA survey of cross-validation procedures for model selection
Arlot, S., & Célisse, A. (2010) · LillOA (Université de Lille (University Of Lille)) · Cited by 3,669
A survey of cross-validation procedures for model selection
Arlot, S., & Celisse, A. (2010) · Statistics Surveys · doi:10.1214/09-ss054 · Cited by 3,522 · cited 1×
“To split the data for training and testing, several techniques can be utilized, such as k-fold cross validation [68].”
MethodThe Vanishing Gradient Problem During Learning Recurrent Neural Nets and Problem Solutions
Hochreiter, S. (1998) · International Journal of Uncertainty, Fuzziness and Knowledge-Based Systems · doi:10.1142/s0218488598000094 · Cited by 2,939 · cited 1×
“LSTMs are very popular in the natural language processing domain where they are used for word prediction, language translation, etc., including in the HAR domain [46,47].”
BackgroundDeep Convolutional and LSTM Recurrent Neural Networks for Multimodal Wearable Activity Recognition
Ordóñez, F., & Roggen, D. (2016) · Sensors · doi:10.3390/s16010115 · Cited by 2,761
Factorizing personalized Markov chains for next-basket recommendation
Rendle, S., Freudenthaler, C., & Schmidt-Thieme, L. (2010) · Proceedings of the 19th international conference on World wide web · doi:10.1145/1772690.1772773 · Cited by 2,692
A Survey on Human Activity Recognition using Wearable Sensors
Lara, O. D., & Labrador, M. A. (2013) · IEEE Communications Surveys & Tutorials · doi:10.1109/surv.2012.110112.00192 · Cited by 2,662 · cited 3×
“Human activities can be categorized into two groups based on [18–20 , 34– 37 Alo et al. [34] classified human activities into two categories: simple and complex.”
BackgroundInceptiontime: finding alexnet for time series classification
Ismail Fawaz, H., Lucas, B., Forestier, G., Pelletier, C., Schmidt, D. F., Weber, J., Webb, G. I., Idoumghar, L., Muller, P.-A., & Petitjean, F. (2020) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-020-00710-y · Cited by 1,788 · cited 4×
“The first model is the InceptionTime model proposed in [29] that combines a modified Inception model with a gated recurrent unit and residual connections to improve recognition performance of imbalance datasets in HAR.”
BackgroundMethodInfluentialIntroducing a New Benchmarked Dataset for Activity Monitoring
Reiss, A., & Stricker, D. (2012) · 2012 16th International Symposium on Wearable Computers · doi:10.1109/iswc.2012.13 · Cited by 1,456 · cited 1×
“Furthermore, this study makes use of the PAMAP2 [71] physical activity monitoring dataset, which is openly accessible from the University of California, Irvine (UCI) Machine Learning Repository.”
MethodMultivariate LSTM-FCNs for time series classification
Karim, F., Majumdar, S., Darabi, H., & Harford, S. (2019) · Neural Networks · doi:10.1016/j.neunet.2019.04.014 · Cited by 1,138 · cited 1×
“Many DL models, such as InceptionTime [29], temporal transformer networks [61], and LSTM-FCNs [62], have been presented in the last year to solve specialized problems in time-series categorization.”
BackgroundOn the Properties of Neural Machine Translation: Encoder-Decoder ApproachesPreprint
Cho, K., van Merriënboer, B., Bahdanau, D., et al. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1409.1259 · Cited by 1,112 · cited 1×
“[51] introduced the gate recurrent unit (GRU) network, a novel RNN-based model, in 2014.”
BackgroundLSTM-CNN Architecture for Human Activity Recognition
Xia, K., Huang, J., & Wang, H. (2020) · IEEE Access · doi:10.1109/access.2020.2982225 · Cited by 851 · cited 1×
“…while carrying out a task, the extraction of important features defining the sensor data, and the application of a learning approach that is trained on existing labeled data and applied to additional unknown data for activity identification are all typical processes in the main data flow for HAR [38].”
MethodReal-time human activity recognition from accelerometer data using Convolutional Neural Networks
Ignatov, A. (2018) · Applied Soft Computing · doi:10.1016/j.asoc.2017.09.027 · Cited by 814 · cited 2×
“On two publicly available datasets, Ignatov [22] introduced a CNN for local feature extraction along with simple statistical characteristics that maintain information about the entire form of the time series.”
MethodSensor-based and vision-based human activity recognition: A comprehensive survey
Minh Dang, L., Min, K., Wang, H., Jalil Piran, M., Hee Lee, C., & Moon, H. (2020) · Pattern Recognition · doi:10.1016/j.patcog.2020.107561 · Cited by 730 · cited 2×
“In [1,8], a fundamental formulation for the HAR challenge was acquired, as well as an overview of previous strategies for solving it.”
Human Activity Recognition and Pattern Discovery
Kim, E., Helal, S., & Cook, D. (2010) · IEEE Pervasive Computing · doi:10.1109/mprv.2010.7 · Cited by 704 · cited 1×
“To address the problem of complex human recognition, we explored activity tax-onomies [19,35,64] and classified human activity into two classes, simple and complex, using the SC 2 taxonomy paradigm [35] as shown in Figure 2.”
MethodWindow Size Impact in Human Activity Recognition
Banos, O., Galvez, J.-M., Damas, M., Pomares, H., & Rojas, I. (2014) · Sensors · doi:10.3390/s140406474 · Cited by 648 · cited 1×
“Enhanced data windows, on the other hand, are often involved with the identification of complex activities [73].”
BackgroundDeep-Learning-Enhanced Human Activity Recognition for Internet of Healthcare Things
Zhou, X., Liang, W., Wang, K. I.-K., Wang, H., Yang, L. T., & Jin, Q. (2020) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.2985082 · Cited by 556 · cited 1×
“Sport coaching, distance health monitoring, wellness self-management, military applications, entertain-Electronics ment, household member identification, gait analysis, and gesture recognition are just a few of the domains where HAR has been effectively developed [32,33].”
BackgroundDeep Recurrent Neural Networks for Human Activity Recognition
Murad, A., & Pyun, J.-Y. (2017) · Sensors · doi:10.3390/s17112556 · Cited by 524 · cited 1×
“As a result, in HAR [25], recurrent neural networks (RNNs) are applied, providing significance to temporal information from wearable sensor data.”
BackgroundSequence-Aware Recommender Systems
Quadrana, M., Cremonesi, P., & Jannach, D. (2019) · ACM Computing Surveys · doi:10.1145/3190616 · Cited by 504 · cited 1×
“That is, it determines which knowledge needs to be transferred to the next state and which does not [53,54].”
BackgroundComplex Human Activity Recognition Using Smartphone and Wrist-Worn Motion Sensors
Shoaib, M., Bosch, S., Incel, O., Scholten, H., & Havinga, P. (2016) · Sensors · doi:10.3390/s16040426 · Cited by 423
Rank Methods for Combination of Independent Experiments in Analysis of Variance
Hodges, J. L., & Lehmann, E. L. (1962) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177704575 · Cited by 396
Rank Methods for Combination of Independent Experiments in Analysis of Variance
Hodges, J. L., & Lehmann, E. L. (2012) · Selected Works of E. L. Lehmann · doi:10.1007/978-1-4614-1412-4_35 · Cited by 373 · cited 2×
“However, to show the comparative performance with statistical analysis, the FAR test [69] and the Finner post hoc test [70] were computed, and their ranks and p -values were compared, as shown in Table 6.”
MethodSmartphone and Smartwatch-Based Biometrics Using Activities of Daily Living
Weiss, G. M., Yoneda, K., & Hayajneh, T. (2019) · IEEE Access · doi:10.1109/access.2019.2940729 · Cited by 360 · cited 1×
“WISDM-HARB Dataset The “WISDM Human Activity Recognition and Biometric Dataset” (WISDM-HARB Dataset) from the UCI Repository [72] is another complex human activity dataset used in this study.”
MethodLSTM Networks Using Smartphone Data for Sensor-Based Human Activity Recognition in Smart Homes
Mekruksavanich, S., & Jitpattanakul, A. (2021) · Sensors · doi:10.3390/s21051636 · Cited by 335 · cited 1×
“Following this, several features are extracted based on these measurements to be used in the training of activity models, which will subsequently be used to identify these activities [11,12].”
MethodInfluentialSelf-citationInnoHAR: A Deep Neural Network for Complex Human Activity Recognition
Xu, C., Chai, D., He, J., Zhang, X., & Duan, S. (2019) · IEEE Access · doi:10.1109/access.2018.2890675 · Cited by 333 · cited 1×
“A CNN and gated recurrent unit (GRU) model framework was presented in [28].”
MethodSimple and Complex Activity Recognition through Smart Phones
Dernbach, S., Das, B., Krishnan, N. C., Thomas, B. L., & Cook, D. J. (2012) · 2012 Eighth International Conference on Intelligent Environments · doi:10.1109/ie.2012.39 · Cited by 312 · cited 2×
“Human activities can be categorized into two groups based on [18–20 , 34– 37 Alo et al. [34] classified human activities into two categories: simple and complex.”
BackgroundResultImaging and fusing time series for wearable sensor-based human activity recognition
Qin, Z., Zhang, Y., Meng, S., Qin, Z., & Choo, K.-K. R. (2020) · Information Fusion · doi:10.1016/j.inffus.2019.06.014 · Cited by 309 · cited 1×
“The architecture of a deep model with convolutional layers [21] has been used to achieve automatic feature extraction in a deep learning (DL) environment.”
MethodLynn, H. M., Pan, S. B., & Kim, P. (2019) · IEEE Access · doi:10.1109/access.2019.2939947 · Cited by 304 · cited 1×
“In certain situations, however, it may be beneficial to look not only at the past but also at the future to make the predictions [56].”
BackgroundOn a Monotonicity Problem in Step-Down Multiple Test Procedures
Finner, H. (1993) · Journal of the American Statistical Association · doi:10.1080/01621459.1993.10476358 · Cited by 301 · cited 2×
“However, to show the comparative performance with statistical analysis, the FAR test [69] and the Finner post hoc test [70] were computed, and their ranks and p -values were compared, as shown in Table 6.”
MethodInfluentialCan Deep Learning Revolutionize Mobile Sensing?
Lane, N. D., & Georgiev, P. (2015) · Proceedings of the 16th International Workshop on Mobile Computing Systems and Applications · doi:10.1145/2699343.2699349 · Cited by 282 · cited 1×
“Furthermore, after many years, the extraction of valuable characteristics was the most challenging part of the mobile and wearable sensor-based HAR pipeline [31].”
BackgroundHuman Activity Recognition: A Survey
Jobanputra, C., Bavishi, J., & Doshi, N. (2019) · Procedia Computer Science · doi:10.1016/j.procs.2019.08.100 · Cited by 274 · cited 2×
“The variety of sensory data used significantly influences the types of functionality, algorithms, architectures, and approaches used for research, so HAR systems can be categorized based on the modality of sensory data used [7,8].”
MethodChow, T. W. S., & Fang, Y. (1998) · IEEE Transactions on Industrial Electronics · doi:10.1109/41.661316 · Cited by 233 · cited 1×
“When dealing with one-dimensional sequence data, the CNN is extremely successful at extracting and achieving features [58].”
MethodAccelerometer-Based Human Fall Detection Using Convolutional Neural Networks
Santos, G. L., Endo, P. T., Monteiro, K. H. D. C., Rocha, E. D. S., Silva, I., & Lynn, T. (2019) · Sensors · doi:10.3390/s19071644 · Cited by 232 · cited 1×
“They are especially good at tracking simple human actions such as walking, jogging, resting, standing, and ascending since they entail repetitive body movements [15,16].”
BackgroundMekruksavanich, S., & Jitpattanakul, A. (2021) · Electronics · doi:10.3390/electronics10030308 · Cited by 219 · cited 1×
“Following this, several features are extracted based on these measurements to be used in the training of activity models, which will subsequently be used to identify these activities [11,12].”
MethodInfluentialSelf-citationiSPLInception: An Inception-ResNet Deep Learning Architecture for Human Activity Recognition
Ronald, M., Poulose, A., & Han, D. S. (2021) · IEEE Access · doi:10.1109/access.2021.3078184 · Cited by 217 · cited 1×
“In [63], a modified InceptionTime model called Inception-ResNet was presented to perform on the HAR challenge and achieve meaningful results.”
MethodWang, K., He, J., & Zhang, L. (2019) · IEEE Sensors Journal · doi:10.1109/jsen.2019.2917225 · Cited by 206 · cited 2×
“With a 50% overlap proportion, the OW scheme is commonly utilized in S-HAR research [24].”
BackgroundMethodLSTM Networks for Mobile Human Activity Recognition
Chen, Y., Zhong, K., Zhang, J., Sun, Q., & Zhao, X. (2016) · Proceedings of the 2016 International Conference on Artificial Intelligence: Technologies and Applications · doi:10.2991/icaita-16.2016.13 · Cited by 197 · cited 1×
“LSTMs are very popular in the natural language processing domain where they are used for word prediction, language translation, etc., including in the HAR domain [46,47].”
BackgroundDeep Convolutional Neural Network-Based Approaches for Face Recognition
Almabdy, S., & Elrefaei, L. (2019) · Applied Sciences · doi:10.3390/app9204397 · Cited by 185 · cited 1×
“DL is a form of machine learning in which models explicitly identify images, video, text, or speech [43,44].”
BackgroundSargano, A., Angelov, P., & Habib, Z. (2017) · Applied Sciences · doi:10.3390/app7010110 · Cited by 181
A Public Domain Dataset for Real-Life Human Activity Recognition Using Smartphone Sensors
Garcia-Gonzalez, D., Rivero, D., Fernandez-Blanco, E., & Luaces, M. R. (2020) · Sensors · doi:10.3390/s20082200 · Cited by 178
A Deep Learning Approach for Human Activities Recognition From Multimodal Sensing Devices
Ihianle, I. K., Nwajana, A. O., Ebenuwa, S. H., Otuka, R. I., Owa, K., & Orisatoki, M. O. (2020) · IEEE Access · doi:10.1109/access.2020.3027979 · Cited by 158
Sensing Technology for Human Activity Recognition: A Comprehensive Survey
Fu, B., Damer, N., Kirchbuchner, F., & Kuijper, A. (2020) · IEEE Access · doi:10.1109/access.2020.2991891 · Cited by 157 · cited 2×
“In [1,8], a fundamental formulation for the HAR challenge was acquired, as well as an overview of previous strategies for solving it.”
BackgroundPires, I., Garcia, N., Pombo, N., & Flórez-Revuelta, F. (2016) · Sensors · doi:10.3390/s16020184 · Cited by 155 · cited 1×
“There are a variety of methodologies and data gathering systems for recognizing these actions, all of which are based on various sensory measurements [14].”
BackgroundPolat, H., & Mehr, H. D. (2019) · Applied Sciences · doi:10.3390/app9050940 · Cited by 150 · cited 1×
“Convolutional Neural Network DL is a form of machine learning in which models explicitly identify images, video, text, or speech [43,44].”
BackgroundHuman activity recognition with inertial sensors using a deep learning approach
Zebin, T., Scully, P. J., & Ozanyan, K. B. (2016) · 2016 IEEE SENSORS · doi:10.1109/icsens.2016.7808590 · Cited by 140 · cited 1×
“The second methodology, sensor-based human activity recognition (S-HAR) [10], is the target of this ongoing study.”
A Review of Internet of Things Technologies for Ambient Assisted Living Environments
Maskeliūnas, R., Damaševičius, R., & Segal, S. (2019) · Future Internet · doi:10.3390/fi11120259 · Cited by 140
Peng (2018) · doi:10.1145/3214277 · Cited by 134
Human Action Recognition by Learning Spatio-Temporal Features With Deep Neural Networks
Wang, L., Xu, Y., Cheng, J. S., Xia, H., Yin, J., & Wu, J. (2018) · IEEE Access · doi:10.1109/access.2018.2817253 · Cited by 129 · cited 1×
“Wang et al. [59] stated that a CNN might be used to extract only the spatial data for each frame in order to tackle the HAR problem, and the researchers developed two types of LSTM networks to investigate temporal features in subsequent video frames.”
MethodMultilevel Depth and Image Fusion for Human Activity Detection
Ni, B., Pei, Y., Moulin, P., & Yan, S. (2013) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2013.2276433 · Cited by 111 · cited 1×
“DL approaches for HAR have become increasingly popular in recent years, providing unrivaled output in a variety of fields such as visual object recognition, natural language processing, and logic reasoning [41].”
BackgroundSensor-based human activity recognition system with a multilayered model using time series shapelets
Liu, L., Peng, Y., Liu, M., & Huang, Z. (2015) · Knowledge-Based Systems · doi:10.1016/j.knosys.2015.09.024 · Cited by 107 · cited 2×
“To address the problem of complex human recognition, we explored activity tax-onomies [19,35,64] and classified human activity into two classes, simple and complex, using the SC 2 taxonomy paradigm [35] as shown in Figure 2.”
BackgroundMethodConvolutional and Recurrent Neural Networks for Activity Recognition in Smart Environment
Singh, D., Merdivan, E., Hanke, S., Kropf, J., Geist, M., & Holzinger, A. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-69775-8_12 · Cited by 94 · cited 1×
“In [48], the authors compare LSTMs to CNNs and standard machine learning models.”
MethodAccelerometer-Based Human Activity Recognition for Patient Monitoring Using a Deep Neural Network
Fridriksdottir, E., & Bonomi, A. (2020) · Sensors · doi:10.3390/s20226424 · Cited by 88 · cited 1×
“Sport coaching, distance health monitoring, wellness self-management, military applications, entertain-Electronics ment, household member identification, gait analysis, and gesture recognition are just a few of the domains where HAR has been effectively developed [32,33].”
BackgroundEnhanced Hand-Oriented Activity Recognition Based on Smartwatch Sensor Data Using LSTMs
Mekruksavanich, S., Jitpattanakul, A., Youplao, P., & Yupapin, P. (2020) · Symmetry · doi:10.3390/sym12091570 · Cited by 85 · cited 1×
“They are especially good at tracking simple human actions such as walking, jogging, resting, standing, and ascending since they entail repetitive body movements [15,16].”
BackgroundSelf-citationHuman Activity Recognition in AAL Environments Using Random Projections
Damaševičius, R., Vasiljevas, M., Šalkevičius, J., & Woźniak, M. (2016) · Computational and Mathematical Methods in Medicine · doi:10.1155/2016/4073584 · Cited by 82 · cited 1×
“Successful recognition of human activities can be extensively useful in ambient assisted living (AAL) applications [2] such as intelligent activity monitoring systems developed for elderly and disabled people in healthcare systems [3], automatic interpretation of hand gestures in sports [4], user identify verification…”
BackgroundSchlötterer, J., Seifert, C., Granitzer, M., Holzinger, A., Kieseberg, P., Tjoa, A. M., & Weippl, E. R. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-66808-6 · Cited by 76
Deep learning based multimodal complex human activity recognition using wearable devices
Chen, L., Liu, X., Peng, L., & Wu, M. (2020) · Applied Intelligence · doi:10.1007/s10489-020-02005-7 · Cited by 72 · cited 1×
“Chen et al. [36] classified human activities into two categories: simple and complex.”
BackgroundSmartphone User Identity Verification Using Gait Characteristics
Damaševičius, R., Maskeliūnas, R., Venčkauskas, A., & Woźniak, M. (2016) · Symmetry · doi:10.3390/sym8100100 · Cited by 71
CrossCount: A Deep Learning System for Device-Free Human Counting Using WiFi
Ibrahim, O. T., Gomaa, W., & Youssef, M. (2019) · IEEE Sensors Journal · doi:10.1109/jsen.2019.2928502 · Cited by 61 · cited 1×
“In general, the following research and development types in HAR systems can be identified [9]: (1) HAR systems based on visual information (images and videos), (2) HAR systems based on motion inertial sensors like IMUs (inertial measurement units), and (3) HAR systems based on obtained signal…”
BackgroundInfluentialA Comparison of Unidirectional and Bidirectional LSTM Networks for Human Activity Recognition
Alawneh, L. M., Mohsen, B., Al-Zinati, M., Shatnawi, A. S., & Al‐Ayyoub, M. (2020) · IEEE International Conference on Pervasive Computing and Communications Workshops (PerCom Workshops) · doi:10.1109/percomworkshops48775.2020.9156264 · Cited by 51 · cited 1×
“Alawneh et al. [50] provided comparison results of unidirectional and bidirectional long short-term memory models on sensor-based human activity data in their S-HAR work.”
BackgroundDeep Learning for Activity Recognition in Older People Using a Pocket-Worn Smartphone
Nan, Y., Lovell, N. H., Redmond, S. J., Wang, K., Delbaere, K., & van Schooten, K. S. (2020) · Sensors · doi:10.3390/s20247195 · Cited by 46 · cited 1×
“Nan et al. [60] enhanced various models in their study, including the 1D-CNN, a multichannel CNN, a CNN-LSTM, and a multichannel CNN-LSTM model.”
MethodŽemgulys, J., Raudonis, V., Maskeliūnas, R., & Damaševičius, R. (2018) · Procedia Computer Science · doi:10.1016/j.procs.2018.04.095 · Cited by 43 · cited 1×
“…activity monitoring systems developed for elderly and disabled people in healthcare systems [3], automatic interpretation of hand gestures in sports [4], user identify verification for security systems using gait characteristics [5], and human–robot interactions through gesture recognition [6].”
BackgroundTowards Integrative Machine Learning and Knowledge Extraction
Holzinger, A., Goebel, R. G., Palade, V., & Ferri, M. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-69775-8_1 · Cited by 43
Alo, U. R., Nweke, H. F., Teh, Y. W., & Murtaza, G. (2020) · Sensors · doi:10.3390/s20216300 · Cited by 40 · cited 8×
“2.898 0.00910 reject Naïve Bayes [20] 5.254 0.00006 reject Support Vector Machine [34] 7.318 0.00001 reject”
BackgroundMethodInfluentialMultidisciplinary studies of illness in aged persons—VI
Katz, S., Jackson, B. A., Jaffe, M. W., Littell, A. S., & Turk, C. E. (1962) · Journal of Chronic Diseases · doi:10.1016/0021-9681(62)90117-0 · Cited by 32 · cited 1×
“Activities of daily living (ADL) that individuals have the ability to do on a regular basis, such as dining, walking, washing, dressing, and so on, are good illustrations of such activities [13].”
BackgroundBidirectional Gated Recurrent Units For Human Activity Recognition Using Accelerometer Data
Alsarhan, T., Alawneh, L. M., Al-Zinati, M., & Al‐Ayyoub, M. (2019) · Proceedings of IEEE Sensors/Proceedings of IEEE Sensors ... · doi:10.1109/sensors43011.2019.8956560 · Cited by 31 · cited 1×
“Alsarhan et al. [57] proposed a bidirectional gated recurrent units (BiGRU) model for recognizing human activities.”
BackgroundOkai, J., Paraschiakos, S., Beekman, M., Knobbe, A., & de Sa, C. R. (2019) · 2019 41st Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc.2019.8857288 · Cited by 29 · cited 1×
“Okai et al. [55] established a robust DL model based on the GRU network for addressing the S-HAR problem through data augmentation.”
MethodImproving Human Activity Monitoring by Imputation of Missing Sensory Data: Experimental Study
Pires, I. M., Hussain, F., García, N. M., & Zdravevski, E. (2020) · Future Internet · doi:10.3390/fi12090155 · Cited by 26 · cited 1×
“Because 99% of the energy in human body movement is held below 15 Hz, this rate is adequate for collection [65]; To transform each piece of sensor data with mean and standard derivation, a normalization procedure is used [66].”
MethodTemporal Approaches for Human Activity Recognition Using Inertial Sensors
Garcia, F. A., Ranieri, C. M., & Romero, R. A. F. (2019) · Latin American Robotics Symposium, Brazilian Symposium on Robotics and Workshop on Robotics in Education (LARS/SBR/WRE) · doi:10.1109/lars-sbr-wre48964.2019.00029 · Cited by 21 · cited 2×
“The former state-of-the-art models on the complex HAR were InceptionTime [29] and DeepCovnTCN [30].”
BackgroundMethodHuman Activity Recognition from Environmental Background Sounds for Wireless Sensor Networks
Zhan, Y., Miura, S., Nishimura, J., & Kuroda, T. (2007) · IEEE International Conference on Networking, Sensing and Control (ICNSC) · doi:10.1109/icnsc.2007.372796 · Cited by 17
Madureira, A. M., Abraham, A., Gandhi, N., & Varela, L. (2019) · Advances in intelligent systems and computing · doi:10.1007/978-3-030-14347-3 · Cited by 15
Activity recognition for locomotion and transportation dataset using deep learning
Naseeb, C., & Saeedi, B. A. (2020) · ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp) · doi:10.1145/3410530.3414348 · Cited by 15 · cited 2×
“Many DL models, such as InceptionTime [29], temporal transformer networks [61], and LSTM-FCNs [62], have been presented in the last year to solve specialized problems in time-series categorization.”
BackgroundMethodAmara, M., Zidi, K., & Ghédira, K. (2019) · Advances in intelligent systems and computing · doi:10.1007/978-3-030-14347-3_56 · Cited by 5 · cited 1×
“To extract features from time series data, previous research used two different techniques: statistical and structural [39].”
MethodResidual Learning Based CNN for Gesture Recognition in Robot Interaction
Hua, H. (2021) · Journal of Information Processing Systems · Cited by 2
Cited by
A Comprehensive Overview and Comparative Analysis on Deep Learning Models
Perumal, T., Mustapha, N., Mohamed, R., & Shiri, F. M. (2024) · Journal on artificial intelligence · doi:10.32604/jai.2024.054314 · Cited by 667
“Unlike traditional methods, CNNs automatically learn and recognize features from the data without the need for manual feature extraction by humans [13].”
MethodDeep Learning for Time Series Classification and Extrinsic Regression: A Current Survey
Mohammadi Foumani, N., Miller, L., Tan, C. W., Webb, G. I., Forestier, G., & Salehi, M. (2024) · ACM Computing Surveys · doi:10.1145/3649448 · Cited by 268
“In addition to the subsequence-based methods, other models employ instance-based sampling [21, 143, 147–150], treating each sample individually to generate positive and negative”
BackgroundMethodHuman Activity Recognition via Hybrid Deep Learning Based Model
Khan, I. U., Afzal, S., & Lee, J. W. (2022) · Sensors · doi:10.3390/s22010323 · Cited by 256
“…recognition [39,40], person re-identification [41], Energy forecasting [42–45], machine translation [46], and activity recognition from sensor data [47] used a special kind of neural network called Recurrent Neural Network (RNN) specifically designed for sequential data analysis having the ability…”
MethodHuman Activity Recognition Based on Residual Network and BiLSTM
Li, Y., & Wang, L. (2022) · Sensors · doi:10.3390/s22020635 · Cited by 156
“In [27], four deep learning hybrid models composed of CNN and RNN were studied to recognize complex activities.”
MethodMekruksavanich, S., & Jitpattanakul, A. (2021) · Sensors · doi:10.3390/s21227519 · Cited by 109
“The human gait is passively visible, inconspicuous, implicit, continuous, and concurrent and can be readily assessed while users are carrying their phones [21].”
BackgroundSelf-citation
Metadata
- Authors
- Mekruksavanich, S., & Jitpattanakul, A.
- Affiliations
- University of Phayao (TH)
- King Mongkut's University of Technology North Bangkok (TH)
- Corresponding author
- Jitpattanakul, Anuchit
- Venue
- Electronics
- Publisher
- MDPI AG
- Published
- 2021-07-14
- Volume
- 10
- Issue
- 14
- Pages
- 1685
- ISSN
- 2079-9292 (ISSN-L)
- OpenAlex
- W3182319652
- Cited by
- 138
- References
- 76
- Citations by year
- 2026: 12 · 2025: 27 · 2024: 36 · 2023: 22 · 2022: 30 · 2021: 10
- FWCI
- 8.78
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Electronics (publishedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- University of Phayao (FF64-UoE008)
- King Mongkut's University of Technology North Bangkok (KMUTNB-BasicR-64-33-2)
- Thailand Science Research and Innovation Fund (-)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Context-Aware Activity Recognition Systems
- Physical Sciences › Engineering › Biomedical Engineering › Gait Recognition and Analysis
- Physical Sciences › Computer Science › Human-Computer Interaction › Hand Gesture Recognition Systems
- Keywords
- wearable sensors, wrist-worn sensors, recurrent neural networks, long short-term memory, bidirectional LSTM, gated recurrent unit, bidirectional GRU, hybrid CNN-RNN model, CNN-BiGRU
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.