Deep Learning for Sensor-based Human Activity Recognition
The DOI matches its Crossref record; 151 of the 151 references it cites were found in a registry or an index.
Abstract
The vast proliferation of sensor devices and Internet of Things enables the applications of sensor-based activity recognition. However, there exist substantial challenges that could influence the performance of the recognition system in practical scenarios. Recently, as deep learning has demonstrated its effectiveness in many areas, plenty of deep methods have been investigated to address the challenges in activity recognition. In this study, we present a survey of the state-of-the-art deep learning methods for sensor-based human activity recognition. We first introduce the multi-modality of the sensory data and provide information for public datasets that can be used for evaluation in different challenge tasks. We then propose a new taxonomy to structure the deep methods by challenges. Challenges and challenge-related deep methods are summarized and analyzed to form an overview of the current research progress. At the end of this work, we discuss the open issues and provide some insights for future directions.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“This renders activity labeling difficult, reducing the number of available labels [8,23,30].”
From Spatial-Temporal Masked Autoencoder for Multi-Device Wearable Human Activity Recognition (2023) · cites this paper as [8]
Citations
Cites
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380
Fully convolutional networks for semantic segmentation
Long, J., Shelhamer, E., & Darrell, T. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298965 · Cited by 38,834
Pan, S. J., & Yang, Q. (2010) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2009.191 · Cited by 23,387 · cited 1×
“Before taking a closer look at the factors that cause distribution discrepancy in sensory data, we briefly introduce transfer learning [102].”
BackgroundGreff, K., Srivastava, R. K., Koutnik, J., Steunebrink, B. R., & Schmidhuber, J. (2017) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2016.2582924 · Cited by 6,955 · cited 19×
“A multi-label RNN was created with each RNN cell responding to activity recognition of one occupant.”
BackgroundMethodInfluentialProceedings of the 19th International Joint Conference on Artificial Intelligence
Pujol, J. M., Delgado, J., Ramon Sangüesa, A., & Flache, A. (2005) · International Joint Conference on Artificial Intelligence · Cited by 5,771
Combining labeled and unlabeled data with co-training
Blum, A., & Mitchell, T. (1998) · Proceedings of the eleventh annual conference on Computational learning theory · doi:10.1145/279943.279962 · Cited by 5,495
Recurrent neural network based language model
Mikolov, T., Karafiát, M., Burget, L., Černocký, J., & Khudanpur, S. (2010) · Interspeech 2010 · doi:10.21437/interspeech.2010-343 · Cited by 5,390
Activity recognition using cell phone accelerometers
Kwapisz, J. R., Weiss, G. M., & Moore, S. A. (2011) · ACM SIGKDD Explorations Newsletter · doi:10.1145/1964897.1964918 · Cited by 2,912
Deep Convolutional and LSTM Recurrent Neural Networks for Multimodal Wearable Activity Recognition
Ordóñez, F., & Roggen, D. (2016) · Sensors · doi:10.3390/s16010115 · Cited by 2,761 · cited 1×
“eep hybrid model to explore different views of temporal dynamics is another attractive trend in the human activity recognition community. In light of the advantages of CNN and RNN, Ordóñez and Roggen [106] proposed to combine CNNs and LSTMs for both local and global temporal feature extraction. Xu et al. [162] adopted…”
A Survey on Human Activity Recognition using Wearable Sensors
Lara, O. D., & Labrador, M. A. (2013) · IEEE Communications Surveys & Tutorials · doi:10.1109/surv.2012.110112.00192 · Cited by 2,662 · cited 1×
“data facilitates recognition and which part deteriorates that. 1.2 Deep Learning in Human Activity Recognition. Numerous previous works adopted machine learning methods in human activity recognition [79]. They highly rely on feature extraction techniques including time-frequency transformation [62], statistical approa…”
MethodInfluential
Research works printed but not linked: 37
- Alsheikh Mohammad Abu, 2016, Proceedings of the Workshops at the 30th AAAI Conference on Artificial Intelligence.
- Bengio Yoshua, 2012, Proceedings of ICML Workshop on Unsupervised and Transfer Learning. 17–36
- Brophy Eoin, 2018, Zhengwei Wang, Alan F. Smeaton, and Tomas E. Ward.
- 10.5555/3367032.3367223 · doi:10.5555/3367032.3367223
- Chen Ling, 2020, METIER: A deep multi-task learning based activity and user recognition model using wearable sensors. Proc. ACM Interact., Mob, Wear. Ubiq. Technol., 4, 1
- Dong Mingtao, 2018, Proceedings of the International Conference on Signal and Information Processing, Networking and Computers. Springer, 32–40
- Goodfellow Ian, 2014, Proceedings of the International Conference on Advances in Neural Information Processing Systems. 2672–2680
- Hammerla Nils Yannick, 2015, Proceedings of the 29th AAAI Conference on Artificial Intelligence.
- Hammerla Nils Y., 2016, Proceedings of the 25th International Joint Conference on Artificial Intelligence. 1533–1540
- Karpathy Andrej, 2016, Proceedings of the 4th International Conference on Learning Representations Workshop.
- Al Hafiz Khan Md Abdullah, 2018, Proceedings of the International Conference on Pervasive Computing and Communications. IEEE, 1–9.
- 10.5555/3164150.3164213 · doi:10.5555/3164150.3164213
- Krizhevsky Alex, Proceedings of the International Conference on Advances in Neural Information Processing Systems. 1097–1105
- Nicholas, Proceedings of the 16th International Workshop on Mobile Computing Systems and Applications. ACM, 117–122
- Lee Song-Mi, 2017, Proceedings of the IEEE International Conference on Big Data and Smart Computing (BigComp’17)
- Li Fei, 2011, Proceedings of the Workshops at the 25th AAAI Conference on Artificial Intelligence.
- Li Xinyu, Proceedings of the 8th Wireless of the Students, by the Students, and for the Students Workshop (S3@MobiCom’16)
- Li Xinyu, Proceedings of the 14th ACM Conference on Embedded Network Sensor Systems CD-ROM. ACM, 164–175
- Li Xinyu, 2017, Burd
- Ordóñez Morales Francisco Javier, 2016, Proceedings of the ACM International Symposium on Wearable Computers. ACM, 92–99
- Vishvak, Proceedings of the ACM International Symposium on Wearable Computers. ACM, 100–103
- Phan NhatHai, 2016, Proceedings of the 30th AAAI Conference on Artificial Intelligence.
- Pouyanfar Samira, 2018, A survey on deep learning: Algorithms, techniques, and applications, Comput. Surv., 51, 92
- Press Ofir, 2017, Language generation with recurrent generative adversarial networks without pre-training. arXiv preprint arXiv:1706.01399 · arXiv
- Qian Hangwei, 2018, Proceedings of the AAAI Conference on Artificial Intelligence.
- Saeedi Ramyar, Proceedings of the IEEE International Conference on Big Data. IEEE, 473–479
- Serrano Sofia, Proceedings of the 57th Conference of the Association for Computational Linguistics (ACL’19)
- van Kasteren Tim L. M., 2011, Kröse
- Xue Li, 2018, Understanding and improving deep neural network for activity recognition. arXiv preprint arXiv:1805.07020 · arXiv
- 10.5555/2832747.2832806 · doi:10.5555/2832747.2832806
- Zebin Tahmina, Proceedings of the IEEE Conference on Sensors (SENSORS’16)
- Zhang Dalin, 2018, Proceedings of the AAAI Conference on Artificial Intelligence, 32
- Zhang Mi, Proceedings of the ACM Conference on Ubiquitous Computing. ACM, 1036–1043
- 10.5555/3304889.3305093 · doi:10.5555/3304889.3305093
- Zhang Yanyi, Proceedings of the 16th ACM/IEEE International Conference on Information Processing in Sensor Networks (IPSN’17)
- Zhang Yong, 2018, Human activity recognition based on time series analysis using U-Net. arXiv preprint arXiv:1809.08113 · arXiv
- Zheng Yi, Proceedings of the International Conference on Web-age Information Management. Springer, 298–310
Cited by
Items 101–200 of 503
Fully Connected Generative Adversarial Network for Human Activity Recognition
Jimale, A. O., & Noor, M. H. M. (2022) · IEEE Access · doi:10.1109/access.2022.3206952 · Cited by 23
“Recently, deep generative models have shown impres-81 sive results in generating massive samples for sensor-based human activity recognition [19].”
BackgroundLightweight Deep Learning Model for Radar-Based Fall Detection With Metric Learning
Ou, Z., & Ye, W. (2022) · IEEE Internet of Things Journal · doi:10.1109/jiot.2022.3229462 · Cited by 26
“The radar sensor has been proved to be a valid modality for fall detection among various sensors [8], [9].”
MethodGraph Transformer for Physical Rehabilitation Evaluation
Réby, K., Dulau, I., Dubrasquet, G., & Beurton‐Aimar, M. (2023) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/fg57933.2023.10042778 · Cited by 22
“Deep learning becomes the state-of-the-art in Computer Vision and Human Action Recognition[1], [2], [3].”
BackgroundA Survey of Visual Affordance Recognition Based on Deep Learning
Chen, D., Kong, D., Li, J., Wang, S., & Yin, B. (2023) · IEEE Transactions on Big Data · doi:10.1109/tbdata.2023.3291558 · Cited by 30
i-Sample: Augment Domain Adversarial Adaptation Models for WiFi-based HAR
Zhou, Z., Wang, F., & Gong, W. (2023) · ACM Transactions on Sensor Networks · doi:10.1145/3616494 · Cited by 25
“Wearable sensors-based solutions [3, 18] relied on modeling topology of the human body or ∗Wei Gong is the corresponding author.”
MethodIntelligent 3D garment system of the human body based on deep spiking neural network
Jiang, M., Tian, Z., Yu, C., Shi, Y., Liu, L., Peng, T., Hu, X., & Yu, F. Q. (2024) · Virtual Reality & Intelligent Hardware · doi:10.1016/j.vrih.2023.07.002 · Cited by 20
Arakawa, R., Yakura, H., Mollyn, V., Nie, S., Russell, E. R., DeMeo, D. P., Reddy, H. A., Maytin, A. K., Carroll, B. T., Lehman, J. F., et al. (2022) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3569504 · Cited by 34
“For full review, please refer to [11, 24, 34].”
Temporal Feature Alignment in Contrastive Self-Supervised Learning for Human Activity Recognition
Khaertdinov, B., & Asteriadis, S. (2022) · IEEE International Joint Conference on Biometrics (IJCB) · doi:10.1109/ijcb54206.2022.10007984 · Cited by 28
Online continual learning for human activity recognition
Schiemer, M., Fang, L., Dobson, S., & Ye, J. (2023) · Pervasive and Mobile Computing · doi:10.1016/j.pmcj.2023.101817 · Cited by 33
Semantic Loss: A New Neuro-Symbolic Approach for Context-Aware Human Activity Recognition
Arrotta, L., Civitarese, G., & Bettini, C. (2023) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3631407 · Cited by 38
CycleSense: Detecting near miss incidents in bicycle traffic from mobile motion sensors
Karakaya, A.-S., Ritter, T., Bießmann, F., & Bermbach, D. (2023) · Pervasive and Mobile Computing · doi:10.1016/j.pmcj.2023.101779 · Cited by 23
Xie, L., Song, S., & Letaief, K. B. (2023) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2023.3322828 · Cited by 19
Modality Consistency-Guided Contrastive Learning for Wearable-Based Human Activity Recognition
Guo, C., Zhang, Y., Chen, Y., Xu, C., & Wang, Z. (2024) · IEEE Internet of Things Journal · doi:10.1109/jiot.2024.3379019 · Cited by 24
“Various deep neural network architectures, including convolutional networks, residual networks, autoencoders, and Transformers, have been explored to learn discriminative features in this context [20], [21].”
BackgroundBu, C., Zhang, L., Cui, H., Cheng, D., Wu, H., & Song, A. (2024) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2024.3351260 · Cited by 16
“Chen et al. [14] present a survey paper about deep-learning-based HAR.”
BackgroundD’Arco, L., Wang, H., & Zheng, H. (2023) · Neural Computing and Applications · doi:10.1007/s00521-023-08363-w · Cited by 20
“Furthermore, when using small datasets and/or complex architecture, these systems are vulnerable to overfitting [18].”
BackgroundStresSense: Real-Time detection of stress-displaying behaviors
Khan, N. S., Qadir, S., Anjum, G., & Uddin, N. (2024) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2024.105401 · Cited by 20
Jagadesh, B. N., Venkataramana, A., Rashmi, V., Singasani, T. R., Pani, A. K., Challageri, M. B., & Saikumar, K. (2024) · Mathematical Modelling and Engineering Problems · doi:10.18280/mmep.110306 · Cited by 21
“Human activity recognition (HAR) in the home, achieved by establishing a network of sensors to detect human behavior, can enhance people's ability to maintain independence and quality of life [1].”
Wang, Y., Xu, Y., Yang, J., Wu, M., Li, X., Xie, L., & Chen, Z. (2024) · CRC Press eBooks · doi:10.1109/tpami.2024.3444904 · Cited by 23
“For C-MAPSS, the time length of each sample is fixed as 60, so we use patch sizes within [4,5,6,7,8,9,10] for patch size analysis.”
MethodZhou, Y., King, T., Zhao, H., Huang, Y., Riedel, T., & Beigl, M. (2024) · Proceedings of the 2024 ACM International Symposium on Wearable Computers · doi:10.1145/3675095.3676624 · Cited by 17
“Wearable human activity recognition (HAR) has gained increasing attention due to its effectiveness in health monitoring, fitness tracking, and human-computer interaction [8].”
BackgroundAI-driven Java Performance Testing: Balancing Result Quality with Testing Time
Traini, L., Menna, F. D., & Cortellessa, V. (2024) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1145/3691620.3695017 · Cited by 25
“We first introduce an overview of the main phases of our framework and then discuss the details of each phase.”
BackgroundReal-Time Littering Activity Monitoring Based on Image Classification Method
Husni, N. L., Sari, P. A. R., Handayani, A. S., et al. (2021) · Smart Cities · doi:10.3390/smartcities4040079 · Cited by 16
Sensor-based Activity Recognition using Deep Learning: A Comparative Study
Trabelsi, I., Françoise, J., & Bellik, Y. (2022) · International Conference on Movement and Computing (MOCO) · doi:10.1145/3537972.3537996 · Cited by 23
“[14] provide a recent review of sensor-based human”
BackgroundIf only we had more data!: Sensor-Based Human Activity Recognition in Challenging Scenarios
Plötz, T. (2023) · 2023 IEEE International Conference on Pervasive Computing and Communications Workshops and other Affiliated Events (PerCom Workshops) · doi:10.1109/percomworkshops56833.2023.10150267 · Cited by 16
“…and for scenarios that target few, specific activities [10], the vast majority of HAR systems are now based on some form of Deep Learning (DL) [11]–[13], which comes with the promise of ‘end-to-end’ learning, i.e., deriving effective HAR systems in a purely data-driven manner, thereby relying as…”
BackgroundXia, S., Chu, L., Pei, L., Yang, J., Yu, W., & Qiu, R. C. (2024) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2024.3381171 · Cited by 23
“1 INTRODUCTION T EMPORAL activity recognition with wearables is one of the essential technologies in intelligent sensing and mobile computing, which has been widely applied in many applications, such as smart home and healthcare services [1], [2], [3].”
BackgroundContextGPT: Infusing LLMs Knowledge into Neuro-Symbolic Activity Recognition Models
Arrotta, L., Bettini, C., Civitarese, G., & Fiori, M. (2024) · IEEE International Conference on Smart Computing · doi:10.1109/smartcomp61445.2024.00029 · Cited by 16
A Robotic Cognitive Control Framework for Collaborative Task Execution and Learning
Caccavale, R., & Finzi, A. (2021) · Topics in Cognitive Science · doi:10.1111/tops.12587 · Cited by 17
RFAR: A Real-Time Firefighter Activity Recognition System Using Wearable Accelerometer
Dao, T.-H., Tran, D.-N., Bui, V.-H., Nguyen, V. S., Hoa, D. K., Thanh, P. V., & Tran, D. (2025) · IEEE Sensors Journal · doi:10.1109/jsen.2025.3593466 · Cited by 16
“Nevertheless, recent studies have applied deep learning (DL) [30], [37], [45], [46] to improve recognition accuracy.”
Context-Aware Complex Human Activity Recognition Using Hybrid Deep Learning Models
Omolaja, A., Otebolaku, A., & Alfoudi, A. S. D. (2022) · Applied Sciences · doi:10.3390/app12189305 · Cited by 21
“Recently, the magnetometer has become common sensing equipment in mobile devices to detect orientation relative to the Earth’s magnetic north [2].”
BackgroundMethodResultInfluentialRobust Human Activity Recognition via Wearable Sensors Using Dynamic Gaussian Kernel Learning
Wang, S., Sun, Y., Sha, Y., Yang, G., Cheng, D., Zhang, L., Wu, H., & Song, A. (2024) · IEEE Sensors Journal · doi:10.1109/jsen.2024.3355704 · Cited by 17
“However, fixed kernel sizes may not be optimal for all applications and tasks [15].”
BackgroundInfluentialAdvanced human activity recognition on wearables with multi-scale sparse attention
Muniasamy, A., & Asiri, F. (2025) · Multimedia Tools and Applications · doi:10.1007/s11042-024-20475-6 · Cited by 14
Li, C., Minati, L., Tokgöz, K. K., Fukawa, M., Bartels, J., Sihan, A., Takeda, K.-I., & Ito, H. (2022) · IEEE Sensors Journal · doi:10.1109/jsen.2022.3219594 · Cited by 17
“Similar situations are encountered when considering wearable systems for livestock activity monitoring [10], human behavior classification [11], gesture recognition [12], as well as room occupancy and activity detection [13].”
BackgroundZhou, W., Zhou, H., Cui, X., Zhou, F., Tan, H., & Li, X.-Y. (2023) · ACM Trans. Sens. Networks · doi:10.1145/3582693 · Cited by 11
Zou, H., Chen, Z., Zhang, C., Yuan, A., Wang, B., Wang, L., Li, J., & Pan, Y. (2024) · IEEE Sensors Journal · doi:10.1109/jsen.2024.3373444 · Cited by 15
“In practice, WHAR systems commonly use inertial sensors for data collection, as they are low-cost, ubiquitous, and nonintrusive [5].”
BackgroundSoK: Behind the Accuracy of Complex Human Activity Recognition Using Deep Learning
Nguyen, D., & Le‐Khac, N. (2024) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn60899.2024.10650322 · Cited by 19
Advancing Activity Recognition With Multimodal Fusion and Transformer Techniques
Aidarova, S., Nurmakhan, T., Myrzakhan, R., Fazli, S., & Yazıcı, A. (2025) · IEEE Sensors Journal · doi:10.1109/jsen.2025.3555663 · Cited by 18
“In recent years, sensor-based HAR has gained significant attention due to its distinct advantages, including location independence, cost-effectiveness, and the ability to monitor natural human behavior in everyday life without invading their privacy [4], [5].”
Turetta, C., Demrozi, F., & Pravadelli, G. (2024) · IEEE Access · doi:10.1109/access.2024.3496497 · Cited by 27
“Details on the structure are reported in the following sections.”
Li, S., Zhu, T., Nie, M., Ning, H., Liu, Z., & Chen, L. (2024) · IEEE Internet of Things Journal · doi:10.1109/jiot.2024.3493380 · Cited by 26
“Traditional approaches, such as fixed-size sliding windows and dense labeling, have demonstrated strong performance [15].”
LLM4HAR: Generalizable On-device Human Activity Recognition with Pretrained LLMs
Hong, Z., Song, Y., Li, Z., Yu, A., Zhong, S., Ding, Y. C., He, T., & Zhang, D. (2025) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3711896.3737226 · Cited by 34
Self-citationChen, D., Yongchareon, S., Lai, E. M.-K., Sheng, Q. Z., & Liesaputra, V. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2021.3139330 · Cited by 13
Wang, L., Chen, Z., Zou, H., Huang, D., Pan, Y., Cheang, C. F., & Li, J. (2023) · Nondestructive Testing And Evaluation · doi:10.1080/10589759.2023.2274008 · Cited by 15
Tian, Y., Hettiarachchi, D., Yu, H. S., & Kamijo, S. (2024) · IEEE Sensors Journal · doi:10.1109/jsen.2024.3404777 · Cited by 15
“Moreover, the application region will be limited, which is not conducive to individual users [11], [12].”
BackgroundPięta, P., Jegierski, H., Babiuch, P., Jegierski, M., Płaza, M., Łukawski, G., Deniziak, S. R., Jasiński, A., Opałka, J., Wȩgrzyn, P., et al. (2024) · IEEE Access · doi:10.1109/access.2024.3424930 · Cited by 17
“The review article [54] provides an overview of the use of DL for sensor-based HAR.”
MethodZhang, J., Feng, L., Liu, Z., Wu, Y., He, Y., Dong, Y., & Xu, D. (2024) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3637528.3671828 · Cited by 18
Qin, L., Zhang, L., Li, C., Song, C., Cheng, D., Wang, S., Wu, H., & Song, A. (2024) · IEEE Transactions on Artificial Intelligence · doi:10.1109/tai.2024.3489532 · Cited by 12
“During the past decade, HAR using miniaturized and low-price sensors has shown significant commercial value in a wide range of application domains such as health monitoring, behavior analysis, elderly-care, gesture recognition, human-computer interaction, and ambient assisted living [2].”
Self-Supervised Few-Shot Time-series Segmentation for Activity Recognition
Xiao, C., Chen, S., Zhou, F., & Wu, J. (2022) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2022.3199015 · Cited by 15
“To conduct activity recognition, continuously received data should be segmented into subsequences, each of which is associated with a single activity [1], [2].”
MethodAutomated Student Classroom Behaviors’ Perception and Identification Using Motion Sensors
Hong-min, W., Gao, C., Fu, H. C., Ma, C. Z.-H., Wang, Q., He, Z., & Li, M. (2023) · Bioengineering · doi:10.3390/bioengineering10020127 · Cited by 17
“The mainstream approaches for human activity recognition can be roughly classified into vision-based and sensor-based based on different data sources [25].”
BackgroundSemiHAR: Improving Semisupervised Human Activity Recognition via Multitask Learning
Wei, C., Wang, Z., Yuan, J., Wang, X., Liu, H., & Zhao, Q. (2023) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2023.3330879 · Cited by 14
Unsupervised Human Activity Recognition Via Large Language Models and Iterative Evolution
Gao, J., Zhang, Y., Chen, Y., Zhang, T., Tang, B., & Wang, X. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10446819 · Cited by 28
“Collecting and annotating sensory activity data is expensive and time-intensive, which re-sults in significant annotation shortages [8].”
BackgroundInfluentialYu, J., Zhang, L., Cheng, D., Bu, C., Wu, H., & Song, A. (2024) · IEEE Sensors Journal · doi:10.1109/jsen.2024.3412736 · Cited by 15
“This surge in popularity is largely due to their robust representational abilities, which are facilitated by their capacity for automatic and multilevel feature extraction [1], [4].”
BackgroundReal-Time Continuous Activity Recognition With a Commercial mmWave Radar
Liu, Y., Zhang, J., Chen, Y., Wang, W., Yang, S., Na, X., Sun, Y., & He, Y. (2024) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2024.3483813 · Cited by 23
“A variety of technologies can provide the ability of activity recognition, including vision based [1], [2], [3], wearable based [4], [5], [6], wireless sensing based solutions [7], [8], [9], [10], [11], [12], and etc. Compared with vision based solutions, wireless sensing technology has the…”
Self-citationPatel, A. D., Jhaveri, R. H., Patel, A. D., Shah, K. A., & Shah, J. H. (2024) · Software Practice and Experience · doi:10.1002/spe.3394 · Cited by 14
Graph-Based Methods for Multimodal Indoor Activity Recognition: A Comprehensive Survey
Javadi, S., Riboni, D., Borzì, L., & Zolfaghari, S. (2025) · IEEE Transactions on Computational Social Systems · doi:10.1109/tcss.2024.3523240 · Cited by 16
“Given their effectiveness when large sets of training data are available, deep learning approaches to HAR have been extensively reviewed in [34] and [35].”
Zhang, Y., Gu, T., & Zhang, X. (2021) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2021.3062575 · Cited by 16
“…health conditions) and can be easily affected by local scenario changes ( i.e. , long-term behavior changes, stationary-to-movement changes or ambient environment condition changes) [7, 22, 35, 60], hence continual training or adaptation is crucial to maintain model generalization and robustness.”
BackgroundMulti-agent Transformer Networks for Multimodal Human Activity Recognition
Li, J., Yao, L., Li, B., Wang, X., & Sammut, C. (2022) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3511808.3557402 · Cited by 15
“Human activity recognition is a significant step towards humancomputer interaction and enables a series of promising applications such as assisted living, skills training, health monitoring, and robotics [11].”
BackgroundInfluentialSelf-citationZone-based Federated Learning for Mobile Sensing Data
Jiang, X., On, T., Phan, N., Mohammadi, H., Mayyuri, V. D., Chen, A., Jin, R., & Borcea, C. (2023) · IEEE International Conference on Pervasive Computing and Communications · doi:10.1109/percom56429.2023.10099308 · Cited by 15
“This performance gain is significant given that it is very challenging for DL models to achieve even 1% improvement in HAR and HRP tasks, as illustrated in recent studies [4, 17].”
MethodImprovement in Multi-resident Activity Recognition System in a Smart Home Using Activity Clustering
Ramanujam, E., Kalimuthu, S., Harshavardhan, B. V., & Perumal, T. (2023) · IFIP advances in information and communication technology · doi:10.1007/978-3-031-45878-1_22 · Cited by 12
Olugbade, T., Buono, R. A., Potapov, K., Bujorianu, A., Williams, A. C. D. C., García, S. D. O., Gold, N., Holloway, C., & Bianchi‐Berthouze, N. (2024) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2024.3390837 · Cited by 13
“Nevertheless, the dataset is a major step in addressing the critical need for movement data in the wild for chronic pain.”
InfluentialPredicting Activities of Daily Living for the Coming Time Period in Smart Homes
Wang, W., Li, J., Li, Y., & Dong, X. (2022) · IEEE Transactions on Human-Machine Systems · doi:10.1109/thms.2022.3176213 · Cited by 12
“With the collected sensor data, to get to understand ADLs of the residents, various activity recognition algorithms have been proposed [8], [9], [11].”
Liu, J., Zhang, L., Liu, X., Yao, M., Wang, L., Wu, H., & Song, A. (2025) · IEEE Sensors Journal · doi:10.1109/jsen.2025.3565646 · Cited by 13
“In fact, we apply 1D-CNNs to separately process each univariate time series of each sensor axis independently [4].”
Enhancing human activity recognition using features reduction in IoT edge and Azure cloud
Wazwaz, A. A., Amin, K., Semary, N. A., & Ghanem, T. F. (2023) · Decision Analytics Journal · doi:10.1016/j.dajour.2023.100282 · Cited by 12
Zhu, R. H., Liang, S., Song, Y., & Cai, Z. (2023) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3610876 · Cited by 20
Wang, J., Cui, W., Zhu, T., Ning, H., & Liu, Z. (2024) · IEEE Sensors Journal · doi:10.1109/jsen.2024.3390755 · Cited by 13
“Unfortunately, manually labeling sensor data proves to be an arduous and time-consuming task, presenting a formidable challenge that restricts the progress of HAR [17].”
BackgroundDeeptha, R., Ramkumar, K., Venkateswaran, S., Hassan, M. M., Hassan, M. R., Noori, F. M., & Uddin, M. Z. (2024) · Frontiers in Neuroinformatics · doi:10.3389/fninf.2024.1454583 · Cited by 16
Statistical Database of Human Motion Recognition Using Wearable IoT—A Review
Asl, E. F., Ebadollahi, S., Vahidnia, R., & Jalali, A. (2023) · IEEE Sensors Journal · doi:10.1109/jsen.2023.3282171 · Cited by 18
“machine learning algorithms have been identified along with their types; and in this field, papers can be found that only deep learning algorithms have been discussed [19], [50], but these algorithms are only a part of machine learning algorithms.”
BackgroundBSDGAN: Balancing Sensor Data Generative Adversarial Networks for Human Activity Recognition
Hu, Y. (2023) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn54540.2023.10191928 · Cited by 23
“The vast majority of sensor data in human activity datasets comes from mobile smartphones and wearables [6].”
BackgroundLeveraging Self-Supervised Learning for Human Activity Recognition with Ambient Sensors
Chen, H., Gouin-Vallerand, C., Bouchard, K., Gaboury, S., Couture, M., Bier, N., & Giroux, S. (2023) · International Conference on Information Technology for Social Good (GoodIT) · doi:10.1145/3582515.3609551 · Cited by 11
“Annotating activity data in real-world smart homes poses a signifcant challenge as it is time-consuming and tedious for researchers and experts [6].”
BackgroundA Tennis Training Action Analysis Model Based on Graph Convolutional Neural Network
Zhang, X., & Chen, J. (2023) · IEEE Access · doi:10.1109/access.2023.3324425 · Cited by 12
“Mean filtering [4], [13], [19] consists of establishing a template for a specific pixel point p ( x , y ) on an image, this template containing the adjacent points f ( x , y ) , and obtaining the average value of all pixels in the template, that is, all pixels in the template.”
BackgroundAnomaly Detection From Low-Dimensional Latent Manifolds With Home Environmental Sensors
Melgarejo-Meseguer, F.-M., Bleda, A. L., Abbenante, S. E., Gimeno-Blanes, F.-J., Everss, E., Muñoz-Romero, S., Rojo‐Álvarez, J. L., & Maestre, R. (2023) · IEEE Internet of Things Journal · doi:10.1109/jiot.2023.3338697 · Cited by 13
“Recent reviews on DL techniques for HAR with sensors suggest that efficient methods are emerging [9], [10].”
BackgroundZou, H., Chen, Z., Zhang, J., Wang, L., Zhang, F., Li, J., & Pan, Y. (2024) · IEEE Transactions on Emerging Topics in Computational Intelligence · doi:10.1109/tetci.2024.3378331 · Cited by 18
Human activity recognition from textile electrocardiograms
Klingenberg, A., Purrucker, V., Schüler, W., Ganapathy, N., Spicher, N., & Deserno, T. M. (2022) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc48229.2022.9871210 · Cited by 12
“A typical approach is representing the 1D signal in a 2D time-frequency domain and feed this ”picture” into a CNN [9].”
BackgroundLightweight human activity recognition method based on the MobileHARC model
Gong, X., Zhang, X., & Li, N. (2024) · Systems Science & Control Engineering · doi:10.1080/21642583.2024.2328549 · Cited by 13
HardenVR: Harassment Detection in Social Virtual Reality
Wang, N., Zhou, J., Li, J., Han, B., Li, F., & Chen, S. (2024) · IEEE Conference on Virtual Reality and 3D User Interfaces (VR) · doi:10.1109/vr58804.2024.00033 · Cited by 15
“However, there is disagreement concerning the minimum necessary depth of LSTM layers to reach state-of-the-art recognition performance [11,14].”
BackgroundAlbadawi, Y., & Shanableh, T. (2024) · IEEE Sensors Journal · doi:10.1109/jsen.2024.3422272 · Cited by 12
“Healthcare systems are another important application where HAR is needed to monitor the activity of daily living (ADL) for patients and the elderly [1], [2].”
BackgroundHuang, Y., Zhou, Y., Zhao, H., Riedel, T., & Beigl, M. (2024) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn60899.2024.10650060 · Cited by 20
“Chen et al. [79] note that identical activities can vary significantly.”
BackgroundGhorrati, Z., Esmaeili, A., & Matson, T. E. (2024) · IEEE Access · doi:10.1109/access.2024.3462515 · Cited by 12
“Other challenges include the complexity of data association, which involves the number of users and activities the data is associated with, including composite activities, data segmentation, and multi-occupant activities [13].”
BackgroundToward Improving Human Training by Combining Wearable Full-Body IoT Sensors and Machine Learning
Akter, N., Molnar, A., & Georgakopoulos, D. (2024) · Sensors · doi:10.3390/s24227351 · Cited by 14
Uhlenberg, L., Haeusler, L. O., & Amft, O. (2024) · IEEE Access · doi:10.1109/access.2024.3513477 · Cited by 16
“In addition, wearable sensors can be integrated into clothes [5] and accessories, e.g., smartwatches [6].”
Anguita-Molina, M. Á., Cardoso, P. J. S., Rodrigues, J. M. F., Medina-Quero, J., & Polo-Rodríguez, A. (2025) · IEEE Internet of Things Journal · doi:10.1109/jiot.2025.3531316 · Cited by 15
“Conventional approaches can struggle to distinguish between individuals and accurately track their activities, leading to potential errors and inaccuracies in behavior analysis [15].”
A Study on Diffusion Modelling For Sensor-based Human Activity Recognition
Shao, S., & Sánchez, V. (2023) · International Workshop on Biometrics and Forensics (IWBF) · doi:10.1109/iwbf57495.2023.10157482 · Cited by 20
“These include issues related to sensor accuracy and data quality [5].”
BackgroundYu, J., Zhang, L., Cheng, D., Huang, W., Wu, H., & Song, A. (2024) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2024.3457830 · Cited by 15
“During the past decade, deep neural networks have played a dominant role in the ubiquitous HAR computing area, due to their automatic feature representation power [3], [4].”
BackgroundMethodInfluentialGhazi, M. E., & Aknin, N. (2023) · International Journal of Advanced Computer Science and Applications · doi:10.14569/ijacsa.2023.0141032 · Cited by 9
Review of the Open Data Sets for Contactless Sensing
Liang, K., Chen, J., He, T., Wang, W. W., Singh, A. K., Rawat, D. B., Song, H., & Lv, Z. (2024) · IEEE Internet of Things Journal · doi:10.1109/jiot.2024.3351838 · Cited by 12
“4) Activity Recognition: Human activity recognition has been found very useful for facilitating our daily lives [31].”
BackgroundDu, T., Fang, X., & Yan, L. (2024) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2024.3511574 · Cited by 9
“Beyond this, ISAC technology plays a significant role in enhanced localization and tracking [11], area imaging [12], UAV monitoring and management [13], spatial-aware computing [14], environmental monitoring [15], and vehicle-to-everything (V2X) [16].”
Investigating (re)current state-of-the-art in human activity recognition datasets
Bock, M., Hoelzemann, A., Moeller, M., & Laerhoven, K. V. (2022) · Frontiers in Computer Science · doi:10.3389/fcomp.2022.924954 · Cited by 10
CNN-RNN Deep Learning Networks for Pattern Recognition Problems
Imran, I. I. (2023) · International Conference on Business Analytics for Technology and Security (ICBATS) · doi:10.1109/icbats57792.2023.10111363 · Cited by 8
“Reference [8] Cheng et al. developed an LDA method named Direct-LDA (D-LDA) to resolve the issue of small-size data in face recognition.”
MethodAhmad, N., & Leung, H.-F. (2024) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3643511 · Cited by 13
Optimum signal duration for Human Activity Recognition based on Deep Convolutional Neural Networks
Nazari, F., Shajari, A., Nahavandi, D., & Mohajer, N. (2024) · IEEE International Systems Conference (SysCon) · doi:10.1109/syscon61195.2024.10553567 · Cited by 9
HAR-CTGAN: A Mobile Sensor Data Generation Tool for Human Activity Recognition
DeOliveira, J., Gerych, W., Koshkarova, A., Rundensteiner, E. A., & Agu, E. (2022) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata55660.2022.10020848 · Cited by 10
“However, HAR models often require labels for each activity that is being performed at any given instance [21].”
BackgroundMulti-dimensional task recognition for human-robot teaming: literature review
Baskaran, P., & Adams, J. A. (2023) · Frontiers in Robotics and AI · doi:10.3389/frobt.2023.1123374 · Cited by 12
Recognition of Human Activities Based on Ambient Audio and Vibration Data
Koch, M., Pfitzinger, T., Schlenke, F., Kohlmorgen, F., Groll, R., & Wöhrle, H. (2024) · IEEE Access · doi:10.1109/access.2024.3457912 · Cited by 8
Intelligent recognition of human activities using deep learning techniques
Bashir, S., Jaffar, A., Rashid, M., Akram, S., & Bhatti, S. (2025) · PLoS ONE · doi:10.1371/journal.pone.0321754 · Cited by 7
“The integration of sensors into various items and portable devices has enabled continuous human motion data capture [11].”
Real-Time Human Activity Recognition in Smart Homes Using IoT Sensors and Deep Learning Models
Radhi, A. D., Altamimi, Z. I., Dihin, H. A. J. A., Husien, W. A., Abbas, O. A., Ahmed, M. R., Hamad, M. T., Al-Shimary, A. J., & Saleem, H. (2025) · International Conference on Business Analytics for Technology and Security (ICBATS) · doi:10.1109/icbats66542.2025.11258537 · Cited by 7
“…that consolidates diverse data streams, • Optimize deep learning architectures to reduce latency while maintaining high recognition accuracy, • Validate the proposed system through extensive real-world experiments, and • Benchmark its performance against current state-of-the-art methods [11].”
Liu, X., Cheng, D., Fu, Z., Zhang, L., Wu, H., & Song, A. (2026) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2026.3664424 · Cited by 16
“Recent advances in deep learning ,includingwearablesensor,video,andWIFIsignals[3].”
InfluentialWang, L., Zhang, L., Yu, J., Cheng, D., Yao, M., Wu, H., & Song, A. (2024) · IEEE Sensors Journal · doi:10.1109/jsen.2024.3510811 · Cited by 10
“Following previous HAR literatures [21], [36], [37], in our design, the small-kernel convolutions are directly performed along the temporal dimen-sion of sensor signals, so that local temporal dependencies may be captured.”
Wang, F. S., Kreiner, T., Lutz, A., Lohmeyer, Q., & Meboldt, M. (2023) · User Modeling and User-Adapted Interaction · doi:10.1007/s11257-022-09352-9 · Cited by 7
Multi-Branch CNN GRU with attention mechanism for human action recognition
Verma, U., Tyagi, P., & Aneja, M. K. (2023) · Engineering Research Express · doi:10.1088/2631-8695/acd98c · Cited by 8
Li, C., Tokgöz, K. K., OKUMURA, A., Bartels, J., Toda, K., MATSUSHIMA, H., Ohashi, T., TAKEDA, K.-I., & Ito, H. (2021) · IEICE Transactions on Fundamentals of Electronics Communications and Computer Sciences · doi:10.1587/transfun.2021smp0003 · Cited by 9
Sensor-based human activity recognition using fuzzified deep CNN architecture with λmax method
Gomathi, V., Kalaiselvi, S., & Thamarai Selvi, D. (2022) · Sensor Review · doi:10.1108/sr-06-2021-0195 · Cited by 9
Boosting the Performance of Lightweight HAR Models with Attention and Knowledge Distillation
Agac, S., & İncel, Ö. D. (2024) · International Conference on Intelligent Environments (IE) · doi:10.1109/ie61493.2024.10599908 · Cited by 9
“Sensor-based human activity recognition (HAR) employing deep learning methods has emerged as a robust approach, surpassing the performance of traditional machine learning methods in a wide range of applications, from healthcare to smart home automation [1].”
BackgroundTørring, M. F., Logacjov, A., Brændvik, S. M., Ustad, A., Roeleveld, K., & Bardal, E. M. (2024) · PLoS ONE · doi:10.1371/journal.pone.0308853 · Cited by 11
Metadata
- Authors
- Chen, K., Zhang, D., Yao, L., Guo, B., Yu, Z., & Liu, Y.
- Affiliations
- Aalborg University (DK)
- UNSW Sydney (AU)
- Northwestern Polytechnical University (CN)
- Michigan State University (US)
- Venue
- ACM Computing Surveys
- Published
- 2021-05-24
- Volume
- 54
- Issue
- 4
- Pages
- 1-40
- ISSN
- 0360-0300 (ISSN-L)
- 1557-7341
- OpenAlex
- W3164845984
- Cited by
- 690
- References
- 144
- Citations by year
- 2026: 83 · 2025: 137 · 2024: 172 · 2023: 149 · 2022: 101 · 2021: 45
- FWCI
- 41.94
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- ACM Computing Surveys (publishedVersion, public-domain)
- VBN Forskningsportal (Aalborg Universitet) (submittedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Context-Aware Activity Recognition Systems
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Human Pose and Action Recognition
- Physical Sciences › Engineering › Biomedical Engineering › Gait Recognition and Analysis
- Keywords
- human activity recognition, sensor-based activity recognition, deep learning, Internet of Things, sensor fusion, activity recognition dataset, wearable sensors
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.