Deep Learning for Sensor-based Human Activity Recognition
The DOI matches its Crossref record; 151 of the 151 references it cites were found in a registry or an index.
Abstract
The vast proliferation of sensor devices and Internet of Things enables the applications of sensor-based activity recognition. However, there exist substantial challenges that could influence the performance of the recognition system in practical scenarios. Recently, as deep learning has demonstrated its effectiveness in many areas, plenty of deep methods have been investigated to address the challenges in activity recognition. In this study, we present a survey of the state-of-the-art deep learning methods for sensor-based human activity recognition. We first introduce the multi-modality of the sensory data and provide information for public datasets that can be used for evaluation in different challenge tasks. We then propose a new taxonomy to structure the deep methods by challenges. Challenges and challenge-related deep methods are summarized and analyzed to form an overview of the current research progress. At the end of this work, we discuss the open issues and provide some insights for future directions.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“This renders activity labeling difficult, reducing the number of available labels [8,23,30].”
From Spatial-Temporal Masked Autoencoder for Multi-Device Wearable Human Activity Recognition (2023) · cites this paper as [8]
Citations
Cites
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380
Fully convolutional networks for semantic segmentation
Long, J., Shelhamer, E., & Darrell, T. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298965 · Cited by 38,834
Pan, S. J., & Yang, Q. (2010) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2009.191 · Cited by 23,387 · cited 1×
“Before taking a closer look at the factors that cause distribution discrepancy in sensory data, we briefly introduce transfer learning [102].”
BackgroundGreff, K., Srivastava, R. K., Koutnik, J., Steunebrink, B. R., & Schmidhuber, J. (2017) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2016.2582924 · Cited by 6,955 · cited 19×
“A multi-label RNN was created with each RNN cell responding to activity recognition of one occupant.”
BackgroundMethodInfluentialProceedings of the 19th International Joint Conference on Artificial Intelligence
Pujol, J. M., Delgado, J., Ramon Sangüesa, A., & Flache, A. (2005) · International Joint Conference on Artificial Intelligence · Cited by 5,771
Combining labeled and unlabeled data with co-training
Blum, A., & Mitchell, T. (1998) · Proceedings of the eleventh annual conference on Computational learning theory · doi:10.1145/279943.279962 · Cited by 5,495
Recurrent neural network based language model
Mikolov, T., Karafiát, M., Burget, L., Černocký, J., & Khudanpur, S. (2010) · Interspeech 2010 · doi:10.21437/interspeech.2010-343 · Cited by 5,390
Activity recognition using cell phone accelerometers
Kwapisz, J. R., Weiss, G. M., & Moore, S. A. (2011) · ACM SIGKDD Explorations Newsletter · doi:10.1145/1964897.1964918 · Cited by 2,912
Deep Convolutional and LSTM Recurrent Neural Networks for Multimodal Wearable Activity Recognition
Ordóñez, F., & Roggen, D. (2016) · Sensors · doi:10.3390/s16010115 · Cited by 2,761 · cited 1×
“eep hybrid model to explore different views of temporal dynamics is another attractive trend in the human activity recognition community. In light of the advantages of CNN and RNN, Ordóñez and Roggen [106] proposed to combine CNNs and LSTMs for both local and global temporal feature extraction. Xu et al. [162] adopted…”
A Survey on Human Activity Recognition using Wearable Sensors
Lara, O. D., & Labrador, M. A. (2013) · IEEE Communications Surveys & Tutorials · doi:10.1109/surv.2012.110112.00192 · Cited by 2,662 · cited 1×
“data facilitates recognition and which part deteriorates that. 1.2 Deep Learning in Human Activity Recognition. Numerous previous works adopted machine learning methods in human activity recognition [79]. They highly rely on feature extraction techniques including time-frequency transformation [62], statistical approa…”
MethodInfluential
Research works printed but not linked: 37
- Alsheikh Mohammad Abu, 2016, Proceedings of the Workshops at the 30th AAAI Conference on Artificial Intelligence.
- Bengio Yoshua, 2012, Proceedings of ICML Workshop on Unsupervised and Transfer Learning. 17–36
- Brophy Eoin, 2018, Zhengwei Wang, Alan F. Smeaton, and Tomas E. Ward.
- 10.5555/3367032.3367223 · doi:10.5555/3367032.3367223
- Chen Ling, 2020, METIER: A deep multi-task learning based activity and user recognition model using wearable sensors. Proc. ACM Interact., Mob, Wear. Ubiq. Technol., 4, 1
- Dong Mingtao, 2018, Proceedings of the International Conference on Signal and Information Processing, Networking and Computers. Springer, 32–40
- Goodfellow Ian, 2014, Proceedings of the International Conference on Advances in Neural Information Processing Systems. 2672–2680
- Hammerla Nils Yannick, 2015, Proceedings of the 29th AAAI Conference on Artificial Intelligence.
- Hammerla Nils Y., 2016, Proceedings of the 25th International Joint Conference on Artificial Intelligence. 1533–1540
- Karpathy Andrej, 2016, Proceedings of the 4th International Conference on Learning Representations Workshop.
- Al Hafiz Khan Md Abdullah, 2018, Proceedings of the International Conference on Pervasive Computing and Communications. IEEE, 1–9.
- 10.5555/3164150.3164213 · doi:10.5555/3164150.3164213
- Krizhevsky Alex, Proceedings of the International Conference on Advances in Neural Information Processing Systems. 1097–1105
- Nicholas, Proceedings of the 16th International Workshop on Mobile Computing Systems and Applications. ACM, 117–122
- Lee Song-Mi, 2017, Proceedings of the IEEE International Conference on Big Data and Smart Computing (BigComp’17)
- Li Fei, 2011, Proceedings of the Workshops at the 25th AAAI Conference on Artificial Intelligence.
- Li Xinyu, Proceedings of the 8th Wireless of the Students, by the Students, and for the Students Workshop (S3@MobiCom’16)
- Li Xinyu, Proceedings of the 14th ACM Conference on Embedded Network Sensor Systems CD-ROM. ACM, 164–175
- Li Xinyu, 2017, Burd
- Ordóñez Morales Francisco Javier, 2016, Proceedings of the ACM International Symposium on Wearable Computers. ACM, 92–99
- Vishvak, Proceedings of the ACM International Symposium on Wearable Computers. ACM, 100–103
- Phan NhatHai, 2016, Proceedings of the 30th AAAI Conference on Artificial Intelligence.
- Pouyanfar Samira, 2018, A survey on deep learning: Algorithms, techniques, and applications, Comput. Surv., 51, 92
- Press Ofir, 2017, Language generation with recurrent generative adversarial networks without pre-training. arXiv preprint arXiv:1706.01399 · arXiv
- Qian Hangwei, 2018, Proceedings of the AAAI Conference on Artificial Intelligence.
- Saeedi Ramyar, Proceedings of the IEEE International Conference on Big Data. IEEE, 473–479
- Serrano Sofia, Proceedings of the 57th Conference of the Association for Computational Linguistics (ACL’19)
- van Kasteren Tim L. M., 2011, Kröse
- Xue Li, 2018, Understanding and improving deep neural network for activity recognition. arXiv preprint arXiv:1805.07020 · arXiv
- 10.5555/2832747.2832806 · doi:10.5555/2832747.2832806
- Zebin Tahmina, Proceedings of the IEEE Conference on Sensors (SENSORS’16)
- Zhang Dalin, 2018, Proceedings of the AAAI Conference on Artificial Intelligence, 32
- Zhang Mi, Proceedings of the ACM Conference on Ubiquitous Computing. ACM, 1036–1043
- 10.5555/3304889.3305093 · doi:10.5555/3304889.3305093
- Zhang Yanyi, Proceedings of the 16th ACM/IEEE International Conference on Information Processing in Sensor Networks (IPSN’17)
- Zhang Yong, 2018, Human activity recognition based on time series analysis using U-Net. arXiv preprint arXiv:1809.08113 · arXiv
- Zheng Yi, Proceedings of the International Conference on Web-age Information Management. Springer, 298–310
Cited by
Integrated Sensing and Communications: Toward Dual-Functional Wireless Networks for 6G and Beyond
Liu, F., Cui, Y., Masouros, C., Xu, J., Han, T. X., Eldar, Y. C., & Buzzi, S. (2022) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2022.3156632 · Cited by 3,857
“, indoor human activity recognition [58] (∼1 cm), autonomous robots and manufacturing [59] (∼5 mm).”
BackgroundQiu, S., Zhao, H., Jiang, N., Wang, Z., Liu, L., An, Y., Zhao, H., Miao, X., Liu, R., & Fortino, G. (2022) · Information Fusion · doi:10.1016/j.inffus.2021.11.006 · Cited by 671
Remote patient monitoring using artificial intelligence: Current state, applications, and challenges
Shaik, T., Tao, X., Higgins, N., Li, L., Gururajan, R., Zhou, X., & Acharya, U. R. (2023) · WIREs Data Mining and Knowledge Discovery · doi:10.1002/widm.1485 · Cited by 515
“Feature extraction is one of the key steps RPM systems perform in analyzing human vital signs and activity recognition (K. Chen, Zhang, et al., 2021).”
BackgroundMethodInfluentialHuman activity recognition in artificial intelligence framework: a narrative review
Gupta, N., Gupta, S. K., Pathak, R. K., Jain, V., Rashidi, P., & Suri, J. S. (2022) · Artificial Intelligence Review · doi:10.1007/s10462-021-10116-x · Cited by 337
“According to our observations (Chen et al. 2020; Suthar and Gadhia 2021; Ding et al. 2019), the growth of HAR is directly proportional to the advancement of AI which thrives the scope of HAR in various application domains.”
BackgroundDeep Learning for Time Series Classification and Extrinsic Regression: A Current Survey
Mohammadi Foumani, N., Miller, L., Tan, C. W., Webb, G. I., Forestier, G., & Salehi, M. (2024) · ACM Computing Surveys · doi:10.1145/3649448 · Cited by 268
“Chen et al. [5] discuss challenges in HAR and the appropriate deep learning methods for addressing each challenge.”
BackgroundMethodInfluentialIslam, M. M., Nooruddin, S., Karray, F., & Muhammad, G. (2022) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2022.106060 · Cited by 217
“A few of these tasks may be carried out by a particular individual like running, jumping, walking, and sitting through changes in the entire body [1], [2].”
BackgroundDeep learning based human activity recognition (HAR) using wearable sensor data
Gupta, S. (2021) · International Journal of Information Management Data Insights · doi:10.1016/j.jjimei.2021.100046 · Cited by 197
Attention induced multi-head convolutional neural network for human activity recognition
Khan, Z. N., & Ahmad, J. (2021) · Applied Soft Computing · doi:10.1016/j.asoc.2021.107671 · Cited by 187
Internet of Things (IoT) Based Activity Recognition Strategies in Smart Homes: A Review
Babangida, L., Perumal, T., Mustapha, N., & Yaakob, R. (2022) · IEEE Sensors Journal · doi:10.1109/jsen.2022.3161797 · Cited by 148
ANN-based automated scaffold builder activity recognition through wearable EMG and IMU sensors
Bangaru, S. S., Wang, C., Busam, S. A., & Aghazadeh, F. (2021) · Automation in Construction · doi:10.1016/j.autcon.2021.103653 · Cited by 114
Machine Learning Methods in Smart Lighting Toward Achieving User Comfort: A Survey
Putrada, A. G., Abdurohman, M., Perdana, D., & Nuha, H. H. (2022) · IEEE Access · doi:10.1109/access.2022.3169765 · Cited by 101
“Chen et al. [418] reveals that deep models can learn descriptive features from complex sensor data.”
BackgroundKoşar, E., & Barshan, B. (2023) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2023.106529 · Cited by 118
Italiano, L., Tedeschini, B. C., Brambilla, M., Huang, H., Nicoli, M., & Wymeersch, H. (2024) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2024.3449031 · Cited by 151
“𝑖, reply = 𝑡 2 − 𝑡 1 and included in the 𝑖 𝑖 𝑖 ′ ′ ′ ( Δ 𝜙 𝑖 , Δ 𝜒 𝑖 , Δ 𝜓 ) the orientation of the array, where Δ 𝜙 𝑖 , Δ 𝜒 𝑖 Δ 𝜓 𝑖 Δ 𝑖 = 0), the AOA measurement ∠ ( 𝒖 ′ − 𝒔 ′ ) extracted by the antenna array is rotated through a rotation matrix 𝑹 𝑥𝑧 ′ ′ 𝑖 𝑖 where 𝑛 𝑖”
ProtoHAR: Prototype Guided Personalized Federated Learning for Human Activity Recognition
Cheng, D., Zhang, L., Bu, C., Wang, X., Wu, H., & Song, A. (2023) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2023.3275438 · Cited by 92
“1, the backbone classification network consists of three convolutional layers, two max-pooling layers, two fully connected layers, and one softmax layer, which has been widely utilized in HAR area due to its powerful ability in extracting features automatically from raw sensor data [2], [14].”
BackgroundMethodInfluentialLatent Independent Excitation for Generalizable Sensor-based Cross-Person Activity Recognition
Qian, H., Pan, S. J., & Miao, C. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i13.17416 · Cited by 85
“…has become one of the most crucial techniques in a wide range of real-world applications, such as healthcare, gait analysis, assisted living, security and smart homes (Chen et al. 2020; Wang et al. 2019; Janidarmian et al. 2017; Bulling, Blanke, and Schiele 2014; Lara and Labrador 2013).”
BackgroundA survey on unsupervised learning for wearable sensor-based activity recognition
Ige, A. O., & Noor, M. H. M. (2022) · Applied Soft Computing · doi:10.1016/j.asoc.2022.109363 · Cited by 98
Yin, Y., Xie, L., Jiang, Z., Xiao, F., Cao, J., & Lu, S. (2024) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2024.3357591 · Cited by 108
“In addition, the existing reviews mainly focused on recognition approaches [24], [31], [32], while paying little attention to computation and resource overhead, which can be an important consideration in designing HAR approaches for mobile devices.”
Improving Deep Learning for HAR with Shallow LSTMs
Bock, M., Hölzemann, A., Moeller, M., & Van Laerhoven, K. (2021) · 2021 International Symposium on Wearable Computers · doi:10.1145/3460421.3480419 · Cited by 74
“[3], based on the findings of Karpathy et al.”
BackgroundMethodMiao, F., Huang, Y., Lu, Z., Ohtsuki, T. O., Gui, G., & Sari, H. (2024) · ACM Computing Surveys · doi:10.1145/3705893 · Cited by 112
Deep transfer learning in sheep activity recognition using accelerometer data
Kleanthous, N., Hussain, A. J., Khan, W., Sneddon, J. C., & Liatsis, P. (2022) · Expert Systems with Applications · doi:10.1016/j.eswa.2022.117925 · Cited by 76
Deformable Convolutional Networks for Multimodal Human Activity Recognition Using Wearable Sensors
Xu, S., Zhang, L., Huang, W., Wu, H., & Song, A. (2022) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2022.3158427 · Cited by 90
Xiao, L., Cao, Y., Gai, Y., Khezri, E., Liu, J., & Yang, M. (2023) · Journal of Cloud Computing Advances Systems and Applications · doi:10.1186/s13677-023-00552-1 · Cited by 73
“Various methodologies, including the examination of cinematic portrayals of actual events, have been suggested as a means of utilizing video surveillance for the purpose of monitoring sport events up to this point [4, 5].”
BackgroundA Survey of Privacy Vulnerabilities of Mobile Device Sensors
Delgado-Santos, P., Stragapede, G., Tolosana, R., Guest, R., Deravi, F., & Vera-Rodríguez, R. (2022) · ACM Computing Surveys · doi:10.1145/3510579 · Cited by 93
“It has been shown that a broad variety of users’ behavior or activities can be inferred from mobile device sensor data [52].”
BackgroundHong, Z., Li, Z., Zhong, S., Lyu, W., Wang, H., Ding, Y., He, T., & Zhang, D. (2024) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3659597 · Cited by 67
“Training with data from the source dataset ( 𝐷 ) and fine-tuning with a subset data from the target dataset ( 𝐷 ) [8, 57, 59].”
BackgroundMethodInfluentialSelf-citationDual-Branch Interactive Networks on Multichannel Time Series for Human Activity Recognition
Tang, Y., Zhang, L., Wu, H., He, J., & Song, A. (2022) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2022.3193148 · Cited by 64
“Human Activity Recognition (HAR) are typically performed by using video-based sport cameras [2], WiFi-based transmitters and receivers [3], as well as inertial measurement units (IMUs) [4]–[6].”
BackgroundMethodCSI-Based Location-Independent Human Activity Recognition Using Feature Fusion
Zhang, Y., Liu, Q., Wang, Y., & Yu, G. (2022) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2022.3216419 · Cited by 60
“The techniques of HAR include sensor-based [8], [9], [10] and video or image-based [11], [12], [13], [14].”
MethodEfficient human activity recognition on edge devices using DeepConv LSTM architectures
Zhou, H., Zhang, X., Feng, Y., Zhang, T., & Xiong, L. (2025) · Scientific Reports · doi:10.1038/s41598-025-98571-2 · Cited by 75
Cheng, D., Zhang, L., Bu, C., Wu, H., & Song, A. (2023) · Knowledge-Based Systems · doi:10.1016/j.knosys.2023.110789 · Cited by 55
Stoeve, M., Schuldhaus, D., Gamp, A., Zwick, C., & Eskofier, B. M. (2021) · Sensors · doi:10.3390/s21093071 · Cited by 63
“However, further work is needed to enable incremental online learning [61].”
BackgroundSAMoSA: Sensing Activities with Motion and Subsampled Audio
Mollyn, V., Ahuja, K., Verma, D., Harrison, C., & Goel, M. (2022) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3550284 · Cited by 82
“Please refer to [12, 20, 54, 57] for a detailed survey.”
BackgroundRemote Health Monitoring Systems for Elderly People: A Survey
Ahmed, S., Irfan, S., Kiran, N., Masood, N., Anjum, N., & Ramzan, N. (2023) · Sensors · doi:10.3390/s23167095 · Cited by 52
Muralidharan, K., Ramesh, A., Rithvik, G., Prem, S., Reghunaath, A. A., & Gopinath, M. P. (2021) · International Journal of Cognitive Computing in Engineering · doi:10.1016/j.ijcce.2021.09.001 · Cited by 68
Zhang, L., Yu, J., Gao, Z., & Ni, Q. (2024) · Alexandria Engineering Journal · doi:10.1016/j.aej.2024.01.030 · Cited by 61
Domain Generalization for Activity Recognition via Adaptive Feature Fusion
Qin, X., Wang, J., Chen, Y., Lu, W., & Jiang, X. (2023) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3552434 · Cited by 55
“Over these years, many eforts have been done to achieve accurate and robust activity recognition including traditional machine learning methods[28] combined with feature extraction, and deep learning methods [8, 53].”
BackgroundLi, Y., Wang, X.-Y., & An, L. (2022) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3580795 · Cited by 99
“Human activity recognition (HAR) can be widely used in several applications such as health monitoring, fall monitoring, smart home, augmented reality, and other scenarios[13][46][6].”
BackgroundAttention-Based Residual BiLSTM Networks for Human Activity Recognition
Zhang, J., Liu, Y., & Yuan, H. (2023) · IEEE Access · doi:10.1109/access.2023.3310269 · Cited by 54
“recognition, has become prevalent [6], [7].”
Self-citationIF-ConvTransformer: A Framework for Human Activity Recognition Using IMU Fusion and ConvTransformer
Zhang, Y., Wang, L., Chen, H., Tian, A., Zhou, S., & Guo, Y. (2022) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3534584 · Cited by 84
“An HAR system utilizes the recorded signals of internal sensors in smartphones and wearable devices to recognize human physical activities automatically [7].”
BackgroundHuman activity recognition: A comprehensive review
Kaur, H., Rani, V., & Kumar, M. (2024) · Expert Systems · doi:10.1111/exsy.13680 · Cited by 66
Recent Advances in Pedestrian Navigation Activity Recognition: A Review
Wang, Q., Luo, H., Wang, Q., Sun, L., Ma, Z., Zhang, C., Fu, M., & Zhao, F. (2022) · IEEE Sensors Journal · doi:10.1109/jsen.2022.3153610 · Cited by 50
Fine-grained activity classification in assembly based on multi-visual modalities
Chen, H., Zendehdel, N., Leu, M. C., & Yin, Z. (2024) · Journal of Intelligent Manufacturing · doi:10.1007/s10845-023-02152-x · Cited by 47
“The goal of activity recognition is to understand the nature of the work environment, which allows for a better understanding of how people perform their jobs and what they are operating at any given time (Ahn et al., 2023; Chen et al., 2021; Rude et al., 2018; Xiao et al., 2022).”
Multimodal vision-based human action recognition using deep learning: a review
Shafizadegan, F., Naghsh‐Nilchi, A. R., & Shabaninia, E. (2024) · Artificial Intelligence Review · doi:10.1007/s10462-024-10730-5 · Cited by 65
Sanabria, A. R., Zambonelli, F., Dobson, S., & Ye, J. (2021) · Pervasive and Mobile Computing · doi:10.1016/j.pmcj.2021.101477 · Cited by 43
“A large number of machine learning techniques have been proposed to improve the accuracy of activity recognition [5, 11, 33, 49].”
BackgroundXie, L., Wang, P., Song, S., & Letaief, K. B. (2022) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2022.3182889 · Cited by 43
Li, S., Zhu, T., Duan, F., Chen, L., Ning, H., Nugent, C., & Wan, Y. (2024) · IEEE Internet of Things Journal · doi:10.1109/jiot.2024.3463405 · Cited by 63
“Traditional approaches, such as fixed-size sliding windows and dense labeling, have demonstrated strong performance [24].”
BackgroundApplication of human activity/action recognition: a review
sedaghati, N., Ardebili, S., & Ghaffari, A. (2025) · Multimedia Tools and Applications · doi:10.1007/s11042-024-20576-2 · Cited by 64
Anwer, S., Li, H., Antwi‐Afari, M. F., Mirza, A. M., Abdul-Rahman, M., Mehmood, I., Guo, R., & Wong, A. Y. L. (2023) · Journal of Construction Engineering and Management · doi:10.1061/jcemd4.coeng-13263 · Cited by 48
Xiao, J., Li, H., Wu, M., Jin, H., Deen, M. J., & Cao, J. (2022) · ACM Computing Surveys · doi:10.1145/3530682 · Cited by 54
“To promote these applications, researchers have explored many sensing techniques [10, 35, 53] to obtain spatiotemporal and motion-related information of human behaviors.”
BackgroundHalgamuge, M. N. (2024) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2024.3365076 · Cited by 58
“Deep learning has been extensively explored across various application areas, including human activity recognition [97], medical diagnosis [98], IoT [99], anomaly detection [100], predictive modeling [101], error correction [102], and text classification [103].”
BackgroundDeXAR: Deep Explainable Sensor-Based Activity Recognition in Smart-Home Environments
Arrotta, L., Civitarese, G., & Bettini, C. (2022) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3517224 · Cited by 68
Adversarial Multi-view Networks for Activity Recognition
Bai, L., Yao, L., Wang, X., Kanhere, S. S., Guo, B., & Yu, Z. (2020) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3397323 · Cited by 40
Self-citationDastbaravardeh, E., Askarpour, S., Anari, M. S., & Rezaee, K. (2024) · International Journal of Intelligent Systems · doi:10.1155/2024/1052344 · Cited by 50
Convolutional Neural Network With Multihead Attention for Human Activity Recognition
Tan, T.-H., Chang, Y.-L., Wu, J.-R., Chen, Y.-F., & Alkhaleefah, M. (2023) · IEEE Internet of Things Journal · doi:10.1109/jiot.2023.3294421 · Cited by 41
TinyML Empowered Transfer Learning on the Edge
Hayajneh, A. M., Hafeez, M., Zaidi, S. A. R., & McLernon, D. (2024) · IEEE Open Journal of the Communications Society · doi:10.1109/ojcoms.2024.3373177 · Cited by 55
Large scale foundation models for intelligent manufacturing applications: a survey
Zhang, H., Semujju, S. D., Wang, Z., Lv, X., Xu, K., Wu, L., Jia, Y., Wu, J., Liang, W., Zhuang, R., et al. (2025) · Journal of Intelligent Manufacturing · doi:10.1007/s10845-024-02536-7 · Cited by 82
“…manufacturing. ln the last decade, deep learning methods was the mainstream data-driven approaches used in various areas of intelligent manufacturing, such as health management (PHM) [104]–[124], quality control [125]–[141], robotic [142]–[148], and human activity recognition [65], [149]–[164].”
InfluentialYu, J.-T., Tseng, Y.-H., & Tseng, P. (2024) · IEEE Sensors Journal · doi:10.1109/jsen.2024.3355395 · Cited by 38
Lauer-Schmaltz, M. W., Cash, P. J., Hansen, J. P., & Das, N. (2024) · IEEE Access · doi:10.1109/access.2024.3508029 · Cited by 51
Assessing Human Motion During Exercise Using Machine Learning: A Literature Review
Frangoudes, F., Matsangidou, M., Schiza, E. C., Neokleous, K., & Pattichis, C. S. (2022) · IEEE Access · doi:10.1109/access.2022.3198935 · Cited by 57
Contrastive Accelerometer–Gyroscope Embedding Model for Human Activity Recognition
Koo, I., Park, Y., Jeong, M., & Kim, C. (2022) · IEEE Sensors Journal · doi:10.1109/jsen.2022.3222825 · Cited by 39
“…to on-body sensors, object-placed sensors such as radio-frequency identifier (RFID) tags and ambient sensors (e.g., radar, Bluetooth, WiFi, acoustic sensor, and temperature sensor) are often utilized for HAR to detect user interaction with specific objects and the surrounding environments [13], [14].”
MethodCiliberto, M., Fortes Rey, V., Calatroni, A., Lukowicz, P., & Roggen, D. (2021) · Frontiers in Computer Science · doi:10.3389/fcomp.2021.792065 · Cited by 35
“…which can be used to provide industrial assistance Stiefmeier et al. (2008), to support independent living or assist in sports and healthcare Avci et al. (2010); Patel et al. (2012); Feuz et al. (2015); Lee and Esko fi er (2018) — see Demrozi et al. (2020) and Chen et al. (2021) for recent reviews.”
BackgroundData Augmentation for Human Activity Recognition With Generative Adversarial Networks
Lupión, M., Cruciani, F., Cleland, I., Nugent, C., & Ortigosa, P. M. (2024) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2024.3364910 · Cited by 40
“ML and DL models require a large amount of data to generalize to unseen data [7], especially when involving new users [8].”
BackgroundA Multitask Deep Learning Approach for Sensor-Based Human Activity Recognition and Segmentation
Duan, F., Zhu, T., Wang, J., Chen, L., Ning, H., & Wan, Y. (2023) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2023.3273673 · Cited by 51
“The window length determines the length of each data segment, which directly affects the quality of the feature extractions and the accuracy of the classifications performed by the model [24].”
MethodCheng, D., Zhang, L., Qin, L., Wang, S., Wu, H., & Song, A. (2024) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2024.3373019 · Cited by 31
“Toassignaccuratelabels,humananno-tatorshavetorelyonpriorexperienceknowledgetodetermine thestartingandterminatinglocationsinintricatetime-series sensordataforanactivity[2].”
BackgroundMethodInfluentialApplication of Wearable Sensors in Parkinson’s Disease: State of the Art
Bougea, A. M. (2025) · Journal of Sensor and Actuator Networks · doi:10.3390/jsan14020023 · Cited by 39
Wang, X., Zhang, L., Huang, W., Wang, S., Wu, H., He, J., & Song, A. (2021) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2021.3132088 · Cited by 42
“Actually, the window size has an important effect on activity recognition performance[50].”
BackgroundKwon, H., Abowd, G. D., & Plötz, T. (2021) · Sensors · doi:10.3390/s21248337 · Cited by 30
“Recently, end-to-end learning approaches have been introduced for supervised feature learning in HAR [22,25].”
BackgroundMethodMuangprathub, J., Sriwichian, A., Wanichsombat, A., Kajornkasirat, S., Nillaor, P., & Boonjing, V. (2021) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph182312652 · Cited by 34
Chen, W., Yu, C., Wang, H., Wang, Z., Yang, L., Wang, Y., Shi, W., & Shi, Y. (2023) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/3586183.3606741 · Cited by 44
“There has already been extensive research on these types of problems [9, 22, 31, 35].”
BackgroundCross-Attention Enhanced Pyramid Multi-Scale Networks for Sensor-Based Human Activity Recognition
Pang, H., Li, Z., & Fang, H. (2024) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2024.3377353 · Cited by 34
“Deep convolutional neural networks have emerged as a powerful alternative, demonstrating superior performance across a wide range of HAR applications [20], [21], [22].”
BackgroundMobility Data Science: Perspectives and Challenges
Mokbel, M. F., Sakr, M. A., Xiong, L., Züfle, A. E., Almeida, J. M., Anderson, T. M., Aref, W. G., Andrienko, G., Andrienko, N. V., Cao, Y., et al. (2024) · ACM Transactions on Spatial Algorithms and Systems · doi:10.1145/3652158 · Cited by 67
“Should we have one, that operator could seamlessly integrate with the query executor and optimize a data management engine to efficiently support a pretty important query in most data mobility applications.”
BackgroundDeeply Trained Real-Time Body Sensor Networks for Analyzing the Symptoms of Parkinson’s Disease
Rajasoundaran, S., Prabu, A. V., Routray, S., Malla, P. P., Ray, A. K., Palai, G., Faragallah, O. S., Baz, M., Abualnaja, M. M., Eid, M. M. A., et al. (2022) · IEEE Access · doi:10.1109/access.2022.3181985 · Cited by 28
“Compared to other DL techniques, CNN takes minimal training time and processing time [15]–[18].”
MethodLarge Language Models are Zero-Shot Recognizers for Activities of Daily Living
Civitarese, G., Fiori, M., Choudhary, P., & Bettini, C. (2024) · arXiv · doi:10.48550/arxiv.2407.01238 · Cited by 28
Feng, H., Shen, Q., Song, R., Shi, L., & Xu, H. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.121296 · Cited by 32
Modeling transformer architecture with attention layer for human activity recognition
Pareek, G., Nigam, S., & Singh, R. K. (2024) · Neural Computing and Applications · doi:10.1007/s00521-023-09362-7 · Cited by 28
Human Activity Recognition Based on Deep Learning and Micro-Doppler Radar Data
Tan, T.-H., Tian, J., Sharma, A. K., Liu, S.-H., & Huang, Y. (2024) · Sensors · doi:10.3390/s24082530 · Cited by 41
“HAR poses a significant challenge in classification tasks, especially when similar actions yield comparable features, such as running and walking, in sensor-based tasks [22,23].”
BackgroundYao, M., Zhang, L., Cheng, D., Qin, L., Liu, X., Fu, Z., Wu, H., & Song, A. (2024) · IEEE Sensors Journal · doi:10.1109/jsen.2024.3371462 · Cited by 31
“Following previous works in Zeng et al. [39], Yang et al. [41], and Chen et al. [42], we comprehensively demonstrate the effectiveness of the ELK block by stacking three convolutional layers or residual blocks as our backbone networks.”
MethodBu, C., Zhang, L., Cui, H., Yang, G., & Wu, H. (2023) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2023.3315773 · Cited by 25
“It is well known that sensor data is often noisy due to sensor malfunction, noisy surrounding, etc. [2], [26].”
BackgroundMethodInfluentialAutoAugHAR: Automated Data Augmentation for Sensor-based Human Activity Recognition
Zhou, Y., Zhao, H., Huang, Y., Röddiger, T., Kurnaz, M., Riedel, T., & Beigl, M. (2024) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3659589 · Cited by 25
A benchmark for computational analysis of animal behavior, using animal-borne tags
Hoffman, B., Cusimano, M., Baglione, V., Canestrari, D., Chevallier, D., DeSantis, D. L., Jeantet, L., Ladds, M., Maekawa, T., Mata‐Silva, V., et al. (2024) · Movement Ecology · doi:10.1186/s40462-024-00511-8 · Cited by 37
Integrated photonic convolution acceleration core for wearable devices
Zhao, B., Cheng, J., Wu, B., Gao, D., Zhou, H., & Dong, J. (2023) · Opto-Electronic Science · doi:10.29026/oes.2023.230017 · Cited by 26
Human Activity Recognition Using Deep Residual Convolutional Network Based on Wearable Sensors
Yu, X., & Al‐qaness, M. A. A. (2024) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2024.3510860 · Cited by 30
“As a result, in recent years, HAR has gradually incorporated deep learning (DL) techniques [15].”
Zhang, H., Chen, L., Zhang, Y., Hu, R., He, C., Tan, Y., & Zhang, J. (2022) · Journal of Sensors · doi:10.1155/2022/8507706 · Cited by 32
Han, C., Zhang, L., Tang, Y., Xu, S., Min, F., Wu, H., & Song, A. (2022) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2022.3191653 · Cited by 26
Semi-Passive Intelligent Reflecting Surface-Enabled Sensing Systems
Peng, Q., Wu, Q., Chen, W., Ma, S., Zhao, M., & Dobre, O. A. (2024) · IEEE Transactions on Communications · doi:10.1109/tcomm.2024.3399202 · Cited by 24
“D UE to the emergence of environment-aware applications, including autonomous driving, unmanned aerial vehicle (UAV) tracking, and human activity recognition, sensing services need to fulfill increasingly stringent demands [1], [2], [3], [4], [5].”
A robust multimodal detection system: physical exercise monitoring in long-term care environments
Mudawi, N. A., Batool, M., Alazeb, A., AlQahtani, Y., Almujally, N. A., Algarni, A. M., Jalal, A., & Liu, H. (2024) · Frontiers in Bioengineering and Biotechnology · doi:10.3389/fbioe.2024.1398291 · Cited by 24
Spatial-Temporal Masked Autoencoder for Multi-Device Wearable Human Activity Recognition
Miao, S., Chen, L., & Hu, R. (2023) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3631415 · Cited by 23
An Efficient Diverse-Branch Convolution Scheme for Sensor-Based Human Activity Recognition
Han, C., Zhang, L., Xu, S., Wang, X., Wu, H., & Song, A. (2023) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2023.3265128 · Cited by 29
“Our DBC can be seen as a complementary to previous research efforts [6] that seek to improve the performance by architecture design for activity recognition.”
BackgroundMethodInfluentialEffective Gait Abnormality Detection in Parkinson’s Patients for Multi-Sensors Surveillance System
Alazeb, A., Batool, M., Mudawi, N. A., Alshehri, M. S., Almakdi, S., Almujally, N. A., & Algarni, A. M. (2024) · IEEE Access · doi:10.1109/access.2024.3372593 · Cited by 23
“Fusion of sensors data as shown in Figure 9, is required to combine RGB, depth, and inertial sensor’s data which is of different format into a standard representational format [46].”
MethodBassani, G., Filippeschi, A., & Avizzano, C. A. (2021) · IEEE Sensors Journal · doi:10.1109/jsen.2021.3113123 · Cited by 28
Liang, J., Zhang, L., Han, C., Bu, C., Wu, H., & Song, A. (2023) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2023.3271306 · Cited by 26
Integrated Sensing and Communications: Background and Applications
Cui, Y., Liu, F., Masouros, C., Xu, J., Han, T. X., & Eldar, Y. C. (2023) · Springer eBooks · doi:10.1007/978-981-99-2501-8_1 · Cited by 24
MMTSA: Multi-Modal Temporal Segment Attention Network for Efficient Human Activity Recognition
Gao, Z., Wang, Y., Chen, J., Xing, J., Patel, S., Liu, X., & Shi, Y. (2023) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3610872 · Cited by 44
Intelligent Adaptive Real-Time Monitoring and Recognition System for Human Activities
Thakur, D., Guzzo, A., & Fortino, G. (2024) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2024.3431628 · Cited by 25
Karim, M. F. A., Khalid, S., Lee, S., Almutairi, S. S., Namoun, A., & Abohashrh, M. (2025) · IEEE Access · doi:10.1109/access.2025.3590073 · Cited by 36
“Chen et al. [108] proposed a hybrid CNN-RNN pipeline that models spatial-temporal features : NeuroHar [47] optimizes network structure using genetic encoding : These methods support the move toward self-evolving, low-cost HAR models capable of adapting to sensor variability and noise.”
Resource-Efficient Continual Learning for Sensor-Based Human Activity Recognition
Leite, C. F. S., & Xiao, Y. (2022) · ACM Transactions on Embedded Computing Systems · doi:10.1145/3530910 · Cited by 29
Worker Activity Recognition in Manufacturing Line Using Near-Body Electric Field
Suh, S., Rey, V. F., Bian, S., Huang, Y.-C., Rožanec, J. M., Ghinani, H. T., Zhou, B., & Lukowicz, P. (2023) · IEEE Internet of Things Journal · doi:10.1109/jiot.2023.3330372 · Cited by 34
“…methods and complementary approaches, we can mention the use of many deep learning architectures [e.g., recurrent neural networks, autoencoders (sparse, denoising, or variational), and generative adversarial networks (GANs)] [50], [51], [52], and approaches such as active learning [53], [54], [55].”
MethodChen, J., Xu, X., Wang, T., Jeon, G., & Camacho, D. (2024) · IEEE Internet of Things Journal · doi:10.1109/jiot.2024.3400773 · Cited by 23
“Commonly, gesture recognition and action recognition are different but related in recognizing and understanding human movements [21].”
Large Language Models Are Zero-Shot Recognizers for Activities of Daily Living
Civitarese, G., Fiori, M., Choudhary, P., & Bettini, C. (2025) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3725856 · Cited by 67
Multi-Person Activity Recognition in Continuously Monitored Smart Homes
Wang, T., & Cook, D. J. (2021) · IEEE Transactions on Emerging Topics in Computing · doi:10.1109/tetc.2021.3072980 · Cited by 21
Xia, S., Chu, L., Pei, L., Yu, W., & Qiu, R. C. (2022) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2022.3173957 · Cited by 20
“In recent years, sensor-based HAR models have been widely studied [3].”
Fully Connected Generative Adversarial Network for Human Activity Recognition
Jimale, A. O., & Noor, M. H. M. (2022) · IEEE Access · doi:10.1109/access.2022.3206952 · Cited by 23
“Recently, deep generative models have shown impres-81 sive results in generating massive samples for sensor-based human activity recognition [19].”
Background
Metadata
- Authors
- Chen, K., Zhang, D., Yao, L., Guo, B., Yu, Z., & Liu, Y.
- Affiliations
- Aalborg University (DK)
- UNSW Sydney (AU)
- Northwestern Polytechnical University (CN)
- Michigan State University (US)
- Venue
- ACM Computing Surveys
- Published
- 2021-05-24
- Volume
- 54
- Issue
- 4
- Pages
- 1-40
- ISSN
- 0360-0300 (ISSN-L)
- 1557-7341
- OpenAlex
- W3164845984
- Cited by
- 690
- References
- 144
- Citations by year
- 2026: 83 · 2025: 137 · 2024: 172 · 2023: 149 · 2022: 101 · 2021: 45
- FWCI
- 41.94
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- ACM Computing Surveys (publishedVersion, public-domain)
- VBN Forskningsportal (Aalborg Universitet) (submittedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Context-Aware Activity Recognition Systems
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Human Pose and Action Recognition
- Physical Sciences › Engineering › Biomedical Engineering › Gait Recognition and Analysis
- Keywords
- human activity recognition, sensor-based activity recognition, deep learning, Internet of Things, sensor fusion, activity recognition dataset, wearable sensors
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.