The DOI matches its Crossref record; 119 of the 119 references it cites were found in a registry or an index.
A Comprehensive Survey of Vision-Based Human Action Recognition Methods
Open accessAbstract
Although widely used in many applications, accurate and efficient human action recognition remains a challenging area of research in the field of computer vision. Most recent surveys have focused on narrow problems such as human action recognition methods using depth data, 3D-skeleton data, still image data, spatiotemporal interest point-based methods, and human walking motion recognition. However, there has been no systematic survey of human action recognition. To this end, we present a thorough review of human action recognition methods and provide a comprehensive overview of recent approaches in human action recognition research, including progress in hand-designed action features in RGB and depth data, current deep learning-based action feature representation methods, advances in human–object interaction recognition methods, and the current prominent research topic of action detection methods. Finally, we present several analysis recommendations for researchers. This survey paper provides an essential reference for those interested in further research on human action recognition.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“videobased activity recognition is naturally complementary to other sensing modalities Zhang et al. (2019);”
From Opportunity++: A Multimodal Dataset for Video- and Wearable, Object and Ambient Sensors-Based Human Activity Recognition (2021) · cites this paper as Zhang et al. (2019)
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Representation Learning: A Review and New Perspectives
Bengio, Y., Courville, A., & Vincent, P. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.50 · Cited by 13,001 · cited 1×
“Feature representation and selection is a classic problem in computer vision and machine learning [8].”
BackgroundLearning Spatiotemporal Features with 3D Convolutional Networks
Tran, D., Bourdev, L., Fergus, R., Torresani, L., & Paluri, M. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.510 · Cited by 9,593 · cited 4×
“Depending on the structure of the deep learning network, the main representative works can be summarized as discussing methods based on two-stream convolutional networks [19], those based on 3D convolutional networks [20], and those based on long short-term memory (LSTM) [83].”
BackgroundInfluentialQuo Vadis, Action Recognition? A New Model and the Kinetics Dataset
Carreira, J., & Zisserman, A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.502 · Cited by 9,570
Realtime Multi-person 2D Pose Estimation Using Part Affinity Fields
Cao, Z., Simon, T., Wei, S.-E., & Sheikh, Y. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.143 · Cited by 7,539
Two-Stream Convolutional Networks for Action Recognition in Videos
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1406.2199 · Cited by 6,756 · cited 4×
“Depending on the structure of the deep learning network, the main representative works can be summarized as discussing methods based on two-stream convolutional networks [19], those based on 3D convolutional networks [20], and those based on long short-term memory (LSTM) [83].”
BackgroundInfluentialSpatial Temporal Graph Convolutional Networks for Skeleton-Based Action Recognition
Yan, S., Xiong, Y., & Lin, D. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.12328 · Cited by 5,410
Proceedings European Conference on Computer Vision 2002
Heyden, A., Sparr, G., Nielsen, M., & Johansen, P. (2002) · Lund University Publications (Lund University) · Cited by 5,153
Temporal Segment Networks: Towards Good Practices for Deep Action Recognition
Wang, L., Xiong, Y., Wang, Z., Qiao, Y., Lin, D., Tang, X., & Van Gool, L. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46484-8_2 · Cited by 3,958
Action Recognition with Improved Trajectories
Wang, H., & Schmid, C. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.441 · Cited by 3,407
NTU RGB+D: A Large Scale Dataset for 3D Human Activity Analysis
Shahroudy, A., Liu, J., Ng, T.-T., & Wang, G. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.115 · Cited by 3,148 · cited 2×
“However, with the development of large-scale and challenging RGBD and skeleton datasets, for example, the NTU RGB+D dataset, deep-leaning-based methods for depth and skeleton data are becoming the primary research topic in the field of human action recognition.”
Research works printed but not linked: 9
- Yu, K., and Yun, F. (arXiv, 2018). Human Action Recognition and Prediction: A Survey, arXiv.
- Diba, A., Fayyaz, M., Sharma, V., Karami, A.H., Arzani, M.M., Yousefzadeh, R., and Van Gool, L. (arXiv, 2017). Temporal 3D ConvNets: New Architecture and Transfer Learning for Video Classification, arXiv.
- Wang, P., Li, W., Gao, Z., Zhang, J., Tang, C., and Ogunbona, P. (arXiv, 2015). Deep Convolutional Neural Networks for Action Recognition Using Depth Map Sequences, arXiv.
- Zhu, Y., Lan, Z., Newsam, S., and Hauptmann, A.G. (arXiv, 2017). Hidden two-stream convolutional networks for action recognition, arXiv.
- Soomro, K., Zamir, A.R., and Shah, M. (arXiv, 2012). UCF101: A Dataset of 101 Human Actions Classes from Videos in The Wild, arXiv.
- Kay, W., Carreira, J., Simonyan, K., Zhang, B., Hillier, C., Vijayanarasimhan, S., Viola, F., Green, T., Back, T., and Natsev, P. (arXiv, 2017). The Kinetics Human Action Video Dataset, arXiv.
- Gupta, S., and Malik, J. (arXiv, 2015). Visual Semantic Role Labeling, arXiv.
- Yu, G., Liu, Z., and Yuan, J. (2014). Discriminative Orderlet Mining for Real-Time Recognition of Human-Object Interaction, Springer.
- Gorban, A., Idrees, H., Jiang, Y., Zamir, A.R., Laptev, I., Shah, M., and Sukthankar, R. (2015, January 7–12). THUMOS challenge: Action recognition with a large number of classes. Proceedings of the CVPR Workshop, Boston, MA, USA.
Cited by
Vision-based human activity recognition: a survey
Beddiar, D. R., Nini, B., Sabokrou, M., & Hadid, A. (2020) · Multimedia Tools and Applications · doi:10.1007/s11042-020-09004-3 · Cited by 505
Synthetic Data for Deep Learning
Nikolenko, S. I. (2021) · Springer Optimization and Its Applications · doi:10.1007/978-3-030-75178-4 · Cited by 423
“Moving from still images to videos, we begin with human action recognition [460, 688].”
BackgroundSkeleton-based action recognition via spatial and temporal transformer networks
Plizzari, C., Cannici, M., & Matteucci, M. (2021) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2021.103219 · Cited by 409
“Nevertheless, several aspects of skeleton-based action recognition still remain open (Zhang et al. (2019); Aggarwal and Ryoo (2011); Ren et al. (2020)).”
BackgroundDeep Learning for Time Series Classification and Extrinsic Regression: A Current Survey
Mohammadi Foumani, N., Miller, L., Tan, C. W., Webb, G. I., Forestier, G., & Salehi, M. (2024) · ACM Computing Surveys · doi:10.1145/3649448 · Cited by 268
“For reviews of vision-based HAR, refer to Kong and Fu [190] or Zhang et al. [191].”
MethodKhan, M. A., Javed, K., Khan, S. A., Saba, T., Habib, U., Khan, J. A., & Abbasi, A. A. (2020) · Multimedia Tools and Applications · doi:10.1007/s11042-020-08806-9 · Cited by 277
“Moreover, it is extensively used in various industrial applications [9, 44].”
Islam, M. M., Nooruddin, S., Karray, F., & Muhammad, G. (2022) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2022.106060 · Cited by 217
“In addition, vision-based HAR is more influenced by environmental factors like shooting angles, lighting, and overlap between individuals, although it is less expensive to develop [26], [27].”
BackgroundVision-based human action recognition: An overview and real world challenges
Jegham, I., Ben Khalifa, A., Alouani, I., & Mahjoub, M. A. (2020) · Forensic Science International: Digital Investigation · doi:10.1016/j.fsidi.2019.200901 · Cited by 181
Evidential Deep Learning for Open Set Action Recognition
Bao, W., Yu, Q., & Kong, Y. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01310 · Cited by 174
“Video action recognition has been widely studied in closed set setting [59, 25, 64].”
BackgroundDeep Learning-Based Anomaly Detection in Video Surveillance: A Survey
Duong, H.-T., Le, V.-T., & Hoang, V. T. (2023) · Sensors · doi:10.3390/s23115024 · Cited by 178
“The authors of [29] performed a comprehensive review focused on the three different aspects of feature presentation, interaction recognition, and human action detection methods.”
BackgroundMethodA Comprehensive Study of Deep Video Action RecognitionPreprint
Zhu, Y., Li, X., Liu, C., Zolfaghari, M., Xiong, Y., Wu, C., Zhang, Z., Tighe, J., Manmatha, R., & Li, M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2012.06567 · Cited by 261
“Previous survey papers either put more efforts into hand-crafted features [77, 173] or focus on broader topics such as video captioning [236], video prediction [104], video action detection [261] and zero-shot video action recognition [96].”
BackgroundHow Deep Learning Sees the World: A Survey on Adversarial Attacks & Defenses
Costa, J. C., Roxo, T., Proença, H. P. M. C., & Inácio, P. R. M. (2024) · IEEE Access · doi:10.1109/access.2024.3395118 · Cited by 251
“(DNNs) [1], achieving results similar to, or better than, humans in multiple tasks, such as object recognition [2], [3], face recognition [4], [5], and natural language processing [6], [7].”
BackgroundToward human activity recognition: a survey
Saleem, G., Bajwa, U. I., & Raza, R. H. (2022) · Neural Computing and Applications · doi:10.1007/s00521-022-07937-4 · Cited by 179
Golestani, N., & Moghaddam, M. (2020) · Nature Communications · doi:10.1038/s41467-020-15086-2 · Cited by 157
“The vision-based technique, for example, is one of the well-known external methods that has been extensively studied for human activity analysis 9,10 .”
MethodLi, S., Zheng, P., Fan, J., & Wang, L. (2021) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2021.3105977 · Cited by 154
“As analyzed in the comprehensive survey of human action recognition methods [18], current deep learning techniques [19] can directly predict human activities and human–object interaction from RGB videos, depth, and skeleton data.”
BackgroundRobotic Vision for Human-Robot Interaction and Collaboration: A Survey and Systematic Review
Robinson, N., Tidd, B., Campbell, D., Kulić, D., & Corke, P. (2022) · ACM Transactions on Human-Robot Interaction · doi:10.1145/3570731 · Cited by 210
“Others have explored more detailed and specific use cases such as action recognition [491], hand gesture recognition [259, 363, 462] and human motion capture [304].”
BackgroundGraph Convolutional Neural Network for Human Action Recognition: A Comprehensive Survey
Ahmad, T., Jin, L., Zhang, X., Lai, S., Tang, G., & Lin, L. (2021) · IEEE Transactions on Artificial Intelligence · doi:10.1109/tai.2021.3076974 · Cited by 180
Digital Technologies for Emotion-Regulation Assessment and Intervention: A Conceptual Review
Bettis, A. H., Burke, T. A., Nesi, J. L., & Liu, R. T. (2021) · Clinical Psychological Science · doi:10.1177/21677026211011982 · Cited by 191
“Advances in computer vision, and specifically in human activity recognition (e.g., Wu et al., 2017; H.-B. Zhang et al., 2019), may aid in detecting the full range of the emotion-regulation process.”
Temporal Action Segmentation: An Analysis of Modern Techniques
Ding, G., Şener, F., & Yao, A. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3327284 · Cited by 213
Levels of explainable artificial intelligence for human-aligned conversational explanations
Dazeley, R., Vamplew, P. W., Foale, C., Young, C., Aryal, S., & Cruz, F. (2021) · Artificial Intelligence · doi:10.1016/j.artint.2021.103525 · Cited by 162
A survey on human-aware robot navigation
Möller, R., Furnari, A., Battiato, S., Härmä, A., & Farinella, G. M. (2021) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2021.103837 · Cited by 140
Khan, M. A., Zhang, Y., Khan, S. A., Attique, M., Rehman, A. U., & Seo, S. (2020) · Multimedia Tools and Applications · doi:10.1007/s11042-020-09408-1 · Cited by 105
Self-citationDDGCN: A Dynamic Directed Graph Convolutional Network for Action Recognition
Korban, M., & Li, X. S. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58565-5_45 · Cited by 103
Patel, C. I., Labana, D. L., Pandya, S., Modi, K. J., Ghayvat, H., & Awais, M. A. (2020) · Sensors · doi:10.3390/s20247299 · Cited by 121
“In addition to that, there are several methods proposed over the decades [22].”
MethodA Survey of Vision-Based Human Action Evaluation Methods
Lei, Q., Du, J., Zhang, H., Ye, S., & Chen, D. (2019) · Sensors · doi:10.3390/s19194129 · Cited by 114
Self-citationA Review of Deep Learning-based Human Activity Recognition on Benchmark Video Datasets
Sharma, V., Gupta, M., Pandey, A. K., Mishra, D., & Kumar, A. (2022) · Applied Artificial Intelligence · doi:10.1080/08839514.2022.2093705 · Cited by 112
“The survey by Zhang et al. (H.-B. Zhang et al. 2019) shows progress in action features for depth and RGB data, advances in human-object interaction recognition methods, and recent deep learning-based action feature representation methods.”
BackgroundA Mixed-Perception Approach for Safe Human–Robot Collaboration in Industrial Automation
Amin, F. M., Rezayati, M., van de Venn, H. W., & Karimpour, H. (2020) · Sensors · doi:10.3390/s20216347 · Cited by 110
“Recent studies have been concentrated on visual and non-visual perception systems to recognize human actions [9].”
BackgroundRGB-D Data-Based Action Recognition: A Review
Shaikh, M. B., & Chai, D. (2021) · Sensors · doi:10.3390/s21124246 · Cited by 108
A Review of Digital Twin Applications in Civil and Infrastructure Emergency Management
Cheng, R., Hou, L., & Xu, S. (2023) · Buildings · doi:10.3390/buildings13051143 · Cited by 94
Vision and Inertial Sensing Fusion for Human Action Recognition: A Review
Majumder, S., & Kehtarnavaz, N. (2020) · IEEE Sensors Journal · doi:10.1109/jsen.2020.3022326 · Cited by 97
“RGB, depth [83] 2019 Action recognition methods, feature representation, human-object interaction”
MethodA survey on unsupervised learning for wearable sensor-based activity recognition
Ige, A. O., & Noor, M. H. M. (2022) · Applied Soft Computing · doi:10.1016/j.asoc.2022.109363 · Cited by 98
3DFCNN: real-time action recognition using 3D deep neural networks with raw depth information
Sánchez-Caballero, A., Diz, S. D. L., Fuentes-Jiménez, D., Losada-Gutiérrez, C., Marrón-Romera, M., Casillas-Pérez, D., & Sarker, M. I. (2022) · Multimedia Tools and Applications · doi:10.1007/s11042-022-12091-z · Cited by 93
“The main HAR works can be classified into three groups depending on the technology used: RGB, RGB-D or depth images [65, 95].”
A new framework for deep learning video based Human Action Recognition on the edge
Cob-Parro, A. C., Losada-Gutiérrez, C., Marrón-Romera, M., Gardel, A., & Bravo, I. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.122220 · Cited by 99
Activity Recognition for Ambient Assisted Living with Videos, Inertial Units and Ambient Sensors
Ranieri, C. M., MacLeod, S., Dragone, M., Vargas, P. A., & Romero, R. A. F. (2021) · Sensors · doi:10.3390/s21030768 · Cited by 100
“For RGB videos, although strategies based on classic feature extraction techniques still provide competitive results [69–71], Deep Learning (DL) architectures have led to increasingly accurate, state-of-the-art results, representing a very active field of research, as discussed by Zhang et al. [72].”
BackgroundA survey on state-of-the-art deep learning applications and challenges
Noor, M. H. M., & Ige, A. O. (2025) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2025.111225 · Cited by 120
A Comprehensive Survey of Machine Learning Methods for Surveillance Videos Anomaly Detection
Choudhry, N., Abawajy, J., Huda, S., & Rao, I. (2023) · IEEE Access · doi:10.1109/access.2023.3321800 · Cited by 87
“Zhang and Zhang [221] carried out an extensive review of various human action feature representation methods, targeting a wide range of datasets.”
BackgroundOops! Predicting Unintentional Action in Video
Epstein, D., Chen, B., & Vondrick, C. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00100 · Cited by 134
Video-Based Human Activity Recognition Using Deep Learning Approaches
Surek, G. A. S., Seman, L. O., Stefenon, S. F., Mariani, V. C., & Coelho, L. D. S. (2023) · Sensors · doi:10.3390/s23146384 · Cited by 94
“The main challenges in HAR include (i) inference from nonexplicit poses and actions; (ii) different people can classify poses and actions differently; (ii) the possibility of partial occlusion of the body or objects involved in the scene; (iii) videos of questionable quality, such as blurring, and poor-quality sensors…”
BackgroundA Comprehensive Survey of RGB-Based and Skeleton-Based Human Action Recognition
Wang, C., & Yan, J. (2023) · IEEE Access · doi:10.1109/access.2023.3282311 · Cited by 91
“In addition, some surveys [12], [13], [14], [15] discuss the merits and demerits of handcrafted and deep learning in detail and highlight the benefits of deep learning-based meth-ods.”
BackgroundCicirelli, G., Marani, R., Romeo, L., García-Domínguez, M., Heras, J., Perri, A. G., & D’Orazio, T. (2022) · Scientific Data · doi:10.1038/s41597-022-01843-z · Cited by 78
CAPturAR: An Augmented Reality Tool for Authoring Human-Involved Context-Aware Applications
Wang, T., Qian, X., He, F., Hu, X., Huo, K., Cao, Y., & Ramani, K. (2020) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/3379337.3415815 · Cited by 85
“Meanwhile, vision-based approaches are proposed by in-stalling cameras in the environment [81].”
BackgroundHuman action recognition approaches with video datasets—A survey
Özyer, T., Selin, A. D., & Alhajj, R. (2021) · Knowledge-Based Systems · doi:10.1016/j.knosys.2021.106995 · Cited by 81
Data Augmentation with Suboptimal Warping for Time-Series Classification
Kamycki, K., Kapuściński, T., & Oszust, M. (2019) · Sensors · doi:10.3390/s20010098 · Cited by 74
“This applies to time-series captured by sensors in most action recognition problems [3].”
BackgroundImproved two-stream model for human action recognition
Zhao, Y., Man, K. L., Smith, J. S., Siddique, K., & Guan, S.-U. (2020) · EURASIP Journal on Image and Video Processing · doi:10.1186/s13640-020-00501-x · Cited by 82
Vanneste, P., Jose Oramas, M., Verelst, T., Tuytelaars, T., Raes, A., Depaepe, F., & Noortgate, W. V. D. (2021) · Mathematics · doi:10.3390/math9030287 · Cited by 84
“There are plenty of examples across multiple domains on how computer vision could impact our daily lives [1,2].”
BackgroundSkeleton Graph-Neural-Network-Based Human Action Recognition: A Survey
Feng, M., & Meunier, J. (2022) · Sensors · doi:10.3390/s22062091 · Cited by 88
A Survey of Human Action Recognition and Posture Prediction
Ma, N., Wu, Z., Cheung, Y., Guo, Y., Gao, Y., Li, J., & Jiang, B. (2022) · Tsinghua Science & Technology · doi:10.26599/tst.2021.9010068 · Cited by 78
Gimme Signals: Discriminative signal encoding for multimodal activity recognition
Memmesheimer, R., Theisen, N., & Paulus, D. W. R. (2020) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros45743.2020.9341699 · Cited by 78
“0% in [21] was falsely reported on a similar named dataset.”
BackgroundFrom CNNs to Transformers in Multimodal Human Action Recognition: A Survey
Shaikh, M. B., Chai, D., Islam, S. M. S., & Akhtar, N. (2024) · ACM Transactions on Multimedia Computing Communications and Applications · doi:10.1145/3664815 · Cited by 84
“Due to the emerging popularity of the topic, several survey articles have examined MHAR from different perspectives [2, 4, 8, 20, 41, 104, 118, 134, 136, 151, 152, 154–156].”
Rani, G. J., Hashmi, M. F., & Gupta, A. D. (2023) · IEEE Access · doi:10.1109/access.2023.3316509 · Cited by 84
“HAR has been researched using a variety of techniques, including DL [163], ML [164], sensor [165], and vision [166].”
Tanberk, S., Kilimci, Z. H., Tükel, D. B., Uysal, M., & Akyokuş, S. (2020) · IEEE Access · doi:10.1109/access.2020.2968529 · Cited by 68
“Depending on the structure of the deep learning network, the main representative works can be summarized as in [22] as methods based on two-stream convolutional networks, those based on 3D convolutional networks, and those based on long short-term memory (LSTM).”
BackgroundVisual Semantic Role Labeling for Video Understanding
Sadhu, A., Gupta, T., Yatskar, M., Nevatia, R., & Kembhavi, A. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00554 · Cited by 117
A Survey on Yogic Posture Recognition
Rajendran, A. K., & Sethuraman, S. C. (2023) · IEEE Access · doi:10.1109/access.2023.3240769 · Cited by 83
“[29], [30], [31], sensor [32], [33], [34], [35], [36], [37], machine learning [38], [39], [40], [41], [42], [43], and deep”
A Survey of Deep Learning Based Models for Human Activity Recognition
Khan, N. S., & Ghani, M. S. (2021) · Wireless Personal Communications · doi:10.1007/s11277-021-08525-w · Cited by 69
CGA: a new feature selection model for visual human action recognition
Guha, R., Khan, A. H., Singh, P. K., Sarkar, R., & Bhattacharjee, D. (2020) · Neural Computing and Applications · doi:10.1007/s00521-020-05297-5 · Cited by 62
Egocentric Vision-based Action Recognition: A survey
Núñez-Marcos, A., Azkune, G., & Arganda‐Carreras, I. (2021) · Neurocomputing · doi:10.1016/j.neucom.2021.11.081 · Cited by 78
“The exocentric action recognition field switched to three main approaches [232]: multi-stream Convolu-tional Neural NetworkCNNs (being the two-stream network the most used one [174]), 3D CNN [81] and those based on Recurrent Neural NetworkRNN, e.g. the Long-Short Term Memory LSTM [73].”
MethodZhang, L., Lim, C. P., & Yu, Y. (2021) · Knowledge-Based Systems · doi:10.1016/j.knosys.2021.106918 · Cited by 59
Tool wear prediction using convolutional bidirectional LSTM networks
Chan, Y.-W., Kang, T.-C., Yang, C., Chang, C., Huang, S.-M., & Tsai, Y.-T. (2021) · The Journal of Supercomputing · doi:10.1007/s11227-021-03903-4 · Cited by 60
Continuous Human Action Recognition for Human-machine Interaction: A Review
Gammulle, H., Ahmedt‐Aristizabal, D., Denman, S., Tychsen-Smith, L., Petersson, L., & Fookes, C. (2023) · ACM Computing Surveys · doi:10.1145/3587931 · Cited by 70
“Although there exist numerous recent survey articles [22], [23], [1], [24] concerning human action recognition and in-3 Topic Reference [22] [23] [1] [24] Ours Feature Extractors Action Segmentation Object detection and tracking for action segmentation Discussion of Challenges with real world…”
BackgroundA Comprehensive Review of Recent Deep Learning Techniques for Human Activity Recognition
Le, V.-T., Tran-Trung, K., & Hoang, V. T. (2022) · Computational Intelligence and Neuroscience · doi:10.1155/2022/8323962 · Cited by 69
“[6] provided an overview of human action recognition, interaction recognition, and human action detection methods.”
BackgroundHand Gesture Recognition Based on Active Ultrasonic Sensing of Smartphone: A Survey
Wang, Z., Hou, Y., Jiang, K., Dou, W., Zhang, C., Huang, Z., & Guo, Y. (2019) · IEEE Access · doi:10.1109/access.2019.2933987 · Cited by 59
“various signals, such as video [1], sound [2], radio frequency (RF) [3], and light [4].”
BackgroundMulti-Camera-Based Human Activity Recognition for Human–Robot Collaboration in Construction
Jang, Y., Jeong, I., Heravi, M. Y., Sarkar, S., Shin, H., & Ahn, Y. (2023) · Sensors · doi:10.3390/s23156997 · Cited by 57
“Nonetheless, RGB-D cameras also have limitations in terms of depth measurement accuracy at extreme ranges, narrow field of view, and sensitivity to lighting conditions, which can affect the completeness, accuracy and reliability of 3D pose estimation [23].”
BackgroundA survey of video-based human action recognition in team sports
Yin, H., Sinnott, R., & Jayaputera, G. (2024) · Artificial Intelligence Review · doi:10.1007/s10462-024-10934-9 · Cited by 76
Dahou, A., Al‐qaness, M. A. A., Elaziz, M. A., & Helmi, A. M. (2023) · IEEE Internet of Things Journal · doi:10.1109/jiot.2023.3286378 · Cited by 60
Multimodal vision-based human action recognition using deep learning: a review
Shafizadegan, F., Naghsh‐Nilchi, A. R., & Shabaninia, E. (2024) · Artificial Intelligence Review · doi:10.1007/s10462-024-10730-5 · Cited by 65
Patient activity recognition using radar sensors and machine learning
Bhavanasi, G., Werthen‐Brabants, L., Dhaene, T., & Couckuyt, I. (2022) · Neural Computing and Applications · doi:10.1007/s00521-022-07229-x · Cited by 62
Khaire, P., & Kumar, P. (2022) · Journal of Visual Communication and Image Representation · doi:10.1016/j.jvcir.2022.103531 · Cited by 59
The Multi-Agent Behavior Dataset: Mouse Dyadic Social Interactions
Sun, J. J., Karigo, T., Chakraborty, D., Mohanty, S. P., Wild, B., Sun, Q., Chen, C., Anderson, D. J., Perona, P., Yue, Y., et al. (2021) · PubMed · doi:10.48550/arxiv.2104.02710 · Cited by 81
“Relating to behavior classification and works in behavioral neuroscience, there is also the field of human action recognition (reviewed in [71, 75]).”
BackgroundWi-Fi-Based Location-Independent Human Activity Recognition via Meta Learning
Ding, X., Jiang, T., Zhong, Y., Huang, Y., & Li, Z. (2021) · Sensors · doi:10.3390/s21082654 · Cited by 52
“Traditional human activity sensing approaches are the wearable sensor-based methods [3,4] and the camera (vision)-based methods [5,6].”
MethodRodríguez, I., Campos, C., & Fdez‐Riverola, F. (2021) · Neural Computing and Applications · doi:10.1007/s00521-021-06830-w · Cited by 59
“It is possible to find a fair amount of related works in the existing literature on application domains as diverse as posture estimation [1], pedestrian [2], and face detection [3], or human behavior recognition and analysis [4], among others.”
BackgroundAdvancing human action recognition: A hybrid approach using attention-based LSTM and 3D CNN
Saoudi, E. M., Jaafari, J., & Andaloussi, S. J. (2023) · Scientific African · doi:10.1016/j.sciaf.2023.e01796 · Cited by 46
Yang, Y., Li, Y., Zhang, T., Zhou, Y., & Zhang, H. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i17.17759 · Cited by 48
“Common methods include CNNs, the optical flow method, recurrent neural networks (RNNs), and graph neural networks (Zhang et al. 2019; Hussein, Gavves, and Smeulders 2019).”
MethodSelf-citationDeep Learning-Based Real-Time Multiple-Person Action Recognition System
Tsai, J.-K., Hsu, C.-C. J., Wang, W., & Huang, S.-K. (2020) · Sensors · doi:10.3390/s20174758 · Cited by 50
Cimolin, V., Vismara, L., Ferraris, C., Amprimo, G., Pettiti, G., Lopez, R., Galli, M., Cremascoli, R., Sinagra, S., Mauro, A., et al. (2022) · Sensors · doi:10.3390/s22030824 · Cited by 50
“In recent years, several studies considered the use of RGB-D cameras for the assessment of the motor condition [26,27], for action and activity recognition [28], and motor rehabilitation [29], especially combined with virtual environments [30,31].”
A Systematic Review of Recent Deep Learning Approaches for 3D Human Pose Estimation
El Kaid, A., & Baïna, K. (2023) · Journal of Imaging · doi:10.3390/jimaging9120275 · Cited by 44
3D Human Action Recognition: Through the eyes of researchers
Sarkar, A., Banerjee, A., Singh, P. K., & Sarkar, R. (2022) · Expert Systems with Applications · doi:10.1016/j.eswa.2021.116424 · Cited by 43
Hutchinson, M., & Gadepally, V. N. (2021) · IEEE Access · doi:10.1109/access.2021.3115476 · Cited by 55
“Zhang et al. (2019) [255] use a tracking network and graph convolutional network to derive person-object detections.”
BackgroundMethodWhen AI meets store layout design: a review
Nguyen, K., Le, M. T. H., Martin, B. A. S., Çil, İ., & Fookes, C. (2022) · Artificial Intelligence Review · doi:10.1007/s10462-022-10142-3 · Cited by 51
“7 Action recognition in a supermarket setting Zhang et al. 2019).”
BackgroundMonitoring of Gait Parameters in Post-Stroke Individuals: A Feasibility Study Using RGB-D Sensors
Ferraris, C., Cimolin, V., Vismara, L., Votta, V., Amprimo, G., Cremascoli, R., Galli, M., Nerino, R., Mauro, A., & Priano, L. (2021) · Sensors · doi:10.3390/s21175945 · Cited by 51
Le, V.-H. (2022) · Multimedia Tools and Applications · doi:10.1007/s11042-022-13921-w · Cited by 42
“The HAR approaches performed based on machine learning research, can be categorized the deep learning algorithms [59, 164].”
MethodIndoor human activity recognition using high-dimensional sensors and deep neural networks
Vandersmissen, B., Knudde, N., Jalalvand, A., Couckuyt, I., Dhaene, T., & Neve, W. D. (2019) · Neural Computing and Applications · doi:10.1007/s00521-019-04408-1 · Cited by 44
“A video camera is a powerful sensor when it comes to identifying humans or recognizing actions [24,37].”
BackgroundA Dataset and System for Real-Time Gun Detection in Surveillance Video Using Deep Learning
Qi, D., Tan, W., Liu, Z., Yao, Q., & Liu, J. (2021) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/smc52423.2021.9659207 · Cited by 45
“action recognition, the readers are referred to [16] and more in the literature.”
BackgroundA Comprehensive Methodological Survey of Human Activity Recognition Across Diverse Data Modalities
Shin, J., Hassan, N., Miah, A. S. M., & Nishimura, S. (2025) · Sensors · doi:10.3390/s25134028 · Cited by 58
Mohammadzade, H., Hosseini, S., Rezaei-Dastjerdehei, M., & Tabejamaat, M. (2021) · IEEE Sensors Journal · doi:10.1109/jsen.2021.3051497 · Cited by 38
“camera [1] and radar-based [2] systems.”
Chu, X., Kim, S., Cho, Y., & Park, K.-S. (2024) · Electronics · doi:10.3390/electronics13040747 · Cited by 39
Kratsch, W., König, F., & Röglinger, M. (2022) · Decision Support Systems · doi:10.1016/j.dss.2022.113794 · Cited by 52
“tracts the localization of all activities as well as their start and end times [63].”
BackgroundSlade, S., Zhang, L., Yu, Y., & Lim, C. P. (2022) · Neural Computing and Applications · doi:10.1007/s00521-022-06947-6 · Cited by 37
Are Accelerometers for Activity Recognition a Dead-end?
Tong, C., Tailor, S. A., & Lane, N. D. (2020) · IEEE Workshop on Mobile Computing Systems and Applications (WMCSA) · doi:10.1145/3376897.3377867 · Cited by 43
“than wearable cameras, visual HAR based on stationary cameras has been extensively studied by the computer vision community and we refer readers to [39] for a survey in this area.”
BackgroundYanan, P., Jilong, Y., & Heng, Z. (2021) · Sensors · doi:10.3390/s21196685 · Cited by 36
“[8] can classify human action recognition into the following four categories: original action recognition [9], single-person action recognition [10], interactive recognition [11], and group action recognition [12].”
BackgroundCiliberto, M., Fortes Rey, V., Calatroni, A., Lukowicz, P., & Roggen, D. (2021) · Frontiers in Computer Science · doi:10.3389/fcomp.2021.792065 · Cited by 35
“Several reasons underpin this type of research: video-based activity recognition is naturally complementary to other sensing modalities Zhang et al. (2019); there is a wide availability of public videos that can be used as additional training source (e.g., YouTube) Kwon et al. (2020); and it makes…”
BackgroundRecognizing human violent action using drone surveillance within real-time proximity
Srivastava, A., Badal, T., Garg, A., Vidyarthi, A., & Singh, R. (2021) · Journal of Real-Time Image Processing · doi:10.1007/s11554-021-01171-2 · Cited by 35
A survey on intelligent human action recognition techniques
Kumar, R., & Kumar, S. (2023) · Multimedia Tools and Applications · doi:10.1007/s11042-023-17529-6 · Cited by 46
Rahman, M. M., Gan, K. B., & Aziz, N. A. (2023) · Jurnal Kejuruteraan · doi:10.17576/jkukm-2023-35(3)-05 · Cited by 34
“H. B. Zhang et al. (2019) mentioned about many confounding issues of vision based HAR , such as the diversity and complexity of body postures, occlusion, and background clutter for human action recognition, deep learning challenges for multimodal, interaction recognition problems, and fast action…”
BackgroundHybrid handcrafted and learned feature framework for human action recognition
Zhang, C., Xu, Y., Xu, Z., Huang, J., & Lu, J. (2022) · Applied Intelligence · doi:10.1007/s10489-021-03068-w · Cited by 33
“Trajectories based methods show reasonable results on several datasets [25].”
MethodHuman Activity Recognition with an HMM-Based Generative Model
Manouchehri, N., & Bouguila, N. (2023) · Sensors · doi:10.3390/s23031390 · Cited by 37
Bowen, D. T., Russo, I. M., Cleaver, C. J., Allwood, J. M., & Loukaides, E. G. (2021) · Journal of Materials Processing Technology · doi:10.1016/j.jmatprotec.2021.117337 · Cited by 32
Progress of Human Action Recognition Research in the Last Ten Years: A Comprehensive Survey
Singh, P. K., Kundu, S., Adhikary, T., Sarkar, R., & Bhattacharjee, D. (2021) · Archives of Computational Methods in Engineering · doi:10.1007/s11831-021-09681-9 · Cited by 36
“[17] yielded good accuracy on the IXMAS and WVU datasets.”
BackgroundMethodTsiktsiris, D., Dimitriou, N., Lalas, A. X., Dasygenis, M., Votis, K., & Tzovaras, D. K. (2020) · Sensors · doi:10.3390/s20174943 · Cited by 30
“[32].”
Intelligent Video Analytics for Human Action Recognition: The State of Knowledge
Kulbacki, M., Segen, J., Chaczko, Z., Rozenblit, J. W., Kulbacki, M., Klempous, R., & Wojciechowski, K. W. (2023) · Sensors · doi:10.3390/s23094258 · Cited by 35
DanXe: An extended artificial intelligence framework to analyze and promote dance heritage
Stacchio, L., Garzarella, S., Cascarano, P., Filippo, A. D., Cervellati, E., & Marfia, G. (2024) · Digital Applications in Archaeology and Cultural Heritage · doi:10.1016/j.daach.2024.e00343 · Cited by 42
Wi2Vi: Generating Video Frames From WiFi CSI Samples
Kefayati, M. H., Pourahmadi, V., & Aghaeinia, H. (2020) · IEEE Sensors Journal · doi:10.1109/jsen.2020.2996078 · Cited by 29
“Among the device free approaches for satisfying this requirement, vision-based systems are the most adopted scheme [15].”
Background
Metadata
- Authors
- Zhang, H.-B., Zhang, Y.-X., Zhong, B., Lei, Q., Yang, L., Du, J.-X., & Chen, D.-S.
- Affiliations
- Department of Computer Science and Technology, Huaqiao University, Xiamen 361000, China
- Huaqiao University (CN)
- Corresponding author
- Du, Ji-Xiang
- Venue
- Sensors
- Publisher
- MDPI AG
- Published
- 2019-02-27
- Volume
- 19
- Issue
- 5
- Pages
- 1005
- ISSN
- 1424-8220 (ISSN-L)
- PMC
- PMC6427144
- OpenAlex
- W2917819557
- Cited by
- 503
- References
- 119
- Citations by year
- 2026: 33 · 2025: 55 · 2024: 79 · 2023: 97 · 2022: 71 · 2021: 93 · 2020: 62 · 2019: 12
- FWCI
- 6.84
- Type
- journal article
- Language
- en
- Open access
- gold
- dx.doi.org
- Licence
- Locations
- Sensors (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Human Pose and Action Recognition
- Physical Sciences › Computer Science › Human-Computer Interaction › Hand Gesture Recognition Systems
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Context-Aware Activity Recognition Systems
- Keywords
- human action recognition, depth information, 3D skeleton data, human-object interaction recognition, action detection
- MeSH terms
- Algorithms, Humans, Human Activities, Motion, Pattern Recognition, Automated, Surveys and Questionnaires, Skeleton, Vision, Ocular, Visual Perception
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
