The DOI matches its Crossref record; 502 of the 502 references it cites were found in a registry or an index.
Human Action Recognition From Various Data Modalities: A Review
Open accessAbstract
Human Action Recognition (HAR) aims to understand human behavior and assign a label to each action. It has a wide range of applications, and therefore has been attracting increasing attention in the field of computer vision. Human actions can be represented using various data modalities, such as RGB, skeleton, depth, infrared, point cloud, event stream, audio, acceleration, radar, and WiFi signal, which encode different sources of useful yet distinct information and have various advantages depending on the application scenarios. Consequently, lots of existing works have attempted to investigate different types of approaches for HAR using various modalities. In this article, we present a comprehensive survey of recent progress in deep learning methods for HAR based on the type of input data modality. Specifically, we review the current mainstream deep learning methods for single data modalities and multiple data modalities, including the fusion-based and the co-learning-based frameworks. We also present comparative results on several benchmark datasets for HAR, together with insightful observations and inspiring future research directions.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Items 401–502 of 502
Infrared and 3D Skeleton Feature Fusion for RGB-D Action Recognition
de Boissiere, A. M., & Noumeir, R. (2020) · IEEE Access · doi:10.1109/access.2020.3023599 · Cited by 72
Multimodal Attentive Fusion Network for audio-visual event recognition
Brousmiche, M., Rouat, J., & Dupont, S. (2022) · Information Fusion · doi:10.1016/j.inffus.2022.03.001 · Cited by 71
Human action recognition using RGB-D sensor and deep convolutional neural networks
Imran, J., & Kumar, P. (2016) · International Conference on Advances in Computing, Communications and Informatics (ICACCI) · doi:10.1109/icacci.2016.7732038 · Cited by 70
A Motion-Based Feature for Event-Based Pattern Recognition
Clady, X., Maro, J.-M., Barré, S., & Benosman, R. B. (2017) · Frontiers in Neuroscience · doi:10.3389/fnins.2016.00594 · Cited by 70
CT-Net: Channel Tensorization Network for Video ClassificationPreprint
Li, K., Li, X., Wang, Y., Wang, J., & Qiao, Y. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.01603 · Cited by 70
IA-RED$^2$: Interpretability-Aware Redundancy Reduction for Vision Transformers
Pan, B., Panda, R., Jiang, Y., Wang, Z., Feris, R., & Oliva, A. (2021) · arXiv · doi:10.48550/arxiv.2106.12620 · Cited by 70
SSNet: Scale Selection Network for Online 3D Action Prediction
Liu, J., Shahroudy, A., Wang, G., Duan, L., & Kot, A. C. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00871 · Cited by 68
Self-citationTransfer Learning for Human Activities Classification Using Micro-Doppler Spectrograms
Du, H., He, Y., & Jin, T. (2018) · IEEE International Conference on Computational Electromagnetics · doi:10.1109/compem.2018.8496654 · Cited by 68
Structured Images for RGB-D Action Recognition
Wang, P., Wang, S., Gao, Z., Hou, Y., & Li, W. (2017) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2017.123 · Cited by 66
Else-Net: Elastic Semantic Network for Continual Action Recognition from Skeleton Data
Li, T., Ke, Q., Rahmani, H., Ho, R. E., Ding, H., & Liu, J. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01318 · Cited by 66
Self-citationDirectional Temporal Modeling for Action Recognition
Li, X., Shuai, B., & Tighe, J. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58539-6_17 · Cited by 65
Skeleton-based relational reasoning for group activity analysis
Pérez, M., Liu, J., & Kot, A. C. (2021) · Pattern Recognition · doi:10.1016/j.patcog.2021.108360 · Cited by 64
Self-citationStructure-Aware Human-Action Generation
Yu, P., Zhao, Y., Li, C., Yuan, J., & Chen, C. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58577-8_2 · Cited by 63
Optical flow-motion history image (OF-MHI) for action recognition
Tsai, D., Chiu, W., & Lee, M.-H. (2014) · Signal Image and Video Processing · doi:10.1007/s11760-014-0677-9 · Cited by 62
A Reservoir-based Convolutional Spiking Neural Network for Gesture Recognition from DVS Input
George, A. M., Banerjee, D., Dey, S., Mukherjee, A., & Balamurali, P. (2020) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn48605.2020.9206681 · Cited by 61
Spatial-Temporal Transformer for 3D Point Cloud Sequences
Wei, Y., Liu, H., Xie, T., Ke, Q., & Guo, Y. (2022) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv51458.2022.00073 · Cited by 61
Self-citationMulti-modality learning for human action recognition
Ren, Z., Zhang, Q., Gao, X., Hao, P., & Cheng, J. S. (2020) · Multimedia Tools and Applications · doi:10.1007/s11042-019-08576-z · Cited by 60
Deep Independently Recurrent Neural Network (IndRNN)Preprint
Li, S., Li, W., Cook, C., & Gao, Y. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1910.06251 · Cited by 59
Interact before Align: Leveraging Cross-Modal Knowledge for Domain Adaptive Action Recognition
Yang, L., Huang, Y., Sugano, Y., & Sato, Y. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01431 · Cited by 59
Uncertainty-Guided Probabilistic Transformer for Complex Action Recognition
Guo, H., Wang, H., & Ji, Q. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01942 · Cited by 59
STAR: Sparse Transformer-based Action RecognitionPreprint
Shi, F., Lee, C., Qiu, L., Zhao, Y., Shen, T., Muralidhar, S., Han, T., Zhu, S. C., & Narayanan, V. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2107.07089 · Cited by 58
Ahmad, Z., & Khan, N. (2020) · IEEE Sensors Journal · doi:10.1109/jsen.2020.3028561 · Cited by 57
Crossmodal Representation Learning for Zero-shot Action Recognition
Lin, C.-C., Lin, K., Wang, L., Liu, Z., & Li, L. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01935 · Cited by 57
Real-time human action recognition using raw depth video-based recurrent neural networks
Sánchez-Caballero, A., Fuentes-Jiménez, D., & Losada-Gutiérrez, C. (2022) · Multimedia Tools and Applications · doi:10.1007/s11042-022-14075-5 · Cited by 56
Audio-Adaptive Activity Recognition Across Video Domains
Zhang, Y., Doughty, H., Shao, L., & Snoek, C. G. M. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01342 · Cited by 56
Dynamic Graph CNN for Event-Camera Based Gesture Recognition
Chen, J., Meng, J., Wang, X., & Yuan, J. (2020) · IEEE International Symposium on Circuits and Systems proceedings · doi:10.1109/iscas45731.2020.9181247 · Cited by 55
Simultaneous Energy Harvesting and Gait Recognition Using Piezoelectric Energy Harvester
Ma, D., Lan, G., Xu, W., Hassan, M., & Hu, W. S. (2020) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2020.3035045 · Cited by 55
KEH-Gait: Towards a Mobile Healthcare User Authentication System by Kinetic Energy Harvesting
Xu, W., Lan, G., Lin, Q., Khalifa, S., Bergmann, N. W., Hassan, M., & Hu, W. S. (2017) · Network and Distributed System Security Symposium · doi:10.14722/ndss.2017.23023 · Cited by 54
Multimodal Transformer for Nursing Activity Recognition
Ijaz, M., Díaz, R., & Chen, C. (2022) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw56347.2022.00224 · Cited by 54
Human Interaction Prediction Using Deep Temporal Features
Ke, Q., Bennamoun, M., An, S., Boussaïd, F., & Sohel, F. A. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-48881-3_28 · Cited by 53
Self-citationDistillation Multiple Choice Learning for Multimodal Action Recognition
Garcia, N. C., Bargal, S. A., Ablavsky, V., Morerio, P., Murino, V., & Sclaroff, S. (2021) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv48630.2021.00280 · Cited by 53
Decoupling and Recoupling Spatiotemporal Representation for RGB-D-based Motion Recognition
Zhou, B., Wang, P., Wan, J., Liang, Y., Wang, F., Zhang, D., Lei, Z., Li, H., & Jin, R. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01952 · Cited by 53
3D CNNs with Adaptive Temporal Feature Resolutions
Fayyaz, M., Rad, E. B., Diba, A., Noroozi, M., Adeli, E., Gool, L. V., & Gall, J. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00470 · Cited by 51
Can An Image Classifier Suffice For Action Recognition?Preprint
Fan, Q., Chun-Fu, Chen, & Panda, R. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.14104 · Cited by 51
Skeleton-Indexed Deep Multi-Modal Feature Learning for High Performance Human Action Recognition
Song, S., Lan, C., Xing, J., Zeng, W., & Liu, J. (2018) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme.2018.8486486 · Cited by 50
Self-citationSpatiotemporal Filtering for Event-Based Action RecognitionPreprint
Ghosh, R., Gupta, A. K., Nakagawa, A., Soares, A. B., & Thakor, N. V. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1903.07067 · Cited by 50
Spatiotemporal saliency-based multi-stream networks with attention-aware LSTM for action recognition
Liu, Z., Li, Z., Wang, R., Zong, M., & Ji, W. (2020) · Neural Computing and Applications · doi:10.1007/s00521-020-05144-7 · Cited by 50
Action recognition from extremely low-resolution thermal image sequence
Kawashima, T., Kawanishi, Y., Ide, I., Murase, H., Deguchi, D., Aizawa, T., & Kawade, M. (2017) · IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS) · doi:10.1109/avss.2017.8078497 · Cited by 49
Elmadany, N. E. D., He, Y., & Guan, L. (2018) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2018.2875510 · Cited by 49
Depth2Action: Exploring Embedded Depth for Large-Scale Action Recognition
Zhu, Y., & Newsam, S. D. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-46604-0_47 · Cited by 47
Alfasly, S., Lu, J., Xu, C., & Zou, Y. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01957 · Cited by 47
Dawar, N., & Kehtarnavaz, N. (2018) · International Conference on Control and Automation · doi:10.1109/icca.2018.8444326 · Cited by 46
Learning Human Pose Models from Synthesized Data for Robust RGB-D Action Recognition
Liu, J., Rahmani, H., Akhtar, N., & Mian, A. S. (2019) · International Journal of Computer Vision · doi:10.1007/s11263-019-01192-2 · Cited by 46
Self-citationA Coarse-to-Fine Framework for Resource Efficient Video Recognition
Wu, Z., Li, H., Zheng, Y., Xiong, C., Jiang, Y., & Davis, L. S. (2021) · International Journal of Computer Vision · doi:10.1007/s11263-021-01508-1 · Cited by 46
SLIC: Self-Supervised Learning with Iterative Clustering for Human Action Videos
Khorasgani, S. H., Chen, Y., & Shkurti, F. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01562 · Cited by 46
Sánchez-Caballero, A., Fuentes-Jiménez, D., & Losada-Gutiérrez, C. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.07744 · Cited by 45
Spatio-Temporal Tuples Transformer for Skeleton-Based Action Recognition
Qiu, H., Hou, B., Ren, B., & Zhang, X. (2022) · arXiv · doi:10.48550/arxiv.2201.02849 · Cited by 44
EV-Action: Electromyography-Vision Multi-Modal Action Dataset
Wang, L., Sun, B., Robinson, J. P., Jing, T., & Fu, Y. (2020) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/fg47880.2020.00018 · Cited by 43
Audio-Visual Model Distillation Using Acoustic Images
Pérez, A. F., Sanguineti, V., Morerio, P., & Murino, V. (2020) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv45572.2020.9093307 · Cited by 39
A Hybrid Network for Large-Scale Action Recognition from RGB and Depth Modalities
Wang, H., Song, Z., Li, W., & Wang, P. (2020) · Sensors · doi:10.3390/s20113305 · Cited by 39
PM-GANs: Discriminative Representation Learning for Action Recognition Using Partial-Modalities
Wang, L., Gao, C., Yang, L., Zhao, Y., Zuo, W., & Meng, D. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01231-1_24 · Cited by 38
Spatiotemporal Fusion in 3D CNNs: A Probabilistic View
Zhou, Y., Sun, X., Luo, C., Zha, Z.-J., & Zeng, W. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00985 · Cited by 38
Recognizing Actions in Videos from Unseen Viewpoints
Piergiovanni, A., & Ryoo, M. S. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00411 · Cited by 38
Pham, C., Nguyen, L., Nguyen, A., Nguyen, C.-N., & Nguyen, V.-T. (2021) · Multimedia Tools and Applications · doi:10.1007/s11042-021-11058-w · Cited by 38
Representing Videos as Discriminative Sub-graphs for Action Recognition
Li, D., Qiu, Z., Pan, Y., Yao, T., Li, H., & Mei, T. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00332 · Cited by 38
3D Behavior Recognition Based on Multi-Modal Deep Space-Time Learning
Zhao, C. K., Chen, M., Zhao, J., Wang, Q., & Shen, Y. (2019) · Applied Sciences · doi:10.3390/app9040716 · Cited by 37
Regularization on Spatio-Temporally Smoothed Feature for Action Recognition
Kim, J.-H., Cha, S., Wee, D., Bae, S., & Kim, J. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.01212 · Cited by 37
Wang, H., Yang, L., Rong, X., Feng, J., & Tian, Y. (2021) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv48630.2021.00381 · Cited by 37
DDLSTM: Dual-Domain LSTM for Cross-Dataset Action Recognition
Perrett, T., & Damen, D. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00804 · Cited by 36
3D flow estimation for human action recognition from colored point clouds
Munaro, M., Ballin, G., Michieletto, S., & Menegatti, E. (2013) · Biologically Inspired Cognitive Architectures · doi:10.1016/j.bica.2013.05.008 · Cited by 35
Deep residual infrared action recognition by integrating local and global spatio-temporal cues
Imran, J., & Raman, B. (2019) · Infrared Physics & Technology · doi:10.1016/j.infrared.2019.103014 · Cited by 34
Motion and Region Aware Adversarial Learning for Fall Detection with Thermal Imaging
Mehta, V., Dhall, A., Pal, S., & Khan, S. S. (2021) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr48806.2021.9412632 · Cited by 34
Wang, G., Liu, H., Chen, M., Yang, Y., Liu, Z., & Wang, H. (2021) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2021.3106101 · Cited by 34
Self-citationYe, J., Li, K., Qi, G.-J., & Hua, K. A. (2015) · International Conference on Multimedia Retrieval · doi:10.1145/2671188.2749340 · Cited by 33
Geometric Deep Neural Network using Rigid and Non-Rigid Transformations for Human Action Recognition
Friji, R., Drira, H., Chaieb, F., Kchok, H., & Kurtek, S. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01238 · Cited by 33
Exploring multimodal video representation for action recognition
Wang, C., Yang, H., & Meinel, C. (2016) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2016.7727435 · Cited by 32
Human Activity Recognition by Fusion of RGB, Depth, and Skeletal Data
Khaire, P., Imran, J., & Kumar, P. (2018) · Advances in intelligent systems and computing · doi:10.1007/978-981-10-7895-8_32 · Cited by 29
Temporal Unet: Sample Level Human Action Recognition using WiFiPreprint
Wang, F., Song, Y., Zhang, J., Han, J., & Huang, D. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1904.11953 · Cited by 29
Rani, S. S., Naidu, G. A., & Shree, V. U. (2020) · Materials Today Proceedings · doi:10.1016/j.matpr.2020.09.052 · Cited by 29
Shuffle-invariant Network for Action Recognition in Videos
Shi, Q., Zhang, H., Li, Z., Du, J., Lei, Q., & Liu, J. (2022) · ACM Transactions on Multimedia Computing Communications and Applications · doi:10.1145/3485665 · Cited by 29
Self-citationUnsupervised Few-Shot Action Recognition via Action-Appearance Aligned Meta-Adaptation
Patravali, J., Mittal, G., Yu, Y., Li, F., & Chen, M. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00837 · Cited by 28
Hernangόmez, R., Santra, A., & Stańczak, S. (2019) · International Radar Conference (RADAR) · doi:10.1109/radar41533.2019.171243 · Cited by 27
Learning from Temporal Spatial Cubism for Cross-Dataset Skeleton-based Action Recognition
Tang, Y., Liu, X., Yu, X., Zhang, D., Lu, J., & Zhou, J. (2022) · ACM Transactions on Multimedia Computing Communications and Applications · doi:10.1145/3472722 · Cited by 27
Action Classification with Locality-Constrained Linear Coding
Rahmani, H., Mahmood, A., Huynh, D. Q., & Mian, A. S. (2014) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr.2014.604 · Cited by 26
Self-citationMax-Margin Heterogeneous Information Machine for RGB-D Action Recognition
Kong, Y., & Fu, Y. (2017) · International Journal of Computer Vision · doi:10.1007/s11263-016-0982-6 · Cited by 26
Learning Discriminative Features via Label Consistent Neural Network
Jiang, Z., Wang, Y., Davis, L. S., Andrews, W. D., & Rozgić, V. (2017) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv.2017.30 · Cited by 26
TP-VIT: A Two-Pathway Vision Transformer for Video Action Recognition
Jing, Y., & Wang, F. (2022) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp43922.2022.9747276 · Cited by 25
Orthogonal moment-based descriptors for pose shape query on 3D point cloud patches
Cheng, H., & Chung, S. M. (2015) · Pattern Recognition · doi:10.1016/j.patcog.2015.09.028 · Cited by 24
Temporal Reasoning in Videos Using Convolutional Gated Recurrent Units
Dwibedi, D., Sermanet, P., & Tompson, J. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · Cited by 24
How Do You Do It? Fine-Grained Action Understanding with Pseudo-Adverbs
Doughty, H., & Snoek, C. G. M. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01346 · Cited by 24
Mohaghegh, H., Karimi, N., Soroushmehr, S. M. R., Samavi, S., & Najarian, K. (2018) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2018.2808682 · Cited by 23
Neuromorphic Vision Sensing for CNN-based Action Recognition
Chadha, A., Bi, Y., Abbas, A., & Andreopoulos, Y. (2019) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2019.8683606 · Cited by 23
NUTA: Non-uniform Temporal Aggregation for Action Recognition
Li, X., Liu, C., Shuai, B., Zhu, Y., Chen, H., & Tighe, J. (2022) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv51458.2022.00090 · Cited by 23
Beyond Short Clips: End-to-End Video-Level Learning with Collaborative Memories
Yang, X., Fan, H., Torresani, L., Davis, L. S., & Wang, H. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00748 · Cited by 23
Dear-Net: Learning Diversities for Skeleton-Based Early Action Recognition
Wang, R., Liu, J., Ke, Q., Peng, D., & Lei, Y. (2021) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2021.3139768 · Cited by 23
Self-citationMulti-View and Multi-Modal Action Recognition with Learned Fusion
Ardianto, S., & Hang, H. (2018) · Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC) · doi:10.23919/apsipa.2018.8659539 · Cited by 21
Benchmark for Kitchen20, a daily life dataset for audio-based human action recognition
Moreaux, M., Ortiz, M. G., Ferrané, I., & Lerasle, F. (2019) · International Workshop on Content-Based Multimedia Indexing (CBMI) · doi:10.1109/cbmi.2019.8877429 · Cited by 19
DMCL: Distillation Multiple Choice Learning for Multimodal Action Recognition
Garcia, N. C., Bargal, S. A., Ablavsky, V., Morerio, P., Murino, V., & Sclaroff, S. (2019) · OpenBU (Boston University) · doi:10.48550/arxiv.1912.10982 · Cited by 19
Kim, Y., Park, J., & Moon, T. (2017) · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · doi:10.1117/12.2262719 · Cited by 17
Interaction Recognition Through Body Parts Relation Reasoning
Pérez, M., Liu, J., & Kot, A. C. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-41404-7_19 · Cited by 17
Self-citationHuman Action Recognition Based on Improved Fusion Attention CNN and RNN
Zhao, H., & Jin, X. (2020) · International Conference on Computational Intelligence and Applications (ICCIA) · doi:10.1109/iccia49625.2020.00028 · Cited by 16
Cross-Domain First Person Audio-Visual Action Recognition through Relative Norm AlignmentPreprint
Planamente, M., Plizzari, C., Alberti, E., & Caputo, B. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.01689 · Cited by 16
Multi-Modal Multi-Action Video Recognition
Shi, Z., Ju, L., Li, Q., Zheng, H., Gu, Z., Dong, J., & Zheng, B. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01342 · Cited by 16
Wiga: A WiFi-Based Contactless Activity Sequence Recognition System Based on Deep Learning
Huang, S., Wang, D., Zhao, R., & Zhang, Q. (2019) · International Conference on Mobile Ad-Hoc and Sensor Networks (MSN) · doi:10.1109/msn48538.2019.00026 · Cited by 14
RareAct: A video dataset of unusual interactionsPreprint
Miech, A., Alayrac, J.-B., Ivan Laptev, A., Šivic, J., & Zisserman, A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2008.01018 · Cited by 14
Model-Agnostic Multi-Domain Learning with Domain-Specific Adapters for Action Recognition
Omi, K., Kimata, J., & Tamaki, T. (2022) · IEICE Transactions on Information and Systems · doi:10.1587/transinf.2022edp7058 · Cited by 13
Multimodal Human Action Recognition Based on a Fusion of Dynamic Images Using CNN Descriptors
Cárdenas, E. J. E., & Cámara-Chávez, G. (2018) · SIBGRAPI Conference on Graphics, Patterns and Images (SIBGRAPI) · doi:10.1109/sibgrapi.2018.00019 · Cited by 12
ActAR: Actor-Driven Pose Embeddings for Video Action Recognition
Lamghari, S., Bilodeau, G.-A., & Saunier, N. (2022) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw56347.2022.00055 · Cited by 12
Event-based Action Recognition Using Timestamp Image Encoding NetworkPreprint
Huang, C. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2009.13049 · Cited by 8
Selective Feature Compression for Efficient Activity Recognition Inference
Liu, C., Li, X., Chen, H., et al. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01337 · Cited by 7
Few-Shot Action Localization without Knowing Boundaries
Xie, T., Tzelepis, C., Fu, F., & Patras, I. (2021) · International Conference on Multimedia Retrieval · doi:10.1145/3460426.3463643 · Cited by 7
Khan, N., & Ahmad, Z. (2023) · doi:10.32920/22734332 · Cited by 3
Research works printed but not linked: 17
- 10.5555/3045118.3045336 · doi:10.5555/3045118.3045336
- Ballas, Delving deeper into convolutional networks for learning video representations, 1
- 10.1109/CVPR.2019.00033 · DOI
- 10.1109/AVSS.2019.8909840 · DOI
- Liu, Skepxels: Spatio-temporal image representation of human skeleton joints for action recognition, 10
- 10.1016/j.patrec.2009.11.017 · doi:10.1016/j.patrec.2009.11.017
- Shah, A spatio-temporal deep learning approach for human action recognition in infrared videos, 249
- Meglouli, 2019, A new technique based on 3D convolutional neural networks and filtering optical flow maps for action classification in infrared video, Control Eng. Appl. Inf., 21, 43
- Qi, PointNet++: Deep hierarchical feature learning on point sets in a metric space, 5105
- Berner, A 240 × 180 10mw 12us latency sparse-output vision sensor for mobile applications, C186
- 10.1109/ACPR.2017.136 · DOI
- 10.2991/cnci-19.2019.95 · doi:10.2991/cnci-19.2019.95
- 10.1109/TAES.2007.4441754 · doi:10.1109/taes.2007.4441754
- Stove, Modern FMCW radar-techniques and applications, 149
- 10.1007/978-981-15-4163-6_3 · doi:10.1007/978-981-15-4163-6_3
- 10.1109/ICIP.2017.8296630 · doi:10.1109/icip.2017.8296630
- Goyal, The “something something, 5843
Cited by
Object Detection Using Deep Learning, CNNs and Vision Transformers: A Review
Amjoud, A. B., & Amrouch, M. (2023) · IEEE Access · doi:10.1109/access.2023.3266093 · Cited by 318
Spatio-temporal segments attention for skeleton-based action recognition
Qiu, H., Hou, B., Ren, B., & Zhang, X. (2023) · Neurocomputing · doi:10.1016/j.neucom.2022.10.084 · Cited by 86
SkeletonMAE: Spatial-Temporal Masked Autoencoders for Self-Supervised Skeleton Action Recognition
Wu, W., Hua, Y., Zheng, C., Wu, S., Chen, C., & Lu, A. (2023) · 2023 IEEE International Conference on Multimedia and Expo Workshops (ICMEW) · doi:10.1109/icmew59549.2023.00045 · Cited by 60
Lamaakal, I., Yahyati, C., Maleh, Y., El Makkaoui, K., Ouahbi, I., El-Latif, A. A. A., Zomorodi, M., & El-Rahiem, B. A. (2025) · Scientific Reports · doi:10.1038/s41598-025-26297-2 · Cited by 26
Deep Learning for Skeleton-Based Human Activity Segmentation: An Autoencoder Approach
Hossen, M. A., Naim, A. G., & Abas, P. E. (2024) · Technologies · doi:10.3390/technologies12070096 · Cited by 7
Metadata
- Authors
- Sun, Z., Ke, Q., Rahmani, H., Bennamoun, M., Wang, G., & Liu, J.
- Venue
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- Published
- 2022
- Volume
- 45
- Issue
- 3
- Pages
- 1-20
- ISSN
- 0162-8828 (ISSN-L)
- 2160-9292
- 1939-3539
- OpenAlex
- W4282981352
- Cited by
- 601
- References
- 502
- FWCI
- 43.87
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.