The DOI matches its Crossref record; 27 of the 27 references it cites were found in a registry or an index.
Co-Occurrence Feature Learning for Skeleton Based Action Recognition Using Regularized Deep LSTM Networks
Open accessAbstract
Skeleton based action recognition distinguishes human actions using the trajectories of skeleton joints, which provide a very good representation for describing actions. Considering that recurrent neural networks (RNNs) with Long Short-Term Memory (LSTM) can learn feature representations and model long-term temporal dependencies automatically, we propose an end-to-end fully connected deep LSTM network for skeleton based action recognition. Inspired by the observation that the co-occurrences of the joints intrinsically characterize human actions, we take the skeleton as the input at each time slot and introduce a novel regularization scheme to learn the co-occurrence features of skeleton joints. To train the deep LSTM network effectively, we propose a new dropout algorithm which simultaneously operates on the gates, cells, and output responses of the LSTM neurons. Experimental results on three human action recognition datasets consistently demonstrate the effectiveness of the proposed model.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
(2014) · Cited by 33,419
Smoothing and Differentiation of Data by Simplified Least Squares Procedures.
Savitzky, A., & Golay, M. J. E. (1964) · Analytical Chemistry · doi:10.1021/ac60214a047 · Cited by 21,904
Speech recognition with deep recurrent neural networks
Graves, A., Mohamed, A.-R., & Hinton, G. (2013) · 2013 IEEE International Conference on Acoustics, Speech and Signal Processing · doi:10.1109/icassp.2013.6638947 · Cited by 8,893 · cited 3×
“LSTM is an advanced RNN architecture which can learn long-range dependencies (Graves, Mohamed, and Hinton 2013).”
BackgroundMethodFramewise phoneme classification with bidirectional LSTM and other neural network architectures
Graves, A., & Schmidhuber, J. (2005) · Neural Networks · doi:10.1016/j.neunet.2005.06.042 · Cited by 5,839
Supervised Sequence Labelling with Recurrent Neural Networks
Graves, A. (2012) · Studies in Computational Intelligence · doi:10.1007/978-3-642-24797-2 · Cited by 3,120
A survey on vision-based human action recognition
Poppe, R. (2010) · Image and Vision Computing · doi:10.1016/j.imavis.2009.11.014 · Cited by 2,242
Recurrent Neural Network Regularization
Zaremba, W., Sutskever, I., & Vinyals, O. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1409.2329 · Cited by 2,123
Hierarchical recurrent neural network for skeleton based action recognition
Du, Y., Wang, W., & Wang, L. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298714 · Cited by 1,895
Cited by
Spatial Temporal Graph Convolutional Networks for Skeleton-Based Action Recognition
Yan, S., Xiong, Y., & Lin, D. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.12328 · Cited by 5,410
“These works have been using recurrent neural networks (Shahroudy et al. 2016; Zhu et al. 2016; Liu et al. 2016; Zhang, Liu, and Xiao 2017) and temporal CNNs (Li et al.”
BackgroundNTU RGB+D: A Large Scale Dataset for 3D Human Activity Analysis
Shahroudy, A., Liu, J., Ng, T.-T., & Wang, G. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.115 · Cited by 3,148
A review on the long short-term memory model
Van Houdt, G., Mosquera, C., & Nápoles, G. (2020) · Artificial Intelligence Review · doi:10.1007/s10462-020-09838-1 · Cited by 1,991
NTU RGB+D 120: A Large-Scale Benchmark for 3D Human Activity Understanding
Liu, J., Shahroudy, A., Perez, M., Wang, G., Duan, L.-Y., & Kot, A. C. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2916873 · Cited by 1,818
Spatio-Temporal LSTM with Trust Gates for 3D Human Action Recognition
Liu, J., Shahroudy, A., Xu, D., & Wang, G. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46487-9_50 · Cited by 1,351
An End-to-End Spatio-Temporal Attention Model for Human Action Recognition from Skeleton Data
Song, S., Lan, C., Xing, J., Zeng, W., & Liu, J. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.11212 · Cited by 977
Self-citationQuang, D., & Xie, X. (2016) · Nucleic Acids Research · doi:10.1093/nar/gkw226 · Cited by 853
Self-citationEnhanced skeleton visualization for view invariant human action recognition
Liu, M., Liu, H., & Chen, C. (2017) · Pattern Recognition · doi:10.1016/j.patcog.2017.02.030 · Cited by 842
A New Representation of Skeleton Sequences for 3D Action Recognition
Ke, Q., Bennamoun, M., An, S., Sohel, F., & Boussaid, F. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.486 · Cited by 793
“For all datasets, the clips are generated with all frames of the original skeleton sequence without any pre-processing such as normalization, temporal down-sampling or noise fil-tering.”
BackgroundMethodInfluentialHuman Action Recognition and Prediction: A Survey
Kong, Y., & Fu, Y. (2022) · International Journal of Computer Vision · doi:10.1007/s11263-022-01594-9 · Cited by 780
Zhang, P., Lan, C., Xing, J., Zeng, W., Xue, J., & Zheng, N. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.233 · Cited by 691
“A general treatment employs a pre-processing step to transform the 3D joint coordinates from the camera coordinate system to a personcentric coordinate system by placing the body center at the origin, followed by rotating the skeleton such that the body plane is parallel to the (x, y)-plane, to make the skeleton data…”
BackgroundMethodInfluentialSelf-citationInterpretable 3D Human Action Analysis with Temporal Convolutional Networks
Kim, T. S., & Reiter, A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2017.207 · Cited by 691
Global Context-Aware Attention LSTM Networks for 3D Action Recognition
Liu, J., Wang, G., Hu, P., Duan, L.-Y., & Kot, A. C. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.391 · Cited by 682
Semantics-Guided Neural Networks for Efficient Skeleton-Based Human Action Recognition
Zhang, P., Lan, C., Zeng, W., Xing, J., Xue, J., & Zheng, N. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00119 · Cited by 647
Self-citationHuman Action Recognition From Various Data Modalities: A Review
Sun, Z., Ke, Q., Rahmani, H., Bennamoun, M., Wang, G., & Liu, J. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3183112 · Cited by 601
Li, C., Zhong, Q., Xie, D., & Pu, S. (2018) · Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2018/109 · Cited by 582
Skeleton-Based Action Recognition Using Spatio-Temporal LSTM Network with Trust Gates
Liu, J., Shahroudy, A., Xu, D., Kot, A. C., & Wang, G. (2018) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2771306 · Cited by 530
View Adaptive Neural Networks for High Performance Skeleton-Based Human Action Recognition
Zhang, P., Lan, C., Xing, J., Zeng, W., Xue, J., & Zheng, N. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2896631 · Cited by 523
Self-citationFirst-Person Hand Action Benchmark with RGB-D Videos and 3D Hand Pose Annotations
Garcia-Hernando, G., Yuan, S., Baek, S., & Kim, T.-K. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00050 · Cited by 519
Wang, H., & Wang, L. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.387 · Cited by 463
Group sparse regularization for deep neural networks
Scardapane, S., Comminiello, D., Hussain, A., & Uncini, A. (2017) · Neurocomputing · doi:10.1016/j.neucom.2017.02.029 · Cited by 457
Pareek, P., & Thakkar, A. (2021) · Artificial Intelligence Review · doi:10.1007/s10462-020-09904-8 · Cited by 455
DeepLung: Deep 3D Dual Path Nets for Automated Pulmonary Nodule Detection and Classification
Zhu, W., Liu, C., Fan, W., & Xie, X. (2018) · 2018 IEEE Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv.2018.00079 · Cited by 449
Self-citationDeep Progressive Reinforcement Learning for Skeleton-Based Action Recognition
Tang, Y., Tian, Y., Lu, J., Li, P., & Zhou, J. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00558 · Cited by 444
SS-LSTM: A Hierarchical LSTM Model for Pedestrian Trajectory Prediction
Xue, H., Huynh, D. Q., & Reynolds, M. (2018) · 2018 IEEE Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv.2018.00135 · Cited by 433
Ensemble Deep Learning for Skeleton-Based Action Recognition Using Temporal Sliding LSTM Networks
Lee, I., Kim, D., Kang, S., & Lee, S. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.115 · Cited by 425
Núñez, J. C., Cabido, R., Pantrigo, J. J., Montemayor, A. S., & Vélez, J. F. (2018) · Pattern Recognition · doi:10.1016/j.patcog.2017.10.033 · Cited by 419
RGB-D-based human motion recognition with deep learning: A survey
Wang, P., Li, W., Ogunbona, P., Wan, J., & Escalera, S. (2018) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2018.04.007 · Cited by 402
Skeleton-Based Action Recognition with Spatial Reasoning and Temporal Stack Learning
Si, C., Jing, Y., Wang, W., Wang, L., & Tan, T. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01246-5_7 · Cited by 400
Action Recognition Based on Joint Trajectory Maps Using Convolutional Neural Networks
Wang, P., Li, Z., Hou, Y., & Li, W. (2016) · Proceedings of the 24th ACM international conference on Multimedia · doi:10.1145/2964284.2967191 · Cited by 383
MotionBERT: A Unified Perspective on Learning Human Motion Representations
Zhu, W., Ma, X., Liu, Z., Liu, L., Wu, W., & Wang, Y. (2023) · 2023 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01385 · Cited by 348
Self-citationSkeleton-based action recognition with convolutional neural networks
Li, C., Zhong, Q., Xie, D., & Pu, S. (2017) · 2017 IEEE International Conference on Multimedia & Expo Workshops (ICMEW) · doi:10.1109/icmew.2017.8026285 · Cited by 347
Space-time representation of people based on 3D skeletal data: A review
Han, F., Reily, B., Hoff, W., & Zhang, H. (2017) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2017.01.011 · Cited by 316
Yadav, S. K., Tiwari, K., Pandey, H. M., & Akbar, S. A. (2021) · Knowledge-Based Systems · doi:10.1016/j.knosys.2021.106970 · Cited by 311
On Geometric Features for Skeleton-Based Action Recognition Using Multilayer LSTM Networks
Zhang, S., Liu, X., & Xiao, J. (2017) · 2017 IEEE Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv.2017.24 · Cited by 310
Spatiotemporal Co-Attention Recurrent Neural Networks for Human-Skeleton Motion Prediction
Shu, X., Zhang, L., Qi, G.-J., Liu, W., & Tang, J. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3050918 · Cited by 276
Learning Clip Representations for Skeleton-Based 3D Action Recognition
Ke, Q., Bennamoun, M., An, S., Sohel, F., & Boussaid, F. (2018) · IEEE Transactions on Image Processing · doi:10.1109/tip.2018.2812099 · Cited by 270
Deep Multimodal Feature Analysis for Action Recognition in RGB+D Videos
Shahroudy, A., Ng, T.-T., Gong, Y., & Wang, G. (2018) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2691321 · Cited by 264
Adaptive stock trading strategies with deep reinforcement learning methods
Wu, X., Chen, H., Wang, J., Troiano, L., Loia, V., & Fujita, H. (2020) · Information Sciences · doi:10.1016/j.ins.2020.05.066 · Cited by 263
Host–Parasite: Graph LSTM-in-LSTM for Group Activity Recognition
Shu, X., Zhang, L., Sun, Y., & Tang, J. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.2978942 · Cited by 258
Spatio-Temporal Attention-Based LSTM Networks for 3D Action Recognition and Detection
Song, S., Lan, C., Xing, J., Zeng, W., & Liu, J. (2018) · IEEE Transactions on Image Processing · doi:10.1109/tip.2018.2818328 · Cited by 257
Self-citationLearning representations for the early detection of sepsis with deep neural networks
Kam, H. J., & Kim, H. Y. (2017) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2017.08.015 · Cited by 218
Quang, D., & Xie, X. (2019) · Methods · doi:10.1016/j.ymeth.2019.03.020 · Cited by 204
Self-citationUnsupervised Representation Learning With Long-Term Dynamics for Skeleton Based Action Recognition
Zheng, N., Wen, J., Liu, R., Long, L., Dai, J., & Gong, Z. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11853 · Cited by 201
“In past few years, end-to-end deep learning techniques (Sutskever, Vinyals, and Le 2014; LeCun, Bengio, and Hinton 2015), especially Recurrent Neural Networks (RNNs) have been used for action recognition and achieved impressively better performances (Du, Wang, and Wang 2015; Zhu et al. 2016).”
BackgroundMethodInfluentialAmbient Sensors for Elderly Care and Independent Living: A Survey
Uddin, M. Z., Khaksar, W., & Torresen, J. (2018) · Sensors · doi:10.3390/s18072027 · Cited by 166
Deep Fisher discriminant learning for mobile hand gesture recognition
Li, C., Xie, C., Zhang, B., Chen, C., & Han, J. (2018) · Pattern Recognition · doi:10.1016/j.patcog.2017.12.023 · Cited by 72
Unsupervised Feature Learning of Human Actions As Trajectories in Pose Embedding Manifold
Kundu, J. N., Gor, M., Uppala, P. K., & Radhakrishnan, V. B. (2019) · 2019 IEEE Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv.2019.00160 · Cited by 72
Multi-Modality Multi-Task Recurrent Neural Network for Online Action Detection
Liu, J., Li, Y., Song, S., Xing, J., Lan, C., & Zeng, W. (2019) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2018.2799968 · Cited by 62
Self-citationLearning Multi-View Interactional Skeleton Graph for Action Recognition
Wang, M., Ni, B., & Yang, X. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.3032738 · Cited by 67
Learning spatial-temporal features for video copy detection by the combination of CNN and RNN
Hu, Y., & Lu, X. (2018) · Journal of Visual Communication and Image Representation · doi:10.1016/j.jvcir.2018.05.013 · Cited by 57
Gait Neural Network for Human-Exoskeleton Interaction
Fang, B., Zhou, Q., Sun, F., Shan, J., Wang, M., Xiang, C., & Zhang, Q. (2020) · Frontiers in Neurorobotics · doi:10.3389/fnbot.2020.00058 · Cited by 39
Metadata
- Authors
- Zhu, W., Lan, C., Xing, J., Zeng, W., Li, Y., Shen, L., & Xie, X.
- Venue
- Proceedings of the AAAI Conference on Artificial Intelligence
- Published
- 2016-03-05
- Volume
- 30
- Issue
- 1
- ISSN
- 2159-5399 (ISSN-L)
- 2374-3468
- OpenAlex
- W2952587893
- Cited by
- 915
- References
- 27
- FWCI
- 40.41
- Type
- conference paper
- Language
- en
- Open access
- diamond
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.