The DOI matches its Crossref record; 39 of the 39 references it cites were found in a registry or an index.
Hierarchical recurrent neural network for skeleton based action recognition
Abstract
Human actions can be represented by the trajectories of skeleton joints. Traditional methods generally model the spatial structure and temporal dynamics of human skeleton with hand-crafted features and recognize human actions by well-designed classifiers. In this paper, considering that recurrent neural network (RNN) can model the long-term contextual information of temporal sequences well, we propose an end-to-end hierarchical RNN for skeleton based action recognition. Instead of taking the whole skeleton as the input, we divide the human skeleton into five parts according to human physical structure, and then separately feed them to five subnets. As the number of layers increases, the representations extracted by the subnets are hierarchically fused to be the inputs of higher layers. The final representations of the skeleton sequences are fed into a single-layer perceptron, and the temporally accumulated output of the perceptron is the final decision. We compare with five other deep RNN architectures derived from our model to verify the effectiveness of the proposed network, and also compare with several other methods on three publicly available datasets. Experimental results demonstrate that our model achieves the state-of-the-art performance with high computational efficiency.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
Smoothing and Differentiation of Data by Simplified Least Squares Procedures.
Savitzky, A., & Golay, M. J. E. (1964) · Analytical Chemistry · doi:10.1021/ac60214a047 · Cited by 21,904
Bidirectional recurrent neural networks
Schuster, M., & Paliwal, K. K. (1997) · IEEE Transactions on Signal Processing · doi:10.1109/78.650093 · Cited by 10,172
Speech recognition with deep recurrent neural networks
Graves, A., Mohamed, A.-R., & Hinton, G. (2013) · 2013 IEEE International Conference on Acoustics, Speech and Signal Processing · doi:10.1109/icassp.2013.6638947 · Cited by 8,893
Supervised Sequence Labelling with Recurrent Neural Networks
Graves, A. (2012) · Studies in Computational Intelligence · doi:10.1007/978-3-642-24797-2 · Cited by 3,120
Recurrent Neural Network Regularization
Zaremba, W., Sutskever, I., & Vinyals, O. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1409.2329 · Cited by 2,123
Real-time human pose recognition in parts from single depth images
Shotton, J., Sharp, T., Kipman, A., Fitzgibbon, A., Finocchio, M., Blake, A., Cook, M., & Moore, R. (2013) · Communications of the ACM · doi:10.1145/2398356.2398381 · Cited by 2,044
Towards End-To-End Speech Recognition with Recurrent Neural Networks
Graves, A., & Jaitly, N. (2014) · Cited by 1,861
Human Action Recognition by Representing 3D Skeletons as Points in a Lie Group
Vemulapalli, R., Arrate, F., & Chellappa, R. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.82 · Cited by 1,517
Mining actionlet ensemble for action recognition with depth cameras
Wang, J., Liu, Z., Wu, Y., & Yuan, J. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6247813 · Cited by 1,512
View invariant human action recognition using histograms of 3D joints
Xia, L., Chen, C.-C., & Aggarwal, J. K. (2012) · 2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops · doi:10.1109/cvprw.2012.6239233 · Cited by 1,452
Action recognition based on a bag of 3D points
Li, W., Zhang, Z., & Liu, Z. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops · doi:10.1109/cvprw.2010.5543273 · Cited by 1,428
Gradient Flow in Recurrent Nets: The Difficulty of Learning LongTerm Dependencies
(2009) · A Field Guide to Dynamical Recurrent Networks · doi:10.1109/9780470544037.ch14 · Cited by 1,246
Practical Variational Inference for Neural Networks
Graves, A. (2011) · Cited by 1,078
Joint Training of a Convolutional Network and a Graphical Model for Human Pose Estimation
Tompson, J., Jain, A., LeCun, Y., & Bregler, C. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1406.2984 · Cited by 915
Sequential Deep Learning for Human Action Recognition
Baccouche, M., Mamalet, F., Wolf, C., Garcia, C., & Baskurt, A. (2011) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-25446-8_4 · Cited by 782
Berkeley MHAD: A comprehensive Multimodal Human Action Database
Ofli, F., Chaudhry, R., Kurillo, G., Vidal, R., & Bajcsy, R. (2013) · 2013 IEEE Workshop on Applications of Computer Vision (WACV) · doi:10.1109/wacv.2013.6474999 · Cited by 484
Zanfir, M., Leordeanu, M., & Sminchisescu, C. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.342 · Cited by 438
Super Normal Vector for Activity Recognition Using Depth Sequences
Yang, X., & Tian, Y. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.108 · Cited by 388
Documentation Mocap Database HDM05
Müller, M., Röder, T., Clausen, M. V., Eberhardt, B., Krüger, B., & Weber⋆, A. (2007) · Cited by 378
An Approach to Pose-Based Action Recognition
Wang, C., Wang, Y., & Yuille, A. L. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.123 · Cited by 373
Recognition and Segmentation of 3-D Human Action Using HMM and Multi-class AdaBoost
Lv, F., & Nevatia, R. (2006) · Lecture Notes in Computer Science · doi:10.1007/11744085_28 · Cited by 351
Ofli, F., Chaudhry, R., Kurillo, G., Vidal, R., & Bajcsy, R. (2014) · Journal of Visual Communication and Image Representation · doi:10.1016/j.jvcir.2013.04.007 · Cited by 318
Real-time human action recognition based on depth motion maps
Chen, C., Liu, K., & Kehtarnavaz, N. (2016) · Journal of Real-Time Image Processing · doi:10.1007/s11554-013-0370-1 · Cited by 314
A Survey on Human Motion Analysis from Depth Data
Ye, M., Zhang, Q., Wang, L., Zhu, J., Yang, R., & Gall, J. (2013) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-44964-2_8 · Cited by 213
Self-citationWu, D., & Shao, L. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.98 · Cited by 211
Prediction of Human Activity by Discovering Temporal Sequence Patterns
Li, K., & Fu, Y. (2014) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.2297321 · Cited by 208
Group Sparsity and Geometry Constrained Dictionary Learning for Action Recognition from Depth Maps
Luo, J., Wang, W., & Qi, H. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.227 · Cited by 204
Self-citationBio-inspired Dynamic 3D Discriminative Skeletal Features for Human Action Recognition
Chaudhry, R., Ofli, F., Kurillo, G., Bajcsy, R., & Vidal, R. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition Workshops · doi:10.1109/cvprw.2013.153 · Cited by 179
Gowayyed, M. A., Torki, M., Hussein, M. E., & El-Saban, M. (2013) · Cited by 172
Evolving deep unsupervised convolutional networks for vision-based reinforcement learning
Koutník, J., Schmidhuber, J., & Gomez, F. J. (2014) · Genetic and Evolutionary Computation Conference (GECCO) · doi:10.1145/2576768.2598358 · Cited by 115
Structured Time Series Analysis for Human Action Segmentation and Recognition
Gong, D., Medioni, G. G., & Zhao, X. (2014) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.244 · Cited by 111
Robust human action recognition via long short-term memory
Grushin, A., Monner, D. D., Reggia, J. A., & Mishra, A. (2013) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2013.6706797 · Cited by 83
BLSTM-RNN Based 3D Gesture Classification
Lefebvre, G., Berlemont, S., Mamalet, F., & García, C. (2013) · Lecture notes in computer science · doi:10.1007/978-3-642-40728-4_48 · Cited by 80
Classifying and Visualizing Motion Capture Sequences using Deep Neural Networks
Cho, K., & Chen, X. (2014) · International Conference on Computer Vision Theory and Applications · doi:10.5220/0004718301220130 · Cited by 74
Action recognition on motion capture data using a dynemes and forward differences representation
Kapsouras, I., & Nikolaidis, N. (2014) · Journal of Visual Communication and Image Representation · doi:10.1016/j.jvcir.2014.04.007 · Cited by 72
López, J. R. P., Chaaraoui, A. A., & Flórez‐Revuelta, F. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1407.7390 · Cited by 42
Action recognition from motion capture data using Meta-Cognitive RBF Network classifier
Vantigodi, S., & Babu, R. V. (2014) · International Conference on Intelligent Sensors, Sensor Networks and Information Processing · doi:10.1109/issnip.2014.6827664 · Cited by 30
Real-time human action recognition from motion capture data
Vantigodi, S., & Babu, R. V. (2013) · National Conference on Computer Vision, Pattern Recognition, Image Processing and Graphics (NCVPRIPG) · doi:10.1109/ncvpripg.2013.6776204 · Cited by 29
Cited by
Spatial Temporal Graph Convolutional Networks for Skeleton-Based Action Recognition
Yan, S., Xiong, Y., & Lin, D. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.12328 · Cited by 5,410
“All rights reserved. attempt to leverage the natural connections between joints have been developed (Shahroudy et al. 2016; Du, Wang, and Wang 2015).”
BackgroundDeep Learning in Remote Sensing: A Comprehensive Review and List of Resources
Zhu, X. X., Tuia, D., Mou, L., Xia, G.-S., Zhang, L., Xu, F., & Fraundorfer, F. (2017) · IEEE Geoscience and Remote Sensing Magazine · doi:10.1109/mgrs.2017.2762307 · Cited by 3,400
NTU RGB+D: A Large Scale Dataset for 3D Human Activity Analysis
Shahroudy, A., Liu, J., Ng, T.-T., & Wang, G. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.115 · Cited by 3,148
Social GAN: Socially Acceptable Trajectories with Generative Adversarial Networks
Gupta, A., Johnson, J., Fei-Fei, L., Savarese, S., & Alahi, A. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00240 · Cited by 2,466
Two-Stream Adaptive Graph Convolutional Networks for Skeleton-Based Action Recognition
Shi, L., Zhang, Y., Cheng, J., & Lu, H. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.01230 · Cited by 2,071
Metadata
- Authors
- Du, Y., Wang, W., & Wang, L.
- Venue
- 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
- Publisher
- IEEE
- Published
- 2015-06
- Pages
- 1110-1118
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W1950788856
- Cited by
- 1,895
- References
- 39
- FWCI
- 62.77
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.