The DOI matches its Crossref record.
Human Action Recognition by Representing 3D Skeletons as Points in a Lie Group
Abstract
Recently introduced cost-effective depth sensors coupled with the real-time skeleton estimation algorithm of Shotton et al. [16] have generated a renewed interest in skeleton-based human action recognition. Most of the existing skeleton-based approaches use either the joint locations or the joint angles to represent a human skeleton. In this paper, we propose a new skeletal representation that explicitly models the 3D geometric relationships between various body parts using rotations and translations in 3D space. Since 3D rigid body motions are members of the special Euclidean group SE(3), the proposed skeletal representation lies in the Lie group SE(3)×.. .×SE(3), which is a curved manifold. Using the proposed representation, human actions can be modeled as curves in this Lie group. Since classification of curves in this Lie group is not an easy task, we map the action curves from the Lie group to its Lie algebra, which is a vector space. We then perform classification using a combination of dynamic time warping, Fourier temporal pyramid representation and linear SVM. Experimental results on three action datasets show that the proposed representation performs better than many existing skeletal representations. The proposed approach also outperforms various state-of-the-art skeleton-based human action recognition approaches.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
No references could be resolved yet.
Research works printed but not linked: 27
- wang, 2012, Mining actionlet ensemble for action recognition with depth cameras, CVPR
- 10.1109/TIP.2009.2017143 · DOI
- 10.1109/CVPR.2013.123 · DOI · Paper page
- 10.1109/ICCV.2005.90 · DOI
- 10.1109/CVPR.2011.5995316 · DOI · Paper page
- 10.1109/CVPRW.2013.76 · DOI · Paper page
- 10.1109/CVPRW.2013.77 · DOI
- murray, 1994, A Mathematical Introduction to Robotic Manipulation
- 10.1109/CVPRW.2012.6239231 · DOI
- 10.1109/ICCV.1998.710709 · DOI
- 10.1109/CVPRW.2012.6239233 · DOI · Paper page
- yang, 2012, EigenJoints-based action recognition using n�ive-bayes-nearest-neighbor, cvprw
- 10.1007/978-3-642-44964-2_8 · DOI
- zatsiorsky, 1997, Kinematics of Human Motion
- 10.1109/ROBOT.1998.680708 · DOI
- zefran, 1996, Choice of riemannian metrics for rigid body kinematics, ASME Design Engineering Technical Conference and Computers in Engineering Conference
- 10.1109/CVPRW.2013.78 · DOI
- gavrila, 1995, Towards 3-D model-based tracking and recognition of human movement: A multiview approach, International workshop on Automatic Face and Gesture Recognition
- 10.1109/CVPRW.2013.153 · DOI
- 10.1007/978-3-540-74048-3 · DOI · Paper page
- 10.1145/1922649.1922653 · DOI · Paper page
- 10.1109/CVPRW.2010.5543273 · DOI · Paper page
- 10.3758/BF03212378 · DOI · Paper page
- hussein, 2013, Human action recognition using a temporal hierarchy of co-variance descriptors on 3D joint locations, IJCAI
- hall, 2003, Lie Groups Lie Algebras and Representations An Elementary Introduction, 10.1007/978-0-387-21554-9 · DOI · Paper page
- 10.1016/j.cviu.2006.08.002 · DOI · Paper page
- lv, 2006, Recognition and segmentation of 3D human action using HMM and multi-class adaboost, ECCV
Cited by
Spatial Temporal Graph Convolutional Networks for Skeleton-Based Action Recognition
Yan, S., Xiong, Y., & Lin, D. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.12328 · Cited by 5,410
NTU RGB+D: A Large Scale Dataset for 3D Human Activity Analysis
Shahroudy, A., Liu, J., Ng, T.-T., & Wang, G. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.115 · Cited by 3,148
A New Representation of Skeleton Sequences for 3D Action Recognition
Ke, Q., Bennamoun, M., An, S., Sohel, F., & Boussaid, F. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.486 · Cited by 793
Zhang, P., Lan, C., Xing, J., Zeng, W., Xue, J., & Zheng, N. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.233 · Cited by 691
View Adaptive Neural Networks for High Performance Skeleton-Based Human Action Recognition
Zhang, P., Lan, C., Xing, J., Zeng, W., Xue, J., & Zheng, N. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2896631 · Cited by 523
A Comprehensive Survey of Vision-Based Human Action Recognition Methods
Zhang, H.-B., Zhang, Y.-X., Zhong, B., Lei, Q., Yang, L., Du, J.-X., & Chen, D.-S. (2019) · Sensors · doi:10.3390/s19051005 · Cited by 503
Skeleton based action recognition with convolutional neural network
Du, Y., Fu, Y., & Wang, L. (2015) · 2015 3rd IAPR Asian Conference on Pattern Recognition (ACPR) · doi:10.1109/acpr.2015.7486569 · Cited by 445
Skeleton-based action recognition via spatial and temporal transformer networks
Plizzari, C., Cannici, M., & Matteucci, M. (2021) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2021.103219 · Cited by 409
Decoupling GCN with DropGraph Module for Skeleton-Based Action Recognition
Cheng, K., Zhang, Y., Cao, C., Shi, L., Cheng, J., & Lu, H. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58586-0_32 · Cited by 384
A survey of depth and inertial sensor fusion for human action recognition
Chen, C., Jafari, R., & Kehtarnavaz, N. (2017) · Multimedia Tools and Applications · doi:10.1007/s11042-015-3177-1 · Cited by 356
Spatiotemporal Co-Attention Recurrent Neural Networks for Human-Skeleton Motion Prediction
Shu, X., Zhang, L., Qi, G.-J., Liu, W., & Tang, J. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3050918 · Cited by 276
3D Human Action Representation Learning via Cross-View Consistency Pursuit
Li, L., Wang, M., Ni, B., Wang, H., Yang, J., & Zhang, W. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00471 · Cited by 236
“To tackle skeletonbased action recognition tasks, early approaches are generally based on hand-craft features [33, 52, 49, 50].”
BackgroundRao, H., Xu, S., Hu, X., Cheng, J., & Hu, B. (2021) · Information Sciences · doi:10.1016/j.ins.2021.04.023 · Cited by 235
MS2L: Multi-Task Self-Supervised Learning for Skeleton Based Action Recognition
Lin, L., Song, S., Yang, W., & Liu, J. (2020) · Proceedings of the 28th ACM International Conference on Multimedia · doi:10.1145/3394171.3413548 · Cited by 223
Unsupervised Representation Learning With Long-Term Dynamics for Skeleton Based Action Recognition
Zheng, N., Wen, J., Liu, R., Long, L., Dai, J., & Gong, Z. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11853 · Cited by 201
Guo, T., Liu, H., Chen, Z., Liu, M., Wang, T., & Ding, R. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i1.19957 · Cited by 202
Super Normal Vector for Human Activity Recognition with Depth Cameras
Yang, X., & Tian, Y. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2565479 · Cited by 162
Spatio-temporal segments attention for skeleton-based action recognition
Qiu, H., Hou, B., Ren, B., & Zhang, X. (2023) · Neurocomputing · doi:10.1016/j.neucom.2022.10.084 · Cited by 86
Unsupervised 3D Human Pose Representation with Viewpoint and Pose Disentanglement
Nie, Q., Liu, Z., & Liu, Y. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58529-7_7 · Cited by 80
Learning Multi-View Interactional Skeleton Graph for Action Recognition
Wang, M., Ni, B., & Yang, X. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.3032738 · Cited by 67
Multi-Modality Multi-Task Recurrent Neural Network for Online Action Detection
Liu, J., Li, Y., Song, S., Xing, J., Lan, C., & Zeng, W. (2019) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2018.2799968 · Cited by 62
SkeletonMAE: Spatial-Temporal Masked Autoencoders for Self-Supervised Skeleton Action Recognition
Wu, W., Hua, Y., Zheng, C., Wu, S., Chen, C., & Lu, A. (2023) · 2023 IEEE International Conference on Multimedia and Expo Workshops (ICMEW) · doi:10.1109/icmew59549.2023.00045 · Cited by 60
Li, Q., Lin, W., & Li, J. (2018) · Signal Processing: Image Communication · doi:10.1016/j.image.2018.06.013 · Cited by 19
View Enhanced Jigsaw Puzzle for Self-Supervised Feature Learning in 3D Human Action Recognition
You, W., & Wang, X. (2022) · IEEE Access · doi:10.1109/access.2022.3165040 · Cited by 6
Metadata
- Authors
- Vemulapalli, R., Arrate, F., & Chellappa, R.
- Venue
- 2014 IEEE Conference on Computer Vision and Pattern Recognition
- Publisher
- IEEE
- Published
- 2014-06
- Pages
- 588-595
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W2048821851
- Cited by
- 1,517
- References
- 0
- FWCI
- 58.38
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.