The DOI matches its Crossref record; 42 of the 42 references it cites were found in a registry or an index.
An Attention Enhanced Graph Convolutional LSTM Network for Skeleton-Based Action Recognition
Abstract
Skeleton-based action recognition is an important task that requires the adequate understanding of movement characteristics of a human action from the given skeleton sequence. Recent studies have shown that exploring spatial and temporal features of the skeleton sequence is vital for this task. Nevertheless, how to effectively extract discriminative spatial and temporal features is still a challenging problem. In this paper, we propose a novel Attention Enhanced Graph Convolutional LSTM Network (AGC-LSTM) for human action recognition from skeleton data. The proposed AGC-LSTM can not only capture discriminative features in spatial configuration and temporal dynamics but also explore the co-occurrence relationship between spatial and temporal domains. We also present a temporal hierarchical architecture to increase temporal receptive fields of the top AGC-LSTM layer, which boosts the ability to learn the high-level semantic representation and significantly reduces the computation cost. Furthermore, to select discriminative spatial information, the attention mechanism is employed to enhance information of key joints in each AGC-LSTM layer. Experimental results on two datasets are provided: NTU RGB+D dataset and Northwestern-UCLA dataset. The comparison results demonstrate the effectiveness of our approach and show that our approach outperforms the state-of-the-art methods on both datasets.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Learning Spatiotemporal Features with 3D Convolutional Networks
Tran, D., Bourdev, L., Fergus, R., Torresani, L., & Paluri, M. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.510 · Cited by 9,593
Realtime Multi-person 2D Pose Estimation Using Part Affinity Fields
Cao, Z., Simon, T., Wei, S.-E., & Sheikh, Y. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.143 · Cited by 7,539 · cited 1×
“Besides, the Microsoft Kinect [37] and advanced human pose estimation algorithms [2] make it easier to gain skeleton data.”
BackgroundTwo-Stream Convolutional Networks for Action Recognition in Videos
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1406.2199 · Cited by 6,756
Spatial Temporal Graph Convolutional Networks for Skeleton-Based Action Recognition
Yan, S., Xiong, Y., & Lin, D. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.12328 · Cited by 5,410
Visual perception of biological motion and a model for its analysis
Johansson, G. (1973) · Perception & Psychophysics · doi:10.3758/bf03212378 · Cited by 4,462
Temporal Segment Networks: Towards Good Practices for Deep Action Recognition
Wang, L., Xiong, Y., Wang, Z., Qiao, Y., Lin, D., Tang, X., & Van Gool, L. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46484-8_2 · Cited by 3,958
Self-citationFormal Semantics for Kolmogorov-Arnold Network Representations of Operational Games
Zhukov, G. A. (2025) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.5281/zenodo.15206559 · Cited by 3,212
NTU RGB+D: A Large Scale Dataset for 3D Human Activity Analysis
Shahroudy, A., Liu, J., Ng, T.-T., & Wang, G. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.115 · Cited by 3,148
Microsoft Kinect Sensor and Its Effect
Zhang, Z. (2012) · IEEE Multimedia · doi:10.1109/mmul.2012.24 · Cited by 2,487
Research works printed but not linked: 3
- kipf, 2017, Semi-supervised classification with graph convolutional networks, ICLRE
- duvenaud, 2015, Convolutional networks on graphs for learning molecular fingerprints, NIPS
- thakkar, 2018, Part-based graph convolutional network for action recognition, BMVC
Cited by
A review on the long short-term memory model
Van Houdt, G., Mosquera, C., & Nápoles, G. (2020) · Artificial Intelligence Review · doi:10.1007/s10462-020-09838-1 · Cited by 1,991
Disentangling and Unifying Graph Convolutions for Skeleton-Based Action Recognition
Liu, Z., Zhang, H., Chen, Z., Wang, Z., & Ouyang, W. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00022 · Cited by 1,225
Channel-wise Topology Refinement Graph Convolution for Skeleton-Based Action Recognition
Chen, Y., Zhang, Z., Yuan, C., Li, B., Deng, Y., & Hu, W. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01311 · Cited by 1,039
Skeleton-Based Action Recognition With Shift Graph Convolutional Network
Cheng, K., Zhang, Y., He, X., Chen, W., Cheng, J., & Lu, H. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00026 · Cited by 981
Self-citationHuman Action Recognition and Prediction: A Survey
Kong, Y., & Fu, Y. (2022) · International Journal of Computer Vision · doi:10.1007/s11263-022-01594-9 · Cited by 780
STGAT: Modeling Spatial-Temporal Interactions for Human Trajectory Prediction
Huang, Y., Bi, H., Li, Z., Mao, T., & Wang, Z. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00637 · Cited by 658
Semantics-Guided Neural Networks for Efficient Skeleton-Based Human Action Recognition
Zhang, P., Lan, C., Zeng, W., Xing, J., Xue, J., & Zheng, N. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00119 · Cited by 647
Human Action Recognition From Various Data Modalities: A Review
Sun, Z., Ke, Q., Rahmani, H., Bennamoun, M., Wang, G., & Liu, J. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3183112 · Cited by 601
Skeleton-Based Action Recognition With Multi-Stream Adaptive Graph Convolutional Networks
Shi, L., Zhang, Y., Cheng, J., & Lu, H. (2020) · IEEE Transactions on Image Processing · doi:10.1109/tip.2020.3028207 · Cited by 553
Constructing Stronger and Faster Baselines for Skeleton-Based Action Recognition
Song, Y.-F., Zhang, Z., Shan, C., & Wang, L. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3157033 · Cited by 528
Self-citationBhatti, U. A., Tang, H., Wu, G., Marjan, S., & Hussain, A. (2023) · International Journal of Intelligent Systems · doi:10.1155/2023/8342104 · Cited by 462
Pareek, P., & Thakkar, A. (2021) · Artificial Intelligence Review · doi:10.1007/s10462-020-09904-8 · Cited by 455
InfoGCN: Representation Learning for Human Skeleton-based Action Recognition
Chi, H.-G., Ha, M. H., Chi, S., Lee, S. W., Huang, Q., & Ramani, K. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01955 · Cited by 446
Skeleton-based action recognition via spatial and temporal transformer networks
Plizzari, C., Cannici, M., & Matteucci, M. (2021) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2021.103219 · Cited by 409
Decoupling GCN with DropGraph Module for Skeleton-Based Action Recognition
Cheng, K., Zhang, Y., Cao, C., Shi, L., Cheng, J., & Lu, H. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58586-0_32 · Cited by 384
Song, Y.-F., Zhang, Z., Shan, C., & Wang, L. (2020) · Proceedings of the 28th ACM International Conference on Multimedia · doi:10.1145/3394171.3413802 · Cited by 350
Self-citationMulti-Scale Spatial Temporal Graph Convolutional Network for Skeleton-Based Action Recognition
Chen, Z., Li, S., Yang, B., Li, Q., & Liu, H. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i2.16197 · Cited by 339
Hierarchically Decomposed Graph Convolutional Networks for Skeleton-Based Action Recognition
Lee, J., Lee, M., Lee, D., & Lee, S. (2023) · 2023 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00958 · Cited by 317
Attention, please! A survey of neural attention models in deep learning
de Santana Correia, A., & Colombini, E. L. (2022) · Artificial Intelligence Review · doi:10.1007/s10462-022-10148-x · Cited by 298
Skeleton Aware Multi-modal Sign Language Recognition
Jiang, S., Sun, B., Wang, L., Bai, Y., Li, K., & Fu, Y. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw53098.2021.00380 · Cited by 290
Self-citationGraph-Based Deep Learning for Medical Diagnosis and Analysis: Past, Present and Future
Ahmedt-Aristizabal, D., Armin, M. A., Denman, S., Fookes, C., & Petersson, L. (2021) · Sensors · doi:10.3390/s21144758 · Cited by 272
Decoupled Spatial-Temporal Attention Network for Skeleton-Based Action-Gesture Recognition
Shi, L., Zhang, Y., Cheng, J., & Lu, H. (2021) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-69541-5_3 · Cited by 262
MSR-GCN: Multi-Scale Residual Graph Convolution Networks for Human Motion Prediction
Dang, L., Nie, Y., Long, C., Zhang, Q., & Li, G. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01127 · Cited by 257
Richly Activated Graph Convolutional Network for Robust Skeleton-Based Action Recognition
Song, Y.-F., Zhang, Z., Shan, C., & Wang, L. (2021) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2020.3015051 · Cited by 254
Self-citationSpatiotemporal Co-Attention Recurrent Neural Networks for Human-Skeleton Motion Prediction
Shu, X., Zhang, L., Qi, G.-J., Liu, W., & Tang, J. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3050918 · Cited by 276
3D Human Action Representation Learning via Cross-View Consistency Pursuit
Li, L., Wang, M., Ni, B., Wang, H., Yang, J., & Zhang, W. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00471 · Cited by 236
“Many 3D action recognition works [6, 60, 17, 25, 44, 28, 16] use a fully-supervised manner and require massive labeled 3D skeleton data.”
BackgroundMethodRao, H., Xu, S., Hu, X., Cheng, J., & Hu, B. (2021) · Information Sciences · doi:10.1016/j.ins.2021.04.023 · Cited by 235
MS2L: Multi-Task Self-Supervised Learning for Skeleton Based Action Recognition
Lin, L., Song, S., Yang, W., & Liu, J. (2020) · Proceedings of the 28th ACM International Conference on Multimedia · doi:10.1145/3394171.3413548 · Cited by 223
Guo, T., Liu, H., Chen, Z., Liu, M., Wang, T., & Ding, R. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i1.19957 · Cited by 202
“In recent years, with the introduction of graph convolutional networks, a variety of GCN-based methods (Shi et al. 2019; Si et al. 2019; Chen et al. 2021) have emerged on the basis of ST-GCN (Yan, Xiong, and Lin 2018) to better model the spatio-temporal structure relationship.”
MethodSpatio-temporal segments attention for skeleton-based action recognition
Qiu, H., Hou, B., Ren, B., & Zhang, X. (2023) · Neurocomputing · doi:10.1016/j.neucom.2022.10.084 · Cited by 86
Unsupervised 3D Human Pose Representation with Viewpoint and Pose Disentanglement
Nie, Q., Liu, Z., & Liu, Y. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58529-7_7 · Cited by 80
Learning Multi-View Interactional Skeleton Graph for Action Recognition
Wang, M., Ni, B., & Yang, X. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.3032738 · Cited by 67
View Enhanced Jigsaw Puzzle for Self-Supervised Feature Learning in 3D Human Action Recognition
You, W., & Wang, X. (2022) · IEEE Access · doi:10.1109/access.2022.3165040 · Cited by 6
Metadata
- Authors
- Si, C., Chen, W., Wang, W., Wang, L., & Tan, T.
- Venue
- 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
- Publisher
- IEEE
- Published
- 2019-06
- Pages
- 1227-1236
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W2963465695
- Cited by
- 917
- References
- 42
- FWCI
- 40.73
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.