The DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.
Skeleton-Based Online Action Prediction Using Scale Selection Network
Open accessAbstract
Action prediction is to recognize the class label of an ongoing activity when only a part of it is observed. In this paper, we focus on online action prediction in streaming 3D skeleton sequences. A dilated convolutional network is introduced to model the motion dynamics in temporal dimension via a sliding window over the temporal axis. Since there are significant temporal scale variations in the observed part of the ongoing action at different time steps, a novel window scale selection method is proposed to make our network focus on the performed part of the ongoing action and try to suppress the possible incoming interference from the previous actions at each step. An activation sharing scheme is also proposed to handle the overlapping computations among the adjacent time steps, which enables our framework to run more efficiently. Moreover, to enhance the performance of our framework for action prediction with the skeletal input data, a hierarchy of dilated tree convolutions are also designed to learn the multi-level structured semantic representations over the skeleton joints at each frame. Our proposed approach is evaluated on four challenging datasets. The extensive experiments demonstrate the effectiveness of our method for skeleton-based online action prediction.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Feature Pyramid Networks for Object Detection
Lin, T.-Y., Dollar, P., Girshick, R., He, K., Hariharan, B., & Belongie, S. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.106 · Cited by 30,939
Identity mappings in deep residual networks
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46493-0_38 · Cited by 10,741
Identity Mappings in Deep Residual Networks
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · arXiv · doi:10.48550/arxiv.1603.05027 · Cited by 10,665
Multi-scale context aggregation by dilated convolutions
Yu, F., & Koltun, V. (2015) · arXiv · doi:10.48550/arxiv.1511.07122 · Cited by 7,738
WaveNet: a generative model for raw audio
Oord, A. V. D., Dieleman, S., Zen, H., Simonyan, K., Vinyals, O., Graves, A., Kalchbrenner, N., Senior, A., & Kavukcuoglu, K. (2016) · arXiv · doi:10.48550/arxiv.1609.03499 · Cited by 4,911
Temporal Convolutional Networks for Action Segmentation and Detection
Lea, C., Flynn, M. D., Vidal, R., Reiter, A., & Hager, G. D. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.113 · Cited by 2,238 · cited 1×
“Beside the online action prediction task, the problem of temporal action detection [22], [56], [56], [57], [58], [59], [60], [61], [62], [63],”
BackgroundA New Representation of Skeleton Sequences for 3D Action Recognition
Ke, Q., Bennamoun, M., An, S., Sohel, F., & Boussaid, F. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.486 · Cited by 793
Zhang, P., Lan, C., Xing, J., Zeng, W., Xue, J., & Zheng, N. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.233 · Cited by 691
End-to-End Learning of Action Detection from Frame Glimpses in Videos
Yeung, S., Russakovsky, O., Mori, G., & Fei-Fei, L. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.293 · Cited by 585
Research works printed but not linked: 76
- 10.1145/2522848.2532595 · DOI · Paper page
- 10.1109/CVPR.2018.00871 · DOI
- 10.1109/WACV.2017.29 · DOI
- 10.1109/CVPR.2016.119 · DOI · Paper page
- dauphin, 2017, Language modeling with gated convolutional networks, Proc Int Conf Mach Learn
- 10.1109/TPAMI.2017.2712608 · DOI · Paper page
- lecun, 1995, Convolutional networks for images, speech, and time series, The Handbook of Brain Theory and Neural Networks
- zhu, 2016, Co-occurrence feature learning for skeleton based action recognition using regularized deep lstm networks, Proc 13th AAAI Conf Artif Intell, 3697
- 10.1016/B978-0-12-813445-0.00005-8 · DOI
- 10.1109/CVPRW.2012.6239234 · DOI · Paper page
- 10.1109/ICPR.2014.772 · DOI · Paper page
- 10.1109/TPAMI.2015.2505295 · DOI
- 10.1109/CVPR.2014.82 · DOI · Paper page
- 10.1007/978-3-319-46478-7_23 · DOI
- 10.1109/CVPRW.2012.6239233 · DOI · Paper page
- 10.1109/TPAMI.2016.2640292 · DOI · Paper page
- yu, 2014, Discriminative orderlet mining for real-time recognition of human-object interaction, Proc Asian Conf Comput Vis, 50
- 10.1109/ICCV.2017.610 · DOI · Paper page
- 10.5244/C.31.92 · DOI · Paper page
- 10.1109/WACV.2015.138 · DOI
- 10.1109/CVPR.2017.155 · DOI · Paper page
- 10.1016/j.jvcir.2013.03.001 · DOI · Paper page
- 10.5244/C.31.52 · DOI · Paper page
- 10.1016/j.patcog.2016.05.019 · DOI · Paper page
- 10.1109/CVPR.2017.678 · DOI · Paper page
- 10.1109/ICCV.2017.317 · DOI · Paper page
- 10.1109/TPAMI.2013.198 · DOI · Paper page
- 10.1007/978-3-319-46478-7_13 · DOI · Paper page
- li, 2017, Skeleton boxes: Solving skeleton based action detection with a single deep convolutional neural network, ArXiv
- 10.1109/WACV.2017.25 · DOI
- 10.1109/CVPR.2013.343 · DOI · Paper page
- 10.1007/978-3-319-46448-0_17 · DOI
- 10.1109/CVPR.2006.200 · DOI · Paper page
- 10.1109/TPAMI.2008.260 · DOI · Paper page
- 10.1109/ICCV.2013.342 · DOI · Paper page
- 10.5244/C.25.65 · DOI
- 10.1016/j.patrec.2014.04.011 · DOI · Paper page
- 10.1007/s11263-013-0683-3 · DOI · Paper page
- 10.1007/978-3-319-10602-1_39 · doi:10.1007/978-3-319-10602-1_39
- 10.1109/ICCV.2011.6126349 · DOI · Paper page
- 10.1109/ICCV.2013.389 · DOI
- 10.1007/978-3-642-33718-5_21 · DOI
- 10.1109/TMM.2017.2778559 · DOI
- 10.1109/TPAMI.2013.2297321 · DOI · Paper page
- 10.1109/ICCV.2015.365 · DOI
- 10.1016/j.patcog.2015.11.019 · DOI · Paper page
- 10.1109/ICCV.2015.460 · DOI · Paper page
- 10.1109/CVPR.2016.115 · DOI · Paper page
- 10.1109/TPAMI.2017.2771306 · DOI · Paper page
- 10.1109/ICIP.2017.8296967 · doi:10.1109/icip.2017.8296967
- 10.1109/WACV.2017.24 · DOI · Paper page
- 10.1109/TIP.2017.2785279 · DOI · Paper page
- 10.1109/ICCV.2017.621 · DOI
- liu, 2017, Manifold warp segmentation of human action, IEEE Trans Neural Netw Learn Syst, 1414
- 10.1109/WACV.2014.6836044 · DOI
- liu, 2017, Pku-mmd: A large scale benchmark for continuous multi-modal human action understanding, ArXiv
- du, 2015, Hierarchical recurrent neural network for skeleton based action recognition, Proc IEEE Conf Comput Vis Pattern Recognit, 1110
- 10.1109/ICCV.2015.169 · DOI · Paper page
- 10.1007/978-3-319-46487-9_50 · DOI · Paper page
- 10.1109/CVPR.2017.390 · DOI · Paper page
- 10.1007/978-3-319-48881-3_28 · DOI
- 10.3758/BF03212378 · DOI · Paper page
- 10.1109/CVPR.2017.391 · DOI · Paper page
- han, 2013, Enhanced computer vision with microsoft kinect sensor: A review, IEEE Trans Cybern, 43, 1318, 10.1109/TCYB.2013.2265378 · DOI · Paper page
- collobert, 2011, Torch7: A matlab-like environment for machine learning, Proc NIPSW
- 10.24963/ijcai.2017/342 · DOI
- 10.1109/CVPRW.2012.6239175 · DOI · Paper page
- ioffe, 2015, Batch normalization: Accelerating deep network training by reducing internal covariate shift, Proc 32nd Int Conf Mach Learn, 448
- 10.1016/j.cviu.2017.01.011 · DOI · Paper page
- 10.1145/2964284.2967191 · DOI · Paper page
- 10.1109/CVPR.2017.137 · DOI · Paper page
- 10.1109/ACPR.2015.7486569 · DOI · Paper page
- 10.1109/CVPRW.2017.207 · DOI · Paper page
- li, 2018, Spatio-temporal graph convolution for skeleton based action recognition, ArXiv
- 10.1109/LSP.2017.2690339 · DOI · Paper page
- yan, 2018, Spatial temporal graph convolutional networks for skeleton-based action recognition, ArXiv
Cited by
Human Action Recognition From Various Data Modalities: A Review
Sun, Z., Ke, Q., Rahmani, H., Bennamoun, M., Wang, G., & Liu, J. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3183112 · Cited by 601
Self-citationConstructing Stronger and Faster Baselines for Skeleton-Based Action Recognition
Song, Y.-F., Zhang, Z., Shan, C., & Wang, L. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3157033 · Cited by 528
Decoupling GCN with DropGraph Module for Skeleton-Based Action Recognition
Cheng, K., Zhang, Y., Cao, C., Shi, L., Cheng, J., & Lu, H. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58586-0_32 · Cited by 384
Dynamic GCN: Context-enriched Topology Learning for Skeleton-based Action Recognition
Ye, F., Pu, S., Zhong, Q., Li, C., Xie, D., & Tang, H. (2020) · Proceedings of the 28th ACM International Conference on Multimedia · doi:10.1145/3394171.3413941 · Cited by 341
Skeleton Image Representation for 3D Action Recognition Based on Tree Structure and Reference Joints
Caetano, C., Bremond, F., & Schwartz, W. R. (2019) · 2019 32nd SIBGRAPI Conference on Graphics, Patterns and Images (SIBGRAPI) · doi:10.1109/sibgrapi.2019.00011 · Cited by 149
Metadata
- Authors
- Liu, J., Shahroudy, A., Wang, G., Duan, L.-Y., & Kot, A. C.
- Venue
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- Published
- 2020-06-01
- Volume
- 42
- Issue
- 6
- Pages
- 1453-1467
- ISSN
- 0162-8828 (ISSN-L)
- 2160-9292
- 1939-3539
- OpenAlex
- W2914177721
- Cited by
- 169
- References
- 11
- FWCI
- 13.30
- Type
- journal article
- Language
- en
- Open access
- green
- Licence
- Funders
- National Research Foundation Singapore
- Infocomm Media Development Authority, Singapore
- National Basic Research Program of China (2015CB351806)
- National Natural Science Foundation of China (61661146005, U1611461)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Skeleton-Based Online Action Prediction Using Scale Selection Network. https://app.cochat.ai/papers/10.1109/tpami.2019.2898954
- The paper
- Liu, J., Shahroudy, A., Wang, G., Duan, L.-Y., & Kot, A. C. (2020). Skeleton-Based Online Action Prediction Using Scale Selection Network. IEEE Transactions on Pattern Analysis and Machine Intelligence. https://doi.org/10.1109/tpami.2019.2898954
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.