Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 67 of the 68 references it cites were found in a registry or an index.

Spatiotemporal Co-Attention Recurrent Neural Networks for Human-Skeleton Motion Prediction

Shu, Xiangbo, Zhang, Liyan, Qi, Guo-Jun, Liu, Wei, Tang, Jinhui · 2022 · IEEE Transactions on Pattern Analysis and Machine Intelligence

Abstract

Human motion prediction aims to generate future motions based on the observed human motions. Witnessing the success of Recurrent Neural Networks (RNN) in modeling sequential data, recent works utilize RNNs to model human-skeleton motions on the observed motion sequence and predict future human motions. However, these methods disregard the existence of the spatial coherence among joints and the temporal evolution among skeletons, which reflects the crucial characteristics of human motions in spatiotemporal space. To this end, we propose a novel Skeleton-Joint Co-Attention Recurrent Neural Networks (SC-RNN) to capture the spatial coherence among joints, and the temporal evolution among skeletons simultaneously on a skeleton-joint co-attention feature map in spatiotemporal space. First, a skeleton-joint feature map is constructed as the representation of the observed motion sequence. Second, we design a new Skeleton-Joint Co-Attention (SCA) mechanism to dynamically learn a skeleton-joint co-attention feature map of this skeleton-joint feature map, which can refine the useful observed motion information to predict one future motion. Third, a variant of GRU embedded with SCA collaboratively models the human-skeleton motion and human-joint motion in spatiotemporal space by regarding the skeleton-joint co-attention feature map as the motion context. Experimental results of human motion prediction demonstrate that the proposed method outperforms the competing methods.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1109/tpami.2021.3050918

Cites

67 of 67 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 68 references

Research works printed but not linked: 1

  1. Li, 2019, Symbiotic graph neural networks for 3d skeleton-based human action recognition and motion prediction, arXiv:1910.02212 · arXiv

Cited by

See all 310

Metadata

Authors
Shu, X., Zhang, L., Qi, G.-J., Liu, W., & Tang, J.
Affiliations
  • Nanjing University of Science and Technology (CN)
  • Nanjing University of Aeronautics and Astronautics (CN)
  • Huawei Cloud, Bellevue, WA, USA
  • Tencent (China) (CN)
Venue
IEEE Transactions on Pattern Analysis and Machine Intelligence
Published
2022-06-01
Volume
44
Issue
6
Pages
3300-3315
ISSN
  • 0162-8828 (ISSN-L)
  • 2160-9292
  • 1939-3539
OpenAlex
W2976669726
Cited by
276
References
68
Citations by year
2026: 21 · 2025: 49 · 2024: 33 · 2023: 73 · 2022: 67
FWCI
22.35
Type
journal article
Language
en
Open access
closed
Locations
  • IEEE Transactions on Pattern Analysis and Machine Intelligence (publishedVersion)
  • PubMed (publishedVersion)
Funders
  • National Key Research and Development Program of China (2018AAA0102001)
  • National Natural Science Foundation of China (61925204, 62072245, 61772268)
  • Natural Science Foundation of Jiangsu Province (BK20190065)
  • Qing Lan Project of Jiangsu Province
Topics
  • Physical Sciences › Computer Science › Computer Graphics and Computer-Aided Design › Human Motion and Animation
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Human Pose and Action Recognition
  • Physical Sciences › Computer Science › Computer Graphics and Computer-Aided Design › 3D Shape Modeling and Analysis
Keywords
human motion prediction, co-attention, spatio-temporal modeling, GRU
MeSH terms
Algorithms, Attention, Humans, Motion, Skeleton, Neural Networks, Computer

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Spatiotemporal Co-Attention Recurrent Neural Networks for Human-Skeleton Motion Prediction. https://app.cochat.ai/papers/10.1109/tpami.2021.3050918
The paper
Shu, X., Zhang, L., Qi, G.-J., Liu, W., & Tang, J. (2022). Spatiotemporal Co-Attention Recurrent Neural Networks for Human-Skeleton Motion Prediction. IEEE Transactions on Pattern Analysis and Machine Intelligence. https://doi.org/10.1109/tpami.2021.3050918

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.