The DOI matches its Crossref record; 48 of the 48 references it cites were found in a registry or an index.
Dynamic Multiscale Graph Neural Networks for 3D Skeleton Based Human Motion Prediction
Open accessAbstract
We propose novel dynamic multiscale graph neural networks (DMGNN) to predict 3D skeleton-based human motions. The core idea of DMGNN is to use a multiscale graph to comprehensively model the internal relations of a human body for motion feature learning. This multiscale graph is adaptive during training and dynamic across network layers. Based on this graph, we propose a multiscale graph computational unit (MGCU) to extract features at individual scales and fuse features across scales. The entire model is action-category-agnostic and follows an encoder-decoder framework. The encoder consists of a sequence of MGCUs to learn motion features. The decoder uses a proposed graph-based gate recurrent unit to generate future poses. Extensive experiments show that the proposed DMGNN outperforms state-of-the-art methods in both short and long-term predictions on the datasets of Human 3.6M and CMU Mocap. We further investigate the learned multiscale graphs for the interpretability. The codes could be downloaded from https://github.com/limaosen0/DMGNN.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Inductive Representation Learning on Large Graphs
Hamilton, W. L., Ying, R., & Leskovec, J. (2017) · arXiv · doi:10.48550/arxiv.1706.02216 · Cited by 10,639
Large-Scale Machine Learning with Stochastic Gradient Descent
Bottou, L. (2010) · Proceedings of COMPSTAT'2010 · doi:10.1007/978-3-7908-2604-3_16 · Cited by 5,795
Spatial Temporal Graph Convolutional Networks for Skeleton-Based Action Recognition
Yan, S., Xiong, Y., & Lin, D. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.12328 · Cited by 5,410 · cited 3×
“Graph deep learning: Graphs, expressing data associated with non-grid structures, preserve the dependencies among internal nodes [46, 40, 39].”
BackgroundMethodTargeted Branching for the Maximum Independent Set Problem Using Graph Neural Networks
Silva, G., Rodrigues, M., Teixeira, A., & Amorim, M. (2024) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.sea.2024.20 · Cited by 5,183
Advances In Deep Learning On Graphs (Gsp'18 Workshop)
Defferrard, M. (2016) · Figshare · doi:10.5281/zenodo.1286817 · Cited by 4,613
Human3.6M: Large Scale Datasets and Predictive Methods for 3D Human Sensing in Natural Environments
Ionescu, C., Papava, D., Olaru, V., & Sminchisescu, C. (2014) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.248 · Cited by 3,653 · cited 1×
“6M dataset [19] has 7 subjects performing 15 different classes of actions.”
BackgroundSocial LSTM: Human Trajectory Prediction in Crowded Spaces
Alahi, A., Goel, K., Ramanathan, V., Robicquet, A., Fei-Fei, L., & Savarese, S. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.110 · Cited by 3,483
Actional-Structural Graph Convolutional Networks for Skeleton-Based Action Recognition
Li, M., Chen, S., Chen, X., Zhang, Y., Wang, Y., & Tian, Q. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00371 · Cited by 1,230
Self-citationStructural-RNN: Deep Learning on Spatio-Temporal Graphs
Jain, A., Zamir, A. R., Savarese, S., & Saxena, A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.573 · Cited by 1,133
On Human Motion Prediction Using Recurrent Neural Networks
Martinez, J., Black, M. J., & Romero, J. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.497 · Cited by 984
Skeleton-Based Action Recognition With Directed Graph Neural Networks
Shi, L., Zhang, Y., Cheng, J., & Lu, H. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00810 · Cited by 930
Self-citationRecurrent Network Models for Human Dynamics
Fragkiadaki, K., Levine, S., Felsen, P., & Malik, J. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.494 · Cited by 860
Metrics for 3D Rotations: Comparison and Analysis
Huynh, D. Q. (2009) · Journal of Mathematical Imaging and Vision · doi:10.1007/s10851-009-0161-2 · Cited by 698
Modeling Human Motion Using Binary Latent Variables
Taylor, G. W., Hinton, G. E., & Roweis, S. T. (2007) · Advances in Neural Information Processing Systems 19 · doi:10.7551/mitpress/7503.003.0173 · Cited by 689
Anticipating Human Activities Using Object Affordances for Reactive Robotic Response
Koppula, H. S., & Saxena, A. (2016) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2015.2430335 · Cited by 596
Semantic Graph Convolutional Networks for 3D Human Pose Regression
Zhao, L., Peng, X., Tian, Y., Kapadia, M., & Metaxas, D. N. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00354 · Cited by 522
Learning Trajectory Dependencies for Human Motion Prediction
Mao, W., Liu, M., Salzmann, M., & Li, H. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00958 · Cited by 512
The Recurrent Temporal Restricted Boltzmann Machine
Sutskever, I., Hinton, G. E., & Taylor, G. W. (2008) · neural information processing systems · Cited by 465
Gaussian Process Dynamical Models
Wang, J., Hertzmann, A., & Blei, D. M. (2005) · Cited by 438
Deep Representation Learning for Human Motion Prediction and Classification
Butepage, J., Black, M. J., Kragic, D., & Kjellstrom, H. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.173 · Cited by 406
Skeleton-Based Action Recognition with Spatial Reasoning and Temporal Stack Learning
Si, C., Jing, Y., Wang, W., Wang, L., & Tan, T. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01246-5_7 · Cited by 400
Convolutional Sequence to Sequence Model for Human Dynamics
Li, C., Zhang, Z., Lee, W. S., & Lee, G. H. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00548 · Cited by 364
Factored conditional restricted Boltzmann Machines for modeling motion style
Taylor, G. W., & Hinton, G. E. (2009) · Proceedings of the 26th Annual International Conference on Machine Learning · doi:10.1145/1553374.1553505 · Cited by 358
The Pose Knows: Video Forecasting by Generating Pose Futures
Walker, J., Marino, K., Gupta, A., & Hebert, M. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.361 · Cited by 330
FeaStNet: Feature-Steered Graph Convolutions for 3D Shape Analysis
Verma, N., Boyer, E., & Verbeek, J. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00275 · Cited by 324
HP-GAN: Probabilistic 3D Human Motion Prediction via GAN
Barsoum, E., Kender, J., & Liu, Z. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2018.00191 · Cited by 322
Visual Dynamics: Probabilistic Future Frame Synthesis via Cross Convolutional Networks
Xue, T., Wu, J., Bouman, K. L., & Freeman, W. T. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1607.02586 · Cited by 320
Adversarial Geometry-Aware Human Motion Prediction
Gui, L.-Y., Wang, Y.-X., Liang, X., & Moura, J. M. F. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01225-0_48 · Cited by 276
Self-citationLong-Term On-board Prediction of People in Traffic Scenes Under Uncertainty
Bhattacharyya, A., Fritz, M., & Schiele, B. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00441 · Cited by 243
Symbiotic Graph Neural Networks for 3D Skeleton-Based Human Action Recognition and Motion Prediction
Li, M., Chen, S., Chen, X., Zhang, Y., Wang, Y., & Tian, Q. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3053765 · Cited by 240
Self-citationAction-Agnostic Human Pose Forecasting
Chiu, H.-K., Adeli, E., Wang, B., Huang, D.-A., & Niebles, J. C. (2019) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv.2019.00156 · Cited by 212
Learning Human Motion Models for Long-Term Predictions
Ghosh, P., Song, J., Aksan, E., & Hilliges, O. (2017) · 2017 International Conference on 3D Vision (3DV) · doi:10.1109/3dv.2017.00059 · Cited by 207
Learning Localized Generative Models for 3D Point Clouds via Graph Convolution
Valsesia, D., Fracastoro, G., & Magli, E. (2018) · International Conference on Learning Representations · Cited by 190
Efficient Nonlinear Markov Models for Human Motion
Lehrmann, A. M., Gehler, P. V., & Nowozin, S. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.171 · Cited by 187
A Neural Temporal Model for Human Motion Prediction
Gopalakrishnan, A., Mali, A., Kifer, D., Giles, L., & Ororbia, A. G. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.01239 · Cited by 185 · cited 2×
“Many methods, including the conventional state-based methods [25, 44, 38, 37, 36] and deep-network-based methods [9, 32, 10, 7, 12, 14, 11, 33, 43], have been proposed to Figure 1.”
BackgroundMethodQuaterNet: A Quaternion-based Recurrent Model for Human Motion
Pavllo, D., Grangier, D., & Auli, M. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1805.06485 · Cited by 174
Towards Natural and Accurate Future Motion Prediction of Humans and Animals
Liu, Z., Wu, S., Jin, S., Liu, Q., Lu, S., Zimmermann, R., & Li, C. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.01024 · Cited by 171
Learning Spatio-Temporal Structure from RGB-D Videos for Human Activity Detection and Anticipation
Koppula, H. S., & Saxena, A. (2013) · International Conference on Machine Learning · Cited by 169
Teaching Robots to Predict Human Motion
Gui, L.-Y., Zhang, K., Wang, Y.-X., Liang, X., Moura, J. M. F., & Veloso, M. (2018) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2018.8594452 · Cited by 138
Self-citation3D Pose from Motion for Cross-View Action Recognition via Non-linear Circulant Temporal Encoding
Gupta, A., Martínez, J., Little, J. J., & Woodham, R. J. (2014) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2014.333 · Cited by 134
Action-Reaction: Forecasting the Dynamics of Human Interaction
Huang, D.-A., & Kitani, K. (2014) · Lecture notes in computer science · doi:10.1007/978-3-319-10584-0_32 · Cited by 125
Imitation Learning for Human Pose Prediction
Wang, B., Adeli, E., Chiu, H.-K., Huang, D.-A., & Niebles, J. C. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00722 · Cited by 123
Human Motion Prediction via Learning Local Structure Representations and Temporal Dependencies
Guo, X. J., & Choi, J. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33012580 · Cited by 115
Spatio-Temporal Manifold Learning for Human Motions via Long-Horizon Modeling
Wang, H., Ho, E. S. L., Shum, H. P. H., & Zhu, Z. (2019) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2019.2936810 · Cited by 104
Learning Human Motion Models for Long-term PredictionsPreprint
Ghosh, P. S., Song, J., Aksan, E., & Hilliges, O. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1704.02827 · Cited by 37
3D Point Cloud Processing and Learning for Autonomous DrivingPreprint
Chen, S., Liu, B., Feng, C., Vallespi-Gonzalez, C., & Wellington, C. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.00601 · Cited by 31
Self-citationChen, T., Wang, Z., Li, L., Li, D., Li, Z., Chang, X., Bian, P., Liang, G., Wang, Q., & Xie, T. (2025) · Schloss Dagstuhl – Leibniz-Zentrum für Informatik · doi:10.4230/lipics.ecoop.2025.6
Cited by
A Survey of Graph Neural Networks for Recommender Systems: Challenges, Methods, and Directions
Gao, C., Zheng, Y., Li, N., Li, Y., Qin, Y., Piao, J., Quan, Y., Chang, J., Jin, D., He, X., et al. (2023) · ACM Transactions on Recommender Systems · doi:10.1145/3568022 · Cited by 1,082
MSR-GCN: Multi-Scale Residual Graph Convolution Networks for Human Motion Prediction
Dang, L., Nie, Y., Long, C., Zhang, Q., & Li, G. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01127 · Cited by 257
Bidirectional Transformer GAN for Long-term Human Motion Prediction
Zhao, M., Tang, H., Xie, P., Dai, S., Sebe, N., & Wang, W. (2023) · ACM Transactions on Multimedia Computing, Communications, and Applications · doi:10.1145/3579359 · Cited by 38
Directed Acyclic Graph Neural Network for Human Motion Prediction
Li, Q., Chalvatzaki, G., Peters, J., & Wang, Y. (2021) · 2021 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra48506.2021.9561540 · Cited by 29
Self-citationA spatio-temporal graph neural network for fall prediction with inertial sensors
Wang, S., Li, X., Liao, G., Liu, J., Liao, C., Liu, M., Liao, J., & Liu, L. (2024) · Knowledge-Based Systems · doi:10.1016/j.knosys.2024.111709 · Cited by 18
Metadata
- Authors
- Li, M., Chen, S., Zhao, Y., Zhang, Y., Wang, Y., & Tian, Q.
- Venue
- 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
- Publisher
- IEEE
- Published
- 2020-06
- Pages
- 211-220
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W3035545045
- Cited by
- 370
- References
- 48
- FWCI
- 89.95
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.