CoChat
Sign Up
PreprintCited by 123D Shape Modeling and AnalysisHuman Motion and AnimationComputer Graphics and Visualization Techniques

The DOI matches its DataCite record.

HumanRig: Learning Automatic Rigging for Humanoid Character in a Large Scale Dataset

Open access
Chu, Zedong, Xiong, Feng, Liu, Meiduo, Zhang, Jinzhi, Shao, Mingqi, Sun, Zhaoxu, Wang, Di, Xu, Mu·2024·arXiv
DOI 10.48550/arxiv.2412.02317arXiv 2412.02317
Open this paper in CoChat — free accountOpen PDF

Abstract

With the rapid evolution of 3D generation algorithms, the cost of producing 3D humanoid character models has plummeted, yet the field is impeded by the lack of a comprehensive dataset for automatic rigging, which is a pivotal step in character animation. Addressing this gap, we present HumanRig, the first large-scale dataset specifically designed for 3D humanoid character rigging, encompassing 11,434 meticulously curated T-posed meshes adhered to a uniform skeleton topology. Capitalizing on this dataset, we introduce an innovative, data-driven automatic rigging framework, which overcomes the limitations of GNN-based methods in handling complex AI-generated meshes. Our approach integrates a Prior-Guided Skeleton Estimator (PGSE) module, which uses 2D skeleton joints to provide a preliminary 3D skeleton, and a Mesh-Skeleton Mutual Attention Network (MSMAN) that fuses skeleton features with 3D mesh features extracted by a U-shaped point transformer. This enables a coarse-to-fine 3D skeleton joint regression and a robust skinning estimation, surpassing previous methods in quality and versatility. This work not only remedies the dataset deficiency in rigging research but also propels the animation industry towards more efficient and automated character rigging pipelines.

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.2412.02317

Cites

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

No references could be resolved yet.

Research works printed but not linked: 28

  1. Ilya Baran and Jovan Popović. Automatic rigging and anima- tion of 3d characters. ACM Transactions on graphics (TOG), 26(3):72-es, 2007. 2, 7
  2. Bharat Lal Bhatnagar, Garvita Tiwari, Christian Theobalt, and Gerard Pons-Moll. Multi-garment net: Learning to dress 3d people from images. In IEEE International Conference on Computer Vision (ICCV). IEEE, 2019. 2
  3. Sue Blackman and Sue Blackman. Rigging with mixamo. Unity for Absolute Beginners, pages 565-573, 2014. 3
  4. Olivier Dionne and Martin De Lasa. Geodesic binding for degenerate character geometry using sparse voxelization. IEEE transactions on visualization and computer graphics, 20(10):1367-1378, 2014. 7
  5. Will Hamilton, Zhitao Ying, and Jure Leskovec. Inductive representation learning on large graphs. Advances in neural information processing systems, 30, 2017. 6, 7
  6. Rana Hanocka, Amir Hertz, Noa Fish, Raja Giryes, Shachar Fleishman, and Daniel Cohen-Or. Meshcnn: a network with an edge. ACM Transactions on Graphics (ToG), 38(4):1-12, 2019. 2
  7. Alec Jacobson, Ilya Baran, Jovan Popovic, and Olga Sorkine. Bounded biharmonic weights for real-time deformation. ACM Trans. Graph., 30(4):78, 2011.
  8. Tao Jiang, Peng Lu, Li Zhang, Ningsheng Ma, Rui Han, Chengqi Lyu, Yining Li, and Kai Chen. Rtmpose: Real- time multi-person pose estimation based on mmpose. arXiv preprint arXiv:2303.07399, 2023. 4, 5 · arXiv
  9. Ladislav Kavan and Olga Sorkine. Elasticity-inspired de- formers for character articulation. ACM Transactions on Graphics (TOG), 31(6):1-8, 2012. 2
  10. Peizhuo Li, Kfir Aberman, Rana Hanocka, Libin Liu, Olga Sorkine-Hornung, and Baoquan Chen. Learning skeletal ar- ticulations with neural blend shapes. ACM Transactions on Graphics (TOG), 40(4):1-15, 2021. 2, 7
  11. Lijuan Liu, Youyi Zheng, Di Tang, Yi Yuan, Changjie Fan, and Kun Zhou. Neuroskinning: Automatic skin binding for production characters with deep graph networks. ACM Transactions on Graphics (ToG), 38(4):1-12, 2019. 2, 5, 7
  12. Matthew Loper, Naureen Mahmood, Javier Romero, Gerard Pons-Moll, and Michael J Black. Smpl: A skinned multi- person linear model. Acm Transactions on Graphics, 34 (Article 248), 2015. 2, 3, 7
  13. I Loshchilov. Decoupled weight decay regularization. arXiv preprint arXiv:1711.05101, 2017. 5 · arXiv
  14. Albert Mosella-Montoro and Javier Ruiz-Hidalgo. Skin- ningnet: Two-stream graph convolutional neural network for skinning prediction of synthetic characters. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pat- tern Recognition, pages 18593-18602, 2022. 5
  15. Xiaoyu Pan, Jiancong Huang, Jiaming Mai, He Wang, Honglin Li, Tongkui Su, Wenjun Wang, and Xiaogang Jin. Heterskinnet: A heterogeneous network for skin weights pre- diction. In Proceedings of the ACM on Computer Graphics and Interactive Techniques. Association for Computing Ma- chinery, 2021. 2, 5, 7
  16. Robin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser, and Björn Ommer. High-resolution image synthesis with latent diffusion models. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 10684-10695, 2022. 3
  17. Yunsheng Shi, Zhengjie Huang, Shikun Feng, Hui Zhong, Wenjin Wang, and Yu Sun. Masked label prediction: Uni- fied message passing model for semi-supervised classifica- tion. arXiv preprint arXiv:2009.03509, 2020. 6, 7 · arXiv
  18. Dmitry Tochilkin, David Pankratz, Zexiang Liu, Zixuan Huang, Adam Letts, Yangguang Li, Ding Liang, Christian Laforte, Varun Jampani, and Yan-Pei Cao. Triposr: Fast 3d object reconstruction from a single image. arXiv preprint arXiv:2403.02151, 2024. 1, 3 · arXiv
  19. Yue Wang, Yongbin Sun, Ziwei Liu, Sanjay E Sarma, Michael M Bronstein, and Justin M Solomon. Dynamic graph cnn for learning on point clouds. ACM Transactions on Graphics (tog), 38(5):1-12, 2019. 2, 7
  20. Rich Wareham and Joan Lasenby. Bone glow: An improved method for the assignment of weights for mesh deforma- tion. In Articulated Motion and Deformable Objects: 5th In- ternational Conference, AMDO 2008, Port d'Andratx, Mal- lorca, Spain, July 9-11, 2008. Proceedings 5, pages 63-71. Springer, 2008. 2
  21. Kailu Wu, Fangfu Liu, Zhihan Cai, Runjie Yan, Hanyang Wang, Yating Hu, Yueqi Duan, and Kaisheng Ma. Unique3d: High-quality and efficient 3d mesh generation from a single image. arXiv preprint arXiv:2405.20343, 2024. 1, 3 · arXiv
  22. Jiale Xu, Weihao Cheng, Yiming Gao, Xintao Wang, Shenghua Gao, and Ying Shan. Instantmesh: Efficient 3d mesh generation from a single image with sparse-view large reconstruction models. arXiv preprint arXiv:2404.07191, 2024. 1, 3 · arXiv
  23. Zhan Xu, Yang Zhou, Evangelos Kalogerakis, Chris Lan- dreth, and Karan Singh. Rignet: neural rigging for articu- lated characters. ACM Transactions on Graphics (TOG), 39 (4):58-1, 2020. 1, 2, 3, 5, 6, 7
  24. Zhendong Yang, Ailing Zeng, Chun Yuan, and Yu Li. Effec- tive whole-body pose estimation with two-stages distillation. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pages 4210-4220, 2023. 3
  25. Jinzhi Zhang, Feng Xiong, and Mu Xu. G3PT: unleash the power of autoregressive modeling in 3d generation via cross- scale querying transformer. CoRR, abs/2409.06322, 2024. 1 · arXiv
  26. Lvmin Zhang, Anyi Rao, and Maneesh Agrawala. Adding conditional control to text-to-image diffusion models. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pages 3836-3847, 2023. 3
  27. Longwen Zhang, Ziyu Wang, Qixuan Zhang, Qiwei Qiu, Anqi Pang, Haoran Jiang, Wei Yang, Lan Xu, and Jingyi Yu. Clay: A controllable large-scale generative model for creat- ing high-quality 3d assets. ACM Transactions on Graphics (TOG), 43(4):1-20, 2024. 1, 3
  28. Hengshuang Zhao, Li Jiang, Jiaya Jia, Philip HS Torr, and Vladlen Koltun. Point transformer. In Proceedings of the IEEE/CVF international conference on computer vision, pages 16259-16268, 2021. 2, 5

Cited by

Sorted by citations

Metadata

Authors
Chu, Z., Xiong, F., Liu, M., Zhang, J., Shao, M., Sun, Z., Wang, D., & Xu, M.
Affiliations
Alibaba Group (China) (CN)
ORCID
Venue
arXiv
Publisher
arXiv
Published
2024
Pages
304-313
ISSN
1063-6919 (ISSN-L)
DOI
10.48550/arxiv.2412.02317
arXiv
2412.02317
OpenAlex
W4413158132
Cited by
12
References
0
Citations by year
2026: 7 · 2025: 5
FWCI
10.04
Type
conference paper
Language
en
Open access
Licence
arxiv.org/licenses/nonexclusive-distrib/1.0/
Locations
  • IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings (publishedVersion)
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
Topics
  • Physical Sciences › Computer Science › Computer Graphics and Computer-Aided Design › 3D Shape Modeling and Analysis
  • Physical Sciences › Computer Science › Computer Graphics and Computer-Aided Design › Human Motion and Animation
  • Physical Sciences › Computer Science › Computer Graphics and Computer-Aided Design › Computer Graphics and Visualization Techniques
Keywords
skeleton estimation, point transformer

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review