Skinned Motion Retargeting with Residual Perception of Motion Semantics & Geometry
Open accessThe DOI matches its Crossref record; 6 of the 6 references it cites were found in a registry or an index.
Abstract
A good motion retargeting cannot be reached without reasonable consideration of source-target differences on both the skeleton and shape geometry levels. In this work, we propose a novel Residual RETargeting network (R2ET) structure, which relies on two neural modification modules, to adjust the source motions to fit the target skeletons and shapes progressively. In particular, a skeleton-aware module is introduced to preserve the source motion semantics. A shape-aware module is designed to perceive the geometries of target characters to reduce interpenetration and contact-missing. Driven by our explored distance-based losses that explicitly model the motion semantics and geometry, these two modules can learn residual motion modifications on the source motion to generate plausible retargeted motion in a single inference without postprocessing. To balance these two modifications, we further present a balancing gate to conduct linear interpolation between them. Extensive experiments on the public dataset Mixamo demonstrate that our R2ET achieves the state-of-the-art performance, and provides a good balance between the preservation of motion semantics as well as the attenuation of interpenetration and contact-missing. Code is available at https://github.com/Kebii/R2ET.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
U-Net: Convolutional Networks for Biomedical Image Segmentation
Ronneberger, O., Fischer, P., & Brox, T. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24574-4_28 · Cited by 99,404
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Loper, M., Mahmood, N., Romero, J., Pons-Moll, G., & J, B. M. (2015) · ACM Transactions on Graphics · doi:10.1145/2816795.2818013 · Cited by 3,734 · cited 1×
“Our method mainly copes with the animated characters with articulated skeletons, but can be also extended to retarget the motion from Skinned Multi-Person Linear Model (SMPL) [17] estimated from RGB videos.”
MethodOn the Continuity of Rotation Representations in Neural Networks
Zhou, Y., Barnes, C., Lu, J., Yang, J., & Li, H. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00589 · Cited by 1,255 · cited 1×
“Meanwhile, the full joint rotation encoding always leads to discontinuity in the rotation space [1, 26].”
BackgroundRetargetting motion to new characters
Gleicher, M. (1998) · Proceedings of the 25th annual conference on Computer graphics and interactive techniques - SIGGRAPH '98 · doi:10.1145/280814.280820 · Cited by 854
Skeleton-aware networks for deep motion retargeting
Aberman, K., Li, P., Lischinski, D., Sorkine-Hornung, O., Cohen-Or, D., & Chen, B. (2020) · ACM Transactions on Graphics · doi:10.1145/3386569.3392462 · Cited by 230
Cited by
ImitationNet: Unsupervised Human-to-Robot Motion Retargeting via Shared Latent Space
Yan, Y., Mascaro, E. V., & Lee, D. (2023) · 2023 IEEE-RAS 22nd International Conference on Humanoid Robots (Humanoids) · doi:10.1109/humanoids57100.2023.10375150 · Cited by 27
AnyTop: Character Animation Diffusion with Any Topology
Gat, I., Raab, S., Tevet, G., Reshef, Y., Bermano, A. H., & Cohen-Or, D. (2025) · Proceedings of the Special Interest Group on Computer Graphics and Interactive Techniques Conference Conference Papers · doi:10.1145/3721238.3730621 · Cited by 9
“These works demonstrate great flexibility in target character structure, but overlook the advantage of skeletons, which are more compact and semantically meaningful, easier to manipulate via rig-based animation, and compatible with physics engines [Tevet et al. 2024] and inverse kinematics systems.”
Motion2Motion: Cross-topology Motion Transfer with Sparse Correspondence
Chen, L.-H., Zhang, Y., Yin, Z., Dou, Z., Chen, X., Wang, J., Komura, T., & Zhang, L. (2025) · Proceedings of the SIGGRAPH Asia 2025 Conference Papers · doi:10.1145/3757377.3763811 · Cited by 3
“Regardless of whether skeleton-based or geometric-based methods, most of these meth-ods [Ye et al. 2024; Zhang et al. 2023b] rely on a quite amount of data.”
Self-citation
Metadata
- Authors
- Zhang, J., Weng, J., Kang, D., Zhao, F., Huang, S., Zhe, X., Bao, L., Shan, Y., Wang, J., & Tu, Z.
- Venue
- 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
- Publisher
- IEEE
- Published
- 2023-06
- Pages
- 13864-13872
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W4386075543
- Cited by
- 48
- References
- 6
- FWCI
- 21.58
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.