The DOI matches its Crossref record; 29 of the 29 references it cites were found in a registry or an index.
ImitationNet: Unsupervised Human-to-Robot Motion Retargeting via Shared Latent Space
Open accessAbstract
This paper introduces a novel deep-learning approach for human-to-robot motion retargeting, enabling robots to mimic human poses accurately. Contrary to prior deep-learning-based works, our method does not require paired human-to-robot data, which facilitates its translation to new robots. First, we construct a shared latent space between humans and robots via adaptive contrastive learning that takes advantage of a proposed cross-domain similarity metric between the human and robot poses. Additionally, we propose a consistency term to build a common latent space that captures the similarity of the poses with precision while allowing direct robot motion control from the latent space. For instance, we can generate in-between motion through simple linear interpolation between two projected human poses. We conduct a comprehensive evaluation of robot control from diverse modalities (i.e., texts, RGB videos, and key poses), which facilitates robot control for non-expert users. Our model outperforms existing works regarding human-to-robot retargeting in terms of efficiency and precision. Finally, we implemented our method in a real robot with self-collision avoidance through a whole-body controller to showcase the effectiveness of our approach.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“While these studies have successfully demonstrated motion retargeting from humanoid to non-humanoid morphologies, they often rely on either embodiment-specific or task-specific models.”
From LEGATO: Cross-Embodiment Imitation Using a Grasping Tool (2025) · cites this paper as [34]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Nevertheless, these approaches often encounter challenges in achieving broad generalization across different scenarios.”
From LEGATO: Cross-Embodiment Imitation Using a Grasping Tool (2025) · cites this paper as [34]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Human3.6M: Large Scale Datasets and Predictive Methods for 3D Human Sensing in Natural Environments
Ionescu, C., Papava, D., Olaru, V., & Sminchisescu, C. (2014) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.248 · Cited by 3,653
Deep Metric Learning Using Triplet Network
Hoffer, E., & Ailon, N. (2015) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-24261-3_7 · Cited by 2,134
Retargetting motion to new characters
Gleicher, M. (1998) · Proceedings of the 25th annual conference on Computer graphics and interactive techniques - SIGGRAPH '98 · doi:10.1145/280814.280820 · Cited by 854
Generating Diverse and Natural 3D Human Motions from Text
Guo, C., Zou, S., Zuo, X., Wang, S., Ji, W., Li, X., & Cheng, L. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.00509 · Cited by 575
A hierarchical approach to interactive motion editing for human-like figures
Lee, J., & Shin, S. Y. (1999) · Proceedings of the 26th annual conference on Computer graphics and interactive techniques - SIGGRAPH '99 · doi:10.1145/311535.311539 · Cited by 566
Li, J., Xu, C., Chen, Z., Bian, S., Yang, L., & Lu, C. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00339 · Cited by 402
TMR: Text-to-Motion Retrieval Using Contrastive 3D Human Motion Synthesis
Petrovich, M., Black, M. J., & Varol, G. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00870 · Cited by 295
Tevet, G., Raab, S., Gordon, B., Shafir, Y., Cohen-Or, D., & Bermano, A. H. (2022) · arXiv · doi:10.48550/arxiv.2209.14916 · Cited by 290
Teleoperation of Humanoid Robots: A Survey
Darvish, K., Penco, L., Ramos, J., Cisneros, R., Pratt, J., Yoshida, E., Ivaldi, S., & Pucci, D. (2023) · IEEE Transactions on Robotics · doi:10.1109/tro.2023.3236952 · Cited by 278
Research works printed but not linked: 4
- Lim, Pmnet: learning of disentangled pose and movement for unsupervised motion retargeting
- Radford, 2021, Learning transferable visual models from natural language supervision
- Mansard, A versatile generalized inverted kinematics implementation for collaborative working humanoid robots: The stack of tasks, 1
- Jocher, 2023, YOLO by Ultralytics
Cited by
LEGATO: Cross-Embodiment Imitation Using a Grasping Tool
Seo, M., Park, H. A., Yuan, S., Zhu, Y., & Sentis, L. (2025) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2025.3535182 · Cited by 11
“Encoding motions into learned latent spaces facilitates the transfer of human motions to simulated humanoid models [40] and adapts them to robotic embodiments with varying kinematic structures [33].”
Background
Metadata
- Authors
- Yan, Y., Mascaro, E. V., & Lee, D.
- Affiliations
- TU Wien (AT)
- Venue
- 2023 IEEE-RAS 22nd International Conference on Humanoid Robots (Humanoids)
- Publisher
- IEEE
- Published
- 2023-12-12
- Pages
- 1-8
- OpenAlex
- W4390480930
- Cited by
- 27
- References
- 29
- Citations by year
- 2026: 7 · 2025: 13 · 2024: 7
- FWCI
- 11.55
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- IEEE-RAS International Conference on Humanoid Robots (Humanoids) (publishedVersion)
- arXiv (Cornell University) (submittedVersion, cc-by)
- elib (German Aerospace Center) (submittedVersion)
- arXiv (Cornell University) (cc-by)
- Topics
- Physical Sciences › Computer Science › Computer Graphics and Computer-Aided Design › Human Motion and Animation
- Physical Sciences › Engineering › Control and Systems Engineering › Robot Manipulation and Learning
- Physical Sciences › Computer Science › Computer Graphics and Computer-Aided Design › 3D Shape Modeling and Analysis
- Keywords
- unsupervised learning, shared latent space, consistency regularization, robot motion control, keyframe interpolation, whole-body control, collision avoidance, human-robot interaction
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: ImitationNet: Unsupervised Human-to-Robot Motion Retargeting via Shared Latent Space. https://app.cochat.ai/papers/10.1109/humanoids57100.2023.10375150
- The paper
- Yan, Y., Mascaro, E. V., & Lee, D. (2023). ImitationNet: Unsupervised Human-to-Robot Motion Retargeting via Shared Latent Space. 2023 IEEE-RAS 22nd International Conference on Humanoid Robots (Humanoids). https://doi.org/10.1109/humanoids57100.2023.10375150
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.