CoChat

Cross-robot behavior adaptation through intention alignment

The DOI matches its Crossref record; 54 of the 54 references it cites were found in a registry or an index.

Abstract

Imitation learning (IL) has succeeded in enabling robots to perform new tasks by learning from demonstrations. However, its success is often constrained by the need for direct skill mappings between a learner and a demonstrator under identical conditions, limiting its adaptability to diverse environments and generalization across robots with different physical embodiments. To address these challenges, we introduce the Intention-Aligned Imitation Learning (IAIL) framework, a behavior adaptation approach that extends the conventional scope of IL by enabling robots to reproduce motions demonstrated by heterogeneous peers, even in previously unseen situations. Inspired by human cultural learning, IAIL aligns and adapts robot motions on the basis of high-level intentions annotated in natural language rather than by directly copying motor movements. This alignment is achieved by constructing a shared intention space that connects robot-generated motions with linguistic annotations, enabling inference-time behavior adaptation across diverse embodiments and environmental contexts. The framework further supports scalable task allocation in heterogeneous robot teams by leveraging differences in capabilities and constraints. We validated IAIL through real-world experiments involving seven distinct robots performing multistep collaboration tasks across 30 scenarios. Our results demonstrate that IAIL enables robust intention-aligned behavior adaptation across variations in embodiment, motion modality, and task configuration. These capabilities enable flexible behavior transfer across heterogeneous robots and support resilient, autonomous multirobot systems for reliable real-world collaboration.

Overview

Integrity signals

Registry

Crossref · 10.1126/scirobotics.adv2250

Cites

54 of 54 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Citations

Cites

Show all 54 references

Research works printed but not linked: 13

  1. D. Hejna L. Pinto P. Abbeel “Hierarchically decoupled imitation for morphological transfer” in Proceedings of the 37th International Conference on Machine Learning H. Daumé III A. Singh Eds. vol. 119 of Proceedings of Machine Learning Research (PMLR 2020) pp. 4159–4171.
  2. C. Finn T. Yu T. Zhang P. Abbeel S. Levine “One-shot visual imitation learning via meta-learning” in Proceedings of the First Conference on Robot Learning S. Levine V. Vanhoucke K. Goldberg Eds. vol. 78 of Proceedings of Machine Learning Research (PMLR 2017) pp. 357–368.
  3. J. Li T. Lu X. Cao Y. Cai S. Wang “Meta-imitation learning by watching video demonstrations” poster presented at the Tenth International Conference on Learning Representations (ICLR 2022) virtual 25 April 2022. https://openreview.net/forum?id=KTPuIsx4pmo.
  4. T. Shankar Y. Lin A. Rajeswaran V. Kumar S. Anderson J. Oh “Translating robot skills: Learning unsupervised skill correspondences across robots” in Proceedings of the 39th International Conference on Machine Learning K. Chaudhuri S. Jegelka L. Song C. Szepesvari G. Niu S. Sabato Eds. vol. 162 of Proceedings of Machine Learning Research (PMLR 2022) pp. 19626–19644.
  5. J. Song H. Ren D. Sadigh S. Ermon “Multi-agent generative adversarial imitation learning” in Advances in Neural Information Processing Systems 31 NeurIPS 2018 S. Bengio H. Wallach H. Larochelle K. Grauman N. Cesa-Bianchi R. Garnett Eds. (Curran Associates 2018) pp. 7472–7483.
  6. K. Hu Z. Rui Y. He Y. Liu P. Hua H. Xu “Stem-OB: Generalizable visual imitation learning with stem-like convergent observation through diffusion inversion” in The Tenth International Conference on Learning Representations (ICLR 2025) (Curran Associates 2025); https://openreview.net/forum?id=KTPuIsx4pmo.
  7. K. Pertsch R. Desai V. Kumar F. Meier J. J. Lim D. Batra A. Rai “Cross-domain transfer via semantic skill imitation” in Proceedings of the 6th Conference on Robot Learning K. Liu D. Kulic J. Ichnowski Eds. vol. 205 of Proceedings of Machine Learning Research (PMLR 2023) pp. 690–700.
  8. L. Y. Chen C. Xu K. Dharmarajan R. Cheng K. Keutzer M. Tomizuka Q. Vuong K. Goldberg “RoVi-Aug: Robot and viewpoint augmentation for cross-embodiment robot learning” in Proceedings of the 8th Conference on Robot Learning P. Agrawal O. Kroemer W. Burgard Eds. vol. 270 of Proceedings of Machine Learning Research (PMLR 2025) pp. 209–233.
  9. B. Zitkovich T. Yu S. Xu P. Xu T. Xiao F. Xia J. Wu P. Wohlhart S. Welker A. Wahid Q. Vuong V. Vanhoucke H. Tran R. Soricut A. Singh J. Singh P. Sermanet P. R. Sanketi G. Salazar M. S. Ryoo K. Reymann K. Rao K. Pertsch I. Mordatch H. Michalewski Y. Lu S. Levine L. Lee T.-W. E. Lee I. Leal Y. Kuang D. Kalashnikov R. Julian N. J. Joshi A. Irpan B. Ichter J. Hsu A. Herzog K. Hausman K. Gopalakrishnan C. Fu P. Florence C. Finn K. A. Dubey D. Driess T. Ding K. M. Choromanski X. Chen Y. Chebotar J. Carbajal N. Brown A. Brohan M. G. Arenas K. Han “RT-2: Vision-language-action models transfer web knowledge to robotic control” in Proceedings of the 7th Conference on Robot Learning J. Tan M. Toussaint K. Darvish Eds. vol. 229 of Proceedings of Machine Learning Research (PMLR 2023) pp. 2165–2183.
  10. M. J. Kim K. Pertsch S. Karamcheti T. Xiao A. Balakrishna S. Nair R. Rafailov E. Foster G. Lam P. Sanketi Q. Vuong T. Kollar B. Burchfiel R. Tedrake D. Sadigh S. Levine P. Liang C. Finn “OpenVLA: An open-source vision-language-action model” in Proceedings of the 8th Conference on Robot Learning Proceedings of the 8th Conference on Robot Learning P. Agrawal O. Kroemer W. Burgard Eds. vol. 270 of Proceedings of Machine Learning Research (PMLR 2025) pp. 2679–2713.
  11. A. Radford J. W. Kim C. Hallacy A. Ramesh G. Goh S. Agarwal G. Sastry A. Askell P. Mishkin J. Clark G. Krueger I. Sutskever “Learning transferable visual models from natural language supervision” in Proceedings of the 38th International Conference on Machine Learning M. Meila T. Zhang Eds. vol. 139 of Proceedings of Machine Learning Research (PMLR 2021) pp. 8748–8763.
  12. I. Higgins L. Matthey A. Pal C. P. Burgess X. Glorot M. M. Botvinick S. Mohamed Lerchner “beta-VAE: Learning basic visual concepts with a constrained variational framework” poster presented at the 5th International Conference on Learning Representations (ICLR 2017) Toulon France 24 to 26 April 2017; https://openreview.net/forum?id=Sy2fzU9gl.
  13. M. Shridhar L. Manuelli D. Fox “CLIPort: What and where pathways for robotic manipulation” in Proceedings of the 5th Conference on Robot Learning A. Faust D. Hsu G. Neumann Eds. vol. 164 of Proceedings of Machine Learning Research (PMLR 2022) pp. 894–906.

Cited by

See all 2

Metadata

Authors
Chen, X., Gao, Y., Liu, H., Yang, F., Ghadirzadeh, A., Yang, J., Liang, B., Zhang, C., Lam, T. L., & Zhu, S.-C.
Affiliations
  • Beijing Institute for General Artificial Intelligence (CN)
  • Chinese University of Hong Kong, Shenzhen (CN)
  • Peking University (CN)
  • Microsoft Research Asia (China) (CN)
  • Embark Studios, Stockholm, Sweden.
  • Tsinghua University (CN)
  • Washington University in St. Louis (US)
Corresponding author
  • Chen, Xi
  • Gao, Yuan
  • Zhang, Chongjie
  • Lam, Tin Lun
Venue
Science Robotics
Published
2026-03-18
Volume
11
Issue
112
Pages
eadv2250-eadv2250
ISSN
2470-9476 (ISSN-L)
OpenAlex
W7138844590
Cited by
0
References
51
FWCI
0.00
Type
journal article
Language
en
Open access
closed
Locations
  • Science Robotics (publishedVersion)
  • PubMed (publishedVersion)
Funders
  • National Natural Science Foundation of China (62376031)
  • Shenzhen Science and Technology Innovation Program (JSGGKQTD20221101115656029, Grant No. JSGGKQTD20221101115656029 and ZDCY20250901104706008))
  • Basic and Applied Basic Research Foundation of Guangdong Province (2023B1515020089)
  • National Key Research and Development Program of China (2024YFB4505500 &2024YFB4505503)
Topics
  • Physical Sciences › Engineering › Control and Systems Engineering › Robot Manipulation and Learning
  • Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
  • Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
Keywords
imitation learning, behavioral adaptation, heterogeneous robots, task allocation, cultural learning
MeSH terms
Autonomous Robots, Intelligent Systems, Adaptive Algorithms, Algorithms, Artificial Intelligence, Humans, Imitative Behavior, Learning, Motion, Robotics, Intention

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.