Generalizable Long-Horizon Manipulations with Large Language Models
Open accessAbstract
This work introduces a framework harnessing the capabilities of Large Language Models (LLMs) to generate primitive task conditions for generalizable long-horizon manipulations with novel objects and unseen tasks. These task conditions serve as guides for the generation and adjustment of Dynamic Movement Primitives (DMP) trajectories for long-horizon task execution. We further create a challenging robotic manipulation task suite based on Pybullet for long-horizon task evaluation. Extensive experiments in both simulated and real-world environments demonstrate the effectiveness of our framework on both familiar tasks involving new objects and novel but related tasks, highlighting the potential of LLMs in enhancing robotic system versatility and adaptability. Project website: https://object814.github.io/Task-Condition-With-LLM/
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Long-context is a different capability from long-horizon execution.
“While long-context will help models execute for longer, it is a different capability compared to longhorizon execution (Zhou et al., 2023; Chen et al., 2024a), as it focuses on performance as a function of input, not output length.”
From The Illusion of Diminishing Returns: Measuring Long Horizon Execution in LLMs (2025) · cites this paper as Zhou et al., 2023
Cites
Still being checked.
Cited by
Sorted by citations
GPT-4V(ision) for Robotics: Multimodal Task Planning From Human Demonstration
Wake, N., Kanehira, A., Sasabuchi, K., Takamatsu, J., & Ikeuchi, K. (2024) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2024.3477090 · Cited by 77 · see citing works
A Survey of Reasoning with Foundation ModelsPreprint
Sun, J., Zheng, C., Xie, E., Liu, Z., Chu, R., Liu, J., Xu, J., Ding, M., Li, H., Geng, M., et al. (2023) · doi:10.31219/osf.io/ac4sp · Cited by 51 · see citing works
Self-citationExploring Embodied Multimodal Large Models: Development, datasets, and future directions
Chen, S., Wu, Z., Zhang, K., Li, C., Zhang, B., Ma, F., Yu, F. R., & Li, Q. (2025) · Information Fusion · doi:10.1016/j.inffus.2025.103198 · Cited by 31 · see citing works
The Illusion of Diminishing Returns: Measuring Long Horizon Execution in LLMs
Sinha, A., Arun, A., Goel, S., Staab, S., & Geiping, J. (2025) · arXiv · doi:10.48550/arxiv.2509.09677 · Cited by 1 · see citing works
“While long-context will help models execute for longer, it is a different capability compared to long-horizon execution (Zhou et al., 2023; Chen et al., 2024a), as it focuses on performance as a function of input, not output length.”
Anarossi, E., Kwon, Y., Tahara, H., Tanaka, S., Shirai, K., Hamaya, M., Beltran-Hernandez, C. C., Hashimoto, A., & Matsubara, T. (2025) · IEEE Access · doi:10.1109/access.2025.3588975
MulPlanLM: multimodal robotic task planning with vision-language models and physical feedback
Son, Y.-C., Lee, D.-H., & Lim, S. (2026) · Intelligent Service Robotics · doi:10.1007/s11370-026-00743-0
- Authors
- Zhou, H., Ding, M., Peng, W., Tomizuka, M., Shao, L., & Gan, C.
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2023
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 2310.02264
- OpenAlex
- W4387356467
- Cited by
- 4
- References
- 0
- Citations by year
- 2025: 2 · 2024: 1 · 2023: 1
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Engineering › Control and Systems Engineering › Robot Manipulation and Learning
- Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
- Physical Sciences › Computer Science › Artificial Intelligence › AI-based Problem Solving and Planning
- Keywords
- large language models, long-horizon manipulation, robotic manipulation, dynamic movement primitives, novel objects, unseen tasks, generalization, PyBullet simulation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
