The DOI matches its DataCite record; 2 of the 2 references it cites were found in a registry or an index.
MLDT: Multi-Level Decomposition for Complex Long-Horizon Robotic Task Planning with Open-Source Large Language Model
Open accessAbstract
In the realm of data-driven AI technology, the application of open-source large language models (LLMs) in robotic task planning represents a significant milestone. Recent robotic task planning methods based on open-source LLMs typically leverage vast task planning datasets to enhance models' planning abilities. While these methods show promise, they struggle with complex long-horizon tasks, which require comprehending more context and generating longer action sequences. This paper addresses this limitation by proposing MLDT, theMulti-Level Decomposition Task planning method. This method innovatively decomposes tasks at the goal-level, task-level, and action-level to mitigate the challenge of complex long-horizon tasks. In order to enhance open-source LLMs' planning abilities, we introduce a goal-sensitive corpus generation method to create high-quality training data and conduct instruction tuning on the generated corpus. Since the complexity of the existing datasets is not high enough, we construct a more challenging dataset, LongTasks, to specifically evaluate planning ability on complex long-horizon tasks. We evaluate our method using various LLMs on four datasets in VirtualHome. Our results demonstrate a significant performance enhancement in robotic task planning, showcasing MLDT's effectiveness in overcoming the limitations of existing methods based on open-source LLMs as well as its practicality in complex, real-world scenarios.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“LLMs can also be used to combine multiple of the above modules at once via chain-of-thought prompting or pipelined queries, such as goal interpretation with action sequencing [13–32], goal interpretation with subgoal decomposition [2, 27, 33], action sequencing with subgoal decomposition [27, 34, 18, 35], action sequencing with transition modeling [8, 28, 32, 36, 37, 13, 38].”
From Embodied Agent Interface: Benchmarking LLMs for Embodied Decision Making (2024) · cites this paper as [20]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Scaling Laws for Neural Language Models
Kaplan, J., McCandlish, S., Henighan, T., Brown, T. B., Chess, B., Child, R., Gray, S., Radford, A., Wu, J., & Amodei, D. (2020) · arXiv · doi:10.48550/arxiv.2001.08361 · Cited by 9,550 · cited 1×
“Therefore, they possess limited memory and reasoning abilities [14,30].”
BackgroundInner Monologue: Embodied Reasoning through Planning with Language Models
Huang, W., Xia, F., Xiao, T., Chan, H., Liang, J., Florence, P., Zeng, A., Tompson, J., Mordatch, I., Chebotar, Y., et al. (2022) · arXiv · doi:10.48550/arxiv.2207.05608 · Cited by 287 · cited 1×
“Inner Monologue [12] integrates feedback from multiple sources to form an inner monologue, enhancing the performance of LLMs in complex long-horizon tasks.”
Background
Research works printed but not linked: 34
- An, C., Gong, S., Zhong, M., Li, M., Zhang, J., Kong, L., Qiu, X.: L-eval: Instituting standardized evaluation for long context language models. CoRR abs/2307.11088 (2023) · arXiv
- Brown, T.B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Nee- lakantan, A., Shyam, P., Sastry, G., Askell, A., et al.: Language models are few-shot learners. In: NeurIPS (2020)
- Chen, Y., Qian, S., Tang, H., Lai, X., Liu, Z., Han, S., Jia, J.: Longlora: Efficient fine-tuning of long-context large language models. CoRR abs/2309.12307 (2023) · arXiv
- Conneau, A., Khandelwal, K., Goyal, N., Chaudhary, V., Wenzek, G., Guzmán, F., Grave, E., Ott, M., Zettlemoyer, L., Stoyanov, V.: Unsupervised cross-lingual representation learning at scale. In: ACL. pp. 8440-8451. Association for Compu- tational Linguistics (2020)
- Du, Z., Qian, Y., Liu, X., Ding, M., Qiu, J., Yang, Z., Tang, J.: GLM: general language model pretraining with autoregressive blank infilling. In: ACL (1). pp. 320-335. Association for Computational Linguistics (2022)
- Fiorini, L., Sorrentino, A., Pistolesi, M., Becchimanzi, C., Tosi, F., Cavallo, F.: Living with a telepresence robot: Results from a field-trial. IEEE Robotics Autom. Lett. 7(2), 5405-5412 (2022)
- Gilardi, F., Alizadeh, M., Kubli, M.: Chatgpt outperforms crowd-workers for text- annotation tasks. CoRR abs/2303.15056 (2023) · arXiv
- Guhur, P., Chen, S., Pinel, R.G., Tapaswi, M., Laptev, I., Schmid, C.: Instruction- driven history-aware policies for robotic manipulations. In: CoRL. Proceedings of Machine Learning Research, vol. 205, pp. 175-187. PMLR (2022)
- Huang, C., Mees, O., Zeng, A., Burgard, W.: Visual language maps for robot navigation. In: ICRA. pp. 10608-10615. IEEE (2023)
- Huang, W., Abbeel, P., Pathak, D., Mordatch, I.: Language models as zero-shot planners: Extracting actionable knowledge for embodied agents. In: ICML. Pro- ceedings of Machine Learning Research, vol. 162, pp. 9118-9147. PMLR (2022)
- Ichter, B., Brohan, A., Chebotar, Y., Finn, C., Hausman, K., Herzog, A., Ho, D., Ibarz, J., Irpan, A., Jang, E., et al.: Do as I can, not as I say: Grounding language in robotic affordances. In: CoRL. Proceedings of Machine Learning Research, vol. 205, pp. 287-318. PMLR (2022)
- Laskar, M.T.R., Rahman, M., Jahan, I., Hoque, E., Huang, J.X.: Cqsumdp: A chatgpt-annotated resource for query-focused abstractive summarization based on debatepedia. CoRR abs/2305.06147 (2023) · arXiv
- Li, B., Wu, P., Abbeel, P., Malik, J.: Interactive task planning with language models. CoRR abs/2310.10645 (2023) · arXiv
- Li, S., Yan, J., Wang, H., Tang, Z., Ren, X., Srinivasan, V., Jin, H.: Instruction- following evaluation through verbalizer manipulation. CoRR abs/2307.10558 (2023) · arXiv
- Li, S., Puig, X., Paxton, C., Du, Y., Wang, C., Fan, L., Chen, T., Huang, D., Akyürek, E., Anandkumar, A., et al.: Pre-trained language models for interactive decision-making. In: NeurIPS (2022)
- Liu, H., Ning, R., Teng, Z., Liu, J., Zhou, Q., Zhang, Y.: Evaluating the logical reasoning ability of chatgpt and GPT-4. CoRR abs/2304.03439 (2023) · arXiv
- Liu, H., Tam, D., Muqeeth, M., Mohta, J., Huang, T., Bansal, M., Raffel, C.: Few- shot parameter-efficient fine-tuning is better and cheaper than in-context learning. In: NeurIPS (2022)
- Liu, X., Yu, H., Zhang, H., Xu, Y., Lei, X., Lai, H., Gu, Y., Ding, H., Men, K., Yang, K., et al.: Agentbench: Evaluating llms as agents. CoRR abs/2308.03688 (2023) · arXiv
- Puig, X., Ra, K., Boben, M., Li, J., Wang, T., Fidler, S., Torralba, A.: Virtualhome: Simulating household activities via programs. In: CVPR. pp. 8494-8502. Computer Vision Foundation / IEEE Computer Society (2018)
- Radford, A., Wu, J., Child, R., Luan, D., Amodei, D., Sutskever, I., et al.: Language models are unsupervised multitask learners. OpenAI blog 1(8), 9 (2019)
- Ray, P.P.: Chatgpt: A comprehensive review on background, applications, key chal- lenges, bias, ethics, limitations and future scope. Internet of Things and Cyber- Physical Systems (2023)
- Scao, T.L., Fan, A., Akiki, C., Pavlick, E., Ilic, S., Hesslow, D., Castagné, R., Luccioni, A.S., Yvon, F., Gallé, M., et al.: BLOOM: A 176b-parameter open-access multilingual language model. CoRR abs/2211.05100 (2022) · arXiv
- Singh, I., Blukis, V., Mousavian, A., Goyal, A., Xu, D., Tremblay, J., Fox, D., Thomason, J., Garg, A.: Progprompt: Generating situated robot task plans using large language models. In: ICRA. pp. 11523-11530. IEEE (2023)
- Touvron, H., Martin, L., Stone, K., Albert, P., Almahairi, A., Babaei, Y., Bash- lykov, N., Batra, S., Bhargava, P., Bhosale, S., et al.: Llama 2: Open foundation and fine-tuned chat models. CoRR abs/2307.09288 (2023) · arXiv
- Tworkowski, S., Staniszewski, K., Pacek, M., Wu, Y., Michalewski, H., Mi- los, P.: Focused transformer: Contrastive training for context scaling. CoRR abs/2307.03170 (2023) · arXiv
- Upadhayay, B., Behzadan, V.: Taco: Enhancing cross-lingual transfer for low- resource languages in llms through translation-assisted chain-of-thought processes. CoRR abs/2311.10797 (2023) · arXiv
- Wei, J., Bosma, M., Zhao, V.Y., Guu, K., Yu, A.W., Lester, B., Du, N., Dai, A.M., Le, Q.V.: Finetuned language models are zero-shot learners. In: ICLR. OpenRe- view.net (2022)
- Wu, X., Duan, R., Ni, J.: Unveiling security, privacy, and ethical concerns of chat- gpt. Journal of Information and Intelligence (2023)
- Wu, Z., Wang, Z., Xu, X., Lu, J., Yan, H.: Embodied task planning with large language models. CoRR abs/2307.01848 (2023) · arXiv
- Xiang, J., Tao, T., Gu, Y., Shu, T., Wang, Z., Yang, Z., Hu, Z.: Language mod- els meet world models: Embodied experiences enhance language models. CoRR abs/2305.10626 (2023) · arXiv
- Yao, S., Zhao, J., Yu, D., Du, N., Shafran, I., Narasimhan, K.R., Cao, Y.: React: Synergizing reasoning and acting in language models. In: ICLR. OpenReview.net (2023)
- Zeng, A., Liu, M., Lu, R., Wang, B., Liu, X., Dong, Y., Tang, J.: Agenttuning: Enabling generalized agent abilities for llms. CoRR abs/2310.12823 (2023) · arXiv
- Zhang, J., Liao, J., Hu, T., Zhou, T., Qian, H., Zhang, H., Li, H., Tang, L., Meng, Q., Song, W., Zhu, S.: Experience adapter: Adapting pre-trained language models for continual task planning. In: ICIRA (5). Lecture Notes in Computer Science, vol. 14271, pp. 389-400. Springer (2023)
- Zhou, Z., Song, J., Yao, K., Shu, Z., Ma, L.: ISR-LLM: iterative self-refined large language model for long-horizon sequential task planning. CoRR abs/2308.13724 (2023) · arXiv
Cited by
Embodied Agent Interface: Benchmarking LLMs for Embodied Decision Making
Li, M., Zhao, S., Wang, Q., Wang, K., Zhou, Y., Srivastava, S., Gokmen, C., Lee, T., Li, L., Zhang, R., et al. (2024) · Advances in Neural Information Processing Systems 37 · doi:10.52202/079017-3188 · Cited by 21
Metadata
- Authors
- Wu, Y., Zhang, J., Hu, N., Tang, L., Qi, G., Shao, J., Ren, J., & Song, W.
- Affiliations
- Southeast University (CN)
- Zhejiang University (CN)
- University of Chinese Academy of Sciences (CN)
- Zhejiang Lab (CN)
- Corresponding author
- Qi, Guilin
- Song, Wei
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2024
- Pages
- 251-267
- ISSN
- 0302-9743 (ISSN-L)
- arXiv
- 2403.18760
- OpenAlex
- W4405347088
- Cited by
- 34
- References
- 2
- Citations by year
- 2026: 10 · 2025: 20 · 2024: 4
- FWCI
- 5.37
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- Lecture notes in computer science (publishedVersion)
- arXiv (Cornell University) (submittedVersion, other-oa)
- arXiv (Cornell University)
- Funders
- National Natural Science Foundation of China (U21A20488)
- Southeast University
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › AI-based Problem Solving and Planning
- Physical Sciences › Engineering › Control and Systems Engineering › Robot Manipulation and Learning
- Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
- Keywords
- robot planning, long-horizon planning, open-source large language models, instruction tuning, action sequence generation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
