Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat
Sign Up
PreprintCited by 60AI-based Problem Solving and PlanningRobot Manipulation and LearningRobotic Path Planning Algorithms

The DOI matches its DataCite record.

DELTA: Decomposed Efficient Long-Term Robot Task Planning using Large Language Models

Open access
Liu, Yuchen, Palmieri, Luigi, Koch, Sebastian, Georgievski, Ilche, Aiello, Marco·2024·arXiv
DOI 10.48550/arxiv.2404.03275arXiv 2404.03275
Open this paper in CoChat — free accountOpen PDF

Abstract

Recent advancements in Large Language Models (LLMs) have sparked a revolution across many research fields. In robotics, the integration of common-sense knowledge from LLMs into task and motion planning has drastically advanced the field by unlocking unprecedented levels of context awareness. Despite their vast collection of knowledge, large language models may generate infeasible plans due to hallucinations or missing domain information. To address these challenges and improve plan feasibility and computational efficiency, we introduce DELTA, a novel LLM-informed task planning approach. By using scene graphs as environment representations within LLMs, DELTA achieves rapid generation of precise planning problem descriptions. To enhance planning performance, DELTA decomposes long-term task goals with LLMs into an autoregressive sequence of sub-goals, enabling automated task planners to efficiently solve complex problems. In our extensive evaluation, we show that DELTA enables an efficient and fully automatic task planning pipeline, achieving higher planning success rates and significantly shorter planning times compared to the state of the art. Project webpage: https://delta-llm.github.io/

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.2404.03275

Cites

Statistics

Figures

Fig. 2 : Fig.2: Shelbiana scene[25] and the corresponding SG with floor, room, and item node layers. The edges refer to the semantic relationships. Not all item nodes are visualized.
Fig. 2 : Fig.2: Shelbiana scene[25] and the corresponding SG with floor, room, and item node layers. The edges refer to the semantic relationships. Not all item nodes are visualized.CC-BY · From the PDF

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

No references could be resolved yet.

Research works printed but not linked: 43

  1. J. Achiam et al., "Gpt-4 technical report," arXiv preprint arXiv:2303.08774, 2023. · arXiv
  2. A. Chowdhery et al., "Palm: Scaling language modeling with path- ways," Journal of Machine Learning Research, vol. 24, no. 240, pp. 1-113, 2023.
  3. J. Devlin, M.-W. Chang, K. Lee, and K. Toutanova, "Bert: Pre-training of deep bidirectional transformers for language understanding," arXiv preprint arXiv:1810.04805, 2018. · arXiv
  4. H. Touvron et al., "Llama: Open and efficient foundation language models," arXiv preprint arXiv:2302.13971, 2023. · arXiv
  5. M. Aiello and I. Georgievski, "Service composition in the chatgpt era," Service Oriented Computing and Applications, pp. 1-6, 2023.
  6. Y. Liu, L. Palmieri, I. Georgievski, and M. Aiello, "Human-flow- aware long-term mobile robot task planning based on hierarchical reinforcement learning," IEEE Robotics and Automation Letters, 2023.
  7. N. Aboki, I. Georgievski, and M. Aiello, "Automating a telepresence robot for human detection, tracking, and following," in Annual Con- ference Towards Autonomous Robotic Systems. Springer, 2023.
  8. W. Huang, P. Abbeel, D. Pathak, and I. Mordatch, "Language models as zero-shot planners: Extracting actionable knowledge for embodied agents," in International Conference on Machine Learning. PMLR, 2022, pp. 9118-9147.
  9. C. H. Song, J. Wu, C. Washington, B. M. Sadler, W.-L. Chao, and Y. Su, "Llm-planner: Few-shot grounded planning for embodied agents with large language models," in Proceedings of the IEEE/CVF International Conference on Computer Vision, 2023, pp. 2998-3009.
  10. B. Liu et al., "Llm+ p: Empowering large language models with optimal planning proficiency," arXiv preprint arXiv:2304.11477, 2023. · arXiv
  11. Y. Ding, X. Zhang, C. Paxton, and S. Zhang, "Task and motion planning with large language models for object rearrangement," arXiv preprint arXiv:2303.06247, 2023. · arXiv
  12. M. Ahn et al., "Do as i can, not as i say: Grounding language in robotic affordances," arXiv preprint arXiv:2204.01691, 2022. · arXiv
  13. K. Rana, J. Haviland, S. Garg, J. Abou-Chakra, I. Reid, and N. Suen- derhauf, "Sayplan: Grounding large language models using 3d scene graphs for scalable robot task planning," in Conference on Robot Learning. PMLR, 2023, pp. 23-72.
  14. Y. Chen, J. Arkin, Y. Zhang, N. Roy, and C. Fan, "Autotamp: Au- toregressive task and motion planning with llms as translators and checkers," arXiv preprint arXiv:2306.06531, 2023. · arXiv
  15. T. Silver, S. Dan, K. Srinivas, J. B. Tenenbaum, L. Kaelbling, and M. Katz, "Generalized planning in PDDL domains with pretrained large language models," in Proceedings of the AAAI Conference on Artificial Intelligence, vol. 38, no. 18, 2024, pp. 20 256-20 264.
  16. V. Pallagani et al., "On the prospects of incorporating large language models (llms) in automated planning and scheduling (aps)," in Pro- ceedings of the International Conference on Automated Planning and Scheduling, vol. 34, 2024, pp. 432-444.
  17. K. Valmeekam, A. Olmo, S. Sreedharan, and S. Kambhampati, "Large language models still can't plan (a benchmark for llms on planning and reasoning about change)," arXiv preprint arXiv:2206.10498, 2022. · arXiv
  18. Y. Xie, C. Yu, T. Zhu, J. Bai, Z. Gong, and H. Soh, "Translating natural language to planning goals with large-language models," arXiv preprint arXiv:2302.05128, 2023. · arXiv
  19. M. Zuo, F. P. Velez, X. Li, M. L. Littman, and S. H. Bach, "Planetarium: A rigorous benchmark for translating text to structured planning languages," arXiv preprint arXiv:2407.03321, 2024. · arXiv
  20. Y. Goel, N. Vaskevicius, L. Palmieri, N. Chebrolu, K. O. Arras, and C. Stachniss, "Semantically informed mpc for context-aware robot exploration," in 2023 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). IEEE, 2023, pp. 11 218-11 225.
  21. G. Chalvatzaki, A. Younes, D. Nandha, A. T. Le, L. F. Ribeiro, and I. Gurevych, "Learning to reason over scene graphs: a case study of finetuning gpt-2 into a robot language model for grounded task planning," Frontiers in Robotics and AI, vol. 10, 2023.
  22. Z. Ravichandran, L. Peng, N. Hughes, J. D. Griffith, and L. Carlone, "Hierarchical representations and explicit memory: Learning effective navigation policies on 3d scene graphs using graph neural networks," in 2022 International Conference on Robotics and Automation (ICRA). IEEE, 2022, pp. 9272-9279.
  23. C. Agia et al., "Taskography: Evaluating robot task planning over large 3d scene graphs," in Conference on Robot Learning. PMLR, 2022.
  24. I. Armeni et al., "3d scene graph: A structure for unified semantics, 3d space, and camera," in Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), 2019.
  25. A. Rosinol et al., "Kimera: From slam to spatial perception with 3d dynamic scene graphs," The International Journal of Robotics Research, vol. 40, no. 12-14, pp. 1510-1546, 2021.
  26. J. Wald, H. Dhamo, N. Navab, and F. Tombari, "Learning 3d semantic scene graphs from 3d indoor reconstructions," in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2020.
  27. S.-C. Wu, J. Wald, K. Tateno, N. Navab, and F. Tombari, "Scenegraph- fusion: Incremental 3d scene graph prediction from rgb-d sequences," in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), June 2021, pp. 7515-7525.
  28. Z. Wang, B. Cheng, L. Zhao, D. Xu, Y. Tang, and L. Sheng, "Vl- sat: Visual-linguistic semantics assisted training for 3d semantic scene graph prediction in point cloud," in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), June 2023, pp. 21 560-21 569.
  29. S. Koch, P. Hermosilla, N. Vaskevicius, M. Colosi, and T. Ropinski, "Sgrec3d: Self-supervised 3d scene graph learning via object-level scene reconstruction," in Proceedings of the IEEE/CVF Winter Con- ference on Applications of Computer Vision (WACV), 2024.
  30. S. Koch, P. Hermosilla, N. Vaskevicius, M. Colosi, and T. Ropinski, "Lang3dsg: Language-based contrastive pre-training for 3d scene graph prediction," arXiv preprint arXiv:2310.16494, 2023. · arXiv
  31. Q. Gu et al., "Conceptgraphs: Open-vocabulary 3d scene graphs for perception and planning," arXiv preprint arXiv:2309.16650, 2023. · arXiv
  32. H. Chang et al., "Context-aware entity grounding with open-vocabulary 3d scene graphs," in 7th Annual Conference on Robot Learning, 2023.
  33. S. Koch, N. Vaskevicius, M. Colosi, P. Hermosilla, and T. Ropinski, "Open3dsg: Open-vocabulary 3d scene graphs from point clouds with queryable objects and open-set relationships," arXiv preprint arXiv:2402.12259, 2024. · arXiv
  34. Z. Seymour, N. C. Mithun, H.-P. Chiu, S. Samarasekera, and R. Kumar, "Graphmapper: Efficient visual navigation by scene graph generation," in 2022 26th International Conference on Pattern Recognition (ICPR). IEEE, 2022, pp. 4146-4153.
  35. S. Xiong, A. Payani, R. Kompella, and F. Fekri, "Large language models can learn temporal reasoning," arXiv preprint arXiv:2401.06853, 2024. · arXiv
  36. Y. Yang, S. Xiong, A. Payani, E. Shareghi, and F. Fekri, "Harnessing the power of large language models for natural language to first-order logic translation," arXiv preprint arXiv:2305.15541, 2023. · arXiv
  37. T. Brown et al., "Language models are few-shot learners," Advances in neural information processing systems, vol. 33, pp. 1877-1901, 2020.
  38. B. Chen et al., "Open-vocabulary queryable scene representations for real world planning," in 2023 IEEE International Conference on Robotics and Automation (ICRA). IEEE, 2023, pp. 11 509-11 522.
  39. D. Shah, B. Osiński, S. Levine et al., "Lm-nav: Robotic navigation with large pre-trained models of language, vision, and action," in Conference on Robot Learning. PMLR, 2023, pp. 492-504.
  40. S. Wang et al., "Less is more: Generating grounded navigation instruc- tions from landmarks," in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2022, pp. 15 428-15 438.
  41. M. Helmert, "The Fast Downward Planning System," Journal of Artificial Intelligence Research, vol. 26, pp. 191-246, 2006.
  42. T. Silver and R. Chitnis, "Pddlgym: Gym environments from pddl problems," in International Conference on Automated Planning and Scheduling (ICAPS) PRL Workshop, 2020.
  43. R. Howey, D. Long, and M. Fox, "VAL: automatic plan validation, continuous effects and mixed initiative planning using PDDL," in 16th IEEE International Conference on Tools with Artificial Intelligence. IEEE, 2004, pp. 294-301.

Cited by

See all 60

Metadata

Authors
Liu, Y., Palmieri, L., Koch, S., Georgievski, I., & Aiello, M.
Affiliations
  • Robert Bosch (Germany) (DE)
  • University of Stuttgart (DE)
ORCID
Venue
arXiv
Publisher
arXiv
Published
2024
Pages
10995-11001
ISSN
1050-4729 (ISSN-L)
DOI
10.48550/arxiv.2404.03275
arXiv
2404.03275
OpenAlex
W4413945106
Cited by
60
References
0
Citations by year
2026: 34 · 2025: 20 · 2024: 6
FWCI
19.62
Type
conference paper
Language
en
Open access
Licence
Locations
  • Proceedings - IEEE International Conference on Robotics and Automation/Proceedings (publishedVersion)
  • arXiv (Cornell University) (submittedVersion, cc-by)
  • arXiv (Cornell University) (cc-by)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › AI-based Problem Solving and Planning
  • Physical Sciences › Engineering › Control and Systems Engineering › Robot Manipulation and Learning
  • Physical Sciences › Engineering › Control and Systems Engineering › Robotic Path Planning Algorithms
Keywords
robot task planning, large language models, scene graph, plan feasibility, hallucination mitigation, task and motion planning

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: DELTA: Decomposed Efficient Long-Term Robot Task Planning using Large Language Models. https://app.cochat.ai/papers/10.48550/arxiv.2404.03275
The paper
Liu, Y., Palmieri, L., Koch, S., Georgievski, I., & Aiello, M. (2024). DELTA: Decomposed Efficient Long-Term Robot Task Planning using Large Language Models. arXiv. https://doi.org/10.48550/arxiv.2404.03275

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.