PreprintCited by 69AI-based Problem Solving and PlanningNatural Language Processing TechniquesMulti-Agent Systems and Negotiation

Understanding the planning of LLM agents: A survey

Open access
Huang, Xu, Liu, Weiwen, Chen, Xiaolong, Wang, Xingmei, Wang, Hao, Lian, Defu, Wang, Yasheng, Tang, Ruiming +1 more·2024·arXiv

Abstract

As Large Language Models (LLMs) have shown significant intelligence, the progress to leverage LLMs as planning modules of autonomous agents has attracted more attention. This survey provides the first systematic view of LLM-based agents planning, covering recent works aiming to improve planning ability. We provide a taxonomy of existing works on LLM-Agent planning, which can be categorized into Task Decomposition, Plan Selection, External Module, Reflection and Memory. Comprehensive analyses are conducted for each direction, and further challenges for the field of research are discussed.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.2402.02716

Cites

0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • LLM agents frequently optimize for actions with local consistency, resulting in a departure from objectives at the global level.

    “Due to the inherent nature of planning by the agent, LLM agents frequently optimize for actions with local consistency, which results in a departure from objectives at the global level (Huang et al., 2024; Everitt et al., 2025).”

    From From Storage to Experience: A Survey on the Evolution of LLM Agent Memory Mechanisms (2026) · cites this paper as Huang et al., 2024

    Section 9 (Conclusions and Future Directions; page unavailable) says existing LLM-agent planning can be greedy and may produce plans unfaithful to task prompts. That supports a concern about planning failures, but it does not say agents frequently optimize for locally consistent actions or establish that this causes departure from global objectives. (LLM, conf=0.82)

    Experimental — accuracy not yet measured
  • Interactive environments introduce a larger and more highly task-dependent design space compared to single-input-output settings.

    “First, they introduce a larger and more highly task-dependent design space compared to the singleinput-output settings.”

    From ADIAS: Automated Design of Interactive Agentic Systems (2026) · cites this paper as Huang et al., 2024

    The Evaluation section (page not provided) describes interactive environments with different action spaces and feedback, and explains that a method suitable for gaming tasks does not apply to the two-action QA tasks. This supports the task-dependent aspect, but the paper does not compare their overall design space with single-input-output settings. (LLM, conf=0.84)

    Experimental — accuracy not yet measured
  • The planning component enables an agent to decompose complex tasks into structured sequences of sub-tasks, facilitating long-horizon decision-making.

    “The planning component enables an agent to decompose complex tasks into structured sequences of sub-tasks, facilitating long-horizon decision-making [269].”

    From A Survey of Large Language Models (2026) · cites this paper as [269]

  • In dynamic environments, agents often need to interleave planning and execution, adapting their actions in response to evolving context.

    “In dynamic environments, agents often need to interleave planning and execution, adapting their actions in response to evolving context [37].”

    From Evaluation and Benchmarking of LLM Agents: A Survey (2025) · cites this paper as [37]

  • Successful interactive agents may require different combinations of observation processing, memory, planning, tool use, verification, and recovery mechanisms.

    “Successful agents may require different combinations of observation processing, memory, planning, tool use, verification, and recovery mechanisms (Huang et al., 2024;Wang et al., 2024a).”

    From ADIAS: Automated Design of Interactive Agentic Systems (2026) · cites this paper as Huang et al., 2024

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

The publisher hasn’t deposited this paper’s reference list.

Research works printed but not linked: 20

  1. An et al., 2023] Shengnan An, Zexiong Ma, et al. Learning from mistakes makes llm better reasoner. arXiv preprint arXiv:2310.20689, 2023. · arXiv
  2. Maciej Besta, Nils Blach, et al. Graph of thoughts: Solving elaborate problems with large language models. arXiv preprint arXiv:2308.09687, 2023. · arXiv
  3. Deng Cai, Yan Wang, Lemao Liu, and Shuming Shi. Recent advances in retrieval-augmented text generation. In SIGIR, pages 3417-3419, 2022.
  4. Chen et al., 2021a] Lili Chen, Kevin Lu, et al. Decision transformer: Reinforcement learning via sequence mod- eling. NeurIPS, 34:15084-15097, 2021.
  5. Chen et al., 2021b] Mark Chen, Jerry Tworek, et al. Eval- uating large language models trained on code. arXiv preprint arXiv:2107.03374, 2021. · arXiv
  6. Gao et al., 2023] Luyu Gao, Aman Madaan, et al. Pal: Program-aided language models. In ICML, pages 10764- 10799, 2023.
  7. Gerevini and Serina, 2002] Alfonso Gerevini and Ivan Se- rina. Lpg: A planner based on local search for planning graphs with action costs. In Aips, volume 2, pages 281- 290, 2002.
  8. Malik Ghallab, Dana Nau, et al. Auto- mated Planning: theory and practice. Elsevier, 2004.
  9. Haslum et al., 2019] Patrik Haslum, Nir Lipovetzky, et al. An introduction to the planning domain definition lan- guage, volume 13. Springer, 2019.
  10. Jeff Johnson, Matthijs Douze, and Hervé Jégou. Billion-scale similarity search with GPUs. IEEE Transactions on Big Data, 7(3):535-547, 2019.
  11. Takeshi Kojima, Shixiang Shane Gu, et al. Large language models are zero-shot reasoners. NeurIPS, 35:22199-22213, 2022.
  12. Patrick Lewis, Ethan Perez, et al. Retrieval-augmented generation for knowledge-intensive nlp tasks. NeurIPS, 33:9459-9474, 2020.
  13. Joon Sung Park, Joseph O'Brien, et al. Generative agents: Interactive simulacra of human behav- ior. In SUIST, pages 1-22, 2023.
  14. Schraagen et al., 2000] Jan Maarten Schraagen, Susan F Chipman, et al. Cognitive task analysis. Psychology Press, 2000.
  15. Shinn et al., 2023] Noah Shinn, Federico Cassano, et al. Reflexion: Language agents with verbal reinforcement learning. In NeurIPS, 2023.
  16. Ishika Singh, Valts Blukis, et al. Prog- prompt: Generating situated robot task plans using large language models. In ICRA 2023, pages 11523-11530. IEEE, 2023.
  17. James Thorne, Andreas Vlachos, et al. Fever: a large-scale dataset for fact extraction and verifi- cation. arXiv preprint arXiv:1803.05355, 2018. · arXiv
  18. Touvron et al., 2023] Hugo Touvron, Louis Martin, et al. Llama 2: Open foundation and fine-tuned chat models. arXiv preprint arXiv:2307.09288, 2023. · arXiv
  19. Jason Wei, Xuezhi Wang, et al. Chain- of-thought prompting elicits reasoning in large language models. NeurIPS, 35:24824-24837, 2022.
  20. Yao et al., 2020b] Shunyu Yao, Rohan Rao, et al. Keep calm and explore: Language models for action generation in text-based games. arXiv preprint arXiv:2010.02903, 2020. · arXiv

Cited by

Sorted by citations

Authors
Huang, X., Liu, W., Chen, X., Wang, X., Wang, H., Lian, D., Wang, Y., Tang, R., & Chen, E.
Affiliations
  • University of Science and Technology of China (CN)
  • Huawei Technologies (China) (CN)
Venue
arXiv
Publisher
arXiv
Published
2024
ISSN
2331-8422 (ISSN-L)
OpenAlex
W4391620956
Cited by
47
References
0
Citations by year
2026: 12 · 2025: 26 · 2024: 9
Type
posted content
Language
en
Open access
Locations
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › AI-based Problem Solving and Planning
  • Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
  • Physical Sciences › Computer Science › Artificial Intelligence › Multi-Agent Systems and Negotiation
Keywords
large language models, LLM agents, autonomous agents, planning, task decomposition, plan selection, external module, reflection, memory

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review