Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 196 of the 196 references it cites were found in a registry or an index; 159 of the 182 sources its claims cite were checked for support.

A survey on large language model based autonomous agents

Open access

Abstract

Abstract Autonomous agents have long been a research focus in academic and industry communities. Previous research often focuses on training agents with limited knowledge within isolated environments, which diverges significantly from human learning processes, and makes the agents hard to achieve human-like decisions. Recently, through the acquisition of vast amounts of Web knowledge, large language models (LLMs) have shown potential in human-level intelligence, leading to a surge in research on LLM-based autonomous agents. In this paper, we present a comprehensive survey of these studies, delivering a systematic review of LLM-based autonomous agents from a holistic perspective. We first discuss the construction of LLM-based autonomous agents, proposing a unified framework that encompasses much of previous work. Then, we present a overview of the diverse applications of LLM-based autonomous agents in social science, natural science, and engineering. Finally, we delve into the evaluation strategies commonly used for LLM-based autonomous agents. Based on the previous studies, we also present several challenges and future directions in this field.

Overview

CoChat Summary

## TL;DR

This paper is a survey of LLM-based autonomous agents, organizing the literature around three pillars: construction, application, and evaluation. It proposes a unified framework for agent architecture, reviews application areas across social science, natural science, and engineering, and summarizes common evaluation strategies plus open challenges.

## Key findings

  • The authors state they compiled 100 relevant works on LLM-based agents and synthesized them into a taxonomy covering construction, application, and evaluation.
  • For agent construction, they propose a unified architecture with four modules: profiling, memory, planning, and action; they also divide capability acquisition into fine-tuning and non-fine-tuning strategies.
  • For evaluation, they distinguish subjective and objective methods; objective evaluation is further broken into metrics, protocols, and benchmarks such as task success, human similarity, efficiency, real-world simulation, social evaluation, multi-task evaluation, and software testing.
  • The paper identifies major challenges including role-playing capability, prompt robustness, hallucination, knowledge boundary, and efficiency.

## Methods

  • This is a survey/review paper, not an experimental study; it systematically organizes prior work on LLM-based autonomous agents.
  • The survey is structured around three aspects: agent construction, application, and evaluation; construction is further split into architecture design and capability acquisition.
  • The authors use taxonomies and representative examples from prior papers to synthesize methods, applications, benchmarks, and challenges.

## Limitations

  • The paper does not report original experiments or new quantitative results; this is implied by the survey nature of the work.
  • The text states that the field is “still at its initial stage”, so the synthesis is limited by the maturity of the underlying literature.
  • The authors note that some content is “not explicitly discussed in the paper” in their tables/figures, indicating incomplete coverage of all possible agent designs and evaluation modes.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1007/s11704-024-40231-1

Cites

196 of 196 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Verification

Claims the paper makes

90 Valid · 12 Not valid · 9 Not checked · 90 Own results and interpretations

41 more claims · 22 with their cited sources checked

Create a free account to see all 201 claims and to verify the 5 references still open.

See all claims — free account
  • It may state two separate claims as one. 79
  • Probably not a substantial claim. 112
  • The quote only partly states this claim. 2

Create a free account to see these claims.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

20 more claims about this paper

Create a free account to see every claim other papers make about this one.

See all claims — free account

Citations

Cites

Show all 61 references

Research works printed but not linked: 5

  1. Radford A, Wu J, Child R, Luan D, Amodei D, Sutskever I. Language models are unsupervised multitask learners. OpenAI Blog, 2019, 1(8): 9
  2. Raman S S, Cohen V, Rosen E, Idrees I, Paulius D, Tellex S. Planning with large language models via corrective re-prompting. In: Proceedings of Foundation Models for Decision Making Workshop at Neural Information Processing Systems. 2022
  3. Weng X, Gu Y, Zheng B, Chen S, Stevens S, Wang B, Sun H, Su Y. Mind2Web: towards a generalist agent for the Web. In: Proceedings of the 37th Conference on Neural Information Processing Systems. 2023, 36
  4. Aher G V, Arriaga R I, Kalai A T. Using large language models to simulate multiple humans and replicate human subject studies. In: Proceedings of the 40th International Conference on Machine Learning. 2023, 337–371
  5. Nottingham K, Ammanabrolu P, Suhr A, Choi Y, Hajishirzi H, Singh S, Fox R. Do embodied agents dream of pixelated sheep: embodied decision making using language guided world modelling. In: Proceedings of the 40th International Conference on Machine Learning. 2023, 26311–26325

Cited by

See all 1,941

Metadata

Authors
Wang, L., Ma, C., Feng, X., Zhang, Z., Yang, H., Zhang, J., Chen, Z., Tang, J., Chen, X., Lin, Y., Zhao, W. X., Wei, Z., & Wen, J.
Affiliations
Renmin University of China (CN)
Corresponding author
  • Chen, Xu
  • Lin, Yankai
Venue
Frontiers of Computer Science
Published
2024-03-22
Volume
18
Issue
6
ISSN
  • 2095-2228 (ISSN-L)
  • 2095-2236
OpenAlex
W4393065402
Cited by
1,941
References
61
Citations by year
2026: 1060 · 2025: 623 · 2024: 249
FWCI
284.94
Type
journal article
Language
en
Open access
Licence
Locations
  • Frontiers of Computer Science (publishedVersion, cc-by)
  • arXiv (Cornell University) (submittedVersion, cc-by)
  • arXiv (Cornell University) (cc-by)
Funders
  • National Natural Science Foundation of China (62102420)
  • Renmin University of China
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence Applications
  • Physical Sciences › Computer Science › Artificial Intelligence › AI-based Problem Solving and Planning
  • Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
Keywords
large language models, autonomous agents, LLM agents, agent applications, assessment methods, human-like decision making, social science applications, engineering applications

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-09-28, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-09-28 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (qwen3.8-omni-flash and gpt-6-sol).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: A survey on large language model based autonomous agents. https://app.cochat.ai/papers/10.1007/s11704-024-40231-1
The paper
Wang, L., Ma, C., Feng, X., Zhang, Z., Yang, H., Zhang, J., Chen, Z., Tang, J., Chen, X., Lin, Y., Zhao, W. X., Wei, Z., & Wen, J. (2024). A survey on large language model based autonomous agents. Frontiers of Computer Science. https://doi.org/10.1007/s11704-024-40231-1

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.