Reflexion: Language Agents with Verbal Reinforcement Learning
Open accessThe DOI matches its DataCite record; 42 of the 42 references it cites were found in a registry or an index; 7 of the 8 sources its claims cite were checked for support.
Abstract
Large language models (LLMs) have been increasingly used to interact with external environments (e.g., games, compilers, APIs) as goal-driven agents. However, it remains challenging for these language agents to quickly and efficiently learn from trial-and-error as traditional reinforcement learning methods require extensive training samples and expensive model fine-tuning. We propose Reflexion, a novel framework to reinforce language agents not by updating weights, but instead through linguistic feedback. Concretely, Reflexion agents verbally reflect on task feedback signals, then maintain their own reflective text in an episodic memory buffer to induce better decision-making in subsequent trials. Reflexion is flexible enough to incorporate various types (scalar values or free-form language) and sources (external or internally simulated) of feedback signals, and obtains significant improvements over a baseline agent across diverse tasks (sequential decision-making, coding, language reasoning). For example, Reflexion achieves a 91% pass@1 accuracy on the HumanEval coding benchmark, surpassing the previous state-of-the-art GPT-4 that achieves 80%. We also conduct ablation and analysis studies using different feedback signals, feedback incorporation methods, and agent types, and provide insights into how they affect performance.
Overview
CoChat Summary
TL;DR
Reflexion reinforces language agents through verbal self-reflection stored in episodic memory rather than weight updates, improving performance across decision-making, reasoning, and coding tasks. It reports gains including 91% pass@1 on HumanEval, a 22% absolute improvement on AlfWorld, and 20% on HotPotQA.
Key findings
- On HumanEval Python, Reflexion achieves 91.0 pass@1, surpassing the previous state-of-the-art GPT-4 at 80.1; on HumanEval Rust it reaches 68.0 vs. 60.0, MBPP Rust 75.4 vs. 70.9, and Leetcode Hard 15.0 vs. 7.5.
- In AlfWorld, ReAct + Reflexion completes 130 out of 134 tasks using a simple heuristic and improves over strong baselines by an absolute 22% over 12 iterative learning steps; ReAct-only converges at a 22% hallucination rate with no long-term recovery.
- In HotPotQA, Reflexion improves over baselines by 20%; self-reflection gives an 8% absolute boost over episodic memory alone, and although CoT (GT) fails on 39% of questions, Reflexion improves accuracy by 14% without access to ground-truth answers.
- Ablations on the 50 hardest HumanEval Rust problems show full Reflexion at 0.68 vs. baseline 0.60; omitting test generation drops to 0.52, and omitting self-reflection stays at 0.60.
Methods
- Reflexion uses a modular loop with an Actor that generates text/actions, an Evaluator that scores outputs, and a Self-Reflection model that converts feedback into verbal summaries stored in memory; trials repeat until the Evaluator passes or a max trial count is reached, with memory usually bounded to 1–3 experiences.
- Experiments cover AlfWorld (134 environments, six tasks, ReAct + GPT-3), HotPotQA (100 questions, CoT/ReAct, exact-match grading, memory size 3), and programming (HumanEval, MBPP, LeetcodeHardGym; Python/Rust via MultiPL-E; self-generated unit tests up to 6).
- Ablations and analyses vary feedback signals, feedback incorporation methods, and agent types; compromised approaches are tested on HumanEval Rust, and a WebShop experiment is run across 100 environments.
Limitations
- The paper states Reflexion may fall into non-optimal local minima, limits long-term memory to a sliding window with maximum capacity, and notes code-generation test-driven development is limited by non-deterministic, impure, hardware-dependent, or concurrent functions; it also relies on LLM self-evaluation/heuristics and lacks a formal success guarantee.
- The paper reports WebShop failure: after only four trials the agent shows no improvement and does not generate helpful self-reflections, concluding Reflexion cannot solve tasks requiring significant diversity and exploration.
- Evident from the text: self-correction is an emergent quality of stronger, larger models—starchat-beta shows no improvement (baseline 0.26 vs. Reflexion 0.26)—and flaky or incorrect test suites can cause false positives/negatives, with false negatives preferred.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
4 Valid · 2 Not valid · 0 Not checked · 59 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Therefore, in the case in which the model generates a flaky test suite, it is possible that all tests pass on an incorrect solution and lead to a false positive label on a code completion [11].”
§ Reflexion: Language Agents with Verbal Reinforcement Learning > Analysis
What the sources say
- Partly supportedcites [11] 11. Lam, W., Winter, S., Wei, A., Xie, T., Marinov, D., and Bell, J. (2020). A large-scale longitudinal study of flaky tests. Proc. ACM Program. Lang., 4(OOPSLA). sourceExperimental — accuracy not yet measured
The Introduction (page not provided) says a flaky test can pass and fail on the same code and that changes may be merged when all tests pass. It does not address model-generated test suites, incorrect code completions, or false-positive labels, so those parts of the claim are not established by this paper. (LLM, conf=0.82)
hedgedstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“3 shows an inferior 52% vs 60% (baseline) accuracy, which suggests that the agent is unable to determine if the current implementation is correct without unit tests.”
§ Reflexion: Language Agents with Verbal Reinforcement Learning > Ablation study
hedgedstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“ReAct + Reflexion significantly outperforms ReAct by completing 130 out of 134 tasks using the simple heuristic to detect hallucinations and inefficient planning.”
§ Reflexion: Language Agents with Verbal Reinforcement Learning > Results
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“4 shows that self-reflection improves learning by an 8% absolute boost over the episodic memory learning advantage.”
§ Reflexion: Language Agents with Verbal Reinforcement Learning > Analysis
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“on reasoning questions in HotPotQA [28] by 20%”
- Also stated in: § 4 Experiments · plain
“Most notably, Reflexion improves performance over strong baselines by 22% in AlfWorld, 20% in HotPotQA, and 11% on HumanEval.”
§ Reflexion: Language Agents with Verbal Reinforcement Learning > 1 Introduction
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § 4 Experiments · plain
30 more claims
Create a free account to see all 65 claims and every source verdict.
- It may state two separate claims as one. 18
- Probably not a substantial claim. 11
- The quote only partly states this claim. 3
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source doesn’t support the claim as written.
In the citing paper
“Memory and reflection systems such as MemAgent (Yu et al., 2025a), Reflexion (Shinn et al., 2023), and Generative Agents (Park et al., 2023) improve retrieval and episodic memory, but do not perform context shaping, state restructuring, or nextinstruction refinement.”
From PAACE: A Plan-Aware Automated Agent Context Engineering Framework (2025) · cites this paper as Shinn et al., 2023
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe cited source doesn’t support the claim as written.
In the citing paper
“However, Reflexion computes verbal reward over a full trajectory, yielding a single end-of-episode signal that conflates credit across reasoning steps: a failure due to a single intermediate error receives the same critique pressure as one due to a flawed strategy.”
From Process Supervision via Verbal Critique Improves Reasoning in Large Language Models (2026) · cites this paper as Shinn et al. [2023]
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe cited source doesn’t support the claim as written.
In the citing paper
“Unlike Reflexion, which only reflects on unsuccessful trajectories, our approach separately reflects on both successful and unsuccessful ones.”
From An Efficient Context-Dependent Memory Framework for LLM-Centric Agents (2025) · cites this paper as Shinn et al., 2023
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe cited source doesn’t support the claim as written.
In the citing paper
“The dominant approach is to curate memory at write time.”
From Just-in-Time Memory: Learning to Curate Task-Adaptive Memory for LLM Agents (2026) · cites this paper as Shinn et al., 2023
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Interaction and code generation are increasingly used together, with code as the modality of choice for actions [48, 59], tool construction [13, 51, 69], and reasoning [39, 66, 67].”
From SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineering (2024) · cites this paper as [39]
Experimental — accuracy not yet measured
107 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Reflexion: Language Agents with Verbal Reinforcement Learning > 3 Reflexion: reinforcement via verbal reflection
“while M e not pass or t < max trials do”
§ Reflexion: Language Agents with Verbal Reinforcement Learning > Self-reflection
“The Actor, Evaluator, and Self-Reflection models work together through trials in a loop until the Evaluator deems τ t to be correct.”
Citations
Cites
The publisher hasn’t deposited this paper’s reference list.
Cited by
Items 501–600 of 3,537
HarnessDev: Can LLMs Create and Evolve Their Own Agent Harness?Preprint
Wu, Y., Zhang, J., Shi, J., Lei, X., Gu, Q., Zhang, Y., Wang, Z., He, C., Huang, C., Song, M., et al. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2609.01437 · Cited by 22
“Effective harness improvement therefore demands that the model recognize its own behavioral limitations from execution traces [42], diagnose structural bottlenecks in the system it runs inside, and commit targeted changes that accumulate into lasting, reusable capability gains rather than one-off…”
Exchange-of-Thought: Enhancing Large Language Model Capabilities through Cross-Model Communication
Yin, Z., Sun, Q., Chang, C., Guo, Q., Dai, J., Huang, X., & Qiu, X. (2023) · arXiv · doi:10.48550/arxiv.2312.01823 · Cited by 21
A Generative Artificial Intelligence Copilot for Biomedical Nanoengineering
Wang, Y., Song, H., Teng, Y., Huang, G., Qian, J., Wang, H., Dong, S., Ha, J., Ma, Y., Chang, M., et al. (2025) · ACS Nano · doi:10.1021/acsnano.5c03454 · Cited by 22
Diagnosing Bias and Instability in LLM Evaluation: A Scalable Pairwise Meta-Evaluator
Anghel, C., Anghel, A. A., Pecheanu, E., Cocu, A., Istrate, A., & Andrei, C. A. (2025) · Information · doi:10.3390/info16080652 · Cited by 27
Zhang, Y., Lin, Y., Li, T., & Yang, X. (2025) · Sustainable Cities and Society · doi:10.1016/j.scs.2025.106761 · Cited by 22
Cloud Infrastructure Management in the Age of AI Agents
Yang, Z., Bhatnagar, A., Qiu, Y., Miao, T., Kon, P. T. J., Xiao, Y., Huang, Y., Casado, M., & Chen, A. (2025) · ACM SIGOPS Operating Systems Review · doi:10.1145/3759441.3759443 · Cited by 26
SEDM: Selective Self-Evolving Distributed Memory for Agents
Liu, Y., Min, A., Wang, Y., Yao, Y., Han, Y., Zhang, R., He, J., Li, Z., Qi, Y., Xu, H., et al. (2025) · arXiv · doi:10.48550/arxiv.2509.09498 · Cited by 20
“Approaches such as Reflexion [40] and Voyager [45] allow agents to iteratively refine their strategies by leveraging self-reflection and accumulated trajectories.”
Improving Multi-Agent Debate with Sparse Communication Topology
Li, Y., Du, Y., Zhang, J., Hou, L., Grabowski, P., Li, Y., & Ie, E. (2024) · Findings of the Association for Computational Linguistics: EMNLP 2024 · doi:10.18653/v1/2024.findings-emnlp.427 · Cited by 20
RefAgent: A Multi-agent LLM-based Framework for Automatic Software Refactoring
Oueslati, K., Lamothe, M., & Khomh, F. (2026) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/3744916.3773153 · Cited by 25
“The Compiler Agent employs a self-reflection loop [42] by inter-acting with the Maven compiler tool to validate the syntax of the refactored code.”
LLaMP: Large Language Model Made Powerful for High-fidelity Materials Knowledge Retrieval
Chiang, Y., Hsieh, E., Chou, C.-H., & Riebesell, J. (2025) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2025.emnlp-main.1280 · Cited by 30
FinReflectKG: Agentic Construction and Evaluation of Financial Knowledge Graphs
Arun, A., Dimino, F., Agarwal, T. P., Sarmah, B., & Pasquali, S. (2025) · ACM International Conference on AI in Finance (ICAIF) · doi:10.1145/3768292.3770363 · Cited by 30
System 0/1/2/3: Quad-Process Theory for Multitimescale Embodied Collective Cognitive Systems
Taniguchi, T., Hirai, Y., Suzuki, M., Murata, S., Horii, T., & Tanaka, K. (2025) · Artificial Life · doi:10.1162/artl.a.12 · Cited by 25
Scaling LLM Test-Time Compute with Mobile NPU on Smartphones
Hao, Z., Wei, J., Wang, T., Huang, M., Jiang, H., Jiang, S., Cao, T., & Ren, J. (2026) · European Conference on Computer Systems · doi:10.1145/3767295.3769382 · Cited by 28
Lu, M., Gao, F., Tang, X., & Chen, L. (2024) · iScience · doi:10.1016/j.isci.2024.109451 · Cited by 23
Liu, W., Li, G., Zhang, K., Du, B., Chen, Q., Hu, X., Xu, H., Chen, J., & Wu, J. (2024) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2024.naacl-long.376 · Cited by 34
Ma, P., Li, Z., Sun, A., & Wang, S. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2305.02626 · Cited by 21
How Can LLM Guide RL? A Value-Based ApproachPreprint
Zhang, S.-A., Zheng, S.-R., Ke, S.-Q., Liu, Z., Jin, W.-X., Yuan, J.-B., Yang, Y.-X., Yang, H.-X., & Wang, Z.-R. (2024) · arXiv.org · doi:10.48550/arxiv.2402.16181 · Cited by 18
“Works building on the self-reflection abilities of LLMs (Shinn et al., 2023; Sun et al., 2023; Ma et al., 2023) also demonstrate limitations in refining initial strategies based on feedback, as shown in our experiments.”
BackgroundMethodPromptomatix: An Automatic Prompt Optimization Framework for Large Language ModelsPreprint
Murthy, R., Zhu, M. Q., Yang, L., Qiu, J., Tan, J., Heinecke, S., Xiong, C., Savarese, S., & Wang, H. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2507.14241 · Cited by 23
“• Meta-prompting : Use LLMs to generate and refine prompt variations based on performance feedback [19].”
WebSight: A Vision-First Architecture for Robust Web AgentsPreprint
Bhathal, T., & Gupta, A. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2508.16987 · Cited by 20
“Recent work on self-improving and reflective agents provides a foundation for such capabilities [53, 28, 43].”
Sabbagh, V. B., Lima, C. B. D. C., & Xexeo, G. B. (2024) · SPE Journal · doi:10.2118/223612-pa · Cited by 20
Small Language Model Can Self-Correct
Han, H., Liang, J., Shi, J., He, Q., & Xiao, Y. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i16.29774 · Cited by 40
FactorMiner: A Self-Evolving Agent with Skills and Experience Memory for Financial Alpha Discovery
Wang, Y., Xu, J., Zhang, H., Huang, S., Sun, D., & Zhang, X.-P. S. (2026) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3770855.3818978 · Cited by 23
“Second, we introduce experience memory that enables the agent to self-evolve through accumulated knowledge [28, 36].”
Identifying the Risks of LM Agents with an LM-Emulated Sandbox
Ruan, Y., Dong, H., Wang, A., Pitis, S., Zhou, Y., Ba, J., Dubois, Y., Maddison, C. J., & Hashimoto, T. (2023) · arXiv · doi:10.48550/arxiv.2309.15817 · Cited by 19
Exploring the MIT Mathematics and EECS Curriculum Using Large Language Models
Zhang, S. J., Florin, S., Lee, A. N., Niknafs, E., Marginean, A., Wang, A., Tyser, K., Chin, Z., Hicke, Y., Singh, N., et al. (2023) · arXiv · doi:10.48550/arxiv.2306.08997 · Cited by 19
RetractedTimeArena: Shaping Efficient Multitasking Language Agents in a Time-Aware Simulation
Zhang, Y., Yuan, S., Hu, C., Richardson, K., Xiao, Y., & Chen, J. (2024) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2024.acl-long.215 · Cited by 27
GlitchBench: Can Large Multimodal Models Detect Video Game Glitches?
Taesiri, M. R., Feng, T., Bezemer, C., & Nguyen, A. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.02118 · Cited by 38
Blind Spot Navigation in Large Language Model Reasoning with Thought Space Explorer
Zhang, J., Mo, F., Weerasooriya, T. C., Ye, X., Wang, D., Fu, Y., & Liu, K. (2026) · Findings of the Association for Computational Linguistics: EACL · doi:10.18653/v1/2026.findings-eacl.191 · Cited by 22
From Words to Code: Harnessing Data for Program Synthesis from Natural LanguagePreprint
Khatry, A., Cahoon, J., Henkel, J., Deep, S., Emani, V., Floratou, A., Gulwani, S., Le, V., Raza, M., Shi, S., et al. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2305.01598 · Cited by 23
Knowledge Graph Enhanced Language Agents for RecommendationPreprint
Guo, T., Liu, C., Wang, H. R., Mannam, V., Wang, F., Chen, X., Zhang, X., & Reddy, C. K. A. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2410.19627 · Cited by 22
Privacy-Enhancing Paradigms within Federated Multi-Agent SystemsPreprint
Shi, Z., Wan, G., Huang, W., Zhang, G., Shao, J., Ye, M., & Yang, C. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2503.08175 · Cited by 27
The OpenELM Library: Leveraging Progress in Language Models for Novel Evolutionary Algorithms
Bradley, H., Fan, H., Galanos, T., Zhou, R., Scott, D., & Lehman, J. (2024) · Genetic and Evolutionary Computation · doi:10.1007/978-981-99-8413-8_10 · Cited by 19
Huang, W., Zhuang, H., Huang, W., Kou, J., Wei, R., & Lyu, N. (2026) · International Conference on Communications, Information System and Computer Engineering (CISCE) · doi:10.1109/cisce69494.2026.11504621 · Cited by 18
“Self-Refine [12] and Reflexion [13] enable agents to iteratively improve outputs via verbal self-feedback.”
VLN-Game: Vision-Language Equilibrium Search for Zero-Shot Semantic Navigation
Yu, B., Liu, Y., Han, L., Kasaei, H., Li, T., & Cao, M. (2026) · IEEE Transactions on Robotics · doi:10.1109/tro.2026.3677047 · Cited by 24
“The likelihood of these hallucinations grows with the complexity and scale of the models, as the vast amounts of data they process can lead to the generation of common but incorrect outputs.”
Abstractive text summarization: A comprehensive survey of techniques, systems, and challenges
Almohaimeed, N., & Azmi, A. M. (2025) · Computer Science Review · doi:10.1016/j.cosrev.2025.100762 · Cited by 20
Personalized Distillation: Empowering Open-Sourced LLMs with Adaptive Learning for Code Generation
Chen, H., Saha, A., Hoi, S. C. H., & Joty, S. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.417 · Cited by 38
Large Language Model Guided Self-Debugging Code GenerationPreprint
Adnan, M., Kuhn, C. C. N., & Xu, Z. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5396508 · Cited by 19
WebWalker: Benchmarking LLMs in Web Traversal
Wu, J., Yin, W., Jiang, Y., Wang, Z., Xi, Z., Fang, R., Zhang, L., He, Y., Zhou, D., Xie, P., et al. (2025) · Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2025.acl-long.508 · Cited by 18
MINT: Evaluating LLMs in Multi-turn Interaction with Tools and Language Feedback
Wang, X., Wang, Z., Liu, J., Chen, Y., Yuan, L., Peng, H., & Ji, H. (2023) · arXiv · doi:10.48550/arxiv.2309.10691 · Cited by 18
Saving SWE-Bench: A Benchmark Mutation Approach for Realistic Agent Evaluation
Garg, S., Steenhoek, B. J., & Huang, Y. (2026) · IEEE/ACM International Conference on AI Engineering – Software Engineering for AI (CAIN) · doi:10.1145/3793653.3793762 · Cited by 19
Condor: Enhance LLM Alignment with Knowledge-Driven Data Synthesis and Refinement
Maosongcao, M., Zhang, T., Li, M., Zhang, C., Liu, Y., He, C., Duan, H., Zhang, S., & Chen, K. (2025) · Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2025.acl-long.1091
VLM Agents Generate Their Own Memories: Distilling Experience into Embodied Programs of Thought
Sarch, G. H., Jang, L., Tarr, M. J., Cohen, W. W., Marino, K., & Fragkiadaki, K. (2024) · neural information processing systems · doi:10.52202/079017-2418 · Cited by 88
Introspective Planning: Aligning Robots' Uncertainty with Inherent Task Ambiguity
Liang, K., Zhang, Z., & Fisac, J. F. (2024) · neural information processing systems · doi:10.52202/079017-2299 · Cited by 58
ANPL: Towards Natural Programming with Interactive Decomposition
Huang, D., Nan, Z., Hu, X., Jin, P., Peng, S., Wen, Y., Zhang, R., Du, Z., Guo, Q., Pu, Y., et al. (2023) · neural information processing systems · doi:10.52202/075280-3040 · Cited by 34
Tree-of-Mixed-Thought: Combining Fast and Slow Thinking for Multi-hop Visual ReasoningPreprint
Hu, P., Qi, J., Li, X., Li, H., Wang, X., Bing, Q., Wang, R., & Zhou, Y. F. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2308.09658 · Cited by 20
LLM4EFFI: Leveraging Large Language Models to Enhance Code Efficiency and CorrectnessPreprint
Ye, T., Huang, W., Zhang, X., Ma, T., Liu, P., Yin, J., & Wang, W. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2502.18489 · Cited by 22
“Other approaches utilize multi-agent collaboration frameworks to enhance code generation (Zhong et al., 2024; Shinn et al., 2023; Islam et al., 2024; Madaan et al., 2023; Li et al., 2024).”
Ji, Y., Zhao, S., Tian, X., Wang, H., Chen, S., Peng, Y., Zhao, H., & Li, X. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2504.00829 · Cited by 18
“While contemporary LLMs, such as GPT-4 [11], Claude 3 [2], and DeepSeek-R1 [17], have demonstrated impressive performance across various tasks, further enhancing their reasoning abilities in specialized domains like mathematical reasoning and code generation is still an ongoing challenge [22, 15].”
AndroTMem: From Interaction Trajectories to Anchored Memory in Long-Horizon GUI AgentsPreprint
Shi, Y., Li, J., Zhang, L., Dongfang, Z., Wu, B., Tao, S., Yan, Y., Qin, C., Liu, W., Lin, Z., et al. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2603.18429 · Cited by 20
Milestone-Guided Policy Learning for Long-Horizon Language AgentsPreprint
Wang, Z., Yan, Y., Li, H., Pan, T., Li, D., Zhang, R., Lu, W., Xiao, J., Zhuang, Y., & Shen, Y. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2605.06078 · Cited by 19
RoboICL: Embodied In-Context Learning with GPT-6 AstraPreprint
Liu, F., Shen, Y., Cheng, A., Mi, W., Tang, C., Liu, C., Xiang, Y., Li, T., Li, Y.-L., & Tang, Y. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2609.34261 · Cited by 24
“ReAct (Yao et al., 2023) and Reflexion (Shinn et al., 2023) use feedback and memory for sequential decision making, while Zeva (Chen et al., 2026a) and Reflective VLA (Lian et al., 2026) study interaction histories in robotics.”
Out of the Cage: How Stochastic Parrots Win in Cyber Security Environments
Rigaki, M., Lukáš, O., Catania, C., & Garcia, S. (2024) · Proceedings of the 16th International Conference on Agents and Artificial Intelligence · doi:10.5220/0012391800003636 · Cited by 17
“Reflexion [30] is a sequential decision-making framework that uses several components, such as self-reflection and evaluation, to assess the quality of the different actions taken by the agent and the whole trajectory within an episode.”
BackgroundMethodInfluentialSargeant, H., Izzidien, A., & Steffek, F. (2025) · Artificial Intelligence and Law · doi:10.1007/s10506-025-09434-0 · Cited by 28
“Shinn et al. (2023) introduced a ‘reflection’ strategy, where an LLM reviews and adjusts its answers based on previous outputs, fostering a self-corrective process.”
Learning from Mistakes via Cooperative Study Assistant for Large Language Models
Wang, D., & Li, L. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.659 · Cited by 41
TickIt: Leveraging Large Language Models for Automated Ticket Escalation
Liu, F., He, X., Zhang, T., Chen, J., Li, Y., Yi, L.-H., Zhang, H., Wu, G., & Shi, R. (2025) · ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) · doi:10.1145/3696630.3728558 · Cited by 22
Wang, R., Todd, G., Yuan, X., Xiao, Z., Côté, M.-A., & Jansen, P. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.830 · Cited by 26
Agent Lumos: Unified and Modular Training for Open-Source Language Agents
Yin, D., Brahman, F., Ravichander, A., Chandu, K., Chang, K.-W., Choi, Y., & Lin, B. Y. (2024) · Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2024.acl-long.670 · Cited by 17
ReWOO: Decoupling Reasoning from Observations for Efficient Augmented Language Models
Xu, B., Peng, Z., Lei, B., Mukherjee, S., Liu, Y., & Xu, D. (2023) · arXiv · doi:10.48550/arxiv.2305.18323 · Cited by 17
Content Knowledge Identification with Multi-agent Large Language Models (LLMs)
Yang, K., Chu, Y., Darwin, T., Han, A., Li, H., Wen, H., Copur-Gencturk, Y., Tang, J., & Liu, H. (2024) · Lecture Notes in Computer Science · doi:10.1007/978-3-031-64299-9_23 · Cited by 17
Beyond pip Install: Evaluating LLM Agents for the Automated Installation of Python Projects
Milliken, L., Kang, S., & Yoo, S. (2025) · IEEE International Conference on Software Analysis, Evolution and Reengineering (SANER) · doi:10.1109/saner64311.2025.00009 · Cited by 35
“The Tox 3 library needs to be installed manually. performance [21] and explainability [22] by emulating human behaviour, we chose to use an LLM-guided search step over traditional search methods, such as BM25 [23] or neural embeddings [24].”
More with Less: An Empirical Study of Turn-Control Strategies for Efficient Coding Agents
Gao, P., & Peng, C.-C. (2026) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/3744916.3773250 · Cited by 18
Luo, Q., Lin, Q., Xu, L., Wu, S., Mao, R., Wang, C., Feng, H., Huang, B., & Du, Z. (2026) · Big Earth Data · doi:10.1080/20964471.2026.2615511 · Cited by 18
EvoGraphCoder: An Evolutionary Graph-Reasoning Framework for Self-Adaptive Software Engineering
Ramamurthy, K., Konduru, R. K., & Amanmadov, N. (2026) · IEEE Access · doi:10.1109/access.2026.3686019 · Cited by 17
“Methods such as Self-Refine and Reflexion iteratively critique and revise model outputs [27], [28].”
Analysis of architecture options for foundation-model-based agents: A taxonomy and decision model
Zhou, J., Lu, Q., Chen, J., Zhu, L., Xu, X., Xing, Z., & Harrer, S. (2026) · Journal of Systems and Software · doi:10.1016/j.jss.2026.113109 · Cited by 18
Bring Your Own KG: Self-Supervised Program Synthesis for Zero-Shot KGQA
Agarwal, D., Das, R., Khosla, S., & Gangadharaiah, R. (2024) · Findings of the Association for Computational Linguistics: NAACL · doi:10.18653/v1/2024.findings-naacl.57 · Cited by 26
Zhou, Y., & Ai, W. (2024) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2024.findings-acl.17 · Cited by 28
Towards Modeling Human-Agentic Collaborative Workflows: A BPMN Extension
Ait, A., Izquierdo, J. L., & Cabot, J. (2025) · Lecture notes in computer science · doi:10.1007/978-3-032-04190-6_22 · Cited by 17
“To alleviate this, reflection strategies have been proposed to refine their answers [13], namely: (1) self-reflection , where agents generate feedback on the plan and reasoning process to re-fine themselves; (2) cross-reflection , where the feedback is provided by other agents; and (3)…”
Towards Pervasive Distributed Agentic Generative AI–A State of The Art
Molinari, G., & Ciravegna, F. (2026) · ACM Computing Surveys · doi:10.1145/3821566 · Cited by 18
“Table 1.”
InfluentialPath-Consistency with Prefix Enhancement for Efficient Inference in LLMsPreprint
Zhu, J., Huang, Y., Shen, Y., Zhao, J., & Zou, A. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2409.01281 · Cited by 21
Exploring the Necessity of Reasoning in LLM-based Agent ScenariosPreprint
Zhou, X., Tie, G., Zhang, G., Wang, W., Zuo, Z., Wu, S., Chu, D., Zhou, P., Gong, N. Z., & Sun, L. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2503.11074 · Cited by 22
Architecting Trust in Artificial Epistemic AgentsPreprint
Marchal, N., Chan, S., Franklin, M., Revel, M., Keeling, G., Fischli, R., Chandra, B., & Gabriel, I. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2603.02960 · Cited by 19
“Future agents will also likely have robust self-improvement cycles, allowing them to learn by interacting with their environment, accumulating knowledge continuously without needing additional retraining to retain previous learning (Shi et al., 2025a; Shinn et al., 2023; Zheng et al., 2025).”
Tu, S., Xu, C., Zhang, Q., Ma, Y., Zhang, Y., Li, L., Li, D., Lan, X., & Zhao, D. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2606.29502 · Cited by 19
“A natural way to reduce this difficulty is to reuse past experience: agents can reflect on trajectories, store reusable textual skills, retrieve relevant skills in later states, and condition future actions on this external memory (Shinn et al., 2023; Wang et al., 2023).”
Autonomous Research Agents: A Survey of AI Scientists and the Verification GapPreprint
Ding, T., Nannapaneni, A., Liu, B., & Zhang, L. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2608.05179 · Cited by 23
Hammane, Z., Ben-Bouazza, F.-E., & Fennan, A. (2024) · 2024 International Conference on Intelligent Systems and Computer Vision (ISCV) · doi:10.1109/iscv60512.2024.10620139 · Cited by 11
“Aligned with the approach described in ”Reflexion: An Autonomous Agent with Dynamic Mentor and Self-Reflection”[14], this prompt focuses on the model characterized as a researcher.”
MethodSurgBox: Agent-Driven Operating Room Sandbox with Surgery Copilot
Wu, J., Liang, X., Bai, X., & Chen, Z. (2024) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata62323.2024.10825748 · Cited by 24
“Many current agent-related works tend to simulate human-like understanding of human activities to generate human-like instructions [15] and facilitate complex interactions and decision-making in a wide range of situations [16], [17].”
Enhancing intent understanding for ambiguous prompt: A human–machine co-adaption strategy
Wang, Y., He, Y., Wang, J., Li, K., Sun, L., Yin, J., Zhang, M., & Wang, X. (2025) · Neurocomputing · doi:10.1016/j.neucom.2025.130415 · Cited by 23
“Advances in large language models (LLMs) self-correction such as Pan et al (Pan et al., 2023), Shinn et al. (Shinn et al., 2023), Madaan et al (Madaan et al., 2024), improving language understanding and production.”
Forouzandeh, S., Peng, W., Moradi, P., Yu, X., & Jalili, M. (2025) · arXiv · doi:10.48550/arxiv.2512.18950 · Cited by 16
Replacing Judges with Juries: Evaluating LLM Generations with a Panel of Diverse Models
Verga, P., Hofstatter, S., Althammer, S., Su, Y., Piktus, A., Arkhangorodsky, A., Xu, M., White, N., & Lewis, P. (2024) · arXiv · doi:10.48550/arxiv.2404.18796 · Cited by 16
PoisonedRAG: Knowledge Corruption Attacks to Retrieval-Augmented Generation of Large Language Models
Zou, W., Geng, R., Wang, B., & Jia, J. (2024) · arXiv · doi:10.48550/arxiv.2402.07867 · Cited by 16
Quiet-STaR: Language Models Can Teach Themselves to Think Before Speaking
Zelikman, E., Harik, G., Shao, Y., Jayasiri, V., Haber, N., & Goodman, N. D. (2024) · arXiv · doi:10.48550/arxiv.2403.09629 · Cited by 16
“Some works have investigated how models can learn from their reasoning mistakes in-context (Shinn et al., 2023; Madaan et al., 2023; Zhang et al., 2024; Liu et al., 2023”
BackgroundMulti-Agent Consensus Seeking via Large Language Models
Chen, H., Ji, W., Xu, L., & Zhao, S. (2023) · arXiv · doi:10.48550/arxiv.2310.20151 · Cited by 16
“For example, research studies such as Camel [5], ChatDev [6], RoCo [19], and MetaGPT [4], along with others [20–22], explore strategies related to task division and collaboration: a complex task is decomposed into several refined subtasks, which are then processed by agents based on their expertise.”
MethodJoint User Association and Beamforming Design for ISAC Networks With Large Language Models
Li, H., Xiao, M., Wang, K., Schober, R., Kim, D. I., & Guan, Y. L. (2025) · IEEE Open Journal of the Communications Society · doi:10.1109/ojcoms.2025.3606812 · Cited by 16
“Finally, the self-reflection technique has proven to be a powerful tool that enables LLMs to learn from their mistakes, self-correct, and generate more accurate outputs [51].”
FlowSearch: Advancing Deep Research with Dynamic Structured Knowledge Flow
Hu, Y., Ma, R., Fan, Y., Shi, J., Cao, Z., Zhou, Y., Yuan, J., Zhang, S., Feng, S., Yan, X., et al. (2026) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2026.acl-long.971 · Cited by 19
Harnessing LLM Agents with Skill Programs
Liu, H., Ming, Y., Joty, S., & Zhao, C. (2026) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/2026.emnlp-main.2086 · Cited by 16
Agentic AI Workload Characterization
Yuan, Y., Nayak, A., Kundu, S., & Talati, N. (2026) · IEEE International Symposium on Workload Characterization · doi:10.48550/arxiv.2605.26297 · Cited by 19
“Agentic systems span ReAct-style reason-act-observe loops [3], Reflexion-style self-reflection [10], Toolformer-style tool learning [11], and LATS-style planning/search [12], differing in how they organize reasoning, tool use, observations, planning, and delegation.”
InfluentialOpenSkill: Open-World Self-Evolution for LLM Agents
Yan, Z., Song, D., Zhang, H., Liang, W., Zhang, Y., Dai, Y., He, L., Yu, P. S., Xu, R., Li, X., et al. (2026) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/2026.emnlp-main.1118 · Cited by 18
Artificial Intelligence and Privacy: Causes for Concern
Jurewicz, M., Käfer, N. K., & Kran, E. (2024) · Privacy Studies Journal · doi:10.7146/psj.v3i.143099 · Cited by 17
Automatically Generating Rules of Malicious Software Packages via Large Language Model
Zhang, X., Du, X., Chen, H., He, Y., Niu, W., & Li, Y. (2025) · International Conference on Dependable Systems & Networks/Proceedings · doi:10.1109/dsn64029.2025.00072 · Cited by 25
“This approach leverages the LLM’s capability to evaluate and critique its own prior outputs, enhancing overall performance [23, 24].”
Qasim, K. U., Zhang, J., Alsahfi, T., & Butt, A. U. R. (2025) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.18562 · Cited by 25
BatchPrompt: Accomplish more with less
Lin, J., Diesendruck, M., Du, L., & Abraham, R. (2024) · International Conference on Learning Representations · doi:10.48550/arxiv.2309.00384 · Cited by 30
“Inspired by the reflexion idea Shinn et al. (2023), in the task specification, we add this text: If you are confident in your output class, append a “confident” at the end of the label; else, append a “not confident”.”
BackgroundMethodConceptual Framework for Autonomous Cognitive EntitiesPreprint
Shapiro, D., Li, W., Delaflor, M., & Toxtli, C. (2023) · arXiv (Cornell University) · doi:10.13140/rg.2.2.14161.30569 · Cited by 22
“This enables ACE to develop sophisticated, transferrable conceptual faculties across diverse applications, rather than being limited to narrow reactive tasks in controlled environments [95].”
BackgroundEntropy-Regularized Token-Level Policy Optimization for Language Agent ReinforcementPreprint
Wen, M., Liao, J., Deng, C. D., Wang, J., Zhang, W., & Wen, Y. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2402.06700 · Cited by 20
SAUP: Situation Awareness Uncertainty Propagation on LLM AgentPreprint
Zhao, Q. C., Zhao, X., Liu, Y., Cheng, W., Sun, Y., Oishi, M., Osaki, T., Matsuda, K., Yao, H., & Chen, H. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2412.01033 · Cited by 23
SOP-Agent: Empower General Purpose AI Agent with Domain-Specific SOPsPreprint
Ye, A., Ma, Q., Chen, J., Li, M., Li, T., Liu, F., Mai, S., Lu, M., Bao, H., & You, Y. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2501.09316 · Cited by 21
Wang, H., Zhang, X., & Mu, C. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2502.11422 · Cited by 19
“Similarly, guiding LLMs to engage in self-reflection, allowing them to evaluate their generated content, can effectively improve their problem solving performance (Shinn et al., 2023; Kumar et al., 2024; Huang et al., 2022).”
Designing Domain-Specific Agents via Hierarchical Task Abstraction MechanismPreprint
Li, K., Wang, J., Wang, Z., Qiao, H., Zhang, W., Meng, D., & Cao, X. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2511.17198 · Cited by 19
AgentSM: Semantic Memory for Agentic Text-to-SQLPreprint
Biswal, A., Lei, C., Qin, X., Li, A., Narayanaswamy, B., & Kraska, T. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2601.15709 · Cited by 20
“Approaches like ReACT [32] and Re-flexion [25] highlight the effectiveness of planning, execution, and feedback stages for complex tasks.”
Iterative Prompt Refinement for Mining Gene Relationships from ChatGPT
Chen, Y., Gao, J., Petruc, M., Hammer, R., Popescu, M., & Xu, D. H. (2024) · International Journal of Artificial Intelligence and Robotics Research · doi:10.1142/s2972335324500054 · Cited by 16
GPT-4 as a biomedical simulator
Schaefer, M., Reichl, S., ter Horst, R., Nicolas, A. M., Krausgruber, T., Piras, F., Stepper, P., Bock, C., & Samwald, M. (2024) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2024.108796 · Cited by 17
LogRESP-Agent: A Recursive AI Framework for Context-Aware Log Anomaly Detection and TTP Analysis
Lee, J., Jeong, Y., Han, T., & Lee, T. (2025) · Applied Sciences · doi:10.3390/app15137237 · Cited by 18
Importance Weighting Can Help Large Language Models Self-Improve
Jiang, C., Chan, C.-M., Xue, W., Liu, Q., & Guo, Y. (2025) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v39i23.34602 · Cited by 20
AlphaEvolve: A coding agent for scientific and algorithmic discovery
Novikov, A., Vũ, N., Eisenberger, M., Dupont, E., Huang, P.-S., Wagner, A. Z., Shirobokov, S., Kozlovskii, B., Ruiz, F. J. R., Mehrabian, A., et al. (2025) · arXiv · doi:10.48550/arxiv.2506.13131 · Cited by 15
“Hopes of success here are driven by the breathtaking power of recent LLMs [32, 76], which can enhance their capabilities using test-time compute, and the rise of agents that combine language generation and action [88, 114].”
Metadata
- Authors
- Shinn, N., Cassano, F., Berman, E., Gopinath, A., Narasimhan, K., & Yao, S.
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2023
- Pages
- 8634-8652
- ISSN
- 1049-5258 (ISSN-L)
- arXiv
- 2303.11366
- OpenAlex
- W7133222210
- Cited by
- 1,087
- References
- 0
- Citations by year
- 2026: 760 · 2025: 167 · 2024: 105 · 2023: 55
- FWCI
- 192.15
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- neural information processing systems (publishedVersion)
- arXiv (Cornell University) (submittedVersion, cc-by)
- arXiv (Cornell University) (cc-by)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Keywords
- language agents, verbal behavior, language acquisition
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-01, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-01 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.