Reflexion: Language Agents with Verbal Reinforcement Learning
Open accessThe DOI matches its DataCite record; 42 of the 42 references it cites were found in a registry or an index; 7 of the 8 sources its claims cite were checked for support.
Abstract
Large language models (LLMs) have been increasingly used to interact with external environments (e.g., games, compilers, APIs) as goal-driven agents. However, it remains challenging for these language agents to quickly and efficiently learn from trial-and-error as traditional reinforcement learning methods require extensive training samples and expensive model fine-tuning. We propose Reflexion, a novel framework to reinforce language agents not by updating weights, but instead through linguistic feedback. Concretely, Reflexion agents verbally reflect on task feedback signals, then maintain their own reflective text in an episodic memory buffer to induce better decision-making in subsequent trials. Reflexion is flexible enough to incorporate various types (scalar values or free-form language) and sources (external or internally simulated) of feedback signals, and obtains significant improvements over a baseline agent across diverse tasks (sequential decision-making, coding, language reasoning). For example, Reflexion achieves a 91% pass@1 accuracy on the HumanEval coding benchmark, surpassing the previous state-of-the-art GPT-4 that achieves 80%. We also conduct ablation and analysis studies using different feedback signals, feedback incorporation methods, and agent types, and provide insights into how they affect performance.
Overview
CoChat Summary
TL;DR
Reflexion reinforces language agents through verbal self-reflection stored in episodic memory rather than weight updates, improving performance across decision-making, reasoning, and coding tasks. It reports gains including 91% pass@1 on HumanEval, a 22% absolute improvement on AlfWorld, and 20% on HotPotQA.
Key findings
- On HumanEval Python, Reflexion achieves 91.0 pass@1, surpassing the previous state-of-the-art GPT-4 at 80.1; on HumanEval Rust it reaches 68.0 vs. 60.0, MBPP Rust 75.4 vs. 70.9, and Leetcode Hard 15.0 vs. 7.5.
- In AlfWorld, ReAct + Reflexion completes 130 out of 134 tasks using a simple heuristic and improves over strong baselines by an absolute 22% over 12 iterative learning steps; ReAct-only converges at a 22% hallucination rate with no long-term recovery.
- In HotPotQA, Reflexion improves over baselines by 20%; self-reflection gives an 8% absolute boost over episodic memory alone, and although CoT (GT) fails on 39% of questions, Reflexion improves accuracy by 14% without access to ground-truth answers.
- Ablations on the 50 hardest HumanEval Rust problems show full Reflexion at 0.68 vs. baseline 0.60; omitting test generation drops to 0.52, and omitting self-reflection stays at 0.60.
Methods
- Reflexion uses a modular loop with an Actor that generates text/actions, an Evaluator that scores outputs, and a Self-Reflection model that converts feedback into verbal summaries stored in memory; trials repeat until the Evaluator passes or a max trial count is reached, with memory usually bounded to 1–3 experiences.
- Experiments cover AlfWorld (134 environments, six tasks, ReAct + GPT-3), HotPotQA (100 questions, CoT/ReAct, exact-match grading, memory size 3), and programming (HumanEval, MBPP, LeetcodeHardGym; Python/Rust via MultiPL-E; self-generated unit tests up to 6).
- Ablations and analyses vary feedback signals, feedback incorporation methods, and agent types; compromised approaches are tested on HumanEval Rust, and a WebShop experiment is run across 100 environments.
Limitations
- The paper states Reflexion may fall into non-optimal local minima, limits long-term memory to a sliding window with maximum capacity, and notes code-generation test-driven development is limited by non-deterministic, impure, hardware-dependent, or concurrent functions; it also relies on LLM self-evaluation/heuristics and lacks a formal success guarantee.
- The paper reports WebShop failure: after only four trials the agent shows no improvement and does not generate helpful self-reflections, concluding Reflexion cannot solve tasks requiring significant diversity and exploration.
- Evident from the text: self-correction is an emergent quality of stronger, larger models—starchat-beta shows no improvement (baseline 0.26 vs. Reflexion 0.26)—and flaky or incorrect test suites can cause false positives/negatives, with false negatives preferred.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
4 Valid · 2 Not valid · 0 Not checked · 59 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Therefore, in the case in which the model generates a flaky test suite, it is possible that all tests pass on an incorrect solution and lead to a false positive label on a code completion [11].”
§ Reflexion: Language Agents with Verbal Reinforcement Learning > Analysis
What the sources say
- Partly supportedcites [11] 11. Lam, W., Winter, S., Wei, A., Xie, T., Marinov, D., and Bell, J. (2020). A large-scale longitudinal study of flaky tests. Proc. ACM Program. Lang., 4(OOPSLA). sourceExperimental — accuracy not yet measured
The Introduction (page not provided) says a flaky test can pass and fail on the same code and that changes may be merged when all tests pass. It does not address model-generated test suites, incorrect code completions, or false-positive labels, so those parts of the claim are not established by this paper. (LLM, conf=0.82)
hedgedstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“3 shows an inferior 52% vs 60% (baseline) accuracy, which suggests that the agent is unable to determine if the current implementation is correct without unit tests.”
§ Reflexion: Language Agents with Verbal Reinforcement Learning > Ablation study
hedgedstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“ReAct + Reflexion significantly outperforms ReAct by completing 130 out of 134 tasks using the simple heuristic to detect hallucinations and inefficient planning.”
§ Reflexion: Language Agents with Verbal Reinforcement Learning > Results
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“4 shows that self-reflection improves learning by an 8% absolute boost over the episodic memory learning advantage.”
§ Reflexion: Language Agents with Verbal Reinforcement Learning > Analysis
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“on reasoning questions in HotPotQA [28] by 20%”
- Also stated in: § 4 Experiments · plain
“Most notably, Reflexion improves performance over strong baselines by 22% in AlfWorld, 20% in HotPotQA, and 11% on HumanEval.”
§ Reflexion: Language Agents with Verbal Reinforcement Learning > 1 Introduction
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § 4 Experiments · plain
30 more claims
Create a free account to see all 65 claims and every source verdict.
- It may state two separate claims as one. 18
- Probably not a substantial claim. 11
- The quote only partly states this claim. 3
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source doesn’t support the claim as written.
In the citing paper
“Memory and reflection systems such as MemAgent (Yu et al., 2025a), Reflexion (Shinn et al., 2023), and Generative Agents (Park et al., 2023) improve retrieval and episodic memory, but do not perform context shaping, state restructuring, or nextinstruction refinement.”
From PAACE: A Plan-Aware Automated Agent Context Engineering Framework (2025) · cites this paper as Shinn et al., 2023
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe cited source doesn’t support the claim as written.
In the citing paper
“However, Reflexion computes verbal reward over a full trajectory, yielding a single end-of-episode signal that conflates credit across reasoning steps: a failure due to a single intermediate error receives the same critique pressure as one due to a flawed strategy.”
From Process Supervision via Verbal Critique Improves Reasoning in Large Language Models (2026) · cites this paper as Shinn et al. [2023]
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe cited source doesn’t support the claim as written.
In the citing paper
“Unlike Reflexion, which only reflects on unsuccessful trajectories, our approach separately reflects on both successful and unsuccessful ones.”
From An Efficient Context-Dependent Memory Framework for LLM-Centric Agents (2025) · cites this paper as Shinn et al., 2023
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe cited source doesn’t support the claim as written.
In the citing paper
“The dominant approach is to curate memory at write time.”
From Just-in-Time Memory: Learning to Curate Task-Adaptive Memory for LLM Agents (2026) · cites this paper as Shinn et al., 2023
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Interaction and code generation are increasingly used together, with code as the modality of choice for actions [48, 59], tool construction [13, 51, 69], and reasoning [39, 66, 67].”
From SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineering (2024) · cites this paper as [39]
Experimental — accuracy not yet measured
107 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Reflexion: Language Agents with Verbal Reinforcement Learning > 3 Reflexion: reinforcement via verbal reflection
“while M e not pass or t < max trials do”
§ Reflexion: Language Agents with Verbal Reinforcement Learning > Self-reflection
“The Actor, Evaluator, and Self-Reflection models work together through trials in a loop until the Evaluator deems τ t to be correct.”
Citations
Cites
The publisher hasn’t deposited this paper’s reference list.
Cited by
Items 601–700 of 3,537
From Persona to Personalization: A Survey on Role-Playing Language Agents
Chen, J., Wang, X., Xu, R., Yuan, S., Zhang, Y., Shi, W., Xie, J., Li, S., Yang, R., Zhu, T., et al. (2024) · arXiv · doi:10.48550/arxiv.2404.18231 · Cited by 15
“…in the external vector storage (Qian et al., 2023; Zhong et al., 2023; Zhu et al., 2023b; Lin et al., 2023; Xie et al., 2023; Wu et al., 2024b) or natural languages database (Shinn et al., 2023; Modarressi et al., 2023), from which agents can quickly query and retrieve information as required.”
BackgroundEvaluating Language-Model Agents on Realistic Autonomous Tasks
Kinniment, M., Sato, L. J. K., Du, H., Goodrich, B., Hasin, M., Chan, L., Miles, L. H., Lin, T. R., Wijk, H., Burget, J., et al. (2023) · arXiv · doi:10.48550/arxiv.2312.11671 · Cited by 15
Red-Teaming Coding Agents from a Tool-Invocation Perspective: An Empirical Security Assessment
Xie, Y., Luo, M., Liu, Z., Zhang, Z., Zhang, K. F., Liu, Y., Tao, C., Wang, C., Li, Z., Chen, P., et al. (2026) · Proceedings of the ACM on software engineering. · doi:10.1145/3832267 · Cited by 17
“We present the first systematic red-teaming and security assessment on six real-world coding agents.”
Quevedo, E., Abdelfattah, A. S., Rodriguez, A., Yero, J., & Cerny, T. (2024) · SN Computer Science · doi:10.1007/s42979-024-02664-0 · Cited by 16
Harnessing Multi-Role Capabilities of Large Language Models for Open-Domain Question Answering
Sun, H., Liu, Y., Wu, C., Yan, H., Tai, C., Gao, X., Shang, S., & Yan, R. (2024) · International World Wide Web Conference (WWW) · doi:10.1145/3589334.3645670 · Cited by 26
m &m’s: A Benchmark to Evaluate Tool-Use for multi-step multi-modal Tasks
Ma, Z., Huang, W., Zhang, J., Gupta, T., & Krishna, R. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-72684-2_2 · Cited by 52
Zhang, Z., Lian, J., Ma, C., Qu, Y., Luo, Y., Wang, L., Li, R., Chen, X., Lin, Y., Le, W., et al. (2025) · Findings of the Association for Computational Linguistics: NAACL · doi:10.18653/v1/2025.findings-naacl.160 · Cited by 24
AssistantX: An LLM-Powered Proactive Assistant in Collaborative Human-Populated Environments
Sun, N., Mao, B., Li, Y., Guo, D., & Liu, H. (2025) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros60139.2025.11246901 · Cited by 20
“Methods like ReAct [8] and Reflexion [9] enhance reasoning by step-by-step thinking, while multi-agent frameworks like Mobile-Agent-v2 [10] and AppAgent [11] have been effectively applied to tasks like GUI operations on smart devices for long-horizon tasks.”
WESE: weak exploration to strong exploitation for LLM agents
Huang, X., Liu, W., Chen, X., Wang, X., Lian, D., Wang, Y., Tang, R., & Chen, E. (2026) · Science China Information Sciences · doi:10.1007/s11432-024-4554-x · Cited by 16
a1: Steep Test-time Scaling Law via Environment Augmented Generation
Mei, L., Liu, S., Wang, Y., Bi, B., Ge, Y., Wan, J., Wu, Y., & Cheng, X. (2026) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2026.findings-acl.1240 · Cited by 15
AcademicGPT: Empowering Academic ResearchPreprint
Wei, S., Xu, X., Qi, X., Yin, X., Xia, J. W., Ren, J., Tang, P., Zhong, Y., Chen, Y., Ren, X., et al. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2311.12315 · Cited by 18
“…works (Shinn et al., 2023; Wang et al., 2022; Wei et al., 2022; Yao et al., 2022) focusing on improving models’ planning and reasoning abilities including chain of thoughts (CoT) (Wei et al., 2022), self-consistency (Wang et al., 2022), reflection (Shinn et al., 2023) and ReAct (Yao et al., 2022).”
BackgroundMethodSelf-Steering Language ModelsPreprint
Grand, G., Tenenbaum, J. B., Mansinghka, V. K., Lew, A. K., & Andreas, J. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2504.07081 · Cited by 17
“…a variety of novel methods have been proposed for using LMs to optimize prompts (Fernando et al., 2024; Honovich et al., 2023; Khattab et al., 2023; Shinn et al., 2023; Yang et al., 2024; Zhou et al., 2023c), agentic systems (Hu et al., 2024), and optimization procedures themselves (Zelikman et…”
Sculptor: Empowering LLMs with Cognitive Agency via Active Context Management
Li, M., Xu, L., Tan, Q., Ma, L., Cao, T., & Liu, Y. (2026) · International Conference on Learning Representations · doi:10.48550/arxiv.2508.04664 · Cited by 21
A Systematization of Security Vulnerabilities in Computer Use AgentsPreprint
Jones, D. J., Severi, G., Pouliot, M., Lopez, G., de Gruyter, J., Zanella-Béguelin, S., Song, J., Bullwinkel, B., Cortez, P., & Minnich, A. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2507.05445 · Cited by 18
SQL-of-Thought: Multi-agentic Text-to-SQL with Guided Error CorrectionPreprint
Chaturvedi, S., Chadha, A. R., & Bindschaedler, L. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2509.00581 · Cited by 20
“Inspired by reflexive learning approaches [17], the agent iteratively generates structured feedback that informs the correction SQL generation process.”
Understanding Agentic AI: Algorithms and Infrastructure
Ma, W., Guo, Y., Han, Q., Zhou, W., Zhu, X., Xiong, J., Wen, S., & Xiang, Y. (2026) · IEEE/CAA Journal of Automatica Sinica · doi:10.1109/jas.2026.125993 · Cited by 19
CoCoEvo: Co-Evolution of Programs and Test Cases to Enhance Code Generation
Li, K., Yuan, Y., Yu, H., Guo, T., & Cao, S. (2025) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2025.3593272 · Cited by 27
Ruiz, F. V., Grishina, A., Hort, M., & Moonen, L. (2026) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3771922 · Cited by 20
AgentSpec: Customizable Runtime Enforcement for Safe and Reliable LLM Agents
Wang, H., Poskitt, C. M., & Sun, J. (2026) · Proceedings of the 2026 IEEE/ACM 48th International Conference on Software Engineering · doi:10.1145/3744916.3764546 · Cited by 14
“For example, a rule may enforce human verification before an agent modifies sensitive data, or enforce self-reflection [35] via an LLM before an agent proceeds with a high-risk task.”
MasRouter: Learning to Route LLMs for Multi-Agent Systems
Yue, Y., Zhang, G., Liu, B., Wan, G., Wang, K., Cheng, D., & Qi, Y. (2025) · Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2025.acl-long.757 · Cited by 14
LLexus: an AI agent system for incident management
Las-Casas, P., Kumbhare, A. G., Fonseca, R., & Agarwal, S. (2024) · ACM SIGOPS Operating Systems Review · doi:10.1145/3689051.3689056 · Cited by 14
“To achieve this, we have developed a general approach of self-reflection and correction [28] that instructs the LLM on how to validate a given response, against a set of goals.”
Win Fast or Lose Slow: Balancing Speed and Accuracy in Latency-Sensitive Decisions of LLMs
Kang, H., Zhang, Q., Cai, H., Xu, W., Krishna, T., Du, Y., & Weissman, T. (2025) · neural information processing systems · doi:10.52202/085713-5044 · Cited by 28
OpsAgent: An Evolving Multi-agent System for Incident Management in Microservices
Luo, Y., Jiang, J., Feng, J., Tao, L., Zhang, Q., Wen, X., Sun, Y., Zhang, S., Liu, T., Zhang, W., et al. (2026) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1145/3832783.3834479 · Cited by 16
Few-Shot Joint Multimodal Entity-Relation Extraction via Knowledge-Enhanced Cross-modal Prompt Model
Li, Y., Cai, Y., & Huang, J. (2024) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3664647.3680717 · Cited by 23
Multimodal Fake News Detection Based on Chain-of-Thought Prompting Large Language Models
Xu, Y., Ge, J., Lyu, G., Li, G., & Li, H. (2024) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/smc54092.2024.10831252 · Cited by 18
“Towards this challenge, imitating humans to analyze errors and reflect is a potential solution [38], [39]: Make the model self-analyzes the problem-solving process after it completes a task, which improves the adaptability and flexibility of LLMs.”
Parvez, M. R. (2024) · Proceedings of the 4th International Workshop on Knowledge-Augmented Methods for Natural Language Processing · doi:10.18653/v1/2025.knowledgenlp-1.21 · Cited by 9
DocAgent: A Multi-Agent System for Automated Code Documentation Generation
Yang, D., Simoulin, A., Qian, X., Liu, X., Cao, Y., Teng, Z., & Yang, G. (2025) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2025.acl-demo.44 · Cited by 29
AllHands :Ask Me Anything on Large-scale Verbatim Feedback via Large Language Models
Zhang, C., Ma, Z., Wu, Y., He, S., Qin, S., Ma, M., Qin, X., Kang, Y., Liang, Y., Gou, X., et al. (2025) · IEEE International Conference on Data Engineering (ICDE) · doi:10.1109/icde65448.2025.00011 · Cited by 20
Matryoshka Pilot: Learning to Drive Black-Box LLMs with LLMs
Li, C., Zhuang, Y., Qiang, R., Sun, H., Dai, H., Zhang, C., & Dai, B. (2025) · neural information processing systems · doi:10.52202/085713-1482 · Cited by 19
HiCRISP: An LLM-Based Hierarchical Closed-Loop Robotic Intelligent Self-Correction Planner
Ming, C., Lin, J., Fong, P., Wang, H., Duan, X., & He, J. (2024) · China Automation Congress (CAC) · doi:10.1109/cac63892.2024.10865457 · Cited by 16
REX: Rapid Exploration and eXploitation for AI AgentsPreprint
Murthy, R., Heinecke, S., Niebles, J. C., Liu, Z., Xue, L., Yao, W., Feng, Y., Chen, Z., Gokul, A., Arpit, D., et al. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2307.08962 · Cited by 18
“Among these techniques, Reflexion and RAP partially address this issue.”
BackgroundInfluentialSkill Set Optimization: Reinforcing Language Model Behavior via Transferable SkillsPreprint
Nottingham, K., Majumder, B. P., Mishra, B. D., Singh, S., Clark, P. E., & Fox, R. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2402.03244 · Cited by 23
Lee, K., Hwang, D., Park, S., Jang, Y., & Lee, M. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2403.14238 · Cited by 15
Graph-Augmented Reasoning: Evolving Step-by-Step Knowledge Graph Retrieval for LLM ReasoningPreprint
Wu, W., Jing, Y., Wang, Y., Hu, W., & Tao, D. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2503.01642 · Cited by 19
Synthesizing Multi-Agent Harnesses for Vulnerability DiscoveryPreprint
Liu, H., Shou, C., Liu, X., Wen, H., Chen, Y.-F. R., Fang, R. J., & Feng, Y. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2604.20801 · Cited by 18
Always-OnAgents:A Survey of Persistent Memory, State, and Governance in LLMAgentsPreprint
Ding, T., Nannapaneni, A., Liu, B., & Zhang, L. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2606.30306 · Cited by 16
Reddy, V., Challaram, S., & Basu, A. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2607.07405 · Cited by 14
Evidence-Gated Memory Writing for Personalized Large Language Model Agents
Ma, L., Song, T., Long, R., Mao, L., & Gu, Z. (2026) · International Conference on Image Processing and Artificial Intelligence (ICIPAI) · doi:10.1109/icipai70034.2026.11605481 · Cited by 13
“Investigations of long-horizon conversational agents indicate that memory quality directly influences the stability of downstream reasoning and personalization capabilities [8].”
Are LLMs reliable code reviewers? systematic overcorrection in requirement conformance judgement
Jin, H., & Chen, H. (2026) · Automated Software Engineering · doi:10.1007/s10515-026-00638-5 · Cited by 18
“…in test suite based program repair and execution guided verification, where candidate changes are accepted only when they withstand behavioral checks, while also aligning with recent self-refinement or feedback-based LLM frameworks that leverage external signals to correct model behaviors [39, 40].”
Generative AI Agents for Knowledge Work Augmentation in Finance
Ganesh, S., Ardon, L., Borrajo, D., Garg, D., Madhushani, U., Narayanan, A. L., Canonaco, G., & Veloso, M. (2024) · Annual Review of Control Robotics and Autonomous Systems · doi:10.1146/annurev-control-022823-033813 · Cited by 16
MAF: Multi-Aspect Feedback for Improving Reasoning in Large Language Models
Nathani, D., Wang, D., Pan, L., & Wang, W. Y. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.407 · Cited by 43
Kapoor, S., Stroebl, B., Siegel, Z. S., Nadgir, N., & Narayanan, A. (2024) · arXiv · doi:10.48550/arxiv.2407.01502 · Cited by 13
“For example, the Reflexion [44] and LATS [65] modified HumanEval by removing the problems without example tests.”
InfluentialThinking Fast and Slow in Human and Machine Intelligence
Fabiano, F., Ganapini, M. B., Loreggia, A., Mattei, N., Murugesan, K., Pallagani, V., Rossi, F., Srivastava, B., & Venable, K. B. (2025) · Communications of the ACM · doi:10.1145/3715709 · Cited by 20
“36 On the other side, part of the community argues that these tools cannot truly reason, but rather generate something similar to what they have learned from the training set.”
VERGE : Formal Refinement and Guidance Engine for Verifiable LLM Reasoning
Singh, V., Cassel, D., Weir, N., Feng, N., & Bayless, S. (2026) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/2026.findings-emnlp.1309 · Cited by 14
ORThought: Benchmarking and automating logistics optimization modeling via structured LLM reasoning
Yang, B., Zhou, Q., Li, J., Su, C., Angeloudis, P., & Hu, S. (2026) · Artificial Intelligence for Transportation · doi:10.1016/j.ait.2026.100059 · Cited by 19
MemGuard: Persisting Verifier Signals for LLM-Agent Memory Governance
Wang, H., Dong, G., Liang, H., Zhang, Z., Luo, J., Xue, C., Liu, C., & Tang, H. (2026) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/2026.emnlp-main.423 · Cited by 14
Lin, J., Zhu, C., Kneuertz, P. J., Bai, Y., & Xue, Y. (2026) · 2026 IEEE/CVF Conference on Computer Vision and Pattern Recognition- FINDINGS Track (CVPRF) · doi:10.1109/cvprf71909.2026.00534 · Cited by 23
“Training-based approaches show promise via reinforcement learning [35] and reflection mechanisms [63, 65, 77].”
Emotion-Aware Chatbots: Understanding, Reacting and Adapting to Human Emotions in Text Conversations
Kossack, P., & Unger, H. (2024) · Lecture notes in networks and systems · doi:10.1007/978-3-031-61418-7_8 · Cited by 18
An Agentic Approach For Dynamic Software-Defined Network Management Using Large Language Models
Araujo, A. S., das Merces, J. M. O., Silva, R. L. D., Alencar, A., Passos, I. F., Sousa, M. P., Dias, M. C., Meneses, T. F., & Santos, D. F. S. (2024) · IEEE Conference on Network Function Virtualization and Software Defined Networks (NFV-SDN) · doi:10.1109/nfv-sdn61811.2024.10807498 · Cited by 13
Mosquera, M., Pinzón, J. S., Fonseca, Y., Ríos, M., Quijano, N., Giraldo, L. F., & Manrique, R. (2025) · IEEE Transactions on Artificial Intelligence · doi:10.1109/tai.2025.3569192 · Cited by 19
“Moreover, Wang et al. developed the Voyager architecture, enabling autonomous gameplay in Minecraft [20].”
AMERICANO: Argument Generation with Discourse-driven Decomposition and Agent Interaction
Zhe, H., Chan, H. P., & Yin, Y. (2024) · International Conference on Natural Language Generation · doi:10.18653/v1/2024.inlg-main.8 · Cited by 24
Language Models can Subtly Deceive Without Lying: A Case Study on Strategic Phrasing in Legislation
Dogra, A., Pillutla, K., Deshpande, A., Sai, A. B., Nay, J. J., Rajpurohit, T., Kalyan, A., & Ravindran, B. (2025) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2025.acl-long.1600 · Cited by 25
“To do this, we employ a simple yet effective strategy known as re-planning and re-sampling (Raman et al., 2022; Shinn et al., 2023; Yao et al., 2023; Madaan et al., 2023), where the lobbyist iteratively builds on previous generations–revising phrasing based on prior feedback–to increasingly obscure…”
Anghel, C., Anghel, A. A., Pecheanu, E., Șușnea, I., Cocu, A., & Istrate, A. (2025) · Informatics · doi:10.3390/informatics12030076 · Cited by 14
Revealing and Mitigating the Challenge of Detecting Character Knowledge Errors in LLM Role-Playing
Zhang, W., Nie, S., Sheng, J., Zhang, Z., Zhang, X., He, Y., & Liu, T. (2025) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2025.emnlp-main.1689 · Cited by 23
From Belief Entrenchment to Robust Reasoning in LLM Agents
Oh, J., Jeong, M., Ko, J., & Yun, S.-Y. (2026) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl.a.728 · Cited by 15
“Feedback-loop methods such as STaR (Ze-likman et al., 2022), Reflexion (Shinn et al., 2023), and SCoRe (Kumar et al., 2024) also struggle to reliably correct biases or foster diverse reasoning (Guo et al., 2024).”
(Ir)rationality in AI: state of the art, research challenges and open questions
Macmillan-Scott, O., & Musolesi, M. (2025) · Artificial Intelligence Review · doi:10.1007/s10462-025-11341-4 · Cited by 16
“Similarly, within natural language, this type of approach can remove the need for a human trainer and lead to agents that learn from their own mistakes and correct this in planning sequences (Shinn et al. 2023).”
Enabling Language Models to Implicitly Learn Self-Improvement
Wang, Z., Hou, L., Lu, T., Wu, Y., Li, Y., Yu, H., & Ji, H. (2024) · International Conference on Learning Representations · doi:10.48550/arxiv.2310.00898 · Cited by 21
“Shinn et al. (2023) put language models into an environment and let language models reflect their actions when they meet failures.”
BackgroundTowards Hierarchical Multi-Agent Workflows for Zero-Shot Prompt OptimizationPreprint
Liu, Y., Singh, J., Liu, G., Payani, A., & Zheng, L. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2405.20252 · Cited by 19
Maestro: Joint Graph & Config Optimization for Reliable AI AgentsPreprint
Wang, W., Kattakinda, P., & Feizi, S. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2509.04642 · Cited by 14
“Reflection-based controllers (e.g., Reflexion) attach verbal self-critique to a predetermined architecture but do not conduct global, cross-component optimization Shinn et al. (2023).”
Can Theoretical Physics Research Benefit from Language Agents?Preprint
Lu, S., Jin, Z., Zhang, T. J., Kos, P., Cirac, J. I., & Schölkopf, B. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2506.06214 · Cited by 22
“Self-correction techniques (Madaan et al., 2023; Shinn et al., 2023; Saunders et al., 2022) must be adapted to evaluate physical plausibility alongside logical consistency.”
Web World ModelsPreprint
Feng, J., Zhang, Y., Zhang, C., Lu, Y., Liu, S., & Wang, M. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2512.23676 · Cited by 17
AI Agents Need Memory Control Over More ContextPreprint
Bousetouane, F. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2601.11653 · Cited by 13
“Reflection-based approaches store distilled lessons or self-critique to influence later turns [34].”
(2025) · 2025 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros60139.2025.11247088 · Cited by 13
“We consider them invaluable for achieving policy alignment [28] and failure reflection [29], essential for advancing the next generation of robot foundation models.”
Cognitive Modeling for Long-Horizon Agent Learning via Integrated Long-Term Memory and Reasoning
Yang, L., Guan, T., Ma, Y., Li, Z., Fang, Z., & Wang, F. (2026) · International Conference on Communication Networks and Machine Learning (CNML) · doi:10.1109/cnml68938.2026.11452287 · Cited by 12
“Mechanisms that allow agents to actively select, organize, and update long-term memory can overcome short-sighted decision-making and enable cross-stage coordination and experience transfer[3].”
EvoVLA: Self-evolving Vision-Language-Action Model
Liu, Z., Yang, Z., Zhang, Z., & Tang, H. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37023-5_14 · Cited by 13
Yager, K. G. (2024) · Digital Discovery · doi:10.1039/d4dd00178h · Cited by 12
Code Detection for Hardware Acceleration Using Large Language Models
Martínez, P. A., Bernabé, G., & García, J. M. (2024) · IEEE Access · doi:10.1109/access.2024.3372853 · Cited by 12
AutoPlan: Automatic Planning of Interactive Decision-Making Tasks With Large Language Models
Ouyang, S., & Li, L. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.205 · Cited by 32
“Reflexion (Shinn et al., 2023) built on top of ReAct and refines the interaction by iteratively reflecting on its past failed trials of a task instance.”
MethodHuang, W., & Deng, X. (2025) · Journal of Network and Computer Applications · doi:10.1016/j.jnca.2025.104231 · Cited by 15
Fully Autonomous Programming Using Iterative Multi-Agent Debugging with Large Language Models
Grishina, A., Liventsev, V., Härmä, A., & Moonen, L. (2025) · ACM Transactions on Evolutionary Learning and Optimization · doi:10.1145/3719351 · Cited by 18
“Several studies explore an iterative approach to program synthesis in a manner similar to SEIDR [Chen et al., 2023; Shinn et al., 2023; Xia and Zhang, 2023].”
Artificial intelligent disobedience: Rethinking the agency of our artificial teammates
Mirsky, R. (2025) · AI Magazine · doi:10.1002/aaai.70011 · Cited by 12
Project Sid: Many-agent simulations toward AI civilization
AL, A., Ahn, A., Becker, N., Carroll, S., Christie, N., Cortes, M., Demirci, A., Du, M., Li, F., Luo, S., et al. (2024) · arXiv · doi:10.48550/arxiv.2411.00114 · Cited by 12
“In recent years, advancements in reasoning and decision-making in LLMs have significantly enhanced agent autonomy (52; 58; 36; 45).”
BackgroundTextGrad: Automatic "Differentiation" via Text
Yuksekgonul, M., Bianchi, F., Boen, J., Liu, S., Huang, Z., Guestrin, C., & Zou, J. (2024) · arXiv · doi:10.48550/arxiv.2406.07496 · Cited by 12
Requirements Are All You Need: The Final Frontier for End-User Software Engineering
Robinson, D., Cabrera, C., Gordon, A. D., Lawrence, N. D., & Mennen, L. (2025) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3708524 · Cited by 12
“…from natural language descriptions to effectively select appropriate code from amongst the many possibilities suggested by an LLM. Reflexion [85] achieved state of the art performance on HumanEval using a prompt chaining method that generates code, applies tests, reflects on error messages…”
Simulating Oxford-Style Debates with LLM-Based Multi-Agent Systems
Harbar, Y., & Chudziak, J. A. (2025) · Lecture notes in computer science · doi:10.1007/978-981-96-6008-7_21 · Cited by 20
Embracing large language model (LLM) technologies in hydrology research
Ma, Z., Peng, B., Yue, Z., Zeng, H., Pan, M., Wu, X., Yang, J., Mai, L., & Guan, K. (2025) · Environmental Research Water · doi:10.1088/3033-4942/addd43 · Cited by 18
“Since then, the LLM landscape has rapidly evolved, with continuous advancements enhancing their abilities and mitigating potential risks(Dong et al., 2022; Wei et al., 2022; Shinn et al., 2023; Yao et al., 2022; Wei et al., 2021; Lewis et al., 2020; Paranjape et al., 2023; Patil et al., 2023).”
Feyijimi, T. R., Aliu, J., Oke, A. E., & Aghimien, D. O. (2025) · Computers · doi:10.3390/computers14090366 · Cited by 12
“Unlike traditional NLU, which focuses on comprehension and response, agents use NLU to interact with an environment and execute actions, representing a move from passive text generation to proactive, goal-directed behavior [16,17].”
InfluentialAgentic Large Language Models for Conceptual Systems Engineering and Design
Massoudi, S., & Fuge, M. (2025) · ASME International Design Engineering Technical Conferences and Computers and Information in Engineering Conference (IDETC/CIE) · doi:10.1115/detc2025-168856 · Cited by 23
“In contrast, LLM agents are beginning to transform adjacent fields through tool integration, memory, reflection [29, 30, 31], and multi-step planning [32, 33].”
LLM agents security duality: a comprehensive survey of self-security and empowered cybersecurity
Xu, Y., Zhuang, Y., Liu, X., Zhang, T. B., Xiao, B., Xu, X., Jiang, D., Wang, J., & Hu, H. (2026) · Artificial Intelligence Review · doi:10.1007/s10462-026-11563-0 · Cited by 19
GAGPO: Generalized Advantage Grouped Policy Optimization
Zhu, S., Yu, C., Yang, R., Liu, Z., Hu, J., Chen, Q., & Zhang, Y. (2026) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/2026.findings-emnlp.864 · Cited by 12
Agent Memory: Characterization and System Implications of Stateful Long-Horizon Workloads
Omri, Y., Gan, Z., Broveak, Z., Geens, R., He, Z., Pentland, A., Verhelst, M., Weissman, T., & Tambe, T. (2026) · IEEE International Symposium on Workload Characterization · doi:10.1109/iiswc71020.2026.00040 · Cited by 12
Planning without Search: Refining Frontier LLMs with Offline Goal-Conditioned RL
Hong, J., Dragan, A., & Levine, S. (2025) · neural information processing systems · doi:10.52202/085713-0338 · Cited by 15
Enhance Multi-Domain Sentiment Analysis of Review Texts Through Prompting Strategies
Wang, Y., & Luo, Z. (2023) · International Conference on High Performance Big Data and Intelligent Systems (HPBD&IS) · doi:10.1109/hdis60872.2023.10499502 · Cited by 25
AdaRefiner: Refining Decisions of Language Models with Adaptive Feedback
Zhang, W., & Lu, Z. (2024) · Findings of the Association for Computational Linguistics: NAACL · doi:10.18653/v1/2024.findings-naacl.50 · Cited by 23
LLM-Based Multi-Agent Systems are Scalable Graph Generative Models
Ji, J., Lei, R., Bi, J., Wei, Z., Chen, X., Lin, Y., Pan, X., Li, Y., & Ding, B. (2025) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2025.findings-acl.78 · Cited by 21
“We organize the memory using reflection (Shinn et al., 2023) and summarization techniques.”
Learning to Check: Unleashing Potentials for Self-Correction in Large Language ModelsPreprint
Che, Z., Xiao, Z., Han, C., Lian, Y., & Fang, Y. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2402.13035 · Cited by 16
“…(Huang et al., 2023; Stechly et al., 2023; Valmeekam et al., 2023) indicates that without external feedback, such as ground truth labels for determining the stopping point (Shinn et al., 2023; Kim et al., 2023), LLMs cannot improve their reasoning abilities through intrinsic self-correction .”
BackgroundSPA-Bench: A Comprehensive Benchmark for SmartPhone Agent Evaluation
Chen, J., Yuen, D., Xie, B., Yang, Y., Chen, G., Wu, Z., Yixing, L., Zhou, X., Liu, W., Wang, S., et al. (2025) · International Conference on Learning Representations · doi:10.48550/arxiv.2410.15164 · Cited by 74
EmbedGenius: Towards Automated Software Development for Generic Embedded IoT SystemsPreprint
Yang, H., Li, M., Han, M., Li, Z., & Xu, W. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2412.09058 · Cited by 13
RoboReflect: A Robotic Reflective Reasoning Framework for Grasping Ambiguous-Condition ObjectsPreprint
Luo, Z., Yang, Y., Zhang, Y., & Zheng, F. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2501.09307 · Cited by 15
AutoMedPrompt: A New Framework for Optimizing LLM Medical Prompts Using Textual GradientsPreprint
Wu, S. F., Koo, M., Scalzo, F., & Kurtz, I. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2502.15944 · Cited by 15
“Our framework builds upon collective advancements in text-based reflection (Shinn et al., 2023), textual gradients (Yuk-sekgonul et al., 2024), and transforming generalist LLMs into specialized models through prompting(Nori et al., 2023).”
Can Language Models Discover Scaling Laws?
Lin, H., Ye, H., Feng, W., Huang, Q., Li, Y., Lim, H., Li, Z., Wang, X., Ma, J., Liang, Y., et al. (2026) · International Conference on Learning Representations · doi:10.48550/arxiv.2507.21184 · Cited by 13
“…(Anthropic, 2025), Gemini CLI (Google, 2025)) have shifted from single-shot code generation to iterative, tool-augmented planning and self-repair (Shinn et al., 2023), handling tasks such as dependency resolution, unit-test authoring, and regression debugging (Google, 2025; Yang et al., 2024; Hu…”
CodeAgents: A Token-Efficient Framework for Codified Multi-Agent Reasoning in LLMsPreprint
Yang, B., He, X., Gao, H. B., Cao, Y., Li, X., & Hsu, D. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2507.03254 · Cited by 16
Evidence-Bound Autonomous Research (EviBound): A Governance Framework for Eliminating False ClaimsPreprint
Chen, R. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2511.05524 · Cited by 12
“Reflexion [20] performs iterative refinement with verbal feedback, where agents reflect on failures and refine actions.”
TRACER: Trajectory Risk Aggregation for Critical Episodes in Agentic ReasoningPreprint
Tayebati, S., Kumar, D., Darabi, N., Ettori, D., Krishnan, R., & Trivedi, A. R. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2602.11409 · Cited by 14
“Token-level confidence can remain high even as an agent enters repetitive loops or misuses tools, motivating uncertainty metrics that incorporate behavioral signals beyond likelihood [6], [11].”
MatClaw: An Autonomous Code-First LLM Agent for End-to-End Materials ExplorationPreprint
Zhang, C., & Yakobson, B. I. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2604.02688 · Cited by 13
“The predominant agent design routes actions through manually written tool functions [Yao et al., 2023, Shinn et al., 2023].”
SkillMAS: Skill Co-Evolution with LLM-based Multi-Agent SystemPreprint
Pan, S., Liu, Y., Gao, J., Gao, T., Liu, W., Lin, J., Fu, Z., Wang, J., Zhang, W., & Yu, Y. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2605.09341 · Cited by 15
“Reflexion and Voyager showed that reflective feedback and accumulated executable skills can improve future behavior without retraining from scratch [Shinn et al., 2023, Wang et al., 2023].”
REFLECT: Intervention-Supported Error Attribution for Silent Failures in LLM Agent TracesPreprint
Lin, X., Wang, Y., Kwok, T. S. T., Guo, D., Nale, S. A., Fleming, C., & Cheng, G. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2606.09071 · Cited by 13
“R EFLECT ’s correction–localization coupling (Table 4) directly quantifies this gap: Reflexion’s ∆ between corrected and failed explanation quality is ≤ +0 .”
InfluentialACE-Brain-0.5: A Unified Embodied Foundational Model for Physical Agentic AIPreprint
Brain Team, Gong, Z., Gu, H., Luo, Z., Zhang, T., Tao, T., Chi, Y., Liu, Z., Zhu, L., Liu, J., et al. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2607.04426 · Cited by 18
Tycho: Active Abstraction with Programmatic World Models for ARC-AGI-3Preprint
Lehmann, J., Aioanei, A. C., & Vahdati, S. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2607.28287 · Cited by 13
Yang, L., Wu, Y., Xu, R., Zhang, K., Yang, X., & Wu, K. (2025) · International Conference on Electronic Communication, Computer Science and Technology (ECCST) · doi:10.1109/eccst68196.2025.11441200 · Cited by 12
Metadata
- Authors
- Shinn, N., Cassano, F., Berman, E., Gopinath, A., Narasimhan, K., & Yao, S.
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2023
- Pages
- 8634-8652
- ISSN
- 1049-5258 (ISSN-L)
- arXiv
- 2303.11366
- OpenAlex
- W7133222210
- Cited by
- 1,087
- References
- 0
- Citations by year
- 2026: 760 · 2025: 167 · 2024: 105 · 2023: 55
- FWCI
- 192.15
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- neural information processing systems (publishedVersion)
- arXiv (Cornell University) (submittedVersion, cc-by)
- arXiv (Cornell University) (cc-by)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Keywords
- language agents, verbal behavior, language acquisition
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-01, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-01 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.