Reflexion: Language Agents with Verbal Reinforcement Learning
Open accessThe DOI matches its DataCite record; 42 of the 42 references it cites were found in a registry or an index; 7 of the 8 sources its claims cite were checked for support.
Abstract
Large language models (LLMs) have been increasingly used to interact with external environments (e.g., games, compilers, APIs) as goal-driven agents. However, it remains challenging for these language agents to quickly and efficiently learn from trial-and-error as traditional reinforcement learning methods require extensive training samples and expensive model fine-tuning. We propose Reflexion, a novel framework to reinforce language agents not by updating weights, but instead through linguistic feedback. Concretely, Reflexion agents verbally reflect on task feedback signals, then maintain their own reflective text in an episodic memory buffer to induce better decision-making in subsequent trials. Reflexion is flexible enough to incorporate various types (scalar values or free-form language) and sources (external or internally simulated) of feedback signals, and obtains significant improvements over a baseline agent across diverse tasks (sequential decision-making, coding, language reasoning). For example, Reflexion achieves a 91% pass@1 accuracy on the HumanEval coding benchmark, surpassing the previous state-of-the-art GPT-4 that achieves 80%. We also conduct ablation and analysis studies using different feedback signals, feedback incorporation methods, and agent types, and provide insights into how they affect performance.
Overview
CoChat Summary
TL;DR
Reflexion reinforces language agents through verbal self-reflection stored in episodic memory rather than weight updates, improving performance across decision-making, reasoning, and coding tasks. It reports gains including 91% pass@1 on HumanEval, a 22% absolute improvement on AlfWorld, and 20% on HotPotQA.
Key findings
- On HumanEval Python, Reflexion achieves 91.0 pass@1, surpassing the previous state-of-the-art GPT-4 at 80.1; on HumanEval Rust it reaches 68.0 vs. 60.0, MBPP Rust 75.4 vs. 70.9, and Leetcode Hard 15.0 vs. 7.5.
- In AlfWorld, ReAct + Reflexion completes 130 out of 134 tasks using a simple heuristic and improves over strong baselines by an absolute 22% over 12 iterative learning steps; ReAct-only converges at a 22% hallucination rate with no long-term recovery.
- In HotPotQA, Reflexion improves over baselines by 20%; self-reflection gives an 8% absolute boost over episodic memory alone, and although CoT (GT) fails on 39% of questions, Reflexion improves accuracy by 14% without access to ground-truth answers.
- Ablations on the 50 hardest HumanEval Rust problems show full Reflexion at 0.68 vs. baseline 0.60; omitting test generation drops to 0.52, and omitting self-reflection stays at 0.60.
Methods
- Reflexion uses a modular loop with an Actor that generates text/actions, an Evaluator that scores outputs, and a Self-Reflection model that converts feedback into verbal summaries stored in memory; trials repeat until the Evaluator passes or a max trial count is reached, with memory usually bounded to 1–3 experiences.
- Experiments cover AlfWorld (134 environments, six tasks, ReAct + GPT-3), HotPotQA (100 questions, CoT/ReAct, exact-match grading, memory size 3), and programming (HumanEval, MBPP, LeetcodeHardGym; Python/Rust via MultiPL-E; self-generated unit tests up to 6).
- Ablations and analyses vary feedback signals, feedback incorporation methods, and agent types; compromised approaches are tested on HumanEval Rust, and a WebShop experiment is run across 100 environments.
Limitations
- The paper states Reflexion may fall into non-optimal local minima, limits long-term memory to a sliding window with maximum capacity, and notes code-generation test-driven development is limited by non-deterministic, impure, hardware-dependent, or concurrent functions; it also relies on LLM self-evaluation/heuristics and lacks a formal success guarantee.
- The paper reports WebShop failure: after only four trials the agent shows no improvement and does not generate helpful self-reflections, concluding Reflexion cannot solve tasks requiring significant diversity and exploration.
- Evident from the text: self-correction is an emergent quality of stronger, larger models—starchat-beta shows no improvement (baseline 0.26 vs. Reflexion 0.26)—and flaky or incorrect test suites can cause false positives/negatives, with false negatives preferred.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
4 Valid · 2 Not valid · 0 Not checked · 59 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Therefore, in the case in which the model generates a flaky test suite, it is possible that all tests pass on an incorrect solution and lead to a false positive label on a code completion [11].”
§ Reflexion: Language Agents with Verbal Reinforcement Learning > Analysis
What the sources say
- Partly supportedcites [11] 11. Lam, W., Winter, S., Wei, A., Xie, T., Marinov, D., and Bell, J. (2020). A large-scale longitudinal study of flaky tests. Proc. ACM Program. Lang., 4(OOPSLA). sourceExperimental — accuracy not yet measured
The Introduction (page not provided) says a flaky test can pass and fail on the same code and that changes may be merged when all tests pass. It does not address model-generated test suites, incorrect code completions, or false-positive labels, so those parts of the claim are not established by this paper. (LLM, conf=0.82)
hedgedstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“3 shows an inferior 52% vs 60% (baseline) accuracy, which suggests that the agent is unable to determine if the current implementation is correct without unit tests.”
§ Reflexion: Language Agents with Verbal Reinforcement Learning > Ablation study
hedgedstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“ReAct + Reflexion significantly outperforms ReAct by completing 130 out of 134 tasks using the simple heuristic to detect hallucinations and inefficient planning.”
§ Reflexion: Language Agents with Verbal Reinforcement Learning > Results
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“4 shows that self-reflection improves learning by an 8% absolute boost over the episodic memory learning advantage.”
§ Reflexion: Language Agents with Verbal Reinforcement Learning > Analysis
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“on reasoning questions in HotPotQA [28] by 20%”
- Also stated in: § 4 Experiments · plain
“Most notably, Reflexion improves performance over strong baselines by 22% in AlfWorld, 20% in HotPotQA, and 11% on HumanEval.”
§ Reflexion: Language Agents with Verbal Reinforcement Learning > 1 Introduction
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § 4 Experiments · plain
30 more claims
Create a free account to see all 65 claims and every source verdict.
- It may state two separate claims as one. 18
- Probably not a substantial claim. 11
- The quote only partly states this claim. 3
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source doesn’t support the claim as written.
In the citing paper
“Memory and reflection systems such as MemAgent (Yu et al., 2025a), Reflexion (Shinn et al., 2023), and Generative Agents (Park et al., 2023) improve retrieval and episodic memory, but do not perform context shaping, state restructuring, or nextinstruction refinement.”
From PAACE: A Plan-Aware Automated Agent Context Engineering Framework (2025) · cites this paper as Shinn et al., 2023
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe cited source doesn’t support the claim as written.
In the citing paper
“However, Reflexion computes verbal reward over a full trajectory, yielding a single end-of-episode signal that conflates credit across reasoning steps: a failure due to a single intermediate error receives the same critique pressure as one due to a flawed strategy.”
From Process Supervision via Verbal Critique Improves Reasoning in Large Language Models (2026) · cites this paper as Shinn et al. [2023]
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe cited source doesn’t support the claim as written.
In the citing paper
“Unlike Reflexion, which only reflects on unsuccessful trajectories, our approach separately reflects on both successful and unsuccessful ones.”
From An Efficient Context-Dependent Memory Framework for LLM-Centric Agents (2025) · cites this paper as Shinn et al., 2023
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe cited source doesn’t support the claim as written.
In the citing paper
“The dominant approach is to curate memory at write time.”
From Just-in-Time Memory: Learning to Curate Task-Adaptive Memory for LLM Agents (2026) · cites this paper as Shinn et al., 2023
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Interaction and code generation are increasingly used together, with code as the modality of choice for actions [48, 59], tool construction [13, 51, 69], and reasoning [39, 66, 67].”
From SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineering (2024) · cites this paper as [39]
Experimental — accuracy not yet measured
107 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Reflexion: Language Agents with Verbal Reinforcement Learning > 3 Reflexion: reinforcement via verbal reflection
“while M e not pass or t < max trials do”
§ Reflexion: Language Agents with Verbal Reinforcement Learning > Self-reflection
“The Actor, Evaluator, and Self-Reflection models work together through trials in a loop until the Evaluator deems τ t to be correct.”
Citations
Cites
The publisher hasn’t deposited this paper’s reference list.
Cited by
Items 1,201–1,300 of 3,537
Shortening agent skills leaves LLM agent cost unchangedPreprint
Xu, X. X., & Wu, W. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2607.03048 · Cited by 4
İşcan, M. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2607.12962 · Cited by 4
MANTA: Multi-Agent Network Topology Adaptation for Self-Evolving Multi-Agent SystemsPreprint
Huang, M.-X., Wang, J., Lai, Y.-C., Zhang, Z., Cardie, C., & Huang, H.-H. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2607.28527 · Cited by 4
Jena, G., Wanaskar, K., Jain, V., Chadha, A., Sharma, V., & Das, A. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2608.01851 · Cited by 4
Quo Vadis, World Modeling?Preprint
Yang, Y., Yang, X., Wen, L., Kong, L., Hu, X., Lu, D., Chow, W., Huang, X., Feng, Y., Liao, Y., et al. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2608.02713 · Cited by 4
“9 [20, 41, 140].”
InfluentialSelf-Evolving Coding AgentsPreprint
Zhou, H., Hu, H., Luo, T., Shang, Y., Fang, C., Chen, Z., Xiao, L., & Zhang, Q. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2608.03392 · Cited by 4
“For example, Reflexion and Self-Refine use verbal feedback and self-critique to improve subsequent decisions without changing model weights [74, 96], while ExpeL and AGENT KB convert past trajectories into reusable experience that can be retrieved across tasks [100, 149].”
Fan, S., Li, M., Ma, X., Tan, W., Huang, X., Wu, J., Zhang, L., Shang, S., & Chen, W. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2608.03327 · Cited by 4
Li, R., Zhang, L., Xu, B., Du, M., Fu, Z., & Chen, W. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2608.12888 · Cited by 6
“Large language model (LLM) agents have become a core paradigm for AI applications, demonstrating strong capabilities in tool use, code generation, scientific problem solving, and dialogue simulation (Yao et al., 2022; Shinn et al., 2023; Wang et al., 2023a; Park et al., 2023).”
PILOT in the Loop: Live Self-Improvement for Long-Horizon AgentsPreprint
Xiao, Y., Sun, Y., Wu, H., Hui, W., Da, W., Luo, Z., Chuan, M., Hu, Y., Li, W., & Jiang, C. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2608.26530 · Cited by 4
“Reflection critiques a completed trajectory, judge-based evaluation assesses the final result, and self-evolving harnesses revise prompts, skills, or memory from completed traces and feedback [23, 36, 17, 14, 15].”
ExecCritic: Learn to Test, Test to Improve for Coding AgentsPreprint
Tao, L., Peng, B., Wang, H., Wang, H., Cheng, H., Yao, W., Wu, Q., Ge, T., Li, S., & Gao, J. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2609.09133 · Cited by 4
“The”
SE-GoS: Self-Evolving Graph-of-Skills for Skill Library at ScalePreprint
Fu, D., Jiang, C., Qian, S., Wang, H., & Hao, Z. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2609.08228 · Cited by 4
“…distill cross-episode insights, turn failures into verbal reinforcement, synthesize new skills, or induce reusable workflows (Zhao et al., 2024; Shinn et al., 2023; Zheng et al., 2025; Wang et al., 2025); others compile a skill directory from a document corpus and have the agent browse it (Sun…”
ECDSA.Fail: Open Autoresearch for Optimizing Elliptic-Curve Point Addition in Shor's AlgorithmPreprint
Long, J., Pender, T., Huang, Z., Santos, M. B., Singh, S. K., Naskręcki, B., Wonka, B., Dallaire-Demers, P.-L., Giannicola, F., Paschoarelli, R. M. L., et al. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2609.09582 · Cited by 5
Ecdysis: Efficient and Effective Training of Runtime Harnesses for LLM AgentsPreprint
Yue, R., Cui, Y., Zhuoyu, S., Pan, S., Xue, X., Li, T., Li, T., Zhu, W., Chen, Y., Liu, Y., et al. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2609.11677 · Cited by 4
“Inference-time mechanisms such as tool interaction, deliberate planning, and feedback-driven adaptation have substantially enhanced LLM agents [3, 16].”
When Agents Slow Down: Understanding LLM Agents' Test-Time Strategies via Elo-per-token AnalysisPreprint
Liu, K., Mang, Q., Peng, B., Chai, W., Li, H., Pimpalgaonkar, S., Zettlemoyer, L., Dimakis, A. G., & Cheung, A. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2609.15309 · Cited by 5
CodeMidas: Scaling Agentic Coding RL Environments from Code ItselfPreprint
Ye, B., Li, L., Li, S., Yue, Z., Zhang, L., Lv, H., Liu, Y., Ma, W., Tian, H., Li, R., et al. (2026) · arXiv (Cornell University) · Cited by 4
NavHarness: Towards Lifelong Embodied NavigationPreprint
Zhao, X., Zhou, J., Lin, S., Zhou, G., Li, Z., Yan, X., Liu, J., van den Hengel, A., & Wu, Q. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2609.34276 · Cited by 5
WEFT: Scaling Tool-Use Post-Training for General-Purpose AgentsPreprint
Mao, B., He, H., Wang, L., Lin, L., Zhou, M., Liu, G., Liu, J., Huai, T., Zhang, C., Li, B., et al. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2609.36887 · Cited by 4
“Behavioral approaches refine outputs through self-feedback (Madaan et al., 2023), use verbal reflection to guide subsequent attempts (Shinn et al., 2023), or accumulate executable skills through exploration (Wang et al., 2024).”
Agent Plasticity: Measuring Self-Improvement Through ExperiencePreprint
Singh, H., Bakhtin, A., Shao, R., Synnaeve, G., Kulikov, I., Fergus, R., Arora, S., Keutzer, K., Weston, J., Mahajan, A., et al. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.08902 · Cited by 6
“Reflection, memory, and skills (Shinn et al., 2023; Wang et al., 2024) Mechanisms for retaining and reusing experience.”
Ai, L., Y, B., Zhang, J., Ai, Y., Hao, Z., Li, J., Yu, Z., & Cheng, J. (2026) · Drones · doi:10.3390/drones10040289 · Cited by 3
Agentic Patterns for Decentralized Network Protocol Configuration
Twabi, A., Ding, Y., & Kondo, T. (2026) · Electronics · doi:10.3390/electronics15112270 · Cited by 3
Xia, S.-J., Zhang, H., Jiang, Y., Chen, X., Chen, Y., Li, Z., Wan, Z., & Sun, A. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5731427 · Cited by 4
Advancing the science of qualitative patient preference assessment using large language models
Grover, T., Krebs, E., Weymann, D., Ehman, M., & Regier, D. A. (2026) · PLOS Digital Health · doi:10.1371/journal.pdig.0001263 · Cited by 3
“Prompt engineering methods such as self-reflection [23], iterative refinement [24], and step-by-step reasoning [25] can be combined into multi-step algorithms that significantly improve the quality and relevance of final LLM outputs [26,27].”
Damarched, M. K. (2026) · Journal of Drug Delivery and Therapeutics · doi:10.22270/jddt.v16i3.7649 · Cited by 3
Yue, L., Ko, C.-Y., Chen, P.-Y., Di, S., & Pan, S. (2026) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2026.1820375 · Cited by 8
“In an MCP-native setting, new agents can be materialized as new MCP servers (tools) or as new orchestration policies (managers), expanding the ecosystem over time (Shinn et al., 2023).”
Multi-Agent Systems: From Classical Paradigms to Large Foundation Model-Enabled Futures
Wang, Z., Gong, M., Sun, Q., Xu, J., Mao, S., Jin, X., Han, Q., & Tang, Y. (2026) · IEEE/CAA Journal of Automatica Sinica · doi:10.1109/jas.2026.126113 · Cited by 4
“Reflexion [104] generates language-based self-reflection signals and stores them in memory, providing valuable self-feedback that informs future attempts.”
Pylarinou, C., Gortzis, L. G., Leivaditis, V., Liolis, E., Antzoulas, A., Papadoulas, S., Nikolakopoulos, K. M., Panagiotopoulos, I., Mitsos, S., Tomos, P., et al. (2026) · Bioengineering · doi:10.3390/bioengineering13060686 · Cited by 3
A lifecycle-oriented survey of LLM-based agents: Workflow, graph augmentation, and future directions
Kang, C., & Li, K. (2026) · Neurocomputing · doi:10.1016/j.neucom.2026.134838 · Cited by 4
VideoTIR: Accurate Understanding for Long Videos with Efficient Tool-Integrated Reasoning
Gao, Z., Shen, S., Chai, T., Wang, W., Xu, H., Xing, W., Li, W., Fan, Q., Gao, Y., & Tao, D. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37255-0_14 · Cited by 3
OpaqueToolsBench: Learning Nuances of Tool Behavior Through Interaction
Hallinan, S., Venkatesh, T., Ren, X., Karimireddy, S. P., Paranjape, A., Zhang, Y., & Hessel, J. (2026) · ACM Conference on AI and Agentic Systems (CAIS) · doi:10.1145/3786335.3813182 · Cited by 4
TaxBreak: Unmasking the Hidden Costs of LLM Inference Through Overhead Decomposition
Vellaisamy, P., Tripathi, S., Natarajan, V., Thenarasu, S. S., Blanton, S., & Shen, J. P. (2026) · IEEE International Symposium on Performance Analysis of Systems and Software (ISPASS) · doi:10.1109/ispass69572.2026.00014 · Cited by 3
Yu, L. J., Li, S. Y., Zhou, M., Chu, G., & Guo, Y. R. (2026) · Lecture notes in computer science · doi:10.1007/978-981-92-3423-3_49 · Cited by 3
“Multi-agent systems, such as CurriculumPT [17] and MindAgent [4], use role decoupling to manage complex interactions and often incorporate verbal reflection for iterative self-correction [12].”
Łabuz, M., Szczęsny, P., & Mika-Łabuz, K. (2026) · Ethics and Information Technology · doi:10.1007/s10676-026-09917-x · Cited by 3
“…sentences (Wei et al., 2022), (b) exploring multiple candidate branches/versions and selecting or combining them (Yao et al., 2023), (c) using external tools or memory (Press et al., 2022), and (d) verifying and revising answers with learned critics or reward models (Shinn et al., 2023).”
Camera Control at the Edge with Language Models for Scene Understanding
Buynitsky, A., Ehsani, S., Pallakonda, B., & Mishra, P. (2025) · International Conference on Control, Automation and Robotics (ICCAR) · doi:10.1109/iccar64901.2025.11073044 · Cited by 3
Learning from Failure: Improving Meeting Summarization without Good Samples
Wang, K., Zhao, X., & Peng, W. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i17.29883 · Cited by 4
“More recently, a flour-ishing literature has suggested impressive in-context learning abilities of LLMs (Brown et al. 2020; Liu et al. 2021, 2022; Shinn et al. 2023; Wei et al. 2023; Gao et al. 2023; Roit et al. 2023).”
BackgroundMethodSituationalLLM: Proactive Language Models with Scene Awareness for Dynamic, Contextual Task Guidance
Khan, M. S. U., Afzal, M. Z., & Stricker, D. (2025) · Open Research Europe · doi:10.12688/openreseurope.18551.1 · Cited by 3
An approach to optimizing semantic consistency for text-to-digital human generation
Liu, X., Liu, X., Yang, P., Wang, Z., & Liu, F. (2025) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2025.111909 · Cited by 4
RRdE: A Decision Making Framework for Language Agents in Interactive Environments
Zhou, X., Li, L., & Zeng, D. D. (2024) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn60899.2024.10650094 · Cited by 4
“Reflexion [1] extends the React method by incorporating a multi-round learning process.”
BackgroundMethodInfluentialZhu, D., 弗里斯, 彼., & Friess, P. (2024) · Leonardo · doi:10.1162/leon_a_02625 · Cited by 3
Iterative improvements from feedback for language modelsPreprint
Li, Y. (2023) · doi:10.14293/pr2199.000220.v1 · Cited by 5
İSTEM MÜHENDİSLİĞİNİN BÜYÜK DİL MODELLERİNİN PERFORMANSINDAKİ ROLÜ: ANALİZ VE UYGULAMA ÖRNEKLERİ
Tan, F. G., Yüksel, A. S., & Karabıyık, M. A. (2024) · Kahramanmaraş Sütçü İmam Üniversitesi Mühendislik Bilimleri Dergisi · doi:10.17780/ksujes.1480838 · Cited by 3
Niederwieser, E., Siegele, D., & Matt, D. T. (2025) · Zeitschrift für wirtschaftlichen Fabrikbetrieb · doi:10.1515/zwf-2025-0007 · Cited by 7
LLMAGENTNET: A COLLABORATIVE NETWORK OF AUTONOMOUS AI AGENTS FOR COMPLEX TASK EXECUTION
Бідочко, А., & Виклюк, Я. І. (2025) · Науковий вісник НЛТУ України · doi:10.36930/40350412 · Cited by 3
Optimization and Application of English Word Memory Algorithm Based on Reinforcement Learning
Zhang, G. (2024) · Journal of Electrical Systems · doi:10.52783/jes.3096 · Cited by 4
The Use of Generative Artificial Intelligence for Business Decision-Making
Mummar, A., Pacheco, A., Saunders, S., Ratliff-Villarreal, L., & Schmitt, A. (2024) · The Pinnacle A Journal by Scholar-Practitioners · doi:10.61643/c16259 · Cited by 3
Lee, D., Joo, S., Lee, K., & Kim, B. (2025) · The International Journal of Robotics Research · doi:10.1177/02783649251347307 · Cited by 6
Human-inspired Perspectives: A Survey on AI Long-term Memory
He, Z., Lin, W., Zheng, H., Zhang, F., Jones, M. W., Aitchison, L., Xu, X., Liu, M., Kristensson, P. O., & Shen, J. (2024) · arXiv · doi:10.48550/arxiv.2411.00489 · Cited by 3
From Human Memory to AI Memory: A Survey on Memory Mechanisms in the Era of LLMs
Wu, Y., Liang, S., Zhang, C., Wang, Y., Zhang, Y., Guo, H., Tang, R., & Liu, Y. (2025) · arXiv · doi:10.48550/arxiv.2504.15965 · Cited by 3
“Similarly, Reflexion [95] introduces mechanisms for dynamic memory and self-reflection, allowing the LLM to self-evaluate and iteratively refine its behavior based on prior errors or limitations.”
Feedback Loops With Language Models Drive In-Context Reward Hacking
Pan, A., Jones, E., Jagadeesan, M., & Steinhardt, J. (2024) · arXiv · doi:10.48550/arxiv.2402.06627 · Cited by 3
“In the two running examples (and in Yang et al. (2023); Madaan et al. (2023); Shinn et al. (2023)), the feedback loop induces optimization by iteratively refining parts of the world-LLM system.”
BackgroundOn the Self-Verification Limitations of Large Language Models on Reasoning and Planning Tasks
Stechly, K., Valmeekam, K., & Kambhampati, S. (2024) · arXiv · doi:10.48550/arxiv.2402.08115 · Cited by 120
“These take many forms: common search algorithms with the LLM cast in the role of heuristic [37, 11], approaches which reduce error rates by enforcing various consistency conditions [8, 6, 17], and direct LLM self-critique [27, 35, 5, 15, 21, 38].”
BackgroundMethodFrom Storage to Experience: A Survey on the Evolution of LLM Agent Memory Mechanisms
Luo, J., Tian, Y., Cao, C., Luo, Z., Lin, H., Li, K., Kong, C., Yang, R., & Ma, J. (2026) · Findings of the Association for Computational Linguistics: ACL 2026 · doi:10.18653/v1/2026.findings-acl.2069 · Cited by 3
“Although reflection mechanisms mitigate hallucinations (Tian et al., 2025b) and noise through evaluation, their corrective efficacy remains at the level of trajectories and has not yet yielded knowledge at the level of strategy that is transferable (Shinn et al., 2023; Renze and Guven, 2024).”
InfluentialAgentic Context Engineering: Evolving Contexts for Self-Improving Language Models
Zhang, Q., Hu, C., Upasani, S., Ma, B., Hong, F., Kamanuru, V., Rainton, J., Wu, C., Ji, M., Li, H., et al. (2025) · arXiv · doi:10.48550/arxiv.2510.04618 · Cited by 370
“Representative methods include Reflexion (Shinn et al., 2023), which reflects on failures to improve agent planning; TextGrad (Yuksekgonul et al., 2024), which optimizes prompts via gradient-like textual feedback; GEPA (Agrawal et al., 2025), which refines prompts iteratively based on execution…”
Gao, H.-A., Geng, J., Hua, W., Hu, M., Juan, X., Liu, H., Liu, S., Qiu, J., Qi, X., Wu, Y., et al. (2025) · arXiv · doi:10.48550/arxiv.2507.21046 · Cited by 3
AgentSquare: Automatic LLM Agent Search in Modular Design Space
Shang, Y., Li, Y., Zhao, K., Ma, L., Liu, J., Xu, F., & Li, Y. (2024) · arXiv · doi:10.48550/arxiv.2410.06153 · Cited by 3
“Memory plays a critical role by storing past thoughts, actions, and observations of agents (Park et al., 2023; Shinn et al., 2024).”
Language Agents as Optimizable Graphs
Zhuge, M., Wang, W., Kirsch, L., Faccio, F., Khizbullin, D., & Schmidhuber, J. (2024) · arXiv · doi:10.48550/arxiv.2402.16823 · Cited by 3
“The second agent is based on the Reflex-ion method (Shinn et al., 2023).”
MethodInfluentialEmpowering Large Language Model Agent through Step-Level Self-Critique and Self-Training
Zhai, Y., Liu, H., Zhang, Z., Lin, T., Xu, K., Yang, C., Feng, D., Ding, B., & Wang, H. (2025) · Proceedings of the 48th International ACM SIGIR Conference on Research and Development in Information Retrieval · doi:10.1145/3726302.3729965 · Cited by 3
Progent: Securing AI Agents with Privilege Control
Shi, T., He, J., Wang, Z., Li, H., Wu, L., Guo, W., & Song, D. (2025) · arXiv · doi:10.48550/arxiv.2504.11703 · Cited by 3
Mind2Web 2: Evaluating Agentic Search with Agent-as-a-Judge
Gou, B., Huang, Z., Ning, Y., Gu, Y., Lin, M., Qi, W., Kopanev, A., Yu, B., Gutiérrez, B. J., Shu, Y., et al. (2025) · arXiv · doi:10.48550/arxiv.2506.21506 · Cited by 3
Bogdanov, I., Lung, C.-H., Kunz, T., Gao, J., Taylor, A., & Zaman, M. (2026) · Proceedings of the ACM Conference on AI and Agentic Systems · doi:10.1145/3786335.3813149 · Cited by 3
AndroidWorld: A Dynamic Benchmarking Environment for Autonomous Agents
Rawles, C., Clinckemaillie, S., Chang, Y., Waltz, J., Lau, G., Fair, M., Li, A., Bishop, W., Li, W., Campbell-Ajala, F., et al. (2024) · arXiv · doi:10.48550/arxiv.2405.14573 · Cited by 3
Can Language Models Solve Olympiad Programming?
Shi, Q., Tang, M., Narasimhan, K., & Yao, S. (2024) · arXiv · doi:10.48550/arxiv.2404.10952 · Cited by 3
Self-citationALYMPICS: LLM Agents Meet Game Theory -- Exploring Strategic Decision-Making with AI Agents
Mao, S., Cai, Y., Xia, Y., Wu, W., Wang, X., Wang, F., Ge, T., & Wei, F. (2023) · arXiv · doi:10.48550/arxiv.2311.03220 · Cited by 3
Are Long-LLMs A Necessity For Long-Context Tasks?
Qian, H., Liu, Z., Zhang, P., Mao, K., Zhou, Y., Chen, X., & Dou, Z. (2024) · arXiv · doi:10.48550/arxiv.2405.15318 · Cited by 3
Small Language Model Agent for the Operations of Continuously Updating ICT Systems
Fukuda, N., Nozue, H., & Oishi, H. (2025) · IEEE Access · doi:10.1109/access.2025.3544637 · Cited by 4
“Reflexion [39] extends the ReAct by introducing a self-reflection framework that enables the LLM to enhance the solution by repeatedly reflecting on unsuccessful attempts.”
Faithful Self-Refinement in Mathematical Reasoning via Progressive Back-Translation
Liao, H., Zhu, Z., Hu, S., He, H., & Jin, Y. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10890054 · Cited by 3
“One type of external signal includes interactive tools [13]– [15], human experts [16]–[18], and verifier models [19]– [21].”
Wang, C., Zhang, L., & Zhou, Y. (2025) · Knowledge-Based Systems · doi:10.1016/j.knosys.2025.113711 · Cited by 4
VeriMinder: Mitigating Analytical Vulnerabilities in NL2SQL
Mohole, S., & Galhotra, S. (2025) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2025.acl-demo.43 · Cited by 3
“This mirrors self-refinement techniques that improve LLM performance (Madaan et al., 2023; Shinn et al., 2023).”
Generating Frequently Asked Questions from Technical Support Tickets using Large Language Models
Joslin, C., Burns, D., Ashish, F., & Sarbijan, E. J. (2025) · International Conference for High Performance Computing, Networking, Storage and Analysis (SC) · doi:10.1145/3731599.3767429 · Cited by 3
“Our approach also parallels recent self-refinement and reflection-based validation techniques used in LLM pipelines [25, 38].”
From prompt to persona: a literature review on LLMs as single cognitive agents
Tissaoui, A. (2025) · Journal of Ambient Intelligence and Humanized Computing · doi:10.1007/s12652-025-05029-4 · Cited by 5
“The Reflexion architecture (Shinn et al. 2023) adds an inner loop of self evaluation, where the agent reflects on task failures, critiques its own mistakes, and revises its strategy.”
Architectures for Building Agentic AI
Nowaczyk, S. (2026) · Studies in computational intelligence · doi:10.1007/978-3-032-18585-3_3 · Cited by 3
A Comparative Featureset Analysis of Agentic IDE Tools
Shrivastava, M. (2025) · Journal of Cognitive Computing and Extended Realities · doi:10.65157/jccer.2025.001 · Cited by 5
A memory-augmented LLM-driven method for autonomous merging of 3D printing work orders
Liu, Y., Yang, M., & Jiang, P. (2026) · Procedia CIRP · doi:10.1016/j.procir.2025.08.194 · Cited by 3
Fodeh, S. J., Ma, L., Puthiaraju, G., Talakokkul, S., Khan, A., Hagaman, A. K., Lowe, S., & Roundtree, A. K. (2026) · npj Digital Public Health · doi:10.1038/s44482-026-00039-1 · Cited by 3
“Relative to 2-shot learning, the corresponding improvements are 29.15%, 57 .76%, and 26.83%, respectively.”
InfluentialSCAFFOLD-CEGIS: Preventing Latent Security Degradation in LLM-Driven Iterative Code Refinement
Chen, Y. H., Bian, Y., Wang, H., Li, S., & Cui, Z. (2026) · International Conference on Artificial Intelligence and Big Data (ICAIBD) · doi:10.1109/icaibd69640.2026.11637170 · Cited by 3
“The Reflexion framework proposed by Shinn et al. [17] improves subsequent attempts by prompting models to reflect on natural-language trajectories of failed execution and by accumulating failure experience in memory.”
Gao, D., Wen, X., Lv, J., Si, J., Wang, C., & Bao, J. (2026) · Digital engineering. · doi:10.1016/j.dte.2026.100099 · Cited by 7
Pioneer Agent: Continual Improvement of Small Language Models in Production
Atreja, D., White, J., Nayak, N., Zhang, K., Princis, H., Hurn-Maloney, G., Lewis, A., & Zaratiana, U. (2026) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/2026.emnlp-industry.12 · Cited by 4
ICAM-Trans: Implicit-Context-Aware Multi-Agent Framework for Function-Level Code Translation
Chen, R., Wang, J., Cao, L., Cai, Y., & Zhao, M. (2026) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3810952 · Cited by 3
“Early works such as Reflexion[25] and AgentCoder[9] explored using LLMs as self-reflective agents for code generation and debugging, where the model evaluates its own output and performs corrective iterations based on error signals.”
Zong, Y., Jia, R., Li, K., Xue, D., Zhang, L., & He, D. (2026) · Neural Networks · doi:10.1016/j.neunet.2026.109055 · Cited by 5
MARVEL: a multi-agent research validator and enabler using large language models
Mukund, N., Luo, Y., Zhang, F., Barsotti, L., & Katsavounidis, E. (2026) · Machine Learning Science and Technology · doi:10.1088/2632-2153/ae68ba · Cited by 3
“Prompting methods such as self-ask, ReAct, tree-of-thoughts, and reflection introduce intermediate steps and feedback [50–53].”
OLIVIA: Online Learning via Inference-time Action Adaptation
Yu, S., Wu, J., Li, X., Kuang, N. L., Zhou, S., Yu, T., Han, J., Shang, J., & McAuley, J. (2026) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/2026.emnlp-main.764 · Cited by 3
optimize_anything: A Universal API for Optimizing any Text Parameter
Agrawal, L. A., Lee, D., Tan, S., Ma, W., Elmaaroufi, K., Seshia, S. A., Sen, K., Klein, D., Stoica, I. G., Gonzalez, J. E., et al. (2026) · ACM Conference on AI and Agentic Systems (CAIS) · doi:10.1145/3786335.3813190 · Cited by 8
Freeman, B., Kicklighter, A., Erdman, M., & Gordon, Z. (2026) · Computer and Information Science · doi:10.5539/cis.v19n2p1 · Cited by 3
“Shinn et al. (2023) extend this with verbal reinforcement signals.”
Jin, C. (., Kim, J., & Im, J. (2026) · Tourism Management · doi:10.1016/j.tourman.2026.105468 · Cited by 3
TravelEval: A Comprehensive Benchmarking Framework for Evaluating LLM-Powered Travel Planning Agents
Chen, W., Shuaixiong, W. A. N. G., Gao, Z., Hu, K., Ni, W., Di, S., Zhang, C., & Chen, L. (2026) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3770855.3817533 · Cited by 3
“…demands), we induce a six-dimensional evaluation framework and design normalized, quantifiable metrics for each dimension, covering not only the factual accuracy and constraint satisfaction of generated plans but also their spatiotemporal rationality, economic balance, and user experience utility.”
Agentic workflows for end-to-end software engineering automation
Verma, H. (2025) · World Journal of Advanced Research and Reviews · doi:10.30574/wjarr.2025.25.3.0887 · Cited by 3
Debnath, T., Siddiky, M. N. A., Rahman, M. E., Das, P., Guha, A. K., Rahman, M. R., & Kabir, H. M. D. (2026) · Computer Science Review · doi:10.1016/j.cosrev.2026.100979 · Cited by 4
Thinking with Reasoning Skills: Fewer Tokens, More Accuracy
Zhao, G., Shi, Q., Xiao, X., Zhang, X. B., Yang, T., & Sun, L. (2026) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2026.acl-industry.154 · Cited by 3
Reinforced Agent: Inference-Time Feedback for Tool-Calling Agents
Ta, A., Zhu, J., & Shayandeh, S. (2026) · Workshop on Generation, Evaluation and Metrics (GEM) · doi:10.18653/v1/2026.gem-main.13 · Cited by 11
Intelligence as Managed Autonomy: Failure, Escalation, and Governance for Agentic AI Systems
Ramaswamy, S. (2026) · Journal of Intelligent & Robotic Systems · doi:10.1007/s10846-026-02413-w · Cited by 4
“Iterative refinement frameworks, such as Self-Refine [15] and Reflexion [16], allow agents to critique and revise their outputs.”
Human-in-the-loop validation of a sequential multi-LLM medical education pipeline
Nam, Y., An, T., Hwang, S. I., Jeon, C., Jeong, J. W., Jeong, J., Kim, D. Y., Kim, P. H., Kim, S. Y., Kim, S., et al. (2026) · npj Digital Medicine · doi:10.1038/s41746-026-02978-8 · Cited by 4
“Automated systems that fl ag content for human review face a lower accountability bar than those that attempt autonomous correction 38,39 .”
Hypothesis-driven Model Expansion under Uncertainty for Open-World Robot Planning
Xiao, A., Zhang, H., Hu, T., & Hsu, D. (2026) · Robotics: Science and Systems · doi:10.15607/rss.2026.xxii.181 · Cited by 7
UniMem: Complementary Episodic-to-Parametric Memory for Boundary-Agnostic Task Streams
Xia, S., Zhang, C., Wu, Y., Li, H., Chai, J., Wang, X., Yin, G., Lin, W., Lin, Z., Zhang, H., et al. (2026) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/2026.emnlp-main.1490 · Cited by 3
Mokssit, Y., Ravi, K., Nie, M., Kim, J., & Liu, C. (2026) · npj Digital Medicine · doi:10.1038/s41746-026-03348-0 · Cited by 3
Agentic AI systems for scientific discovery
Feng, B., Walther, P., Zhang, L., Coyle, R. A., Kim, S., Mandal, A., Zhang, Z., Papidocha, S. M., Kelmanson, A., Segura, D. M., et al. (2026) · Nature Reviews Methods Primers · doi:10.1038/s43586-026-00534-y · Cited by 8
“Additionally, iterative self-refinement 180–182 and dynamic replanning approaches 183,184 have been proposed.”
LLM-Evolve: Evaluation for LLM’s Evolving Capability on Benchmarks
You, J., Liu, M., Prabhumoye, S., Patwary, M. A., Shoeybi, M., & Catanzaro, B. (2024) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2024.emnlp-main.940 · Cited by 17
Meta-Reflection: A Feedback-Free Reflection Learning Framework
Wang, Y., Zhu, Y., XintongBao, X., Zhang, W., Dai, S., Chen, K., Li, W., Huang, G., Tang, S., & Zhuang, Y. (2025) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2025.acl-long.201 · Cited by 8
He, G., Zhang, M., Su, T., Ma, L., & Zhu, X. (2025) · Expert Systems with Applications · doi:10.1016/j.eswa.2025.129273 · Cited by 7
Rahman, S., Hameed, A., Srivastava, G., & Danish, S. M. (2026) · IEEE Transactions on Services Computing · doi:10.1109/tsc.2026.3717248 · Cited by 5
“Together, these criteria ensure the robustness, consistency, and practical applicability of theRefactorCoderQAdatasetasabenchmarkforassessingLLM capabilities.”
Qiu, L., Xu, Z., Tan, Q., Tang, W., Yu, C., & Wang, Y. (2026) · IEEE International Conference on Automation Science and Engineering (CASE) · doi:10.1109/case69030.2026.11704313 · Cited by 3
“Our work automatically constructs preference data pairs from simulation outcomes produced by parallel adversarial policies, enabling scalable preference learning while capturing diverse vulnerabilities in multi-agent interactions.”
Wu, X. (2025) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2025.findings-emnlp.970 · Cited by 8
“Learning from rewards can occur at different stages of the language model lifecycle, including Training , Inference , and Post-Inference . and Raffel, 2023; Khanov et al., 2024), and post-inference correction (Shinn et al., 2023; Pan et al., 2023a).”
Memory-Augmented Agent Training for Business Document Understanding
Liu, J., Zeng, Y., Højmark‐Bertelsen, M., Gadeberg, M. N., Wang, H., & Wu, Q. (2026) · Communications in computer and information science · doi:10.1007/978-3-032-11477-8_5 · Cited by 3
Metadata
- Authors
- Shinn, N., Cassano, F., Berman, E., Gopinath, A., Narasimhan, K., & Yao, S.
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2023
- Pages
- 8634-8652
- ISSN
- 1049-5258 (ISSN-L)
- arXiv
- 2303.11366
- OpenAlex
- W7133222210
- Cited by
- 1,087
- References
- 0
- Citations by year
- 2026: 760 · 2025: 167 · 2024: 105 · 2023: 55
- FWCI
- 192.15
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- neural information processing systems (publishedVersion)
- arXiv (Cornell University) (submittedVersion, cc-by)
- arXiv (Cornell University) (cc-by)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Keywords
- language agents, verbal behavior, language acquisition
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-01, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-01 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.