Reflexion: Language Agents with Verbal Reinforcement Learning
Open accessThe DOI matches its DataCite record; 42 of the 42 references it cites were found in a registry or an index; 7 of the 8 sources its claims cite were checked for support.
Abstract
Large language models (LLMs) have been increasingly used to interact with external environments (e.g., games, compilers, APIs) as goal-driven agents. However, it remains challenging for these language agents to quickly and efficiently learn from trial-and-error as traditional reinforcement learning methods require extensive training samples and expensive model fine-tuning. We propose Reflexion, a novel framework to reinforce language agents not by updating weights, but instead through linguistic feedback. Concretely, Reflexion agents verbally reflect on task feedback signals, then maintain their own reflective text in an episodic memory buffer to induce better decision-making in subsequent trials. Reflexion is flexible enough to incorporate various types (scalar values or free-form language) and sources (external or internally simulated) of feedback signals, and obtains significant improvements over a baseline agent across diverse tasks (sequential decision-making, coding, language reasoning). For example, Reflexion achieves a 91% pass@1 accuracy on the HumanEval coding benchmark, surpassing the previous state-of-the-art GPT-4 that achieves 80%. We also conduct ablation and analysis studies using different feedback signals, feedback incorporation methods, and agent types, and provide insights into how they affect performance.
Overview
CoChat Summary
TL;DR
Reflexion reinforces language agents through verbal self-reflection stored in episodic memory rather than weight updates, improving performance across decision-making, reasoning, and coding tasks. It reports gains including 91% pass@1 on HumanEval, a 22% absolute improvement on AlfWorld, and 20% on HotPotQA.
Key findings
- On HumanEval Python, Reflexion achieves 91.0 pass@1, surpassing the previous state-of-the-art GPT-4 at 80.1; on HumanEval Rust it reaches 68.0 vs. 60.0, MBPP Rust 75.4 vs. 70.9, and Leetcode Hard 15.0 vs. 7.5.
- In AlfWorld, ReAct + Reflexion completes 130 out of 134 tasks using a simple heuristic and improves over strong baselines by an absolute 22% over 12 iterative learning steps; ReAct-only converges at a 22% hallucination rate with no long-term recovery.
- In HotPotQA, Reflexion improves over baselines by 20%; self-reflection gives an 8% absolute boost over episodic memory alone, and although CoT (GT) fails on 39% of questions, Reflexion improves accuracy by 14% without access to ground-truth answers.
- Ablations on the 50 hardest HumanEval Rust problems show full Reflexion at 0.68 vs. baseline 0.60; omitting test generation drops to 0.52, and omitting self-reflection stays at 0.60.
Methods
- Reflexion uses a modular loop with an Actor that generates text/actions, an Evaluator that scores outputs, and a Self-Reflection model that converts feedback into verbal summaries stored in memory; trials repeat until the Evaluator passes or a max trial count is reached, with memory usually bounded to 1–3 experiences.
- Experiments cover AlfWorld (134 environments, six tasks, ReAct + GPT-3), HotPotQA (100 questions, CoT/ReAct, exact-match grading, memory size 3), and programming (HumanEval, MBPP, LeetcodeHardGym; Python/Rust via MultiPL-E; self-generated unit tests up to 6).
- Ablations and analyses vary feedback signals, feedback incorporation methods, and agent types; compromised approaches are tested on HumanEval Rust, and a WebShop experiment is run across 100 environments.
Limitations
- The paper states Reflexion may fall into non-optimal local minima, limits long-term memory to a sliding window with maximum capacity, and notes code-generation test-driven development is limited by non-deterministic, impure, hardware-dependent, or concurrent functions; it also relies on LLM self-evaluation/heuristics and lacks a formal success guarantee.
- The paper reports WebShop failure: after only four trials the agent shows no improvement and does not generate helpful self-reflections, concluding Reflexion cannot solve tasks requiring significant diversity and exploration.
- Evident from the text: self-correction is an emergent quality of stronger, larger models—starchat-beta shows no improvement (baseline 0.26 vs. Reflexion 0.26)—and flaky or incorrect test suites can cause false positives/negatives, with false negatives preferred.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
4 Valid · 2 Not valid · 0 Not checked · 59 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Therefore, in the case in which the model generates a flaky test suite, it is possible that all tests pass on an incorrect solution and lead to a false positive label on a code completion [11].”
§ Reflexion: Language Agents with Verbal Reinforcement Learning > Analysis
What the sources say
- Partly supportedcites [11] 11. Lam, W., Winter, S., Wei, A., Xie, T., Marinov, D., and Bell, J. (2020). A large-scale longitudinal study of flaky tests. Proc. ACM Program. Lang., 4(OOPSLA). sourceExperimental — accuracy not yet measured
The Introduction (page not provided) says a flaky test can pass and fail on the same code and that changes may be merged when all tests pass. It does not address model-generated test suites, incorrect code completions, or false-positive labels, so those parts of the claim are not established by this paper. (LLM, conf=0.82)
hedgedstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“3 shows an inferior 52% vs 60% (baseline) accuracy, which suggests that the agent is unable to determine if the current implementation is correct without unit tests.”
§ Reflexion: Language Agents with Verbal Reinforcement Learning > Ablation study
hedgedstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“ReAct + Reflexion significantly outperforms ReAct by completing 130 out of 134 tasks using the simple heuristic to detect hallucinations and inefficient planning.”
§ Reflexion: Language Agents with Verbal Reinforcement Learning > Results
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“4 shows that self-reflection improves learning by an 8% absolute boost over the episodic memory learning advantage.”
§ Reflexion: Language Agents with Verbal Reinforcement Learning > Analysis
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“on reasoning questions in HotPotQA [28] by 20%”
- Also stated in: § 4 Experiments · plain
“Most notably, Reflexion improves performance over strong baselines by 22% in AlfWorld, 20% in HotPotQA, and 11% on HumanEval.”
§ Reflexion: Language Agents with Verbal Reinforcement Learning > 1 Introduction
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § 4 Experiments · plain
30 more claims
Create a free account to see all 65 claims and every source verdict.
- It may state two separate claims as one. 18
- Probably not a substantial claim. 11
- The quote only partly states this claim. 3
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source doesn’t support the claim as written.
In the citing paper
“Memory and reflection systems such as MemAgent (Yu et al., 2025a), Reflexion (Shinn et al., 2023), and Generative Agents (Park et al., 2023) improve retrieval and episodic memory, but do not perform context shaping, state restructuring, or nextinstruction refinement.”
From PAACE: A Plan-Aware Automated Agent Context Engineering Framework (2025) · cites this paper as Shinn et al., 2023
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe cited source doesn’t support the claim as written.
In the citing paper
“However, Reflexion computes verbal reward over a full trajectory, yielding a single end-of-episode signal that conflates credit across reasoning steps: a failure due to a single intermediate error receives the same critique pressure as one due to a flawed strategy.”
From Process Supervision via Verbal Critique Improves Reasoning in Large Language Models (2026) · cites this paper as Shinn et al. [2023]
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe cited source doesn’t support the claim as written.
In the citing paper
“Unlike Reflexion, which only reflects on unsuccessful trajectories, our approach separately reflects on both successful and unsuccessful ones.”
From An Efficient Context-Dependent Memory Framework for LLM-Centric Agents (2025) · cites this paper as Shinn et al., 2023
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe cited source doesn’t support the claim as written.
In the citing paper
“The dominant approach is to curate memory at write time.”
From Just-in-Time Memory: Learning to Curate Task-Adaptive Memory for LLM Agents (2026) · cites this paper as Shinn et al., 2023
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Interaction and code generation are increasingly used together, with code as the modality of choice for actions [48, 59], tool construction [13, 51, 69], and reasoning [39, 66, 67].”
From SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineering (2024) · cites this paper as [39]
Experimental — accuracy not yet measured
107 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Reflexion: Language Agents with Verbal Reinforcement Learning > 3 Reflexion: reinforcement via verbal reflection
“while M e not pass or t < max trials do”
§ Reflexion: Language Agents with Verbal Reinforcement Learning > Self-reflection
“The Actor, Evaluator, and Self-Reflection models work together through trials in a loop until the Evaluator deems τ t to be correct.”
Citations
Cites
The publisher hasn’t deposited this paper’s reference list.
Cited by
Items 3,201–3,300 of 3,537
Enhancing Tool Orchestration and Planning for Agentic RAG Systems: A Case Study
Miyaji, R. O., Bedin, V., Moulin, R., & Machado, L. (2026) · Simpósio Brasileiro de Bancos de Dados (SBBD) · doi:10.5753/sbbd.2026.249641
“Furthermore, the system tests advanced deliberative modules like SwiftSage [Lin et al. 2023], alongside iterative self-correction loops such as Reflexion [Shinn et al. 2023] and Self-Refine [Madaan et al. 2023].”
Composable Prompt Modularization in Text-to-SQL Agents: A Practical Approach
Gonçalves, D. C., Neves, B. S., Ferrufino, P. I. V., Costa, D. U. C., Venceslau, A., Franco, W., de Macêdo, J. A. F., & Filho, R. H. (2026) · Simpósio Brasileiro de Bancos de Dados (SBBD) · doi:10.5753/sbbd.2026.249296
“This modular design ensures component reuse and facilitates maintainability [Shinn et al. 2023].”
Large language model multiagent systems for industrial problem discovery and prioritization
Adoul, M. A., & Ghoul, A. (2026) · Discover Artificial Intelligence · doi:10.1007/s44163-026-02468-6
“The ReAct framework [11] interleaves reasoning and action for dynamic planning, and Reflexion [10] adds self-evaluation and iterative improvement.”
LLM-Based Code Generation for Android Automotive OS Vehicle Hardware Abstraction Layer
Tam, N. N., Diep, V. T., & Hung, P. D. (2026) · Lecture notes in computer science · doi:10.1007/978-981-92-6510-7_21
Deilami, M. F. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.33853
From Traceability to Reviewability: Intent-Anchored Claim Review for Agentic AI Design Handoffs
Ming, S., He, Z., Zhao, N., & Jiang, K. (2026) · Design and Artificial Intelligence · doi:10.1016/j.daai.2026.100118
Atawulla, A., Yang, F., Bi, R., Han, B., Han, Y., Liu, X., Yang, Y., & Zhou, X. (2026) · Information Processing & Management · doi:10.1016/j.ipm.2026.105220
Evidence-Guided Recovery from Ambiguous and Partial Agent EffectsPreprint
Zhu, G., Chen, X., Wang, Z., & Wang, C. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.7609459
CB-Agent: Concept-Based In-Context Learning for Sequential Action SelectionPreprint
Zhang, Q., Tang, H., Zhang, M., Yan, Y., Ding, W., & Huang, S.-L. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.14574
“Reflexion instead maintains verbal reflections on feedback to guide subsequent attempts (Shinn et al., 2023).”
InfluentialEvoQuantLab: Training-Free Dual-Loop Evolution for Auditable Quantitative ResearchPreprint
Yang, H., Qian, Z., Chen, C., Zhang, J., Zhu, Z., Deng, T., Jian, X., Gong, S., Guo, Y., & Han, S. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.17130
“Beyond finance, self-evolving agents aim to improve their own reasoning procedures, workflows, architectures, or procedural skills through accumulated execution feedback and experiential memory (Shinn et al., 2023; He et al., 2026a; Zhao et al., 2024; Zheng et al., 2026).”
Towards a Systematic Study of Embodied System 2 over Full Task Execution CyclesPreprint
Wei, Y., Fang, Y., Yang, S., Wu, T., Wang, T., & Qi, X. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.17657
Reasoning for Propaganda Detection via Label-Guided CoT OptimisationPreprint
Afroz, Z., Vardhan, H., & Akhtar, M. S. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.17271
“In addition, recent refinement meth-ods such as Self-Refine (Madaan et al., 2023), Re-flexion (Shinn et al., 2023), and Self-Consistency (Wei et al., 2022) demonstrate the benefits of iterative refinement but rely primarily on self-feedback, memory, or ensembling.”
Almiani, K., Zufferey, C., Kanhere, S. S., & Siyam, N. (2026) · Research Square · doi:10.21203/rs.3.rs-11144191/v1
Chen, J., Chen, W., & Vong, C. M. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.15738
“Reflection and stored experience help agents when feedback is informative (Shinn et al., 2023; Madaan et al., 2023; Zhao et al., 2024; Alazraki et al., 2025; Huang et al., 2024; Kamoi et al., 2024), while irrelevant context distracts (Shi et al., 2023).”
ASIWorld: Benchmarking Autonomous Agents in a Persistent Survival SandboxPreprint
Lin, J., Wang, R., Hong, H., Xie, Y., Zeng, Z., & Liu, Z. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.14807
“ASIWorld supports the study of sustained goal execution through persistent world and character state, character-scoped observations, and a programmable asynchronous interface.”
Learning from fracture: Teaching language models to design through physical experiencePreprint
Ni, B. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.17804
Jishnu, K. S., Arya, A., Kulshrestha, S., & Shijukumar, P. S. (2026) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-2600-4800-9.ch012
The Anatomy of a Blind Spot: What an LLM Judge Must Be Shown, and How MuchPreprint
Kumar, N., Pothuneedi, P., & Bandak, G. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.15938
“We also study the case in which a system acts on the judge’s reports, as self-refinement loops, reflective agents and prompt optimisers do, so that the judge is steering the system [15, 16, 17, 18].”
Zeng, J. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-40829-7_4
Shinohara, T. (2026) · Street Art & Urban Creativity · doi:10.66838/sauc.6368
EnactOpt: Diagnosis-Guided Harness Evolution for Embodied AgentsPreprint
Feng, Z., Pan, Z., Kang, Z., Chen, Z., Yang, S., Ye, S., Wang, H., & Li, H. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.14977 · Cited by 1
“Prior work on reflection and experience-guided learning shows that such experience can be retained as reusable guidance (Shinn et al., 2023; Zhao et al., 2024).”
Reels-RSI: Program-Level Self-Improvement for Code-Rendered Explainer VideosPreprint
Lin, W. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.14495 · Cited by 1
“Reflexion [11], ExpeL [21] and ACE [20] store verbal reflections, insights or an evolving playbook; our L1 and L3 belong to this family, with ACE’s incrementally curated playbook closest to evolve .”
Inverse Garment Design with Visual AgentsPreprint
Jiang, N., Chen, Y., Tao, Z., Li, Z., Guo, Q., Wu, J., Yang, Y., & Jiang, C. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.15582
ECMR: Evidence-Aware Deliberation Control for Multi-Agent LLM ReasoningPreprint
Liu, Y., Peng, H., Hu, F., Huang, L., & Cai, W. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.17869
“Chain-of-thought, Self-Refine, and Reflexion expose or revise one trajectory [Wei et al., 2022, Madaan et al., 2023, Shinn et al., 2023]; ReAct, Toolformer, Tree of Thoughts, and Program of Thoughts add actions, search, or numerical execution [Yao et al., 2023b, Schick et al., 2023, Yao et al.,…”
Harmony Harness: Multi-Objective Self-Evolution of Agent HarnessesPreprint
Yu, W., Miculicich, L., Mishra, B. D., Chen, J., Li, S., Fredrikson, M., Pfister, T., & Le, L. T. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.15150 · Cited by 2
PhySGA: A Physics-Space Grounded Agentic Framework for Generalizable and Interactive 3D CompositionPreprint
Lyu, W., Xia, C., Dong, M., Xu, L., Zhang, S., & Duan, Y. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.20560
“Concurrently, experiential language agents demonstrate that models can improve over time by accumulating trial-and-error feedback [2, 18, 32, 49] or self-evolving skills across episodes [35, 43, 50].”
Seeing, Maintaining, and Learning: The Evolution of Multimodal Agent MemoryPreprint
Guo, M., Jiao, Q., Liu, X., Pang, J., Yang, R., Xu, N., Che, L., Xue, H., Wang, Z., Cai, X., et al. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.19366 · Cited by 2
BizAgentBench: Unveiling Hidden Challenges in Deploying Long-Horizon Agents for Real-World BusinessPreprint
Zhao, E., Tong, Y., Yu, X., Wang, H., Wang, P., Wang, Y., He, D., Li, J., Yang, J.-M., & Wu, W. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.20424
“Reflection, skill reuse, and search support multistep reasoning and planning [Shinn et al., 2023, Wang et al., 2023, Yao et al., 2023a, Zhou et al., 2024a], while clarification research examines when additional information is useful [Gulati et al., 2026].”
Sun, Y. (2026) · International Conference on Computer Science, Machine Learning and Agents (CSMLA) · doi:10.1109/csmla70906.2026.11724504
“Beyond one-shot prompting, Self-Refine and Reflexion iteratively revise outputs using self-or verbal feedback without parameter updates [9], [10].”
Function-Space Temporal Self-Distillation for Policy OptimizationPreprint
Das, A., Bhattacharya, A., & Verma, V. K. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.19687
“Richer supervision has also emerged through critiques (Scheurer et al., 2023; Luo et al., 2025; Song et al., 2026), self-reflection (Shinn et al., 2023; Madaan et al., 2023; Lee et al., 2024), hindsight (Andrychowicz et al., 2017; Liu et al., 2023; Zhang et al., 2023), context distillation (Snell…”
APEX: Agentic Pentesting Execution
Barcelos, T. R., Quincozes, C. B., Bellagamba, G. P., de Souza, P. S. S., & Quincozes, S. E. (2026) · Simpósio Brasileiro de Cibersegurança (SBSeg) · doi:10.5753/sbseg_estendido.2026.29810
“ReAct, Reflexion, Toolformer, and AutoGen show how reasoning, memory, tool use, and multi-agent coordination can support complex tasks [Yao et al. 2023, Shinn et al. 2023, Schick et al. 2023, Wu et al. 2023].”
Contextual Credit Policy OptimizationPreprint
Han, H., Zeng, Z., Zhu, Z., Bei, S., Wang, H., Xu, H., Han, Y., Zhi, D., & Fan, Z. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.19103
“Agentic RL can also learn from successes and failures through verbal reflection and trajectory preference learning (Shinn et al., 2023; Yao et al., 2024; Song et al., 2024; Putta et al., 2024).”
Nguyen, H. H. (2026) · Information · doi:10.3390/info17101026
MMLA-RSI: Recursive Self-Improvement through RTT and RTMAPreprint
Zou, J., & Donz, A. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.20294
“Self-Refine and Reflexion use feedback to revise outputs or maintain textual reflections [12, 15].”
Cortex: Consolidating Context into Parametric MemoryPreprint
Zhang, J., He, F., Liang, X., Xu, Z., Xu, H., Huang, H., Wu, S., & Zhang, N. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.20399
In-Context Teacher–Student Guidance for Open-Weight Browser Agents
Cardoso, W. S., & Marcacini, R. M. (2026) · Anais do Symposium on Knowledge Discovery, Mining and Learning (KDMiLe) · doi:10.5753/kdmile.2026.32021
“Other methods use feedback or experience as natural language guidance, including Reflexion [Shinn et al. 2023], Self Refine [Madaan et al. 2023], ExpeL [Zhao et al. 2023], and AdaPlanner [Sun et al. 2023].”
GynoNurse: An LLM-Driven Clinical Consultation System for Gynecological Nursing
Li, Z., Deng, X., Deng, C., Feng, C., Liu, W., Chen, J., Fan, J., Yang, Y., Wang, X., & Wang, B. (2026) · Lecture notes in computer science · doi:10.1007/978-981-92-6916-7_1
Evaluating Self-Reflective LLM Agents for Autonomous Kubernetes Troubleshooting
Süerkan, M. M., Kugu, E., & Emekci, H. (2026) · IEEE Access · doi:10.1109/access.2026.3743626
МУЛЬТИАГЕНТНИЙ ПІДХІД ДО ОНТОЛОГІЧНО-КЕРОВАНОГО ГЕНЕРУВАННЯ НАУКОВИХ ТЕКСТІВ: ТЕОРЕТИЧНІ ЗАСАДИ
Pasichnyk, V. V., YAROMYCH, M., & АСАУЛЮК, А. (2026) · Humanities science current issues · doi:10.24919/2308-4863/103-24
Gou, C. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.21165
“…Gutierrez et al., 2024, 2025), hierarchical and multi-granularity memory across time scales (Kang et al., 2025a; Sun and Zeng, 2025; Xu et al., 2025a), structured semantic compression of memory units (Liu et al., 2026a), and stores of reflections and skills (Shinn et al., 2023; Wang et al., 2023a).”
Diviner: Agentic RCA with Human-Governed Adaptation for Large-Scale InfrastructurePreprint
Ghosh, P., Mitra, G., Nadgowda, S., Shah, A., Liu, J., Isci, C., Bandla, S., Hu, X., Deshpande, O., & Dasgupta, A. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.21281
“MT-Bench and Agent-as-a-Judge study model evaluation, while Reflexion uses feedback [27, 36, 37].”
Sun, Y., Ren, X., Yi, C., Zhang, K., Wu, D., Cao, Y., Zhou, A., Ye, J., Liu, S., Guo, J., et al. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.21082
“Refinement methods that supply external feedback can improve outputs (Madaan et al., 2023; Shinn et al., 2023), while reconsideration here receives no feedback, and self-correction without external feedback can reduce accuracy (Huang et al., 2023).”
Disagreement-Guided Weak-to-Strong RoutingPreprint
Noorani, S., Kiyani, S., Pappas, G. J., & Hassani, H. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.22245
“Consequently, correctness-supervised routers and automated LLM judges remain notoriously unreliable in agentic domains [42, 54].”
Learning from Unverified Peers via Shared Residual DistillationPreprint
Chen, F., Ma, R., Wang, Z., Lou, J., Wang, Z., Zheng, S., & Li, J. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.22080
“Feedback can also be expressed in language: Self-Refine iterates self-feedback (Madaan et al., 2023), Reflexion uses verbal feedback across attempts (Shinn et al., 2023), and tool-interactive critiquing incorporates external checks (Gou et al., 2024).”
Lin, Y., Jiang, Y.-S., Ji, D.-Y., Wang, R., & Lee, J. (2026) · Electronics · doi:10.3390/electronics15204767
Enriching Cultural Heritage Knowledge Graphs from Historical Travel Narratives
Colombino, M., Miceli, M., Zaharia, L. I., Coppola, F., Musumeci, E., Pizzigoni, F. D., & Ciravegna, F. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-41614-8_18
Yang, T., Zhang, X., & Ying, W. (2026) · IFIP advances in information and communication technology · doi:10.1007/978-3-032-41230-0_10
TEM: Temporal State Tracking Memory for Large Language Model AgentsPreprint
Song, P., Zhuang, Y., & Shi, L. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.21900
Log-To-Leak: Prompt Injection Attacks on Tool-Using LLM Agents via the Model Context Protocol
Hu, Y., Fan, C., Samyoun, S., & Du, J. (2026) · doi:10.1145/3847320.3847399 · Cited by 10
MemScope: Evolving Agent Memory Architectures through Localized Code RepairPreprint
Su, M., Guo, Y., Li, Z., Bai, L., Hou, Z., Jin, X., & Guo, J. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.21170 · Cited by 1
“Many memory-related approaches accumulate or refine non-parametric experience and natural-language memory skills (Shinn et al., 2023; Liu et al., 2025; Fang et al., 2026; Zhang et al., 2026c; Ouyang et al., 2026b; Zhang et al., 2026d; 2025a; Lin et al., 2026a; Ouyang et al., 2026a; Yang et al.,…”
From Understanding to Action: A Survey on Closed-Loop Multimodal AgentsPreprint
Wei, Y., Gao, Y., Wang, J., & Jia, H. (2026) · Research Square · doi:10.21203/rs.3.rs-11179875/v1
Toward Autonomous Industrial Systems: Agentic Alarm-Based Retrieval-Augmented Operator Advisory
Najafi, A., & Chen, T. (2026) · IEEE International Conference on Emerging Technologies and Factory Automation (ETFA) · doi:10.1109/etfa68377.2026.11725031
“Agen-tic extensions of RAG incorporate autonomous planning and self-reflective retrieval [18], [19].”
Improving Environment-Agnostic Agents: The Role of ScaffoldingPreprint
Rodionov, S. A. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.22289
“Reflexion generates verbal reflections from task feedback and retains them in memory for subsequent trials, also without updating model weights [24].”
Grounding Generative Verification in 3D ContentPreprint
Li, S., Lin, J., & Ye, S. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.22360
“A system can also reflect on its output and use feedback to guide a subsequent attempt (Madaan et al., 2023; Shinn et al., 2023).”
Verifiable and Reproducible LLM-Based Extraction of AAS Constraints from IDTA Submodel Template PDFs
Jannatabadi, M. H. K., Heppner, S., Miny, T., & Kleinert, T. (2026) · IEEE International Conference on Emerging Technologies and Factory Automation (ETFA) · doi:10.1109/etfa68377.2026.11725266
“Iterative self-refinement loops, represented by Reflexion [28] and CRITIC [29], feed verifier critiques back to the LLM and request a rewrite.”
Process, Not Trace: A Theoretical Framework for Agentic AI and Process-Preserving Human–AI Cognition
Richardson, M. J., Monfort, M. P. D., Alhasan, A., Crone, C., Tyagi, S., Varlet, M., Dras, M., & Kallen, R. W. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-41794-7_23
The Third Case: Prompt-Governed Agency under a Consciousness Hypothesis
Bankuti, O. (2026) · PhilPapers (PhilPapers Foundation) · doi:10.5281/zenodo.23428897
iBRAHIMOĞLU, N., & Demirezen, M. U. (2026) · Automated Software Engineering · doi:10.1007/s10515-026-00695-w
PRAXIS-MD: a long-term brain-enhanced agent framework for end-to-end molecular dynamics research
Ma, Z., Yang, C., Zhu, J., Song, Y., Yang, L., Xu, L., Xiao, M., & Jiang, X. (2026) · Journal of Molecular Graphics and Modelling · doi:10.1016/j.jmgm.2026.109623
ARIA: Runtime Inspection and Amendment for Multi-Agent SystemsPreprint
Shen, B., & Dong, Y. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.20780
“The use of large language models (LLMs) has expanded from text generation and dialogue (Brown et al., 2020; Touvron et al., 2023) to agents that plan, invoke tools, and adapt to feedback (Yao et al., 2023; Schick et al., 2023; Shinn et al., 2023).”
Correcting AI-generated false criminal allegations: a human-rights framework for remedial closurePreprint
Hanane, M., Gong, X., & Liu, Y. (2026) · Research Square · doi:10.21203/rs.3.rs-11036486/v1
Інформаційна безпека та комп’ютерні технології. 2026
(2026) · Central Ukrainian National Technical University Repozitory
MC-SQL: A Multi-Agent Collaborative and Multi-Reasoning-Chain Framework for Text-to-SQL
He, P., Liu, M., & Liu, M. (2026) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn69854.2026.11728670
“Compared with traditional agents that rely on rules or reinforcement learning, LLM agents demonstrate superior adaptability to environments, reasoning capabilities, and cross-task generalization [11].”
Ren, Y., & Zhou, Y. (2026) · Lecture notes in computer science · doi:10.1007/978-981-92-6913-6_29
A Hierarchical Multi-Agent Framework for Automated Radar Signal Analysis
Wang, Z., Yan, J., Gong, M., Li, P., & Li, H. (2026) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn69854.2026.11728748
“Furthermore, to mitigate error propagation, reflexive mechanisms such as Reflexion [15] introduce verbal reinforcement learning, allowing agents to self-correct based on feedback.”
Liu, S., Shi, L., Xu, J., Gao, Y., & Shi, Y. (2026) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn69854.2026.11729391
Shi, Y., & Song, R. (2026) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2026.1960601
Fault-Controlled Routing: Proactive Failure Avoidance for Cost-Effective and Robust LLM Reasoning
Fan, C., & Chen, S. (2026) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn69854.2026.11730022
“These range from multi-agent orchestration frameworks like AFlow [6] and AutoGen [7] that follow pre-defined collaboration graphs, to various validation-driven workflows [8], [9], and reflective techniques such as Self-Refine [10] and Reflexion [11].”
Wei, J., Yang, Y., & Xu, G. (2026) · Lecture notes in computer science · doi:10.1007/978-981-92-6910-5_10
CPGR-Mem: Cross-Platform Graph-based Routing Memory for Multimodal Intelligent Agents
Kong, J., & Zhao, Y. (2026) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn69854.2026.11730075
“However, executing robust long-horizon tasks across these platforms remains a formidable challenge [5].”
Repair, Retry, and the Cost of Hindsight: Verifier Feedback in Formal Theorem ProvingPreprint
Li, J., & Li, S. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.22698
“Verifier feedback supports incremental theorem proving [Thakur et al., 2024], whole-proof repair and refinement [First et al., 2023, Lin et al., 2025, Li et al., 2026, Requena et al., 2026, Wang et al., 2026], and reflection, memory, or self-debugging [Shinn et al., 2023, Chen et al., 2023].”
ReAct for Prescriptive Maintenance in Industry 4.0
Oliveira, L. Z. B., & Berton, L. (2026) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn69854.2026.11729633
Wang, Y., Han, Y., Gao, J., Zhang, W., Wang, J., & Zhang, W. (2026) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn69854.2026.11728474
MCIR-RAG: Multi-Agent Chain-of-Thought Iterative Reflection for Multi-modal Document Understanding
Liu, C., Wang, S., Li, Z., Hu, M., Fang, Q., Xiao, Y., Zhang, J., Luo, Z., Luo, W., Yi, Z., et al. (2026) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn69854.2026.11729376
Experiences developing structural biology tools with AI coding assistance
Sobolev, O. V., Liebschner, D. C., & Adams, P. D. (2026) · Acta Crystallographica Section D Structural Biology · doi:10.1107/s2059798326010211
Almeida, L. M., Cadete, A. B., & Queiroz, V. X. (2026) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn69854.2026.11729360
“Subsequent work on self-reflection [11], Tree of Thoughts [12], and intent-aware self-correction [13] has shown that LLMs can identify and correct their own biased reasoning when appropriately prompted.”
Beyond Reward Scoring: Online Multi-Agent Preference Learning for Multimodal Response GenerationPreprint
Zou, Z., Hong, J., Lu, Y., Tang, S., Wu, W., Gupta, A., Tian, J., & Razzak, I. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.23256
Multi-level Retrieval-Augmented Generation for Agent Workflow Synthesis
Fan, H., & Cao, J. (2026) · Lecture notes in computer science · doi:10.1007/978-981-92-6910-5_32
Chen, L., & Yu, C. (2026) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn69854.2026.11729806
“2) Reflexion [14]: An agentic workflow that iteratively refines the generated code through a “gener-ate–execute–reflect–regenerate” loop.”
Plan4PLC: Semantic Planning for Verifiable and High-Quality PLC Code Generation
Zhou, Y., Gu, Y., Wang, T., 程良伦, & Chen, C. (2026) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn69854.2026.11729622
“Large language models (LLMs) have enabled progress in automated code generation [5], [6], but direct application to PLC programming often results in brittle outputs that lack structured task comprehension and domain-specific reasoning [7]–[9].”
ConfigSwarm: A Multi-Agent Framework on Versioned Kernel Configuration Graphs
Han, Y., Yao, K., & Zhang, L. (2026) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn69854.2026.11729614
“Agentic approaches further interleave reasoning and acting, enabling models to invoke tools and execute multi-step procedures [14]– [16].”
ASE: Attribution-Guided Semantic Evolution for Time Series ForecastingPreprint
Zheng, Y., Li, Z., Liu, P., Xiao, H., & He, G. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.23027
“OPRO uses candidate/objective histories (Yang et al., 2024); Self-Refine and Reflexion use iterative verbal feedback (Madaan et al., 2023; Shinn et al., 2023).”
Task-Tree A-Star: A Hierarchical Framework for Long-Horizon Task Planning with Large Language Models
Li, Z., Zhang, Z., Lu, Y., & Li, G. (2026) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn69854.2026.11729884
GCAM-Gym: A Benchmark for Agent-Based Climate Policy SearchPreprint
Zhang, T., Tai, Z., Wang, X., Rish, I., & Bengio, Y. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.23569
“Chain-of-thought prompting studies intermediate reasoning, while Reflexion retains verbal feedback across trials (Wei et al., 2022; Shinn et al., 2023).”
EnterpriseSynth: Zero-Execution SFT and Evaluation Data from OpenAPI SpecsPreprint
Thimmaraju, R., Vidra, N., & Spurthi, S. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.22412
Li, J., Niu, J., Ding, Y., & Yi, P. (2026) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn69854.2026.11729385
“Restrictions apply. b) Mitigation: Greedy decoding, DoLa [24], Self-Reflection [26], Self-Refine [25], and Integrative Decoding [35].”
Agentic Physics-Grounded Video Generation via Memory-Augmented In-Context ReasoningPreprint
Guan, X., Yang, S., Bao, Y., Wang, C., Gu, Z., Chen, Z., Chen, K., Huo, J., & Gao, Y. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.23677 · Cited by 1
“…failures require different physical evidence, simulation configurations, and generation conditions that cannot be predefined for every case, while overly broad corrections may disrupt already-valid interactions and dynamics and introduce new inconsistencies (Shinn et al., 2023; Xu et al., 2026).”
Designing PDEL-DRK: An Ablation-Testable Architecture for Repeated Agentic Delegation
Kim, H., & 장윤환 (n.d.) · Journal of the Association for Information Systems
Zhang, H., Li, W., & Guo, J. (n.d.) · AIS Electronic Library (AISeL)
Liu, S., Min, B., Zheng, Z., & Wang, J. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.25978
“Large language models (LLMs) increasingly handle such reasoning through chain-of-thought style decoding [13, 29], yet single forward passes remain unreliable on hard sub-questions, and repeated regeneration is costly.”
InfluentialFrom Code to Playable Systems: CEGame-Bench for Long-Horizon Game Creation AgentsPreprint
Dong, Z., Wang, Y., Bian, H., Tao, J., Li, J., Wang, J., Che, X., Liu, L., Peng, B., Wang, X., et al. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.26098 · Cited by 1
Zhang, T., & Li, M. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.26662
Agentic Interpretation: Harness-Governed Evidence Construction for Software AgentsPreprint
He, Y., Wang, Y., Cui, S., Sengupta, A., & Ramanathan, M. K. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.23996
“Like deployed agent systems (Shinn et al., 2023; Yang et al., 2024b; Zhang et al., 2024), AgInt therefore enforces resource caps.”
Cortex: A Fixed-Point Theory of Governed Coding Agents - Technical ReportPreprint
Dinu, M.-C., & Zeba, F. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.24255
“ReAct interleaves reasoning and interaction (Yao et al., 2023); Self-Refine and Reflexion study feedback and revision (Madaan et al., 2023; Shinn et al., 2023).”
EvoSkill v2: Fully Agentic Skill Evolution from Benchmark Adaptation to a Stateful EvolverPreprint
Huang, D., Nama, B., & Alzubi, S. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.25931
“Our method builds on self-reflection, in which an agent reads its own failed attempt and tries again [11, 14].”
NIOCIS: Typed-Decision Next-Hop Routing with Node-Conditioned Option Spaces for Tool-Use AgentsPreprint
Han, J., Xin, M., Liang, F., & Yu, J. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.25985
“…control loops keep an LLM in the loop at every step (Yao et al., 2023), self-reflective retry feeds verbal feedback back into the next attempt (Shinn et al., 2023), and open-ended agents grow executable skill libraries as text (Wang et al., 2023); we instead bind the induced graph as the…”
Persistent Memory and Iterative Improvement in an LLM Agent for Chinese-Character DrawingPreprint
Wu, P., & You, Y.-Z. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.24090
“…a library of executable skills in an open-ended environment [Wang et al., 2024a], Reflexion stores verbal self-reflections that inform later trials [Shinn et al., 2023], ExpeL distills reusable insights from experience [Zhao et al., 2024], Agent Workflow Memory induces reusable workflows [Wang et…”
Huang, L., Chen, W., Yu, S., Deng, C., & Sun, B. (2026) · Applied Sciences · doi:10.3390/app162010394
NeuroAct: Advancing EEG Analysis and Decoding via Dual-Loop Autonomous ResearchPreprint
Xiong, W., Li, J., Zhao, H., Yang, L., Li, J., & Jiang, C. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.25211
LAMB: Latent Multi-Hypothesis Beliefs for Long-Horizon Large Language AgentsPreprint
Ding, P., Li, H., Liu, Y., & Su, J. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.26955
“Experience-reuse methods, including Reflexion (Shinn et al., 2023), ExpeL (Zhao et al., 2024), AWM (Wang et al., 2025), and ACE (Zhang et al., 2026c), distill cross-episode knowledge into insights, workflows, or playbooks.”
Metadata
- Authors
- Shinn, N., Cassano, F., Berman, E., Gopinath, A., Narasimhan, K., & Yao, S.
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2023
- Pages
- 8634-8652
- ISSN
- 1049-5258 (ISSN-L)
- arXiv
- 2303.11366
- OpenAlex
- W7133222210
- Cited by
- 1,087
- References
- 0
- Citations by year
- 2026: 760 · 2025: 167 · 2024: 105 · 2023: 55
- FWCI
- 192.15
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- neural information processing systems (publishedVersion)
- arXiv (Cornell University) (submittedVersion, cc-by)
- arXiv (Cornell University) (cc-by)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Keywords
- language agents, verbal behavior, language acquisition
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-01, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-01 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.