Reflexion: Language Agents with Verbal Reinforcement Learning
Open accessThe DOI matches its DataCite record; 42 of the 42 references it cites were found in a registry or an index; 7 of the 8 sources its claims cite were checked for support.
Abstract
Large language models (LLMs) have been increasingly used to interact with external environments (e.g., games, compilers, APIs) as goal-driven agents. However, it remains challenging for these language agents to quickly and efficiently learn from trial-and-error as traditional reinforcement learning methods require extensive training samples and expensive model fine-tuning. We propose Reflexion, a novel framework to reinforce language agents not by updating weights, but instead through linguistic feedback. Concretely, Reflexion agents verbally reflect on task feedback signals, then maintain their own reflective text in an episodic memory buffer to induce better decision-making in subsequent trials. Reflexion is flexible enough to incorporate various types (scalar values or free-form language) and sources (external or internally simulated) of feedback signals, and obtains significant improvements over a baseline agent across diverse tasks (sequential decision-making, coding, language reasoning). For example, Reflexion achieves a 91% pass@1 accuracy on the HumanEval coding benchmark, surpassing the previous state-of-the-art GPT-4 that achieves 80%. We also conduct ablation and analysis studies using different feedback signals, feedback incorporation methods, and agent types, and provide insights into how they affect performance.
Overview
CoChat Summary
TL;DR
Reflexion reinforces language agents through verbal self-reflection stored in episodic memory rather than weight updates, improving performance across decision-making, reasoning, and coding tasks. It reports gains including 91% pass@1 on HumanEval, a 22% absolute improvement on AlfWorld, and 20% on HotPotQA.
Key findings
- On HumanEval Python, Reflexion achieves 91.0 pass@1, surpassing the previous state-of-the-art GPT-4 at 80.1; on HumanEval Rust it reaches 68.0 vs. 60.0, MBPP Rust 75.4 vs. 70.9, and Leetcode Hard 15.0 vs. 7.5.
- In AlfWorld, ReAct + Reflexion completes 130 out of 134 tasks using a simple heuristic and improves over strong baselines by an absolute 22% over 12 iterative learning steps; ReAct-only converges at a 22% hallucination rate with no long-term recovery.
- In HotPotQA, Reflexion improves over baselines by 20%; self-reflection gives an 8% absolute boost over episodic memory alone, and although CoT (GT) fails on 39% of questions, Reflexion improves accuracy by 14% without access to ground-truth answers.
- Ablations on the 50 hardest HumanEval Rust problems show full Reflexion at 0.68 vs. baseline 0.60; omitting test generation drops to 0.52, and omitting self-reflection stays at 0.60.
Methods
- Reflexion uses a modular loop with an Actor that generates text/actions, an Evaluator that scores outputs, and a Self-Reflection model that converts feedback into verbal summaries stored in memory; trials repeat until the Evaluator passes or a max trial count is reached, with memory usually bounded to 1–3 experiences.
- Experiments cover AlfWorld (134 environments, six tasks, ReAct + GPT-3), HotPotQA (100 questions, CoT/ReAct, exact-match grading, memory size 3), and programming (HumanEval, MBPP, LeetcodeHardGym; Python/Rust via MultiPL-E; self-generated unit tests up to 6).
- Ablations and analyses vary feedback signals, feedback incorporation methods, and agent types; compromised approaches are tested on HumanEval Rust, and a WebShop experiment is run across 100 environments.
Limitations
- The paper states Reflexion may fall into non-optimal local minima, limits long-term memory to a sliding window with maximum capacity, and notes code-generation test-driven development is limited by non-deterministic, impure, hardware-dependent, or concurrent functions; it also relies on LLM self-evaluation/heuristics and lacks a formal success guarantee.
- The paper reports WebShop failure: after only four trials the agent shows no improvement and does not generate helpful self-reflections, concluding Reflexion cannot solve tasks requiring significant diversity and exploration.
- Evident from the text: self-correction is an emergent quality of stronger, larger models—starchat-beta shows no improvement (baseline 0.26 vs. Reflexion 0.26)—and flaky or incorrect test suites can cause false positives/negatives, with false negatives preferred.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
4 Valid · 2 Not valid · 0 Not checked · 59 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Therefore, in the case in which the model generates a flaky test suite, it is possible that all tests pass on an incorrect solution and lead to a false positive label on a code completion [11].”
§ Reflexion: Language Agents with Verbal Reinforcement Learning > Analysis
What the sources say
- Partly supportedcites [11] 11. Lam, W., Winter, S., Wei, A., Xie, T., Marinov, D., and Bell, J. (2020). A large-scale longitudinal study of flaky tests. Proc. ACM Program. Lang., 4(OOPSLA). sourceExperimental — accuracy not yet measured
The Introduction (page not provided) says a flaky test can pass and fail on the same code and that changes may be merged when all tests pass. It does not address model-generated test suites, incorrect code completions, or false-positive labels, so those parts of the claim are not established by this paper. (LLM, conf=0.82)
hedgedstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“3 shows an inferior 52% vs 60% (baseline) accuracy, which suggests that the agent is unable to determine if the current implementation is correct without unit tests.”
§ Reflexion: Language Agents with Verbal Reinforcement Learning > Ablation study
hedgedstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“ReAct + Reflexion significantly outperforms ReAct by completing 130 out of 134 tasks using the simple heuristic to detect hallucinations and inefficient planning.”
§ Reflexion: Language Agents with Verbal Reinforcement Learning > Results
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“4 shows that self-reflection improves learning by an 8% absolute boost over the episodic memory learning advantage.”
§ Reflexion: Language Agents with Verbal Reinforcement Learning > Analysis
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“on reasoning questions in HotPotQA [28] by 20%”
- Also stated in: § 4 Experiments · plain
“Most notably, Reflexion improves performance over strong baselines by 22% in AlfWorld, 20% in HotPotQA, and 11% on HumanEval.”
§ Reflexion: Language Agents with Verbal Reinforcement Learning > 1 Introduction
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § 4 Experiments · plain
30 more claims
Create a free account to see all 65 claims and every source verdict.
- It may state two separate claims as one. 18
- Probably not a substantial claim. 11
- The quote only partly states this claim. 3
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source doesn’t support the claim as written.
In the citing paper
“Memory and reflection systems such as MemAgent (Yu et al., 2025a), Reflexion (Shinn et al., 2023), and Generative Agents (Park et al., 2023) improve retrieval and episodic memory, but do not perform context shaping, state restructuring, or nextinstruction refinement.”
From PAACE: A Plan-Aware Automated Agent Context Engineering Framework (2025) · cites this paper as Shinn et al., 2023
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe cited source doesn’t support the claim as written.
In the citing paper
“However, Reflexion computes verbal reward over a full trajectory, yielding a single end-of-episode signal that conflates credit across reasoning steps: a failure due to a single intermediate error receives the same critique pressure as one due to a flawed strategy.”
From Process Supervision via Verbal Critique Improves Reasoning in Large Language Models (2026) · cites this paper as Shinn et al. [2023]
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe cited source doesn’t support the claim as written.
In the citing paper
“Unlike Reflexion, which only reflects on unsuccessful trajectories, our approach separately reflects on both successful and unsuccessful ones.”
From An Efficient Context-Dependent Memory Framework for LLM-Centric Agents (2025) · cites this paper as Shinn et al., 2023
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe cited source doesn’t support the claim as written.
In the citing paper
“The dominant approach is to curate memory at write time.”
From Just-in-Time Memory: Learning to Curate Task-Adaptive Memory for LLM Agents (2026) · cites this paper as Shinn et al., 2023
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Interaction and code generation are increasingly used together, with code as the modality of choice for actions [48, 59], tool construction [13, 51, 69], and reasoning [39, 66, 67].”
From SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineering (2024) · cites this paper as [39]
Experimental — accuracy not yet measured
107 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Reflexion: Language Agents with Verbal Reinforcement Learning > 3 Reflexion: reinforcement via verbal reflection
“while M e not pass or t < max trials do”
§ Reflexion: Language Agents with Verbal Reinforcement Learning > Self-reflection
“The Actor, Evaluator, and Self-Reflection models work together through trials in a loop until the Evaluator deems τ t to be correct.”
Citations
Cites
The publisher hasn’t deposited this paper’s reference list.
Cited by
Items 3,101–3,200 of 3,537
State Trace Rationale As Auxiliary Task in Reinforcement LearningPreprint
Nasir, M. U., Vogt, A., James, S., & Togelius, J. (2026) · arXiv.org · doi:10.48550/arxiv.2609.36867
Ghosh, B. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2609.36739
“Agents that accumulate verbal lessons or skills across episodes [30, 34] are the closest analogue to our Playbook.”
RobotEQ 3.0: Towards Personalized Social Proactive Intelligence in Embodied AgentsPreprint
Zhang, S., Che, X., Fang, K., Wang, X., Liu, L., Wu, J., Cao, J., Wang, Z., Huang, Y., Wu, C., et al. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2609.36618
“Verbal reflection methods store failure analyses for later reuse without changing weights (Shinn et al., 2023; Madaan et al., 2023).”
Absorbed in Inertia: Activation Analysis for Computer-Use AgentsPreprint
Segalini, G., Soi, Z. W., Decouchant, J., & Chen, L. Y. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2609.37176
“Reflexion (Shinn et al., 2023) and Self-Refine (Madaan et al., 2023) organize explicit feedback and revision, whereas we measure acknowledgment and executed actions within the agent’s existing reasoning–action sequence.”
Reward-rate Policy Gradient for Efficient Machine Learning Engineering AgentsPreprint
Tian, M., & Yang, S. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2609.36393
“…attempts is a well-established pattern, such as critiquing its outputs directly (Madaan et al., 2023), reflecting on feedback from the environment (Shinn et al., 2023), training on the attempts that happened to succeed (Zelikman et al., 2022), and rewriting the scaffolding (Zelikman et al., 2023).”
How Can Recommendation Feedback Evolve Agent Memory?Preprint
Mao, S., Li, M., Zhang, H., Li, Z., Wang, Y., Yu, P., & Zhu, J. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2609.37544
“Existing methods transform task trajectories into reflections, reusable experience, workflows, or reasoning memories [Shinn et al., 2023, Zhao et al., 2024, Wang et al., 2024, Ouyang et al., 2026], while recent systems further support dynamic memory consolidation, organization, and revision…”
Wang, Y., Qi, X., Xue, G., Wang, C., Xie, Y., Tang, X., & Sun, C. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2609.35900
“Building on tool use, retrieval, and self-reflection, language-model agents now plan and execute multi-step tasks (Yao et al., 2023; Shinn et al., 2023; Wu et al., 2023), including in scientific domains, where LLM-driven systems have been used to design and run chemical experiments and to operate…”
Memory Is a Derivation: The Distributed-Evidence Paradox in Long-Term AgentsPreprint
Liu, H., & Zhao, C. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2609.36130
Where the Evidence Lives: Auditing AI Companions' Self-DescriptionsPreprint
Ikeda, S., & Ishikawa, S.-N. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2609.38753
From Verification Failures to Reusable Guidance for Coding AgentsPreprint
Zhai, Y., Chen, X., Zhang, L., Vishwanath, S., & Roşu, G. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2609.39022
“Reflexion retains textual reflections on feedback for subsequent attempts (Shinn et al., 2023).”
Thinking Outside the Box: Can Language Models Rely on External Guidance Selectively?Preprint
Wang, M.-H., Wang, B.-Y., Zuo, J.-H., Tao, Y.-X., & Kong, F.-Y. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2609.39578
“LLM agents have progressed from in-context prompting to agent harnesses that structure planning, search, feedback, and tool use (Yao et al., 2023b; Shinn et al., 2023; Yao et al., 2023a; Zhou et al., 2024; Liu et al., 2025).”
SEPAL: Separated Expert Pairs with Answer-Level Fusion for Reliable LLM CollaborationPreprint
Ren, W., Zhang, Y., Li, H., Qi, Z., Zhang, H., & Wang, N. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2609.39645
“STaR bootstraps reasoning traces from successful solutions (Zelikman et al., 2022); Self-Refine and Reflexion use generated feedback or verbal memory to improve later behavior (Madaan et al., 2023; Shinn et al., 2023).”
Does This Action Still Explain the Task? Reverse Scoring for Diffusion Language Model AgentsPreprint
Qiu, J., Mower, C. E., Peters, J., Ammar, H. B., & Zimmer, M. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2609.38536
“Reasoning-and-acting agent frameworks (Yao et al., 2023; Shinn et al., 2023; Mower et al., 2026) couple chain-of-thought traces with environment actions and are standardly evaluated (Liu et al., 2024; Ma et al., 2024) on ALFWorld (Shridhar et al., 2020), ScienceWorld (Wang et al., 2022), BabyAI…”
K2P: Label-Free Knowledge to Prompt DistillationPreprint
Zhang, Y., Lu, H., Zhong, W., & Ma, P. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2609.38898
Loop Engineering in AI: Designing Iterative Feedback Architectures for Autonomous Agent Systems
Warhade, D. A. A. S. N. (2026) · International journal of economic perspectives
Mingbird: A Local-First Agent Harness Enabling Small Open Models to Complete Real TasksPreprint
Wang, H., & Huang, T. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.02001 · Cited by 1
“Around this core, a body of work improves the model’s behavior inside the loop: Reflexion [19] stores verbal self-critiques across attempts, and Self-Refine [20] iterates on its own outputs.”
GUI-HARVEST: Self-Improving GUI Agents through Evidence-Driven Harness EvolutionPreprint
Yang, G., Qu, Z., Li, X., Wang, Z., Zhang, M., Zeng, S., & Dai, Z. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.00948 · Cited by 1
“Reflexion stores linguistic feedback in episodic memory, while STOP improves an executable scaffolding program (Shinn et al., 2023; Ze-likman et al., 2024).”
From Proposal to Verified Effect: Praxa, an Evidence-Bound Harness for Governed AI Agent ExecutionPreprint
Creadore, S. G. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.00015
“Reflexion stores linguistic feedback to alter later attempts without updating model weights [Shinn et al., 2023].”
이준재, Kim, J., & Kim, J. (2026) · IEEE Access · doi:10.1109/access.2026.3739263
Understanding and Mitigating Library-Related Issues in LLM-Generated CodePreprint
Majdoub, Y., Hamid, R., Charrada, E. B., Abdellatif, A., & Touati, H. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.00622
“Automating these validation and refinement steps eliminates tedious trial-and-error debugging loops, saving developers substantial time and engineering bandwidth that would otherwise be spent manually resolving subtle, cascading dependency failures [29], [30].”
Saleem, Z., Haq, M. N. U., Ullah, S., & Raza, A. (2026) · Journal of Engineering and Computational Intelligence Review · doi:10.63544/xgvmne24
Jayacharan Kolla Anna University (2026) · International Journal of Computing and Artificial Intelligence · doi:10.33545/27076571.2026.v7.i10a.387
Legality, Not Routing: Why Scaffolding Does Not Fix Language-Model Path PlanningPreprint
Wittayavanichai, K., & Sukpancharoen, S. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.7556542
Rodiah, A., & Dhenabayu, R. (2026) · Journal of Applied Digital Business Research · doi:10.26740/digiventure.v1i3.54630
Shu, Y., Chen, D., Deng, C., Liu, D., Chen, X., & Su, J. (2026) · Journal of educational theory and practice. · doi:10.62177/jetp.v3i4.1744
“Reflective generation can assist the model in revising drafts based on feedback [6] .”
LLM-Based Code Generation: A Systematic Review of Techniques, Metrics, and Empirical Evaluation
Pedraza, J. B. M., & Mostajo, J. B. (2026) · Revista Científica "Fronteras Tecnológicas · doi:10.23670/ft.2026.1.31
Özaytürk, H., & Buzluca, F. (2026) · Schloss Dagstuhl – Leibniz-Zentrum für Informatik · doi:10.4230/lipics.esem.2026.18
When History Fails to Become Experience: Action Calibration in Language AgentsPreprint
Liu, J., Wang, Z., Jing, Y., Zhou, H., & Liu, Y. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.02769
MEA: A Reward-Driven Multi-Agent System for Faithful Model ExplanationsPreprint
Cheng, Y., Ravi, R., Sridhar, S., Saha, S., Ghosh, A., & Agarwal, C. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.02480
“Next, we investigate whether augmenting a base agent with a Critic [50], which receives the original strategy and explanation, critiques them, and regenerates improved outputs, can close the gap with M EA .”
Hindsight-Guided Rationale Distillation for Rare Disease DiagnosisPreprint
Singh, A., Pathak, A., & Singh, N. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.03176
“…has shown this effect in general reasoning settings (Guo et al., 2025; Shao et al., 2024); verbal reinforcement approaches such as Reflexion (Shinn et al., 2023) offer a complementary direction for iterative self-correction without full RL. Disease-vocabulary confound and the dataset…”
MemTrace: State-Consistent Memory for Long-Horizon Coding AgentsPreprint
Xu, H., Zhou, L., Jin, Z., Zhang, X., Tang, B., Li, Z., Zhou, X., & Zhang, J. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.04838 · Cited by 1
EnGRICH: Enhancing Generative Reward Modeling with Critiques from HumansPreprint
Li, X., Wang, B., Li, H., Wang, H., Zhou, Y., Pan, Q., Chen, B., Liu, Y., Zhang, M., & Ai, Q. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.05370
“ILF (Scheurer et al., 2024) trains on feedback-conditioned refinements, while Self-Refine (Madaan et al., 2023), Reflexion (Shinn et al., 2023), and RL4F (Aky ¨ urek et al., 2023) use critiques or reflections to revise model outputs.”
PreAct-Nav: Agentic Reasoning Before Action for Urban NavigationPreprint
Xie, J., Ruan, S., Wang, Y., Zhang, Y., Yang, J., Jin, S., & Shi, D. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.04916
“Reflexion stores verbal reflections (Shinn et al., 2023), REMem retrieves temporally grounded events (Shu et al., 2026), and M3-Agent builds multimodal episodic and semantic memories (Long et al., 2026).”
Living Business Ontologies for Accountable Automated WorkPreprint
Nix, K. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.7563158
Bridging the Evidence-to-Execution Gap:A Reflective Agent for Multi-Objective Peptide DesignPreprint
Zhang, H., & Yang, Y. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.06190
What to Preserve in Recursive Computation: A Local Predictive Sufficiency PrinciplePreprint
Wang, P., Shiyang, F., Gao, H., Zhao, C., Yuan, D., Hui, C., & Ding, G. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.04303
Viva La Vida: Verification and Accumulation Failures in Multi-Agent Proof SearchPreprint
Xu, B., Zheng, K., & Han, N. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.04829
“Reflexion, for instance, keeps verbal reflections in an episodic buffer that conditions later trials [Shinn et al., 2023].”
Building LLM Agent Systems the Deep Learning Way: From Modular Design to Architecture SearchPreprint
Feng, T., Han, P., Dai, Z., & You, J. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.04961
Serve Now or Improve Later? Scheduling Self-Evolution in Online Agent SystemsPreprint
Wei, Y., Qian, J., Huang, Z., Su, Z., Wang, Q., Lu, S., Zhang, R., Wu, C., & He, L. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.06212
“PagedAttention and SGLang improve execution efficiency [12, 29], while Reflexion and Self-Refine provide feedback-based improvement mechanisms [15, 17].”
Bi, X., Ma, X., Sun, Y., Huang, T., Liu, C., Huang, B., Yang, H., & Mo, B. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.03948
“The reasoning and commonsense capabilities of LLMs have extended their use to sequential decision systems, as demonstrated by reasoning-and-acting, self-reflection, and skill-acquisition agents such as ReAct, Reflexion, and Voyager (Yao et al., 2023; Shinn et al., 2023; Wang et al., 2024).”
VIGIL: Verifier-Informed Gated Improvement Loop for Spreadsheet Question AnsweringPreprint
Li, K., He, L., & Guntupalli, S. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.04287
“Reflexion stores linguistic feedback in memory [Shinn et al., 2023].”
Peng, H.-Y., Calvo, R., Kalu, K. G., & Davis, J. C. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.03969
PharmAgent: Constraint-Aware Search with Frozen Language Models for Molecular OptimizationPreprint
Shao, N., Chen, G., Shi, J., Bai, Z., He, H., Tang, Z., Lv, Q., Huang, Y., & Huang, Z.-A. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.05431
“Second, multi-round interaction creates experience, but useful guidance requires edits relevant to the current molecular structure (Shinn et al., 2023; Liu et al., 2025).”
Yu, Z., Li, M., Yu, L., Chow, K.-H., Qin, C., Wu, X., Xing, W., Xiong, S., & Han, M. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.05472
Communication Shapes Collective Inference in Self-Adapting LLM Societies: Evidence from MafiaPreprint
Huang, H., & Xiao, J. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.05041
“…game every agent sees the outcome, the full role reveal and the public record it missed, then rewrites its strategy notes, a verbal-reflection loop inherited across games [23] (400 words requested, not enforced; realized per-chain means 430–1,054), served back next game with roles re-randomized.”
Balancing Memory Pathways: Analyzing and Improving Memory Utilization in Hybrid LMsPreprint
Lee, H., Singh, J., Khan, Z., Chen, J. C.-Y., Stengel-Eskin, E., Sordoni, A., Cohan, A., & Bansal, M. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.06750
“When models are allowed to retry after failures, with their previous attempts stored in memory so that they can revise their answers or actions (Shinn et al., 2023; Zhao et al., 2024), models trained with the auxiliary loss recover more successfully, improving the cumulative recovery rate over…”
Xu, Z. (2025) · Illinois Digital Environment for Access to Learning and Scholarship (University of Illinois at Urbana-Champaign)
Tao, H. (2024) · Illinois Digital Environment for Access to Learning and Scholarship (University of Illinois at Urbana-Champaign)
Vogt, J. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.7574398
From Weights to Words: Representation in Neuroevolution and Explainable AI
Zhou, R. (2026) · QSpace (Queen's University Library)
Learning what to Remember: Reinforcement Learning for Cost-Aware Memory in LLM Agents
Cringasu, C., & Tapus, A. (2026) · IEEE RO-MAN · doi:10.1109/ro-man72286.2026.11714580
“Reflexion [12] augments agents with verbal self-reflection to learn from prior episodes, yet it retains all reflections without accounting for storage cost.”
VETTA: Coordinating Turn- and Token-Level Credit Assignment for Multi-Turn LLM AgentsPreprint
Chen, J., Yang, M., Piao, J., Lan, X., Xia, X., He, X., & Li, Y. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.08402
“5-Instruct without task-specific RL training, ReAct (Yao et al., 2022b), which interleaves reasoning and actions, and Reflexion (Shinn et al., 2023), which uses verbal feedback from previous attempts.”
Constitution-Guided WatermarkingPreprint
Aremu, T., Poppi, S., & Lukas, N. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.09552
Entropy-Based Visual Re-Perception Inference for Multimodal Models
Liufu, J., Yan, Q., Kan, Z., Yang, W., Hu, H., Chen, X., & Jiang, B. (2026) · doi:10.1109/cvprf71909.2026.00935
“In the textual domain, test-time scaling is typically realized through chain-of-thought (CoT) style decoding [24, 27], for example by sampling multiple reasoning paths and selecting the most consistent answer, or by introducing deeper search and verification during generation [16, 21, 30–32].”
Active Video Perception: Iterative Evidence Seeking for Agentic Long Video Understanding
Wang, Z., Zhou, H., Wang, S., Li, J., Xiong, C., Savarese, S., Bansal, M., Ryoo, M. S., & Niebles, J. C. (2026) · doi:10.1109/cvprf71909.2026.00872 · Cited by 3
“Agentic Frameworks for Long Video Understanding To decouple the complex LVU task, early agentic frameworks [12, 19, 20, 30, 40, 63, 64, 75, 76] adopt a captioner–LLM design: video segments are converted into captions, which an LLM then uses the generated caption to answer the video query.”
Cadreasoner: Iterative Program Editing for Cad Reverse Engineering
Kabisov, S., Kirichuk, V., Volkov, A., Barannikov, M., Savrasov, G., Konushin, A., Kuznetsov, A., & Zhemchuzhnikov, D. (2026) · doi:10.1109/cvprf71909.2026.00590 · Cited by 2
MINDSET: Energy-based Memory Evolution for Long Conversational AgentsPreprint
Dutta, S., Tummala, S., Vanga, S., Pavani, A., Subrahmanyam, B., & Choudhary, N. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.08586
“Memory-based agents have introduced reflection (Park et al., 2023; Shinn et al., 2023), virtual context management (Packer et al., 2024), forgetting (Zhong et al., 2023), graph-based organization (Gutiérrez et al., 2025), learned memory operations (Yu et al., 2026) and benchmark-specific…”
GDP: Graph-Based Dynamic Personalization for Multimodal Large Language Models
Ray, C., Deng, X., Huang, F., Wu, Z., Jiang, S., Jiao, P., Liu, Z., & Wang, H. (2026) · doi:10.1109/cvprf71909.2026.00882
“Memory-based frameworks such as MemoryBank [46] employ external memory modules to continuously record historical information from users [9, 17, 24, 33, 35, 49], allowing for the expansion of knowledge without retraining, and effectively improving response consistency and contextual adaptability in…”
Training Advisors for LLM Agents from Task OutcomesPreprint
Polezhaev, S., Liskavets, B., Press, O., & Golubev, A. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.09858
“During its execution, an agent can get stuck repeating unsuccessful actions or lose sight of the original goal (Shinn et al., 2023; Kim et al., 2025).”
Intelligent Photo Retouching with Language Model-Based Artist Agents
Chen, H., Tao, K., Wang, Y., Wang, X., Zhu, L., & Gu, J. (2026) · doi:10.1109/cvprf71909.2026.00124
SkillCycle: Co-Evolving Agent Policies and Skill BanksPreprint
Li, L., Shen, Q., Jiang, Z., Ma, Q., Liu, Y., & Deng, Z. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.09430
“Reflexion retains linguistic feedback across attempts (Shinn et al., 2023), and ExpeL extracts reusable insights from experience (Zhao et al., 2024).”
Zhao, H., Hao, X., Zhang, C., Yan, Y., & Hu, Z. (2026) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2026.3741796
“Reflection mechanisms such as ReAct [14] and Reflexion [15] enhance reasoning but require multiple expensive LLM calls.”
MemMux: Runtime Verification and Honest Resource Attribution for Fleets of Parallel Coding AgentsPreprint
Muku, S. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.07257
“Interleaving reasoning with tool use [13] and adding self-reflection [10] turned language models into agents that take long sequences of actions.”
CATune: Structural Constraint-Aware Bayesian Optimization for DBMS Configuration TuningPreprint
Lan, F., Zhang, Q., & Dragut, E. C. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.09276
Environmental Understanding Vision-Language Model for Embodied Agent
Bang, J., Bae, J., Lee, D., Jung, S., & Kim, T. (2026) · doi:10.1109/cvprf71909.2026.00301 · Cited by 1
“To overcome these failures, existing recovery methods rely on the environment to automatically validate outcomes [34] and predefined failure types [10], or they depend on textual feedback [30], which lacks the visual grounding essential for embodied agents.”
InfluentialRecursive Think-Answer Process for LLMs and VLMs
Lee, B.-K., Chee, Y., & Ro, Y. M. (2026) · 2026 IEEE/CVF Conference on Computer Vision and Pattern Recognition- FINDINGS Track (CVPRF) · doi:10.1109/cvprf71909.2026.00920 · Cited by 5
“This objective encourages the model to engage in further recursive reasoning when it internally detects low confidence, while allowing it to stop once its confidence reaches a satisfactory level.”
AMBER: Training Long-Horizon Web Agents through Append-Only MemoryPreprint
Savadikar, C., Zhang, Z., Zhao, M., Xie, S., Li, H., Wu, T., & Wang, L. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.07118
“Reflexion stores verbal feedback from failed attempts (Shinn et al., 2023); ExpeL extracts reusable natural-language insights (Zhao et al., 2024); Voyager accumulates executable skills (Wang et al., 2023); and MemGPT manages multiple memory tiers beyond the model context (Packer et al., 2023).”
AgentEvolver: System-Wide Self-Evolution Through Task ExecutionPreprint
Zhang, W., Yang, F., Zhao, Y., Wang, X., & An, B. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.11613
“Reflexion (Shinn et al., 2023) uses retained verbal feedback to influence later attempts, while Voyager (Wang et al., 2023) develops an executable skill library through exploration and refinement in Minecraft.”
Chi, Y., Liu, M., Hong, Y., Li, H., & Liang, X. (2026) · ACM Conference on Computer Supported Cooperative Work (CSCW) · doi:10.1145/3785651.3831571
ActiveMedAgent: Cost-Aware Trajectory Learning for Multimodal Medical Diagnosis
Ma, W., Yu, X., Qiu, P., Yang, J. M., An, Z., Dong, X., Zhao, X., & Liu, X. (2026) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/2026.findings-emnlp.1434
A Conversational Agent for Natural Language Access to Public Health Data
Moraes, M., Figueiredo, I., Marques, V., Ruiz, D., & Manssour, I. H. (2026) · Proceedings - IEEE Symposium on Computer-Based Medical Systems · doi:10.1109/cbms69103.2026.00015
“This design follows evidence that graph-orchestrated, self-correcting Text-to-SQL pipelines improve robustness [11], [12].”
TestPrism: Rethinking Test Evaluation Beyond a Single ReferencePreprint
Li, H., Hu, L., Huang, J., Jiang, Z., Luo, J., Gao, W., Tan, Y., Wang, Z., & Liu, J. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.12289
“…uses AutoSaddler (Park et al., 2026) to search a large semantic space of test generation strategies, drawing on Meta-Harness (Lee et al., 2026) and prior work on reflective feedback and prompt optimization (Shinn et al., 2023; Khattab et al., 2023; Yuksekgonul et al., 2024; Agrawal et al., 2026).”
From Retrieval to Evidence: A Task-Adaptive Two-Layer Knowledge Architecture for LLM Agents
Volkov, A., Pustovoy, T., Istomin, D., & Otbetkina, T. (2026) · Machine Learning and Knowledge Extraction · doi:10.3390/make8100322
Yan, D., Li, G., Yang, J., Chen, Y., Zhang, D., & Li, X. (2026) · International Conference on High Performance Compilation, Computing and Communications (HP3C) · doi:10.1145/3833907.3833931
A Survey of Code-to-Code Translation: From Statistical Rule-Based Systems to LLM Agents
Zhang, Z., Wen, S., Yan, Z., Zhu, B., Shen, C., & Guo, H. (2026) · Algorithms · doi:10.3390/a19100857
RELACE: retrospective likelihood-based action credit estimation for long-horizon language agentsPreprint
Chakrabarti, S., & Indurthi, S. R. (2026) · arXiv (Cornell University)
Singh, K., & Ramakrishnan, S. (2026) · International Journal of Computer Information Systems and Industrial Management Applications · doi:10.70917/ijcisim-2026-5936
Sadjadi, S. M., Bai, Q., Yang, W., & Liu, Q. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.7593345
A dual-head self-reflective framework for text-to-CAD generation
Qiao, Y., & Yu, D. (2026) · Expert Systems with Applications · doi:10.1016/j.eswa.2026.134693
DRIVE: Coordinating Reasoning and Interaction Skills for Web AgentsPreprint
Liu, X., Zhou, S. K., Hou, Y., Zhou, R., Chen, H., He, M., Wang, S., Chen, H., Huang, J., & Liang, K. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.7601859
Chang, I., & Park, G. (2026) · Journal of Broadcast Engineering · doi:10.5909/jbe.2026.31.5.1101
Agent Foundry: A Boundary-Preserving Architecture for Governed Agentic Platforms
arghya, M. (2026) · Indian Journal of Computer Science and Technology · doi:10.59256/indjcst.20260503028
Liu, W., & Zhang, Y. (2026) · Internet Research · doi:10.1108/intr-10-2025-1717
A dynamic patching LLM framework for adaptive yield trend prediction
Zhang, Y., Pei, J., Qin, K., Liu, T., Yang, J., & Wu, Q. (2026) · Digital Chemical Engineering · doi:10.1016/j.dche.2026.100349
SpireBench: Evaluating Long-Horizon Strategic Play of Agentic Models with Slay the SpirePreprint
Lowe, S. C., & Keemink, S. W. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.12596 · Cited by 1
An agent for water-transfer scheduling constrained by engineering semantics and hydraulic feedbackPreprint
Zhu, J., Yue, X., & Lei, X. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.7601919
AgentTune: A Unified Training Lifecycle for Tool-Using LLM AgentsPreprint
Lyngkhoi, R. E. Z. M., Gupta, A., Vats, V., Kadiyala, R. M. R., Sankarapu, V. K., & Seth, P. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.13335 · Cited by 1
“• ReflexionStrategy [11] retries a task up to max_attempts times and carries a verbal self-critique from each failed attempt into the next.”
A Multi-Agent LLM System for Automated Tuning of Specialized Neural Network ModelsPreprint
Александрович, М. И., Kunitsyn, D., Sboev, A., Skorokhodov, M., Rybka, R., & Liu, Y. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.13663
“…planning module (Chain-of-Thought Wei, Wang, Schuurmans et al. (2022), Tree-of-Thoughts Yao, Yu, Zhao et al. (2023a)), dynamic memory and self-reflection Shinn, Cassano, Berman et al. (2023), calls to external tools, and multi-agent designs with role separation Chen, Liu, Han, Zhang and Liu (2024).”
VETR: Execution-Grounded Self-Improving Agent for Symbolic Graphics ReasoningPreprint
Ma, Y., Ai, K., Dai, G., Yu, C., Wang, C., & Shen, H. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.13098
“Feedback-driven refinement is studied by Self-Refine, Reflexion, CRITIC (Madaan et al., 2023; Shinn et al., 2023; Gou et al., 2024), Self-Debugging, and CodeAct (Chen et al., 2024; Wang et al., 2024); VDebugger leverages step-wise traces (Wu et al., 2024); visual unit tests guide revision…”
Koyluoglu, O. O. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.13000
“Self-Refine has the model critique and revise its own output [33], and Reflexion has an agent keep verbal reflections on failed trials in memory for later attempts [34].”
Oh, P. S., Luo, Y., & Liu, J. (2026) · ACM/IEEE Joint Conference on Digital Libraries · doi:10.1145/3805696.3846485
Inject a Turn, Not a Token: Learning Where to Redirect LLM Reasoning for Self-CorrectionPreprint
Jeon, J., Cho, M., Kim, J., & Sung, Y. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.13672
“L C OMPLEMENTARY WITH O THER B ASELINES UPTURN redirects a rollout rather than rewriting it, so it does not compete with a self-correction method for the same slot: it can run on whatever pool that method produces.”
InfluentialWang, J., Liu, Y., Wu, Y., Chen, G., Pechuk, N., Chen, T., Erickson, Z., Qin, Y., & Li, T. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.12561 · Cited by 1
“…(Chhikara et al., 2025), A-MEM links evolving notes (Xu et al., 2025), Reflexion and Agent Workflow Memory distill feedback and reusable procedures (Shinn et al., 2023; Wang et al., 2025b), and filesystem memories let agents read and reorganize files through generic file tools (Zhou et al., 2026).”
The rise of agentic AI in drug discovery from static tools to autonomous virtual scientists
Zhao, D., Fang, M., Mao, L., Zhu, Y., Su, Q., Shi, H., Xu, H., Li, L., Hou, T., & Hsieh, C.-Y. (2026) · npj Drug Discovery. · doi:10.1038/s44386-026-00075-0
PReFER: A Multi-Proposer Refiner Framework for Named Entity Recognition
Anjum, A., & Krestel, R. (2026) · ACM/IEEE Joint Conference on Digital Libraries · doi:10.1145/3805696.3846032
Towards reliable AI via human guidance
Heo, J. (2025) · Apollo (University of Cambridge) · doi:10.17863/cam.135655
Returning to Development States: When Full Sandbox Snapshots Help Coding AgentsPreprint
Graviet, D. T., & Shah, T. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.13841
“It converts feedback from previous attempts into textual reflections that guide future trials (Shinn et al., 2023).”
A METHOD FOR CONTROLLED ITERATIVE PROCESS EXECUTION IN SYSTEMS BASED ON LARGE LANGUAGE MODELS
Пучков, О. О., Lande, D., & Subach, I. (2026) · Cybersecurity Education Science Technique · doi:10.28925/2663-4023.2026.34.1308
Metadata
- Authors
- Shinn, N., Cassano, F., Berman, E., Gopinath, A., Narasimhan, K., & Yao, S.
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2023
- Pages
- 8634-8652
- ISSN
- 1049-5258 (ISSN-L)
- arXiv
- 2303.11366
- OpenAlex
- W7133222210
- Cited by
- 1,087
- References
- 0
- Citations by year
- 2026: 760 · 2025: 167 · 2024: 105 · 2023: 55
- FWCI
- 192.15
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- neural information processing systems (publishedVersion)
- arXiv (Cornell University) (submittedVersion, cc-by)
- arXiv (Cornell University) (cc-by)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Keywords
- language agents, verbal behavior, language acquisition
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-01, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-01 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.