Reflexion: Language Agents with Verbal Reinforcement Learning
Open accessThe DOI matches its DataCite record; 42 of the 42 references it cites were found in a registry or an index; 7 of the 8 sources its claims cite were checked for support.
Abstract
Large language models (LLMs) have been increasingly used to interact with external environments (e.g., games, compilers, APIs) as goal-driven agents. However, it remains challenging for these language agents to quickly and efficiently learn from trial-and-error as traditional reinforcement learning methods require extensive training samples and expensive model fine-tuning. We propose Reflexion, a novel framework to reinforce language agents not by updating weights, but instead through linguistic feedback. Concretely, Reflexion agents verbally reflect on task feedback signals, then maintain their own reflective text in an episodic memory buffer to induce better decision-making in subsequent trials. Reflexion is flexible enough to incorporate various types (scalar values or free-form language) and sources (external or internally simulated) of feedback signals, and obtains significant improvements over a baseline agent across diverse tasks (sequential decision-making, coding, language reasoning). For example, Reflexion achieves a 91% pass@1 accuracy on the HumanEval coding benchmark, surpassing the previous state-of-the-art GPT-4 that achieves 80%. We also conduct ablation and analysis studies using different feedback signals, feedback incorporation methods, and agent types, and provide insights into how they affect performance.
Overview
CoChat Summary
TL;DR
Reflexion reinforces language agents through verbal self-reflection stored in episodic memory rather than weight updates, improving performance across decision-making, reasoning, and coding tasks. It reports gains including 91% pass@1 on HumanEval, a 22% absolute improvement on AlfWorld, and 20% on HotPotQA.
Key findings
- On HumanEval Python, Reflexion achieves 91.0 pass@1, surpassing the previous state-of-the-art GPT-4 at 80.1; on HumanEval Rust it reaches 68.0 vs. 60.0, MBPP Rust 75.4 vs. 70.9, and Leetcode Hard 15.0 vs. 7.5.
- In AlfWorld, ReAct + Reflexion completes 130 out of 134 tasks using a simple heuristic and improves over strong baselines by an absolute 22% over 12 iterative learning steps; ReAct-only converges at a 22% hallucination rate with no long-term recovery.
- In HotPotQA, Reflexion improves over baselines by 20%; self-reflection gives an 8% absolute boost over episodic memory alone, and although CoT (GT) fails on 39% of questions, Reflexion improves accuracy by 14% without access to ground-truth answers.
- Ablations on the 50 hardest HumanEval Rust problems show full Reflexion at 0.68 vs. baseline 0.60; omitting test generation drops to 0.52, and omitting self-reflection stays at 0.60.
Methods
- Reflexion uses a modular loop with an Actor that generates text/actions, an Evaluator that scores outputs, and a Self-Reflection model that converts feedback into verbal summaries stored in memory; trials repeat until the Evaluator passes or a max trial count is reached, with memory usually bounded to 1–3 experiences.
- Experiments cover AlfWorld (134 environments, six tasks, ReAct + GPT-3), HotPotQA (100 questions, CoT/ReAct, exact-match grading, memory size 3), and programming (HumanEval, MBPP, LeetcodeHardGym; Python/Rust via MultiPL-E; self-generated unit tests up to 6).
- Ablations and analyses vary feedback signals, feedback incorporation methods, and agent types; compromised approaches are tested on HumanEval Rust, and a WebShop experiment is run across 100 environments.
Limitations
- The paper states Reflexion may fall into non-optimal local minima, limits long-term memory to a sliding window with maximum capacity, and notes code-generation test-driven development is limited by non-deterministic, impure, hardware-dependent, or concurrent functions; it also relies on LLM self-evaluation/heuristics and lacks a formal success guarantee.
- The paper reports WebShop failure: after only four trials the agent shows no improvement and does not generate helpful self-reflections, concluding Reflexion cannot solve tasks requiring significant diversity and exploration.
- Evident from the text: self-correction is an emergent quality of stronger, larger models—starchat-beta shows no improvement (baseline 0.26 vs. Reflexion 0.26)—and flaky or incorrect test suites can cause false positives/negatives, with false negatives preferred.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
4 Valid · 2 Not valid · 0 Not checked · 59 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Therefore, in the case in which the model generates a flaky test suite, it is possible that all tests pass on an incorrect solution and lead to a false positive label on a code completion [11].”
§ Reflexion: Language Agents with Verbal Reinforcement Learning > Analysis
What the sources say
- Partly supportedcites [11] 11. Lam, W., Winter, S., Wei, A., Xie, T., Marinov, D., and Bell, J. (2020). A large-scale longitudinal study of flaky tests. Proc. ACM Program. Lang., 4(OOPSLA). sourceExperimental — accuracy not yet measured
The Introduction (page not provided) says a flaky test can pass and fail on the same code and that changes may be merged when all tests pass. It does not address model-generated test suites, incorrect code completions, or false-positive labels, so those parts of the claim are not established by this paper. (LLM, conf=0.82)
hedgedstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“3 shows an inferior 52% vs 60% (baseline) accuracy, which suggests that the agent is unable to determine if the current implementation is correct without unit tests.”
§ Reflexion: Language Agents with Verbal Reinforcement Learning > Ablation study
hedgedstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“ReAct + Reflexion significantly outperforms ReAct by completing 130 out of 134 tasks using the simple heuristic to detect hallucinations and inefficient planning.”
§ Reflexion: Language Agents with Verbal Reinforcement Learning > Results
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“4 shows that self-reflection improves learning by an 8% absolute boost over the episodic memory learning advantage.”
§ Reflexion: Language Agents with Verbal Reinforcement Learning > Analysis
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“on reasoning questions in HotPotQA [28] by 20%”
- Also stated in: § 4 Experiments · plain
“Most notably, Reflexion improves performance over strong baselines by 22% in AlfWorld, 20% in HotPotQA, and 11% on HumanEval.”
§ Reflexion: Language Agents with Verbal Reinforcement Learning > 1 Introduction
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § 4 Experiments · plain
30 more claims
Create a free account to see all 65 claims and every source verdict.
- It may state two separate claims as one. 18
- Probably not a substantial claim. 11
- The quote only partly states this claim. 3
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source doesn’t support the claim as written.
In the citing paper
“Memory and reflection systems such as MemAgent (Yu et al., 2025a), Reflexion (Shinn et al., 2023), and Generative Agents (Park et al., 2023) improve retrieval and episodic memory, but do not perform context shaping, state restructuring, or nextinstruction refinement.”
From PAACE: A Plan-Aware Automated Agent Context Engineering Framework (2025) · cites this paper as Shinn et al., 2023
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe cited source doesn’t support the claim as written.
In the citing paper
“However, Reflexion computes verbal reward over a full trajectory, yielding a single end-of-episode signal that conflates credit across reasoning steps: a failure due to a single intermediate error receives the same critique pressure as one due to a flawed strategy.”
From Process Supervision via Verbal Critique Improves Reasoning in Large Language Models (2026) · cites this paper as Shinn et al. [2023]
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe cited source doesn’t support the claim as written.
In the citing paper
“Unlike Reflexion, which only reflects on unsuccessful trajectories, our approach separately reflects on both successful and unsuccessful ones.”
From An Efficient Context-Dependent Memory Framework for LLM-Centric Agents (2025) · cites this paper as Shinn et al., 2023
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe cited source doesn’t support the claim as written.
In the citing paper
“The dominant approach is to curate memory at write time.”
From Just-in-Time Memory: Learning to Curate Task-Adaptive Memory for LLM Agents (2026) · cites this paper as Shinn et al., 2023
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Interaction and code generation are increasingly used together, with code as the modality of choice for actions [48, 59], tool construction [13, 51, 69], and reasoning [39, 66, 67].”
From SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineering (2024) · cites this paper as [39]
Experimental — accuracy not yet measured
107 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Reflexion: Language Agents with Verbal Reinforcement Learning > 3 Reflexion: reinforcement via verbal reflection
“while M e not pass or t < max trials do”
§ Reflexion: Language Agents with Verbal Reinforcement Learning > Self-reflection
“The Actor, Evaluator, and Self-Reflection models work together through trials in a loop until the Evaluator deems τ t to be correct.”
Citations
Cites
The publisher hasn’t deposited this paper’s reference list.
Cited by
Items 2,801–2,900 of 3,537
AVATAR-AGENT: A Multi-Agent System for Expressive 3D Avatar Generation
Ding, J., Gangaraju, R., Garikipati, K. C., Dabiri, F., & Xu, C. (2026) · International Workshop on Agentic Engineering · doi:10.1145/3786167.3788404 · Cited by 1
“Key architectural principles have emerged: reasoning and action loops [8], self-correction [6], memory architectures [5], and multi-agent collaboration [2, 3].”
LLM-X: A Scalable Negotiation-Oriented Exchange for Communication Among Personal LLM Agents
Lorenzoni, G., Alencar, P., & Cowan, D. D. (2026) · International Workshop on Agentic Engineering · doi:10.1145/3786167.3788429
Goel, R. (2026) · Digital Access to Scholarship at Harvard (DASH) (Harvard University)
Benchmarking Reference-Free LLM Agent Robustness Under Schema, Policy, and Toolset Drift
Assidiqi, M. H., Alghazzawi, D., Alarifi, S., & Cheng, L. (2026) · IEEE Access · doi:10.1109/access.2026.3696096 · Cited by 1
Golchinfar, D., Vaziri, D. D., Hennekeuser, D., & Schreiber, D. (2026) · Lecture notes in mechanical engineering · doi:10.1007/978-3-032-16889-4_62
A survey of agentic materials science and engineering: where are we and where are we going?
Zhu, J., Zhang, L.-H., Zhu, Y., Lin, X.-T., Wu, Y.-F., Di, S.-M., Liu, B., Luo, Y.-Y., & Zhang, T. (2026) · Journal of Materials Informatics · doi:10.20517/jmi.2026.07 · Cited by 2
From brittle to robust: Improving LLM annotations for SE optimization
Senthilkumar, L., & Menzies, T. (2026) · Empirical Software Engineering · doi:10.1007/s10664-026-10823-5 · Cited by 1
“Self-reflection prompting [55] represents a distinct strategy in which the model iteratively refines its responses.”
Ji, Y., Li, Z., Ji, H., & He, D. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2605.24733
LipoAgent: Coordinating Fine-Tuned LLM Agents for Safer Lipid DesignPreprint
Li, L., Lu, A., Wang, H., Feng, Z., Duan, C., Bao, Q., Zhao, Z., & Zhang, S. Q. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2605.25250
“Systems such as CAMEL (Li et al., 2023), Voy-ager (Wang et al., 2023), and Reflexion (Shinn et al., 2023) demonstrate how agent interaction, self-reflection, and feedback loops can enhance task performance in scientific reasoning.”
Martynov, A., Lapina, M., & Babenko, M. G. (2026) · Big Data and Cognitive Computing · doi:10.3390/bdcc10060172
Omelchenko, I., & Strukov, V. (2025) · Bulletin of V N Karazin Kharkiv National University series «Mathematical modeling Information technology Automated control systems» · doi:10.26565/2304-6201-2025-68-06
Yasuno, T. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2605.27452
“Reflexion [49] built on this by introducing verbal reinforcement signals from a linguistic reflection mechanism, allowing agents to revise strategies across trials without gradient updates.”
Collaborative LLM Agents for End-to-End Software Development
Garg, S., Omidvar-Tehrani, B., Fu, S., Guinet, G., & Ray, B. (2026) · International World Wide Web Conference (WWW) · doi:10.1145/3774905.3793914
Vu, T., Nguyen, L., & Dao, Q. (2026) · IEEE Access · doi:10.1109/access.2026.3698020
Long, Z., Li, X., Chen, J., Gao, Y., Li, D., & Yang, H.-J. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-38062-3_5 · Cited by 1
Closed-Loop Quality Assurance for Production Clinical AI DocumentationPreprint
Napier, A., Wiley, J., & Heslin, M. (2026) · medRxiv · doi:10.64898/2026.05.27.26353977
Kim, M. (2026) · PhilSci-Archive (University of Pittsburgh)
Falda, P. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2606.02019
“The dispatch architecture of section 3.3 occupies a structurally distinct position from each of these: it lifts the honest-negative discipline (Reflexion-family verbal-reflection on negatives) into a coordinator-mediated cross-axis re-routing primitive (extending plan-then-execute decomposition with a per-step structu…”
InfluentialKACE: Knowledge-Adaptive Context Engineering for Mathematical ReasoningPreprint
Parashar, J., & Bhandarkar, S. M. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2606.00532
“A.2 Reflection, Memory, and Self-Improvement Reflexion, Self-Refine, and related self-improvement systems show that language feedback can serve as an optimization signal at inference time [Shinn et al., 2023, Madaan et al., 2023].”
Intelligent Mobile App Development Using Generative AI: Opportunities and Challenges
Kumar, B., & Rani, S. (2026) · International Journal for Research in Applied Science and Engineering Technology · doi:10.22214/ijraset.2026.83360
Understanding the Self-Reflection Mechanisms of LLMs through Biased Attitude AssociationsPreprint
Zhang, J., Wang, B., Yang, B., Zhao, D., He, R., Hou, Y., & Yu, Z. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2606.00600
“…learning, Large Language Models (LLMs) have demonstrated surprising emergent self-reflection capabilities, offering a novel paradigm for autonomous decision-making and safety governance (Shinn et al., 2023; Ji et al., 2023; Gallego, 2024; Phan et al., 2025; Zhao et al., 2025; Liu et al., 2025).”
Gouaïch, A. (2026) · Procedia Computer Science · doi:10.1016/j.procs.2026.04.143
SAGE: A Quantitative Evaluation of Socialized Evolution in Agent EcosystemsPreprint
Pan, L., Zhu, Y., Qiu, L., Cao, X., & Cai, X. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2606.03544
“A growing literature studies agents that improve through self-feedback, memory, or iterative refinement (Madaan et al., 2023; Shinn et al., 2023; Park et al., 2023; Wang et al., 2023).”
Saveliev, R., & Dendiuk, M. (2026) · Наука і техніка сьогодні · doi:10.52058/2786-6025-2026-4(58)-2620-2630
A Survey of Mobile Agents: From Code Mobility to Large Multimodal Model-driven Autonomy
Chen, J. (2026) · Electronic Imaging · doi:10.2352/ei.2026.38.7.image-269
ProtoMedAgent : Multimodal Clinical Interpretability via Privacy-Aware Agentic Workflows
Pellicer, A. L., Angelov, P. P., Bukhari, M. A. S., Li, Y., Soares, E. A., & Kerns, J. G. (2026) · Lancaster EPrints (Lancaster University)
Guan, Y., Guo, S., Hou, L., & Li, J. (2026) · ACM Transactions on Information Systems · doi:10.1145/3819825
“They relied on role-conditioned prompting, reasoning frameworks, such as ReAct [43] and Reflexion [27], memory-augmented retrieval mechanisms, and tool integration to support decision-making.”
USDOE, Werth, A. W., Hahn, G., Hink, R. B., Piesciorovsky, E. C., Prowell, S., Torkelson, L., Oesch, S., Searle, J., & Roberts, J. (2026) · OSTI OAI (U.S. Department of Energy Office of Scientific and Technical Information) · doi:10.2172/3367033
A stigmergy-driven multi-agent framework for intelligent task orchestration
Veli, E. (2026) · UPCommons institutional repository (Universitat Politècnica de Catalunya)
From Signals to Root Cause: A Systems Architecture for Agentic AI in Observability
Balasubramanian, A. (2026) · International Journal of Intelligent Systems and Applications in Engineering · doi:10.5281/zenodo.20583511
MACA: A Framework for Distilling Trustworthy LLMs into Efficient Retrievers
Gudipudi, S. S., Girhepuje, S., Kumaraguru, P., & Ma, K. (2026) · Lecture notes in computer science · doi:10.1007/978-981-92-1468-6_39
Ge, H., Jia, Y., Li, Y., Chen, Z., Shi, L., Han, L., Zhou, G., & Huang, R. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2606.08542
“Our iteration agent’s reason-act-revise template follows the ReAct [20], Reflexion [21], and Self-Refine [22] pattern, applied to a one-line natural-language prompt rather than to free-form LLM output.”
Aliaga-Torro, C. (2025) · RiuNet (Universitat Politècnica de València)
Regimes: An Auditable, Held-Out-Gated Improvement Loop Demonstrated on LongMemEval with ActiveGraphPreprint
Nakajima, Y. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2606.10241
MASŁOWSKI, J., & Chudziak, J. A. (2026) · Procedia Computer Science · doi:10.1016/j.procs.2026.09.362 · Cited by 1
From Topology to Trajectory: LLM-driven World Models For Supply Chain ResiliencePreprint
Luo, J., & Liu, M. H. (2026) · Research Square · doi:10.21203/rs.3.rs-9747498/v1
Zhang, S., Wang, A., & Sophie, L. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2606.11686
“Agent scaffolds are typically validated by ablation measured end-to-end — ReAct ablates reason/act (Yao et al., 2023), Reflexion ablates self-reflection and measures global success (Shinn et al., 2023).”
Fever, Q., & Aslam, N. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2606.11199
Search Discipline for Long-Horizon Research AgentsPreprint
Srinivasan, A., & Paragiri, D. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2606.11522
“In-context self-critique and iterative self-refinement keep the evaluation inside the agent that produced the candidate [5, 13].”
Implementació del Passaport de Materials en la construcció
Gilabert, L. L. (2026) · UPCommons institutional repository (Universitat Politècnica de Catalunya)
Rama, R. (2026) · International Journal of AI BigData Computational and Management Studies · doi:10.63282/3050-9416.ijaibdcms-v7i1p147
Under What Conditions Can a Machine Be Called Genuinely Creative?Preprint
Zeng, Y. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2606.13196
Zhang, J., Xu, W., Zhang, Y., Lee, D., & Wang, G. (2026) · Information Sciences · doi:10.1016/j.ins.2026.123782
APEX: Adaptive Principle EXtraction A Three-Layer Self-Evolution Framework for Production AI AgentsPreprint
Chen, Y., Lai, T.-J., & Hu, H.-W. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2606.15363
“…principles; EvoAgentX [3] applies gradient-like text optimisation and AFlow [6] DAG topology search to improve agent workflows; Reflexion [9] enables agents to self-improve via verbal reflection over prior trajectories; Symbolic Learning [11] propagates natural language “gradients”…”
Scaling LLM Reasoning from Minimal Labels: A Semi-Supervised Framework with a Lightweight VerifierPreprint
Kato, K., Chu, C., Murawaki, Y., & Kurohashi, S. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2606.16811
Sesay, J., Yu, Y., Dong, S., & Karlsson, B. F. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2606.16428
Zhou, Z., Dai, J., & ling, X. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2606.15074
“Self-refinement approaches [6, 7] have shown that LLMs can improve their own outputs through iterative feedback.”
Context-Aware RL for Agentic and Multimodal LLMsPreprint
Xu, P., Li, B., Liu, S., Narasimhan, K., Viswanath, P., Mittal, P., & Fu, X. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2606.17053
“This progress has enabled a wide range of intelligent systems, including agentic systems [64, 61, 4, 32, 63, 42, 49, 38] that interleave reasoning with tool use over extended horizons, and multimodal models [23, 2, 21, 45, 5, 31] that combine fine-grained perception with textual reasoning over…”
Self-citationPrimeAgentOrchestrator: Memory-Primed Agent Spawning for Personal AI InfrastructurePreprint
KOCH, M. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2608.20342
“Reflexion [13] showed that verbal self-reflection stored in episodic memory improves agent performance on sequential decision tasks.”
Lumi Agent: Autonomous Lumerical FDTD Simulation for Photonic Waveguide Experiments
Chen, W., Capuano, A., Gu, Q., & Ding, C. (2026) · ACM Great Lakes Symposium on VLSI (GLSVLSI) · doi:10.1145/3787109.3816402
“Systems such as ReAct, Toolformer, AutoGen, and Reflexion show how language models can alternate among generation, tool calls, execution feedback, and self-revision [16, 17, 22, 24].”
SEPevo: From Academic Pipeline to Enterprise Deployment— A tech transfer story with ROI ambitions
Corradin, A., & Melchior, S. (2026) · Proceedings of the International Conference of Control, Dynamic systems, and Robotics · doi:10.11159/cdsr26.138
Bajpai, M. (2025) · The Eastasouth Journal of Information System and Computer Science · doi:10.58812/esiscs.v3i01.1102
“Reflexion-style memory can be useful when it stores validated lessons from postmortems, failed hypotheses, and successful runbook paths [6].”
Token-Operations-Oriented Inference Optimization Techniques for Large ModelsPreprint
Lian, S., Wang, K., Liu, Z., Liu, W., Hua, M., Liu, Y., Yan, J., Wang, X., Wang, C., Zhang, Y., et al. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2606.20295
Trustworthy Multi-Agent Systems: Mitigating Semantic Drift with the Argent Signaling ProtocolPreprint
Sharma, A. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2606.19356
Generování strukturovaných testovacích dat pomocí LLM
Komanický, J. (2026) · Brno University of Technology Digital Library (Brno University of Technology)
Agentic llms for psycholinguistic marker extraction and conspiracy endorsement detection
Spanakis, P. A. (2026) · DSpace - NTUA (National Technical University of Athens) · doi:10.26240/heal.ntua.32682
Han, S.-T. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2606.22151
“Representative papers include Self-RAG [10], Re-flexion [7], CAMEL [6], Generative Agents [9], AgentVerse [16], ReWOO [17], and MetaAgents [18].”
GeoMind: An Autonomous Multi-Agent Framework for Verified Geospatial AnalysisPreprint
Habib, J., Srabon, M. I., Nahar, M. L., Lutfy, M., Khatun, M. A., Shammo, M. B. A. Z., & Hasan, M. A. (2026) · Research Square · doi:10.21203/rs.3.rs-10034367/v1
Lin, Y., Zhang, Z., & Li, Y. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2606.24598
“…target external prompt injection (an orthogonal threat [5, 7, 15, 22] to our agent’s own decision boundary); agent frameworks (ReAct, Reflexion [18], AutoGen [25], Planner–Executor, Toolformer [17]) are greenfield [8, 14, 23, 27]; legacy migration (Strangler Fig, modernization surveys) [1, 2]…”
SOFTWARE IMPLEMENTATION OF A PIPELINE FOR AUTOMATED GENERATION OF TEST MATERIALS BASED ON LLMS
Havrylenko, O., & Пугач, Д. (2026) · doi:10.70286/isu-03.06.2026.004
Agentic System as Compressor: Quantifying System Intelligence in BitsPreprint
Qin, Z., & Zhang, H. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2606.25960
“ReAct interleaves reasoning and acting (Yao et al., 2023b); Toolformer teaches a model to call APIs (Schick et al., 2023); RAG conditions generation on retrieved documents (Lewis et al., 2020); Reflexion uses verbal feedback to improve subsequent attempts (Shinn et al., 2023).”
Interactive recommendation algorithm based on intelligent assistance for project application
Shao, C., Zou, Q., Qiu, Z., Luo, L., Chen, L., Chen, P., Guan, F., & Zheng, H. (2026) · Scientific Reports · doi:10.1038/s41598-026-58948-3
Multi-Agent Framework for Inferencing Activities of Objects in Satellite Image
Hwang, J., & Jung, D. (2026) · GEO DATA · doi:10.22761/gd.2026.0012
Shen, Z., Guo, Q., Pang, K., Cai, X., Yu, Z., Feng, K., & Yu, T. (2026) · Computers · doi:10.3390/computers15070422
“…Pure LLM establishes the performance floor of direct generation without any augmentation; Reflection adds iterative prompt self-refinement [28], representing the current state of prompting-only LLM improvement; and Memory + Ref further adds experience retrieval [29], representing the…”
Narasimhan, V. (2026) · International Journal of Intelligent Systems and Applications in Engineering · doi:10.5281/zenodo.21043500
KnowMat: An AI-guided material design agent with knowledge-integrated tool learning mechanisms
Yin, N., Li, Z., Liu, J., Guo, X., Jiang, X., Zhang, X., & He, J. (2026) · Neurocomputing · doi:10.1016/j.neucom.2026.134405
Hesaplamalı Zekanın Kuramsal Temelleri: Yapay Zeka, Öğrenme Kuramı ve Büyük Veri Paradigması
Yılmaz, A., Zadeh, S. N., Aydın, Z., Gök, H. N., Arslan, C., Aydın, U., Gökbay, İ. Z., Erbaş, M. D., Peker, K., Ergüven, G. Ö., et al. (2026) · Özgür Yayınları eBooks · doi:10.58830/ozgur.pub1351
Büyük Dil Modellerinin (LLM) Kuramsal Sınırları ve Varsayımları
Baylay, T. E., & Yılmaz, A. (2026) · Özgür Yayınları eBooks · doi:10.58830/ozgur.pub1351.c5537
Multi-Constraint State Tracking with Negation: A Diagnostic Benchmark for LLM World Modeling
Sar, A., Puri, P. S., Aich, S., Kaushish, A., Choudhury, T., & Abraham, A. (2026) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2026.acl-srw.119
“These successes have fueled growing interest in deploying LLMs as reasoning agents in settings that require understanding and acting upon descriptions of the world, such as dialogue systems, planning assistants, and embodied or simulated agents (Yao et al., 2023) (Shinn et al., 2023).”
ACRM: Multi-Agent Trajectory Learning for Automated Credit Risk Model Refreshing in Production
Liu, L., Ruan, M., Chen, X., HaonanChen, XudongNiu, Yuan, W., YuechenLi, Liu, Y. J., & Wang, G. (2026) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2026.acl-industry.65
“To bridge this gap, we introduce ACRM, a deployed agentic framework that automates the end-to-end credit modeling workflow (Qiao et al., 2024; Zhang et al., 2024) by learning from expert trajectories (Yao et al., 2023; Shinn et al., 2023).”
Building Multi-turn Intent Classification with LLM-based Labeling
Xie, B., Bian, K., Gusain, J. R. S., Ramanathan, M., & Maragoud, R. (2026) · Workshop on Customizable NLP: Progress and Challenges in Customizing NLP for a Domain, Application, Group, or Individual (CustomNLP4U) · doi:10.18653/v1/2026.customnlp4u-1.8
RSMeM: Knowledge-Enhanced Memory Evolution for Remote Sensing Agents with Systematic Evaluation
Wu, B., Zhang, Y., Guo, Z., Liu, T., Qian, C., Lu, Y., Du, X., Li, Y., Zhang, Y., Chen, C., et al. (2026) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2026.acl-long.1519 · Cited by 2
“Across these paradigms, experiences are typically stored as textual summaries or embedding representations and retrieved via semantic similarity, with memory update and forgetting strategies used to maintain relevance (Shinn et al., 2023).”
InfluentialWhat Drives Interactive Improvement from Feedback?
Cupiał, B., Łojek, J., Garstecki, M., Pobłocki, S., Ziarko, A., & Miłoś, P. (2026) · arXiv · doi:10.48550/arxiv.2606.30774
“Related agent systems such as Reflexion use verbal feedback or memories of past failures to improve future attempts [Shinn et al., 2023].”
Hierarchical Visual Agent: Managing Contexts in Joint Image-Text Space for Advanced Chart Reasoning
Dong, Q., He, R., Chen, J., Wang, Y., Ma, X., Jiang, S., & Fu, Y. (2026) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2026.findings-acl.1914 · Cited by 1
“For multi-step reasoning, text-based chain-of-thought (CoT) prompting (Wei et al., 2022; Yao et al., 2022; Wang et al., 2023; Shinn et al., 2023; Zhang et al., 2025) is mainly adopted to elicit explicit reasoning traces.”
Panda, S. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2606.30689
Self-Awareness before Action: Mitigating Logical Inertia via Proactive Cognitive Awareness
Fan, F., Liu, P., FengZhe, L., Yang, S., & Yan, G. (2026) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2026.findings-acl.793 · Cited by 1
Huang, J., Yu, T., Pan, Z., & Wu, Y. (2026) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2026.3708850
“• Memory Stream: Instead of treating each market round as an isolated Markov process, the agent maintains an individual autoregressive memory trajectory H i , t , inspired by the Generative Agents and Reflexion architectures [16], [24].”
ConMA : Confidence-Guided Kernel Sampling with Multi-Stage Aggregation for LLM Reasoning
Wang, Y., Li, Q., Cui, W., Li, Q., & Huaping, Z. (2026) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2026.findings-acl.1475 · Cited by 1
Think Like You Execute: Verifiable Chain of Thought from Program Traces
Thakur, S., Saxena, V., Kulkarni, R., Singh, S., Selvam, P., Kanayama, H., & Patel, H. (2026) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2026.acl-industry.53 · Cited by 1
SAMem: State-Aware Memory as a Fine-Grained Memory for LLM Agents in Decision-Making
Wang, T., Xu, P., Cao, S., Yang, L., Li, D., Jiao, J., & Huang, K. (2026) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2026.findings-acl.722 · Cited by 4
“1) Reflexion (Shinn et al., 2023) is one of the earliest memory mechanisms, which enhances working memory by transforming failure cases into structured reflections.”
Dev, H., Mhaskar, S., Vutla, S., & Pattnaik, A. (2026) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2026.acl-industry.137
AI Agents for the Science of Science: A Survey of Tasks, Architectures, Evaluations, and Challenges
Liu, Y., & Zhang, Y. (2026) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2026.findings-acl.1804
“…by enabling adaptive, data-driven decision-making and the orchestration of multi-step analytical workflows through rule-based planners, reinforcement learning agents, and LLM-based agentic systems (Wang et al., 2024a; Huang et al., 2024; Yao et al., 2023b; Shinn et al., 2023; Zhang et al., 2025).”
Lazem, A. H., & Teahan, W. J. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2607.00870
“Reflexion (Shinn et al., 2023) extends this with verbal self-reflection persisted in an episodic memory buffer between trials, reinforcing the agent through linguistic feedback rather than gradient updates.”
Ramadhan, R. F. (2026) · Blockchain Artificial Intelligence and Future Research · doi:10.70211/bafr.v2i1.384
“…web environments [14], [15], [16], multimodal extensions [22], and prompting-based scaffolds for reasoning, planning, and reflection [7], [8], [9], [10], [11], [12], [13] but they typically report interaction success primarily as a benchmark score rather than as a usability-oriented…”
AlgoBench: Benchmarking Algorithmic Adaptation in Code GenerationPreprint
Song, X., Cai, Z., & Zhao, L. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2607.00062
“Re-flexion uses execution feedback for revision (Shinn et al., 2023).”
Hybrid Architecture of Intelligent Systems with a Deterministic Core: from Concept to Prototype
Rotkin, V. (2026) · International Journal of Innovative Science and Research Technology (IJISRT) · doi:10.38124/ijisrt/26aug1186
Episodic-to-Semantic Consolidation Without Identity DriftPreprint
Qin, X., Luan, S., Yang, C., & Li, Z. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2607.01988
“…of the autonomic loop in the LLM-agent space inherit its shape while differing in substrate: reflection-based language agents such as Shinn et al. [9] and Park et al. [10] store verbal feedback and feed it into later episodes; Wang et al. [11] builds a persistent skill library through trial;…”
On the Time Efficiency of Code Generated and Optimized by Large Language Models
Peng, Y., Wan, J., Ren, X., Menzies, T., & Lyu, M. R.-T. (2026) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2026.3709872
“…to make use of LLMs on code generation and code optimization via prompting engineering [8], [10], [31], [45], [50], [57], [67], [73], [87], [92], [96], [100], [117], multiple-agent cooperation [41], [42], [44], [102], [111], [115], and retrieval augmentation [32], [63], [85], [99], [114], [118].”
Path-Level Hindsight Instructions for Semantic Exploration in Vision-Language Navigation
Kim, S. J., Kim, S., & Lee, H. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37086-0_15
Chasing Abpms Vision: The Bab Framework Approach for LLM Agents Over Model-driven Enterprise Systems
Bogdanović, B., Segedinac, M., Konjović, Z., & Marković, V. (2026) · International Scientific Conference Sinteza · doi:10.15308/sinteza-2026-103-116
“The ReAct paradigm proposed by Yao et al. introduced the now-common pattern of interleaving reasoning steps with tool invocations [16], while subsequent work such as Reflexion [17] and Self-Refine [18] explored mechanisms for iterative self-correction.”
Fixpad++: Automated Bug Fix Verification using LLM Agents
İr, M. Ö., Dedeler, M., Koyuncu, A., & Tüzün, E. (2026) · ACM International Conference on AI-Powered Software (AIware) · doi:10.1145/3805760.3814915 · Cited by 2
PLACEMEM: Toward a Compute-Aware Memory Plane for Lifelong AgentsPreprint
Ganguly, S. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2607.04089
“Agent-memory systems (Generative Agents, Reflexion, MemGPT) model what to remember and retrieve, but leave runtime reuse and invalidation to the serving layer (Park et al., 2023; Shinn et al., 2023; Packer et al., 2024).”
From Voting to Agent Collaboration: Answer-Type-Aware LLM Pipelines for BioASQ 14bPreprint
Roh, T., Lee, E., Jang, W., Chung, S., Jung, J., & Kang, J. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2607.06452
“For yes/no questions, we apply snippet shuffling together with self-reflection [20] to reduce sensitivity to evidence ordering and improve the consistency of binary decisions.”
Self-Review Reinforcement Learning (SRRL) with Cross-Episode Memory and Policy DistillationPreprint
Amin, M. Z., & Yildirim, K. S. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2607.05541
“For this reason, the model must access memory during inference, which increases computational cost and restricts improvements in runtime framing rather than permanent changes in the policy (Zelikman et al., 2022; Madaan et al., 2023; Shinn et al., 2023).”
Memory in the Loop: In-Process Retrieval as Extended Working Memory for Language AgentsPreprint
Khan, Y., & Lipizzi, C. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2607.05690
“…under memory pressure; Generative Agents [Park et al., 2023] retrieve from a memory stream scored by recency, importance, and relevance; Reflexion [Shinn et al., 2023] and Voyager [Wang et al., 2024] add episodic and procedural memory; surveys consolidate the taxonomy [Du, 2026, Wu et al., 2025].”
Zhang, B., & Jiang, N. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2607.07387
Agent Delivery Engineering Predictive Reliability FrameworkPreprint
Liu, D. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2607.07689
UGenLah: A Human-in-the-loop Agentic Paradigm for Game Development
Lim, C. H., Zhang, H., Ruihao, L., Bai, Y., & Yan, M. (2026) · Annual Symposium on Human-Computer Interaction for Work (CHIWORK) · doi:10.1145/3805029.3818296
“The agency of UGenLah is realized through a recursive Plan–Act– Reflect cycle (Figure 3), extending reasoning-and-acting [26] and verbal self-reflection [19] frameworks to a stateful engine environment.”
Guruvelli, S. C. (2026) · International Journal of Computational and Experimental Science and Engineering · doi:10.22399/ijcesen.5402
“Research on autonomous agent architectures [11][12][8] and tool-augmented language models [13][14][15] addresses capability without addressing governance.”
Metadata
- Authors
- Shinn, N., Cassano, F., Berman, E., Gopinath, A., Narasimhan, K., & Yao, S.
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2023
- Pages
- 8634-8652
- ISSN
- 1049-5258 (ISSN-L)
- arXiv
- 2303.11366
- OpenAlex
- W7133222210
- Cited by
- 1,087
- References
- 0
- Citations by year
- 2026: 760 · 2025: 167 · 2024: 105 · 2023: 55
- FWCI
- 192.15
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- neural information processing systems (publishedVersion)
- arXiv (Cornell University) (submittedVersion, cc-by)
- arXiv (Cornell University) (cc-by)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Keywords
- language agents, verbal behavior, language acquisition
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-01, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-01 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.