Reflexion: Language Agents with Verbal Reinforcement Learning
Open accessThe DOI matches its DataCite record; 42 of the 42 references it cites were found in a registry or an index; 7 of the 8 sources its claims cite were checked for support.
Abstract
Large language models (LLMs) have been increasingly used to interact with external environments (e.g., games, compilers, APIs) as goal-driven agents. However, it remains challenging for these language agents to quickly and efficiently learn from trial-and-error as traditional reinforcement learning methods require extensive training samples and expensive model fine-tuning. We propose Reflexion, a novel framework to reinforce language agents not by updating weights, but instead through linguistic feedback. Concretely, Reflexion agents verbally reflect on task feedback signals, then maintain their own reflective text in an episodic memory buffer to induce better decision-making in subsequent trials. Reflexion is flexible enough to incorporate various types (scalar values or free-form language) and sources (external or internally simulated) of feedback signals, and obtains significant improvements over a baseline agent across diverse tasks (sequential decision-making, coding, language reasoning). For example, Reflexion achieves a 91% pass@1 accuracy on the HumanEval coding benchmark, surpassing the previous state-of-the-art GPT-4 that achieves 80%. We also conduct ablation and analysis studies using different feedback signals, feedback incorporation methods, and agent types, and provide insights into how they affect performance.
Overview
CoChat Summary
TL;DR
Reflexion reinforces language agents through verbal self-reflection stored in episodic memory rather than weight updates, improving performance across decision-making, reasoning, and coding tasks. It reports gains including 91% pass@1 on HumanEval, a 22% absolute improvement on AlfWorld, and 20% on HotPotQA.
Key findings
- On HumanEval Python, Reflexion achieves 91.0 pass@1, surpassing the previous state-of-the-art GPT-4 at 80.1; on HumanEval Rust it reaches 68.0 vs. 60.0, MBPP Rust 75.4 vs. 70.9, and Leetcode Hard 15.0 vs. 7.5.
- In AlfWorld, ReAct + Reflexion completes 130 out of 134 tasks using a simple heuristic and improves over strong baselines by an absolute 22% over 12 iterative learning steps; ReAct-only converges at a 22% hallucination rate with no long-term recovery.
- In HotPotQA, Reflexion improves over baselines by 20%; self-reflection gives an 8% absolute boost over episodic memory alone, and although CoT (GT) fails on 39% of questions, Reflexion improves accuracy by 14% without access to ground-truth answers.
- Ablations on the 50 hardest HumanEval Rust problems show full Reflexion at 0.68 vs. baseline 0.60; omitting test generation drops to 0.52, and omitting self-reflection stays at 0.60.
Methods
- Reflexion uses a modular loop with an Actor that generates text/actions, an Evaluator that scores outputs, and a Self-Reflection model that converts feedback into verbal summaries stored in memory; trials repeat until the Evaluator passes or a max trial count is reached, with memory usually bounded to 1–3 experiences.
- Experiments cover AlfWorld (134 environments, six tasks, ReAct + GPT-3), HotPotQA (100 questions, CoT/ReAct, exact-match grading, memory size 3), and programming (HumanEval, MBPP, LeetcodeHardGym; Python/Rust via MultiPL-E; self-generated unit tests up to 6).
- Ablations and analyses vary feedback signals, feedback incorporation methods, and agent types; compromised approaches are tested on HumanEval Rust, and a WebShop experiment is run across 100 environments.
Limitations
- The paper states Reflexion may fall into non-optimal local minima, limits long-term memory to a sliding window with maximum capacity, and notes code-generation test-driven development is limited by non-deterministic, impure, hardware-dependent, or concurrent functions; it also relies on LLM self-evaluation/heuristics and lacks a formal success guarantee.
- The paper reports WebShop failure: after only four trials the agent shows no improvement and does not generate helpful self-reflections, concluding Reflexion cannot solve tasks requiring significant diversity and exploration.
- Evident from the text: self-correction is an emergent quality of stronger, larger models—starchat-beta shows no improvement (baseline 0.26 vs. Reflexion 0.26)—and flaky or incorrect test suites can cause false positives/negatives, with false negatives preferred.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
4 Valid · 2 Not valid · 0 Not checked · 59 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Therefore, in the case in which the model generates a flaky test suite, it is possible that all tests pass on an incorrect solution and lead to a false positive label on a code completion [11].”
§ Reflexion: Language Agents with Verbal Reinforcement Learning > Analysis
What the sources say
- Partly supportedcites [11] 11. Lam, W., Winter, S., Wei, A., Xie, T., Marinov, D., and Bell, J. (2020). A large-scale longitudinal study of flaky tests. Proc. ACM Program. Lang., 4(OOPSLA). sourceExperimental — accuracy not yet measured
The Introduction (page not provided) says a flaky test can pass and fail on the same code and that changes may be merged when all tests pass. It does not address model-generated test suites, incorrect code completions, or false-positive labels, so those parts of the claim are not established by this paper. (LLM, conf=0.82)
hedgedstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“3 shows an inferior 52% vs 60% (baseline) accuracy, which suggests that the agent is unable to determine if the current implementation is correct without unit tests.”
§ Reflexion: Language Agents with Verbal Reinforcement Learning > Ablation study
hedgedstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“ReAct + Reflexion significantly outperforms ReAct by completing 130 out of 134 tasks using the simple heuristic to detect hallucinations and inefficient planning.”
§ Reflexion: Language Agents with Verbal Reinforcement Learning > Results
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“4 shows that self-reflection improves learning by an 8% absolute boost over the episodic memory learning advantage.”
§ Reflexion: Language Agents with Verbal Reinforcement Learning > Analysis
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“on reasoning questions in HotPotQA [28] by 20%”
- Also stated in: § 4 Experiments · plain
“Most notably, Reflexion improves performance over strong baselines by 22% in AlfWorld, 20% in HotPotQA, and 11% on HumanEval.”
§ Reflexion: Language Agents with Verbal Reinforcement Learning > 1 Introduction
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § 4 Experiments · plain
30 more claims
Create a free account to see all 65 claims and every source verdict.
- It may state two separate claims as one. 18
- Probably not a substantial claim. 11
- The quote only partly states this claim. 3
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source doesn’t support the claim as written.
In the citing paper
“Memory and reflection systems such as MemAgent (Yu et al., 2025a), Reflexion (Shinn et al., 2023), and Generative Agents (Park et al., 2023) improve retrieval and episodic memory, but do not perform context shaping, state restructuring, or nextinstruction refinement.”
From PAACE: A Plan-Aware Automated Agent Context Engineering Framework (2025) · cites this paper as Shinn et al., 2023
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe cited source doesn’t support the claim as written.
In the citing paper
“However, Reflexion computes verbal reward over a full trajectory, yielding a single end-of-episode signal that conflates credit across reasoning steps: a failure due to a single intermediate error receives the same critique pressure as one due to a flawed strategy.”
From Process Supervision via Verbal Critique Improves Reasoning in Large Language Models (2026) · cites this paper as Shinn et al. [2023]
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe cited source doesn’t support the claim as written.
In the citing paper
“Unlike Reflexion, which only reflects on unsuccessful trajectories, our approach separately reflects on both successful and unsuccessful ones.”
From An Efficient Context-Dependent Memory Framework for LLM-Centric Agents (2025) · cites this paper as Shinn et al., 2023
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe cited source doesn’t support the claim as written.
In the citing paper
“The dominant approach is to curate memory at write time.”
From Just-in-Time Memory: Learning to Curate Task-Adaptive Memory for LLM Agents (2026) · cites this paper as Shinn et al., 2023
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Interaction and code generation are increasingly used together, with code as the modality of choice for actions [48, 59], tool construction [13, 51, 69], and reasoning [39, 66, 67].”
From SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineering (2024) · cites this paper as [39]
Experimental — accuracy not yet measured
107 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Reflexion: Language Agents with Verbal Reinforcement Learning > 3 Reflexion: reinforcement via verbal reflection
“while M e not pass or t < max trials do”
§ Reflexion: Language Agents with Verbal Reinforcement Learning > Self-reflection
“The Actor, Evaluator, and Self-Reflection models work together through trials in a loop until the Evaluator deems τ t to be correct.”
Citations
Cites
The publisher hasn’t deposited this paper’s reference list.
Cited by
Items 2,101–2,200 of 3,537
白明和, Chen, W., Li, S., & Zhu, J. (2026) · IEEE International Conference on Software Analysis, Evolution and Reengineering (SANER) · doi:10.1109/saner67736.2026.00072
Vishwakarma, S. C. A. P. S. (2026) · International Journal of Advanced Research in Science Communication and Technology · doi:10.48175/ijarsct-37344
Progressive knowledge-enhanced instruction generation for tactical UAV swarms
Tan, C., Li, B., Wei, Z., Ma, G., Zhu, W., & Zhang, B. (2026) · Defence Technology · doi:10.1016/j.dt.2026.06.004
Privacy Leakage in Small Agentic Healthcare Models: An Empirical Analysis
Aguzzi, G., Montagna, S., & Ferretti, S. (2026) · IEEE International Conference on Pervasive Computing and Communications Workshops (PerCom Workshops) · doi:10.1109/percomworkshops68308.2026.11585450
“Unlike conventional AI-based prediction, agentic architectures implement reasoning loops wherein models iteratively plan, execute, and reflect upon intermediate steps [13].”
Rudder: Steering Prefetching in Distributed GNN Training using LLM Agents
Sarkar, A., Ghosh, S., Tallent, N. R., Chadha, A. R., Roosta, T. G., & Jannesari, A. (2026) · International Conference on Supercomputing · doi:10.1145/3797905.3800542 · Cited by 1
White, J., Zaffarano, K., Stacy, J., & Bian, X. (2026) · Journal of Cybersecurity and Privacy · doi:10.3390/jcp6040118
“Current execution-based validation approaches span multiple technical domains, such as Runtime Monitoring [26], Dynamic Analysis [27], Model Checking [26], and Agentic Code Repair [28].”
ReflectCache: A Self-Reflective and Parameter-Level Caching Approach for Tool-Augmented Agents
Ma, J., Li, C., Li, X., Wang, C., Wang, Q., Zhang, Y., Yang, W., & Zhao, Z. (2026) · International Conference on Computer Supported Cooperative Work in Design (CSCWD) · doi:10.1109/cscwd68734.2026.11582719
MT-CSD: Multi-Trajectory Consensus Self-Distillation for Robust Web Agents Learning
Chen, Z., Li, J., Yang, Y., Yang, J., & Cao, G. (2026) · International Conference on Computer Supported Cooperative Work in Design (CSCWD) · doi:10.1109/cscwd68734.2026.11581450
Zohaib, M., Akbar, M. A., & Hyrynsalmi, S. (2026) · ACM/IEEE International Workshop on Software-intensive Business (IWSiB) · doi:10.1145/3786158.3788561
“Governance innovations such as verifier loops and LLM-as-a-judge architectures introduce oversight and auditability, aligning with compliance requirements [11, 33].”
InfluentialORI : Ordinal-feedback for Refining and Instructing LLMs toward Alignment
Zhang, S., Zhang, B., Liu, Y., & Zhang, Y. X. (2026) · International Conference on Computer Supported Cooperative Work in Design (CSCWD) · doi:10.1109/cscwd68734.2026.11582773
Raheem, E. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.6976218
Feature-Augmented Iterative Critique: Enhancing Low-Resource LLMs for Threat Intelligence Extraction
Zhou, J., Wang, P., Dai, G., Ma, D., & Liu, F. (2026) · International Conference on Computer Supported Cooperative Work in Design (CSCWD) · doi:10.1109/cscwd68734.2026.11581619
“Shinn [16] adopted LLM as a critic for two-stage verification.”
Character History in the Context Design of LLM-Based AI
Matsumoto, T. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-30038-6_26
Tool Context Adaptation for Agentic Retrieval-Augmented Generation
Li, H., & Jin, J. (2026) · International Conference on Computer Supported Cooperative Work in Design (CSCWD) · doi:10.1109/cscwd68734.2026.11582519
Combining feedback enhancement with knowledge graphs in large language models
Zhou, Y., Qin, Y., & Lin, C. (2026) · Journal of King Saud University - Computer and Information Sciences · doi:10.1007/s44443-026-00877-2
Enhancing University Services and Governance With Self-Reflective Agentic AI
Tamizharasan, A., & Kanishka, S. (2026) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3373-7665-3.ch008
Composable Trust in Agentic AI: Bridging Architectural Capability and System-Level Assurance
Al-Refai, O., Shahbaz, I., & Hammad, E. (2026) · International Conference on Dependable Systems and Networks workshops · doi:10.1109/dsn-w70714.2026.00023
“Agents can improve their behavior over time by using methods like self-reflection, iterative reasoning, and LLM-based evaluation [3].”
SoiQL: Robust Enterprise Text-to-SQL via Topological Grounding and Risk-Aware Decision Gating
Behzadi, G., Alsop, L., Dowlut, A., Mroninski, P., & Harris, G. (2026) · Lecture notes in computer science · doi:10.1007/978-981-92-2497-5_5
LGAgent: A Structured and Rule-Guided Multi-Agent Framework for Interpretable Legal ReasoningPreprint
Feng, X., Shu, F., Feng, M., Feng, Y., & Liu, H. F. (2026) · Research Square · doi:10.21203/rs.3.rs-9571992/v1
Logic-Guided Data Extraction with Answer Set Programming and Large Language Models
Alviano, M., Grillo, L., Leone, N., & Scudo, F. L. (2026) · Theory and Practice of Logic Programming · doi:10.1017/s1471068426100635
Approaching LLM Alignment using Agents with RAG
Fliahin, V., Turuta, O., & Turuta, O. (2026) · International Workshop of IT-professionals on Artificial Intelligence (ProfIT AI) · doi:10.55056/ceur-ws.org/vol-4164/short6.pdf · Cited by 1
Prompt Optimization for LLM Code Generation via Reinforcement Learning
Esfahani, A. M., Kahani, N., & Ajila, S. A. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-30699-9_3 · Cited by 1
Autofy: Automated Synthesis of Formally Verified Code
Purschke, N., Schamschurko, A., Kirchner, S., Wu, C., & Knoll, A. (2026) · IEEE/ACM International Conference on Formal Methods in Software Engineering (FormaliSE) · doi:10.1145/3793656.3793688
Jiang, S., Qi, C., Chen, Y., Song, X., & Wei, Z. (2026) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.64898/2026.07.06.736807
Reasoning Without Rendering: Efficient 3D Scene Synthesis via ReAct-Based Solver Failure Recovery
Fu, J., Kuang, J., Chen, H., Huang, Y., & Cai, S. (2026) · Lecture notes in computer science · doi:10.1007/978-981-92-2856-0_35
Zhu, H., Wu, J., Ling, X., Luo, T., & Zhao, C. (2026) · Lecture notes in computer science · doi:10.1007/978-981-92-2856-0_32
CASA-RAG: Shared-Evidence Arbitration for Training-Free Retrieval-Augmented Generation
Wang, Y., Zhu, X., Deng, H., & Lou, Y. (2026) · Lecture notes in computer science · doi:10.1007/978-981-92-2862-1_4
D$$^3$$: Dispute-Driven Debate for Stabilizing Multi-agent Reasoning in Large Language Models
Liu, Y., Sun, S. Y., Wang, Y., Zhang, S., & Li, J. (2026) · Lecture notes in computer science · doi:10.1007/978-981-92-2852-2_47
Examples of Using LLMs as Metaheuristics
Iba, H., Batista, J. E., & Xu, J. (2026) · Natural computing series · doi:10.1007/978-981-95-8597-7_2
Dual-Loop Multi-agent Framework and Policy Optimization for Numbered Musical Notation Digitization
Lei, Z., Bai, P., & Shi, X. (2026) · Lecture notes in computer science · doi:10.1007/978-981-92-3447-9_18
Dou, L., Gong, S., Qiujie, S., & Varlamov, O. (2026) · Lecture notes in computer science · doi:10.1007/978-981-92-3447-9_38
MAP: GPU Resource Planning for Multi-Agent Systems With Stochastic and Verbose Outputs
Zhang, Q., Li, M., Li, Q., Hua, X., Chen, F., Zeng, D., & Li, P. L. (2026) · IEEE Transactions on Cloud Computing · doi:10.1109/tcc.2026.3712315 · Cited by 1
A Survey on Agentic AI Approaches for Unifying Knowledge Graphs and Large Language Models
Tiwari, S., Amara, F. Z., Hammaz, M., Chand, B., Khorashadizadeh, H., Groppe, S., Sahri, S., Mihindukulasooriya, N., Groppe, J., & Benamara, F. (2026) · Lecture notes in computer science · doi:10.1007/978-981-92-2014-4_39
SCTS: Self-Critique Tree Search for Out-of-Distribution Vulnerability Detection
Zhu, R., Zhou, N., 廖继康, Duan, L., & Yin, G. (2026) · Lecture notes in computer science · doi:10.1007/978-981-92-2014-4_14
CoCortex: A Memory Governance Framework for Reliable Long-Horizon LLM Agents
Kaviyaraj, R., Bijju, R. N., Nagarajan, T., & Singh, P. K. (2026) · International Conference on Next Generation Electronics (NELEX) · doi:10.1109/nelex69209.2026.11590154
“Self-refinement [11] and verbal reinforcement [12] address generation-time errors, but leave persistent hallucinatory content in memory untouched.”
MemeUMPIRE: Zero-Shot Multi-Agent Debate with Judge for Explainable Harmful-Meme Reasoning
Huang, S.-C., Wu, M.-R., Low, T. H., Morikawa, T., Tanuwidjaja, H. C., Takahashi, T., & Wang, M.-H. (2026) · International Conference on Communications · doi:10.1109/icc59461.2026.11587811
Is a Busy Search Agent a Good One? Overthinking and Overretrieval at Scale
Liu, X., Zhang, R., Liu, Y.-A., Su, L., Guo, J., & Cheng, X. (2026) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3805712.3809941
Road Network Vulnerability Analysis Based on Multi‐Agent Collaboration of LLM
Guo, X., Yu, S., Bi, H., & Liu, J. (2026) · Transactions in GIS · doi:10.1111/tgis.70350
Cheng, Z., Wang, Z., Tang, Y., Liu, D., Zhang, B., Νικολακόπουλος, Α. Ν., Itabada, P. S., Zhang, J., Chou, C.-C., Gao, P., et al. (2026) · Lecture notes in computer science · doi:10.1007/978-981-92-2759-4_9
“Self-Refine [24] uses iterative self-critique, Reflexion [25] maintains verbal reflections in episodic memory, and Malt [26] improves reasoning through multi-agent training.”
RILEE: Reasoning-Intensive Legal Element Extraction via Hierarchical Re-answering
Wang, L., Hu, J., Ying, Y., Liu, Z., Zhou, Q., Guo, D., & Luo, C. (2026) · Lecture notes in computer science · doi:10.1007/978-981-92-2759-4_4
TEC: A Collection of Human Trial-and-error Trajectories for Problem Solving
Zhang, X., Zhan, J., Liu, Y., & Ai, Q. (2026) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3805712.3808611
Yin, B., & Yin, B. (2026) · Lecture notes in computer science · doi:10.1007/978-981-92-3417-2_49
Agentic mobile AI systems: From post-hoc optimization to runtime-elastic realization
Liu, S., Wu, W., Xu, X., Li, T., Pang, B., Zhou, W., Guo, B., & Yu, Z. (2026) · Information Fusion · doi:10.1016/j.inffus.2026.104630
Genetic Evolution of Domain Expertise with Multi-agent Collaboration
Huang, R., Tan, W., Hu, Y., Wang, Z., Peng, M., & Yang, J. (2026) · Lecture notes in computer science · doi:10.1007/978-981-92-3435-6_9
Liu, S., & Zhu, W. (2026) · Communications in computer and information science · doi:10.1007/978-981-92-3551-3_27
Kamal, R., & Kumar, N. (2026) · International Conference on Secure Cyber Computing and Communications (ICSCCC) · doi:10.1109/icsccc69031.2026.11600052
A Multi-Stage Agentic Approach to Factuality-Aware Long and Multi-Document Text Summarization
Khandar, P. V., Mohanty, D. K., & Baliarsingh, S. K. (2026) · International Conference on Innovations in Communication, Geoscience and Robotics (ICICGR) · doi:10.1109/icicgr68236.2026.11600371
CHORUS++: An agentic RAG framework with iterative refinement for linear programming code generation
Ahmed, T., & Choudhury, S. (2026) · Annals of Mathematics and Artificial Intelligence · doi:10.1007/s10472-026-10017-1
Understanding the Evolving Threat Landscape of Generative and Agentic Artificial Intelligence
Mohapatra, H. (2026) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-2600-0368-8.ch002
LEOPARD: A Structured LLM Orchestration Framework for Precision-Centric Grammatical Error Correction
Ashrafi, N. S., Mediani, M., & Bouktif, S. (2026) · 2026 International Conference on Frontiers of Engineering and Emerging Technologies (FET) · doi:10.1109/fet68771.2026.11601896
“Similarly, Shinn et al. [11] proposed “Reflexion,” using verbal reinforcement learning to guide agents.”
Self-Backtracking: Internalizing Search for Efficient LLM Agent Planning
Wu, Z. W., & Wang, C. R. (2026) · Communications in computer and information science · doi:10.1007/978-981-92-3557-5_9
Closed-Loop Recovery Mechanism for Multi-agent Process Planning Under Manufacturing Constraints
Yin, B., & Sun, N. (2026) · Lecture notes in computer science · doi:10.1007/978-981-92-3403-5_13
Ma, J., Wang, C., Zhang, Y., Wang, Q., Yang, W., & Zhao, Z. (2026) · Lecture notes in computer science · doi:10.1007/978-981-92-3403-5_9
MDTace: Agentic Context Engineering for Multi-disciplinary Team Medical Consultation
Chen, K., & Gao, Y. (2026) · Lecture notes in computer science · doi:10.1007/978-981-92-3403-5_6
AdaInertia: Dynamic Tool Usage Inertia Control via Deep Q-Learning for Efficient LLM Agent Reasoning
Hu, Y., Zhao, Y., Huang, Y., Dong, G., Zhang, B., Di, M., & Wang, C. (2026) · Lecture notes in computer science · doi:10.1007/978-981-92-3381-6_37
From Trajectories to States: State-Constrained Plan Execution for LLM Agents
Chen, Q., Yu, Y., Cheng, N., Guo, R., Yin, R., & Wang, X. (2026) · Lecture notes in computer science · doi:10.1007/978-981-92-3403-5_4
Task Planning with Explicit Graphs and Learnable Constraints
Wu, Z., & Wang, C. (2026) · Lecture notes in computer science · doi:10.1007/978-981-92-3403-5_15
57Chapter 3 Key Technologies Driving the Agentic AI Paradigm
Rakhi, S., Singhal, N., Saxena, S., & Sundaravadivazhagan, B. (2026) · De Gruyter eBooks · doi:10.1515/9783112223062-003
He, C., Li, Y., Yang, J., & Zhao, S. (2026) · Applied Sciences · doi:10.3390/app16147213
Multi-Agent OSINT System: Strategic Planning and Graph-Based Verification
Hasret, B., Türk, A., Çiçek, D., Şimşek, H. Z., & Baykara, M. (2026) · International Symposium on AI-Driven Engineering Systems (ISADES) · doi:10.1109/isades69945.2026.11608218
GEM: Graph-Evidence Executive Planning for Lightweight LLM Agents in Text-Based Embodied Tasks
Xu, S., Xie, W., & Zuo, T. (2026) · International Conference on Internet of Things, Automation and Artificial Intelligence (IoTAAI) · doi:10.1109/iotaai70471.2026.11607778
Liu, Q., Wang, M., & Xie, J. (2026) · 2026 6th International Conference on Machine Learning and Intelligent Systems Engineering (MLISE) · doi:10.1109/mlise70044.2026.11607496
“FIFO buffers discard entries indiscriminately, MemoryBank [11] relies on decay rather than correctness, and Reflexion [9] stores verbal self-critiques without independent verification.”
InfluentialSchneider, H. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-33195-3_20
Multi-Agent LLM Pipeline for Code Writing: An Experimental Study of Writer-Reviewer Architecture
Ekiz, T. K., & Konyar, M. Z. (2026) · ADBA computer science. · doi:10.69882/adba.cs.2026071
Chang, E. Y. (2026) · ACM eBooks · doi:10.1145/3822380.3822392
“Huang et al. [2024] show LLMs cannot self-correct without external feed back; Reflexion [Shinn et al. 2023] and extended chain-of-thought [OpenAI 2024] improve within-framework reasoning, but paradigm shifts require stepping outside the reasoning chain.”
Yin, X., Chen, Z. Q., Shen, Y., & Lee, T. H.-Y. (2026) · Applied Sciences · doi:10.3390/app16157396 · Cited by 1
Do influence tactics matter? investigating prompt framing effects in LLM code generation
Deaconu, A., Gupta, A., Basha, M., Haydu, N., & Rodríguez-Pérez, G. (2026) · Empirical Software Engineering · doi:10.1007/s10664-026-10934-z · Cited by 1
“For example, Reflexion uses the model’s own feedback to detect and correct errors in subsequent iterations [57].”
Grounding Corporate Environmental Claims in Satellite Evidence with Large Language ModelsPreprint
Vaghefi, S. A., Senni, C. C., Huggel, C., & Leippold, M. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.7084378
Leveraging Large Language Model Agents for Autonomous Software Testing and Intelligent Automation
Arumalla, R. K. R. (2026) · International Conference on Computer Networks, Big Data and IoT (ICCBI) · doi:10.1109/iccbi68589.2026.11619891
Grounded Refusal in Dialogue Troubleshooting Agents via Constrained Reinforcement Learning
Li, X., Jin, D., Chen, S., Li, W., & Guo, J. (2026) · International Conference on Computer Intelligence and Software Engineering (CICSE) · doi:10.1109/cicse70286.2026.11620948
“At the same time, tool-using and agentic models indicate that language models can decide when to call external functions [3], interleave reasoning and actions [4], and refine decisions with feedback over multiple attempts [5].”
Feedback Granularity in Bounded Repair of LLM-Generated PDDL Domains
Zhang, Y., Li, N., Zhou, Z., & Lu, Y. (2026) · International Conference on Artificial Intelligence, Big Data and Algorithms (CAIBDA) · doi:10.1109/caibda70336.2026.11621110
“…[21] applies iterative self-feedback to a range of generation tasks (e.g., code optimization, dialogue response, mathematical reasoning), and Reflexion [22] extends this idea with episodic verbal feedback for language agents on sequential decision-making, coding, and language-reasoning benchmarks.”
OmegaClaw: A Continually Operating Agentic Architecture Under Bounded Resources
Botnick, M., Hammer, P., Isaev, P., Goertzel, B., & Crawford, K. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-33010-9_22
EvoMod: Evolutionary Optimization of Modular Prompts for Biomedical Relation Extraction
Yang, L., Zhan, J. Z., & Chen, J. (2026) · ACM International Conference on Bioinformatics, Computational Biology, and Health Informatics (ACM-BCB) · doi:10.1145/3807503.3819434
Dynamic Workflow Orchestration with Executability Verification for Multi-Agent AutoML Task Execution
Deng, L., Yan, J., Cao, C., Zhao, M., & Jin, S. (2026) · International Conference on Artificial Intelligence, Big Data and Algorithms (CAIBDA) · doi:10.1109/caibda70336.2026.11621590
MAGen: Multi-agent smart contract generation with automated testing and verification
Liu, L., Ke, W., Chi, H., & Yan, J. (2026) · Empirical Software Engineering · doi:10.1007/s10664-026-10931-2
“Reflexion introduces reflective reasoning that steers iterative improve - ment toward specification conformance (Shinn et al. 2023).”
ReDesign: Recovering Editable Design Structures from Images via Agentic Decomposition
Yun, J., Park, J., Lim, H., Hyung, J., Chung, H., & Choo, J. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37255-0_16
MERIT: A Multi-Signal Repair Framework for Code Translation with Large Language Models
Guo, J. (2026) · International Conference on Big Data & Artificial Intelligence & Software Engineering (ICBASE) · doi:10.1109/icbase70763.2026.11619379
“4) Signal 4: LLM Self-Reflection: Inspired by Reflexion [11] and Self-Refine [12], we add a reflection step before repair.”
Zhong, C., Wu, S., Yu, J., Wu, W., Herremans, D., & Zhang, K. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.7199726
Liu, F., Zhu, E., Tan, J., Tong, J., Wang, T., & Zhang, S. (2026) · IEEE Open Journal of the Communications Society · doi:10.1109/ojcoms.2026.3718178
“Inspired by the Reflexion architecture [21], it utilizes an LLM to evaluate recent access behavior and generate semantic optimization suggestions.”
Agentic Metaverse Services: A New As-a-Service Paradigm
Xu, X., Sheng, Q. Z., Wang, Z., Benatallah, B., Wang, X., & Han, R. (2026) · IEEE International Conference on Web Services (ICWS) · doi:10.1109/icws72778.2026.00162
“Chain-of-Thought prompting [12] and ReAct [13] enabled explicit reasoning and tool invocation, while Toolformer [14], Reflexion [15], and Generative Agents [16] further extended tool-use learning, self-reflection, and emergent social behavior [5].”
Autonomous Agent-Based Observability Framework for Cloud-Native Systems - SENTINEL
Srinivasan, S., Sankararaman, G. S., & Kumar, A. K. (2026) · IEEE Cloud Summit · doi:10.1109/cloudsummit68932.2026.00045
“Recent work on LLM-backed autonomous agents (Park et al., 2023; Shinn et al., 2023; Yao et al., 2023) [7] [8] [10] has demonstrated the ability of language models to perform multi-step reasoning, invoke external tools, and complete complex tasks with minimal human guidance.”
From Redundancy to Precision: Constructing a Compressed Tree-Based Experiential Case Base for LLMs
Xie, M., Xu, Y., & Li, J. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-33865-5_25
Beyond Trajectory: Explicit Case-Based Memory for Decision-Making in Multimodal GUI Agents
Zhang, Y., & Zheng, A. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-33865-5_21
TextBFGS: A Case-Based Reasoning Approach to Code Optimization via Error-Operator Retrieval
Zhang, Z., Liao, Y., Chen, C., He, J., Wu, D., Yu, Q., Gao, Y., Yang, J., Zhang, K., Zhong, X., et al. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-33865-5_19
“Reflexion [20], REVOLVE [30], and HessianGrad [29] utilize short-term memory or meta-prompt optimization [21] to avoid repeating immediate errors.”
TRIP: A Bi-level Travel Routing Intelligent Planner Informed from Human Planning Behaviors
Liu, Y., Zhang, R., Chen, Y., Sun, L., & Zhu, T. (2026) · ACM Transactions on Knowledge Discovery from Data · doi:10.1145/3836768
“Even with the Reflexion module [33] aiding in self-reflection to identify inconsistencies, it is challenging to effectively combine its current reasoning with returned results to make appropriate corrections.”
The Human Layer of Agentic AI Memory: What Self-Improving LLM Systems Actually Learn in Production
Parameswaran, A., Hussain, W., & Hossain, M. N. (2026) · Studies in big data · doi:10.1007/978-3-032-31204-4_3
A Multi-agent AI System for Automated Patent Deep Research and Analysis
Sofean, M., & Aras, H. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-34374-1_20
Mozi-TSEIP: Task Self-Evolution in Multi-Agent Systems
Liu, X., Qi, F., Li, X., Chu, D., Yuan, Y., Du, H., & Zhang, R. (2026) · Lecture notes in electrical engineering · doi:10.1007/978-981-92-0232-4_54
MileGraph: Flexible Task Control via Milestone-Guided Hierarchical Planning for LLM Agents
Yang, D., & Sun, Q. (2026) · Communications in computer and information science · doi:10.1007/978-3-032-34189-1_15
A Generative AI-Based Framework for Business Process Orchestration in Industrial Enterprises
Ilieva, G., & Iliev, Y. (2026) · Electronics · doi:10.3390/electronics15153392
IKEA: Intelligent Knowledge Extraction with Reasonable and Agentic AI Agents
Alghamdi, M. M. M., & Alamri, W. A. (2026) · Applied Sciences · doi:10.3390/app16157704 · Cited by 1
Multi-agent Capability Assessment Based on Agent Cards and Dynamic Interaction Profiles
Sun, Q., & Yang, D. (2026) · Communications in computer and information science · doi:10.1007/978-3-032-34189-1_14
A Platform-Aware Survey of Execution, Verification, and Risk of Graphical User Interface Agents
Wu, Y., & Yang, Y. (2026) · ENGINEERING Information Technology & Electronic Engineering · doi:10.1631/eng.itee.2026.0103 · Cited by 1
Husk, S. (2026) · AI and Ethics · doi:10.1007/s43681-026-01300-2
“Pre-registration is the established mechanism for distinguishing confirmatory from exploratory empirical work [ 19, 20], and is increasingly adopted in AI and machine learning research as a structural response to the field’s reproducibil - ity concerns [ 21–23].”
Huang, Y., Li, Y., Chen, X., & Chen, B. M. (2026) · International Conference on Control and Automation · doi:10.1109/icca69928.2026.11618077
“The orchestrator-worker pattern [23] has become the dominant multi-agent design, with isolated sub-agent contexts shown to cut setup time from weeks to hours [13] and human-in-the-loop review before execution [24].”
Shingavi, H., Ranbhare, Y., Shasri, E., & Wadmare, J. G. (2026) · SN Computer Science · doi:10.1007/s42979-026-05256-2
“Emerging approaches, such as Tree-of-Thought (ToT) reasoning [ 21 ] and Reflexion frameworks [ 33], are expanding these capabilities with self-corrective learning loops where agents iteratively improve on negotiating strat - egies and policies.”
Luo, J., Liu, M., Huang, Z., Ke, Z., & Wang, Q. (2026) · Electronics · doi:10.3390/electronics15153452
A Multi-Head Attention Approach for SLA Compliance Monitoring in Data Centers
Thapliyal, O. (2026) · IEEE International Conference on Distributed Computing Systems Workshops (ICDCSW) · doi:10.1109/icdcsw72724.2026.00033
“The orchestrator routes relevant excerpted text, and adds a context to each researcher, triggering the needed number of research agents in parallel [11], [12].”
Kim, D. K., Lee, Y.-W., & Jeong, J.-S. (2026) · Applied Sciences · doi:10.3390/app16157733
Metadata
- Authors
- Shinn, N., Cassano, F., Berman, E., Gopinath, A., Narasimhan, K., & Yao, S.
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2023
- Pages
- 8634-8652
- ISSN
- 1049-5258 (ISSN-L)
- arXiv
- 2303.11366
- OpenAlex
- W7133222210
- Cited by
- 1,087
- References
- 0
- Citations by year
- 2026: 760 · 2025: 167 · 2024: 105 · 2023: 55
- FWCI
- 192.15
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- neural information processing systems (publishedVersion)
- arXiv (Cornell University) (submittedVersion, cc-by)
- arXiv (Cornell University) (cc-by)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Keywords
- language agents, verbal behavior, language acquisition
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-01, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-01 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.