Reflexion: Language Agents with Verbal Reinforcement Learning
Open accessThe DOI matches its DataCite record; 42 of the 42 references it cites were found in a registry or an index; 7 of the 8 sources its claims cite were checked for support.
Abstract
Large language models (LLMs) have been increasingly used to interact with external environments (e.g., games, compilers, APIs) as goal-driven agents. However, it remains challenging for these language agents to quickly and efficiently learn from trial-and-error as traditional reinforcement learning methods require extensive training samples and expensive model fine-tuning. We propose Reflexion, a novel framework to reinforce language agents not by updating weights, but instead through linguistic feedback. Concretely, Reflexion agents verbally reflect on task feedback signals, then maintain their own reflective text in an episodic memory buffer to induce better decision-making in subsequent trials. Reflexion is flexible enough to incorporate various types (scalar values or free-form language) and sources (external or internally simulated) of feedback signals, and obtains significant improvements over a baseline agent across diverse tasks (sequential decision-making, coding, language reasoning). For example, Reflexion achieves a 91% pass@1 accuracy on the HumanEval coding benchmark, surpassing the previous state-of-the-art GPT-4 that achieves 80%. We also conduct ablation and analysis studies using different feedback signals, feedback incorporation methods, and agent types, and provide insights into how they affect performance.
Overview
CoChat Summary
TL;DR
Reflexion reinforces language agents through verbal self-reflection stored in episodic memory rather than weight updates, improving performance across decision-making, reasoning, and coding tasks. It reports gains including 91% pass@1 on HumanEval, a 22% absolute improvement on AlfWorld, and 20% on HotPotQA.
Key findings
- On HumanEval Python, Reflexion achieves 91.0 pass@1, surpassing the previous state-of-the-art GPT-4 at 80.1; on HumanEval Rust it reaches 68.0 vs. 60.0, MBPP Rust 75.4 vs. 70.9, and Leetcode Hard 15.0 vs. 7.5.
- In AlfWorld, ReAct + Reflexion completes 130 out of 134 tasks using a simple heuristic and improves over strong baselines by an absolute 22% over 12 iterative learning steps; ReAct-only converges at a 22% hallucination rate with no long-term recovery.
- In HotPotQA, Reflexion improves over baselines by 20%; self-reflection gives an 8% absolute boost over episodic memory alone, and although CoT (GT) fails on 39% of questions, Reflexion improves accuracy by 14% without access to ground-truth answers.
- Ablations on the 50 hardest HumanEval Rust problems show full Reflexion at 0.68 vs. baseline 0.60; omitting test generation drops to 0.52, and omitting self-reflection stays at 0.60.
Methods
- Reflexion uses a modular loop with an Actor that generates text/actions, an Evaluator that scores outputs, and a Self-Reflection model that converts feedback into verbal summaries stored in memory; trials repeat until the Evaluator passes or a max trial count is reached, with memory usually bounded to 1–3 experiences.
- Experiments cover AlfWorld (134 environments, six tasks, ReAct + GPT-3), HotPotQA (100 questions, CoT/ReAct, exact-match grading, memory size 3), and programming (HumanEval, MBPP, LeetcodeHardGym; Python/Rust via MultiPL-E; self-generated unit tests up to 6).
- Ablations and analyses vary feedback signals, feedback incorporation methods, and agent types; compromised approaches are tested on HumanEval Rust, and a WebShop experiment is run across 100 environments.
Limitations
- The paper states Reflexion may fall into non-optimal local minima, limits long-term memory to a sliding window with maximum capacity, and notes code-generation test-driven development is limited by non-deterministic, impure, hardware-dependent, or concurrent functions; it also relies on LLM self-evaluation/heuristics and lacks a formal success guarantee.
- The paper reports WebShop failure: after only four trials the agent shows no improvement and does not generate helpful self-reflections, concluding Reflexion cannot solve tasks requiring significant diversity and exploration.
- Evident from the text: self-correction is an emergent quality of stronger, larger models—starchat-beta shows no improvement (baseline 0.26 vs. Reflexion 0.26)—and flaky or incorrect test suites can cause false positives/negatives, with false negatives preferred.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
4 Valid · 2 Not valid · 0 Not checked · 59 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Therefore, in the case in which the model generates a flaky test suite, it is possible that all tests pass on an incorrect solution and lead to a false positive label on a code completion [11].”
§ Reflexion: Language Agents with Verbal Reinforcement Learning > Analysis
What the sources say
- Partly supportedcites [11] 11. Lam, W., Winter, S., Wei, A., Xie, T., Marinov, D., and Bell, J. (2020). A large-scale longitudinal study of flaky tests. Proc. ACM Program. Lang., 4(OOPSLA). sourceExperimental — accuracy not yet measured
The Introduction (page not provided) says a flaky test can pass and fail on the same code and that changes may be merged when all tests pass. It does not address model-generated test suites, incorrect code completions, or false-positive labels, so those parts of the claim are not established by this paper. (LLM, conf=0.82)
hedgedstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“3 shows an inferior 52% vs 60% (baseline) accuracy, which suggests that the agent is unable to determine if the current implementation is correct without unit tests.”
§ Reflexion: Language Agents with Verbal Reinforcement Learning > Ablation study
hedgedstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“ReAct + Reflexion significantly outperforms ReAct by completing 130 out of 134 tasks using the simple heuristic to detect hallucinations and inefficient planning.”
§ Reflexion: Language Agents with Verbal Reinforcement Learning > Results
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“4 shows that self-reflection improves learning by an 8% absolute boost over the episodic memory learning advantage.”
§ Reflexion: Language Agents with Verbal Reinforcement Learning > Analysis
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“on reasoning questions in HotPotQA [28] by 20%”
- Also stated in: § 4 Experiments · plain
“Most notably, Reflexion improves performance over strong baselines by 22% in AlfWorld, 20% in HotPotQA, and 11% on HumanEval.”
§ Reflexion: Language Agents with Verbal Reinforcement Learning > 1 Introduction
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § 4 Experiments · plain
30 more claims
Create a free account to see all 65 claims and every source verdict.
- It may state two separate claims as one. 18
- Probably not a substantial claim. 11
- The quote only partly states this claim. 3
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source doesn’t support the claim as written.
In the citing paper
“Memory and reflection systems such as MemAgent (Yu et al., 2025a), Reflexion (Shinn et al., 2023), and Generative Agents (Park et al., 2023) improve retrieval and episodic memory, but do not perform context shaping, state restructuring, or nextinstruction refinement.”
From PAACE: A Plan-Aware Automated Agent Context Engineering Framework (2025) · cites this paper as Shinn et al., 2023
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe cited source doesn’t support the claim as written.
In the citing paper
“However, Reflexion computes verbal reward over a full trajectory, yielding a single end-of-episode signal that conflates credit across reasoning steps: a failure due to a single intermediate error receives the same critique pressure as one due to a flawed strategy.”
From Process Supervision via Verbal Critique Improves Reasoning in Large Language Models (2026) · cites this paper as Shinn et al. [2023]
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe cited source doesn’t support the claim as written.
In the citing paper
“Unlike Reflexion, which only reflects on unsuccessful trajectories, our approach separately reflects on both successful and unsuccessful ones.”
From An Efficient Context-Dependent Memory Framework for LLM-Centric Agents (2025) · cites this paper as Shinn et al., 2023
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe cited source doesn’t support the claim as written.
In the citing paper
“The dominant approach is to curate memory at write time.”
From Just-in-Time Memory: Learning to Curate Task-Adaptive Memory for LLM Agents (2026) · cites this paper as Shinn et al., 2023
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Interaction and code generation are increasingly used together, with code as the modality of choice for actions [48, 59], tool construction [13, 51, 69], and reasoning [39, 66, 67].”
From SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineering (2024) · cites this paper as [39]
Experimental — accuracy not yet measured
107 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Reflexion: Language Agents with Verbal Reinforcement Learning > 3 Reflexion: reinforcement via verbal reflection
“while M e not pass or t < max trials do”
§ Reflexion: Language Agents with Verbal Reinforcement Learning > Self-reflection
“The Actor, Evaluator, and Self-Reflection models work together through trials in a loop until the Evaluator deems τ t to be correct.”
Citations
Cites
The publisher hasn’t deposited this paper’s reference list.
Cited by
Items 1,601–1,700 of 3,537
Multi-round self-optimization with large language models for conversational recommendation
He, Q., Zhang, Y., Li, K., Li, X., & Wang, X. (2026) · Applied Intelligence · doi:10.1007/s10489-026-07165-6 · Cited by 1
Dominić, I., S, M. K. H., Nandakumar, R. G., & Regunathan, R. (2025) · International Conference on Signal Processing, Computation, Electronics, Power and Telecommunication (IConSCEPT) · doi:10.1109/iconscept66142.2025.11436852 · Cited by 1
“Inspired by the Reflexion Agent architecture [27], this stage introduces an additional layer of validation before a summary is either accepted or rejected.”
Wei, Z., Chen, G., Xu, Y., Yang, X., Cao, M., & Minyi, L. (2026) · PLoS ONE · doi:10.1371/journal.pone.0344565 · Cited by 1
“This limit was informed by empirical patterns in iterative refinement [49], where performance gains typically plateau after the initial few cycles, allowing us to balance extraction quality with computational costs.”
VSP: Diagnosing the Dual Challenges of Perception and Reasoning in Spatial Planning Tasks for MLLMS
Wu, Q., Zhao, H., Saxon, M., Bui, T., Wang, W. Y., Zhang, Y., & Chang, S. (2025) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51701.2025.00219 · Cited by 16
“Many works explore the best ways to activate the planning capabilities of LMs, including divide and conquer [49, 61, 66, 67], grounding outputs in admissible actions [4, 28], retrospecting and refining [41, 50], and leveraging external tools [25, 46].”
Ho, T.-L., & Lam, T.-P. (2026) · Applied Sciences · doi:10.3390/app16094400 · Cited by 5
LLM-driven smart agents using tools for the recovery of interdependent infrastructure networks
Wang, H., Zhou, S., Chen, Z., Li, D., Wang, J., Wu, S., & Ng, S. T. (2026) · Expert Systems with Applications · doi:10.1016/j.eswa.2026.132701 · Cited by 2
The Silent Scholar Problem: A Probabilistic Framework for Breaking Epistemic Asymmetry in LLM Agents
Chong, Z., Ohsaki, H., & Ng, B. (2026) · IEEE International Conference on Robotics and Technologies for Industrial Automation (ROBOTHIA) · doi:10.1109/robothia68364.2026.11506698 · Cited by 1
LLM-Enhanced Deep Reinforcement Learning for Task Offloading in Collaborative Edge Computing
Hao, 郭. G., Xv, K., Ge, Z., & Yang, L. (2026) · IEEE International Conference on Sensing, Communication, and Networking (SECON) · doi:10.1109/secon68281.2026.11579040 · Cited by 1
“Reflexion [27]. an LLM-driven baseline that prompts Qwen3-4B with structured task–state–outcome tuples and uses iterative self-feedback to refine decentralized offloading decisions during training.”
Prompt Engineering Based Factivity Hallucination Alleviation System for Large Language Models
Yang, H., Zeng, N., Cui, T., & Lin, Q. (2026) · International Annual Conference on Complex Systems and Intelligent Science (CSIS-IAC) · doi:10.1109/csis-iac70275.2026.11585163 · Cited by 1
“ReAct interweaves reasoning and action, while Reflexion utilizes verbal self reflection for iterative improvement [24] [25].”
Taricco, G. (2026) · Entropy · doi:10.3390/e28070811 · Cited by 1
Toward Human-Centered Explanations for Agentic AI: Taxonomy, Mapping, and Evaluation
Hou, X., Mualla, Y., & Dridi, M. (2026) · International Conference on Human Centric Artificial Intelligence (ICHCAI) · doi:10.1109/ichcai70183.2026.11607607 · Cited by 2
“Recent work shows that chain-of-thought rationales produced by LLMs often fail to reflect the model’s actual decision process [1], [42], a concern that becomes more acute in agen-tic systems where reasoning traces drive tool use and self-reflection [5], [7].”
Can large language models be a cardinality estimator? An empirical study
Liu, L., Wu, Y., Wang, Y., Chang, Z., Su, R., Wu, P., Chen, J., Jiang, F., Shi, R., Cui, B., et al. (2026) · The VLDB Journal · doi:10.1007/s00778-026-00975-7 · Cited by 1
Choi, H., & Ha, J.-E. (2026) · International Journal of Precision Engineering and Manufacturing · doi:10.1007/s12541-026-01548-y · Cited by 1
The Agentic Frontier: Artificial Intelligence in Commercial Real Estate
Seagraves, C., Seiler, M. J., & Sirmans, S. (2026) · Journal of Real Estate Research · doi:10.1080/08965803.2026.2665905 · Cited by 3
Rocha, A., de Oliveira, P. C., Ferreira, J. P., Alves, M., & Sousa, A. J. (2026) · Applied Sciences · doi:10.3390/app16157745 · Cited by 1
KC-Agent: A Dual-Process Cognitive Architecture for Efficient ML Model Improvement
Bravo-Rocca, G., Guitart, J., Dholakia, A., Ellison, D. D., & Jain, P. K. (2026) · IEEE Annual International Computer Software and Applications Conference (COMPSAC) · doi:10.1109/compsac69091.2026.00186 · Cited by 1
“Tree of Thoughts [13] explores multiple reasoning paths simultaneously, while Reflexion [7] incorporates self-reflection mechanisms to learn from failures.”
Constructive Specification for Plug-and-Play Learnware Agents
Liu, J.-D., Zhao, Z.-C., Sun, H., Wu, L.-X., Zhang, H., Wang, P., Zhao, M., Chu, X., Yan, S., Zhu, Y., et al. (2026) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3770855.3817996 · Cited by 3
Xiang, J., Ye, T., Liu, P., Zhang, Y. Z., & Wang, W. (2026) · ACM/IEEE International Conference on Model Driven Engineering Languages and Systems (MODELS) · doi:10.1145/3822455.3830313 · Cited by 1
K-Lines: A Cognitively-Grounded Four-Memory Architecture for Persistent Conversational AIPreprint
Kende, R. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.6234218 · Cited by 1
Agentic AI Framework for Low-Resource Essay Evaluation via Scoring, Explanation, and Debate
Thapa, S., Rauniyar, K., Shiwakoti, S., Adhikari, S., Rashid, J., Kim, J., & Naseem, U. (2025) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata66926.2025.11402339 · Cited by 1
“Early work on reasoning-driven agents introduced methods like ReAct, which combined step-by-step reasoning with tool use to improve factual accuracy and decision making [34], and Reflexion, which enabled self-improvement through reflective feedback and iterative learning [24].”
MIRAI: Multimodal Intelligence via Reflective agentic AI for enterprise knowledge assistants
Pai, P. P., Sarkar, S., Sumanth, V. K., Gupta, V. K., Srivastava, G., & Manne, V. S. R. (2025) · IEEE Women in Technology Conference (WINTECHCON) · doi:10.1109/wintechcon66724.2025.11430100 · Cited by 1
“In a subsequent report, addition to ReAct framework, called Reflexion [8] was proposed to incorporate self-reflection mechanism.”
Training-Free Agentic AI: Probabilistic Control and Coordination in Multi-Agent LLM Systems
Hosseini, M. P., Shah, A., Qureshi, S., Huang, A., Miao, C., & Wei, W. (2026) · IEEE Annual International Computer Software and Applications Conference (COMPSAC) · doi:10.1109/compsac69091.2026.00034 · Cited by 1
“: Methods such as ReAct [3], Self-Refine [4], Reflexion [5], and Tree-of-Thoughts (ToT) [6] improve reasoning by coupling tool use, iterative self-feedback, episodic memory, or backtracking search.”
Xie, C., Zhu, D., Wang, Z., Zhang, H., & Wei, Z. (2026) · IEEE International Conference on Healthcare Informatics (ICHI) · doi:10.1109/ichi69079.2026.00234 · Cited by 1
“A single-prompt model augmented with chain-of-thought reasoning or a Reflexion-style self-check loop [6] could partially address these gaps, but the resulting audit trace remains an internal reasoning artifact rather than a set of separately parseable, failure-mode-specific outputs.”
The Impact of Generative AI on 6G Network Architecture and Service
Nurakhov, Y. S., Aibagarov, S., Kassymbek, N., Mukhanbet, A., Kumalakov, B., & Imankulov, T. (2026) · Electronics · doi:10.3390/electronics15071345 · Cited by 2
Zhou, X., Shao, X., Guo, R., & Liu, S. H. (2025) · IEEE International Conference on Computer and Communications (ICCC) · doi:10.1109/iccc68654.2025.11437995 · Cited by 1
Demirhan, H., & Zadrozny, W. (2026) · AI · doi:10.3390/ai7040131 · Cited by 1
“Reflexion introduced a form of self-correction in which an agent reviews its previous attempts and adjusts its next move [16].”
ReflectCAP: Detailed Image Captioning with Reflective Memory
Min, K., Kim, M., Lee, K.-I., Yoon, S., & Jung, K. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37556-8_27 · Cited by 1
Reflective Confidence: Correcting Reasoning Flaws via Online Self-Correction
Zeng, Q., Yang, J., & Wang, K. (2026) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp55912.2026.11463123 · Cited by 1
Enhancing Value Alignment of LLMs with Multi-Agent System and Combinatorial Fusion
Wu, Y., Bouneffouf, D., & Hsu, D. F. (2026) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp55912.2026.11460611 · Cited by 2
“Similarly, Reflexion [7] converts feedback into verbal self-supervision by having the model generate brief reflections that guide its subsequent attempts, yielding better reasoning performance without additional training.”
Iterative Refinement Loop: A Design Pattern for Code Generation with LLMs
Krisper, M., & Moling, D. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-19157-1_6 · Cited by 1
Dossier: Deep Research via Ledger-Driven Branching Search and Query Encoding Learning
Chabra, O., Ziems, N., Jiang, M., Khattab, O., & Balakrishnan, H. (2026) · ACM Conference on AI and Agentic Systems (CAIS) · doi:10.1145/3786335.3813122 · Cited by 1
From AI Agents to AI Scientists in Health: Emerging Landscape, Challenges, and the Path ForwardPreprint
Chen, Q., Wang, X., Zhou, R., Kim, H., Wang, S., Zhao, W., Liu, T., Riaz, I., He, L., Zhao, Y., et al. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.6889798 · Cited by 3
Sherson, J. F., Rafner, J. F., Reiter‐Palmon, R., Lebuda, I., Kjeldsen, F. B., Söllner, M., Kenett, Y. N., Emruli, B., Rindle, M., Weiss, S., et al. (2026) · Nordic Conference on Human-Computer Interaction · doi:10.1145/3821402.3830141 · Cited by 2
PEPA: A Persistently Autonomous Embodied Agent With Personalities
Liu, K., Li, Y., Zhu, L., & Zhang, W. (2026) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2026.3706956 · Cited by 1
“Authorized licensed use limited to the terms of the applicable license agreement with IEEE.”
ViKSeR: Visual Knowledge-Driven Self-Reinforcing Reasoning Framework
Wang, C., Zhang, C., Tian, Y., Zhou, Y., & Peng, Y. (2026) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2026.3707187 · Cited by 1
“Concretely, the PVLM first analyzes fine-grained visual knowledge provided by the F-VKE module, extracting factual information to serve as evidence for reasoning.”
RAP: Resource-Adaptive Planning for Efficient LLM Tool Calling in Edge Computing
Liu, T., Tang, Z., Guo, J., Lou, J., Wang, T., & Jia, W. (2026) · IEEE Conference on Computer Communications (INFOCOM) · doi:10.1109/infocom59046.2026.11571461 · Cited by 1
Improving Kazakh Abstractive Summarization with LLMs via Domain Adaptation and Self-Correction
Zhabayev, T., Tukeyev, U., Amirova, D., & Rakhmanberdi, N. (2026) · Information · doi:10.3390/info17070639 · Cited by 1
GI-Agent Search-Based LLM Agent for Code Optimization with Genetic Improvement
Lee, D., Langdon, W. B., & Petke, J. (2026) · doi:10.1145/3786162.3793232 · Cited by 1
“Zhang et al.’s AI-Assisted Software Development Framework (AISD) [26] leverages Reflexion [24] to iteratively refine code implementations based on feedback, achieving a 75.2% pass rate on benchmark tasks.”
InfluentialDelta Debugging for LLM-integrated Systems
Zhu, H., Mansur, M. N., Schäf, M., Chen, Z., Lepoint, T., & Visser, W. (2026) · IEEE/ACM International Conference on Software Engineering: Software Engineering in Practice (ICSE-SEIP) · doi:10.1145/3786583.3786854 · Cited by 1
Divi, V. R., Gullapalli, S., & Brahmandam, B. A. (2026) · International Conference on Electronics Representation and Algorithm (ICERA) · doi:10.1109/icera72709.2026.11666599 · Cited by 1
Qu, C., Cui, C., Lu, Z., ZHU, J., Yao, T., Guo, J., Xiong, J., Zhu, Y., Yang, Y., Landman, B. A., et al. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-38059-3_51 · Cited by 2
Wang, B., Wu, L., Guo, S., Wang, K., Wang, Q., Zhang, T., Liu, J., & Khan, H. U. (2026) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3805712.3809665 · Cited by 1
Dammu, P. P. S., Palkhiwala, A., Roosta, T. G., & Shah, C. (2026) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3805712.3808627 · Cited by 1
Stateful LLM Agents for Autonomous Capture-the-Flag Solving
Amine, A., Zayat, A., & Saab, S., Jr. (2026) · Cognitive Models and Artificial Intelligence Conference (AICCONF) · doi:10.1109/aicconf69182.2026.11600706 · Cited by 1
Deconstructing Superintelligence: Identity, Self-Modification and Différance
Perrier, E. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-33195-3_14 · Cited by 1
EzBlender: Efficient 3D Editing with Plan-and-ReAct Agent
Wang, H., Zhu, W., Tang, S., Wang, Z., Dong, X., Li, X., Chen, X., Bastola, A., Huang, X., Wang, Y., et al. (2026) · IEEE/CVF Winter Conference on Applications of Computer Vision Workshops (WACVW) · doi:10.1109/wacvw68408.2026.00146 · Cited by 5
“…contemporary agent designs have become far more complex and diverse, the boundary between general and specialized agents is rapidly blurring, with numerous variants (e.g., Reflexion [42], Supervisor [24]) extending the design space, and multi-agent collaboration further complicating the landscape.”
Hao, J., Bai, H., Dong, X., Dong, Z., Ji, W., Xie, D., & Guo, S. (2026) · Communications in computer and information science · doi:10.1007/978-981-92-1884-4_15 · Cited by 1
Hyper-KGGen: A Skill-Driven Knowledge Extractor for High-Quality Knowledge Hypergraph Generation
Huang, R., Feng, Y., Xue, R., Ying, S., Yong, J., Shi, C., Du, S., & Gao, Y. (2026) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3770855.3818198 · Cited by 1
“Reflexion [28] stores self-reflections as episodic memory and reuses them to steer later attempts.”
Causal Abstraction Learning for Multi-Modal Grounded Planning
Li, X., Yang, S.-M., Xu, Z., Xia, F., Sheng, Q. Z., & Yao, L. (2026) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3770855.3817995 · Cited by 2
Learning design skills as memory policies for agentic photonic inverse design
Chen, S., Shu, T., & Ren, S. (2026) · Knowledge-Based Systems · doi:10.1016/j.knosys.2026.116726 · Cited by 1
TRACE-QA: Task-routed constraint elimination for auditable multi-agent question answering
Lu, J., Chen, H., Zhu, Y., Xu, J., & Xu, A. (2026) · Journal of King Saud University - Computer and Information Sciences · doi:10.1007/s44443-026-01141-3 · Cited by 1
Toward Causal Reasoning in GeoAI : A Three‐Tier Framework for Spatial Decision Support
Niu, Y., Zhang, Z., Yuan, M., Cheng, T., & Li, W. (2026) · Transactions in GIS · doi:10.1111/tgis.70372 · Cited by 1
“…can refine their own outputs or accumulate skills through iterative self-refinement (Madaan et al. 2023), verbal reflections stored in memory (Shinn et al. 2023), skill accumulation with self-verification (Wang et al. 2023), and self-generated feedback for self-evolution (Lu et al. 2023),…”
Developing and Benchmarking Verification Algorithms to Improve Text-to-SQL Generation
Alrashed, T., Sukoon, M., Karger, D. R., & Noy, N. F. (2026) · Proceedings of the VLDB Endowment · doi:10.14778/3836663.3836721 · Cited by 2
“In code generation, researchers have explored direct critiques [4, 29, 30] to detect bugs or inconsistencies.”
SAGE-QA: Shared-context agentic graph-enhanced question answering for scientific reasoning
Hsu, Y.-C., & Buehler, M. J. (2026) · MRS Communications · doi:10.1557/s43579-026-01036-4 · Cited by 1
LLM‐Powered AI Agents in Materials Science: From Autonomous Design to Autonomous Experimentation
Jiang, T., Zhang, Z., Nie, M., Zhu, D., Meng, E., Wu, H., & Mao, X. (2026) · Advanced Functional Materials · doi:10.1002/adfm.78275 · Cited by 1
Li, Y., Liu, H., Chen, B., & Luo, J. (2026) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2026.116316 · Cited by 1
Jôrgensen, B. N., & Ma, Z. G. (2026) · Information · doi:10.3390/info17090923 · Cited by 4
: Evolving Agentic Omni Models via Symbolic Concept Learning
Liu, J., Li, J., Kuang, T., Liu, X., Mei, K., Wen, Y., & Liu, W. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37372-4_11 · Cited by 3
World-In-Loop: Online Correction via Event-Triggered World Models for Robust VLA Policies
Xu, S., Li, F., Luo, Y., Chen, Q., Yang, Y. F., Duan, Z., Chen, L., & Yang, Z.-X. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37083-9_37 · Cited by 2
Tropos$$^{+}$$: Tropos Extended in the Days of Large Language Models
Bresciani, P., Giorgini, P., Mylopoulos, J., Perini, A., & Susi, A. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-40795-5_26 · Cited by 1
PhotoAgent: A Robotic Photographer with Spatial and Aesthetic Understanding
Che, L., Gan, Z., Chen, Y., Tan, J., & Wang, X. (2026) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra57385.2026.11696515 · Cited by 1
“Building on ReAct, Reflexion [13], [14] introduces a self-improvement layer, where the agent summarizes and critiques its own past behaviors using language.”
InfluentialILSTMA: Enhancing Accuracy and Speed of Long-Term and Short-Term Memory Architecture
Ming, Z., Wu, Z., & Chen, G. (2025) · Information · doi:10.3390/info16040251 · Cited by 4
“Reflexion [34] Language Feedback Reinforcement Learning is a framework designed to enhance the learning process of language agents through their past interactions.”
Multi-Agent LLM System for Automatic Meeting Information Processing
Varjú, Á., & Varga, P. (2025) · IEEE/IFIP Network Operations and Management Symposium (NOMS) · doi:10.1109/noms57970.2025.11073611 · Cited by 1
EMRDCM : An experience-enhanced multi-role debate method based on compromise mechanisms
Zhang, Y., Feng, J., Yiming, X., Wang, Z., Yang, T., & Wang, X. (2026) · Journal of Intelligent Information Systems · doi:10.1007/s10844-026-01022-1 · Cited by 1
“Since our method is implemented by calling the LLM API, we compared our method with MAD and Reflexion, which are both API calling methods.”
InfluentialMeta-reasoning in autonomous agents: performance gains across benchmarks and models
Talukdar, W., Biswas, A., Shankar, G., Shinde, V., & Parekh, G. (2026) · Academia AI and Applications · doi:10.20935/acadai8229 · Cited by 2
Vista: Verifier-in-the-Loop Agentic Reinforcement Learning for Quantum Program Synthesis
Yu, C., Shi, T., Uotila, V., Deng, S., You, L., & Zhao, B. (2026) · ACM Conference on AI and Agentic Systems (CAIS) · doi:10.1145/3786335.3813148 · Cited by 1
“Existing execution-feedback methods improve code generation when checks are cheap and decisive, e.g., through reinforcement learning (RL) from test outcomes or iterative self-reflection over tool interaction [25, 42].”
Thought flow nets: From single predictions to trains of model thought
Schuff, H., Adel, H., & Vu, N. T. (2024) · Natural language processing. · doi:10.1017/nlp.2024.41 · Cited by 2
Mathis, W. S., Zhao, S., Pratt, N., et al. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4673015 · Cited by 1
Smetana, M., de Salles, L. S., & Khazanovich, L. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4804307 · Cited by 1
Ansaldo, G. (2023) · Digital Repository Service (Northeastern University) · doi:10.17760/d20621578 · Cited by 6
Liu, Y., Shen, R., Zhou, L., Xiao, Q., Yuan, J., & Li, Y. (2024) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2024.05.19.594895 · Cited by 1
Nakhost, M. A., Bloemer, A., & Minner, S. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5235972 · Cited by 1
An Interactive Agentic HPC Tutor for Lesson Planning, Teaching, and Assessment
Pautsch, E., Han, M., Insley, J. A., Knowles, J., Mateevitsi, V. A., Rizzi, S., & Thiruvathukal, G. K. (2025) · International Conference for High Performance Computing, Networking, Storage and Analysis (SC) · doi:10.1145/3731599.3767386 · Cited by 1
OmicOS: A Comprehensive Omics Ecosystem Infrastructure and Agent System for the AI EraPreprint
Zeng, Z., Meng, X., Hu, L., Li, C., Liu, P., Shi, Y., Ma, X., Gao, L., Wang, X., Luo, Z., et al. (2026) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.64898/2026.06.11.731775 · Cited by 1
ASPIRO: Any-shot Structured Parsing-error-Induced ReprOmpting for Consistent Data-to-Text Generation
Vejvar, M., & Fujimoto, Y. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.229 · Cited by 3
Intelligent Digital Agents in the Era of Large Language ModelsPreprint
Faught, B., Lu, H., Marshall, T., Sikka, H., Guruprasad, P., & Gauri, B. (2024) · OSF Preprints (OSF Preprints) · doi:10.31219/osf.io/f75wz · Cited by 2
DSKIPP: A Prompt Method to Enhance the Reliability in LLMs for Java API Recommendation Task
Yang, J., Wu, W., & Ren, J. (2025) · Software Testing Verification and Reliability · doi:10.1002/stvr.1913 · Cited by 3
“Secondly, the outputs derived from LLMs may not consistently be accurate, and the absence of reflection mechanisms can compromise their performance [21, 22].”
CRMR: A Collaborative Multistep Reasoning Framework for Solving Mathematical Problems
Zhang, Y., Tang, X., & Hao, K. (2025) · Machine Intelligence Research · doi:10.1007/s11633-024-1531-3 · Cited by 3
Application and progress of artificial intelligence agents in drug development
Zhao, D., & Hsieh, C. (2026) · Journal of Zhejiang University (Medical Sciences) · doi:10.3724/zdxbyxb-2025-0697 · Cited by 2
Taylor, P. (2026) · Frontiers in Computer Science · doi:10.3389/fcomp.2025.1639677 · Cited by 1
Making Enterprise AI Explainable through Calibrated Confidence and Provenance
Krstev, S., Devedžić, V., & Krneta, D. (2026) · Applied Artificial Intelligence · doi:10.1080/08839514.2026.2739513 · Cited by 1
DarwinX: Evolving Agent Harnesses Through Natural Selection
Zhang, Y., Dai, Y., Tan, J., Yang, L., Mullur, R., Hoang, T., Hu, Z., Zhu, J., Mui, P., Savarese, S., et al. (2026) · arXiv · doi:10.48550/arxiv.2608.07545 · Cited by 1
“Prompt optimizers search over instructions [12, 14, 49, 54, 60], and reflective variants reuse verbal feedback and trajectory distillation [2, 29, 34, 42], while DSPy and related programs compile prompts, demonstrations, or textual parameters against data [9, 23, 36].”
Agentic Harness Engineering: Observability-Driven Automatic Evolution of Coding-Agent Harnesses
Lin, J., Liu, S., Pan, C., Lin, L., Dou, S., Xi, Z., Huang, X., Yan, H., Han, Z., Gui, T., et al. (2026) · arXiv · doi:10.48550/arxiv.2604.25850 · Cited by 1
“Existing approaches mostly optimize individual harness components, typically the prompt [30, 44, 18] or an in-context playbook [43], with few jointly evolving the full set of editable components [15].”
SkillsBench: Benchmarking How Well Agent Skills Work Across Diverse Tasks
Li, X., Liu, Y., Chen, W., You, B., Di, Z., He, Y., Zheng, S., Choe, K. W., Sun, J., Wang, S., et al. (2026) · arXiv · doi:10.48550/arxiv.2602.12670 · Cited by 438
Lahmy, M., & Yozevitch, R. (2025) · arXiv · doi:10.48550/arxiv.2512.10787 · Cited by 1
“This confirms that SEAL-RAG is not relying on brute-force search or deep reflective loops like Reflexion [23].”
Memory for Autonomous LLM Agents:Mechanisms, Evaluation, and Emerging Frontiers
Du, P. (2026) · arXiv · Cited by 1
“Reflexion [Shinn et al., 2023] introduced a deceptively simple idea: after failing a task, have the agent write a natural language post-mortem, then prepend it to the prompt on the next attempt.”
InfluentialSearch Arena: Analyzing Search-Augmented LLMs
Miroyan, M., Wu, T.-H., King, L., Li, T., Pan, J., Hu, X., Chiang, W.-L., Angelopoulos, A. N., Darrell, T., Norouzi, N., et al. (2025) · arXiv · doi:10.48550/arxiv.2506.05334 · Cited by 1
“LLMs have made impressive advances in language understanding, dialogue generation, and reasoning, enabled by techniques such as large-scale pretraining [2, 3, 6, 18, 36, 56], chain-of-thought prompting [31, 59, 51, 58, 66], and reinforcement learning with human feedback (RLHF) [4, 43].”
Harness^2: Recursive Agent Harnessing for an Open World
Xu, R., Chen, Y., CuiZhu, Z., Mishra, B. D., Ming, Y., Yu, H., Han, R., Lee, C.-Y., & Pfister, T. (2026) · arXiv · doi:10.48550/arxiv.2610.14224 · Cited by 1
“Early approaches refine outputs through self-feedback or retain reflections for subsequent attempts (Madaan et al., 2023; Shinn et al., 2023).”
The Red Queen Gödel Machine: Co-Evolving Agents and Their Evaluators
Iacob, A., Jovanović, A., Shen, W. F., Burkhardt, D., Kurmanji, M., Tastan, N., Sani, L., Venanzi, N. A. E., Nie, J., Odonnat, A., et al. (2026) · arXiv · doi:10.48550/arxiv.2606.26294 · Cited by 1
“The node representation is the metacognitive workspace of HyperAgents [4]: each archive node is a shared workspace 𝑤 𝑎 with 𝐾 role agents plus a meta-agent that can edit the node’s code and coordination, while HGM search decides which lineage receives expansion and evaluation budget (App.”
A Multi-Agent Framework for Accessible Web Code Generation
Aljedaani, W., Shaik, M. A., & Aljohani, A. (2026) · Proceedings of the 23rd International Web for All Conference · doi:10.1145/3800424.3800453 · Cited by 1
“In principle, our repair procedure follows the reflect– revise paradigm [65, 67], where each repair step is driven by the accessibility tool flags reported in the A11y Report , which guide targeted code modifications toward WCAG compliance.”
Memory Injection Attacks on LLM Agents via Query-Only Interaction
Dong, S., Xu, S., He, P., Li, Y., Tang, J., Liu, T., Liu, H., & Xiang, Z. (2025) · arXiv · doi:10.48550/arxiv.2503.03704 · Cited by 124
MDTeamGPT: Mitigating Context Collapse and Enabling Self-Evolution in Medical Multi-Agent Reasoning
Chen, K., Li, X., Yang, T., Wang, H., Yang, G., Huo, J., & Gao, Y. (2026) · Findings of the Association for Computational Linguistics: ACL 2026 · doi:10.18653/v1/2026.findings-acl.1427 · Cited by 2
Failure as a Process: An Anatomy of CLI Coding Agent Trajectories
Zhao, X., Li, H., Li, S., Zhao, T., Barr, E. T., Sarro, F., & Ye, H. (2026) · arXiv · doi:10.48550/arxiv.2607.09510 · Cited by 17
“Follow-up works such as Reflexion [42] further form the basis of agent systems.”
Externalization in LLM Agents: A Unified Review of Memory, Skills, Protocols and Harness Engineering
Zhou, C., Chai, H., Chen, W., Guo, Z., Shan, R., Song, Y., Xu, T., Yang, Y., Yu, A., Zhang, W., et al. (2026) · arXiv · doi:10.48550/arxiv.2604.08224 · Cited by 1
Towards a Science of Scaling Agent Systems
Kim, Y., Gu, K., Park, C., Park, C., Schmidgall, S., Heydari, A. A., Yan, Y., Zhang, Z., Zhuang, Y., Liu, Y., et al. (2025) · arXiv · doi:10.48550/arxiv.2512.08296 · Cited by 197
“Single Agent System ( SAS ) serves as reference trajectories, while Multi Agent System ( MAS ) variants (Centralized, Decentralized, Independent, and Hybrid) reveal distinct scaling behaviors (see Table 2 for architecture comparisons).”
DebateQA: Evaluating Question Answering on Debatable Knowledge
Xu, R., Qi, X., Qi, Z., Xu, W., & Guo, Z. (2026) · Findings of the Association for Computational Linguistics: EACL 2026 · doi:10.18653/v1/2026.findings-eacl.44 · Cited by 1
A State-Aware Dual-Tool Architecture for Improved Tool Use in Multi-Turn LLM Dialogue
Pałgan, B., Wawryszczuk, M., Chwał, J., Tkacz, E., & Dzik, R. (2026) · Applied Sciences · doi:10.3390/app16094329 · Cited by 1
EvoX: Meta-Evolution for Automated Discovery
Liu, S., Agarwal, S., Maheswaran, M., Cemri, M., Li, Z., Mang, Q., Naren, A., Boneh, E., Cheng, A., Pan, M. Z., et al. (2026) · arXiv · doi:10.48550/arxiv.2602.23413 · Cited by 1
Context as a Tool: Context Management for Long-Horizon SWE-Agents
Liu, S., Yang, J., Jiang, B., Li, Y., Guo, J., Liu, X., & Dai, B. (2025) · arXiv · doi:10.48550/arxiv.2512.22087 · Cited by 35
Meta Context Engineering via Agentic Skill Evolution
Ye, H., He, X., Arak, V., Dong, H., & Song, G. (2026) · arXiv · doi:10.48550/arxiv.2601.21557 · Cited by 1
“While LLMs possess strong zero-shot capabilities, post-deployment context engineering (CE) is crucial for domain adaptation and self-improvement [Fang et al., 2025, Hu et al., 2025b, Khattab et al., 2023, Shinn et al., 2023, Yuksekgonul et al., 2025].”
Metadata
- Authors
- Shinn, N., Cassano, F., Berman, E., Gopinath, A., Narasimhan, K., & Yao, S.
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2023
- Pages
- 8634-8652
- ISSN
- 1049-5258 (ISSN-L)
- arXiv
- 2303.11366
- OpenAlex
- W7133222210
- Cited by
- 1,087
- References
- 0
- Citations by year
- 2026: 760 · 2025: 167 · 2024: 105 · 2023: 55
- FWCI
- 192.15
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- neural information processing systems (publishedVersion)
- arXiv (Cornell University) (submittedVersion, cc-by)
- arXiv (Cornell University) (cc-by)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Keywords
- language agents, verbal behavior, language acquisition
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-01, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-01 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.