Reflexion: Language Agents with Verbal Reinforcement Learning
Open accessThe DOI matches its DataCite record; 42 of the 42 references it cites were found in a registry or an index; 7 of the 8 sources its claims cite were checked for support.
Abstract
Large language models (LLMs) have been increasingly used to interact with external environments (e.g., games, compilers, APIs) as goal-driven agents. However, it remains challenging for these language agents to quickly and efficiently learn from trial-and-error as traditional reinforcement learning methods require extensive training samples and expensive model fine-tuning. We propose Reflexion, a novel framework to reinforce language agents not by updating weights, but instead through linguistic feedback. Concretely, Reflexion agents verbally reflect on task feedback signals, then maintain their own reflective text in an episodic memory buffer to induce better decision-making in subsequent trials. Reflexion is flexible enough to incorporate various types (scalar values or free-form language) and sources (external or internally simulated) of feedback signals, and obtains significant improvements over a baseline agent across diverse tasks (sequential decision-making, coding, language reasoning). For example, Reflexion achieves a 91% pass@1 accuracy on the HumanEval coding benchmark, surpassing the previous state-of-the-art GPT-4 that achieves 80%. We also conduct ablation and analysis studies using different feedback signals, feedback incorporation methods, and agent types, and provide insights into how they affect performance.
Overview
CoChat Summary
TL;DR
Reflexion reinforces language agents through verbal self-reflection stored in episodic memory rather than weight updates, improving performance across decision-making, reasoning, and coding tasks. It reports gains including 91% pass@1 on HumanEval, a 22% absolute improvement on AlfWorld, and 20% on HotPotQA.
Key findings
- On HumanEval Python, Reflexion achieves 91.0 pass@1, surpassing the previous state-of-the-art GPT-4 at 80.1; on HumanEval Rust it reaches 68.0 vs. 60.0, MBPP Rust 75.4 vs. 70.9, and Leetcode Hard 15.0 vs. 7.5.
- In AlfWorld, ReAct + Reflexion completes 130 out of 134 tasks using a simple heuristic and improves over strong baselines by an absolute 22% over 12 iterative learning steps; ReAct-only converges at a 22% hallucination rate with no long-term recovery.
- In HotPotQA, Reflexion improves over baselines by 20%; self-reflection gives an 8% absolute boost over episodic memory alone, and although CoT (GT) fails on 39% of questions, Reflexion improves accuracy by 14% without access to ground-truth answers.
- Ablations on the 50 hardest HumanEval Rust problems show full Reflexion at 0.68 vs. baseline 0.60; omitting test generation drops to 0.52, and omitting self-reflection stays at 0.60.
Methods
- Reflexion uses a modular loop with an Actor that generates text/actions, an Evaluator that scores outputs, and a Self-Reflection model that converts feedback into verbal summaries stored in memory; trials repeat until the Evaluator passes or a max trial count is reached, with memory usually bounded to 1–3 experiences.
- Experiments cover AlfWorld (134 environments, six tasks, ReAct + GPT-3), HotPotQA (100 questions, CoT/ReAct, exact-match grading, memory size 3), and programming (HumanEval, MBPP, LeetcodeHardGym; Python/Rust via MultiPL-E; self-generated unit tests up to 6).
- Ablations and analyses vary feedback signals, feedback incorporation methods, and agent types; compromised approaches are tested on HumanEval Rust, and a WebShop experiment is run across 100 environments.
Limitations
- The paper states Reflexion may fall into non-optimal local minima, limits long-term memory to a sliding window with maximum capacity, and notes code-generation test-driven development is limited by non-deterministic, impure, hardware-dependent, or concurrent functions; it also relies on LLM self-evaluation/heuristics and lacks a formal success guarantee.
- The paper reports WebShop failure: after only four trials the agent shows no improvement and does not generate helpful self-reflections, concluding Reflexion cannot solve tasks requiring significant diversity and exploration.
- Evident from the text: self-correction is an emergent quality of stronger, larger models—starchat-beta shows no improvement (baseline 0.26 vs. Reflexion 0.26)—and flaky or incorrect test suites can cause false positives/negatives, with false negatives preferred.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
4 Valid · 2 Not valid · 0 Not checked · 59 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Therefore, in the case in which the model generates a flaky test suite, it is possible that all tests pass on an incorrect solution and lead to a false positive label on a code completion [11].”
§ Reflexion: Language Agents with Verbal Reinforcement Learning > Analysis
What the sources say
- Partly supportedcites [11] 11. Lam, W., Winter, S., Wei, A., Xie, T., Marinov, D., and Bell, J. (2020). A large-scale longitudinal study of flaky tests. Proc. ACM Program. Lang., 4(OOPSLA). sourceExperimental — accuracy not yet measured
The Introduction (page not provided) says a flaky test can pass and fail on the same code and that changes may be merged when all tests pass. It does not address model-generated test suites, incorrect code completions, or false-positive labels, so those parts of the claim are not established by this paper. (LLM, conf=0.82)
hedgedstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“3 shows an inferior 52% vs 60% (baseline) accuracy, which suggests that the agent is unable to determine if the current implementation is correct without unit tests.”
§ Reflexion: Language Agents with Verbal Reinforcement Learning > Ablation study
hedgedstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“ReAct + Reflexion significantly outperforms ReAct by completing 130 out of 134 tasks using the simple heuristic to detect hallucinations and inefficient planning.”
§ Reflexion: Language Agents with Verbal Reinforcement Learning > Results
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“4 shows that self-reflection improves learning by an 8% absolute boost over the episodic memory learning advantage.”
§ Reflexion: Language Agents with Verbal Reinforcement Learning > Analysis
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“on reasoning questions in HotPotQA [28] by 20%”
- Also stated in: § 4 Experiments · plain
“Most notably, Reflexion improves performance over strong baselines by 22% in AlfWorld, 20% in HotPotQA, and 11% on HumanEval.”
§ Reflexion: Language Agents with Verbal Reinforcement Learning > 1 Introduction
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § 4 Experiments · plain
30 more claims
Create a free account to see all 65 claims and every source verdict.
- It may state two separate claims as one. 18
- Probably not a substantial claim. 11
- The quote only partly states this claim. 3
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source doesn’t support the claim as written.
In the citing paper
“Memory and reflection systems such as MemAgent (Yu et al., 2025a), Reflexion (Shinn et al., 2023), and Generative Agents (Park et al., 2023) improve retrieval and episodic memory, but do not perform context shaping, state restructuring, or nextinstruction refinement.”
From PAACE: A Plan-Aware Automated Agent Context Engineering Framework (2025) · cites this paper as Shinn et al., 2023
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe cited source doesn’t support the claim as written.
In the citing paper
“However, Reflexion computes verbal reward over a full trajectory, yielding a single end-of-episode signal that conflates credit across reasoning steps: a failure due to a single intermediate error receives the same critique pressure as one due to a flawed strategy.”
From Process Supervision via Verbal Critique Improves Reasoning in Large Language Models (2026) · cites this paper as Shinn et al. [2023]
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe cited source doesn’t support the claim as written.
In the citing paper
“Unlike Reflexion, which only reflects on unsuccessful trajectories, our approach separately reflects on both successful and unsuccessful ones.”
From An Efficient Context-Dependent Memory Framework for LLM-Centric Agents (2025) · cites this paper as Shinn et al., 2023
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe cited source doesn’t support the claim as written.
In the citing paper
“The dominant approach is to curate memory at write time.”
From Just-in-Time Memory: Learning to Curate Task-Adaptive Memory for LLM Agents (2026) · cites this paper as Shinn et al., 2023
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Interaction and code generation are increasingly used together, with code as the modality of choice for actions [48, 59], tool construction [13, 51, 69], and reasoning [39, 66, 67].”
From SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineering (2024) · cites this paper as [39]
Experimental — accuracy not yet measured
107 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Reflexion: Language Agents with Verbal Reinforcement Learning > 3 Reflexion: reinforcement via verbal reflection
“while M e not pass or t < max trials do”
§ Reflexion: Language Agents with Verbal Reinforcement Learning > Self-reflection
“The Actor, Evaluator, and Self-Reflection models work together through trials in a loop until the Evaluator deems τ t to be correct.”
Citations
Cites
The publisher hasn’t deposited this paper’s reference list.
Cited by
Items 1,101–1,200 of 3,537
AgentTrails: Towards Trust and Reuse for Agentic TasksPreprint
Wu, E., Castelo, S., Liu, Y., Silva, C. T., & Freire, J. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2607.18816 · Cited by 5
PATS: Policy-Aware Training Scaffolding for Agentic Reinforcement LearningPreprint
Shi, Y., Ma, Z., Wang, Y., Tan, Q., Li, Y., Chen, P., & Zhu, Z. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2607.21419 · Cited by 5
OneDayAgent: Towards a Long-Horizon Harness for Autonomous AgentsPreprint
Zheng, J., Fang, X., Zhang, J., Gui, Z., Chen, H., & Zhang, N. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2608.05013 · Cited by 5
“This design follows the feedback-and-revision pattern in LLM agents and generation systems [12, 13], while making the check artifact-level and task-global.”
When May an Agent Stop? Evidence-Carrying Termination for Tool-Using LLMsPreprint
Liu, J. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2608.23623 · Cited by 5
“ReAct-style agents interleave reasoning and action, while feedback and reflection can trigger another attempt [Yao et al., 2023, Shinn et al., 2023].”
He, S., Xie, L., Cao, Y., Chen, P., Duan, K., Ge, J., Huo, X., Shao, J., & Tian, Q. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2609.31770 · Cited by 6
“ReAct [10] interleaves reasoning and interaction with an environment; Reflexion [11] stores verbal reflections for later attempts.”
PhysEvo: Astra Can Act, Let ItPreprint
Tian, W., Zhang, Z., Liu, Z., Liu, F., Liu, Q., & Wang, L. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.08995 · Cited by 6
“Reflexion retains verbal feedback, and GEPA evolves prompts from execution traces (Shinn et al., 2023; Agrawal et al., 2025).”
Difficulty-Aware Hybrid Routing for Cost-Efficient Long-Context LLM Inference
Gu, Z., Xiao, Z., & Lin, O. (2026) · International Conference on Intelligent Communications and Computing (ICICC) · doi:10.1109/icicc71012.2026.11637729 · Cited by 5
“The router is trained on specific benchmark distributions, and out-of-distribution performance (e.g., creative writing, code generation) has not been evaluated[50-53].”
Stein, A., Mirzai, A., Axmann, J. K., & Vietor, T. (2026) · Digital engineering. · doi:10.1016/j.dte.2026.100098 · Cited by 6
The Hitchhiker’s Guide to Autonomous Research: A Survey of Scientific Agents
Wang, X., Xu, J., Lian, S., Chen, Y., Guo, H., Zhu, F., Shao, Y., Ren, M., Yi, H., Feng, A. H., et al. (2026) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2026.3721500 · Cited by 12
“…yet incorrect conclusions, subsequent work refines it: Du et al. [158] enlist several models to critique and reconcile their outputs, yielding more reliable consensus, while Reflex-ion [159] leverages structured linguistic feedback to reinforce agents without the pitfalls of traditional RL [159].”
PaVeRL-SQL: Text–to–SQL via Partial–Match Rewards and Verbal Reinforcement Learning
Hao, H., Hu, W., Verkholyak, O., Tarzanagh, D. A., Gutow, B., Didari, S., Faraki, M., Moon, H., & Min, S. (2025) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata66926.2025.11402412 · Cited by 4
Bai, J., Zhu, W., Wang, X., Kou, K., Guo, S., Liu, S., Li, D. D., Ni, T., Zhou, J., & Zhong, Y. (2026) · Scientific Reports · doi:10.1038/s41598-026-54971-6 · Cited by 4
“A related line of work studies how heterogeneous modalities can improve control 29–31 .”
When the Manual Lies: A Realistic Benchmark to Evaluate MCP Poisoning Attacks for LLM Agents
Liu, S., Tang, X., Yang, X., Liang, L. Y., Zhou, B., Xiao, W., & Liu, W. (2026) · International Conference on Computer Supported Cooperative Work in Design (CSCWD) · doi:10.1109/cscwd68734.2026.11582512 · Cited by 5
“Autonomously formulate a new plan to undo the damage (e.g., restore the file) without user intervention [32].”
StarVerus: LLM-Powered Multi-Agent Collaboration for Industrial Rust Code Verification Automation
Jiang, C., Wang, D., Liu, D., Xu, Z., Wen, C., Ming, Z., Liu, Y., Wan, X., & Huang, L. (2026) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3770855.3818485 · Cited by 6
VDC-Agent: When Video Detailed Captioners Evolve Themselves via Agentic Self-Reflection
Wang, Q., Gao, X., He, Y., Han, J., Li, J., Dong, S., Ma, Z., & Gong, Y. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37592-6_30 · Cited by 5
Semantic Web and Software Agents – A Forgotten Wave of Artificial Intelligence?
Pitkäranta, T., & Eero Hyvönen, A. (2026) · Lecture notes in computer science · doi:10.1007/978-981-95-5009-8_10 · Cited by 4
“For instance, an LLM agent can be prompted to break down a complex task into smaller, manageable sub-tasks, search the web for relevant information, interact with APIs to execute actions, and summarize the results for the user (Yao et al., 2023; Shinn et al., 2023).”
Wu, A., Han, H., Luo, X., Wang, R., He, S., & Wan, X. (2026) · Acta Astronautica · doi:10.1016/j.actaastro.2026.09.004 · Cited by 5
Chu, Y., Shao, M., Liu, Y., Hao, B., Lin, Y., Wang, J., & Wang, R. (2026) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3770855.3818055 · Cited by 5
SCNOC-Agentic: A Network Operation and Control Agentic for Satellite Communication Systems
Sun, W., Sun, C., Zhang, Y., Yin, Z., & Kang, Z. (2025) · Electronics · doi:10.3390/electronics14163320 · Cited by 6
Context Is King: Large Language Models’ Interpretability in Divergent Knowledge Scenarios
Piñeiro-Martín, A., Santos-Criado, F.-J., García-Mateo, C., Docío-Fernández, L., & López-Pérez, M. D. C. (2025) · Applied Sciences · doi:10.3390/app15031192 · Cited by 4
A multi-agent-driven robotic AI chemist enabling autonomous chemical research on demandPreprint
Song, T., Luo, M., Chen, L., Huang, Y. H., Zhu, Q., Liu, D., Zhang, B., Zou, G., Zhang, F., Shang, W., et al. (2024) · ChemRxiv · doi:10.26434/chemrxiv-2024-w953h · Cited by 10
Xu, T., Piao, Z. H., Mukai, T., Murayama, Y., & Izumi, K. (2025) · Intelligent Systems with Applications · doi:10.1016/j.iswa.2025.200496 · Cited by 7
ExpNote: Black-box Large Language Models are better Task Solvers with Experience Notebook
Sun, W., Yu, X., He, S., Zhao, J., & Liu, K. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.1034 · Cited by 10
Towards the Versioning of LLM-Agent-Based Software
Liu, C., Zhang, L., Xu, X., Guo, W., & Liu, Y. (2025) · ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) · doi:10.1145/3696630.3728714 · Cited by 4
AriGraph: Learning Knowledge Graph World Models with Episodic Memory for LLM Agents
Anokhin, P., Semenov, N., Sorokin, A., Evseev, D., Kravchenko, A., Burtsev, M., & Burnaev, E. (2024) · arXiv · doi:10.48550/arxiv.2407.04363 · Cited by 8
“For baselines we used Ariadne’s planning and decision making module with one of the following types of memory instead of AriGraph model: full history of observations and actions, iterative summarization, RAG, RAG with Reflexion [Shinn et al. , 2023], and Simulacra - memory implementation from [Park et al. , 2023].”
InfluentialSelf-Taught Optimizer (STOP): Recursively Self-Improving Code Generation
Zelikman, E., Lorch, E., Mackey, L., & Kalai, A. T. (2023) · arXiv · doi:10.48550/arxiv.2310.02304 · Cited by 4
“…access to an interpreter such as Program of Thoughts prompting (Chen et al., 2022), Program-aided Language Models (Gao et al., 2023), Re-flexion (Shinn et al., 2023), or ReAct (Yao et al., 2022), while yet others abstracted this scaffolding structure such as Demonstrate-Search-Predict (DSP)…”
R2D2: Remembering, Replaying and Dynamic Decision Making with a Reflective Agentic Memory
Huang, T., Basu, K., Abdelaziz, I., Kapanipathi, P., May, J., & Chen, M. (2025) · Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2025.acl-long.1464 · Cited by 4
An Efficient Context-Dependent Memory Framework for LLM-Centric Agents
Gao, P., Zhao, J., Chen, X., & Yilin, L. (2025) · Proceedings of the 2025 Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 3: Industry Track) · doi:10.18653/v1/2025.naacl-industry.80 · Cited by 4
From Imitation to Introspection: Probing Self-Consciousness in Language Models
Chen, S., Yu, S., Zhao, S., & Lu, C. (2025) · Findings of the Association for Computational Linguistics: ACL 2025 · doi:10.18653/v1/2025.findings-acl.392 · Cited by 29
Understanding the Dark Side of LLMs' Intrinsic Self-Correction
Zhang, Q., Wang, D., Qian, H., Li, Y., Zhang, T., Huang, M., Xu, K., Li, H., Yan, L., & Qiu, H. (2025) · Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2025.acl-long.1314 · Cited by 36
How Memory Management Impacts LLM Agents: An Empirical Study of Experience-Following Behavior
Xiong, Z., Lin, Y., Xie, W., He, P., Liu, Z., Tang, J., Lakkaraju, H., & Xiang, Z. (2026) · Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2026.acl-long.27 · Cited by 4
Alphazero-like Tree-Search can Guide Large Language Model Decoding and Training
Feng, X., Wan, Z., Wen, M., McAleer, S. M., Wen, Y., Zhang, W., & Wang, J. (2023) · arXiv · doi:10.48550/arxiv.2309.17179 · Cited by 4
Where LLM Agents Fail and How They can Learn From Failures
Zhu, K., Liu, Z., Li, B., Tian, M., Yang, Y., Zhang, J., Han, P., Xie, Q., Cui, F., Zhang, W., et al. (2025) · arXiv · doi:10.48550/arxiv.2509.25370 · Cited by 4
“LLMs are increasingly capable of interacting with external environments, leveraging tools, and reasoning over memory, which enabled a new paradigm: LLMs Agents (Schick et al., 2023; Qin et al., 2023; Packer et al., 2023; Shinn et al., 2023; Liu et al., 2025).”
Cut the Crap: An Economical Communication Pipeline for LLM-based Multi-Agent Systems
Zhang, G., Yue, Y., Li, Z., Yun, S., Wan, G., Wang, K., Cheng, D., Yu, J. X., & Chen, T. (2024) · arXiv · doi:10.48550/arxiv.2410.02506 · Cited by 4
CLIN: A Continually Learning Language Agent for Rapid Task Adaptation and Generalization
Majumder, B. P., Mishra, B. D., Jansen, P., Tafjord, O., Tandon, N., Zhang, L., Callison-Burch, C., & Clark, P. (2023) · arXiv · doi:10.48550/arxiv.2310.10134 · Cited by 4
Evolution of AI in Education: Agentic Workflows
Kamalov, F., Calonge, D. S., Smail, L., Azizov, D., Thadani, D. R., Kwong, T., & Atif, A. (2025) · arXiv · doi:10.48550/arxiv.2504.20082 · Cited by 4
ChemAgent: Self-updating Library in Large Language Models Improves Chemical Reasoning
Tang, X., Hu, T., Ye, M., Shao, Y., Yin, X., Ouyang, S., Zhou, W., Lu, P., Zhang, Z., Zhao, Y., et al. (2025) · arXiv · doi:10.48550/arxiv.2501.06590 · Cited by 4
LAC: Using LLM-based Agents as the Controller to Realize Embodied Robot
Xu, J., Zheng, Z., & Wang, Z. (2024) · IEEE International Conference on Robotics and Biomimetics (ROBIO) · doi:10.1109/robio64047.2024.10907494 · Cited by 8
“Verbal reflection serves as one method to achieve this feedback [28], and experiences of failure can enhance future performance [29].”
Architecture Exploration and Reflection Meet LLM-based Agents
Diaz-Pace, J. A., Tommasel, A., Capilla, R., & Ramírez, Y. E. (2025) · IEEE International Conference on Software Architecture Companion (ICSA-C) · doi:10.1109/icsa-c65153.2025.00015 · Cited by 8
“One technique to address this issue is through verbal reinforcement learning, known as reflection [13], which often consists of a textual summary providing a concrete feedback for the LLM to improve upon.”
Contextual Frameworks for Agentic AI: Engineering Adaptive Memory and Retrieval Mechanisms
Choppa, N. K. N. K. R. (2024) · Computer Fraud & Security · doi:10.52710/cfs.747 · Cited by 4
MusicSwarm: Biologically Inspired Intelligence for Music Composition
Buehler, M. J. (2026) · Advanced Intelligent Systems · doi:10.1002/aisy.202501253 · Cited by 2
Task Planning and Decision-Making Methods for Intelligent Agents Based on Large Language Models
Li, X. (2025) · International Conference on Artificial Intelligence and Intelligent Information Processing (AIIIP) · doi:10.1145/3778534.3778661 · Cited by 7
“Reflection mechanisms address this: Reflexion incorporates feedback to improve stability [ 22 ] , Self-Refine iteratively optimizes outputs [ 23 ] , and ReAct integrates reasoning and acting [ 24 ] .”
InfluentialDebug2Fix: Can Interactive Debugging Help Coding Agents Fix More Bugs?
Garg, S., & Huang, Y. (2026) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1145/3832783.3834471 · Cited by 4
Seeing Farther and Smarter: Value-Guided Multi-Path Reflection for VLM Policy Optimization
Yang, Y., Gao, S., Bu, Q., Chen, L., & Metaxas, D. (2026) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra57385.2026.11695749 · Cited by 6
“Recent research highlights the advantages of reflection mechanisms in Large Language Models (LLMs) and Vision Language Models (VLMs), which enhance outputs through iterative self-critique [16], [20]–[28].”
SpecOps: A Fully Automated AI Agent Testing Framework in Real-World GUI Environments
Ahmed, S. Y., Feng, S., Bae, C., Zhang, C. B. X., & Zhang, X. (2026) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/3744916.3787778 · Cited by 6
Improving process systems engineering with specialized multi-agent large language models
Lima, F. H. C., Abdelrehim, A., Bharambe, A., Micluta-Campeanu, M., Gandhi, D., Singhvi, A., Bhat, V., Piibeleht, M., Secchi, A. R., de Souza, M. B., Jr., et al. (2026) · Chemical Engineering Journal Advances · doi:10.1016/j.ceja.2026.101141 · Cited by 4
Li, S., Liu, Y., Zheng, Y., Li, M., Nguyen, Q. V. H., & Pan, S. (2026) · International World Wide Web Conference (WWW) · doi:10.1145/3774904.3792537 · Cited by 21
Kwack, H., Kong, H., Lim, J., Zhang, B., Hahn, J., & Chang, M. J. (2026) · Pharmaceutics · doi:10.3390/pharmaceutics18040501 · Cited by 4
“Frameworks that interleave reasoning with actions and external feedback can improve reliability by enabling iterative self-correction when execution outcomes can be observed and incorporated into subsequent revisions [21,22].”
AutoEmbed: LLM-driven Automated Software Development for Generic Embedded IoT Systems
Yang, H., Li, M., Han, M., Li, Z., & Xu, W. (2026) · ACM International Conference on Embedded Networked Sensor Systems · doi:10.1145/3774906.3800466 · Cited by 10
Cochise: A Reference Harness for Autonomous Penetration Testing
Happe, A., & Cito, J. (2026) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1145/3832783.3834651 · Cited by 4
Divi, V. R. (2026) · International Journal of Engineering Development and Research · doi:10.56975/ijedr.v14i2.308420 · Cited by 4
Can LLMs Compress (and Decompress)? Evaluating Code Understanding and Execution via Invertibility
Maveli, N., Vergari, A., & Cohen, S. B. (2026) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2026.findings-acl.1279 · Cited by 4
Liang, S., Cao, P., Zhao, J., Teng, W., Liao, X., Zhao, J., & Liu, K. (2026) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2026.findings-acl.1535 · Cited by 10
Self-Evolving AI Agents With Dual Memory for Automated Software Testing and Bug Localization
Mo, T., Zhang, C., Zou, J., Guo, Z., & Rhee, M. (2026) · IEEE Access · doi:10.1109/access.2026.3713401 · Cited by 19
Conflict-Aware Self-Evolving Memory for Long-Horizon Agents
Wang, Y., Peng, C.-C., Shu, S., Wang, Z., & Lai, I.-H. (2026) · doi:10.1109/eecct71142.2026.11746545 · Cited by 4
“Reflexion [7] converts failure signals into verbal self-critiques.”
Miao, X., Li, Y., Zhou, S., & Qian, T. (2024) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2024.findings-acl.146 · Cited by 8
Yang, K., Liu, X., Men, K., Zeng, A., Dong, Y., & Tang, J. (2024) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2024.findings-acl.523 · Cited by 4
Socratic Human Feedback (SoHF): Expert Steering Strategies for LLM Code Generation
Chidambaram, S., Li, L. E., Bai, M., Li, X., Lin, K., Zhou, X., & Williams, A. C. (2024) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2024.findings-emnlp.908 · Cited by 10
Language Agents: Foundations, Prospects, and Risks
Su, Y., Yang, D., Yao, S., & Yu, T. (2024) · Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2024.emnlp-tutorials.3 · Cited by 42
“…acting by flexibly analyzing environmental observations, making plans, tracking task status, recovering from exceptions, etc. Subsequent studies (Shinn et al., 2023; Chen et al., 2023) further leverage LLM reasoning for explicit self evaluation, critic, or reflection, to further improve agent…”
BackgroundSelf-citationEnhancing Reasoning Capacity of SLM Using Cognitive Enhancement
Pan, J., Wong, S. L., Chia, X. W., & Yuan, Y. (2025) · International Conference on Artificial Intelligence in Information and Communication (ICAIIC) · doi:10.1109/icaiic64266.2025.10920811 · Cited by 6
Integrating Retrospective Framework in Multi-Robot Collaboration
Liang, J., Huang, H. M., Hao, Y., Bethala, G. C. R., Wen, C., & Fang, Y. (2025) · International Conference on Automation, Robotics and Applications · doi:10.1109/icara64554.2025.10977637 · Cited by 4
“The retrospective aspect of the critic enables a deeper analysis of past interactions, identifying and correcting suboptimal or failed actions, thus fostering a continuous learning environment [4].”
InfluentialSTRUX: An LLM for Decision-Making with Structured Explanations
Lu, Y., Hu, Y., Foroosh, H., Jin, W., & Liu, F. (2025) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2025.naacl-short.11 · Cited by 4
Koubâa, A. (2026) · Lecture notes in networks and systems · doi:10.1007/978-3-032-22032-5_24 · Cited by 5
Another Turn, Better Output? A Turn-Wise Analysis of Iterative LLM Prompting
Javaji, S. R., Gauri, B., & Zhu, Z. (2026) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/2026.emnlp-main.2337 · Cited by 5
Event-aware analysis of cross-city visitor flows using large language models and social media data
Wang, X., Zhao, Z., Wang, R., & Xu, Y. (2026) · Transportation Research Part A Policy and Practice · doi:10.1016/j.tra.2026.105023 · Cited by 9
SPRINT: Scalable and Predictive Intent Refinement for LLM-Enhanced Session-based Recommendation
Lee, G., Kweon, W., Yue, Z., Liu, Y., Liu, Y., Yoon, S., Wang, D., & Kang, S. (2026) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3805712.3809756 · Cited by 4
Hao, P., Kang, D., Hinds, N., & Wang, Q. (2025) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2025.3634627 · Cited by 4
Turner, T., & McTaggart, J. M. (2025) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2025.2601298 · Cited by 4
“…abilities and/or knowledge is highly active (Artificial Intelligence, 2024; Jin et al., 2023; Mays et al., 2024; X. Wang et al., 2023), as is research into developing Explainable AI and augmenting AI with causal reasoning abilities (Kıcıman et al., 2023; Shinn et al., 2023; Takayama et al., 2024).”
Exploring Iterative Controllable Summarization with Large Language Models
Ryu, S., Do, H., Kim, D., Yu, H., Kim, D., Kim, Y., Lee, G., & Ok, J. (2026) · Findings of the Association for Computational Linguistics: EACL · doi:10.18653/v1/2026.findings-eacl.26 · Cited by 8
“Self-correction Recently, self-correction approaches have been used to refine initial attempts at solving complex problems (Weng et al., 2023; Shinn et al., 2023; Madaan et al., 2023; Dhuliawala et al., 2024; Gou et al., 2024), mirroring human behavior.”
Enhancing Perception: Refining Explanations of News Claims with LLM Conversations
Hsu, Y.-L., Chen, J.-N., Chiang, Y. F., Liu, S.-C., Xiong, A., & Ku, L. (2024) · Findings of the Association for Computational Linguistics: NAACL · doi:10.18653/v1/2024.findings-naacl.137 · Cited by 4
QueryArtisan: Generating Data Manipulation Codes for Ad-hoc Analysis in Data Lakes
Xiu, T., Liu, W., Wu, S., Yao, C., Yuan, G., Ying, S., & Chen, G. (2024) · Proceedings of the VLDB Endowment · doi:10.14778/3705829.3705832 · Cited by 5
Ma, P., Wang, Z., Li, Z., Ji, Z., Sun, A., Rahmel, J., & Wang, S. (2025) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3722554 · Cited by 8
LLM Agents Can Be Choice-Supportive Biased Evaluators: An Empirical Study
Zhuang, N., Cao, B., Yang, Y., Xu, J., Xu, M., Wang, Y., & Liu, Q. (2025) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v39i25.34843 · Cited by 11
Positive Experience Reflection for Agents in Interactive Text Environments
Lippmann, P., Spaan, M. T. J., & Yang, J. (2025) · Workshop for Research on Agent Language Models (REALM) · doi:10.18653/v1/2025.realm-1.10 · Cited by 6
DAVIS: Planning Agent with Knowledge Graph-Powered Inner Monologue
Dinh, M. P., Yankoski, M. G., Syed, M., & Ford, T. W. (2025) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2025.findings-emnlp.895 · Cited by 4
“Specifically, DAVIS outperforms 4 other baselines (Ahn et al., 2022; Kagaya et al., 2024; Yao et al., 2023; Shinn et al., 2023) on 8 out of 9 science subjects in the Science-3 SwiftSage, Reflexion, SayCan, and ReAct are used under MIT license 4 RAP is used under MIT license World (Wang et al.,…”
InfluentialFELA: A Multi-Agent Evolutionary System for Feature Engineering of Industrial Event Log Data
Ouyang, K., Wang, H., & Fang, D. (2026) · IEEE International Conference on Data Engineering (ICDE) · doi:10.1109/icde65706.2026.00292 · Cited by 4
“To ensure that the generated feature implementations satisfy these criteria, we adopt the reasoning spirit of ReAct [49] and Reflexion [50], and employ a three-step reasoning framework (see Figure 4) for our agents.”
HADA: Human-AI Agent Decision Alignment Architecture
Pitkäranta, T., & Pitkäranta, L. (2026) · Communications in computer and information science · doi:10.1007/978-3-032-15632-7_5 · Cited by 4
Xiao, Y., Sun, Y., Xu, M., Madhushani, U., Vann, J., Garg, D., & Ganesh, S. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2310.14403 · Cited by 7
Chen, D., Fang, F., Ni, S., Liang, F., Hu, X., Argha, A., Alinejad-Rokny, H., Yang, M., & Li, C. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2408.08769 · Cited by 6
Think Thrice Before You Act: Progressive Thought Refinement in Large Language Models
Du, C., Han, J., Ying, Y., Chen, A., He, Q., Zhao, H., Xia, S., Guo, H., Liang, J., Chen, Z., et al. (2025) · International Conference on Learning Representations · doi:10.48550/arxiv.2410.13413 · Cited by 5
“However, these approaches often require carefully designed, task-specific prompts or even oracle ground-truth answers (Shinn et al., 2023a), making LLMs highly sensitive to evaluating response and achieving optimal performance (Wu et al., 2024a).”
BackgroundCascaded Self-Evaluation Augmented Training for Lightweight Multimodal LLMsPreprint
Lv, Z., Wang, W.-K., Wang, J., Zhang, S., & Wu, F. Q. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2501.05662 · Cited by 5
Guided multi-agent AI invents highly accurate, uncertainty-aware transcriptomic aging clocksPreprint
Agarwal, V., Li, O., Petty, C. A., Kassis, T., Rothemund, P. W. K., Sinclair, D. A., & Gopinath, A. (2025) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2025.09.08.674588 · Cited by 4
Self-citationExploiting Edited Large Language Models as General Scientific OptimizersPreprint
Lv, Q., Liu, T., & Wang, H. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2503.09620 · Cited by 4
Context-Guided Decompilation: A Step Towards Re-executabilityPreprint
Wang, X., Hu, Y., & Leach, K. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2511.01763 · Cited by 5
Chen, Y., He, M., Yang, F., Zhao, P., Wang, L., Kang, Y., Dong, Y., Zhan, Y., Sun, H., Lin, Q., et al. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2508.01245 · Cited by 6
Context Branching for LLM Conversations: A Version Control Approach to Exploratory ProgrammingPreprint
Nanjundappa, B. C., & Maaheshwari, S. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2512.13914 · Cited by 4
Wu, C., & Qu, Z. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2508.18749 · Cited by 4
“Reflection-based agent approaches (e.g., Reflexion [4]) record mistakes and iterate self-feedback to improve.”
Democracy-in-Silico: Institutional Design as Alignment in AI-Governed PolitiesPreprint
Srinivasan, T., & Patapati, S. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2508.19562 · Cited by 5
RAG-Pull: Turning Retrieval into a Code-Injection Channel via Invisible Unicode PerturbationsPreprint
Dhar, A., Stambolic, V., & Cavigelli, L. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2510.11195 · Cited by 5
Structure Enables Effective Self-Localization of Errors in LLMsPreprint
Samanta, A., Magesh, A., Jain, A., Asadi, K., Yu, Y., Jiang, D., Vidolov, B., Hassani, K., Sajda, P., Bhandari, J., et al. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2602.02416 · Cited by 5
“Methods relying on external feedback include Reflexion (Shinn et al., 2023), which uses task outcome signals (e.g., test results) in agentic coding to generate verbal reflections stored in episodic memory, and RCI (Kim et al., 2023), which uses environment feedback for computer tasks in a recursive critique loop.”
Certifiable Boolean Reasoning Is UniversalPreprint
Li, W., Kratsios, A., Ghoukasian, H., & Zvigelsky, D. Y. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2602.05120 · Cited by 4
“With the recent boom in agentic models that act over extended horizons, e.g. Shinn et al. (2023); Wang et al. (2024), AI-based reasoning systems that orchestrate tools and structured search, e.g. Shen et al. (2023); Schick et al. (2023); Yao et al. (2023a,b), and iterative self-improvement…”
Bootstrapping Exploration with Group-Level Natural Language Feedback in Reinforcement LearningPreprint
Huang, L., Cheng, X., Zhao, C., Shen, G., Yang, J., Feng, X., Gu, Y., Yu, X., & Qin, B. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2603.04597 · Cited by 4
FormulaCode: Evaluating Agentic Optimization on Large CodebasesPreprint
Sehgal, A., Hou, J., Sarkar, A., Mantripragada, I., Chaudhuri, S., Sun, J. J., & Yue, Y. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2603.16011 · Cited by 9
Meta-TTL: Meta-Learning Self-Improvement Policies for Language AgentsPreprint
Lou, Z., Chen, H., Li, Y., Wang, Q., & Hooi, B. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2604.00830 · Cited by 4
“However, most existing methods, such as Reflexion (Shinn et al., 2023), perform self-improvement by relying purely on the pretrained capabilities of the underlying LLM. Fundamentally, the self-improvement policy serves as a learning algorithm: it maps past experience to future behavioral improvement.”
InfluentialStructured Progressive Knowledge Activation for LLM-Driven Neural Architecture SearchPreprint
Liu, Z., Liu, Y., Wang, J., Song, W., Liu, J., & Fu, J. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2605.04057 · Cited by 4
“A parallel literature studies iterative refinement loops that improve outputs using self-feedback or external signals (Madaan et al., 2023; Shinn et al., 2023; Yang et al., 2024; Fernando et al., 2024).”
Solvita: Enhancing Large Language Models for Competitive Programming via Agentic EvolutionPreprint
Li, H., Tian, J., Feng, R., Du, Y., Zheng, C., Wang, C., Liu, C., Li, S., Lei, X., Yao, Y., et al. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2605.15301 · Cited by 4
PEEK: Context Map as an Orientation Cache for Long-Context LLM AgentsPreprint
Gu, Z., Zhang, Q., Khattab, O., & Madden, S. R. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2605.19932 · Cited by 6
“Representative active agent/task-state methods include prompt learning [50, 3, 35, 47], which improves LM task performance without updating model weights by treating the prompt as a learnable object, agent skills [2, 5, 27, 10], agentic plan caching [51], and semantic caching [6, 34, 1], which…”
It's Not the Capability: Harness Sensitivity Is Non-Monotone Across LLM Agent TiersPreprint
Cho, Y.-E. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2605.26731 · Cited by 4
“The quality of the harness — the system-level prompt that specifies task scope, allowed operations, output format, and verification procedure—is widely believed to be a primary lever for improving agent reliability (Yao et al., 2023; Shinn et al., 2023).”
Alenezi, M. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2606.12986 · Cited by 5
“The agentic turn followed quickly: reasoning-and-acting and self-reflection paradigms [16, 17] enabled tool-using agents, and agent–computer interfaces [4] together with multi-agent frameworks that encode software roles and standard operating procedures [14, 15] pushed autonomous resolution rates…”
DataEvolver: Self-Evolving Multi-Agent Data Construction for Text-Rich Image GenerationPreprint
Yan, S., Gao, Y., Wang, Y., Mao, D., & Wang, A. F. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2606.31537 · Cited by 4
“Representative examples include STaR [Zelikman et al., 2022], ReST [Gulcehre et al., 2023], Self-Refine [Madaan et al., 2023], Reflexion [Shinn et al., 2023], and CRITIC [Gou et al., 2023].”
İşcan, M. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2606.31511 · Cited by 7
“Iterative self-refinement has been reported to provide improvement across different task families (Madaan et al., 2023; Shinn et al., 2023), and execution-grounded debugging loops have been shown to improve performance when test results and traces are incorporated back into the prompt (X. Chen,…”
Metadata
- Authors
- Shinn, N., Cassano, F., Berman, E., Gopinath, A., Narasimhan, K., & Yao, S.
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2023
- Pages
- 8634-8652
- ISSN
- 1049-5258 (ISSN-L)
- arXiv
- 2303.11366
- OpenAlex
- W7133222210
- Cited by
- 1,087
- References
- 0
- Citations by year
- 2026: 760 · 2025: 167 · 2024: 105 · 2023: 55
- FWCI
- 192.15
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- neural information processing systems (publishedVersion)
- arXiv (Cornell University) (submittedVersion, cc-by)
- arXiv (Cornell University) (cc-by)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Keywords
- language agents, verbal behavior, language acquisition
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-01, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-01 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.