Reflexion: Language Agents with Verbal Reinforcement Learning
Open accessThe DOI matches its DataCite record; 42 of the 42 references it cites were found in a registry or an index; 7 of the 8 sources its claims cite were checked for support.
Abstract
Large language models (LLMs) have been increasingly used to interact with external environments (e.g., games, compilers, APIs) as goal-driven agents. However, it remains challenging for these language agents to quickly and efficiently learn from trial-and-error as traditional reinforcement learning methods require extensive training samples and expensive model fine-tuning. We propose Reflexion, a novel framework to reinforce language agents not by updating weights, but instead through linguistic feedback. Concretely, Reflexion agents verbally reflect on task feedback signals, then maintain their own reflective text in an episodic memory buffer to induce better decision-making in subsequent trials. Reflexion is flexible enough to incorporate various types (scalar values or free-form language) and sources (external or internally simulated) of feedback signals, and obtains significant improvements over a baseline agent across diverse tasks (sequential decision-making, coding, language reasoning). For example, Reflexion achieves a 91% pass@1 accuracy on the HumanEval coding benchmark, surpassing the previous state-of-the-art GPT-4 that achieves 80%. We also conduct ablation and analysis studies using different feedback signals, feedback incorporation methods, and agent types, and provide insights into how they affect performance.
Overview
CoChat Summary
TL;DR
Reflexion reinforces language agents through verbal self-reflection stored in episodic memory rather than weight updates, improving performance across decision-making, reasoning, and coding tasks. It reports gains including 91% pass@1 on HumanEval, a 22% absolute improvement on AlfWorld, and 20% on HotPotQA.
Key findings
- On HumanEval Python, Reflexion achieves 91.0 pass@1, surpassing the previous state-of-the-art GPT-4 at 80.1; on HumanEval Rust it reaches 68.0 vs. 60.0, MBPP Rust 75.4 vs. 70.9, and Leetcode Hard 15.0 vs. 7.5.
- In AlfWorld, ReAct + Reflexion completes 130 out of 134 tasks using a simple heuristic and improves over strong baselines by an absolute 22% over 12 iterative learning steps; ReAct-only converges at a 22% hallucination rate with no long-term recovery.
- In HotPotQA, Reflexion improves over baselines by 20%; self-reflection gives an 8% absolute boost over episodic memory alone, and although CoT (GT) fails on 39% of questions, Reflexion improves accuracy by 14% without access to ground-truth answers.
- Ablations on the 50 hardest HumanEval Rust problems show full Reflexion at 0.68 vs. baseline 0.60; omitting test generation drops to 0.52, and omitting self-reflection stays at 0.60.
Methods
- Reflexion uses a modular loop with an Actor that generates text/actions, an Evaluator that scores outputs, and a Self-Reflection model that converts feedback into verbal summaries stored in memory; trials repeat until the Evaluator passes or a max trial count is reached, with memory usually bounded to 1–3 experiences.
- Experiments cover AlfWorld (134 environments, six tasks, ReAct + GPT-3), HotPotQA (100 questions, CoT/ReAct, exact-match grading, memory size 3), and programming (HumanEval, MBPP, LeetcodeHardGym; Python/Rust via MultiPL-E; self-generated unit tests up to 6).
- Ablations and analyses vary feedback signals, feedback incorporation methods, and agent types; compromised approaches are tested on HumanEval Rust, and a WebShop experiment is run across 100 environments.
Limitations
- The paper states Reflexion may fall into non-optimal local minima, limits long-term memory to a sliding window with maximum capacity, and notes code-generation test-driven development is limited by non-deterministic, impure, hardware-dependent, or concurrent functions; it also relies on LLM self-evaluation/heuristics and lacks a formal success guarantee.
- The paper reports WebShop failure: after only four trials the agent shows no improvement and does not generate helpful self-reflections, concluding Reflexion cannot solve tasks requiring significant diversity and exploration.
- Evident from the text: self-correction is an emergent quality of stronger, larger models—starchat-beta shows no improvement (baseline 0.26 vs. Reflexion 0.26)—and flaky or incorrect test suites can cause false positives/negatives, with false negatives preferred.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
4 Valid · 2 Not valid · 0 Not checked · 59 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Therefore, in the case in which the model generates a flaky test suite, it is possible that all tests pass on an incorrect solution and lead to a false positive label on a code completion [11].”
§ Reflexion: Language Agents with Verbal Reinforcement Learning > Analysis
What the sources say
- Partly supportedcites [11] 11. Lam, W., Winter, S., Wei, A., Xie, T., Marinov, D., and Bell, J. (2020). A large-scale longitudinal study of flaky tests. Proc. ACM Program. Lang., 4(OOPSLA). sourceExperimental — accuracy not yet measured
The Introduction (page not provided) says a flaky test can pass and fail on the same code and that changes may be merged when all tests pass. It does not address model-generated test suites, incorrect code completions, or false-positive labels, so those parts of the claim are not established by this paper. (LLM, conf=0.82)
hedgedstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“3 shows an inferior 52% vs 60% (baseline) accuracy, which suggests that the agent is unable to determine if the current implementation is correct without unit tests.”
§ Reflexion: Language Agents with Verbal Reinforcement Learning > Ablation study
hedgedstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“ReAct + Reflexion significantly outperforms ReAct by completing 130 out of 134 tasks using the simple heuristic to detect hallucinations and inefficient planning.”
§ Reflexion: Language Agents with Verbal Reinforcement Learning > Results
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“4 shows that self-reflection improves learning by an 8% absolute boost over the episodic memory learning advantage.”
§ Reflexion: Language Agents with Verbal Reinforcement Learning > Analysis
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“on reasoning questions in HotPotQA [28] by 20%”
- Also stated in: § 4 Experiments · plain
“Most notably, Reflexion improves performance over strong baselines by 22% in AlfWorld, 20% in HotPotQA, and 11% on HumanEval.”
§ Reflexion: Language Agents with Verbal Reinforcement Learning > 1 Introduction
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § 4 Experiments · plain
30 more claims
Create a free account to see all 65 claims and every source verdict.
- It may state two separate claims as one. 18
- Probably not a substantial claim. 11
- The quote only partly states this claim. 3
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source doesn’t support the claim as written.
In the citing paper
“Memory and reflection systems such as MemAgent (Yu et al., 2025a), Reflexion (Shinn et al., 2023), and Generative Agents (Park et al., 2023) improve retrieval and episodic memory, but do not perform context shaping, state restructuring, or nextinstruction refinement.”
From PAACE: A Plan-Aware Automated Agent Context Engineering Framework (2025) · cites this paper as Shinn et al., 2023
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe cited source doesn’t support the claim as written.
In the citing paper
“However, Reflexion computes verbal reward over a full trajectory, yielding a single end-of-episode signal that conflates credit across reasoning steps: a failure due to a single intermediate error receives the same critique pressure as one due to a flawed strategy.”
From Process Supervision via Verbal Critique Improves Reasoning in Large Language Models (2026) · cites this paper as Shinn et al. [2023]
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe cited source doesn’t support the claim as written.
In the citing paper
“Unlike Reflexion, which only reflects on unsuccessful trajectories, our approach separately reflects on both successful and unsuccessful ones.”
From An Efficient Context-Dependent Memory Framework for LLM-Centric Agents (2025) · cites this paper as Shinn et al., 2023
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe cited source doesn’t support the claim as written.
In the citing paper
“The dominant approach is to curate memory at write time.”
From Just-in-Time Memory: Learning to Curate Task-Adaptive Memory for LLM Agents (2026) · cites this paper as Shinn et al., 2023
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Interaction and code generation are increasingly used together, with code as the modality of choice for actions [48, 59], tool construction [13, 51, 69], and reasoning [39, 66, 67].”
From SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineering (2024) · cites this paper as [39]
Experimental — accuracy not yet measured
107 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Reflexion: Language Agents with Verbal Reinforcement Learning > 3 Reflexion: reinforcement via verbal reflection
“while M e not pass or t < max trials do”
§ Reflexion: Language Agents with Verbal Reinforcement Learning > Self-reflection
“The Actor, Evaluator, and Self-Reflection models work together through trials in a loop until the Evaluator deems τ t to be correct.”
Citations
Cites
The publisher hasn’t deposited this paper’s reference list.
Cited by
Items 3,301–3,400 of 3,537
Evolving Agent InterfacesPreprint
Agashe, S., Yang, Y., Gonzalez-Pumariega, G., Koduru, B. C., Li, C.-L., Yang, J., Li, A., & Wang, X. E. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.28601 · Cited by 1
Patwal, H., Dhanik, S., Bisht, P., & Deogaonkar, A. (2026) · International Conference on Networks, Computers and Communications (ICNCCom) · doi:10.1109/icnccom69117.2026.11736184
RG-Agent: Risk-Gated and Adaptive LLM Agents for Reliable Automated Tabular Data Analysis
Meng, W. (2026) · IEEE Access · doi:10.1109/access.2026.3745424
Santos, G. M., Julia, R. M. S., & Nascimento, M. (2026) · Simpósio Brasileiro de Jogos e Entretenimento Digital (SBGames) · doi:10.5753/sbgames.2026.25637
“…page cache backed by external storage; A-MEM [Xu et al. 2025] structures memory as a Zettelkasten of dynamically linked notes; Reflexion [Shinn et al. 2023] casts verbal self-reflection as an episodic buffer; and Voyager [Wang et al. 2024a] maintains a procedural skill library with…”
Artificial Intelligence Tools in Qualitative Research II
Demirkol, M., Çiftçi, F. C., Başaran, M., Kalender, B., Deniz, İ. D., Arıcı, M., Polat, Ö., Döş, B., Yokuş, E., Kalınkara, Y., et al. (2026) · doi:10.59537/saupress.2577
LiveUIBench: Evaluating Agent as App WorkflowsPreprint
Zhang, T., Cheng, Y., Zhang, R., Peng, Y., & Xie, T. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.27977
“Self-Refine and Reflexion improve outputs or later attempts through feedback (Madaan et al., 2023; Shinn et al., 2023), and generative agents maintain memory for continuing behavior (Park et al., 2023).”
VISTA: Verified Belief-Centric LLM Agents for Safe Network Management
Dai, Y., Chen, J., Huang, X., Dong, R., & Fu, T. (2026) · IEEE Transactions on Network and Service Management · doi:10.1109/tnsm.2026.3745152
Enhancing Multi-Agent LLM Output Quality Through Adversarial Critique: a Cross-Domain Evaluation
Kalra, U., & Gupta, R. K. (2026) · International Conference on Networks, Computers and Communications (ICNCCom) · doi:10.1109/icnccom69117.2026.11736314
“Self-refinement and feedback-driven generation approaches have demonstrated that iterative evaluation can improve LLM responses [6,7].”
Iyengar, S. S., Gowtham, S., Pradeep, T. G., & Jayashree, R. (2026) · IEEE International Conference on Intelligent Systems · doi:10.1109/is71416.2026.11727381
“…of resampled reasoning paths [7] by using a lack of consistency, rather than agreement, as the trigger for further inference-time computation, drawing conceptually on consistency-based hallucination detection such as SelfCheckGPT [18] and on verbal-feedback agentic loops such as Reflexion [21].”
VisualEvolve: A Skill Self-Evolution Framework for Visual ReasoningPreprint
Wang, J., Li, Y., Li, X., Wang, S., Gong, X., Zhang, D., Lv, Z., Le, Y., Yuan, S., Zhang, A., et al. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.28386
“Self-evolving agents improve over time by externalizing accumulated experience into reusable artifacts, including verbal reflections (Shinn et al., 2023), experiential knowledge (Zhao et al., 2024; Ouyang et al., 2026), and reusable skills (Wang et al., 2024; Wei et al., 2026; Ni et al., 2026; Sun…”
Adaptive Replay Refinement: Allocating Test-Time Compute Between Revision and ResamplingPreprint
Bilal, A., Mohsin, M. A., Umer, M. S., Mohsin, A., Bilal, S., & Hougen, D. F. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.28294
“(Wang et al., 2023), while sequential methods re-peatedly revise a single solution, often through separate feedback and refinement stages (Madaan et al., 2023; Shinn et al., 2023).”
MACRA: a training-free multi-agent framework for reliable and cost-aware clinical summarization
Yin, P., Zhu, C., & Tao, W. (2026) · The Journal of Supercomputing · doi:10.1007/s11227-026-08944-1
Inheritance as an Admission Test for LLM Prompt Merge OperatorsPreprint
Chong, Z., Ohsaki, H., & Ng, B. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.29023
From VLM Planners to Robotic Agents: Self-Evolving Harnesses for History-Dependent ManipulationPreprint
Du, T., Guo, H., Zhang, H., Wang, X., Dong, J., Gao, C., Han, M., Lu, T., Yu, M., Shen, C., et al. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.29560 · Cited by 3
“Agentic systems further organize reasoning, actions, and feedback into iterative decision processes (Yao et al., 2022; Shinn et al., 2023; Wang et al., 2023).”
SpatialBrain: Spatial Intelligence Growing from ExperiencePreprint
Zhou, Y., Gong, Z., Ye, X., Liu, Y., Li, D., Zhou, X., Zhong, Z., & Yang, X. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.29317
“Agent methods also retain reflections and reusable workflows from earlier tasks [21, 23, 25, 32].”
Combating Catastrophic Forgetting in Continual Domain Adaptation via Knowledge RecastingPreprint
Liu, Z., Tan, Z., Fleming, C., & Chen, T. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.28892
Lessons from Luck: Do LLM-Written Lessons Carry Chance into an Agent's Next Decision?Preprint
Nakayashiki, K. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.33029
“Agents that store lessons from past runs and read them later include Reflexion’s verbal reflections on task feedback [Shinn et al., 2023], ExpeL’s insights extracted from successful and failed trajectories [Zhao et al., 2023], Agent Workflow Memory’s reusable workflows [Wang et al., 2024], Dynamic…”
Forging More Tasks into Better Harnesses: Agentic Harness Evolution via Successive Scale RacingPreprint
Liu, J., Tang, J., Zhao, T., Shah, N., & Ju, C. M. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.28815
“Experience can improve outputs through self-feedback (Madaan et al., 2023), later attempts through verbal reflection (Shinn et al., 2023), and future tasks through reusable skills (Wang et al., 2023), extracted insights (Zhao et al., 2023), contextual guidelines (Fu et al., 2024), instruction…”
Yu, F. X., Adam, G., Bastian, N. D., & Lan, T. (2026) · Expert Systems with Applications · doi:10.1016/j.eswa.2026.134792
MemPlan: Memory-Conditioned PDDL Planning for Partially Observable Text EnvironmentsPreprint
Song, T., & Hoehndorf, R. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.30379
“These baselines include full-history context, summary memory, retrieval memory, Reflexion [Shinn et al., 2023], Simulacra-style simulation memory, and AriGraph [Anokhin et al., 2025].”
CANNBot-CAKE: Collaborative Agentic Kernel Evolution for Ascend NPUPreprint
Pan, D., Gao, X.-J., Fan, J.-Y., Du, B., Li, J.-S., Chen, X.-X., Chang, N.-Y., Li, X., Zheng, L.-C., Li, J., et al. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.31034
“Agent memory has progressed from per-episode self-reflection [18] and single-agent skill or experience libraries [19, 20] to self-linking memory notes [21], and recently to sharing across actors through banked lessons for cooperating code agents [22] and provenance-tracked multi-user memory [23].”
A Multi-Agent LLM System for Automated Tuning of Specialized Neural Network ModelsPreprint
Sboev, A. G., Kunitsyn, D., Скороходов, М. С., Александрович, М. И., Борисович, Р. Р., & Liu, Y. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.7661436
Feedback That Backfires in Games: Do LLM Players Repeat the Move They Just Watched Fail?Preprint
Gumaan, E. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.30205
“ReAct [Yao et al., 2022], Reflexion [Shinn et al., 2023] and Self-Refine [Madaan et al., 2023] append actions, observations or critiques to a growing transcript on the premise that feedback is informative.”
A Topology-Guided GeoAI Agentic Framework for Urban Flood ScreeningPreprint
Tao, Y., Feng, H., Xu, X., & Floriani, L. D. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.30660
“Existing agentic approaches ( e.g. , ReAct[15], Plan-and-Solve[14], and Reflexion[10]) allow language models to interleave reasoning, planning, and self-critique.”
RALLM-STAR: Spatial–Temporal Aligned Retrieval-Augmented LLM for zero-shot next POI recommendation
Li, K., & Lim, K. H. (2026) · Knowledge-Based Systems · doi:10.1016/j.knosys.2026.117234
EnsinaAI: Geração de Questões com Qualidade Pedagógica Auditada por Catálogos Declarativos
Grosmann, D., da Silva, T. R., Oliveira, A., & Teixeira, M. M. (2026) · Anais do ... Simpósio Brasileiro de Informática na Educação/Anais do Simpósio Brasileiro de Informática na Educação · doi:10.5753/sbie.2026.27699
Babu, M., Nejatia, F., & S, M. E. (2026) · Research Square · doi:10.21203/rs.3.rs-11226881/v1
Wu, K., Zhang, H., Gan, R., Li, P., Jiang, J., & Zhou, Y. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.30979
“Following verbal self-reflection and self-refinement for LLM agents [62, 63], a dedicated reflection operator then updates the prompt: The purpose of reflection is to diagnose why the intended mechanism failed to affect the application and revise the test description accordingly.”
Reinforcement Learning for the Working Memory Controller
Gokulraj, J., & Karthikeyan, L. (2026) · International Conference on Smart Electronics and Communication (ICOSEC) · doi:10.1109/icosec70158.2026.11735862
“Reflexion [12] appends episodic self-feedback without ever evicting it, deferring the capacity problem entirely.”
From Prose to Properties: Testing Research Claims with ARATest for Agent-Native SciencePreprint
He, Y., Liu, J., & Chen, H. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.30495
“ARA provides the host representation and PaperBench the source corpus [33, 45].”
Can LLMs Improve Their Own Harness? A Controlled Study on ARC-AGI-3Preprint
Lehmann, J., & Vahdati, S. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.30499
“Self-Refine, Reflexion, and CRITIC revise responses or task policies through self-feedback, retained verbal feedback, or tool-grounded critique (Madaan et al., 2023; Shinn et al., 2023; Gou et al., 2024).”
Your Token Is Gone: A Token-Consumption Countermeasure for Disrupting LLM-Based Scam SystemsPreprint
杜, 星., Wang, K., & Yu, T. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.30666
“Frameworks such as ReAct and Reflexion support iterative reasoning and self-correction (Yao et al. 2023; Shinn et al. 2023), while AutoGen, MetaGPT, ChatDev, CAMEL, and Generative Agents demonstrate increasingly sophisticated multi-agent planning and collaboration (Wu et al. 2023; Hong et al. 2024;…”
Large model empowered embodied AI: A survey on decision-making and embodied learning
Zhou, R., Liang, W., Ma, Y., Zhang, B., Li, S., Liao, Y., & Kuang, P. (2026) · Neurocomputing · doi:10.1016/j.neucom.2026.135458
Куренков, А. Л., & Куренкова, Д. А. (n.d.) · CyberLeninK (CyberLeninka)
Agentic AI: The Future of Autonomous Systems
Raj, A., Bewal, D., Pandey, A., & Shrivastav, V. (2026) · International Journal For Multidisciplinary Research · doi:10.36948/ijfmr.2026.v08i05.90134
“Reflexion adds a further step in which the agent writes down why an attempt failed and uses that note in the next try [13].”
Can Test-Time Memory Evolution Outperform Test-Time Training for Scientific Discovery?Preprint
Liu, Y., Chen, S., Zhao, X., Liu, C., Song, D., Wang, X. E., & Bu, Y. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.32046
SPECMEM: Accelerating Agentic Tool Calling via Live Memory ManagementPreprint
Song, Z., Zhao, W., Liu, Y., Zhu, Y., Xu, K., Li, S., & Yu, P. S. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.31840
“…updated, user-scoped stores (MemGPT (Packer et al., 2023), MemoryBank (Zhong et al., 2023), Generative Agents (Park et al., 2023), Reflexion (Shinn et al., 2023), A-MEM (Xu et al., 2025), Agent Workflow Memory (Wang et al., 2024)), but for knowledge or skill recall, not speculative drafts;…”
Frontier-OPD: Discovering the Edge of Agent Capability and Teaching Agents to Go BeyondPreprint
Jiang, Z., Chen, Y., Qian, H., Li, L., Li, C., & Sun, L. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.32802
Execution-Supervised Text-to-CAD Generation for Reliable AI-Assisted Parametric Design
Niu, L., Zhao, J., & Li, W. (2026) · Buildings · doi:10.3390/buildings16214204
Multi-Agent Prompting with In-Context Feedback for Cross-Modal Urban Event Chain Prediction
Gupta, B., Sah, S., Dina, A. S., & Jaimes, L. G. (2026) · International Electronic Conference on Sensors and Applications (ECSA) · doi:10.3390/engproc2026163005
VSRL: A Unified Reinforcement Learning Framework for Autonomous Search in Vertical Domains
Li, S., Gao, Z., Cheng, W., Ji, W., Yuan, C., & Zhu, X. (2026) · Computers, materials & continua/Computers, materials & continua (Print) · doi:10.32604/cmc.2026.089753
“Reflexion [20] demonstrates that verbal reinforcement through self-reflection can improve agent reasoning without requiring explicit reward modeling.”
S³-Agent: Causal and Contract-Checked Scheduling for Abstract GPU Partitioning
Lin, J., & Yi, Z. (2026) · IEEE Access · doi:10.1109/access.2026.3747680
Adaptive Control of Scientific Instruments with Nonstationary Responses through Multimodal AgentsPreprint
Shi, G., Li, H., Yu, Y., Fu, Z., Ding, S., Chen, Z., Chen, J., Zhao, H., & Liu, T. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.32370
“Retrieval-augmented generation (RAG) and episodic-memory methods provide traceable interfaces for integrating evolving procedures and long-horizon experience [33, 34, 35, 36].”
Li, J. (2026) · International Conference on Biomedical and Intelligent Systems (IC-BIS) · doi:10.1145/3841905.3841977
Takahashi, K. (2026) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.5281/zenodo.20116148
forge-harness: Engineering Methods for Robust AI Collaboration HarnessesPreprint
Kwon, S. (2026) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.5281/zenodo.22542168
MÜLLER, S. (2026) · International Journal of Modern Scientific Discoveries · doi:10.64137/31079377/ijmsd-v2i3p102
Sathiri, D. (2026) · International Journal of Computer Science and Engineering Innovations · doi:10.64137/31079458/ijcsei-v2i3p103 · Cited by 1
SelfAudit: Heterogeneous Multi-Dimensional Reflection for Complex Document Auditing
Chen, F., Zhang, C., Jiang, M., & Chen, Y. (2026) · Applied Sciences · doi:10.3390/app162110626
RoboDoctor: Training-Free Recursive Self-Improvement for Robot PoliciesPreprint
Yu, H., Li, H., Li, S., Yan, J., Peng, S., Zhong, W., Xin, T., Yao, Y., Tian, X., & Li, Y. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.35604 · Cited by 2
“ReAct interleaves reasoning and action, Reflexion retains verbal feedback, and Voyager accumulates executable skills (Yao et al., 2022; Shinn et al., 2023; Wang et al., 2023).”
Benchmarking Coding Agents under Evolving RequirementsPreprint
Feng, J., Wu, A., Gao, C., Wang, Y., Lu, S., & Hu, Z. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.35488
Infinity Machine: a self-improving AI agent for researchPreprint
Ganesan, H. S. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.35579
“ReAct [45] and Reflexion [46] established tool use and verbal feedback.”
THOMPSON, M. (2026) · International Journal of Emerging Trends in Engineering and Technology · doi:10.64137/31078699/ijetet-v2i3p102
Hierarchical Skill Evolution for Coding AgentPreprint
Gao, J., Peng, Y., Zhou, C., Zhu, Y., Zeng, X., Zhou, S. Z. Y., Qin, L., Qiao, Q., Ma, X., Shang, B. C. W., et al. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.35616
“An external writer–evaluator loop jointly evolves the skill library and the policies governing skill generation and assessment (Shinn et al., 2023; Ouyang et al., 2026b; Pryzant et al., 2023; Agrawal et al., 2026), while the coding model remains frozen and receives only the evolved skills.”
Zhang, L., Daireaux, B., & Alyaev, S. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.35267
“Repair-oriented LLM systems depend on action-able feedback [17, 23], and explainable SHACL work distinguishes machine-detectable violations from human-actionable explanations [21].”
Cost-Aware Python Code Repair via Budget-Threshold LLM Optimization
Qu, K. (2026) · Applied and Computational Engineering · doi:10.54254/2755-2721/2026.38363
Autonomous Financial DevOps Using Agentic AI in Cloud-Native Enterprise Environments
Bennett, O. (2026) · International Journal of Computer Science and Engineering Innovations · doi:10.64137/31079458/ijcsei-v2i3p102
Beyond Compilation Feedback: Refining Vulnerability Checkers with Program-Analysis EvidencePreprint
Yi, C., Wang, S., Zhao, Y., Cheng, X., & Wang, H. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.34928
“The tool-mediated loop draws on LLM agent and self-refinement architectures, with actions restricted to evidence requests, detector edits and validation commands [40, 50, 53, 62].”
Wang, B., Li, Z., Ramchurn, S. D., Huang, X., & Dong, Y. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.34836
“Agent C Riverton lies in Luma. come from voting [13], repeated sampling [36], or individual refinement [22, 26].”
Rethinking Verification in Agent HarnessesPreprint
Zhang, Z., Zhu, E., Lin, Y., Cardie, C., Ding, B., & Zhou, J. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.34577
Lu, J., Zhang, C., Lu, J., Song, Y., Song, Y., & Wong, R. C.-W. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.35316
“Inference-time self-correction methods such as Reflexion, Self-Refine, and DSPy [7, 21, 29] improve individual trajectories through verbal feedback, iterative drafting, or compiled prompt pipelines, but do not commit persistent harness revisions validated across a task distribution.”
EvolveMAS: A Unified Self-Evolution Framework for Decentralized Multi-Agent SystemsPreprint
Wu, Y., Ma, Q., Xu, B., Zhang, D., Bai, L., Wang, B., Li, J., Lv, Z., Yuan, S., Wang, P., et al. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.34450
“Reflexion (Shinn et al., 2023), ExpeL (Zhao et al., 2024), and Self-Refine (Madaan et al., 2023) demonstrate experience-driven improvements on single-agent tasks, while EvoMAC (Hu et al., 2025b) and AgentNet (Yang et al., 2025) extend iterative adaptation to multi-agent systems.”
Koushki, N. M., & Kant, K. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.7674875
CaliMem: Search-Efficient Data Agent via Calibrated MemoryPreprint
Li, H., Li, A. Z., Kang, F., Wang, J. T., Chen, Y., Liu, R., & Jia, R. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.34500
Work Agents: Systems, Capabilities, and OptimizationPreprint
Xu, Z., Du, E., Gao, M., Yang, C., Shen, J., Chen, Z., Yao, Z., Guo, Y., Lu, Y., Huang, J., et al. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.35845
Agented AI for Intelligent Workflow Automation: An Agent Framework Powered By Large Language Models
Maurya, S., & Kumar, S. (2026) · Journal of Recent Innovations in Computer Science and Technology · doi:10.70454/jricst.2026.30406
安向京, Jiao, Z., & Chen, A. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.33451
LogLook: Execution-Grounded Memory for Frontier-Model Robot PlannersPreprint
Jiang, T., Tong, T., & Bing, Z. (2026) · arXiv (Cornell University)
Wang, D. (2025) · Digital Commons-TMC (Texas Medical Center)
When the Critic Falls Behind: Co-Evolving Rubrics and Harnesses for Continual Agent Self-ImprovementPreprint
Chen, H., Yan, Y., Han, Z., He, Y., Guo, C., Li, S., Shi, Q., Zhu, Q., Sun, M., & Che, W. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.36826
“Reflection-and memory-based methods refine experience to improve future decisions (Shinn et al., 2023; Zhong et al., 2023), while skill evolution treats reusable skills as editable knowledge that can be refined from execution feedback (Zhu et al., 2026; Yang et al., 2026).”
Self-Driving Microscopy with Agents: Progress and ProspectsPreprint
Chowdhury, M. H. J., Harris, S. B., Narasimha, G., Dyck, O., Ganesh, P., Solsona, R. M., Checa, M., Collins, L. F., Bagchi, S., Vasudevan, R., et al. (2026) · ChemRxiv · doi:10.26434/chemrxiv.15011161/v1
Jain, S., & Vedam, V. N. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.36544
“Iterative self-improvement methods use generated feedback to revise an answer or policy [18, 19].”
Wang, H., Zhang, B., Chang, Y., Liang, L., Chang, Y., & Wang, C. (2026) · ISPRS International Journal of Geo-Information · doi:10.3390/ijgi15110488
h1: A Taste of the Bitter Lesson in Automated Theorem ProvingPreprint
Moalla, S., Rammal, A., Patel, N., Munos, R., & Kempe, J. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.35962 · Cited by 2
Ruixi, L., Wang, J., Pan, X., Hao, X., Kendrick, K., Yang, M., Yao, D., Becker, B., & Jiang, X. (2026) · Psychoradiology · doi:10.1093/psyrad/kkag035
Lost in the Handoff: Contract-Aware Compliance Checking for Multi-Agent LLM Systems
He, Y., Wang, J., Ji, Y., & Zhang, J. (2026) · Workshop for Research on Agent Language Models (REALM) · doi:10.18653/2026.realm-1.89
AgendaFlow: Task-Adaptive Meeting Protocols for Multi-Agent LLM Reasoning
Sun, M., Wang, Y., & Zhang, Y. (2026) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/2026.findings-emnlp.322
Grounding First: Auditing a Structured Recovery Wrapper for Local Open-Weight Reflexion Agents
Ballal, N., & R, B. P. V. (2026) · Workshop for Research on Agent Language Models (REALM) · doi:10.18653/2026.realm-1.52
SkillForge: Learning from Success–Failure Boundaries for Consistent Long-Horizon Agents
Wan, G., Wang, H., Ling, X., Ling, M., Ren, X., & Li, S. (2026) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/2026.emnlp-main.1954
FIVER: Adaptive Fusion of Formal and Informal Verification for Mathematical Reasoning in LLMs
Li, Y., Xu, A., Guo, Z., & Wu, T. (2026) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/2026.findings-emnlp.702
Code Agents Don’t Understand Root Cause:Evaluating Code Agents on Linux Kernel Fault Localization
Li, Y., Xu, A., Shi, J., Jiang, S., Ma, L., Xu, B., & Xiao, Y. (2026) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/2026.emnlp-main.2201
TARL: A Terminology-Aware Agentic Repair Loop for Language-Agnostic Translation
Mhaskar, S., Sukhadia, V. N., Deshmukh, A., Sharma, M., & Rajpoot, P. K. (2026) · Conference on Machine Translation (WMT) · doi:10.18653/2026.wmt-main.119
EffectMem: Effectiveness-Driven Memory Reuse for Long-Horizon LLM Agents
Yin, J., Wang, L., Cao, D., & Hong, Y. (2026) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/2026.findings-emnlp.859
ReFeedGraph: Graph-Grounded Reusable Feedback for Debate Improvement
Pitre, P., Joshi, O. J., Ziegenbein, T., & Wachsmuth, H. (2026) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/2026.emnlp-main.678
LLM-based agents for generalized web automation and schema-guided data extraction: a survey
Khayoub, I., Chadi, M.-A., Mousannif, H., & Mohamed, F. A. (2026) · International Journal of Data Science and Analytics · doi:10.1007/s41060-026-01335-y
“R2D2 and reflective memory methods store experience for later decisions [47, 63].”
Liu, J., Xu, J., Du, Z., Zheng, H., Yang, Y., & Jiang, W. (2026) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/2026.emnlp-main.207
From Imitation to Reasoning: Sample-Efficient LLM Agents for Knowledge Graph Completion
Zheng, C., Wang, Z., Zhang, W., Wang, Z., & Yang, X. (2026) · Automated Knowledge Base Construction · doi:10.18653/2026.akbc-1.26
Varas, J. M. (2025) · Repositorio Digital Universidad Torcuato Di Tella
Incentivizing Self-Learning in Large Language Models via Reinforcement LearningPreprint
Kong, L., Gu, Y., Zhao, H., Wu, Z., Fang, Y., Hua, Z., Sun, Y., Chen, K., & Zhang, W. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.39671
Scripts2KB: AI-Powered Knowledge Extraction from Job Flows
Sarma, A. S., & Singh, P. (2026) · International Conference on Information, Implementation, and Innovation in Technology (I2ITCON) · doi:10.1109/i2itcon69735.2026.11747472
“That observation has driven growing interest in validation and repair mechanisms [11-12].”
Automated Data Visualization & Analytics Model using Agentic-AI & RAG
Jamadar, R. A., Kulkarni, S., Kokate, V., & Thakre, C. (2026) · International Conference on Information, Implementation, and Innovation in Technology (I2ITCON) · doi:10.1109/i2itcon69735.2026.11747681
“In parallel, RAG-based approaches have demonstrated strong performance in grounding LLM outputs for domain-sensitive analytical tasks where correctness and explainability are critical [3], [6].”
Cross-Domain Transfer of the Procedural Skill Cache
Gokulraj, J., & Karthikeyan, L. (2026) · International Conference on Innovative Mechanisms for Industry Applications · doi:10.1109/icimia69818.2026.11744954
“Reflexion [13] accumulates verbal self-feedback as episodic memory without abstracting it into reusable procedures.”
Causally-Grounded Generation: LLM-Based Analog Circuit Synthesis via Causal Hierarchy
Mai, W., Zeng, X., & Bi, Z. (2026) · International Symposium of Electronics Design Automation (ISEDA) · doi:10.1109/iseda70083.2026.11751514
Self-Improving and Meta-Reasoning in Agentic Retrieval-Augmented Generation: A Survey
Kukreja, S., Bharate, V., & Kamble, S. (2026) · International Conference on Information, Implementation, and Innovation in Technology (I2ITCON) · doi:10.1109/i2itcon69735.2026.11747761
“The objective is to enhance performance of system in terms of results, available resources and task requirements [18, 19].”
Ma, J., Ma, Y., & Zhu, H. (2026) · Array · doi:10.1016/j.array.2026.101379
Adityaraj, Rathore, N. P. S., Ali, A., & Sethi, K. K. (2026) · IEEE International Conference on Advances in Computing Research on Science Engineering and Technology (ACROSET) · doi:10.1109/acroset70960.2026.11742563
“Agent-based reasoning frameworks such as ReAct [13] and Reflexion [14] further extend this capability by enabling language models to combine reasoning, action, and feedback-driven learning.”
Kadam, P. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.38977
Position Paper: Crash-Safe Effects for Agents in Operational Systems
Pasandi, H. B., & Sepahi, M. (2026) · Workshop on Practical Adoption Challenges of ML for Systems (PACMI) · doi:10.1145/3843967.3844688
Metadata
- Authors
- Shinn, N., Cassano, F., Berman, E., Gopinath, A., Narasimhan, K., & Yao, S.
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2023
- Pages
- 8634-8652
- ISSN
- 1049-5258 (ISSN-L)
- arXiv
- 2303.11366
- OpenAlex
- W7133222210
- Cited by
- 1,087
- References
- 0
- Citations by year
- 2026: 760 · 2025: 167 · 2024: 105 · 2023: 55
- FWCI
- 192.15
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- neural information processing systems (publishedVersion)
- arXiv (Cornell University) (submittedVersion, cc-by)
- arXiv (Cornell University) (cc-by)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Keywords
- language agents, verbal behavior, language acquisition
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-01, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-01 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.