Reflexion: Language Agents with Verbal Reinforcement Learning
Open accessThe DOI matches its DataCite record; 42 of the 42 references it cites were found in a registry or an index; 7 of the 8 sources its claims cite were checked for support.
Abstract
Large language models (LLMs) have been increasingly used to interact with external environments (e.g., games, compilers, APIs) as goal-driven agents. However, it remains challenging for these language agents to quickly and efficiently learn from trial-and-error as traditional reinforcement learning methods require extensive training samples and expensive model fine-tuning. We propose Reflexion, a novel framework to reinforce language agents not by updating weights, but instead through linguistic feedback. Concretely, Reflexion agents verbally reflect on task feedback signals, then maintain their own reflective text in an episodic memory buffer to induce better decision-making in subsequent trials. Reflexion is flexible enough to incorporate various types (scalar values or free-form language) and sources (external or internally simulated) of feedback signals, and obtains significant improvements over a baseline agent across diverse tasks (sequential decision-making, coding, language reasoning). For example, Reflexion achieves a 91% pass@1 accuracy on the HumanEval coding benchmark, surpassing the previous state-of-the-art GPT-4 that achieves 80%. We also conduct ablation and analysis studies using different feedback signals, feedback incorporation methods, and agent types, and provide insights into how they affect performance.
Overview
CoChat Summary
TL;DR
Reflexion reinforces language agents through verbal self-reflection stored in episodic memory rather than weight updates, improving performance across decision-making, reasoning, and coding tasks. It reports gains including 91% pass@1 on HumanEval, a 22% absolute improvement on AlfWorld, and 20% on HotPotQA.
Key findings
- On HumanEval Python, Reflexion achieves 91.0 pass@1, surpassing the previous state-of-the-art GPT-4 at 80.1; on HumanEval Rust it reaches 68.0 vs. 60.0, MBPP Rust 75.4 vs. 70.9, and Leetcode Hard 15.0 vs. 7.5.
- In AlfWorld, ReAct + Reflexion completes 130 out of 134 tasks using a simple heuristic and improves over strong baselines by an absolute 22% over 12 iterative learning steps; ReAct-only converges at a 22% hallucination rate with no long-term recovery.
- In HotPotQA, Reflexion improves over baselines by 20%; self-reflection gives an 8% absolute boost over episodic memory alone, and although CoT (GT) fails on 39% of questions, Reflexion improves accuracy by 14% without access to ground-truth answers.
- Ablations on the 50 hardest HumanEval Rust problems show full Reflexion at 0.68 vs. baseline 0.60; omitting test generation drops to 0.52, and omitting self-reflection stays at 0.60.
Methods
- Reflexion uses a modular loop with an Actor that generates text/actions, an Evaluator that scores outputs, and a Self-Reflection model that converts feedback into verbal summaries stored in memory; trials repeat until the Evaluator passes or a max trial count is reached, with memory usually bounded to 1–3 experiences.
- Experiments cover AlfWorld (134 environments, six tasks, ReAct + GPT-3), HotPotQA (100 questions, CoT/ReAct, exact-match grading, memory size 3), and programming (HumanEval, MBPP, LeetcodeHardGym; Python/Rust via MultiPL-E; self-generated unit tests up to 6).
- Ablations and analyses vary feedback signals, feedback incorporation methods, and agent types; compromised approaches are tested on HumanEval Rust, and a WebShop experiment is run across 100 environments.
Limitations
- The paper states Reflexion may fall into non-optimal local minima, limits long-term memory to a sliding window with maximum capacity, and notes code-generation test-driven development is limited by non-deterministic, impure, hardware-dependent, or concurrent functions; it also relies on LLM self-evaluation/heuristics and lacks a formal success guarantee.
- The paper reports WebShop failure: after only four trials the agent shows no improvement and does not generate helpful self-reflections, concluding Reflexion cannot solve tasks requiring significant diversity and exploration.
- Evident from the text: self-correction is an emergent quality of stronger, larger models—starchat-beta shows no improvement (baseline 0.26 vs. Reflexion 0.26)—and flaky or incorrect test suites can cause false positives/negatives, with false negatives preferred.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
4 Valid · 2 Not valid · 0 Not checked · 59 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Therefore, in the case in which the model generates a flaky test suite, it is possible that all tests pass on an incorrect solution and lead to a false positive label on a code completion [11].”
§ Reflexion: Language Agents with Verbal Reinforcement Learning > Analysis
What the sources say
- Partly supportedcites [11] 11. Lam, W., Winter, S., Wei, A., Xie, T., Marinov, D., and Bell, J. (2020). A large-scale longitudinal study of flaky tests. Proc. ACM Program. Lang., 4(OOPSLA). sourceExperimental — accuracy not yet measured
The Introduction (page not provided) says a flaky test can pass and fail on the same code and that changes may be merged when all tests pass. It does not address model-generated test suites, incorrect code completions, or false-positive labels, so those parts of the claim are not established by this paper. (LLM, conf=0.82)
hedgedstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“3 shows an inferior 52% vs 60% (baseline) accuracy, which suggests that the agent is unable to determine if the current implementation is correct without unit tests.”
§ Reflexion: Language Agents with Verbal Reinforcement Learning > Ablation study
hedgedstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“ReAct + Reflexion significantly outperforms ReAct by completing 130 out of 134 tasks using the simple heuristic to detect hallucinations and inefficient planning.”
§ Reflexion: Language Agents with Verbal Reinforcement Learning > Results
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“4 shows that self-reflection improves learning by an 8% absolute boost over the episodic memory learning advantage.”
§ Reflexion: Language Agents with Verbal Reinforcement Learning > Analysis
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“on reasoning questions in HotPotQA [28] by 20%”
- Also stated in: § 4 Experiments · plain
“Most notably, Reflexion improves performance over strong baselines by 22% in AlfWorld, 20% in HotPotQA, and 11% on HumanEval.”
§ Reflexion: Language Agents with Verbal Reinforcement Learning > 1 Introduction
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § 4 Experiments · plain
30 more claims
Create a free account to see all 65 claims and every source verdict.
- It may state two separate claims as one. 18
- Probably not a substantial claim. 11
- The quote only partly states this claim. 3
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source doesn’t support the claim as written.
In the citing paper
“Memory and reflection systems such as MemAgent (Yu et al., 2025a), Reflexion (Shinn et al., 2023), and Generative Agents (Park et al., 2023) improve retrieval and episodic memory, but do not perform context shaping, state restructuring, or nextinstruction refinement.”
From PAACE: A Plan-Aware Automated Agent Context Engineering Framework (2025) · cites this paper as Shinn et al., 2023
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe cited source doesn’t support the claim as written.
In the citing paper
“However, Reflexion computes verbal reward over a full trajectory, yielding a single end-of-episode signal that conflates credit across reasoning steps: a failure due to a single intermediate error receives the same critique pressure as one due to a flawed strategy.”
From Process Supervision via Verbal Critique Improves Reasoning in Large Language Models (2026) · cites this paper as Shinn et al. [2023]
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe cited source doesn’t support the claim as written.
In the citing paper
“Unlike Reflexion, which only reflects on unsuccessful trajectories, our approach separately reflects on both successful and unsuccessful ones.”
From An Efficient Context-Dependent Memory Framework for LLM-Centric Agents (2025) · cites this paper as Shinn et al., 2023
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe cited source doesn’t support the claim as written.
In the citing paper
“The dominant approach is to curate memory at write time.”
From Just-in-Time Memory: Learning to Curate Task-Adaptive Memory for LLM Agents (2026) · cites this paper as Shinn et al., 2023
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Interaction and code generation are increasingly used together, with code as the modality of choice for actions [48, 59], tool construction [13, 51, 69], and reasoning [39, 66, 67].”
From SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineering (2024) · cites this paper as [39]
Experimental — accuracy not yet measured
107 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Reflexion: Language Agents with Verbal Reinforcement Learning > 3 Reflexion: reinforcement via verbal reflection
“while M e not pass or t < max trials do”
§ Reflexion: Language Agents with Verbal Reinforcement Learning > Self-reflection
“The Actor, Evaluator, and Self-Reflection models work together through trials in a loop until the Evaluator deems τ t to be correct.”
Citations
Cites
The publisher hasn’t deposited this paper’s reference list.
Cited by
Items 2,901–3,000 of 3,537
Chapman, T. E., & Lassmann, T. (2026) · Briefings in Bioinformatics · doi:10.64898/2026.07.07.736901
“An llm review step runs up to five rounds of keyword discovery and three rounds of search (both configurable), stopping early when an llm reflector [24] either judges search coverage to be sufficient, or directs further queries toward identified gaps.”
Auditing Belief-Conditioned LLM Agents in Hidden-Information Social Deduction GamesPreprint
Gao, Y., Yang, J., Zhao, Y., & Zhang, Y. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2607.10814
“Reflexion proposes verbal self-improvement through stored reflections over past trials [Shinn et al., 2023].”
Spectral Origins of the Self-Correction Blind Spot in Autoregressive GenerationPreprint
Petrova, I., & Vejsiu, L. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2607.09803
“The empirical study of LLM self-correction begins with iterative self-feedback: Self-Refine (Madaan et al., 2023) iterates a critic-and-revise loop, while Reflexion (Shinn et al., 2023) augments agents with verbal reinforcement.”
InfluentialLOGOS: A Living Logic for AI Agent Teams That Evolve With HumansPreprint
Ichikawa, Y., Arai, Y., Kimura, K., Sakai, A., & Kobashi, H. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2607.10878
Agentic Query Reformulation for Contextualized Hyper-Personalized Product Search
Gaggar, R., Rosario, S. D., Varivoda, D., Golchin, S., Sachdev, J., Lafzi, A., Singh, S., Cho, J., Domlur, Y., Kirti, S., et al. (2026) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3805712.3808502
“If the findings are insufficient, the loop repeats with all the previous context until a specific, personalized intent is identified [15].”
CSMAD: Hallucination Detection via Multi-Agent Debate with NLI-Verified Contradictory Statements
Gupta, S., Verma, A., Gupta, K., Sircar, P., & Gupta, D. (2026) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3805712.3808508
Iterative Feedback--Refinement for Faithful Structured Clinical-Note RepresentationPreprint
Mohamed, E. A., Logothetis, I., Bingham, A., & Mouzakis, K. (2026) · Research Square · doi:10.21203/rs.3.rs-10249995/v1
AI-based Decision Systems for Operational Planning and Real-time Power Grid Management
Moaidi, F. (2026) · Portuguese National Funding Agency for Science, Research and Technology (RCAAP Project by FCT)
Evidence-in-the-Loop: Trace-Driven Optimization for Customer-Service LLM AgentsPreprint
Wu, C. E., Qiu, D., Yuan, C., Quan, C., Wu, J., Li, S., Wu, M., Xie, G., Chen, H., & Yao, M. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2607.18039
“This also aligns with work arguing that practical LLM systems improve through explicit memory, protocols, and feedback harnesses rather than model weights alone [20, 30, 31].”
PlanFlip: Attacking Multi-Agent LLM Systems via Planning-Phase Prompt InjectionPreprint
Wang, Y. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2607.16199
“Planning methods—ReAct [Yao et al., 2023b], Tree of Thoughts [Yao et al., 2023a], Reflexion [Shinn et al., 2023], Plan-and-Solve [Wang et al., 2023]—study how to improve plan quality in benign environments.”
Dudaka, M. (2026) · International Journal of Intelligent Systems and Applications in Engineering · doi:10.5281/zenodo.21478247
Wang, Y. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2607.18696
“ReAct, Reflexion, Tree of Thoughts, HuggingGPT, AgentBench, AgentBoard, and SWE-bench further illustrate that agent performance depends on decomposition, tool use, execution environment, and evaluation design [7, 8, 9, 10, 11, 12, 13].”
Bogdanov, I. (2026) · Carleton University's Institutional Repository (MacOdrum Library, Carleton University) · doi:10.22215/etd/2026-17135
An interviewer–evaluator–judger LLM framework for text-based personality inference
Ha, T. (2026) · Scientific Reports · doi:10.1038/s41598-026-62333-5
Language Model Council: A Multi-Agent Framework using Explainable AI
Deekshitha, M., Shwetha, K. R., S, D. G., Deepika, M., Mali, A. S., & Math, A. M. (2026) · International Research Journal on Advanced Engineering Hub (IRJAEH) · doi:10.47392/10.47392/irjaeh.2026.0646
Sidik, B., Levi, C., & Kimhi, N. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2607.20488
“ATMcomplementsexistingself-healing(Reflexion[18],CRITIC[4]) andself-improving(OpenClaw[20],Hermes[13],Auto-Harness[15]) systems:wherethosechangebehaviour,ATMchangesstructure.”
Naparat, D., & Ekasingh, E. (2026) · Research Square · doi:10.21203/rs.3.rs-10173035/v1
Secure Agentic AI and Multimodal Intelligence in 6G Communication Systems
Gaba, S., Motwani, D., Sai, S., Suri, V., Ranjan, V., & Chamola, V. (2026) · IEEE Open Journal of the Communications Society · doi:10.1109/ojcoms.2026.3717323 · Cited by 1
“Agent-oriented systems work likewise treat memory and tool interfaces as first-class operational components rather than incidental metadata [27], [28].”
InfluentialYakusheva, K. K. (2026) · Institutional Repository of the University of Granada (University of Granada)
CRAFT: Learn the Schema, Execute the PlanPreprint
Kolekar, A., Genç, Ş., Shariat, S., Sisman, B., Mezi, T., Poblete, B., Kachroo, S. V., Chi, C., Parmar, P., Singer, A., et al. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2607.22642
“Toolformer [17] and Gorilla [14] study API invocation by language models, while ReAct [27], Reflexion [19], and CodeAct [25] inter-leave reasoning, actions, and executable code.”
Gao, X., Yang, J., & Yang, Q. (2026) · International Workshop on Agentic AI for Next-Generation Software Development · doi:10.1145/3843282.3844438
Try Once, Then Optimal: De-Redundified Procedure Memory for Cross-Episode Exploration AmortizationPreprint
Ge, H., Ouyang, H., Chen, Z., Jia, Y., Li, Y., Shi, L., Han, L., Zhou, G., & Huang, R. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2607.23702
“The store-abstract-retrieve loop is well established for language agents, which reflect on trials into reusable text and recall it later [17]–[21], and for robots that distill corrections or skills into a growing library [22]–[26].”
AgentOmnia: Scaling Agentic Models for Full-Scenario ApplicationsPreprint
Jiang, H., Xin, G., Huang, Y., Zhu, G., Zhang, J., Lin, X., Xu, Y., Shen, C. P., Fei, W., Li, J., et al. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2607.23124 · Cited by 1
RSMeM: Knowledge-Enhanced Memory Evolution for Remote Sensing Agents with Systematic EvaluationPreprint
Wu, B., Zhang, Y., Guo, Z., Liu, T., Qian, C., Lu, Y., Du, X., Li, Y., Zhang, Y., Chen, C., et al. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2607.24772 · Cited by 2
“Across these paradigms, experiences are typically stored as textual summaries or embedding representations and retrieved via semantic similarity, with memory update and forgetting strategies used to maintain relevance (Shinn et al., 2023).”
InfluentialMelo: A Production LLM-Powered Music Recommendation Agent
Wang, S., Guo, D., Xiao, Q., Bi, F., Li, W., Wang, D., & Luo, C. (2026) · ACM Conference on Recommender Systems (RecSys) · doi:10.1145/3773078.3831935
“This is the verbal-feedback idea of Reflexion [12] compressed into a single, latency-bounded session, and the loop runs at most twice.”
Agentology: Ontology-Driven Operational Environments for Multi-Agent SystemsPreprint
Ortaç, A., Tosun, E., Özbek, A. K., Terzioglu, F., & Bayraktar, R. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.6919461 · Cited by 1
Transparency in Agentic AI: A Survey of Interpretability, Explainability, and GovernancePreprint
Raza, S., Radwan, A. Y., Chaduvula, S., Alinoori, M., & Emmanouilidis, C. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.7030899 · Cited by 1
AdaKP: Online Adaptive Knowledge-Point Selection for Reasoning-Oriented Reinforcement LearningPreprint
Meng, Z., Zhao, Z., & Run, C. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2607.24833
Reimagining Academic Workflows with Agentic AI: An Agent-Enabled Automation Prototype
Quintela, A. R. C. D. O. L. M. (2026) · Portuguese National Funding Agency for Science, Research and Technology (RCAAP Project by FCT)
The AI Analyst Workbench: A Business Review of Automated Data Preparation, Modeling, and ReportingPreprint
Pillai, A., Cruz, J., Iyer, S., & Balan, K. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.7138318
HOBA: Hierarchical On-Policy Bidding Agents for Adaptive Online Advertising
Wu, J., Peng, Y., Bai, W., Bai, Y., Shu, W., Pang, J., Zeng, Y. J., & Liu, X. (2026) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3770855.3818435
Aggarwal, A. (2026) · International Journal of Intelligent Systems and Applications in Engineering · doi:10.5281/zenodo.21706482
Beyond Intent Detection: Multi-Intent Reasoning And Execution In Agentic Observability Systems
Balasubramanian, A. (2026) · International Journal of Artificial Intelligence and Machine Learning · doi:10.51483/ijaiml.6.5s.2026.532-539
Learning Implicit Causal World Models from Multi-Agent DemonstrationsPreprint
Ghosh, J. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2607.26336
LoopMemGR: From Behavior Logs to Evolving Memory for Generative RecommendationPreprint
Qian, H., Wu, C., Liu, C., Cao, B., Wu, J., Yan, Y., Zhu, H., Zheng, B., & Wang, S. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2607.27647
“The target interaction and the experience generated from the current request are excluded from its input.”
RefineSVG: Visual Feedback-Driven Reinforcement Learning for Image-to-SVG Generation
Liu, S., Mao, F., Zhou, S., Tan, W., Lu, Z., Zhan, Y., & Liang, Z. (2026) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3767308.3836570 · Cited by 1
Skill Training with Corruption and Reconstruction LoopPreprint
Li, M., Yin, Z., Wu, Q., Cao, T., Liu, Y., & Shum, H. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2607.27557
“Early memory mechanisms append experiences to a flat linear stream (Park et al., 2023; Shinn et al., 2023), which makes specific memories hard to locate and update as the pool grows.”
A Regress Argument Concerning Autonomous Self-Correction in AI AgentsPreprint
Lee-Sursin, J., & Ryoo, H. J. (2026) · PhilSci-Archive (University of Pittsburgh)
Куренков, А. Л., & Kurenkova, D. A. (2026) · Vestnik of the Plekhanov Russian University of Economics · doi:10.21686/2413-2829-2026-4-48-57
Sharda, K. M., & Sambo, A. S. (2026) · NLP & Big Data · doi:10.5121/csit.2026.1601303
“Through this form of self-reflection and memory, it achieved 91% accuracy on the HumanEvalcoding benchmark, outperforming GPT-4’s reported 80.1% [45].”
InfluentialChain-of-Models: Cross-Model Auditing for Bias-Robust LLM JudgesPreprint
Wang, Q., Lou, Z., Tang, Z., Chen, N., & He, B. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2607.28636
Lu, E. (2026) · Journal of Knowledge Learning and Science Technology · doi:10.60087/jklst.vol5.n2.005
Evaluating prompting strategies for LLM-based code generation in offensive security tasks
Luca, R. D., Liguori, P., & Natella, R. (2026) · Information and Software Technology · doi:10.1016/j.infsof.2026.108281
A Taxonomy of Cognitive Capability Gaps in Generative and Agentic AIPreprint
Akinrele, T., Penchala, S., Golilarz, N. A., Mittal, S., & Rahimi, S. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2608.02553
“Hierarchical frameworks such as HiPlan [51] support long-horizon planning through multi-level guidance, while adaptive approaches including AdaPlanner [52], Reflex-ion [53], and Self-Refine [54] incorporate feedback to revise plans and recover from failures.”
Hybrid LLM-Augmented Reinforcement Learning Agents for Complex Sequential Decision TasksPreprint
Hounwanou, C. D., Eze, J. E., & Gaba, Y. U. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2608.03502
Autoreflection: How Agentic Strange Loops Turn Human Culture into AI InfrastructurePreprint
Lewis, H. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2608.03800
ECLAIR: A Causally-Grounded AI Framework for Scientific Discovery in Empirical Software Engineering
Velasco, A., Rodríguez-Cárdenas, D., Khati, D., Palacio, D. N., & Poshyvanyk, D. (2026) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1145/3832783.3834544
Cao, S., & Li, R. (2026) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3770855.3817699
Dobson, R. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.7185962
Funabiki, A. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.7183959
Albayaydh, W. S., & Zhao, R. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.7187898
Human-like communication in conversational agents for delivering digital health interventions
Martins, A. C. D. S. (2025) · Portuguese National Funding Agency for Science, Research and Technology (RCAAP Project by FCT)
SkillTFM: Gated Skill Evolution for Training-Free Adaptation of Tabular Foundation ModelsPreprint
He, Y., Guan, Z., Wu, A., Cui, P., Wu, F., & Kuang, K. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2608.06137
“Related agent systems use tools, reflection, and experiential memory (Wang et al. 2023; Shinn et al. 2023; Zhao et al. 2024; Yao et al. 2023; Schick et al. 2023), while prompt and program optimization treats textual or modular components as revisable objects (Khattab et al. 2023; Yuksekgonul et al.…”
Q-Reflector: Learning GUI Action Reflection with Generated ConditionsPreprint
Guo, L., Liu, W., Gu, L., Wang, Y., Tse-Hsun, & Chen (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2608.05587
Адаптивне керування інструментами в автономних агентних архітектурах
Череднічок, К. (2026) · Electronic Kyiv-Mohyla Academy Institutional Repository (National University of Kyiv-Mohyla Academy)
Brobbey, A. A., Bhosale¹, N., & Bamfo³, D. (2026) · Research Square · doi:10.21203/rs.3.rs-10499935/v1
Sureshbabu, A. D. (2026) · International Journal of Intelligent Systems and Applications in Engineering · doi:10.5281/zenodo.21875543
Dynamic autonomous joint judgement and adaptive learning
Mukto, D. M. I., Aktar, A., Akter, M., & Islam, R. (2026) · BRAC University Institutional Repository (BRAC University)
Comparative benchmarking of AI research agents for omics data interpretationPreprint
Basov, N. V., Tirta, Y., Li, Z., Zhou, H., & Piatkevich, K. D. (2026) · Research Square · doi:10.21203/rs.3.rs-10437888/v1
Akhmerov, V., Gilemkhanov, D., Kaminsky, Y., Dubrovsky, I. R., Zaitseva, M., Kuznechenko, D., Rozhdestvenskiy, E., Fedorov, D., Revin, I., Potemkin, V. F., et al. (2026) · Genetic and Evolutionary Computation Conference Companion (GECCO Companion) · doi:10.1145/3795101.3814705
Lekkala, S. D., Appadurai, J. P., Bellibatlu, R. R., Singh, M., & Joshi, R. (2026) · Research Square · doi:10.21203/rs.3.rs-10681298/v1
ARC: Fair Relative Advantage Comparison in Open-Ended Real-World InteractionPreprint
Tong, Y., Faith, T. L. H., Marcus, C. Z. W., Jin, Z., Fu, K., Yang, J.-M., Li, J., & Zhang, X. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2608.13622
On AI operational alignment and misalignment for high-risk AI systems: case study
Mihai, R. G., Daireaux, B., & Cayeux, E. (2026) · Scientific Reports · doi:10.1038/s41598-026-67330-2
Hamraoui, I. E., Jose, S., Bureau, N., & Plana, R. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2608.14109
“Beyond the reward itself, the approach inherits classical limits of verbal self-recovery [Shinn et al., 2023].”
InfluentialPosition: Certified Correctness in Neural Constraint Reasoning Requires Symbolic IntegrationPreprint
Kong, S., Zhang, X., & Liu, C. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2608.14569
“Code generation (verifier: compiler / unit tests): on Hu-manEval Python, Reflexion’s verbal-feedback loop with self-generated tests improves GPT-4 pass@1 from 80% to 91% (Shinn et al., 2023); failed candidates trigger a reflection-conditioned regeneration instead of being silently accepted.”
From Errors to Proofs: Minimal-Core-Guided Repair for Neuro-Symbolic Constraint SolvingPreprint
Sarkar, D. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2608.14771
LOCAL: Enabling Learning On-device Contiguously for Agent LLMsPreprint
Liu, X., Li, J., Wang, Z., Ji, Y., Zhu, Z., Hu, Q., Wang, Z., Gu, R., Zhong, S., & Tian, C. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2608.15241
WARA: Toward Automated Wireless Optimization Research With Closed-Loop LLM Agents
Guo, Y., Chen, Y., Hu, C., Yu, X., Hong, L., & Xu, J. (2026) · IEEE Open Journal of the Communications Society · doi:10.1109/ojcoms.2026.3745043 · Cited by 2
“Beyond their established use in text and code generation, LLMs are increasingly being embedded into agentic systems that integrate language-based reasoning with external tools, executable environments, reflection mechanisms, and multi-agent coordination [1]–[4].”
Liu, J., Guo, J., Zhang, T., Xu, Y., Wang, J., Fan, J., Xiao, B., Guo, C., Guo, K., & Hu, H. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2608.16806
“…Mind2Web, OSWorld, SWE-agent, and OpenDevin advance agent systems through self-reflection, browser-assisted question answering, online shopping, realistic web tasks, desktop-environment interaction, software-engineering tasks, and general computer operation, respectively [13,31,43,53,56–58].”
Deep Academic Survey: Stateful Agentic Closed-Loop Paradigm for Academic Survey AutomationPreprint
Xu, Z., Xue, Z., Hu, T., Wang, Y., Liu, Y., & Zhang, J. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2608.18034 · Cited by 1
“This repeated state update and re-evaluation forms a scoped agentic review-and-repair loop [30, 43], which continues until the subsection is accepted or the retry budget is exhausted.”
Tuning the Stochastic Machine: A Systems Engineer's Operating Model for Human-AI EngineeringPreprint
Andrikopoulos, G. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2608.19125
Narra, S. B. (2026) · International Journal of Integrative Studies (IJIS) · doi:10.63856/ijis/v2i8/00003
Agent-System Interface Designs for Enterprise Applications: A Comparative Empirical Study
Nygård, A. (2026) · Aaltodoc (Aalto University)
Hallusinaatioiden havaitseminen tekoälyllä tuotetussa tietotekniikan koulutusmateriaalissa
Kääriäinen, A. (2026) · Aaltodoc (Aalto University)
A Graph-Based Provenance Model for Human-Agent Software Workflows
Sokhin, A. (2026) · Aaltodoc (Aalto University)
A Self-Correcting Agentic AI Framework for Autonomous Reasoning and Decision-Making
Ingole, V. G. (2026) · International Journal of Engineering and Creative Science · doi:10.66631/ijecs.2026.9.11.5
Generation of Web Apps with Agentic IDEs: An Empirical Assessment
Marceca, M., Rossi, M. T., & Mariani, L. (2026) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1145/3832783.3837506
“This research question investigates whether agentic IDEs can produce a running application that satisfies the stated requirements and whose implementation is of high-quality.”
Beyond Truth Discovery: A Two-Stage Framework to Assess the Severity of False Claim during Disasters
Yao, R., Dasari, T., Baispay, G., Zaurbek, A., Liu, Y., Liu, Y., Li, Z., & Wang, D. (2026) · ACM Conference on Human-AI Complementarity and Alignment · doi:10.1145/3834580.3838746
Molecular LLM Agents: From Architectural Design to Scientific AutonomyPreprint
Li, J., Zhang, W., Wang, W., Ren, Y., Liu, W., Mao, C., Li, Y., Bian, Y., Zheng, C., Wei, X., et al. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2608.23104
“Reflexion [123] stores natural-language feedback that can alter behavior in later attempts without parameter updates.”
From Inertia to Objectivity: Improving Deep Research Agents with Noise Isolation
Zhang, X., Zhang, Z., Fu, Z., Lin, B., & Wang, W. (2026) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/2026.emnlp-main.1860 · Cited by 1
Kato, K., Chu, C., Murawaki, Y., & Kurohashi, S. (2026) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2026.1857934
“…work, recent studies have also explored reusing model-generated reasoning traces for self-improvement, often treating generated solutions with correct final answers as useful supervision signals (Zelikman et al., 2022; Shinn et al., 2023; Madaan et al., 2023; Xiang et al., 2025; Peng et al., 2025).”
ACE: A Self-Correcting Agentic Canvas Editor for Multi-Slide Presentation Automation
Jang, J., Lee, T., Park, J., & Kwak, N. (2026) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/2026.emnlp-industry.74
Multi-Specialist LLM Relay System for Competitive Programming
Mikhailov, A., Burtsev, M., & Sagirova, A. (2026) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/2026.emnlp-main.1359
RENDER: Controlling Reader-Facing Evidence in LLM Memory EvaluationPreprint
Si, Y., Han, S., Li, D., & Zhang, J. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2608.23568
“…and GraphRAG organize evidence through graph indices (Gutierrez et al., 2024; Edge et al., 2024); ENGRAM uses typed memory schemas (Pa-tel and Patel, 2025); and agent memory work includes MemoryBank, Generative Agents, and Reflexion (Zhong et al., 2023; Park et al., 2023; Shinn et al., 2023).”
An Integrated Ethical and Governance Framework for Agentic Artificial Intelligence Systems
Waghe, S., Gadpayle, A., Zade, D., & Bangade, H. (2026) · International Journal of Computational and Electronic Aspects in Engineering · doi:10.26706/ijceae.7.3.20260702
FTDI: A budget-aware self-healing framework for LLM multi-agent code generation
Men, S., Lu, Z., Luo, H., & Zheng, Y. (2026) · Expert Systems with Applications · doi:10.1016/j.eswa.2026.134164
Huang, Y., & Zhang, X. (2026) · Discover Artificial Intelligence · doi:10.1007/s44163-026-02612-2
DCGC: Draft-Conditioned Global Correction for Complex Reasoning with Masked Diffusion Models
Oh, M., Lee, N., & Lee, J. (2026) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/2026.emnlp-main.1208
$R^3$: Training Robots to Reason in Natural Language via Reinforcement LearningPreprint
Wu, L., Qu, Y., Hu, Z., Zhang, I., Wei, L., Erickson, Z., & Kumar, A. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2608.26053
“Reasoning has also helped in interactive domains such as coding and web agents [10, 60], where models call tools, observe feedback, and revise their behavior online [42, 47, 51].”
Recursive Agentic ReasoningPreprint
Zhang, S., Wu, X., Wu, X., & Xie, J. (2026) · arXiv (Cornell University)
Vishwakarma, A. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.7360399
GVS5H: Zero-Shot Self-Orchestration with Ledger-Based Control for Improved LLM Coding PerformancePreprint
Gao, V., Khosrowshahi, V., Khosrowshahi, A., Sun, X., Lee, J., Simon, & Lee (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2608.26480
Wang, K. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.7356518
Hawkins, J. (2026) · Wiley eBooks · doi:10.1002/9781394406432.ch11
Enhancing Retrieval-Augmented Generation Capabilities Through the Design of a Quote-Extraction Agent
Bezerra, Y. (2026) · RIUnB Institutional Repository (University of Brasília)
Brain Cognition-Inspired Adaptable LLM Agents for Continuous Knowledge Reuse Across Tasks in IoT
Chen, T., Sui, M., Zhang, B., Cao, S., Zhang, W., Qi, L., & Li, X. (2026) · IEEE Internet of Things Journal · doi:10.1109/jiot.2026.3729453
Thinking Costs Tokens: When More Structure is Worth the PricePreprint
Nolasque, T., Grey, J., Pham, C., & Vani, A. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2608.27506
“Shinn et al. [2023] proposed Reflexion, where agents verbally reflect on task feedback and store reflections in episodic memory to improve subsequent attempts.”
Metadata
- Authors
- Shinn, N., Cassano, F., Berman, E., Gopinath, A., Narasimhan, K., & Yao, S.
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2023
- Pages
- 8634-8652
- ISSN
- 1049-5258 (ISSN-L)
- arXiv
- 2303.11366
- OpenAlex
- W7133222210
- Cited by
- 1,087
- References
- 0
- Citations by year
- 2026: 760 · 2025: 167 · 2024: 105 · 2023: 55
- FWCI
- 192.15
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- neural information processing systems (publishedVersion)
- arXiv (Cornell University) (submittedVersion, cc-by)
- arXiv (Cornell University) (cc-by)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Keywords
- language agents, verbal behavior, language acquisition
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-01, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-01 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.