Reflexion: Language Agents with Verbal Reinforcement Learning
Open accessThe DOI matches its DataCite record; 42 of the 42 references it cites were found in a registry or an index; 7 of the 8 sources its claims cite were checked for support.
Abstract
Large language models (LLMs) have been increasingly used to interact with external environments (e.g., games, compilers, APIs) as goal-driven agents. However, it remains challenging for these language agents to quickly and efficiently learn from trial-and-error as traditional reinforcement learning methods require extensive training samples and expensive model fine-tuning. We propose Reflexion, a novel framework to reinforce language agents not by updating weights, but instead through linguistic feedback. Concretely, Reflexion agents verbally reflect on task feedback signals, then maintain their own reflective text in an episodic memory buffer to induce better decision-making in subsequent trials. Reflexion is flexible enough to incorporate various types (scalar values or free-form language) and sources (external or internally simulated) of feedback signals, and obtains significant improvements over a baseline agent across diverse tasks (sequential decision-making, coding, language reasoning). For example, Reflexion achieves a 91% pass@1 accuracy on the HumanEval coding benchmark, surpassing the previous state-of-the-art GPT-4 that achieves 80%. We also conduct ablation and analysis studies using different feedback signals, feedback incorporation methods, and agent types, and provide insights into how they affect performance.
Overview
CoChat Summary
TL;DR
Reflexion reinforces language agents through verbal self-reflection stored in episodic memory rather than weight updates, improving performance across decision-making, reasoning, and coding tasks. It reports gains including 91% pass@1 on HumanEval, a 22% absolute improvement on AlfWorld, and 20% on HotPotQA.
Key findings
- On HumanEval Python, Reflexion achieves 91.0 pass@1, surpassing the previous state-of-the-art GPT-4 at 80.1; on HumanEval Rust it reaches 68.0 vs. 60.0, MBPP Rust 75.4 vs. 70.9, and Leetcode Hard 15.0 vs. 7.5.
- In AlfWorld, ReAct + Reflexion completes 130 out of 134 tasks using a simple heuristic and improves over strong baselines by an absolute 22% over 12 iterative learning steps; ReAct-only converges at a 22% hallucination rate with no long-term recovery.
- In HotPotQA, Reflexion improves over baselines by 20%; self-reflection gives an 8% absolute boost over episodic memory alone, and although CoT (GT) fails on 39% of questions, Reflexion improves accuracy by 14% without access to ground-truth answers.
- Ablations on the 50 hardest HumanEval Rust problems show full Reflexion at 0.68 vs. baseline 0.60; omitting test generation drops to 0.52, and omitting self-reflection stays at 0.60.
Methods
- Reflexion uses a modular loop with an Actor that generates text/actions, an Evaluator that scores outputs, and a Self-Reflection model that converts feedback into verbal summaries stored in memory; trials repeat until the Evaluator passes or a max trial count is reached, with memory usually bounded to 1–3 experiences.
- Experiments cover AlfWorld (134 environments, six tasks, ReAct + GPT-3), HotPotQA (100 questions, CoT/ReAct, exact-match grading, memory size 3), and programming (HumanEval, MBPP, LeetcodeHardGym; Python/Rust via MultiPL-E; self-generated unit tests up to 6).
- Ablations and analyses vary feedback signals, feedback incorporation methods, and agent types; compromised approaches are tested on HumanEval Rust, and a WebShop experiment is run across 100 environments.
Limitations
- The paper states Reflexion may fall into non-optimal local minima, limits long-term memory to a sliding window with maximum capacity, and notes code-generation test-driven development is limited by non-deterministic, impure, hardware-dependent, or concurrent functions; it also relies on LLM self-evaluation/heuristics and lacks a formal success guarantee.
- The paper reports WebShop failure: after only four trials the agent shows no improvement and does not generate helpful self-reflections, concluding Reflexion cannot solve tasks requiring significant diversity and exploration.
- Evident from the text: self-correction is an emergent quality of stronger, larger models—starchat-beta shows no improvement (baseline 0.26 vs. Reflexion 0.26)—and flaky or incorrect test suites can cause false positives/negatives, with false negatives preferred.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
4 Valid · 2 Not valid · 0 Not checked · 59 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Therefore, in the case in which the model generates a flaky test suite, it is possible that all tests pass on an incorrect solution and lead to a false positive label on a code completion [11].”
§ Reflexion: Language Agents with Verbal Reinforcement Learning > Analysis
What the sources say
- Partly supportedcites [11] 11. Lam, W., Winter, S., Wei, A., Xie, T., Marinov, D., and Bell, J. (2020). A large-scale longitudinal study of flaky tests. Proc. ACM Program. Lang., 4(OOPSLA). sourceExperimental — accuracy not yet measured
The Introduction (page not provided) says a flaky test can pass and fail on the same code and that changes may be merged when all tests pass. It does not address model-generated test suites, incorrect code completions, or false-positive labels, so those parts of the claim are not established by this paper. (LLM, conf=0.82)
hedgedstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“3 shows an inferior 52% vs 60% (baseline) accuracy, which suggests that the agent is unable to determine if the current implementation is correct without unit tests.”
§ Reflexion: Language Agents with Verbal Reinforcement Learning > Ablation study
hedgedstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“ReAct + Reflexion significantly outperforms ReAct by completing 130 out of 134 tasks using the simple heuristic to detect hallucinations and inefficient planning.”
§ Reflexion: Language Agents with Verbal Reinforcement Learning > Results
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“4 shows that self-reflection improves learning by an 8% absolute boost over the episodic memory learning advantage.”
§ Reflexion: Language Agents with Verbal Reinforcement Learning > Analysis
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“on reasoning questions in HotPotQA [28] by 20%”
- Also stated in: § 4 Experiments · plain
“Most notably, Reflexion improves performance over strong baselines by 22% in AlfWorld, 20% in HotPotQA, and 11% on HumanEval.”
§ Reflexion: Language Agents with Verbal Reinforcement Learning > 1 Introduction
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § 4 Experiments · plain
30 more claims
Create a free account to see all 65 claims and every source verdict.
- It may state two separate claims as one. 18
- Probably not a substantial claim. 11
- The quote only partly states this claim. 3
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source doesn’t support the claim as written.
In the citing paper
“Memory and reflection systems such as MemAgent (Yu et al., 2025a), Reflexion (Shinn et al., 2023), and Generative Agents (Park et al., 2023) improve retrieval and episodic memory, but do not perform context shaping, state restructuring, or nextinstruction refinement.”
From PAACE: A Plan-Aware Automated Agent Context Engineering Framework (2025) · cites this paper as Shinn et al., 2023
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe cited source doesn’t support the claim as written.
In the citing paper
“However, Reflexion computes verbal reward over a full trajectory, yielding a single end-of-episode signal that conflates credit across reasoning steps: a failure due to a single intermediate error receives the same critique pressure as one due to a flawed strategy.”
From Process Supervision via Verbal Critique Improves Reasoning in Large Language Models (2026) · cites this paper as Shinn et al. [2023]
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe cited source doesn’t support the claim as written.
In the citing paper
“Unlike Reflexion, which only reflects on unsuccessful trajectories, our approach separately reflects on both successful and unsuccessful ones.”
From An Efficient Context-Dependent Memory Framework for LLM-Centric Agents (2025) · cites this paper as Shinn et al., 2023
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe cited source doesn’t support the claim as written.
In the citing paper
“The dominant approach is to curate memory at write time.”
From Just-in-Time Memory: Learning to Curate Task-Adaptive Memory for LLM Agents (2026) · cites this paper as Shinn et al., 2023
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Interaction and code generation are increasingly used together, with code as the modality of choice for actions [48, 59], tool construction [13, 51, 69], and reasoning [39, 66, 67].”
From SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineering (2024) · cites this paper as [39]
Experimental — accuracy not yet measured
107 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Reflexion: Language Agents with Verbal Reinforcement Learning > 3 Reflexion: reinforcement via verbal reflection
“while M e not pass or t < max trials do”
§ Reflexion: Language Agents with Verbal Reinforcement Learning > Self-reflection
“The Actor, Evaluator, and Self-Reflection models work together through trials in a loop until the Evaluator deems τ t to be correct.”
Citations
Cites
The publisher hasn’t deposited this paper’s reference list.
Cited by
Items 2,701–2,800 of 3,537
Adam, A. M. I. (2026) · Preprints.org · doi:10.20944/preprints202601.0896.v1
GATS: Graph-Augmented Tree Search with Layered World Models for Efficient Agent PlanningPreprint
Williams, M., & Nowicki, D. (2026) · arXiv (Cornell University) · doi:10.5281/zenodo.18264144
A Survey on Multi-Agent LLM Frameworks for Data-Driven Dashboard Automation and Insight Generation
Jamadar, C. T. D. R., & Kulkarni, V. K. S. (2026) · International Journal of Advanced Research in Science Communication and Technology · doi:10.48175/ijarsct-30945
Zhang, P., Hao, G., Xu, M.-N., Wang, X., Ren, S., & Zhu, Y. (2026) · Communications in computer and information science · doi:10.1007/978-981-95-5294-8_5
METIS: Mentoring Engine for Thoughtful Inquiry & SolutionsPreprint
Kumar, A. R., Trehan, D., & Chopra, P. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2601.13075
“For grounding, retrieval-augmented generation (Lewis et al. 2020) is paired with lightweight self-critique (Shinn et al. 2023) to encourage evidence and methodology checks.”
Inoshita, K. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2601.12771
“In this study, 5 independent inferences are executed for the same name, and the most frequently predicted nationality is adopted as the final result. vi) Self-Reflection [3]: A method that has the model self-evaluate its initial prediction and make corrections as needed.”
Leveraging LLM Reflection to Improve Small Language Model Agents’ Capabilities
Mohamed, A. H., Villas, L. A., & dos Reis, J. C. (2026) · Communications in computer and information science · doi:10.1007/978-3-032-15632-7_24
Reflective Translation: Improving Low-Resource Machine Translation via Structured Self-ReflectionPreprint
Cheng, N. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2601.19871
“Iterative prompting frameworks such as Reflexion (Shinn et al., 2023), Self-Refine (Madaan et al., 2023), and Chain-of-Verification (Creswell and Shanahan, 2023) demonstrate that structured self-evaluation can improve factuality and consistency.”
Khan, R. A. S., Bibi, S., Latif, A., Soomro, M. S., & Mahpara (2026) · Global Research Journal of Natural Science and Technology · doi:10.53762/grjnst.03.04.29
A Dialectic Pipeline for Improving LLM RobustnessPreprint
Candussio, S. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2601.20659
Personality Intelligence System Based on a Three-Layer Psychological Model
万, 学. (2025) · Embedded Technology and Intelligent Systems · doi:10.12677/etis.2025.25030
Zhao, W. X., Zhou, K., Li, J., Tang, T., & Wen, J.-R. (2025) · Artificial intelligence: foundations, theory, and algorithms/Artificial intelligence: Foundations, theory, and algorithms · doi:10.1007/978-981-96-6259-3_11
Best-of-Q: Improving VLM agents with Q-function Action Ranking at InferencePreprint
Biré, E., Santos, M., & Yuan, K. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2601.22701
“Some approaches utilize the LLM itself as a value estimator or utilize verbal reinforcement to self-correct, as seen in Reflexion (Shinn et al., 2023) and other critic-based methods (Ma et al., 2024; Cao et al., 2024).”
Enhancing Mathematical Problem Solving in LLMs through Execution-Driven Reasoning AugmentationPreprint
Basarkar, A., Tabarsi, B. T., Barnes, T. M., & Xu, D. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2602.03950
“Agents like self-refine (Madaan et al., 2023) and Reflexion (Shinn et al., 2023) adopt an iterative self-improvement approach, generating feedback on their own output and refining it until a predefined stopping condition is met.”
NordDRG AI Benchmark for Large Language Models
Pitkäranta, T. (2026) · Communications in computer and information science · doi:10.1007/978-3-032-16451-3_14
rePIRL: Learn PRM with Inverse RL for LLM ReasoningPreprint
Wu, X., Zhu, K., Zhang, Y., Wang, L., & Guo, W. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2602.07832 · Cited by 1
“First, it would be valuable to systematically study and compare the various heuristics proposed for online RL with outcome reward for LLM reasoning ( e.g., curriculum learning (Bengio et al., 2009), self-correction (Shinn et al., 2023)), comparing their effectiveness under our learning framework.”
Huang, S., Lin, C., Yang, Y., Wu, Y., Wu, K., & Deng, H. (2026) · International Symposium on Robotics and Artificial Intelligence (ISRAI) · doi:10.1117/12.3103545
Can LLMs Be Effective Sensor Processing Copilots?
Quan, P., Ouyang, X., Jeyakumar, J. V., Wang, Z., Xing, Y., & Srivastava, M. (2026) · IEEE Internet of Things Journal · doi:10.1109/jiot.2026.3664751 · Cited by 1
“We explore the e ff ectiveness of advanced prompting strategies, such as chain-of-thought (CoT) [10], ReAct [11], and self-verification [12].”
InfluentialAlgebraic Quantum Intelligence: A New Framework for Reproducible Machine CreativityPreprint
Yano, K., Lee, J., Ishitomi, T., KAWAGUCHI, H., Koyama, A., Ota, M., 太田, 裕., Sato, N., Shimada, K., Takematsu, S., et al. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2602.14130
“To address this limitation, numerous methods have been proposed, including test-time scaling to increase computational resources during inference [6–8], context adaptation and in-context learning [9–12], and self-reflective or iterative reasoning strategies [13].”
General learned delegation by clonesPreprint
Li, D., Chen, M., Shao, C., Meng, F., & Zhou, J. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2602.13262
“These approaches demonstrate that language models can learn to decompose tasks, invoke tools, and revise intermediate states, but typically rely on hand-designed prompting strategies, fixed agent roles, or supervised traces (Shinn et al., 2023; Schick et al., 2023).”
Position: Introspective Experience from Conversational Environments as a Path to Better LearningPreprint
Musat, C., Tolins, J., Antognini, D., Jingling, L., Klissarov, M., & Duerig, T. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2602.14910
“Reflexion Shinn et al. (2023) demonstrated verbal reinforcement for self-correction; we extend this to high-fidelity introspection as an internalized social capability.”
ChatCEE: a causality extraction framework based on large language model
Liu, B., & Li, Y. (2026) · Information Technology and Management · doi:10.1007/s10799-026-00484-7
Process-Supervised Multi-Agent Reinforcement Learning for Reliable Clinical ReasoningPreprint
Lee, C., Yates, T. M., Minervini, P., & Simpson, T. I. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2602.14160
“Recent works on LLM agents (Yao et al., 2023; Schick et al., 2023; Shinn et al., 2023; Jin et al., 2025) have extended LLM reasoning through tool use, self-reflection, and retrieval, while multi-agent systems (MAS; Wu et al., 2023; Chen et al., 2024; Yang et al., 2025c) further expand this paradigm…”
Gerrits, B. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2602.15867
Xue, Y., Tsunokake, M., Koreeda, Y., & Sogawa, Y. (2026) · International Journal of Semantic Computing · doi:10.1142/s1793351x26410023
Baduwal, M., & Paudel, P. (2026) · doi:10.36227/techrxiv.177162480.04513202/v1 · Cited by 3
G-DMAD: Group-Based Diverse Multi-Agent Debate for Robust Reasoning
Chen, S., Lian, D., Hong, Y., Weng, L., & Hong, D. (2026) · IEEE Access · doi:10.1109/access.2026.3667025
Kodandaram, S. R., Zhou, J., Bi, X., Ramakrishnan, I. V., & Ashok, V. G. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3790956 · Cited by 2
“Recent work on agentic frameworks, including AutoGen [116], CAMEL [69], and Reflexion [102], shows that structured agent collaboration improves reasoning, reduces hallucinations, and produces higher-quality task-specific outputs.”
Tool Use Reduces Depth-Induced Collapse in OOD ReasoningPreprint
Koplow, D., Galanti, T., & Poggio, T. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2602.21061
“The core of our construction is a statistical obfuscation mechanism to block three prevalent shortcuts: (i) data-only prediction that attempts to infer the next term without the historical context, (ii) statistical-leakage prediction that uses statistics about the data and problem specification to…”
EVLM: Self-reflective Multimodal Reasoning and KTO Alignment for Cross-Dimensional Visual Editing
Khalid, U., Munir, K., Iqbal, H., Farooq, A., Hua, J., Rahnavard, N., Chen, C., Zhu, V., & Ji, Z. (2026) · Communications in computer and information science · doi:10.1007/978-3-032-16893-1_8
CWM: Contrastive World Models for Action Feasibility Learning in Embodied Agent PipelinesPreprint
Banerjee, C. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2602.22452
“ReAct [4] and Re-flexion [5] demonstrate that LLMs can be prompted to reason over and act within text environments, but both operate without any pre-execution validity check.”
Liu, Z., Xia, C., He, W., & Wang, C. (2024) · Language Resources and Evaluation Conference (LREC) · doi:10.63317/4kqnu9hz3873 · Cited by 10
An Axiomatic Framework for Belief-State Representation in Partially Observable Decision ProcessesPreprint
Chattopadhayay, A., & Halder, D. (2026) · doi:10.36227/techrxiv.177223113.31284773/v1
Speech-visual integration multimodal multi-agents framework for mobile operation
Wang, Y., Li, J., & Xing, J. (2026) · Journal of King Saud University - Computer and Information Sciences · doi:10.1007/s44443-026-00584-y
“The latest advances, Mobile-Agent-E (Wang et al. 2025a; Shinn et al. 2023) and MobileSteward (Liu et al. 2025), focus on lifelong learning.”
A Software-Oriented Computational Study of Prompt Engineering Pipelines for Large Language Models
Kasimala, K. (2025) · Journal of Computational Analysis and Applications · doi:10.48047/jocaaa.2025.34.02.29
Haddad, Z. (2025) · KTH Publication Database DiVA (KTH Royal Institute of Technology)
Jaime, A. (2026) · Research Square · doi:10.21203/rs.3.rs-9148928/v1
Moral Self-correction is Not An Innate Capability in Language Models
Liu, G., Qi, Z., Zhang, X., Cheng, L., & Johnson, K. (2025) · International Joint Conference on Natural Language Processing and Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics (IJCNLP-AACL) · doi:10.18653/v1/2025.findings-ijcnlp.39
“Further studies asked for external tools or knowledge for better self-correction (Shinn et al., 2023; Chen et al., 2023b; Gou et al., 2024; Gao et al., 2023).”
Making Large Language Models More Flexible to Changing Contingencies through Tracking Induction
Ruiz, F. J., & Martínez-Carrillo, E. (2026) · The Psychological Record · doi:10.1007/s40732-026-00698-9
Multimodal Memory-Augmented Multi-Agent Conversational AI with Multilingual Support
Ranjith, D. (2026) · International Journal for Research in Applied Science and Engineering Technology · doi:10.22214/ijraset.2026.78339
LORIN: Log Retrieval With Intelligent Decomposition and Narrowing
Park, D., Choi, W.-G., Kim, M., Cho, S., Wang, D.-S., Hong, H.-G., Park, C.-W., Lee, C.-G., & Park, H. (2026) · IEEE Access · doi:10.1109/access.2026.3675981
TASER: Table Agents for Schema-guided Extraction and Recommendation
Cho, N., Fielding, K., Watson, W., Ganesh, S., & Veloso, M. (2026) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.18653/v1/2026.eacl-industry.17 · Cited by 3
ARQA: A Benchmark for Grounded Table–Text QA in Enterprise Annual Reports
Wang, R., & Balloccu, S. (2026) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.18653/v1/2026.eacl-industry.63 · Cited by 2
AgenticRS: Agentic Recommender SystemsPreprint
Hu, J., Deng, H., Mu, L., Zhang, H., Wang, S., Zhang, Y., & Zeng, X. (2026) · Preprints.org · doi:10.20944/preprints202603.2003.v1 · Cited by 1
Indeewara, T. A. D. (2026) · Qucosa (Saxon State and University Library Dresden) · Cited by 1
Agentic and Generative AI Based Multi-Agent System for Intelligent Customer Ticket Management
(2026) · International Research Journal of Modernization in Engineering Technology and Science · doi:10.56726/irjmets92093
The Impact of Generative AI on Individual and Society: Prospects and Future Possibilities
Wang, Z., Li, Y., Xu, H., & Chen, M. (2026) · Journal of Technology Innovation and Society · doi:10.63646/jtis.2026.040102 · Cited by 2
Wang, X., Gu, J., Qiu, J., Liu, G., Cai, X., Zhu, J., Liu, Y., Dong, Z. Y., & Zhao, J. (2026) · Engineering · doi:10.1016/j.eng.2026.02.031 · Cited by 1
A novel approach to AI LLM Agents for interaction with Geospatial Databases
Мороз, Б. І., & Шишацький, О. О. (2026) · COMPUTER-INTEGRATED TECHNOLOGIES EDUCATION SCIENCE PRODUCTION · doi:10.36910/6775-2524-0560-2026-62-11
Engineering Agent Feedback Loops
Nagasubramanian, D. (2026) · Apress eBooks · doi:10.1007/979-8-8688-2361-9_11
RASPRef: Retrieval-Augmented Self-Supervised Prompt Refinement for Large Reasoning ModelsPreprint
Soni, R. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2603.27008
“Prior work has shown that noisy reasoning traces can degrade model behavior during self-refinement [Madaan et al., 2023, Shinn et al., 2023].”
InfluentialWang, Q., Zhao, P., She, C., Chen, Y., Kong, X., Wang, X., & Chen, C. (2026) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2026.114296
BACE: LLM-based Code Generation through Bayesian Anchored Co-Evolution of Code and Test Populations
Silva, K., & Perera, S. (2026) · Genetic and Evolutionary Computation Conference (GECCO) · doi:10.1145/3795095.3805085 · Cited by 1
“Consequently, “closed-loop” approaches like Reflexion [26], CodeCoT [14], INTERVENOR [29], and Self-Debugging [5] incorporated iterative feedback from execution traces, either by generating their own tests or by using publicly available tests.”
Prompt Sensitivity to Context in LLM Multi-Agent Decision-Making: a Prisoner’s Dilemma Case Study
Nanni, G. (2026) · AMS Degree Thesis (University of Bologna)
AnomalyAgent: Agentic Industrial Anomaly Synthesis via Tool-Augmented Reinforcement Learning
Su, J., Yang, T., Zhang, R., Yan, Z., Sun, H., & Zhang, L. (2026) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3767308.3835418
Is This Enough to Decide? Facilitating Informed Investment Decisions by Visualizing Missing Evidence
Lee, N., & Jeon, H. (2026) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3772363.3798348
“Furthermore, our system facilitates reflection by providing natural-language feedback in the form of questions that guide users to identify missing yet critical information for decision-making [12, 19, 20, 23, 28].”
Karnatak, N., Chatila, M., Hernandez, D. A. P., Yazdanfar, R., DUGAS, M. A., & Vakis, R. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3791062 · Cited by 2
Imperfect Visual Verification for Code Edition : A Case Study on TikZPreprint
Reux, C., Acher, M., Khelladi, D. E., Quinton, C., & Barais, O. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2606.15693
“Prior work has applied iterative refinement to code generation [5, 26, 33, 42, 47] and, more recently, to multimodal tasks [2, 18, 20, 42].”
Semantic Feature Analysis: Improving Agents Without Searching Over RolloutsPreprint
David, Y., Fournier, F., Limonad, L., & Mulian, H. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2604.10513
FD-Bench: Fine-Grained Evaluating the Decision-Making Capability of LLM Agents in Dynamic Scenarios
Cognitive Science Society 2025, Jin, Y., Zheng, Y., & Zhu, Z. (2025) · eScholarship (California Digital Library) · doi:10.48448/jyy2-mf64
New Machine Learning Algorithms to Study the Large-Scale Structure of the Universe
Crastolla, C. (2026) · AMS Degree Thesis (University of Bologna)
cryoAgent: An agentic workflow for robust and adaptive end-to-end cryo-EM image processingPreprint
Li, D., 杨少迪, Pei, T., Qi, C., 肖茜, Niu, T., Zhang, Y., Zhu, Y., & Sun, F. (2026) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.64898/2026.04.16.718662
Beem, J., Barrak, A., & Ksontini, E. (2026) · Research Square · doi:10.21203/rs.3.rs-9350097/v1
ReflectMT: Internalizing Reflection for Efficient and High-Quality Machine TranslationPreprint
Li, K., Zhang, Y., Lan, Z., Meng, F., & Su, J. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2604.19144
“Shinn et al. (2023) proposed the Reflexion framework, systematically embedding self-reflection into LLM reasoning processes to enable iterative evaluation and improvement.”
Learning When Not to Decide: A Framework for Overcoming Factual Presumptuousness in AI AdjudicationPreprint
Afane, M., Robitschek, E. J., Ouyang, D., & Ho, D. E. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2604.19895 · Cited by 1
“Reflexion enables iterative self-critique and refinement [31].”
You Don't Need Public Tests to Generate Correct CodePreprint
Silva, K., & Perera, S. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2604.21598
“Recognizing that two or three examples are rarely comprehensive, subsequent frameworks like AgentCoder [6], Reflexion [18], ThinkCoder [23], DebateCoder [2], CodeCoR [16], and CodeT [1] prompted LLMs to generate extensive autonomous test suites.”
Nykoliuk, M. (2024) · International Journal of Computer (IJC)
ReCAPA: Hierarchical Predictive Correction to Mitigate Cascading Failures
Zeng, X., Sun, Y., Li, H., Liu, S., & Wang, H. (2026) · arXiv (Cornell University)
Young, H., & Bjørner, N. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2604.27209
“Reflexion [32] adds self-reflection but no formal model of debt accumulation and decay.”
LaMAR: A scalable architecture-Reward co-Design for expert systems in multi-Task robotics
Chen, K., Long, Y., & Shang, M. (2026) · Expert Systems with Applications · doi:10.1016/j.eswa.2026.132674
Adaptive Workflow Intelligence: A Cognitive Architecture for Context-Driven Enterprise AutomationPreprint
Viswambaran, S. P. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.08793
“LLM-based agent frameworks demonstrate strong reasoning and reflection capabilities [7], [8], yet they are primarily designed for episodic interaction and generally lack persistent policy evolution grounded in structured enterprise outcomes.”
Influentialİşcan, M. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2605.01567
“Reflexion stores verbal feedback for later decisions [27]; interactive debugging systems combine reinforcement learning, developer feedback, and memory for code repair [13]; and self-correction methods can improve multi-turn repair behavior [15, 21].”
Kapłański, P. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2605.02236
Ding, Z., Yang, Z., & Zhang, Y. R.-Y. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2605.02939
“These include Standard Prompting (GLM et al., 2024), Zero-shot Chain of Thought (Kojima et al., 2022), Plan-and-Solve(Wang et al., 2023b), Self-Consistency (Wang et al., 2023a), Self-Reflect (Shinn et al., 2023), Sel-fRefine (Madaan et al., 2023), Tree of Thoughts (Yao et al., 2023), Cumulative Reasoning (Zhang et al.…”
A trajectory-based framework for diagnosing and calibrating social order in large language models
Wang, S., Zhao, Y. F., Han, P., & Zhai, G. (2026) · Expert Systems with Applications · doi:10.1016/j.eswa.2026.132734
Hierarchical Visual Agent: Managing Contexts in Joint Image-Text Space for Advanced Chart ReasoningPreprint
Dong, Q., He, R., Chen, J., Wang, Y., Ma, X., Jiang, S., & Fu, Y. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2605.04304
“For multi-step reasoning, text-based chain-of-thought (CoT) prompting (Wei et al., 2022; Yao et al., 2022; Wang et al., 2023; Shinn et al., 2023; Zhang et al., 2025) is mainly adopted to elicit explicit reasoning traces.”
Liem, T. Q. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2605.04243
“Recent efforts to navigate this diagnostic impasse have largely gravitated toward post-hoc self-correction protocols and iterative refinement loops, aiming to retroactively identify and rectify representation anomalies before symbolic execution [49, 76].”
Abbasi, S. U., Faiz, M., Gautham, V., V, Rajeev, V., Sreya, J., & A, A. V. (2026) · International Research Journal on Advanced Engineering and Management (IRJAEM) · doi:10.47392/irjaem.2026.0226
“[11] – [15] By integrating both quantitative performance metrics and qualitative interaction analysis, the study aims to provide a clearer understanding of how different levels of AI autonomy influence developer productivity, control, and system reliability 1.5.”
InfluentialDing, F., Zhang, Y., Liu, R., Liao, Y., Zeng, Z., wang, S., & Yang, H. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2605.05226
“Another body of work investigates whether models can improve reasoning through correction and verification, including Self-Refine (Madaan et al., 2023), Reflexion (Shinn et al., 2023), SCoRe (Kumar et al., 2025), S 2 R (Ma et al., 2025), and self-rewarding correction (Xiong et al., 2025).”
Agrawal, R. (2026) · International Journal on Science and Technology · doi:10.71097/ijsat.v17.i2.10738
Dutta, B. D. B. (2026) · International Journal of Creative and Open Research in Engineering and Management · doi:10.55041/ijcope.v2i5.306
LMTree: Leveraging LLMs with Monte Carlo Tree Search for Automated Feature Engineering
Qin, G., Xu, Y., Chen, P., Ma, D., Xu, H., Chen, M., Li, H., & Wang, Y. (2026) · Machine Learning · doi:10.1007/s10994-026-07044-8
I CAN Debias: Uncovering and Enhancing Self-debiasing Mechanisms of Social Bias in LLMsPreprint
Zhang, J., Wang, B., Fu, Y., Dang, Y., Zhao, D., Hou, Y., & Yu, Z. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2605.09647
AssemPlanner: a multi-agent based task planning framework for flexible assembly system
Zhang, C., Zhang, C., Xu, Z., Yang, Y., Feng, P., & Zeng, L. (2026) · Journal of Intelligent Manufacturing · doi:10.48550/arxiv.2605.08831
“The LineBalanceAgent optimizes process allocation via a natural-language-driven self-reflective strategy [17], while the scene graph maintains a structured spatial-resource representation.”
Wang, W., Shen, Z., Li, L., & Hsiao, M. S. (2026) · ACM SIGCPR Conference on Computer Personnel Research (SIGCPR) · doi:10.1145/3768310.3807795
“One model drafts an answer while another model checks it against a short checklist and requests revisions if needed [20, 29].”
It's Not the Size: Harness Design Determines Operational Stability in Small Language ModelsPreprint
Cho, Y.-E. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2605.12129
Yunus, R., & Fajri, L. R. H. A. (2025) · Teknik Jurnal Ilmu Teknik dan Informatika · doi:10.51903/teknik.v5i2.1225
Budgeted agentic AI for adaptive lightweight model fine-tuning
Wang, Y. M., Sun, Q., & Xu, J. (2026) · Multiagent and Grid Systems · doi:10.1177/15741702261450097
“9 Early paradigms mainly emphasized open-ended reasoning and acting, 10,11 while more recent systems such as SWE-agent, 12 Openhands, 13 and ChatDev 14 have demonstrated the potential of large-language-model-based agents in complex engineering workflows.”
EvoCap: Enhancing video captioning via self-evolving video-LLMs with knowledge consolidation
Hu, Y., Wu, M., Yu, J., Chen, Y. P., & Yang, W. (2026) · Knowledge-Based Systems · doi:10.1016/j.knosys.2026.116075
The age of Articicial Intelligence: a thematic review on AI agent and explainable AI
de Carvalho, M. F., Dias, M. D. O., & Junior, D. S. D. S. (2026) · Revista edUCA - Revista Multidisciplinar da Faculdade Católica Paulista · doi:10.54901/educa.v9-275
Dynamic Normativity: Learning Human Preferences
Corrêa, N. K. (2026) · The International library of ethics, law and technology · doi:10.1007/978-3-032-22150-6_5
An Empirical Study of Privacy Leakage Chains via Prompt Injection in Black-Box Chatbot EnvironmentsPreprint
Yang, H., Na, H., & Choi, D. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2605.18133
“These capabilities are useful because agents can interpret heterogeneous inputs, reason over context, and decide when to invoke external actions [Yao et al., 2023, Shinn et al., 2023].”
Enhancing Metacognitive AI: Knowledge-Graph Population with Graph-Theoretic LLM EnrichmentPreprint
Askin, D., Hadar, G., & Conway-Smith, B. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2605.16676
Towards Expert Financial QA via Self-Improving RAGPreprint
Xiong, J., Ghezavat, S., & Hirpara, A. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2608.26706
“Reflexion (Shinn et al., 2023) uses verbal reinforcement learning across episodes; Self-Refine (Madaan et al., 2023) achieves 15–20% gains via single-model critique-refine loops.”
GeoGen3D 1.0: An LMM-Based Reasoning Agent Framework for 3D Geological Model GenerationPreprint
Guo, J., Li, J., Jessell, M., Liu, Z. B., Wang, L., & Wang, X. (2026) · doi:10.5194/egusphere-2026-1960 · Cited by 1
Metadata
- Authors
- Shinn, N., Cassano, F., Berman, E., Gopinath, A., Narasimhan, K., & Yao, S.
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2023
- Pages
- 8634-8652
- ISSN
- 1049-5258 (ISSN-L)
- arXiv
- 2303.11366
- OpenAlex
- W7133222210
- Cited by
- 1,087
- References
- 0
- Citations by year
- 2026: 760 · 2025: 167 · 2024: 105 · 2023: 55
- FWCI
- 192.15
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- neural information processing systems (publishedVersion)
- arXiv (Cornell University) (submittedVersion, cc-by)
- arXiv (Cornell University) (cc-by)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Keywords
- language agents, verbal behavior, language acquisition
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-01, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-01 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.