Reflexion: Language Agents with Verbal Reinforcement Learning
Open accessThe DOI matches its DataCite record; 42 of the 42 references it cites were found in a registry or an index; 7 of the 8 sources its claims cite were checked for support.
Abstract
Large language models (LLMs) have been increasingly used to interact with external environments (e.g., games, compilers, APIs) as goal-driven agents. However, it remains challenging for these language agents to quickly and efficiently learn from trial-and-error as traditional reinforcement learning methods require extensive training samples and expensive model fine-tuning. We propose Reflexion, a novel framework to reinforce language agents not by updating weights, but instead through linguistic feedback. Concretely, Reflexion agents verbally reflect on task feedback signals, then maintain their own reflective text in an episodic memory buffer to induce better decision-making in subsequent trials. Reflexion is flexible enough to incorporate various types (scalar values or free-form language) and sources (external or internally simulated) of feedback signals, and obtains significant improvements over a baseline agent across diverse tasks (sequential decision-making, coding, language reasoning). For example, Reflexion achieves a 91% pass@1 accuracy on the HumanEval coding benchmark, surpassing the previous state-of-the-art GPT-4 that achieves 80%. We also conduct ablation and analysis studies using different feedback signals, feedback incorporation methods, and agent types, and provide insights into how they affect performance.
Overview
CoChat Summary
TL;DR
Reflexion reinforces language agents through verbal self-reflection stored in episodic memory rather than weight updates, improving performance across decision-making, reasoning, and coding tasks. It reports gains including 91% pass@1 on HumanEval, a 22% absolute improvement on AlfWorld, and 20% on HotPotQA.
Key findings
- On HumanEval Python, Reflexion achieves 91.0 pass@1, surpassing the previous state-of-the-art GPT-4 at 80.1; on HumanEval Rust it reaches 68.0 vs. 60.0, MBPP Rust 75.4 vs. 70.9, and Leetcode Hard 15.0 vs. 7.5.
- In AlfWorld, ReAct + Reflexion completes 130 out of 134 tasks using a simple heuristic and improves over strong baselines by an absolute 22% over 12 iterative learning steps; ReAct-only converges at a 22% hallucination rate with no long-term recovery.
- In HotPotQA, Reflexion improves over baselines by 20%; self-reflection gives an 8% absolute boost over episodic memory alone, and although CoT (GT) fails on 39% of questions, Reflexion improves accuracy by 14% without access to ground-truth answers.
- Ablations on the 50 hardest HumanEval Rust problems show full Reflexion at 0.68 vs. baseline 0.60; omitting test generation drops to 0.52, and omitting self-reflection stays at 0.60.
Methods
- Reflexion uses a modular loop with an Actor that generates text/actions, an Evaluator that scores outputs, and a Self-Reflection model that converts feedback into verbal summaries stored in memory; trials repeat until the Evaluator passes or a max trial count is reached, with memory usually bounded to 1–3 experiences.
- Experiments cover AlfWorld (134 environments, six tasks, ReAct + GPT-3), HotPotQA (100 questions, CoT/ReAct, exact-match grading, memory size 3), and programming (HumanEval, MBPP, LeetcodeHardGym; Python/Rust via MultiPL-E; self-generated unit tests up to 6).
- Ablations and analyses vary feedback signals, feedback incorporation methods, and agent types; compromised approaches are tested on HumanEval Rust, and a WebShop experiment is run across 100 environments.
Limitations
- The paper states Reflexion may fall into non-optimal local minima, limits long-term memory to a sliding window with maximum capacity, and notes code-generation test-driven development is limited by non-deterministic, impure, hardware-dependent, or concurrent functions; it also relies on LLM self-evaluation/heuristics and lacks a formal success guarantee.
- The paper reports WebShop failure: after only four trials the agent shows no improvement and does not generate helpful self-reflections, concluding Reflexion cannot solve tasks requiring significant diversity and exploration.
- Evident from the text: self-correction is an emergent quality of stronger, larger models—starchat-beta shows no improvement (baseline 0.26 vs. Reflexion 0.26)—and flaky or incorrect test suites can cause false positives/negatives, with false negatives preferred.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
4 Valid · 2 Not valid · 0 Not checked · 59 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Therefore, in the case in which the model generates a flaky test suite, it is possible that all tests pass on an incorrect solution and lead to a false positive label on a code completion [11].”
§ Reflexion: Language Agents with Verbal Reinforcement Learning > Analysis
What the sources say
- Partly supportedcites [11] 11. Lam, W., Winter, S., Wei, A., Xie, T., Marinov, D., and Bell, J. (2020). A large-scale longitudinal study of flaky tests. Proc. ACM Program. Lang., 4(OOPSLA). sourceExperimental — accuracy not yet measured
The Introduction (page not provided) says a flaky test can pass and fail on the same code and that changes may be merged when all tests pass. It does not address model-generated test suites, incorrect code completions, or false-positive labels, so those parts of the claim are not established by this paper. (LLM, conf=0.82)
hedgedstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“3 shows an inferior 52% vs 60% (baseline) accuracy, which suggests that the agent is unable to determine if the current implementation is correct without unit tests.”
§ Reflexion: Language Agents with Verbal Reinforcement Learning > Ablation study
hedgedstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“ReAct + Reflexion significantly outperforms ReAct by completing 130 out of 134 tasks using the simple heuristic to detect hallucinations and inefficient planning.”
§ Reflexion: Language Agents with Verbal Reinforcement Learning > Results
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“4 shows that self-reflection improves learning by an 8% absolute boost over the episodic memory learning advantage.”
§ Reflexion: Language Agents with Verbal Reinforcement Learning > Analysis
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“on reasoning questions in HotPotQA [28] by 20%”
- Also stated in: § 4 Experiments · plain
“Most notably, Reflexion improves performance over strong baselines by 22% in AlfWorld, 20% in HotPotQA, and 11% on HumanEval.”
§ Reflexion: Language Agents with Verbal Reinforcement Learning > 1 Introduction
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § 4 Experiments · plain
30 more claims
Create a free account to see all 65 claims and every source verdict.
- It may state two separate claims as one. 18
- Probably not a substantial claim. 11
- The quote only partly states this claim. 3
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source doesn’t support the claim as written.
In the citing paper
“Memory and reflection systems such as MemAgent (Yu et al., 2025a), Reflexion (Shinn et al., 2023), and Generative Agents (Park et al., 2023) improve retrieval and episodic memory, but do not perform context shaping, state restructuring, or nextinstruction refinement.”
From PAACE: A Plan-Aware Automated Agent Context Engineering Framework (2025) · cites this paper as Shinn et al., 2023
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe cited source doesn’t support the claim as written.
In the citing paper
“However, Reflexion computes verbal reward over a full trajectory, yielding a single end-of-episode signal that conflates credit across reasoning steps: a failure due to a single intermediate error receives the same critique pressure as one due to a flawed strategy.”
From Process Supervision via Verbal Critique Improves Reasoning in Large Language Models (2026) · cites this paper as Shinn et al. [2023]
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe cited source doesn’t support the claim as written.
In the citing paper
“Unlike Reflexion, which only reflects on unsuccessful trajectories, our approach separately reflects on both successful and unsuccessful ones.”
From An Efficient Context-Dependent Memory Framework for LLM-Centric Agents (2025) · cites this paper as Shinn et al., 2023
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe cited source doesn’t support the claim as written.
In the citing paper
“The dominant approach is to curate memory at write time.”
From Just-in-Time Memory: Learning to Curate Task-Adaptive Memory for LLM Agents (2026) · cites this paper as Shinn et al., 2023
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Interaction and code generation are increasingly used together, with code as the modality of choice for actions [48, 59], tool construction [13, 51, 69], and reasoning [39, 66, 67].”
From SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineering (2024) · cites this paper as [39]
Experimental — accuracy not yet measured
107 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Reflexion: Language Agents with Verbal Reinforcement Learning > 3 Reflexion: reinforcement via verbal reflection
“while M e not pass or t < max trials do”
§ Reflexion: Language Agents with Verbal Reinforcement Learning > Self-reflection
“The Actor, Evaluator, and Self-Reflection models work together through trials in a loop until the Evaluator deems τ t to be correct.”
Citations
Cites
The publisher hasn’t deposited this paper’s reference list.
Cited by
Items 3,401–3,500 of 3,537
A Multi-Agent Method for Resource-Scheduling Scheme Generation in Complex Task Scenarios
Sun, H., Gao, T., Li, J., Li, C., & Ma, Y. (2026) · doi:10.1109/aice71085.2026.11736930
“Feedback-based language agents have shown that verbal reflection [13] and iterative self-refinement [14] can improve a previous generation.”
ReFINE-MT: Structured Iterative Self-Enhancement for Large Language Model Translation Systems
Sun, J. (2026) · International Conference on Computer Engineering and Application (ICCEA) · doi:10.1109/iccea69962.2026.11743639
“Nevertheless, these methods often lack a structured evaluation stage, provide underspecified feedback, and do not establish a principled closed-loop mechanism tightly coupling evaluation and revision [11], [12].”
Subjectivity without a subject: structural agency and ethical attribution in artificial intelligence
Nemoto, R. (2026) · AI and Ethics · doi:10.1007/s43681-026-01457-w
“This problem becomes increasingly important as large language models are combined with memory, retrieval, planning, self-correction, tool use, and environmental interaction [1, 17, 18, 20].”
Emektar, M., Harmancı, F. M., Aktolun, A., Karadavut, B., & Arpacı, E. (2026) · International Conference on Computer Science and Engineering (UBMK) · doi:10.1109/ubmk71847.2026.11745119
“Reflexion shows how feedback can be retained in episodic memory to improve later trials without necessarily updating model weights [15].”
Interface-First Repository-Level Code Generation with Layered Quality Control
Wu, Q., Li, H., Yu, W., Qiu, Z., Wang, K., Guoze, S., Wu, N., & Leng, W. (2026) · International Conference on Computer Engineering and Application (ICCEA) · doi:10.1109/iccea69962.2026.11743717
“Test-driven evaluation and feedback-based repair, including Self-Refine [13], Reflexion [14], and Self-Debugging [15], improve compilation, testing, and execution-based validation, but they do not adequately model repository-level engineering adaptation such as interface reuse, naming consistency,…”
LexRevise-MT: A benchmark for legal conclusion revision under supervening evidence
Lorenzo, C.-M. (2026) · Information Processing & Management · doi:10.1016/j.ipm.2026.105279
Savoie, B. M. (2026) · ChemRxiv · doi:10.26434/chemrxiv.15011333/v1
Swathika, K., Sai Siva Rubha, H., Raja Mohamed, N., & Kumar, N., V (2026) · doi:10.1109/icosics70095.2026.11746778
“Shinn et al. presented Reflexion [5], and Madaan et al. [6] added Self-Refine with iterative self-feedback.”
A Multi-Agent Question-Answering System for Financial Statements Based on Large Language Models
Chen, K., Liao, S.-C., & Cheng, L. (2026) · Applied Soft Computing · doi:10.1016/j.asoc.2026.116738
С., Д. Д., И., К. Н., Б., М. С., & С., Б. И. (n.d.) · CyberLeninK (CyberLeninka)
Democratizing False Positives Filtering Through Learning Assisted Reasoning
Shen, M., Tanksalkar, S. R., Hauser, C., & Machiry, A. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-42929-2_1
Wei, G., Zhang, S., Lin, Z., Ling, S., Wang, W., & Xiao, Y. (2026) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/3830398.3830622
“Third, the Structured Reasoning Core combines Chain-of-Thought [48] with a Reflexion-based verification loop [44] to keep judgments grounded in explicit evidence when complex trade-offs must be assessed.”
LLM-Assisted Offline Reward Design for Reinforcement Learning-Based Irrigation Scheduling
Wang, Q., Wang, T., & Wang, Z. (2026) · International Journal of Advanced Computer Science and Applications · doi:10.14569/ijacsa.2026.0171024
Khuha, A. (2026) · Journal of Information Technology Review · doi:10.6025/jitr/2026/17/4/204-226
Propose-Validate-Correct Shadow-Plant Architecture for Safe AI Agents in Process Operations
Khan, M. I., Khanna, M., Shivkumar, A., Sharma, T., Sakala, A., Kumar, N., Singh, P., Pundir, D., & Ghosh, A. (2026) · Abu Dhabi International Petroleum Exhibition & Conference (ADIPEC) · doi:10.2118/235393-ms
Khan, M. I., Khanna, M., Shivkumar, A., Sharma, T., Sakala, A., Kumar, N., Singh, P., Pundir, D., & Ghosh, A. (2026) · Abu Dhabi International Petroleum Exhibition & Conference (ADIPEC) · doi:10.2118/236401-ms
Куренков, А. Л. (2026) · Modern Economy Success · doi:10.58224/2500-3747-2026-6-250-260
FortMem: Secure Stateful Data Management for Long-Term LLM Agent Memory
Li, Z., Qin, H., Zeng, G., & Li, R.-H. (2026) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3799682.3840872
POLAR: Policy Optimization through Larger Reasoners
Yuan, Y., Xiao, Z., & Zhang, M. (2026) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3799682.3841057
TinyAstral: Transferring Self-Evolving Harnesses to Tiny Generalist Manipulation AgentsPreprint
Gong, K., Zheng, X., Hou, G., Lee, S., Guo, M., Tan, R., Wen, Z., Wang, Q., He, X., Zhang, M., et al. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.41216 · Cited by 2
“Language agents can improve through stored experience and reflection [36, 44], and recent systems let a model rewrite its own scaffold or code: STOP [52], ADAS [17], G¨odel Agent [49], and the Darwin G ¨ odel Machine [54], following the classical notion of recursive self-improvement [13]; GEPA [2]…”
Multidisciplinary Research: New Horizons, Emerging Trends and Contemporary Perspectives
Vennila, R., Nanci, A., Jr., Sanitha, K. K., & Kaveri, M. (2026) · doi:10.65647/msp/146/2026
What Do Grammars Actually Contribute to Structured LLM Generation? A Factorial Study on GPU Kernels
Delgado, A., Cuevas, F., Jiménez, A. H., Maltos, S. C., & Hinojosa, S. (2026) · Communications in computer and information science · doi:10.1007/978-3-032-44185-0_22
Towards a Comprehensive Framework for Agentic AI Governance and Orchestration in Organizations
Ayadi, Y., Charroux, B., & Sliman, L. (2026) · Procedia Computer Science · doi:10.1016/j.procs.2026.10.289
EvoMCP: Co-evolving MCP agents and training dataPreprint
Gao, X.-A., Lin, K.-P., Shi, X.-Y., Deng, Y., Shen, S.-H., Meng, C.-H., Wu, X.-F., Yang, J., & Liu, W. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.41479
Minimal Intervention: Function Isolation via AST before Language-Model PatchingPreprint
Tishkov, V. (2026) · doi:10.24108/preprints-3116873
Plan-Then-Verify: Verifier-First Planning for Early Feasibility Validation in LLM Agent Systems
Benedykciuk, E., Denkowski, M., Jezior, M., Kawiak, A., Kobus, A., Kurasiewicz, S., & Wójcik, G. M. (2026) · Applied Sciences · doi:10.3390/app162110828
AdaCon: Learning Adaptive Trust Regions for Consistent LLM Agent Reasoning
Chen, H., Jiang, X., Huang, K., & Jiao, J. (2026) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3799682.3840027
Wang, H., Chen, X., Du, B., & Guo, Y. (2026) · IEEE Access · doi:10.1109/access.2026.3749353
TSBPO: Tree-Structured Branching for Policy Optimization in Interactive Language AgentsPreprint
Yu, R., Mu, C., & Zhang, J. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.41697
“ReAct interleaves reasoning and actions with observations [13], while Reflexion uses textual feedback to revise subsequent behavior [14].”
TraceSpec: Understanding and Improving Speculative Decoding for LLM AgentsPreprint
Zhao, J., Zu, S., Li, P., Qin, B., Fang, G. H., Feng, B., & 杨保川 (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.41177
BenchGuard: A Calibrated, Adversary-Aware Triage Layer for Reward-Hacking Agentic Trajectories
Liu, Z., Lyu, H., Zhang, J., Xie, Y., & Chen, Q. (2026) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3799682.3840600
Zhang, J., Ma, B., Ai, L., Song, X., Cheng, J., Li, J., & Yu, Z. (2026) · Systems · doi:10.3390/systems14111377
From Evaluation to Evolution: Benchmarking Image Editing and Evolving Image ModelsPreprint
He, J., Fu, C., Zhang, Y., Huang, Z., Mu, C., Xie, Y., Li, C., Lyu, J., Li, W., & Zhang, X. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.41210
Learning to Interact and Direct: Co-Evolving Video Director AgentsPreprint
Jian, Y., Wang, Z., Hou, Y., & Fan, H. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.41865
Learning from Physical Experience:Context-Space Adaptation for Robotic ManipulationPreprint
Zeng, Y., Li, Y., Huang, K., Wudunn, M., Kovacs, A., Harseno, M., Lin, K., Hunley, P., Shentu, F., Wu, P., et al. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.41320
“Reflexion [24] uses verbal reflections as memory for subsequent attempts, and ExpeL [35] extracts reusable insights from accumulated experiences.”
Leveraging Large Language Models for Automated BPMN 2.0 Process Modelling in Public Administration
Lindner, M.-L., Brennecke, R., Ludwig, S., Hrach, C., Roemer, I., Burow, S., & Ludwig, A. (2026) · Procedia Computer Science · doi:10.1016/j.procs.2026.09.274
IRIS: an agentic eye on symmetry-derived paths and energy landscapes of structural phase transitionsPreprint
Manna, S., Agrawal, S., Ramesh, R., Ganesh, P., Darancet, P., & Sankaranarayanan, S. K. R. S. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2611.00761
Exo: An Architecture for Self-Improving Systems at RuntimePreprint
Krentsel, A., Ratnasamy, S., Stoica, I. G., Casado, M., & Goyal, A. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2611.00463
BLPO: Beyond-Local Policy Optimization for Long-Horizon LLM AgentsPreprint
Chen, X., Tao, C., Hu, W., Wang, Y., Deng, B., Zheng, X., & Ma, S. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2611.03005
When to Nudge? Budget-Constrained Test-Time Coordination for Reliable LLM Decision Making
Yu, C.-Y., & Zhang, W. (2026) · International Conference on Machine Learning and Applications · doi:10.1109/icmla69890.2026.00152
DS-Agent: Role-Aware Hybrid LLM Assignment for Cost-Efficient Automated Data Science
Akbar, H., Ahmed, S. Z., Imtiaz, U., Noor, E., Khan, A. A., & Iqbal, E. (2026) · International Bhurban Conference on Applied Sciences and Technology (IBCAST) · doi:10.1109/ibcast71075.2026.11761950
GeoGuesser Bench: Benchmarking Vision-Language Agents on Interactive GeolocationPreprint
Mao, H., Wang, Y., Koo, M., Huang, W., Doan, H., Xia, J., Wang, Z., & Gonzalez, J. E. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2611.02698
RecGroupMemory: Feedback-Aware Cohort Memory for E-Commerce RecommendationPreprint
Zhang, W., Huang, W., Ma, Z., Zhang, B., & Wang, D. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2611.02453
CARE: Grounded Recursive Self-Improvement for Production Customer-Service AgentsPreprint
Jiang, Y., Lei, C., Gao, R., Zhao, X., Ge, Y., Liu, H., Nie, R., Chen, Q., An, Q., Song, H., et al. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2611.02839
Xiong, H., Liu, Y., Bian, J., Diao, P., Zhu, B., Hu, T., Wang, Y. R., & Helal, S. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2611.03066
NorthCUA Technical Report: Turbocharging Computer-Use Agents through Experience at ScalePreprint
Zhang, C., Li, B., Guo, P., Gao, Y., Cai, Z., Xie, T., Li, H., Huang, Y., Cao, Y., Mao, B., et al. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2611.02102
Harness-Level Self-Evolution of Hydrologic AI SystemsPreprint
Wang, T., Yang, Y., Wang, Z., Zhu, Y., & Jiang, S. (2026) · doi:10.22541/essoar.15011612/v1
Hierarchical Memory and Loop-Aware Optimization for Autonomous Language Agents
Beernalli, A., Pattar, P., Pagad, V., Kulkarni, U. R., & Netagal, A. (2026) · doi:10.1109/aidml70736.2026.11749089
Gambo, I., Massenon, R., Okegbile, S. D., Abdallah, H. A., & Agarwal, S. (2026) · Empirical Software Engineering · doi:10.1007/s10664-026-10963-8
Budget-Aware Verifier-Guided Test-Time Reasoning for Efficient Large Language Models
Wang, S., Zhang, B., Gong, Y., & He, C. (2026) · doi:10.1109/iotaiee70863.2026.11749415
Reasoning-Augmented Retrieval for Clinical Question Answering
Chinnam, Y., Gogineni, S., Kunchala, S. R., Rao, M. N., Suryanarayana, G., & Muralidhar, G. (2026) · doi:10.1109/icact70625.2026.11748869
Error-Aware Context Coordination for Task-Specific Execution-Error Mitigation in OS Agents
Huang, K., Gu, Y., Jia, X., & Du, Z. (2026) · doi:10.1109/iotaiee70863.2026.11749470
Chen, M., & Arifuzzaman, S. (2026) · International Conference on Machine Learning and Applications · doi:10.1109/icmla69890.2026.00107
Li, J., Golilarz, N. A., & Rahimi, S. (2026) · International Conference on Machine Learning and Applications · doi:10.1109/icmla69890.2026.00173
Feng, G., Chen, J., Zhiwei, L., Yang, Q., & Wang, Y. (2026) · doi:10.1109/iotaiee70863.2026.11749416
A Multi-Agent Framework for Structured Contribution Extraction from Scientific Papers
Siravuri, H. V., Akella, A. P., & Alhoori, H. (2026) · International Conference on Machine Learning and Applications · doi:10.1109/icmla69890.2026.00097 · Cited by 1
Learning by Doing: Autonomously Compiling and Curating Agent Skills from Verified TracesPreprint
Chalef, D., Evans, P., Paliychuk, P., Patel, M., Rasmussen, P., & Ryan, J. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2611.01386
DiabAgent: Toward Agentic Physiological ControlPreprint
Li, C., Li, S., Hong, D., Liu, Q., Huang, Y., Bian, P., Xu, M., Zhang, L., 孙, 铭., Li, X., et al. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2611.03601
Who Schedules Agent Memory? A Sidecar Approach to Long-Horizon TasksPreprint
Zhuang, Q., Liu, R., & Ren, Y. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2611.00779
Qubrio: High-Performance Quantum Compilation via Multi-Agent LLM CollaborationPreprint
Ruan, J., Cui, Z., Hu, Z., Yu, Z., Fang, X., Guan, Y., Ludmir, J., Weinberg, P. E., Luo, X., Wang, S., et al. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2611.02269
CR-Bench-v2: Evaluating the Real-World Utility of AI Code Review AgentsPreprint
Pereira, K., Sinha, N., Ghosh, R., & Dutta, D. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2611.02566
Specialist Multi-Model SELF-REFINE with Dual-Feedback Ranking for Robust Mathematical Reasoning
Iqbal, S., Umer, H., & Sasna, S. (2026) · International Bhurban Conference on Applied Sciences and Technology (IBCAST) · doi:10.1109/ibcast71075.2026.11761563
Pulse: Long-Horizon Tasks Need Streaming PersonalizationPreprint
Zhuang, Q., Liang, J., & Ren, Y. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2611.00988
Value-Conditioned Proposal Acquisition for Test-Time ReasoningPreprint
Li, Z., & Xu, J. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2611.02852
Imagine Before You Act: A Self-Evolving Industrial Agent with a Physics-Grounded World Model
He, B., Chen, Y., & Liu, X. (2026) · doi:10.1145/3841560.3841567
WASP-Mem: Let Agent Organize Procedural Memory. Human Spend Effort on DiagnosisPreprint
Niu, P., Shi, G., Gorde, V., Ghosh, S., Faloutsos, C., Cheng, M., & Chen, K. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2611.04003
Thapa, I., Subedi, R., Shrestha, G., Adhikari, S., Magar, P. R., & Poudel, B. (2026) · Bulletin of Computational Intelligence · doi:10.53941/bci.2026.100016
HTN-PT: A Hierarchical Task Network-Guided Framework for LLM-Based Automated Web Penetration Testing
Wang, C., Li, Y., Li, H., Sun, G., Li, X., & Tian, C. (2026) · Computers, materials & continua/Computers, materials & continua (Print) · doi:10.32604/cmc.2026.091579
Runtime Failure Recovery in LLM-Based Agent Systems: A Review of Detection, Attribution and Repair
Islam, M. T., Rahman, K. A., Biswas, P., Khan, S., & Mahmud, S. (2026) · European Journal of Theoretical and Applied Sciences · doi:10.59324/ejtas.2026.4(6).04
Beyond Division of Labor: How Roles Shape Feedback and Recovery in Multi-Agent SystemsPreprint
Yang, C.-H., Li, X., Thakur, R., & Yan, F. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2611.03931
DualEvolve: Dual-Level Self-Evolution of Mechanism and Orchestration for RecommendationPreprint
Gao, T., Wang, C., Yang, W., Mou, Y., Biao, T., Liu, M., & Yan, P. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2611.04439
ToolSpace: Scaling Tool-Centric Environment Synthesis for Long-Horizon AgentsPreprint
Dong, G.-T., Sun, Z.-C., Yang, X.-Y., Wang, R., Deng, X., Jin, J., Yang, Z.-X., Huang, J.-H., Han, H., Ma, M.-Y., et al. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2611.05036 · Cited by 1
Mondal, S. S., & Wang, J. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2611.05263
AgentAM: An AI Agent for Spatter- and Defect-Aware Process Optimization in Laser Powder Bed FusionPreprint
Ajenifujah, O., & Farimani, A. B. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2611.05171
FamilyTravel: Benchmarking Member-Attributable Conflict Resolution in Family Travel Planning
Qian, W., Yang, L., Su, L., Sheng, C., & Shao, M. (2026) · Lecture notes in computer science · doi:10.1007/978-981-92-7738-4_26
tok: a textual concrete syntax of BPMN and DMN for humans and AI agentsPreprint
Deja, M. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2611.07945
PyRUA-REAL: Robot Exploration and Adaptive Learning through RSI in the Real WorldPreprint
Wang, Q., Bi, J., Jiang, S., Si, R., Huang, W., Chen, K., Li, J., 李立云, Li, X., & Zhou, D. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2611.06768
Amine, A., & Saab, S. (2026) · International Journal of Information Security · doi:10.1007/s10207-026-01350-x
Liu, H., Chen, Y., Qiu, Z., Zhang, Y., Zhong, J., Wang, W., Li, Y., & Wang, T. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2611.05953
Rethinking Self-Repair in Code-as-Policy Agents: What Drives Retry Success?
Aphale, S., & Singh, A. (2026) · arXiv
Ma, J., Luo, H., Zhang, J., & Zuo, H. (2026) · doi:10.1145/3841452.3841493
Plan-Retrieve-Verify: An LLM-Driven Framework for Long-Video Audio-Visual Evidence Reasoning
XIAO, Y., Xu, D., Li, S., & Huang, Y. (2026) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3767308.3836283
LLM4Rail: An LLM-Augmented Personalized Railway Services Platform
Li, Z., Deng, X., Feng, C., Li, H., Wang, S., Fan, J., Shen, J., Wen, Z., Gao, L., & Wu, L. (2026) · Lecture notes in computer science · doi:10.1007/978-981-92-7735-3_27
EviSeek: An Evidence-Centric Agentic Framework for Embodied Active Information SeekingPreprint
Li, J., Cao, Z., 肖柏华, Bai, Y., & Karlsson, B. F. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2611.06434
Reglos: A Self-Evolving Personal Memory Agent with Recursive Self-ImprovementPreprint
Yang, S., Lin, J., Huang, Z., & Liu, W. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2611.06049
Time-Division Multiplexing: The Operational Rhythm and Temporal Organization Layer of Digital LifePreprint
Tong, H., Guo, L., Cui, N., & Yu, J. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2611.06603
A Real-Time Hallucination Intervention Method for Trustworthy LLM Reasoning
He, Y., Li, Z., Lu, S., Liu, G., & Dou, W. (2026) · Lecture notes in computer science · doi:10.1007/978-981-92-7744-5_4
Wang, M., Ning, W., Ying, J., & Li, D. (2026) · Expert Systems with Applications · doi:10.1016/j.eswa.2026.134954
KASPA: Knowledge-Augmented Sememe Prediction via LLMs and Adversarial Alignment
Zhao, X., Bai, Y., & Li, H. (2026) · Lecture notes in computer science · doi:10.1007/978-981-92-7741-4_9
Qian, C. Y., Peng, G., Sun, Y., Zeng, C., & Liu, J. (2026) · doi:10.5194/egusphere-2026-6762
ReproBridge: Building Reproducibility into ML Research ArtifactsPreprint
Wang, Y., Meng, R., Nam, J., Pfister, T., & Yoon, J. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2611.08452
RIVER: Evidence-guided multi-agent retrieval for enzyme--reaction discoveryPreprint
Chang, Y., Li, Y., Jiang, F., Wu, J., Chen, X., Hu, H., Wu, Y., Tang, W., Ma, M., Ouyang, W., et al. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2611.07757
ManimCode: Learning Visual Self-Correction for Educational AnimationPreprint
Liang, Z., & Liao, L. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2611.08294
ReferClaw: Disambiguating User Intent for Egocentric AssistancePreprint
Qin, H., Xiao, J., & Yao, A. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2611.07683
Recursive Self-Improvement for Long-Horizon Role-Playing DialoguePreprint
Li, Y. L., & Wu, Y. H. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2611.07469
Peilivanidis, V. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2611.07652
K, S. P., & Dr. Janarthanam, S. (2026) · Minimax Theory and its Applications
Shah, V. (2025) · Sciences du Nord Nature Science and Technology · doi:10.71238/snnst.v2i02.179
MP–GV: Multi-path Generation and Verification for LLM Reasoning
He, C., Zou, B., Chen, J., Xing, J., Shi, Y., & Ma, H. (2026) · Lecture notes in computer science · doi:10.1007/978-981-92-7201-3_9
Agentic AI for inverse design in nanophotonics and meta-optics
Kang, C., Bae, J., Bae, M., HAN, J., Suk, H., Kim, J., Jang, I., & Chung, H. (2026) · Scientific Reports · doi:10.1038/s41598-026-78977-2
Metadata
- Authors
- Shinn, N., Cassano, F., Berman, E., Gopinath, A., Narasimhan, K., & Yao, S.
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2023
- Pages
- 8634-8652
- ISSN
- 1049-5258 (ISSN-L)
- arXiv
- 2303.11366
- OpenAlex
- W7133222210
- Cited by
- 1,087
- References
- 0
- Citations by year
- 2026: 760 · 2025: 167 · 2024: 105 · 2023: 55
- FWCI
- 192.15
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- neural information processing systems (publishedVersion)
- arXiv (Cornell University) (submittedVersion, cc-by)
- arXiv (Cornell University) (cc-by)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Keywords
- language agents, verbal behavior, language acquisition
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-01, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-01 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.