Reflexion: Language Agents with Verbal Reinforcement Learning
Open accessThe DOI matches its DataCite record; 42 of the 42 references it cites were found in a registry or an index; 7 of the 8 sources its claims cite were checked for support.
Abstract
Large language models (LLMs) have been increasingly used to interact with external environments (e.g., games, compilers, APIs) as goal-driven agents. However, it remains challenging for these language agents to quickly and efficiently learn from trial-and-error as traditional reinforcement learning methods require extensive training samples and expensive model fine-tuning. We propose Reflexion, a novel framework to reinforce language agents not by updating weights, but instead through linguistic feedback. Concretely, Reflexion agents verbally reflect on task feedback signals, then maintain their own reflective text in an episodic memory buffer to induce better decision-making in subsequent trials. Reflexion is flexible enough to incorporate various types (scalar values or free-form language) and sources (external or internally simulated) of feedback signals, and obtains significant improvements over a baseline agent across diverse tasks (sequential decision-making, coding, language reasoning). For example, Reflexion achieves a 91% pass@1 accuracy on the HumanEval coding benchmark, surpassing the previous state-of-the-art GPT-4 that achieves 80%. We also conduct ablation and analysis studies using different feedback signals, feedback incorporation methods, and agent types, and provide insights into how they affect performance.
Overview
CoChat Summary
TL;DR
Reflexion reinforces language agents through verbal self-reflection stored in episodic memory rather than weight updates, improving performance across decision-making, reasoning, and coding tasks. It reports gains including 91% pass@1 on HumanEval, a 22% absolute improvement on AlfWorld, and 20% on HotPotQA.
Key findings
- On HumanEval Python, Reflexion achieves 91.0 pass@1, surpassing the previous state-of-the-art GPT-4 at 80.1; on HumanEval Rust it reaches 68.0 vs. 60.0, MBPP Rust 75.4 vs. 70.9, and Leetcode Hard 15.0 vs. 7.5.
- In AlfWorld, ReAct + Reflexion completes 130 out of 134 tasks using a simple heuristic and improves over strong baselines by an absolute 22% over 12 iterative learning steps; ReAct-only converges at a 22% hallucination rate with no long-term recovery.
- In HotPotQA, Reflexion improves over baselines by 20%; self-reflection gives an 8% absolute boost over episodic memory alone, and although CoT (GT) fails on 39% of questions, Reflexion improves accuracy by 14% without access to ground-truth answers.
- Ablations on the 50 hardest HumanEval Rust problems show full Reflexion at 0.68 vs. baseline 0.60; omitting test generation drops to 0.52, and omitting self-reflection stays at 0.60.
Methods
- Reflexion uses a modular loop with an Actor that generates text/actions, an Evaluator that scores outputs, and a Self-Reflection model that converts feedback into verbal summaries stored in memory; trials repeat until the Evaluator passes or a max trial count is reached, with memory usually bounded to 1–3 experiences.
- Experiments cover AlfWorld (134 environments, six tasks, ReAct + GPT-3), HotPotQA (100 questions, CoT/ReAct, exact-match grading, memory size 3), and programming (HumanEval, MBPP, LeetcodeHardGym; Python/Rust via MultiPL-E; self-generated unit tests up to 6).
- Ablations and analyses vary feedback signals, feedback incorporation methods, and agent types; compromised approaches are tested on HumanEval Rust, and a WebShop experiment is run across 100 environments.
Limitations
- The paper states Reflexion may fall into non-optimal local minima, limits long-term memory to a sliding window with maximum capacity, and notes code-generation test-driven development is limited by non-deterministic, impure, hardware-dependent, or concurrent functions; it also relies on LLM self-evaluation/heuristics and lacks a formal success guarantee.
- The paper reports WebShop failure: after only four trials the agent shows no improvement and does not generate helpful self-reflections, concluding Reflexion cannot solve tasks requiring significant diversity and exploration.
- Evident from the text: self-correction is an emergent quality of stronger, larger models—starchat-beta shows no improvement (baseline 0.26 vs. Reflexion 0.26)—and flaky or incorrect test suites can cause false positives/negatives, with false negatives preferred.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
4 Valid · 2 Not valid · 0 Not checked · 59 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Therefore, in the case in which the model generates a flaky test suite, it is possible that all tests pass on an incorrect solution and lead to a false positive label on a code completion [11].”
§ Reflexion: Language Agents with Verbal Reinforcement Learning > Analysis
What the sources say
- Partly supportedcites [11] 11. Lam, W., Winter, S., Wei, A., Xie, T., Marinov, D., and Bell, J. (2020). A large-scale longitudinal study of flaky tests. Proc. ACM Program. Lang., 4(OOPSLA). sourceExperimental — accuracy not yet measured
The Introduction (page not provided) says a flaky test can pass and fail on the same code and that changes may be merged when all tests pass. It does not address model-generated test suites, incorrect code completions, or false-positive labels, so those parts of the claim are not established by this paper. (LLM, conf=0.82)
hedgedstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“3 shows an inferior 52% vs 60% (baseline) accuracy, which suggests that the agent is unable to determine if the current implementation is correct without unit tests.”
§ Reflexion: Language Agents with Verbal Reinforcement Learning > Ablation study
hedgedstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“ReAct + Reflexion significantly outperforms ReAct by completing 130 out of 134 tasks using the simple heuristic to detect hallucinations and inefficient planning.”
§ Reflexion: Language Agents with Verbal Reinforcement Learning > Results
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“4 shows that self-reflection improves learning by an 8% absolute boost over the episodic memory learning advantage.”
§ Reflexion: Language Agents with Verbal Reinforcement Learning > Analysis
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“on reasoning questions in HotPotQA [28] by 20%”
- Also stated in: § 4 Experiments · plain
“Most notably, Reflexion improves performance over strong baselines by 22% in AlfWorld, 20% in HotPotQA, and 11% on HumanEval.”
§ Reflexion: Language Agents with Verbal Reinforcement Learning > 1 Introduction
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § 4 Experiments · plain
30 more claims
Create a free account to see all 65 claims and every source verdict.
- It may state two separate claims as one. 18
- Probably not a substantial claim. 11
- The quote only partly states this claim. 3
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source doesn’t support the claim as written.
In the citing paper
“Memory and reflection systems such as MemAgent (Yu et al., 2025a), Reflexion (Shinn et al., 2023), and Generative Agents (Park et al., 2023) improve retrieval and episodic memory, but do not perform context shaping, state restructuring, or nextinstruction refinement.”
From PAACE: A Plan-Aware Automated Agent Context Engineering Framework (2025) · cites this paper as Shinn et al., 2023
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe cited source doesn’t support the claim as written.
In the citing paper
“However, Reflexion computes verbal reward over a full trajectory, yielding a single end-of-episode signal that conflates credit across reasoning steps: a failure due to a single intermediate error receives the same critique pressure as one due to a flawed strategy.”
From Process Supervision via Verbal Critique Improves Reasoning in Large Language Models (2026) · cites this paper as Shinn et al. [2023]
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe cited source doesn’t support the claim as written.
In the citing paper
“Unlike Reflexion, which only reflects on unsuccessful trajectories, our approach separately reflects on both successful and unsuccessful ones.”
From An Efficient Context-Dependent Memory Framework for LLM-Centric Agents (2025) · cites this paper as Shinn et al., 2023
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe cited source doesn’t support the claim as written.
In the citing paper
“The dominant approach is to curate memory at write time.”
From Just-in-Time Memory: Learning to Curate Task-Adaptive Memory for LLM Agents (2026) · cites this paper as Shinn et al., 2023
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Interaction and code generation are increasingly used together, with code as the modality of choice for actions [48, 59], tool construction [13, 51, 69], and reasoning [39, 66, 67].”
From SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineering (2024) · cites this paper as [39]
Experimental — accuracy not yet measured
107 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Reflexion: Language Agents with Verbal Reinforcement Learning > 3 Reflexion: reinforcement via verbal reflection
“while M e not pass or t < max trials do”
§ Reflexion: Language Agents with Verbal Reinforcement Learning > Self-reflection
“The Actor, Evaluator, and Self-Reflection models work together through trials in a loop until the Evaluator deems τ t to be correct.”
Citations
Cites
The publisher hasn’t deposited this paper’s reference list.
Cited by
Items 1,701–1,800 of 3,537
Dissecting Adversarial Robustness of Multimodal LM Agents
Wu, C. H., Shah, R., Koh, J. Y., Salakhutdinov, R., Fried, D., & Raghunathan, A. (2024) · arXiv · doi:10.48550/arxiv.2406.12814 · Cited by 1
“…in these environments, and many works have focused on improving the agents via reasoning (Wei et al., 2022; Kojima et al., 2022; Yao et al., 2023b), search (Yao et al., 2023a), environment feedback (Huang et al., 2022; Shinn et al., 2023), and grounding (Ichter et al., 2022; Zheng et al., 2024).”
Do as We Do, Not as You Think: the Conformity of Large Language Models
Weng, Z., Chen, G., & Wang, W. (2025) · arXiv · doi:10.48550/arxiv.2501.13381 · Cited by 1
“Llama3-70B Qwen2-72B Another commonly used strategy to enhance LLM reasoning, apart from modifying system prompts, is introducing of a reflection mechanism [55–57].”
Memory in the Age of AI Agents
Hu, Y., Liu, S., Yue, Y., Zhang, G., Liu, B., Zhu, F., Lin, J., Guo, H., Dou, S., Xi, Z., et al. (2025) · arXiv · doi:10.48550/arxiv.2512.13564 · Cited by 389
Mittal, S. (2026) · arXiv · doi:10.48550/arxiv.2609.01660 · Cited by 1
“On agent methods, ReAct-style interleaved reasoning-and-acting [1] and verbal self-reflection [2] are the dominant control loops in current agent systems.”
Diversity Empowers Intelligence: Integrating Expertise of Software Engineering Agents
Zhang, K., Yao, W., Liu, Z., Feng, Y., Liu, Z., Murthy, R., Lan, T., Li, L., Lou, R., Xu, J., et al. (2024) · arXiv · doi:10.48550/arxiv.2408.07060 · Cited by 1
“Fundamental Language Agent Pioneering AI agent methods along this line of work include ReAct (Yao et al., 2023), Reflexion (Shinn et al., 2023), CodeAct (Wang et al., 2024b), etc., in which ReAct interprets the user query, generates functional API calls, and gets the tool outputs in real time;…”
MethodReinforcement World Model Learning for LLM-based Agents
Yu, X., Peng, B., Xu, R., Shen, Y., He, P., Nath, S., Singh, N., Gao, J., & Yu, Z. (2026) · arXiv · doi:10.48550/arxiv.2602.05842 · Cited by 1
“Training Decision-Making Agents LLM-based agents (Yao et al., 2023; Shinn et al., 2023) has seen wide applications in domains such as interactive gaming (Wang et al., 2023; Feng et al., 2025c); software engineering (Jimenez et al., 2024; Yang et al., 2024); computer, phone, browser-use (Xie et al.,…”
Chu, K. (2026) · arXiv · doi:10.48550/arxiv.2604.23338 · Cited by 1
“2) Chain-of-Thought Unfaithfulness: Chain-of-thought reasoning [31] is foundational to modern agent planning; extensions such as Tree of Thoughts [82], Self-Refine [83], and Reflexion [84] amplify reasoning depth by branching over multiple thought trajectories or incorporating verbal feedback loops.”
Feng, Y., Sun, J., Yang, Z., Ai, J., Li, C., Li, Z., Zhang, F., He, K., Ma, R., Lin, J., et al. (2026) · arXiv · doi:10.48550/arxiv.2602.14337 · Cited by 1
“…2025; Google, 2025) can now function like human engineers: they plan architectures, navigate repositories, manage development environments, and execute multi-step workflows via Command Line Interfaces (CLI) based on environment feedback (Yao et al., 2022; Shinn et al., 2023; Madaan et al., 2023).”
Fundamentals of Building Autonomous LLM Agents
Castrillo, V. D. L., Gidey, H. K., Lenz, A., & Knoll, A. (2025) · arXiv · doi:10.48550/arxiv.2510.09244 · Cited by 1
“Papers like [49] and [38] exemplify this capability, where agents analyze their own outputs or execution traces to pinpoint issues.”
InfluentialMMAU: A Holistic Benchmark of Agent Capabilities Across Diverse Domains
Yin, G., Bai, H., Ma, S., Nan, F., Sun, Y., Xu, Z., Ma, S., Lu, J., Kong, X., Zhang, A., et al. (2024) · arXiv · doi:10.48550/arxiv.2407.18961 · Cited by 1
GTR: Guided Thought Reinforcement Prevents Thought Collapse in RL-Based VLM Agent Training
Wei, T., Yang, Y., Xing, J., Shi, Y., Lu, Z., & Ye, D. (2025) · 2025 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51701.2025.01752 · Cited by 1
“Many previous works have leveraged prompting techniques to activate decision-making capabilities from frozen LLMs [2, 16, 29, 36, 45, 47–49, 56, 57].”
Explicit Memory Learning with Expectation Maximization
Yin, Z., Sun, Q., Guo, Q., Zeng, Z., Cheng, Q., Qiu, X., & Huang, X. (2024) · Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2024.emnlp-main.927 · Cited by 1
“Current methods of updating explicit memory include manual re-visions (Mei et al., 2024) and self-reflection (Liu et al., 2023a; Shinn et al., 2023; Praas, 2023).”
MethodAmbiguity Resolution in Vision-and-Language Navigation with Large Language Models
Wei, S., Wang, C., & Qi, J. (2024) · IEEE International Conference on Information Technology, Big Data and Artificial Intelligence (ICIBA) · doi:10.1109/iciba62489.2024.10868019 · Cited by 2
“In comparison, the ReAct+Reflexion [26] method also shows significant improvement, achieving an SR of 54.4%, although it remains slightly inferior to our model.”
InfluentialTackling the Length Barrier: Dynamic Context Browsing for Knowledge-Intensive Task
Qian, H., Liu, Z., Zhang, P., Mao, K., Zhou, Y., Chen, X., & Dou, Z. (2025) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3690624.3709240 · Cited by 1
Exploiting Edited Large Language Models as General Scientific Optimizers
Lv, Q., Liu, T., & Wang, H. (2025) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2025.naacl-long.270 · Cited by 7
On the Truthfulness of Surprisingly Likely Responses of Large Language Models
Goel, N. (2025) · ACM Collective Intelligence Conference (CI) · doi:10.1145/3715928.3737471 · Cited by 2
Jordan, J., Hakimov, S., & Schlangen, D. (2025) · Lecture notes in computer science · doi:10.1007/978-3-032-02551-7_6 · Cited by 2
Peradantha, I. B. G. S., Ruspawati, I. A. W., Karina, A. E., & Wijaya, K. I. (2025) · Visual Heritage Jurnal Kreasi Seni dan Budaya · doi:10.30998/vh.v7i2.13254 · Cited by 1
ToolBrain: A Flexible Reinforcement Learning Framework for Agentic Tools
Le, Q. M., Luu, M. S. K., Tran, K.-T., Nguyen, D., Pham, H. Q. V., Le, Q., Lam, H. T., & Nguyen, H. D. (2026) · Adaptive Agents and Multi-Agents Systems · doi:10.65109/zkra7271 · Cited by 1
Leveraging Large Language Models for Enhanced Code Review
Rybalchenko, A., & Al-Turany, M. (2025) · EPJ Web of Conferences · doi:10.1051/epjconf/202533701066 · Cited by 1
FuseMind: Fusing reflection and prediction elevates agent’s reasoning capabilities
Ma, X., Ge, X., Xu, H., Fu, D., Wang, Z., Liu, Y., He, K., & Xu, W. (2025) · Neurocomputing · doi:10.1016/j.neucom.2025.131755 · Cited by 2
PanelTR: Zero-Shot Table Reasoning Framework Through Multi-Agent Scientific Discussion
Ma, Y. (2025) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn64981.2025.11228106 · Cited by 2
“Reflexion [43] enhances this by incorporating self-reflection mechanisms that allow agents to learn from their mistakes and improve their reasoning strategies over time.”
Agile assistive hospital robot for suboptimal Task execution in dynamic environments
Chiang, Y., Lee, I.-P., Fu, L., & Lee, Y.-H. (2026) · Autonomous Robots · doi:10.1007/s10514-026-10255-6 · Cited by 1
“Closed-loop strategies, including ReAct (Yao et al., 2023) and Reflexion (Shinn et al., 2023), improve robustness through feedback, while interactive frameworks (Hori et al., 2025) allow users to correct plans in real time.”
ChartGen-Agent: A Three-Stage Framework for Automated High-Quality Chart Generation
Jiang, R., Wu, S., Wu, Z., Han, Z., & Zhong, J. (2025) · Lecture notes in computer science · doi:10.1007/978-981-95-3462-3_2 · Cited by 1
LLM-based Adaptive Requirements Elicitation for Innovative Systems (S)
Nakagawa, H., & Honiden, S. (2025) · Proceedings/Proceedings of the ... International Conference on Software Engineering and Knowledge Engineering · doi:10.18293/seke2025-038 · Cited by 1
Cognition Envelopes for Bounded Decision Making in Autonomous UAS Operations
Granadeno, P. A. A., Russell, A. M. B., Nelson, S., Hernandez, D., Petterson, M., Murphy, M. N., Scheirer, W. J., & Cleland‐Huang, J. (2026) · IEEE/ACM International Conference on AI Engineering – Software Engineering for AI (CAIN) · doi:10.1145/3793653.3793768 · Cited by 1
Chen, D., Liu, Z., Fang, F., Leong, C. T., Ni, S., Argha, A., Alinejad‐Rokny, H., Yang, M., & Li, C. (2025) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2025.emnlp-main.645 · Cited by 4
Lango, M., & Dušek, O. (2025) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2025.emnlp-industry.142 · Cited by 2
“Beyond single-pass generation, reflective approaches like Reflexion (Shinn et al., 2023) and Self-Refine (Madaan et al., 2023) introduced iterative frameworks that equip models with the ability to critique and revise their own outputs to improve constructed programs.”
Enhancing Edge Microservice Deployment Efficiency with an LLM-Empowered Multi-agent Framework
Gao, S., Wang, Z., Zhao, Y., & Li, Z. (2025) · Communications in computer and information science · doi:10.1007/978-981-95-4088-4_26 · Cited by 1
StarBurst: Aiding Design Ideation Through AI-Generated Remote Associations
Zhang, P., Fang, R., Liu, F., Ye, Y., Cui, S., & Yin, M. (2025) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2025.2582774 · Cited by 1
“Research has shown that this reflection mechanism can significantly improve the performance of large language models (Duan et al., 2024; Shinn et al., 2023).”
(P)rior(D)yna(F)low: A Priori Dynamic Workflow Construction via Multi-Agent Collaboration
Lin, Y., Zhao, L., & Shi, Y. (2026) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp55912.2026.11462751 · Cited by 1
Anand, D., & Shareghi, E. (2026) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/2026.emnlp-main.1259 · Cited by 1
RE-GRPO: Leveraging hard negative cases through large language model guided self training
Liu, H., & Xiao, L. (2025) · Neurocomputing · doi:10.1016/j.neucom.2025.132543 · Cited by 1
Luo, J., Huang, Z., & Jian-hua, G. (2026) · IET Software · doi:10.1049/sfw2/2169889 · Cited by 1
Sivamayilvelan, K., Elakkiya, R., Subramaniyaswamy, V., Balachandran, S., Kotecha, K. V., & Kulkarni, A. (2026) · Journal Of Big Data · doi:10.1186/s40537-025-01351-y · Cited by 1
“We are planning to implement verbal feedback [59] to improve the decision-making ability of the chatbot using Reinforcement Learning.”
Du, Z., Wang, H., & Hashimoto, K. (2026) · Computers, materials & continua/Computers, materials & continua (Print) · doi:10.32604/cmc.2025.074520 · Cited by 2
“Representative approaches include ReAct [20], which interleaves reasoning traces with environment actions, and Reflexion [21], which employs verbal self-reflection to learn from task failures.”
Robot-based Optical Assessment of Vital Signs in Healthcare with a Social Interface
Klein, S., Eixelberger, T., Werling, A., Kraus, M., Shen, S., André, E., Folwerk, J., Lang-Richter, N. R., & Wittenberg, T. C. (2025) · Current Directions in Biomedical Engineering · doi:10.1515/cdbme-2025-0306 · Cited by 1
AdaTIR: Adaptive Tool-Integrated Reasoning via Difficulty-Aware Policy Optimization
Fang, Z., & Sun, R. (2026) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/2026.findings-emnlp.567 · Cited by 1
Chen, Y., Li, S., & Yan, R. (2024) · Findings of the Association for Computational Linguistics: EACL · doi:10.18653/v1/2024.findings-eacl.4 · Cited by 8
Kamat, R. S. K. A. R. K. (2025) · International Conference on Research in Computational Intelligence and Communication Networks (ICRCICN) · doi:10.1109/icrcicn68210.2025.11364909 · Cited by 1
“Contemporary agent architectures predominantly rely on augmenting LLMs with external tools, memory systems, and structured workflows to enhance their reasoning and execution capabilities [7], [8].”
Hardware implementation of photonic neuromorphic autonomous navigation
Chen, Y., Xiang, S., Zeng, X., Yu, M., Zou, T., Shi, S., Guo, X., Han, Y., Zhang, Y., & Hao, Y. (2026) · npj Unconventional Computing · doi:10.1038/s44335-026-00086-0 · Cited by 1
Zikrullah, S. (2026) · JATI (Jurnal Mahasiswa Teknik Informatika) · doi:10.36040/jati.v10i1.16926 · Cited by 1
Cai, L., Zhang, R., Wang, J., Zhang, Y., Peng, M., Jiang, T., Niyato, D. T., Ni, W., Jamalipour, A., & Kim, D. S. (2026) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2026.3665241 · Cited by 5
“In the LAENet environment generated by the LLM-based simulator, the Lipschitz constant of reward relative to state is computed according to (38).”
Pham, T., Phan, N. M., Cao, B., Truong, C. P., Nguyen, T.-S., Tien, M., & Nguyen, N. S. (2026) · Scientific Journal of Computer Science · doi:10.64539/sjcs.v2i1.2026.380 · Cited by 1
“Self-reflection mechanisms enable LLMs to evaluate and improve their outputs through introspection [10], [11], [17].”
Yu, X., Zhong, V., & Crisan, A. (2026) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/3742413.3789088 · Cited by 1
“Implemented through an agentic, reflection-based annotation pipeline [38], this abstraction enables users to visualize and reason about what code is doing.”
InfluentialAVATAAR: Agentic Video Answering via Temporal Adaptive Alignment and Reasoning
Yeh, F.-C., Patel, U., & Gondhalekar, C. (2025) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata66926.2025.11401853 · Cited by 1
“Reflexion [21] equips agents to critique prior outputs and revise them through memory updates.”
From Verification Burden to Trusted Collaboration: Design Goals for LLM-Assisted Literature Reviews
Nogueira, B., Geyer, W., Anderson, A. W., Li, T. J.-J., Kim, D., Moniz, N., & Chawla, N. V. (2026) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/3742414.3794723 · Cited by 4
“While fully autonomous discovery remains as-pirational, near-term developments promise hybrid systems that augment human scientific reasoning and creativity.”
InfluentialAgentic Meta-Orchestrator for Multi-Task Copilots
Zhu, X., & Zhou, Y. (2025) · IEEE ... International Conference on Data Mining workshops · doi:10.1109/icdmw69685.2025.00206 · Cited by 1
“Although great reinforcement learning approaches, for example, React [45] and Reflection [46], and Self-critic [47] have been attempted for complex systems, how we quickly update the planning when new agents are added remains an open problem.”
Javaji, S. R., & Zhu, Z. (2025) · International Joint Conference on Natural Language Processing and Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics (IJCNLP-AACL) · doi:10.18653/v1/2025.ijcnlp-long.126 · Cited by 1
“Current technologies like tree-of-thought (Yao et al. 2024), maieutic prompting (Jung et al. 2022) and Reflexion (Shinn et al. 2023) incorporate functions resembling self-questioning.”
DiffBench Meets DiffAgent: End-to-End LLM-Driven Diffusion Acceleration Code Generation
Jiao, J., Zhu, H., Yang, P., Wang, J., Liu, J., Liu, Z., Li, D., Fang, Y., Yong, J., Wang, B., et al. (2026) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v40i27.39395 · Cited by 1
RAGTurk: Best Practices for Retrieval Augmented Generation in Turkish
Köse, S. K., Baytekin, M. C., Aktaş, B., Görür, B. K., Munis, E. A., Yılmaz, D., Kartal, M. Y., & Toraman, Ç. (2026) · Workshop on Natural Language Processing for Turkic Languages (SIGTURK) · doi:10.18653/v1/2026.sigturk-1.15 · Cited by 2
Notice of Removal: DUPLEX: Agentic Dual-System Planning via LLM-Driven Information Extraction
Hua, K., Wang, D., Gu, Y., & Ma, X. (2026) · International Conference on Robotics and Automation Sciences (ICRAS) · doi:10.1109/icras70064.2026.11717896 · Cited by 1
“Recent advancements in autonomous agents have introduced the concept of reflexion or self-correction, enabling LLMs to iteratively refine their outputs based on external feedback [26], [27].”
IoT-Brain: Grounding LLMs for Semantic-Spatial Sensor Scheduling
Zhou, Z., Zhang, L., Wang, J., Yuan, M., Lin, J., & Song, J. (2026) · ACM Annual International Conference on Mobile Computing and Networking (MobiCom) · doi:10.1145/3795866.3796695 · Cited by 1
“Through a Thought-Action-Observation cycle [63, 78], the agent addresses specific node hypotheses, such as identifying a valid exit in the Library , translating them into designing a corresponding topological verification query.”
Romero-Mariona, J., & Romero, E. (2026) · Hawaii International Conference on System Sciences (HICSS) · doi:10.24251/hicss.2026.615 · Cited by 1
Li, J., Zhu, S., & Xiong, D. (2026) · Information Processing & Management · doi:10.1016/j.ipm.2026.104819 · Cited by 1
Kukkala, U. R. (2026) · International Journal of Computer Applications · doi:10.5120/ijca2026926599 · Cited by 1
A Reproducibility Study of Metacognitive Retrieval-Augmented Generation
Iturra-Bocaz, G., & Galuščáková, P. (2026) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3805712.3808551 · Cited by 1
“However, although modern LLMs employ implicit control mechanisms such as routing or model selection, they typically generate responses without explicit self-reflection or awareness of their own knowledge limitations [23, 37].”
LBM: Hierarchical Large Auto-Bidding Model via Reasoning and Acting
Li, Y., Lyu, Z., Jiang, P., Cai, Q., Pan, F., An, B., & Jiang, P. (2026) · International World Wide Web Conference (WWW) · doi:10.1145/3774904.3792202 · Cited by 4
Scaling LLM Reasoning from Minimal Labels: A Semi-Supervised Framework with a Lightweight Verifier
Kato, K., Chu, C., Murawaki, Y., & Kurohashi, S. (2026) · Language Resources and Evaluation Conference (LREC) · doi:10.63317/36fhpois9sxp · Cited by 1
Ponduru, P. S. (2026) · INTERANTIONAL JOURNAL OF SCIENTIFIC RESEARCH IN ENGINEERING AND MANAGEMENT · doi:10.55041/ijsrem62689 · Cited by 1
Li, Y., Jin, C., Peng, X., & Lin, Y. (2026) · Journal of Intelligent Information Systems · doi:10.1007/s10844-026-01050-x · Cited by 1
“Feedback sources can be categorized into: LLM itself (Madaan et al., 2023; Shinn et al., 2023), a separately trained feedback model, or external tools.”
Influentialcotomi Act: Learning to Automate Work by Watching You
Oyamada, M., Takeoka, K., Akimoto, K., Obara, R., Enomoto, M., Zhang, H., Haraguchi, D., & Tamura, T. (2026) · ACM Conference on AI and Agentic Systems (CAIS) · doi:10.1145/3786335.3813203 · Cited by 2
“A controlled proxy study confirms that task success improves as this behavior-derived knowledge accumulates, validating learning from observation as a practical path to organizational grounding.”
Liu, K., Xiong, H., Zhang, J., & Peng, M. (2026) · Electronics · doi:10.3390/electronics15102078 · Cited by 1
Genflow Ad Studio: A Compound AI Architecture for Brand-Aligned, Self-Correcting Video Generation
Das, D., Nigam, L., Bahadur, S. K. J., & Dhar, G. (2026) · ACM Conference on AI and Agentic Systems (CAIS) · doi:10.1145/3786335.3813213 · Cited by 1
On the Challenges and Opportunities of Fuzzing via Large Language Models: A Review
Sun, Y., Andersen, V. H., Choudhary, G., & Dragoni, N. (2026) · Applied Sciences · doi:10.3390/app16105160 · Cited by 1
Ngom, A., Wu, Z., Mohoney, J., Moore, J., Zhang, A., Madden, S. R., & Kraska, T. (2026) · ACM Conference on AI and Agentic Systems (CAIS) · doi:10.1145/3786335.3813143 · Cited by 2
Karakaş, S. (2026) · Proceedings of the Workshop on Turkic and Languages in Contact with Turkic · doi:10.3765/sm30v174 · Cited by 2
Parthenon Law: A Self-Evolving Legal-Agent Framework
Geng, H., & Liu, L. (2026) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/2026.emnlp-industry.28 · Cited by 2
From Digital Twins to Autonomous Local Agents: Rethinking AI for Smart Water Networks
Restuccia, G., Garlisi, D., Giuliano, F., Pagano, A., & Tinnirello, I. (2026) · IEEE Internet of Things Journal · doi:10.1109/jiot.2026.3700039 · Cited by 2
“This self-correction mechanism instantiates the Reflexion [15] and Self-Refine [16] paradigms, where the agent leverages environmental feedback (i.e., runtime execution errors) to iteratively update its state and refine its outputs within a bounded number of attempts.”
RASO: Role-Aware Shared Reflection for Multi-Agent Orchestration in E-Commerce Long-Horizon Planning
Niu, K., Zhang, Y., Wang, X., Ma, C., Hong, S., Zhuo, H. H., Zhu, J., & Zheng, B. (2026) · Proceedings of the International Conference on Automated Planning and Scheduling · doi:10.1609/icaps.v36i1.42873 · Cited by 1
“Recent work has applied Large Language Model (LLM) to multi-agent systems with self-reflection for strategic decision-making(Shinn et al. 2023; Madaan et al. 2024; Du et al. 2023; Hong et al. 2023; Qian et al. 2024; Gao et al. 2024; Lu et al. 2025).”
SciTrace: Trajectory-Aware Safety Reasoning for Scientific Discovery Agents
Swaminathan, T., Jiang, R., Zhang, L., & Xu, M. (2026) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/2026.findings-emnlp.1502 · Cited by 1
MAESTRO: large language model-enabled cross-agency coordination for natural disaster early warning
Wang, J., Wang, N., Shen, Y., Lu, W., Lin, P., Ouyang, M., Wang, Y., Wang, J., Huang, X., Liang, W., et al. (2026) · npj Artificial Intelligence · doi:10.1038/s44387-026-00124-z · Cited by 1
MapAgent: An Industrial-Grade Agentic Framework for City-scale Lane-level Map Generation
Xia, D., Li, Z., Zhao, H., Xie, D., Kong, Y., Liu, X., Huang, J., Yang, M., & Yang, D. (2026) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3770855.3818443 · Cited by 3
SPOT-E: Test-Time Entropy Shaping with Visual Spotlights for Frozen VLMs
Yin, B., Hu, X., Xu, C., Shen, R., Yang, M., Zhang, J., Jiang, P.-T., Tan, C., & Yan, S. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37225-3_6 · Cited by 1
Zhang, B. (2026) · Acadlore Transactions on AI and Machine Learning · doi:10.56578/ataiml050206 · Cited by 1
A Survey of Large-Model-Based AI Agents
Qin, C., & Jin, L. (2026) · Tsinghua Science & Technology · doi:10.26599/tst.2026.9010072 · Cited by 2
FactCorrector: A Graph-Inspired Approach to Long-Form Factuality Correction of Large Language Models
Carnerero-Cano, J., Pronesti, M., Marinescu, R., Tchrakian, T. T., Barry, J., Gajcin, J., Hou, Y., Pascale, A., & Daly, E. M. (2026) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2026.acl-long.2147 · Cited by 1
Tran, N. P., Jaumard, B., Premkumar, K., & Memon, S. (2026) · Joint European Conference on Networks and Communications & 6G Summit (EuCNC/6G Summit) · doi:10.1109/eucnc/6gsummit68295.2026.11577467 · Cited by 1
“• Reflection-Augmented Agent Coordination : A multi-agent environment based on ReAct reasoning patterns [5], reinforced with self-reflection loops to refine outputs, detect hallucinations, and correct errors without human supervisory intervention [6], [7].”
OPT-BENCH: Evaluating the Iterative Self-Optimization of LLM Agents in Large-Scale Search Spaces
Li, X., Chen, J., Fang, X., Ding, S., Duan, H., Liu, Q., & Chen, K. (2026) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2026.findings-acl.1417 · Cited by 1
“LLM Agents Recent frameworks have empowered LLMs with tool use (ReAct (Yao et al., 2022a), RDAgent (Yang et al., 2025), Toolformer (Schick et al., 2023)) and feedback loops (Reflexion (Shinn et al., 2023)).”
PRISM-MCTS: Learning from Reasoning Trajectories with Metacognitive Reflection
Cheng, S., Tian, B., Hao, Y., & Wei, Z. (2026) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2026.findings-acl.807 · Cited by 1
Beyond Length Scaling: Synergizing Breadth and Depth for Generative Reward Models
Zhang, Q., Wang, Y., Wu, T., Xu, C., Sun, Q., Zheng, K., Liu, X., & Ma, C. (2026) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2026.findings-acl.709 · Cited by 1
Yang, X., Lin, C., Ma, X., Liu, D., Zheng, R., Liu, H., & Wu, W. (2026) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2026.3710392 · Cited by 4
“To this end, we propose a Reflexion [25]-based self-evolution mechanism for the LLM policy, which continuously enhances its decision-making through environmental feedback, self-reflection, and dynamic knowledge base updates.”
Knowledge-Centric Agents for Workflow Generation in ComfyUI
Li, Z., Sun, L., Ming, R., Zhang, H., Paudel, D. P., Gool, L. V., & Gu, J. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37232-1_17 · Cited by 1
Kim, C. G., & Ahn, S. (2026) · Systems · doi:10.3390/systems14070881 · Cited by 1
Harrison, J. (2026) · Scientific Reports · doi:10.1038/s41598-026-64449-0 · Cited by 1
AdPilot: Towards Fully Autonomous Advertising Delivery via Agentic Reinforcement Learning
Sun, S., He, Q., Li, X., Song, Z., Dai, S., Wang, R., Cheng, Y., Zhu, Z., Yao, L., Xiao, L., et al. (2026) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3770855.3818315 · Cited by 1
Enhancing GUI Agent with Uncertainty-Aware Self-Trained Evaluator
Chen, G., Jie, L., Zou, L., Guan, W., Zhang, M., & Nie, L. (2025) · neural information processing systems · doi:10.52202/085713-4752 · Cited by 8
“With the powerful language understanding and generation abilities, (multimodal) large language model-based agents [53, 62, 7, 28, 38, 45] can perform more effectively across diverse and complex tasks, demonstrating greater generality and adapt-ability.”
Yi, Z., Zhao, J., Lv, J., & Wang, T. (2026) · Information Fusion · doi:10.1016/j.inffus.2026.104700 · Cited by 1
ATLAS: Discovering Agent Strategies through LLM-Guided Abstraction and Automata Learning
Lopez-Miguel, I. D., Happe, A., Cito, J., Bartocci, E., Könighofer, B., & Tappler, M. (2026) · ACM/IEEE International Conference on Model Driven Engineering Languages and Systems (MODELS) · doi:10.1145/3822455.3838777 · Cited by 1
ForeDreamer: A Self-Evolving Dual-Agent Memory Architecture for Future Event Prediction
Zhong, L., Du, Z., Wu, L., Bo, Y., Li, H., Jing, C., Chen, H., Xi, Y., & Shen, C. (2026) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/2026.findings-emnlp.147 · Cited by 1
Agent-G2: Gaussian Guidance for Agentic Reinforcement Learning
Wang, Z., Miao, Y., Lu, Z., Pan, T., Qiu, Y., Li, H., Qiu, P., Zhang, R., & Shen, Y. (2026) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/2026.emnlp-main.268 · Cited by 3
Dynamic Adaptation of the LLM Context for Generating Routines with Coupled Semantics
Villuri, G., Shaik, H., & Doboli, A. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-38410-2_26 · Cited by 1
“Zero-shot Reflexion [13] AlphaEvolve [11] Ours Iterative refinement Structured feedback Multi-candidate per iter.”
Knowledge‐Augmented Large Language Model for Autonomous MODFLOW 6 Input File Generation
Krčmář, D., Hodasová, K., Zatlakovic, M., & Bahnova, N. (2026) · Ground Water · doi:10.1111/gwat.70102 · Cited by 1
“The loop pattern itself is not new: Self-Refine (Madaan et al. 2023), Reflexion (Shinn et al. 2023), and SWE-agent (Yang et al. 2024) package similar feedback loops for general-purpose coding agents.”
Step Back to Move Forward: Reflection-Aware Preference Optimization for Visual Generation
Wu, J., Lin, J., Sun, J., Zhang, B., Wang, H., Fan, D., Liu, H., Gan, Q., Yang, F., & Gao, T. (2026) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3767308.3835988 · Cited by 1
Quantum Hybridization: Toward Intelligent Hybrids That Are Smarter and Safer Than Their Constituents
Terziyan, V. Y., Antonini, A., Vitko, O., & Terziyan, O. (2026) · Open Research Online (The Open University) · doi:10.5281/zenodo.22939502 · Cited by 1
AndroidLens: Long-Latency Evaluation with Nested Sub-Targets for Android GUI Agents
Cao, Y., Wang, Y., Bu, P., Xing, J., Jiang, W., Zhu, Z., Ma, J., Zhou, S., Lu, T., Song, J., et al. (2026) · doi:10.1109/cvprf71909.2026.00187 · Cited by 2
“M3A [29] employs a fusion of ReAct [42] and Reflex-ion [30] prompting strategies.”
Gen-n-Val: Agentic Image Data Generation and Validation
Huang, J.-E., Fang, I.-S., Huang, T., Liu, Y.-L., Wang, C.-Y., & Chen, J.-C. (2026) · doi:10.1109/cvprf71909.2026.00843 · Cited by 2
“Reflexion [33] enhances LLM agents’ decision-making by using reflective linguistic feedback stored in an episodic memory.”
Dobson, R. (2026) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2026.1985132 · Cited by 1
“Inference-time self-critique carries the same lineage to the serving side: Reflexion (Shinn et al., 2023) improves an agent by critiquing what has already been generated, which places it—like output filtering—after the enforcement point that the scaffold measured here occupies.”
Frez, J., & Baloian, N. A. (2023) · Lecture notes in networks and systems · doi:10.1007/978-3-031-48642-5_24 · Cited by 1
Metadata
- Authors
- Shinn, N., Cassano, F., Berman, E., Gopinath, A., Narasimhan, K., & Yao, S.
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2023
- Pages
- 8634-8652
- ISSN
- 1049-5258 (ISSN-L)
- arXiv
- 2303.11366
- OpenAlex
- W7133222210
- Cited by
- 1,087
- References
- 0
- Citations by year
- 2026: 760 · 2025: 167 · 2024: 105 · 2023: 55
- FWCI
- 192.15
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- neural information processing systems (publishedVersion)
- arXiv (Cornell University) (submittedVersion, cc-by)
- arXiv (Cornell University) (cc-by)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Keywords
- language agents, verbal behavior, language acquisition
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-01, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-01 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.