Reflexion: Language Agents with Verbal Reinforcement Learning
Open accessThe DOI matches its DataCite record; 42 of the 42 references it cites were found in a registry or an index; 7 of the 8 sources its claims cite were checked for support.
Abstract
Large language models (LLMs) have been increasingly used to interact with external environments (e.g., games, compilers, APIs) as goal-driven agents. However, it remains challenging for these language agents to quickly and efficiently learn from trial-and-error as traditional reinforcement learning methods require extensive training samples and expensive model fine-tuning. We propose Reflexion, a novel framework to reinforce language agents not by updating weights, but instead through linguistic feedback. Concretely, Reflexion agents verbally reflect on task feedback signals, then maintain their own reflective text in an episodic memory buffer to induce better decision-making in subsequent trials. Reflexion is flexible enough to incorporate various types (scalar values or free-form language) and sources (external or internally simulated) of feedback signals, and obtains significant improvements over a baseline agent across diverse tasks (sequential decision-making, coding, language reasoning). For example, Reflexion achieves a 91% pass@1 accuracy on the HumanEval coding benchmark, surpassing the previous state-of-the-art GPT-4 that achieves 80%. We also conduct ablation and analysis studies using different feedback signals, feedback incorporation methods, and agent types, and provide insights into how they affect performance.
Overview
CoChat Summary
TL;DR
Reflexion reinforces language agents through verbal self-reflection stored in episodic memory rather than weight updates, improving performance across decision-making, reasoning, and coding tasks. It reports gains including 91% pass@1 on HumanEval, a 22% absolute improvement on AlfWorld, and 20% on HotPotQA.
Key findings
- On HumanEval Python, Reflexion achieves 91.0 pass@1, surpassing the previous state-of-the-art GPT-4 at 80.1; on HumanEval Rust it reaches 68.0 vs. 60.0, MBPP Rust 75.4 vs. 70.9, and Leetcode Hard 15.0 vs. 7.5.
- In AlfWorld, ReAct + Reflexion completes 130 out of 134 tasks using a simple heuristic and improves over strong baselines by an absolute 22% over 12 iterative learning steps; ReAct-only converges at a 22% hallucination rate with no long-term recovery.
- In HotPotQA, Reflexion improves over baselines by 20%; self-reflection gives an 8% absolute boost over episodic memory alone, and although CoT (GT) fails on 39% of questions, Reflexion improves accuracy by 14% without access to ground-truth answers.
- Ablations on the 50 hardest HumanEval Rust problems show full Reflexion at 0.68 vs. baseline 0.60; omitting test generation drops to 0.52, and omitting self-reflection stays at 0.60.
Methods
- Reflexion uses a modular loop with an Actor that generates text/actions, an Evaluator that scores outputs, and a Self-Reflection model that converts feedback into verbal summaries stored in memory; trials repeat until the Evaluator passes or a max trial count is reached, with memory usually bounded to 1–3 experiences.
- Experiments cover AlfWorld (134 environments, six tasks, ReAct + GPT-3), HotPotQA (100 questions, CoT/ReAct, exact-match grading, memory size 3), and programming (HumanEval, MBPP, LeetcodeHardGym; Python/Rust via MultiPL-E; self-generated unit tests up to 6).
- Ablations and analyses vary feedback signals, feedback incorporation methods, and agent types; compromised approaches are tested on HumanEval Rust, and a WebShop experiment is run across 100 environments.
Limitations
- The paper states Reflexion may fall into non-optimal local minima, limits long-term memory to a sliding window with maximum capacity, and notes code-generation test-driven development is limited by non-deterministic, impure, hardware-dependent, or concurrent functions; it also relies on LLM self-evaluation/heuristics and lacks a formal success guarantee.
- The paper reports WebShop failure: after only four trials the agent shows no improvement and does not generate helpful self-reflections, concluding Reflexion cannot solve tasks requiring significant diversity and exploration.
- Evident from the text: self-correction is an emergent quality of stronger, larger models—starchat-beta shows no improvement (baseline 0.26 vs. Reflexion 0.26)—and flaky or incorrect test suites can cause false positives/negatives, with false negatives preferred.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
4 Valid · 2 Not valid · 0 Not checked · 59 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Therefore, in the case in which the model generates a flaky test suite, it is possible that all tests pass on an incorrect solution and lead to a false positive label on a code completion [11].”
§ Reflexion: Language Agents with Verbal Reinforcement Learning > Analysis
What the sources say
- Partly supportedcites [11] 11. Lam, W., Winter, S., Wei, A., Xie, T., Marinov, D., and Bell, J. (2020). A large-scale longitudinal study of flaky tests. Proc. ACM Program. Lang., 4(OOPSLA). sourceExperimental — accuracy not yet measured
The Introduction (page not provided) says a flaky test can pass and fail on the same code and that changes may be merged when all tests pass. It does not address model-generated test suites, incorrect code completions, or false-positive labels, so those parts of the claim are not established by this paper. (LLM, conf=0.82)
hedgedstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“3 shows an inferior 52% vs 60% (baseline) accuracy, which suggests that the agent is unable to determine if the current implementation is correct without unit tests.”
§ Reflexion: Language Agents with Verbal Reinforcement Learning > Ablation study
hedgedstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“ReAct + Reflexion significantly outperforms ReAct by completing 130 out of 134 tasks using the simple heuristic to detect hallucinations and inefficient planning.”
§ Reflexion: Language Agents with Verbal Reinforcement Learning > Results
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“4 shows that self-reflection improves learning by an 8% absolute boost over the episodic memory learning advantage.”
§ Reflexion: Language Agents with Verbal Reinforcement Learning > Analysis
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“on reasoning questions in HotPotQA [28] by 20%”
- Also stated in: § 4 Experiments · plain
“Most notably, Reflexion improves performance over strong baselines by 22% in AlfWorld, 20% in HotPotQA, and 11% on HumanEval.”
§ Reflexion: Language Agents with Verbal Reinforcement Learning > 1 Introduction
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § 4 Experiments · plain
30 more claims
Create a free account to see all 65 claims and every source verdict.
- It may state two separate claims as one. 18
- Probably not a substantial claim. 11
- The quote only partly states this claim. 3
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source doesn’t support the claim as written.
In the citing paper
“Memory and reflection systems such as MemAgent (Yu et al., 2025a), Reflexion (Shinn et al., 2023), and Generative Agents (Park et al., 2023) improve retrieval and episodic memory, but do not perform context shaping, state restructuring, or nextinstruction refinement.”
From PAACE: A Plan-Aware Automated Agent Context Engineering Framework (2025) · cites this paper as Shinn et al., 2023
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe cited source doesn’t support the claim as written.
In the citing paper
“However, Reflexion computes verbal reward over a full trajectory, yielding a single end-of-episode signal that conflates credit across reasoning steps: a failure due to a single intermediate error receives the same critique pressure as one due to a flawed strategy.”
From Process Supervision via Verbal Critique Improves Reasoning in Large Language Models (2026) · cites this paper as Shinn et al. [2023]
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe cited source doesn’t support the claim as written.
In the citing paper
“Unlike Reflexion, which only reflects on unsuccessful trajectories, our approach separately reflects on both successful and unsuccessful ones.”
From An Efficient Context-Dependent Memory Framework for LLM-Centric Agents (2025) · cites this paper as Shinn et al., 2023
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe cited source doesn’t support the claim as written.
In the citing paper
“The dominant approach is to curate memory at write time.”
From Just-in-Time Memory: Learning to Curate Task-Adaptive Memory for LLM Agents (2026) · cites this paper as Shinn et al., 2023
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Interaction and code generation are increasingly used together, with code as the modality of choice for actions [48, 59], tool construction [13, 51, 69], and reasoning [39, 66, 67].”
From SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineering (2024) · cites this paper as [39]
Experimental — accuracy not yet measured
107 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Reflexion: Language Agents with Verbal Reinforcement Learning > 3 Reflexion: reinforcement via verbal reflection
“while M e not pass or t < max trials do”
§ Reflexion: Language Agents with Verbal Reinforcement Learning > Self-reflection
“The Actor, Evaluator, and Self-Reflection models work together through trials in a loop until the Evaluator deems τ t to be correct.”
Citations
Cites
The publisher hasn’t deposited this paper’s reference list.
Cited by
Items 801–900 of 3,533
STRUX: An LLM for Decision-Making with Structured ExplanationsPreprint
Lu, Y., Hu, Y., Foroosh, H., Jin, W., & Liu, F. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2410.12583 · Cited by 9
“Further, a significant advantage of LLMs is their ability to reason through complex scenarios, which can enhance the decision-making processes (Shinn et al., 2023; Zeng et al., 2024; Hu et al., 2024a,b; Band et al., 2024).”
PersonaMath: Boosting Mathematical Reasoning via Persona-Driven Data AugmentationPreprint
Luo, J., Chen, L., Luo, R., Zhu, L. W., Ao, C., Li, J., Chen, Y., Cheng, X., Yang, W., Su, J., et al. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2410.01504 · Cited by 12
“This approach is inspired by previous research demonstrating that LLMs can self-reflect and self-correct (Shinn et al., 2023; Li et al., 2023b).”
ResultLiu, L., Zhang, C., Wu, L., Zhao, C., Hu, Z., He, M., & Fan, J. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2503.00902 · Cited by 9
Rana, M., Man, C., Msiiwa, A. E., Paine, J., Zhu, K., Dev, S., Sharma, V., & Ahan, M. R. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2510.18170 · Cited by 13
Han, S.-T. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2504.20342 · Cited by 9
“This use is distinct from prior work using “Reflexion” to describe verbal reinforcement learning for language agents [5]; the present system focuses on user-facing emotional reflection, metaphorical narrative generation, and structured self-inquiry rather than agent learning or task-solving.”
DecisionFlow: Advancing Large Language Model as Principled Decision MakerPreprint
Chen, X., Wang, S., Qian, C., Wang, H., Han, P., & Ji, H. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2505.21397 · Cited by 10
“However, prior research has predominantly focused on low-stakes domains where the cost of suboptimal decisions is relatively low (Wang et al., 2023; Nie et al., 2024; Shinn et al., 2023; Yang et al., 2024b; Chen et al., 2025).”
Liang, S., Cao, P., Zhao, J., Teng, W., Liao, X., Zhao, J., & Liu, K. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2601.07470 · Cited by 11
From Prompt-Response to Goal-Directed Systems: The Evolution of Agentic AI Software ArchitecturePreprint
Alenezi, M. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2602.10479 · Cited by 9
“Reflection-based methods aim to reduce error accumulation by revising plans based on outcomes [16].”
ClawEnvKit: Automatic Environment Generation for Claw-Like AgentsPreprint
Li, X., Li, M., Stoica, I., Hsieh, C., & Zhou, T. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2604.18543 · Cited by 9
CastFlow: Bridging Evidence Acquisition and Accurate Prediction in Agentic Time Series ForecastingPreprint
潘柏凱, Cheng, M., Tao, X., Liu, Z., Yu, S., Wu, Y., Liu, Q., Lian, D., & Chen, E. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2604.27840 · Cited by 10
User as Code: Executable Memory for Personalized AgentsPreprint
Li, B. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2606.16707 · Cited by 9
“Code as action : CodeAct [Wang et al., 2024b] unifies an agent’s action space into executable Python, outperforming JSON/text tool calls; this contrasts with the text-and-action interleaving of ReAct [Yao et al., 2023] and the natural-language self-reflection of Reflexion [Shinn et al., 2023].”
Stop Hand-Holding Your Coding Agent: Engineering the Loops that Replace Step-by-Step PromptingPreprint
Macedo, S. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2607.00038 · Cited by 10
“…path explicit: Self-Refine generated, critiqued and revised in place [26]; Reflexion turned failed episodes into verbal lessons reused next time [36]; ReST-style training fed an agent’s own successful trajectories back as iterative self-improvement [2]; Self-RAG retrieved and critiqued its own…”
Demystifying Agent Skills: Why They Work-Until They Don'tPreprint
Jiang, Z., Huang, F., Xing, H., Wu, X., Gao, Y., Cao, R., Wang, M., Liu, S., & Li, Y. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2608.14036 · Cited by 11
“Early systems store and retrieve episodic experiences, reflections, or interaction histories to support future planning and decision-making (Park et al., 2023; Shinn et al., 2023; Wang et al., 2023; Zhong et al., 2023).”
RoboRSI: Stable, efficient, and reusable robot self-evolution in complex real-world environmentsPreprint
Wen, Z., Chen, Y., Cao, Y., Chen, W., Zou, Y., Yu, W., Kuang, F., Xue, H., Lv, J., Wen, C., et al. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.12424 · Cited by 14
“Language agents first did so through verbal feedback: Reflexion stores reflections on failed attempts, and Self-Refine iteratively critiques and revises its own outputs (Madaan et al., 2023; Shinn et al., 2023).”
LogRESP-Agent: A Recursive AI Framework for Context-Aware Log Anomaly Detection and TTP Analysis
Lee, J., Jeong, Y., Han, T., & Lee, T. (2025) · doi:10.20944/preprints202506.0235.v1 · Cited by 9
Safeguarding LLM Agents from Misalignment through Provenance Analysis
She, Y., Liang, Y., & Kang, E. (2026) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1145/3832783.3837535 · Cited by 9
S2AF : An action framework to self-check the Understanding Self-Consistency of Large Language Models
Shao, H., Wang, F., & Xie, Z. (2025) · Neural Networks · doi:10.1016/j.neunet.2025.107365 · Cited by 10
Ballester, P. L. (2023) · Journal of Medical Internet Research · doi:10.2196/49323 · Cited by 10
LogGenius: An Unsupervised Log Parsing Framework with Zero-shot Prompt Engineering
Yu, X., Nong, S., He, D., Zheng, W., Ma, T., Liu, N., Li, J., & Xie, G. (2024) · IEEE International Conference on Web Services (ICWS) · doi:10.1109/icws62655.2024.00159 · Cited by 13
FI-NL2PY2SQL: Financial Industry NL2SQL Innovation Model Based on Python and Large Language Model
Du, X., Hu, S., Zhou, F., Wang, C., & Nguyen, B. M. (2025) · Future Internet · doi:10.3390/fi17010012 · Cited by 9
“Additionally, new techniques worth noting include CoT [24], Self-Consistency [25], ToT [26], RAP [27], ReAct [28], Self-Refine [29], Reflexion [30], and LATS [31].”
CriSPO: Multi-Aspect Critique-Suggestion-guided Automatic Prompt Optimization for Text Generation
He, H., Liu, Q., Xu, L., Shivade, C., Zhang, Y., Srinivasan, S., & Kirchhoff, K. (2025) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v39i22.34575 · Cited by 30
Foundational Design Principles and Patterns for Building Robust and Adaptive GenAI-Native Systems
Putte, F. V. D. (2025) · SIGPLAN symposium on New ideas, new paradigms, and reflections on programming and software · doi:10.1145/3759429.3762620 · Cited by 7
BYOC: Personalized Few-Shot Classification with Co-Authored Class Descriptions
Bohra, A., Verkes, G., Harutyunyan, A., Weinberger, P., & Campagna, G. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.933 · Cited by 10
Agentic LLM Workflows for Generating Patient-Friendly Medical Reports
Sudarshan, M., Shih, S., Yee, E., Yang, A., Zou, J., Chen, C., Zhou, Q., Chen, L., Singhal, C., & Shih, G. (2024) · arXiv · doi:10.48550/arxiv.2408.01112 · Cited by 36
“We leveraged an existing framework, Reflexion [14], which incorporates verbal reinforcement into its iterative refinement process.”
MethodScaling Large Language Model-based Multi-Agent Collaboration
Qian, C., Xie, Z., Wang, Y., Liu, W., Zhu, K., Xia, H., Dang, Y., Du, Z., Chen, W., Yang, C., et al. (2024) · arXiv · doi:10.48550/arxiv.2406.07155 · Cited by 8
“Notably, neural scaling laws typically require a million-fold increase in neurons to reveal significant trends around a scale of 10 18 to 10 24 (Schaeffer et al., 2024).”
A Survey of Post-Training Scaling in Large Language Models
Lai, H., Liu, X., Gao, J., Cheng, J., Qi, Z., Xu, Y., Yao, S., Zhang, D., Du, J., Hou, Z., et al. (2025) · Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2025.acl-long.140 · Cited by 8
Self-citationReasoning in Token Economies: Budget-Aware Evaluation of LLM Reasoning Strategies
Wang, J., Jain, S., Zhang, D., Ray, B., Kumar, V., & Athiwaratkun, B. (2024) · Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2024.emnlp-main.1112 · Cited by 8
Ontology-Constrained Generation of Domain-Specific Clinical Summaries
Mehenni, G., & Zouaq, A. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-77792-9_23 · Cited by 12
Khaki, A. M. Z., Choi, A., & Seyyed-Kalantari, L. (2025) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2025.2495117 · Cited by 16
“This can be further enhanced when combined with CoT analysis, which enables designers to observe the reasoning behind each action taken by LANAs, thereby improving their performance (Shinn et al., 2023).”
DCA-Bench: A Benchmark for Dataset Curation Agents
Huang, B., Yu, Y., Huang, J., Zhang, X., & Ma, J. (2025) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3711896.3737422 · Cited by 11
“On the framework side, Reflexion [70], Parsel [85] and MetaGPT [35] are the best reasoning frameworks at the time of writing.”
Egersdoerfer, C., Carns, P., Snyder, S., Ross, R. B., & Dai, D. (2025) · International Conference for High Performance Computing, Networking, Storage and Analysis (SC) · doi:10.1145/3712285.3759887 · Cited by 8
“It has been shown that promoting self-reflection instructions can significantly enhance an LLM agent’s performance [58].”
Ahtisham, B., Vanacore, K., Lee, J., Zhou, Z., Pietrzak, D., & Kizilcec, R. F. (2026) · International Conference on Learning Analytics and Knowledge (LAK) · doi:10.1145/3785022.3785095 · Cited by 12
“This pattern supports prior findings that reflective prompting and rubric reapplication enhance model consistency by forcing deliberate reconsideration of border-line cases [27, 37, 45].”
Co-Designing Quantum Codes with Transversal Diagonal Gates via Multi-Agent Systems
He, X. S., Lu, S., & Zeng, B. (2026) · IEEE Dallas Circuits and Systems Conference (DCAS) · doi:10.1109/dcas69364.2026.11544392 · Cited by 11
PennyCoder: Efficient Domain-Specific LLMs for PennyLane-Based Quantum Code Generation
Basit, A., Shao, M., Asif, M., Innan, N., Kashif, M., Marchisio, A., & Shafique, M. (2025) · IEEE International Conference on Quantum Computing and Engineering (QCE) · doi:10.1109/qce65121.2025.10324 · Cited by 16
“Simultaneously, Large Language Models (LLMs) have transformed code generation across domains, including software engineering [7], hardware design [8], robotics [9], and art [10].”
CollabVLA: Self-Reflective Vision–Language–Action Model Dreaming Together with Human
Sun, N., Li, Y., Wang, C., Mao, B., Liu, H., Yao, J., Li, K., Liu, J., Zhang, Y., Zhang, G., et al. (2026) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra57385.2026.11697568 · Cited by 9
“It lacks the deeper reflective understanding necessary for real-time failure recognition and effective interaction, as illustrated by the evolution from ReAct [15] to Reflexion [16] in LLM agents.”
CompanionCast: Social Collaboration with Multi-Agent Systems in Shared Experiences
Wang, Y., Chen, C., Lin, T., Raj, V., Kimball, J., Cabral, A., & Hester, J. D. (2026) · doi:10.1145/3806096.3844834 · Cited by 8
GeoAgentbench: a dynamic execution benchmark for tool-augmented agents in spatial analysis
Yu, B., Yang, C., Hou, D., Liu, C., Liu, J., Wang, C., Zhang, Z., Li, H., & Yang, W. (2026) · Geo-spatial Information Science · doi:10.1080/10095020.2026.2736957 · Cited by 9
The Illusion of Insight in Reasoning Models
d'Aliberti, L., & Ribeiro, M. H. (2026) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2026.findings-acl.47 · Cited by 10
Your Agent’s Memories Are Not Its Own: Forged Reasoning Attack on LLM Agent Memory and Its Defense
Karamchandani, N., Nagasubramaniam, P., Zhu, S., & Wu, D. (2026) · IEEE Conference on Communications and Network Security · doi:10.1109/cns69863.2026.11720906 · Cited by 9
Investigating the Transferability of Code Repair for Low-Resource Programming Languages
Wong, K., Amayuelas, A., Pan, L., & Wang, W. Y. (2025) · Findings of the Association for Computational Linguistics: NAACL · doi:10.18653/v1/2025.findings-naacl.190 · Cited by 10
“Thus, frameworks that improve code generation and can apply to smaller models have become increasingly useful (Ding et al., 2024; Shinn et al., 2023).”
BackgroundAissi, M.-S., Romac, C., Carta, T., Lamprier, S., Oudeyer, P., Sigaud, O., Soulier, L., & Thome, N. (2025) · Findings of the Association for Computational Linguistics: NAACL · doi:10.18653/v1/2025.findings-naacl.390 · Cited by 13
Adaptation of Large Language Models
Ke, Z., Ming, Y., & Joty, S. (2025) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2025.naacl-tutorial.5 · Cited by 13
LA-RCS: LLM-agent-based Robot Control System
Park, T.-H., Choi, Y., Shin, S.-H., Lee, C.-E., & Lee, K. (2025) · Sensors and Materials · doi:10.18494/sam5643 · Cited by 11
“…possess the ability to make intelligent decisions, enabling them to plan and reason effectively in response to natural language-based requests[18] [19] [20] These technological advances facilitate and provide an important foundation for the evolution of large language models(LLM) into large…”
Assessing the research landscape and clinical utility of large language models: A scoping reviewPreprint
Park, Y., Pillai, A., Deng, J., Guo, E., Gupta, M., Paget, M., & Naugler, C. T. (2023) · Research Square · doi:10.21203/rs.3.rs-3472000/v1 · Cited by 8
NLP-based Regulatory Compliance -- Using GPT 4.0 to Decode Regulatory DocumentsPreprint
Kumar, B., & Roussinov, D. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2412.20602 · Cited by 8
Tang, Y., Chen, K., Yue, L., Fan, J., Zhou, C., Li, X., Zhang, Y., Zhao, M., Kai, S., Guo, K., et al. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2510.17491 · Cited by 10
“The Reflexion framework builds upon ReAct by adding a self-reflection loop, enabling agents to analyze failure trajectories, generate textual reflections, and store them in memory to guide subsequent attempts [169].”
Hiding in the AI Traffic: Abusing MCP for LLM-Powered Agentic Red TeamingPreprint
Janjusevic, S., Garcia, A. B., & Kazerounian, S. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2511.15998 · Cited by 10
“They can implement feedback loops: observe results, reflect, and refine the approach (as in VulnBot’s reflection phase) [4,26].”
TinyLLM: Evaluation and Optimization of Small Language Models for Agentic Tasks on Edge DevicesPreprint
Haque, M. A., Rahman, F., Gupta, K. D., Shujaee, K. A., & George, R. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2511.22138 · Cited by 13
“Reflection equips agents with self-reflective feedback loops and episodic memory, enabling iterative self-improvement without weight updates [11].”
Dyna-Mind: Learning to Simulate from Experience for Better AI Agents
Xiao, Y., Peng, B., Galley, M., Cheng, H., Wu, Q., Kulkarni, J., Nath, S., Yu, Z., & Gao, J. (2026) · International Conference on Learning Representations · doi:10.48550/arxiv.2510.09577 · Cited by 8
“We note that this is different from methods such as Reflexion (Shinn et al., 2023), which performs reflection at the end of the episode utilizing success/failure information, and is also not intended for any training purposes.”
Dynamic Normativity: Necessary and Sufficient Conditions for Value Alignment
Corrêa, N. K. (2024) · LA Referencia (Red Federada de Repositorios Institucionales de Publicaciones Científicas) · doi:10.48550/arxiv.2406.11039 · Cited by 8
Language Models Coupled with Metacognition Can Outperform Reasoning ModelsPreprint
Khandelwal, V., Rossi, F., Murugesan, K., Miehling, E., Campbell, M. S., Ramamurthy, K. N., & Lior Horesh, C. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2508.17959 · Cited by 8
MAR:Multi-Agent Reflexion Improves Reasoning Abilities in LLMsPreprint
Ozer, O., Wang, Y., Wu, G., Dosti, D., Zhang, H., & Rue, V. D. L. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2512.20845 · Cited by 13
“Reflexion (Shinn et al. 2023) wraps a language model in a simple loop that turns past failures into natural-language guidance for future attempts.”
AgentDevel: Reframing Self-Evolving LLM Agents as Release EngineeringPreprint
Zhang, D. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2601.04620 · Cited by 10
EvoFSM: Controllable Self-Evolution for Deep Research with Finite State MachinesPreprint
Zhang, S., Yuan, C., Guo, R. Y., Yu, X., Xu, R., Chen, Z., Li, Z., Yang, Z., Guan, S., Tang, Z., et al. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2601.09465 · Cited by 8
“As shown in Figure 3(a), EvoFSM consistently outperforms both ReAct (Yao et al., 2023) and Re-flexion (Shinn et al., 2023), with particularly strong gains on WebShop.”
SMCP: Secure Model Context ProtocolPreprint
Hou, X., Wang, S., Zhang, Y., Xue, Z., Zhao, Y., Fu, C., & Wang, H. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2602.01129 · Cited by 15
PABU: Progress-Aware Belief Update for Efficient LLM AgentsPreprint
Jiang, H., Ge, L., Cai, H., & Song, R. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2602.09138 · Cited by 10
“Large Language Models (LLMs) are increasingly deployed as agents (Wei et al., 2026) rather than merely as information extractors, leveraging capabilities such as self-reflection (Shinn et al., 2023), retrieval-augmented generation (Gao et al., 2024), and tool invocation (Schick et al., 2023).”
FinTradeBench: A Financial Reasoning Benchmark for LLMsPreprint
Agrawal, Y., Dutta, A., Hasan, M. M., Karmaker, S., & Dutta, A. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2603.19225 · Cited by 11
Utility-Guided Agent Orchestration for Efficient LLM Tool UsePreprint
Liu, B., Zhao, G., & Xu, H. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2603.19896 · Cited by 8
“Recent work shows that multi-step reasoning, planning, program use, and reflection can improve complex task solving [8], [9], [10], [11], [12], [13], [14], [15], [16], [17], [18], [19].”
Stummer, F. O. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2603.24065 · Cited by 8
“Shinn et al. [5] introduced a framework where language agents maintain a verbal memory of previous attempts and their outcomes, using this reflective feedback to improve subsequent performance.”
Skills on the Fly: Test-Time Adaptive Skill Synthesis for LLM AgentsPreprint
Wang, J., Zhou, C., Fu, Z., Wang, J., Liu, W., Zhang, W., & Lin, J. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2605.16986 · Cited by 10
“Prior work on reflective and experiential agents further shows that such experience can be converted into natural-language memories or lessons that improve later decisions without parameter updates [Shinn et al., 2023, Zhao et al., 2023].”
ReCA: Multi-Shot Long Video Extrapolation via Recursive Context AllocationPreprint
Liu, A., Xing, J., Mao, C., Li, Y., Zhang, Z., He, Y., Wang, W., Wang, Z., Liu, Y., Haffari, G., et al. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2605.26525 · Cited by 8
What makes a harness a harness: necessary and sufficient conditions for an agent harnessPreprint
de Macedo, S. O. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2606.10106 · Cited by 10
“The reasoning and action loop [59, 41].”
Xu, H., He, Z., Wang, H., Xu, J., & Dong, H. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2608.04933 · Cited by 8
aDSL: Agentic 3D Creation via Joint Agent-Program DesignPreprint
Wang, R.-H., Wei, S.-T., He, J.-Q., Wei, H.-Y., Chen, B.-Q., & Wang, P.-S. (2026) · arXiv.org · doi:10.48550/arxiv.2608.17975 · Cited by 7
“Representative paradigms include reasoning–action loops, plan-then-solve decomposition, tree-structured search over intermediate thoughts, and reflection/memory mechanisms [Shinn et al. 2023; Wang et al. 2023; Yao et al. 2023, 2022].”
Apodex 1.1: Scaling Agentic Intelligence for Complex WorkPreprint
An, B., An, B., Wang, B., Wang, B. L., Zhang, B., Feng, C., Wei, C., Xue, C., Zhang, C., Zhang, C., et al. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2608.23283 · Cited by 8
“Apodex 1.1 establishes this development path and shows how agentic intelligence can be scaled around completed work rather than isolated responses.”
InfluentialFeedback That Backfires: Why Small Language Model Agents Repeat the Call They Just Watched FailPreprint
Gumaan, E. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2608.23651 · Cited by 10
“…Holtzman et al., 2019] Negative instructions n/a no prompt [Castricato et al., 2024] Self-correction critiques yes no prompt [Huang et al., 2023, Shinn et al., 2023] Agent loop detection yes no static analysis [Hou et al., 2026] Observation-fidelity probe yes no degrade inputs [Zenkri and…”
ScienceIDE: Turning World's Scientific Codebase into Agent Learnable EnvironmentsPreprint
Geng, H., Huang, Z., Li, H., Li, W., Wu, K., Zhou, Z., Pang, Y., Liu, W., Xu, Z., Li, Z., et al. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2609.19134 · Cited by 8
“Tool-use scaffolds enable reading, editing, and execution [105, 124, 126, 127, 134, 137].”
AFlow: Automating Agentic Workflow Generation
Zhang, J., Xiang, J., Yu, Z., Teng, F., Chen, X., Chen, J., Zhuge, M., Cheng, X., Hong, S., Wang, J., et al. (2024) · arXiv · doi:10.48550/arxiv.2410.10762 · Cited by 359
“For HotpotQA (Yang et al., 2018) and DROP (Dua et al., 2019), we randomly select 1,000 samples each, in line with (Hu et al., 2024; Shinn et al., 2023).”
Lifelong Learning of Large Language Model Based Agents: A Roadmap
Zheng, J., Shi, C., Cai, X., Li, Q., Zhang, D., Li, C., Yu, D., & Ma, Q. (2026) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2025.3650546 · Cited by 7
“Reflexion [159] is one of the most representative studies.”
Cost-Constrained Automatic Workflow Search for Small LLM Agents
Zhang, K., Jiang, Y., Liu, S., Xiao, Z., & Yang, Z. (2026) · International Conference on Electronic Information Technology and Computer Engineering (EITCE) · doi:10.1109/eitce70137.2026.11634430 · Cited by 7
“Repair attempts to fix a failed or low-confidence output by re-691 prompting with error feedback, inspired by verbal self-reflection [30].”
ErrorChain: Error Cascade Detection and Early Truncation in Multi-Step Agents
Chen, F., Chen, B., Tang, Y., Hu, Z., Zhang, J., & Zhan, Y. (2026) · International Conference on Electronic Technology and Information Science (ICETIS) · doi:10.1109/icetis70504.2026.11633456 · Cited by 8
“Reflexion [8] enables agents to verbally reflect on task feedback across episodes, but operates post-hoc rather than detecting errors in real time.”
EpidemIQs: Prompt-to-Paper LLM Agents for Epidemic Modeling and Analysis
Samaei, M. H., Sahneh, F. D., Cohnstaedt, L. W., & Scoglio, C. (2026) · IEEE Transactions on Artificial Intelligence · doi:10.1109/tai.2026.3666830 · Cited by 9
“These constraints led to the development of LLM agents, which extend LLMs with abilities such as external tool use [11], [12], chain-of-thought prompting [13], and iterative self-improvement [14].”
Digital Red Queen: Adversarial Program Evolution in Core War with LLMs
Kumar, A., Boldi, R., Sharma, P., Isola, P., Risi, S., Tang, Y., & Ha, D. (2026) · Genetic and Evolutionary Computation Conference (GECCO) · doi:10.1145/3795095.3805116 · Cited by 7
Han, Z., Wang, J., Yan, X., Jiang, Z., Zhang, Y., Liu, S., Gong, Q., & Song, C. (2025) · Applied Sciences · doi:10.3390/app15105663 · Cited by 8
“Such capabilities enable LLM-powered agents to iteratively evaluate their outputs and adjust the reasoning process accordingly [17].”
Schoch, N., Hoernicke, M., Strem, N., & Stärk, K. D. C. (2024) · IEEE International Conference on Emerging Technologies and Factory Automation (ETFA) · doi:10.1109/etfa61755.2024.10710789 · Cited by 8
“Hence, under these constraints, LLM-based agents with access to tools and expert models seem suitable, and have recently shown impressive skills and progress [13][14][15], even though not yet in the engineering domain for processing O/O or EPC data.”
BackgroundFrom Words to Wires: Generating Functioning Electronic Devices from Natural Language Descriptions
Jansen, P. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.864 · Cited by 10
A survey on Android dynamic evasive malware: Taxonomy, countermeasures and open challenges
Zhang, D., Yang, X., Liu, S., Zhou, Y., Fu, J., & Peng, G. (2025) · Computers & Security · doi:10.1016/j.cose.2025.104646 · Cited by 7
LegalGPT: Legal Chain of Thought for the Legal Large Language Model Multi-agent Framework
Shi, J., Guo, Q., Liao, Y., & Liang, S. (2024) · Lecture notes in computer science · doi:10.1007/978-981-97-5678-0_3 · Cited by 25
Guan, L., Shi, H., Chen, H., & Wang, Y. (2025) · Mathematics · doi:10.3390/math13193055 · Cited by 7
ReTA: Recursively Thinking Ahead to Improve the Strategic Reasoning of Large Language Models
Duan, J., Wang, S., Diffenderfer, J., Sun, L., Chen, T., Kailkhura, B., & Xu, K. (2024) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2024.naacl-long.123 · Cited by 25
“(Yao et al., 2022b; Shinn et al., 2023) endow agents with the capability to engage in introspection regarding the feedback provided by LLMs.”
Vibe researching: can AI agents with skills replace or augment social scientists?
Zhang, Y. (2026) · Chinese Sociological Review · doi:10.1080/21620555.2026.2707167 · Cited by 8
GEPA: Reflective Prompt Evolution Can Outperform Reinforcement Learning
Agrawal, L. A., Tan, S., Soylu, D., Ziems, N., Khare, R., Opsahl-Ong, K., Singhvi, A., Shandilya, H., Ryan, M. J., Jiang, M., et al. (2025) · arXiv · doi:10.48550/arxiv.2507.19457 · Cited by 7
Enhancing memory retrieval in generative agents through LLM-trained cross attention networks
Hong, C., & He, Q. (2025) · Frontiers in Psychology · doi:10.3389/fpsyg.2025.1591618 · Cited by 7
“Therefore, the common practice is to store the agent’s memories externally and provide the necessary memories to the LLM in the form of linguistic feedback during decision-making (Shinn et al., 2023).”
Spider 2.0: Evaluating Language Models on Real-World Enterprise Text-to-SQL Workflows
Lei, F., Chen, J., Ye, Y., Cao, R., Shin, D., Su, H., Suo, Z., Gao, H., Hu, W., Yin, P., et al. (2024) · arXiv · doi:10.48550/arxiv.2411.07763 · Cited by 7
“These include Reflexion (Shinn et al., 2023), CodeR (Chen et al., 2024), AutoEval (Pan et al., 2024).”
CRUXEval: A Benchmark for Code Reasoning, Understanding and Execution
Gu, A., Rozière, B., Leather, H., Solar-Lezama, A., Synnaeve, G., & Wang, S. I. (2024) · arXiv · doi:10.48550/arxiv.2401.03065 · Cited by 7
InterAct: Exploring the Potentials of ChatGPT as a Cooperative Agent
Chen, P.-L., & Chang, C.-S. (2023) · arXiv · doi:10.48550/arxiv.2308.01552 · Cited by 7
Enhancing LLM Reasoning Capabilities Through Brokered Multi-Expert Reflection
Sheokand, T., Jain, G., Bahga, A., & Madisetti, V. K. (2025) · IEEE Access · doi:10.1109/access.2025.3561693 · Cited by 7
“As a baseline, we adopted the solutions proposed by Shinn et al. [25] that use Reflexion + ReAct [26] and Reflexion + Chain-of-Thought (CoT) [27].”
Choubey, P. K., Peng, X., Bhagavath, S., Xiong, C., Pentyala, S., & Wu, C.-S. (2025) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2025.findings-acl.203 · Cited by 7
EchoRAG: a framework for enhancing language models with graph-RAG and in-context learning
Beckhauser, W. J., & Fileto, R. (2025) · Machine Learning · doi:10.1007/s10994-025-06859-1 · Cited by 7
“Iterative feedback mechanisms – where human agents or automated processes evaluate and correct responses – can also be integrated to the process (Tseng et al., 2024 ; Shinn et al., 2023; Madaan et al., 2023).”
Metareasoning for Edge-Cloud Collaborative LLM Planning for Efficient Autonomous Navigation
Navardi, M., Gao, S., Walczak, M., Camacho, F., & Mohsenin, T. (2026) · ACM Transactions on Embedded Computing Systems · doi:10.1145/3765750 · Cited by 10
“Similarly, AI agentic workflows adopt iterative prompting to refine LLM outputs [4, 25, 48, 71].”
A review on an AI-driven face robot for human-robot expression interaction
Sheng, Q., Tang, W., Qin, H., Kong, Y., Dai, H., Zhong, Y., Wang, Y., Zou, J. T., & Yang, H. (2025) · Science China Technological Sciences · doi:10.1007/s11431-025-3027-x · Cited by 10
“By storing both successful and failed trajectories, agents can iteratively refine their reasoning and actions, mimicking human-like learning [200].”
AgentArcEval: An architecture evaluation method for foundation model based agents
Lu, Q., Zhao, D., Liu, Y., Zhang, H., Zhu, L., Xu, X., Shi, A., Tan, T., & Kazman, R. (2025) · Journal of Systems and Software · doi:10.1016/j.jss.2025.112656 · Cited by 12
An LLM Agentic Approach for Legal-Critical Software: A Case Study for Tax Prep Software
Gogani-Khiabani, S., Trivedi, A., Saha, D., & Tizpaz-Niari, S. (2026) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/3744916.3764575 · Cited by 8
Learning Affordances at Inference-Time for Vision-Language-Action Models
Shah, A., Chen, W., Godbole, A., Mora, F., Seshia, S. A., & Levine, S. (2026) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra57385.2026.11697401 · Cited by 7
“Our approach can be seen as an adaptation of inference-time self-refinement approaches for agentic foundation models [8], [10], [11] to real-world robotics.”
InfluentialSingamsetty, S., & Singamsetty, S. (2025) · Advances in engineering research/Advances in Engineering Research · doi:10.2991/978-94-6463-978-0_37 · Cited by 7
X R : Cross-Modal Agents for Composed Image Retrieval
Yang, Z., Pang, W., & Yuan, Y. (2026) · International World Wide Web Conference (WWW) · doi:10.1145/3774904.3792276 · Cited by 7
LongDS-Bench: On the Failure of Long-Horizon Agentic Data Analysis
Xu, K., Lu, X., Qiao, S., Ding, Z., Xu, H., Liang, L., & Zhang, N. (2026) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/2026.emnlp-main.584 · Cited by 10
Feng, Y., Sun, J., Yang, Z., Ai, J., Li, C., Li, Z., Zhang, F., He, K., Ma, R., Lin, J., et al. (2026) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2026.findings-acl.1497 · Cited by 18
SeLaR: Selective Latent Reasoning in Large Language Models
Fu, R., & Luo, G. (2026) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2026.acl-long.320 · Cited by 13
Paper2Rebuttal: A Multi-Agent Framework for Transparent Author Response Assistance
Ma, Q., Guo, C., Tian, Z., Wang, S., Xiao, J., Yue, Y., & Zhang, Z. (2026) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2026.acl-long.2140 · Cited by 10
Metadata
- Authors
- Shinn, N., Cassano, F., Berman, E., Gopinath, A., Narasimhan, K., & Yao, S.
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2023
- Pages
- 8634-8652
- ISSN
- 1049-5258 (ISSN-L)
- arXiv
- 2303.11366
- OpenAlex
- W7133222210
- Cited by
- 1,087
- References
- 0
- Citations by year
- 2026: 760 · 2025: 167 · 2024: 105 · 2023: 55
- FWCI
- 192.15
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- neural information processing systems (publishedVersion)
- arXiv (Cornell University) (submittedVersion, cc-by)
- arXiv (Cornell University) (cc-by)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Keywords
- language agents, verbal behavior, language acquisition
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-01, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-01 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.