Reflexion: Language Agents with Verbal Reinforcement Learning
Open accessThe DOI matches its DataCite record; 42 of the 42 references it cites were found in a registry or an index; 7 of the 8 sources its claims cite were checked for support.
Abstract
Large language models (LLMs) have been increasingly used to interact with external environments (e.g., games, compilers, APIs) as goal-driven agents. However, it remains challenging for these language agents to quickly and efficiently learn from trial-and-error as traditional reinforcement learning methods require extensive training samples and expensive model fine-tuning. We propose Reflexion, a novel framework to reinforce language agents not by updating weights, but instead through linguistic feedback. Concretely, Reflexion agents verbally reflect on task feedback signals, then maintain their own reflective text in an episodic memory buffer to induce better decision-making in subsequent trials. Reflexion is flexible enough to incorporate various types (scalar values or free-form language) and sources (external or internally simulated) of feedback signals, and obtains significant improvements over a baseline agent across diverse tasks (sequential decision-making, coding, language reasoning). For example, Reflexion achieves a 91% pass@1 accuracy on the HumanEval coding benchmark, surpassing the previous state-of-the-art GPT-4 that achieves 80%. We also conduct ablation and analysis studies using different feedback signals, feedback incorporation methods, and agent types, and provide insights into how they affect performance.
Overview
CoChat Summary
TL;DR
Reflexion reinforces language agents through verbal self-reflection stored in episodic memory rather than weight updates, improving performance across decision-making, reasoning, and coding tasks. It reports gains including 91% pass@1 on HumanEval, a 22% absolute improvement on AlfWorld, and 20% on HotPotQA.
Key findings
- On HumanEval Python, Reflexion achieves 91.0 pass@1, surpassing the previous state-of-the-art GPT-4 at 80.1; on HumanEval Rust it reaches 68.0 vs. 60.0, MBPP Rust 75.4 vs. 70.9, and Leetcode Hard 15.0 vs. 7.5.
- In AlfWorld, ReAct + Reflexion completes 130 out of 134 tasks using a simple heuristic and improves over strong baselines by an absolute 22% over 12 iterative learning steps; ReAct-only converges at a 22% hallucination rate with no long-term recovery.
- In HotPotQA, Reflexion improves over baselines by 20%; self-reflection gives an 8% absolute boost over episodic memory alone, and although CoT (GT) fails on 39% of questions, Reflexion improves accuracy by 14% without access to ground-truth answers.
- Ablations on the 50 hardest HumanEval Rust problems show full Reflexion at 0.68 vs. baseline 0.60; omitting test generation drops to 0.52, and omitting self-reflection stays at 0.60.
Methods
- Reflexion uses a modular loop with an Actor that generates text/actions, an Evaluator that scores outputs, and a Self-Reflection model that converts feedback into verbal summaries stored in memory; trials repeat until the Evaluator passes or a max trial count is reached, with memory usually bounded to 1–3 experiences.
- Experiments cover AlfWorld (134 environments, six tasks, ReAct + GPT-3), HotPotQA (100 questions, CoT/ReAct, exact-match grading, memory size 3), and programming (HumanEval, MBPP, LeetcodeHardGym; Python/Rust via MultiPL-E; self-generated unit tests up to 6).
- Ablations and analyses vary feedback signals, feedback incorporation methods, and agent types; compromised approaches are tested on HumanEval Rust, and a WebShop experiment is run across 100 environments.
Limitations
- The paper states Reflexion may fall into non-optimal local minima, limits long-term memory to a sliding window with maximum capacity, and notes code-generation test-driven development is limited by non-deterministic, impure, hardware-dependent, or concurrent functions; it also relies on LLM self-evaluation/heuristics and lacks a formal success guarantee.
- The paper reports WebShop failure: after only four trials the agent shows no improvement and does not generate helpful self-reflections, concluding Reflexion cannot solve tasks requiring significant diversity and exploration.
- Evident from the text: self-correction is an emergent quality of stronger, larger models—starchat-beta shows no improvement (baseline 0.26 vs. Reflexion 0.26)—and flaky or incorrect test suites can cause false positives/negatives, with false negatives preferred.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
4 Valid · 2 Not valid · 0 Not checked · 59 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Therefore, in the case in which the model generates a flaky test suite, it is possible that all tests pass on an incorrect solution and lead to a false positive label on a code completion [11].”
§ Reflexion: Language Agents with Verbal Reinforcement Learning > Analysis
What the sources say
- Partly supportedcites [11] 11. Lam, W., Winter, S., Wei, A., Xie, T., Marinov, D., and Bell, J. (2020). A large-scale longitudinal study of flaky tests. Proc. ACM Program. Lang., 4(OOPSLA). sourceExperimental — accuracy not yet measured
The Introduction (page not provided) says a flaky test can pass and fail on the same code and that changes may be merged when all tests pass. It does not address model-generated test suites, incorrect code completions, or false-positive labels, so those parts of the claim are not established by this paper. (LLM, conf=0.82)
hedgedstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“3 shows an inferior 52% vs 60% (baseline) accuracy, which suggests that the agent is unable to determine if the current implementation is correct without unit tests.”
§ Reflexion: Language Agents with Verbal Reinforcement Learning > Ablation study
hedgedstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“ReAct + Reflexion significantly outperforms ReAct by completing 130 out of 134 tasks using the simple heuristic to detect hallucinations and inefficient planning.”
§ Reflexion: Language Agents with Verbal Reinforcement Learning > Results
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“4 shows that self-reflection improves learning by an 8% absolute boost over the episodic memory learning advantage.”
§ Reflexion: Language Agents with Verbal Reinforcement Learning > Analysis
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“on reasoning questions in HotPotQA [28] by 20%”
- Also stated in: § 4 Experiments · plain
“Most notably, Reflexion improves performance over strong baselines by 22% in AlfWorld, 20% in HotPotQA, and 11% on HumanEval.”
§ Reflexion: Language Agents with Verbal Reinforcement Learning > 1 Introduction
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § 4 Experiments · plain
30 more claims
Create a free account to see all 65 claims and every source verdict.
- It may state two separate claims as one. 18
- Probably not a substantial claim. 11
- The quote only partly states this claim. 3
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source doesn’t support the claim as written.
In the citing paper
“Memory and reflection systems such as MemAgent (Yu et al., 2025a), Reflexion (Shinn et al., 2023), and Generative Agents (Park et al., 2023) improve retrieval and episodic memory, but do not perform context shaping, state restructuring, or nextinstruction refinement.”
From PAACE: A Plan-Aware Automated Agent Context Engineering Framework (2025) · cites this paper as Shinn et al., 2023
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe cited source doesn’t support the claim as written.
In the citing paper
“However, Reflexion computes verbal reward over a full trajectory, yielding a single end-of-episode signal that conflates credit across reasoning steps: a failure due to a single intermediate error receives the same critique pressure as one due to a flawed strategy.”
From Process Supervision via Verbal Critique Improves Reasoning in Large Language Models (2026) · cites this paper as Shinn et al. [2023]
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe cited source doesn’t support the claim as written.
In the citing paper
“Unlike Reflexion, which only reflects on unsuccessful trajectories, our approach separately reflects on both successful and unsuccessful ones.”
From An Efficient Context-Dependent Memory Framework for LLM-Centric Agents (2025) · cites this paper as Shinn et al., 2023
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe cited source doesn’t support the claim as written.
In the citing paper
“The dominant approach is to curate memory at write time.”
From Just-in-Time Memory: Learning to Curate Task-Adaptive Memory for LLM Agents (2026) · cites this paper as Shinn et al., 2023
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Interaction and code generation are increasingly used together, with code as the modality of choice for actions [48, 59], tool construction [13, 51, 69], and reasoning [39, 66, 67].”
From SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineering (2024) · cites this paper as [39]
Experimental — accuracy not yet measured
107 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Reflexion: Language Agents with Verbal Reinforcement Learning > 3 Reflexion: reinforcement via verbal reflection
“while M e not pass or t < max trials do”
§ Reflexion: Language Agents with Verbal Reinforcement Learning > Self-reflection
“The Actor, Evaluator, and Self-Reflection models work together through trials in a loop until the Evaluator deems τ t to be correct.”
Citations
Cites
The publisher hasn’t deposited this paper’s reference list.
Cited by
Items 2,301–2,400 of 3,537
AnchorGUI: Asymmetric Memory for Dual-Scale Learning in GUI Navigation
Jin, S., Sun, Z., Xu, H., Ma, Y., & Lu, Z. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37447-9_6
“Reflexion [20] demonstrates that verbal self-reflection enables effective cross-trial learning in text-based environments [21, 35].”
Li, M., Bu, F., Zhang, Y., & Sun, F. (2026) · Sustainability · doi:10.3390/su18189277
Iterative Perceptual Alignment for VLMs via Deterministic Reconstruction Feedback
Chen, X., Guo, H., Cai, N., & Luo, J. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37211-6_4
Multi-Agent LLM Collaborative Reasoning and Task Planning for Complex Task Solving
Zhang, W., Liao, T., & Feng, Y. (2026) · International Conference on Computer Information Science and Application Technology (CISAT) · doi:10.1109/cisat71030.2026.11682610
“Reflexion introduces verbal reinforcement through episodic self-feedback, enabling an agent to learn from failed trajectories without parameter updates [9].”
ReAct Ops: A Plan-and-Execute ReAct Agent Framework for Autonomous Distributed Cluster Diagnosis
Li, D., Miao, Y., Chen, J., & Chen, L. (2026) · International Conference on Computer Information Science and Application Technology (CISAT) · doi:10.1109/cisat71030.2026.11682211
“The Reflection mechanism is the critical reliability component of R E A CT O PS , drawing on recent advances in reflection-based agent control [15], [16].”
RF-FilterLLM: A Fine-Tuned LLM Agent for Automated RF Filter Design
Sun, W., Li, Y., Wang, Z., Sui, X., Luo, X., Mei, Y., Li, Q., Wang, R., Shi, H., & Pang, J. (2026) · International Conference on Microwave and Millimeter Wave Technology (ICMMT) · doi:10.1109/icmmt69626.2026.11678389
“Whenever a simulation run fails to meet the specifica-tions, element-wise sensitivity is computed via ABCD-matrix perturbation: Elements are then ranked by impact score, and the resulting report is fed back to the LLM [8], narrowing the correction search space from O ( N ) to O ( k ) ( k ≪ N ).”
Yu, J. (2026) · Discover Artificial Intelligence · doi:10.1007/s44163-026-01984-9
“Shinn et al. introduced Reflexion, a framework in which LLM-based agents improve performance through iterative self-reflection and dynamic memory, suggesting a direction toward forms of adaptive restructuring relevant to ISM’s Stage Three [38].”
Think-Commit Decoupling for Accelerated and Reliable Tool Invocation in LLM Agents
Lu, X., Wang, J., He, Y., Wu, W., & Li, Y. (2026) · International Conference on Computer Information Science and Application Technology (CISAT) · doi:10.1109/cisat71030.2026.11682253
“This reveals a key gap: current LLM agent frameworks lack a mechanism to explicitly separate internal reasoning from ex-ternal execution under evolving instructions [17], [18], making it difficult to simultaneously achieve fast response preparation and reliable tool invocation.”
OceanSkill: An Agentic Skill Framework for Evidence-Grounded Ocean Forecast Report Generation
Yu, X., Bi, Z., Zhu, Y., Wang, Z., Liu, Z., & Lou, J. (2026) · International Conference on Large Models and Intelligent Agent Technologies (LMIAT) · doi:10.1109/lmiat70705.2026.11682146
“Skill-based agent frameworks further emphasize the modularization and reuse of task-specific capabilities [17], [18].”
AGE: Agentic Gaussian Editing in 3D Scenarios
Qin, H., Lin, T., Wei, M., Sun, Y., Lu, M., Kong, M., & Zhu, Q. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37553-7_13
Dong, C. (2026) · International Conference on Large Models and Intelligent Agent Technologies (LMIAT) · doi:10.1109/lmiat70705.2026.11682536
Knowledge-Grounded Adaptive Reflection for Reliable and Fair Educational LLM Agents
Pan, K., Bi, Z., Zhao, K., Wang, Z., Liu, Z., & Lou, J. (2026) · International Conference on Large Models and Intelligent Agent Technologies (LMIAT) · doi:10.1109/lmiat70705.2026.11682086
“Inference-time reflection frameworks like Self-Refine [14] and Reflexion [13] enable iterative self-correction and align with metacognitive principles [12].”
Pal, A. (2026) · Discover Artificial Intelligence · doi:10.1007/s44163-026-02240-w
“Self-refinement Self-refinement and Reflexion-style approaches use feedback or reflection to improve outputs without weight updates [23, 24].”
FloodClaw: A Test-Time Reasoning Framework for Flood Preparedness
Men, Y., He, X., Liu, X., Mohamed, W. O. H., & Kan, G. L. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-38407-2_28
ReliHarness: A Self-Learning Reliability Harness for LLM Agent Tool Execution
Chen, W., Song, P., Lu, Q., Cao, L., Cheng, B. H., Feng, W., & Liu, C. (2026) · Electronics · doi:10.3390/electronics15184166
Security-Augmented Use Case Flow Refinement for LLM-Based Agentic Systems
Wang, G., Li, B., Wu, J., & Shao, Z. (2026) · Electronics · doi:10.3390/electronics15184135
Learning to coordinate: A knowledge-distilled agent for adaptive multi-agent code generation
Bai, X., Huang, S., & Wang, R. (2026) · Expert Systems with Applications · doi:10.1016/j.eswa.2026.134396
Ali, A., Ramkissoon, T., Rajaram, K., Murray, D., Addison, L. M., Manohar, K., & Hosein, P. (2026) · Lecture notes in networks and systems · doi:10.1007/978-3-032-35078-7_19
FinDS-Agent: A Cloud–Edge Collaborative Data Science Agent for Financial Analytics
Xiaozheng, D. U., Deng, R., Wang, C., Zhou, F., Hu, S., Lu, Z., & Fong, S. J. (2026) · Future Internet · doi:10.3390/fi18090477
Closing the Empirical Loop: Autonomous AI Agents Conduct End‐to‐end Research With Human Participants
Wehr, G., Rideaux, R., Fox, A. J., Lightfoot, D. R., Tangen, J. M., Mattingley, J. B., & Ehrhardt, S. E. (2026) · Advanced Science · doi:10.1002/advs.76675
“These task feedback signals were then synthesized using a framework analogous to ‘Reflexion’ [ 85 ] and incorporated by the agent to inform subsequent propositions.”
A Multi-Agent and RAG-Based Framework for Amazon Book Review Rating Prediction
Ma, Y., & 贾双玉 (2026) · International Conference on Digital Society and Artificial Intelligence (DSAI) · doi:10.1145/3833541.3833669
NovaWM: An Action-Conditioned World Model for State Simulation in StarCraft II
Zhang, C., & Luo, X. (2026) · International Conference on Machine Learning, Natural Language Processing and Modeling · doi:10.1145/3832928.3832995
Agentic AI for Autonomous Marketing: Taxonomy, Benchmark, and an Open-Source Agent
Thapa, P., Khadka, S., Sharma, P., Rai, A., Bhattarai, U., Regmi, K., & Bohara, P. (2026) · doi:10.1145/3838457.3838570
Iovane, G., Ziccardi, C., Rosati, A., & Iovane, G. (2026) · Information · doi:10.3390/info17090901
Reflection-Augmented Strategy Generation via In-Game Triggering in Large Language Models
Ni, Y., Zhu, Z., 龚晨枫, Qi, R., & Huang, K. (2026) · International Conference on Big Data and Information Analytics (BigDIA) · doi:10.1109/bigdia71496.2026.11684683
“Reflexion [13] guides models to extract experience from failure through linguistic retrospection; Iterative Refinement with Self-Feedback (Self-Refine) [15] employs an iterative “draft–self-review– rewrite” process to improve generation quality; Reflection-Reinforced Self-Training (Re-ReST) [16]…”
Xu, Y., Hao, Q., Li, X., 牛立全, & Xia, C. (2026) · Information Processing & Management · doi:10.1016/j.ipm.2026.105167 · Cited by 1
Graph-based Multi-Agent LLM Framework for OCR-based Visual Question Answering
Dang, T. L.-T., Nguyen, H. M., & Nguyen, K. V. (2026) · International Conference on Multimedia Analysis and Pattern Recognition (MAPR) · doi:10.1109/mapr72750.2026.11685818
“Self-Refine [32] and Reflexion [33] revise output from self-generated feedback, Chain-of-Verification [34] drafts and answers verification questions before finalizing, and Self-CheckGPT [35] detects hallucination via consistency across samples.”
Adaptive Solving with Episodic Memory and Serial Multi-Agent Reasoning
Fan, W., Zhou, M., He, J., Chen, F., He, S., Li, S., & Zeng, W. (2026) · International Conference on Big Data and Information Analytics (BigDIA) · doi:10.1109/bigdia71496.2026.11684607
“• Self-Refl [29]: Task-internal self-reflection using execution feedback; no cross-task memory.”
ConDA: A constraint discovery agent for cross-system optimization of manufacturing operations
Zhang, Y., Imani, F., & Tang, J. (2026) · Journal of Manufacturing Systems · doi:10.1016/j.jmsy.2026.09.001
When Iterative Prompting Fails: An Empirical Study of Unit Test Generation with Open-Source LLMs
Tran, M.-D., & Mai, K. (2026) · International Conference on Multimedia Analysis and Pattern Recognition (MAPR) · doi:10.1109/mapr72750.2026.11685714
“Methods such as Self-Refine and Reflexion introduce multi-step generate–critique– refine pipelines [5, 6], but their effectiveness in code-centric tasks requiring strict semantic correctness remains unclear, particularly for small LLMs [7, 8].”
InfluentialCross-Platform Heterogeneous Data-Driven Multi-Agent Hierarchical Consensus Decision-Making
Gong, J., Yan, Z., Dai, X., Liu, J., Qiao, Z., & Wang, F. (2026) · International Conference on Big Data and Information Analytics (BigDIA) · doi:10.1109/bigdia71496.2026.11684669
Fu, Y., Zhang, Q., Zhu, M., Wang, M., Kaiyue, L., & Hu, S. (2026) · International Conference on Big Data and Information Analytics (BigDIA) · doi:10.1109/bigdia71496.2026.11684539
“Self-Refine [14] and Reflexion [15] have demonstrated that LLMs are capable of self-correction through a closed loop of generation–feedback–reflection.”
TopoAgent: An Agentic Framework for Automated Topology Learning in Medical Imaging
Meng, G., Gu, P., Li, X., Shi, Y., Chambers, E. W., & Chen, D. Z. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37032-7_17 · Cited by 3
When AI Agents Rewrite Their Own Rules: Power-Seeking in Endogenously Changing Environments
Rozinek, O. (2026) · Communications in computer and information science · doi:10.1007/978-3-032-37933-7_2
He, Q., Liu, X., Liu, J., Liu, B., & Liu, W. (2026) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2026.106727
LLM-Agent-Based Energy-Neutral Random Access for Low-Altitude UAV Localization
Zhu, E., Tan, J., Liu, F., Tong, J., Wang, T., & Zhang, S. (2026) · IEEE Sensor Array and Multichannel Signal Processing Workshop (SAM) · doi:10.1109/sam68950.2026.11687959
“Unlike traditional RL which requires extensive trial and error, Reinforcement Learning from Language Feedback (RL-LF) frameworks, such as Reflexion, have proven that agents can rapidly correct errors from historical interactions by introducing self-reflection mechanisms [11].”
Hierarchical Reasoning and Evidence-Guided Agentic Framework for Factual Text Summarization
Khandar, P. V., Mohanty, D. K., & Baliarsingh, S. K. (2026) · International Conference Computational Vision and Bio Inspired Computing · doi:10.1109/iccvbic71195.2026.11688292
“Recent studies have explored iterative refinement, where multiple rounds of feedback help revise the generated summaries [8], [11].”
Toward Reliable Agentic AI for Software Architectural Analysis
Liljas, V. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-39143-8_4
Samarasekara, I., Bandara, M., Rabhi, F., & Benatallah, B. (2026) · Lecture notes in business information processing · doi:10.1007/978-3-032-37877-4_16
Jędrzejowicz, P. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-36868-3_1
RS-Flow: Learning to Plan Tool-Augmented Workflows for Remote Sensing
Shen, J. (2026) · International Conference on Artificial Intelligence, Internet of Things and Cloud Computing Technology (AIoTC) · doi:10.1109/aiotc71250.2026.11689261
Ioannou, I. I., & Javaid, S. (2026) · Energies · doi:10.3390/en19184444
Hybrid Graph Retrieval-Augmented Language Agents for Collaborative Recommendation
Bulychev, I., & Savchenko, A. (2026) · AI · doi:10.3390/ai7090380
“Hierarchical memory structures have been studied in reinforcement learning [27,28] and dialogue systems [29].”
Dynamic Graph Retrieval-Augmented Reasoning via Query Drift-Aware Uncertainty Estimation
Zhao, H., Jing, X., & Deng, Q. (2026) · International Conference on Artificial Intelligence, Internet of Things and Cloud Computing Technology (AIoTC) · doi:10.1109/aiotc71250.2026.11688585
“Uncertainty-aware systems such as Self-RAG [5], UAR [6], CRAG [7], and Reflexion [8] improve reliability from retrieval quality or generation confidence perspectives, but none establishes a dedicated mechanism for query drift occurring during evolution.”
Commit Before Trust: Transactional Shared Memory for Multi-Agent LLMs
Kim, C., Ojha, M., Konnur, S., Kolachana, S., & Hu, L. (2026) · International Conference on Artificial Intelligence, Internet of Things and Cloud Computing Technology (AIoTC) · doi:10.1109/aiotc71250.2026.11689396
“Several studies have explored improving the reliability of LLM agents through self-reflection, iterative refinement, verification, and LLM-as-a-Judge techniques [15]–[18].”
Bondarenko, A., Zamorskaia, N., Djakons, D., Djakona, A., & Djakons, R. (2026) · Latvian Journal of Physics and Technical Sciences · doi:10.2478/lpts-2026-0036
Adaptive Stopping in Iterative LLM Loops: Measuring Regret and Recoverable Policy GainPreprint
Zhai, Y., Nie, C., Wang, G., Wang, Z., & Zhou, J. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.7507225
Elmasry, M. A. (2026) · Research Square · doi:10.21203/rs.3.rs-10985030/v1
Guru, D. (2026) · International Symposium on Networks, Computers and Communications (ISNCC) · doi:10.1109/isncc70543.2026.11693853
“…the reasoning agents construct a context-specific assessment from multiple sources of evidence, generate alternative root-cause hypotheses, rank those hypotheses according to evidential support, and select an appropriate workflow action[1], [4], [5] within defined financial-policy constraints.”
Nie, P., Nie, D., Jin, X., Liu, Y., & Liao, Q. (2026) · Applied Sciences · doi:10.3390/app16189354
Chen, J., Xu, A., Lin, S., Li, L., Zhang, Z., Weng, Z., Zhou, Z., Wen, T., & Zhu, B. (2026) · International Conference on System Reliability and Safety Engineering (SRSE) · doi:10.1109/srse70977.2026.11694794
“Recent agentic frameworks such as ReAct [12] and Reflex-ion [13] show that orchestrated reasoning can solve multi-step tasks, but primarily target throughput in software or linguistic domains.”
Shi, Y., Liu, Y., Du, G., Liu, H., & Feng, S. (2026) · IEEE Access · doi:10.1109/access.2026.3736562
Understanding Creativity Across Brains and Machines Through the GEEC Framework
Owen, L. L. W., Peng, Z., & Guzik, E. E. (2026) · Knowledge · doi:10.3390/knowledge6040025
An LLM-Driven Intelligent Agent for Adaptive Data Preparation with Strategy Memory
Ju, C., Zhao, G., & Chen, Y. (2026) · International Conference on Electronic Information, Computer and Aerospace Remote Sensing (EICARS) · doi:10.1109/eicars71536.2026.11694749
“In the direction of agent self-improvement, Shinn et al. [11] proposed Reflexion, a framework that reinforces language agents through verbal feedback rather than weight updates.”
Cao, H., Fu, Y., Gao, W., Lin, Y., Li, X., & Wang, W. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-38260-3_43
Measuring Reproducibility in LLM Research: A Rubric and Cross-Topic Corpus Study
Chong, C. J., Hou, C., Liu, S., & Yao, Z. (2026) · ACM Conference on Reproducibility and Replicability (ACM REP) · doi:10.1145/3820002.3828584
“[9];MRKLSystems[52];AgentBench[70];AutoGen[111];Gorilla[81];HuggingGPT[94];RARR[29];ReAct[116];Reflexion[95];ToolLLM[85];Toolformer[93];Voyager[106]; AutoWebGLM[56];DSPy[53];GraphRAG[24];Self-RAG[3];StableToolBench[35];WebArena[127] 22 1.36 2.09 1.86 2.14 1.36 1.77 Code / Software Engineering…”
InfluentialGroundTrader: Multi-Agent Transition Supervision for LLM-Based Financial Trading
Cui, X., Liu, Y., & Zhang, S. (2026) · Mathematics · doi:10.3390/math14193472
Jia, H., He, M. X., Yin, Z., Wu, L. J., Fan, J., & Sang, J. (2026) · International Conference on Automation Control, Algorithm and Intelligent Bionics (ACAIB) · doi:10.1145/3828836.3828924
Adaptive Honey-Memory: A Semantic Deception Framework for Disrupting Agentic Malware
Ahsan, T., Asad, M., Firdous, S., Tahir, Z., Malik, A. H., & Abid, A. (2026) · International Journal of Innovations in Science and Technology · doi:10.33411/ijist/2010
Rocha, A., Ferreira, J. P., de Oliveira, P. C., Alves, M., & Sousa, A. J. (2026) · Computers · doi:10.3390/computers15100647
Jia, Q., Li, H., Shi, J., Chen, X., Wang, R., Peng, Y., Gao, L., Chen, Q., An, H., Ouyang, R., et al. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-38079-1_40 · Cited by 1
Zeng, C., & Kang, S.-W. (2026) · 2026 8th Asia Conference on Machine Learning and Computing (ACMLC) · doi:10.1109/acmlc70381.2026.11700470
“ReAct combines reasoning and action through a “think-act-observe” loop, Reflexion [32] introduces reflective mechanisms to learn from failures, and Self-RAG [16] employs on-demand retrieval coupled with self-critique.”
Engineering verification-guided LLM framework for feasibility-aware spec configuration
Park, S. (2026) · Advanced Engineering Informatics · doi:10.1016/j.aei.2026.105299
Wang, C., Bai, J., Zhang, Z., luo, L., & Zhu, C. (2026) · Swarm and Evolutionary Computation · doi:10.1016/j.swevo.2026.102539
Controlled knowledge updating in memory-enabled AI agents: beyond model editing and recall
Chavira, G., Bravo, E. J. G., García, G. E. R., Espinosa, J. A. A., & Nava, S. W. (2026) · Frontiers in Big Data · doi:10.3389/fdata.2026.1938137
Sun, T., & Li, Y. (2026) · Mathematics · doi:10.3390/math14193523
Pwnagent: a knowledge-guided multi-agent system for automatic exploit generation
Wei, C., Geng, Y., Wang, Y., Wu, Q., Huang, J., Wu, Q., & Wei, Q. (2026) · Cybersecurity · doi:10.1186/s42400-026-00649-5
“To overcome the limitations of coarse-grained feedback signals, this approach builds a reflection loop around layout-oriented feedback (Shinn et al. 2023; Chen et al. 2024).”
Language Models in Video Anomaly Detection: A Dynamic Survey
Mumcu, F., Bekit, L., Jones, M., Cherian, A., & Yılmaz, Y. (2026) · IEEE Access · doi:10.1109/access.2026.3737989
“Formally, let T gt denote the set of ground-truth anomalous tracks and let T det denote the subset of ground-truth tracks that satisfy the track-level detection criterion.”
From PATTS to Agentic Workflows for Zonation-Aware Well Log Imputation
Chen, Y. (2026) · Communications in computer and information science · doi:10.1007/978-3-032-39823-9_26
Generation of Data Dependency Analyzers via LLM-Based Defect-Guided Iterative Regeneration
Kinoshita, T., Mizuno, T., Igarashi, S., & Fukui, D. (2026) · International Conference on Information, Intelligence, Systems & Applications (IISA) · doi:10.1109/iisa71656.2026.11705570
“Self-refinement methods indicate that iterative feedback can improve model behavior [19], [20], and related agentic/tool-use approaches provide complementary motivation for feedback loops [21], [22].”
Kommuri, S. S. (2026) · Technology and Innovation Conference (TIC) · doi:10.1109/tic68483.2026.11702875
“The Thought Rollback (TR) framework enables systems to automatically recognize and rectify reasoning mistakes [5], reducing reliance on manual correction cycles.”
OCEAN-Weighted Event Gating Preserves Recall in LLM NPC Memory Pipelines
Damastuti, F. A., Gumelar, A. B., Firmansyah, K., Fananda, I. Y., Hakkun, R. Y., & Akbar, Z. F. (2026) · International Electronics Symposium (IES) · doi:10.1109/ies71033.2026.11702684
Review of Boltly: Agentic AI Web Experience Platform
Pabalkar, S., Kamble, Y., Patil, T., Bargule, K., & Rodage, A. (2026) · International Conference on Innovation & Growth in Next-Gen Intelligent Technology & Engineering (IGNITE) · doi:10.1109/ignite69592.2026.11706280
Ponduru, P. S., Nandanavanam, P. P. V., & Ponduru, S. K. K. (2024) · International Journal of Scientific Research in Science Engineering and Technology · doi:10.32628/ijsrset2613385
WALL-EVE: World Alignment with Rule Learning in Visual Environments
Zhou, S., Zhou, T., Yang, Y., Long, G., Ye, D., Jiang, J., & Zhang, C. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37372-4_32
MARE: Framework to Enhance Long-Term Reasoning with Controlled Memory Augmentation
Porbandarwala, M., Seth, M., Pai, V., Nayak, K., & Deshpande, H. (2026) · International Conference on Innovation & Growth in Next-Gen Intelligent Technology & Engineering (IGNITE) · doi:10.1109/ignite69592.2026.11706478
“In addition to this, some reflective memory approaches have improved performance by learning from past mistakes and use stored feedback to improve future decisions [12].”
Liu, Y., Chung, H., Song, Y., Liu, D., & Chen, T. (2026) · Transportation Research Part A Policy and Practice · doi:10.1016/j.tra.2026.105290 · Cited by 1
Human–AI Collaboration in Agentic Systems: Designing Guardrails, Escalation, and Trust
Khashu, K. (2026) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-2600-4473-5.ch005
Enhancing Autonomous Agent Accuracy Through Reflection-Based Reasoning
Pang, L., Cen, C., Yu, J., Huang, D., & Sun, X. (2026) · International Conference on Advanced Network Technologies and Applications (APAN) · doi:10.1109/apan70967.2026.11709799
“Reflexion uses verbal feedback from previous failures to guide future attempts in agent settings [22].”
Memory-Aware Multi-agent Architecture with LLM-Based Orchestration for Conversational Recommendation
de Castro, E. P., Silva, V., Kanno, G. D. O., dos Santos, M., do Amaral, B. F., Nogueira, M., Pellicer, L. F., Lanaro, L., Luiz, P. A., Manesco, J. R. R., et al. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-39892-5_25
Large language models discover complementary heuristics for combinatorial optimization
Gong, H., Wang, S., Song, D., Sheu, J., & Yan, R. (2026) · Nature Machine Intelligence · doi:10.1038/s42256-026-01307-8 · Cited by 2
“The five LLM-based baselines 4,21,22,29,31 that fail on every one of our four problems while LACE attains 0.97–0.99 on the same problems with the same backbone sharpen this conclusion: when the interface absorbs the burden of problem-specific structure, generalization depends less on whether the…”
InfluentialUncertainty-Aware Adaptive Debate for Robust and Efficient Large Language Model Reasoning
Liu, R., Guo, W., Liao, T., & Fang, X. (2026) · International Conference on Computer Vision and Data Mining (ICCVDM) · doi:10.1109/iccvdm71812.2026.11709092
“Reflection-based agents reuse verbal feedback across attempts [5], and iterative self-feedback can refine an initially weak response without parameter updates [6].”
ETTAFSSAOUI, Y., & Bencharef, O. (2026) · Research Square · doi:10.21203/rs.3.rs-10963932/v1
Guo, Z., Zhang, W., & Guo, W. (2026) · International Conference on Computer Vision and Data Mining (ICCVDM) · doi:10.1109/iccvdm71812.2026.11709171
“Reflexion shows that reinforcement signals can improve agent decisions across trials [15].”
Datura: Progressive Red Teaming Testing for Tool Invocation Chain in LLM Agents
Shao, Y., Bao, Z., Huang, Y., Shi, Y., Weng, M., Sun, Y., Yang, L., Ma, L., Su, T., & Wan, C. (2026) · Proceedings of the ACM on software engineering. · doi:10.1145/3832101
What Makes In-Context Examples Effective for Code Generation?
Li, D., Chen, S., Cao, J., & Cheung, S.-C. (2026) · Proceedings of the ACM on Software Engineering · doi:10.1145/3832275
From Large Language Models to Agentic Systems: A Systematic Review of Generative AI in GIScience
Zhang, J., Huang, X., Mai, G., Zhou, B., Jia, Y., Wu, Q., & Franklin, R. S. (2026) · Transactions in GIS · doi:10.1111/tgis.70400
A Structural Survey of Coordination Patterns in LLM-Based Multi-agent Systems
Esposito, N., Aniello, G., Gambino, G., Panariello, C., Alfano, D., & Abbruzzese, R. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-40774-0_21
AGoT: A Reasoning Framework for LLM Agents
Matteini, M., Raggini, M., Ciatto, G., & Omicini, A. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-40774-0_29
De novo molecular design with agentic AI: Integrating tree search and iterative refinement
Lavinia, Y., Ang, D., & Atamian, H. S. (2026) · Intelligent Systems with Applications · doi:10.1016/j.iswa.2026.200737
Agentic AI in der Unternehmenspraxis: Vom Werkzeug zum Akteur
Li, M. M., Reinhard, P., & Leimeister, J. M. (2026) · HMD Praxis der Wirtschaftsinformatik · doi:10.1365/s40702-026-01331-7
Agentic Generative AI in Higher Education: Perceived Benefits, Risks, and Implications for Learning
Ilieva, G., Yankova, T., Ruseva, M., Klisarova-Belcheva, S., Georgiev, P., & Totkov, G. (2026) · Trends in Higher Education · doi:10.3390/higheredu5040108
“The framework is designed to examine the potential pedagogical benefits of persistent workflow support for complex tasks requiring planning, evidence use, comparison, justification, verification, and reflection [35–37].”
Turaga, V. S. P., Singh, S. U., & Namin, A. S. (2026) · Communications in computer and information science · doi:10.1007/978-3-032-39763-8_22
LLMA-UML: Extending the UML for Modeling LLM-Agent Systems
Walter, L., Rother, K. M., & Henkler, S. (2026) · ACM/IEEE International Conference on Model Driven Engineering Languages and Systems (MODELS) · doi:10.1145/3837062.3838894
Can LLM agents with generic tools perform MBSE tasks, build-up skills and transfer them?
Ober, I. (2026) · ACM/IEEE International Conference on Model Driven Engineering Languages and Systems (MODELS) · doi:10.1145/3837062.3838900
“Closer to our setting, context-level approaches that avoid weight updates include, Reflexion [8], a framework in which agents store self-generated reflections in an episodic memory that is re-injected as context on subsequent attempts to solve a task.”
Towards AI-Assisted Hardware Engineering: An Overview of LLM-Driven RTL Design Frameworks
Ahir, S., Doboli, A., & Doboli, S. (2026) · IEEE Conference on Information Technology and Data Science (CITDS) · doi:10.1109/citds70571.2026.11706876
“Subsequent work introduced retrieval-augmented generation (RAG), simulation-guided refinement, iterative self-correction, and verification-aware frameworks to improve functional correctness and reduce hallucinated logic [4], [6], [7], [13], [14].”
Increasing Resilience of Smart Home Agents
Terrazas, C., & Cotilla‐Sanchez, E. (2026) · International Conference on Smart Energy Systems and Technologies (SEST) · doi:10.1109/sest67798.2026.11712302 · Cited by 1
“To explore diverse types of agents, we implemented the Reflexion [19] agent as shown in Algorithm 1.”
Shaik, H., Villuri, G., & Doboli, A. (2026) · IEEE Conference on Information Technology and Data Science (CITDS) · doi:10.1109/citds70571.2026.11706879
“5-72B-Instruct, the method outperforms zero-shot, Re-flexion [22], and OpenEvolve [23] on seven of eight problems at both 300 and 600 evaluations (paired Wilcoxon tests over 10 matched seeds, p 0 .”
MAM-PT: A Memory-Augmented Middleware for Enhancing Automated Penetration Testing
Sun, W., Wang, W., Wu, W., & Wang, Y. (2026) · International Conference on Computer Science and Blockchain (CCSB) · doi:10.1109/ccsb71176.2026.11716413
Hierarchical Structured Abstraction as an Inductive Bias for Out-Of-Distribution Generalisation
Villuri, G., Shaik, H., & Doboli, A. (2026) · IEEE Conference on Information Technology and Data Science (CITDS) · doi:10.1109/citds70571.2026.11706866
“On eight benchmark problems spanning maze navigation, cross-coupled resource allocation, and symbolic optimisation, the framework outperforms zero-shot, Reflex-ion [21], and OpenEvolve [22] on 7 of 8 problems at both 300 and 600 evaluations ( p 0 .”
Metadata
- Authors
- Shinn, N., Cassano, F., Berman, E., Gopinath, A., Narasimhan, K., & Yao, S.
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2023
- Pages
- 8634-8652
- ISSN
- 1049-5258 (ISSN-L)
- arXiv
- 2303.11366
- OpenAlex
- W7133222210
- Cited by
- 1,087
- References
- 0
- Citations by year
- 2026: 760 · 2025: 167 · 2024: 105 · 2023: 55
- FWCI
- 192.15
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- neural information processing systems (publishedVersion)
- arXiv (Cornell University) (submittedVersion, cc-by)
- arXiv (Cornell University) (cc-by)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Keywords
- language agents, verbal behavior, language acquisition
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-01, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-01 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.