Reflexion: Language Agents with Verbal Reinforcement Learning
Open accessThe DOI matches its DataCite record; 42 of the 42 references it cites were found in a registry or an index; 7 of the 8 sources its claims cite were checked for support.
Abstract
Large language models (LLMs) have been increasingly used to interact with external environments (e.g., games, compilers, APIs) as goal-driven agents. However, it remains challenging for these language agents to quickly and efficiently learn from trial-and-error as traditional reinforcement learning methods require extensive training samples and expensive model fine-tuning. We propose Reflexion, a novel framework to reinforce language agents not by updating weights, but instead through linguistic feedback. Concretely, Reflexion agents verbally reflect on task feedback signals, then maintain their own reflective text in an episodic memory buffer to induce better decision-making in subsequent trials. Reflexion is flexible enough to incorporate various types (scalar values or free-form language) and sources (external or internally simulated) of feedback signals, and obtains significant improvements over a baseline agent across diverse tasks (sequential decision-making, coding, language reasoning). For example, Reflexion achieves a 91% pass@1 accuracy on the HumanEval coding benchmark, surpassing the previous state-of-the-art GPT-4 that achieves 80%. We also conduct ablation and analysis studies using different feedback signals, feedback incorporation methods, and agent types, and provide insights into how they affect performance.
Overview
CoChat Summary
TL;DR
Reflexion reinforces language agents through verbal self-reflection stored in episodic memory rather than weight updates, improving performance across decision-making, reasoning, and coding tasks. It reports gains including 91% pass@1 on HumanEval, a 22% absolute improvement on AlfWorld, and 20% on HotPotQA.
Key findings
- On HumanEval Python, Reflexion achieves 91.0 pass@1, surpassing the previous state-of-the-art GPT-4 at 80.1; on HumanEval Rust it reaches 68.0 vs. 60.0, MBPP Rust 75.4 vs. 70.9, and Leetcode Hard 15.0 vs. 7.5.
- In AlfWorld, ReAct + Reflexion completes 130 out of 134 tasks using a simple heuristic and improves over strong baselines by an absolute 22% over 12 iterative learning steps; ReAct-only converges at a 22% hallucination rate with no long-term recovery.
- In HotPotQA, Reflexion improves over baselines by 20%; self-reflection gives an 8% absolute boost over episodic memory alone, and although CoT (GT) fails on 39% of questions, Reflexion improves accuracy by 14% without access to ground-truth answers.
- Ablations on the 50 hardest HumanEval Rust problems show full Reflexion at 0.68 vs. baseline 0.60; omitting test generation drops to 0.52, and omitting self-reflection stays at 0.60.
Methods
- Reflexion uses a modular loop with an Actor that generates text/actions, an Evaluator that scores outputs, and a Self-Reflection model that converts feedback into verbal summaries stored in memory; trials repeat until the Evaluator passes or a max trial count is reached, with memory usually bounded to 1–3 experiences.
- Experiments cover AlfWorld (134 environments, six tasks, ReAct + GPT-3), HotPotQA (100 questions, CoT/ReAct, exact-match grading, memory size 3), and programming (HumanEval, MBPP, LeetcodeHardGym; Python/Rust via MultiPL-E; self-generated unit tests up to 6).
- Ablations and analyses vary feedback signals, feedback incorporation methods, and agent types; compromised approaches are tested on HumanEval Rust, and a WebShop experiment is run across 100 environments.
Limitations
- The paper states Reflexion may fall into non-optimal local minima, limits long-term memory to a sliding window with maximum capacity, and notes code-generation test-driven development is limited by non-deterministic, impure, hardware-dependent, or concurrent functions; it also relies on LLM self-evaluation/heuristics and lacks a formal success guarantee.
- The paper reports WebShop failure: after only four trials the agent shows no improvement and does not generate helpful self-reflections, concluding Reflexion cannot solve tasks requiring significant diversity and exploration.
- Evident from the text: self-correction is an emergent quality of stronger, larger models—starchat-beta shows no improvement (baseline 0.26 vs. Reflexion 0.26)—and flaky or incorrect test suites can cause false positives/negatives, with false negatives preferred.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
4 Valid · 2 Not valid · 0 Not checked · 59 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Therefore, in the case in which the model generates a flaky test suite, it is possible that all tests pass on an incorrect solution and lead to a false positive label on a code completion [11].”
§ Reflexion: Language Agents with Verbal Reinforcement Learning > Analysis
What the sources say
- Partly supportedcites [11] 11. Lam, W., Winter, S., Wei, A., Xie, T., Marinov, D., and Bell, J. (2020). A large-scale longitudinal study of flaky tests. Proc. ACM Program. Lang., 4(OOPSLA). sourceExperimental — accuracy not yet measured
The Introduction (page not provided) says a flaky test can pass and fail on the same code and that changes may be merged when all tests pass. It does not address model-generated test suites, incorrect code completions, or false-positive labels, so those parts of the claim are not established by this paper. (LLM, conf=0.82)
hedgedstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“3 shows an inferior 52% vs 60% (baseline) accuracy, which suggests that the agent is unable to determine if the current implementation is correct without unit tests.”
§ Reflexion: Language Agents with Verbal Reinforcement Learning > Ablation study
hedgedstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“ReAct + Reflexion significantly outperforms ReAct by completing 130 out of 134 tasks using the simple heuristic to detect hallucinations and inefficient planning.”
§ Reflexion: Language Agents with Verbal Reinforcement Learning > Results
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“4 shows that self-reflection improves learning by an 8% absolute boost over the episodic memory learning advantage.”
§ Reflexion: Language Agents with Verbal Reinforcement Learning > Analysis
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“on reasoning questions in HotPotQA [28] by 20%”
- Also stated in: § 4 Experiments · plain
“Most notably, Reflexion improves performance over strong baselines by 22% in AlfWorld, 20% in HotPotQA, and 11% on HumanEval.”
§ Reflexion: Language Agents with Verbal Reinforcement Learning > 1 Introduction
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § 4 Experiments · plain
30 more claims
Create a free account to see all 65 claims and every source verdict.
- It may state two separate claims as one. 18
- Probably not a substantial claim. 11
- The quote only partly states this claim. 3
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source doesn’t support the claim as written.
In the citing paper
“Memory and reflection systems such as MemAgent (Yu et al., 2025a), Reflexion (Shinn et al., 2023), and Generative Agents (Park et al., 2023) improve retrieval and episodic memory, but do not perform context shaping, state restructuring, or nextinstruction refinement.”
From PAACE: A Plan-Aware Automated Agent Context Engineering Framework (2025) · cites this paper as Shinn et al., 2023
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe cited source doesn’t support the claim as written.
In the citing paper
“However, Reflexion computes verbal reward over a full trajectory, yielding a single end-of-episode signal that conflates credit across reasoning steps: a failure due to a single intermediate error receives the same critique pressure as one due to a flawed strategy.”
From Process Supervision via Verbal Critique Improves Reasoning in Large Language Models (2026) · cites this paper as Shinn et al. [2023]
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe cited source doesn’t support the claim as written.
In the citing paper
“Unlike Reflexion, which only reflects on unsuccessful trajectories, our approach separately reflects on both successful and unsuccessful ones.”
From An Efficient Context-Dependent Memory Framework for LLM-Centric Agents (2025) · cites this paper as Shinn et al., 2023
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe cited source doesn’t support the claim as written.
In the citing paper
“The dominant approach is to curate memory at write time.”
From Just-in-Time Memory: Learning to Curate Task-Adaptive Memory for LLM Agents (2026) · cites this paper as Shinn et al., 2023
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Interaction and code generation are increasingly used together, with code as the modality of choice for actions [48, 59], tool construction [13, 51, 69], and reasoning [39, 66, 67].”
From SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineering (2024) · cites this paper as [39]
Experimental — accuracy not yet measured
107 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Reflexion: Language Agents with Verbal Reinforcement Learning > 3 Reflexion: reinforcement via verbal reflection
“while M e not pass or t < max trials do”
§ Reflexion: Language Agents with Verbal Reinforcement Learning > Self-reflection
“The Actor, Evaluator, and Self-Reflection models work together through trials in a loop until the Evaluator deems τ t to be correct.”
Citations
Cites
The publisher hasn’t deposited this paper’s reference list.
Cited by
Items 2,201–2,300 of 3,537
From Prompts to Pressure: Evaluating LLM-driven Agents for GPU Stress-code Generation
GENSALE, A., Esposito, G., Guerrero-Balaguera, J.-D., Condia, J. E. R., Cagliero, L., & Reorda, M. S. (2026) · IEEE International On-Line Testing Symposium (IOLTS) · doi:10.1109/iolts69666.2026.11633814
“Recent literature has demonstrated the advanced capabilities of LLMs to iteratively improve generated code by incorporating reflection and collaboration mechanisms [21]–[23] and by leveraging direct execution-based feedback [24], [25].”
SHEM — An Agentic Smart Home Executive Manager
Kumi, S., Lomotey, R. K., & Deters, R. (2026) · International Conference on Revolutionary Artificial Intelligence and Future Applications (Rev-AI) · doi:10.1109/rev-ai70456.2026.11622243
“For instance, Reflexion [7] utilizes self-evaluation loops, while LATS [8] relies on Monte Carlo Tree Search to explore LLM-generated action spaces.”
Vatsal, S., Dubey, H., & Bajaj, A. (2026) · IEEE Access · doi:10.1109/access.2026.3720396
“Reflexion [13] improves performance by storing reflective text and reusing it later but it keeps the base model unchanged.”
InfluentialLlm-Guided Training and Llm-Free Inference for Reliable Task Offloading in Edge Computing
Guo, H., Xv, K., & Yang, L. (2026) · IEEE International Conference on Distributed Computing Systems (ICDCS) · doi:10.1109/2575-8411.2026.00079
A Multi-Head Attention Approach for SLA Compliance Monitoring in Data Centers
Thapliyal, O. (2026) · IEEE International Conference on Distributed Computing Systems Workshops (ICDCSW) · doi:10.1109/icdcsw72724.2026.00030
“The orchestrator routes relevant excerpted text, and adds a context to each researcher, triggering the needed number of research agents in parallel [11], [12].”
Agentic Foresight: Potenziale autonomer KI-Agenten für die strategische Vorausschau in Unternehmen
Haugk, S., & Leyh, C. (2026) · HMD Praxis der Wirtschaftsinformatik · doi:10.1365/s40702-026-01318-4
Rai, B., & Popović, M. J. (2026) · Applied Decision Analytics · doi:10.66972/ada202734
DynaTree: Dynamic Agentic Retrieval Tree for Time-Sensitive News Retrieval
Qi, S., Wang, X., Yang, Y., Guo, H., Lin, J., Liu, W., Yu, Y., & Zhang, W. (2026) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3770855.3818386
BiVCoder: A Multi-Agent Framework for Code Generation via Bidirectional Code-Test Diagnosis
Li, X., Dong, J., Shi, W., Lü, W., & Du, X. (2026) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3770855.3818107
VCAgent: A Mutation-Guided Self-Reflective Agent Framework for Virtual Cell Modeling
Li, Z., Han, R. D., Wang, X., Zhang, G., Gao, W., Su, Y., Tian, Z., Liu, X., & Wang, G. (2026) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3770855.3818989
U-EHR: A Self-Evolving EHR Agent with Step-Level Credit Assignment and UCB-Guided Memory Retrieval
Wu, H., Wang, Z., Rao, Z., Lin, H., Zhu, J., Cai, Q., Zhou, Y., Lin, A., Wang, H., & Xiong, H. (2026) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3770855.3819038
Li, Y., Dou, Y., Shao, J.-J., Lyu, Y., Tsang, I. W.-H., & Yin, H. (2026) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3770855.3817981 · Cited by 4
Test-Time Deep Thinking to Explore Implicit Rules
Chen, W., Cong, X., Zhang, Z., Lu, Y., Zhao, S., Wu, Y., Luo, Q., Chen, H., Lin, Y., Liu, Z., et al. (2026) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3770855.3817790
Iklassov, Z., Madmoun, H., Duhot, J.-J., & Lahlou, S. (2026) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3770855.3816459
Kilaru, S. (2026) · Lecture notes in networks and systems · doi:10.1007/978-3-032-31523-6_3
DDIAgents: Mechanism-Conditioned Context Flow for Drug-Drug Interaction Prediction
Shen, Z., Liu, Y., Fu, X., & Yao, Q. (2026) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3770855.3818959
A Progressive Visual-Logic-Aligned Framework for Ride-Hailing Adjudication
Wu, W., Cheng, Z.-J., Meng, J., Zhen, 彭. P., Huang, S., Li, Q., Wu, G., & Guo, L.-Z. (2026) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3770855.3817688
“To avoid information sparsity arising from raw text concatenation, we employ a Summary Agent powered by an LLM. Drawing inspiration from verbal reinforcement learning mechanisms [25], this agent analyzes the retrieved cohort 𝒩 𝐾 to identify statistical commonalities and adjudication patterns.”
Dimension-Constrained Organizational Relay for Long-Context LLMs
Wang, X., Li, Z., Hu, C., & Wei, S. (2026) · Applied Sciences · doi:10.3390/app16167903
Retrieval-Guided Safety Alignment for Action Spaces in LLM-Based Embodied Agents
Yang, W., Han, M., Ren, F., & Zhang, J. (2026) · International Conference on Artificial Intelligence and Computing (AIC) · doi:10.1109/aic65131.2026.11633630
“Reflexion introduces a self-reflective memory mechanism based on language feedback, improving subsequent decisions through explicit summarization of prior experience [20].”
LLM-Powered Agentic Data Science: Automated Analysis and Insight Generation
Keerthika, M. (2026) · Eduschool International Journal of Data Science and Machine learning (EIJDSML) · doi:10.63090/eijdsml/3139.7344.0010
Zhao, Y., Hu, T., & Jiang, S. (2026) · Symmetry · doi:10.3390/sym18081340
Saidi, W., Satouri, B., Abderrahmani, A. E., & Satori, K. (2026) · Big Data and Cognitive Computing · doi:10.3390/bdcc10080267 · Cited by 1
“Shinn et al. [62] established the importance of self-reflection for general artificial intelligence agents by introducing Reflexion, a system that enables linguistic agents to acquire knowledge through verbal reinforcement via self-reflection.”
Handoff Hallucinations: Taxonomy, Benchmark, and Mitigation for Multi-agent Pipeline Failures
Jafarova, H., & Alakbarli, F. (2026) · Communications in computer and information science · doi:10.1007/978-3-032-31319-5_22
CALA: A Context-Augmented Lightweight Agent for Record Adjudication
Chen, X., & Huang, S. (2026) · doi:10.1109/icbdse70225.2026.11635503
“Reflexion [11] and ReAct [7] provide the broader agent-loop substrate.”
Agentic Ecosystem for Question Answering using Multi-Persona Agents
Vrisheeka, M., Mandlik, A. J., Singh, P. K., Kavisankar, L., & Ray, B. (2026) · International Conference on Data Science and Business Systems (ICDSBS) · doi:10.1109/icdsbs69077.2026.11634648
Incorporating Reflection Mechanism into Multi-Modal Reasoning for MLLMs
Leng, X. (2026) · International Conference on Electronic Information Technology and Computer Engineering (EITCE) · doi:10.1109/eitce70137.2026.11634616
“Research into self-refinement and the Reflexion strategy [18] has shown that MLLMs can identify and rectify their own reasoning errors by reviewing their generated traces against a set of constraints or external feedback.”
CausalDX: Diagnosing Long-Tail and Cascading Cloud Incidents With LLM-Guided Causal Reasoning
Chang, Z., Wu, Y.-J., Feng, H., Li, Y., Fang, Y., Liu, L., Jin, Z., Huang, D.-Q., Yang, X., Chen, P., et al. (2026) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2026.3722256
Agent Architectures and the PARM Framework
Dinç, R., & Ardıç, N. (2026) · Springer eBooks · doi:10.1007/978-3-032-26723-8_4
Guo, Z., Zhang, W., & Guo, W. (2026) · Research Square · doi:10.21203/rs.3.rs-10630372/v1
Wang, L., Fan, Z., Song, Y., Zhang, J., Li, X., & Chen, X. (2026) · IEEE China Conference on System Simulation Technology and its Applications (CCSSTA) · doi:10.1109/ccssta69471.2026.11635569
“LLM-agent architectures such as ReAct [5], Reflexion [6], and plan-based prompting [7] have been widely investigated for tool-use tasks.”
Graph-Based Multi-agents for Text-to-SQL
Hùng, P. Q., Thi-Ha, L., Vu, H.-T., Xuan-Hieu, P., & Nguyen, M.-T. (2026) · Communications in computer and information science · doi:10.1007/978-981-92-2600-9_7
王, 俊. (2026) · Computer Science and Application · doi:10.12677/csa.2026.168266
Video-Grounded Verification for Long-Horizon Visual Imitation Learning
Chen, Q., Shi, C., Chen, Q., Wu, Y., Zhang, X., Gao, R., Zhang, H., Gao, Z. F., Sun, C., Wu, K., et al. (2026) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2026.3723308
“…often perform verification with respect to an external reference: LLM agents use textual instructions, task goals, or feedback for replanning [30], [31], [32], [33], [34], while robot program-synthesis methods use formal specifica-tions or simulation-based validation to check the program…”
LLM as Automated Theorem Provers for Map-Reduce Code Generation
Simonov, V. S., & Khairetdinov, M. S. (2026) · International Siberian workshops and tutorials on electron devices and materials · doi:10.1109/edm69524.2026.11632200
“Reflexion [25] treats execution failures as verbal reinforcement; Self-Refine [26] iterates a generate–critique– refine loop; AlphaCodium [27] adds test-driven specification stages around code generation; and Self-Edit [28] studies the limits of self-repair.”
Agentic AI for Data Quality: Probabilistic Pivot for Data Quality Management
Upadhyay, P., Rajwade, M., Leuva, N., Dhar, S., & Palecek, D. (2026) · International Conference on Advancement in Data Science, E-learning and Information System (ICADEIS) · doi:10.1109/icadeis71120.2026.11644550
“Prior work applies these patterns exclusively in isolation-Reflexion [14] and Self-Refine [21] address iterative self-correction, Toolformer [15] and Gorilla [10] address external tool integration, and MetaGPT [22] and Guo et al. [20] address multi-agent orchestration — but no prior work integrates…”
NL2SQL+: An Extended Framework for SQL Generation With On-Demand Embedded ML Functions
Jang, J., Son, M., & Li, W.-S. (2026) · IEEE Access · doi:10.1109/access.2026.3722873
Can One Agent Restore Another? Multi-Agent Verification Through Independent Constraint SourcesPreprint
Yuan, S. (2026) · Research Square · doi:10.21203/rs.3.rs-10651733/v1
Tool-Augmented Agentic Inversion for Budget-Constrained Diagnosis of Dam Drainage Degradation
Yan, H., Liu, X., Nie, W., Xin, J., Wang, X., & Zhao, J. (2026) · International Conference on Electronic Technology and Information Science (ICETIS) · doi:10.1109/icetis70504.2026.11633459
“[38], [39] For scientific applications, however, useful autonomy requires a clear trust boundary.”
Cao, S. (2026) · International Conference on Artificial Intelligence and Electromechanical Automation (AIEA) · doi:10.1109/aiea70743.2026.11632893
Towards Optimizing LLM-based Sensor Data Processing: An Empirical Study of Evolutionary Algorithms
Quan, P., Wang, B., Ouyang, X., Yang, K., & Srivastava, M. B. (2026) · IEEE International Workshop on Foundation Models for Cyber-Physical Systems & Internet of Things (FMSys) · doi:10.1109/fmsys72110.2026.00019
“We compare prompting strategies combined with the standard coding paradigm, including zero-shot inference, Chain-of-Thought (CoT) [30], ReAct [33], and self-verification [24].”
Heuristic Search in AI-Assisted Discovery: A Recursive Architecture
Sercovich, F. C. (2026) · Lecture notes in networks and systems · doi:10.1007/978-3-032-32726-0_40
Jang, H., Lee, E., Kim, K., & Kim, M. (2026) · IEEE Access · doi:10.1109/access.2026.3723800
Pham, V. T., Phan, M., Quynh, C. B., Phuc, T. C., Duy, N. T., Tien, M. V., & Son, N. N. (2026) · Malaysian Journal of Science and Advanced Technology · doi:10.56532/mjsat.v6i2.684
“…duplicates, and expert validation before integration; (3) Automatically expanding the corpus by detecting REFERS_TO links and ingesting cited decrees, circulars, and related legal instruments; and (4) Integrating the framework with RAG systems for enhanced question answering capabilities [23].”
Li, B., Guo, Y., Hu, H., Rao, D., & Li, D. (2026) · Energies · doi:10.3390/en19163817
Gundidza, F., Kikuchi, M., & Ozono, T. (2026) · IEEE Access · doi:10.1109/access.2026.3723798
MACRDR: Enhancing Interest Discovery and Diversity in News Recommendation via Multi-Agent ReflectionPreprint
Zhang, X., & Feng, S. (2026) · Research Square · doi:10.21203/rs.3.rs-10567677/v1
StickyMemory: Robust Web Agents with Episodic Memory and Self-Verification
Gudipuri, N. (2026) · International Conference on Cybersecurity, Digital Forensics, and AI Applications (ICCSDFAI) · doi:10.1109/iccsdfai70505.2026.11647973
“Reflex-ion augments ReAct-style agents with verbal self-feedback that is stored as episodic experience, improving downstream trials without gradient updates [10].”
Identity and Access Management for Agentic AI: A Zero-Trust Security Framework
Makhmetov, A., Dota, Y., Auyezov, A., Abdigali, A., & Zhunussov, K. (2026) · International Conference on Cybersecurity, Digital Forensics, and AI Applications (ICCSDFAI) · doi:10.1109/iccsdfai70505.2026.11648021
“Shinn et al. [6] showed that reflection-based agents improve task completion by learning from prior failures.”
Optically Encoded Wearable Memory Systems for Continuous Personal AI
Zhang, W., & Wang, S. (2026) · International Conference on Computer Vision, Image and Deep Learning (CVIDL) · doi:10.1109/cvidl70130.2026.11637894
“Agent-memory work further reinforces the need for persistent episodic buffers and reflection mechanisms [18], [19].”
Self-Reflective LLM Agents with Quality-Aware Episodic Memory for Multi-Step Task Completion
Mohanam, B. N. (2026) · International Conference on Cybersecurity, Digital Forensics, and AI Applications (ICCSDFAI) · doi:10.1109/iccsdfai70505.2026.11648054
Persistent Goal-Tracking and Instruction-Driven Reasoning in Sequential Conversation QA
Ngo, Q.-D., Dang, Q.-D., & Phan, L. (2026) · IEEE Access · doi:10.1109/access.2026.3725149
Analysis and Classification of Approaches to the Evolution of LLM-Agents
Равильевна, Ф. Р., & Sychev, A. E. (2026) · International Conference on Neural Networks and Neurotechnologies (NeuroNT) · doi:10.1109/neuront71829.2026.11651389
“Self-reflection is a mechanism in which the agent analyzes its own responses, errors, and reasoning to improve them [4, 25, 26, 27].”
LLMs Make Robust Stochastic Optimization Easier: An Agentic WorkflowPreprint
Wang, Z., Wang, Z., Chen, Y., Chen, Z., & Lyu, G. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.7283098
Ashok, N., George, J., & Singh, M. (2026) · International Conference on NextGen Data Science and Analytics (ICNDSA) · doi:10.1109/icndsa68777.2026.11652295
“Noah Shinn et al. [2] proposes Reflexion, an entirely new framework that allows large language model-based agents to learn through verbal reinforcement rather than traditional weight updates.”
Bhardwaj, K., & Menon, H. (2026) · IEEE International Symposium on Parallel & Distributed Processing, Workshops and Phd Forum · doi:10.1109/ipdpsw71298.2026.00116
Cao, Y., Keung, J., Wang, Y., Sun, Y., & Mao, Z. (2026) · IEEE Annual International Computer Software and Applications Conference (COMPSAC) · doi:10.1109/compsac69091.2026.00062 · Cited by 1
“From this view, repository-level issue resolution is a constrained search problem over a large and heterogeneous edit space, where weak context selection or poorly guided revisions can quickly waste the available attempts [1], [10], [13].”
Congestion-Aware Scheduling for Heterogeneous LLM-Agent Teams
Xie, W., & Li, Y. (2026) · IEEE Annual International Computer Software and Applications Conference (COMPSAC) · doi:10.1109/compsac69091.2026.00432
ReviewTestFuse: Fusing review-guided and direct test generation for deployable regression testing
Zhen, H., & Zhang, Z. (2026) · Automated Software Engineering · doi:10.1007/s10515-026-00669-y
Pham, A., White, L. L. A., Watson, K. L., & Shryock, K. J. (2026) · ASEE Annual Conference & Exposition · doi:10.18260/1-2--61023
Optimization of Large Model Knowledge Extraction Chain-of-Thought for Hydropower Operation Agents
Wan, K., Deng, W., Zhao, Y., & Sun, Y. (2026) · International Conference on IoT, Data Science and Advanced Computing (IDSAC) · doi:10.1109/idsac70973.2026.11650689
“Related prompting, verification, and reflection methods further improve reasoning robustness through task decomposition, self-feedback, verification, and verbal reinforcement [15], [22]–[24].”
Computational Nutrition 2.0: an algorithmic frontier for AI agents
Xie, M., Shen, C., Zhu, R., & Lv, C. (2026) · AI Agent · doi:10.20517/aiagent.2026.32
Characterizing and Mitigating Context Redundancy in LLM Agent Workflows
Luo, R., Zhao, L., & Che, Y. (2026) · Lecture notes in computer science · doi:10.1007/978-981-92-4805-6_12
Recursive Self-Improving LLM Agents with Meta-Cognitive Feedback Loops
Kushwaha, S., Shah, B., Chauhan, Y., Saxena, A. M., & Priya, S. S. (2026) · International Conference on Smart Systems and Inventive Technology (ICSSIT) · doi:10.1109/icssit69151.2026.11656524
Morsalin, M. I., Onisha, T. A., & Ji, Y. (2026) · International Conference on Intelligent Multimedia, Networking, and Security (IMNS) · doi:10.1109/imns67862.2026.11655317
“Reflexion [10] offers the most principled existing approach to self-evaluation via verbal feedback, but still relies on the agent’s own judgment to decide when to stop, inheriting the same theoretical limitation.”
Utility-Guided Orchestration for Cost-Efficient Tool-Augmented LLM Services
Liu, B., Zhao, G., Xu, H., Tang, H., Zhu, W., Li, L., & Zhang, Y. (2026) · IEEE International Conference on Joint Cloud Computing (JCC) · doi:10.1109/jcc72984.2026.00053
“Recent work shows that multi-step reasoning, planning, program use, and reflection can improve complex task solving [8], [9], [10], [11], [12], [13], [14], [15], [16], [17], [18], [19].”
Shamieh, H., & Aref, A. (2026) · IEEE Jordan Conference on Applied Electrical Engineering and Computing Technologies · doi:10.1109/aeect69724.2026.11657849
“Agent frameworks such as ReAct [12], Reflexion [13], and PMAx [14] run PM workflows on their own, and benchmarks [15], [16] confirm that LLMs can answer conformance, descriptive, and predictive PM questions when they are given well-structured data inputs .”
Ma, S., Li, J., Zhang, G., Yu, J., Li, W., & Ma, X. (2026) · World Conference on Computer and Information Security (WCCIS) · doi:10.1109/wccis70285.2026.11650912
“Recent LLM-based agents such as ReAct [4] , Reflexion [5] , and EmbodiSkill [6] , as well as multimodal embodied models such as ManipLLM [7] , program-prompting methods such as ProgPrompt [8] , and LLM-trained embodied agents from parallel TextWorld [9] , improve benchmark performance, yet they…”
InfluentialDeng, Y. (2026) · 2026 3rd World Conference on Computer and Information Security (WCCIS) · doi:10.1109/wccis70285.2026.11651016
“Reflection and tool-interactive self-correction methods introduce an additional critique or reflection stage to improve output quality, but may increase computational overhead and latency[10], [11].”
Semantic Raft: A Fault-Tolerant Multi-Agent Inference Framework for Reliable LLM Services
Su, Y.-D., Wang, Y., Dong, Y., & Xu, Z. (2026) · International Workshop on Quality of Service · doi:10.1109/iwqos70441.2026.11661187
“Pioneering works such as Chain-of-Thought (CoT) [1] and Tree-of-Thoughts (ToT) [2] structure the reasoning process into intermediate steps, while Self-Consistency (SC) [21] and Reflexion [22] enhance accuracy by introducing sampling redundancy and verbal feedback.”
Formal Trajectory Analysis for Testing Agentic AI in Stateful Environments
Twabi, A., Ding, Y., & Kondo, T. (2026) · IEEE International Conference on Artificial Intelligence Testing (AITest) · doi:10.1109/aitest70988.2026.00025
“These frameworks support patterns including single-agent ReAct [36], sequential planner-executor [37], debate [38], group chat, and concurrent workers.”
Bao, H., Yu, T., Wang, J., Yin, H., Gao, Y., & Mao, Y. (2026) · Frontiers in Public Health · doi:10.3389/fpubh.2026.1844470
DelAct: A Replayable Boundary Runtime for Auditable and Governed LLM Agent Workflows
Zhang, Y., Liao, H., Guo, D., & Tang, G. (2026) · International Workshop on Quality of Service · doi:10.1109/iwqos70441.2026.11661202
“Traditional approaches to handling agent failures heavily rely on prompting techniques like verbal reinforcement or self-reflection (e.g., Reflexion [20] and CoT [27]).”
A Dynamic Evaluation Approach to Repository-Level Code Generation Via LLM
Kuang, F., Liu, D., Wang, Y., Huan, H., Zhao, M., Mi, L., & Zheng, X. (2026) · IEEE International Conference on Artificial Intelligence Testing (AITest) · doi:10.1109/aitest70988.2026.00019
“Self-Refine [4] and Reflexion [5] revise earlier outputs using self-generated or externally provided feedback.”
Software Engineering Reliability in the Era of Generic and Agentic AI
Nwodo, K., & Stavrou, A. (2026) · Studies in computational intelligence · doi:10.1007/978-3-032-18585-3_9
Chen, J., Peng, H., Li, L., Wang, C., & Lan, X. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.7360162
Agentic AI and Cybersecurity: Threats, Defenses, and Open Problems
Stavrou, A. (2026) · Studies in computational intelligence · doi:10.1007/978-3-032-18585-3_6
LLM-Powered Multi-Agent Attacks on Cooperative Spectrum Sensing
Cai, Y., He, Z., Luo, Y., Zhang, Z., Cao, J., Liu, Y.-C., Luo, Z., & Zhao, S.-Q. (2026) · International Conference on Computer Communications and Networks · doi:10.1109/icccn69946.2026.11662754
“To derive the decision vector, we employ Program-Aided Language Models (PAL) [20], which enhance the model’s reasoning and decision-making capabilities.”
LLM-Based Multi-Agent Collaboration for Constrained Multi-Objective Container Placement
Sarkar, S., Hazra, A., Mittal, A., & Sahu, A. (2026) · IEEE ... International Conference on Cloud Computing · doi:10.1109/cloud72782.2026.00018
“…literature, debate-based frameworks have been shown to improve reasoning quality over single-agent designs [12], [13], role-specialized collaboration has been applied to structured task decomposition [14], [15], and verbal scratchpad memory has been shown to improve iterative decision quality [16].”
Zhang, Y., Zhou, P., Zhang, L., & Wang, R. (2026) · Aerospace Systems · doi:10.1007/s42401-026-00487-w
A survey on LLM-enhanced reinforcement learning in financial markets
aldaffaie, G. H. J. A., Taheri, A., Farhadi, A., & Zamanifar, A. (2026) · Discover Artificial Intelligence · doi:10.1007/s44163-026-02018-0
Understanding User Evaluation of Emerging AI Agents: Evidence from YouTube Comments on OpenClaw
Ren, F., & Yan, J. (2026) · Electronics · doi:10.3390/electronics15173881
Traceability and Source Authority Guardrails for Agentic RAG-Based Financial Claim Verification
Thamrin, D. S., Lubis, M., Fansyah, E. A., Fauzan, R. A., & Asyam, M. R. D. (2026) · International Conference on Electronics Representation and Algorithm (ICERA) · doi:10.1109/icera72709.2026.11666732
“Agentic workflows organize complex tasks into structured reasoning and action steps, including planning, retrieval, evidence verification, and final decision-making [15], [16], [17], [18], [19], [20].”
Xiao, J., Yang, C., Xu, X., Yang, Y., Li, Y., Zhang, L., & Yang, Y. (2026) · Aerospace · doi:10.3390/aerospace13090789
Context-Aware LLM-Assisted Stochastic Model Predictive Control for Multi-Energy Microgrid OperationPreprint
Arubayi, M., Li, Z., Wang, Z., & Guo, Z. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.7386065
Role-Aware Agentic Retrieval-Augmented Generation for Urban Rail Transit Fault Management
Zhang, W., Fang, H., Bu, J., Zhong, Q., & Yu, Y. (2026) · AI · doi:10.3390/ai7090339
“Reflexion further introduces self-reflection through language feedback, enabling agents to improve future decisions based on previous failures [21].”
Discharge-agents: A few-shot multi-agent collaborative framework for discharge summary generation
Che, Z.-H., Chen, Z., & Xu, Y. (2026) · Pattern Recognition Letters · doi:10.1016/j.patrec.2026.09.003
Periasamy, P. (2026) · Lecture notes in networks and systems · doi:10.1007/978-3-032-31755-1_27
Jôrgensen, B. N., & Ma, Z. G. (2026) · Automation · doi:10.3390/automation7050138
Kurnovskii, R. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.7404538
Shinohara, T. (2026) · Street Art & Urban Creativity · doi:10.62161/sauc.v12.6387
“ReAct demonstrated that reasoning traces and environment actions can support each other in interactive tasks (Yao et al., 2023), while Reflexion showed that verbal feedback can improve subsequent attempts (Shinn et al., 2023).”
GarmentoPIA: Generating Garment Pattern Models Using Intelligent Agents
Yeom, M., Shin, R., & Lee, S.-H. (2026) · Computational Visual Media · doi:10.26599/cvm.2026.9450567
Technorationality of the Digital Society
Shipunova, O. D., & Berezovskaya, I. P. (2025) · Russian Journal of Philosophical Sciences · doi:10.30727/0235-1188-tjyakx
Gao, L., Shen, G., Hu, W., Chen, W., & Chen, H. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.7417887
Yichen, Y., Dianqing, L., & Meng, C. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.7422696
Intent-Driven and Constraint-Verified Service Composition via Evolving Verified Experience
Ma, B., Liu, J., Ren, B., Luo, L., Guo, D., & Chen, H. (2026) · IEEE International Conference on Web Services (ICWS) · doi:10.1109/icws72778.2026.00168
Stabilizing Graph Explanations Under Spurious Correlations via Self-reflection
Cai, K., Xu, C., Peng, C., Wang, Y., Huang, J., Liang, Q., & Zheng, P. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37657-2_29
Structgen: A Multi-Agent Generative Service for Automated Web UI Prototyping
Luo, J., Zhao, S., Su, Y., Jinjian, Y., Tang, H., Zhao, C., & Li, Y. (2026) · IEEE International Conference on Web Services (ICWS) · doi:10.1109/icws72778.2026.00094
Liu, Z., Wang, Y., Mayer, W., Sheng, Q. Z., Wu, P., & Feng, Z. (2026) · IEEE International Conference on Web Services (ICWS) · doi:10.1109/icws72778.2026.00161
“Reflexion [18] mitigates this issue by prompting LLMs to reflect on and correct previous mistakes, thereby improving reasoning accuracy, while ToolLLM [11] extends this concept with the DFSDT method, allowing LLMs to evaluate multiple reasoning paths and select the most promising one, generalizing…”
A Survey of Multi-Model Collaboration in Video Understanding
Chen, Y., Zhang, J., Zhang, L., Liu, C., Gao, R., Lu, Z., Qi, J., & Lei, Q. (2026) · Data · doi:10.3390/data11090230
Optimizing FaaS Platforms for Orchestrating MCP-Enabled Agentic Workflows
Kulkarni, V., Jha, V., Reddy, N., Kollorath, H. A., Eswaran, A., Jayachandran, P., & Simmhan, Y. L. (2026) · IEEE International Conference on Web Services (ICWS) · doi:10.1109/icws72778.2026.00039 · Cited by 1
Metadata
- Authors
- Shinn, N., Cassano, F., Berman, E., Gopinath, A., Narasimhan, K., & Yao, S.
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2023
- Pages
- 8634-8652
- ISSN
- 1049-5258 (ISSN-L)
- arXiv
- 2303.11366
- OpenAlex
- W7133222210
- Cited by
- 1,087
- References
- 0
- Citations by year
- 2026: 760 · 2025: 167 · 2024: 105 · 2023: 55
- FWCI
- 192.15
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- neural information processing systems (publishedVersion)
- arXiv (Cornell University) (submittedVersion, cc-by)
- arXiv (Cornell University) (cc-by)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Keywords
- language agents, verbal behavior, language acquisition
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-01, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-01 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.