The DOI matches its DataCite record; 27 of the 27 references it cites were found in a registry or an index; 6 of the 22 sources its claims cite were checked for support.
ReAct: Synergizing Reasoning and Acting in Language Models
Open accessAbstract
Autonomous AI agents in business deployments exhibit a recurring failure mode: when an incident occurs, responsibility cannot be redirected to a separable contributor. The dominant discourse treats this as a single phenomenon, addressed by sandboxing, human-in-the-loop overload, or what Elish (2019) named the moral crumple zone. This paper argues the phenomenon is two architecturally distinct failure modes that have been conflated, and that the conflation is sustained by a missing positive name and a missing time-axis. The paper introduces two contributions. First, a four-quadrant decomposition of business AI work — along the axes of deterministic vs semantic-judgment and pre-defined vs exploratory — yields a positive name for the cell most current LLM applications occupy: the LLM Workflow Quadrant. The quadrant is defined by a single load-bearing property: the path is decided in advance by humans or by code, and the LLM is called as a single bounded step within that path; the property divides naturally into a conversational sub-form (specialized chat agents) and a batch sub-form (single-purpose LLM functions inside deterministic pipelines). The decomposition distinguishes principled from artificial redirect impossibility: the former intrinsic to autonomous loops, the latter the product of routing workflow work through autonomous-loop architecture by elimination, with four downstream symptoms (the RPA exception-handling bottleneck, the sandbox-strength demand, the structural distortion of human-in-the-loop, and the dissolution of the accountability chain at postmortem). Second, a Phase Separation axis (design vs operation), independent of Quadrant, surfaces a Phase-crossing decision — recorded at deployment time, in one sentence — required when an autonomous-loop component is placed in the operation phase. The Phase axis descends recursively to skill-design granularity, where the Quadrant 3 ↔ Quadrant 4 boundary is a continuous gradient on which model capability is downstream of phase, not the primary lever. The consequence is procedural rather than architectural: deployments make the Phase-crossing decision explicit, designate a pre-named gap-bearer for principled-impossibility placements, and route artificial-impossibility cases to re-architecture. The framework complements existing AI risk-management and management-system standards by recording the judgment layer they presuppose. Both rules are stated as experimental; the open questions are the research agenda.
Overview
AI snapshot
Written from the paper’s full text.
TL;DR
ReAct prompts large language models to interleave verbal reasoning traces with task-specific actions, allowing reasoning to guide acting and actions to gather external information. Across question answering, fact verification, and interactive decision-making benchmarks, ReAct improves grounding and performance over act-only baselines and combines well with chain-of-thought self-consistency.
Key findings
- On HotpotQA and Fever with PaLM-540B, ReAct reaches 27.4 EM and 60.9 Acc, versus Act at 25.7 EM and 58.9 Acc; CoT reaches 29.4 EM and 56.3 Acc. The best combinations are ReAct→CoT-SC at 35.1 EM on HotpotQA and CoT-SC→ReAct at 64.6 Acc on Fever.
- On ALFWorld, the best ReAct trial achieves 71% average success rate, versus best Act 45% and BUTLER 37%; even the worst ReAct trial at 48% beats the best trial of both baselines. ReAct’s relative gain over Act ranges from 33% to 90%, averaging 62%.
- On WebShop, ReAct scores 66.6 with 40.0 success rate, versus Act 62.3/30.1, IL 59.9/29.1, and IL+RL 62.4/28.7, an absolute 10% improvement over the previous best success rate; human experts score 82.1/59.6.
- Human analysis of 200 HotpotQA trajectories found CoT hallucination made up 56% of its failures, while ReAct had 0% hallucination failures but 47% reasoning errors and 23% search-result errors; CoT had 16% reasoning errors.
Methods
- ReAct augments the action space with language thoughts, prompting a frozen PaLM-540B with few-shot human trajectories of interleaved thoughts, actions, and observations; thoughts are dense for QA/fact verification and sparse for decision-making tasks.
- Evaluated on HotpotQA, Fever, ALFWorld, and WebShop, using a Wikipedia API with search, lookup, and finish actions; baselines include Standard, CoT, CoT-SC, and Act, plus ReAct↔CoT-SC combinations.
- Also finetuned PaLM-8B/62B on 3,000 correct ReAct trajectories; ALFWorld used 134 unseen evaluation games, WebShop used 500 test instructions, and HotpotQA/Fever used EM/accuracy.
Limitations
- The paper states that complex tasks with large action spaces require more demonstrations, which can exceed in-context input limits; finetuning is initially promising but needs more high-quality human annotations; PaLM is not openly accessible.
- The paper reports that ReAct lags CoT on HotpotQA (27.4 vs. 29.4 EM), has higher reasoning-error rate than CoT (47% vs. 16%), can repetitively loop, and suffers when search returns noninformative results (23% of error cases).
- The text makes evident that prompting methods remain far from supervised SoTA on HotpotQA/Fever (67.5 EM, 89.5 Acc) and from human experts on WebShop (82.1 score, 59.6 SR), and that the Wikipedia action space is weaker than state-of-the-art retrievers.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
46 Own result · 30 Own interpretation · 16 No basis given · 8 Sources not found · 5 Partly supported · 1 Supported · 1 Own method · accuracy not yet measured
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Therefore, better incorporation of reasoning abilities might benefit recent Internet-augmented language models (Nakano et al., 2021; Lazaridou et al., 2022; Shuster et al., 2022a) for up-to-date task solving.”
What the sources say
- Not matchedcites Nakano et al., 2021
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Supportedcites Lazaridou et al., 2022 source
The Introduction (p. 1) describes this paper’s Internet-augmented model as using web information for up-to-date question answering, so the citation identifies an example of the kind of model named in the sentence. The scaling analysis (p. 7) also reports that retrieval cannot compensate for a general lack of reasoning abilities, consistent with the citing authors’ suggestion that better reasoning might help. (LLM, conf=0.90)
- Not matchedcites Shuster et al., 2022a
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
hedgedconditionalSingle case- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Not matched
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“PaLM-62B finetuned ReAct outperforming all 540B prompting methods”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“With additional sparse reasoning, ReAct achieves significantly better performance, with an absolute 10% improvement over the previous best success rate.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“PaLM-8B finetuned ReAct outperforming all PaLM-62B prompting methods”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“On Webshop, one-shot Act prompting already performs on par with IL and IL+RL methods.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“and make up its major failure mode (56%)”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“On ALFWorld, the best ReAct trial achieves an average success rate of 71%, significantly outperforming the best Act (45%) and BUTLER (37%) trials.”
boosteddirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Qualitatively, we observed that ReAct-IM often made mistakes in identifying when subgoals were finished, or what the next subgoal should be, due to a lack of highlevel goal decomposition.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“ReAct outperforms CoT on Fever (60.9 vs. 56.3)”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“reaching CoT-SC performance with 21 samples using merely 3-5 samples”
plaindirectn = 21- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Probably not a substantial claim. 28
- It may state two separate claims as one. 36
- The quote only partly states this claim. 2
Every source the paper cites for this claim was checked and supports it.
In the paper
“In SayCan, LLMs were prompted to directly predict possible actions a robot can take, which is then reranked by an affordance model grounded on the visual environments for final prediction.”
What the sources say
- Supportedcites Ahn et al., 2022 source
Section 3 (pp. 3–4) says SayCan prompts an LLM to score candidate robot skills, then combines those scores with affordance values to select a skill. Figure 2 (p. 4) describes affordance values based on the robot’s current observation. The claim’s “reranked” describes this combined scoring, though the LLM scores a fixed set of skills rather than generating unrestricted actions. (LLM, conf=0.90)
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“WebGPT (Nakano et al., 2021) uses an LM to interact with web browsers, navigate through web pages, and infer answers to complicated questions from ELI5 (Fan et al., 2019).”
What the sources say
- Not matchedcites Nakano et al., 2021
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Supportedcites Fan et al., 2019 source
The citation to Fan et al. identifies ELI5 as the source of the questions, not as evidence for how WebGPT works. The Abstract and Introduction describe ELI5 as a dataset of complex, open-ended questions requiring long-form answers. (LLM, conf=0.92)
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
- Not matched
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Perhaps most relevant to ReAct in this respect are SayCan (Ahn et al., 2022) and Inner Monologue (Huang et al., 2022b), which use LLMs for robotic action planning and decision making.”
What the sources say
- Supportedcites Ahn et al., 2022 source
The Introduction (p. 2) says SayCan uses an LLM to determine useful actions for a robot’s high-level goal and combines it with affordance functions to determine what the robot can execute. Related Work (p. 11) explicitly describes its use of an LLM to interpret instructions and plan how to execute them. The separate claim about Inner Monologue is attributed to Huang et al., not this source. (LLM, conf=0.94)
- Not matchedcites Huang et al., 2022b
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“We also note that leveraging language as semantically-rich inputs in the process of interactive decision making has been shown to be successful under other settings (Abramson et al., 2020; Karamcheti et al., 2021; Huang et al., 2022a; Li et al., 2022).”
What the sources say
- Supportedcites Abramson et al., 2020 source
Section 2.5.4 (p. 18) describes agents receiving natural-language instructions and acting on them in an interactive setting. Section 3.6 (p. 29) reports that the best agent successfully performed both sides of these interactions in 39.58% of evaluated episodes, supporting the broad claim of success in this setting. (LLM, conf=0.90)
- Not matchedcites Karamcheti et al., 2021
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Not matchedcites Huang et al., 2022a
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Perhaps the most well-known work of using LLMs for reasoning is Chain-of-Thought (CoT) (Wei et al., 2022), which reveals the ability of LLMs to formulate their own 'thinking procedure' for problem solving.”
What the sources say
- Partly supportedcites Wei et al., 2022 sourceExperimental — accuracy not yet measured
Section 2 (pp. 2–3) says models can generate intermediate reasoning steps to solve problems, which supports the description of a step-by-step ‘thinking procedure.’ But it specifies that this ability is shown in sufficiently large models when chain-of-thought demonstrations are provided in few-shot prompts; the claim leaves those conditions out and could imply that models formulate the procedure unaided. (LLM, conf=0.84)
boosteddirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
- Partly supported
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“As can be seen in Table 3, ReAct substantially outperforms IM-style prompting ( ReAct-IM ) (71 vs. 53 overall success rate), with consistent advantages on five out of six tasks.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“ReAct outperforms Act on both ALFWorld (Table 3) and Webshop (Table 4).”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Through a diverse set of experiments on multi-hop question-answering, fact checking, and interactive decision-making tasks, we show that ReAct leads to superior performance with interpretable decision traces.”
boosteddirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Qualitatively, we saw that, without any thoughts at all, Act fails to correctly decompose goals into smaller subgoals, or loses track of the current state of the environment.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“We also find some HotpotQA questions may contain outdated answer labels”
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“ReAct is better than Act on both tasks”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“We find more examples do not improve performance.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“they both significantly and consistently outperform CoT-SC across different number of samples”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Moreover, the advantage of ReAct over Act is consistent across six controlled trials, with relative performance gain ranging from 33% to 90% and averaging 62%.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Of all trajectories with correct final answers, those with 7 steps on HotpotQA and 5 steps on FEVER only take up 0.84% and 1.33% respectively.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Failure: Search error”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Only ReAct is able to retrieve up-to-date information from the Internet and provide a reasonable answer.”
plaindirectSingle case- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Failure: Reasoning error”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Success: False positive”
plain- Asserted: fails — The authors may not put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The authors may not put it forward as true. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“ReAct is able to correctly find the knife, clean it, and then place it on a countertop.”
plaindirectSingle case- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Act is able to correctly find the knife”
plainSingle case- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. The quote only partly states this claim.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Failure: Label ambiguity”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Figure 5 shows that by simply removing a hallucinating sentence in Act 17 and adding some hints in Act 23, ReAct can be made to change its behavior drastically to align with these human thought edits and succeed in the task.”
plaindirectSingle case- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Failure: Hallucination”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“ReAct-IM is able to correctly find the knife”
plainSingle case- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The LLM then gets stuck trying to place this knife on a countertop.”
plainSingle case- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Success: True positive”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“We find ReAct and Act methods generally benefit from more training steps (and more training data), while Standard and CoT methods degrade soon after finetuning.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“which allows the model to perform dynamic reasoning to create, maintain, and adjust high-level plans for acting (reason to act), while also interact with the external environments (e.g. Wikipedia) to incorporate additional information into reasoning (act to reason).”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
None of the sources cited for this claim could be matched to a paper in Crossref, so there is nothing to check it against.
In the paper
“Unlike ReAct , they do not explicitly consider the reasoning procedure either, and also relies on expensive datasets and human feedback collections for policy learning.”
What the sources say
- Not matchedcites Shuster et al., 2022b
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Not matchedcites Glaese et al., 2022
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Not matchedcites Hosseini-Asl et al., 2020
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
- Not matched
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“by interacting with a Wikipedia API, ReAct is able to retrieve information to support reasoning, while also use reasoning to target what to retrieve next, demonstrating a synergy of reasoning and acting.”
boosteddirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
In the paper
“To increase reproducibility, we have included all used prompts in Appendix C, additional experiments using GPT-3 (Brown et al., 2020) in Appendix A.1, and associated GPT-3 ReAct prompting code at https://anonymous.4open.science/r/ReAct-2268/ .”
What the sources say
- Not matchedcites Brown et al., 2020
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
- Not matched
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Fever claims for SUPPORTS/REFUTES might only differ by a slight amount (see Appendix D.1), so acting to retrieve accurate and up-to-date knowledge is vital.”
hedgedconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
In the paper
“Inner Monologue made further improvements by adding the eponymous 'inner monologue”
What the sources say
- Not matchedcites Huang et al., 2022b
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
- Not matched
In the paper
“In comparison to ReAct , WebGPT does not explicitly model the thinking and reasoning procedure, instead rely on expensive human feedback for reinforcement learning.”
What the sources say
- Not matchedcites Nakano et al., 2021
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
- Not matched
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“as the language space L is unlimited, learning in this augmented action space is difficult and requires strong language priors.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper may give no reason why it holds. It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“the combination of reasoning and acting also contributes to model interpretability, trustworthiness, and diagnosability across all domains”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: unclear — It is unclear whether it could be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“In contrast, ReAct learns a policy in a much cheaper way, since the decision making process only requires language description of the reasoning procedure.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“We note that this action space mostly can only retrieve a small part of a passage based on exact passage name, which is significantly weaker than state-of-theart lexical or neural retrievers.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper may give no reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Despite the simplicity of our method, complex tasks with large action spaces require more demonstrations to learn well, which unfortunately can easily go beyond the input length limit of in-context learning.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper may give no reason why it holds. It may state two separate claims as one.
In the paper
“To our knowledge, Inner Monologue is the first work that demonstrates such a closed-loop system, which ReAct builds on.”
What the sources say
- Not matchedcites Huang et al., 2022b
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
hedgeddirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
- Not matched
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“as humans can readily distinguish information from model's internal knowledge versus external environments, as well as inspect reasoning traces to understand the decision basis of model actions.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper may give no reason why it holds. It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“generating human-like task-solving trajectories that are more interpretable than baselines without reasoning traces”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“derails the model reasoning and gives it a hard time to recover and reformulate thoughts”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“we observe that the problem solving process demonstrated by ReAct is more factual and grounded, whereas CoT is more accurate in formulating reasoning structure but can easily suffer from hallucinated facts or thoughts.”
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“Our experiments minimize such risks by limiting the interactions to specific websites (Wikipedia or WebShop) that are free of private information, without any dangerous actions in the action space design (i.e. models cannot really buy products on WebShop the research benchmark, or edit Wikipedia).”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“In contrast to these methods, ReAct performs more than just isolated, fixed reasoning, and integrates model actions and their corresponding observations into a coherent stream of inputs for the model to reason more accurately and tackle tasks beyond reasoning (e.g. interactive decision making).”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: unclear — It is unclear why the paper says it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“In contrast, the reasoning traces in ReAct for decision making is flexible and sparse, allowing diverse reasoning types (see Section 2) to be induced for different tasks.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“demonstrating the value of reasoning to guide acting”
boosteddirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The quote only partly states this claim.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“In ReAct , this sequence of subgoals would be concretely captured by each thought.”
hedgeddirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
In the paper
“This paradigm is also more than human dialogue to update the goal or subgoal as in Huang et al. (2022b) - while editing ReAct thoughts can do these, it can also modify the model's internal belief, reasoning styles, or anything the flexible thought space supports, for better task solving.”
What the sources say
- Not matchedcites Huang et al. (2022b)
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
plaindirectSingle case- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
- Not matched
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“From a human perspective, solving such a task becomes significantly easier, from typing tens of actions to only editing a couple of thoughts, which enables new forms of human-machine collaboration.”
plaindirectSingle case- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“With ReAct , an existing thought would have concretely identified that the knife had been taken, and that the next subgoal was to go to a sinkbasin to clean it.”
hedgeddirectSingle case- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“We note that such a policy edit on-the-go is difficult for Act and previous RL methods, as a human cannot change the model parameters, and changing a few actions might not edit the rest of the model behavior.”
hedgeddirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source doesn’t support the claim as written.
In the citing paper
“ReAct would require 16-20 LLM calls for this task: reasoning before each action (8 actions × 2 calls/action for 'thought' and 'action'), plus initial planning and reflection. MACLA reduces this to 2 calls by retrieving learned procedures, representing an > 85% reduction in LLM inference overhead.”
From Learning Hierarchical Procedural Memory for LLM Agents through Bayesian Selection and Contrastive Refinement (2025) · cites this paper as [26]
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“All of these new use cases require multiple, often dependent, LLM generation calls, showing a trend of using multi-call structures to complete complex tasks [57, 21].”
From SGLang: Efficient Execution of Structured Language Model Programs (2023) · cites this paper as [57]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Recent work has equipped dialogue agents with the ability to use tools such as calculators and calendars, and to consult external websites 24,25 .”
From Role play with large language models (2023) · cites this paper as [25]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“In systems designed for long-horizon settings, a common approach is to append all past observations, actions, and thoughts to the context at every turn [55, 61].”
From MEM1: Learning to Synergize Memory and Reasoning for Efficient Long-Horizon Agents (2025) · cites this paper as [61]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Early LLM agents used prompt-based planning [26] and selfcritique [15], but lack persistent 'how-to' procedures - when tasks are similar but not identical, agents must re-plan from scratch, increasing cost and latency.”
From Learning Hierarchical Procedural Memory for LLM Agents through Bayesian Selection and Contrastive Refinement (2025) · cites this paper as [26]
Experimental — accuracy not yet measured
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“(3) inferior planning and reasoning : existing works adopted either CoT (Wei et al., 2023) or ReACT (Yao et al., 2022) for model reasoning, which cannot fully elicit the capabilities stored in LLMs and thus fail to handle complex instructions.”
From Counterfactually Auditable Lifecycle Certification for Autonomous Agents (2023) · cites this paper as Yao et al., 2022
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“LLM-based approaches may assist by summarizing large-scale interaction logs, extracting structured event representations, or generating hypotheses about plausible attack paths; recent work on tool-augmented language models and automated log analysis suggests their usefulness in triage and forensic workflows (Schick et al., 2023;Solomon et al., 2026;Yao et al., 2022).”
From Open Challenges in Multi-Agent Security: Towards Secure Systems of Interacting AI Agents (2025) · cites this paper as Yao et al., 2022
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Incorporating user profiles and memory modules into agent systems allows them to display a range of behaviors similar to humans, based on their current observations [33].”
From Generative Agents Navigating Digital Libraries (2025) · cites this paper as [33]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Most modern agentic workloads follow the ReAct -agent loop [61], alternating between a reasoning step where the LLM interprets context and outputs thoughts, and an action step where it invokes external tools.”
From Continuum: Efficient and Robust Multi-Turn LLM Agent Scheduling with KV Cache Time-to-Live (2025) · cites this paper as [61]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“To that end, we first test ReAct (Yao et al., 2022), a multi-step agent for tool use, which is implemented as a built-in module in DSPy.”
From DSPy: Compiling Declarative Language Model Calls into Self-Improving Pipelines (2023) · cites this paper as Yao et al., 2022
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“| Prompt 3: ReAct | Yao et al. (2022) | 593 | 3889 |”
From DSPy: Compiling Declarative Language Model Calls into Self-Improving Pipelines (2023) · cites this paper as Yao et al. (2022)
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Yao et al. (2022) achieve 27.4% EM using ReAct with PaLM-540B and 30.8 with text-davinci-002 , with a tool giving it the ability for search using a Wikipedia API. They push their PaLM results to 35.1% EM by applying an additional CoT step with selfconsistency, which may resemble our ensemble approach in the sense of aggregating multiple answers.”
From DSPy: Compiling Declarative Language Model Calls into Self-Improving Pipelines (2023) · cites this paper as Yao et al. (2022)
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“These agents not only communicate and coordinate with one another but also interface with external resources such as tools, APIs, and structured data sources [24, 16].”
From Collaborative Memory: Multi-User Memory Sharing in LLM Agents with Dynamic Access Control (2025) · cites this paper as [24]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“One preliminary approach to achieving this goal involves prompting LLMs to generate explicit plans using their internal knowledge (Yao et al., 2022; Wang et al., 2023a; Sun et al., 2023). However, this method is limited by errors in the plans, which arise from the inevitable hallucinations of LLMs.”
From iCLP: Large Language Model Reasoning with Implicit Cognition Latent Planning (2025) · cites this paper as Yao et al., 2022
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Guiding thought generation with explicit plans (Yao et al., 2022), which are step-wise and question-specific reasoning instructions, is crucial for improving practical usage and reliability of LLMs (Huang et al., 2024; 2022).”
From iCLP: Large Language Model Reasoning with Implicit Cognition Latent Planning (2025) · cites this paper as Yao et al., 2022
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Current efforts such as ReACT (Yao et al., 2022) and PlaSma (Brahman et al., 2024) that rely on explicit plans face a key limitation: specific and question-oriented instructions often fail to generalize well across diverse problems, and the detailed content involved is prone to errors, making it difficult for the LLM to learn effectively.”
From iCLP: Large Language Model Reasoning with Implicit Cognition Latent Planning (2025) · cites this paper as Yao et al., 2022
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“ReAct (Yao et al., 2022) prompts LLMs to produce reasoning and action traces where actions are calls to a Wikipedia API to return the summary for a given Wikipedia page title.”
From Interleaving Retrieval with Chain-of-Thought Reasoning for Knowledge-Intensive Multi-Step Questions (2023) · cites this paper as Yao et al., 2022
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Large Language Model (LLM)-based agents increasingly rely on external tools to complete tasks beyond text generation (Yao et al., 2022).”
From MemMorph: Tool Hijacking in LLM Agents via Memory Poisoning (2026) · cites this paper as Yao et al., 2022
The cited source says what the claim attributes to it.
In the citing paper
“ReAct Agent (Yao et al., 2022).Maintains full interaction history with a ReAct-style reasoning-acting loop.”
From Git Context Controller: Manage the Context of LLM-based Agents like Git (2025) · cites this paper as Yao et al., 2022
The cited source says what the claim attributes to it.
In the citing paper
“We use ReAct [30] as the action generator as Yao et al. [30] has shown success in long trajectory decisionmaking using explicit intermediate thoughts.”
From Reflexion: Language Agents with Verbal Reinforcement Learning (2023) · cites this paper as [30]
The cited source says what the claim attributes to it.
In the citing paper
“ReAct [29] uses chain-of-thought prompting [46] by generating both reasoning traces and action plans with LLMs.”
From Voyager: An Open-Ended Embodied Agent with Large Language Models (2023) · cites this paper as [29]
The cited source says what the claim attributes to it.
In the citing paper
“A promising design paradigm for AI agents [65] is to combine an LLM with tools that interact with a broader environment [14, 35, 40, 47, 51, 53, 55, 69].”
From AgentDojo: A Dynamic Environment to Evaluate Prompt Injection Attacks and Defenses for LLM Agents (2024) · cites this paper as [69]
The cited source says what the claim attributes to it.
In the citing paper
“Frameworks integrating reasoning with action selection have shown that models can iteratively parse complex goals, call appropriate tools, and interpret results to inform further reasoning [9].”
From Medical AI Agents for Clinical Decision Support: Viewpoint Using the Planning, Action, Reflection, and Memory (PARM) Analytical Lens (2026) · cites this paper as [9]
The cited source says what the claim attributes to it.
In the citing paper
“ReAct interleaves language reasoning with environment actions [16], while Toolformer demonstrates self-supervised learning of when and how to call external APIs [17].”
From HELIX: Model-Harness Co-evolution for Recursive Self-Improvement (2026) · cites this paper as [16]
The cited source says what the claim attributes to it.
In the citing paper
“advancements in reasoning and decision-making in LLMs have significantly enhanced agent autonomy (52; 58; 36; 45).”
From Project Sid: Many-agent simulations toward AI civilization (2024) · cites this paper as [58]
The cited source says what the claim attributes to it.
In the citing paper
“Early LLM agents used prompt-based planning [26] and selfcritique [15], but lack persistent 'how-to' procedures - when tasks are similar but not identical, agents must re-plan from scratch, increasing cost and latency.”
From Learning Hierarchical Procedural Memory for LLM Agents through Bayesian Selection and Contrastive Refinement (2025) · cites this paper as [26]
The cited source says what the claim attributes to it.
In the citing paper
“Early frameworks such as ReAct[26] and Reflexion[14] integrate reasoning and acting within the same loop, while trajectory-tuning methods [2, 22] fine-tune models using expert demonstrations.”
From Learning Hierarchical Procedural Memory for LLM Agents through Bayesian Selection and Contrastive Refinement (2025) · cites this paper as [26]
The cited source says what the claim attributes to it.
In the citing paper
“Large language model (LLM) agents can solve complex, interactive tasks such as web shopping [25] and embodied AI housekeeping [9], by transforming natural-language instructions into sequences of environment actions [26].”
From Learning Hierarchical Procedural Memory for LLM Agents through Bayesian Selection and Contrastive Refinement (2025) · cites this paper as [26]
The cited source says what the claim attributes to it.
In the citing paper
“Personal memory helps the system improve its understanding of user behavior and enhances its personalization capabilities, while system memory can strengthen the system's reasoning ability, such as in approaches like CoT (Chain-of-Thought) [23] and ReAct [24].”
From From Human Memory to AI Memory: A Survey on Memory Mechanisms in the Era of LLMs (2025) · cites this paper as [24]
The cited source says what the claim attributes to it.
In the citing paper
“These agents, powered by LLMs, typically operate in an iterative loop [39, 29], at each turn they reason about the current state, devise a plan, and execute a tool (e.g., read a file, run tests).”
From The Complexity Trap: Simple Observation Masking Is as Efficient as LLM Summarization for Agent Context Management (2025) · cites this paper as [39]
The cited source says what the claim attributes to it.
In the citing paper
“ReAct (Yao et al., 2022) is a novel approach that prompts LLMs to generate both reasoning traces and task-specific actions in an interleaved manner, fostering synergy between the two processes.”
From The AI Hippocampus: How Far are We From Human Memory? (2026) · cites this paper as Yao et al., 2022
The cited source says what the claim attributes to it.
In the citing paper
“In ReAct [230], by leveraging an intuitive prompt, LLMs learn to generate both reasoning paths and task-specific actions alternately when solving a specific task. The execution of specific actions is delegated to corresponding tools, and external feedback obtained from these tools is utilized to validate and guide the reasoning process further.”
From When large language models meet personalization: perspectives of challenges and opportunities (2024) · cites this paper as [230]
The cited source says what the claim attributes to it.
In the citing paper
“Subsequent studies like ToT [228], Plan-and-Solve [229] and ReAct [230] have proposed more advanced techniques for prompt design to assist in guiding LLM to engage in deeper thinking and tool planning.”
From When large language models meet personalization: perspectives of challenges and opportunities (2024) · cites this paper as [230]
The cited source says what the claim attributes to it.
In the citing paper
“ReACT (Yao et al., 2022) integrates reasoning with acting by allowing LLMs to give a proper reason for an action and incorporating environmental feedback for reasoning.”
From Counterfactually Auditable Lifecycle Certification for Autonomous Agents (2023) · cites this paper as Yao et al., 2022
The cited source says what the claim attributes to it.
In the citing paper
“Reasoning-and-acting traces double as short-horizon working memory; 34% absolute gain on ALFWorld.”
From Memory for Autonomous LLM Agents:Mechanisms, Evaluation, and Emerging Frontiers (2026) · cites this paper as Yao et al., 2022
The cited source says what the claim attributes to it.
In the citing paper
“Recent studies on tool-assisted reasoning have shown how AI systems can intertwine reasoning with action selection, allowing agents to select appropriate tools, interpret the returned information, and update subsequent steps accordingly [9].”
From Medical AI Agents for Clinical Decision Support: Viewpoint Using the Planning, Action, Reflection, and Memory (PARM) Analytical Lens (2026) · cites this paper as [9]
The cited source says what the claim attributes to it.
In the citing paper
“More sophisticated RAG methods, which perform multiple steps of retrieval and generation from an LLM, are even able to integrate information across new or updated knowledge elements[38, 64, 72, 78, 88, 90, 92], another crucial aspect of long-term memory systems.”
From HippoRAG: Neurobiologically Inspired Long-Term Memory for Large Language Models (2024) · cites this paper as [90]
The cited source says what the claim attributes to it.
In the citing paper
“which has been shown to improve the quality of reasoning and future actions71,72”
From Evaluation and mitigation of the limitations of large language models in clinical decision-making (2024) · cites this paper as [72]
The cited source says what the claim attributes to it.
In the citing paper
“Both modular-public and triframe/duet incorporate principles from the ReAct framework [46], which interleaves reasoning traces with actions.”
From Measuring AI Ability to Complete Long Software Tasks (2025) · cites this paper as [46]
The cited source says what the claim attributes to it.
In the citing paper
“More promising recent efforts (Yao et al., 2022; Jiao et al., 2024; Qiao et al., 2024b; Brahman et al., 2024) focus on finetuning LLMs on automatically or manually synthesized samples with explicit plans. Unfortunately, LLMs fine-tuned in this manner still struggle to achieve better performance because the plans required by problems within a single task, as well as across tasks, are vast in number”
From iCLP: Large Language Model Reasoning with Implicit Cognition Latent Planning (2025) · cites this paper as Yao et al., 2022
The cited source says what the claim attributes to it.
In the citing paper
“In ReAct [104], the agents are required to answer questions about general knowledge by multiple reasoning steps. They can utilize Wikipedia APIs to obtain external knowledge if they lack information during these steps.”
From A Survey on the Memory Mechanism of Large Language Model-based Agents (2025) · cites this paper as [104]
The cited source says what the claim attributes to it.
In the citing paper
“For instance, accessing external knowledge through Application Programming Interface (API) is a common practice [104, 5].”
From A Survey on the Memory Mechanism of Large Language Model-based Agents (2025) · cites this paper as [104]
The cited source says what the claim attributes to it.
In the citing paper
“Lastly, we note that our QA scores exceed those reported by recent works on few-shot prompting for open-domain QA (ODQA) (Khot et al., 2023;Press et al., 2022;Yao et al., 2022), although a fair apples-to-apples comparison with them isn't possible (cf.Appendix C).”
From Interleaving Retrieval with Chain-of-Thought Reasoning for Knowledge-Intensive Multi-Step Questions (2023) · cites this paper as Yao et al., 2022
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“Previous work introduced non-executable code review and self-reflection (Zhao et al., 2023; Yao et al., 2022; Shinn et al., 2023; Dong et al., 2023). However, they still face challenges in ensuring code executability and runtime correctness.”
From MetaGPT: Meta Programming for A Multi-Agent Collaborative Framework (2023) · cites this paper as Yao et al., 2022
Experimental — accuracy not yet measuredThe check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“IRCoT is SOTA for few-shot multistep ODQA.14”
From Interleaving Retrieval with Chain-of-Thought Reasoning for Knowledge-Intensive Multi-Step Questions (2023) · cites this paper as Yao et al., 2022
Experimental — accuracy not yet measuredIn the citing paper
“although equipped with a broad array of tools compared to other frameworks17, it remains in an experimental stage, thus limiting clinical applicability.”
From Development and validation of an autonomous artificial intelligence agent for clinical decision-making in oncology (2025) · cites this paper as [17]
In the citing paper
“Equipping an LLM with a suite of tools, such as calculators or web search, has proven superiority in tasks that require multistep reasoning and planning17,18.”
From Development and validation of an autonomous artificial intelligence agent for clinical decision-making in oncology (2025) · cites this paper as [17]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ C.4 ALFWORLD · p. 23
“Table 7: An Act prompt on the ALFWorld clean task. No thoughts are provided.”
§ C.4 ALFWORLD · p. 23
“> think: Now I clean a lettuce (1). Next, I need to put it in/on diningtable 1. OK.”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ 3.1 SETUP · p. 4
“or else suggests top-5 similar entities from the Wikipedia search engine”
§ Original · p. 16
“Similar: ['Adam Clayton Powell III', 'Seventh Avenue (Manhattan)', 'Adam Clayton Powell Jr. State Office Building', 'Isabel Washington Powell', 'Adam Powell', 'Adam Clayton Powell (film)', 'Giancarlo Esposito'].”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ C.3 WEBSHOP · p. 22
“Action : think [B078GWRC1J and B078GTKVXY are bright citrus deodorant less then 50 dollars. I can check B078GWRC1J first.”
§ C.3 WEBSHOP · p. 22
“[ B078GTKVXY ] Ginger Fresh Deodorant by Earth Mama | Natural and Safe for Sensitive Skin, Pregnancy and Breastfeeding, Contains Organic Calendula 3-Ounce $10.99”
Citations
Cites
The publisher hasn’t deposited this paper’s reference list.
Research works printed but not linked: 11
- Alan Baddeley. Working memory. Science , 255(5044):556-559, 1992.
- Tom Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared D Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, et al. Language models are few-shot learners. Advances in neural information processing systems , 33:1877-1901, 2020.
- Antonia Creswell, Murray Shanahan, and Irina Higgins. Selection-inference: Exploiting large language models for interpretable logical reasoning, 2022. URL https://arxiv.org/abs/ 2205.09712 .
- Charles Fernyhough. Vygotsky, luria, and the social brain. Self and social regulation: Social interaction and the development of social understanding and executive functions , pp. 56-79, 2010.
- Ehsan Hosseini-Asl, Bryan McCann, Chien-Sheng Wu, Semih Yavuz, and Richard Socher. A simple language model for task-oriented dialogue. Advances in Neural Information Processing Systems , 33:20179-20191, 2020.
- Siddharth Karamcheti, Megha Srivastava, Percy Liang, and Dorsa Sadigh. Lila: Language-informed latent actions. In CoRL , pp. 1379-1390, 2021. URL https://proceedings.mlr.press/ v164/karamcheti22a.html .
- Patrick Lewis, Ethan Perez, Aleksandra Piktus, Fabio Petroni, Vladimir Karpukhin, Naman Goyal, Heinrich Küttler, Mike Lewis, Wen-tau Yih, Tim Rocktäschel, et al. Retrieval-augmented generation for knowledge-intensive nlp tasks. Advances in Neural Information Processing Systems , 33: 9459-9474, 2020.
- Shuang Li, Xavier Puig, Chris Paxton, Yilun Du, Clinton Wang, Linxi Fan, Tao Chen, De-An Huang, Ekin Akyürek, Anima Anandkumar, Jacob Andreas, Igor Mordatch, Antonio Torralba, and Yuke Zhu. Pre-trained language models for interactive decision-making, 2022. URL https: //arxiv.org/abs/2202.01771 .
- Aleksandr Romanovich Luria. Ls vygotsky and the problem of localization of functions. Neuropsychologia , 3(4):387-392, 1965.
- Reiichiro Nakano, Jacob Hilton, Suchir Balaji, Jeff Wu, Long Ouyang, Christina Kim, Christopher Hesse, Shantanu Jain, Vineet Kosaraju, William Saunders, Xu Jiang, Karl Cobbe, Tyna Eloundou, Gretchen Krueger, Kevin Button, Matthew Knight, Benjamin Chess, and John Schulman. Webgpt: Browser-assisted question-answering with human feedback, 2021. URL https://arxiv. org/abs/2112.09332 .
- Scott Reed, Konrad Zolna, Emilio Parisotto, Sergio Gomez Colmenarejo, Alexander Novikov, Gabriel Barth-Maron, Mai Gimenez, Yury Sulsky, Jackie Kay, Jost Tobias Springenberg, Tom Eccles, Jake Bruce, Ali Razavi, Ashley Edwards, Nicolas Heess, Yutian Chen, Raia Hadsell, Oriol Vinyals, Mahyar Bordbar, and Nando de Freitas. A generalist agent, 2022. URL https: //arxiv.org/abs/2205.06175 .
Cited by
Sorted by citations
Items 2,601–2,700 of 5,706
Rodriguez, R., & Syynimaa, N. (2024) · International Conference on Enterprise Information Systems · doi:10.5220/0012735700003690 · Cited by 2
Human-AI Collaborative Taxonomy Construction: A Case Study in Profession-Specific Writing Assistants
Lee, M., Kim, Z. M., Khetan, V., & Kang, D. (2024) · Workshop on Intelligent and Interactive Writing Assistants (In2Writing) · doi:10.1145/3690712.3690726 · Cited by 2
TPE: Towards Better Compositional Reasoning over Cognitive Tools via Multi-persona Collaboration
Wang, H., Wang, H., Wang, L., Hu, M., Wang, R., Xue, B., Huang, Y., & Wong, K. (2024) · Lecture notes in computer science · doi:10.1007/978-981-97-9434-8_22 · Cited by 2
Cognitive Science Society 2024, & Gu, Z. (2024) · eScholarship (California Digital Library) · doi:10.48448/bzqb-wx74 · Cited by 2
Assessing the Limitations of LangChain in Production Environments
Kommuru, M. (2024) · American International Journal of Computer Science and Technology · doi:10.63282/3117-5481/aijcst-v6i4p107 · Cited by 2
Towards Unified Objectives for Self-Reflective AIPreprint
Samwald, M., Praas, R., & Hebenstreit, K. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4446991 · Cited by 2
SurveyLM: A platform to explore emerging value perspectives in augmented language models' behaviorsPreprint
Bickley, S. J., Chan, H. F., Dao, B., Torgler, B., & Tran, S. (2023) · RePEc: Research Papers in Economics · doi:10.48550/arxiv.2308.00521 · Cited by 2
Liu, J., Hu, W., & Zhang, C. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2310.18331 · Cited by 2
Can language agents be alternatives to PPO? A Preliminary Empirical Study On OpenAI GymPreprint
Sheng, J., Huang, Z., Shen, C., Li, W., Hua, Y., Jin, B., Hongyuan Zha, B., & Wang, X. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2312.03290 · Cited by 2
A collection of principles for guiding and evaluating large language modelsPreprint
Hebenstreit, K., Praas, R., & Samwald, M. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2312.10059 · Cited by 2
A Generative AI Assistant to Accelerate Cloud MigrationPreprint
Vaidya, A., Vankayalapati, M. K., Chan, J. W. K., Ibraimoski, S., & Moran, S. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2401.01753 · Cited by 2
RE-GAINS & EnChAnT: Intelligent Tool Manipulation Systems For Enhanced Query ResponsesPreprint
Girhepuje, S., Sajeev, S. S., Jain, P., Sikder, A., Varma, A. R., George, R., Srinivasan, A. G., Kurup, M., Sinha, A., & Mondal, S. S. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2401.15724 · Cited by 2
Accelerating Radio Spectrum Regulation Workflows with Large Language Models (LLMs)Preprint
Ghasemi, A., & Guinand, P. S. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2403.17819 · Cited by 2
Chen, H., Lin, X., & Gong, B. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4795529 · Cited by 2
InfoCon: Concept Discovery with Generative and Discriminative InformativenessPreprint
Liu, R., Luo, Q., & Yang, Y. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2404.10606 · Cited by 2
Unlocking Large Language Model's Planning Capabilities with Maximum Diversity Fine-tuningPreprint
Li, W., Chen, C., & Varakantham, P. R. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2406.10479 · Cited by 2
Input Conditioned Graph Generation for Language AgentsPreprint
Vierling, L., Fu, J., & Chen, K. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2406.11555 · Cited by 2
Large Language Models as Surrogate Models in Evolutionary Algorithms: A Preliminary StudyPreprint
Hao, H., Zhang, X., & Zhou, A. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4870226 · Cited by 2
AutoGRAMS: Autonomous Graphical Agent Modeling SoftwarePreprint
Krause, B., Chen, L., & Kahembwe, E. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2407.10049 · Cited by 2
Coalitions of Large Language Models Increase the Robustness of AI AgentsPreprint
Mangal, P., Mak, C., Kanakis, T., Donovan, T., Braines, D., & Pyzer‐Knapp, E. O. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2408.01380 · Cited by 2
Sakhinana, S. S., Sannidhi, G., & Runkana, V. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2409.00082 · Cited by 2
AutoFeedback: An LLM-based Framework for Efficient and Accurate API Request GenerationPreprint
Liu, H., Liao, J., Feng, D., Xu, K., & Wang, H. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2410.06943 · Cited by 2
LLM-Human Pipeline for Cultural Context Grounding of ConversationsPreprint
Pujari, R., & Goldwasser, D. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2410.13727 · Cited by 2
Enhancing Large Language Models with Domain-Specific Knowledge: The Case in Topological MaterialsPreprint
Xu, H., Zhang, B., Jin, Z., Zhu, T., Wu, Q., & Weng, H. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2409.13732 · Cited by 2
One STEP at a time: Language Agents are Stepwise PlannersPreprint
Nguyen, M., & Shareghi, E. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2411.08432 · Cited by 2
PIANIST: Learning Partially Observable World Models with LLMs for Multi-Agent Decision MakingPreprint
Light, J., Xing, S., Liu, Y., Chen, W., Min, C., Chen, X., Wang, G., Cheng, W., Yue, Y., & Hu, Z. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2411.15998 · Cited by 2
Training Agents with Weakly Supervised Feedback from Large Language ModelsPreprint
Gong, D., Lu, P., Wang, Z., Zhou, M., & He, X. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2411.19547 · Cited by 2
From Simple to Professional: A Combinatorial Controllable Image Captioning AgentPreprint
Wang, X., Diao, M., Li, B., Zhang, H., Liang, K., & Ma, Z. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2412.11025 · Cited by 2
RL-LLM-DT: An Automatic Decision Tree Generation Method Based on RL Evaluation and LLM EnhancementPreprint
Lin, J., Zhao, J. K., Liu, L., Deng, Y., Zhao, Y., Huang, L., Lin, X., Zhou, W., & Li, H. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2412.11417 · Cited by 2
Self-citationXmodel-2 Technical ReportPreprint
Qun, W., Yang, L., Qingquan, L., Zhijiu, Q., & Jiang, L. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2412.19638 · Cited by 2
Shaik, H., & Doboli, A. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2501.00562 · Cited by 3
Large Language Models in Finance: ReasoningPreprint
Alonso, M. N. I. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5048316 · Cited by 2
Text2Struc: Programmatic Crystal Structure Generation with Fine-Tuned Large Language ModelsPreprint
Baibakova, V. (2025) · ChemRxiv · doi:10.26434/chemrxiv-2025-pvgp0-v2 · Cited by 2
KIMAs: A Configurable Knowledge Integrated Multi-Agent SystemPreprint
Li, Z., Wei, F., Xie, Y., Gao, D., Kuang, W., Ma, Z., Qian, B., Li, Y., & Ding, B. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2502.09596 · Cited by 3
Shiinoki, S., Iwama, S., & Ushiba, J. (2025) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2025.06.01.657282 · Cited by 2
GA: A Comprehensive Survey on LLM-based GUI AgentPreprint
Huang, L., Liu, J., Wang, C., Xu, R., Xu, W., Xu, Z., Zhang, Q., Zhang, Y., Fu, K., Gao, L., et al. (2025) · doi:10.36227/techrxiv.175322671.12208812/v1 · Cited by 2
Du, X., Nagy, A. A., Oates, M., Wang, Y., Wang, X., Plasek, J. M., Aronson, S., Lebo, M. S., & Zhou, L. N. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5385545 · Cited by 2
Planet as a Brain: Towards Internet of AgentSites based on AIOS ServerPreprint
Zhang, X., & Zhang, Y. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2504.14411 · Cited by 2
LLM for Comparative Narrative AnalysisPreprint
Kampen, L. L., Villarreal, C. R., Yu, L. L., Karmaker, S., & Feng, D. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2504.08211 · Cited by 2
Zhang, Q., Liao, J., Ying, H., Yi-bo, M., Shen, H., Li, J., Liu, P., Zhang, L., Fang, C., Lee, K., et al. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2505.24354 · Cited by 2
Robot Operation of Home Appliances by Reading User ManualsPreprint
Zhang, J., Zhang, H., Xiao, A., & Hsu, D. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2505.20424 · Cited by 2
Inference Scaled GraphRAG: Improving Multi Hop Question Answering on Knowledge GraphsPreprint
Thompson, T., Lim, S.-H., Liu, P., He, R., & Xu, D. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2506.19967 · Cited by 2
RoE-FND: A Case-Based Reasoning Approach with Dual Verification for Fake News Detection via LLMsPreprint
Yang, Y., Zhou, Y., Zhu, Z., Qian, Z., Zhang, X., & Li, S. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2506.11078 · Cited by 2
Enhancing Computational Cognitive Architectures with LLMs: A Case StudyPreprint
Sun, R. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2509.10972 · Cited by 2
An Exploratory Study of Code Retrieval Techniques in Coding AgentsPreprint
Jain, P. (2025) · Preprints.org · doi:10.20944/preprints202510.0924.v1 · Cited by 2
ACTLLM: Action Consistency Tuned Large Language ModelPreprint
Bi, J., Wen, L. B., Liu, Z., & Xu, C. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2506.21250 · Cited by 2
MCTS-EP: Empowering Embodied Planning with Online Preference OptimizationPreprint
Xu, H., Yu, Z., Tang, Y., Hu, P., Tang, Y., & Dong, H. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2509.17116 · Cited by 2
MADREC: A Multi-Aspect Driven LLM Agent for Explainable and Adaptive RecommendationPreprint
Park, J., & Kim, M. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2510.13371 · Cited by 2
Automatically Generating Rules of Malicious Software Packages via Large Language ModelPreprint
Zhang, X., Chen, H., He, Y., Niu, W., & Li, Y. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2504.17198 · Cited by 2
Agentic LLMs for REST API Test Amplification: A Comparative Study Across Cloud ApplicationsPreprint
Besjes, J., Nooyens, R., Bardakci, T., Beyazıt, M., & Demeyer, S. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2510.27417 · Cited by 2
OncoReason: Structuring Clinical Reasoning in LLMs for Robust and Interpretable Survival PredictionPreprint
Hemadri, R. V., Guruju, G. K., Topollai, K., & Choromanska, A. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2510.17532 · Cited by 2
Responsible Agentic Reasoning and AI Agents: A Critical SurveyPreprint
Raza, S., Sapkota, R., Karkee, M., & Emmanouilidis, C. (2025) · doi:10.36227/techrxiv.175735299.97215847/v2 · Cited by 2
The Role of Reinforcement Learning in Large Language Models: A SurveyPreprint
Liu, L. (2025) · doi:10.36227/techrxiv.176300471.10070244/v1 · Cited by 2
Ni, Y., Zhu, L., & Li, S. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2511.08649 · Cited by 2
Reflect before Act: Proactive Error Correction in Language ModelsPreprint
Zeng, Q., Rajkumar, S., Wang, D., Gyanchandani, N., & Yan, W. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2509.18607 · Cited by 2
AutoMaAS: Self-Evolving Multi-Agent Architecture Search for Large Language ModelsPreprint
Ma, B., Li, H., Hu, Z., Gui, X., Liu, L., & Liu, S. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2510.02669 · Cited by 2
Li, Y., Galimov, A., Ganapaneni, M. D., Thejaswi, P., De, M., Kumar, P., & Potdar, S. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2510.20098 · Cited by 2
Operationalizing CaMeL: Strengthening LLM Defenses for Enterprise DeploymentPreprint
Tallam, K., & Miller, E. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2505.22852 · Cited by 2
Private, Verifiable, and Auditable AI SystemsPreprint
South, T. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2509.00085 · Cited by 2
Language and Experience: A Computational Model of Social Learning in Complex TasksPreprint
Colas, C., Mills, T., Prystawski, B., Tessler, M. H., Goodman, N. D., Andreas, J., & Tenenbaum, J. B. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2509.00074 · Cited by 2
On the Limits of Innate Planning in Large Language ModelsPreprint
Schepanowski, C., & Ling, C. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2511.21591 · Cited by 2
GraphTrafficGPT: Enhancing Traffic Management Through Graph-Based AI Agent CoordinationPreprint
Taleb, N. R. M., Rezaei, A., Patel, R. A., & Sookhak, M. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2507.13511 · Cited by 2
Adaptive Multi-Agent Reasoning via Automated Workflow GenerationPreprint
Sami, H., Islam, M. A., Gaillardon, P., & Tenace, V. (2025) · arXiv (Cornell University) · Cited by 2
Thinking About Thinking: SAGE-nano's Inverse Reasoning for Self-Aware Language ModelsPreprint
Jha, B., Paudel, F., Puri, U., Zhang, Y., Donghyuk, C., & Wang, J. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2507.00092 · Cited by 2
WebArxiv: A Reproducible Benchmark for Evaluating Multimodal Web Agents on arXiv TasksPreprint
Sun, Z., Shi, Z., & Chen, L. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2507.00938 · Cited by 2
INSIGHT: An Interpretable Neural Vision-Language Framework for Reasoning of Generative ArtifactsPreprint
Bagaria, A. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2511.22351 · Cited by 2
Sun, N., Mao, B., Li, Y., Wang, C., Guo, D., & Liu, H. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2512.00797 · Cited by 2
Benchmarking LLM Agents for Wealth-Management WorkflowsPreprint
Milsom, R. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2512.02230 · Cited by 2
Cerebrum (AIOS SDK): A Platform for Agent Development, Deployment, Distribution, and DiscoveryPreprint
Rama, B., Mei, K., & Zhang, Y. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2503.11444 · Cited by 2
PRM-Free Security Alignment of Large Models via Red Teaming and Adversarial TrainingPreprint
Du, P. (2025) · arXiv (Cornell University) · Cited by 2
Evaluating The Architecture Of Large Language Model-Based AgentsPreprint
Lu, Q., Zhao, D., Liu, Y., Zhang, H., Zhu, L., Xu, X., Shi, A., & Tan, T. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5017297 · Cited by 2
Polymath: A Self-Optimizing Agent with Dynamic Hierarchical WorkflowPreprint
Ho, C.-T., Gong, J., Yao, X., Bai, Y., Akkur, A. B., & Ren, H. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2508.02959 · Cited by 2
Large Language Models Could Be Rote LearnersPreprint
Xu, Y., Hu, R., Ying, H., Wu, J., Shi, X., & Lin, W. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2504.08300 · Cited by 2
RePanda: Pandas-powered Tabular Verification and ReasoningPreprint
Chegini, A. M., Rezaei, K., Eghbal-zadeh, H., & Feizi, S. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2503.11921 · Cited by 2
Knowledge Protocol Engineering: A New Paradigm for AI in Domain-Specific Knowledge WorkPreprint
Zhang, G. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2507.02760 · Cited by 2
Learning to Plan Before Answering: Self-Teaching LLMs to Learn Abstract Plans for Problem SolvingPreprint
Zhang, J., Sung, F., Yang, Z., Gao, Y., & Zhang, C. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2505.00031 · Cited by 2
Reddy, S., Khan, K., Patil, R., Chakraborty, A., Khan, F. A., Kulkarni, S., Verma, A., & Singh, N. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2508.10426 · Cited by 2
Malmqvist, L. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2505.07846 · Cited by 2
Feng, Y., Zhang, P., Xiao, G., Ding, L., & Meng, L. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2503.14251 · Cited by 2
A Novel Architecture for Symbolic Reasoning with Decision Trees and LLM AgentsPreprint
Kiruluta, A. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2508.05311 · Cited by 2
Reinforced Language Models for Sequential Decision MakingPreprint
Dilkes, J., Yazdanpanah, V., & Stein, S. (2025) · ePrints Soton (University of Southampton) · doi:10.48550/arxiv.2508.10839 · Cited by 2
Towards Reliable Multi-Agent Systems for Marketing Applications via Reflection, Memory, and PlanningPreprint
Flores, L. J. Y., Shen, J., & Gu, G. (2025) · arXiv (Cornell University) · Cited by 2
Omne-R1: Learning to Reason with Memory for Multi-hop Question AnsweringPreprint
Liu, B., Ji, F., Nan, J., Zhao, H., Chen, W., Xu, S., & Zhou, X. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2508.17330 · Cited by 2
Your AI Bosses Are Still Prejudiced: The Emergence of Stereotypes in LLM-Based Multi-Agent SystemsPreprint
Guo, J., & Xu, Y. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2508.19919 · Cited by 2
Orchid: Orchestrating Context Across Creative Workflows with Generative AIPreprint
Palani, S., & Ramos, G. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2508.19517 · Cited by 2
Haupt, J., Lu, Q., Shen, Y., Chen, J., Dong, Y., McCreary, D., Akçakaya, M., & Giannakis, G. B. (2026) · IEEE Signal Processing Magazine · doi:10.1109/msp.2025.3600846 · Cited by 2
Explore-Execute Chain: Towards an Efficient Structured Reasoning ParadigmPreprint
Yang, K., Zhang, T., Shah, R., Yang, K., Ma, Q., Liu, D., & Lamb, A. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2509.23946 · Cited by 2
Automated Detection of Visual Attribute Reliance with a Self-Reflective AgentPreprint
Li, C., Camuñas, J. L., Touchet, J., Andreas, J., Lapedriza, À., Torralba, A. B., & Shaham, T. R. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2510.21704 · Cited by 2
Reinforcement Learning from Compiler and Language Server FeedbackPreprint
Zhang, Y., & Contributors, L. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2510.22907 · Cited by 2
LLMs as Firmware Experts: A Runtime-Grown Tree-of-Agents FrameworkPreprint
Zhang, X., Chen, Z., Wang, H., & Li, Q. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2511.18438 · Cited by 2
iSHIFT: Lightweight Slow-Fast GUI Agent with Adaptive PerceptionPreprint
Mehrotra, S., Rebbapragada, S., Bonthu, M. H. R., & Balasubramanian, V. N. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2512.22009 · Cited by 2
Adam, A. M. I. (2026) · Preprints.org · doi:10.20944/preprints202601.0038.v1 · Cited by 2
Structured Decomposition for LLM Reasoning: Cross-Domain Validation and Semantic Web IntegrationPreprint
Sadowski, A., & Chudziak, J. A. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2601.01609 · Cited by 2
Iyer, V., Bobadilla, L., & Iyengar, S. S. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2601.06779 · Cited by 2
State Drift in Language-Conditioned Autonomous Agents: A Failure Mode of Long-Horizon ReasoningPreprint
Singh, S. K. (2026) · Preprints.org · doi:10.20944/preprints202601.0910.v1 · Cited by 2
LLMOrbit: A Circular Taxonomy of Large Language Models -From Scaling Walls to Agentic AI SystemsPreprint
Patro, B. N., & Agneeswaran, V. S. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2601.14053 · Cited by 2
Multi-Agent Constraint Factorization Reveals Latent Invariant Solution StructurePreprint
Scofield, C. L. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2601.15077 · Cited by 2
Jailbreaks on Vision Language Model via Multimodal ReasoningPreprint
Noheria, A., & Yao, Y. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2601.22398 · Cited by 2
Chen, J., Cheng, F., Han, S., & Kešelj, V. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2602.02863 · Cited by 2
Reliable and Responsible Foundation Models: A Comprehensive SurveyPreprint
Yang, X., Han, J., Bommasani, R., Luo, J., Qu, W., Zhou, W., Bibi, A., Wang, X., Yoon, J., Stengel-Eskin, E., et al. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2602.08145 · Cited by 2
Metadata
- Authors
- Yao, S., Zhao, J., Yu, D., Du, N., Shafran, I., Narasimhan, K., & Cao, Y.
- Affiliations
- Princeton University (US)
- Google (United States) (US)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2022
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 2210.03629
- OpenAlex
- W4304195432
- Semantic Scholar
- 99832586d55f540f603637e458a292406a0ed75d
- Cited by
- 608
- References
- 0
- Citations by year
- 2026: 130 · 2025: 222 · 2024: 161 · 2023: 95
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University) (cc-by)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Physical Sciences › Engineering › Safety, Risk, Reliability and Quality › Safety Systems Engineering in Autonomy
- Keywords
- autonomous AI agents, phase separation, accountability, failure modes, sandboxing, human-in-the-loop, AI risk management, AI governance
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-11-08, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-11-08 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
