The DOI matches its DataCite record; 27 of the 27 references it cites were found in a registry or an index; 6 of the 22 sources its claims cite were checked for support.
ReAct: Synergizing Reasoning and Acting in Language Models
Open accessAbstract
Autonomous AI agents in business deployments exhibit a recurring failure mode: when an incident occurs, responsibility cannot be redirected to a separable contributor. The dominant discourse treats this as a single phenomenon, addressed by sandboxing, human-in-the-loop overload, or what Elish (2019) named the moral crumple zone. This paper argues the phenomenon is two architecturally distinct failure modes that have been conflated, and that the conflation is sustained by a missing positive name and a missing time-axis. The paper introduces two contributions. First, a four-quadrant decomposition of business AI work — along the axes of deterministic vs semantic-judgment and pre-defined vs exploratory — yields a positive name for the cell most current LLM applications occupy: the LLM Workflow Quadrant. The quadrant is defined by a single load-bearing property: the path is decided in advance by humans or by code, and the LLM is called as a single bounded step within that path; the property divides naturally into a conversational sub-form (specialized chat agents) and a batch sub-form (single-purpose LLM functions inside deterministic pipelines). The decomposition distinguishes principled from artificial redirect impossibility: the former intrinsic to autonomous loops, the latter the product of routing workflow work through autonomous-loop architecture by elimination, with four downstream symptoms (the RPA exception-handling bottleneck, the sandbox-strength demand, the structural distortion of human-in-the-loop, and the dissolution of the accountability chain at postmortem). Second, a Phase Separation axis (design vs operation), independent of Quadrant, surfaces a Phase-crossing decision — recorded at deployment time, in one sentence — required when an autonomous-loop component is placed in the operation phase. The Phase axis descends recursively to skill-design granularity, where the Quadrant 3 ↔ Quadrant 4 boundary is a continuous gradient on which model capability is downstream of phase, not the primary lever. The consequence is procedural rather than architectural: deployments make the Phase-crossing decision explicit, designate a pre-named gap-bearer for principled-impossibility placements, and route artificial-impossibility cases to re-architecture. The framework complements existing AI risk-management and management-system standards by recording the judgment layer they presuppose. Both rules are stated as experimental; the open questions are the research agenda.
Overview
AI snapshot
Written from the paper’s full text.
TL;DR
ReAct prompts large language models to interleave verbal reasoning traces with task-specific actions, allowing reasoning to guide acting and actions to gather external information. Across question answering, fact verification, and interactive decision-making benchmarks, ReAct improves grounding and performance over act-only baselines and combines well with chain-of-thought self-consistency.
Key findings
- On HotpotQA and Fever with PaLM-540B, ReAct reaches 27.4 EM and 60.9 Acc, versus Act at 25.7 EM and 58.9 Acc; CoT reaches 29.4 EM and 56.3 Acc. The best combinations are ReAct→CoT-SC at 35.1 EM on HotpotQA and CoT-SC→ReAct at 64.6 Acc on Fever.
- On ALFWorld, the best ReAct trial achieves 71% average success rate, versus best Act 45% and BUTLER 37%; even the worst ReAct trial at 48% beats the best trial of both baselines. ReAct’s relative gain over Act ranges from 33% to 90%, averaging 62%.
- On WebShop, ReAct scores 66.6 with 40.0 success rate, versus Act 62.3/30.1, IL 59.9/29.1, and IL+RL 62.4/28.7, an absolute 10% improvement over the previous best success rate; human experts score 82.1/59.6.
- Human analysis of 200 HotpotQA trajectories found CoT hallucination made up 56% of its failures, while ReAct had 0% hallucination failures but 47% reasoning errors and 23% search-result errors; CoT had 16% reasoning errors.
Methods
- ReAct augments the action space with language thoughts, prompting a frozen PaLM-540B with few-shot human trajectories of interleaved thoughts, actions, and observations; thoughts are dense for QA/fact verification and sparse for decision-making tasks.
- Evaluated on HotpotQA, Fever, ALFWorld, and WebShop, using a Wikipedia API with search, lookup, and finish actions; baselines include Standard, CoT, CoT-SC, and Act, plus ReAct↔CoT-SC combinations.
- Also finetuned PaLM-8B/62B on 3,000 correct ReAct trajectories; ALFWorld used 134 unseen evaluation games, WebShop used 500 test instructions, and HotpotQA/Fever used EM/accuracy.
Limitations
- The paper states that complex tasks with large action spaces require more demonstrations, which can exceed in-context input limits; finetuning is initially promising but needs more high-quality human annotations; PaLM is not openly accessible.
- The paper reports that ReAct lags CoT on HotpotQA (27.4 vs. 29.4 EM), has higher reasoning-error rate than CoT (47% vs. 16%), can repetitively loop, and suffers when search returns noninformative results (23% of error cases).
- The text makes evident that prompting methods remain far from supervised SoTA on HotpotQA/Fever (67.5 EM, 89.5 Acc) and from human experts on WebShop (82.1 score, 59.6 SR), and that the Wikipedia action space is weaker than state-of-the-art retrievers.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
46 Own result · 30 Own interpretation · 16 No basis given · 8 Sources not found · 5 Partly supported · 1 Supported · 1 Own method · accuracy not yet measured
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Therefore, better incorporation of reasoning abilities might benefit recent Internet-augmented language models (Nakano et al., 2021; Lazaridou et al., 2022; Shuster et al., 2022a) for up-to-date task solving.”
What the sources say
- Not matchedcites Nakano et al., 2021
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Supportedcites Lazaridou et al., 2022 source
The Introduction (p. 1) describes this paper’s Internet-augmented model as using web information for up-to-date question answering, so the citation identifies an example of the kind of model named in the sentence. The scaling analysis (p. 7) also reports that retrieval cannot compensate for a general lack of reasoning abilities, consistent with the citing authors’ suggestion that better reasoning might help. (LLM, conf=0.90)
- Not matchedcites Shuster et al., 2022a
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
hedgedconditionalSingle case- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Not matched
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“PaLM-62B finetuned ReAct outperforming all 540B prompting methods”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“With additional sparse reasoning, ReAct achieves significantly better performance, with an absolute 10% improvement over the previous best success rate.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“PaLM-8B finetuned ReAct outperforming all PaLM-62B prompting methods”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“On Webshop, one-shot Act prompting already performs on par with IL and IL+RL methods.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“and make up its major failure mode (56%)”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“On ALFWorld, the best ReAct trial achieves an average success rate of 71%, significantly outperforming the best Act (45%) and BUTLER (37%) trials.”
boosteddirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Qualitatively, we observed that ReAct-IM often made mistakes in identifying when subgoals were finished, or what the next subgoal should be, due to a lack of highlevel goal decomposition.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“ReAct outperforms CoT on Fever (60.9 vs. 56.3)”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“reaching CoT-SC performance with 21 samples using merely 3-5 samples”
plaindirectn = 21- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Probably not a substantial claim. 28
- It may state two separate claims as one. 36
- The quote only partly states this claim. 2
Every source the paper cites for this claim was checked and supports it.
In the paper
“In SayCan, LLMs were prompted to directly predict possible actions a robot can take, which is then reranked by an affordance model grounded on the visual environments for final prediction.”
What the sources say
- Supportedcites Ahn et al., 2022 source
Section 3 (pp. 3–4) says SayCan prompts an LLM to score candidate robot skills, then combines those scores with affordance values to select a skill. Figure 2 (p. 4) describes affordance values based on the robot’s current observation. The claim’s “reranked” describes this combined scoring, though the LLM scores a fixed set of skills rather than generating unrestricted actions. (LLM, conf=0.90)
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“WebGPT (Nakano et al., 2021) uses an LM to interact with web browsers, navigate through web pages, and infer answers to complicated questions from ELI5 (Fan et al., 2019).”
What the sources say
- Not matchedcites Nakano et al., 2021
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Supportedcites Fan et al., 2019 source
The citation to Fan et al. identifies ELI5 as the source of the questions, not as evidence for how WebGPT works. The Abstract and Introduction describe ELI5 as a dataset of complex, open-ended questions requiring long-form answers. (LLM, conf=0.92)
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
- Not matched
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Perhaps most relevant to ReAct in this respect are SayCan (Ahn et al., 2022) and Inner Monologue (Huang et al., 2022b), which use LLMs for robotic action planning and decision making.”
What the sources say
- Supportedcites Ahn et al., 2022 source
The Introduction (p. 2) says SayCan uses an LLM to determine useful actions for a robot’s high-level goal and combines it with affordance functions to determine what the robot can execute. Related Work (p. 11) explicitly describes its use of an LLM to interpret instructions and plan how to execute them. The separate claim about Inner Monologue is attributed to Huang et al., not this source. (LLM, conf=0.94)
- Not matchedcites Huang et al., 2022b
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“We also note that leveraging language as semantically-rich inputs in the process of interactive decision making has been shown to be successful under other settings (Abramson et al., 2020; Karamcheti et al., 2021; Huang et al., 2022a; Li et al., 2022).”
What the sources say
- Supportedcites Abramson et al., 2020 source
Section 2.5.4 (p. 18) describes agents receiving natural-language instructions and acting on them in an interactive setting. Section 3.6 (p. 29) reports that the best agent successfully performed both sides of these interactions in 39.58% of evaluated episodes, supporting the broad claim of success in this setting. (LLM, conf=0.90)
- Not matchedcites Karamcheti et al., 2021
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Not matchedcites Huang et al., 2022a
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Perhaps the most well-known work of using LLMs for reasoning is Chain-of-Thought (CoT) (Wei et al., 2022), which reveals the ability of LLMs to formulate their own 'thinking procedure' for problem solving.”
What the sources say
- Partly supportedcites Wei et al., 2022 sourceExperimental — accuracy not yet measured
Section 2 (pp. 2–3) says models can generate intermediate reasoning steps to solve problems, which supports the description of a step-by-step ‘thinking procedure.’ But it specifies that this ability is shown in sufficiently large models when chain-of-thought demonstrations are provided in few-shot prompts; the claim leaves those conditions out and could imply that models formulate the procedure unaided. (LLM, conf=0.84)
boosteddirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
- Partly supported
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“As can be seen in Table 3, ReAct substantially outperforms IM-style prompting ( ReAct-IM ) (71 vs. 53 overall success rate), with consistent advantages on five out of six tasks.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“ReAct outperforms Act on both ALFWorld (Table 3) and Webshop (Table 4).”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Through a diverse set of experiments on multi-hop question-answering, fact checking, and interactive decision-making tasks, we show that ReAct leads to superior performance with interpretable decision traces.”
boosteddirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Qualitatively, we saw that, without any thoughts at all, Act fails to correctly decompose goals into smaller subgoals, or loses track of the current state of the environment.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“We also find some HotpotQA questions may contain outdated answer labels”
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“ReAct is better than Act on both tasks”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“We find more examples do not improve performance.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“they both significantly and consistently outperform CoT-SC across different number of samples”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Moreover, the advantage of ReAct over Act is consistent across six controlled trials, with relative performance gain ranging from 33% to 90% and averaging 62%.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Of all trajectories with correct final answers, those with 7 steps on HotpotQA and 5 steps on FEVER only take up 0.84% and 1.33% respectively.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Failure: Search error”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Only ReAct is able to retrieve up-to-date information from the Internet and provide a reasonable answer.”
plaindirectSingle case- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Failure: Reasoning error”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Success: False positive”
plain- Asserted: fails — The authors may not put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The authors may not put it forward as true. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“ReAct is able to correctly find the knife, clean it, and then place it on a countertop.”
plaindirectSingle case- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Act is able to correctly find the knife”
plainSingle case- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. The quote only partly states this claim.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Failure: Label ambiguity”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Figure 5 shows that by simply removing a hallucinating sentence in Act 17 and adding some hints in Act 23, ReAct can be made to change its behavior drastically to align with these human thought edits and succeed in the task.”
plaindirectSingle case- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Failure: Hallucination”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“ReAct-IM is able to correctly find the knife”
plainSingle case- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The LLM then gets stuck trying to place this knife on a countertop.”
plainSingle case- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Success: True positive”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“We find ReAct and Act methods generally benefit from more training steps (and more training data), while Standard and CoT methods degrade soon after finetuning.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“which allows the model to perform dynamic reasoning to create, maintain, and adjust high-level plans for acting (reason to act), while also interact with the external environments (e.g. Wikipedia) to incorporate additional information into reasoning (act to reason).”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
None of the sources cited for this claim could be matched to a paper in Crossref, so there is nothing to check it against.
In the paper
“Unlike ReAct , they do not explicitly consider the reasoning procedure either, and also relies on expensive datasets and human feedback collections for policy learning.”
What the sources say
- Not matchedcites Shuster et al., 2022b
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Not matchedcites Glaese et al., 2022
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Not matchedcites Hosseini-Asl et al., 2020
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
- Not matched
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“by interacting with a Wikipedia API, ReAct is able to retrieve information to support reasoning, while also use reasoning to target what to retrieve next, demonstrating a synergy of reasoning and acting.”
boosteddirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
In the paper
“To increase reproducibility, we have included all used prompts in Appendix C, additional experiments using GPT-3 (Brown et al., 2020) in Appendix A.1, and associated GPT-3 ReAct prompting code at https://anonymous.4open.science/r/ReAct-2268/ .”
What the sources say
- Not matchedcites Brown et al., 2020
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
- Not matched
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Fever claims for SUPPORTS/REFUTES might only differ by a slight amount (see Appendix D.1), so acting to retrieve accurate and up-to-date knowledge is vital.”
hedgedconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
In the paper
“Inner Monologue made further improvements by adding the eponymous 'inner monologue”
What the sources say
- Not matchedcites Huang et al., 2022b
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
- Not matched
In the paper
“In comparison to ReAct , WebGPT does not explicitly model the thinking and reasoning procedure, instead rely on expensive human feedback for reinforcement learning.”
What the sources say
- Not matchedcites Nakano et al., 2021
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
- Not matched
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“as the language space L is unlimited, learning in this augmented action space is difficult and requires strong language priors.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper may give no reason why it holds. It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“the combination of reasoning and acting also contributes to model interpretability, trustworthiness, and diagnosability across all domains”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: unclear — It is unclear whether it could be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“In contrast, ReAct learns a policy in a much cheaper way, since the decision making process only requires language description of the reasoning procedure.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“We note that this action space mostly can only retrieve a small part of a passage based on exact passage name, which is significantly weaker than state-of-theart lexical or neural retrievers.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper may give no reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Despite the simplicity of our method, complex tasks with large action spaces require more demonstrations to learn well, which unfortunately can easily go beyond the input length limit of in-context learning.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper may give no reason why it holds. It may state two separate claims as one.
In the paper
“To our knowledge, Inner Monologue is the first work that demonstrates such a closed-loop system, which ReAct builds on.”
What the sources say
- Not matchedcites Huang et al., 2022b
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
hedgeddirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
- Not matched
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“as humans can readily distinguish information from model's internal knowledge versus external environments, as well as inspect reasoning traces to understand the decision basis of model actions.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper may give no reason why it holds. It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“generating human-like task-solving trajectories that are more interpretable than baselines without reasoning traces”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“derails the model reasoning and gives it a hard time to recover and reformulate thoughts”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“we observe that the problem solving process demonstrated by ReAct is more factual and grounded, whereas CoT is more accurate in formulating reasoning structure but can easily suffer from hallucinated facts or thoughts.”
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“Our experiments minimize such risks by limiting the interactions to specific websites (Wikipedia or WebShop) that are free of private information, without any dangerous actions in the action space design (i.e. models cannot really buy products on WebShop the research benchmark, or edit Wikipedia).”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“In contrast to these methods, ReAct performs more than just isolated, fixed reasoning, and integrates model actions and their corresponding observations into a coherent stream of inputs for the model to reason more accurately and tackle tasks beyond reasoning (e.g. interactive decision making).”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: unclear — It is unclear why the paper says it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“In contrast, the reasoning traces in ReAct for decision making is flexible and sparse, allowing diverse reasoning types (see Section 2) to be induced for different tasks.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“demonstrating the value of reasoning to guide acting”
boosteddirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The quote only partly states this claim.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“In ReAct , this sequence of subgoals would be concretely captured by each thought.”
hedgeddirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
In the paper
“This paradigm is also more than human dialogue to update the goal or subgoal as in Huang et al. (2022b) - while editing ReAct thoughts can do these, it can also modify the model's internal belief, reasoning styles, or anything the flexible thought space supports, for better task solving.”
What the sources say
- Not matchedcites Huang et al. (2022b)
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
plaindirectSingle case- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
- Not matched
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“From a human perspective, solving such a task becomes significantly easier, from typing tens of actions to only editing a couple of thoughts, which enables new forms of human-machine collaboration.”
plaindirectSingle case- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“With ReAct , an existing thought would have concretely identified that the knife had been taken, and that the next subgoal was to go to a sinkbasin to clean it.”
hedgeddirectSingle case- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“We note that such a policy edit on-the-go is difficult for Act and previous RL methods, as a human cannot change the model parameters, and changing a few actions might not edit the rest of the model behavior.”
hedgeddirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source doesn’t support the claim as written.
In the citing paper
“ReAct would require 16-20 LLM calls for this task: reasoning before each action (8 actions × 2 calls/action for 'thought' and 'action'), plus initial planning and reflection. MACLA reduces this to 2 calls by retrieving learned procedures, representing an > 85% reduction in LLM inference overhead.”
From Learning Hierarchical Procedural Memory for LLM Agents through Bayesian Selection and Contrastive Refinement (2025) · cites this paper as [26]
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“All of these new use cases require multiple, often dependent, LLM generation calls, showing a trend of using multi-call structures to complete complex tasks [57, 21].”
From SGLang: Efficient Execution of Structured Language Model Programs (2023) · cites this paper as [57]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Recent work has equipped dialogue agents with the ability to use tools such as calculators and calendars, and to consult external websites 24,25 .”
From Role play with large language models (2023) · cites this paper as [25]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“In systems designed for long-horizon settings, a common approach is to append all past observations, actions, and thoughts to the context at every turn [55, 61].”
From MEM1: Learning to Synergize Memory and Reasoning for Efficient Long-Horizon Agents (2025) · cites this paper as [61]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Early LLM agents used prompt-based planning [26] and selfcritique [15], but lack persistent 'how-to' procedures - when tasks are similar but not identical, agents must re-plan from scratch, increasing cost and latency.”
From Learning Hierarchical Procedural Memory for LLM Agents through Bayesian Selection and Contrastive Refinement (2025) · cites this paper as [26]
Experimental — accuracy not yet measured
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“(3) inferior planning and reasoning : existing works adopted either CoT (Wei et al., 2023) or ReACT (Yao et al., 2022) for model reasoning, which cannot fully elicit the capabilities stored in LLMs and thus fail to handle complex instructions.”
From Counterfactually Auditable Lifecycle Certification for Autonomous Agents (2023) · cites this paper as Yao et al., 2022
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“LLM-based approaches may assist by summarizing large-scale interaction logs, extracting structured event representations, or generating hypotheses about plausible attack paths; recent work on tool-augmented language models and automated log analysis suggests their usefulness in triage and forensic workflows (Schick et al., 2023;Solomon et al., 2026;Yao et al., 2022).”
From Open Challenges in Multi-Agent Security: Towards Secure Systems of Interacting AI Agents (2025) · cites this paper as Yao et al., 2022
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Incorporating user profiles and memory modules into agent systems allows them to display a range of behaviors similar to humans, based on their current observations [33].”
From Generative Agents Navigating Digital Libraries (2025) · cites this paper as [33]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Most modern agentic workloads follow the ReAct -agent loop [61], alternating between a reasoning step where the LLM interprets context and outputs thoughts, and an action step where it invokes external tools.”
From Continuum: Efficient and Robust Multi-Turn LLM Agent Scheduling with KV Cache Time-to-Live (2025) · cites this paper as [61]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“To that end, we first test ReAct (Yao et al., 2022), a multi-step agent for tool use, which is implemented as a built-in module in DSPy.”
From DSPy: Compiling Declarative Language Model Calls into Self-Improving Pipelines (2023) · cites this paper as Yao et al., 2022
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“| Prompt 3: ReAct | Yao et al. (2022) | 593 | 3889 |”
From DSPy: Compiling Declarative Language Model Calls into Self-Improving Pipelines (2023) · cites this paper as Yao et al. (2022)
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Yao et al. (2022) achieve 27.4% EM using ReAct with PaLM-540B and 30.8 with text-davinci-002 , with a tool giving it the ability for search using a Wikipedia API. They push their PaLM results to 35.1% EM by applying an additional CoT step with selfconsistency, which may resemble our ensemble approach in the sense of aggregating multiple answers.”
From DSPy: Compiling Declarative Language Model Calls into Self-Improving Pipelines (2023) · cites this paper as Yao et al. (2022)
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“These agents not only communicate and coordinate with one another but also interface with external resources such as tools, APIs, and structured data sources [24, 16].”
From Collaborative Memory: Multi-User Memory Sharing in LLM Agents with Dynamic Access Control (2025) · cites this paper as [24]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“One preliminary approach to achieving this goal involves prompting LLMs to generate explicit plans using their internal knowledge (Yao et al., 2022; Wang et al., 2023a; Sun et al., 2023). However, this method is limited by errors in the plans, which arise from the inevitable hallucinations of LLMs.”
From iCLP: Large Language Model Reasoning with Implicit Cognition Latent Planning (2025) · cites this paper as Yao et al., 2022
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Guiding thought generation with explicit plans (Yao et al., 2022), which are step-wise and question-specific reasoning instructions, is crucial for improving practical usage and reliability of LLMs (Huang et al., 2024; 2022).”
From iCLP: Large Language Model Reasoning with Implicit Cognition Latent Planning (2025) · cites this paper as Yao et al., 2022
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Current efforts such as ReACT (Yao et al., 2022) and PlaSma (Brahman et al., 2024) that rely on explicit plans face a key limitation: specific and question-oriented instructions often fail to generalize well across diverse problems, and the detailed content involved is prone to errors, making it difficult for the LLM to learn effectively.”
From iCLP: Large Language Model Reasoning with Implicit Cognition Latent Planning (2025) · cites this paper as Yao et al., 2022
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“ReAct (Yao et al., 2022) prompts LLMs to produce reasoning and action traces where actions are calls to a Wikipedia API to return the summary for a given Wikipedia page title.”
From Interleaving Retrieval with Chain-of-Thought Reasoning for Knowledge-Intensive Multi-Step Questions (2023) · cites this paper as Yao et al., 2022
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Large Language Model (LLM)-based agents increasingly rely on external tools to complete tasks beyond text generation (Yao et al., 2022).”
From MemMorph: Tool Hijacking in LLM Agents via Memory Poisoning (2026) · cites this paper as Yao et al., 2022
The cited source says what the claim attributes to it.
In the citing paper
“ReAct Agent (Yao et al., 2022).Maintains full interaction history with a ReAct-style reasoning-acting loop.”
From Git Context Controller: Manage the Context of LLM-based Agents like Git (2025) · cites this paper as Yao et al., 2022
The cited source says what the claim attributes to it.
In the citing paper
“We use ReAct [30] as the action generator as Yao et al. [30] has shown success in long trajectory decisionmaking using explicit intermediate thoughts.”
From Reflexion: Language Agents with Verbal Reinforcement Learning (2023) · cites this paper as [30]
The cited source says what the claim attributes to it.
In the citing paper
“ReAct [29] uses chain-of-thought prompting [46] by generating both reasoning traces and action plans with LLMs.”
From Voyager: An Open-Ended Embodied Agent with Large Language Models (2023) · cites this paper as [29]
The cited source says what the claim attributes to it.
In the citing paper
“A promising design paradigm for AI agents [65] is to combine an LLM with tools that interact with a broader environment [14, 35, 40, 47, 51, 53, 55, 69].”
From AgentDojo: A Dynamic Environment to Evaluate Prompt Injection Attacks and Defenses for LLM Agents (2024) · cites this paper as [69]
The cited source says what the claim attributes to it.
In the citing paper
“Frameworks integrating reasoning with action selection have shown that models can iteratively parse complex goals, call appropriate tools, and interpret results to inform further reasoning [9].”
From Medical AI Agents for Clinical Decision Support: Viewpoint Using the Planning, Action, Reflection, and Memory (PARM) Analytical Lens (2026) · cites this paper as [9]
The cited source says what the claim attributes to it.
In the citing paper
“ReAct interleaves language reasoning with environment actions [16], while Toolformer demonstrates self-supervised learning of when and how to call external APIs [17].”
From HELIX: Model-Harness Co-evolution for Recursive Self-Improvement (2026) · cites this paper as [16]
The cited source says what the claim attributes to it.
In the citing paper
“advancements in reasoning and decision-making in LLMs have significantly enhanced agent autonomy (52; 58; 36; 45).”
From Project Sid: Many-agent simulations toward AI civilization (2024) · cites this paper as [58]
The cited source says what the claim attributes to it.
In the citing paper
“Early LLM agents used prompt-based planning [26] and selfcritique [15], but lack persistent 'how-to' procedures - when tasks are similar but not identical, agents must re-plan from scratch, increasing cost and latency.”
From Learning Hierarchical Procedural Memory for LLM Agents through Bayesian Selection and Contrastive Refinement (2025) · cites this paper as [26]
The cited source says what the claim attributes to it.
In the citing paper
“Early frameworks such as ReAct[26] and Reflexion[14] integrate reasoning and acting within the same loop, while trajectory-tuning methods [2, 22] fine-tune models using expert demonstrations.”
From Learning Hierarchical Procedural Memory for LLM Agents through Bayesian Selection and Contrastive Refinement (2025) · cites this paper as [26]
The cited source says what the claim attributes to it.
In the citing paper
“Large language model (LLM) agents can solve complex, interactive tasks such as web shopping [25] and embodied AI housekeeping [9], by transforming natural-language instructions into sequences of environment actions [26].”
From Learning Hierarchical Procedural Memory for LLM Agents through Bayesian Selection and Contrastive Refinement (2025) · cites this paper as [26]
The cited source says what the claim attributes to it.
In the citing paper
“Personal memory helps the system improve its understanding of user behavior and enhances its personalization capabilities, while system memory can strengthen the system's reasoning ability, such as in approaches like CoT (Chain-of-Thought) [23] and ReAct [24].”
From From Human Memory to AI Memory: A Survey on Memory Mechanisms in the Era of LLMs (2025) · cites this paper as [24]
The cited source says what the claim attributes to it.
In the citing paper
“These agents, powered by LLMs, typically operate in an iterative loop [39, 29], at each turn they reason about the current state, devise a plan, and execute a tool (e.g., read a file, run tests).”
From The Complexity Trap: Simple Observation Masking Is as Efficient as LLM Summarization for Agent Context Management (2025) · cites this paper as [39]
The cited source says what the claim attributes to it.
In the citing paper
“ReAct (Yao et al., 2022) is a novel approach that prompts LLMs to generate both reasoning traces and task-specific actions in an interleaved manner, fostering synergy between the two processes.”
From The AI Hippocampus: How Far are We From Human Memory? (2026) · cites this paper as Yao et al., 2022
The cited source says what the claim attributes to it.
In the citing paper
“In ReAct [230], by leveraging an intuitive prompt, LLMs learn to generate both reasoning paths and task-specific actions alternately when solving a specific task. The execution of specific actions is delegated to corresponding tools, and external feedback obtained from these tools is utilized to validate and guide the reasoning process further.”
From When large language models meet personalization: perspectives of challenges and opportunities (2024) · cites this paper as [230]
The cited source says what the claim attributes to it.
In the citing paper
“Subsequent studies like ToT [228], Plan-and-Solve [229] and ReAct [230] have proposed more advanced techniques for prompt design to assist in guiding LLM to engage in deeper thinking and tool planning.”
From When large language models meet personalization: perspectives of challenges and opportunities (2024) · cites this paper as [230]
The cited source says what the claim attributes to it.
In the citing paper
“ReACT (Yao et al., 2022) integrates reasoning with acting by allowing LLMs to give a proper reason for an action and incorporating environmental feedback for reasoning.”
From Counterfactually Auditable Lifecycle Certification for Autonomous Agents (2023) · cites this paper as Yao et al., 2022
The cited source says what the claim attributes to it.
In the citing paper
“Reasoning-and-acting traces double as short-horizon working memory; 34% absolute gain on ALFWorld.”
From Memory for Autonomous LLM Agents:Mechanisms, Evaluation, and Emerging Frontiers (2026) · cites this paper as Yao et al., 2022
The cited source says what the claim attributes to it.
In the citing paper
“Recent studies on tool-assisted reasoning have shown how AI systems can intertwine reasoning with action selection, allowing agents to select appropriate tools, interpret the returned information, and update subsequent steps accordingly [9].”
From Medical AI Agents for Clinical Decision Support: Viewpoint Using the Planning, Action, Reflection, and Memory (PARM) Analytical Lens (2026) · cites this paper as [9]
The cited source says what the claim attributes to it.
In the citing paper
“More sophisticated RAG methods, which perform multiple steps of retrieval and generation from an LLM, are even able to integrate information across new or updated knowledge elements[38, 64, 72, 78, 88, 90, 92], another crucial aspect of long-term memory systems.”
From HippoRAG: Neurobiologically Inspired Long-Term Memory for Large Language Models (2024) · cites this paper as [90]
The cited source says what the claim attributes to it.
In the citing paper
“which has been shown to improve the quality of reasoning and future actions71,72”
From Evaluation and mitigation of the limitations of large language models in clinical decision-making (2024) · cites this paper as [72]
The cited source says what the claim attributes to it.
In the citing paper
“Both modular-public and triframe/duet incorporate principles from the ReAct framework [46], which interleaves reasoning traces with actions.”
From Measuring AI Ability to Complete Long Software Tasks (2025) · cites this paper as [46]
The cited source says what the claim attributes to it.
In the citing paper
“More promising recent efforts (Yao et al., 2022; Jiao et al., 2024; Qiao et al., 2024b; Brahman et al., 2024) focus on finetuning LLMs on automatically or manually synthesized samples with explicit plans. Unfortunately, LLMs fine-tuned in this manner still struggle to achieve better performance because the plans required by problems within a single task, as well as across tasks, are vast in number”
From iCLP: Large Language Model Reasoning with Implicit Cognition Latent Planning (2025) · cites this paper as Yao et al., 2022
The cited source says what the claim attributes to it.
In the citing paper
“In ReAct [104], the agents are required to answer questions about general knowledge by multiple reasoning steps. They can utilize Wikipedia APIs to obtain external knowledge if they lack information during these steps.”
From A Survey on the Memory Mechanism of Large Language Model-based Agents (2025) · cites this paper as [104]
The cited source says what the claim attributes to it.
In the citing paper
“For instance, accessing external knowledge through Application Programming Interface (API) is a common practice [104, 5].”
From A Survey on the Memory Mechanism of Large Language Model-based Agents (2025) · cites this paper as [104]
The cited source says what the claim attributes to it.
In the citing paper
“Lastly, we note that our QA scores exceed those reported by recent works on few-shot prompting for open-domain QA (ODQA) (Khot et al., 2023;Press et al., 2022;Yao et al., 2022), although a fair apples-to-apples comparison with them isn't possible (cf.Appendix C).”
From Interleaving Retrieval with Chain-of-Thought Reasoning for Knowledge-Intensive Multi-Step Questions (2023) · cites this paper as Yao et al., 2022
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“Previous work introduced non-executable code review and self-reflection (Zhao et al., 2023; Yao et al., 2022; Shinn et al., 2023; Dong et al., 2023). However, they still face challenges in ensuring code executability and runtime correctness.”
From MetaGPT: Meta Programming for A Multi-Agent Collaborative Framework (2023) · cites this paper as Yao et al., 2022
Experimental — accuracy not yet measuredThe check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“IRCoT is SOTA for few-shot multistep ODQA.14”
From Interleaving Retrieval with Chain-of-Thought Reasoning for Knowledge-Intensive Multi-Step Questions (2023) · cites this paper as Yao et al., 2022
Experimental — accuracy not yet measuredIn the citing paper
“although equipped with a broad array of tools compared to other frameworks17, it remains in an experimental stage, thus limiting clinical applicability.”
From Development and validation of an autonomous artificial intelligence agent for clinical decision-making in oncology (2025) · cites this paper as [17]
In the citing paper
“Equipping an LLM with a suite of tools, such as calculators or web search, has proven superiority in tasks that require multistep reasoning and planning17,18.”
From Development and validation of an autonomous artificial intelligence agent for clinical decision-making in oncology (2025) · cites this paper as [17]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ C.4 ALFWORLD · p. 23
“Table 7: An Act prompt on the ALFWorld clean task. No thoughts are provided.”
§ C.4 ALFWORLD · p. 23
“> think: Now I clean a lettuce (1). Next, I need to put it in/on diningtable 1. OK.”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ 3.1 SETUP · p. 4
“or else suggests top-5 similar entities from the Wikipedia search engine”
§ Original · p. 16
“Similar: ['Adam Clayton Powell III', 'Seventh Avenue (Manhattan)', 'Adam Clayton Powell Jr. State Office Building', 'Isabel Washington Powell', 'Adam Powell', 'Adam Clayton Powell (film)', 'Giancarlo Esposito'].”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ C.3 WEBSHOP · p. 22
“Action : think [B078GWRC1J and B078GTKVXY are bright citrus deodorant less then 50 dollars. I can check B078GWRC1J first.”
§ C.3 WEBSHOP · p. 22
“[ B078GTKVXY ] Ginger Fresh Deodorant by Earth Mama | Natural and Safe for Sensitive Skin, Pregnancy and Breastfeeding, Contains Organic Calendula 3-Ounce $10.99”
Citations
Cites
The publisher hasn’t deposited this paper’s reference list.
Research works printed but not linked: 11
- Alan Baddeley. Working memory. Science , 255(5044):556-559, 1992.
- Tom Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared D Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, et al. Language models are few-shot learners. Advances in neural information processing systems , 33:1877-1901, 2020.
- Antonia Creswell, Murray Shanahan, and Irina Higgins. Selection-inference: Exploiting large language models for interpretable logical reasoning, 2022. URL https://arxiv.org/abs/ 2205.09712 .
- Charles Fernyhough. Vygotsky, luria, and the social brain. Self and social regulation: Social interaction and the development of social understanding and executive functions , pp. 56-79, 2010.
- Ehsan Hosseini-Asl, Bryan McCann, Chien-Sheng Wu, Semih Yavuz, and Richard Socher. A simple language model for task-oriented dialogue. Advances in Neural Information Processing Systems , 33:20179-20191, 2020.
- Siddharth Karamcheti, Megha Srivastava, Percy Liang, and Dorsa Sadigh. Lila: Language-informed latent actions. In CoRL , pp. 1379-1390, 2021. URL https://proceedings.mlr.press/ v164/karamcheti22a.html .
- Patrick Lewis, Ethan Perez, Aleksandra Piktus, Fabio Petroni, Vladimir Karpukhin, Naman Goyal, Heinrich Küttler, Mike Lewis, Wen-tau Yih, Tim Rocktäschel, et al. Retrieval-augmented generation for knowledge-intensive nlp tasks. Advances in Neural Information Processing Systems , 33: 9459-9474, 2020.
- Shuang Li, Xavier Puig, Chris Paxton, Yilun Du, Clinton Wang, Linxi Fan, Tao Chen, De-An Huang, Ekin Akyürek, Anima Anandkumar, Jacob Andreas, Igor Mordatch, Antonio Torralba, and Yuke Zhu. Pre-trained language models for interactive decision-making, 2022. URL https: //arxiv.org/abs/2202.01771 .
- Aleksandr Romanovich Luria. Ls vygotsky and the problem of localization of functions. Neuropsychologia , 3(4):387-392, 1965.
- Reiichiro Nakano, Jacob Hilton, Suchir Balaji, Jeff Wu, Long Ouyang, Christina Kim, Christopher Hesse, Shantanu Jain, Vineet Kosaraju, William Saunders, Xu Jiang, Karl Cobbe, Tyna Eloundou, Gretchen Krueger, Kevin Button, Matthew Knight, Benjamin Chess, and John Schulman. Webgpt: Browser-assisted question-answering with human feedback, 2021. URL https://arxiv. org/abs/2112.09332 .
- Scott Reed, Konrad Zolna, Emilio Parisotto, Sergio Gomez Colmenarejo, Alexander Novikov, Gabriel Barth-Maron, Mai Gimenez, Yury Sulsky, Jackie Kay, Jost Tobias Springenberg, Tom Eccles, Jake Bruce, Ali Razavi, Ashley Edwards, Nicolas Heess, Yutian Chen, Raia Hadsell, Oriol Vinyals, Mahyar Bordbar, and Nando de Freitas. A generalist agent, 2022. URL https: //arxiv.org/abs/2205.06175 .
Cited by
Sorted by citations
Items 2,901–3,000 of 5,706
AI and Prompt Architecture – A Literature Review
Ansara, C. (2023) · International Journal of Computer Applications · doi:10.5120/ijca2023923133 · Cited by 1
Augmenting Keyword-based Search in Mobile Applications Using LLMs
Harikrishnan, C. A., Murthy, G. S., & Rangarajan, K. (2024) · ACM International Conference on Web Search and Data Mining (WSDM) · doi:10.1145/3616855.3635745 · Cited by 1
Ms. Gayathri Devi., M., Siranjeevi., K., Rupeshwar., S., & Oviya., T. (2024) · International Journal of Research Publication and Reviews · doi:10.55248/gengpi.5.0324.07107 · Cited by 1
Event GDR: Event-Centric Generative Document Retrieval
Guan, Y., Liu, D., Ma, J., Peng, H. Y., Wang, X., Hou, L., & Li, R. (2024) · International World Wide Web Conference (WWW) · doi:10.1145/3589335.3651500 · Cited by 1
Vision Language Models as Policy Learners in Reinforcement Learning Environments
Bonetta, G., Zago, D., Cancelliere, R., Polato, M., & Magnini, B. (2024) · European Symposium on Artificial Neural Networks, Computational Intelligence and Machine Learning (ESANN) · doi:10.14428/esann/2024.es2024-181 · Cited by 1
Are We Keeping up With the Innovation in Generative AI?
Eldh, S. (2024) · IEEE Software · doi:10.1109/ms.2024.3441908 · Cited by 1
OMG-QA: Building Open-Domain Multi-Modal Generative Question Answering Systems
Nan, L., Fang, W., Rasteh, A., Lahabi, P., Zou, W., Zhao, Y., & Cohan, A. (2024) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2024.emnlp-industry.75 · Cited by 1
Knowledge-Based Extraction for Inverse Design of Optical Thin-Films
Saw, Z. D., Wang, E. J. Q., Yang, Z., Bui, V. P., & Png, C. E. (2024) · IEEE Region 10 Conference (TENCON) · doi:10.1109/tencon61640.2024.10902764 · Cited by 1
Fdil, M., Levasseur, M., Létourneau, D., Maheux, M.-A., Lussier‐Therrien, M., & Michaud, F. (2025) · Lecture notes in computer science · doi:10.1007/978-981-96-3519-1_17 · Cited by 1
Lisboa, M. O., Costa, H., Coura, P., Freitas, I., Villela, M. L. B., & Ferreira, R. (2025) · doi:10.5753/educomp.2025.4927 · Cited by 1
Look Before You Leap: Enhance Attention and Vigilance Regarding Harmful Content with GuidelineLLM
Zhang, S., Zhang, Z., Chen, K., Weng, R., Yang, M., Zhao, T., & Zhang, M. (2025) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v39i24.34784 · Cited by 1
Adaptive AI in Concurrent Engineering: A Paradigm Shift in Design and Integration
Ciano, C., Chrszon, P., Fischer, P. M., Amato, F., & Gerndt, A. (2025) · Lecture notes on data engineering and communications technologies · doi:10.1007/978-3-031-87781-0_3 · Cited by 1
RAGuru: A Tool to Create and Automatically Deploy Workload Optimized RAG
Bhowmick, A., Rishikesh, S., Taksande, A., Singh, K., Mishra, M., & Singhal, R. (2025) · ACM/SPEC International Conference on Performance Engineering (ICPE) · doi:10.1145/3680256.3721326 · Cited by 1
Chen, X., & Hao, H. (2025) · Proceedings of the ... International ISCRAM Conference · doi:10.59297/wjmsp389 · Cited by 1
Predictive Maintenance Automation: Artificial Maintenance Management Agent ( AMMA ) Framework
Qura, A., & Ibrahim, A. (2025) · SPE Conference at Oman Petroleum & Energy Show · doi:10.2118/224880-ms · Cited by 1
Evaluating Reasoning in Large Language Models with a Modified Think-a-Number Game: Case Study
Hoza, P. (2025) · Acta Informatica Pragensia · doi:10.18267/j.aip.273 · Cited by 1
Designing conversational agent(ic) systems
Candello, H. C. D. S. P., & Brachman, M. (2025) · ACM Conference on Conversational User Interfaces (CUI) · doi:10.1145/3719160.3728630 · Cited by 1
Rui, R., Xi, Y., Liu, W., Lin, J., Chen, B., Tang, R., Zhang, W., & Yu, Y. H. (2025) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3726302.3729885 · Cited by 1
Multiagent Systems for Educational Transformation: A Swarm of Intelligent Personal Assistants
Arjona-Giner, S., & Largo, F. L. (2025) · Lecture notes in educational technology · doi:10.1007/978-981-96-5658-5_132 · Cited by 1
Chen, S., & Zhang, C. (2025) · Scientometrics · doi:10.1007/s11192-026-05654-6 · Cited by 1
VulPelican: An LLM and Interactive Static Analysis Tool Based Vulnerability Detection Framework
Xu, H., Kuang, H., & Yang, F. (2025) · Lecture notes in computer science · doi:10.1007/978-981-96-9872-1_42 · Cited by 1
Agentic MailBot: Autonomous Multi-Agent Email Response System with Contextual Intelligence
Patil, S. B. (2026) · INTERANTIONAL JOURNAL OF SCIENTIFIC RESEARCH IN ENGINEERING AND MANAGEMENT · doi:10.55041/ijsrem63558 · Cited by 1
A FAIR Resource Recommender System for Smart Open Scientific Inquiries
Sakib, S. N., Rubaiat, S. Y., Naha, K., Rahman, H. H., & Jamil, H. M. (2025) · Applied Sciences · doi:10.3390/app15158334 · Cited by 1
Mediating between Human Programmers and Integrated Development Environments using LLM-based Agents
Li, Z. (2025) · ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) · doi:10.1145/3696630.3731460 · Cited by 1
Assimilation and Accommodation: Task-Adaptive Hierarchical Abstraction for Solving Web Tasks
Pang, X., Hong, R., Zhang, H., & Zhang, C. (2025) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2025.findings-acl.720 · Cited by 1
MECoT: Markov Emotional Chain-of-Thought for Personality-Consistent Role-Playing
Wei, Y., Huang, Z., Zhao, F., Feng, Q., & Xing, W. W. (2025) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2025.findings-acl.435 · Cited by 1
Tai, L. T., & Văn, T. Đ. (2025) · Joint Workshop on Large Language Models and Structure Modeling (XLLM) · doi:10.18653/v1/2025.xllm-1.27 · Cited by 1
Learning Optimal Agent Behavior From a Synthetic Reasoning Action Dataset
Dina, G.-A., & Ionescu, B. (2025) · International Symposium on Signals, Circuits and Systems · doi:10.1109/isscs66034.2025.11105702 · Cited by 1
The Future Of Machine Learning And Artificial Intelligence: Key Trends And Innovative Applications
Sahu, A., & Singh, P. (2025) · Journal of Informatics Education and Research · doi:10.52783/jier.v5i1s.3460 · Cited by 1
Technology Foundations of Autonomic Business
Voudouris, C. (2025) · Management for professionals · doi:10.1007/978-3-032-01415-3_3 · Cited by 1
Widagdo, H. H. (2025) · Science Technology and Management Journal · doi:10.53416/stmj.v5i2.353 · Cited by 1
Networked LLM Agents: Toward Autonomous LLMs for Querying Heterogeneous Databases
Baddouj, K., Erradi, M., Essabri, M. A., Kolone, H., Moussa, N. O., & Jamal, R. (2025) · Lecture notes in computer science · doi:10.1007/978-3-032-00347-8_13 · Cited by 1
A survey of multi-agent geosimulation methodologies: from ABM to LLM
Padilla, V., & Dávila, J. A. (2026) · Academia AI and Applications · doi:10.20935/acadai8466 · Cited by 1
PanelTR: Zero-Shot Table Reasoning Framework Through Multi-Agent Scientific Discussion
Ma, Y. (2025) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn64981.2025.11228106 · Cited by 1
ChatSOC: A Large Language Model Powered Autonomous Agent for Security Operations Center
Wang, J., Zhou, C., Yi, Y., Sun, Q., Yan, T., & Qi, F. Z. (2025) · International Symposium on Grids and Clouds (ISGC) · doi:10.22323/1.488.0009 · Cited by 1
CARTGPT: Real-Time Correction of CART Captions Using Large Language Models
Wu, L.-Y., Kleiver, A., & Jain, D. (2025) · International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS) · doi:10.1145/3663547.3746326 · Cited by 1
ReFactX: Scalable Reasoning with Reliable Facts via Constrained Generation
Pozzi, R., Palmonari, M., Coletta, A., Bellomarini, L., Lehmann, J., & Vahdati, S. (2025) · Lecture notes in computer science · doi:10.1007/978-3-032-09527-5_16 · Cited by 1
Policy Learning from Tutorial Books via Understanding, Rehearsing and Introspecting
Chen, X., Wang, Z., Du, Y., Jiang, S., Fang, M., Yu, Y., & Wang, J. (2024) · neural information processing systems · doi:10.52202/079017-0600 · Cited by 1
TACLA: An LLM-Based Multi-Agent Tool for Transactional Analysis Training in Education
Zamojska, M., & Chudziak, J. A. (2025) · IEEE International Conference on Tools with Artificial Intelligence (ICTAI) · doi:10.1109/ictai66417.2025.00048 · Cited by 1
Nanajkar, P. J., Kulkarni, S., Nandedkar, S., Nikam, S., & Khopade, S. (2025) · International Journal of Scientific Research in Computer Science Engineering and Information Technology · doi:10.32628/cseit251117145 · Cited by 1
ChatEED: An agentic retrieval assistant for accelerator operators
Reed, A., Bisegni, C., Shrestha, S., Huang, M., & Ratner, D. F. (2025) · International Conference for High Performance Computing, Networking, Storage and Analysis (SC) · doi:10.1145/3731599.3767408 · Cited by 1
LangProBe: a Language Program Benchmark
Tan, S., Agrawal, L. A., Singhvi, A., Lai, L., Ryan, M. J., Klein, D., Khattab, O., Sen, K., & Zaharia, M. (2025) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2025.findings-emnlp.1172 · Cited by 1
CoRAG: Enhancing Hybrid Retrieval-Augmented Generation through a Cooperative Retriever Architecture
Zheng, Z., Wang, S., Chen, Z., Zhu, Y., He, Y., Hong, L., Guo, Q., & Li, J. (2025) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2025.findings-emnlp.872 · Cited by 1
Wu, D., Brudy, F., Liu, B., & Wang, Y. (2025) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2025.findings-emnlp.590 · Cited by 1
ProcWorld: Benchmarking Large Model Planning in Reachability-Constrained Environments
Wang, D., Li, X., Zhang, Z., Liu, J., Ma, X., Zhang, H., Kong, T., & Liu, H. (2025) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2025.emnlp-main.635 · Cited by 1
OMS: On-the-fly, Multi-Objective, Self-Reflective Ad Keyword Generation via LLM Agent
Chen, B., Zhao, W., & Takamatsu, S. (2025) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2025.emnlp-main.938 · Cited by 1
Declarative Techniques for NL Queries over Heterogeneous Data
Khabiri, E., Kephart, J. O., Heath, F. F., Jayaraman, S., Li, Y., Tipu, F. A., Shah, D., Fokoue, A., & Bhamidipaty, A. (2025) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2025.emnlp-industry.123 · Cited by 1
A Vision-Language Model Agent for building code compliance
Zheng, Z., Nabaei, S. H., Asadi, S., Campbell, B., & Heydarian, A. (2025) · ACM International Conference on Systems for Energy-Efficient Buildings, Cities, and Transportation (BuildSys) · doi:10.1145/3736425.3770118 · Cited by 1
Paul, L., Mulayim, O. B., Saka, U. M., Prakash, A. K., Fierro, G., & Pritoni, M. (2025) · ACM International Conference on Systems for Energy-Efficient Buildings, Cities, and Transportation (BuildSys) · doi:10.1145/3736425.3770107 · Cited by 1
Multi-Agent Architecture for Enterprise AI Orchestration
Dhayakar, D. (2025) · Journal of Computational Analysis and Applications · doi:10.48047/jocaaa.2025.34.11.13 · Cited by 1
An Senegalese Legal Texts Structuration Using LLM-augmented Knowledge Graph
Kane, O., Allaya, M. M., Samb, D., & Bousso, M. (2025) · International Conference on Frontiers of Signal Processing (ICFSP) · doi:10.1109/icfsp67350.2025.11353826 · Cited by 1
Multi-Agent LLM Approach for Moderating E-Commerce Customer Service Responses
Gomes, T., Regino, A. G., Caus, R. O., Chico, V. J. S., & dos Reis, J. C. (2025) · Brazilian Symposium on Multimedia and the Web · doi:10.5753/webmedia.2025.16162 · Cited by 1
Language models for the analysis of and interaction with climate change documents
Volkanovska, E. (2025) · Environmental Data Science · doi:10.1017/eds.2025.10024 · Cited by 1
Automatic Creation of Visualizations with a Multi-Agent LLM Approach
Luo, P., Gauthier, K., Huang, B., & Lin, W. (2025) · Lecture notes in networks and systems · doi:10.1007/978-981-96-6429-0_16 · Cited by 1
Liu, Y., Liu, S., Tang, H., Ma, Y., Li, Z., Zhang, J., Xiang, L., & He, Z. (2025) · Knowledge-Based Systems · doi:10.1016/j.knosys.2025.115046 · Cited by 1
MariATE: Automatic Term Extraction Using Large Language Models in the Maritime Domain
Liu, S., Lefever, E., & Hoste, V. (2025) · International conference Recent advances in natural language processing · doi:10.26615/978-954-452-098-4-077 · Cited by 1
Feature engineering for agents: an adaptive cognitive architecture for interpretable ML monitoring
Bravo Rocca, G. J., Liu, P., Guitart Fernández, J., Carrillo Larco, R. M., Dholakia, A., & Ellison, D. (2025) · UPCommons institutional repository (Universitat Politècnica de Catalunya) · doi:10.5555/3709347.3743552 · Cited by 1
AEPIS: Agent-Enabled Planning at Scale
Schmid, S., Gui, Z., Freund, M., Wehr, T., & Harth, A. (2025) · International Conference on Knowledge Capture · doi:10.1145/3731443.3771341 · Cited by 1
A Checks-and-Balances Framework for Context-Aware Ethical AI Alignment
Chang, E. Y. (2025) · ACM eBooks · doi:10.1145/3749421.3749434 · Cited by 1
An LLM and Embeddings-Based Multi-agentic System for Knowledge Graph Construction and Verification
Rodríguez, M. R. M., Nouri, A., Fei, Z., & Hedblom, M. M. (2025) · Lecture notes in computer science · doi:10.1007/978-3-032-13562-9_31 · Cited by 1
AN APPROACH TO ASSESSING THE QUALITY OF PENTEST SCENARIO GENERATION USING LARGE LANGUAGE MODELS
Konev, A., & Игоревна, П. Т. (2025) · Voprosy kiberbezopasnosti · doi:10.21681/2311-3456-2025-6-147-157 · Cited by 1
Benchmarking large language models for geolocating colonial Virginia land grants
Mioduski, R. (2025) · Journal of Spatial Information Science · doi:10.5311/josis.2025.31.502 · Cited by 1
Chest X-ray foundation models: A survey and future directions
Wang, A., Yang, Z., Rais-Bahrami, S., & Yan, P. (2025) · Meta-Radiology · doi:10.1016/j.metrad.2025.100203 · Cited by 1
Application and progress of artificial intelligence agents in drug development
Zhao, D., & Hsieh, C. (2026) · Journal of Zhejiang University (Medical Sciences) · doi:10.3724/zdxbyxb-2025-0697 · Cited by 1
The Effect of Fine Tuning LLMS on Extracting Text Quality: A Case Study in Domain Adaptation
Fawareh, H. J., & Omari, E. Y. (2026) · Studies in systems, decision and control · doi:10.1007/978-3-031-95310-1_183 · Cited by 1
Du, Z., Wang, H., & Hashimoto, K. (2026) · Computers, materials & continua/Computers, materials & continua (Print) · doi:10.32604/cmc.2025.074520 · Cited by 1
Applications of multi-agent systems in computational materials science
Ying, W., Zhong-Yi, L., & Zefeng, G. A. O. (2026) · Acta Physica Sinica · doi:10.7498/aps.75.20251687 · Cited by 1
Asthana, S. (2026) · International Journal of Innovative Science and Research Technology (IJISRT) · doi:10.38124/ijisrt/26jan348 · Cited by 1
МЕТОДОЛОГІЯ CONTEXT ENGINEERING ДЛЯ ПІДВИЩЕННЯ РЕЛЕВАНТНОСТІ ШІ АГЕНТІВ У SaaS СИСТЕМАХ
Романків, Н. Д. (2025) · ГРААЛЬ НАУКИ · doi:10.36074/grail-of-science.12.12.2025.092 · Cited by 1
EMRDCM : An experience-enhanced multi-role debate method based on compromise mechanisms
Zhang, Y., Feng, J., Yiming, X., Wang, Z., Yang, T., & Wang, X. (2026) · Journal of Intelligent Information Systems · doi:10.1007/s10844-026-01022-1 · Cited by 1
BEAR: Budgeted Evidence Allocation for Multi-Document Reasoning
Sun, L., Zhang, L., Huang, J., Jia, C., Cheng, Z., & Zhang, X. (2026) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/2026.emnlp-main.1348 · Cited by 1
Revise to Precise: Self-assessing Chain-of-Draft for Robust Decision-Making in LLMs
Banerjee, P., Bhattacharjee, P., & Jana, A. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-16632-6_17 · Cited by 1
Two-Stage Tool Retrieval and Invocation for Customer Service Interactions
Chen, Z., & Zhao, H. M. (2025) · International Conference on Embodied Intelligence and Large Models · doi:10.1145/3788731.3788739 · Cited by 1
AI agents for automating materials research: a case study of crystal plasticity simulations
Yang, J., Kobayashi, Y., & Demura, M. (2026) · Science and Technology of Advanced Materials Methods · doi:10.1080/27660400.2026.2630445 · Cited by 1
Agentic AI for Recruiting: Designing, Evaluating, and Governing Autonomous Hiring Workflows
Sawant, S. S. (2026) · Journal of Information Systems Engineering & Management · doi:10.52783/jisem.v11i2s.14379 · Cited by 1
Language Modeling and Large Language Models
Yu, J. S., & Yao, Y. (2026) · Springer eBooks · doi:10.1007/978-981-95-4632-9_2 · Cited by 1
Ilagan, J. R., & Ilagan, J. R. (2026) · International Journal of Advanced Computer Science and Applications · doi:10.14569/ijacsa.2026.0170207 · Cited by 1
On Theoretically-Driven LLM Agents for Multi-Dimensional Discourse Analysis
Uberna, M., Wawer, M., Chudziak, J. A., & Koszowy, M. (2026) · International Conference on Agents and Artificial Intelligence (ICAART) · doi:10.5220/0014319700004052 · Cited by 1
Tailoring Memory Granularity for Multi-Hop Reasoning over Long Contexts
Qing, P., Diao, X., Ma, C., Hassanpour, S., & Vosoughi, S. (2026) · Findings of the Association for Computational Linguistics: EACL · doi:10.18653/v1/2026.findings-eacl.189 · Cited by 1
The cognitive architecture of symbolic identity: Structuring coherence in human–AI reasoning systems
Timbs, A. (2026) · Cognitive Systems Research · doi:10.1016/j.cogsys.2026.101467 · Cited by 1
Mastering Deep Learning: From Neurons to Large Language Models
Firouzi, F., Farahani, B., & Ray, A. (2026) · Springer eBooks · doi:10.1007/978-3-032-06286-4_3 · Cited by 1
The Energy Footprint of LLM-Based Environmental Analysis: LLMs and Domain Products
Bao, A., Hsu, A., Manya, D., Zhang, J., & Ji (2026) · Workshop on Natural Language Processing Meets Climate Change (ClimateNLP) · doi:10.18653/2026.climatenlp-1.16 · Cited by 1
Zhang, K., Niu, Y., Alqassim, M. Y., Inglis, A. L., Palansuriya, C., & Constantin, A. (2026) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3772363.3798774 · Cited by 1
"Here, Let Me Help": An Empirical Study of User Interventions in Human–Web Agent Collaboration
Kim, J., Cho, S., Nguyen, D. M., Jeon, J., Shin, M., & Ko, S. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3791536 · Cited by 1
Optimizing Multi-Turn Interactive Recommendation Agents via Generative Intrinsic Motivation
Feng, X., Tang, J., Chen, X., Dai, Q., & Dong, Z. (2026) · International World Wide Web Conference (WWW) · doi:10.1145/3774904.3792209 · Cited by 1
CLIP Prompt Optimization with Evolutionary-Driven LLMs
Ceron, A., Donà, I., & Iacca, G. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-23607-4_11 · Cited by 1
Kovalenko, V. P., & Kovaliuk, O. O. (2026) · Scientific Works of Vinnytsia National Technical University · doi:10.31649/2307-5376-2026-1-22-30 · Cited by 1
Unlocking Tacit Wisdom: A Knowledge Graph Framework for Querying Project Management Expertise
Agarwal, A., & Madhavan, M. (2026) · Innovations in Software Engineering Conference (ISEC) · doi:10.1145/3796563.3796567 · Cited by 1
Scaling LLM Reasoning from Minimal Labels: A Semi-Supervised Framework with a Lightweight Verifier
Kato, K., Chu, C., Murawaki, Y., & Kurohashi, S. (2026) · Language Resources and Evaluation Conference (LREC) · doi:10.63317/36fhpois9sxp · Cited by 1
Securing Tool-Using AI Agents Against Injection and Authority Misuse
Kanaker, H., Fakhouri, H. N., Karim, N. A., Abuhamdeh, M., Ismail, N. H. A., & Fakhouri, S. N. (2026) · Computation · doi:10.3390/computation14050098 · Cited by 2
Jonak, K., & Wodecki, A. (2026) · Scientific Papers of Silesian University of Technology Organization and Management Series · doi:10.29119/1641-3466.2026.242.8 · Cited by 1
Ponduru, P. S. (2026) · INTERANTIONAL JOURNAL OF SCIENTIFIC RESEARCH IN ENGINEERING AND MANAGEMENT · doi:10.55041/ijsrem62689 · Cited by 1
SEPTA: Self-Evolving PenTester Agent
Fernandes, R., Lopes, N., & Gonçalves, J. J. (2026) · Communications in computer and information science · doi:10.1007/978-3-032-16764-4_7 · Cited by 1
AgentO: An Ontology for Modeling Agentic AI Systems
Ekelhart, A., Kurniawan, K., Ekaputra, F. J., & Kiesling, E. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-25159-6_16 · Cited by 1
Brooks, D., & Turner, S. (2025) · Journal of Computing Innovations and Applications · doi:10.63575/cia.2025.30205 · Cited by 1
Tiny-Critic RAG: Empowering Agentic Fallback with Parameter-Efficient Small Language Models
Wu, Y., Liang, P., Xiang, Y., Yuan, M., Liu, J., Yang, J., Li, X., & Yan, W. (2026) · International Conference on Advanced Algorithms and Control Engineering (ICAACE) · doi:10.1109/icaace69793.2026.11508939 · Cited by 1
Customizing an LLM for Enterprise Software Engineering
Kini, A., Chandra, S., Hashemi, M., Thakur, S., Pandey, A., Nguyen, V., Brockschmidt, M., Ivančić, F., Tarlow, D., Ranganathan, P., et al. (2026) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1145/3832783.3834508 · Cited by 1
Interaction Models and Design Paradigms in Human-AI Interaction
Sun, C., Zhu, T., Wang, C., & Tang, R. (2026) · Springer eBooks · doi:10.1007/978-981-95-5585-7_17 · Cited by 1
Satija, S., Bhatt, A., Jani, P., & Rawal, D. (2026) · ACM Conference on AI and Agentic Systems (CAIS) · doi:10.1145/3786335.3813158 · Cited by 1
Ngom, A., Wu, Z., Mohoney, J., Moore, J., Zhang, A., Madden, S. R., & Kraska, T. (2026) · ACM Conference on AI and Agentic Systems (CAIS) · doi:10.1145/3786335.3813143 · Cited by 1
Metadata
- Authors
- Yao, S., Zhao, J., Yu, D., Du, N., Shafran, I., Narasimhan, K., & Cao, Y.
- Affiliations
- Princeton University (US)
- Google (United States) (US)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2022
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 2210.03629
- OpenAlex
- W4304195432
- Semantic Scholar
- 99832586d55f540f603637e458a292406a0ed75d
- Cited by
- 608
- References
- 0
- Citations by year
- 2026: 130 · 2025: 222 · 2024: 161 · 2023: 95
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University) (cc-by)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Physical Sciences › Engineering › Safety, Risk, Reliability and Quality › Safety Systems Engineering in Autonomy
- Keywords
- autonomous AI agents, phase separation, accountability, failure modes, sandboxing, human-in-the-loop, AI risk management, AI governance
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-11-08, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-11-08 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
