The DOI matches its Crossref record; 90 of the 91 references it cites were found in a registry or an index; 11 of the 15 sources its claims cite were checked for support.
Generative Agents: Interactive Simulacra of Human Behavior
Open accessAbstract
Introduces generative agents that store experiences in natural language, synthesize reflections, and retrieve memories dynamically for planning and social behavior.
Overview
AI snapshot
Written from the paper’s full text.
TL;DR
The paper introduces generative agents powered by an LLM architecture with memory, reflection, and planning, instantiated as 25 characters in a Sims-like sandbox. In controlled and end-to-end evaluations, the full architecture produced more believable behavior than ablations and supported emergent social phenomena such as information spread, relationship formation, and party coordination.
Key findings
- In a controlled believability ranking with 100 evaluators, the full architecture scored highest (TrueSkill mean 29.89, SD 0.72), ahead of no-reflection (26.88, 0.69), no-reflection/planning (25.64, 0.68), human crowdworker (22.95, 0.69), and fully ablated (21.21, 0.70); Kruskal-Wallis χ²(4)=150.29, p<0.001; all pairwise Dunn differences were significant at p<0.001 except crowdworker vs. fully ablated; Cohen’s d=8.16 versus the prior-work baseline.
- Over two game days with 25 agents, knowledge of Sam’s mayoral run rose from 1 agent (4%) to 8 (32%), and knowledge of Isabella’s Valentine’s party rose from 1 (4%) to 13 (52%); none who claimed knowledge of this information had hallucinated it.
- Relationship network density increased from 0.167 to 0.74; among 453 awareness responses, 1.3% (n=6) were hallucinated; five of twelve invited agents attended the Valentine’s party.
- Common failures included retrieving wrong or incomplete memories, embellishing memories, and inheriting overly formal or overly cooperative language from the underlying model.
Methods
- Architecture: an LLM (gpt3.5-turbo ChatGPT) augmented with a natural-language memory stream, retrieval scoring by recency (decay 0.995), importance (LLM-rated 1–10), and relevance (embedding cosine similarity), periodic reflection, and recursive planning/reacting/dialogue.
- Controlled evaluation: within-subjects, 100 Prolific participants ranked believability of five conditions (full architecture, three ablations, human crowdworker) across five interview question categories; analysis used TrueSkill, Kruskal-Wallis, Dunn post-hoc with Holm-Bonferroni, plus inductive qualitative coding.
- End-to-end evaluation: 25 agents in Smallville over two game days; measured information diffusion via interviews, relationship formation via mutual-knowledge network density, and coordination via party attendance.
Limitations
- Stated: evaluation was short (two game days) and the human baseline was crowdworker-authored, not maximal human performance; simulation cost thousands of dollars in token credits and multiple days; robustness to prompt hacking, memory hacking, and hallucination is largely untested.
- Stated: agents inherit underlying LLM imperfections, including potential bias/stereotypes and weaker believability for marginalized subpopulations due to limited data.
- Evident from the text: agents showed erratic location choices, misapplied physical/social norms (e.g., one-person bathroom, after-hours stores), and instruction-tuning effects toward formality and excessive agreeableness; the environment was manually authored and not the focus.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
11 of 15 cited sources checked · 5 supported · 0 flagged · accuracy not yet measured
Every source the paper cites for this claim was checked and supports it.
In the paper
“Challenges with long-term planning and coherence remain [19] even with today's most performant models such as GPT-4.”
§ Generative Agents: Interactive Simulacra of Human Behavior > 4 GENERATIVE AGENT ARCHITECTURE
What the sources say
- Supportedcites [19] 19. Sébastien Bubeck, Varun Chandrasekaran, Ronen Eldan, Johannes Gehrke, Eric Horvitz, Ece Kamar, Peter Lee, Yin Tat Lee, Yuanzhi Li, Scott Lundberg, et al. 2023. Sparks of artifcial general intelligence: Early experiments with gpt-4. arXiv preprint arXiv:2303.12712 (2023). source
Section 1.2 says the paper provides an in-depth analysis of GPT-4’s lack of planning. Section 10.2 also says the model can produce inconsistent content and cannot reliably check whether its output is self-consistent. Together, these support the claim that planning and coherence remain challenges for GPT-4. (LLM, conf=0.90)
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passes- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“The no observation, no refection, no planning condition efectively represents the previous state of the art for agents created through large language models [12,46,80].”
§ Generative Agents: Interactive Simulacra of Human Behavior > 6.2 Conditions
What the sources say
- Could not verifycites [12] 12. Marcel Binz and Eric Schulz. 2023. Using cognitive psychology to under- stand GPT-3. Proceedings of the National Academy of Sciences 120, 6 (2023), e2218523120. sourceExperimental — accuracy not yet measured
The Discussion (page not provided) describes GPT-3 as learning passively from text and recommends that future agents interact with the world. The Results (page not provided) examine observations and decision-making in psychological tasks. Neither section identifies a condition without observations, reflection, and planning as the previous state of the art for LLM agents; searches for that condition and for a prior agent baseline found no such passage. (LLM, conf=0.76)
- Could not verifycites [46] 46. John J. Horton. 2023. Large Language Models as Simulated Economic Agents: What Can We Learn from Homo Silicus? arXiv:2301.07543 [econ.GN] sourceExperimental — accuracy not yet measured
Section 2.4 describes creating LLM agents through prompts, but does not characterize a condition without observations, reflections, and planning. Searches for that combination and for the previous state of the art found no passage in our copy addressing the comparison. (LLM, conf=0.73)
- Partly supportedcites [80] 80. Joon Sung Park, Lindsay Popowski, Carrie J. Cai, Meredith Ringel Morris, Percy Liang, and Michael S. Bernstein. 2022. Social Simulacra: Creating Populated Prototypes for Social Computing Systems. In In the 35th Annual ACM Symposium on User Interface Software and Technology (UIST '22) (Bend, OR, USA) (UIST '22). Association for Computing Machinery, New York, NY, USA. https://doi.org/10. 1145/3526113.3545616 sourceExperimental — accuracy not yet measured
Section 4.2 describes a prior GPT-3 system that generates social participants through persona-based prompt chains, so this paper is an example of an earlier language-model agent approach. But §4.2.3 says replies are prompted with the prior conversation as context; the paper does not identify its system as a no-observation, no-reflection, no-planning condition or establish that condition as the previous state of the art. (LLM, conf=0.78)
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passes- Could not verify
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Comparing the condition representing prior work (with no memory, planning, or refection [12,46,80]) to the full architecture produces a standardized efect size of = 8.16, or eight standard deviations.”
§ Generative Agents: Interactive Simulacra of Human Behavior > 6.5.1 The Full Architecture Bests Other Conditions.
What the sources say
- Could not verifycites [12] 12. Marcel Binz and Eric Schulz. 2023. Using cognitive psychology to under- stand GPT-3. Proceedings of the National Academy of Sciences 120, 6 (2023), e2218523120. sourceExperimental — accuracy not yet measured
Two searches of Binz and Schulz’s “Using cognitive psychology to understand GPT-3” found no relevant passage; the closest snippets concern GPT-3’s exploration behavior (scores 0.179 and 0.127), not an architecture ablation or an effect size of 8.16. An unscoped search found the specific 8.16 comparison in “Generative Agents: Interactive Simulacra of Human Behavior,” but its match score was 0.428, below the rubric’s 0.70 threshold for a misattribution verdict. The cited paper does not make a contrary claim, so the prior disputed verdict is unsupported; the exact-match finding warrants a manual citation check. (LLM, conf=0.55)
- Supportedcites [46] 46. John J. Horton. 2023. Large Language Models as Simulated Economic Agents: What Can We Learn from Homo Silicus? arXiv:2301.07543 [econ.GN] source
The citation is attached to the description of prior work, not to the citing paper’s reported effect size. The Introduction (page unavailable) describes Horton’s GPT-3 agents answering economic decision scenarios, and §3.3 describes supplying beliefs through prompts; this supports citing the paper as an example of earlier agent work rather than the full architecture. Horton’s paper does not report the 8.16 comparison. (LLM, conf=0.88)
- Could not verifycites [80] 80. Joon Sung Park, Lindsay Popowski, Carrie J. Cai, Meredith Ringel Morris, Percy Liang, and Michael S. Bernstein. 2022. Social Simulacra: Creating Populated Prototypes for Social Computing Systems. In In the 35th Annual ACM Symposium on User Interface Software and Technology (UIST '22) (Bend, OR, USA) (UIST '22). Association for Computing Machinery, New York, NY, USA. https://doi.org/10. 1145/3526113.3545616 sourceExperimental — accuracy not yet measured
Section 5.5 reports error rates for SimReddit and its ablations, but not a standardized effect size of 8.16. Searches for that value and for a prior-work condition without memory, planning, or reflection found no matching passage in our copy; page numbers were unavailable. (LLM, conf=0.76)
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passes- Rests on an assumption: The five conditions adequately isolate the contributions of memory, planning, and reflection to believability.
- Could not verify
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Extending prior work [80], these social behaviors are emergent rather than pre-programmed.”
§ Generative Agents: Interactive Simulacra of Human Behavior > 3.4 Emergent Social Behaviors
What the sources say
- Partly supportedcites [80] 80. Joon Sung Park, Lindsay Popowski, Carrie J. Cai, Meredith Ringel Morris, Percy Liang, and Michael S. Bernstein. 2022. Social Simulacra: Creating Populated Prototypes for Social Computing Systems. In In the 35th Annual ACM Symposium on User Interface Software and Technology (UIST '22) (Bend, OR, USA) (UIST '22). Association for Computing Machinery, New York, NY, USA. https://doi.org/10. 1145/3526113.3545616 sourceExperimental — accuracy not yet measured
Section 3 describes SimReddit generating users and their interactions with GPT-3, supporting the prior-work premise that social behaviors can be generated rather than individually pre-programmed. The paper does not examine Smallville, so it cannot establish how Smallville’s particular behaviors arose. (LLM, conf=0.82)
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passes- Partly supported
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“For example, starting with only a single user-specifed notion that one agent wants to throw a Valentine's Day party, the agents autonomously spread invitations to the party over the next two”
§ Generative Agents: Interactive Simulacra of Human Behavior > Abstract
Tests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesA result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“We demonstrate that, with generative agents, it is sufcient to simply tell one agent that she wants to throw a party.”
§ Generative Agents: Interactive Simulacra of Human Behavior > 1 INTRODUCTION
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesA result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“We observe that each of these components is critical to strong performance across these interview tasks.”
§ Generative Agents: Interactive Simulacra of Human Behavior > 1 INTRODUCTION
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passes- Rests on an assumption: Natural language interviews can validly assess an agent's knowledge and behavior, including its ability to stay in character, remember, plan, react, and reflect accurately.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Generative agents draw a wide variety of inferences about themselves, other agents, and their environment;”
§ Generative Agents: Interactive Simulacra of Human Behavior > 1 INTRODUCTION
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesThe paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“The architecture of generative agents operates using natural language.”
§ Generative Agents: Interactive Simulacra of Human Behavior > 5.1 From Structured World Environments to Natural Language, and Back Again
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesA result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Out of the 453 agent responses regarding their awareness of other agents, 1.3% (n=6) were found to be hallucinated.”
§ Generative Agents: Interactive Simulacra of Human Behavior > 7.1.2 Results.
Strength:plain· not yet calibratedn = 6Tests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passes- Rests on an assumption: The agents' memory streams accurately record the events and dialogues that ground their interview responses.
- Rests on an assumption: A two-day simulation with 25 agents is sufficient to observe emergent social behaviors such as information diffusion, relationship formation, and coordination.
- Probably not a substantial claim. 36
- It may state two separate claims as one. 42
- The quote only partly states this claim. 1
Every source the paper cites for this claim was checked and supports it.
In the paper
“Finally, we observed possible efects of instruction tuning [79], which seemed to guide the behavior of the agents to be more polite and cooperative overall.”
§ Generative Agents: Interactive Simulacra of Human Behavior > 7.2 Boundaries and Errors
What the sources say
- Supportedcites [79] 79. Long Ouyang, Jef Wu, Xu Jiang, Diogo Almeida, Carroll L. Wainwright, Pamela Mishkin, Chong Zhang, Sandhini Agarwal, Katarina Slama, Alex Ray, John Schulman, Jacob Hilton, Fraser Kelton, Luke Miller, Maddie Simens, Amanda Askell, Peter Welinder, Paul Christiano, Jan Leike, and Ryan Lowe. 2022. Training language models to follow instructions with human feedback. arXiv:2203.02155 [cs.CL] source
The Introduction describes fine-tuning GPT-3 to follow instructions and reports improved behavior across tasks. The labeling instructions call for helpful responses and for treating people with kindness and respect. In the citing sentence, the authors’ observation that their agents seemed more polite and cooperative is their own; the citation identifies the instruction-tuning approach, rather than attributing that observation to Ouyang et al. (LLM, conf=0.88)
Strength:hedged· not yet calibratedCausal:conditional· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
- Rests on an assumption: A two-day simulation with 25 agents is sufficient to observe emergent social behaviors such as information diffusion, relationship formation, and coordination.
- Supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“While a large language model can generate plausible behavior in response to situational information (e.g., [46,80]), agents need to plan over a longer time horizon to ensure that their sequence of actions is coherent and believable.”
§ Generative Agents: Interactive Simulacra of Human Behavior > 4.3 Planning and Reacting
What the sources say
- Supportedcites [46] 46. John J. Horton. 2023. Large Language Models as Simulated Economic Agents: What Can We Learn from Homo Silicus? arXiv:2301.07543 [econ.GN] source
The Introduction says LLMs can be placed in scenarios and respond realistically to textual inputs, producing responses similar to those expected from humans. The citation is attached to that first clause, not to the citing authors’ subsequent claim about long-term planning. (LLM, conf=0.92)
- Supportedcites [80] 80. Joon Sung Park, Lindsay Popowski, Carrie J. Cai, Meredith Ringel Morris, Percy Liang, and Michael S. Bernstein. 2022. Social Simulacra: Creating Populated Prototypes for Social Computing Systems. In In the 35th Annual ACM Symposium on User Interface Software and Technology (UIST '22) (Bend, OR, USA) (UIST '22). Association for Computing Machinery, New York, NY, USA. https://doi.org/10. 1145/3526113.3545616 source
The citation is attached to the first clause, about generating plausible behavior from situational information. Section 3.3 describes SimReddit generating different responses to a specified post and moderator intervention; the Abstract also reports realistic interactions that shift in response to design changes. The later statement about longer-horizon planning is not attributed to this source by the citation placement. (LLM, conf=0.90)
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
- Supported
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“For instance, generative agents turn of the stove when they see that their breakfast is burning, wait outside the bathroom if it is occupied, and stop to chat when they meet another agent they want to talk to.”
§ Generative Agents: Interactive Simulacra of Human Behavior > 1 INTRODUCTION
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“they respond when the end user changes their environment or commands them in natural language.”
§ Generative Agents: Interactive Simulacra of Human Behavior > 1 INTRODUCTION
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“they create daily plans that refect their characteristics and experiences, act out those plans, react, and re-plan when appropriate;”
§ Generative Agents: Interactive Simulacra of Human Behavior > 1 INTRODUCTION
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“A society full of generative agents is marked by emergent social dynamics where new relationships are formed, information difuses, and coordination arises across agents.”
§ Generative Agents: Interactive Simulacra of Human Behavior > 1 INTRODUCTION
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes? Based: unclearIt may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Across the technical and end-to-end evaluation, the most common errors arose when the agent failed to retrieve relevant memories, fabricated embellishments to the agent's memory, or inherited overly formal speech or behavior from the language model.”
§ Generative Agents: Interactive Simulacra of Human Behavior > 1 INTRODUCTION
Strength:plain· not yet calibratedCausal:direct· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIt may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Despite many potential points of failure-the party planner must remember to invite other agents to the party, attendees must remember the invitation, those who remember must decide to actually show up, and moreour agents succeed.They spread the word about the party and then”
- Also stated in: § 1 INTRODUCTION · plain
“show up, with one agent even asking another on a date to the party, all from a single user-generated seed suggestion.”
§ Generative Agents: Interactive Simulacra of Human Behavior > 1 INTRODUCTION
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
- Also stated in: § 1 INTRODUCTION · plain
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“In an evaluation, these generative agents produce believable individual and emergent social behaviors.”
§ Generative Agents: Interactive Simulacra of Human Behavior > Abstract
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“In this scenario, the end user only set Isabella's initial intent to throw a party and Maria's crush on Klaus: the social behaviors of spreading the word, decorating, asking each other out, arriving at the party, and interacting with each other at the party were initiated by the agent architecture.”
§ Generative Agents: Interactive Simulacra of Human Behavior > 3.4.3 Coordination.
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“It was rare for the agents to completely fabricate their knowledge: they may fail to recall certain events having taken place and respond by acknowledging their lack of memory.However, they did not afrmatively claim to have experienced something they had not.”
§ Generative Agents: Interactive Simulacra of Human Behavior > 6.5.2 Generative Agents Remember, but With Embellishments.
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIt may state two separate claims as one.
- Rests on an assumption: The agents' memory streams accurately record the events and dialogues that ground their interview responses.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“These retrieved memories are also used to form longer-term plans and create higher-level refections, both of which are entered into the memory stream for future use.”
§ Generative Agents: Interactive Simulacra of Human Behavior > 3.4.3 Coordination.
Strength:plain· not yet calibratedCausal:direct· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIt may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“For instance, when asked what she might get Wolfgang Schulz for his birthday, Maria Lopez, with no access to refection, responded by acknowledging her uncertainty, stating that she did not know what Wolfgang likes, despite having had many interactions with him.However, with access to refection memories, Maria answered confdently,”
§ Generative Agents: Interactive Simulacra of Human Behavior > 6.5.3 Reflection Is Required for Synthesis.
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
- Rests on an assumption: The agents' memory streams accurately record the events and dialogues that ground their interview responses.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Records are recursively synthesized into higher-and higher-level refections that guide behavior.”
§ Generative Agents: Interactive Simulacra of Human Behavior > 4 GENERATIVE AGENT ARCHITECTURE
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✗ Based: failsProbably not a substantial claim. The paper may give no reason why it holds.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Agents build individual tree representations of the environment as they navigate it -subgraphs of the overall sandbox environment tree.”
- Also stated in: § 5.1 From Structured World Environments to Natural Language, and Back Again · hedged
“Agents are not omniscient: their tree may get out of date as they leave an area, and is updated when they re-enter the area.”
§ Generative Agents: Interactive Simulacra of Human Behavior > 5.1 From Structured World Environments to Natural Language, and Back Again
Strength:plain· not yet calibratedCausal:conditional· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIt may state two separate claims as one.
- Also stated in: § 5.1 From Structured World Environments to Natural Language, and Back Again · hedged
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Two evaluations, a controlled evaluation and an end-to-end evaluation, that establish causal efects of the importance of components of the architecture, as well as identify breakdowns arising from, e.g., improper memory retrieval.”
§ Generative Agents: Interactive Simulacra of Human Behavior > 1 INTRODUCTION
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
- Rests on an assumption: Natural language interviews can validly assess an agent's knowledge and behavior, including its ability to stay in character, remember, plan, react, and reflect accurately.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“The sandbox server is also responsible for sending all agents and objects that are within a preset visual range for each agent to that agent's memory, so the agent can react appropriately.”
§ Generative Agents: Interactive Simulacra of Human Behavior > 5 SANDBOX ENVIRONMENT IMPLEMENTATION
Strength:plain· not yet calibratedCausal:direct· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“The present study required substantial time and resources to simulate 25 agents for two days, costing thousands of dollars in token credits and taking multiple days to complete.”
§ Generative Agents: Interactive Simulacra of Human Behavior > 8.2 Future Work and Limitations
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“This generates a rough sketch of the agent's plan for a day, divided into fve to eight chunks:”
§ Generative Agents: Interactive Simulacra of Human Behavior > 4.3 Planning and Reacting
Strength:plain· not yet calibratedCausal:direct· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“When an agent executes an action on an object, we prompt the language model to ask what happens to the state of the object.”
§ Generative Agents: Interactive Simulacra of Human Behavior > This outputs
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This prompt returns an integer value of 2 for”
§ Generative Agents: Interactive Simulacra of Human Behavior > 4.1 Memory and Retrieval
Strength:plain· not yet calibratedCausal:direct· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“As agents notice each other, they may engage in dialogue-as they do so, information can spread from agent to agent.”
§ Generative Agents: Interactive Simulacra of Human Behavior > 3.4.1 Information Difusion.
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“In a later interaction, Sam's interactions with Latoya indicate a memory of that interaction, as he asks”
§ Generative Agents: Interactive Simulacra of Human Behavior > 3.4.2 Relationship Memory.
Tests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“From the memory stream, records are retrieved as relevant to plan the agent's actions and react appropriately to the environment.”
§ Generative Agents: Interactive Simulacra of Human Behavior > 4 GENERATIVE AGENT ARCHITECTURE
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Based on their perceptions, the architecture retrieves relevant memories and uses those retrieved actions to determine an action.”
§ Generative Agents: Interactive Simulacra of Human Behavior > 3.4.3 Coordination.
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“They are aware of other agents in their local area, and the generative agent architecture determines whether they walk by or engage in conversation.”
§ Generative Agents: Interactive Simulacra of Human Behavior > 3.1.1 Inter-Agent Communication.
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“At the center of our architecture is the memory stream, a database that maintains a comprehensive record of an agent's experience.”
§ Generative Agents: Interactive Simulacra of Human Behavior > 4 GENERATIVE AGENT ARCHITECTURE
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Moreover, we observed that the instruction tuning also seemed to make the agents overly cooperative with one another.For example, Isabella received a wide range of suggestions and ideas from other agents for the Valentine's Day party from other agents, such as hosting a Shakespearean reading session or a professional networking event.Despite these ideas not aligning with her own interests and”
§ Generative Agents: Interactive Simulacra of Human Behavior > 7.2 Boundaries and Errors
Tests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIt may state two separate claims as one.
- Rests on an assumption: A two-day simulation with 25 agents is sufficient to observe emergent social behaviors such as information diffusion, relationship formation, and coordination.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“The output suggests that John could consider asking Eddy about his music composition project.”
§ Generative Agents: Interactive Simulacra of Human Behavior > 4.3.1 Reacting and Updating Plans.
Strength:hedged· not yet calibratedTests✗ Asserted: fails✓ Checkable: passes✗ Load-bearing: fails✗ Based: failsProbably not a substantial claim. The authors may not put it forward as true. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“In practice, our agents refected roughly two or three times a day.”
§ Generative Agents: Interactive Simulacra of Human Behavior > 4.2 Refection
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Gradually, Sam's candidacy becomes the talk of the town, with some supporting him and others remaining undecided.”
§ Generative Agents: Interactive Simulacra of Human Behavior > 3.4.1 Information Difusion.
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Agents may change their plans midstream if needed.”
§ Generative Agents: Interactive Simulacra of Human Behavior > 4.3 Planning and Reacting
Strength:hedged· not yet calibratedCausal:conditional· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✗ Based: failsProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“In our context, we focus on three main components that, together, produce efective results.”
§ Generative Agents: Interactive Simulacra of Human Behavior > 4.1 Memory and Retrieval
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✗ Based: failsProbably not a substantial claim. The paper may give no reason why it holds.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“There are many possible implementations of an importance score; we fnd that directly asking the language model to output an integer score is efective.”
§ Generative Agents: Interactive Simulacra of Human Behavior > 4.1 Memory and Retrieval
Strength:plain· not yet calibratedCausal:direct· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Performance degraded with the removal of each component in the ablation conditions: the ablated architecture with no access to refection was the next best ( = 26.88;= 0.69), followed by no access to refection or planning ( = 25.64;= 0.68), and then the crowdworker condition ( = 22.95; = 0.69).”
§ Generative Agents: Interactive Simulacra of Human Behavior > 6.5.1 The Full Architecture Bests Other Conditions.
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
- Rests on an assumption: The five conditions adequately isolate the contributions of memory, planning, and reflection to believability.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Without access to her observational memory, Abigail denied awareness of Rajiv Patel, an acquaintance in the sandbox world.But with the aid of memory, she could successfully recall Rajiv and describe him:”
§ Generative Agents: Interactive Simulacra of Human Behavior > 6.5.2 Generative Agents Remember, but With Embellishments.
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
- Rests on an assumption: The agents' memory streams accurately record the events and dialogues that ground their interview responses.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“By interacting with each other, generative agents in Smallville exchange information, form new relationships, and coordinate joint activities.”
§ Generative Agents: Interactive Simulacra of Human Behavior > 3.4 Emergent Social Behaviors
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Our architecture implements a retrieval function that takes the agent's current situation as input and returns a subset of the memory stream to pass on to the language model.”
§ Generative Agents: Interactive Simulacra of Human Behavior > 4.1 Memory and Retrieval
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Agents in Smallville form new relationships over time and remember their interactions with other agents.”
§ Generative Agents: Interactive Simulacra of Human Behavior > 3.4.2 Relationship Memory.
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“The agents interact with the world by their actions, and with each other through natural language.”
§ Generative Agents: Interactive Simulacra of Human Behavior > 3.1.1 Inter-Agent Communication.
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim. It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This generates Eddy's response:”
§ Generative Agents: Interactive Simulacra of Human Behavior > 4.3.2 Dialogue.
Strength:plain· not yet calibratedCausal:direct· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“With the approach described below, Klaus's afternoon plan is less gluttonous: he has lunch at Hobbs Cafe while reading at 12pm, works on his research paper at the school library at 1pm, and takes a break for a walk in the park at 3pm.”
§ Generative Agents: Interactive Simulacra of Human Behavior > 4.3 Planning and Reacting
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“We further inspected the seven agents who were invited to the party but did not attend by engaging them in an interview.Three cited conficts that prevented them from joining the party.For example, Rajiv, a painter, explained that he was too busy:”
§ Generative Agents: Interactive Simulacra of Human Behavior > 7.1.2 Results.
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one. The quote only partly states this claim.
- Rests on an assumption: A two-day simulation with 25 agents is sufficient to observe emergent social behaviors such as information diffusion, relationship formation, and coordination.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Despite many possible points of failure in the ensuing chain of events-agents might not act on that intent, might forget to tell others, might not remember to show up-the Valentine's Day party does, in fact, occur, with a number of agents gathering and interacting.”
§ Generative Agents: Interactive Simulacra of Human Behavior > B.5 Refections
Strength:plain· not yet calibratedSingle caseTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIt may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“A refection tree for Klaus Mueller.The agent's observations of the world, represented in the leaf nodes, are recursively synthesized to derive Klaus's self-notion that he is highly dedicated to his research.”
§ Generative Agents: Interactive Simulacra of Human Behavior > B.5 Refections
Tests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“John wakes up around 6 am and completes his morning routine, which includes brushing his teeth, taking a shower, and eating breakfast.He briefy catches up with his wife, Mei, and son, Eddy, before heading out to begin his workday.”
§ Generative Agents: Interactive Simulacra of Human Behavior > B.5 Refections
Strength:plain· not yet calibratedSingle caseTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The full generative agent architecture produces more believable behavior than the ablated architectures and the human crowdworkers.”
§ Generative Agents: Interactive Simulacra of Human Behavior > B.5 Refections
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Generative agents, believable simulacra of human behavior that are dynamically conditioned on agents' changing experiences and environment.”
§ Generative Agents: Interactive Simulacra of Human Behavior > 1 INTRODUCTION
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“A novel architecture that makes it possible for generative agents to remember, retrieve, refect, interact with other agents, and plan through dynamically evolving circumstances.”
§ Generative Agents: Interactive Simulacra of Human Behavior > 1 INTRODUCTION
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“We synthesize this research to suggest that large language models, though not sufcient by themselves, open up a new angle for creating believable agents when leveraged using the appropriate architecture.”
§ Generative Agents: Interactive Simulacra of Human Behavior > 2 RELATED WORK
Tests✓ Asserted: passes✗ Checkable: fails✓ Load-bearing: passes✗ Based: failsProbably not a substantial claim. It may be too vague to check against evidence. The paper may give no reason why it holds. It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Our argument is that large language models ofer an opportunity to re-examine these questions, provided that we can craft an efective architecture to synthesize memories into believable behavior.”
§ Generative Agents: Interactive Simulacra of Human Behavior > 2.2 Believable Proxies of Human Behavior
Tests✓ Asserted: passes✗ Checkable: fails✓ Load-bearing: passes✗ Based: failsProbably not a substantial claim. It may be too vague to check against evidence. The paper may give no reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Refection explicitly allows the agents to refect not only on their observations but also on other refections: for example, the second statement about Klaus Mueller above is a refection that Klaus previously had, not an observation from his environment.”
§ Generative Agents: Interactive Simulacra of Human Behavior > 4.2 Refection
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The architecture leverages the powerful prompting capabilities of large language models and supplements those capabilities to support longer-term agent coherence, the ability to manage dynamically evolving memory, and recursively produce higher-level refections.”
§ Generative Agents: Interactive Simulacra of Human Behavior > 1 INTRODUCTION
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Lastly, the robustness of generative agents is still largely unknown.”
§ Generative Agents: Interactive Simulacra of Human Behavior > 8.2 Future Work and Limitations
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“The study followed a within-subjects design, where 100 participants compared interview responses generated by four diferent agent architectures and a human-authored condition for the same agent.”
§ Generative Agents: Interactive Simulacra of Human Behavior > 6.1 Evaluation Procedure
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Moreover, like many large language models, generative agents may struggle to generate believable behavior for certain subpopulations, particularly marginalized populations, due to limited data availability.”
§ Generative Agents: Interactive Simulacra of Human Behavior > 8.2 Future Work and Limitations
Strength:hedged· not yet calibratedCausal:conditional· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“In general, any imperfections in the underlying large language models will be inherited by generative agents.”
§ Generative Agents: Interactive Simulacra of Human Behavior > 8.2 Future Work and Limitations
Strength:plain· not yet calibratedCausal:direct· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“In terms of evaluation, the assessment of generative agents' behavior in this study was limited to a relatively short timescale and a baseline human crowdworker condition.”
§ Generative Agents: Interactive Simulacra of Human Behavior > 8.2 Future Work and Limitations
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“To ensure that the crowdworker-authored responses met at least a baseline expectation of quality, the frst author manually inspected the workers' responses to the question”
§ Generative Agents: Interactive Simulacra of Human Behavior > 6.2 Conditions
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“Additionally, for every response that confrmed the agents' knowledge of the information, we verifed that the agents did not hallucinate their responses by locating the specifc dialogue in their memory stream that provided them with the information.”
§ Generative Agents: Interactive Simulacra of Human Behavior > 7.1.1 Measurements.
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim.
- Rests on an assumption: The agents' memory streams accurately record the events and dialogues that ground their interview responses.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Without these mechanisms, large language models can output behavior, but the resulting agents may not react based on the agent's past experiences, may not make important inferences, and may not maintain long-term coherence.”
§ Generative Agents: Interactive Simulacra of Human Behavior > 4 GENERATIVE AGENT ARCHITECTURE
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“Four sets of crowdworker-authored responses did not meet these criteria and were re-generated by other workers.”
§ Generative Agents: Interactive Simulacra of Human Behavior > 6.2 Conditions
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“Architectures were given equivalent access to all memories accrued by the agent up until the moment of the interview, so the diferences observed here likely represent a conservative estimate of the true diferences: in reality, the ablated architectures would not have followed the same path as the full architecture through the two-day simulation.”
§ Generative Agents: Interactive Simulacra of Human Behavior > 6.2 Conditions
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“They may be vulnerable to prompt hacking, memory hacking-where a carefully crafted conversation could convince an agent of the existence of a past event that never occurred-and hallucination, among other issues.”
§ Generative Agents: Interactive Simulacra of Human Behavior > 8.2 Future Work and Limitations
Strength:hedged· not yet calibratedCausal:conditional· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✗ Based: failsProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Given the known biases of language models, generative agents may potentially exhibit biased behavior or stereotypes.”
§ Generative Agents: Interactive Simulacra of Human Behavior > 8.2 Future Work and Limitations
Strength:hedged· not yet calibratedCausal:conditional· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“We chose to design the experiment this way as re-simulating for each architecture would cause the simulations to diverge into diferent states, making comparison challenging.”
§ Generative Agents: Interactive Simulacra of Human Behavior > 6.2 Conditions
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“These serve as the initial memories that determine the agent's behavior.These memories are initial starting points: as the agents gain more experience in the sandbox world, and as more records saturate the memory stream, the agent's summary and behavior will evolve.”
§ Generative Agents: Interactive Simulacra of Human Behavior > 5 SANDBOX ENVIRONMENT IMPLEMENTATION
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
None of the sources cited for this claim have been checked yet.
In the paper
“Furthermore, the frst author conducted an inductive analysis [95] to study the qualitative distinctions between the responses produced in each condition.We employed qualitative open coding [33] in two phases.”
§ Generative Agents: Interactive Simulacra of Human Behavior > 6.4 Analysis
What the sources say
- Not checked — no full text of the sourcecites [95] 95. David R. Thomas. 2006. A General Inductive Approach for Analyzing Qualitative Evaluation Data. American Journal of Evaluation 27, 2 (2006), 237-246. https: //doi.org/10.1177/1098214005283748 source
- Not matchedcites [33] 33. Uwe Flick. 2009. An Introduction to Qualitative Research. SAGE.
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
The paper relies on this without support.
Natural language interviews can validly assess an agent's knowledge and behavior, including its ability to stay in character, remember, plan, react, and reflect accurately.
“In the technical evaluation, we leverage a methodological opportunity to evaluate an agent's knowledge and behavior by”
The paper relies on this without support.
The language model can reliably produce coherent and contextually appropriate natural language for agent behavior.
“Underlying this behavior is a novel agent architecture that combines a large language model with mechanisms for synthesizing and retrieving relevant information to condition the language model's output.”
The paper relies on this without support.
The retrieval and synthesis mechanisms are sufficient to maintain long-term coherence.
“Because generative agents produce large streams of events and memories that must be retained, a core challenge of our architecture is to ensure that the most relevant pieces of the agent's memory are retrieved and synthesized when needed.”
The paper relies on this without support.
Human evaluators' believability rankings are a valid measure of behavioral believability.
“Our dependent variable is the believability of the behavior, a central dependent variable in prior work on agents (e.g., [10]).”
The paper relies on this without support.
The crowdworker-authored responses provide a meaningful human baseline for behavioral competency.
“In addition to the ablation conditions, we added a condition with human crowdworker-authored behavior intended to provide a human baseline.”
The paper relies on this without support.
Human evaluators' rankings of believability provide a valid measure of the believability of agent behavior.
“Our experiment produced 100 sets of rank data, where each participant ranked the fve conditions by believability.”
“Our fndings suggest that the full architecture of generative agents generates the most believable behavior among all the conditions.”
The paper relies on this without support.
The five conditions adequately isolate the contributions of memory, planning, and reflection to believability.
“Performance degraded with the removal of each component in the ablation conditions: the ablated architecture with no access to refection was the next best ( = 26.88;= 0.69), followed by no access to refection or planning ( = 25.64;= 0.68), and then the crowdworker condition ( = 22.95; = 0.69).”
The paper relies on this without support.
The agents' memory streams accurately record the events and dialogues that ground their interview responses.
“we verifed that the agents did not hallucinate their responses by locating the specifc dialogue in their memory stream that provided them with the information.”
The paper relies on this without support.
A two-day simulation with 25 agents is sufficient to observe emergent social behaviors such as information diffusion, relationship formation, and coordination.
“we allowed 25 agents to interact with each other continuously over two full game days in Smallville.”
“We observed evidence of emergent outcomes across all three cases.”
The paper relies on this without support.
The crowdworker condition is a meaningful baseline for human believability.
“the crowdworker condition ( = 22.95; = 0.69).”
“While the crowdworker condition provided a helpful comparison point, it did not represent the maximal human performance that could serve as the gold standard in terms of believability.”
The paper relies on this without support.
The sandbox game world is a valid testbed for simulating human behavior.
“We then demonstrate the potential of generative agents by manifesting them as non-player characters in a Sims-style game world and simulating their lives within it.”
The paper relies on this without support.
For agents to coordinate, they must hear about an event and decide to attend by planning to arrive at the correct time and place.
“To coordinate their behavior, agents need to hear about the event and choose to act on it by planning to show up at the right time and location.”
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source doesn’t support the claim as written.
In the citing paper
“Agent memory systems do the same.”
From Is Agent Memory a Database? Rethinking Data Foundations for Long-Term AI Agent Memory (2026) · cites this paper as [32]
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Usually, there three commonly used criteria for information extraction, that is, the recency, relevance, and importance [20].”
From A survey on large language model based autonomous agents (2024) · cites this paper as [20]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Multi-agent simulations show that LLM agents exhibit key social traits like trust and coordination54,55;”
From Understanding large language models demands distinguishing human projection from machine cognition (2026) · cites this paper as [55]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“During decision-making, it retrieves relevant reflections from semantic memory, then reasons to make a high-level plan of the day.”
From Cognitive Architectures for Language Agents (2023) · cites this paper as Park et al., 2023
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Its action space also has all four kinds of actions: grounding, reasoning, retrieval, and learning.”
From Cognitive Architectures for Language Agents (2023) · cites this paper as Park et al., 2023
Experimental — accuracy not yet measured
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“These agents use retrieval and reasoning to generate reflections on their episodic memory (e.g., 'I like to ski now. ') which are then written to long-term semantic memory.”
From Cognitive Architectures for Language Agents (2023) · cites this paper as Park et al., 2023
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“While this approach can generate seemingly believe-able activities to external observers, this process does not fully resemble how humans think.”
From Humanoid Agents: Platform for Simulating Human-like Generative Agents (2023) · cites this paper as Park et al., 2023
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Generative Agents focus on System 2 thinking at the cost of System 1.”
From Humanoid Agents: Platform for Simulating Human-like Generative Agents (2023) · cites this paper as Park et al., 2023
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“GenerativeAgents [26], AgentSociety [27], OpenClaw [24], and MoltBook [23] show that many real agent workloads run in explicit rounds with a shared scheduler.”
From TokenDance: Scaling Multi-Agent LLM Serving via Collective KV Cache Sharing (2026) · cites this paper as [26]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Prior work demonstrates that LLMs can synthesize characters, quests, narratives, and dialogue with high linguistic fluency and diversity, supporting applications ranging from conceptual game design to LLM-driven NPCs and open-ended simulations [1-4].”
From Game Knowledge Management System: Schema-Governed LLM Pipeline for Executable Narrative Generation in RPGs (2026) · cites this paper as [4]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“In contrast, proactive GenAI agents are more engaging and interactive (Oertel et al., 2020; Park et al., 2023).”
From The effects of generative AI agents and scaffolding on enhancing students’ comprehension of visual learning analytics (2025) · cites this paper as Park et al., 2023
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Park et al.'s agents live in a text-based simulation called 'Smallville'.”
From A Case for AI Consciousness: Language Agents and Global Workspace Theory (2024) · cites this paper as Park et al. (2023)
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“At the end of each day, every agent in Smallville calls on the LLM (in this case, gpt3.5-turbo) to generate a plan for the next day in light of the contents of their memory stream .”
From A Case for AI Consciousness: Language Agents and Global Workspace Theory (2024) · cites this paper as Park et al. (2023)
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Memory and reflection systems such as MemAgent (Yu et al., 2025a), Reflexion (Shinn et al., 2023), and Generative Agents (Park et al., 2023) improve retrieval and episodic memory, but do not perform context shaping, state restructuring, or nextinstruction refinement.”
From PAACE: A Plan-Aware Automated Agent Context Engineering Framework (2025) · cites this paper as Park et al., 2023
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Effective agents (Park et al., 2023) must depend on persis-tent and updatable long-term memory mechanisms, rather than simply increasing context length.”
From From Recall to Forgetting: Benchmarking Long-Term Memory for Personalized Agents (2026) · cites this paper as Park et al., 2023
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“RAISE Shao et al. [2023] and Generative Agents Park et al. [2023] implement memory retrieval with recency, importance, and relevance scoring but lack consolidation, forgetting, and reconsolidation mechanisms.”
From Human-Inspired Memory Architecture for LLM Agents (2026) · cites this paper as Park et al. [2023]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The biggest experiments to date have simulated 25-50 agents (39), which is not close to the scale of a civilization.”
From Project Sid: Many-agent simulations toward AI civilization (2024) · cites this paper as [39]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“In the Generative Agents experiment [Park et al., 2023], removing the reflection component caused agent behavior to degenerate from coherent multi-day planning to repetitive, context-free responses within 48 simulated hours.”
From Memory for Autonomous LLM Agents:Mechanisms, Evaluation, and Emerging Frontiers (2026) · cites this paper as Park et al., 2023
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“In practice, naive accumulation progressively contaminates the retrievable pool: entangled units, redundant variants, and superseded versions increasingly occupy a fixed budget, yielding diffuse or even misleading contexts for downstream reasoning (Park et al., 2023; Liu et al., 2024; Wu et al., 2025).”
From All-Mem: Agentic Lifelong Memory via Dynamic Topology Evolution (2026) · cites this paper as Park et al., 2023
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“In sandboxes of society based on LLMs, agents equipped with long-term memory can better simulate human social behaviors, making them valuable subjects for sociological and psychological research [61, 330, 331].”
From Human-inspired Perspectives: A Survey on AI Long-term Memory (2024) · cites this paper as [330]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“We adopted the same GPT-3.5-turbo version of ChatGPT used in Park et al. (2023) to generate agent behaviors. This approach ensures that the comparison of memory retrieval performance is not influenced by variations in the capabilities of the large language models.”
From Enhancing memory retrieval in generative agents through LLM-trained cross attention networks (2025) · cites this paper as Park et al. (2023)
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Existing memory retrieval methods for agents primarily focus on relevance and temporal validity.”
From Enhancing memory retrieval in generative agents through LLM-trained cross attention networks (2025) · cites this paper as Park et al. (2023)
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“the baseline memory retrieval method we used Park et al. (2023) represents one of the most state-of-the-art approaches currently available for comparison in agent memory retrieval.”
From Enhancing memory retrieval in generative agents through LLM-trained cross attention networks (2025) · cites this paper as Park et al. (2023)
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Existing work manages agent state through reflection, memory, skill libraries, and execution traces (Shinn et al., 2023; Park et al., 2023; Packer et al., 2023; Wang et al., 2024; Hu et al., 2025).”
From Multi-agent Collaboration with State Management (2026) · cites this paper as Park et al., 2023
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Existing mitigation strategies, such as sliding context windows, heuristic truncation, and summary-based memory mechanisms (Park et al., 2023), as well as explicit long-term structures such as user profiles or persona memories (Xu et al., 2022a), improve scalability but often degrade recall reliability.”
From A Survey of Agent Memory in the Second Half: Towards Self-Evolving and Long-Horizon Agents (2026) · cites this paper as Park et al., 2023
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Each agent's perceptual observations are stored in a text file called the memory stream along with other beliefs, including those comprising their text backstory, which specifies their long-term goals and relationships with other agents.”
From A Case for AI Consciousness: Language Agents and Global Workspace Theory (2024) · cites this paper as Park et al. (2023)
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Given an input circumstance, the retrieval function produces a list of entries from the memory stream ordered by taking a weighted sum of their importance (as described above), their recency, and their relevance to the input circumstance (this is again calculated by the LLM).”
From A Case for AI Consciousness: Language Agents and Global Workspace Theory (2024) · cites this paper as Park et al. (2023)
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Inefficient Communication Interfaces: Most existing systems use natural language as the primary communication medium, typically relying on message histories or an unstructured pool of information for decision-making (Park et al., 2023; Qian et al., 2024). This approach often results in a 'telephone effect', where details are lost, and states become corrupted as conversations lengthen.”
From TradingAgents: Multi-Agents LLM Financial Trading Framework (2024) · cites this paper as Park et al., 2023
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Agents are increasingly governed by in-context constraints-organizational policies, standing instructions, and loaded 'memory' that specify what the agent must and must not do (Xiang et al. 2024; Debenedetti et al. 2024; Park et al. 2023).”
From Governance Decay: How Context Compaction Silently Erases Safety Constraints in Long-Horizon LLM Agents (2026) · cites this paper as Park et al. 2023
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“25 simulated characters autonomously organize a Valen- tine's party via observation-reflection-planning cycles.”
From Memory for Autonomous LLM Agents:Mechanisms, Evaluation, and Emerging Frontiers (2026) · cites this paper as Park et al., 2023
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“In contrast, many systems use repeated large-model calls for online memory operations, improving accuracy but accumulating latency over long interactions.”
From Lightweight LLM Agent Memory with Small Language Models (2026) · cites this paper as Park et al., 2023
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“finally, they internalize interactions into persistent traits of the persona to ensure uniformity in behavior (Park et al., 2023; Westhäußer et al., 2025; Liang et al., 2025).”
From From Storage to Experience: A Survey on the Evolution of LLM Agent Memory Mechanisms (2026) · cites this paper as Park et al., 2023
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“LLM-based agents couple large language models with planning, memory retrieval, tool invocation and execution, enabling temporally extended, partially autonomous collaboration [1-3].”
From Caring Without Feeling: Affective Dynamics as the Control Layer of Human-AI Agent Collaboration (2026) · cites this paper as [1]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“These processes are especially consequential in LLM-based agents, whose natural-language fluency, memory and tool-use capabilities can make affective expression appear continuous with competence, intention and social presence [1, 2].”
From Caring Without Feeling: Affective Dynamics as the Control Layer of Human-AI Agent Collaboration (2026) · cites this paper as [1]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Multi-agent architectures [1] make this challenge collective, requiring oversight of emergent group-level affective patterns.”
From Caring Without Feeling: Affective Dynamics as the Control Layer of Human-AI Agent Collaboration (2026) · cites this paper as [1]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Furthermore, multi-agent collaboration plays a significant role in LAA applications, allowing agents to collaborate and interact to solve problems through various role-playing scenarios (Park et al., 2023;Fu et al., 2023;Gong et al., 2023;Li et al., 2023).”
From Large Language Models as Biomedical Hypothesis Generators: A Comprehensive Evaluation (2024) · cites this paper as Park et al., 2023
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The weights were fixed a priori and were not tuned: they encode a prior, drawn from the memorystream and forgetting-curve literature [Park et al., 2023, Zhong et al., 2024], that access-driven signals (recency, frequency) should dominate structural and age-based ones.”
From Selective Forgetting: A Graph-Based Memory Framework for Long-Term LLM Agents (2026) · cites this paper as Park et al., 2023
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“For example, Park et al. [83] first calculate the relevance between the current context and memory entries by cosine similarity, and obtain the importance and recency according to auxiliary information.”
From A Survey on the Memory Mechanism of Large Language Model-based Agents (2025) · cites this paper as [83]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Generative Agents maintains a memory stream over observations, retrieves memories by relevance, recency, and importance, and uses reflection to synthesize higher-level inferences from accumulated experience [20].”
From Oracle Agent Memory as an Enterprise Memory Substrate for Long-Horizon AI Agents (2026) · cites this paper as [20]
The cited source says what the claim attributes to it.
In the citing paper
“More specifically, in Generative Agent [20], the agent has the capability to summarize its past experiences stored in memory into broader and more abstract insights.”
From A survey on large language model based autonomous agents (2024) · cites this paper as [20]
The cited source says what the claim attributes to it.
In the citing paper
“Agent profiles typically encompass basic information such as age, gender, and career [20], as well as psychology information, reflecting the personalities of the agent, and social information, detailing the relationships between agents [21].”
From A survey on large language model based autonomous agents (2024) · cites this paper as [20]
The cited source says what the claim attributes to it.
In the citing paper
“In this strategy, the action is generated by extracting information from the agent memory according to the current task.The task and the extracted memories are used as prompts to trigger the agent actions.”
From A survey on large language model based autonomous agents (2024) · cites this paper as [20]
The cited source says what the claim attributes to it.
In the citing paper
“Actions taken by the agent can also change the agent itself, including updating memories, forming new plans, acquiring novel knowledge, and more.”
From A survey on large language model based autonomous agents (2024) · cites this paper as [20]
The cited source says what the claim attributes to it.
In the citing paper
“A pivotal application of LLM-based autonomous agents lies in simulating diverse real-world human behaviors [20].”
From A survey on large language model based autonomous agents (2024) · cites this paper as [20]
The cited source says what the claim attributes to it.
In the citing paper
“Generative Agents (Park et al., 2023) are language agents grounded to a sandbox game affording interaction with the environment and other agents.”
From Cognitive Architectures for Language Agents (2023) · cites this paper as Park et al., 2023
The cited source says what the claim attributes to it.
In the citing paper
“While executing the plan, the agent receives a stream of grounding observations; it can reason over these to maintain or adjust the plan.”
From Cognitive Architectures for Language Agents (2023) · cites this paper as Park et al., 2023
The cited source says what the claim attributes to it.
In the citing paper
“Each agent has a long-term episodic memory that stores events in a list.”
From Cognitive Architectures for Language Agents (2023) · cites this paper as Park et al., 2023
The cited source says what the claim attributes to it.
In the citing paper
“Generative Agents plan activities over a day, execute them at each time-step and adapt their plans based on observations of their environment.”
From Humanoid Agents: Platform for Simulating Human-like Generative Agents (2023) · cites this paper as Park et al., 2023
The cited source says what the claim attributes to it.
In the citing paper
“Humanoid Agents directly build upon Generative Agents, which aim to model believe-able human behavior (Park et al., 2023).”
From Humanoid Agents: Platform for Simulating Human-like Generative Agents (2023) · cites this paper as Park et al., 2023
The cited source says what the claim attributes to it.
In the citing paper
“Existing studies remain narrowly focused on isolated problems and rely on simplified environments, such as text-based [4] or simplistic game environments [80], with limited attention to real-world environment fidelity, revealing notable limitations.”
From AgentSociety: Large-Scale Simulation of LLM-Driven Generative Agents Advances Understanding of Human Behaviors and Society (2025) · cites this paper as [80]
The cited source says what the claim attributes to it.
In the citing paper
“Figure 3 confirms this quantitatively: in an 8-agent GenerativeAgents [26] round, pairwise block similarity ranges from 91% to 97%, meaning the vast majority of cached data is duplicated across agents.”
From TokenDance: Scaling Multi-Agent LLM Serving via Collective KV Cache Sharing (2026) · cites this paper as [26]
The cited source says what the claim attributes to it.
In the citing paper
“Further, IT artifacts were considered passive as they were used directly by humans. With the advent of agentic IT artifacts (Baird and Maruping 2021) powered by LLMs (Park et al. 2023), this human agency primacy assumption needs to be revisited and impacts how we devise the relation between human and AI based on their potency.”
From Generative AI (2024) · cites this paper as Park et al. 2023
The cited source says what the claim attributes to it.
In the citing paper
“Agentic systems (Park et al., 2023) enable GenAI agents to address irrelevant responses generated by incomplete user prompts (White et al., 2023).”
From The effects of generative AI agents and scaffolding on enhancing students’ comprehension of visual learning analytics (2025) · cites this paper as Park et al., 2023
The cited source says what the claim attributes to it.
In the citing paper
“These plans flexibly shape how an agent acts the following day.”
From A Case for AI Consciousness: Language Agents and Global Workspace Theory (2024) · cites this paper as Park et al. (2023)
The cited source says what the claim attributes to it.
In the citing paper
“During reflection, agents draw on the LLM to first pose and then answer a series of questions about how to generalize from their recent experiences.”
From A Case for AI Consciousness: Language Agents and Global Workspace Theory (2024) · cites this paper as Park et al. (2023)
The cited source says what the claim attributes to it.
In the citing paper
“Timestampaware retrieval down-weights older memories as new ones accumulate [31, 52].”
From Transferable End-to-End Optimization for Indirect Long-Term Memory Poisoning in LLM Agents (2026) · cites this paper as [31]
The cited source says what the claim attributes to it.
In the citing paper
“Common memory retrieval methods include temporal decay ranking, evaluation of memory importance, vector similarity matching, and combinations of these techniques (Park et al., 2023).”
From Enhancing memory retrieval in generative agents through LLM-trained cross attention networks (2025) · cites this paper as Park et al., 2023
The cited source says what the claim attributes to it.
In the citing paper
“Generative Agents [Park et al., 2023] demonstrate how persistent memory enables believable social simulation.”
From MemX: A Local-First Long-Term Memory System for AI Assistants (2026) · cites this paper as Park et al., 2023
The cited source says what the claim attributes to it.
In the citing paper
“Loaded memories are then ranked or refined using semantic similarity, heuristic constraints, or budget-aware selection strategies before being injected into the model's prompt or working context, forming the primary interface between external memory and the LLM's inference process (Park et al., 2023; Wang et al., 2025q).”
From A Survey of Agent Memory in the Second Half: Towards Self-Evolving and Long-Horizon Agents (2026) · cites this paper as Park et al., 2023
The cited source says what the claim attributes to it.
In the citing paper
“To solve this problem, Park et al. introduce a function that enables agents to freely draw inferences from their existing beliefs.”
From A Case for AI Consciousness: Language Agents and Global Workspace Theory (2024) · cites this paper as Park et al. (2023)
The cited source says what the claim attributes to it.
In the citing paper
“Since an agent's memory stream is unmanageably long, in planning action is it necessary to select an action-relevant subset of entries.”
From A Case for AI Consciousness: Language Agents and Global Workspace Theory (2024) · cites this paper as Park et al. (2023)
The cited source says what the claim attributes to it.
In the citing paper
“In deciding how to act in a given circumstance, each language agent considers only those entries from its memory stream which rank highly enough according to the retrieval function.”
From A Case for AI Consciousness: Language Agents and Global Workspace Theory (2024) · cites this paper as Park et al. (2023)
The cited source says what the claim attributes to it.
In the citing paper
“In Park et al.'s agents, the memory stream is implicated in all important cognitive processes. It is where perceptions are recorded, as well as where non-perceptual beliefs, desires, and plans are stored.”
From A Case for AI Consciousness: Language Agents and Global Workspace Theory (2024) · cites this paper as Park et al. (2023)
The cited source says what the claim attributes to it.
In the citing paper
“Each entry in the memory stream comes along with a timestamp, and each is assigned an importance score by the LLM as it is recorded.”
From A Case for AI Consciousness: Language Agents and Global Workspace Theory (2024) · cites this paper as Park et al. (2023)
The cited source says what the claim attributes to it.
In the citing paper
“These importance scores play a key role in determining how each entry shapes the future behavior of the agent: entries with higher importance scores are more likely to influence an agent's other beliefs and plans.”
From A Case for AI Consciousness: Language Agents and Global Workspace Theory (2024) · cites this paper as Park et al. (2023)
The cited source says what the claim attributes to it.
In the citing paper
“The results of reflection are then stored in the memory stream, where they are accessible to the retrieval function.”
From A Case for AI Consciousness: Language Agents and Global Workspace Theory (2024) · cites this paper as Park et al. (2023)
The cited source says what the claim attributes to it.
In the citing paper
“As an early example, successful (pro-social) cooperation and coordination can emerge as a by-product of different language model instances that simulate characters in a social environment [Park et al., 2023].”
From The alignment problem from a deep learning perspective (2022) · cites this paper as Park et al., 2023
The cited source says what the claim attributes to it.
In the citing paper
“Retrieval scores memories by a weighted mix of recency (exponential decay), relevance (embedding similarity), and importance (a self-assessed integer).”
From Memory for Autonomous LLM Agents:Mechanisms, Evaluation, and Emerging Frontiers (2026) · cites this paper as Park et al., 2023
The cited source says what the claim attributes to it.
In the citing paper
“For instance, a group of 25 generative agents in a dynamic sandbox environment successfully organised and conducted a Valentine's Day celebration based on a single user input [54].”
From Promises and challenges of generative artificial intelligence for human learning (2024) · cites this paper as [54]
The cited source says what the claim attributes to it.
In the citing paper
“while Park et al. (2023) retrieves memories based on a weighted combination of relevance, recency, and importance.”
From From Storage to Experience: A Survey on the Evolution of LLM Agent Memory Mechanisms (2026) · cites this paper as Park et al., 2023
The cited source says what the claim attributes to it.
In the citing paper
“For instance, Park et al. [74] observed generative agents in a continuously running simulated town environment to study emergent behaviors across multi-day interactions.”
From Evaluation and Benchmarking of LLM Agents: A Survey (2025) · cites this paper as [74]
The cited source says what the claim attributes to it.
In the citing paper
“• GAMemory (Generative Agents [7]): A pioneer memory model with weighted retrieval combination and self-reflection mechanism.”
From MemEngine: A Unified and Modular Library for Developing Advanced Memory of LLM-based Agents (2025) · cites this paper as [7]
The cited source says what the claim attributes to it.
In the citing paper
“AGENTREVIEW is built upon the capabilities of LLMs to perform realistic simulations of societal environments (Wu et al., 2023a;Chen et al., 2024a;Park et al., 2023) and provide high-quality feedback on academic literature comparable to or exceeds human levels”
From AgentReview: Exploring Peer Review Dynamics with LLM Agents (2024) · cites this paper as Park et al., 2023
The cited source says what the claim attributes to it.
In the citing paper
“Generative Agents [32] rank observations at retrieval by recency, importance, and relevance but never attenuate them from the store.”
From Is Agent Memory a Database? Rethinking Data Foundations for Long-Term AI Agent Memory (2026) · cites this paper as [32]
The cited source says what the claim attributes to it.
In the citing paper
“Generative Agents [32] update a memory's recency on access, but only as an embedded heuristic with no correctness condition.”
From Is Agent Memory a Database? Rethinking Data Foundations for Long-Term AI Agent Memory (2026) · cites this paper as [32]
The cited source says what the claim attributes to it.
In the citing paper
“They combine an importance score with recency decay to rank observations at retrieval.”
From Is Agent Memory a Database? Rethinking Data Foundations for Long-Term AI Agent Memory (2026) · cites this paper as [32]
The cited source says what the claim attributes to it.
In the citing paper
“In real-world applications, however, existing systems (Park et al., 2023; Zhuge et al., 2023; Cai et al., 2023; Wang et al., 2023c; Li et al., 2023; Du et al., 2023; Liang et al., 2023; Hao et al., 2023; Zhou et al., 2023b) tend to oversimplify the complexities.”
From MetaGPT: Meta Programming for A Multi-Agent Collaborative Framework (2023) · cites this paper as Park et al., 2023
The cited source says what the claim attributes to it.
In the citing paper
“Researchers have begun directing more attention to developing memory abilities in AI models.”
From Episodic Memory in AI Agents Poses Risks that Should be Studied and Mitigated (2025) · cites this paper as [3]
The cited source says what the claim attributes to it.
In the citing paper
“The existing work which comes closest to our conceptualization of the role of memory introduces a virtual environment of interacting LLM-based agents that record and later consult natural language records of their actions, using these to better understand their environment and make coherent and relevant plans [3].”
From Episodic Memory in AI Agents Poses Risks that Should be Studied and Mitigated (2025) · cites this paper as [3]
The cited source says what the claim attributes to it.
In the citing paper
“Maintaining an up-to-date memory is essential for human-like long-term interactions [4, 12, 44].”
From CAIM: Development and Evaluation of a Cognitive AI Memory Framework for Long-Term Interaction with Intelligent Agents (2026) · cites this paper as [44]
The cited source says what the claim attributes to it.
In the citing paper
“They employed periodic reflections to summarize prior events, synthesizing memories into high-level knowledge and storing them for future use. This produced believable agents but at computational costs unsuitable for real-time interactions.”
From Post-Thinking in NPC Dialogue: A Paradigm for Reflective Character Models (2026) · cites this paper as [4]
The cited source says what the claim attributes to it.
In the citing paper
“in Generative Agents, each character starts from a set of seed memories, and the reflections synthesized from its memory stream inform how it plans and responds [44].”
From Agentic Memory Management Is the Next Frontier of Information Retrieval (2026) · cites this paper as [44]
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“The All-Gather pattern is a natural starting point because it already appears across many agent workloads.”
From TokenDance: Scaling Multi-Agent LLM Serving via Collective KV Cache Sharing (2026) · cites this paper as [26]
Experimental — accuracy not yet measuredThe check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“While these systems demonstrate the power of LLMs for complex medical simulations and text-based dialogue training, many remain primarily confined to textual interactions.”
From LLM-Powered Virtual Patient Agents for Interactive Clinical Skills Training with Automated Feedback (2025) · cites this paper as [11]
Experimental — accuracy not yet measuredThe check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“This design is motivated by the need to monitor emotional states, particularly frustration with complex queries and satisfaction with search results, which play important roles in shaping search experiences and decision-making processes [25].”
From Generative Agents Navigating Digital Libraries (2025) · cites this paper as [25]
Experimental — accuracy not yet measuredThe check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“PANGeA's novel validation system is a key feature supporting these features, as it addresses the challenges behind processing free-form text input and maintaining narrative coherence (Kumaran et al. 2023; Garavaglia et al. 2022; Park et al. 2023).”
From PANGeA: Procedural Artificial Narrative Using Generative AI for Turn-Based, Role-Playing Video Games (2024) · cites this paper as Park et al. 2023
Experimental — accuracy not yet measuredIn the citing paper
“LLM agents [19] serve as intelligent systems that bridge the gap between LLMs and practical applications, making significant impacts in various fields like human behavior simulation [20], chemistry [21–24], bioinformatics [25] and paper searching [26].”
From Automating structure-activity analysis for electrochemical nitrogen reduction catalyst design through multi-agent collaborations (2025) · cites this paper as [20]
In the citing paper
“The architecture facilitates transparency and fast integration by structuring memory as human-readable summaries and lists (Yue et al., 2025; Park et al., 2023).”
From A Survey of Agent Memory in the Second Half: Towards Self-Evolving and Long-Horizon Agents (2026) · cites this paper as Park et al., 2023
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
John's wake-up time differs between the text and figure caption
MinorThe account of John Lin's morning says he wakes at 7 a.m., while the caption for the same morning says he wakes around 6 a.m.
“In the Lin family, John is the frst to wake up at 7 a.m.”
“John wakes up around 6 am and completes his morning routine”
The party scenario is described as having both one and two user-set premises
MinorThe paper attributes the party scenario to a single user-generated seed, but its detailed account says the user also set Maria's crush on Klaus. That second premise bears directly on the reported date invitation.
“all from a single user-generated seed suggestion.”
“In this scenario, the end user only set Isabella's initial intent to throw a party and Maria's crush on Klaus:”
Citations
Cites
Language Models are Few-Shot Learners
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.14165 · Cited by 23,372
A Simple Sequentially Rejective Multiple Test Procedure
(1979) · Scandinavian Journal of Statistics · doi:10.2307/4615733 · Cited by 21,526 · cited 1×
“…memories accrued by the agent up until the moment of the interview, so the differences observed here likely represent a conservative estimate of the true differences: in reality, the ablated architectures would not have followed the same path as the full architecture through the two-day simulation.”
BackgroundUse of Ranks in One-Criterion Variance Analysis
Kruskal, W. H., & Wallis, W. A. (1952) · Journal of the American Statistical Association · doi:10.1080/01621459.1952.10483441 · Cited by 13,912 · cited 1×
“Separately, to investigate the statistical significance of these re-sults, we applied the Kruskal-Wallis test [56], a non-parametric alternative to the one-way ANOVA, to the raw rank data.”
MethodA General Inductive Approach for Analyzing Qualitative Evaluation Data
Thomas, D. R. (2006) · American Journal of Evaluation · doi:10.1177/1098214005283748 · Cited by 10,858 · cited 1×
“Furthermore, the first author conducted an inductive analysis [95] to study the qualitative distinctions between the responses produced in each condition.”
MethodThe Computer for the 21st Century
Weiser, M. (1991) · Scientific American · doi:10.1038/scientificamerican0991-94 · Cited by 10,017
Understanding and Using Context
Dey, A. K. (2001) · Personal and Ubiquitous Computing · doi:10.1007/s007790170019 · Cited by 5,035
ELIZA—a computer program for the study of natural language communication between man and machine
Weizenbaum, J. (1966) · Communications of the ACM · doi:10.1145/365153.365168 · Cited by 4,452 · cited 1×
“Creating NPCs with believable behavior, if possible, could enhance player experiences in games and interactive fictions by enabling emergent narratives [8, 16, 49, 93] and social interactions with the agents [109].”
BackgroundChain-of-Thought Prompting Elicits Reasoning in Large Language Models
Wei, J., Wang, X., Schuurmans, D., Bosma, M., Ichter, B., Xia, F., Chi, E., Le, Q., & Zhou, D. (2022) · arXiv · doi:10.48550/arxiv.2201.11903 · Cited by 4,263
Training language models to follow instructions with human feedback
Ouyang, L., Wu, J., Jiang, X., Almeida, D., Wainwright, C. L., Mishkin, P., Zhang, C., Agarwal, S., Slama, K., Ray, A., et al. (2022) · arXiv · doi:10.48550/arxiv.2203.02155 · Cited by 4,208
Grandmaster level in StarCraft II using multi-agent reinforcement learning
Vinyals, O., Babuschkin, I., Czarnecki, W. M., Mathieu, M., Dudzik, A., Chung, J., Choi, D. H., Powell, R., Ewalds, T., Georgiev, P., et al. (2019) · Nature · doi:10.1038/s41586-019-1724-z · Cited by 3,455 · cited 1×
“On the other hand, prevalent learning-based approaches for creating believable agents, such as reinforcement learning, have overcome the challenge of manual authoring by letting the agents learn their behavior, and have achieved superhuman performance in recent years in games such as AlphaStar for Starcraft [99] and O…”
Background
Flagged first, then by citations
Research works printed but not linked: 19
- John R. Anderson. 1993. Rules of the Mind. Lawrence Erlbaum Associates, Hillsdale, NJ.
- Ruth Aylett. 1999. Narrative in virtual environments—towards emergent narrative. In Narrative Intelligence: Papers from the AAAI Fall Symposium (Technical Report FS-99-01). AAAI Press 83–86.
- 10.5555/7900.16137 · DOI
- Kevin Dill and L Martin. 2011. A Game AI Approach to Autonomous Control of Virtual Characters. In Proceedings of the Interservice/Industry Training, Simulation, and Education Conference (I/ITSEC’11). Orlando, FL, USA.
- Arpad E Elo. 1967. The Proposed USCF Rating System, Its Development, Theory, and Applications. Chess Life XXII, 8 (August 1967), 242–247.
- Rebecca Fiebrink and Perry R Cook. 2010. The Wekinator: a system for real-time, interactive machine learning in music. In Proceedings of The Eleventh International Society for Music Information Retrieval Conference (ISMIR 2010)(Utrecht), Vol. 3. Citeseer, 2–1.
- Uwe Flick. 2009. An Introduction to Qualitative Research. SAGE.
- 10.1609/aimag.v22i2.1558 · DOI
- John E. Laird. 2000. It Knows What You’re Going To Do: Adding Anticipation to a QUAKEBOT. In Papers from the AAAI 2000 Spring Symposium on Artificial Intelligence and Interactive Entertainment(Technical Report SS-00-02). AAAI Press 41–50.
- Josh McCoy, Michael Mateas, and Noah Wardrip-Fruin. 2009. Comme il Faut: A System for Simulating Social Games Between Autonomous Characters. In Proceedings of the 7th International Conference on Digital Arts and Culture. 87–94.
- Marvin Minsky and Seymour Papert. 1970. Draft of a proposal to ARPA for research on artificial intelligence at MIT, 1970–71.
- 10.1109/SNPD.2017.8023884 · DOI
- Kyle Orland. 2021. So what is ’the metaverse’, exactly?Ars Technica (7 November 2021). arxiv:2111.04169https://arstechnica.com/gaming/2021/11/so-what-is-the-metaverse-exactly/
- Richard W. Pew and Ann S. Mavor (Eds.). 1998. Modeling Human and Organizational Behavior: Applications to Military Simulations. National Academy Press Washington D.C.
- Prolific. 2022. Prolific: Quickly Find Research Participants You Can Trust. https://www.prolific.co/
- Mark O. Riedl. 2012. Interactive narrative: A novel application of artificial intelligence for computer games. In Proceedings of the Twenty-Sixth AAAI Conference on Artificial Intelligence (AAAI’12). 2160–2165.
- Ho Chit Siu, Jaime Peña, Edenna Chen, Yutai Zhou, Victor Lopez, Kyle Palko, Kimberlee Chang, and Ross Allen. 2021. Evaluation of Human-AI Teams for Learned and Rule-Based Agents in Hanabi. In Advances in Neural Information Processing Systems, M. Ranzato, A. Beygelzimer, Y. Dauphin, P.S. Liang, and J. Wortman Vaughan (Eds.). Vol. 34. Curran Associates, Inc., 16183–16195. https://proceedings.neurips.cc/paper_files/paper/2021/file/86e8f7ab32cfd12577bc2619bc635690-Paper.pdf
- Graham Upton and Ian Cook. 2006. A Dictionary of Statistics (2 ed.). Oxford University Press, Oxford, United Kingdom.
- Robert Zubek. 2002. Towards implementation of social interaction. In AAAI Spring Symposium on Artificial Intelligence and Interactive Entertainment. AAAI Press. https://www.aaai.org/Papers/Symposia/Spring/2002/SS-02-01/SS02-01-003.pdf
Cited by
Sorted by citations
Items 201–300 of 2,105
Shea, N. J. (2024) · doi:10.1093/9780191997167.001.0001 · Cited by 29
AvatarGPT: All-in-One Framework for Motion Understanding, Planning, Generation and Beyond
Zhou, Z., Wan, Y., & Wang, B. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00135 · Cited by 49
“Works like [9, 14, 19, 29, 30] have shown the potential of using LLMs as task planners across various fields.”
Goldstein, S., & Kirk‐Giannini, C. D. (2025) · Asian Journal of Philosophy · doi:10.1007/s44204-025-00246-2 · Cited by 44
“The answers For concreteness, consider the language agents developed by Park et al. (2023).”
UXAgent: An LLM Agent-Based Usability Testing Framework for Web Design
Lu, Y., Yao, B., Gu, H., Huang, J., Wang, Z. J., Li, Y., Gesi, J., He, Q., Li, T. J.-J., & Wang, D. (2025) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3706599.3719729 · Cited by 68
Zhang, Q., Wen, R., Hendra, L. B., Ding, Z., & Lc, R. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713661 · Cited by 43
“The blue text captures the player’s active expression of intent toward clean energy solutions.”
How malicious AI swarms can threaten democracy
Schroeder, D. T., Cha, M., Baronchelli, A., Bostrom, N., Christakis, N. A., Garcia, D., Goldenberg, A., Kyrychenko, Y., Leyton-Brown, K., Lutz, N., et al. (2026) · Science · doi:10.1126/science.adz1697 · Cited by 53
Wang, Y., Zhou, Q., & Ledo, D. (2024) · International Conference on the Foundations of Digital Games (FDG) · doi:10.1145/3649921.3656987 · Cited by 42
LLM-Augmented Agent-Based Modelling for Social Simulations: Challenges and Opportunities
Gürcan, Ö. (2024) · Frontiers in artificial intelligence and applications · doi:10.3233/faia240190 · Cited by 60
Hwang, A. H., Siy, J. O., Shelby, R. M., & Lentz, A. (2024) · Designing Interactive Systems Conference · doi:10.1145/3643834.3661555 · Cited by 34
“On the other hand, a growing body of research experiments using large language models (LLMs) to simulate social interactions of AI agents at scales [36, 75, 76].”
BackgroundSimulacrum of Stories: Examining Large Language Models as Qualitative Research Participants
Kapania, S., Agnew, W. S., Eslami, M., Heidari, H., & Fox, S. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713220 · Cited by 53
“This shift raises crucial questions about what it means to use LLMs in qualitative research–a methodology focused on contextual and human-centered inquiry.”
InfluentialKozlowski, A. C., & Evans, J. A. (2025) · Sociological Methods & Research · doi:10.1177/00491241251337316 · Cited by 49
PersonaFlow: Designing LLM-Simulated Expert Perspectives for Enhanced Research Ideation
Liu, Y., Sharma, P., Oswal, M., Xia, H., & Huang, Y. (2025) · Designing Interactive Systems Conference · doi:10.1145/3715336.3735789 · Cited by 76
Haq, F. U., Sukı, N. M., Zaigham, H., Masood, A., & Rajput, A. (2025) · Journal of Digital Economy · doi:10.1016/j.jdec.2025.07.002 · Cited by 70
Wu, M., Xu, J., Yuan, Y., Haffari, G., Wan, L., Luo, W., & Zhang, K. (2025) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl.a.25 · Cited by 91
Holldack, F., Banh, L., & Strobel, G. (2026) · Electronic Markets · doi:10.1007/s12525-025-00861-0 · Cited by 39
“They extend the abilities of previous IS toward human-like features such as multimodal perception, complex reasoning, continuous learning, natural language communication, or sophisticated adaptation in evolving environments (Hughes et al., 2025; Park et al., 2023).”
Mindstorms in Natural Language-Based Societies of Mind
Zhuge, M., Liu, H., Faccio, F., Ashley, D. R., Csordás, R., Gopalakrishnan, A., Hamdi, A., Hammoud, H. A. A. K., Herrmann, V., Irie, K., et al. (2025) · Computational Visual Media · doi:10.26599/cvm.2025.9450460 · Cited by 24
A Survey on LLM-powered Agents for Recommender Systems
Peng, Q., Liu, H., Huang, H., Yang, J., Yang, Q., & Shao, M. (2025) · Findings of the Association for Computational Linguistics: EMNLP 2025 · doi:10.18653/v1/2025.findings-emnlp.620 · Cited by 31
Mindstorms in Natural Language-Based Societies of Mind
Zhuge, M., Liu, H., Faccio, F., Ashley, D. R., Csordás, R., Gopalakrishnan, A., Hamdi, A., Hammoud, H. A. A. K., Herrmann, V., Irie, K., et al. (2023) · arXiv · doi:10.48550/arxiv.2305.17066 · Cited by 24
Shen, L., Li, H., Wang, Y., & Qu, H. (2024) · 2024 IEEE VIS Workshop on Data Storytelling in an Era of Generative AI (GEN4DS) · doi:10.1109/gen4ds63889.2024.00008 · Cited by 25
“2.2, suffers from the lack of a global optimization and validation framework for end-to-end data video generation [16].”
InfluentialWang, T., Wu, T., Liu, H., Brown, C., & Chen, Y. (2025) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3701198 · Cited by 39
“The system’s ability to generate diverse perspectives on topics also encouraged critical thinking and deeper discussions among students, further enhancing the learning process.”
TeachTune: Reviewing Pedagogical Agents Against Diverse Student Profiles with Simulated Students
Jin, H., Yoo, M., Park, J., Lee, Y., Wang, X., & Kim, J. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3714054 · Cited by 47
“Recent advancements in LLM have led researchers to explore the capabilities of LLMs in simulating humans and their environments, such as simulating psychology experiments [21], individuals’ beliefs and preferences [17, 20, 39, 67, 84], and social interactions [52, 71, 83, 91].”
Self-citationWang, Z., Wang, D., Xu, Y., Zhou, L., & Zhou, Y. (2025) · Journal of Chinese Political Science · doi:10.1007/s11366-025-09917-6 · Cited by 27
“The essential techniques of prompt engineering include In-Context Learning (ICL) and Chain of Thought (CoT) prompting, and their significance in simulation studies has been well-proven.”
Toward LLM-agent-based modeling of transportation systems: A conceptual framework
Liu, T., Yang, J., & Yin, Y. (2025) · Artificial Intelligence for Transportation · doi:10.1016/j.ait.2025.100001 · Cited by 28
Agentic Large Language Models for day-to-day route choices
Wang, L., Duan, P., He, Z., Lyu, C., Chen, X., Zheng, N., Yao, L., & Ma, Z. (2025) · Transportation Research Part C Emerging Technologies · doi:10.1016/j.trc.2025.105307 · Cited by 49
“The application of LLMs in simulating human behavior has seen rapid progress, including various fields such as social science, gaming, psychology, economics, and policy-making [27, 28, 29].”
Data-driven models in reliability analysis for tunnel structure: A systematic review
Qin, W., Chen, E. J., Wang, F., Liu, W., & Zhou, C. Y. (2024) · Tunnelling and Underground Space Technology · doi:10.1016/j.tust.2024.105928 · Cited by 25
Kang, J., Ji, M., Zhao, Z., & Bai, T. (2025) · arXiv · doi:10.48550/arxiv.2506.06326 · Cited by 23
Simulacra as conscious exotica
Shanahan, M. (2026) · Inquiry · doi:10.1080/0020174x.2024.2434860 · Cited by 25
“…is set to continue with the integration of more deliberative decision making and a greater repertoire of actions (Park et al., 2023; Vezhnevets et al., 2023; Yao et al., 2023), gradually closing the gap be-tween role play and authenticity, between “mere” mimicry and “the real thing”, so to speak.”
He, G., Demartini, G., & Gadiraju, U. (2025) · Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713218 · Cited by 23
“With this in the backdrop, existing work on automated task completion has revealed that LLM agents can exhibit promising performance in handling complex tasks like playing games [105], answering complex questions [116], and in simulating social behavior [78].”
Opportunities and Challenges of Foundation Models in Industrial Manufacturing
Ayyat, M., Osman, M., & Nadeem, T. (2025) · IEEE Access · doi:10.1109/access.2025.3589777 · Cited by 25
“Digital Twins represent a burgeoning field of application for Foundation Models, facilitating real-time, high-fidelity simulations that are crucial for various industries, including manufacturing, urban planning, healthcare, and more [65].”
GestureGPT: Toward Zero-Shot Free-Form Hand Gesture Understanding with Large Language Model Agents
Zeng, X., Wang, X., Zhang, T., Yu, C., Zhao, S., & Chen, Y. (2024) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3698145 · Cited by 41
FinMem: A Performance-Enhanced LLM Trading Agent With Layered Memory and Character Design
Yu, Y., Li, H., Chen, Z., Jiang, Y., Li, Y., Suchow, J. W., Zhang, D., & Khashanah, K. (2025) · IEEE Transactions on Big Data · doi:10.1109/tbdata.2025.3593370 · Cited by 23
Prospective Role of Foundation Models in Advancing Autonomous Vehicles
Wu, J., Gao, B., Gao, J., Yu, J., Chu, H., Yu, Q., Gong, X., Chang, Y. M., Tseng, H. E., Chen, H., et al. (2024) · Research · doi:10.34133/research.0399 · Cited by 27
“Park et al. [16] introduced generative agents that simulated real human behaviors, performed daily activities based on pre-input settings, and stored daily memories in natural language.”
BackgroundXu, K., & Shi, J. J. (2024) · Communication Theory · doi:10.1093/ct/qtae016 · Cited by 29
Bojić, L., Cinelli, M., Culibrk, D. R., & Delibašić, B. (2024) · European Journal of Futures Research · doi:10.1186/s40309-024-00238-0 · Cited by 28
Xu, S., Chen, C., Liu, Z., Jin, X., Yuan, L.-P., Yan, Y., & Qu, H. (2024) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/3654777.3676336 · Cited by 28
“This indicates the role and personality of the chatbot [54, 68] could be further customized.”
Human–robot interaction through joint robot planning with large language models
Asuzu, K., Singh, H., & Idrissi, M. (2025) · Intelligent Service Robotics · doi:10.1007/s11370-024-00570-1 · Cited by 33
Zhuang, W., Pan, X., Wen, S., Yu, W., Li, X., & Bao, J. (2025) · International Journal of Production Research · doi:10.1080/00207543.2025.2509155 · Cited by 21
“Based on the above definition, the existing agents can be classified into three different types of organisational structures (Chen et al. 2024c; Hong et al. 2023; Park et al. 2023), as shown in Figure 4.”
SOEN-101: Code Generation by Emulating Software Process Models Using Large Language Model Agents
Lin, F., Kim, D. J., & Chen, T.-H. P. (2025) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse55347.2025.00140 · Cited by 150
Using New AI-Driven Techniques to Ease Serious Games Authoring
Pérez-Colado, I. J., Pérez-Colado, V. M., Calvo-Morata, A., Píriz, R. S. C., & Fernández‐Manjón, B. (2023) · IEEE Frontiers in Education Conference (FIE) · doi:10.1109/fie58773.2023.10343021 · Cited by 30
“This opens possibilities for immersive storytelling and interactive gameplay experiences [13], [22], [23] and even use GPT for AI decision-making and human behavior simulation [24].”
Generative AI: Overview, Economic Impact, and Applications in Asset ManagementPreprint
Luk, M. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4574814 · Cited by 24
Humanoid Agents: Platform for Simulating Human-like Generative Agents
Wang, Z., Chiu, Y. Y., & Chiu, Y. C. (2023) · arXiv · doi:10.48550/arxiv.2310.05418 · Cited by 21
Humanoid Agents: Platform for Simulating Human-like Generative Agents
Wang, Z., Chiu, Y. Y., & Chiu, Y. C. (2023) · Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing: System Demonstrations · doi:10.18653/v1/2023.emnlp-demo.15 · Cited by 21
What's the Game, then? Opportunities and Challenges for Runtime Behavior Generation
Jennings, N., Wang, H., Li, I., Smith, J., & Hartmann, B. (2024) · Proceedings of the 37th Annual ACM Symposium on User Interface Software and Technology · doi:10.1145/3654777.3676358 · Cited by 20
“While not specifc to games, Park et al.’s Generative Agents sys-tem also tackles the problem of piloting characters through a virtual environment called Smallville, and takes the approach of using LLMs to directly manage Smallville as well as the agents [23].”
Augmenting Cognitive Architectures with Large Language Models
Joshi, H. N., & Ustun, V. (2024) · Proceedings of the AAAI Symposium Series · doi:10.1609/aaaiss.v2i1.27689 · Cited by 23
“This work proposes one possible fusion between LLMs and cognitive architectures.”
BackgroundInfluentialAuthors' Values and Attitudes Towards AI-bridged Scalable Personalization of Creative Language Arts
Kim, T., Han, H., Adar, E., Kay, M., & Chung, J. J. Y. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642529 · Cited by 20
“Some allowed the design of artificial characters and world elements that can autonomously interact with the user [52, 78].”
BackgroundDesignWeaver: Dimensional Scaffolding for Text-to-Image Product Design
Tao, S., Liang, I., Peng, C., Wang, Z., Palani, S., & Dow, S. P. (2025) · Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3714211 · Cited by 21
“This improvement can be partly attributed to the mechanisms discussed above, where participants were able to explore a broader range of design possibilities and simultaneously deepen their understanding of the design space.”
Chen, J., Wu, X., Lan, T., & Li, B. (2025) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2025.3549549 · Cited by 39
“Besides single agents, some researchers (see [1,10,22]) considered the collaboration of multiple agents powered by LLMs, targeting believable simulations of human behavior with proposed frameworks.”
Generative AI-Based Platform for Deliberate Teaching Practice: A Review and a Suggested Framework
Aperstein, Y., Cohen, Y., & Apartsin, A. (2025) · Education Sciences · doi:10.3390/educsci15040405 · Cited by 35
“Inspired by the rapid progress of LLMs, an even more powerful multiagent approach has emerged (Park et al., 2023).”
Wang, K., Mirosa, M., Hou, Y., & Bremer, P. J. (2025) · Trends in Food Science & Technology · doi:10.1016/j.tifs.2025.105050 · Cited by 40
Liu, Y., Liu, Y., Zhang, X., Chen, X., & Yan, R. (2025) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3726302.3730092 · Cited by 30
“Other studies emphasize diversifying agent roles to enrich the debate process [24, 33].”
Larooij, M., & Törnberg, P. (2025) · Artificial Intelligence Review · doi:10.1007/s10462-025-11412-6 · Cited by 50
“Park et al. (2023) validate agent behavior by interviewing agents about their self-knowledge, memory, plans, and reflections, and evaluating whether their responses align with their personality, memory, and environmental context.”
InfluentialLLMs Among Us: Generative AI Participating in Digital Discourse
Radivojevic, K., Clark, N., & Brenner, P. R. (2024) · Proceedings of the AAAI Symposium Series · doi:10.1609/aaaiss.v3i1.31202 · Cited by 31
Improving Multi-Agent Debate with Sparse Communication Topology
Li, Y., Du, Y., Zhang, J., Hou, L., Grabowski, P., Li, Y., & Ie, E. (2024) · Findings of the Association for Computational Linguistics: EMNLP 2024 · doi:10.18653/v1/2024.findings-emnlp.427 · Cited by 20
Hu, X., Chen, S., Chen, L., Wang, H., Zhang, X., & Zhou, Z. (2025) · National Science Review · doi:10.1093/nsr/nwaf372 · Cited by 19
“LLM agents [19 ] serve as intelligent systems that bridge the gap between LLMs and practical applications, making significant impacts in various fields like human behavior simulation [20 ], chemistry [21 –24 ], bioinformatics [25 ] and paper searching [26 ].”
Swain, V. D., & Saha, K. (2024) · Annual Symposium on Human-Computer Interaction for Work (CHIWORK) · doi:10.1145/3663384.3663401 · Cited by 25
Kambeitz, J. P., & Meyer‐Lindenberg, A. (2025) · npj Digital Medicine · doi:10.1038/s41746-024-01422-z · Cited by 25
“Recent work has explored the integration of LLMs into generative agents to simulate human behavior, with a notable study by Park et al. demonstrating signi fi cant progress in this domain 32 .”
InfluentialEmpowering Agile-Based Generative Software Development through Human-AI Teamwork
Zhang, S., Xing, Z., Guo, R., Xu, F., Chen, L., Zhang, Z., Zhang, X., Feng, Z., & Zhuang, Z. (2025) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3702987 · Cited by 43
A 2 C: A modular multi-stage collaborative decision framework for human–AI teams
Tariq, S., Chhetri, M. B., Nepal, ., & Paris, C. L. (2025) · Expert Systems with Applications · doi:10.1016/j.eswa.2025.127318 · Cited by 34
Proxona: Supporting Creators' Sensemaking and Ideation with LLM-Powered Audience Personas
Choi, Y., Kang, E. J., Choi, S., Lee, M. K., & Kim, J. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3714034 · Cited by 64
TRIP: Transport reasoning with intelligence progression — A foundation framework
Liu, Z., Zhou, Z., Gu, Z., Liu, S., Liu, P., Zhang, Y., He, Y., & Zhang, K. (2025) · Transportation Research Part C Emerging Technologies · doi:10.1016/j.trc.2025.105260 · Cited by 23
Foundation Models for Spatio-Temporal Data Science: A Tutorial and Survey
Liang, Y., Wen, H., Xia, Y., Jin, M., Yang, B., Salim, F. D., Wen, Q., Pan, S., & Cong, G. (2025) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3711896.3736552 · Cited by 22
Asfour, M., & Murillo, J. C. (2023) · International Journal of Cybersecurity Intelligence and Cybercrime · doi:10.52306/2578-3289.1172 · Cited by 19
Cox, S. R., & Ooi, W. T. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-54975-5_10 · Cited by 31
“For example, LLM memory is an on-going research area [25] with recent implementations using interaction logs [27] or summarised conversations 9 in subsequent prompting, as well as investigations of how size of conversational memory impacts model behaviour [19].”
BackgroundNegative social tipping dynamics resulting from and reinforcing Earth system destabilization
Spaiser, V., Juhola, S. K., Constantino, S. M., Guo, W., Watson, T., Sillmann, J., Craparo, A., Basel, A. M., Bruun, J. T., Krishnamurthy, P. K., et al. (2024) · Earth System Dynamics · doi:10.5194/esd-15-1179-2024 · Cited by 28
Octopus: Embodied Vision-Language Programmer from Environmental Feedback
Yang, J., Dong, Y., Liu, S., Li, B., Wang, Z., Tan, H., Jiang, C., Kang, J., Zhang, Y., Zhou, K., et al. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-73232-4_2 · Cited by 64
Conducting Qualitative Interviews with AIPreprint
Chopra, F., & Haaland, I. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4572954 · Cited by 34
Automated Social Science: Language Models as Scientist and SubjectsPreprint
Manning, B. S., Zhu, K., & Horton, J. J. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4810596 · Cited by 20
Li, Z., Zhang, H., Peng, C., & Peiris, R. (2025) · 2025 IEEE Conference Virtual Reality and 3D User Interfaces (VR) · doi:10.1109/vr59515.2025.00025 · Cited by 24
“For example, Park et al. [42] proposed generative agents that can simulate a wide range of behaviors through experience recording, memory synthesis, and adaptive planning, enabling personalized experiences and social interaction simulations in virtual environments.”
InfluentialLu, Q., Zhu, L., Xu, X., Xing, Z., Harrer, S., & Whittle, J. (2024) · IEEE International Conference on Software Architecture Companion (ICSA-C) · doi:10.1109/icsa-c63560.2024.00028 · Cited by 38
“Plan reflection allows the agent to incorporate feedback to refine the plan [30] through three design patterns: self-reflection, cross-reflection, and human reflection.”
BackgroundBioMaster: Multi-agent system for automated bioinformatics analysis workflow
Su, H., Feng, J., Lu, Y., Xu, Y., Yang, J., Lu, H., Yang, J., Yang, X., Xie, S., Long, W., et al. (2026) · Patterns · doi:10.1016/j.patter.2026.101611 · Cited by 29
Generative AI and the augmentation of information practices in knowledge work
Jarrahi, M. H., Li, L., Robinson, A. P., & Meng, S. (2025) · Behaviour and Information Technology · doi:10.1080/0144929x.2025.2551570 · Cited by 33
A Comprehensive Survey on Large-Language-Model-Based Agents for Education
Yang, J., Wang, M., Du, X., & Na, R. (2025) · IEEE Transactions on Learning Technologies · doi:10.1109/tlt.2025.3617909 · Cited by 22
Mooncake: A KVCache-centric Disaggregated Architecture for LLM Serving
Qin, R., Li, Z., He, W., Cui, J., Tang, H., Ren, F., Ma, T., Cai, S., Zhang, Y., Zhang, M., et al. (2026) · ACM Transactions on Storage · doi:10.1145/3773772 · Cited by 34
Mao, L., Long, R., Huang, H., Ma, L., & Zhou, S. (2026) · International Conference on Communications, Information System and Computer Engineering (CISCE) · doi:10.1109/cisce69494.2026.11504499 · Cited by 21
“Large language model (LLM)-based agents are increasingly deployed as personalized assistants, recommendation engines, and conversational companions [1].”
Language agents reduce the risk of existential catastrophe
Goldstein, S., & Kirk‐Giannini, C. D. (2023) · AI & Society · doi:10.1007/s00146-023-01748-4 · Cited by 19
“But what, exactly, are language agents? In this section, we describe the architectural innovations that have given rise to language agents, focusing in particular on the “generative agents” described in Park et al. (2023).”
InfluentialIntegration of cognitive tasks into artificial general intelligence test for large models
Qu, Y., Wei, C., Du, P., Che, W., Zhang, C., Ouyang, W., Bian, Y., Xu, F., Hu, B., Du, K., et al. (2024) · iScience · doi:10.1016/j.isci.2024.109550 · Cited by 20
“166 Additionally, embodied learningis an effective way to enhance the intelligence of large models.”
BackgroundImproving Knowledge Extraction from LLMs for Task Learning through Agent Analysis
Kirk, J. R., Wray, R. E., Lindes, P., & Laird, J. E. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i16.29799 · Cited by 28
“Similar to “agentic” uses of LLMs (Sumers et al. 2023; Park et al. 2023; Richards 2023), we employ the LLM as a component within a larger system.”
ResultRayan, J. A., Kanetkar, D., Gong, Y., Yang, Y., Palani, S., Xia, H., & Dow, S. P. (2024) · Creativity and Cognition · doi:10.1145/3635636.3656184 · Cited by 31
“Removing the need for interaction, even autonomously operating agents powered by language models have been able to simulate a set of human actions for different social contexts [51].”
BackgroundThe New Agronomists: Language Models are Experts in Crop Management
Wu, J., Lai, Z., Chen, S., Tao, R., Pan, Z., & Hovakimyan, N. (2024) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw63382.2024.00543 · Cited by 35
“Meanwhile, we notice that LMs have shown distinctive cognitive capabilities, which include advanced thinking [10, 70], robust memory functions [53], reflective skills [36, 61], as well as multi-modal capabilities [68, 77, 84].”
Epifani, L., & Caruso, A. M. (2024) · Smart Agricultural Technology · doi:10.1016/j.atech.2024.100625 · Cited by 19
Kang, J., Ji, M., Zhao, Z., & Bai, T. (2025) · Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2025.emnlp-main.1318 · Cited by 23
Prettyman, A. (2026) · Inquiry · doi:10.1080/0020174x.2024.2439989 · Cited by 18
Towards lifelong dialogue agents via timeline-based memory management
Ong, K. T.-I., Kim, N., Gwak, M., Chae, H., Kwon, T., Jo, Y., Hwang, S.-W., Lee, D., & Yeo, J. (2025) · Proceedings of the 2025 Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers) · doi:10.18653/v1/2025.naacl-long.435 · Cited by 18
BioMaster: Multi-agent System for Automated Bioinformatics Analysis Workflow
Su, H., Long, W., & Zhang, Y. (2025) · doi:10.1101/2025.01.23.634608 · Cited by 18
Prompt Infection: LLM-to-LLM Prompt Injection within Multi-Agent Systems
Lee, D., & Tiwari, M. (2024) · arXiv · doi:10.48550/arxiv.2410.07283 · Cited by 228
Bickley, S. J., Chan, H. F., Dao, B., Torgler, B., Tran, S., & Zimbatu, A. (2024) · Journal of Services Marketing · doi:10.1108/jsm-11-2023-0441 · Cited by 22
Natural language processing for social science research: A comprehensive review
Hou, Y., & Huang, J. (2025) · Chinese Journal of Sociology · doi:10.1177/2057150x241306780 · Cited by 35
“Park et al. (2023) presented one of the most classic LLM-based social simulation researches, in which they constructed a small town with 25 agents, each with different personalities.”
Lu, Z., Zhou, Q., & Wang, Y. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713363 · Cited by 31
He, Y., Wang, E., Rong, Y., Cheng, Z., & Chen, H. (2025) · 2025 IEEE/ACM International Workshop on Responsible AI Engineering (RAIE) · doi:10.1109/raie66699.2025.00013 · Cited by 71
Stuhler, O., Ton, C. D., & Ollion, É. (2025) · Sociological Methods & Research · doi:10.1177/00491241251336794 · Cited by 29
AgentCoord: Visually exploring coordination strategy for LLM-based multi-agent collaboration
Pan, B., Lu, J., Wang, K., Li, Z., Wen, Z., Feng, Y., Zhu, M., & Chen, W. (2025) · Computers & Graphics · doi:10.1016/j.cag.2025.104338 · Cited by 27
A Context-Aware Onboarding Agent for Metaverse Powered by Large Language Models
Hong, J., Lee, Y., Kim, D. H., Choi, D., Yoon, Y.-J., Lee, G.-C., Lee, Z., & Kim, J. (2024) · Designing Interactive Systems Conference · doi:10.1145/3643834.3661579 · Cited by 22
Content Knowledge Identification with Multi-agent Large Language Models (LLMs)
Yang, K., Chu, Y., Darwin, T., Han, A., Li, H., Wen, H., Copur-Gencturk, Y., Tang, J., & Liu, H. (2024) · Lecture Notes in Computer Science · doi:10.1007/978-3-031-64299-9_23 · Cited by 17
“[26] creates a sandbox environment consisting of virtual entities endowed with a character description and memory system.”
BackgroundIzquierdo-Badiola, S., Canal, G., Rizzo, C., & Alenyà, G. (2024) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra57147.2024.10610055 · Cited by 21
“LLMs have been adopted to model and simulate human behaviour [15], [16], or to learn human preferences from past experiences [17].”
MethodVu, M. D., Wang, H., Chen, J., Li, Z., Zhao, S., Xing, Z., & Chen, C. (2024) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/3654777.3676356 · Cited by 57
Artificial intelligence chatbots mimic human collective behaviour
He, J. K., Wallis, F. P. S., Gvirtz, A., & Rathje, S. (2024) · British Journal of Psychology · doi:10.1111/bjop.12764 · Cited by 24
“Recent advances in AI chatbots have led some researchers to propose using them as agents to improve ABM's ability to simulate complex human collective dynamics (Epstein et al., 2023; Grossmann et al., 2023; Park et al., 2023; Pastor-Galindo et al., 2023).”
From Human- to LLM-Centered Collaborative Ontology Engineering
Doumanas, D., Bouchouras, G., Soularidis, A., Kotis, K., & Vouros, G. A. (2024) · Applied Ontology · doi:10.1177/15705838241305067 · Cited by 21
“Park et al. (2023) introduce the concept of generative agents, which are computational software agents that simulate believable human behavior.”
TheAgentCompany: Benchmarking LLM Agents on Consequential Real World Tasks
Xu, F. F., Song, Y., Li, B., Tang, Y., Jain, K., Bao, M., Wang, Z. Z., Zhou, X., Guo, Z., Cao, M., et al. (2024) · arXiv · doi:10.48550/arxiv.2412.14161 · Cited by 17
Understanding Screenwriters' Practices, Attitudes, and Future Expectations in Human-AI Co-Creation
Tang, Y., Li, H., Lan, M., Ma, X., & Qu, H. (2025) · Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3714120 · Cited by 18
“This capability could significantly enrich narrative development and improve the overall screenwriting experience.”
LLMs as Hackers: Autonomous Linux Privilege Escalation Attacks
Happe, A., Kaplan, A., & Cito, J. (2026) · Empirical Software Engineering · doi:10.1007/s10664-025-10758-3 · Cited by 69
“While Fang et al. describe these CTF-like challenges as “ toy problems ”, recent research (Section 2.2) shows that Security Practitioners spent the majority of their time solving these “ toy problems ”.”
Influential
Metadata
- Authors
- Park, J. S., O'Brien, J., Cai, C. J., Morris, M. R., Liang, P., & Bernstein, M. S.
- Affiliations
- Stanford University (US)
- Google (United States) (US)
- ORCID
- Venue
- Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology
- Publisher
- ACM
- Published
- 2023-10-29
- Pages
- 1-22
- OpenAlex
- W4387835442
- Semantic Scholar
- 5278a8eb2ba2429d4029745caf4e661080073c81
- Cited by
- 2,187
- References
- 70
- Citations by year
- 2026: 961 · 2025: 745 · 2024: 380 · 2023: 101
- FWCI
- 386.60
- Type
- conference paper
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- ACM Symposium on User Interface Software and Technology (UIST) (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- Microsoft Research
- Center for Advanced Study in the Behavioral Sciences, Stanford University
- Center for Advanced Study, University of Illinois at Urbana-Champaign
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence in Games
- Physical Sciences › Computer Science › Artificial Intelligence › Multi-Agent Systems and Negotiation
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Keywords
- generative AI agents, large language models, interactive simulation environment, natural language interaction, agent planning, interpersonal communication
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-09-28, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-09-28 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
