Large Language Model based Multi-Agents: A Survey of Progress and Challenges

Probably not a substantial claim: may not pass S3 (load-bearing).

Xiong et al. (2023) claims that debating can improve the inter-consistency between different LLMs.

“The paper also analyzes the inter-consistency between different LLMs and claims that debating can improve the inter-consistency.”

• cites Xiong et al., 2023 sourceSupported

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

The Sandbox interface is widely used in software development and gaming.

“This kind of interface is widely used in software development (code interpreter as simulated environment) [Hong et al., 2023], gaming (using game rules as simulated environment) [Mao et al., 2023], etc.”

• cites Hong et al., 2023 sourcePartly supported

  Hong et al. is cited for the software-development example, not the gaming example. Section 3.3 (p. 6) describes an Engineer agent executing code and unit tests and using the results to guide debugging, which supports an executable environment in a software-development workflow. It does not identify that environment as a code interpreter or establish that a Sandbox interface is widely used. (LLM, conf=0.82)

  Experimental — accuracy not yet measured
• cites Mao et al., 2023 sourcePartly supported

  Section 2.1 (Sandbox Playground; page unavailable) describes a sandbox environment for conducting games, with code defining the game rules. This supports the gaming example attributed to Mao et al., but the paper does not establish that this kind of interface is widely used. The software-development example is attributed to a different citation. (LLM, conf=0.82)

  Experimental — accuracy not yet measured

May combine two claims.

Xiao et al. (2023) simulates a township water pollution crisis, including a demographic structure of different agents and township head and advisor, providing analysis of how a virtual government entity might respond and how information transfer occurs in the social network.

“The research outlined in [Xiao et al., 2023] is centered on simulating a township water pollution crisis.It simulated a town located on an island including a demographic structure of different agents and township head and advisor.Within the water pollution crisis simulation, this work provides an in-depth analysis of how a virtual government entity might respond to such a public administration”

• cites Xiao et al., 2023 sourceSupported

May combine two claims.

Zheng et al. (2023) utilizes multiple LLM-based agents for science experiments, each focusing on specific tasks, and all agents interact with humans to optimize the synthesis process of complex materials.

“[Zheng et al., 2023] utilizes multiple LLM-based agents, each focusing on specific tasks for the science experiments including strategy planning, literature search, coding, robotic operations, and labware design.All these agents interact with humans to work collaboratively to optimize the synthesis process of complex materials.”

• cites Zheng et al., 2023 sourceSupported

May combine two claims.

Hong et al. (2023) first incorporates human workflow insights for more controlled and validated performance, encoding SOPs into prompts to enhance structured coordination.

“[Hong et al., 2023] first incorporates human workflow insights for more controlled and validated performance.It encodes SOPs into prompts to enhance structured coordination.”

• cites Hong et al., 2023 sourceSupported

May combine two claims.

LLM-MA is well-suited for creating simulated gaming environments, enabling controlled, scalable, and dynamic settings that closely mimic human interactions, making it ideal for testing game theory hypotheses.

“LLM-MA is well-suited for creating simulated gaming environments, allowing agents to assume various roles within games.This technology enables the development of controlled, scalable, and dynamic settings that closely mimic human interactions, making it ideal for testing a range of game theory hypotheses [Mao et al., 2023;Xu et al., 2023b;Gong et al., 2023].”

• cites Mao et al., 2023 sourceSupported
• cites Xu et al., 2023bNot matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites Gong et al., 2023 sourcePartly supported

  The Introduction (p. 2) describes CUISINEWORLD as a multi-agent virtual kitchen benchmark with varied tasks and difficulties, and Section 3 (p. 4) says new tasks can be added to make it dynamic. The paper also reports human–AI collaboration, but it does not establish that the setting closely mimics human interactions or is ideal for testing game-theory hypotheses; its stated purpose is evaluating multi-agent planning and coordination. (LLM, conf=0.86)

  Experimental — accuracy not yet measured

May combine two claims.

MetaGPT embeds human workflow processes into language model agents to reduce hallucination, by encoding Standard Operating Procedures and using an assembly line approach to assign roles.

“MetaGPT is designed to embed human workflow processes into the operation of language model agents, thereby reducing the hallucination problem that often arises in complex tasks.It does this by encoding Standard Operating Procedures into the system and using an assembly line approach to assign specific roles to different agents.”

• cites Hong et al., 2023 sourceSupported

Probably not a substantial claim: may not pass S3 (load-bearing).

Ghaffarzadegan et al. (2023) decomposes epidemic propagation simulation into a Mechanistic Model representing virus information/propagation and a Decision-Making Model representing agents' decision-making process.

“[Ghaffarzadegan et al., 2023] also discusses the epidemic propagation simulation and decomposes the simulation into two parts: the Mechanistic Model which represents the information or propagation of the virus and the Decision-Making Model which represents the agents' decision-making process when facing the virus.”

• cites Ghaffarzadegan et al., 2023 sourceSupported

May combine two claims.

Mandi et al. (2023) introduces RoCo, a multirobot collaboration approach using LLMs for high-level communication and low-level path planning, with experimental results demonstrating adaptability and success in collaborative tasks.

“[Mandi et al., 2023] introduces RoCo, a novel approach for multirobot collaboration that uses LLMs for high-level communication and low-level path planning.Each robotic arm is equipped with an LLM, cooperating with inverse kinematics and collision checking.Experimental results demonstrate the adaptability and success of RoCo in collaborative tasks.”

• cites Mandi et al., 2023 sourceSupported

May combine two claims.

Williams et al. (2023) shows that LLM-based agents can accurately emulate human responses to disease outbreaks, including self-quarantine and isolation, and their collective behavior mirrors multiple waves and stabilizes into an endemic state, contributing to attenuation of the epidemic curve.

“The research showcases through various simulations how these LLM-based agents can accurately emulate human responses to disease outbreaks, including behaviors like self-quarantine and isolation during heightened case numbers.The collective behavior of these agents mirrors the complex patterns of multiple waves typically seen in pandemics, eventually stabilizing into an endemic state.Impressively,”

• cites Williams et al., 2023 sourceSupported

May combine two claims.

Park et al. (2022) develops Social Simulacra, which constructs a simulated community of 1,000 personas and simulates behaviors like posting, replying, and anti-social actions.

“At the same time, [Park et al., 2022] develops Social Simulacra, which constructs a simulated community of 1,000 personas.This system takes a designer's vision for a community-its goals, rules, and member personas-and simulates it, generating behaviors like posting, replying, and even anti-social actions.”

• cites Park et al., 2022 sourceSupported

May combine two claims.

Fan et al. (2023) assesses the capability of LLMs as rational players and identifies weaknesses where agents may overlook or modify refined beliefs when taking actions even in explicit game processes.

“[Fan et al., 2023] comprehensively assesses the capability of LLMs as rational players, and identifies the weaknesses of LLM-based Agents that even in the explicit game process, agents may still overlook or modify refined beliefs when taking actions.”

• cites Fan et al., 2023 sourceSupported

May combine two claims.

Zhao et al. (2023) utilizes LLM-based Agents to simulate a virtual town with restaurant and customer agents, yielding insights aligned with sociological and economic theories.

“[Zhao et al., 2023] utilizes LLM-based Agents to simulate a virtual town with restaurant and customer agents, yielding insights aligned with sociological and economic theories.”

• cites Zhao et al., 2023 sourcePartly supported

  Section 3 describes an LLM-agent simulation in a virtual town, and the character descriptions include a restaurant owner and a customer. But the experiments in Section 4 concern a murder mystery, a school activity fair, and helping a patient—not a simulation centered on restaurant and customer agents. The cited passages do not report findings aligned with sociological and economic theories. (LLM, conf=0.87)

  Experimental — accuracy not yet measured

Probably not a substantial claim: may not pass S3 (load-bearing).

Kovač et al. (2023) introduces SocialAI school for creating interactive environments simulating social interactions, drawing from developmental psychology to understand how agents acquire, demonstrate, and evolve social skills.

“[Kovač et al., 2023] introduces a tool named SocialAI school for creating interactive environments simulating social interactions.It draws from developmental psychology to understand how agents can acquire, demonstrate, and evolve social skills such as joint attention, communication, and cultural learning.”

• cites Kovač et al., 2023 sourceSupported

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

Current LLM-MA systems mainly take three paradigms for communication: Cooperative, Debate, and Competitive.

“Communication Paradigms: Current LLM-MA systems mainly take three paradigms for communication: Cooperative, Debate, and Competitive.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Feedback sources in LLM-MA systems can be categorized into four types: Environment, Agents Interactions, Human, and None.

“Based on the sources from which agents receive this feedback, it can be categorized into four types.”

Probably not a substantial claim: may not pass S3 (load-bearing).

LLM-MA systems have been used in a wide range of applications, summarized into Problem Solving and World Simulation.

“LLM-MA systems have been used in a wide range of applications.We summarize two kinds of applications in Table 1: Problem Solving and World Simulation.”

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

In most studies, the format of feedback provided to agents is textual.

“In most studies, the format of feedback provided to agents is textual.”

Probably not a substantial claim: may not pass S4 (based).

LLM-based multi-agent systems have achieved considerable progress in complex problem-solving and world simulation.

“Recently, based on the development of using one LLM as a single planning or decision-making agent, LLMbased multi-agent systems have achieved considerable progress in complex problem-solving and world simulation.”

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

In LLM-MA systems, the communication content typically takes the form of text.

“In LLM-MA systems, the Communication Content typically takes the form of text.”

May combine two claims. The quote only partly states this claim.

Agents in LLM-MA systems can adapt through three main solutions: Memory, Self-Evolution, and Dynamic Generation.

“To enhance their capabilities, agents in LLM-MA systems can adapt through three main solutions.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

In World Simulation scenarios, datasets and benchmarks are used to evaluate the alignment between the simulated world and real-world or analyze the behaviors of different agents.

“In World Simulation scenarios, datasets and benchmarks are used to evaluate the alignment between the simulated world and realworld or analyze the behaviors of different agents.”

May combine two claims.

Many applications utilize multiple agents to debate a question to reach a consensus and do not depend on the external environment.

“For example, many applications [Du et al., 2023;Xiong et al., 2023;Chan et al., 2023] utilize multiple agents to debate a question to reach a consensus.These applications primarily focus on communication among agents and do not depend on the external environment.”

• cites Du et al., 2023;Xiong et al., 2023;Chan et al., 2023Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing).

Different research applications use different datasets and benchmarks.

“We observe that different re-search applications use different datasets and benchmarks.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

Agents Orchestration emerged as a pivotal challenge and began to gain attention.

“Agents Orchestration emerged as a pivotal challenge and began to gain attention in [Moura, 2023;Dibia, 2023].”

• cites Moura, 2023;Dibia, 2023Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing).

Agent profiling methods in LLM-MA systems can be categorized into three types: Pre-defined, Model-Generated, and Data-Derived.

“Regarding the Agent Profiling Methods, we categorized them into three types: Pre-defined, Model-Generated, and Data-Derived.”

Probably not a substantial claim: may not pass S3 (load-bearing).

In LLM-MA systems, agents assume distinct roles, each with comprehensive descriptions encompassing characteristics, capabilities, behaviors, and constraints.

“Across various systems, agents assume distinct roles, each with comprehensive descriptions encompassing characteristics, capabilities, behaviors, and constraints.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Current interfaces in LLM-MA systems can be categorized into three types: Sandbox, Physical, and None.

“We categorize the current interfaces in LLM-MA systems into three types, Sandbox, Physcial, and None, as detailed in Table 1.”

Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based).

LLM-based Multi-Agents have rapidly garnered increasing interest among researchers.

“LLM-based Multi-Agents have shown inspiring collective intelligence and rapidly garnered increasing interest among researchers.”

Classified as probably not a substantial claim. May combine two claims.

Compared to systems using a single LLM-powered agent, multi-agent systems offer advanced capabilities by specializing LLMs into various distinct agents, each with different capabilities, and by enabling interactions among these diverse agents to simulate complex real-world environments effectively.

“Compared to systems using a single LLM-powered agent, multi-agent systems offer advanced capabilities by 1) specializing LLMs into various distinct agents, each with different capabilities, and 2) enabling interactions among these diverse agents to simulate complex real-world environments effectively.”

Classified as probably not a substantial claim.

The main motivation of using LLM-MA for problem solving is to harness the collective capabilities of agents with specialized expertise.

“The main motivation of using LLM-MA for problem solving is to harness the collective capabilities of agents with specialized expertise.”

May combine two claims.

Chen et al. (2023d) investigates communication challenges in scenarios with a large number of robots, comparing four communication frameworks to evaluate their effectiveness in coordinating complex multi-agent tasks.

“[Chen et al., 2023d] investigates communication challenges in scenarios involving a large number of robots, as assigning each robot an LLM will be costly and unpractical due to the long context.The study compares four communication frameworks, centralized, decentralized, and two hybrid models, to evaluate their effectiveness in coordinating complex multi-agent tasks.”

• cites Chen et al., 2023dNot matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S4 (based). May combine two claims.

Most previous work on LLM-MA has focused on text-based environments, with a notable lack in multi-modal settings.

“Most previous work on LLM-MA has been focused on textbased environments, excelling in processing and generating text.However, there is a notable lack in multi-modal settings, where agents would interact with and interpret data from multiple sensory inputs and generate multiple outputs such as images, audio, video, and physical actions.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

AutoGen is a versatile framework for creating applications using language models, with high customization enabling programming agents using both natural language and code.

“AutoGen is a versatile framework that allows for the creation of applications using language models.It is distinctive for its high level of customization, enabling developers to program agents using both natural language and code to define how these agents interact.”

• cites Wu et al., 2023aNot matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

CAMEL facilitates autonomous cooperation among agents using inception prompting, and serves as a tool for generating and studying conversational data.

“CAMEL, or Communicative Agent Framework, is oriented towards facilitating autonomous cooperation among agents.It uses a novel technique called inception prompting to guide conversational agents towards fulfilling tasks that are consistent with human objectives.This framework also serves as a tool for generating and studying conversational data, helping researchers understand how communicative”

• cites Li et al., 2023bNot matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

May combine two claims.

The hallucination problem is a significant challenge in LLMs and single LLM-based Agent systems.

“The hallucination problem is a significant challenge in LLMs and single LLM-based Agent systems.”

• cites Huang et al., 2023bNot matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing).

In certain research applications like Science Team operations for experiments and economic modeling, there is still a need for comprehensive benchmarks.

“However, in certain research applications like Science Team operations for experiments and economic modeling, there is still a need for comprehensive benchmarks.”

May combine two claims.

Scaling up the number of LLM-based agents in an LLM-MA system significantly increases resource requirements, making development challenging in limited computational resource scenarios.

“Scaling up the number of these agents in an LLM-MA system significantly increases resource requirements.In scenarios with limited computational resource, it would be challenging to develop these LLM-MA systems.”

• AssumptionRests on an assumption: Each LLM-based agent, typically built on large language models like GPT-4, demands substantial computational power and memory.

May combine two claims.

The prevailing approaches in current LLM-MA research involve employing Memory and Self-Evolution techniques to adjust agents based on feedback, but these methods do not fully capitalize on the potential collective intelligence of the agent network.

“Moreover, the prevailing approaches in current research involve employing Memory and Self-Evolution techniques to adjust agents based on feedback.While effective for individual agents, these methods do not fully capitalize on the potential collective intelligence of the agent network.”

May combine two claims.

Aher et al. (2023) shows that larger models replicate human behavior more faithfully, but reveal a hyper-accuracy distortion, especially in knowledge-based tasks.

“By simulating various kinds of individuals via LLM, they show that larger models replicate human behavior more faithfully, but they also reveal a hyper-accuracy distortion, especially in knowledge-based tasks.”

• cites Aher et al., 2023Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

May combine two claims.

Agent4Rec shows that LLM-MA can effectively mimic real user preferences and behaviors, provide insights into phenomena like the filter bubble effect, and help uncover causal relationships in recommendation tasks.

“Agent4Rec shows that LLM-MA can effectively mimic real user preferences and behaviors, provide insights into phenomena like the filter bubble effect, and help uncover causal relationships in recommendation tasks.”

• cites Zhang et al., 2023aNot matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing).

Tang et al. (2023) utilizes multiple LLM-based agents as distinct domain experts to do collaborative discussion on a medical report to reach a consensus for medical diagnosis.

“[Tang et al., 2023] also utilizes multiple LLM-based agents as distinct domain experts to do the collaborative discussion on a medical report to reach a consensus for medical diagnosis.”

• cites Tang et al., 2023Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

May combine two claims.

Zhang et al. (2023e) treats both users and items as agents, optimizing them collectively to reflect and adjust to real-world interaction disparities, emphasizing simulating user-item interactions and propagating preferences among agents.

“Different from Agent4Rec work, [Zhang et al., 2023e] treats both users and items as agents, optimizing them collectively to reflect and adjust to realworld interaction disparities.This work emphasizes simulating user-item interactions and propagates preferences among agents, capturing the collaborative filtering essence.”

• cites Zhang et al., 2023eNot matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

Hua et al. (2023) introduces WarAgent to simulate key historical conflicts and provides insights for conflict resolution and understanding, with potential applications in preventing future international conflicts.

“[Hua et al., 2023] introduces WarAgent to simulate key historical conflicts and provides insights for conflict resolution and understanding, with potential applications in preventing future international conflicts.”

• cites Hua et al., 2023Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

May combine two claims.

Zhang et al. (2023c) presents CoELA, a Cooperative Embodied Language Agent, managing discussions and task planning in an LLM-MA setting with decentralized control, complex partial observation, costly communication, and multi-objective long-horizon tasks.

“[Zhang et al., 2023c] presents CoELA, a Cooperative Embodied Language Agent, managing discussions and task planning in an LLM-MA setting.This challenging setting is featured with decentralized control, complex partial observation, costly communication, and multi-objective long-horizon tasks.”

• cites Zhang et al., 2023cNot matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

May combine two claims.

LLM-MA systems mainly learn from instant feedback, such as interactions with the environment or humans, unlike traditional multi-agent systems that use reinforcement learning from offline training datasets.

“In traditional multi-agent systems, agents often use reinforcement learning to learn from offline training datasets.However, LLM-MA systems mainly learn from instant feedback, such as interactions with the environment or humans, as we discussed in Section 3.”

• AssumptionRests on an assumption: In traditional multi-agent systems, agents often use reinforcement learning to learn from offline training datasets.

May combine two claims.

LLM-MA can be used to model robots with different capabilities and cooperate with each other to solve real-world physical tasks.

“Hence, LLM-MA can be used to model robots with different capabilities and cooperate with each other to solve real-world physical tasks.”

• AssumptionRests on an assumption: Most embodied agents applications inherently utilize multiple robots working together to perform complex real-world planning and manipulation tasks such as warehouse management with heterogeneous robot capabilities.

Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).

Effective Agents Orchestration facilitates harmonious operation among agents, minimizing conflicts and redundancies.

“Effective Agents Orchestration facilitates harmonious operation among agents, minimizing conflicts and redundancies.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

Ma et al. (2023) explores the psychological implications and outcomes of employing LLM-based conversational agents for mental well-being support, emphasizing the need for careful evaluation from a psychological perspective.

“[Ma et al., 2023] explores the psychological implications and outcomes of employing LLM-based conversational agents for mental well-being support.It emphasizes the need for carefully evaluating the use of LLM-based agents in mental health applications from a psychological perspective.”

• cites Ma et al., 2023Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing).

Xu et al. (2023b) proposes a framework using ChatArena library for engaging LLMs in communication games like Werewolf, using retrieval and reflection on past communications and Chain-of-Thought.

“Furthermore, [Xu et al., 2023b] proposes a framework using ChatArena library [Wu et al., 2023b] for engaging LLMs in communication games like Werewolf, using retrieval and reflection on past communications for improvement, as well as the Chain-of-Thought mechanism [Wei et al., 2022].”

• cites Xu et al., 2023bNot matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites Wu et al., 2023bNot matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites Wei et al., 2022 sourceNot checked — no full text of the source

Classified as probably not a substantial claim.

As the number of agents in an LLM-MA system increases, the intricacy of ensuring effective coordination and communication rises significantly.

“For instance, with more LLM-based agents, the intricacy of ensuring effective coordination and communication rises significantly.”

• Also stated in: § 6.4 Scaling Up LLM-MA Systems · plain

  “Additionally, as the number of agents in an LLM-MA system increases, additional complexities and research opportunities emerge, particularly in areas like efficient agent coordination, communication, and understanding the scaling laws of multi-agents.”

Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based). May combine two claims.

LLM-MA systems possess the capability to tackle complex problems and simulate various aspects of the real world.

“As we have discussed, LLM-MA systems possess the capability to tackle complex problems and simulate various aspects of the real world.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Zhang et al. (2023d) explores how LLM agents with distinct traits and thinking patterns emulate human-like social behaviors such as conformity and majority rule.

“[Zhang et al., 2023d] explores how LLM agents, with distinct traits and thinking patterns, emulate human-like social behaviors such as conformity and majority rule.”

• cites Zhang et al., 2023dNot matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

Anonymous (2023) explores the buyer's inspection paradox in an information marketplace, revealing improved decision-making and answer quality when agents temporarily access information before purchase.

“[Anonymous, 2023] explores the buyer's inspec- tion paradox in an information marketplace, reveals improved decision-making and answer quality when agents temporarily access information before purchase.”

• cites Anonymous, 2023Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

May combine two claims.

Chen et al. (2023c; Chen et al., 2023a) introduce frameworks for dynamic multi-agent collaboration, while Zhou et al. (2023a); Li et al. (2023h); Xie et al. (2023) present platforms and libraries for building autonomous agents, emphasizing adaptability in task-solving and social simulations.

“More recently, [Chen et al., 2023c;Chen et al., 2023a] introduce frameworks for dynamic multi-agent collaboration, while [Zhou et al., 2023a;Li et al., 2023h;Xie et al., 2023] present platforms and libraries for building autonomous agents, emphasizing their adaptability in tasksolving and social simulations.”

• cites Chen et al., 2023cNot matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites Chen et al., 2023aNot matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites Zhou et al., 2023aNot matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

May combine two claims.

Li et al. (2023e) employs LLMs for macroeconomic simulation, featuring prompt-engineering-driven agents that emulate human-like decision-making, enhancing realism compared to rule-based or other AI agents.

“[Li et al., 2023e] employs LLMs for macroeconomic simulation, featuring prompt-engineering-driven agents that emulate human-like decision-making, thereby enhancing the realism of economic simulations compared to rule-based or other AI agents.”

• cites Li et al., 2023eNot matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing).

Li et al. (2023g) presents an LLM-MA framework for financial trading, emphasizing a layered memory system, debate mechanisms, and individualized trading characters, thereby fortifying decision-making robustness.

“[Li et al., 2023g] presents an LLM-MA framework for financial trading, emphasizing a layered memory system, debate mechanisms, and individualized trading characters, thereby fortifying decisionmaking robustness.”

• cites Li et al., 2023gNot matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

Wang et al. (2023c) focuses on LLM Agents dealing with misinformation in the Avalon game, proposing the Recursive Contemplation (ReCon) framework to enhance LLMs' ability to discern and counteract deceptive information.

“[Wang et al., 2023c] also focuses on the capabilities of LLM Agents in dealing with misinformation in the Avalon game, proposing the Recursive Contemplation (ReCon) framework to enhance LLMs' ability to discern and counteract deceptive information.”

• cites Wang et al., 2023cNot matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

Light et al. (2023b) explores the potential of LLM agents in playing Resistance Avalon, introducing AVALONBENCH, a game environment and benchmark.

“[Light et al., 2023b] explores the potential of LLM agents in playing Resistance Avalon, introducing AVALONBENCH, a comprehensive game environment and benchmark for further developing advanced LLMs and multi-agent frameworks.”

• cites Light et al., 2023bNot matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.