Multi-Agent Collaboration Mechanisms: A Survey of LLMs

Probably not a substantial claim: may not pass S4 (based).

MASs improve interaction efficiency by simultaneously managing subtasks through specialized agents, accelerating the resolution of complex, multi-step tasks.

“Lastly, MASs improve interaction efficiency by simultaneously managing subtasks through specialized agents, accelerating the resolution of complex, multi-step tasks.”

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.

The salient features of MAS, including flexibility, reliability, self-organization, and real-time operation, make it an effective solution to solve complex tasks.

“The salient features of MAS, including flexibility, and reliability, self-organization, and real-time operation make it an effective solution to solve complex tasks, which can be detailed as follows:”

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

Their efficiency stems from the division of labor inherent in MAS whereby a complex task is divided into multiple smaller tasks, each of which is assigned to a distinct agent.

“Their efficiency stems from the division of labor inherent in MAS whereby a complex task is divided into multiple smaller tasks, each of which is assigned to a distinct agent.”

Classified as probably not a substantial claim.

MAS strives to achieve collective intelligence, where the combined capabilities of multiple agents exceed the sum of their individual contributions.

“MAS strives to achieve collective intelligence, where the combined capabilities of multiple agents exceed the sum of their individual contributions [24].”

• cites [24]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

May combine two claims.

LLMs suffer from intrinsic limitations such as hallucination, autoregressive nature, and scaling laws.

“While these models have shown remarkable capabilities individually, they still suffer from intrinsic limitations such as hallucination [57], autoregressive nature (e.g., incapable of slow-thinking [49]), and scaling laws [55,69].”

• cites [57]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites [49]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites [55]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites [69]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

May combine two claims.

MASs enhance long-term planning by delegating tasks across agents, supporting persistent problem-solving over extended interactions.

“They enhance long-term planning by delegating tasks across agents, supporting persistent problem-solving over extended interactions [58].”

• cites [58]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

M2GSC uses an LLM as a shared knowledge base and has it play three critical roles: complex task decomposition, semantic representation specification, and semantic translation and mapping.

“In this framework, the LLM serves as shared knowledge base, plays three critical roles, including complex task decomposition, semantic representation specification, and semantic translation and mapping.”

• cites [145]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing).

The MMA supports synchronized generation of integrated modalities by constructing a shared multimodal space.

“This MMA supports the synchronized generation of integrated modalities by constructing a shared multimodal space.”

• cites [65]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing).

LSGLLM is an LLM-based method that incorporates a spatio-temporal module to capture spatio-temporal correlations.

“they propose LSGLLM, an LLM-based method that incorporates a spatio-temporal module to capture spatio-temporal correlations.”

• cites [112]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

May combine two claims.

Competition between LLM agents enables skills such as spatial reasoning, strategic planning, numerical reasoning, risk assessment, communication, opponent modeling, and team collaboration.

“Crucially, the authors highlight that competition between LLM agents enables skills such as spatial reasoning, strategic planning, numerical reasoning, risk assessment, communication, opponent modeling, and team collaboration.”

• cites [22]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing).

LAM-MSC incorporates a knowledge base powered by an LLM, specifically GPT-4, to enable comprehension of personal information.

“the framework incorporates a knowledge base powered by an LLM, specifically leveraging GPT-4.”

• cites [65]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S2 (checkable).

Establishing robust collaboration channels among agents is crucial for seamless collaboration.

“Effective Collaboration Channels: establishing robust collaboration channels among agents is crucial for seamless collaboration.”

Classified as probably not a substantial claim.

The survey systematically analyzes existing research on MASs to identify the defining characteristics of multi-agent collaboration.

“Our survey strategy involves systematically analyzing existing research on MASs to identify the defining characteristics of multi-agent collaboration.”

Probably not a substantial claim: may not pass S3 (load-bearing).

In mixture-of-experts, multiple expert models compete to contribute to the final output, with a gating mechanism selecting the most appropriate experts for each input.

“In MoE, multiple expert models compete to contribute to the final output, with a gating mechanism selecting the most appropriate experts for each input.”

• cites [6]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites [15]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing).

Issues such as cascading hallucinations pose challenges in sustained multi-agent interactions.

“Issues such as cascading hallucinations -where one erroneous output leads to compounding mistakes pose challenges in sustained multi-agent interactions.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

SAGE is a smart home agent with grounded execution that employs a scheme where a user request initiates a sequence of discrete actions controlled by an LLM.

“The authors in [111] propose SAGE, a smart home agent with grounded execution, which employs a scheme where a user request initiates a sequence of discrete actions controlled by an LLM.”

• cites [111]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing).

GMAC introduces a data transmission strategy based on semantic information extraction to reduce the volume of data transmitted in MASs effectively.

“GMAC [160] introduces a data transmission strategy based on semantic information extraction to reduce the volume of data transmitted in MASs effectively.”

• cites [160]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing).

LAM-MSC presents a novel application of LLMs to enhance multimodal semantic communication frameworks.

“LAM-MSC [65] presents a novel application of LLMs to enhance multimodal semantic communication frameworks.”

• cites [65]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing).

Coordinating actions between multiple agents, particularly in dynamic environments, can be difficult without well-defined collaboration channels.

“Coordinating actions between multiple agents, particularly in dynamic environments, can also be difficult without well-defined collaboration channels 𝑐 𝑖 .”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

An LLM-based IoT system using open-source LLMs deployed in a local network environment includes a prompt management module, a post-processing module, and a task-specific prompts database to address data privacy and security, system scalability, and to enhance LLM capabilities through integrated prompting methods.

“The authors in [137] propose an LLM-based IoT system using open-source LLMs deployed in a local network environment.The system includes a prompt management module, a post-processing module, and a task-specific prompts database to address concerns related to data privacy and security, system scalability, and to enhance the capabilities of the LLM through integrated prompting methods.”

• cites [137]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing).

An edge-based distributed learning architecture divides a large-scale road network into multiple subgraphs, with data and tasks assigned to individual RSUs.

“The authors in [112] present an edge-based distributed learning architecture in which a large-scale road network is divided into multiple subgraphs, with data and tasks assigned to individual RSUs.”

• cites [112]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing).

In the RIS system, the LLM is used to deduce optimized strategies for resource allocation and signal decoding order.

“In this RIS system, the LLM is used to deduce optimized strategies for resource allocation and signal decoding order.”

• cites [78]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

LAM-MSC introduces a multimodal alignment (MMA) mechanism based on a multimodal language model (MLM), utilizing CoDi for modality transformation.

“the study introduces a multimodal alignment (MMA) mechanism based on a multimodal language model (MLM), utilizing CoDi for modality transformation.”

• cites [65]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing).

Coopetition enables agents to collaborate on certain tasks to achieve shared objectives while simultaneously competing with others.

“Coopetition, a strategic blend of cooperation and competition, enables agents to collaborate on certain tasks to achieve shared objectives while simultaneously competing with others.”

Probably not a substantial claim: may not pass S4 (based).

Model-based protocols work well with uncertain or dynamic situations that demand adaptability and contextually informed decision-making.

“model-based protocols work well with uncertain or dynamic situations that demand adaptability and contextually informed decision-making.”

Probably not a substantial claim: may not pass S3 (load-bearing).

GMAC employs LLMs to achieve semantic alignment between observed states and natural language, facilitating compressed semantic communication.

“GMAC employs LLMs to achieve semantic alignment between observed states and natural language, facilitating compressed semantic communication.”

• cites [160]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

May combine two claims.

Role-based techniques improve the efficiency and structure of multi-agent systems.

“By giving each agent a specific function and set of tasks, role-based techniques improve the efficiency and structure of MASs.”

Probably not a substantial claim: may not pass S4 (based).

For tasks requiring rigorous adherence to established procedures, rule-based protocols ensure consistency and fairness by avoiding biases caused by role importance or the inherent probabilistic nature of other protocols.

“for tasks requiring rigorous adherence to established procedures, rule-based protocols ensure consistency and fairness -avoiding biases caused by role importance or inherent probabilistic nature in other protocols.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

LLM-SC utilizes LLM technology to model the semantic information of text and design a semantic communication system based on LLMs.

“LLM-SC [130] proposed a novel framework, which utilizes LLM technology to model the semantic information of text and design a semantic communication system based on LLMs”

• cites [130]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing).

MSADM is an end-to-end health management framework for dynamic heterogeneous networks.

“The authors in [121] propose MSADM, an end-to-end health management framework for dynamic heterogeneous networks.”

• cites [121]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based).

Implementing safety protocols and ethical guidelines helps prevent unintended consequences.

“Implementing safety protocols and ethical guidelines helps prevent unintended consequences.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Integrating LLMs with reconfigurable intelligent surfaces (RIS) enables energy-efficient and reliable communication in the Internet of Vehicles.

“The authors in [78] propose a novel approach that integrates LLMs with reconfigurable intelligent surfaces (RIS) to enable energy-efficient and reliable communication in the Internet of Vehicles.”

• cites [78]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

May combine two claims.

Incorporating competition into collaborative multi-agent systems can enable innovation and improve the robustness of agents' responses.

“Incorporating competition into collaborative MASs can enable innovation and improve the robustness of agents' responses.”

Probably not a substantial claim: may not pass S3 (load-bearing).

The collaboration spectrum extends beyond cooperation to include advanced mechanisms like competition and coopetition.

“While cooperation is a fundamental aspect, the collaboration spectrum extends further, encompassing advanced mechanisms like competition and coopetition.”

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

Frequent communication and multiple collaboration channels between agents can lead to increased computational cost and complexity.

“However, cooperation in MASs also presents challenges.Frequent communication and multiple collaboration channels in C between agents can lead to increased computational cost and complexity.”

May combine two claims.

LaMoSC introduces an LLM-driven multimodal fusion semantic communication system to extend unimodal transmission and improve generalization.

“LaMoSC [157] introduces an LLM-driven multimodal fusion semantic communication system to extend unimodal transmission and improve generalization.”

• cites [157]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S2 (checkable), S4 (based).

Collaboration is the key in enabling AI agents to interact and work with each other.

“Collaboration is the key in enabling AI agents to interact and work with each other.”

Probably not a substantial claim: may not pass S3 (load-bearing).

LLM-SC achieves a communication paradigm that balances both semantic-level and technical-level performance.

“LLM-SC achieves a communication paradigm that balances both semantic-level and technical-level performance.”

• cites [130]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

M2GSC spawns benefits such as semantic encoding standardization and semantic decoding personalization.

“It also spawns a series of benefits such as semantic encoding standardization and semantic decoding personalization.”

• cites [145]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing).

SAGE manages its process through a dynamically constructed tree of LLM prompts, which guide the agent in determining the next action, assessing the success of each action, and deciding when to terminate the process.

“SAGE manages this process through a dynamically constructed tree of LLM prompts, which guide the agent in determining the next action, assessing the success of each action, and deciding when to terminate the process.”

• cites [111]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S4 (based). May combine two claims.

While LLMs have shown remarkable performance in single-agent tasks, their limitations become apparent in multi-agent settings where the complexity of coordination, communication, and decision-making is higher.

“While LLMs have shown remarkable performance in single-agent tasks, their limitations become apparent in multi-agent settings where the complexity of coordination, communication, and decision-making is higher.”

Probably not a substantial claim: may not pass S3 (load-bearing).

MSADM covers all stages of the health management life cycle, including anomaly detection, fault diagnosis, and mitigation.

“MSADM covers all stages of the health management life cycle, including anomaly detection, fault diagnosis, and mitigation.”

• cites [121]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S4 (based). May combine two claims.

LLMs are not inherently designed and trained to communicate with one another, leaving a wide array of potential applications and open problems in this area.

“However, LLMs are not inherently designed and trained to communicate with one another, leaving a wide array of potential applications and open problems in this area.”

Probably not a substantial claim: may not pass S4 (based).

As the number of agents increases, maintaining coordination becomes more complex.

“as the number of agents increases, maintaining coordination becomes more complex.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

Conflicts may arise in cooperative MASs if agents interpret shared objectives differently or if situations require dynamic adaptation.

“Although cooperation is the primary goal, conflicts may arise if agents interpret shared objectives differently or if situations require dynamic adaptation.”

Probably not a substantial claim: may not pass S3 (load-bearing).

GMAC enhances bandwidth efficiency by extracting and compressing relevant information, thereby optimizing data transmission in multi-agent communication.

“This approach enhances bandwidth efficiency by extracting and compressing relevant information, thereby optimizing data transmission in multi-agent communication.”

• cites [160]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.

Incorporating multiple collaboration channels with distinct interaction types in LLM-based multi-agent systems enriches interaction dynamics and enhances the system's ability to achieve complex objectives.

“Incorporating multiple collaboration channels with distinct interaction types in LLM-based MASs enriches the interaction dynamics and enhances the system's ability to achieve complex objectives.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Bee emphasizes modularity, extensibility, and production-level control to create sophisticated MASs for a wide range of applications.

“It emphasizes modularity, extensibility, and production-level control to create sophisticated MASs for a wide range of applications, with future development aimed at enhanced multi-agent orchestration.”

• cites [6]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing).

Authors in [5,36] suggest that LLM-based agents can replace human participants in specific social science experiments.

“Authors in [5,36] suggest that LLM-based agents can replace human participants in specific social science experiments, while [88] demonstrates their use in generating diverse natural language data with iterative cross-agent refinement.”

• cites [5]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites [36]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing).

Magentic-One's core is an Orchestrator agent responsible for high-level planning, progress tracking, and dynamic re-planning to recover from errors.

“At its core is the Orchestrator agent, which is responsible for high-level planning, progress tracking, and dynamic re-planning to recover from errors.”

• cites foot_2Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

May combine two claims.

Experiments on mathematical, logical and commonsense reasoning demonstrate that self-evolving benchmarks are more challenging than the original ones, thus offering a more accurate assessment of LLMs' true capabilities and limitations, while also addressing issues like data contamination.

“Experiments conducted on mathematical, logical and commonsense reasoning demonstrate that the self-evolving benchmarks are more challenging than the original ones, thus offering a more accurate assessment of LLMs' true capabilities and limitations, while also addressing issues like data contamination.”

• cites [129]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

The handoff mechanism allows seamless transitions between agents specialized in particular tasks, thereby enhancing the system's overall efficiency and adaptability.

“This mechanism allows for seamless transitions between agents, each specialized in particular tasks, thereby enhancing the system's overall efficiency and adaptability.”

• cites foot_1Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.

Several notable frameworks recently introduced by big-tech companies pave the way for easier creation of MASs, promoting the development of such systems in practical applications.

“Several notable frameworks recently introduced by big-tech companies also pave the way for the easier creation of MASs, promoting the development of such systems in practical applications.”

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

The integration of LLMs into MASs has significantly advanced the capabilities of question answering and natural language generation.

“The integration of Large Language Models (LLMs) into MASs has significantly advanced the capabilities of question answering and natural language generation.”

Classified as probably not a substantial claim.

These frameworks improve the efficiency and effectiveness of AI systems by allowing specialized agents to work in concert.

“By allowing specialized agents to work in concert, they improve the efficiency and effectiveness of AI systems, paving the way for more sophisticated and adaptable applications.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Magentic-One's modular architecture allows for the integration of various skills, facilitating the system's adaptability to a wide range of scenarios.

“This modular architecture allows for the integration of various skills, facilitating the system's adaptability to a wide range of scenarios.”

• cites foot_2Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing).

LangChain provides a suite of tools and integrations that facilitate the creation of agents capable of complex reasoning and decision-making processes.

“LangChain provides a suite of tools and integrations that facilitate the creation of agents capable of complex reasoning and decision-making processes.”

• cites foot_4Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based). May combine two claims.

Early efforts are still in the process of being adapted and the efficacy of applying them in practice will take time to be assessed.

“It is important to recognize that these early efforts are still in the process of being adapted and that the efficacy of applying them in practice will take time to be assessed.”

Probably not a substantial claim: may not pass S3 (load-bearing).

LSGLLM addresses the absence of spatio-temporal features in traditional LLMs.

“LSGLLM addresses the absence of spatio-temporal features in traditional LLMs.”

• cites [112]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing).

Bee provides a foundation for building applications where multiple AI agents, powered by LLMs such as IBM Granite and Llama 3, collaborate to achieve complex goals.

“It provides a foundation for building applications where multiple AI agents, powered by LLMs such as IBM Granite and Llama 3, collaborate to achieve complex goals.”

• cites [6]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing).

Bee offers a modular design with prebuilt components for agents, tools, memory management, and instrumentation.

“The framework offers a modular design with prebuilt components for agents, tools, memory management, and instrumentation.”

• cites [6]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

May combine two claims.

Agent-as-a-Judge uses agentic systems to assess other agentic systems, providing detailed feedback throughout the task-solving process and mirroring human evaluation at significantly reduced cost and time.

“The core concept involves using agentic systems to assess other agentic systems, providing detailed feedback throughout the task-solving process, and mirroring human evaluation but at a significantly reduced cost and time.”

• cites [165]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing).

LangChain offers a framework for developing applications powered by language models, with a particular focus on agents.

“LangChain Agentsfoot_4 : LangChain offers a framework for developing applications powered by language models, with a particular focus on agents.”

• cites foot_4Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S4 (based).

The NLG task of synthesizing data is carried out with higher-quality training data generated from the collaboration mechanism.

“The NLG task of synthesizing the data is also carried out with higher-quality training data generated from the collaboration mechanism.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Microsoft's Magentic-One is a generalist MAS designed to address complex tasks across diverse domains.

“Microsoft's Magentic-One Systemfoot_2 : this is a generalist MAS designed to address complex tasks across diverse domains.”

• cites foot_2Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

May combine two claims.

Integrating LLM-based agents into traditional agent-based modeling can enhance the realism of simulations, offering controlled environments to test social theories, including the effects of policy interventions and norm violation detection.

“Integrating LLM-based agents into traditional agent-based modeling [48] can enhance the realism of simulations, offering controlled environments to test social theories, including the effects of policy interventions [10,148] and norm violation detection [53].”

• cites [48]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites [10]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites [148]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites [53]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based). May combine two claims.

The integration of different types and strategies of collaboration, communication structures, and orchestration architecture also needs to be considered, since most existing frameworks or systems focus primarily on role-based strategy and either centralized or decentralized structures.

“In addition, the integration of different types and strategies of collaboration, communication structures, and orchestration architecture also need to be considered, since most existing frameworks or systems are focusing primarily on role-based strategy and either centralized or decentralized structures.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Studies [3,11] argue the potential of LLMs to enhance traditional social science methods, including survey research, online experiments, automated content analyses, and agent-based modeling.

“Studies such as [3,11] argue the potential of LLMs to enhance traditional social science methods, including survey research, online experiments, automated content analyses, and agent-based modeling.”

• cites [3]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites [11]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing).

Bee supports the serialization of agent states, enabling the pausing and resuming of complex workflows without data loss.

“Notably, Bee supports the serialization of agent states, enabling the pausing and resuming of complex workflows without data loss.”

• cites [6]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

May combine two claims.

Research has shown that collaboration among LLM-based agents can elicit human-like capabilities, including conversational skills, theory of mind, Hobbesian social contract theory, and non-verbal action inference.

“Research has shown that collaboration among LLM-based agents can elicit human-like capabilities, including conversational skills, theory of mind (reasoning about others' mental states) [2,75], Hobbesian social contract theory (submit to authority to avoid chaos) [31], and non-verbal action inference [79,147].”

• cites [2]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites [75]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites [31]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites [79]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites [147]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

May combine two claims.

The shift from stand-alone LLMs to Multi-Agent Collaborative Systems can enable the analysis of LLMs in replicating individual social behavior and provide powerful tools for exploring complex social dynamics, collaborative problem-solving, and emergent collective behaviors.

“The shift from stand-alone LLMs to Multi-Agent Collaborative Systems can not only enable the analysis of LLMs in replicating individual social behavior but also provide powerful tools for exploring complex social dynamics, collaborative problem-solving, and emergent collective behaviors [46].”

• cites [46]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

Swarm's design emphasizes lightweight coordination and execution, making it suitable for scalable, real-world applications.

“Swarm's design emphasizes lightweight coordination and execution, making it suitable for scalable, real-world applications.”

• cites foot_1Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing).

CASIT generates reports through a step-by-step summary and classification mechanism.

“It generates reports through a step-by-step summary and classification mechanism.”

• cites [159]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing).

The Orchestrator delegates specific tasks to specialized agents, such as operating a web browser, navigating local files, or writing and executing Python code.

“The Orchestrator delegates specific tasks to specialized agents, such as operating a web browser, navigating local files, or writing and executing Python code.”

• cites foot_2Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

An edge agent employs an LLM to generate WebXR code, enabling visualization of corresponding 3D virtual objects on head-mounted devices and estimating multi-sensorial media data.

“an edge agent employs an LLM to generate WebXR code, enabling the visualization of corresponding 3D virtual objects on head-mounted devices and estimating multi-sensorial media data.”

• cites [114]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing).

[89] follows the definition of social interaction as a theatrical performance, with agents assuming roles driven by LLMs like GPT-4, Qwen2.5-14b, or Llama-3-8b.

“For instance, [89] follows the definition of social interaction as a theatrical performance, with agents assuming roles (e.g., office employees or family members) driven by LLMs like GPT-4, Qwen2.5-14b, or Llama-3-8b.”

• cites [89]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing).

Multimodal AI systems such as those described in [144] integrate verbal, non-verbal, and social cues as input to multi-tier collaborative agents to generate in-situ suggestions via augmented reality glasses.

“Moreover, multimodal AI systems such as those described in [144] integrate verbal, non-verbal, and social cues as input to multi-tier collaborative agents to generate in-situ suggestions via augmented reality glasses.”

• cites [144]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing).

IBM's Bee Agent Framework facilitates the development and deployment of scalable, multi-agent workflows.

“IBM's Bee Agent Framework 6 : This open-source framework facilitates the development and deployment of scalable, multi-agent workflows.”

• cites [6]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

May combine two claims.

Orca-AgentInstruct utilizes 3 distinct agentic flows (Content Transformation, Seed Instruction Generation, and Instruction Refinement) and a decentralised structure of agents in each flow.

“Ultilizing 3 distinct agentic flows (Content Transformation, Seed Instruction Generation, and Instruction Refinement) and decentralised structure of agents in each flow, it showed significant performance gains when used to fine-tune a Mistral 7B model, achieving improvements of up to 54% across various benchmarks.”

• cites [88]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing).

CASIT integrates LLMs into IoT systems to enhance the efficiency and intelligence of data processing and operations.

“CASIT [159] integrates LLMs into IoT systems to enhance the efficiency and intelligence of data processing and operations.”

• cites [159]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.

Response evaluation in QA is now done with higher confidence because MAS evaluation systems resemble human evaluation and include more dynamic evaluation with automated modified benchmarks.

“Response evaluation in QA is now done with higher confidence, since the MAS evaluation systems resemble the process of human evaluation and now includes more dynamic evaluation with automated modified benchmarks.”

May combine two claims.

Experiments demonstrate that Agent-as-a-Judge aligns closely with human expert evaluations and surpasses the performance of traditional LLM-as-a-Judge methods, especially in complex scenarios, on the DevAI benchmark with 55 realistic AI development tasks.

“Experiments demonstrate that Agent-as-a-Judge aligns closely with human expert evaluations and surpasses the performance of traditional LLM-as-a-Judge methods, especially in complex scenarios, on the DevAI benchmark with 55 realistic AI development tasks.”

• cites [165]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing).

LangChain agents are designed to interact with their environment, using tools to process information.

“These agents are designed to interact with their environment, using tools to process information.”

• cites foot_4Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing).

OpenAI's Swarm framework introduces a novel approach to orchestrating multiple agents through the concepts of routines and handoffs.

“OpenAI's Swarm Frameworkfoot_1 : this framework introduces a novel approach to orchestrating multiple agents through the concepts of routines and handoffs.”

• cites foot_1Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

May combine two claims.

These studies underscore critical limitations, such as biases in training data that lack global psychological diversity, cautioning against treating stand-alone LLMs as universal solutions.

“However, these studies also underscore critical limitations, such as biases in training data that lack global psychological diversity, cautioning against treating stand-alone LLMs as universal solutions.”

• cites [3]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites [11]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing).

Benchmark Self-Evolving employs a role-based strategy with each agent having a specific function.

“It employs the role-based strategy, with each agent having a specific function (e.g., instance pre-filter, creator and verifier, candidate option formulator).”

• cites [129]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

Assigning specific roles or specializations to individual agents can enhance the system's overall effectiveness.

“Assigning specific roles or specializations to individual agents can enhance the system's overall effectiveness.”

Probably not a substantial claim: may not pass S4 (based). May combine two claims.

LLMs suffer from known limitations such as hallucinations and are susceptible to adversarial attacks.

“They suffer from known limitations such as hallucinations and are susceptible to adversarial attacks.”

• AssumptionRests on an assumption: LLMs were not originally designed for agentic applications involving collaboration and multi-participant interactions.

Classified as probably not a substantial claim.

Through an extensive review of the collaborative aspect of LLM-based MASs, the paper introduces a structured and extensible framework as a lens to guide future research.

“Through our extensive review of the collaborative aspect of LLM-based MASs, we introduce a structured and extensible framework as an important lens to guide future research.”

Probably not a substantial claim: may not pass S2 (checkable), S4 (based).

Enabling collective intelligence through collaborations among multiple LLM-based agents offers the potential for AI systems that are adaptive, efficient, and capable of addressing real-world problems.

“Enabling collective intelligence through collaborations among multiple LLM-based agents offers the potential for AI systems that are adaptive, efficient, and capable of addressing real-world problems.”

Probably not a substantial claim: may not pass S4 (based). May combine two claims.

Current LLM-based MASs commonly utilize limited decision-making methods, such as dictatorial or popular voting, which may not capture different aspects of agent preferences, or aggregating overconfidence of LLMs.

“Current LLM-based MASs commonly utilize limited decision-making methods, such as dictatorial or popular voting, which may not capture different aspects of agent preferences, or aggregating overconfidence of LLMs.”

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

Managing resources, coordination and collaboration channels among a growing number of agents introduces additional complexities, such as maintaining efficiency in agent interactions and preventing bottlenecks.

“Managing resources (memory, processing time), coordination and collaboration channels among a growing number of agents introduces additional complexities, such as maintaining efficiency in agent interactions and preventing bottlenecks.”

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

Complex, emergent behaviors of collective intelligence, such as coordinated problem-solving or innovation, can arise under the right conditions, especially in generalizing to unseen domains.

“Complex, emergent behaviors of collective intelligence, such as coordinated problem-solving or innovation, can arise under the right conditions, especially in generalizing to unseen domains.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

LLM-based MASs can represent diverse cultural perspectives, advancing cross-cultural understanding and reducing bias.

“LLM-based MASs can represent diverse cultural perspectives, advancing cross-cultural understanding and reducing bias.”

Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing). May combine two claims.

Overlooking these limitations not only undermines informed decision-making but also introduces broader ethical concerns regarding the responsible deployment and use of LLM-based MASs.

“Overlooking these limitations not only undermines informed decision-making but also introduces broader ethical concerns 10 regarding the responsible deployment and use of LLM-based MASs.”

May combine two claims.

The CulturePark framework simulates cross-cultural interactions, with each agent embodying distinct cultural viewpoints.

“For example, the CulturePark framework [73] simulates cross-cultural interactions, with each agent embodying distinct cultural viewpoints.”

• cites [73]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

May combine two claims.

LLMs are vulnerable to adversarial attacks, which make MASs particularly attractive targets for exploitation.

“Additionally, LLMs are vulnerable to adversarial attacks, which make MASs particularly attractive targets for exploitation [115].”

• cites [115]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S4 (based). May combine two claims.

The proposed framework is flexible, accommodating previous approaches and enabling the analysis of diverse MASs under a unified structure.

“Our framework is flexible, accommodating previous approaches and enabling the analysis of diverse MASs under a unified structure.”

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.

As the number of agents in LLM-based MAS increases, these risks scale proportionally, compromising the safety and reliability of communication and information exchange.

“As the number of agents in LLMbased MAS increases, these risks scale proportionally, compromising the safety and reliability of communication and information exchange.”

May combine two claims.

Two key factors behind the amplification of LLM issues in MASs are the LLM overconfidence problem, where LLMs persistently assert the correctness of their outputs despite inaccuracies, and misunderstandings that arise between LLM-based agents during collaboration.

“There are two key factors behind this amplification: LLM overconfidence problem, where LLMs persistently assert the correctness of their outputs despite inaccuracies [151], and misunderstandings that arise between LLM-based agents during collaboration.”

• cites [151]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based).

Understanding the scaling laws of the behavior and performance of MASs is critical for designing architectures capable of handling large-scale collaboration.

“Understanding the scaling laws of the behavior and performance of MASs is critical for designing architectures capable of handling large-scale collaboration.”

Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).

Collective intelligence is the ability of a group to perform complex tasks and solve problems collectively, often overcoming the sum of individual contributions.

“Collective intelligence is the ability of a group to perform complex tasks and solve problems collectively, often overcoming the sum of individual contributions [71].”

• cites [71]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Classified as probably not a substantial claim.

The framework characterizes collaboration along five key dimensions: actors, types, structures, strategies, and coordination mechanisms.

“Our framework characterizes collaboration along five key dimensions: actors, types, structures, strategies, and coordination mechanisms, providing a systematic approach to analyze and design collaborative interactions within MASs empowered by LLMs.”

Probably not a substantial claim: may not pass S2 (checkable), S4 (based).

Unified governance is fundamental in enabling collective intelligence among a group of LLM-based agents, including the design of coordination and planning mechanisms.

“Unified governance is fundamental in enabling collective intelligence among group of LLM-based agents, including the design of coordination and planning mechanisms.”

May combine two claims.

Static evaluation benchmarks risk becoming lacking in relevance to current real-world scenarios, leading to data leakage and overfitting.

“Moreover, static evaluation benchmarks risk becoming lack of relevance to current real-world scenarios, leading to data leakage and overfitting [102].”

• cites [102]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

May combine two claims.

Recent studies have highlighted the potential for AI systems to deceive humans, raising significant concerns in the context of LLM-based multi-agent collaborative systems.

“Recent studies have also highlighted the potential for AI systems to deceive humans, raising significant concerns in the context of LLM-based multi-agent collaborative systems [7,35,84].”

• cites [7]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites [35]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites [84]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

May combine two claims.

LLMs are not perfect replicas of humans and cannot fully replicate the complexities of human social and cultural behavior.

“Despite their promise, LLMs are not perfect replicas of humans and cannot fully replicate the complexities of human social and cultural behavior.”

Probably not a substantial claim: may not pass S4 (based).

A single agent's hallucination can be spread and reinforced by other agents, leading minor inaccuracies into critical and cascading effects.

“A single agent's hallucination can be spread and reinforced by other agents, leading to minor inaccuracies into critical and cascading effects.”

May combine two claims.

This perception can increase susceptibility to manipulation and obscure the inherent limitations of LLM-based agents.

“This perception can increase susceptibility to manipulation and obscure the inherent limitations of LLMbased agents [161].”

• cites [161]Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

Increasing agent population poses a significant challenge in MASs.

“Increasing agent population poses a significant challenge in MASs.”