Cited by 1Artificial Intelligence in Healthcare and EducationMulti-Agent Systems and NegotiationBiomedical Text Mining and Ontologies

A Review of Multi-Agent AI Systems for Biological and Clinical Data Analysis

Open access
Spieser, Jackson, Balapour, Ali, Meller, Jarek, Patra, Krushna C., Shamsaei, Behrouz·2026·Methods and Protocols

Abstract

This review evaluates the emerging paradigm of multi-agent systems (MASs) for biomedical and clinical data analysis, focusing on their ability to overcome the reasoning and reliability limitations of standalone large language models (LLMs). We synthesize findings from recent architectural frameworks, specifically LangGraph, CrewAI, and the Model Context Protocol (MCP), to examine how specialized agent teams divide labor, utilize precision tools, and cross-verify outputs. We find that MAS architectures yield significant performance gains in various domains: recent implementations improved oncology decision-making accuracy from 30.3% to 87.2% and reached a peak of 93.2% accuracy on USMLE-style benchmarks through simulated clinical evolution. In clinical trial matching, multi-agent frameworks achieved 87.3% accuracy and enhanced clinician screening efficiency by 42.6% (p < 0.001). However, we also highlight critical operational challenges, including an unreliability tax of 15–50× higher token consumption compared to standalone models and the risk of cascading errors where initial hallucinations are amplified across the agent collective. We conclude that while MAS enables a shift toward collaborative intelligence in biomedicine, its clinical and research adoption requires the development of deterministic orchestration and rigorous cost-utility frameworks to ensure safety and expert-centered oversight.

Verified 2026-10-07 · 14 references not checked yet

AI snapshot

Written from the paper’s full text.

TL;DR

This review synthesizes multi-agent AI systems (MAS) for biomedical and clinical data analysis, arguing that orchestration across specialized agents can improve accuracy, reliability, and explainability over standalone LLMs. It also highlights major operational costs, cascading-error risks, and the need for deterministic orchestration, safety guardrails, and real-world validation.

Key findings

  • In oncology decision-making, an MAS improved decision “completeness” from 30.3% (33/109) with GPT-4 alone to 87.2% (95/109); it used appropriate tools with 87.5% accuracy (56/64) and reached correct clinical conclusions in 91.0% of assessed statements (223/245), though 2.4% (6/245) of statements were flagged as potentially harmful.
  • In clinical trial matching, TrialGPT achieved 87.3% criterion-level accuracy, 90.1% precision and 87.9% recall for supporting sentences, and an AUROC of 0.7979—a 43.8% improvement over BioLinkBERT (AUROC 0.6176); clinicians assisted by TrialGPT completed screening 42.6% faster (35.3 s vs. 61.5 s; p < 0.001).
  • Agent Hospital/MedAgent-Zero reached 92.22% on MedQA (USMLE-style), outperforming GPT-4o (90.65%, p < 0.001) and standard CoT (90.42%); in cardiology, rheumatic heart disease diagnostic accuracy improved from a 9% GPT-3.5 baseline to 82% after about ten thousand simulated patients. The abstract also reports a peak of 93.2% accuracy on USMLE-style benchmarks through simulated clinical evolution.
  • MAS face an “unreliability tax” of 15–50× higher token consumption than standalone models; the MAC framework used over 6000 tokens versus 118 for standard prompting, and cascading errors can amplify initial hallucinations across agents.

Methods

  • This is a narrative literature review, not a primary experimental study. The authors searched PubMed, arXiv, ACM, and IEEE Xplore, initially covering approximately 2019–2025 and extending through 2026 via iterative manual screening of emerging preprints and recent articles.
  • Inclusion required implementation of a multi-agent AI system where multiple autonomous agents collaborated or coordinated; single-LLM studies were excluded unless integrated into a larger multi-agent framework. Studies reporting performance or utility improvements over single-agent baselines were prioritized.
  • Regulatory frameworks from bodies such as the FDA and HHS were updated through March 2025. The review synthesizes architectures, applications, platforms, benchmarks, challenges, and future directions across basic science and clinical domains.

Limitations

  • The paper states that rapid field evolution may mean relevant post-cutoff results, especially preprints, were missed; many summarized studies evaluate MAS on benchmarks or simulated scenarios rather than live clinical environments; heterogeneity in datasets, agent configurations, and outcome metrics prevents direct cross-system comparison; and the LLM-centric focus only partially represents other paradigms such as multi-agent reinforcement learning or symbolic agent systems.
  • The review itself notes publication bias toward success stories and cautions that simple ensembling or majority voting may account for some gains attributed to complex agent interactions.
  • Evident from the text: some key evidence comes from small or synthetic evaluations—for example, the oncology validation used 20 multimodal patient cases, and TrialGPT was evaluated on synthetic patient records—so reported gains may not translate directly to real hospital data and workflows.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.3390/mps9020033

Cites

65 of 89 references verified0 citation errors · 10 not checkable

Statistics

Nothing to recompute.

Claims the paper makes

123 of 154 cited sources checked · 48 supported · 0 flagged · accuracy not yet measured

  • Premisecitation

    MAS, in which multiple autonomous agents collaborate as a team, are emerging as a powerful paradigm for biomedical and clinical data analysis.

    “MAS, in which multiple autonomous agents collaborate as a team, are emerging as a powerful paradigm for biomedical and clinical data analysis [1,2].”
    Quote in the paperSubstantial claim2 of 2 sources checked
    • cites [1] Wang, L., Ma, C., Feng, X., Zhang, Z., Yang, H., Zhang, J., Chen, Z., Tang, J., Chen, X., and Lin, Y. (2024). A survey on large language model based autonomous agents. Front. Comput. Sci., 18. source

      The Computer science & software engineering section describes multiple autonomous agents collaborating as a virtual team, supporting the description of MAS. The Natural science section discusses agents assisting research and managing scientific information, but our copy does not establish that multi-agent teams are emerging as a powerful paradigm specifically for biomedical and clinical data analysis; searches for those terms found no such passage. The passages have no page numbers in our copy. (LLM, conf=0.86)

      Experimental — accuracy not yet measured
    • cites [2] Li, 2024, A survey on LLM-based multi-agent systems: Workflow, infrastructure, and challenges, Vicinagearth source

      Section 2.2 describes MAS as multiple autonomous agents that can collaborate. Section 5.2 discusses analyzing patients’ health records to support diagnosis and treatment, but presents healthcare as a future application. It does not establish that MAS are already emerging as a powerful paradigm across biomedical and clinical data analysis. Page numbers are unavailable in our copy. (LLM, conf=0.84)

      Experimental — accuracy not yet measured
  • Premisecitation

    In various domains, genomics, electronic health records, imaging, and beyond, MAS approaches have already demonstrated improved performance, reliability, and explainability compared to single-agent methods.

    “In various domains, genomics, electronic health records, imaging, and beyond, MAS approaches have already demonstrated improved performance, reliability, and explainability compared to single-agent methods.”
    Quote in the paperSubstantial claim1 of 2 sources checked
    • cites [1] Wang, L., Ma, C., Feng, X., Zhang, Z., Yang, H., Zhang, J., Chen, Z., Tang, J., Chen, X., and Lin, Y. (2024). A survey on large language model based autonomous agents. Front. Comput. Sci., 18. source

      The Computer science & software engineering section (page unavailable) describes multi-agent collaboration that enhances code-output quality, and the Industrial automation section says multi-agent evaluation holds promise for greater credibility. The cited passages do not establish demonstrated improvements in genomics, electronic health records, or imaging, nor do they show improvements in performance, reliability, and explainability compared with single-agent methods. (LLM, conf=0.84)

      Experimental — accuracy not yet measured
    • cites [4] Gao, 2024, Empowering biomedical discovery with AI agents, Cell source
  • Premisecitation

    Collaborative agent teams have produced superior results on complex bioinformatics analyses and clinical decision support challenges where no single model excels.

    “collaborative agent teams have produced superior results on complex bioinformatics analyses and clinical decision support challenges where no single model excels [1,4].”
    Quote in the paperSubstantial claim1 of 2 sources checked
    • cites [1] Wang, L., Ma, C., Feng, X., Zhang, Z., Yang, H., Zhang, J., Chen, Z., Tang, J., Chen, X., and Lin, Y. (2024). A survey on large language model based autonomous agents. Front. Comput. Sci., 18. source

      The Computer science & software engineering section describes collaborative agent teams completing coding tasks and improving software output; the Natural science section describes agents assisting scientific research. Neither section reports superior results in bioinformatics analyses or clinical decision support, or compares teams with single models in those settings (searched: bioinformatics, clinical decision support, and single-agent comparisons). Page numbers were unavailable in our copy. (LLM, conf=0.83)

      Experimental — accuracy not yet measured
    • cites [4] Gao, 2024, Empowering biomedical discovery with AI agents, Cell source
  • Premisecitation

    LLM-based autonomous agents can achieve greater flexibility and robustness by dividing labor among sub-agents.

    “LLM-based autonomous agents can achieve greater flexibility and robustness by dividing labor among sub-agents [1,3].”
    Quote in the paperSubstantial claim1 of 2 sources checked
    • cites [1] Wang, L., Ma, C., Feng, X., Zhang, Z., Yang, H., Zhang, J., Chen, Z., Tang, J., Chen, X., and Lin, Y. (2024). A survey on large language model based autonomous agents. Front. Comput. Sci., 18. source

      The Computer science & software engineering section describes multiple LLM agents taking distinct roles or subtasks and collaborating, which supports the division-of-labor part of the claim. It reports benefits for software development, including improved code quality, but does not say that dividing labor makes agents more flexible or robust. (LLM, conf=0.84)

      Experimental — accuracy not yet measured
    • cites [3] Xi, 2025, The rise and potential of large language model based agents: A survey, Sci. China Inf. Sci. source
  • Premisecitation

    In a validation study of 20 realistic multimodal patient cases focused on gastrointestinal oncology, the MAS autonomously used appropriate tools with 87.5% accuracy (56 out of 64 required invocations).

    “The MAS autonomously utilized appropriate tools with 87.5% accuracy (56 out of 64 required invocations)”
    Quote in the paperSubstantial claim1 of 1 sources checked
    • cites [34] Ferber, 2025, Development and validation of an autonomous artificial intelligence agent for clinical decision-making in oncology, Nat. Cancer source
  • Classified as probably not a substantial claim. 93
  • May combine two claims. 50
  • The quote only partly states this claim. 4
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    LangGraph models a multi-agent system as a stateful graph, giving developers fine-grained control over execution paths.

    “LangGraph, which models a multi-agent system as a stateful graph, giving developers fine-grained control over execution paths.”
    Quote in the paperNot a substantial claim1 of 1 sources checked
    • cites [14] Derouiche, H., Brahmi, Z., and Mezni, H. (2025). Agentic AI Frameworks: Architectures, Protocols, and Design Challenges. arXiv. source

      The Comparative overview (p. 4) describes LangGraph as a graph-based model for sequencing tasks among LLM agents, with compositional flows and stateful operations. The Memory section (p. 5) also describes stateful graph nodes. The paper does not specifically attribute fine-grained developer control over execution paths to LangGraph; its explicit fine-grained-control description refers to Semantic Kernel. (LLM, conf=0.83)

      Experimental — accuracy not yet measured
  • May combine two claims.

    Premisecitation

    The virtual tumor board system leverages GPT-4 as a core reasoning engine and incorporates specialized precision oncology tools, including vision transformers for detecting microsatellite instability (MSI) and mutations (KRAS, BRAF) from histopathology slides, MedSAM for radiological image segmentation, and web-based search tools like OncoKB and PubMed.

    “The system leverages GPT-4 as a core reasoning engine and incorporates specialized precision oncology tools, including vision transformers for detecting microsatellite instability (MSI) and mutations (KRAS, BRAF) from histopathology slides, MedSAM for radiological image segmentation, and web-based search tools like OncoKB and PubMed [34].”
    Quote in the paperNot a substantial claim1 of 1 sources checked
    • cites [34] Ferber, 2025, Development and validation of an autonomous artificial intelligence agent for clinical decision-making in oncology, Nat. Cancer source
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Modern agent frameworks often implement a shared knowledge store or blackboard that agents can read from and write to during collaboration.

    “Modern agent frameworks often implement a shared knowledge store or blackboard that agents can read from and write to during collaboration [16].”
    Quote in the paperNot a substantial claim1 of 1 sources checked
    • cites [16] Joshi, 2025, Review of autonomous systems and collaborative AI agent frameworks, Int. J. Sci. Res. Arch. source

      Section 5.3, “Multi-Agent Systems for Collaborative Problem Solving” (page not provided), discusses collaborative frameworks and proposes that future systems enable agents to share knowledge. It does not say that modern frameworks often implement a shared store or blackboard that agents read from and write to. (LLM, conf=0.82)

      Experimental — accuracy not yet measured
  • Classified as probably not a substantial claim. May combine two claims.

    Premisecitation

    MAS orchestration frameworks provide the infrastructure and design patterns to build systems where multiple AI agents collaborate and solve data-analysis problems more effectively than any individual agent alone.

    “MAS orchestration frameworks provide the infrastructure and design patterns (messaging systems, shared memory stores, standardized agent interfaces, etc.) to build systems where multiple AI agents collaborate and solve data-analysis problems more effectively than any individual agent alone [9,16].”
    Quote in the paperSubstantial claim2 of 2 sources checked
    • cites [9] Adimulam, A., Gupta, R., and Kumar, S. (2026). The Orchestration of Multi-Agent Systems: Architectures, Protocols, and Enterprise Adoption. arXiv. source

      Sections III and IV describe orchestration infrastructure, communication protocols, and specialized agents working together; Section IV says their outcomes can surpass those of a single general-purpose agent. Section VIII gives a data-intensive insurance example, but the paper does not establish that orchestrated agents solve data-analysis problems generally more effectively than any individual agent alone. Page numbers are unavailable in our copy. (LLM, conf=0.82)

      Experimental — accuracy not yet measured
    • cites [16] Joshi, 2025, Review of autonomous systems and collaborative AI agent frameworks, Int. J. Sci. Res. Arch. source

      Sections 2.1 and 5.3 (pages unavailable) describe orchestration frameworks and multi-agent systems for collaborative problem-solving. They do not establish that agents solve data-analysis problems more effectively than an individual agent, and the cited passages do not specify the messaging, shared-memory, or standardized-interface features in the printed sentence. (LLM, conf=0.86)

      Experimental — accuracy not yet measured
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    In 2023, Google introduced an Agent-to-Agent (A2A) communication protocol as an open standard for LLM-based agents to exchange messages in a structured, secure manner.

    “Notably, in 2023, Google introduced an Agent-to-Agent (A2A) communication protocol as an open standard for LLM-based agents to exchange messages in a structured, secure manner [25,26].”
    Quote in the paperNot a substantial claim1 of 2 sources checked
    • cites [25] Louck, Y., Stulman, A., and Dvir, A. (2025). Improving Google A2A Protocol: Protecting Sensitive Data and Mitigating Unintended Harms in Multi-Agent Systems. arXiv. source

      The Introduction and Related Work (p. 1) describe Google’s A2A as a structured, secure framework for communication between agents. They do not call A2A an open standard, and the paper’s References (p. 12) date the cited announcement of the protocol to April 2025, not 2023. (LLM, conf=0.88)

      Experimental — accuracy not yet measured
    • cites [26] Surapaneni, R., Jha, M., Vakoc, M., and Segal, T. (2025, October 01). Announcing the Agent2Agent Protocol (A2A)—A New Era of Agent Interoperability. Google for Developers Blog. Available online: https://developers.googleblog.com/en/a2a-a-new-era-of-agent-interoperability/.

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Various feedback and self-correction techniques have been introduced to improve LLM reliability, such as Reflexion and Self-Refine.

    “various feedback and self-correction techniques have been introduced to improve LLM reliability, such as Reflexion and Self-Refine [21,22].”
    Quote in the paperNot a substantial claim2 of 2 sources checked
    • cites [21] Shinn, N., Labash, M.F., and Tran, T. (2023). Reflexion: Language agents with verbal reinforcement learning. arXiv. source
    • cites [22] Madaan, 2023, Self-refine: Iterative refinement with self-feedback, Adv. Neural Inf. Process. Syst. source
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Interpretationcitation

    Su et al. report relative improvements but do not specify exact percentage deltas; therefore, we treat this as illustrative, pending peer-reviewed, fully quantified results.

    “It is important to note that Su et al. report relative improvements but do not specify exact percentage deltas; therefore, we treat this as illustrative, pending peer-reviewed, fully quantified results.”
    Quote in the paperNot a substantial claim1 of 1 sources checked
    • cites [32] Su, H., Long, W., and Zhang, Y. (2025). BioMaster: Multi-agent system for automated bioinformatics analysis workflows. bioRxiv. source
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Methods such as Toolformer showed that LLMs can learn to call external APIs to aid in problem-solving.

    “methods such as Toolformer showed that LLMs can learn to call external APIs to aid in problem-solving [18].”
    Quote in the paperNot a substantial claim1 of 1 sources checked
    • cites [18] Schick, T., Dwivedi-Yu, J., Dessì, R., Raileanu, R., Lomeli, M., Hambro, E., and Scialom, T. (2023). Toolformer: Language models can teach themselves to use tools. arXiv. source
  • May combine two claims.

    Premisecitation

    In benchmarked evaluations, TxAgent achieved 92.1% accuracy on DrugPC (open-ended drug reasoning), and 93.6%/93.7% on BrandPC/GenericPC, outperforming GPT-4o and other tool-use LLMs across 3168 drug reasoning tasks and 456 personalized treatment scenarios.

    “In benchmarked evaluations, TxAgent achieved 92.1% accuracy on DrugPC (open-ended drug reasoning), and 93.6%/93.7% on BrandPC/GenericPC, outperforming GPT-4o and other tool-use LLMs across 3168 drug reasoning tasks and 456 personalized treatment scenarios.”
    Quote in the paperNot a substantial claim1 of 1 sources checked
    • cites [31] Gao, S., Zhu, R., Kong, Z., Noori, A., Su, X., Ginder, C., and Zitnik, M. (2025). TxAgent: An AI agent for therapeutic reasoning across a universe of tools. arXiv. source
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    An analysis of the A2A framework identified potential attack vectors (e.g., prompt injection, token reuse, agent impersonation) and emphasized the need for agent authentication and permission controls.

    “An analysis of the A2A framework identified potential attack vectors (e.g., prompt injection, token reuse, agent impersonation) and emphasized the need for agent authentication and permission controls [27].”
    Quote in the paperNot a substantial claim1 of 1 sources checked
    • cites [27] Zhang, Z., Cui, S., Lu, Y., Zhou, J., Yang, J., Wang, H., and Huang, M. (2024). Agent-SafetyBench: Evaluating the safety of multi-agent AI systems. arXiv. source

      The Failure Mode Analysis (§4.3; page not provided) discusses tool-use robustness and risk awareness, not an analysis of the A2A framework. Searches for A2A, token reuse, agent impersonation, and authentication found no passage addressing the claimed attack vectors or proposed controls. (LLM, conf=0.76)

      Experimental — accuracy not yet measured
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    An agent team can adopt a self-consistency approach where multiple agents independently work on the same problem and then vote or converge on an answer.

    “an agent team can adopt a self-consistency approach where multiple agents independently work on the same problem and then vote or converge on an answer [19].”
    Quote in the paperNot a substantial claim1 of 1 sources checked
    • cites [19] Wang, X., Wei, J., Schuurmans, D., Le, Q., Chi, E., Narang, S., and Zhou, D. (2022). Self-consistency improves chain-of-thought reasoning in language models. arXiv. source

      The Table 5 passage (section E.4; page not provided) reports a self-consistency variant using five responses per question, supporting the idea of multiple attempts at the same problem. It does not describe independent agents working as a team or say that they vote or converge on an answer. (LLM, conf=0.82)

      Experimental — accuracy not yet measured
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    In an MAS context, guardrails can be implemented by assigning a dedicated critic or reviewer agent to evaluate and correct the outputs of other agents.

    “In an MAS context, such guardrails can be implemented by assigning a dedicated critic or reviewer agent to evaluate and correct the outputs of other agents [23,24].”
    Quote in the paperNot a substantial claim2 of 2 sources checked
    • cites [23] Wang, T., Yu, P., Tan, X.E., O’Brien, S., Pasunuru, R., Dwivedi-Yu, J., and Celikyilmaz, A. (2023). Shepherd: A Critic for Language Model Generation. arXiv. source

      The Introduction describes Shepherd as a dedicated model that critiques another model’s outputs, identifies errors, and suggests actionable refinements (page not specified). It does not describe an MAS guardrail implementation or show Shepherd directly correcting other agents’ outputs; those parts extend beyond the paper. (LLM, conf=0.86)

      Experimental — accuracy not yet measured
    • cites [24] He, 2025, Llm-based multi-agent systems for software engineering: Literature review, vision, and the road ahead, ACM Trans. Softw. Eng. Methodol. source
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Agents can implement a Tree-of-Thoughts strategy, collectively exploring different reasoning branches in parallel and exchanging information to decide on the best path forward.

    “Agents can also implement a Tree-of-Thoughts strategy, collectively exploring different reasoning branches in parallel and exchanging information to decide on the best path forward [18,20].”
    Quote in the paperNot a substantial claim2 of 2 sources checked
    • cites [18] Schick, T., Dwivedi-Yu, J., Dessì, R., Raileanu, R., Lomeli, M., Hambro, E., and Scialom, T. (2023). Toolformer: Language models can teach themselves to use tools. arXiv. source

      The Introduction describes a language model choosing when to use tools, and Section 4.2 describes its zero-shot evaluation. Neither those passages nor searches for Tree-of-Thoughts, parallel reasoning branches, and agents exchanging information found a passage addressing the attributed strategy. Our copy therefore does not verify this claim. (LLM, conf=0.76)

      Experimental — accuracy not yet measured
    • cites [20] Yao, S., Yu, D., Zhao, J., Shafran, I., Griffiths, T., Cao, Y., and Narasimhan, K. (2023). Tree of Thoughts: Deliberate Problem Solving with Large Language Models. arXiv. source

      The Introduction and Section 5 describe Tree of Thoughts as exploring multiple reasoning paths and evaluating which to pursue. They describe language-model self-evaluation, not multiple agents collectively exploring branches or exchanging information; those parts of the attributed claim are unsupported. (LLM, conf=0.88)

      Experimental — accuracy not yet measured
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    CrewAI organizes a multi-agent system as a team of role-based agents-Planner, Executor, Researcher, Reviewer, and Critic-who collaborate through structured but adaptive message exchanges.

    “CrewAI, by contrast, organizes a multi-agent system as a team of role-based agents—Planner, Executor, Researcher, Reviewer, and Critic—who collaborate through structured but adaptive message exchanges.”
    Quote in the paperNot a substantial claim1 of 1 sources checked
    • cites [14] Derouiche, H., Brahmi, Z., and Mezni, H. (2025). Agentic AI Frameworks: Architectures, Protocols, and Design Challenges. arXiv. source

      The Comparative overview (p. 3) describes CrewAI as promoting role-based collaboration, coordination, and delegation among agents. It does not identify the five named roles or describe CrewAI’s collaboration as structured but adaptive message exchanges. The Limitations section (p. 6) instead notes that predefined roles in CrewAI cannot easily change during execution. (LLM, conf=0.86)

      Experimental — accuracy not yet measured
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    CrewAI leverages agent autonomy and role specialization to coordinate tasks dynamically based on the evolving problem state.

    “Rather than enforcing a predefined graph, CrewAI leverages agent autonomy and role specialization to coordinate tasks dynamically based on the evolving problem state [14].”
    Quote in the paperNot a substantial claim1 of 1 sources checked
    • cites [14] Derouiche, H., Brahmi, Z., and Mezni, H. (2025). Agentic AI Frameworks: Architectures, Protocols, and Design Challenges. arXiv. source

      The Comparative overview (p. 3) describes CrewAI as promoting role-based collaboration, coordination, and delegation, supporting the role-specialization part of the claim. But Limitations and Challenges (p. 6) says CrewAI’s predefined roles limit adaptability during execution and that agent interactions are often statically defined; it does not support the claim that CrewAI coordinates tasks dynamically as the problem evolves. (LLM, conf=0.86)

      Experimental — accuracy not yet measured
  • May combine two claims.

    Premisecitation

    Qualitatively, the dialogues revealed that agents effectively introduced diverse perspectives, such as identifying rare syndromes or flagging lab abnormalities that contradicted specific hypotheses, leading to a more thorough analysis than a single model's monologue.

    “Qualitatively, the dialogues revealed that agents effectively introduced diverse perspectives, such as identifying rare syndromes or flagging lab abnormalities that contradicted specific hypotheses, leading to a more thorough analysis than a single model’s monologue.”
    Quote in the paperSubstantial claim1 of 1 sources checked
    • cites [35] Chen, 2025, Enhancing diagnostic capability with multi-agent conversational LLMs, npj Digit. Med. source

      Split into 2 atoms — 1 confirmed, 1 partially supported, 0 disputed, 0 misattributed, 0 unverifiable. Expand the claim to see per-atom verdicts.

      Experimental — accuracy not yet measured
  • May combine two claims.

    Premisecitation

    Token consumption for MAS reached over 6000 tokens compared to just 118 for standard input/output prompting.

    “token consumption for MAS reached over 6000 tokens compared to just 118 for standard input/output prompting”
    Quote in the paperSubstantial claim1 of 1 sources checked
    • cites [35] Chen, 2025, Enhancing diagnostic capability with multi-agent conversational LLMs, npj Digit. Med. source

      The Results section, “Comparison with other methods to improve diagnostic performance” (page unavailable), says MAC produced the highest average output tokens, and the Methods section identifies Input/Output prompting as a comparison method. Our copy does not give the claimed figures of over 6,000 and 118 tokens, so the numerical comparison is unsupported. (LLM, conf=0.85)

      Experimental — accuracy not yet measured
  • The quote only partly states this claim.

    Premisecitation

    MAC's 34.11% primary accuracy beat Self-Refine (32.01%).

    “Self-Refine (32.01%)”
    Quote in the paperNot a substantial claim1 of 1 sources checked
    • cites [35] Chen, 2025, Enhancing diagnostic capability with multi-agent conversational LLMs, npj Digit. Med. source

      Table 1 in Results reports 34.11% accuracy for MAC’s most likely diagnosis in primary consultation. The Results comparison says MAC outperformed Self-Refine, but our copy does not give Self-Refine’s claimed 32.01%; it directs readers to Supplementary Table 12 for those results. (LLM, conf=0.84)

      Experimental — accuracy not yet measured
  • May combine two claims.

    Premisecitation

    The multi-agent approach significantly outperformed single-model baselines in both initial diagnosis and follow-up consultations.

    “The multi-agent approach significantly outperformed single-model baselines in both initial diagnosis and follow-up consultations.”
    Quote in the paperSubstantial claim1 of 1 sources checked
    • cites [35] Chen, 2025, Enhancing diagnostic capability with multi-agent conversational LLMs, npj Digit. Med. source
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    TrialGPT-Retrieval conducts a large-scale search to retrieve candidate trials from databases based on a patient's profile.

    “TrialGPT-Retrieval, first conducts a large-scale search to retrieve candidate trials from databases based on a patient’s profile”
    Quote in the paperNot a substantial claim1 of 1 sources checked
    • cites [36] Jin, 2024, Matching patients to clinical trials with large language models, Nat. Commun. source
  • May combine two claims.

    Premisecitation

    In Chen et al.'s system, four AI doctor agents, each with a specialized knowledge focus or reasoning style, discuss a patient case, while a fifth agent acts as a supervisor to coordinate the conversation.

    “four AI “doctor” agents, each with a specialized knowledge focus or reasoning style, discuss a patient case, while a fifth agent acts as a supervisor to coordinate the conversation”
    Quote in the paperNot a substantial claim1 of 1 sources checked
    • cites [35] Chen, 2025, Enhancing diagnostic capability with multi-agent conversational LLMs, npj Digit. Med. source

      The Methods (Study design) and Results (Fig. 2 caption; pages unavailable) describe three doctor agents discussing a case with one coordinating supervisor, not four doctors and a fifth supervisor. The Methods (Subgroup analysis within MAC) describe assigning specialties as a tested variation; the Results say the standard configuration had no assigned specialties. The supervisor’s coordinating role is supported, but the claimed agent count and characterization of every doctor as specialized are not. (LLM, conf=0.90)

      Experimental — accuracy not yet measured
  • May combine two claims.

    Premisecitation

    Helpfulness rate for recommended further diagnostic tests reached 78.26%, an improvement over the GPT-4 baseline of 58.17% (p < 0.001).

    “The helpfulness rate for recommended further diagnostic tests reached 78.26%, a marked improvement over the GPT-4 baseline of 58.17% (p < 0.001).”
    Quote in the paperSubstantial claim1 of 1 sources checked
    • cites [35] Chen, 2025, Enhancing diagnostic capability with multi-agent conversational LLMs, npj Digit. Med. source

      Table 1 in Results reports a 78.26% helpful rate for further diagnostic tests with the four-agent GPT-4 framework, versus 58.17% for standalone GPT-4, in primary consultations. The Results describe MAC’s improvement as significant, but our copy does not give p < 0.001 for this specific comparison; it also limits these figures to primary consultations. (LLM, conf=0.88)

      Experimental — accuracy not yet measured
  • The quote only partly states this claim.

    Premisecitation

    MAC's 34.11% primary accuracy beat Self-Consistency (32.45%).

    “and Self-Consistency (32.45%) methods”
    Quote in the paperNot a substantial claim1 of 1 sources checked
    • cites [35] Chen, 2025, Enhancing diagnostic capability with multi-agent conversational LLMs, npj Digit. Med. source

      In Results, Table 1 reports 34.11% primary-consultation accuracy for MAC with GPT-4 and four doctor agents. The same table assigns 32.45% to MAC with three doctor agents, not to Self-Consistency. The Results comparison says MAC outperformed Self-Consistency, but our copy does not substantiate the claimed 32.45% figure for Self-Consistency. (LLM, conf=0.90)

      Experimental — accuracy not yet measured
  • May combine two claims.

    Study design and conductreasoning

    The study's reliance on a small sample size (n = 20) and proprietary cloud-based models limits its generalizability and clinical robustness.

    “the study’s reliance on a small sample size (n = 20) and proprietary cloud-based models suggests that future research must prioritize large-scale prospective evaluations and the development of local, open-source architectures”
    Quote in the paperSubstantial claim1 of 1 sources checked
    • cites [34] Ferber, 2025, Development and validation of an autonomous artificial intelligence agent for clinical decision-making in oncology, Nat. Cancer source
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    The authors trained agents using 20,000 simulated patient encounters per task, evaluating them on a test set of 200 cases.

    “The authors trained agents using 20,000 simulated patient encounters per task, evaluating them on a test set of 200 cases.”
    Quote in the paperNot a substantial claim1 of 1 sources checked
    • cites [39] Li, J., Lai, Y., Li, W., Ren, J., Zhang, M., Kang, X., and Liu, Y. (2025). Agent Hospital: A simulacrum of hospital with evolvable medical agents. arXiv. source
  • May combine two claims.

    Interpretationcitation

    This enables the agent to learn from experience and refine clinical reasoning over time.

    “This enables the agent to learn from experience and refine clinical reasoning over time [39].”
    Quote in the paperNot a substantial claim1 of 1 sources checked
    • cites [39] Li, J., Lai, Y., Li, W., Ren, J., Zhang, M., Kang, X., and Liu, Y. (2025). Agent Hospital: A simulacrum of hospital with evolvable medical agents. arXiv. source
  • May combine two claims.

    Interpretationcitation

    Performance improvements arise specifically from the agent's ability to accumulate experience and leverage structured case memory, confirming that multi-agent interaction, not only the base model, drives accuracy gains in an experimental setting.

    “This demonstrates that the performance improvements arise specifically from the agent’s ability to accumulate experience and leverage structured case memory—confirming that multi-agent interaction, not only the base model, drives the accuracy gains in an experimental setting.”
    Quote in the paperSubstantial claim1 of 1 sources checked
    • cites [39] Li, J., Lai, Y., Li, W., Ren, J., Zhang, M., Kang, X., and Liu, Y. (2025). Agent Hospital: A simulacrum of hospital with evolvable medical agents. arXiv. source
  • The quote only partly states this claim.

    Premisecitation

    MedAgent-Zero significantly outperformed standard CoT (90.42%).

    “and standard CoT (90.42%)”
    Quote in the paperSubstantial claim1 of 1 sources checked
    • cites [39] Li, J., Lai, Y., Li, W., Ren, J., Zhang, M., Kang, X., and Liu, Y. (2025). Agent Hospital: A simulacrum of hospital with evolvable medical agents. arXiv. source

      Table 4 reports 92.22% accuracy for MedAgent-Zero and 90.42% for CoT with GPT-4o on MedQA, supporting the comparison and the CoT figure. Section C.5 says MedAgent-Zero outperforms the other methods, but the cited passages do not establish that this 1.80-percentage-point difference is statistically significant. (LLM, conf=0.85)

      Experimental — accuracy not yet measured
  • May combine two claims.

    Premiseown data

    In the initial pass, TrialGPT-Retrieval successfully recalled over 90% of relevant trials while filtering out most irrelevant ones, requiring less than 6% of the total collection to maintain this high recall.

    “TrialGPT-Retrieval successfully recalled over 90% of relevant trials while filtering out most irrelevant ones, requiring less than 6% of the total collection to maintain this high recall”
    Quote in the paperNot a substantial claim1 of 1 sources checked
    • cites [36] Jin, 2024, Matching patients to clinical trials with large language models, Nat. Commun. source
  • May combine two claims.

    Premisecitation

    MedAgent-Zero incorporates two memory systems: an experience base storing tens of thousands of simulated patient trajectories and a case base containing curated medical Q&A exemplars.

    “MedAgent-Zero incorporates two memory systems: an experience base storing tens of thousands of simulated patient trajectories (symptoms → tests → diagnosis → outcome) and a case base containing curated medical Q&A exemplars.”
    Quote in the paperNot a substantial claim1 of 1 sources checked
    • cites [39] Li, J., Lai, Y., Li, W., Ren, J., Zhang, M., Kang, X., and Liu, Y. (2025). Agent Hospital: A simulacrum of hospital with evolvable medical agents. arXiv. source

      The Doctor Agent Evolution section identifies both memory bases, and B.2 describes the medical case base as validated question–answer pairs. But Doctor Agent Evolution and B.3 say the experience base stores rules or principles learned from errors, not patient trajectories. C.2 reports treating 50,000 simulated patients; it does not say their trajectories were stored in that base. (LLM, conf=0.90)

      Experimental — accuracy not yet measured
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    TrialGPT-Ranking assigns scores to rank the trials by suitability.

    “TrialGPT-Ranking, assigns scores to rank the trials by suitability”
    Quote in the paperNot a substantial claim1 of 1 sources checked
    • cites [36] Jin, 2024, Matching patients to clinical trials with large language models, Nat. Commun. source
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    TrialGPT-Matching evaluates the patient's eligibility against each trial's criteria using LLM-based reading and annotation of inclusion/exclusion criteria.

    “TrialGPT-Matching, then evaluates the patient’s eligibility against each trial’s criteria using LLM-based reading and annotation of inclusion/exclusion criteria”
    Quote in the paperNot a substantial claim1 of 1 sources checked
    • cites [36] Jin, 2024, Matching patients to clinical trials with large language models, Nat. Commun. source
  • May combine two claims.

    Premisecitation

    Current improvements may follow a 'scaling law' where gains slow as patient volume increases, suggesting an eventual performance ceiling.

    “current improvements may follow a “scaling law” where gains slow as patient volume increases, suggesting an eventual performance ceiling”
    Quote in the paperNot a substantial claim1 of 1 sources checked
    • cites [39] Li, J., Lai, Y., Li, W., Ren, J., Zhang, M., Kang, X., and Liu, Y. (2025). Agent Hospital: A simulacrum of hospital with evolvable medical agents. arXiv. source

      The “Scaling Laws in Evolution” section reports that diagnostic accuracy improved rapidly for the first 10,000 patient agents, then improved more slowly while continuing to rise through 50,000. This supports slowing gains as patient volume increases, but the paper does not suggest an eventual performance ceiling. (LLM, conf=0.84)

      Experimental — accuracy not yet measured
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    In Agent-SafetyBench, MAS are challenged with scenarios and scored on rule adherence.

    “In this benchmark, MAS are challenged with scenarios (making treatment recommendations under specific constraints) and scored on rule adherence.”
    Quote in the paperNot a substantial claim1 of 1 sources checked
    • cites [27] Zhang, Z., Cui, S., Lu, Y., Zhou, J., Yang, J., Wang, H., and Huang, M. (2024). Agent-SafetyBench: Evaluating the safety of multi-agent AI systems. arXiv. source

      The Benchmark and Conclusion sections describe diverse test cases for LLM agents, and the Step4 passage says interactions receive safe-or-unsafe labels that determine a safety score. The paper does not describe the evaluated agents as multi-agent systems (MAS), and safety scoring is broader than rule adherence. It gives a medication-and-allergies example, but does not characterize the benchmark as treatment recommendations under specific constraints; no page numbers are available in our copy. (LLM, conf=0.88)

      Experimental — accuracy not yet measured
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Zhang et al. (2024) introduced Agent-SafetyBench, a suite of tests to evaluate whether agents respect certain safety and ethical rules in medical and general contexts.

    “Recently, Zhang et al., (2024) introduced Agent-SafetyBench, a suite of tests to evaluate whether agents respect certain safety and ethical rules in medical and general contexts [27].”
    Quote in the paperNot a substantial claim1 of 1 sources checked
    • cites [27] Zhang, Z., Cui, S., Lu, Y., Zhou, J., Yang, J., Wang, H., and Huang, M. (2024). Agent-SafetyBench: Evaluating the safety of multi-agent AI systems. arXiv. source
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    The socioeconomic burden of diagnostic errors is estimated to affect up to 1.8% of GDP in developed economies.

    “While the architectural overhead of agentic orchestration is significant, the socioeconomic burden of diagnostic errors, which is estimated to affect up to 1.8% of GDP in developed economies, provides a strong argument for the “accuracy premium” offered by collaborative designs [55].”
    Quote in the paperNot a substantial claim1 of 1 sources checked
    • cites [55] Slawomirski, L., Kelly, D., de Bienassis, K., Kallas, K.A., and Klazinga, N. (2025). The Economics of Diagnostic Safety, OECD Publishing. OECD Health Working Papers, No. 176. source

      Section 133 estimates the direct cost of diagnostic error at about 1.8% of GDP in a typical OECD country. The citing sentence calls this a socioeconomic burden, but the paper identifies the 1.8% figure as a direct healthcare cost; section 134 says indirect economic costs are difficult to estimate. (LLM, conf=0.88)

      Experimental — accuracy not yet measured
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    Academic groups have released research frameworks CAMEL and MetaGPT, providing templates for common MAS architectures.

    “academic groups have released research frameworks, namely CAMEL and MetaGPT. These provide templates for common MAS architectures (e.g., collaborative coding agents, conversational QA teams) [13].”
    Quote in the paperNot a substantial claim1 of 1 sources checked
    • cites [13] Li, G., Hammoud, H., Itani, H., Khizbullin, D., and Ghanem, B. (2023). CAMEL: Communicative Agents for “Mind” Exploration of Large Language Model Society. arXiv. source

      The Introduction describes CAMEL as an open-source cooperative-agent framework with modular agent implementations, and Section 3.1 shows agents collaborating through conversation on a coding task. These passages support CAMEL as an example of a research framework for a multi-agent architecture, but our copy does not establish the claim about MetaGPT. (LLM, conf=0.86)

      Experimental — accuracy not yet measured
  • May combine two claims.

    Premisecitation

    Expanded attack surfaces and emergent risky behaviors have been observed in autonomous agent experiments.

    “Already, expanded attack surfaces and emergent risky behaviors have been observed in autonomous agent experiments [49,50,51].”
    Quote in the paperSubstantial claim3 of 3 sources checked
    • cites [49] Deng, 2025, AI Agents Under Threat: A Survey of Key Security Challenges and Future Pathways, ACM Comput. Surv. source
    • cites [50] Sapkota, 2025, AI agents vs. agentic AI: A conceptual taxonomy, applications and challenges, Inf. Fusion source

      Section 5.0.2 (page unavailable) says agentic AI has an expanded attack surface and that interactions among autonomous agents can produce unintended behavior and safety risks. It discusses these as challenges, but does not establish that both were observed in autonomous-agent experiments. (LLM, conf=0.85)

      Experimental — accuracy not yet measured
    • cites [51] Su, H., Luo, J., Liu, C., Yang, X., Zhang, Y., Dong, Y., and Zhu, J. (2025). A Survey on Autonomy-Induced Security Risks in Large Model-Based Agents. arXiv. source
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).

    Interpretationcitation

    Improving transparency and auditability of MAS reasoning will build confidence that these systems are working as intended.

    “Improving transparency and auditability of MAS reasoning will build confidence that these systems are working as intended [69].”
    Quote in the paperNot a substantial claim1 of 1 sources checked
    • cites [69] Jimenez-Romero, C., Yegenoglu, A., and Blum, C. (2025). Multi-agent systems powered by large language models: Applications in swarm intelligence. Front. Artif. Intell., 8. source

      Table 5 in the Conclusion identifies reduced transparency and limited explainability of agent decisions as weaknesses, and says unpredictable behavior requires careful monitoring. The paper does not say that improving auditability or transparency will build confidence that MAS are working as intended. (LLM, conf=0.78)

      Experimental — accuracy not yet measured
  • May combine two claims.

    Premisecitation

    Studies on physician attitudes toward AI have found that clear explanations and the ability to veto or override AI suggestions are important for acceptance.

    “Studies on physician attitudes toward AI have found that clear explanations and the ability to veto or override AI suggestions are important for acceptance [59,60].”
    Quote in the paperSubstantial claim2 of 2 sources checked
    • cites [59] Sullivan, 2019, Are Current Tort Liability Doctrines Adequate for Addressing Injury Caused by AI?, AMA J. Ethics source

      The Abstract discusses the difficulty of explaining black-box AI recommendations in the context of liability, not physician acceptance. The section “Modify the standard of care” discusses clinicians evaluating AI results. Searches for physician attitudes, acceptance, and the ability to veto or override AI suggestions found no passage addressing the claimed findings; page numbers were not available in our copy. (LLM, conf=0.73)

      Experimental — accuracy not yet measured
    • cites [60] Rigby, 2019, Ethical Dimensions of Using Artificial Intelligence in Health Care, AMA J. Ethics source

      The editor’s article (page not provided) discusses physician input, AI as a complementary tool, and difficulty explaining black-box outputs. It does not report studies of physician attitudes or say that clear explanations and the ability to override AI suggestions affect acceptance. Searches for physician acceptance, explanations, vetoes, and overrides found no supporting passage. (LLM, conf=0.76)

      Experimental — accuracy not yet measured
  • May combine two claims.

    Premisecitation

    Recent evaluations indicate that structured agentic panels can reduce complex diagnostic expenditures from approximately $7850 to $2397 while significantly increasing specificity over human specialists.

    “Recent evaluations indicate that structured agentic panels can reduce complex diagnostic expenditures from approximately $7850 to $2397 while significantly increasing specificity over human specialists [54,55].”
    Quote in the paperSubstantial claim1 of 2 sources checked
    • cites [54] Klang, 2025, Assessing retrieval-augmented large language models for medical coding, NEJM AI source
    • cites [55] Slawomirski, L., Kelly, D., de Bienassis, K., Kallas, K.A., and Klazinga, N. (2025). The Economics of Diagnostic Safety, OECD Publishing. OECD Health Working Papers, No. 176. source

      Sections 222 and 236 discuss possible diagnostic benefits of AI and potential cost savings, but neither reports an evaluation of structured agentic panels. Searches for “agentic panels,” $7,850, $2,397, and specificity relative to human specialists found no passage supporting the claimed results. (LLM, conf=0.76)

      Experimental — accuracy not yet measured
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).

    Premisecitation

    Ongoing work on federated learning and secure multi-party computation might inform how agents can operate on sensitive data without pooling it centrally.

    “Ongoing work on federated learning and secure multi-party computation might inform how agents can operate on sensitive data without pooling it centrally [60].”
    Quote in the paperNot a substantial claim1 of 1 sources checked
    • cites [60] Rigby, 2019, Ethical Dimensions of Using Artificial Intelligence in Health Care, AMA J. Ethics source

      The editor’s discussion of privacy and confidentiality in AI health care (Abstract; page not provided) does not address federated learning, secure multi-party computation, or operating on sensitive data without central pooling. Searches for those techniques and for privacy-preserving distributed learning found no passage in our copy that speaks to the claim. (LLM, conf=0.74)

      Experimental — accuracy not yet measured
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    The proposed Model Context Protocol (MCP) mediates agent access to external data with fine-grained security rules, acting as an intelligent broker that filters queries and enforces policies.

    “for instance, the proposed Model Context Protocol (MCP) mediates agent access to external data with fine-grained security rules, acting as an intelligent broker that filters queries and enforces policies [52,53,64].”
    Quote in the paperNot a substantial claim1 of 3 sources checked
    • cites [52] Singh, A., Ehtesham, A., Kumar, S., and Khoei, T.T. (2025). A Survey of the Model Context Protocol (MCP): Standardizing Context to Enhance LLMs. Preprints. source

      The Introduction describes MCP as connecting AI models to external resources through servers that securely access data, and the Security and Security & Validation sections describe authorization and controlled execution policies (pages not provided). These passages support mediated, policy-controlled access, but they do not describe MCP as an intelligent broker that filters queries or establish the claimed fine-grained security rules. (LLM, conf=0.82)

      Experimental — accuracy not yet measured
    • cites [53] Hou, X., Zhao, Y., Wang, S., and Wang, H. (2025). Model Context Protocol (MCP): Landscape, Security Threats, and Future Research Directions. arXiv. source
    • cites [64] IMDRF Software as a Medical Device (SaMD) Working Group (2025). Characterization Considerations for Medical Device Software and Software-Specific Risk. IMDRF/SaMD WG/N81 FINAL:2025, International Medical Device Regulators Forum.

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • May combine two claims.

    Findingnone given

    In clinical trial matching, multi-agent frameworks achieved 87.3% accuracy and enhanced clinician screening efficiency by 42.6% (p < 0.001).

    “In clinical trial matching, multi-agent frameworks achieved 87.3% accuracy and enhanced clinician screening efficiency by 42.6% (p < 0.001).”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingreasoning

    Many of the studies summarized in this review evaluate MAS on benchmark datasets or simulated scenarios rather than in live clinical environments, so their reported success may not directly translate to real-world settings where unpredictability is higher.

    “Second, many of the studies we summarized evaluate MAS on benchmark datasets or simulated scenarios rather than in live clinical environments, which means their reported success may not directly translate to real-world settings where unpredictability is higher.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingreasoning

    Early evidence indicates that MAS can reduce oversights, catch inconsistencies, and provide clearer rationale through inter-agent dialogue.

    “We see early evidence that they can reduce oversights, catch inconsistencies, and provide clearer rationale through inter-agent dialogue.”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim.

    Study design and conductnone given

    Studies were included only if they described the implementation of a multi-agent AI system where multiple autonomous agents collaborated or coordinated to perform tasks.

    “To be included, a study needed to describe the implementation of a multi-agent AI system where multiple autonomous agents collaborated or coordinated to perform tasks.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S4 (based).

    Interpretationnone given

    The orchestration layer-not merely the agent design itself-is increasingly the critical determinant of system performance, safety, and clinical relevance.

    “We argue that the orchestration layer—not merely the agent design itself—is increasingly the critical determinant of system performance, safety, and clinical relevance.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim.

    Study design and conductnone given

    Studies focusing on single-LLM systems were excluded, except where such a system was integrated into a larger multi-agent framework.

    “We excluded studies focusing on single-LLM systems, except where such a system was integrated into a larger multi-agent framework.”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim.

    Study design and conductreasoning

    The search window was extended through 2026 via iterative manual screening of emerging preprints and recently published journal articles.

    “we extended our search window through 2026 via iterative manual screening of emerging preprints and recently published journal articles.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisereasoning

    LangGraph maintains a persistent state throughout the workflow: intermediate results, memory, and context are stored directly in the graph's state object and passed deterministically across nodes.

    “Unlike linear pipelines, LangGraph maintains a persistent state throughout the workflow: intermediate results, memory, and context are stored directly in the graph’s state object and passed deterministically across nodes.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable).

    Interpretationreasoning

    Clinical and research adoption of MAS requires the development of deterministic orchestration and rigorous cost-utility frameworks to ensure safety and expert-centered oversight.

    “its clinical and research adoption requires the development of deterministic orchestration and rigorous cost-utility frameworks to ensure safety and expert-centered oversight”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationreasoning

    These design choices make LangGraph particularly effective for structured, protocol-bound, or safety-critical applications where reproducibility and auditability matter.

    “These design choices make LangGraph particularly effective for structured, protocol-bound, or safety-critical applications where reproducibility and auditability matter.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).

    Premisecitation

    Compared to a single-agent setting, an MAS more realistically represents complex real-world scenarios involving multiple decision-makers or information sources.

    “Compared to a single-agent setting, an MAS more realistically represents complex real-world scenarios involving multiple decision-makers or information sources [7,8].”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites [7] Wooldridge, 1995, Intelligent agents: Theory and practice, Knowl. Eng. Rev. source
    • cites [8] Stone, 2000, Multiagent systems: A survey from a machine learning perspective, Auton. Robot. source
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductreasoning

    The initial search strategy focused on the preceding six-year window (approximately 2019-2025).

    “The initial search strategy focused on the preceding six-year window (approximately 2019–2025)”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable).

    Interpretationnone given

    MAS enables a shift toward collaborative intelligence in biomedicine.

    “MAS enables a shift toward collaborative intelligence in biomedicine”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductnone given

    The literature search spanned multiple databases: PubMed, arXiv, ACM, and IEEE Xplore.

    “The search spanned multiple databases: PubMed, arXiv, ACM, and IEEE Xplore.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim.

    Study design and conductnone given

    Studies that reported performance or utility improvements of the multi-agent approach over single-agent baselines were prioritized as evidence of the value added by agent collaboration.

    “We prioritized studies that reported performance or utility improvements of the multi-agent approach over single-agent baselines as evidence of the value added by agent collaboration.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Interpretationnone given

    A team of agents autonomously generating and executing complex action sequences raises the risk of propagating errors or undesirable behaviors.

    “A team of agents autonomously generating and executing complex action sequences raises the risk of propagating errors or undesirable behaviors.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing). May combine two claims.

    Interpretationreasoning

    MAS will require defense-in-depth: sandboxing of agent actions, well-defined scopes for each agent's authority, and continuous monitoring for anomalous behaviors.

    “In general, MAS will require defense-in-depth: sandboxing of agent actions, well-defined scopes for each agent’s authority, and continuous monitoring for anomalous behaviors.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based). May combine two claims.

    Interpretationnone given

    Effective MAS requires mechanisms for memory sharing, safety constraints, and structured inter-agent communication.

    “Effective MAS requires mechanisms for memory sharing, safety constraints, and structured inter-agent communication.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).

    Premisereasoning

    Drug discovery is a complex, multi-factorial process that can benefit from the division of labor offered by agentic workflows.

    “Drug discovery is a complex, multi-factorial process that can benefit from the division of labor offered by agentic workflows.”
    Quote in the paperNot a substantial claim
    • Rests on an assumption: Drug discovery is a complex, multi-factorial process that can benefit from the division of labor offered by agentic workflows.
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationreasoning

    These differences reflect two distinct orchestration philosophies: graph-driven determinism versus role-driven collaboration.

    “These differences reflect two distinct orchestration philosophies: graph-driven determinism versus role-driven collaboration.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationreasoning

    One safeguard is to include a specialized monitoring or moderation agent that watches the agents' interactions and intervenes if policies are violated.

    “One safeguard is to include a specialized monitoring or moderation agent that watches the agents’ interactions and intervenes if policies are violated”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Interpretationnone given

    Alignment techniques from single-agent LLMs, such as content filtering and reinforcement learning from human feedback (RLHF), can be extended to MAS settings by applying them to each agent's outputs or decisions.

    “Alignment techniques from single-agent LLMs, such as content filtering and reinforcement learning from human feedback (RLHF), can be extended to MAS settings by applying them to each agent’s outputs or decisions.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationcitation

    MAS has rapidly gained traction as a strategy for tackling the complexity of biomedical data analysis and clinical decision-making.

    “MAS has rapidly gained traction as a strategy for tackling the complexity of biomedical data analysis and clinical decision-making.”
    Quote in the paperNot a substantial claim
    • Rests on an assumption: MAS has rapidly gained traction as a strategy for tackling the complexity of biomedical data analysis and clinical decision-making.
  • Probably not a substantial claim: may not pass S4 (based).

    Interpretationreasoning

    As these frameworks evolve toward increasingly autonomous and distributed architectures, these same communication and control mechanisms introduce new vectors for error propagation, bias amplification, or unsafe tool invocation.

    “As these frameworks evolve toward increasingly autonomous and distributed architectures, these same communication and control mechanisms introduce new vectors for error propagation, bias amplification, or unsafe tool invocation.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Techniques such as ReAct interleave logical Reasoning and concrete Acting steps by an LLM, demonstrating how language models can use external tools dynamically.

    “Techniques, such as ReAct, interleave logical Reasoning and concrete Acting steps by an LLM, demonstrating how language models can use external tools dynamically [17].”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [17] Yao, 2023, ReAct: Synergizing reasoning and acting in language models, Adv. Neural Inf. Process. Syst.

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).

    Interpretationcitation

    Ensuring secure and authenticated inter-agent communication will be vital so that a rogue agent cannot impersonate a trusted one or leak sensitive data.

    “Ensuring secure and authenticated inter-agent communication will be vital so that a rogue agent cannot impersonate a trusted one or leak sensitive data.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationreasoning

    These paradigms are complementary rather than mutually exclusive.

    “Importantly, these paradigms are complementary rather than mutually exclusive.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationreasoning

    Shared memory facilitates experience replay, where agents can learn from prior cases by referencing how similar problems were solved, improving continual learning.

    “Shared memory also facilitates experience replay, where agents can learn from prior cases by referencing how similar problems were solved, improving continual learning”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationreasoning

    Shared memory ensures that facts discovered by one agent persist and inform the others.

    “This ensures that facts discovered by one agent (e.g., a relevant patient finding or an experimental result) persist and inform the others.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.

    Interpretationnone given

    MAS in drug discovery is still in its infant stages, and most systems are prototypes or proofs-of-concept.

    “MAS in drug discovery is still in its infant stages, and most systems are prototypes or proofs-of-concept.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.

    Interpretationreasoning

    The incorporation of a knowledge-graph agent helps reduce factual errors by grounding answers in curated databases, addressing a key limitation of standalone LLMs.

    “Notably, the incorporation of a knowledge-graph agent helps reduce factual errors by grounding answers in curated databases, addressing a key limitation of standalone LLMs.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing). May combine two claims.

    Interpretationreasoning

    In practice, LangGraph excels when workflows require strict branching logic, formal validation, or deterministic execution, while CrewAI shines when tasks benefit from adaptive teamwork and iterative critique.

    “In practice, LangGraph excels when workflows require strict branching logic, formal validation, or deterministic execution, while CrewAI shines when tasks benefit from adaptive teamwork and iterative critique.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).

    Interpretationreasoning

    This marks a shift toward a paradigm where AI acts as a digital coordinator of diverse medical resources.

    “This marks a shift toward a paradigm where AI acts as a digital coordinator of diverse medical resources [28,29].”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites [28] Sutton, R.S., and Barto, A.G. (2018). Reinforcement Learning: An Introduction, MIT Press. [2nd ed.].

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

    • cites [29] Ferber, D., Wei, J., Ghaffari Laleh, N., Wu, Z., Tan, Y., Peng, C., Wang, X., Liu, Y., Zhang, Z., and Chen, J. (2025). Multimodal Oncology Agent for IDH1 Mutation Prediction in Low-Grade Glioma. arXiv.

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Classified as probably not a substantial claim.

    Interpretationnone given

    MAS is naturally suited to multimodal reasoning because different agents can specialize in processing distinct data types and then collaborate to form a comprehensive assessment.

    “MAS is naturally suited to such multimodal reasoning: different agents can specialize in processing distinct data types and then collaborate to form a comprehensive assessment.”
    Quote in the paperSubstantial claim
    • Rests on an assumption: Clinical diagnosis often requires integrating information from multiple sources, specifically physical exam findings, laboratory results, and medical images.
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    An AI research assistant was able to draft research proposals and survey prior work with minimal human input.

    “an AI research assistant was able to draft research proposals and survey prior work with minimal human input [38]”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [38] Naumov, V., Zagirova, D., Lin, S., Xie, Y., Gou, W., Urban, A., and Zhavoronkov, A. (2025). DORA AI Scientist: Multi-agent Virtual Research Team for Scientific Exploration Discovery and Automated Report Generation. bioRxiv. source
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims. The quote only partly states this claim.

    Premisereasoning

    Parallelizing agent operations and allowing asynchronous processing can help reduce latency.

    “Parallelizing agent operations and allowing asynchronous processing can help.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Zheng et al. (2025) outlined strategies for incorporating lifelong learning into agent architecture by dividing the system into a perception module, a memory module, and an action module.

    “Zheng et al. (2025) outlined strategies for incorporating lifelong learning into agent architecture by dividing the system into a perception module (to handle new modalities), a memory module (to accumulate evolving knowledge), and an action module (to adapt behaviors) [47].”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [47] Zheng, J., Shi, C., Cai, X., Li, Q., Zhang, D., Li, C., Yu, D., and Ma, Q. (2025). Lifelong learning of large language model based agents: A roadmap. IEEE Trans. Pattern Anal. Mach. Intell., 1–20. source
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisereasoning

    Latency is a concern for clinical applications.

    “Latency is also a concern for clinical applications: doctors need answers fast.”
    Quote in the paperNot a substantial claim
    • Rests on an assumption: Doctors need answers fast.
  • Probably not a substantial claim: may not pass S4 (based).

    Interpretationnone given

    Current frameworks are primarily limited by their focus on multiple-choice formats rather than the continuous, interactive narrative of patient-centered diagnostics.

    “Current frameworks are primarily limited by their focus on multiple-choice formats rather than the continuous, interactive narrative of patient-centered diagnostics.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    Microsoft has open-sourced Autogen as a Python 3.10+ library, which provides high-level abstractions for spawning agents, managing their message exchanges, and incorporating new agents dynamically.

    “Microsoft has open-sourced Autogen (mentioned in Section 2.1) as a Python 3.10+ library, which provides high-level abstractions for spawning agents, managing their message exchanges, and incorporating new agents dynamically [12].”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [12] Wu, Q., Bansal, G., Zhang, J., Wu, Y., Zhang, S., Zhu, E., Li, B., Jiang, L., Zhang, X., and Wang, C. (2023). AutoGen: Enabling next-gen LLM applications via multi-agent conversation frameworks. arXiv.

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisereasoning

    If too many agents overlap in functionality, the system wastes time and computing resources on duplicate efforts.

    “If too many agents overlap in functionality, the system wastes time and computing resources on duplicate efforts.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationreasoning

    The system can iterate in a loop (plan → answer → review → refine) until a consensus or confidence threshold is reached.

    “The system can iterate in a loop (plan → answer → review → refine) until a consensus or confidence threshold is reached.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Premisecitation

    In complex medical coding tasks, a RAG-enhanced agentic system demonstrated superior performance to human providers; expert reviewers favored the AI's accuracy in 447 instances compared to 277 for provider-assigned codes (p < 0.001).

    “For instance, in complex medical coding tasks where diagnostic specificity is tied to financial and legal outcomes, a RAG-enhanced agentic system demonstrated superior performance to human providers; expert reviewers favored the AI’s accuracy in 447 instances compared to 277 for provider-assigned codes (p < 0.001) [54].”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites [54] Klang, 2025, Assessing retrieval-augmented large language models for medical coding, NEJM AI source
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Premisenone given

    As the number of agents grows, communication overhead can grow combinatorially, a phenomenon sometimes called "agent flurry," where agents produce a torrent of messages that can slow down the system.

    “As the number of agents grows, communication overhead can also grow combinatorially, a phenomenon sometimes called “agent flurry,” where agents produce a torrent of messages that can slow down the system.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Interpretationreasoning

    If two diagnostic agents disagree, that flags uncertainty for human review or triggers the system to gather more information.

    “If two diagnostic agents disagree, that flags uncertainty for human review or triggers the system to gather more information.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationreasoning

    MCP acts as a safety layer-essentially a "secure USB port" through which AI agents can plug into critical data sources without breaching compliance or confidentiality.

    “By enforcing standardized request formats, access controls (e.g., role-based permissions, user consent requirements), and comprehensive logging, MCP acts as a safety layer—essentially a “secure USB port” through which AI agents can plug into critical data sources without breaching compliance or confidentiality.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S4 (based). May combine two claims.

    Premisenone given

    Most current MAS rely on foundation models that have a fixed knowledge cutoff and do not automatically update as new data arrives.

    “Most current MAS rely on foundation models that have a fixed knowledge cutoff and do not automatically update as new data arrives.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationreasoning

    A retrieval agent might fetch irrelevant or misleading data, and a reasoning agent could incorporate it into a diagnosis, leading to an incorrect conclusion.

    “a retrieval agent might fetch irrelevant or misleading data, and a reasoning agent could incorporate it into a diagnosis, leading to an incorrect conclusion”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisenone given

    If each agent needs the full history of the conversation or the entire patient record, the token usage can explode.

    “One issue is the context length and memory: If each agent needs the full history of the conversation or the entire patient record, the token usage can explode.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Interpretationnone given

    MCP is only a communication standard; thus, intra-system errors from agent reasoning are still a possibility.

    “Finally, it is important to note MCP is only a communication standard; thus, intra-system errors from agent reasoning are still a possibility.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisereasoning

    Agent role differentiation, specialized fine-tuning, or using smaller models for simpler agents can make the system leaner.

    “Techniques such as agent role differentiation, perhaps via specialized fine-tuning for each agent’s subtask, or using smaller models for simpler agents can make the system leaner.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim.

    Interpretationreasoning

    A clear distinction remains between simulation success and real-world bedside utility.

    “a clear distinction remains between simulation success and real-world bedside utility”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S4 (based).

    Premisenone given

    Running several LLM agents in parallel or in long sequential dialogues can be resource-intensive in terms of CPU/GPU usage and memory.

    “Running several LLM agents in parallel or in long sequential dialogues can be resource-intensive in terms of CPU/GPU usage and memory.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based).

    Interpretationreasoning

    The shift from static, text-only models to evolvable and adaptive multi-agent ecosystems marks a pivotal transition in medical artificial intelligence.

    “the shift from static, text-only models to evolvable and adaptive multi-agent ecosystems marks a pivotal transition in medical artificial intelligence”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim.

    Interpretationreasoning

    By moving beyond 'reading' medical literature to 'practicing' within synthetic simulations or dynamically assembling specialist teams, these systems begin to replicate the collaborative and iterative nature of real-world clinical decision-making.

    “By moving beyond “reading” medical literature to “practicing” within synthetic simulations similar to Agent Hospital, or dynamically assembling specialist teams via MDAgents, these systems begin to replicate the collaborative and iterative nature of real-world clinical decision-making.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationcitation

    After a Question-Answering Agent proposes an answer, a Reviewer Agent can assess its factual accuracy and coherence.

    “after a Question-Answering Agent proposes an answer, a Reviewer Agent can assess its factual accuracy and coherence”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).

    Premisecitation

    It may be necessary to log detailed transcripts of agent dialogues and decision paths so that any failures can be audited after the fact.

    “From a regulatory perspective, it may be necessary to log detailed transcripts of agent dialogues and decision paths so that any failures can be audited after the fact [57].”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [57] (2025, July 05). High-Level Expert Group on Artificial Intelligence. Ethics Guidelines for Trustworthy AI. European Commission. Available online: https://digital-strategy.ec.europa.eu/en/library/ethics-guidelines-trustworthy-ai.

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisenone given

    Continual learning in deployed AI systems carries risks: models can forget old knowledge when fine-tuned on new data (catastrophic forgetting), or they can drift in undesirable ways.

    “However, continual learning in deployed AI systems carries risks: models can forget old knowledge when fine-tuned on new data (catastrophic forgetting), or they can drift in undesirable ways (if new data is biased or if adversarial inputs are encountered).”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based).

    Premisenone given

    Lifelong learning for biomedical MAS is still largely uncharted territory.

    “Lifelong learning for biomedical MAS is still largely uncharted territory.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim.

    Premisereasoning

    With multiple agents contributing, it can be unclear which agent's action or which interaction led to an error.

    “With multiple agents contributing, it can be unclear which agent’s action or which interaction led to an error.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisereasoning

    Techniques similar to experience replay and periodic evaluation against fixed benchmarks can help detect when an agent's performance on prior knowledge starts degrading.

    “Techniques similar to experience replay (re-training on a mix of old and new cases) and periodic evaluation against fixed benchmarks can help detect when an agent’s performance on prior knowledge starts degrading.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Premisecitation

    A 2025 study developed a taxonomy of collaborative failure patterns in multi-agent medical systems, including flawed consensus driven by shared model biases, suppression of correct minority opinions, ineffective discussion dynamics, and critical information loss during synthesis.

    “For example, a 2025 study developed a taxonomy of collaborative failure patterns, including flawed consensus driven by shared model biases, suppression of correct minority opinions, ineffective discussion dynamics, and critical information loss during synthesis [70].”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [70] Gu, L., Zhu, Y., Sang, H., Wang, Z., Sui, D., Tang, W., Harrison, E., Gao, J., Yu, L., and Ma, L. (2025). MedAgentAudit: Diagnosing and Quantifying Collaborative Failure Modes in Medical Multi-Agent Systems. arXiv.

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing). May combine two claims.

    Premisereasoning

    Trust goes beyond raw accuracy: it involves human factors.

    “This goes beyond raw accuracy: it involves human factors.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Premisecitation

    The FDA has already signaled interest in adaptive AI that learns over time, proposing monitoring approaches to ensure safety is maintained during algorithm updates.

    “The FDA has already signaled interest in adaptive AI that learns over time, proposing monitoring approaches to ensure safety is maintained during algorithm updates [58].”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [58] Yang, G., Rao, A., Fernandez-Maloigne, C., Calhoun, V., and Menegaz, G. (2022, January 16–19). Explainable AI (XAI) In Biomedical Signal and Image Processing: Promises and Challenges. Proceedings of the 2022 IEEE International Conference on Image Processing (ICIP), Bordeaux, France. source
  • Probably not a substantial claim: may not pass S2 (checkable).

    Interpretationreasoning

    This enables human experts to focus more on empathy in patient care, insight in experimental design, or ethical judgment in difficult decisions.

    “This enables human experts to focus more on empathy in patient care, insight in experimental design, or ethical judgment in difficult decisions.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationreasoning

    The 'many hands' problem complicates assigning responsibility.

    “This “many hands” problem complicates assigning responsibility.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.

    Premisenone given

    MASs often intensively share and process data, which raises privacy concerns.

    “MASs often intensively share and process data, which raises privacy concerns.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Interpretationnone given

    The complexity that gives MAS power also makes them challenging to govern.

    “The complexity that gives these systems power also makes them challenging to govern.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Premisecitation

    Orchestrating multiple large language models is resource-intensive: context must be shared back-and-forth between agents, and they often engage in lengthy dialogues.

    “Orchestrating multiple large language models is resource-intensive: context must be shared back-and-forth between agents, and they often engage in lengthy dialogues.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Premisenone given

    Robust cross-check mechanisms (such as reviewer or auditor agents) have been proposed to catch such errors, but not all MAS implementations include them.

    “Robust cross-check mechanisms (such as reviewer or auditor agents) have been proposed to catch such errors, but not all MAS implementations include them.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable).

    Premisenone given

    For MAS to be adopted, human practitioners and patients must trust it.

    “Finally, for MAS to be adopted, human practitioners and patients must trust it.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S4 (based). May combine two claims.

    Interpretationnone given

    When designed with care, AI agent teams can handle information overload, perform tedious or complex multi-step analyses, and offer second opinions or suggestions that a busy human might miss.

    “When designed with care, AI agent teams can handle information overload, perform tedious or complex multi-step analyses, and offer second opinions or suggestions that a busy human might miss.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable).

    Interpretationreasoning

    Responsible MAS deployment depends not only on ethical principles but also on technical and procedural guardrails.

    “Collectively, these ethical domains highlight that responsible MAS deployment depends not only on ethical principles but also on technical and procedural guardrails, concrete mechanisms that ensure these values are enforced during design, operation, and oversight.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable).

    Interpretationreasoning

    MAS are charting a path toward biomedical AI systems that collaborate in a manner analogous to human teams by combining specialized skills, cross-checking each other, and jointly tackling problems beyond the scope of any single model.

    “MAS are charting a path toward biomedical AI systems that collaborate in a manner analogous to human teams by combining specialized skills, cross-checking each other, and jointly tackling problems beyond the scope of any single model.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based).

    Interpretationreasoning

    Memory mechanisms will play a central role in continual learning.

    “Memory mechanisms will play a central role in continual learning.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationreasoning

    The modular nature of MAS may aid continual learning since knowledge can be compartmentalized.

    “Encouragingly, the modular nature of MAS may aid continual learning since knowledge can be compartmentalized.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductreasoning

    Given the quick evolution of the field, new results (especially preprints) have likely emerged after the review's literature search cutoff, so some relevant developments may not be captured.

    “First, given the quick evolution of the field, new results (especially preprints) have likely emerged after our literature search cutoff, so some relevant developments may not be captured.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim. May combine two claims.

    Study design and conductreasoning

    The review's focus on LLM-based MAS means that other paradigms (e.g., multi-agent reinforcement learning or symbolic agent systems) are only partially represented, so its conclusions reflect the current LLM-centric state of the field.

    “Finally, our focus on LLM-based MAS means that other paradigms (e.g., multi-agent reinforcement learning or symbolic agent systems) are only partially represented; our conclusions should be viewed as reflective of the current LLM-centric state of the field.”
    Quote in the paperSubstantial claim
121 of 121
  • The paper relies on this without support.

    MAS has rapidly gained traction as a strategy for tackling the complexity of biomedical data analysis and clinical decision-making.

    “MAS has rapidly gained traction as a strategy for tackling the complexity of biomedical data analysis and clinical decision-making.”
  • The paper relies on this without support.

    Drug discovery is a complex, multi-factorial process that can benefit from the division of labor offered by agentic workflows.

    “Drug discovery is a complex, multi-factorial process that can benefit from the division of labor offered by agentic workflows.”
  • The paper relies on this without support.

    Few domain-specific reviews examine how emerging MAS architectures are tailored for use in biomedicine.

    “Despite these promising developments, few domain-specific reviews examine how emerging MAS architectures are tailored for use in biomedicine.”
  • The paper relies on this without support.

    Modern systems increasingly employ hybrid designs in which LangGraph defines the global control flow while specific nodes delegate to a collaborative CrewAI team.

    “Modern systems increasingly employ hybrid designs in which LangGraph defines the global control flow while specific nodes delegate to a collaborative CrewAI team.”
  • The paper relies on this without support.

    Bioinformatics was one of the first areas to embrace MAS, given the inherent complexity of biological data-processing pipelines.

    “Bioinformatics was one of the first areas to embrace MAS, given the inherent complexity of biological data-processing pipelines.”
  • The paper relies on this without support.

    Clinical diagnosis often requires integrating information from multiple sources, specifically physical exam findings, laboratory results, and medical images.

    “Clinical diagnosis often requires integrating information from multiple sources, specifically physical exam findings, laboratory results, and medical images.”
  • The paper relies on this without support.

    Identifying suitable clinical trials for a patient, or finding patients for a trial, is essentially an exercise in complex criteria matching and data retrieval.

    “Identifying suitable clinical trials for a patient, or conversely, finding patients for a trial, is essentially an exercise in complex criteria matching and data retrieval.”
  • The paper relies on this without support.

    Many domains in biomedicine and healthcare remain underutilized or unexplored for MAS.

    “While early successes are evident, there remain many domains in biomedicine and healthcare where MAS is underutilized or has yet to be explored.”
  • The paper relies on this without support.

    The complexity of real clinical cases, especially in internal medicine, often requires gathering disparate information, reasoning through possible diagnoses, consulting guidelines, and double-checking for errors or contraindications.

    “The complexity of real clinical cases, especially in fields such as internal medicine, often requires gathering disparate information, reasoning through possible diagnoses, consulting guidelines, and double-checking for errors or contraindications.”
  • The paper relies on this without support.

    Doctors need answers fast.

    “Latency is also a concern for clinical applications: doctors need answers fast.”
  • The paper relies on this without support.

    New research findings, drug approvals, or clinical guidelines emerge constantly.

    “New research findings, drug approvals, or clinical guidelines emerge constantly.”
  • The paper relies on this without support.

    Clinical practice in one hospital may differ from another; patient populations differ; even the preferred communication style of clinicians may vary.

    “Clinical practice in one hospital may differ from another; patient populations differ; even the preferred communication style of clinicians may vary.”
  • The paper relies on this without support.

    A notable bias in the current literature is the focus on success stories—many MAS studies highlight impressive outcomes, whereas failures or neutral results often go unreported.

    “A notable bias in the current literature (and thus in our review) is the focus on success stories—many MAS studies highlight impressive outcomes, whereas failures or neutral results often go unreported.”
  • The paper relies on this without support.

    MAS may consume 50 times more tokens than standalone models to achieve a roughly 15% absolute accuracy gain.

    “To navigate the trade-off where MAS may consume 50 times more tokens than standalone models to achieve a roughly 15% absolute accuracy gain, we propose a classification framework based on Cost-Utility Analysis (CUA).”
  • The paper relies on this without support.

    Many MAS prototypes remain confined to the lab and have never been plugged into electronic health record systems or laboratory information management systems.

    “Many MAS prototypes remain confined to the lab and have never been plugged into electronic health record systems or laboratory information management systems.”
  • The paper relies on this without support.

    If an MAS is intended as a clinical decision support tool, it may qualify as a medical device subject to FDA or EMA oversight.

    “If an MAS is intended as a clinical decision support tool, it may qualify as a medical device subject to FDA or EMA oversight.”
  • The paper relies on this without support.

    Studies consistently indicate that keeping doctors and scientists involved is essential for reviewing AI outputs, correcting errors, and making the ultimate decisions.

    “Human oversight should remain integral to MAS deployments: studies consistently indicate that keeping doctors and scientists involved is essential for reviewing AI outputs, correcting errors, and making the ultimate decisions.”
  • The paper relies on this without support.

    New approaches to validation and quality assurance, such as simulation-based stress testing of MAS behaviors and continuous post-market monitoring of their performance in the field, have been suggested.

    “New approaches to validation and quality assurance have been suggested, such as simulation-based stress testing of MAS behaviors and continuous post-market monitoring of their performance in the field.”
18 of 18

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

  • Abstract USMLE accuracy conflicts with detailed MedQA result

    Major

    The abstract states a peak of 93.2% on USMLE-style benchmarks, while the Agent Hospital section reports MedAgent-Zero achieving 92.22% on the USMLE-style MedQA benchmark.

  • Oncology 30.3% to 87.2% metric labeled accuracy and completeness

    Minor

    The abstract calls the 30.3% to 87.2% improvement oncology decision-making accuracy, while the detailed section defines the same values as completeness in identifying expert-predetermined interventions.

  • A2A protocol date conflicts with reference

    Minor

    The text says Google introduced A2A in 2023, but the cited Google announcement is dated 9 April 2025.

  • MDAgents citation conflicts with its reference number

    Minor

    MDAgents is introduced with reference [42], but later the same system is cited as [39], which is the Agent Hospital reference.

  • Knowledge-practice gap review cited to wrong reference

    Minor

    The text attributes the systematic review of 39 medical AI benchmarks to reference [41], but reference [72] is the Gong et al. systematic review of 39 benchmarks; [41] is a rare-disease cost study.

5 of 5

Cites

Flagged first, then by citations

24 of the 74 references couldn’t be matched to a known paper.

Cited by

Sorted by citations

Authors
Spieser, J., Balapour, A., Meller, J., Patra, K. C., & Shamsaei, B.
Affiliations
  • University of Cincinnati (US)
  • Northern Kentucky University (US)
  • Department of Biostatistics, Health Informatics and Data Sciences, College of Medicine, University of Cincinnati, Cincinnati, OH 45267, USA
Corresponding author
Shamsaei, Behrouz
Venue
Methods and Protocols
Publisher
MDPI AG
Published
2026-02-28
Volume
9
Issue
2
Pages
33
ISSN
2409-9279 (ISSN-L)
OpenAlex
W7132847160
Cited by
1
References
74
Citations by year
2026: 1
FWCI
2.15
Type
journal article
Language
en
Open access
Locations
  • Methods and Protocols (publishedVersion, cc-by)
  • Preprints.org (acceptedVersion, cc-by)
  • PubMed (publishedVersion)
  • PubMed Central (submittedVersion, cc-by)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
Funders
The University of Cincinnati (UC) Center for Clinical and Translational Science and Training (UL1TR001425)
Topics
  • Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
  • Physical Sciences › Computer Science › Artificial Intelligence › Multi-Agent Systems and Negotiation
  • Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Biomedical Text Mining and Ontologies
Keywords
multi-agent systems, large language models, biomedical data analysis, medical data analysis, LangGraph, CrewAI, Model Context Protocol, clinical trial matching

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-07.

Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-07.

Cited sources are checked by gpt-6-sol.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review