A Review of Multi-Agent AI Systems for Biological and Clinical Data Analysis
Open accessAbstract
This review evaluates the emerging paradigm of multi-agent systems (MASs) for biomedical and clinical data analysis, focusing on their ability to overcome the reasoning and reliability limitations of standalone large language models (LLMs). We synthesize findings from recent architectural frameworks, specifically LangGraph, CrewAI, and the Model Context Protocol (MCP), to examine how specialized agent teams divide labor, utilize precision tools, and cross-verify outputs. We find that MAS architectures yield significant performance gains in various domains: recent implementations improved oncology decision-making accuracy from 30.3% to 87.2% and reached a peak of 93.2% accuracy on USMLE-style benchmarks through simulated clinical evolution. In clinical trial matching, multi-agent frameworks achieved 87.3% accuracy and enhanced clinician screening efficiency by 42.6% (p < 0.001). However, we also highlight critical operational challenges, including an unreliability tax of 15–50× higher token consumption compared to standalone models and the risk of cascading errors where initial hallucinations are amplified across the agent collective. We conclude that while MAS enables a shift toward collaborative intelligence in biomedicine, its clinical and research adoption requires the development of deterministic orchestration and rigorous cost-utility frameworks to ensure safety and expert-centered oversight.
Verified 2026-10-07 · 14 references not checked yet
AI snapshot
Written from the paper’s full text.
TL;DR
This review synthesizes multi-agent AI systems (MAS) for biomedical and clinical data analysis, arguing that orchestration across specialized agents can improve accuracy, reliability, and explainability over standalone LLMs. It also highlights major operational costs, cascading-error risks, and the need for deterministic orchestration, safety guardrails, and real-world validation.
Key findings
- In oncology decision-making, an MAS improved decision “completeness” from 30.3% (33/109) with GPT-4 alone to 87.2% (95/109); it used appropriate tools with 87.5% accuracy (56/64) and reached correct clinical conclusions in 91.0% of assessed statements (223/245), though 2.4% (6/245) of statements were flagged as potentially harmful.
- In clinical trial matching, TrialGPT achieved 87.3% criterion-level accuracy, 90.1% precision and 87.9% recall for supporting sentences, and an AUROC of 0.7979—a 43.8% improvement over BioLinkBERT (AUROC 0.6176); clinicians assisted by TrialGPT completed screening 42.6% faster (35.3 s vs. 61.5 s; p < 0.001).
- Agent Hospital/MedAgent-Zero reached 92.22% on MedQA (USMLE-style), outperforming GPT-4o (90.65%, p < 0.001) and standard CoT (90.42%); in cardiology, rheumatic heart disease diagnostic accuracy improved from a 9% GPT-3.5 baseline to 82% after about ten thousand simulated patients. The abstract also reports a peak of 93.2% accuracy on USMLE-style benchmarks through simulated clinical evolution.
- MAS face an “unreliability tax” of 15–50× higher token consumption than standalone models; the MAC framework used over 6000 tokens versus 118 for standard prompting, and cascading errors can amplify initial hallucinations across agents.
Methods
- This is a narrative literature review, not a primary experimental study. The authors searched PubMed, arXiv, ACM, and IEEE Xplore, initially covering approximately 2019–2025 and extending through 2026 via iterative manual screening of emerging preprints and recent articles.
- Inclusion required implementation of a multi-agent AI system where multiple autonomous agents collaborated or coordinated; single-LLM studies were excluded unless integrated into a larger multi-agent framework. Studies reporting performance or utility improvements over single-agent baselines were prioritized.
- Regulatory frameworks from bodies such as the FDA and HHS were updated through March 2025. The review synthesizes architectures, applications, platforms, benchmarks, challenges, and future directions across basic science and clinical domains.
Limitations
- The paper states that rapid field evolution may mean relevant post-cutoff results, especially preprints, were missed; many summarized studies evaluate MAS on benchmarks or simulated scenarios rather than live clinical environments; heterogeneity in datasets, agent configurations, and outcome metrics prevents direct cross-system comparison; and the LLM-centric focus only partially represents other paradigms such as multi-agent reinforcement learning or symbolic agent systems.
- The review itself notes publication bias toward success stories and cautions that simple ensembling or majority voting may account for some gains attributed to complex agent interactions.
- Evident from the text: some key evidence comes from small or synthetic evaluations—for example, the oncology validation used 20 multimodal patient cases, and TrialGPT was evaluated on synthetic patient records—so reported gains may not translate directly to real hospital data and workflows.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
123 of 154 cited sources checked · 48 supported · 0 flagged · accuracy not yet measured
- Premisecitation
MAS, in which multiple autonomous agents collaborate as a team, are emerging as a powerful paradigm for biomedical and clinical data analysis.
“MAS, in which multiple autonomous agents collaborate as a team, are emerging as a powerful paradigm for biomedical and clinical data analysis [1,2].”
Quote in the paperSubstantial claim2 of 2 sources checked- cites [1] Wang, L., Ma, C., Feng, X., Zhang, Z., Yang, H., Zhang, J., Chen, Z., Tang, J., Chen, X., and Lin, Y. (2024). A survey on large language model based autonomous agents. Front. Comput. Sci., 18. source
The Computer science & software engineering section describes multiple autonomous agents collaborating as a virtual team, supporting the description of MAS. The Natural science section discusses agents assisting research and managing scientific information, but our copy does not establish that multi-agent teams are emerging as a powerful paradigm specifically for biomedical and clinical data analysis; searches for those terms found no such passage. The passages have no page numbers in our copy. (LLM, conf=0.86)
Experimental — accuracy not yet measured - cites [2] Li, 2024, A survey on LLM-based multi-agent systems: Workflow, infrastructure, and challenges, Vicinagearth source
Section 2.2 describes MAS as multiple autonomous agents that can collaborate. Section 5.2 discusses analyzing patients’ health records to support diagnosis and treatment, but presents healthcare as a future application. It does not establish that MAS are already emerging as a powerful paradigm across biomedical and clinical data analysis. Page numbers are unavailable in our copy. (LLM, conf=0.84)
Experimental — accuracy not yet measured
- Premisecitation
In various domains, genomics, electronic health records, imaging, and beyond, MAS approaches have already demonstrated improved performance, reliability, and explainability compared to single-agent methods.
“In various domains, genomics, electronic health records, imaging, and beyond, MAS approaches have already demonstrated improved performance, reliability, and explainability compared to single-agent methods.”
Quote in the paperSubstantial claim1 of 2 sources checked- cites [1] Wang, L., Ma, C., Feng, X., Zhang, Z., Yang, H., Zhang, J., Chen, Z., Tang, J., Chen, X., and Lin, Y. (2024). A survey on large language model based autonomous agents. Front. Comput. Sci., 18. source
The Computer science & software engineering section (page unavailable) describes multi-agent collaboration that enhances code-output quality, and the Industrial automation section says multi-agent evaluation holds promise for greater credibility. The cited passages do not establish demonstrated improvements in genomics, electronic health records, or imaging, nor do they show improvements in performance, reliability, and explainability compared with single-agent methods. (LLM, conf=0.84)
Experimental — accuracy not yet measured - cites [4] Gao, 2024, Empowering biomedical discovery with AI agents, Cell source
- Premisecitation
Collaborative agent teams have produced superior results on complex bioinformatics analyses and clinical decision support challenges where no single model excels.
“collaborative agent teams have produced superior results on complex bioinformatics analyses and clinical decision support challenges where no single model excels [1,4].”
Quote in the paperSubstantial claim1 of 2 sources checked- cites [1] Wang, L., Ma, C., Feng, X., Zhang, Z., Yang, H., Zhang, J., Chen, Z., Tang, J., Chen, X., and Lin, Y. (2024). A survey on large language model based autonomous agents. Front. Comput. Sci., 18. source
The Computer science & software engineering section describes collaborative agent teams completing coding tasks and improving software output; the Natural science section describes agents assisting scientific research. Neither section reports superior results in bioinformatics analyses or clinical decision support, or compares teams with single models in those settings (searched: bioinformatics, clinical decision support, and single-agent comparisons). Page numbers were unavailable in our copy. (LLM, conf=0.83)
Experimental — accuracy not yet measured - cites [4] Gao, 2024, Empowering biomedical discovery with AI agents, Cell source
- Premisecitation
LLM-based autonomous agents can achieve greater flexibility and robustness by dividing labor among sub-agents.
“LLM-based autonomous agents can achieve greater flexibility and robustness by dividing labor among sub-agents [1,3].”
Quote in the paperSubstantial claim1 of 2 sources checked- cites [1] Wang, L., Ma, C., Feng, X., Zhang, Z., Yang, H., Zhang, J., Chen, Z., Tang, J., Chen, X., and Lin, Y. (2024). A survey on large language model based autonomous agents. Front. Comput. Sci., 18. source
The Computer science & software engineering section describes multiple LLM agents taking distinct roles or subtasks and collaborating, which supports the division-of-labor part of the claim. It reports benefits for software development, including improved code quality, but does not say that dividing labor makes agents more flexible or robust. (LLM, conf=0.84)
Experimental — accuracy not yet measured - cites [3] Xi, 2025, The rise and potential of large language model based agents: A survey, Sci. China Inf. Sci. source
- Premisecitation
In a validation study of 20 realistic multimodal patient cases focused on gastrointestinal oncology, the MAS autonomously used appropriate tools with 87.5% accuracy (56 out of 64 required invocations).
“The MAS autonomously utilized appropriate tools with 87.5% accuracy (56 out of 64 required invocations)”
Quote in the paperSubstantial claim1 of 1 sources checked- cites [34] Ferber, 2025, Development and validation of an autonomous artificial intelligence agent for clinical decision-making in oncology, Nat. Cancer source
- Premisecitation
BioMaster is an MAS framework for automated multi-omics workflows.
“A current example is the BioMaster system by Su et al., 2025, an MAS framework for automated multi-omics workflows [32].”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites [32] Su, H., Long, W., and Zhang, Y. (2025). BioMaster: Multi-agent system for automated bioinformatics analysis workflows. bioRxiv. source
The Abstract (p. 1) identifies BioMaster as a multi-agent framework that automates bioinformatics workflows and lists tasks spanning RNA-seq, ChIP-seq, single-cell analysis, and Hi-C. It does not establish that BioMaster automates integrated multi-omics workflows; the Introduction (p. 2) uses that description for AutoBA instead. (LLM, conf=0.86)
Experimental — accuracy not yet measured
- Premisecitation
BioAgents focuses on accessibility by leveraging small language models (SLMs) and retrieval-augmented generation to guide researchers through complex genomics tasks, even without extensive computational backgrounds.
“the BioAgents system, which focuses on accessibility by leveraging small language models (SLMs) and retrieval-augmented generation to guide researchers through complex genomics tasks, even without extensive computational backgrounds [33]”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites [33] Mehandru, N., Hall, A.K., Melnichenko, O., Dubinina, Y., Tsirulnikov, D., Bamman, D., and Malladi, V.S. (2025). Bioagents: Democratizing bioinformatics analysis with multi-agent systems. arXiv. source
- Premisecitation
In benchmarking across 49 representative tasks spanning 18 omics modalities and 102 distinct bioinformatics tools, BioMaster completed substantially more analysis workflows than a baseline automated pipeline, especially on complex, multi-step analyses with interdependent tasks.
“In benchmarking across 49 representative tasks spanning 18 omics modalities and 102 distinct bioinformatics tools, BioMaster completed substantially more analysis workflows than a baseline automated pipeline, especially on complex, multi-step analyses with interdependent tasks [32].”
Quote in the paperSubstantial claim1 of 1 sources checked- cites [32] Su, H., Long, W., and Zhang, Y. (2025). BioMaster: Multi-agent system for automated bioinformatics analysis workflows. bioRxiv. source
Split into 2 atoms — 0 confirmed, 2 partially supported, 0 disputed, 0 misattributed, 0 unverifiable. Expand the claim to see per-atom verdicts.
Experimental — accuracy not yet measured
- Premisecitation
TxAgent is an AI system that leverages multi-step reasoning and real-time knowledge retrieval across an extensive toolbox of domain-specific models (over 200 specialized tools in total) to support treatment discovery and optimization.
“TxAgent is an AI system that leverages multi-step reasoning and real-time knowledge retrieval across an extensive toolbox of domain-specific models (over 200 specialized tools in total) to support treatment discovery and optimization.”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites [31] Gao, S., Zhu, R., Kong, Z., Noori, A., Su, X., Ginder, C., and Zitnik, M. (2025). TxAgent: An AI agent for therapeutic reasoning across a universe of tools. arXiv. source
The Main and Overview sections describe TxAgent’s multi-step reasoning, real-time biomedical retrieval, and use of 211 tools for treatment recommendations. However, the TOOLUNIVERSE section says many of those tools are built on data-source APIs; the paper does not describe all 211 as domain-specific models. (LLM, conf=0.85)
Experimental — accuracy not yet measured
- Premisecitation
Ferber et al. (2025) developed an MAS that replicates a multi-disciplinary tumor board discussion by integrating multiple specialized agents for different data modalities and decision facets.
“Ferber et al., (2025) developed an MAS that replicates a multi-disciplinary tumor board discussion by integrating multiple specialized agents for different data modalities and decision facets [34].”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites [34] Ferber, 2025, Development and validation of an autonomous artificial intelligence agent for clinical decision-making in oncology, Nat. Cancer source
The Main section describes one GPT-4-based oncology agent that uses specialized tools for radiology, histopathology and information retrieval. The Methods section (Agent composition: tools; page unavailable) says that this agent plans and invokes the tools. The paper does not describe multiple collaborating agents or a replication of multidisciplinary tumor board discussion. (LLM, conf=0.88)
Experimental — accuracy not yet measured
- Premisecitation
With complete information in follow-up consultations, MAC accuracy for most-likely diagnosis rose to 53.86%.
“With complete information provided in follow-up consultations, the MAS accuracy for the most-likely diagnosis rose to 53.86%”
Quote in the paperSubstantial claim1 of 1 sources checked- cites [35] Chen, 2025, Enhancing diagnostic capability with multi-agent conversational LLMs, npj Digit. Med. source
- Premisecitation
MAC possible diagnoses accuracy reached 48.12% in primary consultations.
“the ‘possible diagnoses’ accuracy reached 48.12% in primary consultations”
Quote in the paperSubstantial claim1 of 1 sources checked- cites [35] Chen, 2025, Enhancing diagnostic capability with multi-agent conversational LLMs, npj Digit. Med. source
- Premisecitation
MAC primary possible diagnoses accuracy compared to GPT-4 34.55%, p = 0.001.
“compared to 34.55% for GPT-4, p = 0.001”
Quote in the paperSubstantial claim1 of 1 sources checked- cites [35] Chen, 2025, Enhancing diagnostic capability with multi-agent conversational LLMs, npj Digit. Med. source
Table 1 in Results (Performance of MAC on diagnostic ability; page unavailable) reports 34.55% possible-diagnosis accuracy for standalone GPT-4 in primary consultations and higher accuracy for MAC using GPT-4. The Results say MAC significantly outperformed standalone GPT-4, but our copy does not give p = 0.001 for this comparison; it directs readers to supplementary tables for statistical values. (LLM, conf=0.87)
Experimental — accuracy not yet measured
- Premisecitation
2.4% (6/245) of the agent's statements were flagged as potentially harmful, such as recommending suboptimal treatments.
“2.4% (6/245) of the agent’s statements were flagged as potentially harmful, such as recommending suboptimal treatments”
Quote in the paperSubstantial claim1 of 1 sources checked- cites [34] Ferber, 2025, Development and validation of an autonomous artificial intelligence agent for clinical decision-making in oncology, Nat. Cancer source
- Premisecitation
The agent accurately cited guidelines 75.5% of the time.
“accurately cited guidelines 75.5% of the time”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites [34] Ferber, 2025, Development and validation of an autonomous artificial intelligence agent for clinical decision-making in oncology, Nat. Cancer source
The Results (‘Evaluations show accurate, helpful and reliable responses’; page unavailable) report that 194 of 257 citations (75.5%) accurately aligned with the agent’s assertions. That percentage covers all evaluated citations, not a separately reported subset of citations to guidelines; the Methods (‘Dataset composition and data collection’) describe sources that include both guidelines and other medical resources. (LLM, conf=0.84)
Experimental — accuracy not yet measured
- Premisecitation
MAC's 34.11% primary accuracy beat CoT (27.81%).
“the MAC’s 34.11% primary accuracy beat CoT (27.81%)”
Quote in the paperSubstantial claim1 of 1 sources checked- cites [35] Chen, 2025, Enhancing diagnostic capability with multi-agent conversational LLMs, npj Digit. Med. source
Table 1 in Results reports 34.11% accuracy for the most likely diagnosis in primary consultations using MAC with GPT-4 and four doctor agents. The Results section on comparisons says MAC outperformed CoT, but our copy does not give CoT’s claimed 27.81% figure; it directs readers to Supplementary Table 12. (LLM, conf=0.87)
Experimental — accuracy not yet measured
- Premisecitation
TrialGPT uses a trio of agents to match patients to clinical trials.
“A pioneering system in this realm is TrialGPT, which uses a trio of agents to match patients to clinical trials [36].”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites [36] Jin, 2024, Matching patients to clinical trials with large language models, Nat. Commun. source
The Methods section (“TrialGPT”) describes a patient–trial matching architecture with three modules: Retrieval, Matching, and Ranking. This supports the three-part structure and purpose, but the paper calls them modules, not agents; it does not establish that TrialGPT uses three agents. (LLM, conf=0.85)
Experimental — accuracy not yet measured
- Premisecitation
Llama-3 70B had a success rate of 39.1% in the comparison.
“Llama-3 70B and Mixtral 8x7B registered significantly lower success rates of 39.1% and 7.8%, respectively”
Quote in the paperSubstantial claim1 of 1 sources checked- cites [34] Ferber, 2025, Development and validation of an autonomous artificial intelligence agent for clinical decision-making in oncology, Nat. Cancer source
- Premisecitation
The MAS's success rates were significantly higher than those of Llama-3 70B and Mixtral 8x7B.
“For comparison, state-of-the-art open-weights models like Llama-3 70B and Mixtral 8x7B registered significantly lower success rates of 39.1% and 7.8%, respectively [34].”
Quote in the paperSubstantial claim1 of 1 sources checked- cites [34] Ferber, 2025, Development and validation of an autonomous artificial intelligence agent for clinical decision-making in oncology, Nat. Cancer source
- Premisecitation
MAC follow-up most-likely diagnosis accuracy significantly exceeded GPT-4 (37.86%, p = 0.010).
“significantly exceeding GPT-4 (37.86%, p = 0.010)”
Quote in the paperSubstantial claim1 of 1 sources checked- cites [35] Chen, 2025, Enhancing diagnostic capability with multi-agent conversational LLMs, npj Digit. Med. source
In Results, Table 2 lists GPT-4’s follow-up most-likely diagnosis accuracy as 37.86% and higher accuracies for MAC. The Results text says MAC significantly outperformed GPT-4 in follow-up consultation, but the cited passages do not substantiate the specific p-value of 0.010. (LLM, conf=0.87)
Experimental — accuracy not yet measured
- Premisecitation
Chen et al. (2025) developed an MAS framework for differential diagnosis inspired by multidisciplinary team meetings common in clinical practice.
“The authors developed an MAS framework for differential diagnosis, inspired by the multidisciplinary team meetings common in clinical practice.”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites [35] Chen, 2025, Enhancing diagnostic capability with multi-agent conversational LLMs, npj Digit. Med. source
The Methods (Study design; Multi-agent conversation framework, no page provided) describe a diagnostic framework in which doctor agents discuss cases under a supervisor, supporting the framework and its resemblance to a clinical team discussion. The non-abstract passages do not explicitly say that multidisciplinary team meetings inspired its design or that such meetings are common in clinical practice. (LLM, conf=0.78)
Experimental — accuracy not yet measured
- Premisecitation
On a dataset of 302 curated rare-disease cases, the MAC framework attained 34.11% most-likely diagnosis accuracy during primary consultation.
“On a dataset of 302 curated rare-disease cases (spanning categories such as abdominal surgery, cardiac, and genetic disorders), the MAS—referred to as the Multi-agent Conversation (MAC) framework in their paper—attained a 34.11% ‘most-likely diagnosis’ accuracy during the primary consultation”
Quote in the paperSubstantial claim1 of 1 sources checked- cites [35] Chen, 2025, Enhancing diagnostic capability with multi-agent conversational LLMs, npj Digit. Med. source
- Premisecitation
MAC follow-up most-likely diagnosis accuracy significantly exceeded GPT-3.5 (29.36%, p < 0.001).
“and GPT-3.5 (29.36%, p < 0.001)”
Quote in the paperSubstantial claim1 of 1 sources checked- cites [35] Chen, 2025, Enhancing diagnostic capability with multi-agent conversational LLMs, npj Digit. Med. source
In Results, Table 2 reports 29.36% most-likely-diagnosis accuracy for standalone GPT-3.5 in follow-up consultations, below the MAC results. The Results text says MAC significantly outperformed single-agent GPT-3.5 in follow-up consultations, but the available passages do not give p < 0.001 for this comparison. (LLM, conf=0.84)
Experimental — accuracy not yet measured
- Premisecitation
Mixtral 8x7B had a success rate of 7.8% in the comparison.
“Llama-3 70B and Mixtral 8x7B registered significantly lower success rates of 39.1% and 7.8%, respectively”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites [34] Ferber, 2025, Development and validation of an autonomous artificial intelligence agent for clinical decision-making in oncology, Nat. Cancer source
- Premisecitation
MAC's primary most-likely diagnosis accuracy nearly doubled standalone GPT-4 (19.65%, p < 0.001).
“nearly doubling the performance of standalone GPT-4 (19.65%, p < 0.001)”
Quote in the paperSubstantial claim1 of 1 sources checked- cites [35] Chen, 2025, Enhancing diagnostic capability with multi-agent conversational LLMs, npj Digit. Med. source
Table 1 in Results (page unavailable) reports 34.11% most-likely-diagnosis accuracy for four-agent GPT-4 MAC versus 19.65% for standalone GPT-4 in primary consultations, supporting the comparison, though the ratio is about 1.74 rather than two. The Results say MAC significantly outperformed standalone GPT-4 but do not give the claimed p < 0.001 for this comparison; they direct readers to supplementary tables for statistical values. (LLM, conf=0.83)
Experimental — accuracy not yet measured
- Premisecitation
MAC possible diagnoses accuracy reached 67.88% in follow-ups (p = 0.042).
“and 67.88% in follow-ups (p = 0.042)”
Quote in the paperSubstantial claim1 of 1 sources checked- cites [35] Chen, 2025, Enhancing diagnostic capability with multi-agent conversational LLMs, npj Digit. Med. source
Table 2 in Results > Performance of MAC on diagnostic ability reports 67.88% possible-diagnosis accuracy in follow-up consultations for MAC using GPT-4 with three or four doctor agents. The passages in our copy do not give p = 0.042 for that result, so the stated p-value is not verified. (LLM, conf=0.88)
Experimental — accuracy not yet measured
- Premisecitation
MAC's primary most-likely diagnosis accuracy nearly doubled GPT-3.5 (16.23%, p < 0.001).
“and GPT-3.5 (16.23%, p < 0.001)”
Quote in the paperSubstantial claim1 of 1 sources checked- cites [35] Chen, 2025, Enhancing diagnostic capability with multi-agent conversational LLMs, npj Digit. Med. source
Table 1 in the Results reports 16.23% most-likely-diagnosis accuracy for standalone GPT-3.5 and 34.11% for four-agent MAC using GPT-4 in primary consultations—approximately twice as high. The Results say MAC significantly outperformed standalone models, but our copy does not give p < 0.001 for this specific comparison. (LLM, conf=0.84)
Experimental — accuracy not yet measured
- Premisecitation
In that validation study, the MAS reached correct clinical conclusions in 91.0% of assessed statements (223/245).
“reached correct clinical conclusions in 91.0% of assessed statements (223/245)”
Quote in the paperSubstantial claim1 of 1 sources checked- cites [34] Ferber, 2025, Development and validation of an autonomous artificial intelligence agent for clinical decision-making in oncology, Nat. Cancer source
- Premisecitation
The integrated agent improved decision-making completeness from 30.3% (33/109) using GPT-4 alone to 87.2% (95/109).
“improved decision-making “completeness”, or the ability to identify expert-predetermined interventions, from 30.3% (33/109) using GPT-4 alone to 87.2% (95/109)”
Quote in the paperSubstantial claim1 of 1 sources checked- cites [34] Ferber, 2025, Development and validation of an autonomous artificial intelligence agent for clinical decision-making in oncology, Nat. Cancer source
- Premisecitation
The agent achieved a 94.0% helpfulness rate in addressing sub-questions.
“The agent also achieved a 94.0% helpfulness rate in addressing sub-questions”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites [34] Ferber, 2025, Development and validation of an autonomous artificial intelligence agent for clinical decision-making in oncology, Nat. Cancer source
- Premisecitation
MDAgents introduces an adaptive coordination framework that automatically assigns collaboration structures to a team of agents based on task complexity, mirroring tiered referral processes used in clinical practice.
“MDAgents (Kim et al., 2024), introduces an adaptive coordination framework that automatically assigns collaboration structures to a team of agents based on task complexity, mirroring the tiered referral processes used in clinical practice [42].”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites [42] Kim, 2024, MDAgents: An adaptive collaboration of LLMs for medical decision-making, Adv. Neural Inf. Process. Syst. source
- Premisecitation
In evaluations across ten diverse medical benchmarks, MDAgents achieved superior performance in seven out of ten tasks.
“In evaluations across ten diverse medical benchmarks, including medical knowledge retrieval (MedQA, PubMedQA) and multimodal reasoning (Path-VQA, PMC-VQA), the framework achieved superior performance in seven out of ten tasks.”
Quote in the paperSubstantial claim1 of 1 sources checked- cites [42] Kim, 2024, MDAgents: An adaptive collaboration of LLMs for medical decision-making, Adv. Neural Inf. Process. Syst. source
- Premisecitation
Agent Hospital framework utilizes a virtual hospital spanning 32 departments and 339 diseases.
“the Agent Hospital framework, which utilizes a virtual hospital spanning 32 departments and 339 diseases [39]”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites [39] Li, J., Lai, Y., Li, W., Ren, J., Zhang, M., Kang, X., and Liu, Y. (2025). Agent Hospital: A simulacrum of hospital with evolvable medical agents. arXiv. source
- Premisecitation
The combination of moderator review and external medical knowledge retrieval (MedRAG) resulted in an average accuracy boost of 11.8%.
“the combination of moderator review and external medical knowledge retrieval (MedRAG), which resulted in an average accuracy boost of 11.8%”
Quote in the paperSubstantial claim1 of 1 sources checked- cites [42] Kim, 2024, MDAgents: An adaptive collaboration of LLMs for medical decision-making, Adv. Neural Inf. Process. Syst. source
- Premisecitation
TrialGPT achieved a recall of 87.9% in locating relevant supporting sentences in clinical notes.
“the system achieved a precision of 90.1% and a recall of 87.9% in locating relevant supporting sentences in clinical notes”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites [36] Jin, 2024, Matching patients to clinical trials with large language models, Nat. Commun. source
- Premisecitation
Static multi-agent settings often result in high computational costs (averaging 20.3 API calls).
“Static multi-agent settings often result in high computational costs (averaging 20.3 API calls)”
Quote in the paperSubstantial claim1 of 1 sources checked- cites [42] Kim, 2024, MDAgents: An adaptive collaboration of LLMs for medical decision-making, Adv. Neural Inf. Process. Syst. source
- Premisecitation
TrialGPT's AUROC of 0.7979 represents a 43.8% improvement over cross-encoder BioLinkBERT (AUROC 0.6176).
“representing a 43.8% improvement over state-of-the-art baselines like the cross-encoder BioLinkBERT (AUROC: 0.6176)”
Quote in the paperSubstantial claim1 of 1 sources checked- cites [36] Jin, 2024, Matching patients to clinical trials with large language models, Nat. Commun. source
In Results (section “TrialGPT-Ranking can effectively rank and exclude candidate clinical trials”), TrialGPT’s AUROC is 0.7979 and cross-encoder BioLinkBERT’s is 0.6176. The reported 43.8% improvement refers instead to the overall average score (0.7314 versus 0.5085); the AUROC improvement over 0.6176 is about 29.2%. (LLM, conf=0.94)
Experimental — accuracy not yet measured
- Interpretationcitation
The high correlation between TrialGPT's ranking scores and human judgment suggests that MAS has the potential to serve as a reliable cognitive assistant for complex, zero-shot patient-to-trial matching.
“the high correlation between TrialGPT’s ranking scores and human judgment suggests that MAS has the potential to serve as a reliable cognitive assistant for complex, zero-shot patient-to-trial matching”
Quote in the paperSubstantial claim1 of 1 sources checked- cites [36] Jin, 2024, Matching patients to clinical trials with large language models, Nat. Commun. source
The Results section reports that TrialGPT-Ranking scores correlate highly with patient–trial eligibility and that its LLM-aggregated scores correlate significantly with manual eligibility labels. The Discussion supports using TrialGPT to assist human recruiters, but the paper does not evaluate a multi-agent system (MAS); extending the finding to MAS is the citing authors’ inference, not a finding of this source. (LLM, conf=0.84)
Experimental — accuracy not yet measured
- Premisecitation
Specific accuracy gains reached 5.2% on diagnostic reasoning datasets like DDXPlus.
“with specific accuracy gains reaching 5.2% on diagnostic reasoning datasets like DDXPlus”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites [42] Kim, 2024, MDAgents: An adaptive collaboration of LLMs for medical decision-making, Adv. Neural Inf. Process. Syst. source
- Study design and conductcitation
Evaluations of TrialGPT were conducted on synthetic patient records.
“as these evaluations were conducted on synthetic patient records”
Quote in the paperSubstantial claim1 of 1 sources checked- cites [36] Jin, 2024, Matching patients to clinical trials with large language models, Nat. Commun. source
- Premisecitation
MDAgents demonstrated a significant improvement of up to 4.2% (p < 0.05) over the best-performing prior methods.
“MDAgents demonstrated a significant improvement of up to 4.2% (p < 0.05) over the best-performing prior methods”
Quote in the paperSubstantial claim1 of 1 sources checked- cites [42] Kim, 2024, MDAgents: An adaptive collaboration of LLMs for medical decision-making, Adv. Neural Inf. Process. Syst. source
Section 4.2 (Results; page not provided) reports that MDAgents significantly outperformed solo and group methods (p < 0.05) and performed best on seven of ten benchmarks. The Results passage does not establish the claimed maximum improvement of 4.2% over prior methods; that figure appears only in the abstract, which is excluded as evidence under the supplied rubric. (LLM, conf=0.82)
Experimental — accuracy not yet measured
- Premisecitation
On the MedQA benchmark, MedAgent-Zero achieved 92.22% accuracy.
“On the MedQA (USMLE-style) benchmark, MedAgent-Zero achieved 92.22% accuracy”
Quote in the paperSubstantial claim1 of 1 sources checked- cites [39] Li, J., Lai, Y., Li, W., Ren, J., Zhang, M., Kang, X., and Liu, Y. (2025). Agent Hospital: A simulacrum of hospital with evolvable medical agents. arXiv. source
- Premisecitation
Recent systematic reviews of 39 medical AI benchmarks quantify a significant 'knowledge-practice gap', finding that models achieving 84-90% on examinations often drop to 45-69% success rates when subjected to practice-based assessments requiring diagnostic reasoning under uncertainty.
“Recent systematic reviews of 39 medical AI benchmarks quantify a significant ‘knowledge-practice gap,’ finding that models achieving 84–90% on examinations often drop to 45–69% success rates when subjected to practice-based assessments that require diagnostic reasoning under uncertainty [41].”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites [41] Glaubitz, 2025, The cost of the diagnostic odyssey of patients with suspected rare diseases, Orphanet J. Rare Dis. source
Split into 2 atoms — 0 confirmed, 0 partially supported, 0 disputed, 0 misattributed, 2 unverifiable. Expand the claim to see per-atom verdicts.
Experimental — accuracy not yet measured
- Premisecitation
MedAgent-Zero significantly outperformed the GPT-4o baseline (90.65%, p < 0.001).
“significantly outperforming the GPT-4o baseline (90.65%, p < 0.001)”
Quote in the paperSubstantial claim1 of 1 sources checked- cites [39] Li, J., Lai, Y., Li, W., Ren, J., Zhang, M., Kang, X., and Liu, Y. (2025). Agent Hospital: A simulacrum of hospital with evolvable medical agents. arXiv. source
Section C.5 says MedAgent-Zero outperforms comparison methods, and Table 4 reports 92.22% accuracy for MedAgent-Zero using GPT-4o versus 88.22% for the direct GPT-4o method. The cited paper does not report the claimed 90.65% figure or a p < 0.001 test for this comparison. (LLM, conf=0.88)
Experimental — accuracy not yet measured
- Premisecitation
In the trial exclusion task, TrialGPT attained an AUROC of 0.7979.
“In the trial exclusion task, TrialGPT attained an AUROC of 0.7979”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites [36] Jin, 2024, Matching patients to clinical trials with large language models, Nat. Commun. source
- Premisecitation
Clinicians assisted by TrialGPT completed trial screening tasks 42.6% faster than those working without AI assistance (35.3 s vs. 61.5 s; p < 0.001).
“clinicians assisted by TrialGPT were able to complete trial screening tasks 42.6% faster than those working without AI assistance (35.3 s vs. 61.5 s; p < 0.001)”
Quote in the paperSubstantial claim1 of 1 sources checked- cites [36] Jin, 2024, Matching patients to clinical trials with large language models, Nat. Commun. source
The Results section, ‘TrialGPT can reduce the screening time for patient-trial matching’ (page not provided), reports about 42.6% less screening time with TrialGPT in a pilot study involving two medical doctors. Our copy does not state the claimed overall times of 35.3 s and 61.5 s or a p-value below 0.001 for that comparison. (LLM, conf=0.86)
Experimental — accuracy not yet measured
- Premisecitation
The system was evaluated on three cohorts comprising 183 synthetic patients with over 75,000 trial eligibility annotations.
“The system was then evaluated on three cohorts comprising 183 synthetic patients with over 75,000 trial eligibility annotations.”
Quote in the paperSubstantial claim1 of 1 sources checked- cites [36] Jin, 2024, Matching patients to clinical trials with large language models, Nat. Commun. source
- Premisecitation
Ablation studies confirmed the necessity of both memory systems, as removing the experience base dropped accuracy to 91.36%.
“Ablation studies confirmed the necessity of both memory systems, as removing the experience base dropped accuracy to 91.36% [39].”
Quote in the paperSubstantial claim1 of 1 sources checked- cites [39] Li, J., Lai, Y., Li, W., Ren, J., Zhang, M., Kang, X., and Liu, Y. (2025). Agent Hospital: A simulacrum of hospital with evolvable medical agents. arXiv. source
Section C.7 reports that MedAgent-Zero performs better with both the medical case base and experience base than with either alone, supporting the ablation finding that both are helpful. It does not give the claimed 91.36% accuracy after removing the experience base, and describes the components as helpful rather than necessary. The Figure 12 caption identifies the ablation but supplies no numerical result in our copy; page numbers are unavailable. (LLM, conf=0.85)
Experimental — accuracy not yet measured
- Premiseown data
TrialGPT achieved a precision of 90.1% in locating relevant supporting sentences in clinical notes.
“the system achieved a precision of 90.1% and a recall of 87.9% in locating relevant supporting sentences in clinical notes”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites [36] Jin, 2024, Matching patients to clinical trials with large language models, Nat. Commun. source
- Premisecitation
The adaptive approach achieved peak accuracy using only 9.3 calls.
“the adaptive approach achieved peak accuracy using only 9.3 calls [42]”
Quote in the paperSubstantial claim1 of 1 sources checked- cites [42] Kim, 2024, MDAgents: An adaptive collaboration of LLMs for medical decision-making, Adv. Neural Inf. Process. Syst. source
- Premiseown data
Manual evaluations of 1015 patient-criterion pairs demonstrated that the matching agent achieved an accuracy of 87.3%.
“manual evaluations of 1015 patient-criterion pairs demonstrated that the matching agent achieved an accuracy of 87.3%”
Quote in the paperSubstantial claim1 of 1 sources checked- cites [36] Jin, 2024, Matching patients to clinical trials with large language models, Nat. Commun. source
- Premisecitation
In simulated environments, results suggest statistically significant performance gains through this evolutionary process.
“In simulated environments, the results suggest statistically significant performance gains through this evolutionary process.”
Quote in the paperSubstantial claim1 of 1 sources checked- cites [39] Li, J., Lai, Y., Li, W., Ren, J., Zhang, M., Kang, X., and Liu, Y. (2025). Agent Hospital: A simulacrum of hospital with evolvable medical agents. arXiv. source
Section C.4 reports improved examination and diagnosis accuracy after doctor-agent evolution in simulations, including overall gains of 32.62% and 18.33%. It calls the improvements “significant,” but the passages provide no statistical test or uncertainty measure establishing statistical significance; the claim adds that unsupported qualification. (LLM, conf=0.87)
Experimental — accuracy not yet measured
- Premisecitation
In cardiology, diagnostic accuracy for rheumatic heart disease improved from a 9% baseline (GPT-3.5) to 82% after treating approximately ten thousand simulated patients.
“In cardiology, diagnostic accuracy for rheumatic heart disease improved from a 9% baseline (GPT-3.5) to 82% after treating approximately ten thousand simulated patients.”
Quote in the paperSubstantial claim1 of 1 sources checked- cites [39] Li, J., Lai, Y., Li, W., Ren, J., Zhang, M., Kang, X., and Liu, Y. (2025). Agent Hospital: A simulacrum of hospital with evolvable medical agents. arXiv. source
The “Scaling Laws in Evolution” section reports that cardiology diagnostic accuracy for rheumatic heart disease rose from 9% with base GPT-3.5 to 82% after doctor-agent evolution. It does not tie that result to approximately 10,000 simulated patients: its discussion of the first 10,000 patients concerns the respiratory department, while section C.3 says the cardiology department used up to 20,000 AI patients. Page numbers are unavailable in our copy. (LLM, conf=0.89)
Experimental — accuracy not yet measured
- Premisecitation
MDAgents began to explore dynamic group vs single agent decision.
“Early systems such as MDAgents began to explore this by dynamically deciding whether a task needs a “group” or can be handled by one agent [39].”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites [39] Li, J., Lai, Y., Li, W., Ren, J., Zhang, M., Kang, X., and Liu, Y. (2025). Agent Hospital: A simulacrum of hospital with evolvable medical agents. arXiv. source
The Related Work section cites MDAgents among studies of medical-agent collaboration, and the References list calls it an “adaptive collaboration” approach. Our copy does not say that MDAgents dynamically chooses between a group and a single agent for each task. (LLM, conf=0.82)
Experimental — accuracy not yet measured
- Premisecitation
The MAC framework reported a 50-fold increase in token consumption (6000 vs. 118) for a roughly 15% absolute accuracy gain.
“While early evaluations such as the MAC framework reported a 50-fold increase in token consumption (6000 vs. 118) for a roughly 15% absolute accuracy gain, recent large-scale clinical evidence suggests this ‘accuracy premium’ is vital in high-stakes domains [35].”
Quote in the paperSubstantial claim1 of 1 sources checked- cites [35] Chen, 2025, Enhancing diagnostic capability with multi-agent conversational LLMs, npj Digit. Med. source
The Results sections on method comparisons and MAC performance report that MAC used the most output tokens and improved diagnostic accuracy over the comparison methods and standalone models (page not provided in our copy). They do not substantiate the stated 6,000-versus-118 token counts, 50-fold ratio, or roughly 15-percentage-point accuracy gain; searches for those numbers found no matching passage. (LLM, conf=0.82)
Experimental — accuracy not yet measured
- Premisecitation
Recent large-scale clinical evidence suggests the 'accuracy premium' is vital in high-stakes domains.
“While early evaluations such as the MAC framework reported a 50-fold increase in token consumption (6000 vs. 118) for a roughly 15% absolute accuracy gain, recent large-scale clinical evidence suggests this ‘accuracy premium’ is vital in high-stakes domains [35].”
Quote in the paperSubstantial claim1 of 1 sources checked- cites [35] Chen, 2025, Enhancing diagnostic capability with multi-agent conversational LLMs, npj Digit. Med. source
The Results (Performance of MAC on diagnostic ability) report improved diagnostic accuracy with the multi-agent framework, and the Discussion says additional output tokens can improve performance. But the Discussion describes the 302-rare-disease case-report study as relatively small and preliminary; it does not establish that the added token cost is vital across high-stakes domains or validate that trade-off in clinical practice. The 50-fold token and 15% accuracy figures appear in a separate, uncited part of the sentence and are not judged here. (LLM, conf=0.84)
Experimental — accuracy not yet measured
- Premisecitation
MCP enables real-time policy enforcement: every tool invocation or data query from an agent can be evaluated against security and privacy rules before execution, with the MCP server blocking or flagging any disallowed actions automatically.
“Crucially, MCP enables real-time policy enforcement: every tool invocation or data query from an agent can be evaluated against security and privacy rules before execution, with the MCP server blocking or flagging any disallowed actions automatically [52].”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites [52] Singh, A., Ehtesham, A., Kumar, S., and Khoei, T.T. (2025). A Survey of the Model Context Protocol (MCP): Standardizing Context to Enhance LLMs. Preprints. source
Section 4.3 (Tools; page unavailable) describes structured tool calls, input validation, and controlled execution. The Security & Validation and 4.1 (Resources) passages also mention controlled execution policies and access control. None says that every tool invocation or data query is checked before execution or that an MCP server automatically blocks or flags disallowed actions. (LLM, conf=0.84)
Experimental — accuracy not yet measured
- Premisecitation
Average inference times scale with complexity, ranging from 14.7 s for straightforward 'low' cases to 226 s for 'high' complexity scenarios involving multidisciplinary care.
“average inference times were found to scale with complexity, ranging from 14.7 s for straightforward “low” cases to 226 s for “high” complexity scenarios involving multidisciplinary care”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites [42] Kim, 2024, MDAgents: An adaptive collaboration of LLMs for medical decision-making, Adv. Neural Inf. Process. Syst. source
- Premisecitation
For patients with rare, undiagnosed, or complex diseases, MAS has the potential to mitigate the heavy financial burden offsetting computational costs through the reduction of redundant secondary testing and acute care utilization.
“For patients with rare, undiagnosed, or complex diseases, MAS has the potential to mitigate the heavy financial burden offsetting computational costs through the reduction of redundant secondary testing and acute care utilization [41].”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites [41] Glaubitz, 2025, The cost of the diagnostic odyssey of patients with suspected rare diseases, Orphanet J. Rare Dis. source
The Results (Cost analysis; page unavailable) document substantially higher inpatient and outpatient costs for patients with suspected rare diseases. The Discussion says diagnostic support systems may reduce diagnostic delays and costs, but the paper does not address MAS, computational costs, or whether reducing redundant secondary testing and acute care utilization would offset those costs. (LLM, conf=0.87)
Experimental — accuracy not yet measured
- Premisecitation
LLMs can generate synthetic patient data to augment real datasets for rare conditions.
“Early research has shown that LLMs can generate synthetic patient data to augment real datasets for rare conditions [44].”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites [44] Alsentzer, 2025, Few shot learning for phenotype-driven diagnosis of patients with rare genetic diseases, npj Digit. Med. source
The Discussion (page unavailable) says synthetic rare-disease patients are used to train SHEPHERD and notes that simulated data can augment training datasets. But it says these patients are generated by a clinico-genetic simulator, not an LLM, and that this study primarily trains on simulated patients rather than using them to augment a real dataset. (LLM, conf=0.87)
Experimental — accuracy not yet measured
- Premisecitation
A reviewer setup that iterates in a loop (plan → answer → review → refine) until a consensus or confidence threshold is reached reduces hallucinations in LLM-generated answers.
“Empirically, this kind of reviewer setup has been shown to reduce hallucinations in LLM-generated answers [47,48].”
Quote in the paperNot a substantial claim1 of 2 sources checked- cites [47] Zheng, J., Shi, C., Cai, X., Li, Q., Zhang, D., Li, C., Yu, D., and Ma, Q. (2025). Lifelong learning of large language model based agents: A roadmap. IEEE Trans. Pattern Anal. Mach. Intell., 1–20. source
- cites [48] Mialon, G., Dessì, R., Lomeli, M., Nalmpantis, C., Pasunuru, R., Raileanu, R., Rozière, B., Schick, T., Dwivedi-Yu, J., and Celikyilmaz, A. (2023). Augmented language models: A survey. arXiv. source
The “Iterative LM calling” section (page unavailable) describes repeatedly calling a model to refine its output, which supports the iterative-refinement aspect. It does not describe a plan → answer → review → refine reviewer loop, a consensus or confidence stopping threshold, or empirical evidence that such a setup reduces hallucinations. The “Augmented Language Models benefits” section (page unavailable) also notes that evidence for improved truthfulness is limited in one related setting. (LLM, conf=0.82)
Experimental — accuracy not yet measured
- Premisecitation
Early results from Agent-SafetyBench have already helped identify weaknesses in current systems' guardrails, guiding researchers toward better training and oversight mechanisms.
“Early results from Agent-SafetyBench have already helped identify weaknesses in current systems’ guardrails, guiding researchers toward better training and oversight mechanisms.”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites [27] Zhang, Z., Cui, S., Lu, Y., Zhou, J., Yang, J., Wang, H., and Huang, M. (2024). Agent-SafetyBench: Evaluating the safety of multi-agent AI systems. arXiv. source
The Conclusion (page not available) reports that tests of 16 LLM agents uncovered significant vulnerabilities, and §4.3 identifies lack of robustness and risk awareness as key defects. The paper suggests that addressing these defects could improve safety, but our copy does not establish that the results have already guided researchers toward better training or oversight mechanisms. (LLM, conf=0.84)
Experimental — accuracy not yet measured
- Premisecitation
This dramatically increases runtime and cost, as each agent's inference and communication incurs additional latency and token usage.
“This dramatically increases runtime and cost, as each agent’s inference and communication incurs additional latency and token usage [69].”
Quote in the paperSubstantial claim1 of 1 sources checked- cites [69] Jimenez-Romero, C., Yegenoglu, A., and Blum, C. (2025). Multi-agent systems powered by large language models: Applications in swarm intelligence. Front. Artif. Intell., 8. source
- Premisecitation
In low-risk environments, the marginal gains of multi-agent deliberation do not offset the increased latency, API costs, or computational footprint.
“In these low-risk environments, the marginal gains do not offset the increased latency, API costs, or computational footprint [41,55].”
Quote in the paperSubstantial claim2 of 2 sources checked- cites [41] Glaubitz, 2025, The cost of the diagnostic odyssey of patients with suspected rare diseases, Orphanet J. Rare Dis. source
The Results and Discussion address healthcare costs during diagnosis of suspected rare diseases, not multi-agent deliberation. Searches for low-risk environments, latency, API costs, and computational footprint found no passage addressing the claimed trade-off. Page numbers were not available in our copy. (LLM, conf=0.78)
Experimental — accuracy not yet measured - cites [55] Slawomirski, L., Kelly, D., de Bienassis, K., Kallas, K.A., and Klazinga, N. (2025). The Economics of Diagnostic Safety, OECD Publishing. OECD Health Working Papers, No. 176. source
Section 14 discusses when the cost of additional diagnostic testing exceeds its benefit, and section 237 says AI’s carbon costs should be considered. Neither addresses multi-agent deliberation in low-risk environments or compares its gains with latency, API costs, and computational footprint. Searches for those terms found no passage making the attributed claim. (LLM, conf=0.76)
Experimental — accuracy not yet measured
- Rests on an assumption: MAS may consume 50 times more tokens than standalone models to achieve a roughly 15% absolute accuracy gain.
- Premisecitation
Regulators expect evidence that MASs have been tested for equitable performance across diverse patient groups.
“Regulators expect evidence that MASs have been tested for equitable performance across diverse patient groups [59].”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites [59] Sullivan, 2019, Are Current Tort Liability Doctrines Adequate for Addressing Injury Caused by AI?, AMA J. Ethics source
The “Modify the standard of care” section discusses clinicians’ duty to evaluate black-box algorithms and validate their results. The copy does not address regulators expecting evidence of equitable performance across diverse patient groups; searches for that phrase and for bias testing across patient populations found no such passage. Page numbers were not available. (LLM, conf=0.72)
Experimental — accuracy not yet measured
- Premisecitation
A fundamental 'knowledge-practice gap' remains a bottleneck for clinical adoption of MAS.
“Beyond reporting bias, a fundamental ‘knowledge-practice gap’ remains a bottleneck for clinical adoption of MAS [41].”
Quote in the paperSubstantial claim1 of 1 sources checked- cites [41] Glaubitz, 2025, The cost of the diagnostic odyssey of patients with suspected rare diseases, Orphanet J. Rare Dis. source
The Methods section describes a study of diagnostic pathways and costs for patients with suspected rare diseases; the Discussion addresses limitations of that study. Searches for “knowledge-practice gap” and barriers to clinical adoption of MAS found no passage addressing the claimed bottleneck. (LLM, conf=0.76)
Experimental — accuracy not yet measured
- Interpretationcitation
This disparity suggests that current models suffer from 'inflexible reasoning,' or the Einstellung effect, where they rely on pattern matching from training data rather than engaging in adaptive, threshold-based decision-making required at the bedside.
“This disparity suggests that current models suffer from “inflexible reasoning,” or the Einstellung effect, where they rely on pattern matching from training data rather than engaging in the adaptive, threshold-based decision-making required at the bedside [41,68].”
Quote in the paperSubstantial claim2 of 2 sources checked- cites [41] Glaubitz, 2025, The cost of the diagnostic odyssey of patients with suspected rare diseases, Orphanet J. Rare Dis. source
Split into 2 atoms — 0 confirmed, 0 partially supported, 0 disputed, 0 misattributed, 2 unverifiable. Expand the claim to see per-atom verdicts.
Experimental — accuracy not yet measured - cites [68] Kim, 2025, Limitations of large language models in clinical problem-solving arising from inflexible reasoning, Sci. Rep. source
- Premisecitation
Agents produce fluent, high-confidence outputs even when accuracy in life-critical safety assessments drops as low as 40-50%.
“The implication is a dangerous “miscalibrated overconfidence”: agents produce fluent, high-confidence outputs even when accuracy in life-critical safety assessments drops as low as 40–50% [68].”
Quote in the paperSubstantial claim1 of 1 sources checked- cites [68] Kim, 2025, Limitations of large language models in clinical problem-solving arising from inflexible reasoning, Sci. Rep. source
The Results report 48–52% accuracy for the best-performing models on clinical-reasoning questions, and Uncertainty Estimation and Calibration reports overconfident responses despite low accuracy (page numbers unavailable). But the study tested LLMs on a question-based benchmark, not agents performing real-world life-critical safety assessments; the Discussion says its questions are unlikely to be encountered in the real world. The cited passages also do not establish that the outputs were fluent. (LLM, conf=0.87)
Experimental — accuracy not yet measured
- Premisecitation
A 2025 systematic review of 39 medical LLM benchmarks quantified a 19.3 percentage point drop in success rates when moving from examination-based pattern recognition (84-90%) to practice-based assessments (45-69%).
“A 2025 systematic review of 39 medical LLM benchmarks quantified a 19.3 percentage point drop in success rates when moving from examination-based pattern recognition (84–90%) to practice-based assessments (45–69%) [41].”
Quote in the paperSubstantial claim1 of 1 sources checked- cites [41] Glaubitz, 2025, The cost of the diagnostic odyssey of patients with suspected rare diseases, Orphanet J. Rare Dis. source
The Study population and Diagnostic pathways sections describe patients with suspected rare diseases, matched controls, and diagnostic procedures—not a review of medical LLM benchmarks. Searches for the 39 benchmarks, the 19.3-point drop, and the stated performance ranges found no passage addressing the claim. (LLM, conf=0.78)
Experimental — accuracy not yet measured
- Premisecitation
For patients with suspected rare diseases, uncoordinated clinical investigations typically incur costs 7.6-fold higher than matched controls.
“For patients with suspected rare diseases, uncoordinated clinical investigations typically incur costs 7.6-fold higher than matched controls [41].”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites [41] Glaubitz, 2025, The cost of the diagnostic odyssey of patients with suspected rare diseases, Orphanet J. Rare Dis. source
The Abstract Results and Conclusion report that mean direct healthcare costs during the diagnostic pathway were 7.6-fold higher for patients with suspected rare diseases than for matched controls. They do not establish that the investigations were uncoordinated or that the 7.6-fold difference was specifically the cost of clinical investigations; the measure includes inpatient, outpatient, and prescription drug costs. (LLM, conf=0.89)
Experimental — accuracy not yet measured
- Findingnone given
MAS have an unreliability tax of 15-50× higher token consumption compared to standalone models.
“an unreliability tax of 15–50× higher token consumption compared to standalone models”
Quote in the paperNot a substantial claim - Findingnone given
Recent MAS implementations improved oncology decision-making accuracy from 30.3% to 87.2%.
“recent implementations improved oncology decision-making accuracy from 30.3% to 87.2%”
Quote in the paperSubstantial claim - Findingnone given
MAS reached a peak of 93.2% accuracy on USMLE-style benchmarks through simulated clinical evolution.
“reached a peak of 93.2% accuracy on USMLE-style benchmarks through simulated clinical evolution”
Quote in the paperSubstantial claim - Findingnone given
Heterogeneity in evaluation settings, differences in datasets, agent configurations, and outcome metrics makes it difficult to directly compare performance across MAS.
“Third, heterogeneity in evaluation settings, differences in datasets, agent configurations, and outcome metrics makes it difficult to directly compare performance across systems.”
Quote in the paperSubstantial claim - Findingnone given
Prototype systems in drug discovery, bioinformatics, and clinical decision support have already illustrated benefits of MAS, in some cases achieving results that rival or exceed prior single-model methods.
“Prototype systems in drug discovery, bioinformatics, and clinical decision support have already illustrated these benefits, in some cases achieving results that rival or exceed prior single-model methods.”
Quote in the paperSubstantial claim - Interpretationnone given
MAS carry the risk of cascading errors where initial hallucinations are amplified across the agent collective.
“the risk of cascading errors where initial hallucinations are amplified across the agent collective”
Quote in the paperNot a substantial claim - Interpretationreasoning
MAS architectures yield significant performance gains in various domains.
“We find that MAS architectures yield significant performance gains in various domains”
Quote in the paperSubstantial claim - Interpretationreasoning
These benchmark results do not yet represent established clinical endpoints.
“These are benchmarked tasks; the manuscript provides limited clinical outcome evaluation, so we treat these as benchmarks rather than clinical endpoints.”
Quote in the paperSubstantial claim - Premisecitation
Researchers have already demonstrated that orchestrating multiple specialized agents can outperform single-model approaches on challenging tasks.
“Researchers have already demonstrated that orchestrating multiple specialized agents can outperform single-model approaches on challenging tasks [28,29].”
Quote in the paperNot a substantial claim0 of 2 sources checked- cites [28] Sutton, R.S., and Barto, A.G. (2018). Reinforcement Learning: An Introduction, MIT Press. [2nd ed.].
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites [29] Ferber, D., Wei, J., Ghaffari Laleh, N., Wu, Z., Tan, Y., Peng, C., Wang, X., Liu, Y., Zhang, Z., and Chen, J. (2025). Multimodal Oncology Agent for IDH1 Mutation Prediction in Low-Grade Glioma. arXiv.
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Premisereasoning
GPCR-Nexus produces context-rich, evidence-backed answers to questions that neither a conventional search engine nor a single LLM alone could easily handle.
“GPCR-Nexus produces context-rich, evidence-backed answers to questions that neither a conventional search engine nor a single LLM alone could easily handle.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [30] (2026, February 20). Multi-Agent Orchestration for Knowledge Extraction and Retrieval: AI Expert System for GPCRs. bioRxiv 2025, Available online: https://submit.biorxiv.org/submission/pdf?msid=BIORXIV/2025/696782.
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Premisecitation
GPCR-Nexus is an MAS that focuses on G protein-coupled receptors (GPCRs), a large family of drug targets.
“GPCR-Nexus is an MAS that focuses on G protein-coupled receptors (GPCRs), a large family of drug targets [30].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [30] (2026, February 20). Multi-Agent Orchestration for Knowledge Extraction and Retrieval: AI Expert System for GPCRs. bioRxiv 2025, Available online: https://submit.biorxiv.org/submission/pdf?msid=BIORXIV/2025/696782.
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Interpretationreasoning
By combining hierarchical planning, tool use, parallel problem solving, and iterative self-correction, current frameworks are beginning to enable autonomous agent teams that are more robust and capable than any single AI agent.
“By combining these approaches, hierarchical planning, tool use, parallel problem solving, and iterative self-correction, current frameworks are beginning to enable autonomous agent teams that are more robust and capable than any single AI agent.”
Quote in the paperNot a substantial claim - Interpretationcitation
Systematic integration of specialized diagnostic tools can effectively mitigate the genericity and reasoning bottlenecks of standalone LLMs in oncology.
“These results demonstrate that the systematic integration of specialized diagnostic tools can effectively mitigate the genericity and reasoning bottlenecks of standalone LLMs in oncology.”
Quote in the paperSubstantial claim - Interpretationreasoning
By delegating complex subtasks to specialized agents, a MAS can synthesize a more comprehensive and evidence-backed treatment plan than a single model's monologue.
“By delegating complex subtasks, such as lesion measurement via MedSAM or mutation prediction via vision transformers, to specialized agents, the MAS can synthesize a more comprehensive and evidence-backed treatment plan than a single model’s monologue.”
Quote in the paperSubstantial claim - Premisecitation
DORA was able to automatically draft biomedical research project proposals that were later refined by humans.
“a research assistant agent named DORA was able to automatically draft biomedical research project proposals that were later refined by humans [38]”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [38] Naumov, V., Zagirova, D., Lin, S., Xie, Y., Gou, W., Urban, A., and Zhavoronkov, A. (2025). DORA AI Scientist: Multi-agent Virtual Research Team for Scientific Exploration Discovery and Automated Report Generation. bioRxiv. source
- Interpretationcitation
Based on Miller's Pyramid, 92.22% accuracy on MedQA benchmarks is a measure of the 'Knows' and 'Knows How' foundational levels of medical knowledge, rather than a surrogate for the 'Shows How' or 'Does' levels required for dynamic, real-world patient interactions.
“based on Miller’s Pyramid of Clinical Competence, it is critical to recognize that a 92.22% accuracy on MedQA benchmarks is a measure of the ‘Knows’ and ‘Knows How’ foundational levels of medical knowledge, rather than a surrogate for the ‘Shows How’ or ‘Does’ levels, which is required for dynamic, real-world patient interactions [40].”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [40] Miller, 1990, The assessment of clinical skills/competence/performance, Acad. Med. source
- Premisecitation
Letting an agent analyze and criticize an initial draft leads to more factual and internally consistent responses.
“Multiple studies report that letting an agent analyze and criticize an initial draft leads to more factual and internally consistent responses.”
Quote in the paperNot a substantial claim - Interpretationreasoning
Ensuring that a team of AI agents works reliably is more complex than verifying a single model's output.
“Ensuring that a team of AI agents works reliably is more complex than verifying a single model’s output.”
Quote in the paperSubstantial claim - Premisecitation
The system was preferred for its specificity in 509 cases versus 181 for human providers (p < 0.001).
“Furthermore, the system was preferred for its specificity in 509 cases versus 181 for human providers (p < 0.001), illustrating that the high token expenditure of agentic loops is economically justified when the cost of diagnostic or administrative error exceeds the marginal cost of increased computing.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [54] Klang, 2025, Assessing retrieval-augmented large language models for medical coding, NEJM AI source
- Interpretationcitation
The high token expenditure of agentic loops is economically justified when the cost of diagnostic or administrative error exceeds the marginal cost of increased computing.
“Furthermore, the system was preferred for its specificity in 509 cases versus 181 for human providers (p < 0.001), illustrating that the high token expenditure of agentic loops is economically justified when the cost of diagnostic or administrative error exceeds the marginal cost of increased computing.”
Quote in the paperNot a substantial claim - Interpretationreasoning
Errors can propagate or even be amplified if agents take each other's faulty outputs at face value.
“Errors can propagate or even be amplified if agents take each other’s faulty outputs at face value.”
Quote in the paperSubstantial claim - Interpretationreasoning
With multiple agents interacting, new failure modes emerge.
“With multiple agents interacting, new failure modes emerge.”
Quote in the paperSubstantial claim - Premisereasoning
Current MASs, especially those based on large language models, face practical challenges in scalability and computational efficiency.
“Current MASs, especially those based on large language models, face practical challenges in scalability and computational efficiency.”
Quote in the paperSubstantial claim - Interpretationreasoning
By eliminating free form prompts in favor of structured JSON payloads, MCP reduces the risk of prompt injection or unexpected data leakage.
“By eliminating free form prompts in favor of structured JSON payloads, MCP reduces the risk of prompt injection or unexpected data leakage, since every query and response must conform to an expected schema and type.”
Quote in the paperNot a substantial claim - Interpretationreasoning
Even partial formalization, such as checklists or rule-based audits performed by an agent, can help catch errors in MAS.
“While true formal proofs may be infeasible for complex language-based behaviors, even partial formalization, such as checklists or rule-based audits performed by an agent, can help catch errors.”
Quote in the paperNot a substantial claim - Premisenone given
MAS can exhibit emergent behaviors not readily predictable from their components.
“One challenge is that MAS can exhibit emergent behaviors not readily predictable from their components (as has been observed in some social simulations).”
Quote in the paperSubstantial claim - Interpretationreasoning
Exam scores are a misleading proxy for clinical readiness.
“Ultimately, the bigger picture indicates that exam scores are a misleading proxy for clinical readiness; the transition from “AI scientist” to “AI clinician” requires moving beyond static facts toward high-fidelity, practice-oriented frameworks that mandate rigorous human-in-the-loop oversight to bridge the gap between theoretical knowledge and bedside utility [41,67].”
Quote in the paperSubstantial claim - Interpretationreasoning
This publication bias can lead to an overly optimistic view of multi-agent approaches.
“This publication bias can lead to an overly optimistic view of multi-agent approaches.”
Quote in the paperSubstantial claim - Premisereasoning
Traditional static testing might not capture an agent team's behavior in all scenarios.
“This can make validation tricky; traditional static testing might not capture an agent team’s behavior in all scenarios.”
Quote in the paperSubstantial claim - Premisereasoning
Combining multiple agents does not automatically cancel out biases in the underlying models or data.
“Combining multiple agents does not automatically cancel out biases in the underlying models or data.”
Quote in the paperSubstantial claim - Interpretationreasoning
By breaking down complex tasks into collaborative subtasks and instituting internal checks-and-balances, multi-agent designs address many shortcomings of standalone LLMs.
“By breaking down complex tasks into collaborative subtasks and instituting internal checks-and-balances, multi-agent designs address many shortcomings of standalone LLMs.”
Quote in the paperSubstantial claim - Interpretationreasoning
Some multi-agent setups appear to outperform single large models not due to teamwork, but because averaging out errors yields more robust answers.
“In other words, some multi-agent setups appear to outperform single large models not due to teamwork, but because averaging out errors yields more robust answers.”
Quote in the paperSubstantial claim - Premisereasoning
With multiple agents in a system, a faulty output from one agent can mislead others and propagate or amplify the mistake throughout the system.
“With multiple agents in a system, a faulty output from one agent can mislead others and propagate or amplify the mistake throughout the system.”
Quote in the paperSubstantial claim - Premisereasoning
There is a risk that agents could reinforce each other's biases.
“In fact, there is a risk that agents could reinforce each other’s biases (if, say, a lead agent has a bias and other agents trust its conclusions).”
Quote in the paperNot a substantial claim - Premisecitation
Simple ensembling methods (majority voting) may account for most of the performance gains initially attributed to complex agent interactions.
“In fact, simple ensembling methods (majority voting) may account for most of the performance gains initially attributed to complex agent interactions [66].”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [66] Choi, H.K., Zhu, X., and Li, S. (2025). Debate or Vote: Which Yields Better Decisions in Multi-Agent Large Language Models?. arXiv. source
- Interpretationcitation
Traditional validation methods, which assume a fixed algorithm, may not suffice for adaptive, learning agent teams.
“Traditional validation methods, which assume a fixed algorithm, may not suffice for adaptive, learning agent teams.”
Quote in the paperSubstantial claim - Premisecitation
The FDA has acknowledged that its traditional paradigm for device regulation was not designed for continuously learning AI/ML systems.
“Indeed, the FDA has acknowledged that its traditional paradigm for device regulation was not designed for continuously learning AI/ML systems [62,63,73].”
Quote in the paperNot a substantial claim0 of 3 sources checked- cites [62] (2019). Medical Devices: Application of Risk Management to Medical Devices (Standard No. ISO 14971:2019).
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites [63] (2015). Medical Device Software: Software Life-Cycle Processes (Standard No. IEC 62304:2006 + A1:2015). source
- cites [73] U.S. Food and Drug Administration (2025, September 25). Artificial Intelligence in Software as a Medical Device, Available online: https://www.fda.gov/medical-devices/software-medical-device-samd/artificial-intelligence-software-medical-device.
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Interpretationreasoning
A solution that works in a controlled research demo might thus be too slow or expensive for real clinical settings.
“A solution that works in a controlled research demo might thus be too slow or expensive for real clinical settings.”
Quote in the paperSubstantial claim - Premisenone given
A notable bias in the current literature is the focus on success stories-many MAS studies highlight impressive outcomes, whereas failures or neutral results often go unreported.
“A notable bias in the current literature (and thus in our review) is the focus on success stories—many MAS studies highlight impressive outcomes, whereas failures or neutral results often go unreported.”
Quote in the paperSubstantial claim
- Classified as probably not a substantial claim. 93
- May combine two claims. 50
- The quote only partly states this claim. 4
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
PremisecitationLangGraph models a multi-agent system as a stateful graph, giving developers fine-grained control over execution paths.
“LangGraph, which models a multi-agent system as a stateful graph, giving developers fine-grained control over execution paths.”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites [14] Derouiche, H., Brahmi, Z., and Mezni, H. (2025). Agentic AI Frameworks: Architectures, Protocols, and Design Challenges. arXiv. source
The Comparative overview (p. 4) describes LangGraph as a graph-based model for sequencing tasks among LLM agents, with compositional flows and stateful operations. The Memory section (p. 5) also describes stateful graph nodes. The paper does not specifically attribute fine-grained developer control over execution paths to LangGraph; its explicit fine-grained-control description refers to Semantic Kernel. (LLM, conf=0.83)
Experimental — accuracy not yet measured
May combine two claims.
PremisecitationThe virtual tumor board system leverages GPT-4 as a core reasoning engine and incorporates specialized precision oncology tools, including vision transformers for detecting microsatellite instability (MSI) and mutations (KRAS, BRAF) from histopathology slides, MedSAM for radiological image segmentation, and web-based search tools like OncoKB and PubMed.
“The system leverages GPT-4 as a core reasoning engine and incorporates specialized precision oncology tools, including vision transformers for detecting microsatellite instability (MSI) and mutations (KRAS, BRAF) from histopathology slides, MedSAM for radiological image segmentation, and web-based search tools like OncoKB and PubMed [34].”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites [34] Ferber, 2025, Development and validation of an autonomous artificial intelligence agent for clinical decision-making in oncology, Nat. Cancer source
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationModern agent frameworks often implement a shared knowledge store or blackboard that agents can read from and write to during collaboration.
“Modern agent frameworks often implement a shared knowledge store or blackboard that agents can read from and write to during collaboration [16].”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites [16] Joshi, 2025, Review of autonomous systems and collaborative AI agent frameworks, Int. J. Sci. Res. Arch. source
Section 5.3, “Multi-Agent Systems for Collaborative Problem Solving” (page not provided), discusses collaborative frameworks and proposes that future systems enable agents to share knowledge. It does not say that modern frameworks often implement a shared store or blackboard that agents read from and write to. (LLM, conf=0.82)
Experimental — accuracy not yet measured
Classified as probably not a substantial claim. May combine two claims.
PremisecitationMAS orchestration frameworks provide the infrastructure and design patterns to build systems where multiple AI agents collaborate and solve data-analysis problems more effectively than any individual agent alone.
“MAS orchestration frameworks provide the infrastructure and design patterns (messaging systems, shared memory stores, standardized agent interfaces, etc.) to build systems where multiple AI agents collaborate and solve data-analysis problems more effectively than any individual agent alone [9,16].”
Quote in the paperSubstantial claim2 of 2 sources checked- cites [9] Adimulam, A., Gupta, R., and Kumar, S. (2026). The Orchestration of Multi-Agent Systems: Architectures, Protocols, and Enterprise Adoption. arXiv. source
Sections III and IV describe orchestration infrastructure, communication protocols, and specialized agents working together; Section IV says their outcomes can surpass those of a single general-purpose agent. Section VIII gives a data-intensive insurance example, but the paper does not establish that orchestrated agents solve data-analysis problems generally more effectively than any individual agent alone. Page numbers are unavailable in our copy. (LLM, conf=0.82)
Experimental — accuracy not yet measured - cites [16] Joshi, 2025, Review of autonomous systems and collaborative AI agent frameworks, Int. J. Sci. Res. Arch. source
Sections 2.1 and 5.3 (pages unavailable) describe orchestration frameworks and multi-agent systems for collaborative problem-solving. They do not establish that agents solve data-analysis problems more effectively than an individual agent, and the cited passages do not specify the messaging, shared-memory, or standardized-interface features in the printed sentence. (LLM, conf=0.86)
Experimental — accuracy not yet measured
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationIn 2023, Google introduced an Agent-to-Agent (A2A) communication protocol as an open standard for LLM-based agents to exchange messages in a structured, secure manner.
“Notably, in 2023, Google introduced an Agent-to-Agent (A2A) communication protocol as an open standard for LLM-based agents to exchange messages in a structured, secure manner [25,26].”
Quote in the paperNot a substantial claim1 of 2 sources checked- cites [25] Louck, Y., Stulman, A., and Dvir, A. (2025). Improving Google A2A Protocol: Protecting Sensitive Data and Mitigating Unintended Harms in Multi-Agent Systems. arXiv. source
The Introduction and Related Work (p. 1) describe Google’s A2A as a structured, secure framework for communication between agents. They do not call A2A an open standard, and the paper’s References (p. 12) date the cited announcement of the protocol to April 2025, not 2023. (LLM, conf=0.88)
Experimental — accuracy not yet measured - cites [26] Surapaneni, R., Jha, M., Vakoc, M., and Segal, T. (2025, October 01). Announcing the Agent2Agent Protocol (A2A)—A New Era of Agent Interoperability. Google for Developers Blog. Available online: https://developers.googleblog.com/en/a2a-a-new-era-of-agent-interoperability/.
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationVarious feedback and self-correction techniques have been introduced to improve LLM reliability, such as Reflexion and Self-Refine.
“various feedback and self-correction techniques have been introduced to improve LLM reliability, such as Reflexion and Self-Refine [21,22].”
Quote in the paperNot a substantial claim2 of 2 sources checkedProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
InterpretationcitationSu et al. report relative improvements but do not specify exact percentage deltas; therefore, we treat this as illustrative, pending peer-reviewed, fully quantified results.
“It is important to note that Su et al. report relative improvements but do not specify exact percentage deltas; therefore, we treat this as illustrative, pending peer-reviewed, fully quantified results.”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites [32] Su, H., Long, W., and Zhang, Y. (2025). BioMaster: Multi-agent system for automated bioinformatics analysis workflows. bioRxiv. source
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationMethods such as Toolformer showed that LLMs can learn to call external APIs to aid in problem-solving.
“methods such as Toolformer showed that LLMs can learn to call external APIs to aid in problem-solving [18].”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites [18] Schick, T., Dwivedi-Yu, J., Dessì, R., Raileanu, R., Lomeli, M., Hambro, E., and Scialom, T. (2023). Toolformer: Language models can teach themselves to use tools. arXiv. source
May combine two claims.
PremisecitationIn benchmarked evaluations, TxAgent achieved 92.1% accuracy on DrugPC (open-ended drug reasoning), and 93.6%/93.7% on BrandPC/GenericPC, outperforming GPT-4o and other tool-use LLMs across 3168 drug reasoning tasks and 456 personalized treatment scenarios.
“In benchmarked evaluations, TxAgent achieved 92.1% accuracy on DrugPC (open-ended drug reasoning), and 93.6%/93.7% on BrandPC/GenericPC, outperforming GPT-4o and other tool-use LLMs across 3168 drug reasoning tasks and 456 personalized treatment scenarios.”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites [31] Gao, S., Zhu, R., Kong, Z., Noori, A., Su, X., Ginder, C., and Zitnik, M. (2025). TxAgent: An AI agent for therapeutic reasoning across a universe of tools. arXiv. source
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
PremisecitationAn analysis of the A2A framework identified potential attack vectors (e.g., prompt injection, token reuse, agent impersonation) and emphasized the need for agent authentication and permission controls.
“An analysis of the A2A framework identified potential attack vectors (e.g., prompt injection, token reuse, agent impersonation) and emphasized the need for agent authentication and permission controls [27].”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites [27] Zhang, Z., Cui, S., Lu, Y., Zhou, J., Yang, J., Wang, H., and Huang, M. (2024). Agent-SafetyBench: Evaluating the safety of multi-agent AI systems. arXiv. source
The Failure Mode Analysis (§4.3; page not provided) discusses tool-use robustness and risk awareness, not an analysis of the A2A framework. Searches for A2A, token reuse, agent impersonation, and authentication found no passage addressing the claimed attack vectors or proposed controls. (LLM, conf=0.76)
Experimental — accuracy not yet measured
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationAn agent team can adopt a self-consistency approach where multiple agents independently work on the same problem and then vote or converge on an answer.
“an agent team can adopt a self-consistency approach where multiple agents independently work on the same problem and then vote or converge on an answer [19].”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites [19] Wang, X., Wei, J., Schuurmans, D., Le, Q., Chi, E., Narang, S., and Zhou, D. (2022). Self-consistency improves chain-of-thought reasoning in language models. arXiv. source
The Table 5 passage (section E.4; page not provided) reports a self-consistency variant using five responses per question, supporting the idea of multiple attempts at the same problem. It does not describe independent agents working as a team or say that they vote or converge on an answer. (LLM, conf=0.82)
Experimental — accuracy not yet measured
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationIn an MAS context, guardrails can be implemented by assigning a dedicated critic or reviewer agent to evaluate and correct the outputs of other agents.
“In an MAS context, such guardrails can be implemented by assigning a dedicated critic or reviewer agent to evaluate and correct the outputs of other agents [23,24].”
Quote in the paperNot a substantial claim2 of 2 sources checked- cites [23] Wang, T., Yu, P., Tan, X.E., O’Brien, S., Pasunuru, R., Dwivedi-Yu, J., and Celikyilmaz, A. (2023). Shepherd: A Critic for Language Model Generation. arXiv. source
The Introduction describes Shepherd as a dedicated model that critiques another model’s outputs, identifies errors, and suggests actionable refinements (page not specified). It does not describe an MAS guardrail implementation or show Shepherd directly correcting other agents’ outputs; those parts extend beyond the paper. (LLM, conf=0.86)
Experimental — accuracy not yet measured - cites [24] He, 2025, Llm-based multi-agent systems for software engineering: Literature review, vision, and the road ahead, ACM Trans. Softw. Eng. Methodol. source
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationAgents can implement a Tree-of-Thoughts strategy, collectively exploring different reasoning branches in parallel and exchanging information to decide on the best path forward.
“Agents can also implement a Tree-of-Thoughts strategy, collectively exploring different reasoning branches in parallel and exchanging information to decide on the best path forward [18,20].”
Quote in the paperNot a substantial claim2 of 2 sources checked- cites [18] Schick, T., Dwivedi-Yu, J., Dessì, R., Raileanu, R., Lomeli, M., Hambro, E., and Scialom, T. (2023). Toolformer: Language models can teach themselves to use tools. arXiv. source
The Introduction describes a language model choosing when to use tools, and Section 4.2 describes its zero-shot evaluation. Neither those passages nor searches for Tree-of-Thoughts, parallel reasoning branches, and agents exchanging information found a passage addressing the attributed strategy. Our copy therefore does not verify this claim. (LLM, conf=0.76)
Experimental — accuracy not yet measured - cites [20] Yao, S., Yu, D., Zhao, J., Shafran, I., Griffiths, T., Cao, Y., and Narasimhan, K. (2023). Tree of Thoughts: Deliberate Problem Solving with Large Language Models. arXiv. source
The Introduction and Section 5 describe Tree of Thoughts as exploring multiple reasoning paths and evaluating which to pursue. They describe language-model self-evaluation, not multiple agents collectively exploring branches or exchanging information; those parts of the attributed claim are unsupported. (LLM, conf=0.88)
Experimental — accuracy not yet measured
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationCrewAI organizes a multi-agent system as a team of role-based agents-Planner, Executor, Researcher, Reviewer, and Critic-who collaborate through structured but adaptive message exchanges.
“CrewAI, by contrast, organizes a multi-agent system as a team of role-based agents—Planner, Executor, Researcher, Reviewer, and Critic—who collaborate through structured but adaptive message exchanges.”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites [14] Derouiche, H., Brahmi, Z., and Mezni, H. (2025). Agentic AI Frameworks: Architectures, Protocols, and Design Challenges. arXiv. source
The Comparative overview (p. 3) describes CrewAI as promoting role-based collaboration, coordination, and delegation among agents. It does not identify the five named roles or describe CrewAI’s collaboration as structured but adaptive message exchanges. The Limitations section (p. 6) instead notes that predefined roles in CrewAI cannot easily change during execution. (LLM, conf=0.86)
Experimental — accuracy not yet measured
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationCrewAI leverages agent autonomy and role specialization to coordinate tasks dynamically based on the evolving problem state.
“Rather than enforcing a predefined graph, CrewAI leverages agent autonomy and role specialization to coordinate tasks dynamically based on the evolving problem state [14].”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites [14] Derouiche, H., Brahmi, Z., and Mezni, H. (2025). Agentic AI Frameworks: Architectures, Protocols, and Design Challenges. arXiv. source
The Comparative overview (p. 3) describes CrewAI as promoting role-based collaboration, coordination, and delegation, supporting the role-specialization part of the claim. But Limitations and Challenges (p. 6) says CrewAI’s predefined roles limit adaptability during execution and that agent interactions are often statically defined; it does not support the claim that CrewAI coordinates tasks dynamically as the problem evolves. (LLM, conf=0.86)
Experimental — accuracy not yet measured
May combine two claims.
PremisecitationQualitatively, the dialogues revealed that agents effectively introduced diverse perspectives, such as identifying rare syndromes or flagging lab abnormalities that contradicted specific hypotheses, leading to a more thorough analysis than a single model's monologue.
“Qualitatively, the dialogues revealed that agents effectively introduced diverse perspectives, such as identifying rare syndromes or flagging lab abnormalities that contradicted specific hypotheses, leading to a more thorough analysis than a single model’s monologue.”
Quote in the paperSubstantial claim1 of 1 sources checked- cites [35] Chen, 2025, Enhancing diagnostic capability with multi-agent conversational LLMs, npj Digit. Med. source
Split into 2 atoms — 1 confirmed, 1 partially supported, 0 disputed, 0 misattributed, 0 unverifiable. Expand the claim to see per-atom verdicts.
Experimental — accuracy not yet measured
May combine two claims.
PremisecitationToken consumption for MAS reached over 6000 tokens compared to just 118 for standard input/output prompting.
“token consumption for MAS reached over 6000 tokens compared to just 118 for standard input/output prompting”
Quote in the paperSubstantial claim1 of 1 sources checked- cites [35] Chen, 2025, Enhancing diagnostic capability with multi-agent conversational LLMs, npj Digit. Med. source
The Results section, “Comparison with other methods to improve diagnostic performance” (page unavailable), says MAC produced the highest average output tokens, and the Methods section identifies Input/Output prompting as a comparison method. Our copy does not give the claimed figures of over 6,000 and 118 tokens, so the numerical comparison is unsupported. (LLM, conf=0.85)
Experimental — accuracy not yet measured
The quote only partly states this claim.
PremisecitationMAC's 34.11% primary accuracy beat Self-Refine (32.01%).
“Self-Refine (32.01%)”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites [35] Chen, 2025, Enhancing diagnostic capability with multi-agent conversational LLMs, npj Digit. Med. source
Table 1 in Results reports 34.11% accuracy for MAC’s most likely diagnosis in primary consultation. The Results comparison says MAC outperformed Self-Refine, but our copy does not give Self-Refine’s claimed 32.01%; it directs readers to Supplementary Table 12 for those results. (LLM, conf=0.84)
Experimental — accuracy not yet measured
May combine two claims.
PremisecitationThe multi-agent approach significantly outperformed single-model baselines in both initial diagnosis and follow-up consultations.
“The multi-agent approach significantly outperformed single-model baselines in both initial diagnosis and follow-up consultations.”
Quote in the paperSubstantial claim1 of 1 sources checked- cites [35] Chen, 2025, Enhancing diagnostic capability with multi-agent conversational LLMs, npj Digit. Med. source
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationTrialGPT-Retrieval conducts a large-scale search to retrieve candidate trials from databases based on a patient's profile.
“TrialGPT-Retrieval, first conducts a large-scale search to retrieve candidate trials from databases based on a patient’s profile”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites [36] Jin, 2024, Matching patients to clinical trials with large language models, Nat. Commun. source
May combine two claims.
PremisecitationIn Chen et al.'s system, four AI doctor agents, each with a specialized knowledge focus or reasoning style, discuss a patient case, while a fifth agent acts as a supervisor to coordinate the conversation.
“four AI “doctor” agents, each with a specialized knowledge focus or reasoning style, discuss a patient case, while a fifth agent acts as a supervisor to coordinate the conversation”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites [35] Chen, 2025, Enhancing diagnostic capability with multi-agent conversational LLMs, npj Digit. Med. source
The Methods (Study design) and Results (Fig. 2 caption; pages unavailable) describe three doctor agents discussing a case with one coordinating supervisor, not four doctors and a fifth supervisor. The Methods (Subgroup analysis within MAC) describe assigning specialties as a tested variation; the Results say the standard configuration had no assigned specialties. The supervisor’s coordinating role is supported, but the claimed agent count and characterization of every doctor as specialized are not. (LLM, conf=0.90)
Experimental — accuracy not yet measured
May combine two claims.
PremisecitationHelpfulness rate for recommended further diagnostic tests reached 78.26%, an improvement over the GPT-4 baseline of 58.17% (p < 0.001).
“The helpfulness rate for recommended further diagnostic tests reached 78.26%, a marked improvement over the GPT-4 baseline of 58.17% (p < 0.001).”
Quote in the paperSubstantial claim1 of 1 sources checked- cites [35] Chen, 2025, Enhancing diagnostic capability with multi-agent conversational LLMs, npj Digit. Med. source
Table 1 in Results reports a 78.26% helpful rate for further diagnostic tests with the four-agent GPT-4 framework, versus 58.17% for standalone GPT-4, in primary consultations. The Results describe MAC’s improvement as significant, but our copy does not give p < 0.001 for this specific comparison; it also limits these figures to primary consultations. (LLM, conf=0.88)
Experimental — accuracy not yet measured
The quote only partly states this claim.
PremisecitationMAC's 34.11% primary accuracy beat Self-Consistency (32.45%).
“and Self-Consistency (32.45%) methods”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites [35] Chen, 2025, Enhancing diagnostic capability with multi-agent conversational LLMs, npj Digit. Med. source
In Results, Table 1 reports 34.11% primary-consultation accuracy for MAC with GPT-4 and four doctor agents. The same table assigns 32.45% to MAC with three doctor agents, not to Self-Consistency. The Results comparison says MAC outperformed Self-Consistency, but our copy does not substantiate the claimed 32.45% figure for Self-Consistency. (LLM, conf=0.90)
Experimental — accuracy not yet measured
May combine two claims.
Study design and conductreasoningThe study's reliance on a small sample size (n = 20) and proprietary cloud-based models limits its generalizability and clinical robustness.
“the study’s reliance on a small sample size (n = 20) and proprietary cloud-based models suggests that future research must prioritize large-scale prospective evaluations and the development of local, open-source architectures”
Quote in the paperSubstantial claim1 of 1 sources checked- cites [34] Ferber, 2025, Development and validation of an autonomous artificial intelligence agent for clinical decision-making in oncology, Nat. Cancer source
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
PremisecitationThe authors trained agents using 20,000 simulated patient encounters per task, evaluating them on a test set of 200 cases.
“The authors trained agents using 20,000 simulated patient encounters per task, evaluating them on a test set of 200 cases.”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites [39] Li, J., Lai, Y., Li, W., Ren, J., Zhang, M., Kang, X., and Liu, Y. (2025). Agent Hospital: A simulacrum of hospital with evolvable medical agents. arXiv. source
May combine two claims.
InterpretationcitationThis enables the agent to learn from experience and refine clinical reasoning over time.
“This enables the agent to learn from experience and refine clinical reasoning over time [39].”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites [39] Li, J., Lai, Y., Li, W., Ren, J., Zhang, M., Kang, X., and Liu, Y. (2025). Agent Hospital: A simulacrum of hospital with evolvable medical agents. arXiv. source
May combine two claims.
InterpretationcitationPerformance improvements arise specifically from the agent's ability to accumulate experience and leverage structured case memory, confirming that multi-agent interaction, not only the base model, drives accuracy gains in an experimental setting.
“This demonstrates that the performance improvements arise specifically from the agent’s ability to accumulate experience and leverage structured case memory—confirming that multi-agent interaction, not only the base model, drives the accuracy gains in an experimental setting.”
Quote in the paperSubstantial claim1 of 1 sources checked- cites [39] Li, J., Lai, Y., Li, W., Ren, J., Zhang, M., Kang, X., and Liu, Y. (2025). Agent Hospital: A simulacrum of hospital with evolvable medical agents. arXiv. source
The quote only partly states this claim.
PremisecitationMedAgent-Zero significantly outperformed standard CoT (90.42%).
“and standard CoT (90.42%)”
Quote in the paperSubstantial claim1 of 1 sources checked- cites [39] Li, J., Lai, Y., Li, W., Ren, J., Zhang, M., Kang, X., and Liu, Y. (2025). Agent Hospital: A simulacrum of hospital with evolvable medical agents. arXiv. source
Table 4 reports 92.22% accuracy for MedAgent-Zero and 90.42% for CoT with GPT-4o on MedQA, supporting the comparison and the CoT figure. Section C.5 says MedAgent-Zero outperforms the other methods, but the cited passages do not establish that this 1.80-percentage-point difference is statistically significant. (LLM, conf=0.85)
Experimental — accuracy not yet measured
May combine two claims.
Premiseown dataIn the initial pass, TrialGPT-Retrieval successfully recalled over 90% of relevant trials while filtering out most irrelevant ones, requiring less than 6% of the total collection to maintain this high recall.
“TrialGPT-Retrieval successfully recalled over 90% of relevant trials while filtering out most irrelevant ones, requiring less than 6% of the total collection to maintain this high recall”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites [36] Jin, 2024, Matching patients to clinical trials with large language models, Nat. Commun. source
May combine two claims.
PremisecitationMedAgent-Zero incorporates two memory systems: an experience base storing tens of thousands of simulated patient trajectories and a case base containing curated medical Q&A exemplars.
“MedAgent-Zero incorporates two memory systems: an experience base storing tens of thousands of simulated patient trajectories (symptoms → tests → diagnosis → outcome) and a case base containing curated medical Q&A exemplars.”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites [39] Li, J., Lai, Y., Li, W., Ren, J., Zhang, M., Kang, X., and Liu, Y. (2025). Agent Hospital: A simulacrum of hospital with evolvable medical agents. arXiv. source
The Doctor Agent Evolution section identifies both memory bases, and B.2 describes the medical case base as validated question–answer pairs. But Doctor Agent Evolution and B.3 say the experience base stores rules or principles learned from errors, not patient trajectories. C.2 reports treating 50,000 simulated patients; it does not say their trajectories were stored in that base. (LLM, conf=0.90)
Experimental — accuracy not yet measured
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationTrialGPT-Ranking assigns scores to rank the trials by suitability.
“TrialGPT-Ranking, assigns scores to rank the trials by suitability”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites [36] Jin, 2024, Matching patients to clinical trials with large language models, Nat. Commun. source
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationTrialGPT-Matching evaluates the patient's eligibility against each trial's criteria using LLM-based reading and annotation of inclusion/exclusion criteria.
“TrialGPT-Matching, then evaluates the patient’s eligibility against each trial’s criteria using LLM-based reading and annotation of inclusion/exclusion criteria”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites [36] Jin, 2024, Matching patients to clinical trials with large language models, Nat. Commun. source
May combine two claims.
PremisecitationCurrent improvements may follow a 'scaling law' where gains slow as patient volume increases, suggesting an eventual performance ceiling.
“current improvements may follow a “scaling law” where gains slow as patient volume increases, suggesting an eventual performance ceiling”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites [39] Li, J., Lai, Y., Li, W., Ren, J., Zhang, M., Kang, X., and Liu, Y. (2025). Agent Hospital: A simulacrum of hospital with evolvable medical agents. arXiv. source
The “Scaling Laws in Evolution” section reports that diagnostic accuracy improved rapidly for the first 10,000 patient agents, then improved more slowly while continuing to rise through 50,000. This supports slowing gains as patient volume increases, but the paper does not suggest an eventual performance ceiling. (LLM, conf=0.84)
Experimental — accuracy not yet measured
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationIn Agent-SafetyBench, MAS are challenged with scenarios and scored on rule adherence.
“In this benchmark, MAS are challenged with scenarios (making treatment recommendations under specific constraints) and scored on rule adherence.”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites [27] Zhang, Z., Cui, S., Lu, Y., Zhou, J., Yang, J., Wang, H., and Huang, M. (2024). Agent-SafetyBench: Evaluating the safety of multi-agent AI systems. arXiv. source
The Benchmark and Conclusion sections describe diverse test cases for LLM agents, and the Step4 passage says interactions receive safe-or-unsafe labels that determine a safety score. The paper does not describe the evaluated agents as multi-agent systems (MAS), and safety scoring is broader than rule adherence. It gives a medication-and-allergies example, but does not characterize the benchmark as treatment recommendations under specific constraints; no page numbers are available in our copy. (LLM, conf=0.88)
Experimental — accuracy not yet measured
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationZhang et al. (2024) introduced Agent-SafetyBench, a suite of tests to evaluate whether agents respect certain safety and ethical rules in medical and general contexts.
“Recently, Zhang et al., (2024) introduced Agent-SafetyBench, a suite of tests to evaluate whether agents respect certain safety and ethical rules in medical and general contexts [27].”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites [27] Zhang, Z., Cui, S., Lu, Y., Zhou, J., Yang, J., Wang, H., and Huang, M. (2024). Agent-SafetyBench: Evaluating the safety of multi-agent AI systems. arXiv. source
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationThe socioeconomic burden of diagnostic errors is estimated to affect up to 1.8% of GDP in developed economies.
“While the architectural overhead of agentic orchestration is significant, the socioeconomic burden of diagnostic errors, which is estimated to affect up to 1.8% of GDP in developed economies, provides a strong argument for the “accuracy premium” offered by collaborative designs [55].”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites [55] Slawomirski, L., Kelly, D., de Bienassis, K., Kallas, K.A., and Klazinga, N. (2025). The Economics of Diagnostic Safety, OECD Publishing. OECD Health Working Papers, No. 176. source
Section 133 estimates the direct cost of diagnostic error at about 1.8% of GDP in a typical OECD country. The citing sentence calls this a socioeconomic burden, but the paper identifies the 1.8% figure as a direct healthcare cost; section 134 says indirect economic costs are difficult to estimate. (LLM, conf=0.88)
Experimental — accuracy not yet measured
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
PremisecitationAcademic groups have released research frameworks CAMEL and MetaGPT, providing templates for common MAS architectures.
“academic groups have released research frameworks, namely CAMEL and MetaGPT. These provide templates for common MAS architectures (e.g., collaborative coding agents, conversational QA teams) [13].”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites [13] Li, G., Hammoud, H., Itani, H., Khizbullin, D., and Ghanem, B. (2023). CAMEL: Communicative Agents for “Mind” Exploration of Large Language Model Society. arXiv. source
The Introduction describes CAMEL as an open-source cooperative-agent framework with modular agent implementations, and Section 3.1 shows agents collaborating through conversation on a coding task. These passages support CAMEL as an example of a research framework for a multi-agent architecture, but our copy does not establish the claim about MetaGPT. (LLM, conf=0.86)
Experimental — accuracy not yet measured
May combine two claims.
PremisecitationExpanded attack surfaces and emergent risky behaviors have been observed in autonomous agent experiments.
“Already, expanded attack surfaces and emergent risky behaviors have been observed in autonomous agent experiments [49,50,51].”
Quote in the paperSubstantial claim3 of 3 sources checked- cites [49] Deng, 2025, AI Agents Under Threat: A Survey of Key Security Challenges and Future Pathways, ACM Comput. Surv. source
- cites [50] Sapkota, 2025, AI agents vs. agentic AI: A conceptual taxonomy, applications and challenges, Inf. Fusion source
Section 5.0.2 (page unavailable) says agentic AI has an expanded attack surface and that interactions among autonomous agents can produce unintended behavior and safety risks. It discusses these as challenges, but does not establish that both were observed in autonomous-agent experiments. (LLM, conf=0.85)
Experimental — accuracy not yet measured - cites [51] Su, H., Luo, J., Liu, C., Yang, X., Zhang, Y., Dong, Y., and Zhu, J. (2025). A Survey on Autonomy-Induced Security Risks in Large Model-Based Agents. arXiv. source
Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).
InterpretationcitationImproving transparency and auditability of MAS reasoning will build confidence that these systems are working as intended.
“Improving transparency and auditability of MAS reasoning will build confidence that these systems are working as intended [69].”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites [69] Jimenez-Romero, C., Yegenoglu, A., and Blum, C. (2025). Multi-agent systems powered by large language models: Applications in swarm intelligence. Front. Artif. Intell., 8. source
Table 5 in the Conclusion identifies reduced transparency and limited explainability of agent decisions as weaknesses, and says unpredictable behavior requires careful monitoring. The paper does not say that improving auditability or transparency will build confidence that MAS are working as intended. (LLM, conf=0.78)
Experimental — accuracy not yet measured
May combine two claims.
PremisecitationStudies on physician attitudes toward AI have found that clear explanations and the ability to veto or override AI suggestions are important for acceptance.
“Studies on physician attitudes toward AI have found that clear explanations and the ability to veto or override AI suggestions are important for acceptance [59,60].”
Quote in the paperSubstantial claim2 of 2 sources checked- cites [59] Sullivan, 2019, Are Current Tort Liability Doctrines Adequate for Addressing Injury Caused by AI?, AMA J. Ethics source
The Abstract discusses the difficulty of explaining black-box AI recommendations in the context of liability, not physician acceptance. The section “Modify the standard of care” discusses clinicians evaluating AI results. Searches for physician attitudes, acceptance, and the ability to veto or override AI suggestions found no passage addressing the claimed findings; page numbers were not available in our copy. (LLM, conf=0.73)
Experimental — accuracy not yet measured - cites [60] Rigby, 2019, Ethical Dimensions of Using Artificial Intelligence in Health Care, AMA J. Ethics source
The editor’s article (page not provided) discusses physician input, AI as a complementary tool, and difficulty explaining black-box outputs. It does not report studies of physician attitudes or say that clear explanations and the ability to override AI suggestions affect acceptance. Searches for physician acceptance, explanations, vetoes, and overrides found no supporting passage. (LLM, conf=0.76)
Experimental — accuracy not yet measured
May combine two claims.
PremisecitationRecent evaluations indicate that structured agentic panels can reduce complex diagnostic expenditures from approximately $7850 to $2397 while significantly increasing specificity over human specialists.
“Recent evaluations indicate that structured agentic panels can reduce complex diagnostic expenditures from approximately $7850 to $2397 while significantly increasing specificity over human specialists [54,55].”
Quote in the paperSubstantial claim1 of 2 sources checked- cites [54] Klang, 2025, Assessing retrieval-augmented large language models for medical coding, NEJM AI source
- cites [55] Slawomirski, L., Kelly, D., de Bienassis, K., Kallas, K.A., and Klazinga, N. (2025). The Economics of Diagnostic Safety, OECD Publishing. OECD Health Working Papers, No. 176. source
Sections 222 and 236 discuss possible diagnostic benefits of AI and potential cost savings, but neither reports an evaluation of structured agentic panels. Searches for “agentic panels,” $7,850, $2,397, and specificity relative to human specialists found no passage supporting the claimed results. (LLM, conf=0.76)
Experimental — accuracy not yet measured
Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).
PremisecitationOngoing work on federated learning and secure multi-party computation might inform how agents can operate on sensitive data without pooling it centrally.
“Ongoing work on federated learning and secure multi-party computation might inform how agents can operate on sensitive data without pooling it centrally [60].”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites [60] Rigby, 2019, Ethical Dimensions of Using Artificial Intelligence in Health Care, AMA J. Ethics source
The editor’s discussion of privacy and confidentiality in AI health care (Abstract; page not provided) does not address federated learning, secure multi-party computation, or operating on sensitive data without central pooling. Searches for those techniques and for privacy-preserving distributed learning found no passage in our copy that speaks to the claim. (LLM, conf=0.74)
Experimental — accuracy not yet measured
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
PremisecitationThe proposed Model Context Protocol (MCP) mediates agent access to external data with fine-grained security rules, acting as an intelligent broker that filters queries and enforces policies.
“for instance, the proposed Model Context Protocol (MCP) mediates agent access to external data with fine-grained security rules, acting as an intelligent broker that filters queries and enforces policies [52,53,64].”
Quote in the paperNot a substantial claim1 of 3 sources checked- cites [52] Singh, A., Ehtesham, A., Kumar, S., and Khoei, T.T. (2025). A Survey of the Model Context Protocol (MCP): Standardizing Context to Enhance LLMs. Preprints. source
The Introduction describes MCP as connecting AI models to external resources through servers that securely access data, and the Security and Security & Validation sections describe authorization and controlled execution policies (pages not provided). These passages support mediated, policy-controlled access, but they do not describe MCP as an intelligent broker that filters queries or establish the claimed fine-grained security rules. (LLM, conf=0.82)
Experimental — accuracy not yet measured - cites [53] Hou, X., Zhao, Y., Wang, S., and Wang, H. (2025). Model Context Protocol (MCP): Landscape, Security Threats, and Future Research Directions. arXiv. source
- cites [64] IMDRF Software as a Medical Device (SaMD) Working Group (2025). Characterization Considerations for Medical Device Software and Software-Specific Risk. IMDRF/SaMD WG/N81 FINAL:2025, International Medical Device Regulators Forum.
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
May combine two claims.
Findingnone givenIn clinical trial matching, multi-agent frameworks achieved 87.3% accuracy and enhanced clinician screening efficiency by 42.6% (p < 0.001).
“In clinical trial matching, multi-agent frameworks achieved 87.3% accuracy and enhanced clinician screening efficiency by 42.6% (p < 0.001).”
Quote in the paperNot a substantial claimMay combine two claims.
FindingreasoningMany of the studies summarized in this review evaluate MAS on benchmark datasets or simulated scenarios rather than in live clinical environments, so their reported success may not directly translate to real-world settings where unpredictability is higher.
“Second, many of the studies we summarized evaluate MAS on benchmark datasets or simulated scenarios rather than in live clinical environments, which means their reported success may not directly translate to real-world settings where unpredictability is higher.”
Quote in the paperSubstantial claimMay combine two claims.
FindingreasoningEarly evidence indicates that MAS can reduce oversights, catch inconsistencies, and provide clearer rationale through inter-agent dialogue.
“We see early evidence that they can reduce oversights, catch inconsistencies, and provide clearer rationale through inter-agent dialogue.”
Quote in the paperSubstantial claimClassified as probably not a substantial claim.
Study design and conductnone givenStudies were included only if they described the implementation of a multi-agent AI system where multiple autonomous agents collaborated or coordinated to perform tasks.
“To be included, a study needed to describe the implementation of a multi-agent AI system where multiple autonomous agents collaborated or coordinated to perform tasks.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S2 (checkable), S4 (based).
Interpretationnone givenThe orchestration layer-not merely the agent design itself-is increasingly the critical determinant of system performance, safety, and clinical relevance.
“We argue that the orchestration layer—not merely the agent design itself—is increasingly the critical determinant of system performance, safety, and clinical relevance.”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim.
Study design and conductnone givenStudies focusing on single-LLM systems were excluded, except where such a system was integrated into a larger multi-agent framework.
“We excluded studies focusing on single-LLM systems, except where such a system was integrated into a larger multi-agent framework.”
Quote in the paperSubstantial claimClassified as probably not a substantial claim.
Study design and conductreasoningThe search window was extended through 2026 via iterative manual screening of emerging preprints and recently published journal articles.
“we extended our search window through 2026 via iterative manual screening of emerging preprints and recently published journal articles.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
PremisereasoningLangGraph maintains a persistent state throughout the workflow: intermediate results, memory, and context are stored directly in the graph's state object and passed deterministically across nodes.
“Unlike linear pipelines, LangGraph maintains a persistent state throughout the workflow: intermediate results, memory, and context are stored directly in the graph’s state object and passed deterministically across nodes.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable).
InterpretationreasoningClinical and research adoption of MAS requires the development of deterministic orchestration and rigorous cost-utility frameworks to ensure safety and expert-centered oversight.
“its clinical and research adoption requires the development of deterministic orchestration and rigorous cost-utility frameworks to ensure safety and expert-centered oversight”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
InterpretationreasoningThese design choices make LangGraph particularly effective for structured, protocol-bound, or safety-critical applications where reproducibility and auditability matter.
“These design choices make LangGraph particularly effective for structured, protocol-bound, or safety-critical applications where reproducibility and auditability matter.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).
PremisecitationCompared to a single-agent setting, an MAS more realistically represents complex real-world scenarios involving multiple decision-makers or information sources.
“Compared to a single-agent setting, an MAS more realistically represents complex real-world scenarios involving multiple decision-makers or information sources [7,8].”
Quote in the paperNot a substantial claim0 of 2 sources checkedProbably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductreasoningThe initial search strategy focused on the preceding six-year window (approximately 2019-2025).
“The initial search strategy focused on the preceding six-year window (approximately 2019–2025)”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable).
Interpretationnone givenMAS enables a shift toward collaborative intelligence in biomedicine.
“MAS enables a shift toward collaborative intelligence in biomedicine”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductnone givenThe literature search spanned multiple databases: PubMed, arXiv, ACM, and IEEE Xplore.
“The search spanned multiple databases: PubMed, arXiv, ACM, and IEEE Xplore.”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim.
Study design and conductnone givenStudies that reported performance or utility improvements of the multi-agent approach over single-agent baselines were prioritized as evidence of the value added by agent collaboration.
“We prioritized studies that reported performance or utility improvements of the multi-agent approach over single-agent baselines as evidence of the value added by agent collaboration.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing), S4 (based).
Interpretationnone givenA team of agents autonomously generating and executing complex action sequences raises the risk of propagating errors or undesirable behaviors.
“A team of agents autonomously generating and executing complex action sequences raises the risk of propagating errors or undesirable behaviors.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing). May combine two claims.
InterpretationreasoningMAS will require defense-in-depth: sandboxing of agent actions, well-defined scopes for each agent's authority, and continuous monitoring for anomalous behaviors.
“In general, MAS will require defense-in-depth: sandboxing of agent actions, well-defined scopes for each agent’s authority, and continuous monitoring for anomalous behaviors.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based). May combine two claims.
Interpretationnone givenEffective MAS requires mechanisms for memory sharing, safety constraints, and structured inter-agent communication.
“Effective MAS requires mechanisms for memory sharing, safety constraints, and structured inter-agent communication.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).
PremisereasoningDrug discovery is a complex, multi-factorial process that can benefit from the division of labor offered by agentic workflows.
“Drug discovery is a complex, multi-factorial process that can benefit from the division of labor offered by agentic workflows.”
Quote in the paperNot a substantial claim- Rests on an assumption: Drug discovery is a complex, multi-factorial process that can benefit from the division of labor offered by agentic workflows.
Probably not a substantial claim: may not pass S3 (load-bearing).
InterpretationreasoningThese differences reflect two distinct orchestration philosophies: graph-driven determinism versus role-driven collaboration.
“These differences reflect two distinct orchestration philosophies: graph-driven determinism versus role-driven collaboration.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
InterpretationreasoningOne safeguard is to include a specialized monitoring or moderation agent that watches the agents' interactions and intervenes if policies are violated.
“One safeguard is to include a specialized monitoring or moderation agent that watches the agents’ interactions and intervenes if policies are violated”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing), S4 (based).
Interpretationnone givenAlignment techniques from single-agent LLMs, such as content filtering and reinforcement learning from human feedback (RLHF), can be extended to MAS settings by applying them to each agent's outputs or decisions.
“Alignment techniques from single-agent LLMs, such as content filtering and reinforcement learning from human feedback (RLHF), can be extended to MAS settings by applying them to each agent’s outputs or decisions.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
InterpretationcitationMAS has rapidly gained traction as a strategy for tackling the complexity of biomedical data analysis and clinical decision-making.
“MAS has rapidly gained traction as a strategy for tackling the complexity of biomedical data analysis and clinical decision-making.”
Quote in the paperNot a substantial claim- Rests on an assumption: MAS has rapidly gained traction as a strategy for tackling the complexity of biomedical data analysis and clinical decision-making.
Probably not a substantial claim: may not pass S4 (based).
InterpretationreasoningAs these frameworks evolve toward increasingly autonomous and distributed architectures, these same communication and control mechanisms introduce new vectors for error propagation, bias amplification, or unsafe tool invocation.
“As these frameworks evolve toward increasingly autonomous and distributed architectures, these same communication and control mechanisms introduce new vectors for error propagation, bias amplification, or unsafe tool invocation.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationTechniques such as ReAct interleave logical Reasoning and concrete Acting steps by an LLM, demonstrating how language models can use external tools dynamically.
“Techniques, such as ReAct, interleave logical Reasoning and concrete Acting steps by an LLM, demonstrating how language models can use external tools dynamically [17].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [17] Yao, 2023, ReAct: Synergizing reasoning and acting in language models, Adv. Neural Inf. Process. Syst.
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).
InterpretationcitationEnsuring secure and authenticated inter-agent communication will be vital so that a rogue agent cannot impersonate a trusted one or leak sensitive data.
“Ensuring secure and authenticated inter-agent communication will be vital so that a rogue agent cannot impersonate a trusted one or leak sensitive data.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
InterpretationreasoningThese paradigms are complementary rather than mutually exclusive.
“Importantly, these paradigms are complementary rather than mutually exclusive.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
InterpretationreasoningShared memory facilitates experience replay, where agents can learn from prior cases by referencing how similar problems were solved, improving continual learning.
“Shared memory also facilitates experience replay, where agents can learn from prior cases by referencing how similar problems were solved, improving continual learning”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
InterpretationreasoningShared memory ensures that facts discovered by one agent persist and inform the others.
“This ensures that facts discovered by one agent (e.g., a relevant patient finding or an experimental result) persist and inform the others.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.
Interpretationnone givenMAS in drug discovery is still in its infant stages, and most systems are prototypes or proofs-of-concept.
“MAS in drug discovery is still in its infant stages, and most systems are prototypes or proofs-of-concept.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.
InterpretationreasoningThe incorporation of a knowledge-graph agent helps reduce factual errors by grounding answers in curated databases, addressing a key limitation of standalone LLMs.
“Notably, the incorporation of a knowledge-graph agent helps reduce factual errors by grounding answers in curated databases, addressing a key limitation of standalone LLMs.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing). May combine two claims.
InterpretationreasoningIn practice, LangGraph excels when workflows require strict branching logic, formal validation, or deterministic execution, while CrewAI shines when tasks benefit from adaptive teamwork and iterative critique.
“In practice, LangGraph excels when workflows require strict branching logic, formal validation, or deterministic execution, while CrewAI shines when tasks benefit from adaptive teamwork and iterative critique.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).
InterpretationreasoningThis marks a shift toward a paradigm where AI acts as a digital coordinator of diverse medical resources.
“This marks a shift toward a paradigm where AI acts as a digital coordinator of diverse medical resources [28,29].”
Quote in the paperNot a substantial claim0 of 2 sources checked- cites [28] Sutton, R.S., and Barto, A.G. (2018). Reinforcement Learning: An Introduction, MIT Press. [2nd ed.].
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites [29] Ferber, D., Wei, J., Ghaffari Laleh, N., Wu, Z., Tan, Y., Peng, C., Wang, X., Liu, Y., Zhang, Z., and Chen, J. (2025). Multimodal Oncology Agent for IDH1 Mutation Prediction in Low-Grade Glioma. arXiv.
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Classified as probably not a substantial claim.
Interpretationnone givenMAS is naturally suited to multimodal reasoning because different agents can specialize in processing distinct data types and then collaborate to form a comprehensive assessment.
“MAS is naturally suited to such multimodal reasoning: different agents can specialize in processing distinct data types and then collaborate to form a comprehensive assessment.”
Quote in the paperSubstantial claim- Rests on an assumption: Clinical diagnosis often requires integrating information from multiple sources, specifically physical exam findings, laboratory results, and medical images.
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
PremisecitationAn AI research assistant was able to draft research proposals and survey prior work with minimal human input.
“an AI research assistant was able to draft research proposals and survey prior work with minimal human input [38]”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [38] Naumov, V., Zagirova, D., Lin, S., Xie, Y., Gou, W., Urban, A., and Zhavoronkov, A. (2025). DORA AI Scientist: Multi-agent Virtual Research Team for Scientific Exploration Discovery and Automated Report Generation. bioRxiv. source
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims. The quote only partly states this claim.
PremisereasoningParallelizing agent operations and allowing asynchronous processing can help reduce latency.
“Parallelizing agent operations and allowing asynchronous processing can help.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationZheng et al. (2025) outlined strategies for incorporating lifelong learning into agent architecture by dividing the system into a perception module, a memory module, and an action module.
“Zheng et al. (2025) outlined strategies for incorporating lifelong learning into agent architecture by dividing the system into a perception module (to handle new modalities), a memory module (to accumulate evolving knowledge), and an action module (to adapt behaviors) [47].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [47] Zheng, J., Shi, C., Cai, X., Li, Q., Zhang, D., Li, C., Yu, D., and Ma, Q. (2025). Lifelong learning of large language model based agents: A roadmap. IEEE Trans. Pattern Anal. Mach. Intell., 1–20. source
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisereasoningLatency is a concern for clinical applications.
“Latency is also a concern for clinical applications: doctors need answers fast.”
Quote in the paperNot a substantial claim- Rests on an assumption: Doctors need answers fast.
Probably not a substantial claim: may not pass S4 (based).
Interpretationnone givenCurrent frameworks are primarily limited by their focus on multiple-choice formats rather than the continuous, interactive narrative of patient-centered diagnostics.
“Current frameworks are primarily limited by their focus on multiple-choice formats rather than the continuous, interactive narrative of patient-centered diagnostics.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
PremisecitationMicrosoft has open-sourced Autogen as a Python 3.10+ library, which provides high-level abstractions for spawning agents, managing their message exchanges, and incorporating new agents dynamically.
“Microsoft has open-sourced Autogen (mentioned in Section 2.1) as a Python 3.10+ library, which provides high-level abstractions for spawning agents, managing their message exchanges, and incorporating new agents dynamically [12].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [12] Wu, Q., Bansal, G., Zhang, J., Wu, Y., Zhang, S., Zhu, E., Li, B., Jiang, L., Zhang, X., and Wang, C. (2023). AutoGen: Enabling next-gen LLM applications via multi-agent conversation frameworks. arXiv.
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisereasoningIf too many agents overlap in functionality, the system wastes time and computing resources on duplicate efforts.
“If too many agents overlap in functionality, the system wastes time and computing resources on duplicate efforts.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
InterpretationreasoningThe system can iterate in a loop (plan → answer → review → refine) until a consensus or confidence threshold is reached.
“The system can iterate in a loop (plan → answer → review → refine) until a consensus or confidence threshold is reached.”
Quote in the paperNot a substantial claimMay combine two claims.
PremisecitationIn complex medical coding tasks, a RAG-enhanced agentic system demonstrated superior performance to human providers; expert reviewers favored the AI's accuracy in 447 instances compared to 277 for provider-assigned codes (p < 0.001).
“For instance, in complex medical coding tasks where diagnostic specificity is tied to financial and legal outcomes, a RAG-enhanced agentic system demonstrated superior performance to human providers; expert reviewers favored the AI’s accuracy in 447 instances compared to 277 for provider-assigned codes (p < 0.001) [54].”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [54] Klang, 2025, Assessing retrieval-augmented large language models for medical coding, NEJM AI source
Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).
Premisenone givenAs the number of agents grows, communication overhead can grow combinatorially, a phenomenon sometimes called "agent flurry," where agents produce a torrent of messages that can slow down the system.
“As the number of agents grows, communication overhead can also grow combinatorially, a phenomenon sometimes called “agent flurry,” where agents produce a torrent of messages that can slow down the system.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
InterpretationreasoningIf two diagnostic agents disagree, that flags uncertainty for human review or triggers the system to gather more information.
“If two diagnostic agents disagree, that flags uncertainty for human review or triggers the system to gather more information.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
InterpretationreasoningMCP acts as a safety layer-essentially a "secure USB port" through which AI agents can plug into critical data sources without breaching compliance or confidentiality.
“By enforcing standardized request formats, access controls (e.g., role-based permissions, user consent requirements), and comprehensive logging, MCP acts as a safety layer—essentially a “secure USB port” through which AI agents can plug into critical data sources without breaching compliance or confidentiality.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S4 (based). May combine two claims.
Premisenone givenMost current MAS rely on foundation models that have a fixed knowledge cutoff and do not automatically update as new data arrives.
“Most current MAS rely on foundation models that have a fixed knowledge cutoff and do not automatically update as new data arrives.”
Quote in the paperNot a substantial claimMay combine two claims.
InterpretationreasoningA retrieval agent might fetch irrelevant or misleading data, and a reasoning agent could incorporate it into a diagnosis, leading to an incorrect conclusion.
“a retrieval agent might fetch irrelevant or misleading data, and a reasoning agent could incorporate it into a diagnosis, leading to an incorrect conclusion”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Premisenone givenIf each agent needs the full history of the conversation or the entire patient record, the token usage can explode.
“One issue is the context length and memory: If each agent needs the full history of the conversation or the entire patient record, the token usage can explode.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Interpretationnone givenMCP is only a communication standard; thus, intra-system errors from agent reasoning are still a possibility.
“Finally, it is important to note MCP is only a communication standard; thus, intra-system errors from agent reasoning are still a possibility.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
PremisereasoningAgent role differentiation, specialized fine-tuning, or using smaller models for simpler agents can make the system leaner.
“Techniques such as agent role differentiation, perhaps via specialized fine-tuning for each agent’s subtask, or using smaller models for simpler agents can make the system leaner.”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim.
InterpretationreasoningA clear distinction remains between simulation success and real-world bedside utility.
“a clear distinction remains between simulation success and real-world bedside utility”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S4 (based).
Premisenone givenRunning several LLM agents in parallel or in long sequential dialogues can be resource-intensive in terms of CPU/GPU usage and memory.
“Running several LLM agents in parallel or in long sequential dialogues can be resource-intensive in terms of CPU/GPU usage and memory.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based).
InterpretationreasoningThe shift from static, text-only models to evolvable and adaptive multi-agent ecosystems marks a pivotal transition in medical artificial intelligence.
“the shift from static, text-only models to evolvable and adaptive multi-agent ecosystems marks a pivotal transition in medical artificial intelligence”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim.
InterpretationreasoningBy moving beyond 'reading' medical literature to 'practicing' within synthetic simulations or dynamically assembling specialist teams, these systems begin to replicate the collaborative and iterative nature of real-world clinical decision-making.
“By moving beyond “reading” medical literature to “practicing” within synthetic simulations similar to Agent Hospital, or dynamically assembling specialist teams via MDAgents, these systems begin to replicate the collaborative and iterative nature of real-world clinical decision-making.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
InterpretationcitationAfter a Question-Answering Agent proposes an answer, a Reviewer Agent can assess its factual accuracy and coherence.
“after a Question-Answering Agent proposes an answer, a Reviewer Agent can assess its factual accuracy and coherence”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).
PremisecitationIt may be necessary to log detailed transcripts of agent dialogues and decision paths so that any failures can be audited after the fact.
“From a regulatory perspective, it may be necessary to log detailed transcripts of agent dialogues and decision paths so that any failures can be audited after the fact [57].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [57] (2025, July 05). High-Level Expert Group on Artificial Intelligence. Ethics Guidelines for Trustworthy AI. European Commission. Available online: https://digital-strategy.ec.europa.eu/en/library/ethics-guidelines-trustworthy-ai.
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Premisenone givenContinual learning in deployed AI systems carries risks: models can forget old knowledge when fine-tuned on new data (catastrophic forgetting), or they can drift in undesirable ways.
“However, continual learning in deployed AI systems carries risks: models can forget old knowledge when fine-tuned on new data (catastrophic forgetting), or they can drift in undesirable ways (if new data is biased or if adversarial inputs are encountered).”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based).
Premisenone givenLifelong learning for biomedical MAS is still largely uncharted territory.
“Lifelong learning for biomedical MAS is still largely uncharted territory.”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim.
PremisereasoningWith multiple agents contributing, it can be unclear which agent's action or which interaction led to an error.
“With multiple agents contributing, it can be unclear which agent’s action or which interaction led to an error.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
PremisereasoningTechniques similar to experience replay and periodic evaluation against fixed benchmarks can help detect when an agent's performance on prior knowledge starts degrading.
“Techniques similar to experience replay (re-training on a mix of old and new cases) and periodic evaluation against fixed benchmarks can help detect when an agent’s performance on prior knowledge starts degrading.”
Quote in the paperNot a substantial claimMay combine two claims.
PremisecitationA 2025 study developed a taxonomy of collaborative failure patterns in multi-agent medical systems, including flawed consensus driven by shared model biases, suppression of correct minority opinions, ineffective discussion dynamics, and critical information loss during synthesis.
“For example, a 2025 study developed a taxonomy of collaborative failure patterns, including flawed consensus driven by shared model biases, suppression of correct minority opinions, ineffective discussion dynamics, and critical information loss during synthesis [70].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [70] Gu, L., Zhu, Y., Sang, H., Wang, Z., Sui, D., Tang, W., Harrison, E., Gao, J., Yu, L., and Ma, L. (2025). MedAgentAudit: Diagnosing and Quantifying Collaborative Failure Modes in Medical Multi-Agent Systems. arXiv.
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing). May combine two claims.
PremisereasoningTrust goes beyond raw accuracy: it involves human factors.
“This goes beyond raw accuracy: it involves human factors.”
Quote in the paperNot a substantial claimMay combine two claims.
PremisecitationThe FDA has already signaled interest in adaptive AI that learns over time, proposing monitoring approaches to ensure safety is maintained during algorithm updates.
“The FDA has already signaled interest in adaptive AI that learns over time, proposing monitoring approaches to ensure safety is maintained during algorithm updates [58].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [58] Yang, G., Rao, A., Fernandez-Maloigne, C., Calhoun, V., and Menegaz, G. (2022, January 16–19). Explainable AI (XAI) In Biomedical Signal and Image Processing: Promises and Challenges. Proceedings of the 2022 IEEE International Conference on Image Processing (ICIP), Bordeaux, France. source
Probably not a substantial claim: may not pass S2 (checkable).
InterpretationreasoningThis enables human experts to focus more on empathy in patient care, insight in experimental design, or ethical judgment in difficult decisions.
“This enables human experts to focus more on empathy in patient care, insight in experimental design, or ethical judgment in difficult decisions.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
InterpretationreasoningThe 'many hands' problem complicates assigning responsibility.
“This “many hands” problem complicates assigning responsibility.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.
Premisenone givenMASs often intensively share and process data, which raises privacy concerns.
“MASs often intensively share and process data, which raises privacy concerns.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing), S4 (based).
Interpretationnone givenThe complexity that gives MAS power also makes them challenging to govern.
“The complexity that gives these systems power also makes them challenging to govern.”
Quote in the paperNot a substantial claimMay combine two claims.
PremisecitationOrchestrating multiple large language models is resource-intensive: context must be shared back-and-forth between agents, and they often engage in lengthy dialogues.
“Orchestrating multiple large language models is resource-intensive: context must be shared back-and-forth between agents, and they often engage in lengthy dialogues.”
Quote in the paperSubstantial claimMay combine two claims.
Premisenone givenRobust cross-check mechanisms (such as reviewer or auditor agents) have been proposed to catch such errors, but not all MAS implementations include them.
“Robust cross-check mechanisms (such as reviewer or auditor agents) have been proposed to catch such errors, but not all MAS implementations include them.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable).
Premisenone givenFor MAS to be adopted, human practitioners and patients must trust it.
“Finally, for MAS to be adopted, human practitioners and patients must trust it.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable), S4 (based). May combine two claims.
Interpretationnone givenWhen designed with care, AI agent teams can handle information overload, perform tedious or complex multi-step analyses, and offer second opinions or suggestions that a busy human might miss.
“When designed with care, AI agent teams can handle information overload, perform tedious or complex multi-step analyses, and offer second opinions or suggestions that a busy human might miss.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable).
InterpretationreasoningResponsible MAS deployment depends not only on ethical principles but also on technical and procedural guardrails.
“Collectively, these ethical domains highlight that responsible MAS deployment depends not only on ethical principles but also on technical and procedural guardrails, concrete mechanisms that ensure these values are enforced during design, operation, and oversight.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable).
InterpretationreasoningMAS are charting a path toward biomedical AI systems that collaborate in a manner analogous to human teams by combining specialized skills, cross-checking each other, and jointly tackling problems beyond the scope of any single model.
“MAS are charting a path toward biomedical AI systems that collaborate in a manner analogous to human teams by combining specialized skills, cross-checking each other, and jointly tackling problems beyond the scope of any single model.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based).
InterpretationreasoningMemory mechanisms will play a central role in continual learning.
“Memory mechanisms will play a central role in continual learning.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
InterpretationreasoningThe modular nature of MAS may aid continual learning since knowledge can be compartmentalized.
“Encouragingly, the modular nature of MAS may aid continual learning since knowledge can be compartmentalized.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductreasoningGiven the quick evolution of the field, new results (especially preprints) have likely emerged after the review's literature search cutoff, so some relevant developments may not be captured.
“First, given the quick evolution of the field, new results (especially preprints) have likely emerged after our literature search cutoff, so some relevant developments may not be captured.”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim. May combine two claims.
Study design and conductreasoningThe review's focus on LLM-based MAS means that other paradigms (e.g., multi-agent reinforcement learning or symbolic agent systems) are only partially represented, so its conclusions reflect the current LLM-centric state of the field.
“Finally, our focus on LLM-based MAS means that other paradigms (e.g., multi-agent reinforcement learning or symbolic agent systems) are only partially represented; our conclusions should be viewed as reflective of the current LLM-centric state of the field.”
Quote in the paperSubstantial claim
The paper relies on this without support.
MAS has rapidly gained traction as a strategy for tackling the complexity of biomedical data analysis and clinical decision-making.
“MAS has rapidly gained traction as a strategy for tackling the complexity of biomedical data analysis and clinical decision-making.”
The paper relies on this without support.
Drug discovery is a complex, multi-factorial process that can benefit from the division of labor offered by agentic workflows.
“Drug discovery is a complex, multi-factorial process that can benefit from the division of labor offered by agentic workflows.”
The paper relies on this without support.
Few domain-specific reviews examine how emerging MAS architectures are tailored for use in biomedicine.
“Despite these promising developments, few domain-specific reviews examine how emerging MAS architectures are tailored for use in biomedicine.”
The paper relies on this without support.
Modern systems increasingly employ hybrid designs in which LangGraph defines the global control flow while specific nodes delegate to a collaborative CrewAI team.
“Modern systems increasingly employ hybrid designs in which LangGraph defines the global control flow while specific nodes delegate to a collaborative CrewAI team.”
The paper relies on this without support.
Bioinformatics was one of the first areas to embrace MAS, given the inherent complexity of biological data-processing pipelines.
“Bioinformatics was one of the first areas to embrace MAS, given the inherent complexity of biological data-processing pipelines.”
The paper relies on this without support.
Clinical diagnosis often requires integrating information from multiple sources, specifically physical exam findings, laboratory results, and medical images.
“Clinical diagnosis often requires integrating information from multiple sources, specifically physical exam findings, laboratory results, and medical images.”
The paper relies on this without support.
Identifying suitable clinical trials for a patient, or finding patients for a trial, is essentially an exercise in complex criteria matching and data retrieval.
“Identifying suitable clinical trials for a patient, or conversely, finding patients for a trial, is essentially an exercise in complex criteria matching and data retrieval.”
The paper relies on this without support.
Many domains in biomedicine and healthcare remain underutilized or unexplored for MAS.
“While early successes are evident, there remain many domains in biomedicine and healthcare where MAS is underutilized or has yet to be explored.”
The paper relies on this without support.
The complexity of real clinical cases, especially in internal medicine, often requires gathering disparate information, reasoning through possible diagnoses, consulting guidelines, and double-checking for errors or contraindications.
“The complexity of real clinical cases, especially in fields such as internal medicine, often requires gathering disparate information, reasoning through possible diagnoses, consulting guidelines, and double-checking for errors or contraindications.”
The paper relies on this without support.
Doctors need answers fast.
“Latency is also a concern for clinical applications: doctors need answers fast.”
The paper relies on this without support.
New research findings, drug approvals, or clinical guidelines emerge constantly.
“New research findings, drug approvals, or clinical guidelines emerge constantly.”
The paper relies on this without support.
Clinical practice in one hospital may differ from another; patient populations differ; even the preferred communication style of clinicians may vary.
“Clinical practice in one hospital may differ from another; patient populations differ; even the preferred communication style of clinicians may vary.”
The paper relies on this without support.
A notable bias in the current literature is the focus on success stories—many MAS studies highlight impressive outcomes, whereas failures or neutral results often go unreported.
“A notable bias in the current literature (and thus in our review) is the focus on success stories—many MAS studies highlight impressive outcomes, whereas failures or neutral results often go unreported.”
The paper relies on this without support.
MAS may consume 50 times more tokens than standalone models to achieve a roughly 15% absolute accuracy gain.
“To navigate the trade-off where MAS may consume 50 times more tokens than standalone models to achieve a roughly 15% absolute accuracy gain, we propose a classification framework based on Cost-Utility Analysis (CUA).”
The paper relies on this without support.
Many MAS prototypes remain confined to the lab and have never been plugged into electronic health record systems or laboratory information management systems.
“Many MAS prototypes remain confined to the lab and have never been plugged into electronic health record systems or laboratory information management systems.”
The paper relies on this without support.
If an MAS is intended as a clinical decision support tool, it may qualify as a medical device subject to FDA or EMA oversight.
“If an MAS is intended as a clinical decision support tool, it may qualify as a medical device subject to FDA or EMA oversight.”
The paper relies on this without support.
Studies consistently indicate that keeping doctors and scientists involved is essential for reviewing AI outputs, correcting errors, and making the ultimate decisions.
“Human oversight should remain integral to MAS deployments: studies consistently indicate that keeping doctors and scientists involved is essential for reviewing AI outputs, correcting errors, and making the ultimate decisions.”
The paper relies on this without support.
New approaches to validation and quality assurance, such as simulation-based stress testing of MAS behaviors and continuous post-market monitoring of their performance in the field, have been suggested.
“New approaches to validation and quality assurance have been suggested, such as simulation-based stress testing of MAS behaviors and continuous post-market monitoring of their performance in the field.”
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Abstract USMLE accuracy conflicts with detailed MedQA result
MajorThe abstract states a peak of 93.2% on USMLE-style benchmarks, while the Agent Hospital section reports MedAgent-Zero achieving 92.22% on the USMLE-style MedQA benchmark.
“reached a peak of 93.2% accuracy on USMLE-style benchmarks through simulated clinical evolution.”
“On the MedQA (USMLE-style) benchmark, MedAgent-Zero achieved 92.22% accuracy”
Oncology 30.3% to 87.2% metric labeled accuracy and completeness
MinorThe abstract calls the 30.3% to 87.2% improvement oncology decision-making accuracy, while the detailed section defines the same values as completeness in identifying expert-predetermined interventions.
“recent implementations improved oncology decision-making accuracy from 30.3% to 87.2%”
“improved decision-making “completeness”, or the ability to identify expert-predetermined interventions, from 30.3% (33/109) using GPT-4 alone to 87.2% (95/109)”
A2A protocol date conflicts with reference
MinorThe text says Google introduced A2A in 2023, but the cited Google announcement is dated 9 April 2025.
“Notably, in 2023, Google introduced an Agent-to-Agent (A2A) communication protocol as an open standard”
“Announcing the Agent2Agent Protocol (A2A)—A New Era of Agent Interoperability. Google for Developers Blog 9 April 2025”
MDAgents citation conflicts with its reference number
MinorMDAgents is introduced with reference [42], but later the same system is cited as [39], which is the Agent Hospital reference.
“Early systems such as MDAgents began to explore this by dynamically deciding whether a task needs a “group” or can be handled by one agent [39].”
“MDAgents (Kim et al., 2024), introduces an adaptive coordination framework that automatically assigns collaboration structures to a team of agents based on task complexity, mirroring the tiered referral processes used in clinical practice [42].”
Knowledge-practice gap review cited to wrong reference
MinorThe text attributes the systematic review of 39 medical AI benchmarks to reference [41], but reference [72] is the Gong et al. systematic review of 39 benchmarks; [41] is a rare-disease cost study.
“Recent systematic reviews of 39 medical AI benchmarks quantify a significant ‘knowledge-practice gap,’ finding that models achieving 84–90% on examinations often drop to 45–69% success rates when subjected to practice-based assessments that require diagnostic reasoning under uncertainty [41].”
“72. Gong E.J. Bang C.S. Lee J.J. Baik G.H. Knowledge-Practice Performance Gap in Clinical Large Language Models: Systematic Review of 39 Benchmarks J. Med. Internet Res. 2025 27 e84120”
Cites
Intelligent agents: theory and practice
Wooldridge, M., & Jennings, N. R. (1995) · The Knowledge Engineering Review · doi:10.1017/s0269888900008122 · Cited by 6,810 · cited 1× · see citing works
“Compared to a single-agent setting, an MAS more realistically represents complex real-world scenarios involving multiple decision-makers or information sources [7,8].”
The assessment of clinical skills/competence/performance
Miller, G. E. (1990) · Academic Medicine · doi:10.1097/00001888-199009000-00045 · Cited by 4,883 · cited 2× · see citing works
“…Competence, it is critical to recognize that a 92.22% accuracy on MedQA benchmarks is a measure of the ‘Knows’ and ‘Knows How’ foundational levels of medical knowledge, rather than a surrogate for the ‘Shows How’ or ‘Does’ levels, which is required for dynamic, real-world patient interactions [40].”
InfluentialA survey on large language model based autonomous agents
Wang, L., Ma, C., Feng, X., Zhang, Z., Yang, H., Zhang, J., Chen, Z., Tang, J., Chen, X., Lin, Y., et al. (2024) · Frontiers of Computer Science · doi:10.1007/s11704-024-40231-1 · Cited by 1,941 · cited 4× · see citing works
“MAS, in which multiple autonomous agents collaborate as a team, are emerging as a powerful paradigm for biomedical and clinical data analysis [1,2].”
InfluentialScientific discovery in the age of artificial intelligence.
Wang, H., Fu, T., Du, Y., Gao, W., Huang, K., Liu, Z., Chandak, P., Liu, S., Van Katwyk, P., Deac, A., et al. (2023) · Nature · doi:10.1038/s41586-023-06221-2 · Cited by 1,823 · cited 1× · see citing works
“In the coming years, we may see agent teams serving as “AI scientist” collaborators that generate hypotheses, design experiments, and analyze results alongside human scientists [43].”
Multiagent systems: A survey from a machine learning perspective
Stone, P., & Veloso, M. (2000) · Autonomous Robots · doi:10.1023/a:1008942012299 · Cited by 1,218 · cited 1× · see citing works
“Compared to a single-agent setting, an MAS more realistically represents complex real-world scenarios involving multiple decision-makers or information sources [7,8].”
Tree of Thoughts: Deliberate Problem Solving with Large Language Models
Yao, S., Yu, D., Zhao, J., Shafran, I., Griffiths, T. L., Cao, Y., & Narasimhan, K. (2023) · arXiv · doi:10.48550/arxiv.2305.10601 · Cited by 1,158 · cited 1× · see citing works
“Agents can also implement a Tree-of-Thoughts strategy, collectively exploring different reasoning branches in parallel and exchanging information to decide on the best path forward [18,20].”
Toolformer: Language Models Can Teach Themselves to Use Tools
Schick, T., Dwivedi-Yu, J., Dessì, R., Raileanu, R., Lomeli, M., Zettlemoyer, L., Cancedda, N., & Scialom, T. (2023) · arXiv · doi:10.48550/arxiv.2302.04761 · Cited by 1,150 · cited 2× · see citing works
“Similarly, methods such as Toolformer showed that LLMs can learn to call external APIs to aid in problem-solving [18].”
Toolformer: language models can teach themselves to use tools
Schick, T., Dwivedi-Yu, J., Dessi, R., Raileanu, R., Lomeli, M., Hambro, E., Zettlemoyer, L., Cancedda, N., & Scialom, T. (2023) · Advances in Neural Information Processing Systems 36 · doi:10.52202/075280-2997 · Cited by 1,150 · see citing works
Artificial Intelligence Risk Management Framework (AI RMF 1.0)
Tabassi, E. (2023) · doi:10.6028/nist.ai.100-1 · Cited by 1,136 · see citing works
Reflexion: Language Agents with Verbal Reinforcement Learning
Shinn, N., Cassano, F., Berman, E., Gopinath, A., Narasimhan, K., & Yao, S. (2023) · arXiv · doi:10.48550/arxiv.2303.11366 · Cited by 1,087 · cited 1× · see citing works
“Furthermore, various feedback and self-correction techniques have been introduced to improve LLM reliability, such as Reflexion and Self-Refine [21,22].”
The rise and potential of large language model based agents: a survey
Xi, Z., Chen, W., Guo, X., He, W., Ding, Y., Hong, B., Zhang, M., Wang, J., Jin, S., Zhou, E., et al. (2025) · Science China Information Sciences · doi:10.1007/s11432-024-4222-0 · Cited by 970 · cited 2× · see citing works
“A recent survey highlights this trend: LLM-based autonomous agents can achieve greater flexibility and robustness by dividing labor among sub-agents [1,3].”
Self-Consistency Improves Chain of Thought Reasoning in Language Models
Wang, X., Wei, J., Schuurmans, D., Le, Q., Chi, E., Narang, S., Chowdhery, A., & Zhou, D. (2022) · arXiv · doi:10.48550/arxiv.2203.11171 · Cited by 829 · cited 2× · see citing works
“This is analogous to the self-consistency method for single LLMs (multiple reasoning paths followed, then a majority vote taken); in a multi-agent setting, each agent (or agent subgroup) provides a second opinion [19].”
Self-Refine: Iterative Refinement with Self-Feedback
Madaan, A., Tandon, N., Gupta, P., Hallinan, S., Gao, L., Wiegreffe, S., Alon, U., Dziri, N., Prabhumoye, S., Yang, Y., et al. (2023) · Advances in Neural Information Processing Systems 36 · doi:10.52202/075280-2019 · Cited by 755 · see citing works
HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Face
Shen, Y., Song, K., Tan, X., Li, D., Lu, W., & Zhuang, Y. (2023) · Advances in Neural Information Processing Systems 36 · doi:10.52202/075280-1657 · Cited by 475 · see citing works
A survey on LLM-based multi-agent systems: Workflow, infrastructure, and challenges
Li, X., Wang, S., Zeng, S., Wu, Y., & Yang, Y. (2024) · Vicinagearth · doi:10.1007/s44336-024-00009-2 · Cited by 404 · cited 1× · see citing works
“MAS, in which multiple autonomous agents collaborate as a team, are emerging as a powerful paradigm for biomedical and clinical data analysis [1,2].”
Guidelines for reinforcement learning in healthcare
Gottesman, O., Johansson, F., Komorowski, M., Faisal, A., Sontag, D., Doshi-Velez, F., & Celi, L. A. (2019) · Nature Medicine · doi:10.1038/s41591-018-0310-5 · Cited by 395 · cited 2× · see citing works
“Modern formulations emphasize that an agent is an autonomous and collaborative entity, equipped with reasoning and communication capabilities, capable of dynamically interpreting contexts, orchestrating tools, and adapting behavior through memory and interaction across distributed systems [6].”
Ethical dimensions of using artificial intelligence in health care
(2019) · AMA Journal of Ethics · doi:10.1001/amajethics.2019.121 · Cited by 328 · cited 3× · see citing works
“Regulatory science may need to embrace new validation methods, such as simulation-based stress testing, which involves throwing thousands of randomized scenarios at the agent team and analyzing outcomes [58,60].”
Empowering biomedical discovery with AI agents
Gao, S., Fang, A., Huang, Y., Giunchiglia, V., Noori, A., Schwarz, J. R., Ektefaie, Y., Kondic, J., & Zitnik, M. (2024) · Cell · doi:10.1016/j.cell.2024.09.022 · Cited by 315 · see citing works
CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Society
Li, G., Hammoud, H. A. A. K., Itani, H., Khizbullin, D., & Ghanem, B. (2023) · arXiv · doi:10.48550/arxiv.2303.17760 · Cited by 315 · cited 2× · see citing works
“These provide templates for common MAS architectures (e.g., collaborative coding agents, conversational QA teams) [13].”
Camel: Communicative agents for" mind" exploration of large language model society
Li, G., Hammoud, H., Itani, H., Khizbullin, D., & Ghanem, B. (2023) · Advances in Neural Information Processing Systems 36 · doi:10.52202/075280-2264 · Cited by 314 · see citing works
Matching patients to clinical trials with large language models
Jin, Q., Wang, Z., Floudas, C. S., Chen, F., Gong, C., Bracken-Clarke, D., Xue, E., Yang, Y., Sun, J., & Lu, Z. (2024) · Nature Communications · doi:10.1038/s41467-024-53081-z · Cited by 287 · cited 4× · see citing works
“A pioneering system in this realm is TrialGPT, which uses a trio of agents to match patients to clinical trials [36].”
InfluentialArtificial intelligence risk management framework :
National Institute of Standards and Technology (US) (2024) · NIST Trustworthy and Responsible AI · doi:10.6028/nist.ai.600-1 · Cited by 274 · see citing works
He, J., Treude, C., & Lo, D. (2025) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3712003 · Cited by 246 · cited 3× · see citing works
“Therefore, techniques for verification and validation are paramount in MAS [24,27].”
AI Agents vs. Agentic AI: A Conceptual taxonomy, applications and challenges
Sapkota, R., Roumeliotis, K. I., & Karkee, M. (2026) · Information Fusion · doi:10.1016/j.inffus.2025.103599 · Cited by 244 · see citing works
Standard IEC 62304 - Medical device software - Software lifecycle processes
Jordan, P. (2006) · IET Seminar on Software for Medical Devices · doi:10.1049/ic:20060141 · Cited by 244 · see citing works
AI agents under threat: A survey of key security challenges and future pathways
Deng, Z., Guo, Y., Han, C., Ma, W., Xiong, J., Wen, S., & Xiang, Y. (2025) · ACM Computing Surveys · doi:10.1145/3716628 · Cited by 210 · cited 1× · see citing works
“Already, expanded attack surfaces and emergent risky behaviors have been observed in autonomous agent experiments [49–51].”
Are Current Tort Liability Doctrines Adequate for Addressing Injury Caused by AI?
(2019) · AMA Journal of Ethics · doi:10.1001/amajethics.2019.160 · Cited by 188 · cited 2× · see citing works
“Regulators expect evidence that MASs have been tested for equitable performance across diverse patient groups [59].”
Ferber, D., El Nahhas, O. S. M., Wölflein, G., Wiest, I. C., Clusmann, J., Leßmann, M.-E., Foersch, S., Lammert, J., Tschochohei, M., Jäger, D., et al. (2025) · Nature Cancer · doi:10.1038/s43018-025-00991-6 · Cited by 175 · cited 4× · see citing works
“…engine and incorporates specialized precision oncology tools, including vision transformers for detecting microsatellite instability (MSI) and mutations (KRAS, BRAF) from histopathology slides, MedSAM for radiological image segmentation, and web-based search tools like OncoKB and PubMed [34].”
InfluentialModel Context Protocol (MCP): Landscape, Security Threats, and Future Research Directions
Hou, X., Zhao, Y., Wang, S., & Wang, H. (2026) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3796519 · Cited by 167 · cited 2× · see citing works
“There are early efforts to address these issues; for instance, the proposed Model Context Protocol (MCP) mediates agent access to external data with fine-grained security rules, acting as an intelligent broker that filters queries and enforces policies [52,53,64].”
Augmented Language Models: a Survey
Mialon, G., Dessì, R., Lomeli, M., Nalmpantis, C., Pasunuru, R., Raileanu, R., Rozière, B., Schick, T., Dwivedi-Yu, J., Celikyilmaz, A., et al. (2023) · arXiv · doi:10.48550/arxiv.2302.07842 · Cited by 160 · cited 1× · see citing works
“Empirically, this kind of reviewer setup has been shown to reduce hallucinations in LLM-generated answers [47,48].”
Enhancing diagnostic capability with multi-agents conversational large language models
Chen, X., Yi, H., You, M., Liu, W., Wang, L., Li, H., Zhang, X., Guo, Y., Fan, L., Chen, G., et al. (2025) · npj Digital Medicine · doi:10.1038/s41746-025-01550-0 · Cited by 117 · cited 5× · see citing works
“Pilot implementations, for instance, testing a multi-agent system as a virtual tumor board in an oncology department, or as a decision-support assistant in live hospital workflows, would be invaluable for assessing true utility and reliability [35].”
InfluentialMDAgents: an adaptive collaboration of LLMs for medical decision-making
Kim, Y., Park, C., Jeong, H., Chan, Y., Xu, X., McDuff, D., Lee, H., Ghassemi, M., Breazeal, C., & Park, H. (2024) · Advances in Neural Information Processing Systems 37 · doi:10.52202/079017-2522 · Cited by 81 · see citing works
Limitations of large language models in clinical problem-solving arising from inflexible reasoning
Kim, J., Podlasek, A., Shidara, K., Liu, F., Alaa, A., & Bernardo, D. (2025) · Scientific Reports · doi:10.1038/s41598-025-22940-0 · Cited by 78 · cited 2× · see citing works
“This disparity suggests that current models suffer from “inflexible reasoning,” or the Einstellung effect, where they rely on pattern matching from training data rather than engaging in the adaptive, threshold-based decision-making required at the bedside [41,68].”
Few shot learning for phenotype-driven diagnosis of patients with rare genetic diseases
Alsentzer, E., Li, M. M., Kobren, S. N., Noori, A., Undiagnosed Diseases Network, Kohane, I. S., & Zitnik, M. (2025) · npj Digital Medicine · doi:10.1038/s41746-025-01749-1 · Cited by 54 · cited 1× · see citing works
“Early research has shown that LLMs can generate synthetic patient data to augment real datasets for rare conditions [44].”
Gupta, S., Basu, A., Nievas, M., Thomas, J., Wolfrath, N., Ramamurthi, A., Taylor, B., Kothari, A. N., Schwind, R., Miller, T. M., et al. (2024) · npj Digital Medicine · doi:10.1038/s41746-024-01274-7 · Cited by 52 · cited 1× · see citing works
“For example, a Protocol-Writing Agent drafts a trial plan based on identified gaps in current research, a Critic Agent, encoded with ethical and feasibility rules, reviews the draft for potential issues and biases, and a Prior-Studies Agent searches for similar past trials to ensure novelty [37].”
Gong, E. J., Bang, C. S., Lee, J. J., & Baik, G. H. (2025) · Journal of Medical Internet Research · doi:10.2196/84120 · Cited by 49 · see citing works
Agent Hospital: A Simulacrum of Hospital with Evolvable Medical Agents
Li, J., Lai, Y., Li, W., Ren, J., Zhang, M., Kang, X., Wang, S., Li, P., Zhang, Y.-Q., Ma, W., et al. (2024) · arXiv · doi:10.48550/arxiv.2405.02957 · Cited by 46 · cited 5× · see citing works
“Ablation studies confirmed the necessity of both memory systems, as removing the experience base dropped accuracy to 91.36% [39].”
InfluentialReview of autonomous systems and collaborative AI agent frameworks
Joshi, S. (2025) · International Journal of Science and Research Archive · doi:10.30574/ijsra.2025.14.2.0439 · Cited by 31 · cited 2× · see citing works
“Modern agent frameworks often implement a shared knowledge store or blackboard that agents can read from and write to during collaboration [16].”
Multi-agent systems powered by large language models: applications in swarm intelligence
Jimenez-Romero, C., Yegenoglu, A., & Blum, C. (2025) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2025.1593017 · Cited by 30 · cited 2× · see citing works
“Improving transparency and auditability of MAS reasoning will build confidence that these systems are working as intended [69].”
Exploration of LLM Multi-Agent Application Implementation Based on LangGraph+CrewAI
Duan, Z., & Wang, J. (2024) · doi:10.32388/r27sw4 · Cited by 30 · see citing works
MEDCO: Medical Education Copilots Based on a Multi-agent Framework
Wei, H., Qiu, J., Yu, H., & Yuan, W. (2025) · Lecture notes in computer science · doi:10.1007/978-3-031-91813-1_8 · Cited by 21 · see citing works
Singh, A., Ehtesham, A., Kumar, S., & Khoei, T. T. (2025) · doi:10.20944/preprints202504.0245.v1 · Cited by 21 · see citing works
The economics of diagnostic safety
Slawomirski, L., Kelly, D., de Bienassis, K., Kallas, K.-A., & Klazinga, N. (2025) · OECD Health Working Papers · doi:10.1787/fc61057a-en · Cited by 20 · cited 4× · see citing works
“The systemic burden of diagnostic safety lapses is estimated at 1.8% of GDP in OECD countries [55].”
InfluentialBioAgents: Bridging the gap in bioinformatics analysis with multi-agent systems
Mehandru, N., Hall, A. K., Melnichenko, O., Dubinina, Y., Tsirulnikov, D., Bamman, D., Alaa, A., Saponas, S., & Malladi, V. S. (2025) · Scientific Reports · doi:10.1038/s41598-025-25919-z · Cited by 19 · see citing works
TxAgent: An AI Agent for Therapeutic Reasoning Across a Universe of Tools
Gao, S., Zhu, R., Kong, Z., Noori, A., Su, X., Ginder, C., Tsiligkaridis, T., & Zitnik, M. (2025) · arXiv · doi:10.48550/arxiv.2503.10970 · Cited by 19 · cited 2× · see citing works
“Although TxAgent is presented as a single composite agent, internally it functions as an MAS: separate sub-modules handle different tasks, such as chemical property prediction, pathway simulation, and literature scanning [31].”
Explainable AI (XAI) In Biomedical Signal and Image Processing: Promises and Challenges
Yang, G., Rao, A., Fernandez-Maloigne, C., Calhoun, V., & Menegaz, G. (2022) · 2022 IEEE International Conference on Image Processing (ICIP) · doi:10.1109/icip46576.2022.9897629 · Cited by 18 · cited 3× · see citing works
“Research in XAI (explainable AI) is beginning to explore how to generate user-friendly explanations from multi-agent processes [58].”
BioMaster: Multi-agent System for Automated Bioinformatics Analysis Workflow
Su, H., Long, W., & Zhang, Y. (2025) · doi:10.1101/2025.01.23.634608 · Cited by 18 · cited 3×
“A dedicated Debug Agent monitors the pipeline for errors or suboptimal results (such as a file format issue or poor sequence coverage) and can intervene to adjust parameters or retry steps when needed [32].”
InfluentialSequential Diagnosis with Language ModelsPreprint
Nori, H., Daswani, M., Kelly, C., et al. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2506.22405 · Cited by 18 · cited 1× · see citing works
“Future systems must therefore utilize dynamic orchestration to selectively deploy agentic teams based on task complexity, ensuring that resource-intensive multi-agent deliberation is reserved for high-stakes clinical scenarios where the cost of error exceeds the marginal cost of compute [38,56].”
The cost of the diagnostic odyssey of patients with suspected rare diseases
Glaubitz, R., Heinrich, L., Tesch, F., Seifert, M., Reber, K. C., Marschall, U., Schmitt, J., & Müller, G. (2025) · Orphanet Journal of Rare Diseases · doi:10.1186/s13023-025-03751-y · Cited by 17 · cited 8× · see citing works
“Beyond reporting bias, a fundamental ‘knowledge-practice gap’ remains a bottleneck for clinical adoption of MAS [41].”
InfluentialSami, A. M., Rasheed, Z., Kemell, K., Waseem, M., Kilamo, T., Saari, M., Nguyen‐Duc, A., Systä, K., & Abrahamsson, P. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2403.08399 · Cited by 13 · cited 1× · see citing works
“Use cases range from automated information extraction in literature mining to multi-step clinical reasoning with tool-assisted LLMs [5,6].”
LLM-as-a-Judge for Software Engineering: Literature Review, Vision, and the Road Ahead
He, J., Shi, J., Zhuo, T. Y., Treude, C., Sun, J., Du, X., Xing, Z., & Lo, D. (2026) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3797276 · Cited by 12 · see citing works
A Survey on Autonomy-Induced Security Risks in Large Model-Based Agents
Su, H., Luo, J., Liu, C., Yang, X., Zhang, Y., Dong, Y., & Zhu, J. (2026) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2026.3688650 · Cited by 11 · see citing works
Li, H., Cheng, X., & Xiao-ping, Z. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713526 · Cited by 10 · cited 1× · see citing works
“For example, developers should include explanation modules (an interface that clearly explains the team’s reasoning in human-understandable terms) and implement fail-safe triggers that defer to human judgment when the system’s uncertainty is high or when ethical boundaries might be crossed [74].”
Lifelong Learning of Large Language Model Based Agents: A Roadmap
Zheng, J., Shi, C., Cai, X., Li, Q., Zhang, D., Li, C., Yu, D., & Ma, Q. (2026) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2025.3650546 · Cited by 7 · cited 4× · see citing works
“Empirically, this kind of reviewer setup has been shown to reduce hallucinations in LLM-generated answers [47,48].”
InfluentialAssessing retrieval-augmented large language models for medical coding
Klang, E., Tessler, I., Apakama, D. U., Abbott, E., Glicksberg, B. S., Arnold, M., Moses, A., Sakhuja, A., Soroush, A., Charney, A. W., et al. (2025) · NEJM AI · doi:10.1056/aics2401161 · Cited by 6 · cited 2× · see citing works
“Recent evaluations indicate that structured agentic panels can reduce complex diagnostic expenditures from approximately $7850 to $2397 while significantly increasing specificity over human specialists [54,55].”
InfluentialAgentic AI Frameworks: Architectures, Protocols, and Design Challenges
Derouiche, H., Brahmi, Z., & Mazeni, H. (2025) · arXiv · doi:10.48550/arxiv.2508.10146 · Cited by 6 · see citing works
Debate or Vote: Which Yields Better Decisions in Multi-Agent Large Language Models?
Choi, H. K., Zhu, J., & Li, S. (2025) · Advances in Neural Information Processing Systems 38 · doi:10.52202/085713-3405 · Cited by 6
Naumov, V., Zagirova, D., Lin, S., Xie, Y., Gou, W., Urban, A., Tikhonova, N., Alawi, K., Durymanov, M., Galkin, F., et al. (2025) · doi:10.1101/2025.03.06.641840 · Cited by 5 · cited 3× · see citing works
“Future systems must therefore utilize dynamic orchestration to selectively deploy agentic teams based on task complexity, ensuring that resource-intensive multi-agent deliberation is reserved for high-stakes clinical scenarios where the cost of error exceeds the marginal cost of compute [38,56].”
Shepherd: A Critic for Language Model Generation
Wang, T., Yu, P., Tan, X. E., O'Brien, S., Pasunuru, R., Dwivedi-Yu, J., Golovneva, O., Zettlemoyer, L., Fazel-Zarandi, M., & Celikyilmaz, A. (2023) · arXiv · doi:10.48550/arxiv.2308.04592 · Cited by 5 · cited 2× · see citing works
“For example, after a Question-Answering Agent proposes an answer, a Reviewer Agent can assess its factual accuracy and coherence, similar to the Reflexion approach (where an agent self-critiques and iterates), but here implemented as a separate agent [23,24].”
AI passed the test, but can it make the rounds?
Rose, C. C., & Preiksaitis, C. M. (2024) · AEM Education and Training · doi:10.1002/aet2.11044 · Cited by 3 · cited 2× · see citing works
“…proxy for clinical readiness; the transition from “AI scientist” to “AI clinician” requires moving beyond static facts toward high-fidelity, practice-oriented frameworks that mandate rigorous human-in-the-loop oversight to bridge the gap between theoretical knowledge and bedside utility [41,67].”
Louck, Y., Stulman, A., & Dvir, A. (2026) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3821216 · Cited by 2
The Orchestration of Multi-Agent Systems: Architectures, Protocols, and Enterprise Adoption
Adimulam, A., Gupta, R., & Kumar, S. (2026) · arXiv · doi:10.48550/arxiv.2601.13671 · cited 2×
“These frameworks define how agents communicate, delegate tasks, and merge their results into a coherent solution [9,10].”
Debate or Vote: Which Yields Better Decisions in Multi-Agent Large Language Models?
Choi, H. K., Zhu, X., & Li, S. (2025) · arXiv · doi:10.48550/arxiv.2508.17536
Multimodal Oncology Agent for IDH1 Mutation Prediction in Low-Grade Glioma
Akebli, H., Shephard, A., Mea, V. D., et al. (2025) · arXiv · doi:10.48550/arxiv.2512.05824
Sequential diagnosis with language models
Nori, H., Daswani, M., Kelly, C., et al. (2026) · Science · doi:10.1126/science.aeh7930
Sami, A.M., Rasheed, Z., Kemell, K.K., Waseem, M., Kilamo, T., Saari, M., and Abrahamsson, P. (2024). System for systematic literature review using multiple ai agents: Concept and an empirical evaluation. arXiv.
(n.d.)
UnresolvedAdimulam, A., Gupta, R., and Kumar, S. (2026). The Orchestration of Multi-Agent Systems: Architectures, Protocols, and Enterprise Adoption. arXiv.
(n.d.)
UnresolvedHong, S., Zhuge, M., Chen, J., Zheng, X., Cheng, Y., Zhang, C., Wang, J., Wang, Z., Yau, S.K.S., and Lin, Z. (2023). MetaGPT: Meta Programming for A Multi-Agent Collaborative Framework. arXiv.
(n.d.)
UnresolvedWu, Q., Bansal, G., Zhang, J., Wu, Y., Zhang, S., Zhu, E., Li, B., Jiang, L., Zhang, X., and Wang, C. (2023). AutoGen: Enabling next-gen LLM applications via multi-agent conversation frameworks. arXiv.
(n.d.)
UnresolvedDerouiche, H., Brahmi, Z., and Mezni, H. (2025). Agentic AI Frameworks: Architectures, Protocols, and Design Challenges. arXiv.
(n.d.)
UnresolvedReAct: Synergizing reasoning and acting in language models
Yao (2023) · Adv. Neural Inf. Process. Syst.
UnresolvedWang, X., Wei, J., Schuurmans, D., Le, Q., Chi, E., Narang, S., and Zhou, D. (2022). Self-consistency improves chain-of-thought reasoning in language models. arXiv.
(n.d.)
UnresolvedWang, T., Yu, P., Tan, X.E., O’Brien, S., Pasunuru, R., Dwivedi-Yu, J., and Celikyilmaz, A. (2023). Shepherd: A Critic for Language Model Generation. arXiv.
(n.d.)
UnresolvedSurapaneni, R., Jha, M., Vakoc, M., and Segal, T. (2025, October 01). Announcing the Agent2Agent Protocol (A2A)—A New Era of Agent Interoperability. Google for Developers Blog. Available online: https://developers.googleblog.com/en/a2a-a-new-era-of-agent-interoperability/.
(n.d.)
UnresolvedZhang, Z., Cui, S., Lu, Y., Zhou, J., Yang, J., Wang, H., and Huang, M. (2024). Agent-SafetyBench: Evaluating the safety of multi-agent AI systems. arXiv.
(n.d.)
UnresolvedSutton, R.S., and Barto, A.G. (2018). Reinforcement Learning: An Introduction, MIT Press. [2nd ed.].
(n.d.)
UnresolvedFerber, D., Wei, J., Ghaffari Laleh, N., Wu, Z., Tan, Y., Peng, C., Wang, X., Liu, Y., Zhang, Z., and Chen, J. (2025). Multimodal Oncology Agent for IDH1 Mutation Prediction in Low-Grade Glioma. arXiv.
(n.d.)
Unresolved(2026, February 20). Multi-Agent Orchestration for Knowledge Extraction and Retrieval: AI Expert System for GPCRs. bioRxiv 2025, Available online: https://submit.biorxiv.org/submission/pdf?msid=BIORXIV/2025/696782.
(n.d.)
UnresolvedGao, S., Zhu, R., Kong, Z., Noori, A., Su, X., Ginder, C., and Zitnik, M. (2025). TxAgent: An AI agent for therapeutic reasoning across a universe of tools. arXiv.
(n.d.)
UnresolvedLi, J., Lai, Y., Li, W., Ren, J., Zhang, M., Kang, X., and Liu, Y. (2025). Agent Hospital: A simulacrum of hospital with evolvable medical agents. arXiv.
(n.d.)
UnresolvedZhu, Y., He, Z., Hu, H., Zheng, X., Zhang, X., Wang, Z., Gao, J., Ma, L., and Yu, L. (2025). MedAgentBoard: Evaluating multi-agent LLM collaboration for medical training. arXiv.
(n.d.)
UnresolvedMialon, G., Dessì, R., Lomeli, M., Nalmpantis, C., Pasunuru, R., Raileanu, R., Rozière, B., Schick, T., Dwivedi-Yu, J., and Celikyilmaz, A. (2023). Augmented language models: A survey. arXiv.
(n.d.)
Unresolved(2025, July 05). High-Level Expert Group on Artificial Intelligence. Ethics Guidelines for Trustworthy AI. European Commission. Available online: https://digital-strategy.ec.europa.eu/en/library/ethics-guidelines-trustworthy-ai.
(n.d.)
Unresolved(2019). Medical Devices: Application of Risk Management to Medical Devices (Standard No. ISO 14971:2019).
(n.d.)
UnresolvedIMDRF Software as a Medical Device (SaMD) Working Group (2025). Characterization Considerations for Medical Device Software and Software-Specific Risk. IMDRF/SaMD WG/N81 FINAL:2025, International Medical Device Regulators Forum.
(n.d.)
UnresolvedU.S. Department of Health and Human Services (HHS) (2023). HIPAA Privacy Rule, 45 CFR Parts 160 and 164, Office for Civil Rights.
(n.d.)
UnresolvedGu, L., Zhu, Y., Sang, H., Wang, Z., Sui, D., Tang, W., Harrison, E., Gao, J., Yu, L., and Ma, L. (2025). MedAgentAudit: Diagnosing and Quantifying Collaborative Failure Modes in Medical Multi-Agent Systems. arXiv.
(n.d.)
UnresolvedDrummond, M.F., Sculpher, M.J., Claxton, K., Stoddart, G.L., and Torrance, G.W. (2015). Methods for the Economic Evaluation of Health Care Programmes, Oxford University Press. [4th ed.].
(n.d.)
UnresolvedU.S. Food and Drug Administration (2025, September 25). Artificial Intelligence in Software as a Medical Device, Available online: https://www.fda.gov/medical-devices/software-medical-device-samd/artificial-intelligence-software-medical-device.
(n.d.)
Unresolved
Flagged first, then by citations
24 of the 74 references couldn’t be matched to a known paper.
Cited by
Sorted by citations
Nalagath, S. R., Gupta, A., Peddi, S. R., Khapekar, N. L., & Sharma, A. (2026) · International Conference on Circuit, Power and Computing Technologies · doi:10.1109/iccpct70290.2026.11654802
“Multi-agent systems are an emerging notion that has become a viable solution to the distributed and complex tasks by delegating tasks to specialized agents [1].”
- Authors
- Spieser, J., Balapour, A., Meller, J., Patra, K. C., & Shamsaei, B.
- Affiliations
- University of Cincinnati (US)
- Northern Kentucky University (US)
- Department of Biostatistics, Health Informatics and Data Sciences, College of Medicine, University of Cincinnati, Cincinnati, OH 45267, USA
- Corresponding author
- Shamsaei, Behrouz
- Venue
- Methods and Protocols
- Publisher
- MDPI AG
- Published
- 2026-02-28
- Volume
- 9
- Issue
- 2
- Pages
- 33
- ISSN
- 2409-9279 (ISSN-L)
- PMC
- PMC13010680
- OpenAlex
- W7132847160
- Semantic Scholar
- 1ec84d2982a88cb441bc9e4c5afd67620370d1b5
- Cited by
- 1
- References
- 74
- Citations by year
- 2026: 1
- FWCI
- 2.15
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Methods and Protocols (publishedVersion, cc-by)
- Preprints.org (acceptedVersion, cc-by)
- PubMed (publishedVersion)
- PubMed Central (submittedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- The University of Cincinnati (UC) Center for Clinical and Translational Science and Training (UL1TR001425)
- Topics
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Physical Sciences › Computer Science › Artificial Intelligence › Multi-Agent Systems and Negotiation
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Biomedical Text Mining and Ontologies
- Keywords
- multi-agent systems, large language models, biomedical data analysis, medical data analysis, LangGraph, CrewAI, Model Context Protocol, clinical trial matching
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-07.
Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-07.
Cited sources are checked by gpt-6-sol.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review