Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 61 of the 61 references it cites were found in a registry or an index; 62 of the 108 sources its claims cite were checked for support.

Ethical issues in multi-agent AI systems for healthcare: a narrative review

Open access
Xie, Zhibin, Wang, Hongyu, Dai, Lexuan, Wang, Zikai, Song, Haitao, Qian, Jingzhe · 2026 · Frontiers in Public Health

Abstract

Introduction: Multi-agent AI systems are believed to bring significant improvements in digital health, but it also brings new and more serious ethical issues. Such systems distribute the decision-making process among multiple interacting agents, and this decentralized decision-making system has raised ethical concerns in the medical field. On the one hand, it continues the ethical issues of traditional AI tools; on the other hand, the interaction processes within complex systems have also brought about new dilemmas. This narrative review aims to synthesize the ethical issues related to multi-agent AI systems in healthcare presented and explore the corresponding mitigation strategies. Methods: The study outcomes were synthesized using a narrative approach. Relevant records were gathered through Boolean searches in databases such as PubMed, Scopus, and Web of Science. A total of 21 articles related to multi-agent AI, healthcare, and ethical issues are included in this review. Results: Seven key ethical challenges were identified: (1) compound opacity, where interacting AI agents create layers of inscrutable decision-making; (2) error propagation and attribution difficulties, complicating accountability for clinical harm; (3) increased clinician dependence and automation bias, leading to potential deskilling and overreliance; (4) erosion of human oversight, as multi-agent AI systems operate beyond effective human control; (5) privacy and data security risks, stemming from complex data flows among agents; (6) threats to patient autonomy and informed consent, due to opaque or paternalistic AI recommendations; and (7) contextual blindness, reflecting a loss of individualized patient understanding in modular AI workflows. Furthermore, this review also summarized solutions proposed in the existing literature for these ethical issues. Conclusions: Multi-agent AI systems intensify existing ethical concerns in healthcare by distributing decision-making and blurring responsibility. To mitigate these issues, recent research advocates for the development of adaptive governance models, clear accountability frameworks, human–AI collaboration structures that preserve clinician authority, enhanced systems for explainability, and privacy-centered designs. In order to successfully incorporate agentic AI into healthcare, it is essential to maintain transparency, protect patient rights, and ensure that human-centered values continue to guide clinical decision-making in an era dominated by autonomous, interacting AI systems.

Overview

CoChat Summary

TL;DR

This narrative review synthesizes 21 articles from 2022–2025 on ethical issues in multi-agent AI systems for healthcare, identifying seven key challenges including compound opacity, error propagation and attribution difficulty, automation bias, eroded human oversight, privacy risks, threats to patient autonomy/informed consent, and contextual blindness. It summarizes proposed mitigations such as adaptive governance, clear accountability frameworks, human–AI collaboration preserving clinician authority, enhanced explainability, and privacy-centered design.

Key findings

  • Seven ethical challenges were identified: (1) compound opacity; (2) error propagation and attribution difficulties; (3) increased clinician dependence and automation bias; (4) erosion of human oversight; (5) privacy and data security risks; (6) threats to patient autonomy and informed consent; and (7) contextual blindness.
  • The search retrieved 115 records; after removing 34 duplicates, 81 articles were screened, 35 were assessed in full text, and 21 met inclusion criteria. Among the 21 included studies, eight were review articles.
  • Multi-agent AI systems are argued to intensify existing healthcare AI ethical concerns by distributing decision-making and blurring responsibility, rather than merely adding risks to single-model AI.
  • Proposed mitigation strategies from the literature include adaptive governance models, clear accountability frameworks, human–AI collaboration structures that preserve clinician authority, system-level explainability, and privacy-centered designs.

Methods

  • Narrative review using SANRA guidelines, with Boolean searches in PubMed, Scopus, and Web of Science for English studies published January 2022–December 2025. Inclusion focused on multi-agent and/or agentic AI in healthcare with ethical, governance, or accountability dimensions; exclusions included non-healthcare AI, purely technical studies, and AI ethics in healthcare without multi-agent or interactive system dynamics.
  • Screening proceeded by title/abstract, then full-text assessment: 115 records retrieved, 34 duplicates removed, 81 retained for screening, 35 assessed for full text, and 21 included.
  • Data analysis used inductive thematic synthesis; authors reviewed material independently, met to compare findings and reach consensus, then clustered overlapping and frequently cited issues into seven broader themes. The synthesis was qualitative and did not attempt quantitative analysis.

Limitations

  • The paper states that the review was restricted to English-language publications from 2022–2025, which may have excluded relevant studies in other languages or outside that time frame, limiting global and temporal scope; it also notes that rapidly evolving AI technologies may mean some relevant studies were overlooked.
  • The paper states that as a narrative review it relies on interpretive synthesis, introducing subjectivity; study selection, thematic grouping, and analytical emphasis may have been influenced by the authors’ perspectives, with a higher risk of interpretive bias than quantitative evidence syntheses.
  • The paper also notes that included studies varied considerably in aims and scope, so direct comparison of findings across studies was not feasible.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.3389/fpubh.2026.1792627

Cites

61 of 61 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Figures

Figure 1 Flowchart of study selection.
Figure 1 Flowchart of study selection.CC BY · PubMed Central
Figure 2 Governance flowchart and layered oversight architecture for multi-agent AI systems in healthcare.
Figure 2 Governance flowchart and layered oversight architecture for multi-agent AI systems in healthcare.CC BY · PubMed Central

Verification

Claims the paper makes

42 Valid · 5 Not valid · 18 Not checked · 37 Own results and interpretations

53 more claims · 27 with their cited sources checked

Create a free account to see all 102 claims and to verify the 4 references still open.

See all claims — free account
  • It may state two separate claims as one. 25
  • Probably not a substantial claim. 23

Create a free account to see these claims.

Citations

Cites

Show all 52 references

Research works printed but not linked: 2

  1. Chen, 2025, Reinforcing Clinical Decision Support through Multi-Agent Systems and Ethical AI Governance, ArXiv:2504.03699 · arXiv
  2. European, 2024, Regulation Laying Down Harmonised Rules on Artificial Intelligence (Artificial Intelligence Act)

Metadata

Authors
Xie, Z., Wang, H., Dai, L., Wang, Z., Song, H., & Qian, J.
Affiliations
  • Shanghai Jiao Tong University (CN)
  • Chinese University of Hong Kong (HK)
  • University of Southern California (US)
  • Shanghai Artificial Intelligence Research Institute
Corresponding author
  • Wang, Zikai
  • Song, Haitao
  • Qian, Jingzhe
Venue
Frontiers in Public Health
Published
2026-04-28
Volume
14
Pages
1792627-1792627
ISSN
2296-2565 (ISSN-L)
OpenAlex
W7157117263
Cited by
11
References
52
Citations by year
2026: 11
FWCI
5.10
Type
journal article
Language
en
Open access
Locations
  • Frontiers in Public Health (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • PubMed Central (publishedVersion, cc-by)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
Topics
  • Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
  • Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
  • Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
Keywords
multi-agent AI, health care ethics, decentralized decision-making, algorithmic opacity, automation bias, human oversight, privacy and data security, patient autonomy, informed consent, explainability, adaptive governance, human-AI collaboration, digital health
MeSH terms
Digital Health, Artificial Intelligence, Delivery of Health Care, Humans

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (gpt-6-sol).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Ethical issues in multi-agent AI systems for healthcare: a narrative review. https://app.cochat.ai/papers/10.3389/fpubh.2026.1792627
The paper
Xie, Z., Wang, H., Dai, L., Wang, Z., Song, H., & Qian, J. (2026). Ethical issues in multi-agent AI systems for healthcare: a narrative review. Frontiers in Public Health. https://doi.org/10.3389/fpubh.2026.1792627

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.