Overcoming regulatory barriers to the implementation of AI agents in healthcare
The DOI matches its Crossref record; 12 of the 12 references it cites were found in a registry or an index.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Seven key ethical challenges were identified: (1) compound opacity, where interacting AI agents create layers of inscrutable decision-making;”
From Ethical issues in multi-agent AI systems for healthcare: a narrative review (2026) · cites this paper as [33]
In the citing paper
“(2) error propagation and attribution difficulties, complicating accountability for clinical harm;”
From Ethical issues in multi-agent AI systems for healthcare: a narrative review (2026) · cites this paper as [33]
In the citing paper
“An error introduced at any point—encompassing data preprocessing, intermediate reasoning, inter-agent communication, or the execution of autonomous actions—can propagate through the system, thereby modifying subsequent decisions in ways that are challenging to identify or reconstruct (6, 15).”
From Ethical issues in multi-agent AI systems for healthcare: a narrative review (2026) · cites this paper as [33]
In the citing paper
“Compound opacity refers to the increased inscrutability that arises when decision-making is distributed across multiple interacting AI agents rather than contained within a single model (15).”
From Ethical issues in multi-agent AI systems for healthcare: a narrative review (2026) · cites this paper as [33]
In the citing paper
“Medical-device certification is therefore designed to secure safe and reliable use through risk management, traceability, and rigorous quality assurance across the product lifecycle [25].”
From Diagnostic performance of Prof. Valmed, ChatGPT-5 Thinking, and OpenEvidence in rheumatology: A comparative evaluation (2026) · cites this paper as [25]
Citations
Cites
LLM-based agentic systems in medicine and healthcare
Qiu, J., Lam, K., Li, G., Acharya, A., Wong, T. Y., Darzi, A., Yuan, W., & Topol, E. J. (2024) · Nature Machine Intelligence · doi:10.1038/s42256-024-00944-1 · Cited by 168
Freyer, O., Wiest, I. C., Kather, J. N., & Gilbert, S. (2024) · The Lancet Digital Health · doi:10.1016/s2589-7500(24)00124-9 · Cited by 157
Self-citationThe rise of agentic AI teammates in medicine
Zou, J., & Topol, E. J. (2025) · The Lancet · doi:10.1016/s0140-6736(25)00202-8 · Cited by 138
Coordinated AI agents for advancing healthcare
Moritz, M., Topol, E. J., & Rajpurkar, P. (2025) · Nature Biomedical Engineering · doi:10.1038/s41551-025-01363-2 · Cited by 96
DeepSeek’s “Low-Cost” Adoption Across China’s Hospital Systems: Too Fast, Too Soon?
Zeng, D., Qin, Y., Sheng, B., & Wong, T. Y. (2025) · JAMA · doi:10.1001/jama.2025.6571 · Cited by 89
Regulate Artificial Intelligence in Health Care by Prioritizing Patient Outcomes
Ayers, J. W., Desai, N., & Smith, D. M. (2024) · JAMA · doi:10.1001/jama.2024.0549 · Cited by 33
A roadmap for safe, regulation-compliant Living Labs for AI and digital health development
Gilbert, S., Mathias, R., Schönfelder, A., Wekenborg, M., Steinigen-Fuchs, J., Dillenseger, A., & Ziemssen, T. (2025) · Science Advances · doi:10.1126/sciadv.adv7719 · Cited by 29
Self-citationDuPreez, J. A., & McDermott, O. (2025) · Expert Review of Medical Devices · doi:10.1080/17434440.2025.2468787 · Cited by 22
Freyer, O., Wiest, I. C., & Gilbert, S. (2025) · Mayo Clinic Proceedings Digital Health · doi:10.1016/j.mcpdig.2025.100196 · Cited by 16
Self-citationGrandis, G. D., Brass, I., & Farid, S. S. (2022) · Regulation & Governance · doi:10.1111/rego.12496 · Cited by 12
Research works printed but not linked: 3
- Anthropic. Building Effective AI Agents (2024); https://go.nature.com/44tZMYl
- OpenAI. A Practical Guide to Building Agents (2025); https://go.nature.com/4l8ugWL
- Blumenthal, D. & Patel, B. NEJM AI 2, 7 (2024).
Cited by
Application of artificial intelligence and digital tools in cancer pathology
Shaktah, L., Carrero, Z. I., Hewitt, K. J., Gustav, M., Cecchini, M. J., Foersch, S., Berezowska, S., & Kather, J. N. (2025) · The Lancet Digital Health · doi:10.1016/j.landig.2025.100933 · Cited by 50
Self-citationShow us the evidence for the value of medical AI
(2026) · Nature Medicine · doi:10.1038/s41591-026-04389-4 · Cited by 46
Tripathi, S., Cook, T. S., & Kim, W. (2026) · Radiology · doi:10.1148/radiol.252730 · Cited by 23
Roemer, A., Schlicker, N., Kernder, A. L., Albe, B., Hack, J., Hirsch, M., Mayr, A. J., Kuhn, S., & Knitza, J. (2026) · BMC Medical Education · doi:10.1186/s12909-026-09079-w · Cited by 20
Kremer, P., Langballe, E., Haase, I., Bamberger, J., Kuhn, S., Krusche, M., & Knitza, J. (2026) · Rheumatology International · doi:10.1007/s00296-025-06068-y · Cited by 17
“Prof. Valmed, in contrast, is a subscription-based clinical decision support tool that emphasizes regulatory compliance and claims to be Europe’s first certified medical product approved for clinical use, thus having successfully overcome the regulatory complexities of LLMs as medical products [15].”
Metadata
- Authors
- Freyer, O., Jayabalan, S., Kather, J. N., & Gilbert, S.
- Affiliations
- Else Kröner Fresenius Center for Digital Health (DE)
- Heidelberg University (DE)
- Corresponding author
- Gilbert, Stephen
- Venue
- Nature Medicine
- Published
- 2025-07-18
- Volume
- 31
- Issue
- 10
- Pages
- 3239-3243
- ISSN
- 1078-8956 (ISSN-L)
- 1546-170X
- OpenAlex
- W4412523390
- Cited by
- 31
- References
- 12
- Citations by year
- 2026: 27 · 2025: 4
- FWCI
- 7.46
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springernature.com/gp/researchers/text-and-data-mining (tdm)
- www.springernature.com/gp/researchers/text-and-data-mining (vor)
- Locations
- Nature Medicine (publishedVersion)
- PubMed (publishedVersion)
- Funders
- Foundation for the National Institutes of Health (R01 CA263318)
- National Institute for Health and Care Excellence (NIHR203331)
- Bundesministerium für Bildung und Forschung
- Deutsche Krebshilfe (70115166)
- Topics
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Healthcare Regulation
- Social Sciences › Law › Digitalization, Law, and Regulation
- Keywords
- AI agents, health care regulation, regulatory framework, autonomous AI agents, clinical implementation of AI, AI safety
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Overcoming regulatory barriers to the implementation of AI agents in healthcare. https://app.cochat.ai/papers/10.1038/s41591-025-03841-1
- The paper
- Freyer, O., Jayabalan, S., Kather, J. N., & Gilbert, S. (2025). Overcoming regulatory barriers to the implementation of AI agents in healthcare. Nature Medicine. https://doi.org/10.1038/s41591-025-03841-1
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.