Trust in AI-assisted health systems and AI’s trust in humans
Open accessThe DOI matches its Crossref record; 8 of the 8 references it cites were found in a registry or an index.
Abstract
Artificial intelligence (AI) is reshaping healthcare, promising improved diagnostics, personalized treatments, and streamlined operations. Yet a lack of trust remains a persistent barrier to widespread adoption. This Perspective examines the web of trust in AI-assisted healthcare systems, exploring the relationships it shapes, the systemic inequalities it can reinforce, and the technical challenges it poses. We highlight the bidirectional nature of trust, in which both patients and providers must trust AI systems, while these systems rely on the quality of human input to function effectively. Using models of care-seeking behavior, we explore the potential of AI to affect patients’ decisions to seek care, influence trust in healthcare providers and institutions, and affect diverse demographic and clinical settings. We argue that addressing trust-related challenges requires rigorous empirical research, equitable algorithm design, and shared accountability frameworks. Ultimately, AI’s impact hinges not just on technical progress but on sustaining trust, which may erode if biases persist, transparency falters, or incentives misalign.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Rudin, C. (2019) · Nature Machine Intelligence · doi:10.1038/s42256-019-0048-x · Cited by 10,561 · cited 1×
“Explainable AI, therefore, can offer only an approximation — not true transparency — and as a result is unlikely to improve trust 6,7 .”
Dissecting racial bias in an algorithm used to manage the health of populations
Obermeyer, Z., Powers, B., Vogeli, C., & Mullainathan, S. (2019) · Science · doi:10.1126/science.aax2342 · Cited by 7,137 · cited 1×
“Obermeyeretal. showthat a commonly used risk prediction tool assigned sicker Black patients the same risk scores as healthier white patients, diverting resources away from Black patients with greater needs 27 .”
Resistance to Medical Artificial Intelligence
Longoni, C., Bonezzi, A., & Morewedge, C. K. (2019) · Journal of Consumer Research · doi:10.1093/jcr/ucz013 · Cited by 2,015
Potential liability for physicians using artificial intelligence
Price, W. N., Gerke, S., & Cohen, I. G. (2019) · JAMA · doi:10.1001/jama.2019.15064 · Cited by 579
Fawzy, A., Wu, T. D., Wang, K., Robinson, M. L., Farha, J., Bradke, A., Golden, S. H., Xu, Y., & Garibaldi, B. T. (2022) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2022.1906 · Cited by 326
Beware explanations from AI in health care
Babic, B., Gerke, S., Evgeniou, T., & Cohen, I. G. (2021) · Science · doi:10.1126/science.abg1834 · Cited by 252
Integrating a Machine Learning System Into Clinical Workflows: Qualitative Study
Sandhu, S., Lin, A. L., Brajer, N., Sperling, J., Ratliff, W., Bedoya, A. D., Balu, S., O'Brien, C., & Sendak, M. P. (2020) · Journal of Medical Internet Research · doi:10.2196/22421 · Cited by 168
Diverse patients’ attitudes towards Artificial Intelligence (AI) in diagnosis
Robertson, C., Woods, A., Bergstrand, K., Findley, J., Balser, C., & Slepian, M. J. (2023) · PLOS Digital Health · doi:10.1371/journal.pdig.0000237 · Cited by 158
Research works printed but not linked: 24
- Cox, J. C., Kerschbamer, R. & Neururer, D. What is trustworthiness and what drives it? Games Econ. Behav. 98, 197–218 (2016). · DOI
- Luhmann, N. Trust and Power. (John Wiley & Sons Inc., 1982).
- Mechanic, D., & Schlesinger, M. The impact of managed care on patients’ trust in medical care and their physicians. J. Am. Med. Assoc. 275, 1693–1697 (1996). · DOI · Paper page
- Safran, D. G. et al. Linking primary care performance to outcomes of care. J. Fam. Pract. 47, 213–220 (1998).
- Schoenthaler, A. et al. Patient–physician racial/ethnic concordance and blood pressure control: the role of trust and medication adherence. Ethn. Health 19, 565–578 (2014). · DOI
- Thom, D. H., Hall, M. A. & Pawlson, L. G. Measuring patients’ trust in physicians when assessing quality of care. Health Aff. (Millwood) 23, 124–132 (2004). · DOI · Paper page
- Darden M. & Macis M. Trust and health care-seeking behavior. National Bureau of Economic Research (2024) https://doi.org/10.3386/w32028. · DOI
- Dai, T. & Singh, S. Conspicuous by its absence: diagnostic expert testing under uncertainty. Mark. Sci. 39, 540–563 (2020). · DOI
- Topol, E. J. Deep Medicine: How Artificial Intelligence Can Make Healthcare Human Again. First edition. (Basic Books, 2019).
- Dai, T. & Singh, S. Artificial intelligence on call: the physician’s decision of whether to use AI in clinical practice. SSRN Electron J. Published online 2021. https://doi.org/10.2139/ssrn.3987454. · doi:10.2139/ssrn.3987454
- Ehrenfeld, J. For health AI to work, physicians and patients have to trust it. June 5, 2024. https://www.ama-assn.org/about/leadership/health-ai-work-physicians-and-patients-have-trust-it.
- Huisman, M. et al. An international survey on AI in radiology in 1,041 radiologists and radiology residents part 1: fear of replacement, knowledge, and attitude. Eur. Radiol. 31, 7058–7066 (2021). · DOI · Paper page
- Perlis, R. H. et al. Trust in physicians and hospitals during the COVID-19 pandemic in a 50-state survey of US adults. JAMA Netw. Open 7, e2424984 (2024). · DOI · Paper page
- Bracic, A., Callier, S. L. & Price, W. N. Exclusion cycles: reinforcing disparities in medicine. Science 377, 1158–1160 (2022). · DOI
- Shavers, V. L., Lynch, C. F. & Burmeister, L. F. Knowledge of the Tuskegee study and its impact on the willingness to participate in medical research studies. J. Natl Med. Assoc. 92, 563–572 (2000).
- Wall, L. L. The medical ethics of Dr J Marion Sims: a fresh look at the historical record. J. Med. Ethics 32, 346–350 (2006). · DOI
- Paniagua, M. E. Field trial of a contraceptive foam in Puerto Rico. J. Am. Med. Assoc. 177, 125–129 (1961). · doi:10.1001/jama.1961.03040280029008
- Larson K. C. Mississippi appendectomy. In: Walk with Me. (Oxford University Press, 2021) 35–49. · doi:10.1093/oso/9780190096847.003.0004
- Averbach, S., Ha, D., Meadows, A., Brubaker, L. & Gyamfi-Bannerman, C. Failure to progress: structural racism in women’s healthcare. EClinicalMedicine 57, 101861 (2023). · DOI
- Hoffman, K. M., Trawalter, S., Axt, J. R. & Oliver, M. N. Racial bias in pain assessment and treatment recommendations, and false beliefs about biological differences between blacks and whites. Proc. Natl Acad. Sci. USA 113, 4296–4301 (2016). · DOI · Paper page
- European Commission: Directorate-General for Communications Networks, Content and Technology. Ethics Guidelines for Trustworthy AI. Published online 2019. https://data.europa.eu/doi/10.2759/346720. · doi:10.2759/346720
- National Governance Committee for the New Generation Artificial Intelligence. Governance principles for the new generation of artificial intelligence—developing responsible artificial intelligence [press release]. Published online 2019. https://www.chinadaily.com.cn/a/201906/17/WS5d07486ba3103dbf14328ab7_10.html.
- Li, Y., Wu, B., Huang, Y. & Luan, S. Developing trustworthy artificial intelligence: insights from research on interpersonal, human-automation, and human-AI trust. Front. Psychol. https://doi.org/10.3389/fpsyg.2024.1382693 (2024). · DOI · Paper page
- Azevedo-Sa, H., Yang, X. J., Robert, L. P. & Tilbury, D. M. A unified bi-directional model for natural and artificial trust in human–robot collaboration. IEEE Robot. Autom. Lett. 6, 5913–5920 (2021). · DOI · Paper page
Cited by
Data Quality in the Age of AI: A Review of Governance, Ethics, and the FAIR Principles
Guillen-Aguinaga, M., Aguinaga-Ontoso, E., Guillen-Aguinaga, L., Guillen-Grima, F., & Aguinaga-Ontoso, I. (2025) · Data · doi:10.3390/data10120201 · Cited by 37
“…for AI-era data quality governance include: Bidirectional Innovation: Organizations must leverage AI to improve data quality at scale while simultaneously ensuring that AI systems themselves are trained, validated, and monitored using high-quality, ethically sourced data [305,310,312,313].”
Reciprocal trust and distrust in artificial intelligence systems: the hard problem of regulation
Maggetti, M. (2026) · AI & SOCIETY · doi:10.1007/s00146-026-02966-2 · Cited by 2
“Sagona et al. (2025) also note that an AI may “struggle to contextualize” human actions without some model of trust—for instance, if a human operator overrides an AI recommendation, an unso-phisticated AI might interpret that as an error in the human’s behavior rather than a correction to the AI,…”
Lajmi, N., Patel, M., Obery, G., Dorge, A., Sharma, A., Halligan, J., & Lo, E. (2026) · JCO Clinical Cancer Informatics · doi:10.1200/cci-25-00244 · Cited by 2
Metadata
- Authors
- Sagona, M., Dai, T., Macis, M., & Darden, M.
- Venue
- npj Health Systems
- Published
- 2025-03-28
- Volume
- 2
- Issue
- 1
- ISSN
- 3005-1959 (ISSN-L)
- OpenAlex
- W4408934813
- Cited by
- 71
- References
- 8
- FWCI
- 14.33
- Type
- journal article
- Language
- en
- Open access
- gold
- Licence
- creativecommons.org/licenses/by/4.0 (tdm)
- creativecommons.org/licenses/by/4.0 (vor)
- Funders
- Hopkins Business of Health Initiative, Johns Hopkins University
- Office of Vice Provost for Research, Johns Hopkins University (Discovery Award)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Trust in AI-assisted health systems and AI’s trust in humans. https://app.cochat.ai/papers/10.1038/s44401-025-00016-5
- The paper
- Sagona, M., Dai, T., Macis, M., & Darden, M. (2025). Trust in AI-assisted health systems and AI’s trust in humans. npj Health Systems. https://doi.org/10.1038/s44401-025-00016-5
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.