CoChat

Trust in AI-assisted health systems and AI’s trust in humans

Open access
Sagona, Madeline, Dai, Tinglong, Macis, Mario, Darden, Michael · 2025 · npj Health Systems
Cited by 71

The DOI matches its Crossref record; 8 of the 8 references it cites were found in a registry or an index.

Abstract

Artificial intelligence (AI) is reshaping healthcare, promising improved diagnostics, personalized treatments, and streamlined operations. Yet a lack of trust remains a persistent barrier to widespread adoption. This Perspective examines the web of trust in AI-assisted healthcare systems, exploring the relationships it shapes, the systemic inequalities it can reinforce, and the technical challenges it poses. We highlight the bidirectional nature of trust, in which both patients and providers must trust AI systems, while these systems rely on the quality of human input to function effectively. Using models of care-seeking behavior, we explore the potential of AI to affect patients’ decisions to seek care, influence trust in healthcare providers and institutions, and affect diverse demographic and clinical settings. We argue that addressing trust-related challenges requires rigorous empirical research, equitable algorithm design, and shared accountability frameworks. Ultimately, AI’s impact hinges not just on technical progress but on sustaining trust, which may erode if biases persist, transparency falters, or incentives misalign.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1038/s44401-025-00016-5

Cites

8 of 8 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 8 references

Research works printed but not linked: 24

  1. Cox, J. C., Kerschbamer, R. & Neururer, D. What is trustworthiness and what drives it? Games Econ. Behav. 98, 197–218 (2016). · DOI
  2. Luhmann, N. Trust and Power. (John Wiley & Sons Inc., 1982).
  3. Mechanic, D., & Schlesinger, M. The impact of managed care on patients’ trust in medical care and their physicians. J. Am. Med. Assoc. 275, 1693–1697 (1996). · DOI · Paper page
  4. Safran, D. G. et al. Linking primary care performance to outcomes of care. J. Fam. Pract. 47, 213–220 (1998).
  5. Schoenthaler, A. et al. Patient–physician racial/ethnic concordance and blood pressure control: the role of trust and medication adherence. Ethn. Health 19, 565–578 (2014). · DOI
  6. Thom, D. H., Hall, M. A. & Pawlson, L. G. Measuring patients’ trust in physicians when assessing quality of care. Health Aff. (Millwood) 23, 124–132 (2004). · DOI · Paper page
  7. Darden M. & Macis M. Trust and health care-seeking behavior. National Bureau of Economic Research (2024) https://doi.org/10.3386/w32028. · DOI
  8. Dai, T. & Singh, S. Conspicuous by its absence: diagnostic expert testing under uncertainty. Mark. Sci. 39, 540–563 (2020). · DOI
  9. Topol, E. J. Deep Medicine: How Artificial Intelligence Can Make Healthcare Human Again. First edition. (Basic Books, 2019).
  10. Dai, T. & Singh, S. Artificial intelligence on call: the physician’s decision of whether to use AI in clinical practice. SSRN Electron J. Published online 2021. https://doi.org/10.2139/ssrn.3987454. · doi:10.2139/ssrn.3987454
  11. Ehrenfeld, J. For health AI to work, physicians and patients have to trust it. June 5, 2024. https://www.ama-assn.org/about/leadership/health-ai-work-physicians-and-patients-have-trust-it.
  12. Huisman, M. et al. An international survey on AI in radiology in 1,041 radiologists and radiology residents part 1: fear of replacement, knowledge, and attitude. Eur. Radiol. 31, 7058–7066 (2021). · DOI · Paper page
  13. Perlis, R. H. et al. Trust in physicians and hospitals during the COVID-19 pandemic in a 50-state survey of US adults. JAMA Netw. Open 7, e2424984 (2024). · DOI · Paper page
  14. Bracic, A., Callier, S. L. & Price, W. N. Exclusion cycles: reinforcing disparities in medicine. Science 377, 1158–1160 (2022). · DOI
  15. Shavers, V. L., Lynch, C. F. & Burmeister, L. F. Knowledge of the Tuskegee study and its impact on the willingness to participate in medical research studies. J. Natl Med. Assoc. 92, 563–572 (2000).
  16. Wall, L. L. The medical ethics of Dr J Marion Sims: a fresh look at the historical record. J. Med. Ethics 32, 346–350 (2006). · DOI
  17. Paniagua, M. E. Field trial of a contraceptive foam in Puerto Rico. J. Am. Med. Assoc. 177, 125–129 (1961). · doi:10.1001/jama.1961.03040280029008
  18. Larson K. C. Mississippi appendectomy. In: Walk with Me. (Oxford University Press, 2021) 35–49. · doi:10.1093/oso/9780190096847.003.0004
  19. Averbach, S., Ha, D., Meadows, A., Brubaker, L. & Gyamfi-Bannerman, C. Failure to progress: structural racism in women’s healthcare. EClinicalMedicine 57, 101861 (2023). · DOI
  20. Hoffman, K. M., Trawalter, S., Axt, J. R. & Oliver, M. N. Racial bias in pain assessment and treatment recommendations, and false beliefs about biological differences between blacks and whites. Proc. Natl Acad. Sci. USA 113, 4296–4301 (2016). · DOI · Paper page
  21. European Commission: Directorate-General for Communications Networks, Content and Technology. Ethics Guidelines for Trustworthy AI. Published online 2019. https://data.europa.eu/doi/10.2759/346720. · doi:10.2759/346720
  22. National Governance Committee for the New Generation Artificial Intelligence. Governance principles for the new generation of artificial intelligence—developing responsible artificial intelligence [press release]. Published online 2019. https://www.chinadaily.com.cn/a/201906/17/WS5d07486ba3103dbf14328ab7_10.html.
  23. Li, Y., Wu, B., Huang, Y. & Luan, S. Developing trustworthy artificial intelligence: insights from research on interpersonal, human-automation, and human-AI trust. Front. Psychol. https://doi.org/10.3389/fpsyg.2024.1382693 (2024). · DOI · Paper page
  24. Azevedo-Sa, H., Yang, X. J., Robert, L. P. & Tilbury, D. M. A unified bi-directional model for natural and artificial trust in human–robot collaboration. IEEE Robot. Autom. Lett. 6, 5913–5920 (2021). · DOI · Paper page

Cited by

See all 71

Metadata

Authors
Sagona, M., Dai, T., Macis, M., & Darden, M.
Venue
npj Health Systems
Published
2025-03-28
Volume
2
Issue
1
ISSN
3005-1959 (ISSN-L)
OpenAlex
W4408934813
Cited by
71
References
8
FWCI
14.33
Type
journal article
Language
en
Open access
gold
Licence
Funders
  • Hopkins Business of Health Initiative, Johns Hopkins University
  • Office of Vice Provost for Research, Johns Hopkins University (Discovery Award)

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Trust in AI-assisted health systems and AI’s trust in humans. https://app.cochat.ai/papers/10.1038/s44401-025-00016-5
The paper
Sagona, M., Dai, T., Macis, M., & Darden, M. (2025). Trust in AI-assisted health systems and AI’s trust in humans. npj Health Systems. https://doi.org/10.1038/s44401-025-00016-5

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.