Artificial Intelligence and Human Trust in Healthcare: Focus on Clinicians
Open accessPublished version of a preprint
The DOI matches its Crossref record; 41 of the 41 references it cites were found in a registry or an index.
Abstract
Artificial intelligence (AI) can transform health care practices with its increasing ability to translate the uncertainty and complexity in data into actionable—though imperfect—clinical decisions or suggestions. In the evolving relationship between humans and AI, trust is the one mechanism that shapes clinicians’ use and adoption of AI. Trust is a psychological mechanism to deal with the uncertainty between what is known and unknown. Several research studies have highlighted the need for improving AI-based systems and enhancing their capabilities to help clinicians. However, assessing the magnitude and impact of human trust on AI technology demands substantial attention. Will a clinician trust an AI-based system? What are the factors that influence human trust in AI? Can trust in AI be optimized to improve decision-making processes? In this paper, we focus on clinicians as the primary users of AI systems in health care and present factors shaping trust between clinicians and AI. We highlight critical challenges related to trust that should be considered during the development of any AI system for clinical use.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Researchers and practitioners have proposed various mitigation strategies, such as improving data quality [8] and designing explicitly fair algorithms [9][10][11].”
From Fairness and Bias in Artificial Intelligence: A Brief Survey of Sources, Impacts, and Mitigation Strategies (2023) · cites this paper as [8]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Human trust is an important factor, and further education on AI and transparency information can build this trust for clinicians and patients [59–61].”
From Use of artificial intelligence in critical care: opportunities and obstacles (2024) · cites this paper as [59]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Medical experience is widely recognized as a critical factor influencing the collaborative performance of human-AI teams in medical contexts [ 10 , 18 , 23 , 57 ].”
From Psychological Factors Influencing Appropriate Reliance on AI-enabled Clinical Decision Support Systems: Experimental Web-Based Study Among Dermatologists (2025) · cites this paper as [18]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The importance of technological experience has been highlighted in several studies as a key element for the acceptance and reliance on systems [ 10 , 18 ].”
From Psychological Factors Influencing Appropriate Reliance on AI-enabled Clinical Decision Support Systems: Experimental Web-Based Study Among Dermatologists (2025) · cites this paper as [18]
Experimental — accuracy not yet measuredIn the citing paper
“Trust for AI in healthcare is fundamental to its adoption 155 both by clinical teams and by patients.”
From Deep learning-enabled medical computer vision (2021) · cites this paper as [155]
1 more claim about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Dermatologist-level classification of skin cancer with deep neural networks
Esteva, A., Kuprel, B., Novoa, R. A., Ko, J., Swetter, S. M., Blau, H. M., & Thrun, S. (2017) · Nature · doi:10.1038/nature21056 · Cited by 14,362
An integrative model of organizational trust
Mayer, R. C., Davis, J. H., & Schoorman, F. D. (1995) · The Academy of Management Review · doi:10.2307/258792 · Cited by 10,736
Trust in Automation: Designing for Appropriate Reliance
Lee, J. D., & See, K. A. (2004) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/hfes.46.1.50_30392 · Cited by 6,605 · cited 5×
“The development of AI must incorporate mechanisms that will establish and maintain a properly balanced, optimal level of trust from and to the user that matches the capability of the AI system [12].”
BackgroundInfluentialA guide to deep learning in healthcare
Esteva, A., Robicquet, A., Ramsundar, B., Kuleshov, V., DePristo, M., Chou, K., Cui, C., Corrado, G., Thrun, S., & Dean, J. (2019) · Nature Medicine · doi:10.1038/s41591-018-0316-z · Cited by 5,312
Dual-Processing Accounts of Reasoning, Judgment, and Social Cognition
Evans, J. S. B. T. (2008) · Annual Review of Psychology · doi:10.1146/annurev.psych.59.103006.093629 · Cited by 5,137
Artificial intelligence in healthcare: past, present and future
Jiang, F., Jiang, Y., Zhi, H., Dong, Y., Li, H., Ma, S., Wang, Y., Dong, Q., Shen, H., & Wang, Y. (2017) · Stroke and Vascular Neurology · doi:10.1136/svn-2017-000101 · Cited by 4,837
Humans and automation: Use, misuse, disuse, abuse
Parasuraman, R., & Riley, V. (1997) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872097778543886 · Cited by 4,554
The potential for artificial intelligence in healthcare
Davenport, T., & Kalakota, R. (2019) · Future Healthcare Journal · doi:10.7861/futurehosp.6-2-94 · Cited by 3,800
Dwork, C., Hardt, M., Pitassi, T., Reingold, O., & Zemel, R. (2012) · Proceedings of the 3rd Innovations in Theoretical Computer Science Conference · doi:10.1145/2090236.2090255 · Cited by 3,501
Some Philosophical Problems from the Standpoint of Artificial Intelligence
McCarthy, J., & Hayes, P. J. (1981) · Readings in Artificial Intelligence · doi:10.1016/b978-0-934613-03-3.50033-7 · Cited by 3,279
Deep learning for healthcare: review, opportunities and challenges
Miotto, R., Wang, F., Wang, S., Jiang, X., & Dudley, J. T. (2018) · Briefings in Bioinformatics · doi:10.1093/bib/bbx044 · Cited by 3,076 · cited 1×
“Existing literature in the machine learning field provides relatively successful methods to train such mathematical models that learn useful knowledge from data [9-11].”
BackgroundCertifying and Removing Disparate Impact
Feldman, M., Friedler, S. A., Moeller, J., Scheidegger, C., & Venkatasubramanian, S. (2015) · Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2783258.2783311 · Cited by 1,827
Kirk, M. D., Pires, S. M., Black, R. E., Caipo, M., Crump, J. A., Devleesschauwer, B., Döpfer, D., Fazil, A., Fischer-Walker, C. L., Hald, T., et al. (2015) · PLoS Medicine · doi:10.1371/journal.pmed.1001921 · Cited by 1,625
Holden, R. J., Carayon, P., Gurses, A. P., Hoonakker, P., Hundt, A. S., Ozok, A. A., & Rivera-Rodriguez, A. J. (2013) · Ergonomics · doi:10.1080/00140139.2013.838643 · Cited by 1,221 · cited 1×
“Applying human factors methodologies such as the SEIPS model [46] to the health care domain can assist researchers in capturing the entire socio-technical work system.”
MethodTrust in a specific technology: An investigation of its components and measures
Mcknight, D. H., Carter, M., Thatcher, J. B., & Clay, P. F. (2011) · ACM Transactions on Management Information Systems · doi:10.1145/1985347.1985353 · Cited by 1,185
Overview of artificial intelligence in medicine
Amisha, Malik, P., Pathania, M., & Rathaur, V. K. (2019) · Journal of Family Medicine and Primary Care · doi:10.4103/jfmpc.jfmpc_440_19 · Cited by 1,106 · cited 1×
“The Da Vinci robotic surgical system can mimic a surgeon’s hand movements with greater precision [28].”
BackgroundAI can be sexist and racist — it’s time to make it fair
Zou, J., & Schiebinger, L. (2018) · Nature · doi:10.1038/d41586-018-05707-8 · Cited by 765
Potential liability for physicians using artificial intelligence
Price, W. N., Gerke, S., & Cohen, I. G. (2019) · JAMA · doi:10.1001/jama.2019.15064 · Cited by 579
Machine Learning for Healthcare: On the Verge of a Major Shift in Healthcare Epidemiology
Wiens, J., & Shenoy, E. S. (2018) · Clinical Infectious Diseases · doi:10.1093/cid/cix731 · Cited by 574
Liu, Y., Kohlberger, T., Norouzi, M., Dahl, G. E., Smith, J. L., Mohtashamian, A., Olson, N., Peng, L. H., Hipp, J. D., & Stumpe, M. C. (2019) · Archives of Pathology & Laboratory Medicine · doi:10.5858/arpa.2018-0147-oa · Cited by 394
(2018) · Singapore Management University Institutional Knowledge (InK) (Singapore Management University) · Cited by 390
Just-in-Time Delivery Comes to Knowledge Management
Davenport, T. H., & Glaser, J. (2006) · Knowledge Management and Organizational Learning · doi:10.1093/oso/9780199291793.003.0020 · Cited by 351
Kirk, M. D., Pires, S. M., Black, R. E., Caipo, M., Crump, J. A., Devleesschauwer, B., Döpfer, D., Fazil, A., Fischer-Walker, C. L., Hald, T., et al. (2015) · PLOS Medicine · doi:10.1371/journal.pmed.1001940 · Cited by 346
Artificial intelligence in healthcare: a critical analysis of the legal and ethical implications
Schönberger, D. (2019) · International Journal of Law and Information Technology · doi:10.1093/ijlit/eaz004 · Cited by 230
Hoffman, R. R., Johnson, M., Bradshaw, J. M., & Underbrink, A. (2013) · IEEE Intelligent Systems · doi:10.1109/mis.2013.24 · Cited by 229
Regulation of predictive analytics in medicine
Parikh, R. B., Obermeyer, Z., & Navathe, A. S. (2019) · Science · doi:10.1126/science.aaw0029 · Cited by 223 · cited 3×
“Among these factors, reliability, which refers to whether the AI technology can perform a task predictably and consistently [34], might be particularly concerning in health care due to the changes in the reliability of AI in the presence of new data [35].”
BackgroundInfluentialA Survey of Multi-Agent Trust Management Systems
Yu, H., Shen, Z., Leung, C., Miao, C., & Lesser, V. R. (2013) · IEEE Access · doi:10.1109/access.2013.2259892 · Cited by 221
Why the Fitts list has persisted throughout the history of function allocation
de Winter, J., & Dodou, D. (2011) · Cognition Technology & Work · doi:10.1007/s10111-011-0188-1 · Cited by 212
Radiomics and Artificial Intelligence for Biomarker and Prediction Model Development in Oncology
Forghani, R., Savadjiev, P., Chatterjee, A., Muthukrishnan, N., Reinhold, C., & Forghani, B. (2019) · Computational and Structural Biotechnology Journal · doi:10.1016/j.csbj.2019.07.001 · Cited by 195
Improving IoT Technology Adoption through Improving Consumer Trust
AlHogail, A. (2018) · Technologies · doi:10.3390/technologies6030064 · Cited by 180
Promoting Trust Between Patients and Physicians in the Era of Artificial Intelligence
Nundy, S., Montgomery, T., & Wachter, R. M. (2019) · JAMA · doi:10.1001/jama.2018.20563 · Cited by 148
Artificial Intelligence in Healthcare: Past, Present and Future
Tekkeşin, A. İ. (2019) · The Anatolian Journal of Cardiology · doi:10.14744/anatoljcardiol.2019.28661 · Cited by 136
Beck, J. T., Rammage, M., Jackson, G. P., Preininger, A. M., Dankwa-Mullan, I., Roebuck, M. C., Torres, A., Holtzen, H., Coverdill, S. E., Williamson, M. P., et al. (2020) · JCO Clinical Cancer Informatics · doi:10.1200/cci.19.00079 · Cited by 127 · cited 1×
“AI has shown significant potential in the area of mining medical records, designing treatment plans [15], robotics mediated surgeries [16], medical management and supporting hospital operations, clinical data interpretation [17], clinical trial participation [18,19], image-based diagnosis [20], preliminary diagnosis […”
BackgroundThe ICO and artificial intelligence: The role of fairness in the GDPR framework
Butterworth, M. L. (2018) · Computer Law and Security Review · doi:10.1016/j.clsr.2018.01.004 · Cited by 84
AI4SE and SE4AI: A Research Roadmap
McDermott, T., DeLaurentis, D., Beling, P. A., et al. (2020) · Insight · doi:10.1002/inst.12278 · Cited by 68
Selection of patients for clinical trials: an interactive web-based system
Fink, E., Kokku, P. K., Nikiforou, S., Hall, L., Goldgof, D. B., & Krischer, J. P. (2004) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2004.01.017 · Cited by 59
Artificial Intelligence in Healthcare
Peete, R., Majowski, K., Lauer, L., et al. (2019) · CRC Press eBooks · doi:10.1201/9780367821654-8 · Cited by 36
Zhao, M., & Jiang, Y. (2019) · Eye · doi:10.1038/s41433-019-0629-2 · Cited by 19
(2019) · Case Medical Research · doi:10.31525/fda2-ucm635083.htm · Cited by 17
(2019) · American Journal of Medical Research · doi:10.22381/ajmr6220195 · Cited by 11
An Analysis on the Rush Strategies of the Real-Time Strategy Game StarCraft-II
Teguh, B., Oh, H., Yi, D., et al. (2017) · 人工知能学会全国大会論文集 · Cited by 2
Research works printed but not linked: 7
- Fitts, P, 1951, Human engineering for an effective air-navigationtraffic-control system. Fitts PM. editor
- Siau, K, 2018, Cutter Business Technology Journal, 31, 47
- 10.1518/hfes.46.1.50.30392 · doi:10.1518/hfes.46.1.50.30392 · Paper page
- Davenport, TH, 2002, Harv Bus Rev, 80, 107
- 2020, White House American artificial intelligence initiative year one annual report, E
- GoodfellowIShlensJSzegedyCExplaining and harnessing adversarial examples20150507Proceeding of 3rd International Conference on Learning Representations; May ; San Diego2015San Diego79
- Ferreira, A, 2015, Springer, 1121
Cited by
Deep learning-enabled medical computer vision
Esteva, A., Chou, K., Yeung, S., Naik, N., Madani, A., Mottaghi, A., Liu, Y., Topol, E., Dean, J., & Socher, R. (2021) · npj Digital Medicine · doi:10.1038/s41746-020-00376-2 · Cited by 1,406
Ferrara, E. (2023) · Sci · doi:10.3390/sci6010003 · Cited by 875
“Researchers and practitioners have proposed various mitigation strategies, such as improving data quality [8] and designing explicitly fair algorithms [9–11].”
BackgroundTrust in AI: progress, challenges, and future directions
Afroogh, S., Akbari, A., Malone, E., Kargar, M., & Alambeigi, H. (2024) · Humanities and Social Sciences Communications · doi:10.1057/s41599-024-04044-8 · Cited by 507
Schepman, A., & Rodway, P. (2023) · International Journal of Human–Computer Interaction · doi:10.1080/10447318.2022.2085400 · Cited by 503
Medical 4.0 technologies for healthcare: Features, capabilities, and applications
Haleem, A., Javaid, M., Pratap Singh, R., & Suman, R. (2022) · Internet of Things and Cyber-Physical Systems · doi:10.1016/j.iotcps.2022.04.001 · Cited by 468
Metadata
- Authors
- Asan, O., Bayrak, A. E., & Choudhury, A.
- Affiliations
- Stevens Institute of Technology (US)
- Corresponding author
- Asan, Onur
- Venue
- Journal of Medical Internet Research
- Publisher
- JMIR Publications Inc.
- Published
- 2020-06-19
- Volume
- 22
- Issue
- 6
- Pages
- e15154
- ISSN
- 1438-8871 (ISSN-L)
- PMC
- PMC7334754
- OpenAlex
- W3036458852
- Cited by
- 825
- References
- 41
- Citations by year
- 2026: 164 · 2025: 200 · 2024: 186 · 2023: 117 · 2022: 108 · 2021: 45 · 2020: 5
- FWCI
- 20.23
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- Journal of Medical Internet Research (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Topics
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Keywords
- artificial intelligence in healthcare, trust in AI, clinicians, trust factors, clinical decision-making, artificial intelligence adoption, human-AI relationship, uncertainty
- MeSH terms
- Artificial Intelligence, Delivery of Health Care, Humans, Trust
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.