The DOI matches its Crossref record; 53 of the 54 references it cites were found in a registry or an index.
Trust in artificial intelligence for medical diagnoses
Abstract
We present two online experiments investigating trust in artificial intelligence (AI) as a primary and secondary medical diagnosis tool and one experiment testing two methods to increase trust in AI. Participants in Experiment 1 read hypothetical scenarios of low and high-risk diseases, followed by two sequential diagnoses, and estimated their trust in the medical findings. In three between-participants groups, the first and second diagnoses were given by: human and AI, AI and human, and human and human doctors, respectively. In Experiment 2 we examined if people expected higher standards of performance from AI than human doctors, in order to trust AI treatment recommendations. In Experiment 3 we investigated the possibility to increase trust in AI diagnoses by: (i) informing our participants that the AI outperforms the human doctor, and (ii) nudging them to prefer AI diagnoses in a choice between AI and human doctors. Results indicate overall lower trust in AI, as well as for diagnoses of high-risk diseases. Participants trusted AI doctors less than humans for first diagnoses, and they were also less likely to trust a second opinion from an AI doctor for high risk diseases. Surprisingly, results highlight that people have comparable standards of performance for AI and human doctors and that trust in AI does not increase when people are told the AI outperforms the human doctor. Importantly, we find that the gap in trust between AI and human diagnoses is eliminated when people are nudged to select AI in a free-choice paradigm between human and AI diagnoses, with trust for AI diagnoses significantly increased when participants could choose their doctor. These findings isolate control over one's medical practitioner as a valid candidate for future trust-related medical diagnosis and highlight a solid potential path to smooth acceptance of AI diagnoses amongst patients.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The results of previous empirical studies on patients’ acceptance or trust in AI are somewhat conflicting. Some studies have shown that participants are more accepting of AI if it is proven to be more accurate than providers26,29 or if the use of AI fits societal and cultural norms.35,36 However, other studies have found that trust in AI did not increase when participants were informed that the AI”
From Patient perspectives on informed consent for medical AI: A web-based experiment (2024) · cites this paper as [34]
In the citing paper
“This result is only partly consistent with those of previous studies, which have shown that participants are more accepting of AI if it is applied in a lower risk setting.32,34,51”
From Patient perspectives on informed consent for medical AI: A web-based experiment (2024) · cites this paper as [34]
Citations
Cites
A Theory of Cognitive Dissonance
Festinger, L. (1957) · doi:10.1515/9781503620766 · Cited by 24,241
Dermatologist-level classification of skin cancer with deep neural networks
Esteva, A., Kuprel, B., Novoa, R. A., Ko, J., Swetter, S. M., Blau, H. M., & Thrun, S. (2017) · Nature · doi:10.1038/nature21056 · Cited by 14,362
Not So Different After All: A Cross-Discipline View Of Trust
Rousseau, D. M., Sitkin, S. B., Burt, R. S., & Camerer, C. (1998) · Academy of Management Review · doi:10.5465/amr.1998.926617 · Cited by 10,274
Feeling and thinking: Preferences need no inferences.
Zajonc, R. B. (1980) · American Psychologist · doi:10.1037/0003-066x.35.2.151 · Cited by 8,094
Trust in Automation: Designing for Appropriate Reliance
Lee, J. D., & See, K. A. (2004) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/hfes.46.1.50_30392 · Cited by 6,605 · cited 1×
“Not surprisingly, trust was found to underlie willingness to try automation, making it crucial for the successful implementation of AI for healthcare (Lee and Moray, 1994; Lee and See, 2004).”
BackgroundHumans and automation: Use, misuse, disuse, abuse
Parasuraman, R., & Riley, V. (1997) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872097778543886 · Cited by 4,554
Algorithm aversion: People erroneously avoid algorithms after seeing them err.
Dietvorst, B. J., Simmons, J. P., & Massey, C. (2015) · Journal of Experimental Psychology: General · doi:10.1037/xge0000033 · Cited by 3,232
Artificial intelligence in healthcare
Yu, K.-H., Beam, A. L., & Kohane, I. S. (2018) · Nature Biomedical Engineering · doi:10.1038/s41551-018-0305-z · Cited by 2,817
Clinically applicable deep learning for diagnosis and referral in retinal disease
De Fauw, J., Ledsam, J. R., Romera-Paredes, B., Nikolov, S., Tomasev, N., Blackwell, S., Askham, H., Glorot, X., O’Donoghue, B., Visentin, D., et al. (2018) · Nature Medicine · doi:10.1038/s41591-018-0107-6 · Cited by 2,639
Algorithm appreciation: People prefer algorithmic to human judgment
Logg, J. M., Minson, J. A., & Moore, D. A. (2019) · Organizational Behavior and Human Decision Processes · doi:10.1016/j.obhdp.2018.12.005 · Cited by 2,061
Thaler, R. H., & Sunstein, C. R. (2003) · American Economic Review · doi:10.1257/000282803321947001 · Cited by 1,874
Lakhani, P., & Sundaram, B. (2017) · Radiology · doi:10.1148/radiol.2017162326 · Cited by 1,775
Can we open the black box of AI?
Castelvecchi, D. (2016) · Nature · doi:10.1038/538020a · Cited by 1,773
Haenssle, H. A., Fink, C., Schneiderbauer, R., Toberer, F., Buhl, T., Blum, A., Kalloo, A., Hassen, A. B. H., Thomas, L., Enk, A., et al. (2018) · Annals of Oncology · doi:10.1093/annonc/mdy166 · Cited by 1,571
Trust in Physicians and Medical Institutions: What Is It, Can It Be Measured, and Does It Matter?
Hall, M. A., Dugan, E., Zheng, B., & Mishra, A. K. (2001) · Milbank Quarterly · doi:10.1111/1468-0009.00223 · Cited by 1,491
Festinger, L. (1962) · Scientific American · doi:10.1038/scientificamerican1062-93 · Cited by 1,421
The role of trust in automation reliance
Dzindolet, M. T., Peterson, S. A., Pomranky, R. A., Pierce, L. G., & Beck, H. P. (2003) · International Journal of Human-Computer Studies · doi:10.1016/s1071-5819(03)00038-7 · Cited by 1,276
Trust in a specific technology: An investigation of its components and measures
Mcknight, D. H., Carter, M., Thatcher, J. B., & Clay, P. F. (2011) · ACM Transactions on Management Information Systems · doi:10.1145/1985347.1985353 · Cited by 1,185
Pukelsheim, F. (1994) · The American Statistician · doi:10.1080/00031305.1994.10476030 · Cited by 1,072
MUIR, B. M., & MORAY, N. (1996) · Ergonomics · doi:10.1080/00140139608964474 · Cited by 993
Trust, self-confidence, and operators' adaptation to automation
Lee, J. D., & Moray, N. (1994) · International Journal of Human-Computer Studies · doi:10.1006/ijhc.1994.1007 · Cited by 932
The Media and Technology Usage and Attitudes Scale: An empirical investigation
Rosen, L. D., Whaling, K., Carrier, L. M., Cheever, N. A., & Rokkum, J. (2013) · Computers in Human Behavior · doi:10.1016/j.chb.2013.06.006 · Cited by 788
Patients’ trust in physicians: Many theories, few measures, and little data
Pearson, S. D., & Raeke, L. H. (2000) · Journal of General Internal Medicine · doi:10.1046/j.1525-1497.2000.11002.x · Cited by 709
What do we need to build explainable AI systems for the medical domain?
Holzinger, A., Biemann, C., Pattichis, C. S., & Kell, D. B. (2017) · arXiv · doi:10.48550/arxiv.1712.09923 · Cited by 636
Patients’ preference for involvement in medical decision making: A narrative review
Say, R., Murtagh, M. J., & Thomson, R. (2005) · Patient Education and Counseling · doi:10.1016/j.pec.2005.02.003 · Cited by 633
What Role Do Patients Wish to Play in Treatment Decision Making?
Deber, R. B. (1996) · Archives of Internal Medicine · doi:10.1001/archinte.1996.00440120070006 · Cited by 627
The Role of Patient-Physician Trust in Moderating Medication Nonadherence Due to Cost Pressures
Piette, J. D., Heisler, M., Krein, S., & Kerr, E. A. (2005) · Archives of Internal Medicine · doi:10.1001/archinte.165.15.1749 · Cited by 388
The patient–doctor relationship: a synthesis of the qualitative literature on patients' perspectives
Ridd, M. J., Shaw, A. R. G., Lewis, G., & Salisbury, C. (2009) · British Journal of General Practice · doi:10.3399/bjgp09x420248 · Cited by 379
Patients’ trust in their physicians
Kao, A. C., Green, D. C., Davis, N., Koplan, J. P., & Cleary, P. D. (1998) · Journal of General Internal Medicine · doi:10.1046/j.1525-1497.1998.00204.x · Cited by 343
Patient trust in the physician: relationship to patient requests
Thom, D. H. (2002) · Family Practice · doi:10.1093/fampra/19.5.476 · Cited by 335
The relative influence of advice from human experts and statistical methods on forecast adjustments
Önkal, D., Goodwin, P., Thomson, M. E., Gonul, M. S., & Pollock, A. C. (2009) · Journal of Behavioral Decision Making · doi:10.1002/bdm.637 · Cited by 331
How Choice Reveals and Shapes Expected Hedonic Outcome
Sharot, T., Martino, B. D., & Dolan, R. J. (2009) · Journal of Neuroscience · doi:10.1523/jneurosci.4972-08.2009 · Cited by 265
Promberger, M., & Baron, J. (2006) · Journal of Behavioral Decision Making · doi:10.1002/bdm.542 · Cited by 242
AI for medical imaging goes deep
Ting, D. S. W., Liu, Y., Burlina, P., Xu, X., Bressler, N. M., & Wong, T. Y. (2018) · Nature Medicine · doi:10.1038/s41591-018-0029-3 · Cited by 211
Magic at the marketplace: Choice blindness for the taste of jam and the smell of tea
Hall, L., Johansson, P., Tärning, B., Sikström, S., & Deutgen, T. (2010) · Cognition · doi:10.1016/j.cognition.2010.06.010 · Cited by 200
Toward a psychosocial typology of chronic and life-threatening illness.
Rolland, J. S. (1984) · Family Systems Medicine · doi:10.1037/h0091663 · Cited by 192
Mandates of Trust in the Doctor–Patient Relationship
Skirbekk, H., Middelthon, A., Hjortdahl, P., & Finset, A. (2011) · Qualitative Health Research · doi:10.1177/1049732311405685 · Cited by 175
Deber, R. (1994) · PubMed · Cited by 173
Why trust an algorithm? Performance, cognition, and neurophysiology
Alexander, V., Blinder, C., & Zak, P. J. (2018) · Computers in Human Behavior · doi:10.1016/j.chb.2018.07.026 · Cited by 148
Physician Trust in the Patient: Development and Validation of a New Measure
Thom, D. H., Wong, S. T., Guzman, D., Wu, A. W., Penko, J., Miaskowski, C. A., & Kushel, M. (2011) · The Annals of Family Medicine · doi:10.1370/afm.1224 · Cited by 122
Bisantz, A. M., & Seong, Y. (2001) · International Journal of Industrial Ergonomics · doi:10.1016/s0169-8141(01)00015-4 · Cited by 106
Johansson, P., Hall, L., Tärning, B., Sikström, S., & Chater, N. (2013) · Journal of Behavioral Decision Making · doi:10.1002/bdm.1807 · Cited by 85
Free Choice and Cognitive Dissonance Revisited: Choosing “Lesser Evils” Versus “Greater Goods”
Shultz, T. R., Léveillé, E., & Lepper, M. R. (1999) · Personality and Social Psychology Bulletin · doi:10.1177/0146167299025001004 · Cited by 84
When Do People Want AI to Make Decisions?
Kramer, M. F., Schaich Borg, J., Conitzer, V., & Sinnott-Armstrong, W. (2018) · Proceedings of the 2018 AAAI/ACM Conference on AI, Ethics, and Society · doi:10.1145/3278721.3278752 · Cited by 83
Reliance, trust and heuristics in judgmental forecasting
Alvarado, J., & Barrero, L. H. (2014) · Computers in Human Behavior · doi:10.1016/j.chb.2014.03.047 · Cited by 66
Post-Decisional Reevaluation of Choice Alternatives
Gerard, H. B., & White, G. L. (1983) · Personality and Social Psychology Bulletin · doi:10.1177/0146167283093006 · Cited by 66
Cao, W., Qi, X., Yao, T., Han, X., & Feng, X. (2016) · Psycho-Oncology · doi:10.1002/pon.4063 · Cited by 66
Empirically understanding trust in medical technology
Montague, E. N. H., Kleiner, B. M., & Winchester, W. W. (2009) · International Journal of Industrial Ergonomics · doi:10.1016/j.ergon.2009.01.004 · Cited by 64
I’m No Longer Torn After Choice
Coppin, G., Delplanque, S., Cayeux, I., Porcherot, C., & Sander, D. (2010) · Psychological Science · doi:10.1177/0956797610364115 · Cited by 62
Comparing sequencing assays and human-machine analyses in actionable genomics for glioblastoma
Wrzeszczyński, K. O., Frank, M. O., Koyama, T., Rhrissorrakrai, K., Robine, N., Utro, F., Emde, A., Chen, B., Arora, K. S., Shah, M. J., et al. (2017) · Neurology Genetics · doi:10.1212/nxg.0000000000000164 · Cited by 39
Chu, C., Fauw, J. D., Tomašev, N., Romera‐Paredes, B., Hughes, C., Ledsam, J. R., Back, T., Montgomery, H., Rees, G. E., Raine, R., et al. (2016) · F1000Research · doi:10.12688/f1000research.9525.1 · Cited by 20
Jung, E. S., Woo, B., & Yun, M. H. (2000) · Cited by 6
Seong, Y., & Bisantz, A. M. (2000) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/154193120004400102 · Cited by 4
Cited by
Sorted by citations
Patient apprehensions about the use of artificial intelligence in healthcare
Richardson, J. P., Smith, C., Curtis, S., Watson, S., Zhu, X., Barry, B., & Sharp, R. R. (2021) · npj Digital Medicine · doi:10.1038/s41746-021-00509-1 · Cited by 424
Young, A. T., Amara, D., Bhattacharya, A., & Wei, M. L. (2021) · The Lancet Digital Health · doi:10.1016/s2589-7500(21)00132-1 · Cited by 400
Vo, V., Chen, G., Aquino, Y. S. J., Carter, S. M., Nga, Q., & Woode, M. E. (2023) · Social Science & Medicine · doi:10.1016/j.socscimed.2023.116357 · Cited by 180
Explainable AI-based Alzheimer’s prediction and management using multimodal data
Jahan, S., Abu Taher, K., Kaiser, M. S., Mahmud, M., Rahman, M. S., Hosen, A. S. M. S., & Ra, I.-H. (2023) · PLOS ONE · doi:10.1371/journal.pone.0294253 · Cited by 122
Mitigating Bias in Radiology Machine Learning: 3. Performance Metrics
Faghani, S., Khosravi, B., Zhang, K., Moassefi, M., Jagtap, J. M. M., Nugen, F., Vahdati, S., Kuanar, S. P., Rassoulinejad-Mousavi, S. M., Singh, Y., et al. (2022) · Radiology Artificial Intelligence · doi:10.1148/ryai.220061 · Cited by 104
Metadata
- Authors
- Juravle, G., Boudouraki, A., Terziyska, M., & Rezlescu, C.
- Affiliations
- Alexandru Ioan Cuza University (RO)
- University of Nottingham (GB)
- University College London (GB)
- Corresponding author
- Georgiana Juravle
- Venue
- Progress in Brain Research
- Publisher
- Elsevier
- Published
- 2020
- Volume
- 253
- Pages
- 263-282
- ISSN
- 0079-6123 (ISSN-L)
- OpenAlex
- W3039044431
- Cited by
- 116
- References
- 54
- Citations by year
- 2026: 22 · 2025: 25 · 2024: 33 · 2023: 21 · 2022: 11 · 2021: 4
- FWCI
- 5.46
- Type
- book chapter
- Language
- en
- Open access
- closed
- Locations
- Progress in brain research (publishedVersion)
- PubMed (publishedVersion)
- UCL Discovery (University College London) (submittedVersion)
- Topics
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Social Sciences › Human Factors and Ergonomics › Human-Automation Interaction and Safety
- Health Sciences › Medicine › Family Practice › Clinical Reasoning and Diagnostic Skills
- Keywords
- trust in AI, diagnosis, second opinion, high-risk disease, nudging, patient acceptance of AI, human-AI collaboration
- MeSH terms
- Clinical Decision-Making, Adolescent, Adult, Aged, Aged, 80 and over, Artificial Intelligence, Diagnosis, Female, Humans, Male, Middle Aged, Physician-Patient Relations, Diagnostic Techniques and Procedures, Trust, Young Adult
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review