Attitudes towards Trusting Artificial Intelligence Insights and Factors to Prevent the Passive Adherence of GPs: A Pilot Study
Open accessThe DOI matches its Crossref record; 22 of the 22 references it cites were found in a registry or an index.
Abstract
Artificial Intelligence (AI) systems could improve system efficiency by supporting clinicians in making appropriate referrals. However, they are imperfect by nature and misdiagnoses, if not correctly identified, can have consequences for patient care. In this paper, findings from an online survey are presented to understand the aptitude of GPs (n = 50) in appropriately trusting or not trusting the output of a fictitious AI-based decision support tool when assessing skin lesions, and to identify which individual characteristics could make GPs less prone to adhere to erroneous diagnostics results. The findings suggest that, when the AI was correct, the GPs’ ability to correctly diagnose a skin lesion significantly improved after receiving correct AI information, from 73.6% to 86.8% (X2 (1, N = 50) = 21.787, p < 0.001), with significant effects for both the benign (X2 (1, N = 50) = 21, p < 0.001) and malignant cases (X2 (1, N = 50) = 4.654, p = 0.031). However, when the AI provided erroneous information, only 10% of the GPs were able to correctly disagree with the indication of the AI in terms of diagnosis (d-AIW M: 0.12, SD: 0.37), and only 14% of participants were able to correctly decide the management plan despite the AI insights (d-AIW M:0.12, SD: 0.32). The analysis of the difference between groups in terms of individual characteristics suggested that GPs with domain knowledge in dermatology were better at rejecting the wrong insights from AI.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Micocci et al. (2021) found that inexperienced general practitioners accepted incorrect AI advice more often than their experienced counterparts.”
From Investigating appropriate reliance on AI-Based decision support systems: the role of expertise, trust, and self-confidence (2025) · cites this paper as Micocci et al., 2021
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“In medicine, for example, less experienced clinicians are more prone to over-reliance on AI advice, while experts tend to exhibit cautious use or even underreliance (Fink et al., 2020;Küper et al., 2024;Micocci et al., 2021;Tschandl et al., 2020).”
From Investigating appropriate reliance on AI-Based decision support systems: the role of expertise, trust, and self-confidence (2025) · cites this paper as Micocci et al., 2021
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Similarly, Micocci et al. [58] highlighted the danger of clinicians passively adhering to incorrect AI recommendations, demonstrating a critical need for systems and evaluations that encourage appropriate reliance.”
From Explainable AI for Clinical Decision Support Systems: Literature Review, Key Gaps, and Research Synthesis (2025) · cites this paper as [58]
The cited source says what the claim attributes to it.
In the citing paper
“User expertise also plays a role: more knowledgeable clinicians are often better able to calibrate their trust in an AI system appropriately [58,62].”
From Explainable AI for Clinical Decision Support Systems: Literature Review, Key Gaps, and Research Synthesis (2025) · cites this paper as [58]
The cited source says what the claim attributes to it.
In the citing paper
“The field grapples with dual risks: on one hand, passive over-reliance on AI (taking AI suggestions without sufficient scrutiny) [58], and on the other, under-reliance or excessive skepticism of AI (dismissal of useful AI input) [60].”
From Explainable AI for Clinical Decision Support Systems: Literature Review, Key Gaps, and Research Synthesis (2025) · cites this paper as [58]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Dermatologist-level classification of skin cancer with deep neural networks
Esteva, A., Kuprel, B., Novoa, R. A., Ko, J., Swetter, S. M., Blau, H. M., & Thrun, S. (2017) · Nature · doi:10.1038/nature21056 · Cited by 14,362
Developing and validating trust measures for e-commerce: an integrative typology
McKnight, D. H., Choudhury, V., & Kacmar, C. (2002) · Information Systems Research · doi:10.1287/isre.13.3.334.81 · Cited by 5,550 · cited 1×
“Three questions considered the GPs overall trust attitude toward innovations in medical devices [25].”
BackgroundArtificial intelligence in healthcare
Yu, K.-H., Beam, A. L., & Kohane, I. S. (2018) · Nature Biomedical Engineering · doi:10.1038/s41551-018-0305-z · Cited by 2,817
Three techniques for integrating data in mixed methods studies
O'Cathain, A., Murphy, E., & Nicholl, J. (2010) · BMJ · doi:10.1136/bmj.c4587 · Cited by 1,584
Haenssle, H. A., Fink, C., Schneiderbauer, R., Toberer, F., Buhl, T., Blum, A., Kalloo, A., Hassen, A. B. H., Thomas, L., Enk, A., et al. (2018) · Annals of Oncology · doi:10.1093/annonc/mdy166 · Cited by 1,571
Macmillan, N. A., & Creelman, C. D. (2004) · doi:10.4324/9781410611147 · Cited by 1,269
Understanding the Hawthorne effect
Sedgwick, P., & Greenwood, N. (2015) · BMJ · doi:10.1136/bmj.h4672 · Cited by 824 · cited 1×
“Secondly, the participants of the present study were aware that the test was a simulation and that no real AI technology was involved; therefore, we cannot rule out that they may have changed their behaviour because of the attention they received [29] and because of the absence of implications for patients.”
BackgroundErdmann, F., Lortet‐Tieulent, J., Schüz, J., Zeeb, H., Greinert, R., Breitbart, E. W., & Bray, F. (2013) · International Journal of Cancer · doi:10.1002/ijc.27616 · Cited by 627
Do as AI say: susceptibility in deployment of clinical decision-aids
Gaube, S., Suresh, H., Raue, M., Merritt, A., Berkowitz, S. J., Lermer, E., Coughlin, J. F., Guttag, J. V., Colak, E., & Ghassemi, M. (2021) · npj Digital Medicine · doi:10.1038/s41746-021-00385-9 · Cited by 543 · cited 1×
“These findings are in alignment with previous studies [28] suggesting that over-reliance on automated systems may be triggered by confirmatory bias when participants direct their attention towards features consistent with the (inaccurate) advice.”
ResultFarmer, E. R., Gonin, R., & Hanna, M. P. (1996) · Human Pathology · doi:10.1016/s0046-8177(96)90157-4 · Cited by 440
Cited by
Tun, H. M., Rahman, H. A., Naing, L., & Malik, O. A. (2025) · Journal of Medical Internet Research · doi:10.2196/69678 · Cited by 210
“Micocci et al [22] noted that AI systems, like human clinicians, are inherently imperfect and should be designed to complement, not replace, the clinician’s holistic understanding of each clinical scenario.”
InfluentialTerry, A. L., Kueper, J. K., Beleno, R., Brown, J. B., Cejic, S., Dang, J., Leger, D., McKay, S., Meredith, L., Pinto, A. D., et al. (2022) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-022-01984-6 · Cited by 64
Quantifying the impact of AI recommendations with explanations on prescription decision making
Nagendran, M., Festor, P., Komorowski, M., Gordon, A. C., & Faisal, A. A. (2023) · npj Digital Medicine · doi:10.1038/s41746-023-00955-z · Cited by 81
Zhou, J., Zhang, J., Wan, R., Cui, X., Liu, Q., Guo, H., Shi, X., Fu, B., Meng, J., Yue, B., et al. (2025) · BMC Medical Education · doi:10.1186/s12909-025-06916-2 · Cited by 73
Rezaeian, O., Bayrak, A. E., & Asan, O. (2026) · International Journal of Human–Computer Interaction · doi:10.1080/10447318.2025.2539458 · Cited by 39
Rezaeian, O., Bayrak, A. E., & Asan, O. (2025) · arXiv · doi:10.48550/arxiv.2501.16693 · Cited by 39
Borsci, S., Lehtola, V., Nex, F., Yang, M. Y., Augustijn, E.-W., Bagheriye, L., Brüne, C., Kounadi, O., Li, J. J., Moreira, J., et al. (2022) · AI & Society · doi:10.1007/s00146-021-01383-x · Cited by 50
Self-citationSalimparsa, M., Sedig, K., Lizotte, D. J., Abdullah, S. S., Chalabianloo, N., & Muanda, F. T. (2025) · Informatics · doi:10.3390/informatics12040119 · Cited by 39
“The field grapples with dual risks: on one hand, passive over-reliance on AI (taking AI suggestions without sufficient scrutiny) [58], and on the other, under-reliance or excessive skepticism of AI (dismissal of useful AI input) [60].”
InfluentialEvans, R. P., Bryant, L. D., Russell, G., & Absolom, K. L. (2024) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2024.105342 · Cited by 41
Razai, M. S., Al‐bedaery, R., Bowen, L., Yahia, R. M., Chandrasekaran, L., & Oakeshott, P. (2024) · PLoS ONE · doi:10.1371/journal.pone.0314196 · Cited by 49
Eye tracking insights into physician behaviour with safe and unsafe explainable AI recommendations
Nagendran, M., Festor, P., Komorowski, M., Gordon, A. C., & Faisal, A. A. (2024) · npj Digital Medicine · doi:10.1038/s41746-024-01200-x · Cited by 35
Are we justified attributing a mistake in diagnosis to an AI diagnostic system?
Babushkina, D. (2022) · AI and Ethics · doi:10.1007/s43681-022-00189-x · Cited by 30
Abdulazeem, H. M., Meckawy, R., Schwarz, S., Novillo-Ortiz, D., & Klug, S. J. (2025) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2025.105945 · Cited by 40
The impact of AI explanations on clinicians’ trust and diagnostic accuracy in breast cancer
Rezaeian, O., Asan, O., & Bayrak, A. E. (2025) · Applied Ergonomics · doi:10.1016/j.apergo.2025.104577 · Cited by 30
Dogru, E. Ö., & Krämer, N. C. (2025) · Journal of Decision Systems · doi:10.1080/12460125.2025.2593251 · Cited by 15
“This could be particularly relevant for high-stakes fields, where over-reliance and under-reliance carry the risk of diminishing task performance (Harada et al., 2021; Micocci et al., 2021).”
InfluentialLiaw, W. R., Ramos Silva, Y., Soltero, E. G., Krist, A., & Stotts, A. L. (2023) · JMIR AI · doi:10.2196/45032 · Cited by 14
“Although most of these tools have targeted specialists, 1 study examined how primary care physicians use an AI tool to diagnose skin lesions [38].”
BackgroundShamszare, H., Chaudhry, Z., Berenji, M., & Choudhury, A. (2025) · IEEE Access · doi:10.1109/access.2025.3586555 · Cited by 12
Human Factors Influencing Trust in Healthcare Artificial Intelligence: Systematic Literature Review
Choudhury, A., & Shamszare, H. (2026) · IISE Transactions on Occupational Ergonomics and Human Factors · doi:10.1080/24725838.2026.2625655 · Cited by 14
Jackson, N. J., Brown, K. E., Rn, M., Murrow, M., Cauley, M. R., Collins, B. X., Novak, L. L., Benda, N. C., & Ancker, J. S. (2026) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocag002 · Cited by 19
An Architecture to Support Graduated Levels of Trust for Cancer Diagnosis with AI
Rezaeian, O., Bayrak, A. E., & Asan, O. (2024) · Communications in computer and information science · doi:10.1007/978-3-031-61966-3_37 · Cited by 11
Hedman, M., Kosuta, V., Lindmark, M., Sandström, J., Trinh, B., Sundvall, P., Rystedt, K., Werner, M., Öhberg, F., & Lundberg, T. (2025) · Scandinavian Journal of Primary Health Care · doi:10.1080/02813432.2025.2571936 · Cited by 5
Gaps in patient safety: Areas that need our attention
Wu, A. W., Vincent, C. A., Øvretveit, J., Mair, A., Buckle, P., García‐Elorrio, E., Bellandi, T., Letaief, M., Ushiro, S., & Koizumi, S. (2023) · Journal of Patient Safety and Risk Management · doi:10.1177/25160435231218489 · Cited by 5
Self-citationDisagreement between human and AI evaluation of treatment plans
Sengupta, D., & Panda, S. (2026) · Scientific Reports · doi:10.1038/s41598-026-35406-8 · Cited by 6
Antweiler, D., & Fuchs, G. (2025) · Computers & Graphics · doi:10.1016/j.cag.2025.104212 · Cited by 3
Influence of artificial intelligence on ophthalmologists’ judgments in glaucoma
Kashiwagi, K., Toyoura, M., Mao, X., Kawase, K., Tanito, M., Nakazawa, T., Miki, A., Mori, K., & Yoshitomi, T. (2025) · PLoS ONE · doi:10.1371/journal.pone.0321368 · Cited by 3
Schnoor, K., Versluis, A., Chavannes, N. H., & Talboom-Kamp, E. P. W. A. (2023) · JMIR Human Factors · doi:10.2196/49221 · Cited by 2
Pavlova, D., Dovramadjiev, T., Daskalov, D., Peev, I., Mirchev, N., Dimova, R., & Radeva, J. (2024) · Lecture notes in networks and systems · doi:10.1007/978-981-97-1326-4_35 · Cited by 2
Borsci, S., Lehtola, V., Nex, F., Yang, M. Y., Augustijn, E.-W., Bagheriye, L., Brüne, C., Kounadi, O., Li, J. J., Moreira, J., et al. (2023) · doi:10.32920/23808690 · Cited by 2
Self-citationEmbedding governance in AI security culture: from trust calibration to accountable decisions
Żywiołek, J., Wolniak, R., & Grebski, W. W. (2026) · International Journal of Information Security · doi:10.1007/s10207-026-01265-7 · Cited by 3
Borsci, S., Lehtola, V., Nex, F., Yang, M. Y., Augustijn, E.-W., Bagheriye, L., Brüne, C., Kounadi, O., Li, J. J., Moreira, J., et al. (2023) · doi:10.32920/23808690.v1 · Cited by 1
Self-citationTun, H. M., Rahman, H. A., Naing, L., & Malik, O. A. (2024) · doi:10.2196/preprints.69678 · Cited by 1
Lorenz, S., Stinehour, S., Chennamaneni, A., Subhani, A. B., & Nadim, M. (2025) · IEEE Access · doi:10.1109/access.2025.3570633 · Cited by 1
Factors Influencing the Effectiveness of AI-Assisted Decision-Making in Medicine: A Scoping ReviewPreprint
Jackson, N. J., Brown, K. E., Miller, R., Murrow, M., Cauley, M. R., Collins, B. X., Novak, L. L., Benda, N. C., & Ancker, J. S. (2025) · medRxiv · doi:10.1101/2025.09.02.25334863
Terry, A. L., Kueper, J. K., Beleno, R., Brown, J. B., Cejic, S., Dang, J., Leger, D., McKay, S., Meredith, L., Pinto, A. D., et al. (2022) · Figshare · doi:10.6084/m9.figshare.21077165
Borsci, S., Haeri, M. A., Schmettow, M., & Federici, S. (2026) · Universal Access in the Information Society · doi:10.1007/s10209-025-01266-8 · Cited by 1
Self-citationCaparatta, T., Tsoi, A., Byramji, D. K., Farooq, S., Ruiz, K., Frank, C., Gartner, G., Schwarz, N., Fenn, A., Nazarian, J. P., et al. (2026) · Research Square · doi:10.21203/rs.3.rs-9899999/v1
Trust typology of medical doctors in artificial intelligence
Velasco, L. C., & Wang, W. (2026) · Procedia Computer Science · doi:10.1016/j.procs.2026.06.625
Evaluating Human factors Design in Clinician-Facing AI Applications: A Scoping Review (Preprint)Preprint
Frank, C. A., Stevens, A., & Engineer, L. D. (2026) · doi:10.2196/preprints.107400
Frank, C. A. (2026) · BMJ Quality & Safety · doi:10.1136/bmjqs-2026-020713
Frank, C. A., Stevens, A., Hsu, Y., Gao, G. G., Streiff, M. B., & Engineer, L. D. (2026) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocag176
Metadata
- Authors
- Micocci, M., Borsci, S., Thakerar, V., Walne, S., Manshadi, Y., Edridge, F., Mullarkey, D., Buckle, P., & Hanna, G. B.
- Affiliations
- National Institute for Health and Care Research (GB)
- Imperial College London (GB)
- British Association of Dermatologists (GB)
- Skin Analytics Limited, London EC2A 4PS, UK
- Corresponding author
- Micocci, Massimo
- Venue
- Journal of Clinical Medicine
- Publisher
- MDPI AG
- Published
- 2021-07-14
- Volume
- 10
- Issue
- 14
- Pages
- 3101
- ISSN
- 2077-0383 (ISSN-L)
- PMC
- PMC8303875
- OpenAlex
- W3179833988
- Cited by
- 39
- References
- 22
- Citations by year
- 2026: 10 · 2025: 13 · 2024: 6 · 2023: 6 · 2022: 4
- FWCI
- 1.17
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Journal of Clinical Medicine (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- University of Twente Research Information (publishedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Spiral (Imperial College London) (submittedVersion, other-oa)
- University of Twente Research Information (submittedVersion, cc-by)
- Funders
- Innovate UK (25763)
- Topics
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Health Sciences › Medicine › Family Practice › Clinical Reasoning and Diagnostic Skills
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Keywords
- general practitioners, AI decision support, skin lesion diagnosis, diagnostic errors, clinical judgment, clinical decision-making
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.

