Attitudes towards Trusting Artificial Intelligence Insights and Factors to Prevent the Passive Adherence of GPs: A Pilot Study
Open accessThe DOI matches its Crossref record; 22 of the 22 references it cites were found in a registry or an index.
Abstract
Artificial Intelligence (AI) systems could improve system efficiency by supporting clinicians in making appropriate referrals. However, they are imperfect by nature and misdiagnoses, if not correctly identified, can have consequences for patient care. In this paper, findings from an online survey are presented to understand the aptitude of GPs (n = 50) in appropriately trusting or not trusting the output of a fictitious AI-based decision support tool when assessing skin lesions, and to identify which individual characteristics could make GPs less prone to adhere to erroneous diagnostics results. The findings suggest that, when the AI was correct, the GPs’ ability to correctly diagnose a skin lesion significantly improved after receiving correct AI information, from 73.6% to 86.8% (X2 (1, N = 50) = 21.787, p < 0.001), with significant effects for both the benign (X2 (1, N = 50) = 21, p < 0.001) and malignant cases (X2 (1, N = 50) = 4.654, p = 0.031). However, when the AI provided erroneous information, only 10% of the GPs were able to correctly disagree with the indication of the AI in terms of diagnosis (d-AIW M: 0.12, SD: 0.37), and only 14% of participants were able to correctly decide the management plan despite the AI insights (d-AIW M:0.12, SD: 0.32). The analysis of the difference between groups in terms of individual characteristics suggested that GPs with domain knowledge in dermatology were better at rejecting the wrong insights from AI.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Micocci et al. (2021) found that inexperienced general practitioners accepted incorrect AI advice more often than their experienced counterparts.”
From Investigating appropriate reliance on AI-Based decision support systems: the role of expertise, trust, and self-confidence (2025) · cites this paper as Micocci et al., 2021
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“In medicine, for example, less experienced clinicians are more prone to over-reliance on AI advice, while experts tend to exhibit cautious use or even underreliance (Fink et al., 2020;Küper et al., 2024;Micocci et al., 2021;Tschandl et al., 2020).”
From Investigating appropriate reliance on AI-Based decision support systems: the role of expertise, trust, and self-confidence (2025) · cites this paper as Micocci et al., 2021
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Similarly, Micocci et al. [58] highlighted the danger of clinicians passively adhering to incorrect AI recommendations, demonstrating a critical need for systems and evaluations that encourage appropriate reliance.”
From Explainable AI for Clinical Decision Support Systems: Literature Review, Key Gaps, and Research Synthesis (2025) · cites this paper as [58]
The cited source says what the claim attributes to it.
In the citing paper
“User expertise also plays a role: more knowledgeable clinicians are often better able to calibrate their trust in an AI system appropriately [58,62].”
From Explainable AI for Clinical Decision Support Systems: Literature Review, Key Gaps, and Research Synthesis (2025) · cites this paper as [58]
The cited source says what the claim attributes to it.
In the citing paper
“The field grapples with dual risks: on one hand, passive over-reliance on AI (taking AI suggestions without sufficient scrutiny) [58], and on the other, under-reliance or excessive skepticism of AI (dismissal of useful AI input) [60].”
From Explainable AI for Clinical Decision Support Systems: Literature Review, Key Gaps, and Research Synthesis (2025) · cites this paper as [58]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Dermatologist-level classification of skin cancer with deep neural networks
Esteva, A., Kuprel, B., Novoa, R. A., Ko, J., Swetter, S. M., Blau, H. M., & Thrun, S. (2017) · Nature · doi:10.1038/nature21056 · Cited by 14,362
Developing and validating trust measures for e-commerce: an integrative typology
McKnight, D. H., Choudhury, V., & Kacmar, C. (2002) · Information Systems Research · doi:10.1287/isre.13.3.334.81 · Cited by 5,550 · cited 1×
“Three questions considered the GPs overall trust attitude toward innovations in medical devices [25].”
BackgroundArtificial intelligence in healthcare
Yu, K.-H., Beam, A. L., & Kohane, I. S. (2018) · Nature Biomedical Engineering · doi:10.1038/s41551-018-0305-z · Cited by 2,817
Three techniques for integrating data in mixed methods studies
O'Cathain, A., Murphy, E., & Nicholl, J. (2010) · BMJ · doi:10.1136/bmj.c4587 · Cited by 1,584
Haenssle, H. A., Fink, C., Schneiderbauer, R., Toberer, F., Buhl, T., Blum, A., Kalloo, A., Hassen, A. B. H., Thomas, L., Enk, A., et al. (2018) · Annals of Oncology · doi:10.1093/annonc/mdy166 · Cited by 1,571
Macmillan, N. A., & Creelman, C. D. (2004) · doi:10.4324/9781410611147 · Cited by 1,269
Understanding the Hawthorne effect
Sedgwick, P., & Greenwood, N. (2015) · BMJ · doi:10.1136/bmj.h4672 · Cited by 824 · cited 1×
“Secondly, the participants of the present study were aware that the test was a simulation and that no real AI technology was involved; therefore, we cannot rule out that they may have changed their behaviour because of the attention they received [29] and because of the absence of implications for patients.”
BackgroundErdmann, F., Lortet‐Tieulent, J., Schüz, J., Zeeb, H., Greinert, R., Breitbart, E. W., & Bray, F. (2013) · International Journal of Cancer · doi:10.1002/ijc.27616 · Cited by 627
Do as AI say: susceptibility in deployment of clinical decision-aids
Gaube, S., Suresh, H., Raue, M., Merritt, A., Berkowitz, S. J., Lermer, E., Coughlin, J. F., Guttag, J. V., Colak, E., & Ghassemi, M. (2021) · npj Digital Medicine · doi:10.1038/s41746-021-00385-9 · Cited by 543 · cited 1×
“These findings are in alignment with previous studies [28] suggesting that over-reliance on automated systems may be triggered by confirmatory bias when participants direct their attention towards features consistent with the (inaccurate) advice.”
ResultFarmer, E. R., Gonin, R., & Hanna, M. P. (1996) · Human Pathology · doi:10.1016/s0046-8177(96)90157-4 · Cited by 440
Freeman, K., Dinnes, J., Chuchu, N., Takwoingi, Y., Bayliss, S. E., Matin, R. N., Jain, A., Walter, F. M., Williams, H. C., & Deeks, J. J. (2020) · BMJ · doi:10.1136/bmj.m127 · Cited by 260
Phillips, M., Marsden, H., Jaffe, W., Matin, R. N., Wali, G. N., Greenhalgh, J., McGrath, E., James, R., Ladoyanni, E., Bewley, A., et al. (2019) · JAMA Network Open · doi:10.1001/jamanetworkopen.2019.13436 · Cited by 223
Artificial Intelligence in Healthcare: Recent Applications and Developments
(2022) · Brain Informatics and Health · doi:10.1007/978-981-19-5272-2 · Cited by 173
Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma
Chuchu, N., Takwoingi, Y., Dinnes, J., Matin, R. N., Bassett, O., Moreau, J. F., Bayliss, S. E., Davenport, C., Godfrey, K., O'Connell, S., et al. (2018) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd013192 · Cited by 144
Welcoming new guidelines for AI clinical research
Topol, E. J. (2020) · Nature Medicine · doi:10.1038/s41591-020-1042-x · Cited by 135
Artificial intelligence systems for complex decision-making in acute care medicine: a review
Lynn, L. A. (2019) · Patient Safety in Surgery · doi:10.1186/s13037-019-0188-2 · Cited by 100
Phillips, M., Greenhalgh, J., Marsden, H., & Palamaras, I. (2019) · Dermatology Practical & Conceptual · doi:10.5826/dpc.1001a11 · Cited by 69
Melanoma Early Detection: Big Data, Bigger Picture
Petrie, T. C., Samatham, R. V., Witkowski, A. M., Esteva, A., & Leachman, S. A. (2018) · Journal of Investigative Dermatology · doi:10.1016/j.jid.2018.06.187 · Cited by 65
Artificial intelligence for melanoma diagnosis: how can we deliver on the promise?
Mar, V. J., & Soyer, H. P. (2018) · Annals of Oncology · doi:10.1093/annonc/mdy193 · Cited by 37
Does Explainable Artificial Intelligence Improve Human Decision-Making?
Alufaisan, Y., Marusich, L. R., Bakdash, J. Z., Zhou, Y., & Kantarcioglu, M. (2020) · doi:10.31234/osf.io/d4r9t · Cited by 30
Automated decision support in melanocytic lesion management
Gilmore, S. J. (2018) · PLoS ONE · doi:10.1371/journal.pone.0203459 · Cited by 19
Augmented Intelligence in Dermatology: Fantasy or Future?
Kromenacker, B. W., Maarouf, M., & Shi, V. Y. (2019) · Dermatology · doi:10.1159/000497275 · Cited by 4
Cited by
Tun, H. M., Rahman, H. A., Naing, L., & Malik, O. A. (2025) · Journal of Medical Internet Research · doi:10.2196/69678 · Cited by 210
“Micocci et al [22] noted that AI systems, like human clinicians, are inherently imperfect and should be designed to complement, not replace, the clinician’s holistic understanding of each clinical scenario.”
InfluentialTerry, A. L., Kueper, J. K., Beleno, R., Brown, J. B., Cejic, S., Dang, J., Leger, D., McKay, S., Meredith, L., Pinto, A. D., et al. (2022) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-022-01984-6 · Cited by 64
Quantifying the impact of AI recommendations with explanations on prescription decision making
Nagendran, M., Festor, P., Komorowski, M., Gordon, A. C., & Faisal, A. A. (2023) · npj Digital Medicine · doi:10.1038/s41746-023-00955-z · Cited by 80
Zhou, J., Zhang, J., Wan, R., Cui, X., Liu, Q., Guo, H., Shi, X., Fu, B., Meng, J., Yue, B., et al. (2025) · BMC Medical Education · doi:10.1186/s12909-025-06916-2 · Cited by 73
Rezaeian, O., Bayrak, A. E., & Asan, O. (2026) · International Journal of Human–Computer Interaction · doi:10.1080/10447318.2025.2539458 · Cited by 39
Metadata
- Authors
- Micocci, M., Borsci, S., Thakerar, V., Walne, S., Manshadi, Y., Edridge, F., Mullarkey, D., Buckle, P., & Hanna, G. B.
- Affiliations
- National Institute for Health and Care Research (GB)
- Imperial College London (GB)
- British Association of Dermatologists (GB)
- Skin Analytics Limited, London EC2A 4PS, UK
- Corresponding author
- Micocci, Massimo
- Venue
- Journal of Clinical Medicine
- Publisher
- MDPI AG
- Published
- 2021-07-14
- Volume
- 10
- Issue
- 14
- Pages
- 3101
- ISSN
- 2077-0383 (ISSN-L)
- PMC
- PMC8303875
- OpenAlex
- W3179833988
- Cited by
- 39
- References
- 22
- Citations by year
- 2026: 10 · 2025: 13 · 2024: 6 · 2023: 6 · 2022: 4
- FWCI
- 1.17
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Journal of Clinical Medicine (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- University of Twente Research Information (publishedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Spiral (Imperial College London) (submittedVersion, other-oa)
- University of Twente Research Information (submittedVersion, cc-by)
- Funders
- Innovate UK (25763)
- Topics
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Health Sciences › Medicine › Family Practice › Clinical Reasoning and Diagnostic Skills
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Keywords
- general practitioners, AI decision support, skin lesion diagnosis, diagnostic errors, clinical judgment, clinical decision-making
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.

