The DOI matches its Crossref record; 46 of the 46 references it cites were found in a registry or an index.
Cognitive Friction in Clinical Decision Support: A Comparative Study of Judicial and Adjunct Human-AI Interaction Protocols
Open accessAbstract
Artificial intelligence is increasingly used to support clinical decision making, yet concerns remain regarding algorithmic aversion, automation bias and the preservation of meaningful human oversight; while explainable AI aims to improve transparency, less attention has been devoted to the design of human–AI interaction protocols. This study investigates Frictional AI, an interaction paradigm that introduces cognitive friction to encourage critical engagement with AI recommendations. First, semi-structured interviews were conducted with a legal expert and a psychologist and analyzed through thematic analysis to identify legal, ethical, and cognitive requirements for AI-assisted decision support. Second, a user study involving 96 medical residents compared three interaction protocols: a conventional explainable AI-first design (XAI) and two friction-based protocols, namely a judicial protocol based on juxtaposed explanations (Judicial AI, JAI) and an adjunct protocol requiring an initial unsupported decision before AI exposure (AAI). Diagnostic accuracy and confidence, perceived usefulness, completion time, and reliance patterns were evaluated. The interviews highlighted the importance of human-centered explanations, contrastive reasoning, preservation of professional responsibility, and the role of user studies in evaluating human–AI interaction. The quantitative results showed that none of the AI-assisted conditions improved diagnostic accuracy relative to the no-support baseline. However, JAI achieved performance comparable to the baseline, outperforming XAI and AAI, and exhibited the lowest level of over-reliance. Overall findings suggest that the effectiveness of decision-support systems depends not only on model performance and explanation quality but also on interaction design. In conclusion, while preserving diagnostic performance, judicial protocols showed promise in mitigating automation bias and promoting active cognitive engagement in clinical decision support.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
A Unified Approach to Interpreting Model Predictions
Lundberg, S., & Lee, S.-I. (2017) · arXiv · doi:10.48550/arxiv.1705.07874 · Cited by 23,707
Sample Size in Qualitative Interview Studies: Guided by Information Power
Malterud, K., Siersma, V. D., & Guassora, A. D. (2016) · Qualitative Health Research · doi:10.1177/1049732315617444 · Cited by 12,703 · cited 1×
“Although only two experts were interviewed, the sample size is consistent with the concept of information power [46], according to which smaller samples may be sufficient when the study aim is narrow, participants possess highly relevant expertise, and the collected data are rich and focused.”
Confirmation Bias: A Ubiquitous Phenomenon in Many Guises
Nickerson, R. S. (1998) · Review of General Psychology · doi:10.1037/1089-2680.2.2.175 · Cited by 7,267 · cited 3×
“The psychology expert raised concerns that numerical probabilities and complex SHAP plots may be difficult to integrate cognitively and could trigger biases such as confirmation bias [56] or base-rate neglect [33].”
Explanation in artificial intelligence: Insights from the social sciences
Miller, T. (2019) · Artificial Intelligence · doi:10.1016/j.artint.2018.07.007 · Cited by 5,302 · cited 1×
“As discussed by Miller [57], contrastivity is a fundamental characteristic of human reasoning and human-generated explanations and constitutes the foundation of both the established field of counterfactual explanations [58–60] and the more recent field of contrastive explanations [60–62].”
GPOWER: A general power analysis program
Erdfelder, E., Faul, F., & Buchner, A. (1996) · Behavior Research Methods, Instruments, & Computers · doi:10.3758/bf03203630 · Cited by 4,864 · cited 1×
“1) [52] was used to perform sample size calculations.”
Algorithm aversion: People erroneously avoid algorithms after seeing them err.
Dietvorst, B. J., Simmons, J. P., & Massey, C. (2015) · Journal of Experimental Psychology: General · doi:10.1037/xge0000033 · Cited by 3,232 · cited 2×
“This lack of transparency has contributed to widespread skepticism toward AI-assisted decision making, a phenomenon known as algorithmic aversion [6].”
The Honest Broker: Making Sense of Science in Policy and Politics
Pielke, Jr. (2007) · doi:10.1017/cbo9780511818110 · Cited by 2,020
Complacency and Bias in Human Use of Automation: An Attentional Integration
Parasuraman, R., & Manzey, D. H. (2010) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720810376055 · Cited by 1,710 · cited 4×
“…expert emphasized that responsibility remains primarily with clinicians and healthcare institutions, despite the growing use of AI support and the consequent tendency of automation complacency [23,25] and medical deresponsibilization [26], in which users tend to defer responsibility to machines.”
InfluentialLekadir, K., Frangi, A. F., Porras, A. R., Glocker, B., Cintas, C., Langlotz, C. P., Weicken, E., Asselbergs, F. W., Prior, F., Collins, G. S., et al. (2025) · BMJ · doi:10.1136/bmj-2024-081554 · Cited by 957 · cited 4×
“…governance frameworks that ensure compliance with emerging regulations, robust data governance, continuous risk management, and meaningful human oversight throughout the AI life cycle, such as the European AI Act [9], the NIST AI Risk Management Framework [14], and the FUTURE-AI guidelines [15].”
InfluentialUsing thematic analysis in qualitative research
Ahmed, S. K., Mohammed, R. A., Nashwan, A. J., Ibrahim, R. H., Abdalla, A. Q., M. Ameen, B. M., & Khdhir, R. M. (2025) · Journal of Medicine, Surgery, and Public Health · doi:10.1016/j.glmedi.2025.100198 · Cited by 769 · cited 1×
“Data from the transcriptions of the interviews were analyzed using thematic analysis following the six-phase framework proposed by Braun and Clarke [47].”
Research works printed but not linked: 5
- IEEE Global Initiative on Ethics of Autonomous and Intelligent Systems (2019). Ethically Aligned Design: A Vision for Prioritizing Human Well-Being with Autonomous and Intelligent Systems, IEEE Standards Association.
- Natali, C. (2023). Per Aspera ad Astra, or Flourishing via Friction: Stimulating Cognitive Activation by Design through Frictional Decision Support Systems. CHItaly-DC 2023 CHItaly 2023 Doctoral Consortium CHItaly 2023 Proceedings of the Doctoral Consortium of the 15th Biannual Conference of the Italian SIGCHI Chapter (CHItaly 2023), CEUR-WS.
- Norman, D.A. (2011). Living with Complexity, MIT Press.
- Nicora, G., Tito, A.L., Donatelli, A., Callea, G., Biasibetti, C., Galli, M.V., Comotto, F., Bortolotto, C., Perlini, S., and Preda, L. (2021, January 29). ALFABETO: Supporting COVID-19 hospital admissions with Bayesian Networks. Proceedings of the Workshop on Towards Smarter Health Care: Can Artificial Intelligence Help? co-located with 20th International Conference of the Italian Association for Artificial Intelligence (AIxIA2021), Online Event.
- Moens, M.F., Huang, X., Specia, L., and Yih, S.W.T. (2021). Contrastive Explanations for Model Interpretability. Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, Association for Computational Linguistics.
Metadata
- Authors
- Pe, S., Bergomi, L., Nicora, G., Simonelli, C. A., Kour, P., Diaz, E., Alendal, G., Hernáiz Ferrer, A. I., Corso, V., Bortolotto, C., Zuccaro, V., Salinaro, F., Preda, L., & Parimbelli, E.
- Affiliations
- University of Pavia (IT)
- University of Bergen (NO)
- Department of Global Public Health and Primary Care, Faculty of Medicine, University of Bergen, 5009 Bergen, Norway
- Department of Radiology, IRCCS Policlinic San Matteo Foundation, 27100 Pavia, Italy
- University of Ottawa (CA)
- Corresponding author
- Pe, Samuele
- Parimbelli, Enea
- ORCID
- Venue
- Machine Learning and Knowledge Extraction
- Publisher
- MDPI AG
- Published
- 2026-07-22
- Volume
- 8
- Issue
- 7
- Pages
- 216
- ISSN
- 2504-4990 (ISSN-L)
- OpenAlex
- W7170090355
- Cited by
- 0
- References
- 42
- FWCI
- 0.00
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Machine Learning and Knowledge Extraction (publishedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- Funders
- Italian Ministry of Research (PNC0000007)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Social Sciences › Human Factors and Ergonomics › Human-Automation Interaction and Safety
- Keywords
- clinical decision support, human-AI interaction, cognitive friction, explainable AI, automation bias, algorithmic aversion, overreliance on AI, diagnostic accuracy, medical residents, interaction design, contrastive reasoning, professional responsibility
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.