Perceived Trust and Professional Identity Threat in AI-Based Clinical Decision Support Systems: Scenario-Based Experimental Study on AI Process Design Features
Open accessThe DOI matches its Crossref record; 65 of the 65 references it cites were found in a registry or an index.
Abstract
Background: Artificial intelligence (AI)–based systems in medicine like clinical decision support systems (CDSSs) have shown promising results in health care, sometimes outperforming human specialists. However, the integration of AI may challenge medical professionals’ identities and lead to limited trust in technology, resulting in health care professionals rejecting AI-based systems. Objective: This study aims to explore the impact of AI process design features on physicians’ trust in the AI solution and on perceived threats to their professional identity. These design features involve the explainability of AI-based CDSS decision outcomes, the integration depth of the AI-generated advice into the clinical workflow, and the physician’s accountability for the AI system-induced medical decisions. Methods: We conducted a 3-factorial web-based between-subject scenario-based experiment with 292 medical students in their medical training and experienced physicians across different specialties. The participants were presented with an AI-based CDSS for sepsis prediction and prevention for use in a hospital. Each participant was given a scenario in which the 3 design features of the AI-based CDSS were manipulated in a 2×2×2 factorial design. SPSS PROCESS (IBM Corp) macro was used for hypothesis testing. Results: The results suggest that the explainability of the AI-based CDSS was positively associated with both trust in the AI system (β=.508; P<.001) and professional identity threat perceptions (β=.351; P=.02). Trust in the AI system was found to be negatively related to professional identity threat perceptions (β=–.138; P=.047), indicating a partially mediated effect on professional identity threat through trust. Deep integration of AI-generated advice into the clinical workflow was positively associated with trust in the system (β=.262; P=.009). The accountability of the AI-based decisions, that is, the system required a signature, was found to be positively associated with professional identity threat perceptions among the respondents (β=.339; P=.004). Conclusions: Our research highlights the role of process design features of AI systems used in medicine in shaping professional identity perceptions, mediated through increased trust in AI. An explainable AI-based CDSS and an AI-generated system advice, which is deeply integrated into the clinical workflow, reinforce trust, thereby mitigating perceived professional identity threats. However, explainable AI and individual accountability of the system directly exacerbate threat perceptions. Our findings illustrate the complex nature of the behavioral patterns of AI in health care and have broader implications for supporting the implementation of AI-based CDSSs in a context where AI systems may impact professional identity.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures




Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“AI may augment clinical decision-making and support more patient-centered workflows [27], but it may also fragment professional identity [28], diffuse accountability [29], and shift tasks according to technical feasibility rather than clinical value unless implementation is guided by human-centered design, governance, and clearly defined clinical oversight [30].”
From Role-Differentiated AI Competencies and Curriculum Implications for Health Professions Education: Qualitative Study (2026) · cites this paper as [28]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Perceived usefulness, perceived ease of use, and user acceptance of information technology
Davis, F. D. (1989) · MIS Quarterly · doi:10.2307/249008 · Cited by 68,483 · cited 1×
“For instance, the Technology Acceptance Model [14] delineates the key determinants shaping users’ attitudes and intentions toward adopting new workplace technology.”
Faul, F., Erdfelder, E., Lang, A.-G., & Buchner, A. (2007) · Behavior Research Methods · doi:10.3758/bf03193146 · Cited by 65,971 · cited 1×
“Thus, the cell sizes for the 8 treatments were large enough for this exploratory study (n 1 =29; n 2 =44; n 3 =41; n 4 =45; n 5 =31; n 6 =36; n 7 =42; and n 8 =24) [58,59].”
Preacher, K. J., & Hayes, A. F. (2008) · Behavior Research Methods · doi:10.3758/brm.40.3.879 · Cited by 34,117 · cited 2×
“We carried out bootstrapping to test the indirect effects with a sample size of 5000 and a 95% CI [67].”
Dermatologist-level classification of skin cancer with deep neural networks
Esteva, A., Kuprel, B., Novoa, R. A., Ko, J., Swetter, S. M., Blau, H. M., & Thrun, S. (2017) · Nature · doi:10.1038/nature21056 · Cited by 14,362 · cited 1×
“AI enables machines to process and analyze vast datasets independently [3], improving clinical outcomes in areas such as sepsis detection and error reduction [4,5].”
An integrative model of organizational trust
Mayer, R. C., Davis, J. H., & Schoorman, F. D. (1995) · The Academy of Management Review · doi:10.2307/258792 · Cited by 10,736 · cited 1×
“Trust denotes the degree to which an individual is willing to believe in or be vulnerable to the actions of another party [18].”
A very brief measure of the Big-Five personality domains
Gosling, S. D., Rentfrow, P. J., & Swann, W. B. (2003) · Journal of Research in Personality · doi:10.1016/s0092-6566(03)00046-1 · Cited by 8,307 · cited 1×
“Moreover, we have refined the estimation of the model by including other control variables, namely 5 personality dimensions: conscientiousness, extraversion, agreeableness, emotional stability, and openness to experience [68], as well as health care job tenure, and surgical specialties.”
Affect and Cognition Based Trust as Foundations for Interpersonal Cooperation in Organizations
McAllister, D. J. (1995) · Academy of Management Journal · doi:10.2307/256727 · Cited by 7,346 · cited 1×
“Empirical research has nuanced human trust in AI into the dimensions of cognitive and affective trust [50].”
Cohen, J. (1992) · Current Directions in Psychological Science · doi:10.1111/1467-8721.ep10768783 · Cited by 5,870
(2003) · International Journal of Electronic Commerce · doi:10.1080/10864415.2003.11044275 · Cited by 5,715
A Second Generation Little Jiffy
Kaiser, H. F. (1970) · Psychometrika · doi:10.1007/bf02291817 · Cited by 4,785 · cited 1×
“The EFA enabled all items to load on any factor, with the number of factors being defined by an eigenvalue larger than 1.00 [62].”
Influential
Research works printed but not linked: 2
- MöhlmannMZalmansonLHands on the wheel: Navigating algorithmic management and uber drivers' autonomy2017International Conference on Information Systems (ICIS 2017)December 10-13, 2017Seoul, South Korea
- Nunnally, JC, 1994, Psychometric Theory
Cited by
Research Progress on Sepsis Diagnosis and Monitoring Based on Omics Technologies: A Review
Jin, X., Shen, H., Zhou, P., Yang, J., Yang, S., Ni, H., Yu, Y., & Zhang, Z. (2025) · Diagnostics · doi:10.3390/diagnostics15222887 · Cited by 18
“Deep workflow integration improves clinician trust and outcome optimization [89,90].”
Not Ready for AI? Exploring Teachers’ Negative Attitudes Toward Artificial Intelligence
Țîru, L. G., Gherheș, V., Stoicov, I., & Stanici, M. (2025) · Societies · doi:10.3390/soc15120337 · Cited by 17
“These findings are supported by recent research showing that personal interactions with AI systems have a much stronger influence on perceived risk levels compared to professional or institutional use [73,74].”
Tinjauan Literatur Sistematis: Analisis Implementasi Kecerdasan Buatan untuk Verifikasi Dokumen
Azzahra, F. S. P., & Prianto, C. (2025) · Jurnal Ilmiah Sistem Informasi · doi:10.51903/kjjwk708 · Cited by 15
Trang, T. T. N., Thắng, P. C., & Vo, T. A. (2025) · Computers in Human Behavior Reports · doi:10.1016/j.chbr.2025.100774 · Cited by 13
Imran, M., & Lee, Y. (2026) · IEEE Access · doi:10.1109/access.2026.3656368 · Cited by 15
“Perceptions of fairness and trust are also shaped by professional identity and control; systems that undermine clinician autonomy or disrupt workflow encounter resistance even when quantitative metrics appear acceptable [145].”
Metadata
- Authors
- Ackerhans, S., Wehkamp, K., Petzina, R., Dumitrescu, D., & Schultz, C.
- Affiliations
- Christian-Albrechts-Universität zu Kiel (DE)
- MSH Medical School Hamburg – University of Applied Sciences and Medical University (DE)
- Bielefeld University (DE)
- Corresponding author
- Ackerhans, Sophia
- Venue
- JMIR Formative Research
- Publisher
- JMIR Publications Inc.
- Published
- 2025-03-26
- Volume
- 9
- Pages
- e64266
- ISSN
- 2561-326X (ISSN-L)
- PMC
- PMC11982750
- OpenAlex
- W4408852197
- Cited by
- 38
- References
- 65
- Citations by year
- 2026: 33 · 2025: 5
- FWCI
- 9.08
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- JMIR Formative Research (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Topics
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Health Sciences › Health Professions › Health Information Management › Electronic Health Records Systems
- Keywords
- trust in AI, clinical decision support systems, explainable AI, clinical workflow integration, physician accountability, sepsis prediction, AI adoption in healthcare, AI-generated medical advice
- MeSH terms
- Adult, Artificial Intelligence, Attitude of Health Personnel, Female, Humans, Male, Physicians, Students, Medical, Decision Support Systems, Clinical, Trust, Young Adult
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.